2023-10-05T11:17:19.209 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-10-05T11:17:19.209 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --owner scheduled_prsrivas@teuthology --name prsrivas-2023-10-05_05:12:08-rgw-wip-rgw-d3n-filter-distro-default-smithi --description rgw/verify/{0-install clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec-profile s3tests-branch sharding$/{default} striping$/{stripe-equals-chunk} supported-random-distro$/{centos_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/valgrind} --archive /home/teuthworker/archive/prsrivas-2023-10-05_05:12:08-rgw-wip-rgw-d3n-filter-distro-default-smithi/7411331 -- /home/teuthworker/archive/prsrivas-2023-10-05_05:12:08-rgw-wip-rgw-d3n-filter-distro-default-smithi/7411331/orig.config.yaml 2023-10-05T11:17:19.251 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-05T11:17:19.336 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/prsrivas-2023-10-05_05:12:08-rgw-wip-rgw-d3n-filter-distro-default-smithi/7411331 branch: wip-rgw-d3n-filter description: rgw/verify/{0-install clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec-profile s3tests-branch sharding$/{default} striping$/{stripe-equals-chunk} supported-random-distro$/{centos_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/valgrind} email: null first_in_suite: false job_id: '7411331' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: prsrivas-2023-10-05_05:12:08-rgw-wip-rgw-d3n-filter-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 10 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-rgw-d3n-filter ceph: conf: client: debug rgw: 20 debug rgw_datacache: 30 rgw crypt require ssl: false rgw crypt s3 kms backend: testing rgw crypt s3 kms encryption keys: testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= rgw d3n l1 datacache persistent path: /tmp/rgw_datacache/ rgw d3n l1 datacache size: 10737418240 rgw d3n l1 local datacache enabled: true rgw enable ops log: true rgw filter: d3n rgw torrent flag: true setgroup: ceph setuser: ceph global: mon client directed command retry: 5 ms inject socket failures: 5000 osd heartbeat grace: 40 osd_max_pg_log_entries: 10 osd_min_pg_log_entries: 10 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon osd crush smoke test: false osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd fast shutdown: false osd objectstore: bluestore osd shutdown pgref assert: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) - \(POOL_APP_NOT_ENABLED\) - not have an application enabled - \(OSD_SLOW_PING_TIME sha1: 38321be854743c0d616618a9ea8aa0b1d4dbc0bf ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 38321be854743c0d616618a9ea8aa0b1d4dbc0bf rgw: client.0: valgrind: - --tool=memcheck - --max-threads=1024 compression type: random datacache: true datacache_path: /tmp/rgw_datacache ec-data-pool: true erasure_code_profile: crush-failure-domain: osd k: 3 m: 1 name: testprofile frontend: beast inline data: false storage classes: LUKEWARM, FROZEN s3tests: force-branch: ceph-master slow_backend: true storage classes: LUKEWARM, FROZEN thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-rgw-d3n-filter sha1: 38321be854743c0d616618a9ea8aa0b1d4dbc0bf owner: scheduled_prsrivas@teuthology priority: 80 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - node-exporter.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - node-exporter.b seed: 1815 sha1: 38321be854743c0d616618a9ea8aa0b1d4dbc0bf sleep_before_teardown: 0 suite: rgw suite_branch: wip-rgw-d3n-filter suite_path: /home/teuthworker/src/github.com_pritha-srivastava_ceph_38321be854743c0d616618a9ea8aa0b1d4dbc0bf/qa suite_relpath: qa suite_repo: https://github.com/pritha-srivastava/ceph.git suite_sha1: 38321be854743c0d616618a9ea8aa0b1d4dbc0bf targets: smithi012.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOgpaICNFfRxogNOB1i4tMaInC0z15nTSYr/P8xvHQ1AjjbvbYvsm/lWaVc06ueeus3uSz5dpKMDJLOwS1avFlU= smithi170.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBB/H8rPW3MDhFqeKPJsSAROqZ831G4Rq11eVY8UEeLVxXTN+Z2dtdc/8h4OZaWZ14amxLi+t2MIT3oivt6/xT0U= tasks: - install: extra_system_packages: deb: - s3cmd rpm: - s3cmd - ceph: null - openssl_keys: null - rgw: client.0: null - tox: - client.0 - workunit: clients: client.0: - rgw/run-datacache.sh env: RGW_DATACACHE_PATH: /tmp/rgw_datacache - workunit: clients: client.0: - rgw/run-bucket-check.sh - workunit: clients: client.0: - cls/test_cls_lock.sh - cls/test_cls_log.sh - cls/test_cls_refcount.sh - cls/test_cls_rgw.sh - cls/test_cls_rgw_gc.sh - cls/test_cls_rgw_stats.sh - cls/test_cls_cmpomap.sh - cls/test_cls_2pc_queue.sh - rgw/test_rgw_gc_log.sh - rgw/test_rgw_obj.sh - rgw/test_librgw_file.sh - workunit: clients: client.0: - rgw/test_rgw_s3_mp_reupload.sh - ragweed: client.0: default-branch: ceph-master rgw_server: client.0 stages: prepare,check - workunit: clients: client.0: - rgw/run-reshard.sh - s3tests-java: client.0: force-branch: ceph-master force-repo: https://github.com/ceph/java_s3tests.git - s3tests: client.0: rgw_server: client.0 - workunit: clients: client.0: - rgw/run-versioning.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 54e62bcbac4e53d9685e08328b790d3b20d71cae timestamp: 2023-10-05_05:12:08 tube: smithi user: prsrivas verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2830 2023-10-05T11:17:19.337 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_pritha-srivastava_ceph_38321be854743c0d616618a9ea8aa0b1d4dbc0bf/qa; will attempt to use it 2023-10-05T11:17:19.337 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_pritha-srivastava_ceph_38321be854743c0d616618a9ea8aa0b1d4dbc0bf/qa/tasks 2023-10-05T11:17:19.337 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-10-05T11:17:19.339 INFO:teuthology.task.internal:Checking packages... 2023-10-05T11:17:19.359 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '38321be854743c0d616618a9ea8aa0b1d4dbc0bf' 2023-10-05T11:17:19.359 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-10-05T11:17:19.359 INFO:teuthology.packaging:ref: None 2023-10-05T11:17:19.359 INFO:teuthology.packaging:tag: None 2023-10-05T11:17:19.359 INFO:teuthology.packaging:branch: wip-rgw-d3n-filter 2023-10-05T11:17:19.359 INFO:teuthology.packaging:sha1: 38321be854743c0d616618a9ea8aa0b1d4dbc0bf 2023-10-05T11:17:19.360 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-rgw-d3n-filter 2023-10-05T11:17:19.588 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-6543.g38321be8 2023-10-05T11:17:19.589 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-10-05T11:17:19.594 INFO:teuthology.task.internal:no buildpackages task found 2023-10-05T11:17:19.594 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-10-05T11:17:19.659 INFO:teuthology.task.internal:Saving configuration 2023-10-05T11:17:19.799 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-10-05T11:17:20.055 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-05T11:17:20.084 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi012.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/prsrivas-2023-10-05_05:12:08-rgw-wip-rgw-d3n-filter-distro-default-smithi/7411331', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-05 11:12:14.457989', 'locked_by': 'scheduled_prsrivas@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOgpaICNFfRxogNOB1i4tMaInC0z15nTSYr/P8xvHQ1AjjbvbYvsm/lWaVc06ueeus3uSz5dpKMDJLOwS1avFlU='} 2023-10-05T11:17:20.108 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi170.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/prsrivas-2023-10-05_05:12:08-rgw-wip-rgw-d3n-filter-distro-default-smithi/7411331', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-05 11:12:14.459554', 'locked_by': 'scheduled_prsrivas@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBB/H8rPW3MDhFqeKPJsSAROqZ831G4Rq11eVY8UEeLVxXTN+Z2dtdc/8h4OZaWZ14amxLi+t2MIT3oivt6/xT0U='} 2023-10-05T11:17:20.109 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-10-05T11:17:20.217 INFO:teuthology.task.internal:roles: ubuntu@smithi012.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2023-10-05T11:17:20.217 INFO:teuthology.task.internal:roles: ubuntu@smithi170.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2023-10-05T11:17:20.217 INFO:teuthology.run_tasks:Running task console_log... 2023-10-05T11:17:20.361 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f832339aee0>, signals=[15]) 2023-10-05T11:17:20.362 INFO:teuthology.run_tasks:Running task internal.connect... 2023-10-05T11:17:20.368 INFO:teuthology.task.internal:Opening connections... 2023-10-05T11:17:20.368 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi012.front.sepia.ceph.com 2023-10-05T11:17:20.370 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-05T11:17:20.472 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi170.front.sepia.ceph.com 2023-10-05T11:17:20.472 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-05T11:17:20.557 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-10-05T11:17:20.563 DEBUG:teuthology.orchestra.run.smithi012:> uname -m 2023-10-05T11:17:20.581 INFO:teuthology.orchestra.run.smithi012.stdout:x86_64 2023-10-05T11:17:20.581 DEBUG:teuthology.orchestra.run.smithi012:> cat /etc/os-release 2023-10-05T11:17:20.637 INFO:teuthology.orchestra.run.smithi012.stdout:NAME="CentOS Stream" 2023-10-05T11:17:20.638 INFO:teuthology.orchestra.run.smithi012.stdout:VERSION="9" 2023-10-05T11:17:20.638 INFO:teuthology.orchestra.run.smithi012.stdout:ID="centos" 2023-10-05T11:17:20.638 INFO:teuthology.orchestra.run.smithi012.stdout:ID_LIKE="rhel fedora" 2023-10-05T11:17:20.638 INFO:teuthology.orchestra.run.smithi012.stdout:VERSION_ID="9" 2023-10-05T11:17:20.638 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM_ID="platform:el9" 2023-10-05T11:17:20.638 INFO:teuthology.orchestra.run.smithi012.stdout:PRETTY_NAME="CentOS Stream 9" 2023-10-05T11:17:20.638 INFO:teuthology.orchestra.run.smithi012.stdout:ANSI_COLOR="0;31" 2023-10-05T11:17:20.638 INFO:teuthology.orchestra.run.smithi012.stdout:LOGO="fedora-logo-icon" 2023-10-05T11:17:20.639 INFO:teuthology.orchestra.run.smithi012.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-10-05T11:17:20.639 INFO:teuthology.orchestra.run.smithi012.stdout:HOME_URL="https://centos.org/" 2023-10-05T11:17:20.639 INFO:teuthology.orchestra.run.smithi012.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-05T11:17:20.639 INFO:teuthology.orchestra.run.smithi012.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-10-05T11:17:20.639 INFO:teuthology.orchestra.run.smithi012.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-05T11:17:20.639 INFO:teuthology.lock.ops:Updating smithi012.front.sepia.ceph.com on lock server 2023-10-05T11:17:20.661 DEBUG:teuthology.orchestra.run.smithi170:> uname -m 2023-10-05T11:17:20.677 INFO:teuthology.orchestra.run.smithi170.stdout:x86_64 2023-10-05T11:17:20.677 DEBUG:teuthology.orchestra.run.smithi170:> cat /etc/os-release 2023-10-05T11:17:20.734 INFO:teuthology.orchestra.run.smithi170.stdout:NAME="CentOS Stream" 2023-10-05T11:17:20.734 INFO:teuthology.orchestra.run.smithi170.stdout:VERSION="9" 2023-10-05T11:17:20.734 INFO:teuthology.orchestra.run.smithi170.stdout:ID="centos" 2023-10-05T11:17:20.734 INFO:teuthology.orchestra.run.smithi170.stdout:ID_LIKE="rhel fedora" 2023-10-05T11:17:20.734 INFO:teuthology.orchestra.run.smithi170.stdout:VERSION_ID="9" 2023-10-05T11:17:20.734 INFO:teuthology.orchestra.run.smithi170.stdout:PLATFORM_ID="platform:el9" 2023-10-05T11:17:20.734 INFO:teuthology.orchestra.run.smithi170.stdout:PRETTY_NAME="CentOS Stream 9" 2023-10-05T11:17:20.735 INFO:teuthology.orchestra.run.smithi170.stdout:ANSI_COLOR="0;31" 2023-10-05T11:17:20.735 INFO:teuthology.orchestra.run.smithi170.stdout:LOGO="fedora-logo-icon" 2023-10-05T11:17:20.735 INFO:teuthology.orchestra.run.smithi170.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-10-05T11:17:20.735 INFO:teuthology.orchestra.run.smithi170.stdout:HOME_URL="https://centos.org/" 2023-10-05T11:17:20.735 INFO:teuthology.orchestra.run.smithi170.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-05T11:17:20.735 INFO:teuthology.orchestra.run.smithi170.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-10-05T11:17:20.735 INFO:teuthology.orchestra.run.smithi170.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-05T11:17:20.735 INFO:teuthology.lock.ops:Updating smithi170.front.sepia.ceph.com on lock server 2023-10-05T11:17:20.760 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-10-05T11:17:20.769 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-10-05T11:17:20.773 INFO:teuthology.task.internal:Checking for old test directory... 2023-10-05T11:17:20.773 DEBUG:teuthology.orchestra.run.smithi012:> test '!' -e /home/ubuntu/cephtest 2023-10-05T11:17:20.775 DEBUG:teuthology.orchestra.run.smithi170:> test '!' -e /home/ubuntu/cephtest 2023-10-05T11:17:20.790 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-10-05T11:17:20.796 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-10-05T11:17:20.796 DEBUG:teuthology.orchestra.run.smithi012:> test -z $(ls -A /var/lib/ceph) 2023-10-05T11:17:20.833 DEBUG:teuthology.orchestra.run.smithi170:> test -z $(ls -A /var/lib/ceph) 2023-10-05T11:17:20.932 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-10-05T11:17:20.978 INFO:teuthology.run_tasks:Running task kernel... 2023-10-05T11:17:20.996 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2023-10-05T11:17:20.996 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2023-10-05T11:17:20.997 DEBUG:teuthology.orchestra.run.smithi012:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-05T11:17:20.997 DEBUG:teuthology.orchestra.run.smithi170:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-05T11:17:21.014 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-05T11:17:21.014 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-05T11:17:21.014 DEBUG:teuthology.orchestra.run.smithi170:> uname -r 2023-10-05T11:17:21.015 DEBUG:teuthology.orchestra.run.smithi012:> uname -r 2023-10-05T11:17:21.071 INFO:teuthology.orchestra.run.smithi012.stdout:5.14.0-361.el9.x86_64 2023-10-05T11:17:21.072 INFO:teuthology.task.kernel:Running kernel on smithi012: 5.14.0-361.el9.x86_64 2023-10-05T11:17:21.072 DEBUG:teuthology.orchestra.run.smithi012:> sudo yum install -y kernel 2023-10-05T11:17:21.073 INFO:teuthology.orchestra.run.smithi170.stdout:5.14.0-361.el9.x86_64 2023-10-05T11:17:21.073 INFO:teuthology.task.kernel:Running kernel on smithi170: 5.14.0-361.el9.x86_64 2023-10-05T11:17:21.073 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum install -y kernel 2023-10-05T11:17:23.469 INFO:teuthology.orchestra.run.smithi012.stdout:CentOS-9 - AppStream 7.8 MB/s | 6.3 MB 00:00 2023-10-05T11:17:23.477 INFO:teuthology.orchestra.run.smithi170.stdout:CentOS-9 - AppStream 8.0 MB/s | 6.3 MB 00:00 2023-10-05T11:17:24.910 INFO:teuthology.orchestra.run.smithi012.stdout:CentOS-9 - BaseOS 5.8 MB/s | 2.0 MB 00:00 2023-10-05T11:17:25.086 INFO:teuthology.orchestra.run.smithi170.stdout:CentOS-9 - BaseOS 3.4 MB/s | 2.0 MB 00:00 2023-10-05T11:17:27.212 INFO:teuthology.orchestra.run.smithi012.stdout:CentOS Stream 9 - BaseOS 4.0 MB/s | 7.9 MB 00:01 2023-10-05T11:17:28.960 INFO:teuthology.orchestra.run.smithi170.stdout:CentOS Stream 9 - BaseOS 2.2 MB/s | 7.9 MB 00:03 2023-10-05T11:17:30.926 INFO:teuthology.orchestra.run.smithi012.stdout:CentOS Stream 9 - AppStream 6.6 MB/s | 18 MB 00:02 2023-10-05T11:17:32.811 INFO:teuthology.orchestra.run.smithi170.stdout:CentOS Stream 9 - AppStream 6.2 MB/s | 18 MB 00:02 2023-10-05T11:17:36.468 INFO:teuthology.orchestra.run.smithi012.stdout:CentOS Stream 9 - CRB 2.8 MB/s | 5.7 MB 00:02 2023-10-05T11:17:36.720 INFO:teuthology.orchestra.run.smithi170.stdout:CentOS Stream 9 - CRB 9.1 MB/s | 5.7 MB 00:00 2023-10-05T11:17:37.769 INFO:teuthology.orchestra.run.smithi012.stdout:CentOS Stream 9 - Extras packages 73 kB/s | 14 kB 00:00 2023-10-05T11:17:38.179 INFO:teuthology.orchestra.run.smithi170.stdout:CentOS Stream 9 - Extras packages 35 kB/s | 14 kB 00:00 2023-10-05T11:17:39.703 INFO:teuthology.orchestra.run.smithi012.stdout:Extra Packages for Enterprise Linux 10 MB/s | 19 MB 00:01 2023-10-05T11:17:40.382 INFO:teuthology.orchestra.run.smithi170.stdout:Extra Packages for Enterprise Linux 9.1 MB/s | 19 MB 00:02 2023-10-05T11:17:44.278 INFO:teuthology.orchestra.run.smithi012.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2023-10-05T11:17:44.896 INFO:teuthology.orchestra.run.smithi170.stdout:lab-extras 12 kB/s | 1.7 kB 00:00 2023-10-05T11:17:46.384 INFO:teuthology.orchestra.run.smithi012.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2023-10-05T11:17:46.993 INFO:teuthology.orchestra.run.smithi012.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2023-10-05T11:17:46.994 INFO:teuthology.orchestra.run.smithi170.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2023-10-05T11:17:46.994 INFO:teuthology.orchestra.run.smithi170.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2023-10-05T11:17:46.995 INFO:teuthology.orchestra.run.smithi012.stdout:Dependencies resolved. 2023-10-05T11:17:46.995 INFO:teuthology.orchestra.run.smithi012.stdout:================================================================================ 2023-10-05T11:17:46.995 INFO:teuthology.orchestra.run.smithi012.stdout: Package Arch Version Repository Size 2023-10-05T11:17:46.995 INFO:teuthology.orchestra.run.smithi012.stdout:================================================================================ 2023-10-05T11:17:46.995 INFO:teuthology.orchestra.run.smithi012.stdout:Installing: 2023-10-05T11:17:46.995 INFO:teuthology.orchestra.run.smithi012.stdout: kernel x86_64 5.14.0-372.el9 CentOS-BaseOS 5.2 M 2023-10-05T11:17:46.995 INFO:teuthology.orchestra.run.smithi012.stdout:Installing dependencies: 2023-10-05T11:17:46.996 INFO:teuthology.orchestra.run.smithi012.stdout: kernel-core x86_64 5.14.0-372.el9 CentOS-BaseOS 20 M 2023-10-05T11:17:46.996 INFO:teuthology.orchestra.run.smithi012.stdout: kernel-modules x86_64 5.14.0-372.el9 CentOS-BaseOS 37 M 2023-10-05T11:17:46.996 INFO:teuthology.orchestra.run.smithi012.stdout: kernel-modules-core x86_64 5.14.0-372.el9 CentOS-BaseOS 32 M 2023-10-05T11:17:46.996 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:17:46.996 INFO:teuthology.orchestra.run.smithi012.stdout:Transaction Summary 2023-10-05T11:17:46.996 INFO:teuthology.orchestra.run.smithi012.stdout:================================================================================ 2023-10-05T11:17:46.996 INFO:teuthology.orchestra.run.smithi012.stdout:Install 4 Packages 2023-10-05T11:17:46.996 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:17:46.996 INFO:teuthology.orchestra.run.smithi012.stdout:Total download size: 94 M 2023-10-05T11:17:46.997 INFO:teuthology.orchestra.run.smithi012.stdout:Installed size: 120 M 2023-10-05T11:17:46.997 INFO:teuthology.orchestra.run.smithi012.stdout:Downloading Packages: 2023-10-05T11:17:47.009 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2023-10-05T11:17:47.012 INFO:teuthology.orchestra.run.smithi012.stdout:(1/4): kernel-5.14.0-372.el9.x86_64.rpm 9.8 MB/s | 5.2 MB 00:00 2023-10-05T11:17:47.017 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2023-10-05T11:17:47.017 INFO:teuthology.orchestra.run.smithi170.stdout: Package Arch Version Repository Size 2023-10-05T11:17:47.017 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2023-10-05T11:17:47.017 INFO:teuthology.orchestra.run.smithi170.stdout:Installing: 2023-10-05T11:17:47.017 INFO:teuthology.orchestra.run.smithi170.stdout: kernel x86_64 5.14.0-372.el9 CentOS-BaseOS 5.2 M 2023-10-05T11:17:47.017 INFO:teuthology.orchestra.run.smithi170.stdout:Installing dependencies: 2023-10-05T11:17:47.017 INFO:teuthology.orchestra.run.smithi170.stdout: kernel-core x86_64 5.14.0-372.el9 CentOS-BaseOS 20 M 2023-10-05T11:17:47.017 INFO:teuthology.orchestra.run.smithi170.stdout: kernel-modules x86_64 5.14.0-372.el9 CentOS-BaseOS 37 M 2023-10-05T11:17:47.018 INFO:teuthology.orchestra.run.smithi170.stdout: kernel-modules-core x86_64 5.14.0-372.el9 CentOS-BaseOS 32 M 2023-10-05T11:17:47.018 INFO:teuthology.orchestra.run.smithi170.stdout: 2023-10-05T11:17:47.018 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction Summary 2023-10-05T11:17:47.018 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2023-10-05T11:17:47.018 INFO:teuthology.orchestra.run.smithi170.stdout:Install 4 Packages 2023-10-05T11:17:47.018 INFO:teuthology.orchestra.run.smithi170.stdout: 2023-10-05T11:17:47.019 INFO:teuthology.orchestra.run.smithi170.stdout:Total download size: 94 M 2023-10-05T11:17:47.019 INFO:teuthology.orchestra.run.smithi170.stdout:Installed size: 120 M 2023-10-05T11:17:47.019 INFO:teuthology.orchestra.run.smithi170.stdout:Downloading Packages: 2023-10-05T11:17:47.837 INFO:teuthology.orchestra.run.smithi012.stdout:(2/4): kernel-core-5.14.0-372.el9.x86_64.rpm 15 MB/s | 20 MB 00:01 2023-10-05T11:17:48.331 INFO:teuthology.orchestra.run.smithi170.stdout:(1/4): kernel-5.14.0-372.el9.x86_64.rpm 4.0 MB/s | 5.2 MB 00:01 2023-10-05T11:17:48.712 INFO:teuthology.orchestra.run.smithi012.stdout:(3/4): kernel-modules-core-5.14.0-372.el9.x86_6 19 MB/s | 32 MB 00:01 2023-10-05T11:17:49.303 INFO:teuthology.orchestra.run.smithi012.stdout:(4/4): kernel-modules-5.14.0-372.el9.x86_64.rpm 13 MB/s | 37 MB 00:02 2023-10-05T11:17:49.307 INFO:teuthology.orchestra.run.smithi012.stdout:-------------------------------------------------------------------------------- 2023-10-05T11:17:49.307 INFO:teuthology.orchestra.run.smithi012.stdout:Total 33 MB/s | 94 MB 00:02 2023-10-05T11:17:49.307 INFO:teuthology.orchestra.run.smithi012.stdout:Running transaction check 2023-10-05T11:17:49.754 INFO:teuthology.orchestra.run.smithi012.stdout:Transaction check succeeded. 2023-10-05T11:17:49.755 INFO:teuthology.orchestra.run.smithi012.stdout:Running transaction test 2023-10-05T11:17:49.889 INFO:teuthology.orchestra.run.smithi170.stdout:(2/4): kernel-modules-core-5.14.0-372.el9.x86_6 20 MB/s | 32 MB 00:01 2023-10-05T11:17:50.098 INFO:teuthology.orchestra.run.smithi170.stdout:(3/4): kernel-core-5.14.0-372.el9.x86_64.rpm 6.4 MB/s | 20 MB 00:03 2023-10-05T11:17:50.440 INFO:teuthology.orchestra.run.smithi170.stdout:(4/4): kernel-modules-5.14.0-372.el9.x86_64.rpm 11 MB/s | 37 MB 00:03 2023-10-05T11:17:50.443 INFO:teuthology.orchestra.run.smithi170.stdout:-------------------------------------------------------------------------------- 2023-10-05T11:17:50.443 INFO:teuthology.orchestra.run.smithi170.stdout:Total 28 MB/s | 94 MB 00:03 2023-10-05T11:17:50.443 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction check 2023-10-05T11:17:50.785 INFO:teuthology.orchestra.run.smithi012.stdout:Transaction test succeeded. 2023-10-05T11:17:50.785 INFO:teuthology.orchestra.run.smithi012.stdout:Running transaction 2023-10-05T11:17:50.797 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction check succeeded. 2023-10-05T11:17:50.798 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction test 2023-10-05T11:17:51.783 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction test succeeded. 2023-10-05T11:17:51.784 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction 2023-10-05T11:17:53.289 INFO:teuthology.orchestra.run.smithi012.stdout: Preparing : 1/1 2023-10-05T11:17:53.947 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : kernel-modules-core-5.14.0-372.el9.x86_64 1/4 2023-10-05T11:17:54.088 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : kernel-core-5.14.0-372.el9.x86_64 2/4 2023-10-05T11:17:54.162 INFO:teuthology.orchestra.run.smithi170.stdout: Preparing : 1/1 2023-10-05T11:17:54.791 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : kernel-modules-core-5.14.0-372.el9.x86_64 1/4 2023-10-05T11:17:54.907 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : kernel-core-5.14.0-372.el9.x86_64 2/4 2023-10-05T11:17:56.973 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: kernel-core-5.14.0-372.el9.x86_64 2/4 2023-10-05T11:17:57.175 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : kernel-modules-5.14.0-372.el9.x86_64 3/4 2023-10-05T11:17:57.619 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: kernel-core-5.14.0-372.el9.x86_64 2/4 2023-10-05T11:17:57.795 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : kernel-modules-5.14.0-372.el9.x86_64 3/4 2023-10-05T11:18:02.112 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: kernel-modules-5.14.0-372.el9.x86_64 3/4 2023-10-05T11:18:02.251 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : kernel-5.14.0-372.el9.x86_64 4/4 2023-10-05T11:18:02.380 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: kernel-modules-5.14.0-372.el9.x86_64 3/4 2023-10-05T11:18:02.479 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : kernel-5.14.0-372.el9.x86_64 4/4 2023-10-05T11:18:07.067 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: kernel-modules-core-5.14.0-372.el9.x86_64 4/4 2023-10-05T11:18:07.289 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: kernel-modules-core-5.14.0-372.el9.x86_64 4/4 2023-10-05T11:18:36.432 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: kernel-core-5.14.0-372.el9.x86_64 4/4 2023-10-05T11:18:36.478 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: kernel-modules-5.14.0-372.el9.x86_64 4/4 2023-10-05T11:18:36.887 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: kernel-5.14.0-372.el9.x86_64 4/4 2023-10-05T11:18:36.888 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : kernel-5.14.0-372.el9.x86_64 1/4 2023-10-05T11:18:36.888 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : kernel-core-5.14.0-372.el9.x86_64 2/4 2023-10-05T11:18:36.888 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : kernel-modules-5.14.0-372.el9.x86_64 3/4 2023-10-05T11:18:37.293 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : kernel-modules-core-5.14.0-372.el9.x86_64 4/4 2023-10-05T11:18:37.293 INFO:teuthology.orchestra.run.smithi170.stdout: 2023-10-05T11:18:37.293 INFO:teuthology.orchestra.run.smithi170.stdout:Installed: 2023-10-05T11:18:37.293 INFO:teuthology.orchestra.run.smithi170.stdout: kernel-5.14.0-372.el9.x86_64 2023-10-05T11:18:37.293 INFO:teuthology.orchestra.run.smithi170.stdout: kernel-core-5.14.0-372.el9.x86_64 2023-10-05T11:18:37.294 INFO:teuthology.orchestra.run.smithi170.stdout: kernel-modules-5.14.0-372.el9.x86_64 2023-10-05T11:18:37.294 INFO:teuthology.orchestra.run.smithi170.stdout: kernel-modules-core-5.14.0-372.el9.x86_64 2023-10-05T11:18:37.294 INFO:teuthology.orchestra.run.smithi170.stdout: 2023-10-05T11:18:37.294 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2023-10-05T11:18:37.771 DEBUG:teuthology.orchestra.run.smithi170:> rpm -q kernel | sort -rV | head -n 1 2023-10-05T11:18:37.774 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: kernel-core-5.14.0-372.el9.x86_64 4/4 2023-10-05T11:18:37.817 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: kernel-modules-5.14.0-372.el9.x86_64 4/4 2023-10-05T11:18:37.891 INFO:teuthology.orchestra.run.smithi170.stdout:kernel-5.14.0-372.el9.x86_64 2023-10-05T11:18:37.891 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-372.el9.x86_64 2023-10-05T11:18:37.891 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-372.el9.x86_64 2023-10-05T11:18:37.891 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-10-05T11:18:37.891 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-10-05T11:18:37.892 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2023-10-05T11:18:37.892 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi170.front.sepia.ceph.com, path=None, version=distro) 2023-10-05T11:18:37.892 DEBUG:teuthology.orchestra.run.smithi170:> rpm -q kernel | sort -rV | head -n 1 2023-10-05T11:18:37.996 INFO:teuthology.orchestra.run.smithi170.stdout:kernel-5.14.0-372.el9.x86_64 2023-10-05T11:18:37.996 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-372.el9.x86_64 2023-10-05T11:18:37.996 DEBUG:teuthology.orchestra.run.smithi170:> sudo rpm -qi grub2-tools 2023-10-05T11:18:38.029 INFO:teuthology.orchestra.run.smithi170.stdout:Name : grub2-tools 2023-10-05T11:18:38.029 INFO:teuthology.orchestra.run.smithi170.stdout:Epoch : 1 2023-10-05T11:18:38.030 INFO:teuthology.orchestra.run.smithi170.stdout:Version : 2.06 2023-10-05T11:18:38.030 INFO:teuthology.orchestra.run.smithi170.stdout:Release : 68.el9 2023-10-05T11:18:38.030 INFO:teuthology.orchestra.run.smithi170.stdout:Architecture: x86_64 2023-10-05T11:18:38.030 INFO:teuthology.orchestra.run.smithi170.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2023-10-05T11:18:38.030 INFO:teuthology.orchestra.run.smithi170.stdout:Group : Unspecified 2023-10-05T11:18:38.030 INFO:teuthology.orchestra.run.smithi170.stdout:Size : 8264254 2023-10-05T11:18:38.030 INFO:teuthology.orchestra.run.smithi170.stdout:License : GPLv3+ 2023-10-05T11:18:38.030 INFO:teuthology.orchestra.run.smithi170.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2023-10-05T11:18:38.030 INFO:teuthology.orchestra.run.smithi170.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2023-10-05T11:18:38.030 INFO:teuthology.orchestra.run.smithi170.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2023-10-05T11:18:38.030 INFO:teuthology.orchestra.run.smithi170.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2023-10-05T11:18:38.030 INFO:teuthology.orchestra.run.smithi170.stdout:Packager : builder@centos.org 2023-10-05T11:18:38.031 INFO:teuthology.orchestra.run.smithi170.stdout:Vendor : CentOS 2023-10-05T11:18:38.031 INFO:teuthology.orchestra.run.smithi170.stdout:URL : http://www.gnu.org/software/grub/ 2023-10-05T11:18:38.031 INFO:teuthology.orchestra.run.smithi170.stdout:Summary : Support tools for GRUB. 2023-10-05T11:18:38.031 INFO:teuthology.orchestra.run.smithi170.stdout:Description : 2023-10-05T11:18:38.031 INFO:teuthology.orchestra.run.smithi170.stdout: 2023-10-05T11:18:38.031 INFO:teuthology.orchestra.run.smithi170.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-10-05T11:18:38.031 INFO:teuthology.orchestra.run.smithi170.stdout:customizable bootloader with modular architecture. It supports a rich 2023-10-05T11:18:38.031 INFO:teuthology.orchestra.run.smithi170.stdout:variety of kernel formats, file systems, computer architectures and 2023-10-05T11:18:38.031 INFO:teuthology.orchestra.run.smithi170.stdout:hardware devices. 2023-10-05T11:18:38.031 INFO:teuthology.orchestra.run.smithi170.stdout: 2023-10-05T11:18:38.031 INFO:teuthology.orchestra.run.smithi170.stdout:This subpackage provides tools for support of all platforms. 2023-10-05T11:18:38.032 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-10-05T11:18:38.032 INFO:teuthology.task.kernel:Updating grub on smithi170 to boot 5.14.0-372.el9.x86_64 2023-10-05T11:18:38.032 DEBUG:teuthology.orchestra.run.smithi170:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-10-05T11:18:38.222 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: kernel-5.14.0-372.el9.x86_64 4/4 2023-10-05T11:18:38.222 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : kernel-5.14.0-372.el9.x86_64 1/4 2023-10-05T11:18:38.222 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : kernel-core-5.14.0-372.el9.x86_64 2/4 2023-10-05T11:18:38.222 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : kernel-modules-5.14.0-372.el9.x86_64 3/4 2023-10-05T11:18:38.631 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : kernel-modules-core-5.14.0-372.el9.x86_64 4/4 2023-10-05T11:18:38.631 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:18:38.631 INFO:teuthology.orchestra.run.smithi012.stdout:Installed: 2023-10-05T11:18:38.631 INFO:teuthology.orchestra.run.smithi012.stdout: kernel-5.14.0-372.el9.x86_64 2023-10-05T11:18:38.631 INFO:teuthology.orchestra.run.smithi012.stdout: kernel-core-5.14.0-372.el9.x86_64 2023-10-05T11:18:38.631 INFO:teuthology.orchestra.run.smithi012.stdout: kernel-modules-5.14.0-372.el9.x86_64 2023-10-05T11:18:38.632 INFO:teuthology.orchestra.run.smithi012.stdout: kernel-modules-core-5.14.0-372.el9.x86_64 2023-10-05T11:18:38.632 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:18:38.632 INFO:teuthology.orchestra.run.smithi012.stdout:Complete! 2023-10-05T11:18:38.712 INFO:teuthology.orchestra.run.smithi170.stderr:Generating grub configuration file ... 2023-10-05T11:18:39.134 DEBUG:teuthology.orchestra.run.smithi012:> rpm -q kernel | sort -rV | head -n 1 2023-10-05T11:18:39.260 INFO:teuthology.orchestra.run.smithi012.stdout:kernel-5.14.0-372.el9.x86_64 2023-10-05T11:18:39.261 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-372.el9.x86_64 2023-10-05T11:18:39.261 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-372.el9.x86_64 2023-10-05T11:18:39.261 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-10-05T11:18:39.262 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-10-05T11:18:39.262 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2023-10-05T11:18:39.262 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi012.front.sepia.ceph.com, path=None, version=distro) 2023-10-05T11:18:39.262 DEBUG:teuthology.orchestra.run.smithi012:> rpm -q kernel | sort -rV | head -n 1 2023-10-05T11:18:39.370 INFO:teuthology.orchestra.run.smithi012.stdout:kernel-5.14.0-372.el9.x86_64 2023-10-05T11:18:39.370 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-372.el9.x86_64 2023-10-05T11:18:39.370 DEBUG:teuthology.orchestra.run.smithi012:> sudo rpm -qi grub2-tools 2023-10-05T11:18:39.414 INFO:teuthology.orchestra.run.smithi012.stdout:Name : grub2-tools 2023-10-05T11:18:39.414 INFO:teuthology.orchestra.run.smithi012.stdout:Epoch : 1 2023-10-05T11:18:39.414 INFO:teuthology.orchestra.run.smithi012.stdout:Version : 2.06 2023-10-05T11:18:39.414 INFO:teuthology.orchestra.run.smithi012.stdout:Release : 68.el9 2023-10-05T11:18:39.415 INFO:teuthology.orchestra.run.smithi012.stdout:Architecture: x86_64 2023-10-05T11:18:39.415 INFO:teuthology.orchestra.run.smithi012.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2023-10-05T11:18:39.415 INFO:teuthology.orchestra.run.smithi012.stdout:Group : Unspecified 2023-10-05T11:18:39.415 INFO:teuthology.orchestra.run.smithi012.stdout:Size : 8264254 2023-10-05T11:18:39.415 INFO:teuthology.orchestra.run.smithi012.stdout:License : GPLv3+ 2023-10-05T11:18:39.415 INFO:teuthology.orchestra.run.smithi012.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2023-10-05T11:18:39.415 INFO:teuthology.orchestra.run.smithi012.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2023-10-05T11:18:39.415 INFO:teuthology.orchestra.run.smithi012.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2023-10-05T11:18:39.415 INFO:teuthology.orchestra.run.smithi012.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2023-10-05T11:18:39.415 INFO:teuthology.orchestra.run.smithi012.stdout:Packager : builder@centos.org 2023-10-05T11:18:39.415 INFO:teuthology.orchestra.run.smithi012.stdout:Vendor : CentOS 2023-10-05T11:18:39.415 INFO:teuthology.orchestra.run.smithi012.stdout:URL : http://www.gnu.org/software/grub/ 2023-10-05T11:18:39.416 INFO:teuthology.orchestra.run.smithi012.stdout:Summary : Support tools for GRUB. 2023-10-05T11:18:39.416 INFO:teuthology.orchestra.run.smithi012.stdout:Description : 2023-10-05T11:18:39.416 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:18:39.416 INFO:teuthology.orchestra.run.smithi012.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-10-05T11:18:39.416 INFO:teuthology.orchestra.run.smithi012.stdout:customizable bootloader with modular architecture. It supports a rich 2023-10-05T11:18:39.416 INFO:teuthology.orchestra.run.smithi012.stdout:variety of kernel formats, file systems, computer architectures and 2023-10-05T11:18:39.416 INFO:teuthology.orchestra.run.smithi012.stdout:hardware devices. 2023-10-05T11:18:39.416 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:18:39.416 INFO:teuthology.orchestra.run.smithi012.stdout:This subpackage provides tools for support of all platforms. 2023-10-05T11:18:39.417 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-10-05T11:18:39.417 INFO:teuthology.task.kernel:Updating grub on smithi012 to boot 5.14.0-372.el9.x86_64 2023-10-05T11:18:39.417 DEBUG:teuthology.orchestra.run.smithi012:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-10-05T11:18:40.008 INFO:teuthology.orchestra.run.smithi012.stderr:Generating grub configuration file ... 2023-10-05T11:18:40.045 INFO:teuthology.orchestra.run.smithi170.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2023-10-05T11:18:40.090 INFO:teuthology.orchestra.run.smithi170.stderr:done 2023-10-05T11:18:40.093 DEBUG:teuthology.orchestra.run.smithi170:> mktemp 2023-10-05T11:18:40.107 INFO:teuthology.orchestra.run.smithi170.stdout:/tmp/tmp.84k7myb7HC 2023-10-05T11:18:40.107 DEBUG:teuthology.orchestra.run.smithi170:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.84k7myb7HC 2023-10-05T11:18:40.175 DEBUG:teuthology.orchestra.run.smithi170:> sudo chmod 0666 /tmp/tmp.84k7myb7HC 2023-10-05T11:18:40.312 DEBUG:teuthology.orchestra.remote:smithi170:/tmp/tmp.84k7myb7HC is 6KB 2023-10-05T11:18:40.332 DEBUG:teuthology.orchestra.run.smithi170:> rm -fr /tmp/tmp.84k7myb7HC 2023-10-05T11:18:40.345 DEBUG:teuthology.orchestra.run.smithi170:> sudo /bin/ls /boot/loader/entries || true 2023-10-05T11:18:40.410 INFO:teuthology.orchestra.run.smithi170.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2023-10-05T11:18:40.411 INFO:teuthology.orchestra.run.smithi170.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2023-10-05T11:18:40.411 INFO:teuthology.orchestra.run.smithi170.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2023-10-05T11:18:40.411 INFO:teuthology.orchestra.run.smithi170.stdout:15949e3c88704300882482eddfd7baae-5.14.0-372.el9.x86_64.conf 2023-10-05T11:18:40.412 DEBUG:teuthology.orchestra.run.smithi170:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-372.el9.x86_64 2023-10-05T11:18:40.567 DEBUG:teuthology.orchestra.run.smithi170:> sudo shutdown -r now 2023-10-05T11:18:41.447 INFO:teuthology.orchestra.run.smithi012.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2023-10-05T11:18:41.474 INFO:teuthology.orchestra.run.smithi012.stderr:done 2023-10-05T11:18:41.475 DEBUG:teuthology.orchestra.run.smithi012:> mktemp 2023-10-05T11:18:41.491 INFO:teuthology.orchestra.run.smithi012.stdout:/tmp/tmp.B9DEHVJN4B 2023-10-05T11:18:41.491 DEBUG:teuthology.orchestra.run.smithi012:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.B9DEHVJN4B 2023-10-05T11:18:41.579 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod 0666 /tmp/tmp.B9DEHVJN4B 2023-10-05T11:18:41.688 DEBUG:teuthology.orchestra.remote:smithi012:/tmp/tmp.B9DEHVJN4B is 6KB 2023-10-05T11:18:41.737 DEBUG:teuthology.orchestra.run.smithi012:> rm -fr /tmp/tmp.B9DEHVJN4B 2023-10-05T11:18:41.752 DEBUG:teuthology.orchestra.run.smithi012:> sudo /bin/ls /boot/loader/entries || true 2023-10-05T11:18:41.830 INFO:teuthology.orchestra.run.smithi012.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2023-10-05T11:18:41.830 INFO:teuthology.orchestra.run.smithi012.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2023-10-05T11:18:41.830 INFO:teuthology.orchestra.run.smithi012.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2023-10-05T11:18:41.830 INFO:teuthology.orchestra.run.smithi012.stdout:15949e3c88704300882482eddfd7baae-5.14.0-372.el9.x86_64.conf 2023-10-05T11:18:41.832 DEBUG:teuthology.orchestra.run.smithi012:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-372.el9.x86_64 2023-10-05T11:18:41.986 DEBUG:teuthology.orchestra.run.smithi012:> sudo shutdown -r now 2023-10-05T11:19:10.588 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2023-10-05T11:19:10.588 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi170.front.sepia.ceph.com' 2023-10-05T11:19:10.589 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-05T11:19:11.990 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2023-10-05T11:19:11.991 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi012.front.sepia.ceph.com' 2023-10-05T11:19:11.991 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-05T11:19:29.146 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.170 2023-10-05T11:19:30.426 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.12 2023-10-05T11:19:38.149 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi170.front.sepia.ceph.com' 2023-10-05T11:19:38.150 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-05T11:19:39.429 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi012.front.sepia.ceph.com' 2023-10-05T11:19:39.429 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-05T11:19:41.210 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.170 2023-10-05T11:19:53.221 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi170.front.sepia.ceph.com' 2023-10-05T11:19:53.222 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-05T11:19:57.818 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.12 2023-10-05T11:20:09.828 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi012.front.sepia.ceph.com' 2023-10-05T11:20:09.829 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-05T11:20:10.092 DEBUG:teuthology.orchestra.run.smithi012:> true 2023-10-05T11:20:10.548 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi012.front.sepia.ceph.com' 2023-10-05T11:20:10.548 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-372.el9.x86_64"... 2023-10-05T11:20:10.549 DEBUG:teuthology.orchestra.run.smithi012:> uname -r 2023-10-05T11:20:10.565 INFO:teuthology.orchestra.run.smithi012.stdout:5.14.0-372.el9.x86_64 2023-10-05T11:20:10.565 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-372.el9.x86_64 vs 5.14.0-372.el9.x86_64 2023-10-05T11:20:10.565 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-05T11:20:10.565 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-10-05T11:20:11.566 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-10-05T11:20:11.566 DEBUG:teuthology.orchestra.run.smithi012:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-10-05T11:20:11.639 INFO:teuthology.orchestra.run.smithi012.stdout:ttyS1 2023-10-05T11:20:11.687 DEBUG:teuthology.parallel:result is None 2023-10-05T11:20:25.131 DEBUG:teuthology.orchestra.run.smithi170:> true 2023-10-05T11:20:25.494 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi170.front.sepia.ceph.com' 2023-10-05T11:20:25.494 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-372.el9.x86_64"... 2023-10-05T11:20:25.494 DEBUG:teuthology.orchestra.run.smithi170:> uname -r 2023-10-05T11:20:25.508 INFO:teuthology.orchestra.run.smithi170.stdout:5.14.0-372.el9.x86_64 2023-10-05T11:20:25.508 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-372.el9.x86_64 vs 5.14.0-372.el9.x86_64 2023-10-05T11:20:25.508 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-05T11:20:25.508 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-10-05T11:20:26.509 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2023-10-05T11:20:26.509 DEBUG:teuthology.orchestra.run.smithi170:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-10-05T11:20:26.672 INFO:teuthology.orchestra.run.smithi170.stdout:ttyS1 2023-10-05T11:20:26.711 DEBUG:teuthology.parallel:result is None 2023-10-05T11:20:26.711 INFO:teuthology.run_tasks:Running task internal.base... 2023-10-05T11:20:26.718 INFO:teuthology.task.internal:Creating test directory... 2023-10-05T11:20:26.718 DEBUG:teuthology.orchestra.run.smithi012:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-05T11:20:26.722 DEBUG:teuthology.orchestra.run.smithi170:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-05T11:20:26.748 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-10-05T11:20:26.753 INFO:teuthology.run_tasks:Running task internal.archive... 2023-10-05T11:20:26.761 INFO:teuthology.task.internal:Creating archive directory... 2023-10-05T11:20:26.761 DEBUG:teuthology.orchestra.run.smithi012:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-05T11:20:26.782 DEBUG:teuthology.orchestra.run.smithi170:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-05T11:20:26.832 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-10-05T11:20:26.838 INFO:teuthology.task.internal:Enabling coredump saving... 2023-10-05T11:20:26.838 DEBUG:teuthology.orchestra.run.smithi012:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-05T11:20:26.848 DEBUG:teuthology.orchestra.run.smithi170:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-05T11:20:26.888 INFO:teuthology.orchestra.run.smithi012.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-05T11:20:26.905 INFO:teuthology.orchestra.run.smithi012.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-05T11:20:27.053 INFO:teuthology.orchestra.run.smithi170.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-05T11:20:27.073 INFO:teuthology.orchestra.run.smithi170.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-05T11:20:27.075 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-10-05T11:20:27.082 INFO:teuthology.task.internal:Configuring sudo... 2023-10-05T11:20:27.082 DEBUG:teuthology.orchestra.run.smithi012:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-05T11:20:27.085 DEBUG:teuthology.orchestra.run.smithi170:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-05T11:20:27.130 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-10-05T11:20:27.138 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-10-05T11:20:27.138 DEBUG:teuthology.orchestra.run.smithi012:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-05T11:20:27.159 DEBUG:teuthology.orchestra.run.smithi170:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-05T11:20:27.188 DEBUG:teuthology.orchestra.run.smithi012:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-05T11:20:27.257 DEBUG:teuthology.orchestra.run.smithi012:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-05T11:20:27.313 DEBUG:teuthology.orchestra.run.smithi012:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-05T11:20:27.395 DEBUG:teuthology.orchestra.run.smithi012:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-05T11:20:27.442 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-10-05T11:20:27.442 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-05T11:20:27.512 DEBUG:teuthology.orchestra.run.smithi170:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-05T11:20:27.559 DEBUG:teuthology.orchestra.run.smithi170:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-05T11:20:27.617 DEBUG:teuthology.orchestra.run.smithi170:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-05T11:20:27.695 DEBUG:teuthology.orchestra.run.smithi170:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-05T11:20:27.740 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2023-10-05T11:20:27.740 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-05T11:20:27.810 DEBUG:teuthology.orchestra.run.smithi012:> sudo service rsyslog restart 2023-10-05T11:20:27.812 DEBUG:teuthology.orchestra.run.smithi170:> sudo service rsyslog restart 2023-10-05T11:20:27.868 INFO:teuthology.orchestra.run.smithi012.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-05T11:20:28.027 INFO:teuthology.orchestra.run.smithi170.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-05T11:20:28.367 INFO:teuthology.run_tasks:Running task internal.timer... 2023-10-05T11:20:28.374 INFO:teuthology.task.internal:Starting timer... 2023-10-05T11:20:28.374 INFO:teuthology.run_tasks:Running task pcp... 2023-10-05T11:20:28.383 INFO:teuthology.run_tasks:Running task selinux... 2023-10-05T11:20:28.391 DEBUG:teuthology.orchestra.run.smithi012:> sudo service auditd rotate 2023-10-05T11:20:28.483 INFO:teuthology.orchestra.run.smithi012.stdout:Rotating logs: 2023-10-05T11:20:28.485 DEBUG:teuthology.orchestra.run.smithi170:> sudo service auditd rotate 2023-10-05T11:20:28.548 INFO:teuthology.orchestra.run.smithi170.stdout:Rotating logs: 2023-10-05T11:20:28.549 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-10-05T11:20:28.550 DEBUG:teuthology.orchestra.run.smithi012:> /usr/sbin/getenforce 2023-10-05T11:20:28.571 INFO:teuthology.orchestra.run.smithi012.stdout:Permissive 2023-10-05T11:20:28.572 DEBUG:teuthology.orchestra.run.smithi170:> /usr/sbin/getenforce 2023-10-05T11:20:28.590 INFO:teuthology.orchestra.run.smithi170.stdout:Permissive 2023-10-05T11:20:28.590 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi012.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi170.front.sepia.ceph.com': 'permissive'} 2023-10-05T11:20:28.591 DEBUG:teuthology.orchestra.run.smithi012:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-05T11:20:28.643 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-05T11:20:28.643 DEBUG:teuthology.orchestra.run.smithi170:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-05T11:20:28.670 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-05T11:20:28.671 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-10-05T11:20:28.671 DEBUG:teuthology.orchestra.run.smithi012:> sudo /usr/sbin/setenforce permissive 2023-10-05T11:20:28.723 DEBUG:teuthology.orchestra.run.smithi170:> sudo /usr/sbin/setenforce permissive 2023-10-05T11:20:28.759 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-10-05T11:20:28.768 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-10-05T11:20:28.773 INFO:teuthology.repo_utils:Fetching main from origin 2023-10-05T11:20:28.973 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-10-05T11:20:28.988 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-10-05T11:20:28.989 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi012.front.sepia.ceph.com,smithi170.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-10-05T11:25:48.215 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi012.front.sepia.ceph.com'), Remote(name='ubuntu@smithi170.front.sepia.ceph.com')] 2023-10-05T11:25:48.216 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi012.front.sepia.ceph.com' 2023-10-05T11:25:48.217 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-05T11:25:48.315 DEBUG:teuthology.orchestra.run.smithi012:> true 2023-10-05T11:25:48.384 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi012.front.sepia.ceph.com' 2023-10-05T11:25:48.385 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi170.front.sepia.ceph.com' 2023-10-05T11:25:48.385 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-05T11:25:48.470 DEBUG:teuthology.orchestra.run.smithi170:> true 2023-10-05T11:25:48.536 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi170.front.sepia.ceph.com' 2023-10-05T11:25:48.537 INFO:teuthology.run_tasks:Running task clock... 2023-10-05T11:25:48.548 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-10-05T11:25:48.548 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-05T11:25:48.548 DEBUG:teuthology.orchestra.run.smithi012:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-05T11:25:48.550 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-05T11:25:48.551 DEBUG:teuthology.orchestra.run.smithi170:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-05T11:25:48.583 INFO:teuthology.orchestra.run.smithi012.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-05T11:25:48.603 INFO:teuthology.orchestra.run.smithi012.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-05T11:25:48.607 INFO:teuthology.orchestra.run.smithi170.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-05T11:25:48.623 INFO:teuthology.orchestra.run.smithi170.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-05T11:25:48.639 INFO:teuthology.orchestra.run.smithi012.stderr:sudo: ntpd: command not found 2023-10-05T11:25:48.653 INFO:teuthology.orchestra.run.smithi170.stderr:sudo: ntpd: command not found 2023-10-05T11:25:48.655 INFO:teuthology.orchestra.run.smithi012.stdout:506 Cannot talk to daemon 2023-10-05T11:25:48.666 INFO:teuthology.orchestra.run.smithi170.stdout:506 Cannot talk to daemon 2023-10-05T11:25:48.675 INFO:teuthology.orchestra.run.smithi012.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-05T11:25:48.683 INFO:teuthology.orchestra.run.smithi170.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-05T11:25:48.695 INFO:teuthology.orchestra.run.smithi012.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-05T11:25:48.699 INFO:teuthology.orchestra.run.smithi170.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-05T11:25:48.742 INFO:teuthology.orchestra.run.smithi012.stderr:bash: line 1: ntpq: command not found 2023-10-05T11:25:48.742 INFO:teuthology.orchestra.run.smithi170.stderr:bash: line 1: ntpq: command not found 2023-10-05T11:25:48.747 INFO:teuthology.orchestra.run.smithi170.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-05T11:25:48.747 INFO:teuthology.orchestra.run.smithi170.stdout:=============================================================================== 2023-10-05T11:25:48.747 INFO:teuthology.orchestra.run.smithi170.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-05T11:25:48.747 INFO:teuthology.orchestra.run.smithi170.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-05T11:25:48.747 INFO:teuthology.orchestra.run.smithi170.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-05T11:25:48.747 INFO:teuthology.orchestra.run.smithi170.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-05T11:25:48.747 INFO:teuthology.orchestra.run.smithi012.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-05T11:25:48.748 INFO:teuthology.orchestra.run.smithi012.stdout:=============================================================================== 2023-10-05T11:25:48.748 INFO:teuthology.orchestra.run.smithi012.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-05T11:25:48.748 INFO:teuthology.orchestra.run.smithi012.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-05T11:25:48.748 INFO:teuthology.orchestra.run.smithi012.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-05T11:25:48.748 INFO:teuthology.orchestra.run.smithi012.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-05T11:25:48.748 INFO:teuthology.run_tasks:Running task install... 2023-10-05T11:25:48.756 DEBUG:teuthology.task.install:project ceph 2023-10-05T11:25:48.756 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '38321be854743c0d616618a9ea8aa0b1d4dbc0bf'}} 2023-10-05T11:25:48.756 DEBUG:teuthology.task.install:config {'extra_system_packages': {'deb': ['s3cmd'], 'rpm': ['s3cmd']}, 'flavor': 'default', 'sha1': '38321be854743c0d616618a9ea8aa0b1d4dbc0bf'} 2023-10-05T11:25:48.756 INFO:teuthology.task.install:Using flavor: default 2023-10-05T11:25:48.762 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-10-05T11:25:48.762 INFO:teuthology.task.install:extra packages: [] 2023-10-05T11:25:48.763 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['s3cmd'], 'rpm': ['s3cmd']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '38321be854743c0d616618a9ea8aa0b1d4dbc0bf', 'tag': None, 'wait_for_package': False} 2023-10-05T11:25:48.763 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=38321be854743c0d616618a9ea8aa0b1d4dbc0bf 2023-10-05T11:25:48.765 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['s3cmd'], 'rpm': ['s3cmd']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '38321be854743c0d616618a9ea8aa0b1d4dbc0bf', 'tag': None, 'wait_for_package': False} 2023-10-05T11:25:48.765 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=38321be854743c0d616618a9ea8aa0b1d4dbc0bf 2023-10-05T11:25:48.911 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-rgw-d3n-filter/38321be854743c0d616618a9ea8aa0b1d4dbc0bf/centos/9/flavors/default/ 2023-10-05T11:25:48.911 INFO:teuthology.task.install.rpm:Package version is 18.0.0-6543.g38321be8 2023-10-05T11:25:49.018 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-rgw-d3n-filter/38321be854743c0d616618a9ea8aa0b1d4dbc0bf/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-rgw-d3n-filter/38321be854743c0d616618a9ea8aa0b1d4dbc0bf/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-rgw-d3n-filter/38321be854743c0d616618a9ea8aa0b1d4dbc0bf/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-05T11:25:49.019 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-10-05T11:25:49.019 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-05T11:25:49.051 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, s3cmd, s3cmd, s3cmd on remote rpm x86_64 2023-10-05T11:25:49.052 DEBUG:teuthology.orchestra.run.smithi012:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/38321be854743c0d616618a9ea8aa0b1d4dbc0bf/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-05T11:25:49.111 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-rgw-d3n-filter/38321be854743c0d616618a9ea8aa0b1d4dbc0bf/centos/9/flavors/default/ 2023-10-05T11:25:49.112 INFO:teuthology.task.install.rpm:Package version is 18.0.0-6543.g38321be8 2023-10-05T11:25:49.123 DEBUG:teuthology.orchestra.run.smithi012:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-05T11:25:49.210 DEBUG:teuthology.orchestra.run.smithi012:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-05T11:25:49.240 INFO:teuthology.orchestra.run.smithi012.stdout:check_obsoletes = 1 2023-10-05T11:25:49.241 DEBUG:teuthology.orchestra.run.smithi012:> sudo yum clean all 2023-10-05T11:25:49.353 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-rgw-d3n-filter/38321be854743c0d616618a9ea8aa0b1d4dbc0bf/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-rgw-d3n-filter/38321be854743c0d616618a9ea8aa0b1d4dbc0bf/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-rgw-d3n-filter/38321be854743c0d616618a9ea8aa0b1d4dbc0bf/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-05T11:25:49.354 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2023-10-05T11:25:49.354 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-05T11:25:49.384 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, s3cmd, s3cmd, s3cmd, s3cmd on remote rpm x86_64 2023-10-05T11:25:49.384 DEBUG:teuthology.orchestra.run.smithi170:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/38321be854743c0d616618a9ea8aa0b1d4dbc0bf/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-05T11:25:49.456 DEBUG:teuthology.orchestra.run.smithi170:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-05T11:25:49.492 INFO:teuthology.orchestra.run.smithi012.stdout:70 files removed 2023-10-05T11:25:49.519 DEBUG:teuthology.orchestra.run.smithi012:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd s3cmd s3cmd s3cmd s3cmd 2023-10-05T11:25:49.534 DEBUG:teuthology.orchestra.run.smithi170:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-05T11:25:49.601 INFO:teuthology.orchestra.run.smithi170.stdout:check_obsoletes = 1 2023-10-05T11:25:49.603 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum clean all 2023-10-05T11:25:49.844 INFO:teuthology.orchestra.run.smithi170.stdout:70 files removed 2023-10-05T11:25:49.872 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd s3cmd s3cmd s3cmd s3cmd 2023-10-05T11:25:50.250 INFO:teuthology.orchestra.run.smithi012.stdout:ceph packages for x86_64 197 kB/s | 78 kB 00:00 2023-10-05T11:25:50.668 INFO:teuthology.orchestra.run.smithi012.stdout:ceph noarch packages 26 kB/s | 9.4 kB 00:00 2023-10-05T11:25:50.708 INFO:teuthology.orchestra.run.smithi170.stdout:ceph packages for x86_64 151 kB/s | 78 kB 00:00 2023-10-05T11:25:51.043 INFO:teuthology.orchestra.run.smithi012.stdout:ceph source packages 5.6 kB/s | 1.9 kB 00:00 2023-10-05T11:25:51.093 INFO:teuthology.orchestra.run.smithi170.stdout:ceph noarch packages 28 kB/s | 9.4 kB 00:00 2023-10-05T11:25:51.618 INFO:teuthology.orchestra.run.smithi170.stdout:ceph source packages 3.8 kB/s | 1.9 kB 00:00 2023-10-05T11:25:51.695 INFO:teuthology.orchestra.run.smithi012.stdout:CentOS-9 - AppStream 12 MB/s | 7.7 MB 00:00 2023-10-05T11:25:52.203 INFO:teuthology.orchestra.run.smithi170.stdout:CentOS-9 - AppStream 14 MB/s | 7.7 MB 00:00 2023-10-05T11:25:53.646 INFO:teuthology.orchestra.run.smithi012.stdout:CentOS-9 - BaseOS 3.9 MB/s | 2.5 MB 00:00 2023-10-05T11:25:54.004 INFO:teuthology.orchestra.run.smithi170.stdout:CentOS-9 - BaseOS 4.6 MB/s | 2.5 MB 00:00 2023-10-05T11:25:55.312 INFO:teuthology.orchestra.run.smithi012.stdout:CentOS Stream 9 - BaseOS 6.6 MB/s | 7.9 MB 00:01 2023-10-05T11:25:56.128 INFO:teuthology.orchestra.run.smithi170.stdout:CentOS Stream 9 - BaseOS 4.7 MB/s | 7.9 MB 00:01 2023-10-05T11:25:57.087 INFO:teuthology.orchestra.run.smithi012.stdout:CentOS Stream 9 - AppStream 25 MB/s | 18 MB 00:00 2023-10-05T11:25:58.862 INFO:teuthology.orchestra.run.smithi170.stdout:CentOS Stream 9 - AppStream 10 MB/s | 18 MB 00:01 2023-10-05T11:26:02.479 INFO:teuthology.orchestra.run.smithi012.stdout:CentOS Stream 9 - CRB 3.0 MB/s | 5.7 MB 00:01 2023-10-05T11:26:04.024 INFO:teuthology.orchestra.run.smithi170.stdout:CentOS Stream 9 - CRB 3.2 MB/s | 5.7 MB 00:01 2023-10-05T11:26:04.821 INFO:teuthology.orchestra.run.smithi012.stdout:CentOS Stream 9 - Extras packages 12 kB/s | 14 kB 00:01 2023-10-05T11:26:05.805 INFO:teuthology.orchestra.run.smithi170.stdout:CentOS Stream 9 - Extras packages 22 kB/s | 14 kB 00:00 2023-10-05T11:26:05.857 INFO:teuthology.orchestra.run.smithi012.stdout:Extra Packages for Enterprise Linux 21 MB/s | 19 MB 00:00 2023-10-05T11:26:07.117 INFO:teuthology.orchestra.run.smithi170.stdout:Extra Packages for Enterprise Linux 16 MB/s | 19 MB 00:01 2023-10-05T11:26:10.598 INFO:teuthology.orchestra.run.smithi012.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2023-10-05T11:26:11.598 INFO:teuthology.orchestra.run.smithi170.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2023-10-05T11:26:12.975 INFO:teuthology.orchestra.run.smithi012.stderr:Modular dependency problems: 2023-10-05T11:26:12.975 INFO:teuthology.orchestra.run.smithi012.stderr: 2023-10-05T11:26:12.975 INFO:teuthology.orchestra.run.smithi012.stderr: Problem 1: conflicting requests 2023-10-05T11:26:12.975 INFO:teuthology.orchestra.run.smithi012.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820230825121312:20125149.x86_64 from CentOS-AppStream 2023-10-05T11:26:12.975 INFO:teuthology.orchestra.run.smithi012.stderr: Problem 2: conflicting requests 2023-10-05T11:26:12.975 INFO:teuthology.orchestra.run.smithi012.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2023-10-05T11:26:12.975 INFO:teuthology.orchestra.run.smithi012.stderr: Problem 3: conflicting requests 2023-10-05T11:26:12.976 INFO:teuthology.orchestra.run.smithi012.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2023-10-05T11:26:12.976 INFO:teuthology.orchestra.run.smithi012.stderr: Problem 4: conflicting requests 2023-10-05T11:26:12.976 INFO:teuthology.orchestra.run.smithi012.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2023-10-05T11:26:12.976 INFO:teuthology.orchestra.run.smithi012.stderr: Problem 5: conflicting requests 2023-10-05T11:26:12.976 INFO:teuthology.orchestra.run.smithi012.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820230817143732:b754926a.x86_64 from CentOS-AppStream 2023-10-05T11:26:12.976 INFO:teuthology.orchestra.run.smithi012.stderr: Problem 6: conflicting requests 2023-10-05T11:26:12.976 INFO:teuthology.orchestra.run.smithi012.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2023-10-05T11:26:12.976 INFO:teuthology.orchestra.run.smithi012.stderr: Problem 7: conflicting requests 2023-10-05T11:26:12.976 INFO:teuthology.orchestra.run.smithi012.stderr: - nothing provides module(platform:el8) needed by module idm:client:820230831144315:49cc9d1b.x86_64 from CentOS-AppStream 2023-10-05T11:26:12.976 INFO:teuthology.orchestra.run.smithi012.stderr: Problem 8: conflicting requests 2023-10-05T11:26:12.976 INFO:teuthology.orchestra.run.smithi012.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2023-10-05T11:26:12.976 INFO:teuthology.orchestra.run.smithi012.stderr: Problem 9: conflicting requests 2023-10-05T11:26:12.977 INFO:teuthology.orchestra.run.smithi012.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2023-10-05T11:26:12.977 INFO:teuthology.orchestra.run.smithi012.stderr: Problem 10: conflicting requests 2023-10-05T11:26:12.977 INFO:teuthology.orchestra.run.smithi012.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820230803191529:9edba152.x86_64 from CentOS-AppStream 2023-10-05T11:26:12.977 INFO:teuthology.orchestra.run.smithi012.stderr: Problem 11: conflicting requests 2023-10-05T11:26:12.977 INFO:teuthology.orchestra.run.smithi012.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2023-10-05T11:26:12.977 INFO:teuthology.orchestra.run.smithi012.stderr: Problem 12: conflicting requests 2023-10-05T11:26:12.977 INFO:teuthology.orchestra.run.smithi012.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:8050020210527144100:fd901a62.x86_64 from CentOS-AppStream 2023-10-05T11:26:12.977 INFO:teuthology.orchestra.run.smithi012.stderr: Problem 13: conflicting requests 2023-10-05T11:26:12.977 INFO:teuthology.orchestra.run.smithi012.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2023-10-05T11:26:12.977 INFO:teuthology.orchestra.run.smithi012.stderr: Problem 14: conflicting requests 2023-10-05T11:26:12.977 INFO:teuthology.orchestra.run.smithi012.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2023-10-05T11:26:12.977 INFO:teuthology.orchestra.run.smithi012.stderr: Problem 15: conflicting requests 2023-10-05T11:26:12.978 INFO:teuthology.orchestra.run.smithi012.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2023-10-05T11:26:12.978 INFO:teuthology.orchestra.run.smithi012.stderr: Problem 16: conflicting requests 2023-10-05T11:26:12.978 INFO:teuthology.orchestra.run.smithi012.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2023-10-05T11:26:12.978 INFO:teuthology.orchestra.run.smithi012.stderr: Problem 17: conflicting requests 2023-10-05T11:26:12.978 INFO:teuthology.orchestra.run.smithi012.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2023-10-05T11:26:12.978 INFO:teuthology.orchestra.run.smithi012.stderr: Problem 18: conflicting requests 2023-10-05T11:26:12.978 INFO:teuthology.orchestra.run.smithi012.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2023-10-05T11:26:12.978 INFO:teuthology.orchestra.run.smithi012.stderr: Problem 19: conflicting requests 2023-10-05T11:26:12.978 INFO:teuthology.orchestra.run.smithi012.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2023-10-05T11:26:12.978 INFO:teuthology.orchestra.run.smithi012.stderr: Problem 20: conflicting requests 2023-10-05T11:26:12.978 INFO:teuthology.orchestra.run.smithi012.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2023-10-05T11:26:12.979 INFO:teuthology.orchestra.run.smithi012.stderr: Problem 21: conflicting requests 2023-10-05T11:26:12.979 INFO:teuthology.orchestra.run.smithi012.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2023-10-05T11:26:12.979 INFO:teuthology.orchestra.run.smithi012.stderr: Problem 22: conflicting requests 2023-10-05T11:26:12.979 INFO:teuthology.orchestra.run.smithi012.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230720113118:9edba152.x86_64 from CentOS-AppStream 2023-10-05T11:26:12.979 INFO:teuthology.orchestra.run.smithi012.stderr: Problem 23: conflicting requests 2023-10-05T11:26:12.979 INFO:teuthology.orchestra.run.smithi012.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820230724122240:182f7c73.x86_64 from CentOS-AppStream 2023-10-05T11:26:12.979 INFO:teuthology.orchestra.run.smithi012.stderr: Problem 24: conflicting requests 2023-10-05T11:26:12.979 INFO:teuthology.orchestra.run.smithi012.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2023-10-05T11:26:12.979 INFO:teuthology.orchestra.run.smithi012.stderr: Problem 25: conflicting requests 2023-10-05T11:26:12.979 INFO:teuthology.orchestra.run.smithi012.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2023-10-05T11:26:12.979 INFO:teuthology.orchestra.run.smithi012.stderr: Problem 26: conflicting requests 2023-10-05T11:26:12.979 INFO:teuthology.orchestra.run.smithi012.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820230810143808:17377f89.x86_64 from CentOS-AppStream 2023-10-05T11:26:12.980 INFO:teuthology.orchestra.run.smithi012.stderr: Problem 27: conflicting requests 2023-10-05T11:26:12.980 INFO:teuthology.orchestra.run.smithi012.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2023-10-05T11:26:12.980 INFO:teuthology.orchestra.run.smithi012.stderr: Problem 28: conflicting requests 2023-10-05T11:26:12.980 INFO:teuthology.orchestra.run.smithi012.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2023-10-05T11:26:12.980 INFO:teuthology.orchestra.run.smithi012.stderr: Problem 29: conflicting requests 2023-10-05T11:26:12.980 INFO:teuthology.orchestra.run.smithi012.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2023-10-05T11:26:12.980 INFO:teuthology.orchestra.run.smithi012.stderr: Problem 30: conflicting requests 2023-10-05T11:26:12.980 INFO:teuthology.orchestra.run.smithi012.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820230814191405:b09eea91.x86_64 from CentOS-AppStream 2023-10-05T11:26:12.980 INFO:teuthology.orchestra.run.smithi012.stderr: Problem 31: conflicting requests 2023-10-05T11:26:12.980 INFO:teuthology.orchestra.run.smithi012.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2023-10-05T11:26:12.980 INFO:teuthology.orchestra.run.smithi012.stderr: Problem 32: conflicting requests 2023-10-05T11:26:12.980 INFO:teuthology.orchestra.run.smithi012.stderr: - nothing provides module(platform:el8) needed by module squid:4:8080020221220134440:fd72936b.x86_64 from CentOS-AppStream 2023-10-05T11:26:12.981 INFO:teuthology.orchestra.run.smithi012.stderr: Problem 33: conflicting requests 2023-10-05T11:26:12.981 INFO:teuthology.orchestra.run.smithi012.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2023-10-05T11:26:12.981 INFO:teuthology.orchestra.run.smithi012.stderr: Problem 34: conflicting requests 2023-10-05T11:26:12.981 INFO:teuthology.orchestra.run.smithi012.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2023-10-05T11:26:12.981 INFO:teuthology.orchestra.run.smithi012.stderr: Problem 35: conflicting requests 2023-10-05T11:26:12.981 INFO:teuthology.orchestra.run.smithi012.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2023-10-05T11:26:12.981 INFO:teuthology.orchestra.run.smithi012.stderr: Problem 36: conflicting requests 2023-10-05T11:26:12.981 INFO:teuthology.orchestra.run.smithi012.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820230907101217:9edba152.x86_64 from CentOS-AppStream 2023-10-05T11:26:12.981 INFO:teuthology.orchestra.run.smithi012.stderr: Problem 37: conflicting requests 2023-10-05T11:26:12.981 INFO:teuthology.orchestra.run.smithi012.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2023-10-05T11:26:12.981 INFO:teuthology.orchestra.run.smithi012.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2023-10-05T11:26:12.982 INFO:teuthology.orchestra.run.smithi012.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2023-10-05T11:26:12.982 INFO:teuthology.orchestra.run.smithi012.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:5e136183.x86_64 from CentOS-AppStream 2023-10-05T11:26:12.982 INFO:teuthology.orchestra.run.smithi012.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:d4f97118.x86_64 from CentOS-AppStream 2023-10-05T11:26:12.982 INFO:teuthology.orchestra.run.smithi012.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:e63f0836.x86_64 from CentOS-AppStream 2023-10-05T11:26:12.982 INFO:teuthology.orchestra.run.smithi012.stderr: Problem 38: cannot install the best candidate for the job 2023-10-05T11:26:12.982 INFO:teuthology.orchestra.run.smithi012.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2023-10-05T11:26:12.982 INFO:teuthology.orchestra.run.smithi012.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2023-10-05T11:26:12.982 INFO:teuthology.orchestra.run.smithi012.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2023-10-05T11:26:12.982 INFO:teuthology.orchestra.run.smithi012.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2023-10-05T11:26:12.982 INFO:teuthology.orchestra.run.smithi012.stderr: Problem 39: conflicting requests 2023-10-05T11:26:12.982 INFO:teuthology.orchestra.run.smithi012.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2023-10-05T11:26:12.982 INFO:teuthology.orchestra.run.smithi012.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2023-10-05T11:26:12.983 INFO:teuthology.orchestra.run.smithi012.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2023-10-05T11:26:12.983 INFO:teuthology.orchestra.run.smithi012.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2023-10-05T11:26:12.983 INFO:teuthology.orchestra.run.smithi012.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2023-10-05T11:26:12.983 INFO:teuthology.orchestra.run.smithi012.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2023-10-05T11:26:12.983 INFO:teuthology.orchestra.run.smithi012.stderr: Problem 40: cannot install the best candidate for the job 2023-10-05T11:26:12.983 INFO:teuthology.orchestra.run.smithi012.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2023-10-05T11:26:12.983 INFO:teuthology.orchestra.run.smithi012.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2023-10-05T11:26:12.983 INFO:teuthology.orchestra.run.smithi012.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2023-10-05T11:26:12.983 INFO:teuthology.orchestra.run.smithi012.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2023-10-05T11:26:12.983 INFO:teuthology.orchestra.run.smithi012.stderr: Problem 41: cannot install the best candidate for the job 2023-10-05T11:26:12.983 INFO:teuthology.orchestra.run.smithi012.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2023-10-05T11:26:12.984 INFO:teuthology.orchestra.run.smithi012.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2023-10-05T11:26:12.984 INFO:teuthology.orchestra.run.smithi012.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2023-10-05T11:26:12.984 INFO:teuthology.orchestra.run.smithi012.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2023-10-05T11:26:12.984 INFO:teuthology.orchestra.run.smithi012.stderr: Problem 42: cannot install the best candidate for the job 2023-10-05T11:26:12.984 INFO:teuthology.orchestra.run.smithi012.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2023-10-05T11:26:12.984 INFO:teuthology.orchestra.run.smithi012.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2023-10-05T11:26:12.984 INFO:teuthology.orchestra.run.smithi012.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2023-10-05T11:26:12.984 INFO:teuthology.orchestra.run.smithi012.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2023-10-05T11:26:12.984 INFO:teuthology.orchestra.run.smithi012.stderr: Problem 43: cannot install the best candidate for the job 2023-10-05T11:26:12.984 INFO:teuthology.orchestra.run.smithi012.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2023-10-05T11:26:12.984 INFO:teuthology.orchestra.run.smithi012.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2023-10-05T11:26:12.984 INFO:teuthology.orchestra.run.smithi012.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2023-10-05T11:26:12.985 INFO:teuthology.orchestra.run.smithi012.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2023-10-05T11:26:12.985 INFO:teuthology.orchestra.run.smithi012.stderr: Problem 44: cannot install the best candidate for the job 2023-10-05T11:26:12.985 INFO:teuthology.orchestra.run.smithi012.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2023-10-05T11:26:12.985 INFO:teuthology.orchestra.run.smithi012.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2023-10-05T11:26:12.985 INFO:teuthology.orchestra.run.smithi012.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2023-10-05T11:26:12.985 INFO:teuthology.orchestra.run.smithi012.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2023-10-05T11:26:12.985 INFO:teuthology.orchestra.run.smithi012.stderr: Problem 45: cannot install the best candidate for the job 2023-10-05T11:26:12.985 INFO:teuthology.orchestra.run.smithi012.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2023-10-05T11:26:12.985 INFO:teuthology.orchestra.run.smithi012.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2023-10-05T11:26:12.985 INFO:teuthology.orchestra.run.smithi012.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2023-10-05T11:26:12.985 INFO:teuthology.orchestra.run.smithi012.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2023-10-05T11:26:13.427 INFO:teuthology.orchestra.run.smithi012.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2023-10-05T11:26:13.428 INFO:teuthology.orchestra.run.smithi012.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2023-10-05T11:26:13.511 INFO:teuthology.orchestra.run.smithi012.stdout:Dependencies resolved. 2023-10-05T11:26:13.532 INFO:teuthology.orchestra.run.smithi012.stdout:======================================================================================= 2023-10-05T11:26:13.532 INFO:teuthology.orchestra.run.smithi012.stdout: Package Arch Version Repository Size 2023-10-05T11:26:13.532 INFO:teuthology.orchestra.run.smithi012.stdout:======================================================================================= 2023-10-05T11:26:13.532 INFO:teuthology.orchestra.run.smithi012.stdout:Installing: 2023-10-05T11:26:13.532 INFO:teuthology.orchestra.run.smithi012.stdout: ceph x86_64 2:18.0.0-6543.g38321be8.el9 ceph 6.5 k 2023-10-05T11:26:13.532 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-base x86_64 2:18.0.0-6543.g38321be8.el9 ceph 5.2 M 2023-10-05T11:26:13.532 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-fuse x86_64 2:18.0.0-6543.g38321be8.el9 ceph 855 k 2023-10-05T11:26:13.533 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-6543.g38321be8.el9 ceph 141 k 2023-10-05T11:26:13.533 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr x86_64 2:18.0.0-6543.g38321be8.el9 ceph 1.5 M 2023-10-05T11:26:13.533 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-cephadm noarch 2:18.0.0-6543.g38321be8.el9 ceph-noarch 132 k 2023-10-05T11:26:13.533 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-dashboard noarch 2:18.0.0-6543.g38321be8.el9 ceph-noarch 1.8 M 2023-10-05T11:26:13.533 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-6543.g38321be8.el9 ceph-noarch 7.4 M 2023-10-05T11:26:13.533 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-rook noarch 2:18.0.0-6543.g38321be8.el9 ceph-noarch 47 k 2023-10-05T11:26:13.533 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-radosgw x86_64 2:18.0.0-6543.g38321be8.el9 ceph 8.6 M 2023-10-05T11:26:13.533 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-test x86_64 2:18.0.0-6543.g38321be8.el9 ceph 41 M 2023-10-05T11:26:13.533 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-volume noarch 2:18.0.0-6543.g38321be8.el9 ceph-noarch 262 k 2023-10-05T11:26:13.533 INFO:teuthology.orchestra.run.smithi012.stdout: cephadm noarch 2:18.0.0-6543.g38321be8.el9 ceph-noarch 256 k 2023-10-05T11:26:13.533 INFO:teuthology.orchestra.run.smithi012.stdout: libcephfs-devel x86_64 2:18.0.0-6543.g38321be8.el9 ceph 31 k 2023-10-05T11:26:13.533 INFO:teuthology.orchestra.run.smithi012.stdout: libcephfs2 x86_64 2:18.0.0-6543.g38321be8.el9 ceph 715 k 2023-10-05T11:26:13.534 INFO:teuthology.orchestra.run.smithi012.stdout: librados-devel x86_64 2:18.0.0-6543.g38321be8.el9 ceph 127 k 2023-10-05T11:26:13.534 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cephfs x86_64 2:18.0.0-6543.g38321be8.el9 ceph 162 k 2023-10-05T11:26:13.534 INFO:teuthology.orchestra.run.smithi012.stdout: python3-rados x86_64 2:18.0.0-6543.g38321be8.el9 ceph 320 k 2023-10-05T11:26:13.534 INFO:teuthology.orchestra.run.smithi012.stdout: python3-rbd x86_64 2:18.0.0-6543.g38321be8.el9 ceph 297 k 2023-10-05T11:26:13.534 INFO:teuthology.orchestra.run.smithi012.stdout: python3-rgw x86_64 2:18.0.0-6543.g38321be8.el9 ceph 100 k 2023-10-05T11:26:13.534 INFO:teuthology.orchestra.run.smithi012.stdout: rbd-fuse x86_64 2:18.0.0-6543.g38321be8.el9 ceph 85 k 2023-10-05T11:26:13.534 INFO:teuthology.orchestra.run.smithi012.stdout: rbd-mirror x86_64 2:18.0.0-6543.g38321be8.el9 ceph 3.0 M 2023-10-05T11:26:13.534 INFO:teuthology.orchestra.run.smithi012.stdout: rbd-nbd x86_64 2:18.0.0-6543.g38321be8.el9 ceph 169 k 2023-10-05T11:26:13.534 INFO:teuthology.orchestra.run.smithi012.stdout: s3cmd noarch 2.3.0-4.el9 epel 197 k 2023-10-05T11:26:13.534 INFO:teuthology.orchestra.run.smithi012.stdout:Upgrading: 2023-10-05T11:26:13.534 INFO:teuthology.orchestra.run.smithi012.stdout: librados2 x86_64 2:18.0.0-6543.g38321be8.el9 ceph 3.3 M 2023-10-05T11:26:13.534 INFO:teuthology.orchestra.run.smithi012.stdout: librbd1 x86_64 2:18.0.0-6543.g38321be8.el9 ceph 3.0 M 2023-10-05T11:26:13.535 INFO:teuthology.orchestra.run.smithi012.stdout:Installing dependencies: 2023-10-05T11:26:13.535 INFO:teuthology.orchestra.run.smithi012.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2023-10-05T11:26:13.535 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-common x86_64 2:18.0.0-6543.g38321be8.el9 ceph 19 M 2023-10-05T11:26:13.535 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-grafana-dashboards noarch 2:18.0.0-6543.g38321be8.el9 ceph-noarch 23 k 2023-10-05T11:26:13.535 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mds x86_64 2:18.0.0-6543.g38321be8.el9 ceph 2.1 M 2023-10-05T11:26:13.535 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-modules-core noarch 2:18.0.0-6543.g38321be8.el9 ceph-noarch 242 k 2023-10-05T11:26:13.535 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mon x86_64 2:18.0.0-6543.g38321be8.el9 ceph 4.4 M 2023-10-05T11:26:13.535 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-osd x86_64 2:18.0.0-6543.g38321be8.el9 ceph 18 M 2023-10-05T11:26:13.535 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-prometheus-alerts noarch 2:18.0.0-6543.g38321be8.el9 ceph-noarch 15 k 2023-10-05T11:26:13.535 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-selinux x86_64 2:18.0.0-6543.g38321be8.el9 ceph 24 k 2023-10-05T11:26:13.536 INFO:teuthology.orchestra.run.smithi012.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2023-10-05T11:26:13.536 INFO:teuthology.orchestra.run.smithi012.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2023-10-05T11:26:13.536 INFO:teuthology.orchestra.run.smithi012.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2023-10-05T11:26:13.536 INFO:teuthology.orchestra.run.smithi012.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2023-10-05T11:26:13.536 INFO:teuthology.orchestra.run.smithi012.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2023-10-05T11:26:13.536 INFO:teuthology.orchestra.run.smithi012.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2023-10-05T11:26:13.536 INFO:teuthology.orchestra.run.smithi012.stdout: jq x86_64 1.6-15.el9 appstream 187 k 2023-10-05T11:26:13.536 INFO:teuthology.orchestra.run.smithi012.stdout: libarrow x86_64 9.0.0-9.el9 epel 4.4 M 2023-10-05T11:26:13.536 INFO:teuthology.orchestra.run.smithi012.stdout: libarrow-doc noarch 9.0.0-9.el9 epel 24 k 2023-10-05T11:26:13.536 INFO:teuthology.orchestra.run.smithi012.stdout: libcephsqlite x86_64 2:18.0.0-6543.g38321be8.el9 ceph 163 k 2023-10-05T11:26:13.536 INFO:teuthology.orchestra.run.smithi012.stdout: libgfortran x86_64 11.4.1-2.1.el9 baseos 809 k 2023-10-05T11:26:13.537 INFO:teuthology.orchestra.run.smithi012.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2023-10-05T11:26:13.537 INFO:teuthology.orchestra.run.smithi012.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2023-10-05T11:26:13.537 INFO:teuthology.orchestra.run.smithi012.stdout: libquadmath x86_64 11.4.1-2.1.el9 baseos 198 k 2023-10-05T11:26:13.537 INFO:teuthology.orchestra.run.smithi012.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2023-10-05T11:26:13.537 INFO:teuthology.orchestra.run.smithi012.stdout: libradosstriper1 x86_64 2:18.0.0-6543.g38321be8.el9 ceph 472 k 2023-10-05T11:26:13.537 INFO:teuthology.orchestra.run.smithi012.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2023-10-05T11:26:13.537 INFO:teuthology.orchestra.run.smithi012.stdout: librgw2 x86_64 2:18.0.0-6543.g38321be8.el9 ceph 4.8 M 2023-10-05T11:26:13.537 INFO:teuthology.orchestra.run.smithi012.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2023-10-05T11:26:13.537 INFO:teuthology.orchestra.run.smithi012.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2023-10-05T11:26:13.537 INFO:teuthology.orchestra.run.smithi012.stdout: oniguruma x86_64 6.9.6-1.el9.5 appstream 218 k 2023-10-05T11:26:13.537 INFO:teuthology.orchestra.run.smithi012.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2023-10-05T11:26:13.537 INFO:teuthology.orchestra.run.smithi012.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2023-10-05T11:26:13.538 INFO:teuthology.orchestra.run.smithi012.stdout: parquet-libs x86_64 9.0.0-9.el9 epel 837 k 2023-10-05T11:26:13.538 INFO:teuthology.orchestra.run.smithi012.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2023-10-05T11:26:13.538 INFO:teuthology.orchestra.run.smithi012.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2023-10-05T11:26:13.538 INFO:teuthology.orchestra.run.smithi012.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2023-10-05T11:26:13.538 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2023-10-05T11:26:13.538 INFO:teuthology.orchestra.run.smithi012.stdout: python3-ceph-argparse x86_64 2:18.0.0-6543.g38321be8.el9 ceph 45 k 2023-10-05T11:26:13.538 INFO:teuthology.orchestra.run.smithi012.stdout: python3-ceph-common x86_64 2:18.0.0-6543.g38321be8.el9 ceph 127 k 2023-10-05T11:26:13.538 INFO:teuthology.orchestra.run.smithi012.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2023-10-05T11:26:13.538 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2023-10-05T11:26:13.538 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2023-10-05T11:26:13.538 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2023-10-05T11:26:13.539 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2023-10-05T11:26:13.539 INFO:teuthology.orchestra.run.smithi012.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2023-10-05T11:26:13.539 INFO:teuthology.orchestra.run.smithi012.stdout: python3-google-auth noarch 1:2.23.0-1.el9 epel 196 k 2023-10-05T11:26:13.539 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2023-10-05T11:26:13.539 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2023-10-05T11:26:13.539 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2023-10-05T11:26:13.539 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2023-10-05T11:26:13.539 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2023-10-05T11:26:13.539 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jinja2 noarch 2.11.3-4.el9 appstream 249 k 2023-10-05T11:26:13.539 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2023-10-05T11:26:13.539 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2023-10-05T11:26:13.539 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2023-10-05T11:26:13.540 INFO:teuthology.orchestra.run.smithi012.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2023-10-05T11:26:13.540 INFO:teuthology.orchestra.run.smithi012.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2023-10-05T11:26:13.540 INFO:teuthology.orchestra.run.smithi012.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2023-10-05T11:26:13.540 INFO:teuthology.orchestra.run.smithi012.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2023-10-05T11:26:13.540 INFO:teuthology.orchestra.run.smithi012.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2023-10-05T11:26:13.540 INFO:teuthology.orchestra.run.smithi012.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2023-10-05T11:26:13.540 INFO:teuthology.orchestra.run.smithi012.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2023-10-05T11:26:13.540 INFO:teuthology.orchestra.run.smithi012.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2023-10-05T11:26:13.540 INFO:teuthology.orchestra.run.smithi012.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2023-10-05T11:26:13.540 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2023-10-05T11:26:13.540 INFO:teuthology.orchestra.run.smithi012.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2023-10-05T11:26:13.540 INFO:teuthology.orchestra.run.smithi012.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2023-10-05T11:26:13.541 INFO:teuthology.orchestra.run.smithi012.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2023-10-05T11:26:13.541 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2023-10-05T11:26:13.541 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2023-10-05T11:26:13.541 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2023-10-05T11:26:13.541 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2023-10-05T11:26:13.541 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2023-10-05T11:26:13.541 INFO:teuthology.orchestra.run.smithi012.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2023-10-05T11:26:13.541 INFO:teuthology.orchestra.run.smithi012.stdout: python3-requests noarch 2.25.1-7.el9 baseos 124 k 2023-10-05T11:26:13.541 INFO:teuthology.orchestra.run.smithi012.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2023-10-05T11:26:13.541 INFO:teuthology.orchestra.run.smithi012.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2023-10-05T11:26:13.541 INFO:teuthology.orchestra.run.smithi012.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2023-10-05T11:26:13.541 INFO:teuthology.orchestra.run.smithi012.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2023-10-05T11:26:13.542 INFO:teuthology.orchestra.run.smithi012.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2023-10-05T11:26:13.542 INFO:teuthology.orchestra.run.smithi012.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2023-10-05T11:26:13.542 INFO:teuthology.orchestra.run.smithi012.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2023-10-05T11:26:13.542 INFO:teuthology.orchestra.run.smithi012.stdout: python3-urllib3 noarch 1.26.5-3.el9 baseos 216 k 2023-10-05T11:26:13.542 INFO:teuthology.orchestra.run.smithi012.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2023-10-05T11:26:13.542 INFO:teuthology.orchestra.run.smithi012.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2023-10-05T11:26:13.542 INFO:teuthology.orchestra.run.smithi012.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2023-10-05T11:26:13.542 INFO:teuthology.orchestra.run.smithi012.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2023-10-05T11:26:13.542 INFO:teuthology.orchestra.run.smithi012.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2023-10-05T11:26:13.542 INFO:teuthology.orchestra.run.smithi012.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2023-10-05T11:26:13.542 INFO:teuthology.orchestra.run.smithi012.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2023-10-05T11:26:13.543 INFO:teuthology.orchestra.run.smithi012.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2023-10-05T11:26:13.543 INFO:teuthology.orchestra.run.smithi012.stdout:Installing weak dependencies: 2023-10-05T11:26:13.543 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2023-10-05T11:26:13.543 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:26:13.543 INFO:teuthology.orchestra.run.smithi012.stdout:Transaction Summary 2023-10-05T11:26:13.543 INFO:teuthology.orchestra.run.smithi012.stdout:======================================================================================= 2023-10-05T11:26:13.543 INFO:teuthology.orchestra.run.smithi012.stdout:Install 116 Packages 2023-10-05T11:26:13.543 INFO:teuthology.orchestra.run.smithi012.stdout:Upgrade 2 Packages 2023-10-05T11:26:13.543 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:26:13.544 INFO:teuthology.orchestra.run.smithi012.stdout:Total download size: 181 M 2023-10-05T11:26:13.544 INFO:teuthology.orchestra.run.smithi012.stdout:Downloading Packages: 2023-10-05T11:26:13.875 INFO:teuthology.orchestra.run.smithi170.stderr:Modular dependency problems: 2023-10-05T11:26:13.876 INFO:teuthology.orchestra.run.smithi170.stderr: 2023-10-05T11:26:13.876 INFO:teuthology.orchestra.run.smithi170.stderr: Problem 1: conflicting requests 2023-10-05T11:26:13.876 INFO:teuthology.orchestra.run.smithi170.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820230825121312:20125149.x86_64 from CentOS-AppStream 2023-10-05T11:26:13.876 INFO:teuthology.orchestra.run.smithi170.stderr: Problem 2: conflicting requests 2023-10-05T11:26:13.876 INFO:teuthology.orchestra.run.smithi170.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2023-10-05T11:26:13.876 INFO:teuthology.orchestra.run.smithi170.stderr: Problem 3: conflicting requests 2023-10-05T11:26:13.876 INFO:teuthology.orchestra.run.smithi170.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2023-10-05T11:26:13.876 INFO:teuthology.orchestra.run.smithi170.stderr: Problem 4: conflicting requests 2023-10-05T11:26:13.876 INFO:teuthology.orchestra.run.smithi170.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2023-10-05T11:26:13.876 INFO:teuthology.orchestra.run.smithi170.stderr: Problem 5: conflicting requests 2023-10-05T11:26:13.877 INFO:teuthology.orchestra.run.smithi170.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820230817143732:b754926a.x86_64 from CentOS-AppStream 2023-10-05T11:26:13.877 INFO:teuthology.orchestra.run.smithi170.stderr: Problem 6: conflicting requests 2023-10-05T11:26:13.877 INFO:teuthology.orchestra.run.smithi170.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2023-10-05T11:26:13.877 INFO:teuthology.orchestra.run.smithi170.stderr: Problem 7: conflicting requests 2023-10-05T11:26:13.877 INFO:teuthology.orchestra.run.smithi170.stderr: - nothing provides module(platform:el8) needed by module idm:client:820230831144315:49cc9d1b.x86_64 from CentOS-AppStream 2023-10-05T11:26:13.877 INFO:teuthology.orchestra.run.smithi170.stderr: Problem 8: conflicting requests 2023-10-05T11:26:13.877 INFO:teuthology.orchestra.run.smithi170.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2023-10-05T11:26:13.877 INFO:teuthology.orchestra.run.smithi170.stderr: Problem 9: conflicting requests 2023-10-05T11:26:13.877 INFO:teuthology.orchestra.run.smithi170.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2023-10-05T11:26:13.877 INFO:teuthology.orchestra.run.smithi170.stderr: Problem 10: conflicting requests 2023-10-05T11:26:13.877 INFO:teuthology.orchestra.run.smithi170.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820230803191529:9edba152.x86_64 from CentOS-AppStream 2023-10-05T11:26:13.877 INFO:teuthology.orchestra.run.smithi170.stderr: Problem 11: conflicting requests 2023-10-05T11:26:13.878 INFO:teuthology.orchestra.run.smithi170.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2023-10-05T11:26:13.878 INFO:teuthology.orchestra.run.smithi170.stderr: Problem 12: conflicting requests 2023-10-05T11:26:13.878 INFO:teuthology.orchestra.run.smithi170.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:8050020210527144100:fd901a62.x86_64 from CentOS-AppStream 2023-10-05T11:26:13.878 INFO:teuthology.orchestra.run.smithi170.stderr: Problem 13: conflicting requests 2023-10-05T11:26:13.878 INFO:teuthology.orchestra.run.smithi170.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2023-10-05T11:26:13.878 INFO:teuthology.orchestra.run.smithi170.stderr: Problem 14: conflicting requests 2023-10-05T11:26:13.878 INFO:teuthology.orchestra.run.smithi170.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2023-10-05T11:26:13.878 INFO:teuthology.orchestra.run.smithi170.stderr: Problem 15: conflicting requests 2023-10-05T11:26:13.878 INFO:teuthology.orchestra.run.smithi170.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2023-10-05T11:26:13.878 INFO:teuthology.orchestra.run.smithi170.stderr: Problem 16: conflicting requests 2023-10-05T11:26:13.878 INFO:teuthology.orchestra.run.smithi170.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2023-10-05T11:26:13.879 INFO:teuthology.orchestra.run.smithi170.stderr: Problem 17: conflicting requests 2023-10-05T11:26:13.879 INFO:teuthology.orchestra.run.smithi170.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2023-10-05T11:26:13.879 INFO:teuthology.orchestra.run.smithi170.stderr: Problem 18: conflicting requests 2023-10-05T11:26:13.879 INFO:teuthology.orchestra.run.smithi170.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2023-10-05T11:26:13.879 INFO:teuthology.orchestra.run.smithi170.stderr: Problem 19: conflicting requests 2023-10-05T11:26:13.879 INFO:teuthology.orchestra.run.smithi170.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2023-10-05T11:26:13.879 INFO:teuthology.orchestra.run.smithi170.stderr: Problem 20: conflicting requests 2023-10-05T11:26:13.879 INFO:teuthology.orchestra.run.smithi170.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2023-10-05T11:26:13.879 INFO:teuthology.orchestra.run.smithi170.stderr: Problem 21: conflicting requests 2023-10-05T11:26:13.879 INFO:teuthology.orchestra.run.smithi170.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2023-10-05T11:26:13.879 INFO:teuthology.orchestra.run.smithi170.stderr: Problem 22: conflicting requests 2023-10-05T11:26:13.880 INFO:teuthology.orchestra.run.smithi170.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230720113118:9edba152.x86_64 from CentOS-AppStream 2023-10-05T11:26:13.880 INFO:teuthology.orchestra.run.smithi170.stderr: Problem 23: conflicting requests 2023-10-05T11:26:13.880 INFO:teuthology.orchestra.run.smithi170.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820230724122240:182f7c73.x86_64 from CentOS-AppStream 2023-10-05T11:26:13.880 INFO:teuthology.orchestra.run.smithi170.stderr: Problem 24: conflicting requests 2023-10-05T11:26:13.880 INFO:teuthology.orchestra.run.smithi170.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2023-10-05T11:26:13.880 INFO:teuthology.orchestra.run.smithi170.stderr: Problem 25: conflicting requests 2023-10-05T11:26:13.880 INFO:teuthology.orchestra.run.smithi170.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2023-10-05T11:26:13.880 INFO:teuthology.orchestra.run.smithi170.stderr: Problem 26: conflicting requests 2023-10-05T11:26:13.880 INFO:teuthology.orchestra.run.smithi170.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820230810143808:17377f89.x86_64 from CentOS-AppStream 2023-10-05T11:26:13.880 INFO:teuthology.orchestra.run.smithi170.stderr: Problem 27: conflicting requests 2023-10-05T11:26:13.880 INFO:teuthology.orchestra.run.smithi170.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2023-10-05T11:26:13.880 INFO:teuthology.orchestra.run.smithi170.stderr: Problem 28: conflicting requests 2023-10-05T11:26:13.881 INFO:teuthology.orchestra.run.smithi170.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2023-10-05T11:26:13.881 INFO:teuthology.orchestra.run.smithi170.stderr: Problem 29: conflicting requests 2023-10-05T11:26:13.881 INFO:teuthology.orchestra.run.smithi170.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2023-10-05T11:26:13.881 INFO:teuthology.orchestra.run.smithi170.stderr: Problem 30: conflicting requests 2023-10-05T11:26:13.881 INFO:teuthology.orchestra.run.smithi170.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820230814191405:b09eea91.x86_64 from CentOS-AppStream 2023-10-05T11:26:13.881 INFO:teuthology.orchestra.run.smithi170.stderr: Problem 31: conflicting requests 2023-10-05T11:26:13.881 INFO:teuthology.orchestra.run.smithi170.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2023-10-05T11:26:13.881 INFO:teuthology.orchestra.run.smithi170.stderr: Problem 32: conflicting requests 2023-10-05T11:26:13.881 INFO:teuthology.orchestra.run.smithi170.stderr: - nothing provides module(platform:el8) needed by module squid:4:8080020221220134440:fd72936b.x86_64 from CentOS-AppStream 2023-10-05T11:26:13.881 INFO:teuthology.orchestra.run.smithi170.stderr: Problem 33: conflicting requests 2023-10-05T11:26:13.881 INFO:teuthology.orchestra.run.smithi170.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2023-10-05T11:26:13.881 INFO:teuthology.orchestra.run.smithi170.stderr: Problem 34: conflicting requests 2023-10-05T11:26:13.882 INFO:teuthology.orchestra.run.smithi170.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2023-10-05T11:26:13.882 INFO:teuthology.orchestra.run.smithi170.stderr: Problem 35: conflicting requests 2023-10-05T11:26:13.882 INFO:teuthology.orchestra.run.smithi170.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2023-10-05T11:26:13.882 INFO:teuthology.orchestra.run.smithi170.stderr: Problem 36: conflicting requests 2023-10-05T11:26:13.882 INFO:teuthology.orchestra.run.smithi170.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820230907101217:9edba152.x86_64 from CentOS-AppStream 2023-10-05T11:26:13.882 INFO:teuthology.orchestra.run.smithi170.stderr: Problem 37: conflicting requests 2023-10-05T11:26:13.882 INFO:teuthology.orchestra.run.smithi170.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2023-10-05T11:26:13.882 INFO:teuthology.orchestra.run.smithi170.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2023-10-05T11:26:13.882 INFO:teuthology.orchestra.run.smithi170.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2023-10-05T11:26:13.882 INFO:teuthology.orchestra.run.smithi170.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:5e136183.x86_64 from CentOS-AppStream 2023-10-05T11:26:13.882 INFO:teuthology.orchestra.run.smithi170.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:d4f97118.x86_64 from CentOS-AppStream 2023-10-05T11:26:13.883 INFO:teuthology.orchestra.run.smithi170.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:e63f0836.x86_64 from CentOS-AppStream 2023-10-05T11:26:13.883 INFO:teuthology.orchestra.run.smithi170.stderr: Problem 38: cannot install the best candidate for the job 2023-10-05T11:26:13.883 INFO:teuthology.orchestra.run.smithi170.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2023-10-05T11:26:13.883 INFO:teuthology.orchestra.run.smithi170.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2023-10-05T11:26:13.883 INFO:teuthology.orchestra.run.smithi170.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2023-10-05T11:26:13.883 INFO:teuthology.orchestra.run.smithi170.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2023-10-05T11:26:13.883 INFO:teuthology.orchestra.run.smithi170.stderr: Problem 39: conflicting requests 2023-10-05T11:26:13.883 INFO:teuthology.orchestra.run.smithi170.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2023-10-05T11:26:13.883 INFO:teuthology.orchestra.run.smithi170.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2023-10-05T11:26:13.883 INFO:teuthology.orchestra.run.smithi170.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2023-10-05T11:26:13.883 INFO:teuthology.orchestra.run.smithi170.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2023-10-05T11:26:13.883 INFO:teuthology.orchestra.run.smithi170.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2023-10-05T11:26:13.884 INFO:teuthology.orchestra.run.smithi170.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2023-10-05T11:26:13.884 INFO:teuthology.orchestra.run.smithi170.stderr: Problem 40: cannot install the best candidate for the job 2023-10-05T11:26:13.884 INFO:teuthology.orchestra.run.smithi170.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2023-10-05T11:26:13.884 INFO:teuthology.orchestra.run.smithi170.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2023-10-05T11:26:13.884 INFO:teuthology.orchestra.run.smithi170.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2023-10-05T11:26:13.884 INFO:teuthology.orchestra.run.smithi170.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2023-10-05T11:26:13.884 INFO:teuthology.orchestra.run.smithi170.stderr: Problem 41: cannot install the best candidate for the job 2023-10-05T11:26:13.884 INFO:teuthology.orchestra.run.smithi170.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2023-10-05T11:26:13.884 INFO:teuthology.orchestra.run.smithi170.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2023-10-05T11:26:13.884 INFO:teuthology.orchestra.run.smithi170.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2023-10-05T11:26:13.884 INFO:teuthology.orchestra.run.smithi170.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2023-10-05T11:26:13.885 INFO:teuthology.orchestra.run.smithi170.stderr: Problem 42: cannot install the best candidate for the job 2023-10-05T11:26:13.885 INFO:teuthology.orchestra.run.smithi170.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2023-10-05T11:26:13.885 INFO:teuthology.orchestra.run.smithi170.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2023-10-05T11:26:13.885 INFO:teuthology.orchestra.run.smithi170.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2023-10-05T11:26:13.885 INFO:teuthology.orchestra.run.smithi170.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2023-10-05T11:26:13.885 INFO:teuthology.orchestra.run.smithi170.stderr: Problem 43: cannot install the best candidate for the job 2023-10-05T11:26:13.885 INFO:teuthology.orchestra.run.smithi170.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2023-10-05T11:26:13.885 INFO:teuthology.orchestra.run.smithi170.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2023-10-05T11:26:13.885 INFO:teuthology.orchestra.run.smithi170.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2023-10-05T11:26:13.885 INFO:teuthology.orchestra.run.smithi170.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2023-10-05T11:26:13.885 INFO:teuthology.orchestra.run.smithi170.stderr: Problem 44: cannot install the best candidate for the job 2023-10-05T11:26:13.885 INFO:teuthology.orchestra.run.smithi170.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2023-10-05T11:26:13.886 INFO:teuthology.orchestra.run.smithi170.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2023-10-05T11:26:13.886 INFO:teuthology.orchestra.run.smithi170.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2023-10-05T11:26:13.886 INFO:teuthology.orchestra.run.smithi170.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2023-10-05T11:26:13.886 INFO:teuthology.orchestra.run.smithi170.stderr: Problem 45: cannot install the best candidate for the job 2023-10-05T11:26:13.886 INFO:teuthology.orchestra.run.smithi170.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2023-10-05T11:26:13.886 INFO:teuthology.orchestra.run.smithi170.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2023-10-05T11:26:13.886 INFO:teuthology.orchestra.run.smithi170.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2023-10-05T11:26:13.886 INFO:teuthology.orchestra.run.smithi170.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2023-10-05T11:26:14.157 INFO:teuthology.orchestra.run.smithi012.stdout:(1/118): ceph-18.0.0-6543.g38321be8.el9.x86_64. 28 kB/s | 6.5 kB 00:00 2023-10-05T11:26:14.318 INFO:teuthology.orchestra.run.smithi170.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2023-10-05T11:26:14.319 INFO:teuthology.orchestra.run.smithi170.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2023-10-05T11:26:14.396 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2023-10-05T11:26:14.420 INFO:teuthology.orchestra.run.smithi170.stdout:======================================================================================= 2023-10-05T11:26:14.420 INFO:teuthology.orchestra.run.smithi170.stdout: Package Arch Version Repository Size 2023-10-05T11:26:14.420 INFO:teuthology.orchestra.run.smithi170.stdout:======================================================================================= 2023-10-05T11:26:14.420 INFO:teuthology.orchestra.run.smithi170.stdout:Installing: 2023-10-05T11:26:14.420 INFO:teuthology.orchestra.run.smithi170.stdout: ceph x86_64 2:18.0.0-6543.g38321be8.el9 ceph 6.5 k 2023-10-05T11:26:14.420 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-base x86_64 2:18.0.0-6543.g38321be8.el9 ceph 5.2 M 2023-10-05T11:26:14.421 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-fuse x86_64 2:18.0.0-6543.g38321be8.el9 ceph 855 k 2023-10-05T11:26:14.421 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-6543.g38321be8.el9 ceph 141 k 2023-10-05T11:26:14.421 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr x86_64 2:18.0.0-6543.g38321be8.el9 ceph 1.5 M 2023-10-05T11:26:14.421 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-cephadm noarch 2:18.0.0-6543.g38321be8.el9 ceph-noarch 132 k 2023-10-05T11:26:14.421 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-dashboard noarch 2:18.0.0-6543.g38321be8.el9 ceph-noarch 1.8 M 2023-10-05T11:26:14.421 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-6543.g38321be8.el9 ceph-noarch 7.4 M 2023-10-05T11:26:14.421 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-rook noarch 2:18.0.0-6543.g38321be8.el9 ceph-noarch 47 k 2023-10-05T11:26:14.421 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-radosgw x86_64 2:18.0.0-6543.g38321be8.el9 ceph 8.6 M 2023-10-05T11:26:14.421 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-test x86_64 2:18.0.0-6543.g38321be8.el9 ceph 41 M 2023-10-05T11:26:14.421 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-volume noarch 2:18.0.0-6543.g38321be8.el9 ceph-noarch 262 k 2023-10-05T11:26:14.421 INFO:teuthology.orchestra.run.smithi170.stdout: cephadm noarch 2:18.0.0-6543.g38321be8.el9 ceph-noarch 256 k 2023-10-05T11:26:14.421 INFO:teuthology.orchestra.run.smithi170.stdout: libcephfs-devel x86_64 2:18.0.0-6543.g38321be8.el9 ceph 31 k 2023-10-05T11:26:14.422 INFO:teuthology.orchestra.run.smithi170.stdout: libcephfs2 x86_64 2:18.0.0-6543.g38321be8.el9 ceph 715 k 2023-10-05T11:26:14.422 INFO:teuthology.orchestra.run.smithi170.stdout: librados-devel x86_64 2:18.0.0-6543.g38321be8.el9 ceph 127 k 2023-10-05T11:26:14.422 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cephfs x86_64 2:18.0.0-6543.g38321be8.el9 ceph 162 k 2023-10-05T11:26:14.422 INFO:teuthology.orchestra.run.smithi170.stdout: python3-rados x86_64 2:18.0.0-6543.g38321be8.el9 ceph 320 k 2023-10-05T11:26:14.422 INFO:teuthology.orchestra.run.smithi170.stdout: python3-rbd x86_64 2:18.0.0-6543.g38321be8.el9 ceph 297 k 2023-10-05T11:26:14.422 INFO:teuthology.orchestra.run.smithi170.stdout: python3-rgw x86_64 2:18.0.0-6543.g38321be8.el9 ceph 100 k 2023-10-05T11:26:14.422 INFO:teuthology.orchestra.run.smithi170.stdout: rbd-fuse x86_64 2:18.0.0-6543.g38321be8.el9 ceph 85 k 2023-10-05T11:26:14.422 INFO:teuthology.orchestra.run.smithi170.stdout: rbd-mirror x86_64 2:18.0.0-6543.g38321be8.el9 ceph 3.0 M 2023-10-05T11:26:14.422 INFO:teuthology.orchestra.run.smithi170.stdout: rbd-nbd x86_64 2:18.0.0-6543.g38321be8.el9 ceph 169 k 2023-10-05T11:26:14.422 INFO:teuthology.orchestra.run.smithi170.stdout: s3cmd noarch 2.3.0-4.el9 epel 197 k 2023-10-05T11:26:14.422 INFO:teuthology.orchestra.run.smithi170.stdout:Upgrading: 2023-10-05T11:26:14.423 INFO:teuthology.orchestra.run.smithi170.stdout: librados2 x86_64 2:18.0.0-6543.g38321be8.el9 ceph 3.3 M 2023-10-05T11:26:14.423 INFO:teuthology.orchestra.run.smithi170.stdout: librbd1 x86_64 2:18.0.0-6543.g38321be8.el9 ceph 3.0 M 2023-10-05T11:26:14.423 INFO:teuthology.orchestra.run.smithi170.stdout:Installing dependencies: 2023-10-05T11:26:14.423 INFO:teuthology.orchestra.run.smithi170.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2023-10-05T11:26:14.423 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-common x86_64 2:18.0.0-6543.g38321be8.el9 ceph 19 M 2023-10-05T11:26:14.423 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-grafana-dashboards noarch 2:18.0.0-6543.g38321be8.el9 ceph-noarch 23 k 2023-10-05T11:26:14.423 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mds x86_64 2:18.0.0-6543.g38321be8.el9 ceph 2.1 M 2023-10-05T11:26:14.423 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-modules-core noarch 2:18.0.0-6543.g38321be8.el9 ceph-noarch 242 k 2023-10-05T11:26:14.423 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mon x86_64 2:18.0.0-6543.g38321be8.el9 ceph 4.4 M 2023-10-05T11:26:14.423 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-osd x86_64 2:18.0.0-6543.g38321be8.el9 ceph 18 M 2023-10-05T11:26:14.423 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-prometheus-alerts noarch 2:18.0.0-6543.g38321be8.el9 ceph-noarch 15 k 2023-10-05T11:26:14.424 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-selinux x86_64 2:18.0.0-6543.g38321be8.el9 ceph 24 k 2023-10-05T11:26:14.424 INFO:teuthology.orchestra.run.smithi170.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2023-10-05T11:26:14.424 INFO:teuthology.orchestra.run.smithi170.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2023-10-05T11:26:14.424 INFO:teuthology.orchestra.run.smithi170.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2023-10-05T11:26:14.424 INFO:teuthology.orchestra.run.smithi170.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2023-10-05T11:26:14.424 INFO:teuthology.orchestra.run.smithi170.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2023-10-05T11:26:14.424 INFO:teuthology.orchestra.run.smithi170.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2023-10-05T11:26:14.424 INFO:teuthology.orchestra.run.smithi170.stdout: jq x86_64 1.6-15.el9 appstream 187 k 2023-10-05T11:26:14.424 INFO:teuthology.orchestra.run.smithi170.stdout: libarrow x86_64 9.0.0-9.el9 epel 4.4 M 2023-10-05T11:26:14.424 INFO:teuthology.orchestra.run.smithi170.stdout: libarrow-doc noarch 9.0.0-9.el9 epel 24 k 2023-10-05T11:26:14.424 INFO:teuthology.orchestra.run.smithi170.stdout: libcephsqlite x86_64 2:18.0.0-6543.g38321be8.el9 ceph 163 k 2023-10-05T11:26:14.425 INFO:teuthology.orchestra.run.smithi170.stdout: libgfortran x86_64 11.4.1-2.1.el9 baseos 809 k 2023-10-05T11:26:14.425 INFO:teuthology.orchestra.run.smithi170.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2023-10-05T11:26:14.425 INFO:teuthology.orchestra.run.smithi170.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2023-10-05T11:26:14.425 INFO:teuthology.orchestra.run.smithi170.stdout: libquadmath x86_64 11.4.1-2.1.el9 baseos 198 k 2023-10-05T11:26:14.425 INFO:teuthology.orchestra.run.smithi170.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2023-10-05T11:26:14.425 INFO:teuthology.orchestra.run.smithi170.stdout: libradosstriper1 x86_64 2:18.0.0-6543.g38321be8.el9 ceph 472 k 2023-10-05T11:26:14.425 INFO:teuthology.orchestra.run.smithi170.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2023-10-05T11:26:14.425 INFO:teuthology.orchestra.run.smithi170.stdout: librgw2 x86_64 2:18.0.0-6543.g38321be8.el9 ceph 4.8 M 2023-10-05T11:26:14.425 INFO:teuthology.orchestra.run.smithi170.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2023-10-05T11:26:14.425 INFO:teuthology.orchestra.run.smithi170.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2023-10-05T11:26:14.425 INFO:teuthology.orchestra.run.smithi170.stdout: oniguruma x86_64 6.9.6-1.el9.5 appstream 218 k 2023-10-05T11:26:14.425 INFO:teuthology.orchestra.run.smithi170.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2023-10-05T11:26:14.426 INFO:teuthology.orchestra.run.smithi170.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2023-10-05T11:26:14.426 INFO:teuthology.orchestra.run.smithi170.stdout: parquet-libs x86_64 9.0.0-9.el9 epel 837 k 2023-10-05T11:26:14.426 INFO:teuthology.orchestra.run.smithi170.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2023-10-05T11:26:14.426 INFO:teuthology.orchestra.run.smithi170.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2023-10-05T11:26:14.426 INFO:teuthology.orchestra.run.smithi170.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2023-10-05T11:26:14.426 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2023-10-05T11:26:14.426 INFO:teuthology.orchestra.run.smithi170.stdout: python3-ceph-argparse x86_64 2:18.0.0-6543.g38321be8.el9 ceph 45 k 2023-10-05T11:26:14.426 INFO:teuthology.orchestra.run.smithi170.stdout: python3-ceph-common x86_64 2:18.0.0-6543.g38321be8.el9 ceph 127 k 2023-10-05T11:26:14.426 INFO:teuthology.orchestra.run.smithi170.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2023-10-05T11:26:14.426 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2023-10-05T11:26:14.426 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2023-10-05T11:26:14.426 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2023-10-05T11:26:14.427 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2023-10-05T11:26:14.427 INFO:teuthology.orchestra.run.smithi170.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2023-10-05T11:26:14.427 INFO:teuthology.orchestra.run.smithi170.stdout: python3-google-auth noarch 1:2.23.0-1.el9 epel 196 k 2023-10-05T11:26:14.427 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2023-10-05T11:26:14.427 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2023-10-05T11:26:14.427 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2023-10-05T11:26:14.427 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2023-10-05T11:26:14.427 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2023-10-05T11:26:14.427 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jinja2 noarch 2.11.3-4.el9 appstream 249 k 2023-10-05T11:26:14.427 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2023-10-05T11:26:14.427 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2023-10-05T11:26:14.427 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2023-10-05T11:26:14.428 INFO:teuthology.orchestra.run.smithi170.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2023-10-05T11:26:14.428 INFO:teuthology.orchestra.run.smithi170.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2023-10-05T11:26:14.428 INFO:teuthology.orchestra.run.smithi170.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2023-10-05T11:26:14.428 INFO:teuthology.orchestra.run.smithi170.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2023-10-05T11:26:14.428 INFO:teuthology.orchestra.run.smithi170.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2023-10-05T11:26:14.428 INFO:teuthology.orchestra.run.smithi170.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2023-10-05T11:26:14.428 INFO:teuthology.orchestra.run.smithi170.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2023-10-05T11:26:14.428 INFO:teuthology.orchestra.run.smithi170.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2023-10-05T11:26:14.428 INFO:teuthology.orchestra.run.smithi170.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2023-10-05T11:26:14.428 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2023-10-05T11:26:14.428 INFO:teuthology.orchestra.run.smithi170.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2023-10-05T11:26:14.429 INFO:teuthology.orchestra.run.smithi170.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2023-10-05T11:26:14.429 INFO:teuthology.orchestra.run.smithi170.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2023-10-05T11:26:14.429 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2023-10-05T11:26:14.429 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2023-10-05T11:26:14.429 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2023-10-05T11:26:14.429 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2023-10-05T11:26:14.429 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2023-10-05T11:26:14.429 INFO:teuthology.orchestra.run.smithi170.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2023-10-05T11:26:14.429 INFO:teuthology.orchestra.run.smithi170.stdout: python3-requests noarch 2.25.1-7.el9 baseos 124 k 2023-10-05T11:26:14.429 INFO:teuthology.orchestra.run.smithi170.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2023-10-05T11:26:14.429 INFO:teuthology.orchestra.run.smithi170.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2023-10-05T11:26:14.429 INFO:teuthology.orchestra.run.smithi170.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2023-10-05T11:26:14.429 INFO:teuthology.orchestra.run.smithi170.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2023-10-05T11:26:14.430 INFO:teuthology.orchestra.run.smithi170.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2023-10-05T11:26:14.430 INFO:teuthology.orchestra.run.smithi170.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2023-10-05T11:26:14.430 INFO:teuthology.orchestra.run.smithi170.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2023-10-05T11:26:14.430 INFO:teuthology.orchestra.run.smithi170.stdout: python3-urllib3 noarch 1.26.5-3.el9 baseos 216 k 2023-10-05T11:26:14.430 INFO:teuthology.orchestra.run.smithi170.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2023-10-05T11:26:14.430 INFO:teuthology.orchestra.run.smithi170.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2023-10-05T11:26:14.430 INFO:teuthology.orchestra.run.smithi170.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2023-10-05T11:26:14.430 INFO:teuthology.orchestra.run.smithi170.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2023-10-05T11:26:14.430 INFO:teuthology.orchestra.run.smithi170.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2023-10-05T11:26:14.430 INFO:teuthology.orchestra.run.smithi170.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2023-10-05T11:26:14.430 INFO:teuthology.orchestra.run.smithi170.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2023-10-05T11:26:14.430 INFO:teuthology.orchestra.run.smithi170.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2023-10-05T11:26:14.431 INFO:teuthology.orchestra.run.smithi170.stdout:Installing weak dependencies: 2023-10-05T11:26:14.431 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2023-10-05T11:26:14.431 INFO:teuthology.orchestra.run.smithi170.stdout: 2023-10-05T11:26:14.431 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction Summary 2023-10-05T11:26:14.431 INFO:teuthology.orchestra.run.smithi170.stdout:======================================================================================= 2023-10-05T11:26:14.431 INFO:teuthology.orchestra.run.smithi170.stdout:Install 116 Packages 2023-10-05T11:26:14.431 INFO:teuthology.orchestra.run.smithi170.stdout:Upgrade 2 Packages 2023-10-05T11:26:14.431 INFO:teuthology.orchestra.run.smithi170.stdout: 2023-10-05T11:26:14.432 INFO:teuthology.orchestra.run.smithi170.stdout:Total download size: 181 M 2023-10-05T11:26:14.432 INFO:teuthology.orchestra.run.smithi170.stdout:Downloading Packages: 2023-10-05T11:26:14.549 INFO:teuthology.orchestra.run.smithi012.stdout:(2/118): ceph-fuse-18.0.0-6543.g38321be8.el9.x8 2.1 MB/s | 855 kB 00:00 2023-10-05T11:26:14.649 INFO:teuthology.orchestra.run.smithi012.stdout:(3/118): ceph-immutable-object-cache-18.0.0-654 1.4 MB/s | 141 kB 00:00 2023-10-05T11:26:14.808 INFO:teuthology.orchestra.run.smithi012.stdout:(4/118): ceph-base-18.0.0-6543.g38321be8.el9.x8 5.9 MB/s | 5.2 MB 00:00 2023-10-05T11:26:14.983 INFO:teuthology.orchestra.run.smithi170.stdout:(1/118): ceph-18.0.0-6543.g38321be8.el9.x86_64. 29 kB/s | 6.5 kB 00:00 2023-10-05T11:26:15.000 INFO:teuthology.orchestra.run.smithi012.stdout:(5/118): ceph-mgr-18.0.0-6543.g38321be8.el9.x86 7.6 MB/s | 1.5 MB 00:00 2023-10-05T11:26:15.367 INFO:teuthology.orchestra.run.smithi012.stdout:(6/118): ceph-mds-18.0.0-6543.g38321be8.el9.x86 2.9 MB/s | 2.1 MB 00:00 2023-10-05T11:26:15.559 INFO:teuthology.orchestra.run.smithi012.stdout:(7/118): ceph-mon-18.0.0-6543.g38321be8.el9.x86 7.8 MB/s | 4.4 MB 00:00 2023-10-05T11:26:15.883 INFO:teuthology.orchestra.run.smithi170.stdout:(2/118): ceph-fuse-18.0.0-6543.g38321be8.el9.x8 951 kB/s | 855 kB 00:00 2023-10-05T11:26:16.000 INFO:teuthology.orchestra.run.smithi170.stdout:(3/118): ceph-immutable-object-cache-18.0.0-654 1.2 MB/s | 141 kB 00:00 2023-10-05T11:26:16.067 INFO:teuthology.orchestra.run.smithi012.stdout:(8/118): ceph-common-18.0.0-6543.g38321be8.el9. 8.9 MB/s | 19 MB 00:02 2023-10-05T11:26:16.117 INFO:teuthology.orchestra.run.smithi012.stdout:(9/118): ceph-selinux-18.0.0-6543.g38321be8.el9 484 kB/s | 24 kB 00:00 2023-10-05T11:26:16.541 INFO:teuthology.orchestra.run.smithi012.stdout:(10/118): ceph-radosgw-18.0.0-6543.g38321be8.el 8.8 MB/s | 8.6 MB 00:00 2023-10-05T11:26:16.601 INFO:teuthology.orchestra.run.smithi012.stdout:(11/118): libcephfs-devel-18.0.0-6543.g38321be8 522 kB/s | 31 kB 00:00 2023-10-05T11:26:16.743 INFO:teuthology.orchestra.run.smithi012.stdout:(12/118): libcephfs2-18.0.0-6543.g38321be8.el9. 4.9 MB/s | 715 kB 00:00 2023-10-05T11:26:16.818 INFO:teuthology.orchestra.run.smithi012.stdout:(13/118): libcephsqlite-18.0.0-6543.g38321be8.e 2.1 MB/s | 163 kB 00:00 2023-10-05T11:26:16.841 INFO:teuthology.orchestra.run.smithi170.stdout:(4/118): ceph-base-18.0.0-6543.g38321be8.el9.x8 2.5 MB/s | 5.2 MB 00:02 2023-10-05T11:26:16.877 INFO:teuthology.orchestra.run.smithi012.stdout:(14/118): librados-devel-18.0.0-6543.g38321be8. 2.1 MB/s | 127 kB 00:00 2023-10-05T11:26:16.892 INFO:teuthology.orchestra.run.smithi170.stdout:(5/118): ceph-mds-18.0.0-6543.g38321be8.el9.x86 2.3 MB/s | 2.1 MB 00:00 2023-10-05T11:26:16.961 INFO:teuthology.orchestra.run.smithi012.stdout:(15/118): libradosstriper1-18.0.0-6543.g38321be 5.5 MB/s | 472 kB 00:00 2023-10-05T11:26:17.617 INFO:teuthology.orchestra.run.smithi170.stdout:(6/118): ceph-mgr-18.0.0-6543.g38321be8.el9.x86 1.9 MB/s | 1.5 MB 00:00 2023-10-05T11:26:17.669 INFO:teuthology.orchestra.run.smithi012.stdout:(16/118): librgw2-18.0.0-6543.g38321be8.el9.x86 6.7 MB/s | 4.8 MB 00:00 2023-10-05T11:26:17.728 INFO:teuthology.orchestra.run.smithi012.stdout:(17/118): python3-ceph-argparse-18.0.0-6543.g38 779 kB/s | 45 kB 00:00 2023-10-05T11:26:17.953 INFO:teuthology.orchestra.run.smithi012.stdout:(18/118): ceph-osd-18.0.0-6543.g38321be8.el9.x8 6.8 MB/s | 18 MB 00:02 2023-10-05T11:26:17.976 INFO:teuthology.orchestra.run.smithi170.stdout:(7/118): ceph-mon-18.0.0-6543.g38321be8.el9.x86 4.0 MB/s | 4.4 MB 00:01 2023-10-05T11:26:17.978 INFO:teuthology.orchestra.run.smithi012.stdout:(19/118): python3-ceph-common-18.0.0-6543.g3832 506 kB/s | 127 kB 00:00 2023-10-05T11:26:18.070 INFO:teuthology.orchestra.run.smithi012.stdout:(20/118): python3-cephfs-18.0.0-6543.g38321be8. 1.4 MB/s | 162 kB 00:00 2023-10-05T11:26:18.095 INFO:teuthology.orchestra.run.smithi012.stdout:(21/118): python3-rados-18.0.0-6543.g38321be8.e 2.7 MB/s | 320 kB 00:00 2023-10-05T11:26:18.154 INFO:teuthology.orchestra.run.smithi012.stdout:(22/118): python3-rbd-18.0.0-6543.g38321be8.el9 3.5 MB/s | 297 kB 00:00 2023-10-05T11:26:18.171 INFO:teuthology.orchestra.run.smithi012.stdout:(23/118): python3-rgw-18.0.0-6543.g38321be8.el9 1.3 MB/s | 100 kB 00:00 2023-10-05T11:26:18.238 INFO:teuthology.orchestra.run.smithi012.stdout:(24/118): rbd-fuse-18.0.0-6543.g38321be8.el9.x8 1.0 MB/s | 85 kB 00:00 2023-10-05T11:26:18.339 INFO:teuthology.orchestra.run.smithi012.stdout:(25/118): rbd-nbd-18.0.0-6543.g38321be8.el9.x86 1.7 MB/s | 169 kB 00:00 2023-10-05T11:26:18.439 INFO:teuthology.orchestra.run.smithi012.stdout:(26/118): ceph-grafana-dashboards-18.0.0-6543.g 232 kB/s | 23 kB 00:00 2023-10-05T11:26:18.556 INFO:teuthology.orchestra.run.smithi012.stdout:(27/118): rbd-mirror-18.0.0-6543.g38321be8.el9. 7.9 MB/s | 3.0 MB 00:00 2023-10-05T11:26:18.581 INFO:teuthology.orchestra.run.smithi012.stdout:(28/118): ceph-mgr-cephadm-18.0.0-6543.g38321be 932 kB/s | 132 kB 00:00 2023-10-05T11:26:18.848 INFO:teuthology.orchestra.run.smithi012.stdout:(29/118): ceph-mgr-dashboard-18.0.0-6543.g38321 6.0 MB/s | 1.8 MB 00:00 2023-10-05T11:26:18.932 INFO:teuthology.orchestra.run.smithi012.stdout:(30/118): ceph-mgr-modules-core-18.0.0-6543.g38 2.9 MB/s | 242 kB 00:00 2023-10-05T11:26:18.998 INFO:teuthology.orchestra.run.smithi012.stdout:(31/118): ceph-mgr-rook-18.0.0-6543.g38321be8.e 714 kB/s | 47 kB 00:00 2023-10-05T11:26:19.065 INFO:teuthology.orchestra.run.smithi012.stdout:(32/118): ceph-prometheus-alerts-18.0.0-6543.g3 220 kB/s | 15 kB 00:00 2023-10-05T11:26:19.124 INFO:teuthology.orchestra.run.smithi012.stdout:(33/118): ceph-volume-18.0.0-6543.g38321be8.el9 4.4 MB/s | 262 kB 00:00 2023-10-05T11:26:19.142 INFO:teuthology.orchestra.run.smithi170.stdout:(8/118): ceph-radosgw-18.0.0-6543.g38321be8.el9 7.4 MB/s | 8.6 MB 00:01 2023-10-05T11:26:19.199 INFO:teuthology.orchestra.run.smithi012.stdout:(34/118): cephadm-18.0.0-6543.g38321be8.el9.noa 3.3 MB/s | 256 kB 00:00 2023-10-05T11:26:19.370 INFO:teuthology.orchestra.run.smithi170.stdout:(9/118): ceph-selinux-18.0.0-6543.g38321be8.el9 322 kB/s | 24 kB 00:00 2023-10-05T11:26:19.370 INFO:teuthology.orchestra.run.smithi012.stdout:(35/118): fuse-2.9.9-15.el9.x86_64.rpm 742 kB/s | 80 kB 00:00 2023-10-05T11:26:19.450 INFO:teuthology.orchestra.run.smithi012.stdout:(36/118): libgfortran-11.4.1-2.1.el9.x86_64.rpm 5.6 MB/s | 809 kB 00:00 2023-10-05T11:26:19.500 INFO:teuthology.orchestra.run.smithi012.stdout:(37/118): libquadmath-11.4.1-2.1.el9.x86_64.rpm 3.9 MB/s | 198 kB 00:00 2023-10-05T11:26:19.559 INFO:teuthology.orchestra.run.smithi012.stdout:(38/118): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.2 MB/s | 253 kB 00:00 2023-10-05T11:26:19.659 INFO:teuthology.orchestra.run.smithi012.stdout:(39/118): ceph-mgr-diskprediction-local-18.0.0- 6.9 MB/s | 7.4 MB 00:01 2023-10-05T11:26:19.701 INFO:teuthology.orchestra.run.smithi012.stdout:(40/118): python3-cryptography-36.0.1-4.el9.x86 8.6 MB/s | 1.2 MB 00:00 2023-10-05T11:26:19.752 INFO:teuthology.orchestra.run.smithi012.stdout:(41/118): python3-pycparser-2.20-6.el9.noarch.r 2.7 MB/s | 135 kB 00:00 2023-10-05T11:26:19.777 INFO:teuthology.orchestra.run.smithi012.stdout:(42/118): python3-ply-3.11-14.el9.noarch.rpm 910 kB/s | 106 kB 00:00 2023-10-05T11:26:19.802 INFO:teuthology.orchestra.run.smithi012.stdout:(43/118): python3-requests-2.25.1-7.el9.noarch. 2.4 MB/s | 124 kB 00:00 2023-10-05T11:26:19.861 INFO:teuthology.orchestra.run.smithi012.stdout:(44/118): python3-urllib3-1.26.5-3.el9.noarch.r 2.5 MB/s | 216 kB 00:00 2023-10-05T11:26:19.994 INFO:teuthology.orchestra.run.smithi012.stdout:(45/118): flexiblas-3.0.4-8.el9.x86_64.rpm 245 kB/s | 33 kB 00:00 2023-10-05T11:26:20.045 INFO:teuthology.orchestra.run.smithi012.stdout:(46/118): boost-program-options-1.75.0-8.el9.x8 441 kB/s | 107 kB 00:00 2023-10-05T11:26:20.095 INFO:teuthology.orchestra.run.smithi012.stdout:(47/118): flexiblas-openblas-openmp-3.0.4-8.el9 364 kB/s | 18 kB 00:00 2023-10-05T11:26:20.195 INFO:teuthology.orchestra.run.smithi012.stdout:(48/118): jq-1.6-15.el9.x86_64.rpm 1.8 MB/s | 187 kB 00:00 2023-10-05T11:26:20.254 INFO:teuthology.orchestra.run.smithi012.stdout:(49/118): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.7 MB/s | 160 kB 00:00 2023-10-05T11:26:20.346 INFO:teuthology.orchestra.run.smithi012.stdout:(50/118): librabbitmq-0.11.0-7.el9.x86_64.rpm 493 kB/s | 45 kB 00:00 2023-10-05T11:26:20.397 INFO:teuthology.orchestra.run.smithi012.stdout:(51/118): flexiblas-netlib-3.0.4-8.el9.x86_64.r 7.4 MB/s | 3.0 MB 00:00 2023-10-05T11:26:20.488 INFO:teuthology.orchestra.run.smithi012.stdout:(52/118): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.1 MB/s | 292 kB 00:00 2023-10-05T11:26:20.522 INFO:teuthology.orchestra.run.smithi012.stdout:(53/118): librdkafka-1.6.1-102.el9.x86_64.rpm 3.7 MB/s | 662 kB 00:00 2023-10-05T11:26:20.556 INFO:teuthology.orchestra.run.smithi012.stdout:(54/118): oniguruma-6.9.6-1.el9.5.x86_64.rpm 3.2 MB/s | 218 kB 00:00 2023-10-05T11:26:20.581 INFO:teuthology.orchestra.run.smithi012.stdout:(55/118): openblas-0.3.21-2.el9.x86_64.rpm 604 kB/s | 35 kB 00:00 2023-10-05T11:26:20.759 INFO:teuthology.orchestra.run.smithi170.stdout:(10/118): ceph-common-18.0.0-6543.g38321be8.el9 3.2 MB/s | 19 MB 00:06 2023-10-05T11:26:20.818 INFO:teuthology.orchestra.run.smithi170.stdout:(11/118): libcephfs-devel-18.0.0-6543.g38321be8 536 kB/s | 31 kB 00:00 2023-10-05T11:26:20.898 INFO:teuthology.orchestra.run.smithi012.stdout:(56/118): openblas-openmp-0.3.21-2.el9.x86_64.r 14 MB/s | 4.7 MB 00:00 2023-10-05T11:26:20.957 INFO:teuthology.orchestra.run.smithi012.stdout:(57/118): python3-devel-3.9.17-2.el9.x86_64.rpm 4.1 MB/s | 245 kB 00:00 2023-10-05T11:26:21.015 INFO:teuthology.orchestra.run.smithi012.stdout:(58/118): python3-jinja2-2.11.3-4.el9.noarch.rp 4.2 MB/s | 249 kB 00:00 2023-10-05T11:26:21.018 INFO:teuthology.orchestra.run.smithi170.stdout:(12/118): libcephfs2-18.0.0-6543.g38321be8.el9. 3.5 MB/s | 715 kB 00:00 2023-10-05T11:26:21.074 INFO:teuthology.orchestra.run.smithi012.stdout:(59/118): python3-jsonpatch-1.21-16.el9.noarch. 441 kB/s | 26 kB 00:00 2023-10-05T11:26:21.085 INFO:teuthology.orchestra.run.smithi170.stdout:(13/118): libcephsqlite-18.0.0-6543.g38321be8.e 2.4 MB/s | 163 kB 00:00 2023-10-05T11:26:21.132 INFO:teuthology.orchestra.run.smithi012.stdout:(60/118): python3-jsonpointer-2.0-4.el9.noarch. 328 kB/s | 19 kB 00:00 2023-10-05T11:26:21.152 INFO:teuthology.orchestra.run.smithi170.stdout:(14/118): librados-devel-18.0.0-6543.g38321be8. 1.9 MB/s | 127 kB 00:00 2023-10-05T11:26:21.249 INFO:teuthology.orchestra.run.smithi012.stdout:(61/118): python3-babel-2.9.1-2.el9.noarch.rpm 8.9 MB/s | 6.0 MB 00:00 2023-10-05T11:26:21.269 INFO:teuthology.orchestra.run.smithi170.stdout:(15/118): libradosstriper1-18.0.0-6543.g38321be 4.0 MB/s | 472 kB 00:00 2023-10-05T11:26:21.274 INFO:teuthology.orchestra.run.smithi012.stdout:(62/118): python3-mako-1.1.4-6.el9.noarch.rpm 1.2 MB/s | 172 kB 00:00 2023-10-05T11:26:21.650 INFO:teuthology.orchestra.run.smithi012.stdout:(63/118): ceph-test-18.0.0-6543.g38321be8.el9.x 7.4 MB/s | 41 MB 00:05 2023-10-05T11:26:21.675 INFO:teuthology.orchestra.run.smithi012.stdout:(64/118): python3-markupsafe-1.1.1-12.el9.x86_6 82 kB/s | 35 kB 00:00 2023-10-05T11:26:21.775 INFO:teuthology.orchestra.run.smithi012.stdout:(65/118): python3-oauthlib-3.1.1-5.el9.noarch.r 2.2 MB/s | 222 kB 00:00 2023-10-05T11:26:21.842 INFO:teuthology.orchestra.run.smithi012.stdout:(66/118): python3-numpy-1.20.1-5.el9.x86_64.rpm 9.0 MB/s | 5.1 MB 00:00 2023-10-05T11:26:21.867 INFO:teuthology.orchestra.run.smithi012.stdout:(67/118): python3-prettytable-0.7.2-27.el9.noar 460 kB/s | 42 kB 00:00 2023-10-05T11:26:21.901 INFO:teuthology.orchestra.run.smithi012.stdout:(68/118): python3-numpy-f2py-1.20.1-5.el9.x86_6 999 kB/s | 250 kB 00:00 2023-10-05T11:26:21.918 INFO:teuthology.orchestra.run.smithi012.stdout:(69/118): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.1 MB/s | 159 kB 00:00 2023-10-05T11:26:21.943 INFO:teuthology.orchestra.run.smithi012.stdout:(70/118): python3-pyasn1-modules-0.4.8-6.el9.no 3.6 MB/s | 279 kB 00:00 2023-10-05T11:26:21.960 INFO:teuthology.orchestra.run.smithi012.stdout:(71/118): python3-pytz-2021.1-5.el9.noarch.rpm 869 kB/s | 51 kB 00:00 2023-10-05T11:26:21.977 INFO:teuthology.orchestra.run.smithi012.stdout:(72/118): python3-requests-oauthlib-1.3.0-12.el 911 kB/s | 54 kB 00:00 2023-10-05T11:26:22.002 INFO:teuthology.orchestra.run.smithi170.stdout:(16/118): librgw2-18.0.0-6543.g38321be8.el9.x86 6.5 MB/s | 4.8 MB 00:00 2023-10-05T11:26:22.011 INFO:teuthology.orchestra.run.smithi012.stdout:(73/118): python3-toml-0.10.2-6.el9.noarch.rpm 833 kB/s | 42 kB 00:00 2023-10-05T11:26:22.044 INFO:teuthology.orchestra.run.smithi012.stdout:(74/118): socat-1.7.4.1-5.el9.x86_64.rpm 4.5 MB/s | 305 kB 00:00 2023-10-05T11:26:22.061 INFO:teuthology.orchestra.run.smithi170.stdout:(17/118): python3-ceph-argparse-18.0.0-6543.g38 775 kB/s | 45 kB 00:00 2023-10-05T11:26:22.070 INFO:teuthology.orchestra.run.smithi012.stdout:(75/118): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.1 MB/s | 64 kB 00:00 2023-10-05T11:26:22.128 INFO:teuthology.orchestra.run.smithi170.stdout:(18/118): python3-ceph-common-18.0.0-6543.g3832 1.9 MB/s | 127 kB 00:00 2023-10-05T11:26:22.187 INFO:teuthology.orchestra.run.smithi170.stdout:(19/118): python3-cephfs-18.0.0-6543.g38321be8. 2.7 MB/s | 162 kB 00:00 2023-10-05T11:26:22.253 INFO:teuthology.orchestra.run.smithi012.stdout:(76/118): fmt-8.1.1-5.el9.x86_64.rpm 531 kB/s | 111 kB 00:00 2023-10-05T11:26:22.278 INFO:teuthology.orchestra.run.smithi170.stdout:(20/118): python3-rados-18.0.0-6543.g38321be8.e 3.4 MB/s | 320 kB 00:00 2023-10-05T11:26:22.320 INFO:teuthology.orchestra.run.smithi012.stdout:(77/118): gperftools-libs-2.9.1-2.el9.x86_64.rp 1.2 MB/s | 309 kB 00:00 2023-10-05T11:26:22.362 INFO:teuthology.orchestra.run.smithi170.stdout:(21/118): python3-rbd-18.0.0-6543.g38321be8.el9 3.5 MB/s | 297 kB 00:00 2023-10-05T11:26:22.387 INFO:teuthology.orchestra.run.smithi012.stdout:(78/118): libarrow-doc-9.0.0-9.el9.noarch.rpm 365 kB/s | 24 kB 00:00 2023-10-05T11:26:22.420 INFO:teuthology.orchestra.run.smithi170.stdout:(22/118): python3-rgw-18.0.0-6543.g38321be8.el9 1.7 MB/s | 100 kB 00:00 2023-10-05T11:26:22.456 INFO:teuthology.orchestra.run.smithi012.stdout:(79/118): liboath-2.6.7-2.el9.x86_64.rpm 708 kB/s | 49 kB 00:00 2023-10-05T11:26:22.488 INFO:teuthology.orchestra.run.smithi170.stdout:(23/118): rbd-fuse-18.0.0-6543.g38321be8.el9.x8 1.2 MB/s | 85 kB 00:00 2023-10-05T11:26:22.582 INFO:teuthology.orchestra.run.smithi012.stdout:(80/118): libarrow-9.0.0-9.el9.x86_64.rpm 13 MB/s | 4.4 MB 00:00 2023-10-05T11:26:22.606 INFO:teuthology.orchestra.run.smithi012.stdout:(81/118): libunwind-1.6.2-1.el9.x86_64.rpm 449 kB/s | 67 kB 00:00 2023-10-05T11:26:22.674 INFO:teuthology.orchestra.run.smithi012.stdout:(82/118): parquet-libs-9.0.0-9.el9.x86_64.rpm 8.9 MB/s | 837 kB 00:00 2023-10-05T11:26:22.733 INFO:teuthology.orchestra.run.smithi012.stdout:(83/118): python3-asyncssh-2.13.2-3.el9.noarch. 4.2 MB/s | 548 kB 00:00 2023-10-05T11:26:22.758 INFO:teuthology.orchestra.run.smithi012.stdout:(84/118): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 516 kB/s | 43 kB 00:00 2023-10-05T11:26:22.800 INFO:teuthology.orchestra.run.smithi012.stdout:(85/118): python3-cachetools-4.2.4-1.el9.noarch 482 kB/s | 32 kB 00:00 2023-10-05T11:26:22.834 INFO:teuthology.orchestra.run.smithi012.stdout:(86/118): python3-certifi-2021.10.8-2.el9.noarc 199 kB/s | 15 kB 00:00 2023-10-05T11:26:22.963 INFO:teuthology.orchestra.run.smithi170.stdout:(24/118): ceph-test-18.0.0-6543.g38321be8.el9.x 11 MB/s | 41 MB 00:03 2023-10-05T11:26:23.009 INFO:teuthology.orchestra.run.smithi012.stdout:(87/118): python3-scipy-1.6.2-8.el9.x86_64.rpm 15 MB/s | 16 MB 00:01 2023-10-05T11:26:23.034 INFO:teuthology.orchestra.run.smithi012.stdout:(88/118): python3-cheroot-8.6.0-4.el9.noarch.rp 734 kB/s | 172 kB 00:00 2023-10-05T11:26:23.060 INFO:teuthology.orchestra.run.smithi012.stdout:(89/118): python3-cherrypy-18.6.1-2.el9.noarch. 1.6 MB/s | 358 kB 00:00 2023-10-05T11:26:23.093 INFO:teuthology.orchestra.run.smithi012.stdout:(90/118): python3-jaraco-8.2.1-3.el9.noarch.rpm 183 kB/s | 11 kB 00:00 2023-10-05T11:26:23.118 INFO:teuthology.orchestra.run.smithi012.stdout:(91/118): python3-jaraco-classes-3.2.1-5.el9.no 302 kB/s | 18 kB 00:00 2023-10-05T11:26:23.144 INFO:teuthology.orchestra.run.smithi012.stdout:(92/118): python3-jaraco-collections-3.0.0-8.el 459 kB/s | 23 kB 00:00 2023-10-05T11:26:23.155 INFO:teuthology.orchestra.run.smithi170.stdout:(25/118): ceph-osd-18.0.0-6543.g38321be8.el9.x8 3.2 MB/s | 18 MB 00:05 2023-10-05T11:26:23.169 INFO:teuthology.orchestra.run.smithi012.stdout:(93/118): python3-jaraco-functools-3.5.0-2.el9. 388 kB/s | 19 kB 00:00 2023-10-05T11:26:23.180 INFO:teuthology.orchestra.run.smithi170.stdout:(26/118): rbd-nbd-18.0.0-6543.g38321be8.el9.x86 779 kB/s | 169 kB 00:00 2023-10-05T11:26:23.194 INFO:teuthology.orchestra.run.smithi012.stdout:(94/118): python3-jaraco-text-3.2.0-6.el9.noarc 392 kB/s | 20 kB 00:00 2023-10-05T11:26:23.205 INFO:teuthology.orchestra.run.smithi170.stdout:(27/118): ceph-grafana-dashboards-18.0.0-6543.g 464 kB/s | 23 kB 00:00 2023-10-05T11:26:23.228 INFO:teuthology.orchestra.run.smithi012.stdout:(95/118): python3-jwt+crypto-2.4.0-1.el9.noarch 154 kB/s | 9.0 kB 00:00 2023-10-05T11:26:23.239 INFO:teuthology.orchestra.run.smithi170.stdout:(28/118): ceph-mgr-cephadm-18.0.0-6543.g38321be 2.2 MB/s | 132 kB 00:00 2023-10-05T11:26:23.253 INFO:teuthology.orchestra.run.smithi012.stdout:(96/118): python3-jwt-2.4.0-1.el9.noarch.rpm 701 kB/s | 41 kB 00:00 2023-10-05T11:26:23.278 INFO:teuthology.orchestra.run.smithi012.stdout:(97/118): python3-google-auth-2.23.0-1.el9.noar 728 kB/s | 196 kB 00:00 2023-10-05T11:26:23.298 INFO:teuthology.orchestra.run.smithi170.stdout:(29/118): rbd-mirror-18.0.0-6543.g38321be8.el9. 3.7 MB/s | 3.0 MB 00:00 2023-10-05T11:26:23.320 INFO:teuthology.orchestra.run.smithi012.stdout:(98/118): python3-kubernetes-26.1.0-2.el9.noarc 11 MB/s | 1.0 MB 00:00 2023-10-05T11:26:23.346 INFO:teuthology.orchestra.run.smithi012.stdout:(99/118): python3-logutils-0.3.5-21.el9.noarch. 501 kB/s | 46 kB 00:00 2023-10-05T11:26:23.371 INFO:teuthology.orchestra.run.smithi012.stdout:(100/118): python3-more-itertools-8.12.0-2.el9. 855 kB/s | 79 kB 00:00 2023-10-05T11:26:23.388 INFO:teuthology.orchestra.run.smithi012.stdout:(101/118): python3-natsort-7.1.1-5.el9.noarch.r 858 kB/s | 58 kB 00:00 2023-10-05T11:26:23.390 INFO:teuthology.orchestra.run.smithi170.stdout:(30/118): ceph-mgr-modules-core-18.0.0-6543.g38 2.6 MB/s | 242 kB 00:00 2023-10-05T11:26:23.430 INFO:teuthology.orchestra.run.smithi012.stdout:(102/118): python3-pecan-1.4.2-3.el9.noarch.rpm 3.2 MB/s | 272 kB 00:00 2023-10-05T11:26:23.447 INFO:teuthology.orchestra.run.smithi012.stdout:(103/118): python3-portend-3.1.0-2.el9.noarch.r 217 kB/s | 16 kB 00:00 2023-10-05T11:26:23.457 INFO:teuthology.orchestra.run.smithi170.stdout:(31/118): ceph-mgr-rook-18.0.0-6543.g38321be8.e 715 kB/s | 47 kB 00:00 2023-10-05T11:26:23.472 INFO:teuthology.orchestra.run.smithi012.stdout:(104/118): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.0 MB/s | 90 kB 00:00 2023-10-05T11:26:23.489 INFO:teuthology.orchestra.run.smithi012.stdout:(105/118): python3-repoze-lru-0.7-16.el9.noarch 524 kB/s | 31 kB 00:00 2023-10-05T11:26:23.507 INFO:teuthology.orchestra.run.smithi170.stdout:(32/118): ceph-prometheus-alerts-18.0.0-6543.g3 294 kB/s | 15 kB 00:00 2023-10-05T11:26:23.523 INFO:teuthology.orchestra.run.smithi012.stdout:(106/118): python3-rsa-4.9-2.el9.noarch.rpm 1.2 MB/s | 59 kB 00:00 2023-10-05T11:26:23.548 INFO:teuthology.orchestra.run.smithi012.stdout:(107/118): python3-routes-2.5.1-5.el9.noarch.rp 1.8 MB/s | 188 kB 00:00 2023-10-05T11:26:23.573 INFO:teuthology.orchestra.run.smithi012.stdout:(108/118): python3-tempora-5.0.0-2.el9.noarch.r 426 kB/s | 36 kB 00:00 2023-10-05T11:26:23.582 INFO:teuthology.orchestra.run.smithi170.stdout:(33/118): ceph-volume-18.0.0-6543.g38321be8.el9 3.4 MB/s | 262 kB 00:00 2023-10-05T11:26:23.598 INFO:teuthology.orchestra.run.smithi012.stdout:(109/118): python3-typing-extensions-4.4.0-2.el 676 kB/s | 51 kB 00:00 2023-10-05T11:26:23.623 INFO:teuthology.orchestra.run.smithi012.stdout:(110/118): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2023-10-05T11:26:23.624 INFO:teuthology.orchestra.run.smithi170.stdout:(34/118): ceph-mgr-dashboard-18.0.0-6543.g38321 4.2 MB/s | 1.8 MB 00:00 2023-10-05T11:26:23.649 INFO:teuthology.orchestra.run.smithi012.stdout:(111/118): python3-webob-1.8.7-6.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2023-10-05T11:26:23.675 INFO:teuthology.orchestra.run.smithi170.stdout:(35/118): cephadm-18.0.0-6543.g38321be8.el9.noa 2.7 MB/s | 256 kB 00:00 2023-10-05T11:26:23.683 INFO:teuthology.orchestra.run.smithi012.stdout:(112/118): python3-werkzeug-2.0.3-3.el9.1.noarc 5.0 MB/s | 427 kB 00:00 2023-10-05T11:26:23.708 INFO:teuthology.orchestra.run.smithi012.stdout:(113/118): python3-zc-lockfile-2.0-10.el9.noarc 237 kB/s | 20 kB 00:00 2023-10-05T11:26:23.742 INFO:teuthology.orchestra.run.smithi012.stdout:(114/118): re2-20211101-3.el9.x86_64.rpm 2.0 MB/s | 192 kB 00:00 2023-10-05T11:26:23.767 INFO:teuthology.orchestra.run.smithi012.stdout:(115/118): s3cmd-2.3.0-4.el9.noarch.rpm 2.3 MB/s | 197 kB 00:00 2023-10-05T11:26:23.850 INFO:teuthology.orchestra.run.smithi012.stdout:(116/118): thrift-0.15.0-2.el9.x86_64.rpm 11 MB/s | 1.6 MB 00:00 2023-10-05T11:26:23.892 INFO:teuthology.orchestra.run.smithi170.stdout:(36/118): ceph-mgr-diskprediction-local-18.0.0- 11 MB/s | 7.4 MB 00:00 2023-10-05T11:26:24.033 INFO:teuthology.orchestra.run.smithi170.stdout:(37/118): fuse-2.9.9-15.el9.x86_64.rpm 196 kB/s | 80 kB 00:00 2023-10-05T11:26:24.126 INFO:teuthology.orchestra.run.smithi012.stdout:(117/118): librbd1-18.0.0-6543.g38321be8.el9.x8 8.5 MB/s | 3.0 MB 00:00 2023-10-05T11:26:24.243 INFO:teuthology.orchestra.run.smithi012.stdout:(118/118): librados2-18.0.0-6543.g38321be8.el9. 6.6 MB/s | 3.3 MB 00:00 2023-10-05T11:26:24.246 INFO:teuthology.orchestra.run.smithi012.stdout:-------------------------------------------------------------------------------- 2023-10-05T11:26:24.247 INFO:teuthology.orchestra.run.smithi012.stdout:Total 17 MB/s | 181 MB 00:10 2023-10-05T11:26:24.317 INFO:teuthology.orchestra.run.smithi170.stdout:(38/118): python3-cffi-1.14.5-5.el9.x86_64.rpm 894 kB/s | 253 kB 00:00 2023-10-05T11:26:24.376 INFO:teuthology.orchestra.run.smithi170.stdout:(39/118): libgfortran-11.4.1-2.1.el9.x86_64.rpm 1.1 MB/s | 809 kB 00:00 2023-10-05T11:26:24.417 INFO:teuthology.orchestra.run.smithi170.stdout:(40/118): libquadmath-11.4.1-2.1.el9.x86_64.rpm 377 kB/s | 198 kB 00:00 2023-10-05T11:26:24.485 INFO:teuthology.orchestra.run.smithi170.stdout:(41/118): python3-ply-3.11-14.el9.noarch.rpm 981 kB/s | 106 kB 00:00 2023-10-05T11:26:24.576 INFO:teuthology.orchestra.run.smithi170.stdout:(42/118): python3-pycparser-2.20-6.el9.noarch.r 853 kB/s | 135 kB 00:00 2023-10-05T11:26:24.602 INFO:teuthology.orchestra.run.smithi170.stdout:(43/118): python3-requests-2.25.1-7.el9.noarch. 1.0 MB/s | 124 kB 00:00 2023-10-05T11:26:24.643 INFO:teuthology.orchestra.run.smithi170.stdout:(44/118): python3-cryptography-36.0.1-4.el9.x86 3.8 MB/s | 1.2 MB 00:00 2023-10-05T11:26:24.752 INFO:teuthology.orchestra.run.smithi170.stdout:(45/118): python3-urllib3-1.26.5-3.el9.noarch.r 1.2 MB/s | 216 kB 00:00 2023-10-05T11:26:24.936 INFO:teuthology.orchestra.run.smithi170.stdout:(46/118): flexiblas-3.0.4-8.el9.x86_64.rpm 112 kB/s | 33 kB 00:00 2023-10-05T11:26:24.953 INFO:teuthology.orchestra.run.smithi012.stdout:Running transaction check 2023-10-05T11:26:25.044 INFO:teuthology.orchestra.run.smithi170.stdout:(47/118): boost-program-options-1.75.0-8.el9.x8 242 kB/s | 107 kB 00:00 2023-10-05T11:26:25.056 INFO:teuthology.orchestra.run.smithi012.stdout:Transaction check succeeded. 2023-10-05T11:26:25.056 INFO:teuthology.orchestra.run.smithi012.stdout:Running transaction test 2023-10-05T11:26:25.061 INFO:teuthology.orchestra.run.smithi170.stdout:(48/118): flexiblas-openblas-openmp-3.0.4-8.el9 145 kB/s | 18 kB 00:00 2023-10-05T11:26:25.370 INFO:teuthology.orchestra.run.smithi170.stdout:(49/118): jq-1.6-15.el9.x86_64.rpm 574 kB/s | 187 kB 00:00 2023-10-05T11:26:25.395 INFO:teuthology.orchestra.run.smithi170.stdout:(50/118): libpmemobj-1.12.1-1.el9.x86_64.rpm 480 kB/s | 160 kB 00:00 2023-10-05T11:26:25.470 INFO:teuthology.orchestra.run.smithi170.stdout:(51/118): librabbitmq-0.11.0-7.el9.x86_64.rpm 451 kB/s | 45 kB 00:00 2023-10-05T11:26:25.654 INFO:teuthology.orchestra.run.smithi170.stdout:(52/118): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.6 MB/s | 292 kB 00:00 2023-10-05T11:26:25.721 INFO:teuthology.orchestra.run.smithi170.stdout:(53/118): flexiblas-netlib-3.0.4-8.el9.x86_64.r 3.1 MB/s | 3.0 MB 00:00 2023-10-05T11:26:25.746 INFO:teuthology.orchestra.run.smithi170.stdout:(54/118): librdkafka-1.6.1-102.el9.x86_64.rpm 1.8 MB/s | 662 kB 00:00 2023-10-05T11:26:25.771 INFO:teuthology.orchestra.run.smithi170.stdout:(55/118): oniguruma-6.9.6-1.el9.5.x86_64.rpm 1.8 MB/s | 218 kB 00:00 2023-10-05T11:26:25.822 INFO:teuthology.orchestra.run.smithi170.stdout:(56/118): openblas-0.3.21-2.el9.x86_64.rpm 350 kB/s | 35 kB 00:00 2023-10-05T11:26:25.930 INFO:teuthology.orchestra.run.smithi170.stdout:(57/118): python3-devel-3.9.17-2.el9.x86_64.rpm 2.2 MB/s | 245 kB 00:00 2023-10-05T11:26:26.047 INFO:teuthology.orchestra.run.smithi170.stdout:(58/118): python3-jinja2-2.11.3-4.el9.noarch.rp 2.1 MB/s | 249 kB 00:00 2023-10-05T11:26:26.156 INFO:teuthology.orchestra.run.smithi170.stdout:(59/118): python3-jsonpatch-1.21-16.el9.noarch. 237 kB/s | 26 kB 00:00 2023-10-05T11:26:26.307 INFO:teuthology.orchestra.run.smithi170.stdout:(60/118): openblas-openmp-0.3.21-2.el9.x86_64.r 8.5 MB/s | 4.7 MB 00:00 2023-10-05T11:26:26.332 INFO:teuthology.orchestra.run.smithi170.stdout:(61/118): python3-jsonpointer-2.0-4.el9.noarch. 109 kB/s | 19 kB 00:00 2023-10-05T11:26:26.440 INFO:teuthology.orchestra.run.smithi170.stdout:(62/118): python3-markupsafe-1.1.1-12.el9.x86_6 321 kB/s | 35 kB 00:00 2023-10-05T11:26:26.516 INFO:teuthology.orchestra.run.smithi170.stdout:(63/118): python3-mako-1.1.4-6.el9.noarch.rpm 826 kB/s | 172 kB 00:00 2023-10-05T11:26:26.730 INFO:teuthology.orchestra.run.smithi012.stdout:Transaction test succeeded. 2023-10-05T11:26:26.730 INFO:teuthology.orchestra.run.smithi012.stdout:Running transaction 2023-10-05T11:26:26.866 INFO:teuthology.orchestra.run.smithi170.stdout:(64/118): python3-numpy-f2py-1.20.1-5.el9.x86_6 716 kB/s | 250 kB 00:00 2023-10-05T11:26:27.074 INFO:teuthology.orchestra.run.smithi170.stdout:(65/118): python3-numpy-1.20.1-5.el9.x86_64.rpm 8.0 MB/s | 5.1 MB 00:00 2023-10-05T11:26:27.191 INFO:teuthology.orchestra.run.smithi170.stdout:(66/118): python3-prettytable-0.7.2-27.el9.noar 362 kB/s | 42 kB 00:00 2023-10-05T11:26:27.217 INFO:teuthology.orchestra.run.smithi170.stdout:(67/118): python3-oauthlib-3.1.1-5.el9.noarch.r 634 kB/s | 222 kB 00:00 2023-10-05T11:26:27.400 INFO:teuthology.orchestra.run.smithi170.stdout:(68/118): python3-babel-2.9.1-2.el9.noarch.rpm 3.7 MB/s | 6.0 MB 00:01 2023-10-05T11:26:27.425 INFO:teuthology.orchestra.run.smithi170.stdout:(69/118): python3-pyasn1-0.4.8-6.el9.noarch.rpm 679 kB/s | 159 kB 00:00 2023-10-05T11:26:27.501 INFO:teuthology.orchestra.run.smithi170.stdout:(70/118): python3-pytz-2021.1-5.el9.noarch.rpm 509 kB/s | 51 kB 00:00 2023-10-05T11:26:27.534 INFO:teuthology.orchestra.run.smithi170.stdout:(71/118): python3-pyasn1-modules-0.4.8-6.el9.no 879 kB/s | 279 kB 00:00 2023-10-05T11:26:27.551 INFO:teuthology.orchestra.run.smithi170.stdout:(72/118): python3-requests-oauthlib-1.3.0-12.el 427 kB/s | 54 kB 00:00 2023-10-05T11:26:27.626 INFO:teuthology.orchestra.run.smithi170.stdout:(73/118): python3-toml-0.10.2-6.el9.noarch.rpm 453 kB/s | 42 kB 00:00 2023-10-05T11:26:27.660 INFO:teuthology.orchestra.run.smithi170.stdout:(74/118): socat-1.7.4.1-5.el9.x86_64.rpm 2.7 MB/s | 305 kB 00:00 2023-10-05T11:26:27.719 INFO:teuthology.orchestra.run.smithi170.stdout:(75/118): xmlstarlet-1.6.1-20.el9.x86_64.rpm 692 kB/s | 64 kB 00:00 2023-10-05T11:26:27.935 INFO:teuthology.orchestra.run.smithi170.stdout:(76/118): fmt-8.1.1-5.el9.x86_64.rpm 402 kB/s | 111 kB 00:00 2023-10-05T11:26:28.052 INFO:teuthology.orchestra.run.smithi170.stdout:(77/118): gperftools-libs-2.9.1-2.el9.x86_64.rp 926 kB/s | 309 kB 00:00 2023-10-05T11:26:28.144 INFO:teuthology.orchestra.run.smithi170.stdout:(78/118): libarrow-doc-9.0.0-9.el9.noarch.rpm 266 kB/s | 24 kB 00:00 2023-10-05T11:26:28.236 INFO:teuthology.orchestra.run.smithi170.stdout:(79/118): liboath-2.6.7-2.el9.x86_64.rpm 530 kB/s | 49 kB 00:00 2023-10-05T11:26:28.303 INFO:teuthology.orchestra.run.smithi170.stdout:(80/118): libarrow-9.0.0-9.el9.x86_64.rpm 12 MB/s | 4.4 MB 00:00 2023-10-05T11:26:28.328 INFO:teuthology.orchestra.run.smithi170.stdout:(81/118): libunwind-1.6.2-1.el9.x86_64.rpm 733 kB/s | 67 kB 00:00 2023-10-05T11:26:28.462 INFO:teuthology.orchestra.run.smithi170.stdout:(82/118): parquet-libs-9.0.0-9.el9.x86_64.rpm 5.2 MB/s | 837 kB 00:00 2023-10-05T11:26:28.504 INFO:teuthology.orchestra.run.smithi170.stdout:(83/118): python3-asyncssh-2.13.2-3.el9.noarch. 3.1 MB/s | 548 kB 00:00 2023-10-05T11:26:28.554 INFO:teuthology.orchestra.run.smithi170.stdout:(84/118): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 473 kB/s | 43 kB 00:00 2023-10-05T11:26:28.579 INFO:teuthology.orchestra.run.smithi170.stdout:(85/118): python3-cachetools-4.2.4-1.el9.noarch 427 kB/s | 32 kB 00:00 2023-10-05T11:26:28.646 INFO:teuthology.orchestra.run.smithi170.stdout:(86/118): python3-certifi-2021.10.8-2.el9.noarc 163 kB/s | 15 kB 00:00 2023-10-05T11:26:28.688 INFO:teuthology.orchestra.run.smithi170.stdout:(87/118): python3-cheroot-8.6.0-4.el9.noarch.rp 1.5 MB/s | 172 kB 00:00 2023-10-05T11:26:28.747 INFO:teuthology.orchestra.run.smithi170.stdout:(88/118): python3-cherrypy-18.6.1-2.el9.noarch. 3.5 MB/s | 358 kB 00:00 2023-10-05T11:26:28.789 INFO:teuthology.orchestra.run.smithi170.stdout:(89/118): python3-google-auth-2.23.0-1.el9.noar 1.9 MB/s | 196 kB 00:00 2023-10-05T11:26:28.814 INFO:teuthology.orchestra.run.smithi170.stdout:(90/118): python3-jaraco-8.2.1-3.el9.noarch.rpm 159 kB/s | 11 kB 00:00 2023-10-05T11:26:28.873 INFO:teuthology.orchestra.run.smithi170.stdout:(91/118): python3-jaraco-classes-3.2.1-5.el9.no 211 kB/s | 18 kB 00:00 2023-10-05T11:26:28.914 INFO:teuthology.orchestra.run.smithi170.stdout:(92/118): python3-jaraco-collections-3.0.0-8.el 233 kB/s | 23 kB 00:00 2023-10-05T11:26:28.948 INFO:teuthology.orchestra.run.smithi170.stdout:(93/118): python3-jaraco-functools-3.5.0-2.el9. 258 kB/s | 19 kB 00:00 2023-10-05T11:26:28.999 INFO:teuthology.orchestra.run.smithi170.stdout:(94/118): python3-jaraco-text-3.2.0-6.el9.noarc 233 kB/s | 20 kB 00:00 2023-10-05T11:26:29.032 INFO:teuthology.orchestra.run.smithi170.stdout:(95/118): python3-jwt+crypto-2.4.0-1.el9.noarch 108 kB/s | 9.0 kB 00:00 2023-10-05T11:26:29.074 INFO:teuthology.orchestra.run.smithi170.stdout:(96/118): python3-jwt-2.4.0-1.el9.noarch.rpm 543 kB/s | 41 kB 00:00 2023-10-05T11:26:29.166 INFO:teuthology.orchestra.run.smithi170.stdout:(97/118): python3-logutils-0.3.5-21.el9.noarch. 506 kB/s | 46 kB 00:00 2023-10-05T11:26:29.250 INFO:teuthology.orchestra.run.smithi170.stdout:(98/118): python3-kubernetes-26.1.0-2.el9.noarc 4.7 MB/s | 1.0 MB 00:00 2023-10-05T11:26:29.275 INFO:teuthology.orchestra.run.smithi170.stdout:(99/118): python3-more-itertools-8.12.0-2.el9.n 726 kB/s | 79 kB 00:00 2023-10-05T11:26:29.334 INFO:teuthology.orchestra.run.smithi170.stdout:(100/118): python3-natsort-7.1.1-5.el9.noarch.r 692 kB/s | 58 kB 00:00 2023-10-05T11:26:29.384 INFO:teuthology.orchestra.run.smithi170.stdout:(101/118): python3-pecan-1.4.2-3.el9.noarch.rpm 2.5 MB/s | 272 kB 00:00 2023-10-05T11:26:29.409 INFO:teuthology.orchestra.run.smithi170.stdout:(102/118): python3-portend-3.1.0-2.el9.noarch.r 218 kB/s | 16 kB 00:00 2023-10-05T11:26:29.451 INFO:teuthology.orchestra.run.smithi170.stdout:(103/118): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.3 MB/s | 90 kB 00:00 2023-10-05T11:26:29.485 INFO:teuthology.orchestra.run.smithi170.stdout:(104/118): python3-repoze-lru-0.7-16.el9.noarch 408 kB/s | 31 kB 00:00 2023-10-05T11:26:29.552 INFO:teuthology.orchestra.run.smithi170.stdout:(105/118): python3-routes-2.5.1-5.el9.noarch.rp 1.8 MB/s | 188 kB 00:00 2023-10-05T11:26:29.619 INFO:teuthology.orchestra.run.smithi170.stdout:(106/118): python3-rsa-4.9-2.el9.noarch.rpm 443 kB/s | 59 kB 00:00 2023-10-05T11:26:29.635 INFO:teuthology.orchestra.run.smithi170.stdout:(107/118): python3-tempora-5.0.0-2.el9.noarch.r 428 kB/s | 36 kB 00:00 2023-10-05T11:26:29.711 INFO:teuthology.orchestra.run.smithi170.stdout:(108/118): python3-typing-extensions-4.4.0-2.el 555 kB/s | 51 kB 00:00 2023-10-05T11:26:29.744 INFO:teuthology.orchestra.run.smithi170.stdout:(109/118): python3-webob-1.8.7-6.el9.noarch.rpm 2.1 MB/s | 230 kB 00:00 2023-10-05T11:26:29.803 INFO:teuthology.orchestra.run.smithi170.stdout:(110/118): python3-websocket-client-1.2.3-2.el9 977 kB/s | 90 kB 00:00 2023-10-05T11:26:29.870 INFO:teuthology.orchestra.run.smithi170.stdout:(111/118): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2023-10-05T11:26:29.895 INFO:teuthology.orchestra.run.smithi170.stdout:(112/118): python3-zc-lockfile-2.0-10.el9.noarc 217 kB/s | 20 kB 00:00 2023-10-05T11:26:29.987 INFO:teuthology.orchestra.run.smithi170.stdout:(113/118): re2-20211101-3.el9.x86_64.rpm 1.6 MB/s | 192 kB 00:00 2023-10-05T11:26:30.622 INFO:teuthology.orchestra.run.smithi170.stdout:(114/118): s3cmd-2.3.0-4.el9.noarch.rpm 1.6 MB/s | 197 kB 00:00 2023-10-05T11:26:30.622 INFO:teuthology.orchestra.run.smithi170.stdout:(115/118): thrift-0.15.0-2.el9.x86_64.rpm 11 MB/s | 1.6 MB 00:00 2023-10-05T11:26:30.622 INFO:teuthology.orchestra.run.smithi170.stdout:(116/118): librados2-18.0.0-6543.g38321be8.el9. 6.9 MB/s | 3.3 MB 00:00 2023-10-05T11:26:30.676 INFO:teuthology.orchestra.run.smithi170.stdout:(117/118): librbd1-18.0.0-6543.g38321be8.el9.x8 5.6 MB/s | 3.0 MB 00:00 2023-10-05T11:26:31.605 INFO:teuthology.orchestra.run.smithi012.stdout: Preparing : 1/1 2023-10-05T11:26:31.678 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : thrift-0.15.0-2.el9.x86_64 1/120 2023-10-05T11:26:31.712 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 2/120 2023-10-05T11:26:31.769 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 3/120 2023-10-05T11:26:32.113 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 4/120 2023-10-05T11:26:32.166 INFO:teuthology.orchestra.run.smithi012.stdout: Upgrading : librados2-2:18.0.0-6543.g38321be8.el9.x86_64 5/120 2023-10-05T11:26:32.300 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: librados2-2:18.0.0-6543.g38321be8.el9.x86_64 5/120 2023-10-05T11:26:32.325 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libcephfs2-2:18.0.0-6543.g38321be8.el9.x86_64 6/120 2023-10-05T11:26:32.418 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: libcephfs2-2:18.0.0-6543.g38321be8.el9.x86_64 6/120 2023-10-05T11:26:32.476 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-rados-2:18.0.0-6543.g38321be8.el9.x86_64 7/120 2023-10-05T11:26:32.556 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 8/120 2023-10-05T11:26:32.747 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 9/120 2023-10-05T11:26:32.805 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-urllib3-1.26.5-3.el9.noarch 10/120 2023-10-05T11:26:32.844 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-requests-2.25.1-7.el9.noarch 11/120 2023-10-05T11:26:32.871 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libcephsqlite-2:18.0.0-6543.g38321be8.el9.x86_64 12/120 2023-10-05T11:26:32.957 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: libcephsqlite-2:18.0.0-6543.g38321be8.el9.x86_64 12/120 2023-10-05T11:26:32.980 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libradosstriper1-2:18.0.0-6543.g38321be8.el9.x86 13/120 2023-10-05T11:26:33.113 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: libradosstriper1-2:18.0.0-6543.g38321be8.el9.x86 13/120 2023-10-05T11:26:33.143 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 14/120 2023-10-05T11:26:33.181 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : liboath-2.6.7-2.el9.x86_64 15/120 2023-10-05T11:26:33.258 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 16/120 2023-10-05T11:26:33.297 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 17/120 2023-10-05T11:26:33.323 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 18/120 2023-10-05T11:26:33.376 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 19/120 2023-10-05T11:26:33.420 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libquadmath-11.4.1-2.1.el9.x86_64 20/120 2023-10-05T11:26:33.498 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libgfortran-11.4.1-2.1.el9.x86_64 21/120 2023-10-05T11:26:33.529 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-ceph-common-2:18.0.0-6543.g38321be8.el9. 22/120 2023-10-05T11:26:33.573 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-ceph-argparse-2:18.0.0-6543.g38321be8.el 23/120 2023-10-05T11:26:33.651 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-cephfs-2:18.0.0-6543.g38321be8.el9.x86_6 24/120 2023-10-05T11:26:33.797 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 25/120 2023-10-05T11:26:33.851 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 26/120 2023-10-05T11:26:34.437 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-rsa-4.9-2.el9.noarch 27/120 2023-10-05T11:26:34.524 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 28/120 2023-10-05T11:26:34.567 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 29/120 2023-10-05T11:26:34.605 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : librados-devel-2:18.0.0-6543.g38321be8.el9.x86_6 30/120 2023-10-05T11:26:34.635 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 31/120 2023-10-05T11:26:34.746 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : re2-1:20211101-3.el9.x86_64 32/120 2023-10-05T11:26:34.780 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libarrow-9.0.0-9.el9.x86_64 33/120 2023-10-05T11:26:34.837 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 34/120 2023-10-05T11:26:34.913 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 35/120 2023-10-05T11:26:34.947 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 36/120 2023-10-05T11:26:34.984 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 37/120 2023-10-05T11:26:35.032 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 38/120 2023-10-05T11:26:35.077 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 39/120 2023-10-05T11:26:35.118 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 40/120 2023-10-05T11:26:35.262 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 41/120 2023-10-05T11:26:35.328 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 42/120 2023-10-05T11:26:35.371 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 43/120 2023-10-05T11:26:35.468 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 44/120 2023-10-05T11:26:35.503 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-google-auth-1:2.23.0-1.el9.noarch 45/120 2023-10-05T11:26:35.551 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 46/120 2023-10-05T11:26:35.584 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 47/120 2023-10-05T11:26:35.611 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libarrow-doc-9.0.0-9.el9.noarch 48/120 2023-10-05T11:26:35.648 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : fmt-8.1.1-5.el9.x86_64 49/120 2023-10-05T11:26:35.693 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 50/120 2023-10-05T11:26:35.727 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 51/120 2023-10-05T11:26:35.756 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 52/120 2023-10-05T11:26:35.800 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 53/120 2023-10-05T11:26:35.833 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 54/120 2023-10-05T11:26:35.875 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 55/120 2023-10-05T11:26:35.909 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 56/120 2023-10-05T11:26:35.944 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 57/120 2023-10-05T11:26:36.050 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 58/120 2023-10-05T11:26:36.104 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 59/120 2023-10-05T11:26:36.876 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 60/120 2023-10-05T11:26:36.926 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 61/120 2023-10-05T11:26:36.959 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 62/120 2023-10-05T11:26:37.064 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 63/120 2023-10-05T11:26:37.101 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 64/120 2023-10-05T11:26:37.288 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : openblas-0.3.21-2.el9.x86_64 65/120 2023-10-05T11:26:37.324 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 66/120 2023-10-05T11:26:37.405 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 67/120 2023-10-05T11:26:38.106 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 68/120 2023-10-05T11:26:38.235 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 69/120 2023-10-05T11:26:39.586 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 70/120 2023-10-05T11:26:39.665 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 71/120 2023-10-05T11:26:39.696 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 72/120 2023-10-05T11:26:39.729 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : jq-1.6-15.el9.x86_64 73/120 2023-10-05T11:26:40.049 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 74/120 2023-10-05T11:26:41.019 INFO:teuthology.orchestra.run.smithi012.stdout: Upgrading : librbd1-2:18.0.0-6543.g38321be8.el9.x86_64 75/120 2023-10-05T11:26:41.019 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: librbd1-2:18.0.0-6543.g38321be8.el9.x86_64 75/120 2023-10-05T11:26:41.019 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-rbd-2:18.0.0-6543.g38321be8.el9.x86_64 76/120 2023-10-05T11:26:41.019 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 77/120 2023-10-05T11:26:41.019 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : parquet-libs-9.0.0-9.el9.x86_64 78/120 2023-10-05T11:26:41.020 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : librgw2-2:18.0.0-6543.g38321be8.el9.x86_64 79/120 2023-10-05T11:26:41.020 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: librgw2-2:18.0.0-6543.g38321be8.el9.x86_64 79/120 2023-10-05T11:26:41.020 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-rgw-2:18.0.0-6543.g38321be8.el9.x86_64 80/120 2023-10-05T11:26:42.999 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-common-2:18.0.0-6543.g38321be8.el9.x86_64 81/120 2023-10-05T11:26:43.110 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-common-2:18.0.0-6543.g38321be8.el9.x86_64 81/120 2023-10-05T11:26:43.691 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-common-2:18.0.0-6543.g38321be8.el9.x86_64 81/120 2023-10-05T11:26:43.721 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-base-2:18.0.0-6543.g38321be8.el9.x86_64 82/120 2023-10-05T11:26:43.790 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-base-2:18.0.0-6543.g38321be8.el9.x86_64 82/120 2023-10-05T11:26:43.791 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2023-10-05T11:26:43.791 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2023-10-05T11:26:43.791 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:26:43.831 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-selinux-2:18.0.0-6543.g38321be8.el9.x86_64 83/120 2023-10-05T11:26:46.667 INFO:teuthology.orchestra.run.smithi170.stdout:(118/118): python3-scipy-1.6.2-8.el9.x86_64.rpm 868 kB/s | 16 MB 00:19 2023-10-05T11:26:46.670 INFO:teuthology.orchestra.run.smithi170.stdout:-------------------------------------------------------------------------------- 2023-10-05T11:26:46.670 INFO:teuthology.orchestra.run.smithi170.stdout:Total 5.6 MB/s | 181 MB 00:32 2023-10-05T11:26:47.333 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction check 2023-10-05T11:26:47.427 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction check succeeded. 2023-10-05T11:26:47.427 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction test 2023-10-05T11:26:49.053 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction test succeeded. 2023-10-05T11:26:49.054 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction 2023-10-05T11:26:53.789 INFO:teuthology.orchestra.run.smithi170.stdout: Preparing : 1/1 2023-10-05T11:26:53.844 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : thrift-0.15.0-2.el9.x86_64 1/120 2023-10-05T11:26:53.870 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 2/120 2023-10-05T11:26:53.931 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 3/120 2023-10-05T11:26:54.263 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 4/120 2023-10-05T11:26:54.312 INFO:teuthology.orchestra.run.smithi170.stdout: Upgrading : librados2-2:18.0.0-6543.g38321be8.el9.x86_64 5/120 2023-10-05T11:26:54.418 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: librados2-2:18.0.0-6543.g38321be8.el9.x86_64 5/120 2023-10-05T11:26:54.447 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libcephfs2-2:18.0.0-6543.g38321be8.el9.x86_64 6/120 2023-10-05T11:26:54.530 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: libcephfs2-2:18.0.0-6543.g38321be8.el9.x86_64 6/120 2023-10-05T11:26:54.585 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-rados-2:18.0.0-6543.g38321be8.el9.x86_64 7/120 2023-10-05T11:26:54.618 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 8/120 2023-10-05T11:26:54.686 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 9/120 2023-10-05T11:26:54.740 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-urllib3-1.26.5-3.el9.noarch 10/120 2023-10-05T11:26:54.782 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-requests-2.25.1-7.el9.noarch 11/120 2023-10-05T11:26:54.809 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libcephsqlite-2:18.0.0-6543.g38321be8.el9.x86_64 12/120 2023-10-05T11:26:54.893 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: libcephsqlite-2:18.0.0-6543.g38321be8.el9.x86_64 12/120 2023-10-05T11:26:54.926 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libradosstriper1-2:18.0.0-6543.g38321be8.el9.x86 13/120 2023-10-05T11:26:55.054 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: libradosstriper1-2:18.0.0-6543.g38321be8.el9.x86 13/120 2023-10-05T11:26:55.090 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 14/120 2023-10-05T11:26:55.124 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : liboath-2.6.7-2.el9.x86_64 15/120 2023-10-05T11:26:55.189 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 16/120 2023-10-05T11:26:55.233 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 17/120 2023-10-05T11:26:55.260 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 18/120 2023-10-05T11:26:55.300 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 19/120 2023-10-05T11:26:55.343 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libquadmath-11.4.1-2.1.el9.x86_64 20/120 2023-10-05T11:26:55.367 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-selinux-2:18.0.0-6543.g38321be8.el9.x86_64 83/120 2023-10-05T11:26:55.367 INFO:teuthology.orchestra.run.smithi012.stdout:skipping the directory /sys 2023-10-05T11:26:55.367 INFO:teuthology.orchestra.run.smithi012.stdout:skipping the directory /proc 2023-10-05T11:26:55.367 INFO:teuthology.orchestra.run.smithi012.stdout:skipping the directory /mnt 2023-10-05T11:26:55.367 INFO:teuthology.orchestra.run.smithi012.stdout:skipping the directory /var/tmp 2023-10-05T11:26:55.367 INFO:teuthology.orchestra.run.smithi012.stdout:skipping the directory /home 2023-10-05T11:26:55.367 INFO:teuthology.orchestra.run.smithi012.stdout:skipping the directory /root 2023-10-05T11:26:55.367 INFO:teuthology.orchestra.run.smithi012.stdout:skipping the directory /tmp 2023-10-05T11:26:55.368 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:26:55.422 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libgfortran-11.4.1-2.1.el9.x86_64 21/120 2023-10-05T11:26:55.458 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-ceph-common-2:18.0.0-6543.g38321be8.el9. 22/120 2023-10-05T11:26:55.501 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-ceph-argparse-2:18.0.0-6543.g38321be8.el 23/120 2023-10-05T11:26:55.530 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-volume-2:18.0.0-6543.g38321be8.el9.noarch 84/120 2023-10-05T11:26:55.546 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-volume-2:18.0.0-6543.g38321be8.el9.noarch 84/120 2023-10-05T11:26:55.546 INFO:teuthology.orchestra.run.smithi012.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-05T11:26:55.547 INFO:teuthology.orchestra.run.smithi012.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2023-10-05T11:26:55.547 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:26:55.574 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-cephfs-2:18.0.0-6543.g38321be8.el9.x86_6 24/120 2023-10-05T11:26:55.718 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 25/120 2023-10-05T11:26:55.769 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 26/120 2023-10-05T11:26:56.292 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-rsa-4.9-2.el9.noarch 27/120 2023-10-05T11:26:56.382 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 28/120 2023-10-05T11:26:56.419 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 29/120 2023-10-05T11:26:56.458 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : librados-devel-2:18.0.0-6543.g38321be8.el9.x86_6 30/120 2023-10-05T11:26:56.488 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 31/120 2023-10-05T11:26:56.595 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : re2-1:20211101-3.el9.x86_64 32/120 2023-10-05T11:26:56.634 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libarrow-9.0.0-9.el9.x86_64 33/120 2023-10-05T11:26:56.688 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 34/120 2023-10-05T11:26:56.761 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 35/120 2023-10-05T11:26:56.801 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 36/120 2023-10-05T11:26:56.838 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 37/120 2023-10-05T11:26:56.884 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 38/120 2023-10-05T11:26:56.947 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 39/120 2023-10-05T11:26:56.971 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 40/120 2023-10-05T11:26:57.105 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 41/120 2023-10-05T11:26:57.140 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 42/120 2023-10-05T11:26:57.166 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-osd-2:18.0.0-6543.g38321be8.el9.x86_64 85/120 2023-10-05T11:26:57.181 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 43/120 2023-10-05T11:26:57.193 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-osd-2:18.0.0-6543.g38321be8.el9.x86_64 85/120 2023-10-05T11:26:57.193 INFO:teuthology.orchestra.run.smithi012.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-05T11:26:57.193 INFO:teuthology.orchestra.run.smithi012.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2023-10-05T11:26:57.193 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-10-05T11:26:57.193 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-10-05T11:26:57.193 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:26:57.275 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 44/120 2023-10-05T11:26:57.316 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-google-auth-1:2.23.0-1.el9.noarch 45/120 2023-10-05T11:26:57.356 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 46/120 2023-10-05T11:26:57.388 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 47/120 2023-10-05T11:26:57.410 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-mds-2:18.0.0-6543.g38321be8.el9.x86_64 86/120 2023-10-05T11:26:57.415 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libarrow-doc-9.0.0-9.el9.noarch 48/120 2023-10-05T11:26:57.423 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-mds-2:18.0.0-6543.g38321be8.el9.x86_64 86/120 2023-10-05T11:26:57.424 INFO:teuthology.orchestra.run.smithi012.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-05T11:26:57.424 INFO:teuthology.orchestra.run.smithi012.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2023-10-05T11:26:57.424 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-10-05T11:26:57.424 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-10-05T11:26:57.424 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:26:57.452 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : fmt-8.1.1-5.el9.x86_64 49/120 2023-10-05T11:26:57.496 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 50/120 2023-10-05T11:26:57.531 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 51/120 2023-10-05T11:26:57.564 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 52/120 2023-10-05T11:26:57.595 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 53/120 2023-10-05T11:26:57.620 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 54/120 2023-10-05T11:26:57.662 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 55/120 2023-10-05T11:26:57.697 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 56/120 2023-10-05T11:26:57.731 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 57/120 2023-10-05T11:26:57.834 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 58/120 2023-10-05T11:26:57.891 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 59/120 2023-10-05T11:26:57.901 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-mon-2:18.0.0-6543.g38321be8.el9.x86_64 87/120 2023-10-05T11:26:57.924 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-mon-2:18.0.0-6543.g38321be8.el9.x86_64 87/120 2023-10-05T11:26:57.925 INFO:teuthology.orchestra.run.smithi012.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-05T11:26:57.925 INFO:teuthology.orchestra.run.smithi012.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2023-10-05T11:26:57.925 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-10-05T11:26:57.925 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-10-05T11:26:57.925 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:26:57.988 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-ply-3.11-14.el9.noarch 88/120 2023-10-05T11:26:58.053 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 89/120 2023-10-05T11:26:58.246 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 90/120 2023-10-05T11:26:58.292 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 91/120 2023-10-05T11:26:58.372 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 92/120 2023-10-05T11:26:58.472 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 93/120 2023-10-05T11:26:58.614 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 94/120 2023-10-05T11:26:58.620 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 60/120 2023-10-05T11:26:58.655 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 95/120 2023-10-05T11:26:58.666 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 61/120 2023-10-05T11:26:58.684 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 96/120 2023-10-05T11:26:58.696 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 62/120 2023-10-05T11:26:58.722 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 97/120 2023-10-05T11:26:58.758 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 98/120 2023-10-05T11:26:58.785 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : fuse-2.9.9-15.el9.x86_64 99/120 2023-10-05T11:26:58.794 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 63/120 2023-10-05T11:26:58.832 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 64/120 2023-10-05T11:26:59.010 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : openblas-0.3.21-2.el9.x86_64 65/120 2023-10-05T11:26:59.048 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 66/120 2023-10-05T11:26:59.124 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 67/120 2023-10-05T11:26:59.156 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: cephadm-2:18.0.0-6543.g38321be8.el9.noarch 100/120 2023-10-05T11:26:59.183 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : cephadm-2:18.0.0-6543.g38321be8.el9.noarch 100/120 2023-10-05T11:26:59.212 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-6543.g38321be8.e 101/120 2023-10-05T11:26:59.277 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-6543.g38321be8. 102/120 2023-10-05T11:26:59.315 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-6543.g38321be8.el9.noa 103/120 2023-10-05T11:26:59.549 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-6543.g38321be8.el9.noa 103/120 2023-10-05T11:26:59.582 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-6543.g38321be8.el9.n 104/120 2023-10-05T11:26:59.788 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 68/120 2023-10-05T11:26:59.903 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 69/120 2023-10-05T11:27:00.596 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-6543.g38321be8.el9.n 104/120 2023-10-05T11:27:00.624 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-6543.g383 105/120 2023-10-05T11:27:00.728 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-6543.g383 105/120 2023-10-05T11:27:00.889 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-6543.g38321be8.el 106/120 2023-10-05T11:27:00.918 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-mgr-2:18.0.0-6543.g38321be8.el9.x86_64 107/120 2023-10-05T11:27:00.943 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-mgr-2:18.0.0-6543.g38321be8.el9.x86_64 107/120 2023-10-05T11:27:00.943 INFO:teuthology.orchestra.run.smithi012.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-05T11:27:00.943 INFO:teuthology.orchestra.run.smithi012.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2023-10-05T11:27:00.943 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-10-05T11:27:00.943 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-10-05T11:27:00.943 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:27:00.985 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-mgr-rook-2:18.0.0-6543.g38321be8.el9.noarch 108/120 2023-10-05T11:27:00.997 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-6543.g38321be8.el9.noarch 108/120 2023-10-05T11:27:01.095 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-2:18.0.0-6543.g38321be8.el9.x86_64 109/120 2023-10-05T11:27:01.208 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 70/120 2023-10-05T11:27:01.314 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 71/120 2023-10-05T11:27:01.345 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 72/120 2023-10-05T11:27:01.378 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : jq-1.6-15.el9.x86_64 73/120 2023-10-05T11:27:01.681 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 74/120 2023-10-05T11:27:01.708 INFO:teuthology.orchestra.run.smithi170.stdout: Upgrading : librbd1-2:18.0.0-6543.g38321be8.el9.x86_64 75/120 2023-10-05T11:27:01.798 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: librbd1-2:18.0.0-6543.g38321be8.el9.x86_64 75/120 2023-10-05T11:27:01.829 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-rbd-2:18.0.0-6543.g38321be8.el9.x86_64 76/120 2023-10-05T11:27:01.865 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 77/120 2023-10-05T11:27:01.914 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-fuse-2:18.0.0-6543.g38321be8.el9.x86_64 110/120 2023-10-05T11:27:01.945 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-radosgw-2:18.0.0-6543.g38321be8.el9.x86_64 111/120 2023-10-05T11:27:01.970 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-6543.g38321be8.el9.x86_64 111/120 2023-10-05T11:27:01.970 INFO:teuthology.orchestra.run.smithi012.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-05T11:27:01.970 INFO:teuthology.orchestra.run.smithi012.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2023-10-05T11:27:01.970 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-10-05T11:27:01.970 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-10-05T11:27:01.971 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:27:02.012 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-6543.g38321 112/120 2023-10-05T11:27:02.035 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-6543.g38321 112/120 2023-10-05T11:27:02.035 INFO:teuthology.orchestra.run.smithi012.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-05T11:27:02.036 INFO:teuthology.orchestra.run.smithi012.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2023-10-05T11:27:02.036 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:27:02.292 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : parquet-libs-9.0.0-9.el9.x86_64 78/120 2023-10-05T11:27:02.319 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : librgw2-2:18.0.0-6543.g38321be8.el9.x86_64 79/120 2023-10-05T11:27:02.356 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : rbd-mirror-2:18.0.0-6543.g38321be8.el9.x86_64 113/120 2023-10-05T11:27:02.380 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: rbd-mirror-2:18.0.0-6543.g38321be8.el9.x86_64 113/120 2023-10-05T11:27:02.380 INFO:teuthology.orchestra.run.smithi012.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-05T11:27:02.380 INFO:teuthology.orchestra.run.smithi012.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2023-10-05T11:27:02.380 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-10-05T11:27:02.380 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-10-05T11:27:02.380 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:27:02.382 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: librgw2-2:18.0.0-6543.g38321be8.el9.x86_64 79/120 2023-10-05T11:27:02.404 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-rgw-2:18.0.0-6543.g38321be8.el9.x86_64 80/120 2023-10-05T11:27:04.574 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-common-2:18.0.0-6543.g38321be8.el9.x86_64 81/120 2023-10-05T11:27:04.610 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-common-2:18.0.0-6543.g38321be8.el9.x86_64 81/120 2023-10-05T11:27:05.153 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-common-2:18.0.0-6543.g38321be8.el9.x86_64 81/120 2023-10-05T11:27:05.197 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-base-2:18.0.0-6543.g38321be8.el9.x86_64 82/120 2023-10-05T11:27:05.286 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-base-2:18.0.0-6543.g38321be8.el9.x86_64 82/120 2023-10-05T11:27:05.286 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2023-10-05T11:27:05.286 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2023-10-05T11:27:05.286 INFO:teuthology.orchestra.run.smithi170.stdout: 2023-10-05T11:27:05.323 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-selinux-2:18.0.0-6543.g38321be8.el9.x86_64 83/120 2023-10-05T11:27:06.416 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-test-2:18.0.0-6543.g38321be8.el9.x86_64 114/120 2023-10-05T11:27:06.466 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : rbd-fuse-2:18.0.0-6543.g38321be8.el9.x86_64 115/120 2023-10-05T11:27:06.497 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : rbd-nbd-2:18.0.0-6543.g38321be8.el9.x86_64 116/120 2023-10-05T11:27:06.557 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libcephfs-devel-2:18.0.0-6543.g38321be8.el9.x86_ 117/120 2023-10-05T11:27:06.587 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : s3cmd-2.3.0-4.el9.noarch 118/120 2023-10-05T11:27:06.587 INFO:teuthology.orchestra.run.smithi012.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 119/120 2023-10-05T11:27:06.671 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 119/120 2023-10-05T11:27:06.671 INFO:teuthology.orchestra.run.smithi012.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 120/120 2023-10-05T11:27:11.030 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 120/120 2023-10-05T11:27:11.031 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-2:18.0.0-6543.g38321be8.el9.x86_64 1/120 2023-10-05T11:27:11.031 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-base-2:18.0.0-6543.g38321be8.el9.x86_64 2/120 2023-10-05T11:27:11.031 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-common-2:18.0.0-6543.g38321be8.el9.x86_64 3/120 2023-10-05T11:27:11.031 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-fuse-2:18.0.0-6543.g38321be8.el9.x86_64 4/120 2023-10-05T11:27:11.031 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-6543.g38321 5/120 2023-10-05T11:27:11.031 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-mds-2:18.0.0-6543.g38321be8.el9.x86_64 6/120 2023-10-05T11:27:11.031 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-mgr-2:18.0.0-6543.g38321be8.el9.x86_64 7/120 2023-10-05T11:27:11.031 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-mon-2:18.0.0-6543.g38321be8.el9.x86_64 8/120 2023-10-05T11:27:11.031 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-osd-2:18.0.0-6543.g38321be8.el9.x86_64 9/120 2023-10-05T11:27:11.031 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-radosgw-2:18.0.0-6543.g38321be8.el9.x86_64 10/120 2023-10-05T11:27:11.032 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-selinux-2:18.0.0-6543.g38321be8.el9.x86_64 11/120 2023-10-05T11:27:11.032 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-test-2:18.0.0-6543.g38321be8.el9.x86_64 12/120 2023-10-05T11:27:11.032 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libcephfs-devel-2:18.0.0-6543.g38321be8.el9.x86_ 13/120 2023-10-05T11:27:11.032 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libcephfs2-2:18.0.0-6543.g38321be8.el9.x86_64 14/120 2023-10-05T11:27:11.032 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libcephsqlite-2:18.0.0-6543.g38321be8.el9.x86_64 15/120 2023-10-05T11:27:11.032 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : librados-devel-2:18.0.0-6543.g38321be8.el9.x86_6 16/120 2023-10-05T11:27:11.032 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libradosstriper1-2:18.0.0-6543.g38321be8.el9.x86 17/120 2023-10-05T11:27:11.032 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : librgw2-2:18.0.0-6543.g38321be8.el9.x86_64 18/120 2023-10-05T11:27:11.032 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-ceph-argparse-2:18.0.0-6543.g38321be8.el 19/120 2023-10-05T11:27:11.032 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-ceph-common-2:18.0.0-6543.g38321be8.el9. 20/120 2023-10-05T11:27:11.032 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-cephfs-2:18.0.0-6543.g38321be8.el9.x86_6 21/120 2023-10-05T11:27:11.032 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-rados-2:18.0.0-6543.g38321be8.el9.x86_64 22/120 2023-10-05T11:27:11.033 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-rbd-2:18.0.0-6543.g38321be8.el9.x86_64 23/120 2023-10-05T11:27:11.033 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-rgw-2:18.0.0-6543.g38321be8.el9.x86_64 24/120 2023-10-05T11:27:11.033 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : rbd-fuse-2:18.0.0-6543.g38321be8.el9.x86_64 25/120 2023-10-05T11:27:11.033 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : rbd-mirror-2:18.0.0-6543.g38321be8.el9.x86_64 26/120 2023-10-05T11:27:11.033 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : rbd-nbd-2:18.0.0-6543.g38321be8.el9.x86_64 27/120 2023-10-05T11:27:11.033 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-6543.g38321be8. 28/120 2023-10-05T11:27:11.033 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-6543.g38321be8.el9.noa 29/120 2023-10-05T11:27:11.033 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-6543.g38321be8.el9.n 30/120 2023-10-05T11:27:11.033 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-6543.g383 31/120 2023-10-05T11:27:11.033 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-6543.g38321be8.el 32/120 2023-10-05T11:27:11.033 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-mgr-rook-2:18.0.0-6543.g38321be8.el9.noarch 33/120 2023-10-05T11:27:11.033 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-6543.g38321be8.e 34/120 2023-10-05T11:27:11.034 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-volume-2:18.0.0-6543.g38321be8.el9.noarch 35/120 2023-10-05T11:27:11.034 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : cephadm-2:18.0.0-6543.g38321be8.el9.noarch 36/120 2023-10-05T11:27:11.034 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 37/120 2023-10-05T11:27:11.034 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libgfortran-11.4.1-2.1.el9.x86_64 38/120 2023-10-05T11:27:11.034 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libquadmath-11.4.1-2.1.el9.x86_64 39/120 2023-10-05T11:27:11.034 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 40/120 2023-10-05T11:27:11.034 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 41/120 2023-10-05T11:27:11.034 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-ply-3.11-14.el9.noarch 42/120 2023-10-05T11:27:11.034 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 43/120 2023-10-05T11:27:11.034 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-requests-2.25.1-7.el9.noarch 44/120 2023-10-05T11:27:11.034 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-urllib3-1.26.5-3.el9.noarch 45/120 2023-10-05T11:27:11.034 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 46/120 2023-10-05T11:27:11.035 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 47/120 2023-10-05T11:27:11.035 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 48/120 2023-10-05T11:27:11.035 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 49/120 2023-10-05T11:27:11.035 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : jq-1.6-15.el9.x86_64 50/120 2023-10-05T11:27:11.035 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 51/120 2023-10-05T11:27:11.035 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 52/120 2023-10-05T11:27:11.035 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 53/120 2023-10-05T11:27:11.035 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 54/120 2023-10-05T11:27:11.035 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 55/120 2023-10-05T11:27:11.035 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 56/120 2023-10-05T11:27:11.035 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 57/120 2023-10-05T11:27:11.035 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 58/120 2023-10-05T11:27:11.035 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 59/120 2023-10-05T11:27:11.036 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 60/120 2023-10-05T11:27:11.036 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 61/120 2023-10-05T11:27:11.036 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 62/120 2023-10-05T11:27:11.036 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 63/120 2023-10-05T11:27:11.036 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 64/120 2023-10-05T11:27:11.036 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 65/120 2023-10-05T11:27:11.036 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 66/120 2023-10-05T11:27:11.036 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 67/120 2023-10-05T11:27:11.036 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 68/120 2023-10-05T11:27:11.036 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 69/120 2023-10-05T11:27:11.036 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 70/120 2023-10-05T11:27:11.036 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 71/120 2023-10-05T11:27:11.037 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 72/120 2023-10-05T11:27:11.037 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 73/120 2023-10-05T11:27:11.037 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 74/120 2023-10-05T11:27:11.037 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 75/120 2023-10-05T11:27:11.037 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 76/120 2023-10-05T11:27:11.037 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 77/120 2023-10-05T11:27:11.037 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 78/120 2023-10-05T11:27:11.037 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libarrow-9.0.0-9.el9.x86_64 79/120 2023-10-05T11:27:11.037 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libarrow-doc-9.0.0-9.el9.noarch 80/120 2023-10-05T11:27:11.037 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 81/120 2023-10-05T11:27:11.037 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 82/120 2023-10-05T11:27:11.037 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : parquet-libs-9.0.0-9.el9.x86_64 83/120 2023-10-05T11:27:11.038 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 84/120 2023-10-05T11:27:11.038 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 85/120 2023-10-05T11:27:11.038 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 86/120 2023-10-05T11:27:11.038 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 87/120 2023-10-05T11:27:11.038 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 88/120 2023-10-05T11:27:11.038 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 89/120 2023-10-05T11:27:11.038 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-google-auth-1:2.23.0-1.el9.noarch 90/120 2023-10-05T11:27:11.038 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 91/120 2023-10-05T11:27:11.038 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 92/120 2023-10-05T11:27:11.038 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 93/120 2023-10-05T11:27:11.038 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 94/120 2023-10-05T11:27:11.038 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 95/120 2023-10-05T11:27:11.038 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 96/120 2023-10-05T11:27:11.039 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 97/120 2023-10-05T11:27:11.039 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 98/120 2023-10-05T11:27:11.039 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 99/120 2023-10-05T11:27:11.039 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 100/120 2023-10-05T11:27:11.039 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 101/120 2023-10-05T11:27:11.039 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 102/120 2023-10-05T11:27:11.039 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 103/120 2023-10-05T11:27:11.039 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 104/120 2023-10-05T11:27:11.039 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 105/120 2023-10-05T11:27:11.039 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 106/120 2023-10-05T11:27:11.039 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 107/120 2023-10-05T11:27:11.039 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 108/120 2023-10-05T11:27:11.040 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 109/120 2023-10-05T11:27:11.040 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 110/120 2023-10-05T11:27:11.040 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 111/120 2023-10-05T11:27:11.040 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 112/120 2023-10-05T11:27:11.040 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 113/120 2023-10-05T11:27:11.040 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : re2-1:20211101-3.el9.x86_64 114/120 2023-10-05T11:27:11.040 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : s3cmd-2.3.0-4.el9.noarch 115/120 2023-10-05T11:27:11.040 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 116/120 2023-10-05T11:27:11.040 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : librados2-2:18.0.0-6543.g38321be8.el9.x86_64 117/120 2023-10-05T11:27:11.040 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 118/120 2023-10-05T11:27:11.040 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : librbd1-2:18.0.0-6543.g38321be8.el9.x86_64 119/120 2023-10-05T11:27:12.967 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 120/120 2023-10-05T11:27:12.967 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:27:12.967 INFO:teuthology.orchestra.run.smithi012.stdout:Upgraded: 2023-10-05T11:27:12.967 INFO:teuthology.orchestra.run.smithi012.stdout: librados2-2:18.0.0-6543.g38321be8.el9.x86_64 2023-10-05T11:27:12.967 INFO:teuthology.orchestra.run.smithi012.stdout: librbd1-2:18.0.0-6543.g38321be8.el9.x86_64 2023-10-05T11:27:12.967 INFO:teuthology.orchestra.run.smithi012.stdout:Installed: 2023-10-05T11:27:12.967 INFO:teuthology.orchestra.run.smithi012.stdout: boost-program-options-1.75.0-8.el9.x86_64 2023-10-05T11:27:12.967 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-2:18.0.0-6543.g38321be8.el9.x86_64 2023-10-05T11:27:12.968 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-base-2:18.0.0-6543.g38321be8.el9.x86_64 2023-10-05T11:27:12.968 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-common-2:18.0.0-6543.g38321be8.el9.x86_64 2023-10-05T11:27:12.968 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-fuse-2:18.0.0-6543.g38321be8.el9.x86_64 2023-10-05T11:27:12.968 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-grafana-dashboards-2:18.0.0-6543.g38321be8.el9.noarch 2023-10-05T11:27:12.968 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-immutable-object-cache-2:18.0.0-6543.g38321be8.el9.x86_64 2023-10-05T11:27:12.968 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mds-2:18.0.0-6543.g38321be8.el9.x86_64 2023-10-05T11:27:12.968 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-2:18.0.0-6543.g38321be8.el9.x86_64 2023-10-05T11:27:12.968 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-cephadm-2:18.0.0-6543.g38321be8.el9.noarch 2023-10-05T11:27:12.968 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-dashboard-2:18.0.0-6543.g38321be8.el9.noarch 2023-10-05T11:27:12.968 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-diskprediction-local-2:18.0.0-6543.g38321be8.el9.noarch 2023-10-05T11:27:12.968 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-modules-core-2:18.0.0-6543.g38321be8.el9.noarch 2023-10-05T11:27:12.968 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-rook-2:18.0.0-6543.g38321be8.el9.noarch 2023-10-05T11:27:12.968 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mon-2:18.0.0-6543.g38321be8.el9.x86_64 2023-10-05T11:27:12.969 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-osd-2:18.0.0-6543.g38321be8.el9.x86_64 2023-10-05T11:27:12.969 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-prometheus-alerts-2:18.0.0-6543.g38321be8.el9.noarch 2023-10-05T11:27:12.969 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-radosgw-2:18.0.0-6543.g38321be8.el9.x86_64 2023-10-05T11:27:12.969 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-selinux-2:18.0.0-6543.g38321be8.el9.x86_64 2023-10-05T11:27:12.969 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-test-2:18.0.0-6543.g38321be8.el9.x86_64 2023-10-05T11:27:12.969 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-volume-2:18.0.0-6543.g38321be8.el9.noarch 2023-10-05T11:27:12.969 INFO:teuthology.orchestra.run.smithi012.stdout: cephadm-2:18.0.0-6543.g38321be8.el9.noarch 2023-10-05T11:27:12.969 INFO:teuthology.orchestra.run.smithi012.stdout: flexiblas-3.0.4-8.el9.x86_64 2023-10-05T11:27:12.969 INFO:teuthology.orchestra.run.smithi012.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2023-10-05T11:27:12.969 INFO:teuthology.orchestra.run.smithi012.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2023-10-05T11:27:12.969 INFO:teuthology.orchestra.run.smithi012.stdout: fmt-8.1.1-5.el9.x86_64 2023-10-05T11:27:12.969 INFO:teuthology.orchestra.run.smithi012.stdout: fuse-2.9.9-15.el9.x86_64 2023-10-05T11:27:12.969 INFO:teuthology.orchestra.run.smithi012.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2023-10-05T11:27:12.970 INFO:teuthology.orchestra.run.smithi012.stdout: jq-1.6-15.el9.x86_64 2023-10-05T11:27:12.970 INFO:teuthology.orchestra.run.smithi012.stdout: libarrow-9.0.0-9.el9.x86_64 2023-10-05T11:27:12.970 INFO:teuthology.orchestra.run.smithi012.stdout: libarrow-doc-9.0.0-9.el9.noarch 2023-10-05T11:27:12.970 INFO:teuthology.orchestra.run.smithi012.stdout: libcephfs-devel-2:18.0.0-6543.g38321be8.el9.x86_64 2023-10-05T11:27:12.970 INFO:teuthology.orchestra.run.smithi012.stdout: libcephfs2-2:18.0.0-6543.g38321be8.el9.x86_64 2023-10-05T11:27:12.970 INFO:teuthology.orchestra.run.smithi012.stdout: libcephsqlite-2:18.0.0-6543.g38321be8.el9.x86_64 2023-10-05T11:27:12.970 INFO:teuthology.orchestra.run.smithi012.stdout: libgfortran-11.4.1-2.1.el9.x86_64 2023-10-05T11:27:12.970 INFO:teuthology.orchestra.run.smithi012.stdout: liboath-2.6.7-2.el9.x86_64 2023-10-05T11:27:12.970 INFO:teuthology.orchestra.run.smithi012.stdout: libpmemobj-1.12.1-1.el9.x86_64 2023-10-05T11:27:12.970 INFO:teuthology.orchestra.run.smithi012.stdout: libquadmath-11.4.1-2.1.el9.x86_64 2023-10-05T11:27:12.970 INFO:teuthology.orchestra.run.smithi012.stdout: librabbitmq-0.11.0-7.el9.x86_64 2023-10-05T11:27:12.970 INFO:teuthology.orchestra.run.smithi012.stdout: librados-devel-2:18.0.0-6543.g38321be8.el9.x86_64 2023-10-05T11:27:12.970 INFO:teuthology.orchestra.run.smithi012.stdout: libradosstriper1-2:18.0.0-6543.g38321be8.el9.x86_64 2023-10-05T11:27:12.971 INFO:teuthology.orchestra.run.smithi012.stdout: librdkafka-1.6.1-102.el9.x86_64 2023-10-05T11:27:12.971 INFO:teuthology.orchestra.run.smithi012.stdout: librgw2-2:18.0.0-6543.g38321be8.el9.x86_64 2023-10-05T11:27:12.971 INFO:teuthology.orchestra.run.smithi012.stdout: libunwind-1.6.2-1.el9.x86_64 2023-10-05T11:27:12.971 INFO:teuthology.orchestra.run.smithi012.stdout: lttng-ust-2.12.0-6.el9.x86_64 2023-10-05T11:27:12.971 INFO:teuthology.orchestra.run.smithi012.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2023-10-05T11:27:12.971 INFO:teuthology.orchestra.run.smithi012.stdout: openblas-0.3.21-2.el9.x86_64 2023-10-05T11:27:12.971 INFO:teuthology.orchestra.run.smithi012.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2023-10-05T11:27:12.971 INFO:teuthology.orchestra.run.smithi012.stdout: parquet-libs-9.0.0-9.el9.x86_64 2023-10-05T11:27:12.971 INFO:teuthology.orchestra.run.smithi012.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2023-10-05T11:27:12.971 INFO:teuthology.orchestra.run.smithi012.stdout: python3-babel-2.9.1-2.el9.noarch 2023-10-05T11:27:12.971 INFO:teuthology.orchestra.run.smithi012.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2023-10-05T11:27:12.971 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cachetools-4.2.4-1.el9.noarch 2023-10-05T11:27:12.971 INFO:teuthology.orchestra.run.smithi012.stdout: python3-ceph-argparse-2:18.0.0-6543.g38321be8.el9.x86_64 2023-10-05T11:27:12.972 INFO:teuthology.orchestra.run.smithi012.stdout: python3-ceph-common-2:18.0.0-6543.g38321be8.el9.x86_64 2023-10-05T11:27:12.972 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cephfs-2:18.0.0-6543.g38321be8.el9.x86_64 2023-10-05T11:27:12.972 INFO:teuthology.orchestra.run.smithi012.stdout: python3-certifi-2021.10.8-2.el9.noarch 2023-10-05T11:27:12.972 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cffi-1.14.5-5.el9.x86_64 2023-10-05T11:27:12.972 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cheroot-8.6.0-4.el9.noarch 2023-10-05T11:27:12.972 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2023-10-05T11:27:12.972 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2023-10-05T11:27:12.972 INFO:teuthology.orchestra.run.smithi012.stdout: python3-devel-3.9.17-2.el9.x86_64 2023-10-05T11:27:12.972 INFO:teuthology.orchestra.run.smithi012.stdout: python3-google-auth-1:2.23.0-1.el9.noarch 2023-10-05T11:27:12.972 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jaraco-8.2.1-3.el9.noarch 2023-10-05T11:27:12.972 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2023-10-05T11:27:12.972 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2023-10-05T11:27:12.972 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2023-10-05T11:27:12.973 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2023-10-05T11:27:12.973 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jinja2-2.11.3-4.el9.noarch 2023-10-05T11:27:12.973 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jsonpatch-1.21-16.el9.noarch 2023-10-05T11:27:12.973 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jsonpointer-2.0-4.el9.noarch 2023-10-05T11:27:12.973 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jwt-2.4.0-1.el9.noarch 2023-10-05T11:27:12.973 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2023-10-05T11:27:12.973 INFO:teuthology.orchestra.run.smithi012.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2023-10-05T11:27:12.973 INFO:teuthology.orchestra.run.smithi012.stdout: python3-logutils-0.3.5-21.el9.noarch 2023-10-05T11:27:12.973 INFO:teuthology.orchestra.run.smithi012.stdout: python3-mako-1.1.4-6.el9.noarch 2023-10-05T11:27:12.973 INFO:teuthology.orchestra.run.smithi012.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2023-10-05T11:27:12.973 INFO:teuthology.orchestra.run.smithi012.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2023-10-05T11:27:12.973 INFO:teuthology.orchestra.run.smithi012.stdout: python3-natsort-7.1.1-5.el9.noarch 2023-10-05T11:27:12.973 INFO:teuthology.orchestra.run.smithi012.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2023-10-05T11:27:12.973 INFO:teuthology.orchestra.run.smithi012.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2023-10-05T11:27:12.974 INFO:teuthology.orchestra.run.smithi012.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2023-10-05T11:27:12.974 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pecan-1.4.2-3.el9.noarch 2023-10-05T11:27:12.974 INFO:teuthology.orchestra.run.smithi012.stdout: python3-ply-3.11-14.el9.noarch 2023-10-05T11:27:12.974 INFO:teuthology.orchestra.run.smithi012.stdout: python3-portend-3.1.0-2.el9.noarch 2023-10-05T11:27:12.974 INFO:teuthology.orchestra.run.smithi012.stdout: python3-prettytable-0.7.2-27.el9.noarch 2023-10-05T11:27:12.974 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2023-10-05T11:27:12.974 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2023-10-05T11:27:12.974 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2023-10-05T11:27:12.974 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pycparser-2.20-6.el9.noarch 2023-10-05T11:27:12.974 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pytz-2021.1-5.el9.noarch 2023-10-05T11:27:12.974 INFO:teuthology.orchestra.run.smithi012.stdout: python3-rados-2:18.0.0-6543.g38321be8.el9.x86_64 2023-10-05T11:27:12.974 INFO:teuthology.orchestra.run.smithi012.stdout: python3-rbd-2:18.0.0-6543.g38321be8.el9.x86_64 2023-10-05T11:27:12.974 INFO:teuthology.orchestra.run.smithi012.stdout: python3-repoze-lru-0.7-16.el9.noarch 2023-10-05T11:27:12.975 INFO:teuthology.orchestra.run.smithi012.stdout: python3-requests-2.25.1-7.el9.noarch 2023-10-05T11:27:12.975 INFO:teuthology.orchestra.run.smithi012.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2023-10-05T11:27:12.975 INFO:teuthology.orchestra.run.smithi012.stdout: python3-rgw-2:18.0.0-6543.g38321be8.el9.x86_64 2023-10-05T11:27:12.975 INFO:teuthology.orchestra.run.smithi012.stdout: python3-routes-2.5.1-5.el9.noarch 2023-10-05T11:27:12.975 INFO:teuthology.orchestra.run.smithi012.stdout: python3-rsa-4.9-2.el9.noarch 2023-10-05T11:27:12.975 INFO:teuthology.orchestra.run.smithi012.stdout: python3-scipy-1.6.2-8.el9.x86_64 2023-10-05T11:27:12.975 INFO:teuthology.orchestra.run.smithi012.stdout: python3-tempora-5.0.0-2.el9.noarch 2023-10-05T11:27:12.975 INFO:teuthology.orchestra.run.smithi012.stdout: python3-toml-0.10.2-6.el9.noarch 2023-10-05T11:27:12.975 INFO:teuthology.orchestra.run.smithi012.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2023-10-05T11:27:12.975 INFO:teuthology.orchestra.run.smithi012.stdout: python3-urllib3-1.26.5-3.el9.noarch 2023-10-05T11:27:12.975 INFO:teuthology.orchestra.run.smithi012.stdout: python3-webob-1.8.7-6.el9.noarch 2023-10-05T11:27:12.976 INFO:teuthology.orchestra.run.smithi012.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2023-10-05T11:27:12.976 INFO:teuthology.orchestra.run.smithi012.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2023-10-05T11:27:12.976 INFO:teuthology.orchestra.run.smithi012.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2023-10-05T11:27:12.976 INFO:teuthology.orchestra.run.smithi012.stdout: rbd-fuse-2:18.0.0-6543.g38321be8.el9.x86_64 2023-10-05T11:27:12.976 INFO:teuthology.orchestra.run.smithi012.stdout: rbd-mirror-2:18.0.0-6543.g38321be8.el9.x86_64 2023-10-05T11:27:12.976 INFO:teuthology.orchestra.run.smithi012.stdout: rbd-nbd-2:18.0.0-6543.g38321be8.el9.x86_64 2023-10-05T11:27:12.976 INFO:teuthology.orchestra.run.smithi012.stdout: re2-1:20211101-3.el9.x86_64 2023-10-05T11:27:12.976 INFO:teuthology.orchestra.run.smithi012.stdout: s3cmd-2.3.0-4.el9.noarch 2023-10-05T11:27:12.976 INFO:teuthology.orchestra.run.smithi012.stdout: socat-1.7.4.1-5.el9.x86_64 2023-10-05T11:27:12.976 INFO:teuthology.orchestra.run.smithi012.stdout: thrift-0.15.0-2.el9.x86_64 2023-10-05T11:27:12.976 INFO:teuthology.orchestra.run.smithi012.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2023-10-05T11:27:12.977 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:27:12.977 INFO:teuthology.orchestra.run.smithi012.stdout:Complete! 2023-10-05T11:27:13.288 DEBUG:teuthology.parallel:result is None 2023-10-05T11:27:16.949 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-selinux-2:18.0.0-6543.g38321be8.el9.x86_64 83/120 2023-10-05T11:27:16.949 INFO:teuthology.orchestra.run.smithi170.stdout:skipping the directory /sys 2023-10-05T11:27:16.949 INFO:teuthology.orchestra.run.smithi170.stdout:skipping the directory /proc 2023-10-05T11:27:16.949 INFO:teuthology.orchestra.run.smithi170.stdout:skipping the directory /mnt 2023-10-05T11:27:16.949 INFO:teuthology.orchestra.run.smithi170.stdout:skipping the directory /var/tmp 2023-10-05T11:27:16.950 INFO:teuthology.orchestra.run.smithi170.stdout:skipping the directory /home 2023-10-05T11:27:16.950 INFO:teuthology.orchestra.run.smithi170.stdout:skipping the directory /root 2023-10-05T11:27:16.950 INFO:teuthology.orchestra.run.smithi170.stdout:skipping the directory /tmp 2023-10-05T11:27:16.950 INFO:teuthology.orchestra.run.smithi170.stdout: 2023-10-05T11:27:17.119 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-volume-2:18.0.0-6543.g38321be8.el9.noarch 84/120 2023-10-05T11:27:17.134 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-volume-2:18.0.0-6543.g38321be8.el9.noarch 84/120 2023-10-05T11:27:17.134 INFO:teuthology.orchestra.run.smithi170.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-05T11:27:17.134 INFO:teuthology.orchestra.run.smithi170.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2023-10-05T11:27:17.135 INFO:teuthology.orchestra.run.smithi170.stdout: 2023-10-05T11:27:18.715 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-osd-2:18.0.0-6543.g38321be8.el9.x86_64 85/120 2023-10-05T11:27:18.740 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-osd-2:18.0.0-6543.g38321be8.el9.x86_64 85/120 2023-10-05T11:27:18.740 INFO:teuthology.orchestra.run.smithi170.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-05T11:27:18.740 INFO:teuthology.orchestra.run.smithi170.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2023-10-05T11:27:18.740 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-10-05T11:27:18.740 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-10-05T11:27:18.740 INFO:teuthology.orchestra.run.smithi170.stdout: 2023-10-05T11:27:18.940 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-mds-2:18.0.0-6543.g38321be8.el9.x86_64 86/120 2023-10-05T11:27:18.962 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-mds-2:18.0.0-6543.g38321be8.el9.x86_64 86/120 2023-10-05T11:27:18.962 INFO:teuthology.orchestra.run.smithi170.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-05T11:27:18.962 INFO:teuthology.orchestra.run.smithi170.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2023-10-05T11:27:18.962 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-10-05T11:27:18.962 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-10-05T11:27:18.963 INFO:teuthology.orchestra.run.smithi170.stdout: 2023-10-05T11:27:19.407 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-mon-2:18.0.0-6543.g38321be8.el9.x86_64 87/120 2023-10-05T11:27:19.429 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-mon-2:18.0.0-6543.g38321be8.el9.x86_64 87/120 2023-10-05T11:27:19.429 INFO:teuthology.orchestra.run.smithi170.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-05T11:27:19.429 INFO:teuthology.orchestra.run.smithi170.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2023-10-05T11:27:19.430 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-10-05T11:27:19.430 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-10-05T11:27:19.430 INFO:teuthology.orchestra.run.smithi170.stdout: 2023-10-05T11:27:19.493 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-ply-3.11-14.el9.noarch 88/120 2023-10-05T11:27:19.549 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 89/120 2023-10-05T11:27:19.740 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 90/120 2023-10-05T11:27:19.790 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 91/120 2023-10-05T11:27:19.859 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 92/120 2023-10-05T11:27:19.947 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 93/120 2023-10-05T11:27:20.079 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 94/120 2023-10-05T11:27:20.136 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 95/120 2023-10-05T11:27:20.166 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 96/120 2023-10-05T11:27:20.199 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 97/120 2023-10-05T11:27:20.231 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 98/120 2023-10-05T11:27:20.259 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : fuse-2.9.9-15.el9.x86_64 99/120 2023-10-05T11:27:20.687 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: cephadm-2:18.0.0-6543.g38321be8.el9.noarch 100/120 2023-10-05T11:27:20.717 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : cephadm-2:18.0.0-6543.g38321be8.el9.noarch 100/120 2023-10-05T11:27:20.745 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-6543.g38321be8.e 101/120 2023-10-05T11:27:20.806 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-6543.g38321be8. 102/120 2023-10-05T11:27:20.831 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-6543.g38321be8.el9.noa 103/120 2023-10-05T11:27:21.053 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-6543.g38321be8.el9.noa 103/120 2023-10-05T11:27:21.082 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-6543.g38321be8.el9.n 104/120 2023-10-05T11:27:22.044 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-6543.g38321be8.el9.n 104/120 2023-10-05T11:27:22.186 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-6543.g383 105/120 2023-10-05T11:27:22.186 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-6543.g383 105/120 2023-10-05T11:27:22.332 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-6543.g38321be8.el 106/120 2023-10-05T11:27:22.496 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-mgr-2:18.0.0-6543.g38321be8.el9.x86_64 107/120 2023-10-05T11:27:22.496 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-mgr-2:18.0.0-6543.g38321be8.el9.x86_64 107/120 2023-10-05T11:27:22.496 INFO:teuthology.orchestra.run.smithi170.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-05T11:27:22.496 INFO:teuthology.orchestra.run.smithi170.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2023-10-05T11:27:22.496 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-10-05T11:27:22.496 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-10-05T11:27:22.496 INFO:teuthology.orchestra.run.smithi170.stdout: 2023-10-05T11:27:22.496 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-mgr-rook-2:18.0.0-6543.g38321be8.el9.noarch 108/120 2023-10-05T11:27:22.496 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-6543.g38321be8.el9.noarch 108/120 2023-10-05T11:27:22.531 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-2:18.0.0-6543.g38321be8.el9.x86_64 109/120 2023-10-05T11:27:23.329 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-fuse-2:18.0.0-6543.g38321be8.el9.x86_64 110/120 2023-10-05T11:27:23.362 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-radosgw-2:18.0.0-6543.g38321be8.el9.x86_64 111/120 2023-10-05T11:27:23.384 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-6543.g38321be8.el9.x86_64 111/120 2023-10-05T11:27:23.384 INFO:teuthology.orchestra.run.smithi170.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-05T11:27:23.384 INFO:teuthology.orchestra.run.smithi170.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2023-10-05T11:27:23.384 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-10-05T11:27:23.384 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-10-05T11:27:23.384 INFO:teuthology.orchestra.run.smithi170.stdout: 2023-10-05T11:27:23.429 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-6543.g38321 112/120 2023-10-05T11:27:23.450 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-6543.g38321 112/120 2023-10-05T11:27:23.451 INFO:teuthology.orchestra.run.smithi170.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-05T11:27:23.451 INFO:teuthology.orchestra.run.smithi170.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2023-10-05T11:27:23.451 INFO:teuthology.orchestra.run.smithi170.stdout: 2023-10-05T11:27:23.754 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : rbd-mirror-2:18.0.0-6543.g38321be8.el9.x86_64 113/120 2023-10-05T11:27:23.776 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: rbd-mirror-2:18.0.0-6543.g38321be8.el9.x86_64 113/120 2023-10-05T11:27:23.776 INFO:teuthology.orchestra.run.smithi170.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-05T11:27:23.776 INFO:teuthology.orchestra.run.smithi170.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2023-10-05T11:27:23.776 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-10-05T11:27:23.777 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-10-05T11:27:23.777 INFO:teuthology.orchestra.run.smithi170.stdout: 2023-10-05T11:27:27.574 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-test-2:18.0.0-6543.g38321be8.el9.x86_64 114/120 2023-10-05T11:27:27.615 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : rbd-fuse-2:18.0.0-6543.g38321be8.el9.x86_64 115/120 2023-10-05T11:27:27.648 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : rbd-nbd-2:18.0.0-6543.g38321be8.el9.x86_64 116/120 2023-10-05T11:27:27.706 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libcephfs-devel-2:18.0.0-6543.g38321be8.el9.x86_ 117/120 2023-10-05T11:27:27.737 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : s3cmd-2.3.0-4.el9.noarch 118/120 2023-10-05T11:27:27.737 INFO:teuthology.orchestra.run.smithi170.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 119/120 2023-10-05T11:27:27.805 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 119/120 2023-10-05T11:27:27.805 INFO:teuthology.orchestra.run.smithi170.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 120/120 2023-10-05T11:27:32.203 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 120/120 2023-10-05T11:27:32.203 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-2:18.0.0-6543.g38321be8.el9.x86_64 1/120 2023-10-05T11:27:32.203 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-base-2:18.0.0-6543.g38321be8.el9.x86_64 2/120 2023-10-05T11:27:32.203 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-common-2:18.0.0-6543.g38321be8.el9.x86_64 3/120 2023-10-05T11:27:32.203 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-fuse-2:18.0.0-6543.g38321be8.el9.x86_64 4/120 2023-10-05T11:27:32.203 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-6543.g38321 5/120 2023-10-05T11:27:32.203 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-mds-2:18.0.0-6543.g38321be8.el9.x86_64 6/120 2023-10-05T11:27:32.203 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-mgr-2:18.0.0-6543.g38321be8.el9.x86_64 7/120 2023-10-05T11:27:32.204 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-mon-2:18.0.0-6543.g38321be8.el9.x86_64 8/120 2023-10-05T11:27:32.204 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-osd-2:18.0.0-6543.g38321be8.el9.x86_64 9/120 2023-10-05T11:27:32.204 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-radosgw-2:18.0.0-6543.g38321be8.el9.x86_64 10/120 2023-10-05T11:27:32.204 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-selinux-2:18.0.0-6543.g38321be8.el9.x86_64 11/120 2023-10-05T11:27:32.204 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-test-2:18.0.0-6543.g38321be8.el9.x86_64 12/120 2023-10-05T11:27:32.204 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libcephfs-devel-2:18.0.0-6543.g38321be8.el9.x86_ 13/120 2023-10-05T11:27:32.204 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libcephfs2-2:18.0.0-6543.g38321be8.el9.x86_64 14/120 2023-10-05T11:27:32.204 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libcephsqlite-2:18.0.0-6543.g38321be8.el9.x86_64 15/120 2023-10-05T11:27:32.204 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : librados-devel-2:18.0.0-6543.g38321be8.el9.x86_6 16/120 2023-10-05T11:27:32.204 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libradosstriper1-2:18.0.0-6543.g38321be8.el9.x86 17/120 2023-10-05T11:27:32.204 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : librgw2-2:18.0.0-6543.g38321be8.el9.x86_64 18/120 2023-10-05T11:27:32.205 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-ceph-argparse-2:18.0.0-6543.g38321be8.el 19/120 2023-10-05T11:27:32.205 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-ceph-common-2:18.0.0-6543.g38321be8.el9. 20/120 2023-10-05T11:27:32.205 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-cephfs-2:18.0.0-6543.g38321be8.el9.x86_6 21/120 2023-10-05T11:27:32.205 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-rados-2:18.0.0-6543.g38321be8.el9.x86_64 22/120 2023-10-05T11:27:32.205 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-rbd-2:18.0.0-6543.g38321be8.el9.x86_64 23/120 2023-10-05T11:27:32.205 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-rgw-2:18.0.0-6543.g38321be8.el9.x86_64 24/120 2023-10-05T11:27:32.205 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : rbd-fuse-2:18.0.0-6543.g38321be8.el9.x86_64 25/120 2023-10-05T11:27:32.205 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : rbd-mirror-2:18.0.0-6543.g38321be8.el9.x86_64 26/120 2023-10-05T11:27:32.205 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : rbd-nbd-2:18.0.0-6543.g38321be8.el9.x86_64 27/120 2023-10-05T11:27:32.205 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-6543.g38321be8. 28/120 2023-10-05T11:27:32.205 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-6543.g38321be8.el9.noa 29/120 2023-10-05T11:27:32.205 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-6543.g38321be8.el9.n 30/120 2023-10-05T11:27:32.213 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-6543.g383 31/120 2023-10-05T11:27:32.213 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-6543.g38321be8.el 32/120 2023-10-05T11:27:32.213 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-mgr-rook-2:18.0.0-6543.g38321be8.el9.noarch 33/120 2023-10-05T11:27:32.213 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-6543.g38321be8.e 34/120 2023-10-05T11:27:32.213 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-volume-2:18.0.0-6543.g38321be8.el9.noarch 35/120 2023-10-05T11:27:32.213 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : cephadm-2:18.0.0-6543.g38321be8.el9.noarch 36/120 2023-10-05T11:27:32.213 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 37/120 2023-10-05T11:27:32.213 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libgfortran-11.4.1-2.1.el9.x86_64 38/120 2023-10-05T11:27:32.213 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libquadmath-11.4.1-2.1.el9.x86_64 39/120 2023-10-05T11:27:32.214 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 40/120 2023-10-05T11:27:32.214 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 41/120 2023-10-05T11:27:32.214 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-ply-3.11-14.el9.noarch 42/120 2023-10-05T11:27:32.214 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 43/120 2023-10-05T11:27:32.214 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-requests-2.25.1-7.el9.noarch 44/120 2023-10-05T11:27:32.214 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-urllib3-1.26.5-3.el9.noarch 45/120 2023-10-05T11:27:32.214 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 46/120 2023-10-05T11:27:32.214 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 47/120 2023-10-05T11:27:32.214 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 48/120 2023-10-05T11:27:32.214 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 49/120 2023-10-05T11:27:32.214 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : jq-1.6-15.el9.x86_64 50/120 2023-10-05T11:27:32.214 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 51/120 2023-10-05T11:27:32.215 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 52/120 2023-10-05T11:27:32.215 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 53/120 2023-10-05T11:27:32.215 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 54/120 2023-10-05T11:27:32.215 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 55/120 2023-10-05T11:27:32.215 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 56/120 2023-10-05T11:27:32.215 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 57/120 2023-10-05T11:27:32.215 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 58/120 2023-10-05T11:27:32.215 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 59/120 2023-10-05T11:27:32.215 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 60/120 2023-10-05T11:27:32.216 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 61/120 2023-10-05T11:27:32.216 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 62/120 2023-10-05T11:27:32.216 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 63/120 2023-10-05T11:27:32.216 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 64/120 2023-10-05T11:27:32.216 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 65/120 2023-10-05T11:27:32.216 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 66/120 2023-10-05T11:27:32.216 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 67/120 2023-10-05T11:27:32.216 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 68/120 2023-10-05T11:27:32.216 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 69/120 2023-10-05T11:27:32.216 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 70/120 2023-10-05T11:27:32.216 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 71/120 2023-10-05T11:27:32.216 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 72/120 2023-10-05T11:27:32.216 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 73/120 2023-10-05T11:27:32.217 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 74/120 2023-10-05T11:27:32.217 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 75/120 2023-10-05T11:27:32.217 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 76/120 2023-10-05T11:27:32.217 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 77/120 2023-10-05T11:27:32.217 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 78/120 2023-10-05T11:27:32.217 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libarrow-9.0.0-9.el9.x86_64 79/120 2023-10-05T11:27:32.217 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libarrow-doc-9.0.0-9.el9.noarch 80/120 2023-10-05T11:27:32.217 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 81/120 2023-10-05T11:27:32.217 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 82/120 2023-10-05T11:27:32.217 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : parquet-libs-9.0.0-9.el9.x86_64 83/120 2023-10-05T11:27:32.217 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 84/120 2023-10-05T11:27:32.218 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 85/120 2023-10-05T11:27:32.218 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 86/120 2023-10-05T11:27:32.218 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 87/120 2023-10-05T11:27:32.218 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 88/120 2023-10-05T11:27:32.218 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 89/120 2023-10-05T11:27:32.218 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-google-auth-1:2.23.0-1.el9.noarch 90/120 2023-10-05T11:27:32.218 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 91/120 2023-10-05T11:27:32.218 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 92/120 2023-10-05T11:27:32.218 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 93/120 2023-10-05T11:27:32.218 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 94/120 2023-10-05T11:27:32.218 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 95/120 2023-10-05T11:27:32.218 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 96/120 2023-10-05T11:27:32.219 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 97/120 2023-10-05T11:27:32.219 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 98/120 2023-10-05T11:27:32.219 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 99/120 2023-10-05T11:27:32.219 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 100/120 2023-10-05T11:27:32.219 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 101/120 2023-10-05T11:27:32.219 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 102/120 2023-10-05T11:27:32.219 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 103/120 2023-10-05T11:27:32.219 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 104/120 2023-10-05T11:27:32.219 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 105/120 2023-10-05T11:27:32.219 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 106/120 2023-10-05T11:27:32.219 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 107/120 2023-10-05T11:27:32.219 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 108/120 2023-10-05T11:27:32.220 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 109/120 2023-10-05T11:27:32.220 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 110/120 2023-10-05T11:27:32.220 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 111/120 2023-10-05T11:27:32.220 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 112/120 2023-10-05T11:27:32.220 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 113/120 2023-10-05T11:27:32.220 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : re2-1:20211101-3.el9.x86_64 114/120 2023-10-05T11:27:32.220 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : s3cmd-2.3.0-4.el9.noarch 115/120 2023-10-05T11:27:32.220 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 116/120 2023-10-05T11:27:32.220 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : librados2-2:18.0.0-6543.g38321be8.el9.x86_64 117/120 2023-10-05T11:27:32.220 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 118/120 2023-10-05T11:27:32.220 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : librbd1-2:18.0.0-6543.g38321be8.el9.x86_64 119/120 2023-10-05T11:27:34.237 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 120/120 2023-10-05T11:27:34.238 INFO:teuthology.orchestra.run.smithi170.stdout: 2023-10-05T11:27:34.238 INFO:teuthology.orchestra.run.smithi170.stdout:Upgraded: 2023-10-05T11:27:34.238 INFO:teuthology.orchestra.run.smithi170.stdout: librados2-2:18.0.0-6543.g38321be8.el9.x86_64 2023-10-05T11:27:34.238 INFO:teuthology.orchestra.run.smithi170.stdout: librbd1-2:18.0.0-6543.g38321be8.el9.x86_64 2023-10-05T11:27:34.238 INFO:teuthology.orchestra.run.smithi170.stdout:Installed: 2023-10-05T11:27:34.238 INFO:teuthology.orchestra.run.smithi170.stdout: boost-program-options-1.75.0-8.el9.x86_64 2023-10-05T11:27:34.238 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-2:18.0.0-6543.g38321be8.el9.x86_64 2023-10-05T11:27:34.238 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-base-2:18.0.0-6543.g38321be8.el9.x86_64 2023-10-05T11:27:34.239 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-common-2:18.0.0-6543.g38321be8.el9.x86_64 2023-10-05T11:27:34.239 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-fuse-2:18.0.0-6543.g38321be8.el9.x86_64 2023-10-05T11:27:34.239 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-grafana-dashboards-2:18.0.0-6543.g38321be8.el9.noarch 2023-10-05T11:27:34.239 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-immutable-object-cache-2:18.0.0-6543.g38321be8.el9.x86_64 2023-10-05T11:27:34.239 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mds-2:18.0.0-6543.g38321be8.el9.x86_64 2023-10-05T11:27:34.239 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-2:18.0.0-6543.g38321be8.el9.x86_64 2023-10-05T11:27:34.239 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-cephadm-2:18.0.0-6543.g38321be8.el9.noarch 2023-10-05T11:27:34.239 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-dashboard-2:18.0.0-6543.g38321be8.el9.noarch 2023-10-05T11:27:34.239 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-diskprediction-local-2:18.0.0-6543.g38321be8.el9.noarch 2023-10-05T11:27:34.239 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-modules-core-2:18.0.0-6543.g38321be8.el9.noarch 2023-10-05T11:27:34.239 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-rook-2:18.0.0-6543.g38321be8.el9.noarch 2023-10-05T11:27:34.239 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mon-2:18.0.0-6543.g38321be8.el9.x86_64 2023-10-05T11:27:34.240 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-osd-2:18.0.0-6543.g38321be8.el9.x86_64 2023-10-05T11:27:34.240 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-prometheus-alerts-2:18.0.0-6543.g38321be8.el9.noarch 2023-10-05T11:27:34.240 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-radosgw-2:18.0.0-6543.g38321be8.el9.x86_64 2023-10-05T11:27:34.240 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-selinux-2:18.0.0-6543.g38321be8.el9.x86_64 2023-10-05T11:27:34.240 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-test-2:18.0.0-6543.g38321be8.el9.x86_64 2023-10-05T11:27:34.240 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-volume-2:18.0.0-6543.g38321be8.el9.noarch 2023-10-05T11:27:34.240 INFO:teuthology.orchestra.run.smithi170.stdout: cephadm-2:18.0.0-6543.g38321be8.el9.noarch 2023-10-05T11:27:34.240 INFO:teuthology.orchestra.run.smithi170.stdout: flexiblas-3.0.4-8.el9.x86_64 2023-10-05T11:27:34.240 INFO:teuthology.orchestra.run.smithi170.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2023-10-05T11:27:34.240 INFO:teuthology.orchestra.run.smithi170.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2023-10-05T11:27:34.240 INFO:teuthology.orchestra.run.smithi170.stdout: fmt-8.1.1-5.el9.x86_64 2023-10-05T11:27:34.240 INFO:teuthology.orchestra.run.smithi170.stdout: fuse-2.9.9-15.el9.x86_64 2023-10-05T11:27:34.241 INFO:teuthology.orchestra.run.smithi170.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2023-10-05T11:27:34.241 INFO:teuthology.orchestra.run.smithi170.stdout: jq-1.6-15.el9.x86_64 2023-10-05T11:27:34.241 INFO:teuthology.orchestra.run.smithi170.stdout: libarrow-9.0.0-9.el9.x86_64 2023-10-05T11:27:34.241 INFO:teuthology.orchestra.run.smithi170.stdout: libarrow-doc-9.0.0-9.el9.noarch 2023-10-05T11:27:34.241 INFO:teuthology.orchestra.run.smithi170.stdout: libcephfs-devel-2:18.0.0-6543.g38321be8.el9.x86_64 2023-10-05T11:27:34.241 INFO:teuthology.orchestra.run.smithi170.stdout: libcephfs2-2:18.0.0-6543.g38321be8.el9.x86_64 2023-10-05T11:27:34.241 INFO:teuthology.orchestra.run.smithi170.stdout: libcephsqlite-2:18.0.0-6543.g38321be8.el9.x86_64 2023-10-05T11:27:34.241 INFO:teuthology.orchestra.run.smithi170.stdout: libgfortran-11.4.1-2.1.el9.x86_64 2023-10-05T11:27:34.241 INFO:teuthology.orchestra.run.smithi170.stdout: liboath-2.6.7-2.el9.x86_64 2023-10-05T11:27:34.241 INFO:teuthology.orchestra.run.smithi170.stdout: libpmemobj-1.12.1-1.el9.x86_64 2023-10-05T11:27:34.241 INFO:teuthology.orchestra.run.smithi170.stdout: libquadmath-11.4.1-2.1.el9.x86_64 2023-10-05T11:27:34.241 INFO:teuthology.orchestra.run.smithi170.stdout: librabbitmq-0.11.0-7.el9.x86_64 2023-10-05T11:27:34.242 INFO:teuthology.orchestra.run.smithi170.stdout: librados-devel-2:18.0.0-6543.g38321be8.el9.x86_64 2023-10-05T11:27:34.242 INFO:teuthology.orchestra.run.smithi170.stdout: libradosstriper1-2:18.0.0-6543.g38321be8.el9.x86_64 2023-10-05T11:27:34.242 INFO:teuthology.orchestra.run.smithi170.stdout: librdkafka-1.6.1-102.el9.x86_64 2023-10-05T11:27:34.242 INFO:teuthology.orchestra.run.smithi170.stdout: librgw2-2:18.0.0-6543.g38321be8.el9.x86_64 2023-10-05T11:27:34.242 INFO:teuthology.orchestra.run.smithi170.stdout: libunwind-1.6.2-1.el9.x86_64 2023-10-05T11:27:34.242 INFO:teuthology.orchestra.run.smithi170.stdout: lttng-ust-2.12.0-6.el9.x86_64 2023-10-05T11:27:34.242 INFO:teuthology.orchestra.run.smithi170.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2023-10-05T11:27:34.242 INFO:teuthology.orchestra.run.smithi170.stdout: openblas-0.3.21-2.el9.x86_64 2023-10-05T11:27:34.242 INFO:teuthology.orchestra.run.smithi170.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2023-10-05T11:27:34.242 INFO:teuthology.orchestra.run.smithi170.stdout: parquet-libs-9.0.0-9.el9.x86_64 2023-10-05T11:27:34.242 INFO:teuthology.orchestra.run.smithi170.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2023-10-05T11:27:34.242 INFO:teuthology.orchestra.run.smithi170.stdout: python3-babel-2.9.1-2.el9.noarch 2023-10-05T11:27:34.243 INFO:teuthology.orchestra.run.smithi170.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2023-10-05T11:27:34.243 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cachetools-4.2.4-1.el9.noarch 2023-10-05T11:27:34.243 INFO:teuthology.orchestra.run.smithi170.stdout: python3-ceph-argparse-2:18.0.0-6543.g38321be8.el9.x86_64 2023-10-05T11:27:34.243 INFO:teuthology.orchestra.run.smithi170.stdout: python3-ceph-common-2:18.0.0-6543.g38321be8.el9.x86_64 2023-10-05T11:27:34.243 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cephfs-2:18.0.0-6543.g38321be8.el9.x86_64 2023-10-05T11:27:34.243 INFO:teuthology.orchestra.run.smithi170.stdout: python3-certifi-2021.10.8-2.el9.noarch 2023-10-05T11:27:34.243 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cffi-1.14.5-5.el9.x86_64 2023-10-05T11:27:34.243 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cheroot-8.6.0-4.el9.noarch 2023-10-05T11:27:34.243 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2023-10-05T11:27:34.243 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2023-10-05T11:27:34.243 INFO:teuthology.orchestra.run.smithi170.stdout: python3-devel-3.9.17-2.el9.x86_64 2023-10-05T11:27:34.244 INFO:teuthology.orchestra.run.smithi170.stdout: python3-google-auth-1:2.23.0-1.el9.noarch 2023-10-05T11:27:34.244 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jaraco-8.2.1-3.el9.noarch 2023-10-05T11:27:34.244 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2023-10-05T11:27:34.244 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2023-10-05T11:27:34.244 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2023-10-05T11:27:34.244 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2023-10-05T11:27:34.244 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jinja2-2.11.3-4.el9.noarch 2023-10-05T11:27:34.244 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jsonpatch-1.21-16.el9.noarch 2023-10-05T11:27:34.244 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jsonpointer-2.0-4.el9.noarch 2023-10-05T11:27:34.244 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jwt-2.4.0-1.el9.noarch 2023-10-05T11:27:34.244 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2023-10-05T11:27:34.244 INFO:teuthology.orchestra.run.smithi170.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2023-10-05T11:27:34.245 INFO:teuthology.orchestra.run.smithi170.stdout: python3-logutils-0.3.5-21.el9.noarch 2023-10-05T11:27:34.245 INFO:teuthology.orchestra.run.smithi170.stdout: python3-mako-1.1.4-6.el9.noarch 2023-10-05T11:27:34.245 INFO:teuthology.orchestra.run.smithi170.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2023-10-05T11:27:34.245 INFO:teuthology.orchestra.run.smithi170.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2023-10-05T11:27:34.245 INFO:teuthology.orchestra.run.smithi170.stdout: python3-natsort-7.1.1-5.el9.noarch 2023-10-05T11:27:34.245 INFO:teuthology.orchestra.run.smithi170.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2023-10-05T11:27:34.245 INFO:teuthology.orchestra.run.smithi170.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2023-10-05T11:27:34.245 INFO:teuthology.orchestra.run.smithi170.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2023-10-05T11:27:34.245 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pecan-1.4.2-3.el9.noarch 2023-10-05T11:27:34.245 INFO:teuthology.orchestra.run.smithi170.stdout: python3-ply-3.11-14.el9.noarch 2023-10-05T11:27:34.245 INFO:teuthology.orchestra.run.smithi170.stdout: python3-portend-3.1.0-2.el9.noarch 2023-10-05T11:27:34.245 INFO:teuthology.orchestra.run.smithi170.stdout: python3-prettytable-0.7.2-27.el9.noarch 2023-10-05T11:27:34.246 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2023-10-05T11:27:34.246 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2023-10-05T11:27:34.246 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2023-10-05T11:27:34.246 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pycparser-2.20-6.el9.noarch 2023-10-05T11:27:34.246 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pytz-2021.1-5.el9.noarch 2023-10-05T11:27:34.246 INFO:teuthology.orchestra.run.smithi170.stdout: python3-rados-2:18.0.0-6543.g38321be8.el9.x86_64 2023-10-05T11:27:34.246 INFO:teuthology.orchestra.run.smithi170.stdout: python3-rbd-2:18.0.0-6543.g38321be8.el9.x86_64 2023-10-05T11:27:34.246 INFO:teuthology.orchestra.run.smithi170.stdout: python3-repoze-lru-0.7-16.el9.noarch 2023-10-05T11:27:34.246 INFO:teuthology.orchestra.run.smithi170.stdout: python3-requests-2.25.1-7.el9.noarch 2023-10-05T11:27:34.246 INFO:teuthology.orchestra.run.smithi170.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2023-10-05T11:27:34.246 INFO:teuthology.orchestra.run.smithi170.stdout: python3-rgw-2:18.0.0-6543.g38321be8.el9.x86_64 2023-10-05T11:27:34.246 INFO:teuthology.orchestra.run.smithi170.stdout: python3-routes-2.5.1-5.el9.noarch 2023-10-05T11:27:34.247 INFO:teuthology.orchestra.run.smithi170.stdout: python3-rsa-4.9-2.el9.noarch 2023-10-05T11:27:34.247 INFO:teuthology.orchestra.run.smithi170.stdout: python3-scipy-1.6.2-8.el9.x86_64 2023-10-05T11:27:34.247 INFO:teuthology.orchestra.run.smithi170.stdout: python3-tempora-5.0.0-2.el9.noarch 2023-10-05T11:27:34.247 INFO:teuthology.orchestra.run.smithi170.stdout: python3-toml-0.10.2-6.el9.noarch 2023-10-05T11:27:34.247 INFO:teuthology.orchestra.run.smithi170.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2023-10-05T11:27:34.247 INFO:teuthology.orchestra.run.smithi170.stdout: python3-urllib3-1.26.5-3.el9.noarch 2023-10-05T11:27:34.247 INFO:teuthology.orchestra.run.smithi170.stdout: python3-webob-1.8.7-6.el9.noarch 2023-10-05T11:27:34.247 INFO:teuthology.orchestra.run.smithi170.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2023-10-05T11:27:34.247 INFO:teuthology.orchestra.run.smithi170.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2023-10-05T11:27:34.247 INFO:teuthology.orchestra.run.smithi170.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2023-10-05T11:27:34.247 INFO:teuthology.orchestra.run.smithi170.stdout: rbd-fuse-2:18.0.0-6543.g38321be8.el9.x86_64 2023-10-05T11:27:34.247 INFO:teuthology.orchestra.run.smithi170.stdout: rbd-mirror-2:18.0.0-6543.g38321be8.el9.x86_64 2023-10-05T11:27:34.248 INFO:teuthology.orchestra.run.smithi170.stdout: rbd-nbd-2:18.0.0-6543.g38321be8.el9.x86_64 2023-10-05T11:27:34.248 INFO:teuthology.orchestra.run.smithi170.stdout: re2-1:20211101-3.el9.x86_64 2023-10-05T11:27:34.248 INFO:teuthology.orchestra.run.smithi170.stdout: s3cmd-2.3.0-4.el9.noarch 2023-10-05T11:27:34.248 INFO:teuthology.orchestra.run.smithi170.stdout: socat-1.7.4.1-5.el9.x86_64 2023-10-05T11:27:34.248 INFO:teuthology.orchestra.run.smithi170.stdout: thrift-0.15.0-2.el9.x86_64 2023-10-05T11:27:34.248 INFO:teuthology.orchestra.run.smithi170.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2023-10-05T11:27:34.248 INFO:teuthology.orchestra.run.smithi170.stdout: 2023-10-05T11:27:34.248 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2023-10-05T11:27:34.587 DEBUG:teuthology.parallel:result is None 2023-10-05T11:27:34.588 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=38321be854743c0d616618a9ea8aa0b1d4dbc0bf 2023-10-05T11:27:34.905 DEBUG:teuthology.orchestra.run.smithi012:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-05T11:27:34.932 INFO:teuthology.orchestra.run.smithi012.stdout:18.0.0-6543.g38321be8.el9 2023-10-05T11:27:34.932 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-6543.g38321be8.el9 2023-10-05T11:27:34.932 INFO:teuthology.task.install:The correct ceph version 18.0.0-6543.g38321be8 is installed. 2023-10-05T11:27:34.933 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=38321be854743c0d616618a9ea8aa0b1d4dbc0bf 2023-10-05T11:27:35.279 DEBUG:teuthology.orchestra.run.smithi170:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-05T11:27:35.301 INFO:teuthology.orchestra.run.smithi170.stdout:18.0.0-6543.g38321be8.el9 2023-10-05T11:27:35.301 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-6543.g38321be8.el9 2023-10-05T11:27:35.301 INFO:teuthology.task.install:The correct ceph version 18.0.0-6543.g38321be8 is installed. 2023-10-05T11:27:35.301 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-10-05T11:27:35.302 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-10-05T11:27:35.302 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-05T11:27:35.340 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2023-10-05T11:27:35.341 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-05T11:27:35.370 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-10-05T11:27:35.370 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-10-05T11:27:35.370 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/usr/bin/daemon-helper 2023-10-05T11:27:35.415 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-05T11:27:35.489 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2023-10-05T11:27:35.489 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd of=/usr/bin/daemon-helper 2023-10-05T11:27:35.516 DEBUG:teuthology.orchestra.run.smithi170:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-05T11:27:35.582 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-10-05T11:27:35.582 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-10-05T11:27:35.582 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-05T11:27:35.617 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-05T11:27:35.690 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2023-10-05T11:27:35.690 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-05T11:27:35.717 DEBUG:teuthology.orchestra.run.smithi170:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-05T11:27:35.783 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-10-05T11:27:35.783 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-10-05T11:27:35.783 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/usr/bin/stdin-killer 2023-10-05T11:27:35.817 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-05T11:27:35.892 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2023-10-05T11:27:35.892 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd of=/usr/bin/stdin-killer 2023-10-05T11:27:35.918 DEBUG:teuthology.orchestra.run.smithi170:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-05T11:27:35.985 INFO:teuthology.run_tasks:Running task ceph... 2023-10-05T11:27:36.054 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-10-05T11:27:36.055 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod 777 /var/log/ceph 2023-10-05T11:27:36.057 DEBUG:teuthology.orchestra.run.smithi170:> sudo chmod 777 /var/log/ceph 2023-10-05T11:27:36.090 INFO:tasks.ceph:Disabling ceph logrotate... 2023-10-05T11:27:36.090 DEBUG:teuthology.orchestra.run.smithi012:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-05T11:27:36.133 DEBUG:teuthology.orchestra.run.smithi170:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-05T11:27:36.166 INFO:tasks.ceph:Creating extra log directories... 2023-10-05T11:27:36.166 DEBUG:teuthology.orchestra.run.smithi012:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-05T11:27:36.208 DEBUG:teuthology.orchestra.run.smithi170:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-05T11:27:36.251 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-10-05T11:27:36.251 INFO:tasks.ceph:config {'conf': {'client': {'debug rgw': 20, 'debug rgw_datacache': 30, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw d3n l1 datacache persistent path': '/tmp/rgw_datacache/', 'rgw d3n l1 datacache size': 10737418240, 'rgw d3n l1 local datacache enabled': True, 'rgw enable ops log': True, 'rgw filter': 'd3n', 'rgw torrent flag': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'global': {'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd heartbeat grace': 40, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon osd crush smoke test': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', '\\(OSD_SLOW_PING_TIME'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-10-05T11:27:36.251 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/prsrivas-2023-10-05_05:12:08-rgw-wip-rgw-d3n-filter-distro-default-smithi/7411331', 'branch': 'wip-rgw-d3n-filter', 'description': 'rgw/verify/{0-install clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec-profile s3tests-branch sharding$/{default} striping$/{stripe-equals-chunk} supported-random-distro$/{centos_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/valgrind}', 'email': None, 'first_in_suite': False, 'job_id': '7411331', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'prsrivas-2023-10-05_05:12:08-rgw-wip-rgw-d3n-filter-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 10}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-rgw-d3n-filter'}, 'ceph': {'conf': {'client': {'debug rgw': 20, 'debug rgw_datacache': 30, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw d3n l1 datacache persistent path': '/tmp/rgw_datacache/', 'rgw d3n l1 datacache size': 10737418240, 'rgw d3n l1 local datacache enabled': True, 'rgw enable ops log': True, 'rgw filter': 'd3n', 'rgw torrent flag': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'global': {'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd heartbeat grace': 40, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon osd crush smoke test': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', '\\(OSD_SLOW_PING_TIME'], 'sha1': '38321be854743c0d616618a9ea8aa0b1d4dbc0bf'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '38321be854743c0d616618a9ea8aa0b1d4dbc0bf'}}, 'rgw': {'client.0': {'valgrind': ['--tool=memcheck', '--max-threads=1024']}, 'compression type': 'random', 'datacache': True, 'datacache_path': '/tmp/rgw_datacache', 'ec-data-pool': True, 'erasure_code_profile': {'crush-failure-domain': 'osd', 'k': 3, 'm': 1, 'name': 'testprofile'}, 'frontend': 'beast', 'inline data': False, 'storage classes': 'LUKEWARM, FROZEN'}, 's3tests': {'force-branch': 'ceph-master', 'slow_backend': True, 'storage classes': 'LUKEWARM, FROZEN'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-rgw-d3n-filter', 'sha1': '38321be854743c0d616618a9ea8aa0b1d4dbc0bf'}}, 'owner': 'scheduled_prsrivas@teuthology', 'priority': 80, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'], ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']], 'seed': 1815, 'sha1': '38321be854743c0d616618a9ea8aa0b1d4dbc0bf', 'sleep_before_teardown': 0, 'suite': 'rgw', 'suite_branch': 'wip-rgw-d3n-filter', 'suite_path': '/home/teuthworker/src/github.com_pritha-srivastava_ceph_38321be854743c0d616618a9ea8aa0b1d4dbc0bf/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/pritha-srivastava/ceph.git', 'suite_sha1': '38321be854743c0d616618a9ea8aa0b1d4dbc0bf', 'targets': {'smithi012.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOgpaICNFfRxogNOB1i4tMaInC0z15nTSYr/P8xvHQ1AjjbvbYvsm/lWaVc06ueeus3uSz5dpKMDJLOwS1avFlU=', 'smithi170.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBB/H8rPW3MDhFqeKPJsSAROqZ831G4Rq11eVY8UEeLVxXTN+Z2dtdc/8h4OZaWZ14amxLi+t2MIT3oivt6/xT0U='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_system_packages': {'deb': ['s3cmd'], 'rpm': ['s3cmd']}, 'flavor': 'default', 'sha1': '38321be854743c0d616618a9ea8aa0b1d4dbc0bf'}}, {'ceph': None}, {'openssl_keys': None}, {'rgw': {'client.0': None}}, {'tox': ['client.0']}, {'workunit': {'clients': {'client.0': ['rgw/run-datacache.sh']}, 'env': {'RGW_DATACACHE_PATH': '/tmp/rgw_datacache'}}}, {'workunit': {'clients': {'client.0': ['rgw/run-bucket-check.sh']}}}, {'workunit': {'clients': {'client.0': ['cls/test_cls_lock.sh', 'cls/test_cls_log.sh', 'cls/test_cls_refcount.sh', 'cls/test_cls_rgw.sh', 'cls/test_cls_rgw_gc.sh', 'cls/test_cls_rgw_stats.sh', 'cls/test_cls_cmpomap.sh', 'cls/test_cls_2pc_queue.sh', 'rgw/test_rgw_gc_log.sh', 'rgw/test_rgw_obj.sh', 'rgw/test_librgw_file.sh']}}}, {'workunit': {'clients': {'client.0': ['rgw/test_rgw_s3_mp_reupload.sh']}}}, {'ragweed': {'client.0': {'default-branch': 'ceph-master', 'rgw_server': 'client.0', 'stages': 'prepare,check'}}}, {'workunit': {'clients': {'client.0': ['rgw/run-reshard.sh']}}}, {'s3tests-java': {'client.0': {'force-branch': 'ceph-master', 'force-repo': 'https://github.com/ceph/java_s3tests.git'}}}, {'s3tests': {'client.0': {'rgw_server': 'client.0'}}}, {'workunit': {'clients': {'client.0': ['rgw/run-versioning.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '54e62bcbac4e53d9685e08328b790d3b20d71cae', 'timestamp': '2023-10-05_05:12:08', 'tube': 'smithi', 'user': 'prsrivas', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2830'} 2023-10-05T11:27:36.253 DEBUG:teuthology.orchestra.run.smithi012:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-05T11:27:36.283 DEBUG:teuthology.orchestra.run.smithi170:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-05T11:27:36.298 DEBUG:teuthology.orchestra.run.smithi012:> sudo install -d -m0777 -- /var/run/ceph 2023-10-05T11:27:36.340 DEBUG:teuthology.orchestra.run.smithi170:> sudo install -d -m0777 -- /var/run/ceph 2023-10-05T11:27:36.555 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-10-05T11:27:36.556 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/scratch_devs of=/dev/stdout 2023-10-05T11:27:36.586 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-05T11:27:36.586 DEBUG:teuthology.orchestra.run.smithi012:> stat /dev/vg_nvme/lv_1 2023-10-05T11:27:36.643 INFO:teuthology.orchestra.run.smithi012.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-05T11:27:36.643 INFO:teuthology.orchestra.run.smithi012.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-05T11:27:36.643 INFO:teuthology.orchestra.run.smithi012.stdout:Device: 5h/5d Inode: 663 Links: 1 2023-10-05T11:27:36.643 INFO:teuthology.orchestra.run.smithi012.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-05T11:27:36.643 INFO:teuthology.orchestra.run.smithi012.stdout:Context: system_u:object_r:device_t:s0 2023-10-05T11:27:36.643 INFO:teuthology.orchestra.run.smithi012.stdout:Access: 2023-10-05 11:27:07.129921261 +0000 2023-10-05T11:27:36.643 INFO:teuthology.orchestra.run.smithi012.stdout:Modify: 2023-10-05 11:25:25.009311558 +0000 2023-10-05T11:27:36.644 INFO:teuthology.orchestra.run.smithi012.stdout:Change: 2023-10-05 11:25:25.009311558 +0000 2023-10-05T11:27:36.644 INFO:teuthology.orchestra.run.smithi012.stdout: Birth: 2023-10-05 11:25:25.009311558 +0000 2023-10-05T11:27:36.644 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-05T11:27:36.715 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records in 2023-10-05T11:27:36.715 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records out 2023-10-05T11:27:36.715 INFO:teuthology.orchestra.run.smithi012.stderr:512 bytes copied, 0.000211459 s, 2.4 MB/s 2023-10-05T11:27:36.717 DEBUG:teuthology.orchestra.run.smithi012:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-05T11:27:36.774 DEBUG:teuthology.orchestra.run.smithi012:> stat /dev/vg_nvme/lv_2 2023-10-05T11:27:36.831 INFO:teuthology.orchestra.run.smithi012.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-05T11:27:36.831 INFO:teuthology.orchestra.run.smithi012.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-05T11:27:36.831 INFO:teuthology.orchestra.run.smithi012.stdout:Device: 5h/5d Inode: 682 Links: 1 2023-10-05T11:27:36.831 INFO:teuthology.orchestra.run.smithi012.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-05T11:27:36.831 INFO:teuthology.orchestra.run.smithi012.stdout:Context: system_u:object_r:device_t:s0 2023-10-05T11:27:36.832 INFO:teuthology.orchestra.run.smithi012.stdout:Access: 2023-10-05 11:27:07.129921261 +0000 2023-10-05T11:27:36.832 INFO:teuthology.orchestra.run.smithi012.stdout:Modify: 2023-10-05 11:25:25.516308106 +0000 2023-10-05T11:27:36.832 INFO:teuthology.orchestra.run.smithi012.stdout:Change: 2023-10-05 11:25:25.516308106 +0000 2023-10-05T11:27:36.832 INFO:teuthology.orchestra.run.smithi012.stdout: Birth: 2023-10-05 11:25:25.516308106 +0000 2023-10-05T11:27:36.832 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-05T11:27:36.903 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records in 2023-10-05T11:27:36.903 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records out 2023-10-05T11:27:36.903 INFO:teuthology.orchestra.run.smithi012.stderr:512 bytes copied, 0.0002451 s, 2.1 MB/s 2023-10-05T11:27:36.904 DEBUG:teuthology.orchestra.run.smithi012:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-05T11:27:36.961 DEBUG:teuthology.orchestra.run.smithi012:> stat /dev/vg_nvme/lv_3 2023-10-05T11:27:37.017 INFO:teuthology.orchestra.run.smithi012.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-05T11:27:37.017 INFO:teuthology.orchestra.run.smithi012.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-05T11:27:37.018 INFO:teuthology.orchestra.run.smithi012.stdout:Device: 5h/5d Inode: 702 Links: 1 2023-10-05T11:27:37.018 INFO:teuthology.orchestra.run.smithi012.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-05T11:27:37.018 INFO:teuthology.orchestra.run.smithi012.stdout:Context: system_u:object_r:device_t:s0 2023-10-05T11:27:37.018 INFO:teuthology.orchestra.run.smithi012.stdout:Access: 2023-10-05 11:27:07.129921261 +0000 2023-10-05T11:27:37.018 INFO:teuthology.orchestra.run.smithi012.stdout:Modify: 2023-10-05 11:25:26.010304743 +0000 2023-10-05T11:27:37.018 INFO:teuthology.orchestra.run.smithi012.stdout:Change: 2023-10-05 11:25:26.010304743 +0000 2023-10-05T11:27:37.018 INFO:teuthology.orchestra.run.smithi012.stdout: Birth: 2023-10-05 11:25:26.010304743 +0000 2023-10-05T11:27:37.018 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-05T11:27:37.088 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records in 2023-10-05T11:27:37.088 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records out 2023-10-05T11:27:37.088 INFO:teuthology.orchestra.run.smithi012.stderr:512 bytes copied, 0.000187326 s, 2.7 MB/s 2023-10-05T11:27:37.089 DEBUG:teuthology.orchestra.run.smithi012:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-05T11:27:37.146 DEBUG:teuthology.orchestra.run.smithi012:> stat /dev/vg_nvme/lv_4 2023-10-05T11:27:37.202 INFO:teuthology.orchestra.run.smithi012.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-05T11:27:37.202 INFO:teuthology.orchestra.run.smithi012.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-05T11:27:37.202 INFO:teuthology.orchestra.run.smithi012.stdout:Device: 5h/5d Inode: 720 Links: 1 2023-10-05T11:27:37.202 INFO:teuthology.orchestra.run.smithi012.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-05T11:27:37.202 INFO:teuthology.orchestra.run.smithi012.stdout:Context: system_u:object_r:device_t:s0 2023-10-05T11:27:37.202 INFO:teuthology.orchestra.run.smithi012.stdout:Access: 2023-10-05 11:27:07.130921255 +0000 2023-10-05T11:27:37.202 INFO:teuthology.orchestra.run.smithi012.stdout:Modify: 2023-10-05 11:25:26.491301468 +0000 2023-10-05T11:27:37.203 INFO:teuthology.orchestra.run.smithi012.stdout:Change: 2023-10-05 11:25:26.491301468 +0000 2023-10-05T11:27:37.203 INFO:teuthology.orchestra.run.smithi012.stdout: Birth: 2023-10-05 11:25:26.491301468 +0000 2023-10-05T11:27:37.203 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-05T11:27:37.273 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records in 2023-10-05T11:27:37.273 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records out 2023-10-05T11:27:37.273 INFO:teuthology.orchestra.run.smithi012.stderr:512 bytes copied, 0.000178002 s, 2.9 MB/s 2023-10-05T11:27:37.274 DEBUG:teuthology.orchestra.run.smithi012:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-05T11:27:37.331 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-05T11:27:37.331 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2023-10-05T11:27:37.331 DEBUG:teuthology.orchestra.run.smithi170:> dd if=/scratch_devs of=/dev/stdout 2023-10-05T11:27:37.349 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-05T11:27:37.349 DEBUG:teuthology.orchestra.run.smithi170:> stat /dev/vg_nvme/lv_1 2023-10-05T11:27:37.406 INFO:teuthology.orchestra.run.smithi170.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-05T11:27:37.407 INFO:teuthology.orchestra.run.smithi170.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-05T11:27:37.407 INFO:teuthology.orchestra.run.smithi170.stdout:Device: 5h/5d Inode: 665 Links: 1 2023-10-05T11:27:37.407 INFO:teuthology.orchestra.run.smithi170.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-05T11:27:37.407 INFO:teuthology.orchestra.run.smithi170.stdout:Context: system_u:object_r:device_t:s0 2023-10-05T11:27:37.407 INFO:teuthology.orchestra.run.smithi170.stdout:Access: 2023-10-05 11:27:28.245433392 +0000 2023-10-05T11:27:37.407 INFO:teuthology.orchestra.run.smithi170.stdout:Modify: 2023-10-05 11:25:16.859247616 +0000 2023-10-05T11:27:37.407 INFO:teuthology.orchestra.run.smithi170.stdout:Change: 2023-10-05 11:25:16.859247616 +0000 2023-10-05T11:27:37.407 INFO:teuthology.orchestra.run.smithi170.stdout: Birth: 2023-10-05 11:25:16.859247616 +0000 2023-10-05T11:27:37.407 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-05T11:27:37.474 INFO:teuthology.orchestra.run.smithi170.stderr:1+0 records in 2023-10-05T11:27:37.475 INFO:teuthology.orchestra.run.smithi170.stderr:1+0 records out 2023-10-05T11:27:37.475 INFO:teuthology.orchestra.run.smithi170.stderr:512 bytes copied, 9.3486e-05 s, 5.5 MB/s 2023-10-05T11:27:37.476 DEBUG:teuthology.orchestra.run.smithi170:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-05T11:27:37.533 DEBUG:teuthology.orchestra.run.smithi170:> stat /dev/vg_nvme/lv_2 2023-10-05T11:27:37.590 INFO:teuthology.orchestra.run.smithi170.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-05T11:27:37.590 INFO:teuthology.orchestra.run.smithi170.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-05T11:27:37.591 INFO:teuthology.orchestra.run.smithi170.stdout:Device: 5h/5d Inode: 681 Links: 1 2023-10-05T11:27:37.591 INFO:teuthology.orchestra.run.smithi170.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-05T11:27:37.591 INFO:teuthology.orchestra.run.smithi170.stdout:Context: system_u:object_r:device_t:s0 2023-10-05T11:27:37.591 INFO:teuthology.orchestra.run.smithi170.stdout:Access: 2023-10-05 11:27:28.245433392 +0000 2023-10-05T11:27:37.591 INFO:teuthology.orchestra.run.smithi170.stdout:Modify: 2023-10-05 11:25:17.336236676 +0000 2023-10-05T11:27:37.591 INFO:teuthology.orchestra.run.smithi170.stdout:Change: 2023-10-05 11:25:17.336236676 +0000 2023-10-05T11:27:37.591 INFO:teuthology.orchestra.run.smithi170.stdout: Birth: 2023-10-05 11:25:17.336236676 +0000 2023-10-05T11:27:37.591 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-05T11:27:37.659 INFO:teuthology.orchestra.run.smithi170.stderr:1+0 records in 2023-10-05T11:27:37.659 INFO:teuthology.orchestra.run.smithi170.stderr:1+0 records out 2023-10-05T11:27:37.659 INFO:teuthology.orchestra.run.smithi170.stderr:512 bytes copied, 0.000106871 s, 4.8 MB/s 2023-10-05T11:27:37.660 DEBUG:teuthology.orchestra.run.smithi170:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-05T11:27:37.718 DEBUG:teuthology.orchestra.run.smithi170:> stat /dev/vg_nvme/lv_3 2023-10-05T11:27:37.774 INFO:teuthology.orchestra.run.smithi170.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-05T11:27:37.774 INFO:teuthology.orchestra.run.smithi170.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-05T11:27:37.774 INFO:teuthology.orchestra.run.smithi170.stdout:Device: 5h/5d Inode: 703 Links: 1 2023-10-05T11:27:37.774 INFO:teuthology.orchestra.run.smithi170.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-05T11:27:37.774 INFO:teuthology.orchestra.run.smithi170.stdout:Context: system_u:object_r:device_t:s0 2023-10-05T11:27:37.774 INFO:teuthology.orchestra.run.smithi170.stdout:Access: 2023-10-05 11:27:28.245433392 +0000 2023-10-05T11:27:37.774 INFO:teuthology.orchestra.run.smithi170.stdout:Modify: 2023-10-05 11:25:17.810225806 +0000 2023-10-05T11:27:37.775 INFO:teuthology.orchestra.run.smithi170.stdout:Change: 2023-10-05 11:25:17.810225806 +0000 2023-10-05T11:27:37.775 INFO:teuthology.orchestra.run.smithi170.stdout: Birth: 2023-10-05 11:25:17.810225806 +0000 2023-10-05T11:27:37.775 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-05T11:27:37.840 INFO:teuthology.orchestra.run.smithi170.stderr:1+0 records in 2023-10-05T11:27:37.840 INFO:teuthology.orchestra.run.smithi170.stderr:1+0 records out 2023-10-05T11:27:37.841 INFO:teuthology.orchestra.run.smithi170.stderr:512 bytes copied, 0.000109312 s, 4.7 MB/s 2023-10-05T11:27:37.842 DEBUG:teuthology.orchestra.run.smithi170:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-05T11:27:37.899 DEBUG:teuthology.orchestra.run.smithi170:> stat /dev/vg_nvme/lv_4 2023-10-05T11:27:37.954 INFO:teuthology.orchestra.run.smithi170.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-05T11:27:37.955 INFO:teuthology.orchestra.run.smithi170.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-05T11:27:37.955 INFO:teuthology.orchestra.run.smithi170.stdout:Device: 5h/5d Inode: 721 Links: 1 2023-10-05T11:27:37.955 INFO:teuthology.orchestra.run.smithi170.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-05T11:27:37.955 INFO:teuthology.orchestra.run.smithi170.stdout:Context: system_u:object_r:device_t:s0 2023-10-05T11:27:37.955 INFO:teuthology.orchestra.run.smithi170.stdout:Access: 2023-10-05 11:27:28.246433369 +0000 2023-10-05T11:27:37.955 INFO:teuthology.orchestra.run.smithi170.stdout:Modify: 2023-10-05 11:25:18.288214844 +0000 2023-10-05T11:27:37.955 INFO:teuthology.orchestra.run.smithi170.stdout:Change: 2023-10-05 11:25:18.288214844 +0000 2023-10-05T11:27:37.955 INFO:teuthology.orchestra.run.smithi170.stdout: Birth: 2023-10-05 11:25:18.288214844 +0000 2023-10-05T11:27:37.956 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-05T11:27:38.021 INFO:teuthology.orchestra.run.smithi170.stderr:1+0 records in 2023-10-05T11:27:38.021 INFO:teuthology.orchestra.run.smithi170.stderr:1+0 records out 2023-10-05T11:27:38.021 INFO:teuthology.orchestra.run.smithi170.stderr:512 bytes copied, 9.9076e-05 s, 5.2 MB/s 2023-10-05T11:27:38.023 DEBUG:teuthology.orchestra.run.smithi170:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-05T11:27:38.078 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-05T11:27:38.079 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi012.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi170.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-10-05T11:27:38.079 INFO:tasks.ceph:Generating config... 2023-10-05T11:27:38.080 INFO:tasks.ceph:[client] debug rgw = 20 2023-10-05T11:27:38.080 INFO:tasks.ceph:[client] debug rgw_datacache = 30 2023-10-05T11:27:38.080 INFO:tasks.ceph:[client] rgw crypt require ssl = False 2023-10-05T11:27:38.080 INFO:tasks.ceph:[client] rgw crypt s3 kms backend = testing 2023-10-05T11:27:38.080 INFO:tasks.ceph:[client] rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2023-10-05T11:27:38.080 INFO:tasks.ceph:[client] rgw d3n l1 datacache persistent path = /tmp/rgw_datacache/ 2023-10-05T11:27:38.081 INFO:tasks.ceph:[client] rgw d3n l1 datacache size = 10737418240 2023-10-05T11:27:38.081 INFO:tasks.ceph:[client] rgw d3n l1 local datacache enabled = True 2023-10-05T11:27:38.081 INFO:tasks.ceph:[client] rgw enable ops log = True 2023-10-05T11:27:38.081 INFO:tasks.ceph:[client] rgw filter = d3n 2023-10-05T11:27:38.081 INFO:tasks.ceph:[client] rgw torrent flag = True 2023-10-05T11:27:38.081 INFO:tasks.ceph:[client] setgroup = ceph 2023-10-05T11:27:38.081 INFO:tasks.ceph:[client] setuser = ceph 2023-10-05T11:27:38.081 INFO:tasks.ceph:[global] mon client directed command retry = 5 2023-10-05T11:27:38.081 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2023-10-05T11:27:38.081 INFO:tasks.ceph:[global] osd heartbeat grace = 40 2023-10-05T11:27:38.081 INFO:tasks.ceph:[global] osd_max_pg_log_entries = 10 2023-10-05T11:27:38.081 INFO:tasks.ceph:[global] osd_min_pg_log_entries = 10 2023-10-05T11:27:38.081 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-10-05T11:27:38.082 INFO:tasks.ceph:[mgr] debug ms = 1 2023-10-05T11:27:38.082 INFO:tasks.ceph:[mon] debug mon = 20 2023-10-05T11:27:38.082 INFO:tasks.ceph:[mon] debug ms = 1 2023-10-05T11:27:38.082 INFO:tasks.ceph:[mon] debug paxos = 20 2023-10-05T11:27:38.082 INFO:tasks.ceph:[mon] mon osd crush smoke test = False 2023-10-05T11:27:38.082 INFO:tasks.ceph:[osd] bdev async discard = True 2023-10-05T11:27:38.082 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-10-05T11:27:38.082 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-10-05T11:27:38.082 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-10-05T11:27:38.082 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-10-05T11:27:38.082 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-10-05T11:27:38.083 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-10-05T11:27:38.083 INFO:tasks.ceph:[osd] debug ms = 1 2023-10-05T11:27:38.083 INFO:tasks.ceph:[osd] debug osd = 20 2023-10-05T11:27:38.083 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-10-05T11:27:38.083 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-10-05T11:27:38.083 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-10-05T11:27:38.083 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-10-05T11:27:38.083 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-10-05T11:27:38.083 INFO:tasks.ceph:[osd] osd fast shutdown = False 2023-10-05T11:27:38.083 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-10-05T11:27:38.083 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2023-10-05T11:27:38.084 INFO:tasks.ceph:Setting up mon.a... 2023-10-05T11:27:38.084 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-10-05T11:27:38.142 INFO:teuthology.orchestra.run.smithi012.stdout:creating /etc/ceph/ceph.keyring 2023-10-05T11:27:38.146 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-10-05T11:27:38.196 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-05T11:27:38.227 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.12'), ('mon.c', '[v2:172.21.15.12:3301,v1:172.21.15.12:6790]'), ('mon.b', '172.21.15.170')] 2023-10-05T11:27:38.228 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.12,[v2:172.21.15.12:3301,v1:172.21.15.12:6790],172.21.15.170', 'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd heartbeat grace': 40, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon osd crush smoke test': False}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': True, 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug rgw': 20, 'debug rgw_datacache': 30, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw d3n l1 datacache persistent path': '/tmp/rgw_datacache/', 'rgw d3n l1 datacache size': 10737418240, 'rgw d3n l1 local datacache enabled': True, 'rgw filter': 'd3n', 'rgw torrent flag': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mon.a': {}, 'mon.c': {}, 'mon.b': {}} 2023-10-05T11:27:38.229 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-10-05T11:27:38.229 DEBUG:teuthology.orchestra.run.smithi012:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-10-05T11:27:38.283 DEBUG:teuthology.orchestra.run.smithi012:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.12 --addv c '[v2:172.21.15.12:3301,v1:172.21.15.12:6790]' --add b 172.21.15.170 --print /home/ubuntu/cephtest/ceph.monmap 2023-10-05T11:27:38.368 INFO:teuthology.orchestra.run.smithi012.stderr:ignoring --setuser ceph since I am not root 2023-10-05T11:27:38.368 INFO:teuthology.orchestra.run.smithi012.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T11:27:38.369 INFO:teuthology.orchestra.run.smithi012.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-10-05T11:27:38.369 INFO:teuthology.orchestra.run.smithi012.stdout:monmaptool: generated fsid 7e015f46-293b-4b09-bd32-7d32b52f6e2f 2023-10-05T11:27:38.369 INFO:teuthology.orchestra.run.smithi012.stdout:setting min_mon_release = pacific 2023-10-05T11:27:38.369 INFO:teuthology.orchestra.run.smithi012.stdout:epoch 0 2023-10-05T11:27:38.369 INFO:teuthology.orchestra.run.smithi012.stdout:fsid 7e015f46-293b-4b09-bd32-7d32b52f6e2f 2023-10-05T11:27:38.369 INFO:teuthology.orchestra.run.smithi012.stdout:last_changed 2023-10-05T11:27:38.366888+0000 2023-10-05T11:27:38.370 INFO:teuthology.orchestra.run.smithi012.stdout:created 2023-10-05T11:27:38.366888+0000 2023-10-05T11:27:38.370 INFO:teuthology.orchestra.run.smithi012.stdout:min_mon_release 16 (pacific) 2023-10-05T11:27:38.370 INFO:teuthology.orchestra.run.smithi012.stdout:election_strategy: 1 2023-10-05T11:27:38.370 INFO:teuthology.orchestra.run.smithi012.stdout:0: [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon.a 2023-10-05T11:27:38.370 INFO:teuthology.orchestra.run.smithi012.stdout:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2023-10-05T11:27:38.370 INFO:teuthology.orchestra.run.smithi012.stdout:2: [v2:172.21.15.12:3301/0,v1:172.21.15.12:6790/0] mon.c 2023-10-05T11:27:38.370 INFO:teuthology.orchestra.run.smithi012.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-10-05T11:27:38.371 DEBUG:teuthology.orchestra.run.smithi012:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-10-05T11:27:38.386 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 7e015f46-293b-4b09-bd32-7d32b52f6e2f... 2023-10-05T11:27:38.387 DEBUG:teuthology.orchestra.run.smithi012:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-05T11:27:38.429 DEBUG:teuthology.orchestra.run.smithi170:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-05T11:27:38.482 INFO:teuthology.orchestra.run.smithi170.stdout:[global] 2023-10-05T11:27:38.483 INFO:teuthology.orchestra.run.smithi170.stdout: chdir = "" 2023-10-05T11:27:38.483 INFO:teuthology.orchestra.run.smithi170.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-05T11:27:38.483 INFO:teuthology.orchestra.run.smithi170.stdout: auth supported = cephx 2023-10-05T11:27:38.483 INFO:teuthology.orchestra.run.smithi170.stdout: 2023-10-05T11:27:38.483 INFO:teuthology.orchestra.run.smithi170.stdout: filestore xattr use omap = true 2023-10-05T11:27:38.483 INFO:teuthology.orchestra.run.smithi170.stdout: 2023-10-05T11:27:38.483 INFO:teuthology.orchestra.run.smithi170.stdout: mon clock drift allowed = 1.000 2023-10-05T11:27:38.483 INFO:teuthology.orchestra.run.smithi170.stdout: 2023-10-05T11:27:38.483 INFO:teuthology.orchestra.run.smithi170.stdout: osd crush chooseleaf type = 0 2023-10-05T11:27:38.484 INFO:teuthology.orchestra.run.smithi170.stdout: auth debug = true 2023-10-05T11:27:38.484 INFO:teuthology.orchestra.run.smithi170.stdout: 2023-10-05T11:27:38.484 INFO:teuthology.orchestra.run.smithi170.stdout: ms die on old message = true 2023-10-05T11:27:38.484 INFO:teuthology.orchestra.run.smithi170.stdout: ms die on bug = true 2023-10-05T11:27:38.484 INFO:teuthology.orchestra.run.smithi170.stdout: 2023-10-05T11:27:38.484 INFO:teuthology.orchestra.run.smithi170.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-05T11:27:38.484 INFO:teuthology.orchestra.run.smithi170.stdout: mon pg warn max object skew = 0 2023-10-05T11:27:38.484 INFO:teuthology.orchestra.run.smithi170.stdout: 2023-10-05T11:27:38.484 INFO:teuthology.orchestra.run.smithi170.stdout: # disable pg_autoscaler by default for new pools 2023-10-05T11:27:38.484 INFO:teuthology.orchestra.run.smithi170.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-05T11:27:38.484 INFO:teuthology.orchestra.run.smithi170.stdout: 2023-10-05T11:27:38.485 INFO:teuthology.orchestra.run.smithi170.stdout: osd pool default size = 2 2023-10-05T11:27:38.485 INFO:teuthology.orchestra.run.smithi170.stdout: 2023-10-05T11:27:38.485 INFO:teuthology.orchestra.run.smithi170.stdout: mon osd allow primary affinity = true 2023-10-05T11:27:38.485 INFO:teuthology.orchestra.run.smithi170.stdout: mon osd allow pg remap = true 2023-10-05T11:27:38.485 INFO:teuthology.orchestra.run.smithi170.stdout: mon warn on legacy crush tunables = false 2023-10-05T11:27:38.485 INFO:teuthology.orchestra.run.smithi170.stdout: mon warn on crush straw calc version zero = false 2023-10-05T11:27:38.485 INFO:teuthology.orchestra.run.smithi170.stdout: mon warn on no sortbitwise = false 2023-10-05T11:27:38.485 INFO:teuthology.orchestra.run.smithi170.stdout: mon warn on osd down out interval zero = false 2023-10-05T11:27:38.485 INFO:teuthology.orchestra.run.smithi170.stdout: mon warn on too few osds = false 2023-10-05T11:27:38.485 INFO:teuthology.orchestra.run.smithi170.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-05T11:27:38.485 INFO:teuthology.orchestra.run.smithi170.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-05T11:27:38.485 INFO:teuthology.orchestra.run.smithi170.stdout: mon_allow_pool_size_one = true 2023-10-05T11:27:38.486 INFO:teuthology.orchestra.run.smithi170.stdout: 2023-10-05T11:27:38.486 INFO:teuthology.orchestra.run.smithi170.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-05T11:27:38.486 INFO:teuthology.orchestra.run.smithi170.stdout: 2023-10-05T11:27:38.486 INFO:teuthology.orchestra.run.smithi170.stdout: osd default data pool replay window = 5 2023-10-05T11:27:38.486 INFO:teuthology.orchestra.run.smithi170.stdout: 2023-10-05T11:27:38.486 INFO:teuthology.orchestra.run.smithi170.stdout: mon allow pool delete = true 2023-10-05T11:27:38.486 INFO:teuthology.orchestra.run.smithi170.stdout: 2023-10-05T11:27:38.486 INFO:teuthology.orchestra.run.smithi170.stdout: mon cluster log file level = debug 2023-10-05T11:27:38.486 INFO:teuthology.orchestra.run.smithi170.stdout: debug asserts on shutdown = true 2023-10-05T11:27:38.486 INFO:teuthology.orchestra.run.smithi170.stdout: mon health detail to clog = false 2023-10-05T11:27:38.487 INFO:teuthology.orchestra.run.smithi170.stdout: mon host = "172.21.15.12,[v2:172.21.15.12:3301,v1:172.21.15.12:6790],172.21.15.170" 2023-10-05T11:27:38.487 INFO:teuthology.orchestra.run.smithi170.stdout: mon client directed command retry = 5 2023-10-05T11:27:38.487 INFO:teuthology.orchestra.run.smithi170.stdout: ms inject socket failures = 5000 2023-10-05T11:27:38.487 INFO:teuthology.orchestra.run.smithi170.stdout: osd heartbeat grace = 40 2023-10-05T11:27:38.487 INFO:teuthology.orchestra.run.smithi170.stdout: osd_max_pg_log_entries = 10 2023-10-05T11:27:38.487 INFO:teuthology.orchestra.run.smithi170.stdout: osd_min_pg_log_entries = 10 2023-10-05T11:27:38.487 INFO:teuthology.orchestra.run.smithi170.stdout: fsid = 7e015f46-293b-4b09-bd32-7d32b52f6e2f 2023-10-05T11:27:38.487 INFO:teuthology.orchestra.run.smithi170.stdout: 2023-10-05T11:27:38.487 INFO:teuthology.orchestra.run.smithi170.stdout:[osd] 2023-10-05T11:27:38.488 INFO:teuthology.orchestra.run.smithi170.stdout: osd journal size = 100 2023-10-05T11:27:38.488 INFO:teuthology.orchestra.run.smithi170.stdout: 2023-10-05T11:27:38.488 INFO:teuthology.orchestra.run.smithi170.stdout: osd scrub load threshold = 5.0 2023-10-05T11:27:38.488 INFO:teuthology.orchestra.run.smithi170.stdout: osd scrub max interval = 600 2023-10-05T11:27:38.488 INFO:teuthology.orchestra.run.smithi170.stdout: osd mclock profile = high_recovery_ops 2023-10-05T11:27:38.488 INFO:teuthology.orchestra.run.smithi170.stdout: 2023-10-05T11:27:38.488 INFO:teuthology.orchestra.run.smithi170.stdout: osd recover clone overlap = true 2023-10-05T11:27:38.488 INFO:teuthology.orchestra.run.smithi170.stdout: osd recovery max chunk = 1048576 2023-10-05T11:27:38.488 INFO:teuthology.orchestra.run.smithi170.stdout: 2023-10-05T11:27:38.488 INFO:teuthology.orchestra.run.smithi170.stdout: osd debug shutdown = true 2023-10-05T11:27:38.489 INFO:teuthology.orchestra.run.smithi170.stdout: osd debug op order = true 2023-10-05T11:27:38.489 INFO:teuthology.orchestra.run.smithi170.stdout: osd debug verify stray on activate = true 2023-10-05T11:27:38.489 INFO:teuthology.orchestra.run.smithi170.stdout: 2023-10-05T11:27:38.489 INFO:teuthology.orchestra.run.smithi170.stdout: osd open classes on start = true 2023-10-05T11:27:38.489 INFO:teuthology.orchestra.run.smithi170.stdout: osd debug pg log writeout = true 2023-10-05T11:27:38.489 INFO:teuthology.orchestra.run.smithi170.stdout: 2023-10-05T11:27:38.489 INFO:teuthology.orchestra.run.smithi170.stdout: osd deep scrub update digest min age = 30 2023-10-05T11:27:38.489 INFO:teuthology.orchestra.run.smithi170.stdout: 2023-10-05T11:27:38.489 INFO:teuthology.orchestra.run.smithi170.stdout: osd map max advance = 10 2023-10-05T11:27:38.489 INFO:teuthology.orchestra.run.smithi170.stdout: 2023-10-05T11:27:38.489 INFO:teuthology.orchestra.run.smithi170.stdout: journal zero on create = true 2023-10-05T11:27:38.490 INFO:teuthology.orchestra.run.smithi170.stdout: 2023-10-05T11:27:38.490 INFO:teuthology.orchestra.run.smithi170.stdout: filestore ondisk finisher threads = 3 2023-10-05T11:27:38.490 INFO:teuthology.orchestra.run.smithi170.stdout: filestore apply finisher threads = 3 2023-10-05T11:27:38.490 INFO:teuthology.orchestra.run.smithi170.stdout: 2023-10-05T11:27:38.490 INFO:teuthology.orchestra.run.smithi170.stdout: bdev debug aio = true 2023-10-05T11:27:38.490 INFO:teuthology.orchestra.run.smithi170.stdout: osd debug misdirected ops = true 2023-10-05T11:27:38.490 INFO:teuthology.orchestra.run.smithi170.stdout: bdev async discard = True 2023-10-05T11:27:38.490 INFO:teuthology.orchestra.run.smithi170.stdout: bdev enable discard = True 2023-10-05T11:27:38.490 INFO:teuthology.orchestra.run.smithi170.stdout: bluestore allocator = bitmap 2023-10-05T11:27:38.490 INFO:teuthology.orchestra.run.smithi170.stdout: bluestore block size = 96636764160 2023-10-05T11:27:38.491 INFO:teuthology.orchestra.run.smithi170.stdout: bluestore fsck on mount = True 2023-10-05T11:27:38.491 INFO:teuthology.orchestra.run.smithi170.stdout: debug bluefs = 1/20 2023-10-05T11:27:38.491 INFO:teuthology.orchestra.run.smithi170.stdout: debug bluestore = 1/20 2023-10-05T11:27:38.491 INFO:teuthology.orchestra.run.smithi170.stdout: debug ms = 1 2023-10-05T11:27:38.491 INFO:teuthology.orchestra.run.smithi170.stdout: debug osd = 20 2023-10-05T11:27:38.491 INFO:teuthology.orchestra.run.smithi170.stdout: debug rocksdb = 4/10 2023-10-05T11:27:38.491 INFO:teuthology.orchestra.run.smithi170.stdout: mon osd backfillfull_ratio = 0.85 2023-10-05T11:27:38.491 INFO:teuthology.orchestra.run.smithi170.stdout: mon osd full ratio = 0.9 2023-10-05T11:27:38.491 INFO:teuthology.orchestra.run.smithi170.stdout: mon osd nearfull ratio = 0.8 2023-10-05T11:27:38.491 INFO:teuthology.orchestra.run.smithi170.stdout: osd failsafe full ratio = 0.95 2023-10-05T11:27:38.492 INFO:teuthology.orchestra.run.smithi170.stdout: osd fast shutdown = False 2023-10-05T11:27:38.492 INFO:teuthology.orchestra.run.smithi170.stdout: osd objectstore = bluestore 2023-10-05T11:27:38.492 INFO:teuthology.orchestra.run.smithi170.stdout: osd shutdown pgref assert = True 2023-10-05T11:27:38.492 INFO:teuthology.orchestra.run.smithi170.stdout: 2023-10-05T11:27:38.492 INFO:teuthology.orchestra.run.smithi170.stdout:[mgr] 2023-10-05T11:27:38.492 INFO:teuthology.orchestra.run.smithi170.stdout: debug ms = 1 2023-10-05T11:27:38.492 INFO:teuthology.orchestra.run.smithi170.stdout: debug mgr = 20 2023-10-05T11:27:38.492 INFO:teuthology.orchestra.run.smithi170.stdout: debug mon = 20 2023-10-05T11:27:38.492 INFO:teuthology.orchestra.run.smithi170.stdout: debug auth = 20 2023-10-05T11:27:38.492 INFO:teuthology.orchestra.run.smithi170.stdout: mon reweight min pgs per osd = 4 2023-10-05T11:27:38.492 INFO:teuthology.orchestra.run.smithi170.stdout: mon reweight min bytes per osd = 10 2023-10-05T11:27:38.493 INFO:teuthology.orchestra.run.smithi170.stdout: mgr/telemetry/nag = false 2023-10-05T11:27:38.493 INFO:teuthology.orchestra.run.smithi170.stdout: 2023-10-05T11:27:38.493 INFO:teuthology.orchestra.run.smithi170.stdout:[mon] 2023-10-05T11:27:38.493 INFO:teuthology.orchestra.run.smithi170.stdout: debug ms = 1 2023-10-05T11:27:38.493 INFO:teuthology.orchestra.run.smithi170.stdout: debug mon = 20 2023-10-05T11:27:38.493 INFO:teuthology.orchestra.run.smithi170.stdout: debug paxos = 20 2023-10-05T11:27:38.493 INFO:teuthology.orchestra.run.smithi170.stdout: debug auth = 20 2023-10-05T11:27:38.493 INFO:teuthology.orchestra.run.smithi170.stdout: mon data avail warn = 5 2023-10-05T11:27:38.493 INFO:teuthology.orchestra.run.smithi170.stdout: mon mgr mkfs grace = 240 2023-10-05T11:27:38.493 INFO:teuthology.orchestra.run.smithi170.stdout: mon reweight min pgs per osd = 4 2023-10-05T11:27:38.494 INFO:teuthology.orchestra.run.smithi170.stdout: mon osd reporter subtree level = osd 2023-10-05T11:27:38.494 INFO:teuthology.orchestra.run.smithi170.stdout: mon osd prime pg temp = true 2023-10-05T11:27:38.494 INFO:teuthology.orchestra.run.smithi170.stdout: mon reweight min bytes per osd = 10 2023-10-05T11:27:38.494 INFO:teuthology.orchestra.run.smithi170.stdout: 2023-10-05T11:27:38.494 INFO:teuthology.orchestra.run.smithi170.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-05T11:27:38.494 INFO:teuthology.orchestra.run.smithi170.stdout: auth mon ticket ttl = 660 # 11m 2023-10-05T11:27:38.494 INFO:teuthology.orchestra.run.smithi170.stdout: auth service ticket ttl = 240 # 4m 2023-10-05T11:27:38.494 INFO:teuthology.orchestra.run.smithi170.stdout: 2023-10-05T11:27:38.494 INFO:teuthology.orchestra.run.smithi170.stdout: # don't complain about insecure global_id in the test suite 2023-10-05T11:27:38.494 INFO:teuthology.orchestra.run.smithi170.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-05T11:27:38.495 INFO:teuthology.orchestra.run.smithi170.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-05T11:27:38.495 INFO:teuthology.orchestra.run.smithi170.stdout: 2023-10-05T11:27:38.495 INFO:teuthology.orchestra.run.smithi170.stdout: # 1m isn't quite enough 2023-10-05T11:27:38.495 INFO:teuthology.orchestra.run.smithi170.stdout: mon_down_mkfs_grace = 2m 2023-10-05T11:27:38.495 INFO:teuthology.orchestra.run.smithi170.stdout: 2023-10-05T11:27:38.495 INFO:teuthology.orchestra.run.smithi170.stdout: mon_warn_on_filestore_osds = false 2023-10-05T11:27:38.495 INFO:teuthology.orchestra.run.smithi170.stdout: mon osd crush smoke test = False 2023-10-05T11:27:38.495 INFO:teuthology.orchestra.run.smithi170.stdout: 2023-10-05T11:27:38.495 INFO:teuthology.orchestra.run.smithi170.stdout:[client] 2023-10-05T11:27:38.495 INFO:teuthology.orchestra.run.smithi170.stdout: rgw cache enabled = true 2023-10-05T11:27:38.495 INFO:teuthology.orchestra.run.smithi170.stdout: rgw enable ops log = True 2023-10-05T11:27:38.497 INFO:teuthology.orchestra.run.smithi170.stdout: rgw enable usage log = true 2023-10-05T11:27:38.497 INFO:teuthology.orchestra.run.smithi170.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-05T11:27:38.497 INFO:teuthology.orchestra.run.smithi170.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-05T11:27:38.497 INFO:teuthology.orchestra.run.smithi170.stdout: debug rgw = 20 2023-10-05T11:27:38.497 INFO:teuthology.orchestra.run.smithi170.stdout: debug rgw_datacache = 30 2023-10-05T11:27:38.497 INFO:teuthology.orchestra.run.smithi170.stdout: rgw crypt require ssl = False 2023-10-05T11:27:38.497 INFO:teuthology.orchestra.run.smithi170.stdout: rgw crypt s3 kms backend = testing 2023-10-05T11:27:38.498 INFO:teuthology.orchestra.run.smithi170.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2023-10-05T11:27:38.498 INFO:teuthology.orchestra.run.smithi170.stdout: rgw d3n l1 datacache persistent path = /tmp/rgw_datacache/ 2023-10-05T11:27:38.498 INFO:teuthology.orchestra.run.smithi170.stdout: rgw d3n l1 datacache size = 10737418240 2023-10-05T11:27:38.498 INFO:teuthology.orchestra.run.smithi170.stdout: rgw d3n l1 local datacache enabled = True 2023-10-05T11:27:38.498 INFO:teuthology.orchestra.run.smithi170.stdout: rgw filter = d3n 2023-10-05T11:27:38.498 INFO:teuthology.orchestra.run.smithi170.stdout: rgw torrent flag = True 2023-10-05T11:27:38.498 INFO:teuthology.orchestra.run.smithi170.stdout: setgroup = ceph 2023-10-05T11:27:38.498 INFO:teuthology.orchestra.run.smithi170.stdout: setuser = ceph 2023-10-05T11:27:38.498 INFO:teuthology.orchestra.run.smithi170.stdout:[mon.a] 2023-10-05T11:27:38.498 INFO:teuthology.orchestra.run.smithi170.stdout:[mon.c] 2023-10-05T11:27:38.498 INFO:teuthology.orchestra.run.smithi170.stdout:[mon.b] 2023-10-05T11:27:38.499 INFO:teuthology.orchestra.run.smithi012.stdout:[global] 2023-10-05T11:27:38.499 INFO:teuthology.orchestra.run.smithi012.stdout: chdir = "" 2023-10-05T11:27:38.499 INFO:teuthology.orchestra.run.smithi012.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-05T11:27:38.499 INFO:teuthology.orchestra.run.smithi012.stdout: auth supported = cephx 2023-10-05T11:27:38.499 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:27:38.500 INFO:teuthology.orchestra.run.smithi012.stdout: filestore xattr use omap = true 2023-10-05T11:27:38.500 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:27:38.500 INFO:teuthology.orchestra.run.smithi012.stdout: mon clock drift allowed = 1.000 2023-10-05T11:27:38.500 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:27:38.500 INFO:teuthology.orchestra.run.smithi012.stdout: osd crush chooseleaf type = 0 2023-10-05T11:27:38.500 INFO:teuthology.orchestra.run.smithi012.stdout: auth debug = true 2023-10-05T11:27:38.500 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:27:38.500 INFO:teuthology.orchestra.run.smithi012.stdout: ms die on old message = true 2023-10-05T11:27:38.500 INFO:teuthology.orchestra.run.smithi012.stdout: ms die on bug = true 2023-10-05T11:27:38.500 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:27:38.500 INFO:teuthology.orchestra.run.smithi012.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-05T11:27:38.500 INFO:teuthology.orchestra.run.smithi012.stdout: mon pg warn max object skew = 0 2023-10-05T11:27:38.501 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:27:38.501 INFO:teuthology.orchestra.run.smithi012.stdout: # disable pg_autoscaler by default for new pools 2023-10-05T11:27:38.501 INFO:teuthology.orchestra.run.smithi012.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-05T11:27:38.501 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:27:38.501 INFO:teuthology.orchestra.run.smithi012.stdout: osd pool default size = 2 2023-10-05T11:27:38.501 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:27:38.501 INFO:teuthology.orchestra.run.smithi012.stdout: mon osd allow primary affinity = true 2023-10-05T11:27:38.501 INFO:teuthology.orchestra.run.smithi012.stdout: mon osd allow pg remap = true 2023-10-05T11:27:38.501 INFO:teuthology.orchestra.run.smithi012.stdout: mon warn on legacy crush tunables = false 2023-10-05T11:27:38.501 INFO:teuthology.orchestra.run.smithi012.stdout: mon warn on crush straw calc version zero = false 2023-10-05T11:27:38.501 INFO:teuthology.orchestra.run.smithi012.stdout: mon warn on no sortbitwise = false 2023-10-05T11:27:38.502 INFO:teuthology.orchestra.run.smithi012.stdout: mon warn on osd down out interval zero = false 2023-10-05T11:27:38.502 INFO:teuthology.orchestra.run.smithi012.stdout: mon warn on too few osds = false 2023-10-05T11:27:38.502 INFO:teuthology.orchestra.run.smithi012.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-05T11:27:38.502 INFO:teuthology.orchestra.run.smithi012.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-05T11:27:38.502 INFO:teuthology.orchestra.run.smithi012.stdout: mon_allow_pool_size_one = true 2023-10-05T11:27:38.502 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:27:38.502 INFO:teuthology.orchestra.run.smithi012.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-05T11:27:38.502 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:27:38.502 INFO:teuthology.orchestra.run.smithi012.stdout: osd default data pool replay window = 5 2023-10-05T11:27:38.502 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:27:38.502 INFO:teuthology.orchestra.run.smithi012.stdout: mon allow pool delete = true 2023-10-05T11:27:38.502 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:27:38.503 INFO:teuthology.orchestra.run.smithi012.stdout: mon cluster log file level = debug 2023-10-05T11:27:38.503 INFO:teuthology.orchestra.run.smithi012.stdout: debug asserts on shutdown = true 2023-10-05T11:27:38.503 INFO:teuthology.orchestra.run.smithi012.stdout: mon health detail to clog = false 2023-10-05T11:27:38.503 INFO:teuthology.orchestra.run.smithi012.stdout: mon host = "172.21.15.12,[v2:172.21.15.12:3301,v1:172.21.15.12:6790],172.21.15.170" 2023-10-05T11:27:38.503 INFO:teuthology.orchestra.run.smithi012.stdout: mon client directed command retry = 5 2023-10-05T11:27:38.503 INFO:teuthology.orchestra.run.smithi012.stdout: ms inject socket failures = 5000 2023-10-05T11:27:38.503 INFO:teuthology.orchestra.run.smithi012.stdout: osd heartbeat grace = 40 2023-10-05T11:27:38.503 INFO:teuthology.orchestra.run.smithi012.stdout: osd_max_pg_log_entries = 10 2023-10-05T11:27:38.503 INFO:teuthology.orchestra.run.smithi012.stdout: osd_min_pg_log_entries = 10 2023-10-05T11:27:38.503 INFO:teuthology.orchestra.run.smithi012.stdout: fsid = 7e015f46-293b-4b09-bd32-7d32b52f6e2f 2023-10-05T11:27:38.503 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:27:38.504 INFO:teuthology.orchestra.run.smithi012.stdout:[osd] 2023-10-05T11:27:38.504 INFO:teuthology.orchestra.run.smithi012.stdout: osd journal size = 100 2023-10-05T11:27:38.504 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:27:38.504 INFO:teuthology.orchestra.run.smithi012.stdout: osd scrub load threshold = 5.0 2023-10-05T11:27:38.504 INFO:teuthology.orchestra.run.smithi012.stdout: osd scrub max interval = 600 2023-10-05T11:27:38.504 INFO:teuthology.orchestra.run.smithi012.stdout: osd mclock profile = high_recovery_ops 2023-10-05T11:27:38.504 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:27:38.504 INFO:teuthology.orchestra.run.smithi012.stdout: osd recover clone overlap = true 2023-10-05T11:27:38.504 INFO:teuthology.orchestra.run.smithi012.stdout: osd recovery max chunk = 1048576 2023-10-05T11:27:38.504 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:27:38.504 INFO:teuthology.orchestra.run.smithi012.stdout: osd debug shutdown = true 2023-10-05T11:27:38.504 INFO:teuthology.orchestra.run.smithi012.stdout: osd debug op order = true 2023-10-05T11:27:38.504 INFO:teuthology.orchestra.run.smithi012.stdout: osd debug verify stray on activate = true 2023-10-05T11:27:38.505 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:27:38.505 INFO:teuthology.orchestra.run.smithi012.stdout: osd open classes on start = true 2023-10-05T11:27:38.505 INFO:teuthology.orchestra.run.smithi012.stdout: osd debug pg log writeout = true 2023-10-05T11:27:38.505 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:27:38.505 INFO:teuthology.orchestra.run.smithi012.stdout: osd deep scrub update digest min age = 30 2023-10-05T11:27:38.505 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:27:38.505 INFO:teuthology.orchestra.run.smithi012.stdout: osd map max advance = 10 2023-10-05T11:27:38.505 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:27:38.505 INFO:teuthology.orchestra.run.smithi012.stdout: journal zero on create = true 2023-10-05T11:27:38.505 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:27:38.505 INFO:teuthology.orchestra.run.smithi012.stdout: filestore ondisk finisher threads = 3 2023-10-05T11:27:38.506 INFO:teuthology.orchestra.run.smithi012.stdout: filestore apply finisher threads = 3 2023-10-05T11:27:38.506 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:27:38.506 INFO:teuthology.orchestra.run.smithi012.stdout: bdev debug aio = true 2023-10-05T11:27:38.506 INFO:teuthology.orchestra.run.smithi012.stdout: osd debug misdirected ops = true 2023-10-05T11:27:38.506 INFO:teuthology.orchestra.run.smithi012.stdout: bdev async discard = True 2023-10-05T11:27:38.506 INFO:teuthology.orchestra.run.smithi012.stdout: bdev enable discard = True 2023-10-05T11:27:38.506 INFO:teuthology.orchestra.run.smithi012.stdout: bluestore allocator = bitmap 2023-10-05T11:27:38.506 INFO:teuthology.orchestra.run.smithi012.stdout: bluestore block size = 96636764160 2023-10-05T11:27:38.506 INFO:teuthology.orchestra.run.smithi012.stdout: bluestore fsck on mount = True 2023-10-05T11:27:38.506 INFO:teuthology.orchestra.run.smithi012.stdout: debug bluefs = 1/20 2023-10-05T11:27:38.506 INFO:teuthology.orchestra.run.smithi012.stdout: debug bluestore = 1/20 2023-10-05T11:27:38.506 INFO:teuthology.orchestra.run.smithi012.stdout: debug ms = 1 2023-10-05T11:27:38.507 INFO:teuthology.orchestra.run.smithi012.stdout: debug osd = 20 2023-10-05T11:27:38.507 INFO:teuthology.orchestra.run.smithi012.stdout: debug rocksdb = 4/10 2023-10-05T11:27:38.507 INFO:teuthology.orchestra.run.smithi012.stdout: mon osd backfillfull_ratio = 0.85 2023-10-05T11:27:38.507 INFO:teuthology.orchestra.run.smithi012.stdout: mon osd full ratio = 0.9 2023-10-05T11:27:38.507 INFO:teuthology.orchestra.run.smithi012.stdout: mon osd nearfull ratio = 0.8 2023-10-05T11:27:38.507 INFO:teuthology.orchestra.run.smithi012.stdout: osd failsafe full ratio = 0.95 2023-10-05T11:27:38.507 INFO:teuthology.orchestra.run.smithi012.stdout: osd fast shutdown = False 2023-10-05T11:27:38.507 INFO:teuthology.orchestra.run.smithi012.stdout: osd objectstore = bluestore 2023-10-05T11:27:38.507 INFO:teuthology.orchestra.run.smithi012.stdout: osd shutdown pgref assert = True 2023-10-05T11:27:38.507 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:27:38.507 INFO:teuthology.orchestra.run.smithi012.stdout:[mgr] 2023-10-05T11:27:38.507 INFO:teuthology.orchestra.run.smithi012.stdout: debug ms = 1 2023-10-05T11:27:38.507 INFO:teuthology.orchestra.run.smithi012.stdout: debug mgr = 20 2023-10-05T11:27:38.508 INFO:teuthology.orchestra.run.smithi012.stdout: debug mon = 20 2023-10-05T11:27:38.508 INFO:teuthology.orchestra.run.smithi012.stdout: debug auth = 20 2023-10-05T11:27:38.508 INFO:teuthology.orchestra.run.smithi012.stdout: mon reweight min pgs per osd = 4 2023-10-05T11:27:38.508 INFO:teuthology.orchestra.run.smithi012.stdout: mon reweight min bytes per osd = 10 2023-10-05T11:27:38.508 INFO:teuthology.orchestra.run.smithi012.stdout: mgr/telemetry/nag = false 2023-10-05T11:27:38.508 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:27:38.508 INFO:teuthology.orchestra.run.smithi012.stdout:[mon] 2023-10-05T11:27:38.508 INFO:teuthology.orchestra.run.smithi012.stdout: debug ms = 1 2023-10-05T11:27:38.508 INFO:teuthology.orchestra.run.smithi012.stdout: debug mon = 20 2023-10-05T11:27:38.508 INFO:teuthology.orchestra.run.smithi012.stdout: debug paxos = 20 2023-10-05T11:27:38.508 INFO:teuthology.orchestra.run.smithi012.stdout: debug auth = 20 2023-10-05T11:27:38.508 INFO:teuthology.orchestra.run.smithi012.stdout: mon data avail warn = 5 2023-10-05T11:27:38.509 INFO:teuthology.orchestra.run.smithi012.stdout: mon mgr mkfs grace = 240 2023-10-05T11:27:38.509 INFO:teuthology.orchestra.run.smithi012.stdout: mon reweight min pgs per osd = 4 2023-10-05T11:27:38.509 INFO:teuthology.orchestra.run.smithi012.stdout: mon osd reporter subtree level = osd 2023-10-05T11:27:38.509 INFO:teuthology.orchestra.run.smithi012.stdout: mon osd prime pg temp = true 2023-10-05T11:27:38.509 INFO:teuthology.orchestra.run.smithi012.stdout: mon reweight min bytes per osd = 10 2023-10-05T11:27:38.509 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:27:38.509 INFO:teuthology.orchestra.run.smithi012.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-05T11:27:38.509 INFO:teuthology.orchestra.run.smithi012.stdout: auth mon ticket ttl = 660 # 11m 2023-10-05T11:27:38.509 INFO:teuthology.orchestra.run.smithi012.stdout: auth service ticket ttl = 240 # 4m 2023-10-05T11:27:38.509 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:27:38.509 INFO:teuthology.orchestra.run.smithi012.stdout: # don't complain about insecure global_id in the test suite 2023-10-05T11:27:38.509 INFO:teuthology.orchestra.run.smithi012.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-05T11:27:38.509 INFO:teuthology.orchestra.run.smithi012.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-05T11:27:38.510 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:27:38.510 INFO:teuthology.orchestra.run.smithi012.stdout: # 1m isn't quite enough 2023-10-05T11:27:38.510 INFO:teuthology.orchestra.run.smithi012.stdout: mon_down_mkfs_grace = 2m 2023-10-05T11:27:38.510 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:27:38.510 INFO:teuthology.orchestra.run.smithi012.stdout: mon_warn_on_filestore_osds = false 2023-10-05T11:27:38.510 INFO:teuthology.orchestra.run.smithi012.stdout: mon osd crush smoke test = False 2023-10-05T11:27:38.510 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:27:38.510 INFO:teuthology.orchestra.run.smithi012.stdout:[client] 2023-10-05T11:27:38.510 INFO:teuthology.orchestra.run.smithi012.stdout: rgw cache enabled = true 2023-10-05T11:27:38.510 INFO:teuthology.orchestra.run.smithi012.stdout: rgw enable ops log = True 2023-10-05T11:27:38.510 INFO:teuthology.orchestra.run.smithi012.stdout: rgw enable usage log = true 2023-10-05T11:27:38.510 INFO:teuthology.orchestra.run.smithi012.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-05T11:27:38.511 INFO:teuthology.orchestra.run.smithi012.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-05T11:27:38.511 INFO:teuthology.orchestra.run.smithi012.stdout: debug rgw = 20 2023-10-05T11:27:38.511 INFO:teuthology.orchestra.run.smithi012.stdout: debug rgw_datacache = 30 2023-10-05T11:27:38.511 INFO:teuthology.orchestra.run.smithi012.stdout: rgw crypt require ssl = False 2023-10-05T11:27:38.511 INFO:teuthology.orchestra.run.smithi012.stdout: rgw crypt s3 kms backend = testing 2023-10-05T11:27:38.511 INFO:teuthology.orchestra.run.smithi012.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2023-10-05T11:27:38.511 INFO:teuthology.orchestra.run.smithi012.stdout: rgw d3n l1 datacache persistent path = /tmp/rgw_datacache/ 2023-10-05T11:27:38.511 INFO:teuthology.orchestra.run.smithi012.stdout: rgw d3n l1 datacache size = 10737418240 2023-10-05T11:27:38.511 INFO:teuthology.orchestra.run.smithi012.stdout: rgw d3n l1 local datacache enabled = True 2023-10-05T11:27:38.511 INFO:teuthology.orchestra.run.smithi012.stdout: rgw filter = d3n 2023-10-05T11:27:38.511 INFO:teuthology.orchestra.run.smithi012.stdout: rgw torrent flag = True 2023-10-05T11:27:38.511 INFO:teuthology.orchestra.run.smithi012.stdout: setgroup = ceph 2023-10-05T11:27:38.512 INFO:teuthology.orchestra.run.smithi012.stdout: setuser = ceph 2023-10-05T11:27:38.512 INFO:teuthology.orchestra.run.smithi012.stdout:[mon.a] 2023-10-05T11:27:38.512 INFO:teuthology.orchestra.run.smithi012.stdout:[mon.c] 2023-10-05T11:27:38.512 INFO:teuthology.orchestra.run.smithi012.stdout:[mon.b] 2023-10-05T11:27:38.513 INFO:tasks.ceph:Creating admin key on mon.a... 2023-10-05T11:27:38.513 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-10-05T11:27:38.612 INFO:tasks.ceph:Copying monmap to all nodes... 2023-10-05T11:27:38.613 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-10-05T11:27:38.613 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-10-05T11:27:38.627 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-10-05T11:27:38.627 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-10-05T11:27:38.682 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi012.front.sepia.ceph.com 2023-10-05T11:27:38.682 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-10-05T11:27:38.682 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-05T11:27:38.683 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-05T11:27:38.769 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-10-05T11:27:38.769 DEBUG:teuthology.orchestra.run.smithi012:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-05T11:27:38.823 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi170.front.sepia.ceph.com 2023-10-05T11:27:38.824 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2023-10-05T11:27:38.824 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-05T11:27:38.824 DEBUG:teuthology.orchestra.run.smithi170:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-05T11:27:38.868 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2023-10-05T11:27:38.868 DEBUG:teuthology.orchestra.run.smithi170:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-05T11:27:38.924 INFO:tasks.ceph:Setting up mon nodes... 2023-10-05T11:27:38.924 INFO:tasks.ceph:Setting up mgr nodes... 2023-10-05T11:27:38.925 DEBUG:teuthology.orchestra.run.smithi012:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-10-05T11:27:38.986 INFO:teuthology.orchestra.run.smithi012.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-10-05T11:27:38.988 DEBUG:teuthology.orchestra.run.smithi170:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-10-05T11:27:39.057 INFO:teuthology.orchestra.run.smithi170.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-10-05T11:27:39.060 INFO:tasks.ceph:Setting up mds nodes... 2023-10-05T11:27:39.060 INFO:tasks.ceph_client:Setting up client nodes... 2023-10-05T11:27:39.060 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-10-05T11:27:39.106 INFO:teuthology.orchestra.run.smithi012.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-10-05T11:27:39.124 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-10-05T11:27:39.167 INFO:teuthology.orchestra.run.smithi170.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-10-05T11:27:39.182 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-10-05T11:27:39.183 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi012.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi170.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-10-05T11:27:39.183 DEBUG:teuthology.orchestra.run.smithi012:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-10-05T11:27:39.213 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-05T11:27:39.213 INFO:tasks.ceph:role: osd.0 2023-10-05T11:27:39.213 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi012.front.sepia.ceph.com 2023-10-05T11:27:39.213 DEBUG:teuthology.orchestra.run.smithi012:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-05T11:27:39.290 INFO:teuthology.orchestra.run.smithi012.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-05T11:27:39.290 INFO:teuthology.orchestra.run.smithi012.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-05T11:27:39.290 INFO:teuthology.orchestra.run.smithi012.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-05T11:27:39.291 INFO:teuthology.orchestra.run.smithi012.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-10-05T11:27:39.291 INFO:teuthology.orchestra.run.smithi012.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-05T11:27:39.291 INFO:teuthology.orchestra.run.smithi012.stdout: = sunit=0 swidth=0 blks 2023-10-05T11:27:39.291 INFO:teuthology.orchestra.run.smithi012.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-05T11:27:39.291 INFO:teuthology.orchestra.run.smithi012.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-10-05T11:27:39.291 INFO:teuthology.orchestra.run.smithi012.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-05T11:27:39.291 INFO:teuthology.orchestra.run.smithi012.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-05T11:27:39.749 INFO:teuthology.orchestra.run.smithi012.stdout:Discarding blocks...Done. 2023-10-05T11:27:39.751 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi012.front.sepia.ceph.com -o noatime 2023-10-05T11:27:39.751 DEBUG:teuthology.orchestra.run.smithi012:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-10-05T11:27:39.892 DEBUG:teuthology.orchestra.run.smithi012:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-10-05T11:27:39.929 DEBUG:teuthology.orchestra.run.smithi012:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-10-05T11:27:40.000 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-05T11:27:40.001 INFO:tasks.ceph:role: osd.1 2023-10-05T11:27:40.001 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi012.front.sepia.ceph.com 2023-10-05T11:27:40.001 DEBUG:teuthology.orchestra.run.smithi012:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-05T11:27:40.079 INFO:teuthology.orchestra.run.smithi012.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-05T11:27:40.079 INFO:teuthology.orchestra.run.smithi012.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-05T11:27:40.079 INFO:teuthology.orchestra.run.smithi012.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-05T11:27:40.079 INFO:teuthology.orchestra.run.smithi012.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-10-05T11:27:40.079 INFO:teuthology.orchestra.run.smithi012.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-05T11:27:40.079 INFO:teuthology.orchestra.run.smithi012.stdout: = sunit=0 swidth=0 blks 2023-10-05T11:27:40.079 INFO:teuthology.orchestra.run.smithi012.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-05T11:27:40.079 INFO:teuthology.orchestra.run.smithi012.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-10-05T11:27:40.079 INFO:teuthology.orchestra.run.smithi012.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-05T11:27:40.080 INFO:teuthology.orchestra.run.smithi012.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-05T11:27:40.550 INFO:teuthology.orchestra.run.smithi012.stdout:Discarding blocks...Done. 2023-10-05T11:27:40.552 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi012.front.sepia.ceph.com -o noatime 2023-10-05T11:27:40.552 DEBUG:teuthology.orchestra.run.smithi012:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-10-05T11:27:40.645 DEBUG:teuthology.orchestra.run.smithi012:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-10-05T11:27:40.684 DEBUG:teuthology.orchestra.run.smithi012:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-10-05T11:27:40.757 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-05T11:27:40.757 INFO:tasks.ceph:role: osd.2 2023-10-05T11:27:40.757 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi012.front.sepia.ceph.com 2023-10-05T11:27:40.757 DEBUG:teuthology.orchestra.run.smithi012:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-10-05T11:27:40.836 INFO:teuthology.orchestra.run.smithi012.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-10-05T11:27:40.837 INFO:teuthology.orchestra.run.smithi012.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-05T11:27:40.837 INFO:teuthology.orchestra.run.smithi012.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-05T11:27:40.837 INFO:teuthology.orchestra.run.smithi012.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-10-05T11:27:40.837 INFO:teuthology.orchestra.run.smithi012.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-05T11:27:40.837 INFO:teuthology.orchestra.run.smithi012.stdout: = sunit=0 swidth=0 blks 2023-10-05T11:27:40.837 INFO:teuthology.orchestra.run.smithi012.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-05T11:27:40.837 INFO:teuthology.orchestra.run.smithi012.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-10-05T11:27:40.837 INFO:teuthology.orchestra.run.smithi012.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-05T11:27:40.837 INFO:teuthology.orchestra.run.smithi012.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-05T11:27:41.355 INFO:teuthology.orchestra.run.smithi012.stdout:Discarding blocks...Done. 2023-10-05T11:27:41.357 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi012.front.sepia.ceph.com -o noatime 2023-10-05T11:27:41.358 DEBUG:teuthology.orchestra.run.smithi012:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-10-05T11:27:41.480 DEBUG:teuthology.orchestra.run.smithi012:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-10-05T11:27:41.521 DEBUG:teuthology.orchestra.run.smithi012:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-10-05T11:27:41.594 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-05T11:27:41.594 INFO:tasks.ceph:role: osd.3 2023-10-05T11:27:41.595 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi012.front.sepia.ceph.com 2023-10-05T11:27:41.595 DEBUG:teuthology.orchestra.run.smithi012:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-10-05T11:27:41.674 INFO:teuthology.orchestra.run.smithi012.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-10-05T11:27:41.675 INFO:teuthology.orchestra.run.smithi012.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-05T11:27:41.675 INFO:teuthology.orchestra.run.smithi012.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-05T11:27:41.675 INFO:teuthology.orchestra.run.smithi012.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-10-05T11:27:41.675 INFO:teuthology.orchestra.run.smithi012.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-05T11:27:41.675 INFO:teuthology.orchestra.run.smithi012.stdout: = sunit=0 swidth=0 blks 2023-10-05T11:27:41.675 INFO:teuthology.orchestra.run.smithi012.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-05T11:27:41.675 INFO:teuthology.orchestra.run.smithi012.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-10-05T11:27:41.675 INFO:teuthology.orchestra.run.smithi012.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-05T11:27:41.675 INFO:teuthology.orchestra.run.smithi012.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-05T11:27:42.158 INFO:teuthology.orchestra.run.smithi012.stdout:Discarding blocks...Done. 2023-10-05T11:27:42.160 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi012.front.sepia.ceph.com -o noatime 2023-10-05T11:27:42.161 DEBUG:teuthology.orchestra.run.smithi012:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-10-05T11:27:42.279 DEBUG:teuthology.orchestra.run.smithi012:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-10-05T11:27:42.324 DEBUG:teuthology.orchestra.run.smithi012:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-05T11:27:42.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:27:42.424+0000 7f97f4374500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-10-05T11:27:42.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:27:42.425+0000 7f97f4374500 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-10-05T11:27:42.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:27:42.425+0000 7f97f4374500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-05T11:27:42.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:27:42.425+0000 7f97f4374500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-05T11:27:42.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:27:42.425+0000 7f97f4374500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-05T11:27:42.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:27:42.425+0000 7f97f4374500 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-10-05T11:27:45.288 DEBUG:teuthology.orchestra.run.smithi012:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-10-05T11:27:45.323 DEBUG:teuthology.orchestra.run.smithi012:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-05T11:27:45.420 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:27:45.416+0000 7f2592615500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-10-05T11:27:45.420 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:27:45.416+0000 7f2592615500 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-10-05T11:27:45.420 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:27:45.416+0000 7f2592615500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-05T11:27:45.420 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:27:45.416+0000 7f2592615500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-05T11:27:45.421 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:27:45.416+0000 7f2592615500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-05T11:27:45.421 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:27:45.416+0000 7f2592615500 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-10-05T11:27:48.271 DEBUG:teuthology.orchestra.run.smithi012:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-10-05T11:27:48.306 DEBUG:teuthology.orchestra.run.smithi012:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-05T11:27:48.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:27:48.397+0000 7fc989dfe500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-10-05T11:27:48.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:27:48.397+0000 7fc989dfe500 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-10-05T11:27:48.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:27:48.397+0000 7fc989dfe500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-05T11:27:48.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:27:48.398+0000 7fc989dfe500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-05T11:27:48.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:27:48.398+0000 7fc989dfe500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-05T11:27:48.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:27:48.398+0000 7fc989dfe500 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-10-05T11:27:51.264 DEBUG:teuthology.orchestra.run.smithi012:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-10-05T11:27:51.299 DEBUG:teuthology.orchestra.run.smithi012:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-05T11:27:51.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:27:51.393+0000 7f249540e500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-10-05T11:27:51.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:27:51.393+0000 7f249540e500 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-10-05T11:27:51.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:27:51.393+0000 7f249540e500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-05T11:27:51.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:27:51.393+0000 7f249540e500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-05T11:27:51.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:27:51.393+0000 7f249540e500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-05T11:27:51.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:27:51.394+0000 7f249540e500 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-10-05T11:27:54.249 DEBUG:teuthology.orchestra.run.smithi012:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-10-05T11:27:54.285 DEBUG:teuthology.orchestra.run.smithi170:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-10-05T11:27:54.316 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-05T11:27:54.316 INFO:tasks.ceph:role: osd.4 2023-10-05T11:27:54.316 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi170.front.sepia.ceph.com 2023-10-05T11:27:54.317 DEBUG:teuthology.orchestra.run.smithi170:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-05T11:27:54.387 INFO:teuthology.orchestra.run.smithi170.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-05T11:27:54.387 INFO:teuthology.orchestra.run.smithi170.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-05T11:27:54.387 INFO:teuthology.orchestra.run.smithi170.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-05T11:27:54.387 INFO:teuthology.orchestra.run.smithi170.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-10-05T11:27:54.387 INFO:teuthology.orchestra.run.smithi170.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-05T11:27:54.387 INFO:teuthology.orchestra.run.smithi170.stdout: = sunit=0 swidth=0 blks 2023-10-05T11:27:54.387 INFO:teuthology.orchestra.run.smithi170.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-05T11:27:54.388 INFO:teuthology.orchestra.run.smithi170.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-10-05T11:27:54.388 INFO:teuthology.orchestra.run.smithi170.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-05T11:27:54.388 INFO:teuthology.orchestra.run.smithi170.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-05T11:27:54.420 INFO:teuthology.orchestra.run.smithi170.stdout:Discarding blocks...Done. 2023-10-05T11:27:54.422 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi170.front.sepia.ceph.com -o noatime 2023-10-05T11:27:54.422 DEBUG:teuthology.orchestra.run.smithi170:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-10-05T11:27:54.497 DEBUG:teuthology.orchestra.run.smithi170:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-10-05T11:27:54.571 DEBUG:teuthology.orchestra.run.smithi170:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-10-05T11:27:54.639 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-05T11:27:54.639 INFO:tasks.ceph:role: osd.5 2023-10-05T11:27:54.639 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi170.front.sepia.ceph.com 2023-10-05T11:27:54.640 DEBUG:teuthology.orchestra.run.smithi170:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-05T11:27:54.706 INFO:teuthology.orchestra.run.smithi170.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-05T11:27:54.707 INFO:teuthology.orchestra.run.smithi170.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-05T11:27:54.707 INFO:teuthology.orchestra.run.smithi170.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-05T11:27:54.707 INFO:teuthology.orchestra.run.smithi170.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-10-05T11:27:54.708 INFO:teuthology.orchestra.run.smithi170.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-05T11:27:54.708 INFO:teuthology.orchestra.run.smithi170.stdout: = sunit=0 swidth=0 blks 2023-10-05T11:27:54.708 INFO:teuthology.orchestra.run.smithi170.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-05T11:27:54.708 INFO:teuthology.orchestra.run.smithi170.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-10-05T11:27:54.708 INFO:teuthology.orchestra.run.smithi170.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-05T11:27:54.709 INFO:teuthology.orchestra.run.smithi170.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-05T11:27:54.743 INFO:teuthology.orchestra.run.smithi170.stdout:Discarding blocks...Done. 2023-10-05T11:27:54.745 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi170.front.sepia.ceph.com -o noatime 2023-10-05T11:27:54.746 DEBUG:teuthology.orchestra.run.smithi170:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-10-05T11:27:54.821 DEBUG:teuthology.orchestra.run.smithi170:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-10-05T11:27:54.894 DEBUG:teuthology.orchestra.run.smithi170:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-10-05T11:27:54.961 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-05T11:27:54.961 INFO:tasks.ceph:role: osd.6 2023-10-05T11:27:54.961 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi170.front.sepia.ceph.com 2023-10-05T11:27:54.961 DEBUG:teuthology.orchestra.run.smithi170:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-10-05T11:27:55.028 INFO:teuthology.orchestra.run.smithi170.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-10-05T11:27:55.028 INFO:teuthology.orchestra.run.smithi170.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-05T11:27:55.028 INFO:teuthology.orchestra.run.smithi170.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-05T11:27:55.028 INFO:teuthology.orchestra.run.smithi170.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-10-05T11:27:55.028 INFO:teuthology.orchestra.run.smithi170.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-05T11:27:55.028 INFO:teuthology.orchestra.run.smithi170.stdout: = sunit=0 swidth=0 blks 2023-10-05T11:27:55.028 INFO:teuthology.orchestra.run.smithi170.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-05T11:27:55.028 INFO:teuthology.orchestra.run.smithi170.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-10-05T11:27:55.028 INFO:teuthology.orchestra.run.smithi170.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-05T11:27:55.029 INFO:teuthology.orchestra.run.smithi170.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-05T11:27:55.060 INFO:teuthology.orchestra.run.smithi170.stdout:Discarding blocks...Done. 2023-10-05T11:27:55.061 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi170.front.sepia.ceph.com -o noatime 2023-10-05T11:27:55.062 DEBUG:teuthology.orchestra.run.smithi170:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-10-05T11:27:55.133 DEBUG:teuthology.orchestra.run.smithi170:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-10-05T11:27:55.203 DEBUG:teuthology.orchestra.run.smithi170:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-10-05T11:27:55.271 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-05T11:27:55.271 INFO:tasks.ceph:role: osd.7 2023-10-05T11:27:55.271 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi170.front.sepia.ceph.com 2023-10-05T11:27:55.271 DEBUG:teuthology.orchestra.run.smithi170:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-10-05T11:27:55.337 INFO:teuthology.orchestra.run.smithi170.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-10-05T11:27:55.337 INFO:teuthology.orchestra.run.smithi170.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-05T11:27:55.337 INFO:teuthology.orchestra.run.smithi170.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-05T11:27:55.337 INFO:teuthology.orchestra.run.smithi170.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-10-05T11:27:55.337 INFO:teuthology.orchestra.run.smithi170.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-05T11:27:55.337 INFO:teuthology.orchestra.run.smithi170.stdout: = sunit=0 swidth=0 blks 2023-10-05T11:27:55.338 INFO:teuthology.orchestra.run.smithi170.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-05T11:27:55.338 INFO:teuthology.orchestra.run.smithi170.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-10-05T11:27:55.338 INFO:teuthology.orchestra.run.smithi170.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-05T11:27:55.338 INFO:teuthology.orchestra.run.smithi170.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-05T11:27:55.369 INFO:teuthology.orchestra.run.smithi170.stdout:Discarding blocks...Done. 2023-10-05T11:27:55.371 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi170.front.sepia.ceph.com -o noatime 2023-10-05T11:27:55.371 DEBUG:teuthology.orchestra.run.smithi170:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-10-05T11:27:55.441 DEBUG:teuthology.orchestra.run.smithi170:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-10-05T11:27:55.511 DEBUG:teuthology.orchestra.run.smithi170:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-05T11:27:55.604 INFO:teuthology.orchestra.run.smithi170.stderr:2023-10-05T11:27:55.600+0000 7f214fc2b500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-10-05T11:27:55.605 INFO:teuthology.orchestra.run.smithi170.stderr:2023-10-05T11:27:55.600+0000 7f214fc2b500 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-10-05T11:27:55.605 INFO:teuthology.orchestra.run.smithi170.stderr:2023-10-05T11:27:55.600+0000 7f214fc2b500 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-05T11:27:55.605 INFO:teuthology.orchestra.run.smithi170.stderr:2023-10-05T11:27:55.600+0000 7f214fc2b500 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-05T11:27:55.605 INFO:teuthology.orchestra.run.smithi170.stderr:2023-10-05T11:27:55.600+0000 7f214fc2b500 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-05T11:27:55.605 INFO:teuthology.orchestra.run.smithi170.stderr:2023-10-05T11:27:55.601+0000 7f214fc2b500 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-10-05T11:27:58.459 DEBUG:teuthology.orchestra.run.smithi170:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-10-05T11:27:58.490 DEBUG:teuthology.orchestra.run.smithi170:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-05T11:27:58.580 INFO:teuthology.orchestra.run.smithi170.stderr:2023-10-05T11:27:58.576+0000 7f27feeb2500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-10-05T11:27:58.580 INFO:teuthology.orchestra.run.smithi170.stderr:2023-10-05T11:27:58.576+0000 7f27feeb2500 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-10-05T11:27:58.580 INFO:teuthology.orchestra.run.smithi170.stderr:2023-10-05T11:27:58.576+0000 7f27feeb2500 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-05T11:27:58.580 INFO:teuthology.orchestra.run.smithi170.stderr:2023-10-05T11:27:58.576+0000 7f27feeb2500 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-05T11:27:58.580 INFO:teuthology.orchestra.run.smithi170.stderr:2023-10-05T11:27:58.576+0000 7f27feeb2500 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-05T11:27:58.580 INFO:teuthology.orchestra.run.smithi170.stderr:2023-10-05T11:27:58.576+0000 7f27feeb2500 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-10-05T11:28:01.422 DEBUG:teuthology.orchestra.run.smithi170:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-10-05T11:28:01.454 DEBUG:teuthology.orchestra.run.smithi170:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-05T11:28:01.545 INFO:teuthology.orchestra.run.smithi170.stderr:2023-10-05T11:28:01.542+0000 7f555fe14500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-10-05T11:28:01.546 INFO:teuthology.orchestra.run.smithi170.stderr:2023-10-05T11:28:01.542+0000 7f555fe14500 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-10-05T11:28:01.546 INFO:teuthology.orchestra.run.smithi170.stderr:2023-10-05T11:28:01.542+0000 7f555fe14500 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-05T11:28:01.546 INFO:teuthology.orchestra.run.smithi170.stderr:2023-10-05T11:28:01.542+0000 7f555fe14500 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-05T11:28:01.546 INFO:teuthology.orchestra.run.smithi170.stderr:2023-10-05T11:28:01.542+0000 7f555fe14500 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-05T11:28:01.546 INFO:teuthology.orchestra.run.smithi170.stderr:2023-10-05T11:28:01.542+0000 7f555fe14500 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-10-05T11:28:04.392 DEBUG:teuthology.orchestra.run.smithi170:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-10-05T11:28:04.423 DEBUG:teuthology.orchestra.run.smithi170:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-05T11:28:04.514 INFO:teuthology.orchestra.run.smithi170.stderr:2023-10-05T11:28:04.510+0000 7fb91201a500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-10-05T11:28:04.515 INFO:teuthology.orchestra.run.smithi170.stderr:2023-10-05T11:28:04.510+0000 7fb91201a500 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-10-05T11:28:04.515 INFO:teuthology.orchestra.run.smithi170.stderr:2023-10-05T11:28:04.510+0000 7fb91201a500 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-05T11:28:04.515 INFO:teuthology.orchestra.run.smithi170.stderr:2023-10-05T11:28:04.510+0000 7fb91201a500 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-05T11:28:04.515 INFO:teuthology.orchestra.run.smithi170.stderr:2023-10-05T11:28:04.510+0000 7fb91201a500 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-05T11:28:04.515 INFO:teuthology.orchestra.run.smithi170.stderr:2023-10-05T11:28:04.511+0000 7fb91201a500 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-10-05T11:28:07.361 DEBUG:teuthology.orchestra.run.smithi170:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-10-05T11:28:07.390 INFO:tasks.ceph:Reading keys from all nodes... 2023-10-05T11:28:07.391 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-10-05T11:28:07.391 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-10-05T11:28:07.427 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-10-05T11:28:07.427 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-10-05T11:28:07.501 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-10-05T11:28:07.502 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-10-05T11:28:07.576 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-10-05T11:28:07.576 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-10-05T11:28:07.649 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-10-05T11:28:07.649 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-10-05T11:28:07.721 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2023-10-05T11:28:07.721 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-10-05T11:28:07.751 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2023-10-05T11:28:07.751 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-10-05T11:28:07.820 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2023-10-05T11:28:07.821 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-10-05T11:28:07.890 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2023-10-05T11:28:07.890 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-10-05T11:28:07.958 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2023-10-05T11:28:07.958 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-10-05T11:28:08.026 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-10-05T11:28:08.026 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-10-05T11:28:08.043 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2023-10-05T11:28:08.043 DEBUG:teuthology.orchestra.run.smithi170:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-10-05T11:28:08.081 INFO:tasks.ceph:Adding keys to all mons... 2023-10-05T11:28:08.081 DEBUG:teuthology.orchestra.run.smithi012:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-05T11:28:08.085 DEBUG:teuthology.orchestra.run.smithi170:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-05T11:28:08.125 INFO:teuthology.orchestra.run.smithi012.stdout:[mgr.y] 2023-10-05T11:28:08.125 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQCqnR5lP+GjOhAAaegrwFlcJmINabVQcjEfCQ== 2023-10-05T11:28:08.125 INFO:teuthology.orchestra.run.smithi012.stdout:[osd.0] 2023-10-05T11:28:08.125 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQCunR5lpGZpGRAAm8BrOK6SvTtWiFGF7M4csg== 2023-10-05T11:28:08.125 INFO:teuthology.orchestra.run.smithi012.stdout:[osd.1] 2023-10-05T11:28:08.125 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQCxnR5lnLbiGBAAZHI73kG+nh54LAYSLdbOpg== 2023-10-05T11:28:08.125 INFO:teuthology.orchestra.run.smithi012.stdout:[osd.2] 2023-10-05T11:28:08.125 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQC0nR5lMlPIFxAAJ4BaXbfojv8qEMW1w4/98g== 2023-10-05T11:28:08.126 INFO:teuthology.orchestra.run.smithi012.stdout:[osd.3] 2023-10-05T11:28:08.126 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQC3nR5luuGKFxAA4+Uso+o0WsdJxqfen9j11w== 2023-10-05T11:28:08.126 INFO:teuthology.orchestra.run.smithi012.stdout:[mgr.x] 2023-10-05T11:28:08.126 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQCrnR5li8xHAxAARNkOGLHbvW9OvbK4sglL+Q== 2023-10-05T11:28:08.126 INFO:teuthology.orchestra.run.smithi012.stdout:[osd.4] 2023-10-05T11:28:08.126 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQC7nR5lV/3dIxAAj0rT8jNTCqML5GZdy2lcGg== 2023-10-05T11:28:08.126 INFO:teuthology.orchestra.run.smithi012.stdout:[osd.5] 2023-10-05T11:28:08.126 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQC+nR5laUVpIhAA2YvqRN/TAbe5aBbOZJ0qLw== 2023-10-05T11:28:08.126 INFO:teuthology.orchestra.run.smithi012.stdout:[osd.6] 2023-10-05T11:28:08.127 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQDBnR5lsOdgIBAAhqiFvEUWvy1euDMmE65d3A== 2023-10-05T11:28:08.127 INFO:teuthology.orchestra.run.smithi012.stdout:[osd.7] 2023-10-05T11:28:08.127 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQDEnR5lpj5+HhAAwDQnEEnQbK5u+FhpDfHrog== 2023-10-05T11:28:08.127 INFO:teuthology.orchestra.run.smithi012.stdout:[client.0] 2023-10-05T11:28:08.127 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQCrnR5l/ew1BhAArpblU/BVeIJ+Xg20Nb0fMA== 2023-10-05T11:28:08.127 INFO:teuthology.orchestra.run.smithi012.stdout:[client.1] 2023-10-05T11:28:08.127 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQCrnR5lqnHaCRAAZTlM4PqS5JTi6XOoAO2VKQ== 2023-10-05T11:28:08.146 INFO:teuthology.orchestra.run.smithi170.stdout:[mgr.y] 2023-10-05T11:28:08.146 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQCqnR5lP+GjOhAAaegrwFlcJmINabVQcjEfCQ== 2023-10-05T11:28:08.146 INFO:teuthology.orchestra.run.smithi170.stdout:[osd.0] 2023-10-05T11:28:08.146 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQCunR5lpGZpGRAAm8BrOK6SvTtWiFGF7M4csg== 2023-10-05T11:28:08.147 INFO:teuthology.orchestra.run.smithi170.stdout:[osd.1] 2023-10-05T11:28:08.147 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQCxnR5lnLbiGBAAZHI73kG+nh54LAYSLdbOpg== 2023-10-05T11:28:08.147 INFO:teuthology.orchestra.run.smithi170.stdout:[osd.2] 2023-10-05T11:28:08.147 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQC0nR5lMlPIFxAAJ4BaXbfojv8qEMW1w4/98g== 2023-10-05T11:28:08.147 INFO:teuthology.orchestra.run.smithi170.stdout:[osd.3] 2023-10-05T11:28:08.147 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQC3nR5luuGKFxAA4+Uso+o0WsdJxqfen9j11w== 2023-10-05T11:28:08.147 INFO:teuthology.orchestra.run.smithi170.stdout:[mgr.x] 2023-10-05T11:28:08.147 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQCrnR5li8xHAxAARNkOGLHbvW9OvbK4sglL+Q== 2023-10-05T11:28:08.147 INFO:teuthology.orchestra.run.smithi170.stdout:[osd.4] 2023-10-05T11:28:08.147 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQC7nR5lV/3dIxAAj0rT8jNTCqML5GZdy2lcGg== 2023-10-05T11:28:08.148 INFO:teuthology.orchestra.run.smithi170.stdout:[osd.5] 2023-10-05T11:28:08.148 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQC+nR5laUVpIhAA2YvqRN/TAbe5aBbOZJ0qLw== 2023-10-05T11:28:08.148 INFO:teuthology.orchestra.run.smithi170.stdout:[osd.6] 2023-10-05T11:28:08.148 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQDBnR5lsOdgIBAAhqiFvEUWvy1euDMmE65d3A== 2023-10-05T11:28:08.148 INFO:teuthology.orchestra.run.smithi170.stdout:[osd.7] 2023-10-05T11:28:08.148 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQDEnR5lpj5+HhAAwDQnEEnQbK5u+FhpDfHrog== 2023-10-05T11:28:08.148 INFO:teuthology.orchestra.run.smithi170.stdout:[client.0] 2023-10-05T11:28:08.148 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQCrnR5l/ew1BhAArpblU/BVeIJ+Xg20Nb0fMA== 2023-10-05T11:28:08.148 INFO:teuthology.orchestra.run.smithi170.stdout:[client.1] 2023-10-05T11:28:08.148 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQCrnR5lqnHaCRAAZTlM4PqS5JTi6XOoAO2VKQ== 2023-10-05T11:28:08.149 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-05T11:28:08.171 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-05T11:28:08.240 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-05T11:28:08.243 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-05T11:28:08.297 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-05T11:28:08.299 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-05T11:28:08.353 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-05T11:28:08.355 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-05T11:28:08.408 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-05T11:28:08.410 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-05T11:28:08.463 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-05T11:28:08.465 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-05T11:28:08.518 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-05T11:28:08.520 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-05T11:28:08.573 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-05T11:28:08.575 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-05T11:28:08.628 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-05T11:28:08.630 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-05T11:28:08.683 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-05T11:28:08.685 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-05T11:28:08.739 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-05T11:28:08.741 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-05T11:28:08.797 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-05T11:28:08.800 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-05T11:28:08.855 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-10-05T11:28:08.856 DEBUG:teuthology.orchestra.run.smithi012:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-10-05T11:28:08.886 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-05T11:28:08.987 DEBUG:teuthology.orchestra.run.smithi012:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-10-05T11:28:09.017 DEBUG:teuthology.orchestra.run.smithi012:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-10-05T11:28:09.088 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-05T11:28:09.189 DEBUG:teuthology.orchestra.run.smithi012:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-10-05T11:28:09.219 DEBUG:teuthology.orchestra.run.smithi170:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-10-05T11:28:09.247 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-05T11:28:09.343 DEBUG:teuthology.orchestra.run.smithi170:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-10-05T11:28:09.370 DEBUG:teuthology.orchestra.run.smithi012:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-05T11:28:09.373 DEBUG:teuthology.orchestra.run.smithi170:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-05T11:28:09.425 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-10-05T11:28:09.425 INFO:tasks.ceph.mon.a:Restarting daemon 2023-10-05T11:28:09.425 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-10-05T11:28:09.428 INFO:tasks.ceph.mon.a:Started 2023-10-05T11:28:09.428 INFO:tasks.ceph.mon.c:Restarting daemon 2023-10-05T11:28:09.428 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-10-05T11:28:09.430 INFO:tasks.ceph.mon.c:Started 2023-10-05T11:28:09.430 INFO:tasks.ceph.mon.b:Restarting daemon 2023-10-05T11:28:09.430 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-10-05T11:28:09.466 INFO:tasks.ceph.mon.b:Started 2023-10-05T11:28:09.466 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-10-05T11:28:09.467 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-10-05T11:28:09.467 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-10-05T11:28:09.469 INFO:tasks.ceph.mgr.y:Started 2023-10-05T11:28:09.469 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-10-05T11:28:09.469 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-10-05T11:28:09.471 INFO:tasks.ceph.mgr.x:Started 2023-10-05T11:28:09.471 INFO:tasks.ceph:Setting crush tunables to default 2023-10-05T11:28:09.471 DEBUG:teuthology.orchestra.run.smithi012:> sudo ceph --cluster ceph osd crush tunables default 2023-10-05T11:28:09.847 INFO:teuthology.orchestra.run.smithi012.stderr:adjusted tunables profile to default 2023-10-05T11:28:09.859 INFO:tasks.ceph:check_enable_crimson: False 2023-10-05T11:28:09.859 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-10-05T11:28:09.859 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-10-05T11:28:09.859 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-10-05T11:28:09.890 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-10-05T11:28:09.890 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-10-05T11:28:09.961 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-10-05T11:28:09.961 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-10-05T11:28:10.031 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-10-05T11:28:10.031 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-10-05T11:28:10.102 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2023-10-05T11:28:10.102 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-10-05T11:28:10.129 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2023-10-05T11:28:10.129 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-10-05T11:28:10.196 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2023-10-05T11:28:10.196 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-10-05T11:28:10.208 INFO:tasks.ceph.mgr.x.smithi170.stderr:2023-10-05T11:28:10.205+0000 7fb922c39040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-05T11:28:10.234 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2023-10-05T11:28:10.234 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-10-05T11:28:10.254 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-05T11:28:10.250+0000 7fb169014040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-05T11:28:10.262 INFO:tasks.ceph.mgr.x.smithi170.stderr:2023-10-05T11:28:10.259+0000 7fb922c39040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-05T11:28:10.288 DEBUG:teuthology.orchestra.run.smithi170:> sudo ceph --cluster ceph osd new 9415b30c-e391-4003-8e66-29b39e9138a0 0 2023-10-05T11:28:10.307 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-05T11:28:10.303+0000 7fb169014040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-05T11:28:10.519 INFO:teuthology.orchestra.run.smithi170.stdout:0 2023-10-05T11:28:10.531 DEBUG:teuthology.orchestra.run.smithi170:> sudo ceph --cluster ceph osd new 3b675a31-7375-4fc0-8894-79157381291b 1 2023-10-05T11:28:10.714 INFO:teuthology.orchestra.run.smithi170.stdout:1 2023-10-05T11:28:10.725 DEBUG:teuthology.orchestra.run.smithi170:> sudo ceph --cluster ceph osd new 15c64694-9fbf-46cf-a902-13d7cc9ac93f 2 2023-10-05T11:28:10.820 INFO:tasks.ceph.mgr.x.smithi170.stderr:2023-10-05T11:28:10.817+0000 7fb922c39040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-05T11:28:10.859 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-05T11:28:10.854+0000 7fb169014040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-05T11:28:10.874 INFO:tasks.ceph.mgr.x.smithi170.stderr:2023-10-05T11:28:10.871+0000 7fb922c39040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-05T11:28:10.906 INFO:teuthology.orchestra.run.smithi170.stdout:2 2023-10-05T11:28:10.913 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-05T11:28:10.910+0000 7fb169014040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-05T11:28:10.917 DEBUG:teuthology.orchestra.run.smithi170:> sudo ceph --cluster ceph osd new f40c40e1-154a-4788-8821-c254425eef6b 3 2023-10-05T11:28:10.920 INFO:tasks.ceph.mgr.x.smithi170.stderr:2023-10-05T11:28:10.917+0000 7fb922c39040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-05T11:28:10.960 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-05T11:28:10.956+0000 7fb169014040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-05T11:28:10.977 INFO:tasks.ceph.mgr.x.smithi170.stderr:2023-10-05T11:28:10.974+0000 7fb922c39040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-05T11:28:11.016 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-05T11:28:11.012+0000 7fb169014040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-05T11:28:11.022 INFO:tasks.ceph.mgr.x.smithi170.stderr:2023-10-05T11:28:11.019+0000 7fb922c39040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-05T11:28:11.060 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-05T11:28:11.056+0000 7fb169014040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-05T11:28:11.100 INFO:teuthology.orchestra.run.smithi170.stdout:3 2023-10-05T11:28:11.111 DEBUG:teuthology.orchestra.run.smithi170:> sudo ceph --cluster ceph osd new 714646f6-8955-4fe4-8b9b-db840f567e86 4 2023-10-05T11:28:11.127 INFO:tasks.ceph.mgr.x.smithi170.stderr:2023-10-05T11:28:11.124+0000 7fb922c39040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-05T11:28:11.165 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-05T11:28:11.162+0000 7fb169014040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-05T11:28:11.200 INFO:tasks.ceph.mgr.x.smithi170.stderr:2023-10-05T11:28:11.197+0000 7fb922c39040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-05T11:28:11.238 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-05T11:28:11.235+0000 7fb169014040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-05T11:28:11.249 INFO:tasks.ceph.mgr.x.smithi170.stderr:2023-10-05T11:28:11.246+0000 7fb922c39040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-05T11:28:11.286 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-05T11:28:11.282+0000 7fb169014040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-05T11:28:11.303 INFO:tasks.ceph.mgr.x.smithi170.stderr:2023-10-05T11:28:11.299+0000 7fb922c39040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-05T11:28:11.309 INFO:teuthology.orchestra.run.smithi170.stdout:4 2023-10-05T11:28:11.320 DEBUG:teuthology.orchestra.run.smithi170:> sudo ceph --cluster ceph osd new ca54baf8-781a-41eb-bae9-8f198cc3569c 5 2023-10-05T11:28:11.341 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-05T11:28:11.337+0000 7fb169014040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-05T11:28:11.353 INFO:tasks.ceph.mgr.x.smithi170.stderr:2023-10-05T11:28:11.350+0000 7fb922c39040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-05T11:28:11.390 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-05T11:28:11.386+0000 7fb169014040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-05T11:28:11.500 INFO:teuthology.orchestra.run.smithi170.stdout:5 2023-10-05T11:28:11.511 DEBUG:teuthology.orchestra.run.smithi170:> sudo ceph --cluster ceph osd new fa84fa70-944c-485e-b14e-516a3ead8b43 6 2023-10-05T11:28:11.734 INFO:teuthology.orchestra.run.smithi170.stdout:6 2023-10-05T11:28:11.745 DEBUG:teuthology.orchestra.run.smithi170:> sudo ceph --cluster ceph osd new c6fe0a72-f5e7-443f-9b51-c1ceee215906 7 2023-10-05T11:28:11.749 INFO:tasks.ceph.mgr.x.smithi170.stderr:2023-10-05T11:28:11.746+0000 7fb922c39040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-05T11:28:11.790 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-05T11:28:11.786+0000 7fb169014040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-05T11:28:11.890 INFO:tasks.ceph.mgr.x.smithi170.stderr:2023-10-05T11:28:11.886+0000 7fb922c39040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-05T11:28:11.928 INFO:teuthology.orchestra.run.smithi170.stdout:7 2023-10-05T11:28:11.931 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-05T11:28:11.928+0000 7fb169014040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-05T11:28:11.939 INFO:tasks.ceph.osd.0:Restarting daemon 2023-10-05T11:28:11.939 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-10-05T11:28:11.941 INFO:tasks.ceph.osd.0:Started 2023-10-05T11:28:11.942 INFO:tasks.ceph.osd.1:Restarting daemon 2023-10-05T11:28:11.942 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-10-05T11:28:11.944 INFO:tasks.ceph.osd.1:Started 2023-10-05T11:28:11.944 INFO:tasks.ceph.osd.2:Restarting daemon 2023-10-05T11:28:11.944 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-10-05T11:28:11.946 INFO:tasks.ceph.osd.2:Started 2023-10-05T11:28:11.947 INFO:tasks.ceph.osd.3:Restarting daemon 2023-10-05T11:28:11.947 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-10-05T11:28:11.949 INFO:tasks.ceph.osd.3:Started 2023-10-05T11:28:11.949 INFO:tasks.ceph.osd.4:Restarting daemon 2023-10-05T11:28:11.949 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-10-05T11:28:11.982 INFO:tasks.ceph.osd.4:Started 2023-10-05T11:28:11.982 INFO:tasks.ceph.osd.5:Restarting daemon 2023-10-05T11:28:11.982 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-10-05T11:28:11.984 INFO:tasks.ceph.osd.5:Started 2023-10-05T11:28:11.984 INFO:tasks.ceph.osd.6:Restarting daemon 2023-10-05T11:28:11.984 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-10-05T11:28:11.986 INFO:tasks.ceph.osd.6:Started 2023-10-05T11:28:11.986 INFO:tasks.ceph.osd.7:Restarting daemon 2023-10-05T11:28:11.986 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-10-05T11:28:11.988 INFO:tasks.ceph.osd.7:Started 2023-10-05T11:28:11.989 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-05T11:28:12.004 INFO:tasks.ceph.mgr.x.smithi170.stderr:2023-10-05T11:28:12.001+0000 7fb922c39040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-05T11:28:12.076 INFO:tasks.ceph.mgr.x.smithi170.stderr:2023-10-05T11:28:12.072+0000 7fb922c39040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-05T11:28:12.093 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-05T11:28:12.089+0000 7fb169014040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-05T11:28:12.159 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-05T11:28:12.155+0000 7fb169014040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-05T11:28:12.176 INFO:tasks.ceph.mgr.x.smithi170.stderr:2023-10-05T11:28:12.172+0000 7fb922c39040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-05T11:28:12.221 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:28:12.222 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":10,"fsid":"7e015f46-293b-4b09-bd32-7d32b52f6e2f","created":"2023-10-05T11:28:09.746128+0000","modified":"2023-10-05T11:28:11.923816+0000","last_up_change":"0.000000","last_in_change":"2023-10-05T11:28:11.923816+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"9415b30c-e391-4003-8e66-29b39e9138a0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"3b675a31-7375-4fc0-8894-79157381291b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"15c64694-9fbf-46cf-a902-13d7cc9ac93f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"f40c40e1-154a-4788-8821-c254425eef6b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"714646f6-8955-4fe4-8b9b-db840f567e86","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"ca54baf8-781a-41eb-bae9-8f198cc3569c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"fa84fa70-944c-485e-b14e-516a3ead8b43","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"c6fe0a72-f5e7-443f-9b51-c1ceee215906","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-05T11:28:12.233 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-10-05T11:28:12.233 INFO:tasks.ceph:Waiting for OSDs to come up 2023-10-05T11:28:12.263 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-05T11:28:12.259+0000 7fb169014040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-05T11:28:12.268 INFO:tasks.ceph.mgr.x.smithi170.stderr:2023-10-05T11:28:12.265+0000 7fb922c39040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-05T11:28:12.364 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-05T11:28:12.360+0000 7fb169014040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-05T11:28:12.408 INFO:tasks.ceph.mgr.x.smithi170.stderr:2023-10-05T11:28:12.405+0000 7fb922c39040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-05T11:28:12.449 INFO:tasks.ceph.mgr.x.smithi170.stderr:2023-10-05T11:28:12.446+0000 7fb922c39040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-05T11:28:12.512 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-05T11:28:12.508+0000 7fb169014040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-05T11:28:12.557 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-05T11:28:12.553+0000 7fb169014040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-05T11:28:12.558 INFO:tasks.ceph.osd.2.smithi012.stderr:2023-10-05T11:28:12.554+0000 7f87c1612500 -1 Falling back to public interface 2023-10-05T11:28:12.569 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-10-05T11:28:12.565+0000 7f2a87014500 -1 Falling back to public interface 2023-10-05T11:28:12.570 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-10-05T11:28:12.567+0000 7f5b40548500 -1 Falling back to public interface 2023-10-05T11:28:12.576 INFO:tasks.ceph.osd.3.smithi012.stderr:2023-10-05T11:28:12.573+0000 7f0b8bc0e500 -1 Falling back to public interface 2023-10-05T11:28:12.587 INFO:tasks.ceph.osd.6.smithi170.stderr:2023-10-05T11:28:12.583+0000 7f4aed014500 -1 Falling back to public interface 2023-10-05T11:28:12.588 INFO:tasks.ceph.mgr.x.smithi170.stderr:2023-10-05T11:28:12.585+0000 7fb922c39040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-05T11:28:12.597 INFO:tasks.ceph.osd.4.smithi170.stderr:2023-10-05T11:28:12.594+0000 7f3fa5669500 -1 Falling back to public interface 2023-10-05T11:28:12.598 INFO:tasks.ceph.osd.5.smithi170.stderr:2023-10-05T11:28:12.595+0000 7f8dc8a11500 -1 Falling back to public interface 2023-10-05T11:28:12.599 INFO:tasks.ceph.osd.5.smithi170.stderr:2023-10-05T11:28:12.595+0000 7f8dc7488640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6813/0: (98) Address already in use 2023-10-05T11:28:12.609 INFO:tasks.ceph.osd.7.smithi170.stderr:2023-10-05T11:28:12.606+0000 7ff79b20d500 -1 Falling back to public interface 2023-10-05T11:28:12.725 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-05T11:28:12.721+0000 7fb169014040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-05T11:28:13.038 DEBUG:teuthology.orchestra.run.smithi012:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-05T11:28:13.203 INFO:teuthology.misc.health.smithi012.stdout: 2023-10-05T11:28:13.203 INFO:teuthology.misc.health.smithi012.stdout:{"epoch":10,"fsid":"7e015f46-293b-4b09-bd32-7d32b52f6e2f","created":"2023-10-05T11:28:09.746128+0000","modified":"2023-10-05T11:28:11.923816+0000","last_up_change":"0.000000","last_in_change":"2023-10-05T11:28:11.923816+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"9415b30c-e391-4003-8e66-29b39e9138a0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"3b675a31-7375-4fc0-8894-79157381291b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"15c64694-9fbf-46cf-a902-13d7cc9ac93f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"f40c40e1-154a-4788-8821-c254425eef6b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"714646f6-8955-4fe4-8b9b-db840f567e86","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"ca54baf8-781a-41eb-bae9-8f198cc3569c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"fa84fa70-944c-485e-b14e-516a3ead8b43","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"c6fe0a72-f5e7-443f-9b51-c1ceee215906","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-05T11:28:13.213 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-10-05T11:28:13.377 INFO:tasks.ceph.mgr.x.smithi170.stderr:2023-10-05T11:28:13.374+0000 7fb922c39040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-05T11:28:13.579 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-05T11:28:13.575+0000 7fb169014040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-05T11:28:13.648 INFO:tasks.ceph.mgr.x.smithi170.stderr:2023-10-05T11:28:13.645+0000 7fb922c39040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-05T11:28:13.700 INFO:tasks.ceph.mgr.x.smithi170.stderr:2023-10-05T11:28:13.696+0000 7fb922c39040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-05T11:28:13.803 INFO:tasks.ceph.mgr.x.smithi170.stderr:2023-10-05T11:28:13.800+0000 7fb922c39040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-05T11:28:13.867 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-05T11:28:13.863+0000 7fb169014040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-05T11:28:13.921 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-05T11:28:13.917+0000 7fb169014040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-05T11:28:14.026 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-05T11:28:14.022+0000 7fb169014040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-05T11:28:14.830 INFO:tasks.ceph.mgr.x.smithi170.stderr:2023-10-05T11:28:14.826+0000 7fb8c405a640 -1 mgr.server handle_report got status from non-daemon mon.b 2023-10-05T11:28:14.831 INFO:tasks.ceph.mgr.x.smithi170.stderr:2023-10-05T11:28:14.828+0000 7fb8c405a640 -1 mgr.server handle_report got status from non-daemon mon.c 2023-10-05T11:28:16.030 INFO:tasks.ceph.osd.2.smithi012.stderr:2023-10-05T11:28:16.026+0000 7f87c1612500 -1 osd.2 0 log_to_monitors true 2023-10-05T11:28:16.056 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-10-05T11:28:16.052+0000 7f5b40548500 -1 osd.1 0 log_to_monitors true 2023-10-05T11:28:16.068 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-10-05T11:28:16.064+0000 7f2a87014500 -1 osd.0 0 log_to_monitors true 2023-10-05T11:28:16.072 INFO:tasks.ceph.osd.6.smithi170.stderr:2023-10-05T11:28:16.069+0000 7f4aed014500 -1 osd.6 0 log_to_monitors true 2023-10-05T11:28:16.080 INFO:tasks.ceph.osd.3.smithi012.stderr:2023-10-05T11:28:16.077+0000 7f0b8bc0e500 -1 osd.3 0 log_to_monitors true 2023-10-05T11:28:16.120 INFO:tasks.ceph.osd.5.smithi170.stderr:2023-10-05T11:28:16.116+0000 7f8dc8a11500 -1 osd.5 0 log_to_monitors true 2023-10-05T11:28:16.120 INFO:tasks.ceph.osd.4.smithi170.stderr:2023-10-05T11:28:16.117+0000 7f3fa5669500 -1 osd.4 0 log_to_monitors true 2023-10-05T11:28:16.144 INFO:tasks.ceph.osd.7.smithi170.stderr:2023-10-05T11:28:16.141+0000 7ff79b20d500 -1 osd.7 0 log_to_monitors true 2023-10-05T11:28:19.243 INFO:tasks.ceph.osd.4.smithi170.stderr:2023-10-05T11:28:19.240+0000 7f3fa260c640 -1 osd.4 0 waiting for initial osdmap 2023-10-05T11:28:19.269 INFO:tasks.ceph.osd.5.smithi170.stderr:2023-10-05T11:28:19.265+0000 7f8dc3c4a640 -1 osd.5 0 waiting for initial osdmap 2023-10-05T11:28:19.270 INFO:tasks.ceph.osd.4.smithi170.stderr:2023-10-05T11:28:19.267+0000 7f3f99404640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-05T11:28:19.279 INFO:tasks.ceph.osd.5.smithi170.stderr:2023-10-05T11:28:19.276+0000 7f8dbc27c640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-05T11:28:19.298 INFO:tasks.ceph.osd.6.smithi170.stderr:2023-10-05T11:28:19.294+0000 7f4ae80ba640 -1 osd.6 0 waiting for initial osdmap 2023-10-05T11:28:19.313 INFO:tasks.ceph.osd.6.smithi170.stderr:2023-10-05T11:28:19.310+0000 7f4ae06ec640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-05T11:28:19.360 INFO:tasks.ceph.osd.7.smithi170.stderr:2023-10-05T11:28:19.357+0000 7ff797c82640 -1 osd.7 0 waiting for initial osdmap 2023-10-05T11:28:19.372 INFO:tasks.ceph.osd.7.smithi170.stderr:2023-10-05T11:28:19.369+0000 7ff78ea7a640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-05T11:28:19.898 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-10-05T11:28:19.894+0000 7f2a820ba640 -1 osd.0 0 waiting for initial osdmap 2023-10-05T11:28:19.916 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-10-05T11:28:19.912+0000 7f2a7a6ec640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-05T11:28:20.005 INFO:tasks.ceph.osd.3.smithi012.stderr:2023-10-05T11:28:20.001+0000 7f0b86d1d640 -1 osd.3 0 waiting for initial osdmap 2023-10-05T11:28:20.011 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-10-05T11:28:20.008+0000 7f5b3bcb1640 -1 osd.1 0 waiting for initial osdmap 2023-10-05T11:28:20.019 DEBUG:teuthology.orchestra.run.smithi012:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-05T11:28:20.020 INFO:tasks.ceph.osd.3.smithi012.stderr:2023-10-05T11:28:20.017+0000 7f0b7f34f640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-05T11:28:20.022 INFO:tasks.ceph.osd.2.smithi012.stderr:2023-10-05T11:28:20.018+0000 7f87bc6e4640 -1 osd.2 0 waiting for initial osdmap 2023-10-05T11:28:20.026 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-10-05T11:28:20.023+0000 7f5b342e3640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-05T11:28:20.033 INFO:tasks.ceph.osd.2.smithi012.stderr:2023-10-05T11:28:20.030+0000 7f87b4d16640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-05T11:28:20.305 INFO:teuthology.misc.health.smithi012.stdout: 2023-10-05T11:28:20.306 INFO:teuthology.misc.health.smithi012.stdout:{"epoch":13,"fsid":"7e015f46-293b-4b09-bd32-7d32b52f6e2f","created":"2023-10-05T11:28:09.746128+0000","modified":"2023-10-05T11:28:20.271709+0000","last_up_change":"2023-10-05T11:28:20.271709+0000","last_in_change":"2023-10-05T11:28:11.923816+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"9415b30c-e391-4003-8e66-29b39e9138a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":396693578},{"type":"v1","addr":"172.21.15.12:6809","nonce":396693578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":396693578},{"type":"v1","addr":"172.21.15.12:6811","nonce":396693578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":396693578},{"type":"v1","addr":"172.21.15.12:6818","nonce":396693578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":396693578},{"type":"v1","addr":"172.21.15.12:6814","nonce":396693578}]},"public_addr":"172.21.15.12:6809/396693578","cluster_addr":"172.21.15.12:6811/396693578","heartbeat_back_addr":"172.21.15.12:6818/396693578","heartbeat_front_addr":"172.21.15.12:6814/396693578","state":["exists","up"]},{"osd":1,"uuid":"3b675a31-7375-4fc0-8894-79157381291b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6813","nonce":3341239609},{"type":"v1","addr":"172.21.15.12:6815","nonce":3341239609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6817","nonce":3341239609},{"type":"v1","addr":"172.21.15.12:6819","nonce":3341239609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":3341239609},{"type":"v1","addr":"172.21.15.12:6823","nonce":3341239609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":3341239609},{"type":"v1","addr":"172.21.15.12:6821","nonce":3341239609}]},"public_addr":"172.21.15.12:6815/3341239609","cluster_addr":"172.21.15.12:6819/3341239609","heartbeat_back_addr":"172.21.15.12:6823/3341239609","heartbeat_front_addr":"172.21.15.12:6821/3341239609","state":["exists","up"]},{"osd":2,"uuid":"15c64694-9fbf-46cf-a902-13d7cc9ac93f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":732466381},{"type":"v1","addr":"172.21.15.12:6801","nonce":732466381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":732466381},{"type":"v1","addr":"172.21.15.12:6803","nonce":732466381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":732466381},{"type":"v1","addr":"172.21.15.12:6807","nonce":732466381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":732466381},{"type":"v1","addr":"172.21.15.12:6805","nonce":732466381}]},"public_addr":"172.21.15.12:6801/732466381","cluster_addr":"172.21.15.12:6803/732466381","heartbeat_back_addr":"172.21.15.12:6807/732466381","heartbeat_front_addr":"172.21.15.12:6805/732466381","state":["exists","up"]},{"osd":3,"uuid":"f40c40e1-154a-4788-8821-c254425eef6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":2171933159},{"type":"v1","addr":"172.21.15.12:6825","nonce":2171933159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":2171933159},{"type":"v1","addr":"172.21.15.12:6827","nonce":2171933159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":2171933159},{"type":"v1","addr":"172.21.15.12:6831","nonce":2171933159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":2171933159},{"type":"v1","addr":"172.21.15.12:6829","nonce":2171933159}]},"public_addr":"172.21.15.12:6825/2171933159","cluster_addr":"172.21.15.12:6827/2171933159","heartbeat_back_addr":"172.21.15.12:6831/2171933159","heartbeat_front_addr":"172.21.15.12:6829/2171933159","state":["exists","up"]},{"osd":4,"uuid":"714646f6-8955-4fe4-8b9b-db840f567e86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2113414864},{"type":"v1","addr":"172.21.15.170:6809","nonce":2113414864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2113414864},{"type":"v1","addr":"172.21.15.170:6811","nonce":2113414864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6815","nonce":2113414864},{"type":"v1","addr":"172.21.15.170:6817","nonce":2113414864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2113414864},{"type":"v1","addr":"172.21.15.170:6813","nonce":2113414864}]},"public_addr":"172.21.15.170:6809/2113414864","cluster_addr":"172.21.15.170:6811/2113414864","heartbeat_back_addr":"172.21.15.170:6817/2113414864","heartbeat_front_addr":"172.21.15.170:6813/2113414864","state":["exists","up"]},{"osd":5,"uuid":"ca54baf8-781a-41eb-bae9-8f198cc3569c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":3150808418},{"type":"v1","addr":"172.21.15.170:6816","nonce":3150808418}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3150808418},{"type":"v1","addr":"172.21.15.170:6819","nonce":3150808418}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3150808418},{"type":"v1","addr":"172.21.15.170:6823","nonce":3150808418}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3150808418},{"type":"v1","addr":"172.21.15.170:6821","nonce":3150808418}]},"public_addr":"172.21.15.170:6816/3150808418","cluster_addr":"172.21.15.170:6819/3150808418","heartbeat_back_addr":"172.21.15.170:6823/3150808418","heartbeat_front_addr":"172.21.15.170:6821/3150808418","state":["exists","up"]},{"osd":6,"uuid":"fa84fa70-944c-485e-b14e-516a3ead8b43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":4137726411},{"type":"v1","addr":"172.21.15.170:6801","nonce":4137726411}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":4137726411},{"type":"v1","addr":"172.21.15.170:6803","nonce":4137726411}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":4137726411},{"type":"v1","addr":"172.21.15.170:6807","nonce":4137726411}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":4137726411},{"type":"v1","addr":"172.21.15.170:6805","nonce":4137726411}]},"public_addr":"172.21.15.170:6801/4137726411","cluster_addr":"172.21.15.170:6803/4137726411","heartbeat_back_addr":"172.21.15.170:6807/4137726411","heartbeat_front_addr":"172.21.15.170:6805/4137726411","state":["exists","up"]},{"osd":7,"uuid":"c6fe0a72-f5e7-443f-9b51-c1ceee215906","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":75773779},{"type":"v1","addr":"172.21.15.170:6825","nonce":75773779}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":75773779},{"type":"v1","addr":"172.21.15.170:6827","nonce":75773779}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":75773779},{"type":"v1","addr":"172.21.15.170:6831","nonce":75773779}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":75773779},{"type":"v1","addr":"172.21.15.170:6829","nonce":75773779}]},"public_addr":"172.21.15.170:6825/75773779","cluster_addr":"172.21.15.170:6827/75773779","heartbeat_back_addr":"172.21.15.170:6831/75773779","heartbeat_front_addr":"172.21.15.170:6829/75773779","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-05T11:28:20.317 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-10-05T11:28:20.317 INFO:tasks.ceph:Creating RBD pool 2023-10-05T11:28:20.317 DEBUG:teuthology.orchestra.run.smithi012:> sudo ceph --cluster ceph osd pool create rbd 8 2023-10-05T11:28:21.278 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'rbd' created 2023-10-05T11:28:21.295 DEBUG:teuthology.orchestra.run.smithi012:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-10-05T11:28:22.290 INFO:teuthology.orchestra.run.smithi012.stderr:enabled application 'rbd' on pool 'rbd' 2023-10-05T11:28:22.305 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-10-05T11:28:22.306 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-10-05T11:28:22.306 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-10-05T11:28:22.306 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-10-05T11:28:22.307 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-10-05T11:28:22.655 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:28:22.666 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":4,"active_gid":4105,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":180516904},{"type":"v1","addr":"172.21.15.170:6833","nonce":180516904}]},"active_addr":"172.21.15.170:6833/180516904","active_change":"2023-10-05T11:28:13.814541+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4103,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.3","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.3","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.170:0","nonce":3108854799}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.170:0","nonce":1498668470}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.170:0","nonce":1301471437}]}]} 2023-10-05T11:28:22.671 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-10-05T11:28:22.671 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-10-05T11:28:22.671 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-05T11:28:22.966 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:28:22.967 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":15,"fsid":"7e015f46-293b-4b09-bd32-7d32b52f6e2f","created":"2023-10-05T11:28:09.746128+0000","modified":"2023-10-05T11:28:22.276275+0000","last_up_change":"2023-10-05T11:28:20.271709+0000","last_in_change":"2023-10-05T11:28:11.923816+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-05T11:28:20.649170+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-05T11:28:21.847603+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9415b30c-e391-4003-8e66-29b39e9138a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":396693578},{"type":"v1","addr":"172.21.15.12:6809","nonce":396693578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":396693578},{"type":"v1","addr":"172.21.15.12:6811","nonce":396693578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":396693578},{"type":"v1","addr":"172.21.15.12:6818","nonce":396693578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":396693578},{"type":"v1","addr":"172.21.15.12:6814","nonce":396693578}]},"public_addr":"172.21.15.12:6809/396693578","cluster_addr":"172.21.15.12:6811/396693578","heartbeat_back_addr":"172.21.15.12:6818/396693578","heartbeat_front_addr":"172.21.15.12:6814/396693578","state":["exists","up"]},{"osd":1,"uuid":"3b675a31-7375-4fc0-8894-79157381291b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6813","nonce":3341239609},{"type":"v1","addr":"172.21.15.12:6815","nonce":3341239609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6817","nonce":3341239609},{"type":"v1","addr":"172.21.15.12:6819","nonce":3341239609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":3341239609},{"type":"v1","addr":"172.21.15.12:6823","nonce":3341239609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":3341239609},{"type":"v1","addr":"172.21.15.12:6821","nonce":3341239609}]},"public_addr":"172.21.15.12:6815/3341239609","cluster_addr":"172.21.15.12:6819/3341239609","heartbeat_back_addr":"172.21.15.12:6823/3341239609","heartbeat_front_addr":"172.21.15.12:6821/3341239609","state":["exists","up"]},{"osd":2,"uuid":"15c64694-9fbf-46cf-a902-13d7cc9ac93f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":732466381},{"type":"v1","addr":"172.21.15.12:6801","nonce":732466381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":732466381},{"type":"v1","addr":"172.21.15.12:6803","nonce":732466381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":732466381},{"type":"v1","addr":"172.21.15.12:6807","nonce":732466381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":732466381},{"type":"v1","addr":"172.21.15.12:6805","nonce":732466381}]},"public_addr":"172.21.15.12:6801/732466381","cluster_addr":"172.21.15.12:6803/732466381","heartbeat_back_addr":"172.21.15.12:6807/732466381","heartbeat_front_addr":"172.21.15.12:6805/732466381","state":["exists","up"]},{"osd":3,"uuid":"f40c40e1-154a-4788-8821-c254425eef6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":2171933159},{"type":"v1","addr":"172.21.15.12:6825","nonce":2171933159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":2171933159},{"type":"v1","addr":"172.21.15.12:6827","nonce":2171933159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":2171933159},{"type":"v1","addr":"172.21.15.12:6831","nonce":2171933159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":2171933159},{"type":"v1","addr":"172.21.15.12:6829","nonce":2171933159}]},"public_addr":"172.21.15.12:6825/2171933159","cluster_addr":"172.21.15.12:6827/2171933159","heartbeat_back_addr":"172.21.15.12:6831/2171933159","heartbeat_front_addr":"172.21.15.12:6829/2171933159","state":["exists","up"]},{"osd":4,"uuid":"714646f6-8955-4fe4-8b9b-db840f567e86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2113414864},{"type":"v1","addr":"172.21.15.170:6809","nonce":2113414864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2113414864},{"type":"v1","addr":"172.21.15.170:6811","nonce":2113414864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6815","nonce":2113414864},{"type":"v1","addr":"172.21.15.170:6817","nonce":2113414864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2113414864},{"type":"v1","addr":"172.21.15.170:6813","nonce":2113414864}]},"public_addr":"172.21.15.170:6809/2113414864","cluster_addr":"172.21.15.170:6811/2113414864","heartbeat_back_addr":"172.21.15.170:6817/2113414864","heartbeat_front_addr":"172.21.15.170:6813/2113414864","state":["exists","up"]},{"osd":5,"uuid":"ca54baf8-781a-41eb-bae9-8f198cc3569c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":3150808418},{"type":"v1","addr":"172.21.15.170:6816","nonce":3150808418}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3150808418},{"type":"v1","addr":"172.21.15.170:6819","nonce":3150808418}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3150808418},{"type":"v1","addr":"172.21.15.170:6823","nonce":3150808418}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3150808418},{"type":"v1","addr":"172.21.15.170:6821","nonce":3150808418}]},"public_addr":"172.21.15.170:6816/3150808418","cluster_addr":"172.21.15.170:6819/3150808418","heartbeat_back_addr":"172.21.15.170:6823/3150808418","heartbeat_front_addr":"172.21.15.170:6821/3150808418","state":["exists","up"]},{"osd":6,"uuid":"fa84fa70-944c-485e-b14e-516a3ead8b43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":4137726411},{"type":"v1","addr":"172.21.15.170:6801","nonce":4137726411}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":4137726411},{"type":"v1","addr":"172.21.15.170:6803","nonce":4137726411}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":4137726411},{"type":"v1","addr":"172.21.15.170:6807","nonce":4137726411}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":4137726411},{"type":"v1","addr":"172.21.15.170:6805","nonce":4137726411}]},"public_addr":"172.21.15.170:6801/4137726411","cluster_addr":"172.21.15.170:6803/4137726411","heartbeat_back_addr":"172.21.15.170:6807/4137726411","heartbeat_front_addr":"172.21.15.170:6805/4137726411","state":["exists","up"]},{"osd":7,"uuid":"c6fe0a72-f5e7-443f-9b51-c1ceee215906","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":75773779},{"type":"v1","addr":"172.21.15.170:6825","nonce":75773779}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":75773779},{"type":"v1","addr":"172.21.15.170:6827","nonce":75773779}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":75773779},{"type":"v1","addr":"172.21.15.170:6831","nonce":75773779}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":75773779},{"type":"v1","addr":"172.21.15.170:6829","nonce":75773779}]},"public_addr":"172.21.15.170:6825/75773779","cluster_addr":"172.21.15.170:6827/75773779","heartbeat_back_addr":"172.21.15.170:6831/75773779","heartbeat_front_addr":"172.21.15.170:6829/75773779","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T11:28:17.089651+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T11:28:17.035492+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T11:28:17.044541+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T11:28:17.074476+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T11:28:17.079171+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T11:28:17.123386+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T11:28:17.039218+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T11:28:17.192218+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-05T11:28:22.979 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-10-05T11:28:22.979 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-05T11:28:23.274 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:28:23.274 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":15,"fsid":"7e015f46-293b-4b09-bd32-7d32b52f6e2f","created":"2023-10-05T11:28:09.746128+0000","modified":"2023-10-05T11:28:22.276275+0000","last_up_change":"2023-10-05T11:28:20.271709+0000","last_in_change":"2023-10-05T11:28:11.923816+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-05T11:28:20.649170+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-05T11:28:21.847603+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9415b30c-e391-4003-8e66-29b39e9138a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":396693578},{"type":"v1","addr":"172.21.15.12:6809","nonce":396693578}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":396693578},{"type":"v1","addr":"172.21.15.12:6811","nonce":396693578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":396693578},{"type":"v1","addr":"172.21.15.12:6818","nonce":396693578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":396693578},{"type":"v1","addr":"172.21.15.12:6814","nonce":396693578}]},"public_addr":"172.21.15.12:6809/396693578","cluster_addr":"172.21.15.12:6811/396693578","heartbeat_back_addr":"172.21.15.12:6818/396693578","heartbeat_front_addr":"172.21.15.12:6814/396693578","state":["exists","up"]},{"osd":1,"uuid":"3b675a31-7375-4fc0-8894-79157381291b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6813","nonce":3341239609},{"type":"v1","addr":"172.21.15.12:6815","nonce":3341239609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6817","nonce":3341239609},{"type":"v1","addr":"172.21.15.12:6819","nonce":3341239609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":3341239609},{"type":"v1","addr":"172.21.15.12:6823","nonce":3341239609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":3341239609},{"type":"v1","addr":"172.21.15.12:6821","nonce":3341239609}]},"public_addr":"172.21.15.12:6815/3341239609","cluster_addr":"172.21.15.12:6819/3341239609","heartbeat_back_addr":"172.21.15.12:6823/3341239609","heartbeat_front_addr":"172.21.15.12:6821/3341239609","state":["exists","up"]},{"osd":2,"uuid":"15c64694-9fbf-46cf-a902-13d7cc9ac93f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":732466381},{"type":"v1","addr":"172.21.15.12:6801","nonce":732466381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":732466381},{"type":"v1","addr":"172.21.15.12:6803","nonce":732466381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":732466381},{"type":"v1","addr":"172.21.15.12:6807","nonce":732466381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":732466381},{"type":"v1","addr":"172.21.15.12:6805","nonce":732466381}]},"public_addr":"172.21.15.12:6801/732466381","cluster_addr":"172.21.15.12:6803/732466381","heartbeat_back_addr":"172.21.15.12:6807/732466381","heartbeat_front_addr":"172.21.15.12:6805/732466381","state":["exists","up"]},{"osd":3,"uuid":"f40c40e1-154a-4788-8821-c254425eef6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":2171933159},{"type":"v1","addr":"172.21.15.12:6825","nonce":2171933159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6826","nonce":2171933159},{"type":"v1","addr":"172.21.15.12:6827","nonce":2171933159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":2171933159},{"type":"v1","addr":"172.21.15.12:6831","nonce":2171933159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":2171933159},{"type":"v1","addr":"172.21.15.12:6829","nonce":2171933159}]},"public_addr":"172.21.15.12:6825/2171933159","cluster_addr":"172.21.15.12:6827/2171933159","heartbeat_back_addr":"172.21.15.12:6831/2171933159","heartbeat_front_addr":"172.21.15.12:6829/2171933159","state":["exists","up"]},{"osd":4,"uuid":"714646f6-8955-4fe4-8b9b-db840f567e86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2113414864},{"type":"v1","addr":"172.21.15.170:6809","nonce":2113414864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2113414864},{"type":"v1","addr":"172.21.15.170:6811","nonce":2113414864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6815","nonce":2113414864},{"type":"v1","addr":"172.21.15.170:6817","nonce":2113414864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2113414864},{"type":"v1","addr":"172.21.15.170:6813","nonce":2113414864}]},"public_addr":"172.21.15.170:6809/2113414864","cluster_addr":"172.21.15.170:6811/2113414864","heartbeat_back_addr":"172.21.15.170:6817/2113414864","heartbeat_front_addr":"172.21.15.170:6813/2113414864","state":["exists","up"]},{"osd":5,"uuid":"ca54baf8-781a-41eb-bae9-8f198cc3569c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":3150808418},{"type":"v1","addr":"172.21.15.170:6816","nonce":3150808418}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":3150808418},{"type":"v1","addr":"172.21.15.170:6819","nonce":3150808418}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3150808418},{"type":"v1","addr":"172.21.15.170:6823","nonce":3150808418}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3150808418},{"type":"v1","addr":"172.21.15.170:6821","nonce":3150808418}]},"public_addr":"172.21.15.170:6816/3150808418","cluster_addr":"172.21.15.170:6819/3150808418","heartbeat_back_addr":"172.21.15.170:6823/3150808418","heartbeat_front_addr":"172.21.15.170:6821/3150808418","state":["exists","up"]},{"osd":6,"uuid":"fa84fa70-944c-485e-b14e-516a3ead8b43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":4137726411},{"type":"v1","addr":"172.21.15.170:6801","nonce":4137726411}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":4137726411},{"type":"v1","addr":"172.21.15.170:6803","nonce":4137726411}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":4137726411},{"type":"v1","addr":"172.21.15.170:6807","nonce":4137726411}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":4137726411},{"type":"v1","addr":"172.21.15.170:6805","nonce":4137726411}]},"public_addr":"172.21.15.170:6801/4137726411","cluster_addr":"172.21.15.170:6803/4137726411","heartbeat_back_addr":"172.21.15.170:6807/4137726411","heartbeat_front_addr":"172.21.15.170:6805/4137726411","state":["exists","up"]},{"osd":7,"uuid":"c6fe0a72-f5e7-443f-9b51-c1ceee215906","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":75773779},{"type":"v1","addr":"172.21.15.170:6825","nonce":75773779}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":75773779},{"type":"v1","addr":"172.21.15.170:6827","nonce":75773779}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":75773779},{"type":"v1","addr":"172.21.15.170:6831","nonce":75773779}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":75773779},{"type":"v1","addr":"172.21.15.170:6829","nonce":75773779}]},"public_addr":"172.21.15.170:6825/75773779","cluster_addr":"172.21.15.170:6827/75773779","heartbeat_back_addr":"172.21.15.170:6831/75773779","heartbeat_front_addr":"172.21.15.170:6829/75773779","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T11:28:17.089651+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T11:28:17.035492+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T11:28:17.044541+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T11:28:17.074476+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T11:28:17.079171+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T11:28:17.123386+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T11:28:17.039218+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-05T11:28:17.192218+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-05T11:28:23.287 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-10-05T11:28:23.287 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-10-05T11:28:23.288 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-10-05T11:28:23.288 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-10-05T11:28:23.289 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-10-05T11:28:23.289 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-10-05T11:28:23.289 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-10-05T11:28:23.290 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-10-05T11:28:23.550 INFO:teuthology.orchestra.run.smithi012.stdout:55834574851 2023-10-05T11:28:23.551 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-05T11:28:23.552 INFO:teuthology.orchestra.run.smithi012.stdout:55834574850 2023-10-05T11:28:23.552 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-10-05T11:28:23.553 INFO:teuthology.orchestra.run.smithi012.stdout:55834574851 2023-10-05T11:28:23.554 INFO:teuthology.orchestra.run.smithi012.stdout:55834574851 2023-10-05T11:28:23.554 INFO:teuthology.orchestra.run.smithi012.stdout:55834574851 2023-10-05T11:28:23.555 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-05T11:28:23.555 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-10-05T11:28:23.556 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-05T11:28:23.557 INFO:teuthology.orchestra.run.smithi012.stdout:55834574851 2023-10-05T11:28:23.558 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-10-05T11:28:23.568 INFO:teuthology.orchestra.run.smithi012.stdout:55834574851 2023-10-05T11:28:23.569 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-10-05T11:28:23.569 INFO:teuthology.orchestra.run.smithi012.stdout:55834574851 2023-10-05T11:28:23.570 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-05T11:28:24.175 INFO:teuthology.orchestra.run.smithi012.stdout:55834574850 2023-10-05T11:28:24.201 INFO:teuthology.orchestra.run.smithi012.stdout:55834574850 2023-10-05T11:28:24.211 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574851 got 55834574850 for osd.1 2023-10-05T11:28:24.218 INFO:teuthology.orchestra.run.smithi012.stdout:55834574849 2023-10-05T11:28:24.222 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574851 got 55834574850 for osd.3 2023-10-05T11:28:24.236 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574850 got 55834574849 for osd.6 2023-10-05T11:28:24.236 INFO:teuthology.orchestra.run.smithi012.stdout:55834574850 2023-10-05T11:28:24.254 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574851 got 55834574850 for osd.5 2023-10-05T11:28:24.267 INFO:teuthology.orchestra.run.smithi012.stdout:55834574850 2023-10-05T11:28:24.272 INFO:teuthology.orchestra.run.smithi012.stdout:55834574850 2023-10-05T11:28:24.282 INFO:teuthology.orchestra.run.smithi012.stdout:55834574850 2023-10-05T11:28:24.282 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574851 got 55834574850 for osd.2 2023-10-05T11:28:24.290 INFO:teuthology.orchestra.run.smithi012.stdout:55834574850 2023-10-05T11:28:24.292 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574851 got 55834574850 for osd.4 2023-10-05T11:28:24.300 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574851 got 55834574850 for osd.0 2023-10-05T11:28:24.317 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574851 got 55834574850 for osd.7 2023-10-05T11:28:25.212 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-05T11:28:25.223 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-05T11:28:25.236 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-10-05T11:28:25.255 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-10-05T11:28:25.283 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-05T11:28:25.293 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-10-05T11:28:25.300 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-05T11:28:25.318 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-10-05T11:28:25.776 INFO:teuthology.orchestra.run.smithi012.stdout:55834574851 2023-10-05T11:28:25.799 INFO:teuthology.orchestra.run.smithi012.stdout:55834574850 2023-10-05T11:28:25.802 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574851 got 55834574851 for osd.1 2023-10-05T11:28:25.803 DEBUG:teuthology.parallel:result is None 2023-10-05T11:28:25.816 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574850 got 55834574850 for osd.6 2023-10-05T11:28:25.816 DEBUG:teuthology.parallel:result is None 2023-10-05T11:28:25.838 INFO:teuthology.orchestra.run.smithi012.stdout:55834574851 2023-10-05T11:28:25.852 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574851 got 55834574851 for osd.5 2023-10-05T11:28:25.853 DEBUG:teuthology.parallel:result is None 2023-10-05T11:28:25.864 INFO:teuthology.orchestra.run.smithi012.stdout:55834574851 2023-10-05T11:28:25.881 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574851 got 55834574851 for osd.4 2023-10-05T11:28:25.881 DEBUG:teuthology.parallel:result is None 2023-10-05T11:28:25.900 INFO:teuthology.orchestra.run.smithi012.stdout:55834574851 2023-10-05T11:28:25.912 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574851 got 55834574851 for osd.3 2023-10-05T11:28:25.913 DEBUG:teuthology.parallel:result is None 2023-10-05T11:28:25.922 INFO:teuthology.orchestra.run.smithi012.stdout:55834574851 2023-10-05T11:28:25.935 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574851 got 55834574851 for osd.2 2023-10-05T11:28:25.935 DEBUG:teuthology.parallel:result is None 2023-10-05T11:28:25.967 INFO:teuthology.orchestra.run.smithi012.stdout:55834574851 2023-10-05T11:28:25.982 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574851 got 55834574851 for osd.0 2023-10-05T11:28:25.982 DEBUG:teuthology.parallel:result is None 2023-10-05T11:28:25.984 INFO:teuthology.orchestra.run.smithi012.stdout:55834574851 2023-10-05T11:28:25.997 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574851 got 55834574851 for osd.7 2023-10-05T11:28:25.997 DEBUG:teuthology.parallel:result is None 2023-10-05T11:28:25.997 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-05T11:28:25.997 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-05T11:28:26.328 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:28:26.329 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2023-10-05T11:28:26.341 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":13,"stamp":"2023-10-05T11:28:25.822507+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":233924,"kb_used_data":1112,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754740796,"statfs":{"total":773094113280,"available":772854575104,"internally_reserved":0,"allocated":1138688,"data_stored":325892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":238276153},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-05T11:28:22.292329+0000","last_change":"2023-10-05T11:28:22.291585+0000","last_active":"2023-10-05T11:28:22.292329+0000","last_peered":"2023-10-05T11:28:22.292329+0000","last_clean":"2023-10-05T11:28:22.292329+0000","last_became_active":"2023-10-05T11:28:22.291207+0000","last_became_peered":"2023-10-05T11:28:22.291207+0000","last_unstale":"2023-10-05T11:28:22.292329+0000","last_undegraded":"2023-10-05T11:28:22.292329+0000","last_fullsized":"2023-10-05T11:28:22.292329+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T11:28:21.273317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T11:28:21.273317+0000","last_clean_scrub_stamp":"2023-10-05T11:28:21.273317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T12:03:19.330515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-05T11:28:22.524143+0000","last_change":"2023-10-05T11:28:22.523287+0000","last_active":"2023-10-05T11:28:22.524143+0000","last_peered":"2023-10-05T11:28:22.524143+0000","last_clean":"2023-10-05T11:28:22.524143+0000","last_became_active":"2023-10-05T11:28:22.522932+0000","last_became_peered":"2023-10-05T11:28:22.522932+0000","last_unstale":"2023-10-05T11:28:22.524143+0000","last_undegraded":"2023-10-05T11:28:22.524143+0000","last_fullsized":"2023-10-05T11:28:22.524143+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T11:28:21.273317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T11:28:21.273317+0000","last_clean_scrub_stamp":"2023-10-05T11:28:21.273317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T16:32:13.811003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-05T11:28:22.292767+0000","last_change":"2023-10-05T11:28:22.292369+0000","last_active":"2023-10-05T11:28:22.292767+0000","last_peered":"2023-10-05T11:28:22.292767+0000","last_clean":"2023-10-05T11:28:22.292767+0000","last_became_active":"2023-10-05T11:28:22.292063+0000","last_became_peered":"2023-10-05T11:28:22.292063+0000","last_unstale":"2023-10-05T11:28:22.292767+0000","last_undegraded":"2023-10-05T11:28:22.292767+0000","last_fullsized":"2023-10-05T11:28:22.292767+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T11:28:21.273317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T11:28:21.273317+0000","last_clean_scrub_stamp":"2023-10-05T11:28:21.273317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T12:01:34.986724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-05T11:28:22.292131+0000","last_change":"2023-10-05T11:28:22.291440+0000","last_active":"2023-10-05T11:28:22.292131+0000","last_peered":"2023-10-05T11:28:22.292131+0000","last_clean":"2023-10-05T11:28:22.292131+0000","last_became_active":"2023-10-05T11:28:22.291156+0000","last_became_peered":"2023-10-05T11:28:22.291156+0000","last_unstale":"2023-10-05T11:28:22.292131+0000","last_undegraded":"2023-10-05T11:28:22.292131+0000","last_fullsized":"2023-10-05T11:28:22.292131+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T11:28:21.273317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T11:28:21.273317+0000","last_clean_scrub_stamp":"2023-10-05T11:28:21.273317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T21:34:58.529303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":3,"reported_epoch":16,"state":"creating+activating","last_fresh":"2023-10-05T11:28:23.294106+0000","last_change":"2023-10-05T11:28:23.294106+0000","last_active":"2023-10-05T11:28:22.276275+0000","last_peered":"2023-10-05T11:28:22.276275+0000","last_clean":"2023-10-05T11:28:22.276275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-05T11:28:23.294106+0000","last_undegraded":"2023-10-05T11:28:23.294106+0000","last_fullsized":"2023-10-05T11:28:23.294106+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T11:28:22.276275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T11:28:22.276275+0000","last_clean_scrub_stamp":"2023-10-05T11:28:22.276275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T17:56:30.758156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":["7","1"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-05T11:28:22.288764+0000","last_change":"2023-10-05T11:28:22.288178+0000","last_active":"2023-10-05T11:28:22.288764+0000","last_peered":"2023-10-05T11:28:22.288764+0000","last_clean":"2023-10-05T11:28:22.288764+0000","last_became_active":"2023-10-05T11:28:22.287837+0000","last_became_peered":"2023-10-05T11:28:22.287837+0000","last_unstale":"2023-10-05T11:28:22.288764+0000","last_undegraded":"2023-10-05T11:28:22.288764+0000","last_fullsized":"2023-10-05T11:28:22.288764+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T11:28:21.273317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T11:28:21.273317+0000","last_clean_scrub_stamp":"2023-10-05T11:28:21.273317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:15:50.481611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-05T11:28:23.293953+0000","last_change":"2023-10-05T11:28:22.523689+0000","last_active":"2023-10-05T11:28:23.293953+0000","last_peered":"2023-10-05T11:28:23.293953+0000","last_clean":"2023-10-05T11:28:23.293953+0000","last_became_active":"2023-10-05T11:28:22.523122+0000","last_became_peered":"2023-10-05T11:28:22.523122+0000","last_unstale":"2023-10-05T11:28:23.293953+0000","last_undegraded":"2023-10-05T11:28:23.293953+0000","last_fullsized":"2023-10-05T11:28:23.293953+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T11:28:21.273317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T11:28:21.273317+0000","last_clean_scrub_stamp":"2023-10-05T11:28:21.273317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T15:59:56.888919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-05T11:28:23.290366+0000","last_change":"2023-10-05T11:28:22.523268+0000","last_active":"2023-10-05T11:28:23.290366+0000","last_peered":"2023-10-05T11:28:23.290366+0000","last_clean":"2023-10-05T11:28:23.290366+0000","last_became_active":"2023-10-05T11:28:22.522906+0000","last_became_peered":"2023-10-05T11:28:22.522906+0000","last_unstale":"2023-10-05T11:28:23.290366+0000","last_undegraded":"2023-10-05T11:28:23.290366+0000","last_fullsized":"2023-10-05T11:28:23.290366+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T11:28:21.273317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T11:28:21.273317+0000","last_clean_scrub_stamp":"2023-10-05T11:28:21.273317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T17:58:35.579137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-05T11:28:23.293973+0000","last_change":"2023-10-05T11:28:22.523701+0000","last_active":"2023-10-05T11:28:23.293973+0000","last_peered":"2023-10-05T11:28:23.293973+0000","last_clean":"2023-10-05T11:28:23.293973+0000","last_became_active":"2023-10-05T11:28:22.523361+0000","last_became_peered":"2023-10-05T11:28:22.523361+0000","last_unstale":"2023-10-05T11:28:23.293973+0000","last_undegraded":"2023-10-05T11:28:23.293973+0000","last_fullsized":"2023-10-05T11:28:23.293973+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T11:28:21.273317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T11:28:21.273317+0000","last_clean_scrub_stamp":"2023-10-05T11:28:21.273317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T19:24:10.862953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31324,"kb_used_data":140,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340516,"statfs":{"total":96636764160,"available":96604688384,"internally_reserved":0,"allocated":143360,"data_stored":40983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1588,"internal_metadata":31914444},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":6,"up_from":13,"seq":55834574850,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31316,"kb_used_data":136,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340524,"statfs":{"total":96636764160,"available":96604696576,"internally_reserved":0,"allocated":139264,"data_stored":39997,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":5,"up_from":13,"seq":55834574851,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31324,"kb_used_data":140,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340516,"statfs":{"total":96636764160,"available":96604688384,"internally_reserved":0,"allocated":143360,"data_stored":40983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31324,"kb_used_data":140,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340516,"statfs":{"total":96636764160,"available":96604688384,"internally_reserved":0,"allocated":143360,"data_stored":40983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51900000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27160,"kb_used_data":140,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344680,"statfs":{"total":96636764160,"available":96608952320,"internally_reserved":0,"allocated":143360,"data_stored":40983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36499999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83399999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0549999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27156,"kb_used_data":136,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344684,"statfs":{"total":96636764160,"available":96608956416,"internally_reserved":0,"allocated":139264,"data_stored":39997,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":1,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27160,"kb_used_data":140,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344680,"statfs":{"total":96636764160,"available":96608952320,"internally_reserved":0,"allocated":143360,"data_stored":40983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33900000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98999999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.747}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77100000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82199999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27160,"kb_used_data":140,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344680,"statfs":{"total":96636764160,"available":96608952320,"internally_reserved":0,"allocated":143360,"data_stored":40983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-05T11:28:26.343 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-05T11:28:26.634 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:28:26.634 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2023-10-05T11:28:26.646 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":13,"stamp":"2023-10-05T11:28:25.822507+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":233924,"kb_used_data":1112,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754740796,"statfs":{"total":773094113280,"available":772854575104,"internally_reserved":0,"allocated":1138688,"data_stored":325892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":238276153},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-05T11:28:22.292329+0000","last_change":"2023-10-05T11:28:22.291585+0000","last_active":"2023-10-05T11:28:22.292329+0000","last_peered":"2023-10-05T11:28:22.292329+0000","last_clean":"2023-10-05T11:28:22.292329+0000","last_became_active":"2023-10-05T11:28:22.291207+0000","last_became_peered":"2023-10-05T11:28:22.291207+0000","last_unstale":"2023-10-05T11:28:22.292329+0000","last_undegraded":"2023-10-05T11:28:22.292329+0000","last_fullsized":"2023-10-05T11:28:22.292329+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T11:28:21.273317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T11:28:21.273317+0000","last_clean_scrub_stamp":"2023-10-05T11:28:21.273317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T12:03:19.330515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-05T11:28:22.524143+0000","last_change":"2023-10-05T11:28:22.523287+0000","last_active":"2023-10-05T11:28:22.524143+0000","last_peered":"2023-10-05T11:28:22.524143+0000","last_clean":"2023-10-05T11:28:22.524143+0000","last_became_active":"2023-10-05T11:28:22.522932+0000","last_became_peered":"2023-10-05T11:28:22.522932+0000","last_unstale":"2023-10-05T11:28:22.524143+0000","last_undegraded":"2023-10-05T11:28:22.524143+0000","last_fullsized":"2023-10-05T11:28:22.524143+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T11:28:21.273317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T11:28:21.273317+0000","last_clean_scrub_stamp":"2023-10-05T11:28:21.273317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T16:32:13.811003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-05T11:28:22.292767+0000","last_change":"2023-10-05T11:28:22.292369+0000","last_active":"2023-10-05T11:28:22.292767+0000","last_peered":"2023-10-05T11:28:22.292767+0000","last_clean":"2023-10-05T11:28:22.292767+0000","last_became_active":"2023-10-05T11:28:22.292063+0000","last_became_peered":"2023-10-05T11:28:22.292063+0000","last_unstale":"2023-10-05T11:28:22.292767+0000","last_undegraded":"2023-10-05T11:28:22.292767+0000","last_fullsized":"2023-10-05T11:28:22.292767+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T11:28:21.273317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T11:28:21.273317+0000","last_clean_scrub_stamp":"2023-10-05T11:28:21.273317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T12:01:34.986724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-05T11:28:22.292131+0000","last_change":"2023-10-05T11:28:22.291440+0000","last_active":"2023-10-05T11:28:22.292131+0000","last_peered":"2023-10-05T11:28:22.292131+0000","last_clean":"2023-10-05T11:28:22.292131+0000","last_became_active":"2023-10-05T11:28:22.291156+0000","last_became_peered":"2023-10-05T11:28:22.291156+0000","last_unstale":"2023-10-05T11:28:22.292131+0000","last_undegraded":"2023-10-05T11:28:22.292131+0000","last_fullsized":"2023-10-05T11:28:22.292131+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T11:28:21.273317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T11:28:21.273317+0000","last_clean_scrub_stamp":"2023-10-05T11:28:21.273317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T21:34:58.529303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":3,"reported_epoch":16,"state":"creating+activating","last_fresh":"2023-10-05T11:28:23.294106+0000","last_change":"2023-10-05T11:28:23.294106+0000","last_active":"2023-10-05T11:28:22.276275+0000","last_peered":"2023-10-05T11:28:22.276275+0000","last_clean":"2023-10-05T11:28:22.276275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-05T11:28:23.294106+0000","last_undegraded":"2023-10-05T11:28:23.294106+0000","last_fullsized":"2023-10-05T11:28:23.294106+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T11:28:22.276275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T11:28:22.276275+0000","last_clean_scrub_stamp":"2023-10-05T11:28:22.276275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T17:56:30.758156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":["7","1"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-05T11:28:22.288764+0000","last_change":"2023-10-05T11:28:22.288178+0000","last_active":"2023-10-05T11:28:22.288764+0000","last_peered":"2023-10-05T11:28:22.288764+0000","last_clean":"2023-10-05T11:28:22.288764+0000","last_became_active":"2023-10-05T11:28:22.287837+0000","last_became_peered":"2023-10-05T11:28:22.287837+0000","last_unstale":"2023-10-05T11:28:22.288764+0000","last_undegraded":"2023-10-05T11:28:22.288764+0000","last_fullsized":"2023-10-05T11:28:22.288764+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T11:28:21.273317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T11:28:21.273317+0000","last_clean_scrub_stamp":"2023-10-05T11:28:21.273317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:15:50.481611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-05T11:28:23.293953+0000","last_change":"2023-10-05T11:28:22.523689+0000","last_active":"2023-10-05T11:28:23.293953+0000","last_peered":"2023-10-05T11:28:23.293953+0000","last_clean":"2023-10-05T11:28:23.293953+0000","last_became_active":"2023-10-05T11:28:22.523122+0000","last_became_peered":"2023-10-05T11:28:22.523122+0000","last_unstale":"2023-10-05T11:28:23.293953+0000","last_undegraded":"2023-10-05T11:28:23.293953+0000","last_fullsized":"2023-10-05T11:28:23.293953+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T11:28:21.273317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T11:28:21.273317+0000","last_clean_scrub_stamp":"2023-10-05T11:28:21.273317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T15:59:56.888919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-05T11:28:23.290366+0000","last_change":"2023-10-05T11:28:22.523268+0000","last_active":"2023-10-05T11:28:23.290366+0000","last_peered":"2023-10-05T11:28:23.290366+0000","last_clean":"2023-10-05T11:28:23.290366+0000","last_became_active":"2023-10-05T11:28:22.522906+0000","last_became_peered":"2023-10-05T11:28:22.522906+0000","last_unstale":"2023-10-05T11:28:23.290366+0000","last_undegraded":"2023-10-05T11:28:23.290366+0000","last_fullsized":"2023-10-05T11:28:23.290366+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T11:28:21.273317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T11:28:21.273317+0000","last_clean_scrub_stamp":"2023-10-05T11:28:21.273317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T17:58:35.579137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-05T11:28:23.293973+0000","last_change":"2023-10-05T11:28:22.523701+0000","last_active":"2023-10-05T11:28:23.293973+0000","last_peered":"2023-10-05T11:28:23.293973+0000","last_clean":"2023-10-05T11:28:23.293973+0000","last_became_active":"2023-10-05T11:28:22.523361+0000","last_became_peered":"2023-10-05T11:28:22.523361+0000","last_unstale":"2023-10-05T11:28:23.293973+0000","last_undegraded":"2023-10-05T11:28:23.293973+0000","last_fullsized":"2023-10-05T11:28:23.293973+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T11:28:21.273317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T11:28:21.273317+0000","last_clean_scrub_stamp":"2023-10-05T11:28:21.273317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T19:24:10.862953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31324,"kb_used_data":140,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340516,"statfs":{"total":96636764160,"available":96604688384,"internally_reserved":0,"allocated":143360,"data_stored":40983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1588,"internal_metadata":31914444},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":6,"up_from":13,"seq":55834574850,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31316,"kb_used_data":136,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340524,"statfs":{"total":96636764160,"available":96604696576,"internally_reserved":0,"allocated":139264,"data_stored":39997,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":5,"up_from":13,"seq":55834574851,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31324,"kb_used_data":140,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340516,"statfs":{"total":96636764160,"available":96604688384,"internally_reserved":0,"allocated":143360,"data_stored":40983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31324,"kb_used_data":140,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340516,"statfs":{"total":96636764160,"available":96604688384,"internally_reserved":0,"allocated":143360,"data_stored":40983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51900000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27160,"kb_used_data":140,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344680,"statfs":{"total":96636764160,"available":96608952320,"internally_reserved":0,"allocated":143360,"data_stored":40983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36499999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83399999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0549999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27156,"kb_used_data":136,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344684,"statfs":{"total":96636764160,"available":96608956416,"internally_reserved":0,"allocated":139264,"data_stored":39997,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":1,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27160,"kb_used_data":140,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344680,"statfs":{"total":96636764160,"available":96608952320,"internally_reserved":0,"allocated":143360,"data_stored":40983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33900000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98999999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.747}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77100000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82199999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27160,"kb_used_data":140,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344680,"statfs":{"total":96636764160,"available":96608952320,"internally_reserved":0,"allocated":143360,"data_stored":40983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-05T11:28:26.648 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-05T11:28:26.942 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:28:26.942 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2023-10-05T11:28:26.954 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":13,"stamp":"2023-10-05T11:28:25.822507+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":233924,"kb_used_data":1112,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754740796,"statfs":{"total":773094113280,"available":772854575104,"internally_reserved":0,"allocated":1138688,"data_stored":325892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":238276153},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-05T11:28:22.292329+0000","last_change":"2023-10-05T11:28:22.291585+0000","last_active":"2023-10-05T11:28:22.292329+0000","last_peered":"2023-10-05T11:28:22.292329+0000","last_clean":"2023-10-05T11:28:22.292329+0000","last_became_active":"2023-10-05T11:28:22.291207+0000","last_became_peered":"2023-10-05T11:28:22.291207+0000","last_unstale":"2023-10-05T11:28:22.292329+0000","last_undegraded":"2023-10-05T11:28:22.292329+0000","last_fullsized":"2023-10-05T11:28:22.292329+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T11:28:21.273317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T11:28:21.273317+0000","last_clean_scrub_stamp":"2023-10-05T11:28:21.273317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T12:03:19.330515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-05T11:28:22.524143+0000","last_change":"2023-10-05T11:28:22.523287+0000","last_active":"2023-10-05T11:28:22.524143+0000","last_peered":"2023-10-05T11:28:22.524143+0000","last_clean":"2023-10-05T11:28:22.524143+0000","last_became_active":"2023-10-05T11:28:22.522932+0000","last_became_peered":"2023-10-05T11:28:22.522932+0000","last_unstale":"2023-10-05T11:28:22.524143+0000","last_undegraded":"2023-10-05T11:28:22.524143+0000","last_fullsized":"2023-10-05T11:28:22.524143+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T11:28:21.273317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T11:28:21.273317+0000","last_clean_scrub_stamp":"2023-10-05T11:28:21.273317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T16:32:13.811003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-05T11:28:22.292767+0000","last_change":"2023-10-05T11:28:22.292369+0000","last_active":"2023-10-05T11:28:22.292767+0000","last_peered":"2023-10-05T11:28:22.292767+0000","last_clean":"2023-10-05T11:28:22.292767+0000","last_became_active":"2023-10-05T11:28:22.292063+0000","last_became_peered":"2023-10-05T11:28:22.292063+0000","last_unstale":"2023-10-05T11:28:22.292767+0000","last_undegraded":"2023-10-05T11:28:22.292767+0000","last_fullsized":"2023-10-05T11:28:22.292767+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T11:28:21.273317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T11:28:21.273317+0000","last_clean_scrub_stamp":"2023-10-05T11:28:21.273317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T12:01:34.986724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-05T11:28:22.292131+0000","last_change":"2023-10-05T11:28:22.291440+0000","last_active":"2023-10-05T11:28:22.292131+0000","last_peered":"2023-10-05T11:28:22.292131+0000","last_clean":"2023-10-05T11:28:22.292131+0000","last_became_active":"2023-10-05T11:28:22.291156+0000","last_became_peered":"2023-10-05T11:28:22.291156+0000","last_unstale":"2023-10-05T11:28:22.292131+0000","last_undegraded":"2023-10-05T11:28:22.292131+0000","last_fullsized":"2023-10-05T11:28:22.292131+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T11:28:21.273317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T11:28:21.273317+0000","last_clean_scrub_stamp":"2023-10-05T11:28:21.273317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T21:34:58.529303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":3,"reported_epoch":16,"state":"creating+activating","last_fresh":"2023-10-05T11:28:23.294106+0000","last_change":"2023-10-05T11:28:23.294106+0000","last_active":"2023-10-05T11:28:22.276275+0000","last_peered":"2023-10-05T11:28:22.276275+0000","last_clean":"2023-10-05T11:28:22.276275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-05T11:28:23.294106+0000","last_undegraded":"2023-10-05T11:28:23.294106+0000","last_fullsized":"2023-10-05T11:28:23.294106+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T11:28:22.276275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T11:28:22.276275+0000","last_clean_scrub_stamp":"2023-10-05T11:28:22.276275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T17:56:30.758156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":["7","1"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-05T11:28:22.288764+0000","last_change":"2023-10-05T11:28:22.288178+0000","last_active":"2023-10-05T11:28:22.288764+0000","last_peered":"2023-10-05T11:28:22.288764+0000","last_clean":"2023-10-05T11:28:22.288764+0000","last_became_active":"2023-10-05T11:28:22.287837+0000","last_became_peered":"2023-10-05T11:28:22.287837+0000","last_unstale":"2023-10-05T11:28:22.288764+0000","last_undegraded":"2023-10-05T11:28:22.288764+0000","last_fullsized":"2023-10-05T11:28:22.288764+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T11:28:21.273317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T11:28:21.273317+0000","last_clean_scrub_stamp":"2023-10-05T11:28:21.273317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:15:50.481611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-05T11:28:23.293953+0000","last_change":"2023-10-05T11:28:22.523689+0000","last_active":"2023-10-05T11:28:23.293953+0000","last_peered":"2023-10-05T11:28:23.293953+0000","last_clean":"2023-10-05T11:28:23.293953+0000","last_became_active":"2023-10-05T11:28:22.523122+0000","last_became_peered":"2023-10-05T11:28:22.523122+0000","last_unstale":"2023-10-05T11:28:23.293953+0000","last_undegraded":"2023-10-05T11:28:23.293953+0000","last_fullsized":"2023-10-05T11:28:23.293953+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T11:28:21.273317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T11:28:21.273317+0000","last_clean_scrub_stamp":"2023-10-05T11:28:21.273317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T15:59:56.888919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-05T11:28:23.290366+0000","last_change":"2023-10-05T11:28:22.523268+0000","last_active":"2023-10-05T11:28:23.290366+0000","last_peered":"2023-10-05T11:28:23.290366+0000","last_clean":"2023-10-05T11:28:23.290366+0000","last_became_active":"2023-10-05T11:28:22.522906+0000","last_became_peered":"2023-10-05T11:28:22.522906+0000","last_unstale":"2023-10-05T11:28:23.290366+0000","last_undegraded":"2023-10-05T11:28:23.290366+0000","last_fullsized":"2023-10-05T11:28:23.290366+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T11:28:21.273317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T11:28:21.273317+0000","last_clean_scrub_stamp":"2023-10-05T11:28:21.273317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T17:58:35.579137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-05T11:28:23.293973+0000","last_change":"2023-10-05T11:28:22.523701+0000","last_active":"2023-10-05T11:28:23.293973+0000","last_peered":"2023-10-05T11:28:23.293973+0000","last_clean":"2023-10-05T11:28:23.293973+0000","last_became_active":"2023-10-05T11:28:22.523361+0000","last_became_peered":"2023-10-05T11:28:22.523361+0000","last_unstale":"2023-10-05T11:28:23.293973+0000","last_undegraded":"2023-10-05T11:28:23.293973+0000","last_fullsized":"2023-10-05T11:28:23.293973+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T11:28:21.273317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T11:28:21.273317+0000","last_clean_scrub_stamp":"2023-10-05T11:28:21.273317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T19:24:10.862953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31324,"kb_used_data":140,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340516,"statfs":{"total":96636764160,"available":96604688384,"internally_reserved":0,"allocated":143360,"data_stored":40983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1588,"internal_metadata":31914444},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":6,"up_from":13,"seq":55834574850,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31316,"kb_used_data":136,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340524,"statfs":{"total":96636764160,"available":96604696576,"internally_reserved":0,"allocated":139264,"data_stored":39997,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":5,"up_from":13,"seq":55834574851,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31324,"kb_used_data":140,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340516,"statfs":{"total":96636764160,"available":96604688384,"internally_reserved":0,"allocated":143360,"data_stored":40983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31324,"kb_used_data":140,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340516,"statfs":{"total":96636764160,"available":96604688384,"internally_reserved":0,"allocated":143360,"data_stored":40983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51900000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27160,"kb_used_data":140,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344680,"statfs":{"total":96636764160,"available":96608952320,"internally_reserved":0,"allocated":143360,"data_stored":40983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36499999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83399999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0549999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27156,"kb_used_data":136,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344684,"statfs":{"total":96636764160,"available":96608956416,"internally_reserved":0,"allocated":139264,"data_stored":39997,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":1,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27160,"kb_used_data":140,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344680,"statfs":{"total":96636764160,"available":96608952320,"internally_reserved":0,"allocated":143360,"data_stored":40983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33900000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98999999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.747}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77100000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82199999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27160,"kb_used_data":140,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344680,"statfs":{"total":96636764160,"available":96608952320,"internally_reserved":0,"allocated":143360,"data_stored":40983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-05T11:28:26.955 INFO:tasks.ceph.ceph_manager.ceph:PG 2.0 is not active+clean 2023-10-05T11:28:26.955 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.0', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 16, 'state': 'creating+activating', 'last_fresh': '2023-10-05T11:28:23.294106+0000', 'last_change': '2023-10-05T11:28:23.294106+0000', 'last_active': '2023-10-05T11:28:22.276275+0000', 'last_peered': '2023-10-05T11:28:22.276275+0000', 'last_clean': '2023-10-05T11:28:22.276275+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-05T11:28:23.294106+0000', 'last_undegraded': '2023-10-05T11:28:23.294106+0000', 'last_fullsized': '2023-10-05T11:28:23.294106+0000', 'mapping_epoch': 15, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 15, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-05T11:28:22.276275+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-05T11:28:22.276275+0000', 'last_clean_scrub_stamp': '2023-10-05T11:28:22.276275+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-06T17:56:30.758156+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': ['7', '1'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-05T11:28:26.956 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-05T11:28:27.315 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:28:27.315 INFO:teuthology.orchestra.run.smithi012.stdout:{"fsid":"7e015f46-293b-4b09-bd32-7d32b52f6e2f","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":17,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":17,"num_osds":8,"num_up_osds":8,"osd_up_since":1696505300,"num_in_osds":8,"osd_in_since":1696505291,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":8},{"state_name":"creating+activating","count":1}],"num_pgs":9,"num_pools":2,"num_objects":0,"data_bytes":0,"bytes_used":239538176,"bytes_avail":772854575104,"bytes_total":773094113280,"inactive_pgs_ratio":0.1111111119389534},"fsmap":{"epoch":1,"by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2023-10-05T11:28:09.747037+0000","services":{}},"progress_events":{}} 2023-10-05T11:28:27.328 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2023-10-05T11:28:27.328 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-05T11:28:27.624 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:28:27.624 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2023-10-05T11:28:27.636 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":13,"stamp":"2023-10-05T11:28:25.822507+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":233924,"kb_used_data":1112,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754740796,"statfs":{"total":773094113280,"available":772854575104,"internally_reserved":0,"allocated":1138688,"data_stored":325892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":238276153},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-05T11:28:22.292329+0000","last_change":"2023-10-05T11:28:22.291585+0000","last_active":"2023-10-05T11:28:22.292329+0000","last_peered":"2023-10-05T11:28:22.292329+0000","last_clean":"2023-10-05T11:28:22.292329+0000","last_became_active":"2023-10-05T11:28:22.291207+0000","last_became_peered":"2023-10-05T11:28:22.291207+0000","last_unstale":"2023-10-05T11:28:22.292329+0000","last_undegraded":"2023-10-05T11:28:22.292329+0000","last_fullsized":"2023-10-05T11:28:22.292329+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T11:28:21.273317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T11:28:21.273317+0000","last_clean_scrub_stamp":"2023-10-05T11:28:21.273317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T12:03:19.330515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-05T11:28:22.524143+0000","last_change":"2023-10-05T11:28:22.523287+0000","last_active":"2023-10-05T11:28:22.524143+0000","last_peered":"2023-10-05T11:28:22.524143+0000","last_clean":"2023-10-05T11:28:22.524143+0000","last_became_active":"2023-10-05T11:28:22.522932+0000","last_became_peered":"2023-10-05T11:28:22.522932+0000","last_unstale":"2023-10-05T11:28:22.524143+0000","last_undegraded":"2023-10-05T11:28:22.524143+0000","last_fullsized":"2023-10-05T11:28:22.524143+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T11:28:21.273317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T11:28:21.273317+0000","last_clean_scrub_stamp":"2023-10-05T11:28:21.273317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T16:32:13.811003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-05T11:28:22.292767+0000","last_change":"2023-10-05T11:28:22.292369+0000","last_active":"2023-10-05T11:28:22.292767+0000","last_peered":"2023-10-05T11:28:22.292767+0000","last_clean":"2023-10-05T11:28:22.292767+0000","last_became_active":"2023-10-05T11:28:22.292063+0000","last_became_peered":"2023-10-05T11:28:22.292063+0000","last_unstale":"2023-10-05T11:28:22.292767+0000","last_undegraded":"2023-10-05T11:28:22.292767+0000","last_fullsized":"2023-10-05T11:28:22.292767+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T11:28:21.273317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T11:28:21.273317+0000","last_clean_scrub_stamp":"2023-10-05T11:28:21.273317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T12:01:34.986724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-05T11:28:22.292131+0000","last_change":"2023-10-05T11:28:22.291440+0000","last_active":"2023-10-05T11:28:22.292131+0000","last_peered":"2023-10-05T11:28:22.292131+0000","last_clean":"2023-10-05T11:28:22.292131+0000","last_became_active":"2023-10-05T11:28:22.291156+0000","last_became_peered":"2023-10-05T11:28:22.291156+0000","last_unstale":"2023-10-05T11:28:22.292131+0000","last_undegraded":"2023-10-05T11:28:22.292131+0000","last_fullsized":"2023-10-05T11:28:22.292131+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T11:28:21.273317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T11:28:21.273317+0000","last_clean_scrub_stamp":"2023-10-05T11:28:21.273317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T21:34:58.529303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":3,"reported_epoch":16,"state":"creating+activating","last_fresh":"2023-10-05T11:28:23.294106+0000","last_change":"2023-10-05T11:28:23.294106+0000","last_active":"2023-10-05T11:28:22.276275+0000","last_peered":"2023-10-05T11:28:22.276275+0000","last_clean":"2023-10-05T11:28:22.276275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-05T11:28:23.294106+0000","last_undegraded":"2023-10-05T11:28:23.294106+0000","last_fullsized":"2023-10-05T11:28:23.294106+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T11:28:22.276275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T11:28:22.276275+0000","last_clean_scrub_stamp":"2023-10-05T11:28:22.276275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T17:56:30.758156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":["7","1"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-05T11:28:22.288764+0000","last_change":"2023-10-05T11:28:22.288178+0000","last_active":"2023-10-05T11:28:22.288764+0000","last_peered":"2023-10-05T11:28:22.288764+0000","last_clean":"2023-10-05T11:28:22.288764+0000","last_became_active":"2023-10-05T11:28:22.287837+0000","last_became_peered":"2023-10-05T11:28:22.287837+0000","last_unstale":"2023-10-05T11:28:22.288764+0000","last_undegraded":"2023-10-05T11:28:22.288764+0000","last_fullsized":"2023-10-05T11:28:22.288764+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T11:28:21.273317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T11:28:21.273317+0000","last_clean_scrub_stamp":"2023-10-05T11:28:21.273317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:15:50.481611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-05T11:28:23.293953+0000","last_change":"2023-10-05T11:28:22.523689+0000","last_active":"2023-10-05T11:28:23.293953+0000","last_peered":"2023-10-05T11:28:23.293953+0000","last_clean":"2023-10-05T11:28:23.293953+0000","last_became_active":"2023-10-05T11:28:22.523122+0000","last_became_peered":"2023-10-05T11:28:22.523122+0000","last_unstale":"2023-10-05T11:28:23.293953+0000","last_undegraded":"2023-10-05T11:28:23.293953+0000","last_fullsized":"2023-10-05T11:28:23.293953+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T11:28:21.273317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T11:28:21.273317+0000","last_clean_scrub_stamp":"2023-10-05T11:28:21.273317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T15:59:56.888919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-05T11:28:23.290366+0000","last_change":"2023-10-05T11:28:22.523268+0000","last_active":"2023-10-05T11:28:23.290366+0000","last_peered":"2023-10-05T11:28:23.290366+0000","last_clean":"2023-10-05T11:28:23.290366+0000","last_became_active":"2023-10-05T11:28:22.522906+0000","last_became_peered":"2023-10-05T11:28:22.522906+0000","last_unstale":"2023-10-05T11:28:23.290366+0000","last_undegraded":"2023-10-05T11:28:23.290366+0000","last_fullsized":"2023-10-05T11:28:23.290366+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T11:28:21.273317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T11:28:21.273317+0000","last_clean_scrub_stamp":"2023-10-05T11:28:21.273317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T17:58:35.579137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-05T11:28:23.293973+0000","last_change":"2023-10-05T11:28:22.523701+0000","last_active":"2023-10-05T11:28:23.293973+0000","last_peered":"2023-10-05T11:28:23.293973+0000","last_clean":"2023-10-05T11:28:23.293973+0000","last_became_active":"2023-10-05T11:28:22.523361+0000","last_became_peered":"2023-10-05T11:28:22.523361+0000","last_unstale":"2023-10-05T11:28:23.293973+0000","last_undegraded":"2023-10-05T11:28:23.293973+0000","last_fullsized":"2023-10-05T11:28:23.293973+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T11:28:21.273317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T11:28:21.273317+0000","last_clean_scrub_stamp":"2023-10-05T11:28:21.273317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T19:24:10.862953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31324,"kb_used_data":140,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340516,"statfs":{"total":96636764160,"available":96604688384,"internally_reserved":0,"allocated":143360,"data_stored":40983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1588,"internal_metadata":31914444},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":6,"up_from":13,"seq":55834574850,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31316,"kb_used_data":136,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340524,"statfs":{"total":96636764160,"available":96604696576,"internally_reserved":0,"allocated":139264,"data_stored":39997,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":5,"up_from":13,"seq":55834574851,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31324,"kb_used_data":140,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340516,"statfs":{"total":96636764160,"available":96604688384,"internally_reserved":0,"allocated":143360,"data_stored":40983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31324,"kb_used_data":140,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340516,"statfs":{"total":96636764160,"available":96604688384,"internally_reserved":0,"allocated":143360,"data_stored":40983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51900000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27160,"kb_used_data":140,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344680,"statfs":{"total":96636764160,"available":96608952320,"internally_reserved":0,"allocated":143360,"data_stored":40983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36499999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83399999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0549999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27156,"kb_used_data":136,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344684,"statfs":{"total":96636764160,"available":96608956416,"internally_reserved":0,"allocated":139264,"data_stored":39997,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":1,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27160,"kb_used_data":140,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344680,"statfs":{"total":96636764160,"available":96608952320,"internally_reserved":0,"allocated":143360,"data_stored":40983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33900000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98999999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.747}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77100000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82199999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27160,"kb_used_data":140,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344680,"statfs":{"total":96636764160,"available":96608952320,"internally_reserved":0,"allocated":143360,"data_stored":40983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-05T11:28:30.639 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-05T11:28:30.945 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:28:30.945 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2023-10-05T11:28:30.957 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":15,"stamp":"2023-10-05T11:28:29.823393+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":14,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235988,"kb_used_data":2416,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738732,"statfs":{"total":773094113280,"available":772852461568,"internally_reserved":0,"allocated":2473984,"data_stored":1578756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":238276153},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.000506"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-05T11:28:24.282420+0000","last_change":"2023-10-05T11:28:22.291585+0000","last_active":"2023-10-05T11:28:24.282420+0000","last_peered":"2023-10-05T11:28:24.282420+0000","last_clean":"2023-10-05T11:28:24.282420+0000","last_became_active":"2023-10-05T11:28:22.291207+0000","last_became_peered":"2023-10-05T11:28:22.291207+0000","last_unstale":"2023-10-05T11:28:24.282420+0000","last_undegraded":"2023-10-05T11:28:24.282420+0000","last_fullsized":"2023-10-05T11:28:24.282420+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T11:28:21.273317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T11:28:21.273317+0000","last_clean_scrub_stamp":"2023-10-05T11:28:21.273317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T19:34:58.144898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-05T11:28:24.282416+0000","last_change":"2023-10-05T11:28:22.523287+0000","last_active":"2023-10-05T11:28:24.282416+0000","last_peered":"2023-10-05T11:28:24.282416+0000","last_clean":"2023-10-05T11:28:24.282416+0000","last_became_active":"2023-10-05T11:28:22.522932+0000","last_became_peered":"2023-10-05T11:28:22.522932+0000","last_unstale":"2023-10-05T11:28:24.282416+0000","last_undegraded":"2023-10-05T11:28:24.282416+0000","last_fullsized":"2023-10-05T11:28:24.282416+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T11:28:21.273317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T11:28:21.273317+0000","last_clean_scrub_stamp":"2023-10-05T11:28:21.273317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T17:40:40.493679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-05T11:28:23.631828+0000","last_change":"2023-10-05T11:28:22.292369+0000","last_active":"2023-10-05T11:28:23.631828+0000","last_peered":"2023-10-05T11:28:23.631828+0000","last_clean":"2023-10-05T11:28:23.631828+0000","last_became_active":"2023-10-05T11:28:22.292063+0000","last_became_peered":"2023-10-05T11:28:22.292063+0000","last_unstale":"2023-10-05T11:28:23.631828+0000","last_undegraded":"2023-10-05T11:28:23.631828+0000","last_fullsized":"2023-10-05T11:28:23.631828+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T11:28:21.273317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T11:28:21.273317+0000","last_clean_scrub_stamp":"2023-10-05T11:28:21.273317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T22:59:52.100128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-05T11:28:23.632741+0000","last_change":"2023-10-05T11:28:22.291440+0000","last_active":"2023-10-05T11:28:23.632741+0000","last_peered":"2023-10-05T11:28:23.632741+0000","last_clean":"2023-10-05T11:28:23.632741+0000","last_became_active":"2023-10-05T11:28:22.291156+0000","last_became_peered":"2023-10-05T11:28:22.291156+0000","last_unstale":"2023-10-05T11:28:23.632741+0000","last_undegraded":"2023-10-05T11:28:23.632741+0000","last_fullsized":"2023-10-05T11:28:23.632741+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T11:28:21.273317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T11:28:21.273317+0000","last_clean_scrub_stamp":"2023-10-05T11:28:21.273317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T11:31:42.739514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":161,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-05T11:28:25.566015+0000","last_change":"2023-10-05T11:28:23.561266+0000","last_active":"2023-10-05T11:28:25.566015+0000","last_peered":"2023-10-05T11:28:25.566015+0000","last_clean":"2023-10-05T11:28:25.566015+0000","last_became_active":"2023-10-05T11:28:23.560256+0000","last_became_peered":"2023-10-05T11:28:23.560256+0000","last_unstale":"2023-10-05T11:28:25.566015+0000","last_undegraded":"2023-10-05T11:28:25.566015+0000","last_fullsized":"2023-10-05T11:28:25.566015+0000","mapping_epoch":15,"log_start":"17'100","ondisk_log_start":"17'100","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T11:28:22.276275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T11:28:22.276275+0000","last_clean_scrub_stamp":"2023-10-05T11:28:22.276275+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T20:15:01.587694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-05T11:28:23.558284+0000","last_change":"2023-10-05T11:28:22.288178+0000","last_active":"2023-10-05T11:28:23.558284+0000","last_peered":"2023-10-05T11:28:23.558284+0000","last_clean":"2023-10-05T11:28:23.558284+0000","last_became_active":"2023-10-05T11:28:22.287837+0000","last_became_peered":"2023-10-05T11:28:22.287837+0000","last_unstale":"2023-10-05T11:28:23.558284+0000","last_undegraded":"2023-10-05T11:28:23.558284+0000","last_fullsized":"2023-10-05T11:28:23.558284+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T11:28:21.273317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T11:28:21.273317+0000","last_clean_scrub_stamp":"2023-10-05T11:28:21.273317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T18:18:36.422111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-05T11:28:23.525192+0000","last_change":"2023-10-05T11:28:22.523689+0000","last_active":"2023-10-05T11:28:23.525192+0000","last_peered":"2023-10-05T11:28:23.525192+0000","last_clean":"2023-10-05T11:28:23.525192+0000","last_became_active":"2023-10-05T11:28:22.523122+0000","last_became_peered":"2023-10-05T11:28:22.523122+0000","last_unstale":"2023-10-05T11:28:23.525192+0000","last_undegraded":"2023-10-05T11:28:23.525192+0000","last_fullsized":"2023-10-05T11:28:23.525192+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T11:28:21.273317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T11:28:21.273317+0000","last_clean_scrub_stamp":"2023-10-05T11:28:21.273317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T15:59:56.888919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-05T11:28:23.525264+0000","last_change":"2023-10-05T11:28:22.523268+0000","last_active":"2023-10-05T11:28:23.525264+0000","last_peered":"2023-10-05T11:28:23.525264+0000","last_clean":"2023-10-05T11:28:23.525264+0000","last_became_active":"2023-10-05T11:28:22.522906+0000","last_became_peered":"2023-10-05T11:28:22.522906+0000","last_unstale":"2023-10-05T11:28:23.525264+0000","last_undegraded":"2023-10-05T11:28:23.525264+0000","last_fullsized":"2023-10-05T11:28:23.525264+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T11:28:21.273317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T11:28:21.273317+0000","last_clean_scrub_stamp":"2023-10-05T11:28:21.273317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T17:58:35.579137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-05T11:28:23.525175+0000","last_change":"2023-10-05T11:28:22.523701+0000","last_active":"2023-10-05T11:28:23.525175+0000","last_peered":"2023-10-05T11:28:23.525175+0000","last_clean":"2023-10-05T11:28:23.525175+0000","last_became_active":"2023-10-05T11:28:22.523361+0000","last_became_peered":"2023-10-05T11:28:22.523361+0000","last_unstale":"2023-10-05T11:28:23.525175+0000","last_undegraded":"2023-10-05T11:28:23.525175+0000","last_fullsized":"2023-10-05T11:28:23.525175+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-05T11:28:21.273317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-05T11:28:21.273317+0000","last_clean_scrub_stamp":"2023-10-05T11:28:21.273317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-06T19:24:10.862953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":2,"acting":2,"num_store_stats":2},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32356,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339484,"statfs":{"total":96636764160,"available":96603631616,"internally_reserved":0,"allocated":761856,"data_stored":643257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1588,"internal_metadata":31914444},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95199999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81899999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34599999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39500000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.442}]}]},{"osd":6,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31332,"kb_used_data":148,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340508,"statfs":{"total":96636764160,"available":96604680192,"internally_reserved":0,"allocated":151552,"data_stored":46123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31344,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340496,"statfs":{"total":96636764160,"available":96604667904,"internally_reserved":0,"allocated":167936,"data_stored":52889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32000000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65800000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39000000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31340,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340500,"statfs":{"total":96636764160,"available":96604672000,"internally_reserved":0,"allocated":155648,"data_stored":47109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51900000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":167936,"data_stored":52889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.376}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.87}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76900000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81100000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85499999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75900000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27172,"kb_used_data":148,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344668,"statfs":{"total":96636764160,"available":96608940032,"internally_reserved":0,"allocated":151552,"data_stored":46123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2809999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.319}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.157}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.502}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89600000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98699999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28076,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343764,"statfs":{"total":96636764160,"available":96608014336,"internally_reserved":0,"allocated":761856,"data_stored":643257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81100000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84999999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89700000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86799999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27176,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":155648,"data_stored":47109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.1379999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.948}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.827}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9059999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.0680000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8680000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-05T11:28:30.959 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-05T11:28:30.959 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-10-05T11:28:30.959 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-10-05T11:28:30.959 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-05T11:28:31.289 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:28:31.289 INFO:teuthology.orchestra.run.smithi012.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-10-05T11:28:31.301 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-10-05T11:28:31.302 INFO:teuthology.run_tasks:Running task openssl_keys... 2023-10-05T11:28:31.314 INFO:teuthology.run_tasks:Running task rgw... 2023-10-05T11:28:31.335 DEBUG:tasks.rgw:config is {'client.0': {'valgrind': ['--tool=memcheck', '--max-threads=1024']}} 2023-10-05T11:28:31.335 DEBUG:tasks.rgw:client list is dict_keys(['client.0']) 2023-10-05T11:28:31.335 INFO:tasks.rgw:Creating data pools 2023-10-05T11:28:31.335 DEBUG:tasks.rgw:Obtaining remote for client client.0 2023-10-05T11:28:31.335 DEBUG:teuthology.orchestra.run.smithi012:> sudo ceph osd erasure-code-profile set client.0 crush-failure-domain=osd k=3 m=1 name=testprofile --cluster ceph 2023-10-05T11:28:32.547 DEBUG:teuthology.orchestra.run.smithi012:> sudo ceph osd pool create default.rgw.buckets.data 64 64 erasure client.0 --cluster ceph 2023-10-05T11:28:34.544 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'default.rgw.buckets.data' created 2023-10-05T11:28:34.572 DEBUG:teuthology.orchestra.run.smithi012:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster ceph 2023-10-05T11:28:35.551 INFO:teuthology.orchestra.run.smithi012.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2023-10-05T11:28:35.599 DEBUG:teuthology.orchestra.run.smithi012:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster ceph 2023-10-05T11:28:36.570 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'default.rgw.buckets.index' created 2023-10-05T11:28:36.594 DEBUG:teuthology.orchestra.run.smithi012:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster ceph 2023-10-05T11:28:37.566 INFO:teuthology.orchestra.run.smithi012.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2023-10-05T11:28:37.697 DEBUG:tasks.rgw:Pools created 2023-10-05T11:28:37.697 INFO:tasks.rgw:Configuring compression type = random 2023-10-05T11:28:37.697 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2023-10-05T11:28:37.697 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2023-10-05T11:28:37.697 DEBUG:teuthology.orchestra.run.smithi012:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2023-10-05T11:28:37.799 INFO:teuthology.orchestra.run.smithi012.stderr:ignoring --setuser ceph since I am not root 2023-10-05T11:28:37.852 INFO:teuthology.orchestra.run.smithi012.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T11:28:37.852 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:37.809+0000 7fe46280f880 20 rados->read ofs=0 len=0 2023-10-05T11:28:39.595 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:39.592+0000 7fe46280f880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:28:39.595 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:39.592+0000 7fe46280f880 20 realm 2023-10-05T11:28:39.595 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:39.592+0000 7fe46280f880 20 rados->read ofs=0 len=0 2023-10-05T11:28:39.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:39.594+0000 7fe46280f880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:28:39.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:39.594+0000 7fe46280f880 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T11:28:39.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:39.594+0000 7fe46280f880 20 rados->read ofs=0 len=0 2023-10-05T11:28:39.598 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:39.595+0000 7fe46280f880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:28:39.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:39.597+0000 7fe46280f880 20 rados->read ofs=0 len=0 2023-10-05T11:28:39.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:39.600+0000 7fe46280f880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:28:39.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:39.600+0000 7fe46280f880 20 rados->read ofs=0 len=0 2023-10-05T11:28:39.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:39.600+0000 7fe46280f880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:28:39.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:39.600+0000 7fe46280f880 20 rados->read ofs=0 len=0 2023-10-05T11:28:39.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:39.600+0000 7fe46280f880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:28:39.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:39.600+0000 7fe46280f880 10 Creating default zonegroup 2023-10-05T11:28:39.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:39.601+0000 7fe46280f880 10 couldn't find old data placement pools config, setting up new ones for the zone 2023-10-05T11:28:39.615 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:39.612+0000 7fe45ed5d640 0 -- 172.21.15.12:0/3985275391 >> [v2:172.21.15.12:6800/732466381,v1:172.21.15.12:6801/732466381] conn(0x55a5e2edf400 msgr2=0x55a5e2481080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:28:39.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:39.615+0000 7fe46280f880 10 WARNING: driver->list_zones() returned r=-2 2023-10-05T11:28:39.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:39.615+0000 7fe46280f880 20 rados->read ofs=0 len=0 2023-10-05T11:28:39.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:39.615+0000 7fe46280f880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:28:39.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:39.618+0000 7fe46280f880 20 rados->read ofs=0 len=0 2023-10-05T11:28:39.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:39.618+0000 7fe46280f880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:28:39.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:39.618+0000 7fe46280f880 10 could not read realm id: (2) No such file or directory 2023-10-05T11:28:39.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:39.618+0000 7fe46280f880 10 WARNING: failed to set zone as default, r=-22 2023-10-05T11:28:39.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:39.618+0000 7fe46280f880 20 rados->read ofs=0 len=0 2023-10-05T11:28:39.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:39.618+0000 7fe46280f880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:28:39.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:39.621+0000 7fe46280f880 20 rados->read ofs=0 len=0 2023-10-05T11:28:39.624 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:39.621+0000 7fe46280f880 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T11:28:39.624 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:39.621+0000 7fe46280f880 20 rados->read ofs=0 len=0 2023-10-05T11:28:39.625 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:39.622+0000 7fe46280f880 20 rados_obj.operate() r=0 bl.length=420 2023-10-05T11:28:39.625 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:39.622+0000 7fe46280f880 10 Using default name default 2023-10-05T11:28:39.625 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:39.622+0000 7fe46280f880 20 rados->read ofs=0 len=0 2023-10-05T11:28:39.625 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:39.622+0000 7fe45ed5d640 0 -- 172.21.15.12:0/3985275391 >> [v2:172.21.15.170:6814/3150808418,v1:172.21.15.170:6816/3150808418] conn(0x55a5e2ff9000 msgr2=0x55a5e23eac00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:28:39.625 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:39.622+0000 7fe46280f880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:28:39.625 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:39.622+0000 7fe46280f880 20 rados->read ofs=0 len=0 2023-10-05T11:28:39.626 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:39.623+0000 7fe46280f880 20 rados_obj.operate() r=0 bl.length=874 2023-10-05T11:28:39.626 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:39.623+0000 7fe46280f880 20 zone default found 2023-10-05T11:28:39.627 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:39.623+0000 7fe46280f880 4 Realm: () 2023-10-05T11:28:39.627 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:39.623+0000 7fe46280f880 4 ZoneGroup: default (c78aa576-9d15-4e9d-b3c0-4af23a22062c) 2023-10-05T11:28:39.627 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:39.623+0000 7fe46280f880 4 Zone: default (dff27d1e-df33-400e-a68a-7ba586947c99) 2023-10-05T11:28:39.627 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:39.623+0000 7fe46280f880 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T11:28:39.627 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:39.623+0000 7fe46280f880 20 zonegroup default 2023-10-05T11:28:39.627 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:39.623+0000 7fe46280f880 20 rados->read ofs=0 len=0 2023-10-05T11:28:39.628 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:39.623+0000 7fe46280f880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:28:39.628 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:39.623+0000 7fe46280f880 20 rados->read ofs=0 len=0 2023-10-05T11:28:41.615 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:41.612+0000 7fe46280f880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:28:41.615 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:41.612+0000 7fe46280f880 20 rados->read ofs=0 len=0 2023-10-05T11:28:41.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:41.614+0000 7fe46280f880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:28:41.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:41.614+0000 7fe46280f880 20 started sync module instance, tier type = 2023-10-05T11:28:41.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:41.614+0000 7fe46280f880 20 started zone id=dff27d1e-df33-400e-a68a-7ba586947c99 (name=default) with tier type = 2023-10-05T11:28:43.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.647+0000 7fe46280f880 20 add_watcher() i=0 2023-10-05T11:28:43.650 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.647+0000 7fe46280f880 20 add_watcher() i=1 2023-10-05T11:28:43.650 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.647+0000 7fe46280f880 20 add_watcher() i=2 2023-10-05T11:28:43.650 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.647+0000 7fe46280f880 20 add_watcher() i=3 2023-10-05T11:28:43.650 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.647+0000 7fe46280f880 20 add_watcher() i=4 2023-10-05T11:28:43.650 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.647+0000 7fe46280f880 20 add_watcher() i=5 2023-10-05T11:28:43.650 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.647+0000 7fe46280f880 20 add_watcher() i=6 2023-10-05T11:28:43.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.649+0000 7fe46280f880 20 add_watcher() i=7 2023-10-05T11:28:43.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.649+0000 7fe46280f880 2 all 8 watchers are set, enabling cache 2023-10-05T11:28:43.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.650+0000 7fe46280f880 5 tl::expected, obj_version>, boost::system::error_code> logback_generations::read(const DoutPrefixProvider*, optional_yield):410: oid=data_loggenerations_metadata not found 2023-10-05T11:28:43.653 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.650+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.0 2023-10-05T11:28:43.653 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.650+0000 7fe46280f880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-10-05T11:28:43.653 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.650+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.0 does not exist 2023-10-05T11:28:43.653 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.650+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.1 2023-10-05T11:28:43.653 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.650+0000 7fe46280f880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-10-05T11:28:43.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.651+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.1 does not exist 2023-10-05T11:28:43.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.651+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.2 2023-10-05T11:28:43.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.651+0000 7fe46280f880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-10-05T11:28:43.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.651+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.2 does not exist 2023-10-05T11:28:43.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.651+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.3 2023-10-05T11:28:43.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.651+0000 7fe46280f880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-10-05T11:28:43.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.651+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.3 does not exist 2023-10-05T11:28:43.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.651+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.4 2023-10-05T11:28:43.655 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.651+0000 7fe46280f880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-10-05T11:28:43.655 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.651+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.4 does not exist 2023-10-05T11:28:43.655 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.651+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.5 2023-10-05T11:28:43.655 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.651+0000 7fe46280f880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-10-05T11:28:43.656 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.652+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.5 does not exist 2023-10-05T11:28:43.656 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.652+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.6 2023-10-05T11:28:43.656 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.652+0000 7fe46280f880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-10-05T11:28:43.656 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.652+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.6 does not exist 2023-10-05T11:28:43.656 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.652+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.7 2023-10-05T11:28:43.656 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.652+0000 7fe46280f880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-10-05T11:28:43.656 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.652+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.7 does not exist 2023-10-05T11:28:43.656 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.652+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.8 2023-10-05T11:28:43.656 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.652+0000 7fe46280f880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-10-05T11:28:43.657 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.653+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.8 does not exist 2023-10-05T11:28:43.657 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.653+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.9 2023-10-05T11:28:43.657 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.653+0000 7fe46280f880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-10-05T11:28:43.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.653+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.9 does not exist 2023-10-05T11:28:43.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.653+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.10 2023-10-05T11:28:43.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.653+0000 7fe46280f880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-10-05T11:28:43.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.653+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.10 does not exist 2023-10-05T11:28:43.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.653+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.11 2023-10-05T11:28:43.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.653+0000 7fe46280f880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-10-05T11:28:43.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.654+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.11 does not exist 2023-10-05T11:28:43.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.654+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.12 2023-10-05T11:28:43.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.654+0000 7fe46280f880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-10-05T11:28:43.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.654+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.12 does not exist 2023-10-05T11:28:43.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.654+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.13 2023-10-05T11:28:43.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.654+0000 7fe46280f880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-10-05T11:28:43.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.654+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.13 does not exist 2023-10-05T11:28:43.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.654+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.14 2023-10-05T11:28:43.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.654+0000 7fe46280f880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-10-05T11:28:43.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.655+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.14 does not exist 2023-10-05T11:28:43.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.655+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.15 2023-10-05T11:28:43.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.655+0000 7fe46280f880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-10-05T11:28:43.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.655+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.15 does not exist 2023-10-05T11:28:43.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.655+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.16 2023-10-05T11:28:43.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.655+0000 7fe46280f880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-10-05T11:28:43.661 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.655+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.16 does not exist 2023-10-05T11:28:43.661 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.655+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.17 2023-10-05T11:28:43.661 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.655+0000 7fe46280f880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-10-05T11:28:43.661 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.655+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.17 does not exist 2023-10-05T11:28:43.661 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.655+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.18 2023-10-05T11:28:43.661 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.655+0000 7fe46280f880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-10-05T11:28:43.661 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.656+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.18 does not exist 2023-10-05T11:28:43.662 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.656+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.19 2023-10-05T11:28:43.662 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.656+0000 7fe46280f880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-10-05T11:28:43.662 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.656+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.19 does not exist 2023-10-05T11:28:43.662 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.656+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.20 2023-10-05T11:28:43.662 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.656+0000 7fe46280f880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-10-05T11:28:43.662 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.656+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.20 does not exist 2023-10-05T11:28:43.662 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.656+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.21 2023-10-05T11:28:43.662 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.656+0000 7fe46280f880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-10-05T11:28:43.662 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.656+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.21 does not exist 2023-10-05T11:28:43.662 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.656+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.22 2023-10-05T11:28:43.662 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.656+0000 7fe46280f880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-10-05T11:28:43.662 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.657+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.22 does not exist 2023-10-05T11:28:43.663 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.657+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.23 2023-10-05T11:28:43.663 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.657+0000 7fe46280f880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-10-05T11:28:43.663 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.657+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.23 does not exist 2023-10-05T11:28:43.663 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.657+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.24 2023-10-05T11:28:43.663 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.657+0000 7fe46280f880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-10-05T11:28:43.663 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.657+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.24 does not exist 2023-10-05T11:28:43.663 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.657+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.25 2023-10-05T11:28:43.663 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.657+0000 7fe46280f880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-10-05T11:28:43.663 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.658+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.25 does not exist 2023-10-05T11:28:43.663 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.658+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.26 2023-10-05T11:28:43.663 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.658+0000 7fe46280f880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-10-05T11:28:43.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.658+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.26 does not exist 2023-10-05T11:28:43.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.658+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.27 2023-10-05T11:28:43.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.658+0000 7fe46280f880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-10-05T11:28:43.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.658+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.27 does not exist 2023-10-05T11:28:43.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.658+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.28 2023-10-05T11:28:43.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.658+0000 7fe46280f880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-10-05T11:28:43.666 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.659+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.28 does not exist 2023-10-05T11:28:43.666 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.659+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.29 2023-10-05T11:28:43.666 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.659+0000 7fe46280f880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-10-05T11:28:43.666 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.659+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.29 does not exist 2023-10-05T11:28:43.666 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.659+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.30 2023-10-05T11:28:43.666 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.659+0000 7fe46280f880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-10-05T11:28:43.666 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.659+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.30 does not exist 2023-10-05T11:28:43.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.659+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.31 2023-10-05T11:28:43.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.659+0000 7fe46280f880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-10-05T11:28:43.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.659+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.31 does not exist 2023-10-05T11:28:43.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.659+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.32 2023-10-05T11:28:43.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.659+0000 7fe46280f880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-10-05T11:28:43.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.660+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.32 does not exist 2023-10-05T11:28:43.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.660+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.33 2023-10-05T11:28:43.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.660+0000 7fe46280f880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-10-05T11:28:43.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.660+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.33 does not exist 2023-10-05T11:28:43.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.660+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.34 2023-10-05T11:28:43.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.660+0000 7fe46280f880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-10-05T11:28:43.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.660+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.34 does not exist 2023-10-05T11:28:43.668 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.660+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.35 2023-10-05T11:28:43.668 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.660+0000 7fe46280f880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-10-05T11:28:43.668 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.661+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.35 does not exist 2023-10-05T11:28:43.668 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.661+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.36 2023-10-05T11:28:43.668 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.661+0000 7fe46280f880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-10-05T11:28:43.668 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.661+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.36 does not exist 2023-10-05T11:28:43.668 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.661+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.37 2023-10-05T11:28:43.668 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.661+0000 7fe46280f880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-10-05T11:28:43.668 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.661+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.37 does not exist 2023-10-05T11:28:43.668 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.661+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.38 2023-10-05T11:28:43.668 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.661+0000 7fe46280f880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-10-05T11:28:43.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.661+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.38 does not exist 2023-10-05T11:28:43.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.661+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.39 2023-10-05T11:28:43.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.661+0000 7fe46280f880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-10-05T11:28:43.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.662+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.39 does not exist 2023-10-05T11:28:43.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.662+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.40 2023-10-05T11:28:43.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.662+0000 7fe46280f880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-10-05T11:28:43.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.662+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.40 does not exist 2023-10-05T11:28:43.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.662+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.41 2023-10-05T11:28:43.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.662+0000 7fe46280f880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-10-05T11:28:43.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.662+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.41 does not exist 2023-10-05T11:28:43.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.662+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.42 2023-10-05T11:28:43.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.662+0000 7fe46280f880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-10-05T11:28:43.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.663+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.42 does not exist 2023-10-05T11:28:43.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.663+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.43 2023-10-05T11:28:43.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.663+0000 7fe46280f880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-10-05T11:28:43.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.663+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.43 does not exist 2023-10-05T11:28:43.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.663+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.44 2023-10-05T11:28:43.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.663+0000 7fe46280f880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-10-05T11:28:43.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.663+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.44 does not exist 2023-10-05T11:28:43.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.663+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.45 2023-10-05T11:28:43.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.663+0000 7fe46280f880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-10-05T11:28:43.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.664+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.45 does not exist 2023-10-05T11:28:43.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.664+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.46 2023-10-05T11:28:43.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.664+0000 7fe46280f880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-10-05T11:28:43.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.664+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.46 does not exist 2023-10-05T11:28:43.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.664+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.47 2023-10-05T11:28:43.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.664+0000 7fe46280f880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-10-05T11:28:43.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.664+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.47 does not exist 2023-10-05T11:28:43.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.664+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.48 2023-10-05T11:28:43.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.664+0000 7fe46280f880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-10-05T11:28:43.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.664+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.48 does not exist 2023-10-05T11:28:43.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.664+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.49 2023-10-05T11:28:43.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.664+0000 7fe46280f880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-10-05T11:28:43.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.665+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.49 does not exist 2023-10-05T11:28:43.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.665+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.50 2023-10-05T11:28:43.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.665+0000 7fe46280f880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-10-05T11:28:43.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.665+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.50 does not exist 2023-10-05T11:28:43.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.665+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.51 2023-10-05T11:28:43.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.665+0000 7fe46280f880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-10-05T11:28:43.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.665+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.51 does not exist 2023-10-05T11:28:43.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.665+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.52 2023-10-05T11:28:43.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.665+0000 7fe46280f880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-10-05T11:28:43.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.666+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.52 does not exist 2023-10-05T11:28:43.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.666+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.53 2023-10-05T11:28:43.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.666+0000 7fe46280f880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-10-05T11:28:43.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.666+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.53 does not exist 2023-10-05T11:28:43.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.666+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.54 2023-10-05T11:28:43.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.666+0000 7fe46280f880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-10-05T11:28:43.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.666+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.54 does not exist 2023-10-05T11:28:43.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.666+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.55 2023-10-05T11:28:43.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.666+0000 7fe46280f880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-10-05T11:28:43.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.666+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.55 does not exist 2023-10-05T11:28:43.676 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.666+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.56 2023-10-05T11:28:43.676 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.666+0000 7fe46280f880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-10-05T11:28:43.676 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.667+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.56 does not exist 2023-10-05T11:28:43.676 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.667+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.57 2023-10-05T11:28:43.676 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.667+0000 7fe46280f880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-10-05T11:28:43.676 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.667+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.57 does not exist 2023-10-05T11:28:43.676 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.667+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.58 2023-10-05T11:28:43.676 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.667+0000 7fe46280f880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-10-05T11:28:43.676 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.667+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.58 does not exist 2023-10-05T11:28:43.676 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.667+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.59 2023-10-05T11:28:43.676 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.667+0000 7fe46280f880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-10-05T11:28:43.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.668+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.59 does not exist 2023-10-05T11:28:43.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.668+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.60 2023-10-05T11:28:43.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.668+0000 7fe46280f880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-10-05T11:28:43.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.668+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.60 does not exist 2023-10-05T11:28:43.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.668+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.61 2023-10-05T11:28:43.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.668+0000 7fe46280f880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-10-05T11:28:43.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.668+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.61 does not exist 2023-10-05T11:28:43.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.668+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.62 2023-10-05T11:28:43.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.668+0000 7fe46280f880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-10-05T11:28:43.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.668+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.62 does not exist 2023-10-05T11:28:43.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.668+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.63 2023-10-05T11:28:43.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.668+0000 7fe46280f880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-10-05T11:28:43.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.669+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.63 does not exist 2023-10-05T11:28:43.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.669+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.64 2023-10-05T11:28:43.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.669+0000 7fe46280f880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-10-05T11:28:43.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.669+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.64 does not exist 2023-10-05T11:28:43.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.669+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.65 2023-10-05T11:28:43.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.669+0000 7fe46280f880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-10-05T11:28:43.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.669+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.65 does not exist 2023-10-05T11:28:43.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.669+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.66 2023-10-05T11:28:43.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.669+0000 7fe46280f880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-10-05T11:28:43.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.669+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.66 does not exist 2023-10-05T11:28:43.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.669+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.67 2023-10-05T11:28:43.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.669+0000 7fe46280f880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-10-05T11:28:43.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.670+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.67 does not exist 2023-10-05T11:28:43.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.670+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.68 2023-10-05T11:28:43.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.670+0000 7fe46280f880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-10-05T11:28:43.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.670+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.68 does not exist 2023-10-05T11:28:43.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.670+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.69 2023-10-05T11:28:43.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.670+0000 7fe46280f880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-10-05T11:28:43.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.670+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.69 does not exist 2023-10-05T11:28:43.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.670+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.70 2023-10-05T11:28:43.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.670+0000 7fe46280f880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-10-05T11:28:43.683 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.670+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.70 does not exist 2023-10-05T11:28:43.683 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.670+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.71 2023-10-05T11:28:43.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.670+0000 7fe46280f880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-10-05T11:28:43.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.671+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.71 does not exist 2023-10-05T11:28:43.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.671+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.72 2023-10-05T11:28:43.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.671+0000 7fe46280f880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-10-05T11:28:43.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.671+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.72 does not exist 2023-10-05T11:28:43.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.671+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.73 2023-10-05T11:28:43.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.671+0000 7fe46280f880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-10-05T11:28:43.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.671+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.73 does not exist 2023-10-05T11:28:43.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.671+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.74 2023-10-05T11:28:43.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.671+0000 7fe46280f880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-10-05T11:28:43.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.672+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.74 does not exist 2023-10-05T11:28:43.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.672+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.75 2023-10-05T11:28:43.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.672+0000 7fe46280f880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-10-05T11:28:43.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.672+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.75 does not exist 2023-10-05T11:28:43.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.672+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.76 2023-10-05T11:28:43.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.672+0000 7fe46280f880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-10-05T11:28:43.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.672+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.76 does not exist 2023-10-05T11:28:43.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.672+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.77 2023-10-05T11:28:43.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.672+0000 7fe46280f880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-10-05T11:28:43.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.673+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.77 does not exist 2023-10-05T11:28:43.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.673+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.78 2023-10-05T11:28:43.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.673+0000 7fe46280f880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-10-05T11:28:43.686 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.673+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.78 does not exist 2023-10-05T11:28:43.686 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.673+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.79 2023-10-05T11:28:43.686 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.673+0000 7fe46280f880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-10-05T11:28:43.686 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.673+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.79 does not exist 2023-10-05T11:28:43.686 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.673+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.80 2023-10-05T11:28:43.686 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.673+0000 7fe46280f880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-10-05T11:28:43.686 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.673+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.80 does not exist 2023-10-05T11:28:43.686 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.673+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.81 2023-10-05T11:28:43.686 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.673+0000 7fe46280f880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-10-05T11:28:43.686 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.674+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.81 does not exist 2023-10-05T11:28:43.686 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.674+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.82 2023-10-05T11:28:43.686 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.674+0000 7fe46280f880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-10-05T11:28:43.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.674+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.82 does not exist 2023-10-05T11:28:43.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.674+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.83 2023-10-05T11:28:43.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.674+0000 7fe46280f880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-10-05T11:28:43.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.674+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.83 does not exist 2023-10-05T11:28:43.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.674+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.84 2023-10-05T11:28:43.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.674+0000 7fe46280f880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-10-05T11:28:43.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.674+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.84 does not exist 2023-10-05T11:28:43.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.674+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.85 2023-10-05T11:28:43.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.674+0000 7fe46280f880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-10-05T11:28:43.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.675+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.85 does not exist 2023-10-05T11:28:43.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.675+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.86 2023-10-05T11:28:43.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.675+0000 7fe46280f880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-10-05T11:28:43.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.675+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.86 does not exist 2023-10-05T11:28:43.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.675+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.87 2023-10-05T11:28:43.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.675+0000 7fe46280f880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-10-05T11:28:43.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.676+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.87 does not exist 2023-10-05T11:28:43.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.676+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.88 2023-10-05T11:28:43.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.676+0000 7fe46280f880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-10-05T11:28:43.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.676+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.88 does not exist 2023-10-05T11:28:43.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.676+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.89 2023-10-05T11:28:43.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.676+0000 7fe46280f880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-10-05T11:28:43.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.676+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.89 does not exist 2023-10-05T11:28:43.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.676+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.90 2023-10-05T11:28:43.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.676+0000 7fe46280f880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-10-05T11:28:43.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.677+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.90 does not exist 2023-10-05T11:28:43.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.677+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.91 2023-10-05T11:28:43.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.677+0000 7fe46280f880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-10-05T11:28:43.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.677+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.91 does not exist 2023-10-05T11:28:43.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.677+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.92 2023-10-05T11:28:43.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.677+0000 7fe46280f880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-10-05T11:28:43.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.677+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.92 does not exist 2023-10-05T11:28:43.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.677+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.93 2023-10-05T11:28:43.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.677+0000 7fe46280f880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-10-05T11:28:43.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.677+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.93 does not exist 2023-10-05T11:28:43.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.677+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.94 2023-10-05T11:28:43.690 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.677+0000 7fe46280f880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-10-05T11:28:43.690 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.678+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.94 does not exist 2023-10-05T11:28:43.690 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.678+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.95 2023-10-05T11:28:43.690 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.678+0000 7fe46280f880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-10-05T11:28:43.690 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.678+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.95 does not exist 2023-10-05T11:28:43.690 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.678+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.96 2023-10-05T11:28:43.690 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.678+0000 7fe46280f880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-10-05T11:28:43.690 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.678+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.96 does not exist 2023-10-05T11:28:43.690 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.678+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.97 2023-10-05T11:28:43.690 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.678+0000 7fe46280f880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-10-05T11:28:43.690 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.679+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.97 does not exist 2023-10-05T11:28:43.691 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.679+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.98 2023-10-05T11:28:43.691 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.679+0000 7fe46280f880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-10-05T11:28:43.691 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.679+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.98 does not exist 2023-10-05T11:28:43.691 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.679+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.99 2023-10-05T11:28:43.691 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.679+0000 7fe46280f880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-10-05T11:28:43.691 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.679+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.99 does not exist 2023-10-05T11:28:43.691 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.679+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.100 2023-10-05T11:28:43.691 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.679+0000 7fe46280f880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-10-05T11:28:43.691 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.679+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.100 does not exist 2023-10-05T11:28:43.691 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.679+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.101 2023-10-05T11:28:43.691 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.679+0000 7fe46280f880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-10-05T11:28:43.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.680+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.101 does not exist 2023-10-05T11:28:43.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.680+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.102 2023-10-05T11:28:43.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.680+0000 7fe46280f880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-10-05T11:28:43.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.680+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.102 does not exist 2023-10-05T11:28:43.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.680+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.103 2023-10-05T11:28:43.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.680+0000 7fe46280f880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-10-05T11:28:43.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.680+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.103 does not exist 2023-10-05T11:28:43.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.680+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.104 2023-10-05T11:28:43.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.680+0000 7fe46280f880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-10-05T11:28:43.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.680+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.104 does not exist 2023-10-05T11:28:43.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.680+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.105 2023-10-05T11:28:43.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.680+0000 7fe46280f880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-10-05T11:28:43.693 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.681+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.105 does not exist 2023-10-05T11:28:43.693 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.681+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.106 2023-10-05T11:28:43.693 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.681+0000 7fe46280f880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-10-05T11:28:43.693 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.681+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.106 does not exist 2023-10-05T11:28:43.693 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.681+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.107 2023-10-05T11:28:43.693 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.681+0000 7fe46280f880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-10-05T11:28:43.696 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.681+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.107 does not exist 2023-10-05T11:28:43.696 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.681+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.108 2023-10-05T11:28:43.696 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.681+0000 7fe46280f880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-10-05T11:28:43.696 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.681+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.108 does not exist 2023-10-05T11:28:43.696 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.681+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.109 2023-10-05T11:28:43.696 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.681+0000 7fe46280f880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-10-05T11:28:43.696 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.682+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.109 does not exist 2023-10-05T11:28:43.696 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.682+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.110 2023-10-05T11:28:43.696 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.682+0000 7fe46280f880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-10-05T11:28:43.697 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.682+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.110 does not exist 2023-10-05T11:28:43.697 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.682+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.111 2023-10-05T11:28:43.697 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.682+0000 7fe46280f880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-10-05T11:28:43.697 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.682+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.111 does not exist 2023-10-05T11:28:43.697 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.682+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.112 2023-10-05T11:28:43.697 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.682+0000 7fe46280f880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-10-05T11:28:43.697 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.682+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.112 does not exist 2023-10-05T11:28:43.697 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.682+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.113 2023-10-05T11:28:43.697 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.682+0000 7fe46280f880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-10-05T11:28:43.697 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.683+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.113 does not exist 2023-10-05T11:28:43.697 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.683+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.114 2023-10-05T11:28:43.698 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.683+0000 7fe46280f880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-10-05T11:28:43.698 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.683+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.114 does not exist 2023-10-05T11:28:43.698 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.683+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.115 2023-10-05T11:28:43.698 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.683+0000 7fe46280f880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-10-05T11:28:43.698 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.683+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.115 does not exist 2023-10-05T11:28:43.698 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.683+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.116 2023-10-05T11:28:43.698 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.683+0000 7fe46280f880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-10-05T11:28:43.698 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.684+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.116 does not exist 2023-10-05T11:28:43.698 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.684+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.117 2023-10-05T11:28:43.698 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.684+0000 7fe46280f880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-10-05T11:28:43.698 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.684+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.117 does not exist 2023-10-05T11:28:43.699 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.684+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.118 2023-10-05T11:28:43.699 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.684+0000 7fe46280f880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-10-05T11:28:43.699 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.684+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.118 does not exist 2023-10-05T11:28:43.699 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.684+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.119 2023-10-05T11:28:43.699 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.684+0000 7fe46280f880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-10-05T11:28:43.699 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.684+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.119 does not exist 2023-10-05T11:28:43.699 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.684+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.120 2023-10-05T11:28:43.699 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.684+0000 7fe46280f880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-10-05T11:28:43.699 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.685+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.120 does not exist 2023-10-05T11:28:43.699 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.685+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.121 2023-10-05T11:28:43.699 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.685+0000 7fe46280f880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-10-05T11:28:43.699 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.685+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.121 does not exist 2023-10-05T11:28:43.700 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.685+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.122 2023-10-05T11:28:43.700 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.685+0000 7fe46280f880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-10-05T11:28:43.700 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.685+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.122 does not exist 2023-10-05T11:28:43.700 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.685+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.123 2023-10-05T11:28:43.700 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.685+0000 7fe46280f880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-10-05T11:28:43.700 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.686+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.123 does not exist 2023-10-05T11:28:43.700 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.686+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.124 2023-10-05T11:28:43.700 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.686+0000 7fe46280f880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-10-05T11:28:43.700 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.686+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.124 does not exist 2023-10-05T11:28:43.700 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.686+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.125 2023-10-05T11:28:43.700 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.686+0000 7fe46280f880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-10-05T11:28:43.701 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.686+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.125 does not exist 2023-10-05T11:28:43.701 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.686+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.126 2023-10-05T11:28:43.701 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.686+0000 7fe46280f880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-10-05T11:28:43.701 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.687+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.126 does not exist 2023-10-05T11:28:43.701 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.687+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.127 2023-10-05T11:28:43.701 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.687+0000 7fe46280f880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-10-05T11:28:43.701 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.687+0000 7fe46280f880 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.127 does not exist 2023-10-05T11:28:43.701 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.687+0000 7fe46280f880 20 static int rgw::cls::fifo::FIFO::create(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, std::optional >, bool, uint64_t, uint64_t):1210 entering 2023-10-05T11:28:43.701 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.688+0000 7fe46280f880 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-10-05T11:28:43.701 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.692+0000 7fe445d2b640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:28:43.701 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.692+0000 7fe46280f880 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T11:28:43.701 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:43.692+0000 7fe46280f880 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T11:28:46.638 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:46.636+0000 7fe46280f880 10 rgw_init_ioctx warning: failed to set recovery_priority on default.rgw.meta 2023-10-05T11:28:46.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:46.636+0000 7fe46280f880 5 note: GC not initialized 2023-10-05T11:28:46.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:46.636+0000 7fe441522640 20 reqs_thread_entry: start 2023-10-05T11:28:46.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:46.636+0000 7fe46280f880 20 init_complete bucket index max shards: 11 2023-10-05T11:28:46.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:46.636+0000 7fe46280f880 20 Filter name: none 2023-10-05T11:28:46.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:46.636+0000 7fe43f51e640 20 reqs_thread_entry: start 2023-10-05T11:28:46.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:46.666+0000 7fe445d2b640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:28:46.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:46.668+0000 7fe46280f880 20 remove_watcher() i=0 2023-10-05T11:28:46.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:46.668+0000 7fe46280f880 2 removed watcher, disabling cache 2023-10-05T11:28:46.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:46.670+0000 7fe46280f880 20 remove_watcher() i=1 2023-10-05T11:28:46.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:46.671+0000 7fe46280f880 20 remove_watcher() i=2 2023-10-05T11:28:46.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:46.673+0000 7fe46280f880 20 remove_watcher() i=3 2023-10-05T11:28:46.676 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:46.674+0000 7fe46280f880 20 remove_watcher() i=4 2023-10-05T11:28:46.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:46.675+0000 7fe46280f880 20 remove_watcher() i=5 2023-10-05T11:28:46.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:46.676+0000 7fe46280f880 20 remove_watcher() i=6 2023-10-05T11:28:46.680 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:46.678+0000 7fe46280f880 20 remove_watcher() i=7 2023-10-05T11:28:46.694 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2023-10-05T11:28:46.694 DEBUG:tasks.util.rgw: json result: [] 2023-10-05T11:28:46.694 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2023-10-05T11:28:46.695 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2023-10-05T11:28:46.695 DEBUG:teuthology.orchestra.run.smithi012:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement modify --rgw-zone default --placement-id default-placement --compression random 2023-10-05T11:28:46.745 INFO:teuthology.orchestra.run.smithi012.stderr:ignoring --setuser ceph since I am not root 2023-10-05T11:28:46.745 INFO:teuthology.orchestra.run.smithi012.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T11:28:46.757 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:46.754+0000 7f6728336880 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T11:28:46.757 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:46.754+0000 7f6728336880 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T11:28:46.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:46.757+0000 7f67084af640 20 reqs_thread_entry: start 2023-10-05T11:28:46.770 INFO:teuthology.orchestra.run.smithi012.stdout:{"id":"dff27d1e-df33-400e-a68a-7ba586947c99","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":"","notif_pool":"default.rgw.log:notif"} 2023-10-05T11:28:46.770 DEBUG:tasks.util.rgw: json result: {'id': 'dff27d1e-df33-400e-a68a-7ba586947c99', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': '', 'notif_pool': 'default.rgw.log:notif'} 2023-10-05T11:28:46.771 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2023-10-05T11:28:46.771 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2023-10-05T11:28:46.771 DEBUG:teuthology.orchestra.run.smithi012:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2023-10-05T11:28:46.813 INFO:teuthology.orchestra.run.smithi012.stderr:ignoring --setuser ceph since I am not root 2023-10-05T11:28:46.813 INFO:teuthology.orchestra.run.smithi012.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T11:28:46.824 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:46.821+0000 7f006c175880 20 rados->read ofs=0 len=0 2023-10-05T11:28:46.825 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:46.823+0000 7f006c175880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:28:46.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:46.823+0000 7f006c175880 20 realm 2023-10-05T11:28:46.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:46.823+0000 7f006c175880 20 rados->read ofs=0 len=0 2023-10-05T11:28:46.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:46.823+0000 7f006c175880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:28:46.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:46.823+0000 7f006c175880 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T11:28:46.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:46.823+0000 7f006c175880 20 rados->read ofs=0 len=0 2023-10-05T11:28:46.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:46.823+0000 7f006c175880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:28:46.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:46.823+0000 7f006c175880 20 rados->read ofs=0 len=0 2023-10-05T11:28:46.827 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:46.824+0000 7f006c175880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:28:46.827 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:46.824+0000 7f006c175880 20 rados->read ofs=0 len=0 2023-10-05T11:28:46.827 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:46.825+0000 7f006c175880 20 rados_obj.operate() r=0 bl.length=890 2023-10-05T11:28:46.827 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:46.825+0000 7f006c175880 20 searching for the correct realm 2023-10-05T11:28:46.838 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:46.835+0000 7f006b122640 0 -- 172.21.15.12:0/3185585456 >> [v2:172.21.15.12:6824/2171933159,v1:172.21.15.12:6825/2171933159] conn(0x55abec62a800 msgr2=0x55abec4b7700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:28:46.839 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:46.836+0000 7f006c175880 20 RGWRados::pool_iterate: got zone_info.dff27d1e-df33-400e-a68a-7ba586947c99 2023-10-05T11:28:46.839 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:46.836+0000 7f006c175880 20 RGWRados::pool_iterate: got zonegroup_info.c78aa576-9d15-4e9d-b3c0-4af23a22062c 2023-10-05T11:28:46.839 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:46.836+0000 7f006c175880 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T11:28:46.839 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:46.836+0000 7f006c175880 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T11:28:46.839 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:46.836+0000 7f006c175880 20 rados->read ofs=0 len=0 2023-10-05T11:28:46.839 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:46.836+0000 7f006c175880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:28:46.839 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:46.836+0000 7f006c175880 20 rados->read ofs=0 len=0 2023-10-05T11:28:46.839 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:46.836+0000 7f006c175880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:28:46.839 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:46.836+0000 7f006c175880 20 rados->read ofs=0 len=0 2023-10-05T11:28:46.840 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:46.836+0000 7f006c175880 20 rados_obj.operate() r=0 bl.length=420 2023-10-05T11:28:46.840 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:46.837+0000 7f006c175880 20 zone default found 2023-10-05T11:28:46.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:46.837+0000 7f006c175880 4 Realm: () 2023-10-05T11:28:46.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:46.837+0000 7f006c175880 4 ZoneGroup: default (c78aa576-9d15-4e9d-b3c0-4af23a22062c) 2023-10-05T11:28:46.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:46.837+0000 7f006c175880 4 Zone: default (dff27d1e-df33-400e-a68a-7ba586947c99) 2023-10-05T11:28:46.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:46.837+0000 7f006c175880 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T11:28:46.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:46.837+0000 7f006c175880 20 zonegroup default 2023-10-05T11:28:46.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:46.837+0000 7f006c175880 20 rados->read ofs=0 len=0 2023-10-05T11:28:46.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:46.837+0000 7f006c175880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:28:46.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:46.837+0000 7f006c175880 20 rados->read ofs=0 len=0 2023-10-05T11:28:46.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:46.837+0000 7f006c175880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:28:46.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:46.837+0000 7f006c175880 20 rados->read ofs=0 len=0 2023-10-05T11:28:46.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:46.837+0000 7f006c175880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:28:46.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:46.837+0000 7f006c175880 20 started sync module instance, tier type = 2023-10-05T11:28:46.842 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:46.837+0000 7f006c175880 20 started zone id=dff27d1e-df33-400e-a68a-7ba586947c99 (name=default) with tier type = 2023-10-05T11:28:46.847 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:46.845+0000 7f006b122640 0 -- 172.21.15.12:0/3185585456 >> [v2:172.21.15.170:6800/4137726411,v1:172.21.15.170:6801/4137726411] conn(0x55abec62bc00 msgr2=0x55abec54d600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:28:46.850 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:46.847+0000 7f006c175880 20 add_watcher() i=0 2023-10-05T11:28:46.850 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:46.847+0000 7f006c175880 20 add_watcher() i=1 2023-10-05T11:28:46.850 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:46.847+0000 7f006c175880 20 add_watcher() i=2 2023-10-05T11:28:46.850 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:46.847+0000 7f006c175880 20 add_watcher() i=3 2023-10-05T11:28:46.850 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:46.847+0000 7f006c175880 20 add_watcher() i=4 2023-10-05T11:28:46.851 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:46.847+0000 7f006c175880 20 add_watcher() i=5 2023-10-05T11:28:46.851 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:46.847+0000 7f006c175880 20 add_watcher() i=6 2023-10-05T11:28:46.851 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:46.848+0000 7f006c175880 20 add_watcher() i=7 2023-10-05T11:28:46.851 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:46.848+0000 7f006c175880 2 all 8 watchers are set, enabling cache 2023-10-05T11:28:46.853 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:46.850+0000 7f00518ef640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:28:46.853 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:46.850+0000 7f006c175880 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T11:28:46.853 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:46.850+0000 7f006c175880 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T11:28:46.858 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:46.855+0000 7f006c175880 5 note: GC not initialized 2023-10-05T11:28:46.858 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:46.855+0000 7f004d0e6640 20 reqs_thread_entry: start 2023-10-05T11:28:46.858 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:46.855+0000 7f006c175880 20 init_complete bucket index max shards: 11 2023-10-05T11:28:46.858 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:46.855+0000 7f006c175880 20 Filter name: none 2023-10-05T11:28:46.858 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:46.855+0000 7f004b0e2640 20 reqs_thread_entry: start 2023-10-05T11:28:46.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:46.865+0000 7f00518ef640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:28:46.869 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:46.867+0000 7f006c175880 20 remove_watcher() i=0 2023-10-05T11:28:46.869 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:46.867+0000 7f006c175880 2 removed watcher, disabling cache 2023-10-05T11:28:46.870 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:46.868+0000 7f006c175880 20 remove_watcher() i=1 2023-10-05T11:28:46.871 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:46.869+0000 7f006c175880 20 remove_watcher() i=2 2023-10-05T11:28:46.872 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:46.870+0000 7f006c175880 20 remove_watcher() i=3 2023-10-05T11:28:46.874 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:46.871+0000 7f006c175880 20 remove_watcher() i=4 2023-10-05T11:28:46.875 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:46.872+0000 7f006c175880 20 remove_watcher() i=5 2023-10-05T11:28:46.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:46.874+0000 7f006c175880 20 remove_watcher() i=6 2023-10-05T11:28:46.878 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:46.876+0000 7f006c175880 20 remove_watcher() i=7 2023-10-05T11:28:46.883 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2023-10-05T11:28:46.883 DEBUG:tasks.util.rgw: json result: [] 2023-10-05T11:28:46.883 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--placement-inline-data', 'false'] 2023-10-05T11:28:46.883 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--placement-inline-data', 'false'] 2023-10-05T11:28:46.884 DEBUG:teuthology.orchestra.run.smithi012:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement modify --rgw-zone default --placement-id default-placement --placement-inline-data false 2023-10-05T11:28:46.974 INFO:teuthology.orchestra.run.smithi012.stderr:ignoring --setuser ceph since I am not root 2023-10-05T11:28:46.974 INFO:teuthology.orchestra.run.smithi012.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T11:28:46.984 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:46.981+0000 7fd952067880 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T11:28:46.984 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:46.981+0000 7fd952067880 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T11:28:46.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:46.985+0000 7fd933fd3640 20 reqs_thread_entry: start 2023-10-05T11:28:46.997 INFO:teuthology.orchestra.run.smithi012.stdout:{"id":"dff27d1e-df33-400e-a68a-7ba586947c99","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":"","notif_pool":"default.rgw.log:notif"} 2023-10-05T11:28:46.998 DEBUG:tasks.util.rgw: json result: {'id': 'dff27d1e-df33-400e-a68a-7ba586947c99', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': '', 'notif_pool': 'default.rgw.log:notif'} 2023-10-05T11:28:46.998 INFO:tasks.rgw:Preparing directory for rgw datacache at /tmp/rgw_datacache 2023-10-05T11:28:46.998 DEBUG:teuthology.orchestra.run.smithi012:> mkdir -p /tmp/rgw_datacache 2023-10-05T11:28:47.013 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod a+rwx /tmp/rgw_datacache 2023-10-05T11:28:47.084 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2023-10-05T11:28:47.084 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2023-10-05T11:28:47.084 DEBUG:teuthology.orchestra.run.smithi012:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2023-10-05T11:28:47.166 INFO:teuthology.orchestra.run.smithi012.stderr:ignoring --setuser ceph since I am not root 2023-10-05T11:28:47.166 INFO:teuthology.orchestra.run.smithi012.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T11:28:47.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:47.174+0000 7f6a7de24880 20 rados->read ofs=0 len=0 2023-10-05T11:28:47.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:47.175+0000 7f6a7de24880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:28:47.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:47.175+0000 7f6a7de24880 20 realm 2023-10-05T11:28:47.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:47.175+0000 7f6a7de24880 20 rados->read ofs=0 len=0 2023-10-05T11:28:47.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:47.175+0000 7f6a7de24880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:28:47.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:47.175+0000 7f6a7de24880 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T11:28:47.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:47.175+0000 7f6a7de24880 20 rados->read ofs=0 len=0 2023-10-05T11:28:47.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:47.175+0000 7f6a7de24880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:28:47.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:47.175+0000 7f6a7de24880 20 rados->read ofs=0 len=0 2023-10-05T11:28:47.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:47.176+0000 7f6a7de24880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:28:47.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:47.176+0000 7f6a7de24880 20 rados->read ofs=0 len=0 2023-10-05T11:28:47.180 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:47.177+0000 7f6a7de24880 20 rados_obj.operate() r=0 bl.length=890 2023-10-05T11:28:47.180 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:47.177+0000 7f6a7de24880 20 searching for the correct realm 2023-10-05T11:28:47.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:47.187+0000 7f6a7cdd1640 0 -- 172.21.15.12:0/4085525069 >> [v2:172.21.15.12:6824/2171933159,v1:172.21.15.12:6825/2171933159] conn(0x56395e3e0800 msgr2=0x56395e281700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:28:47.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:47.188+0000 7f6a7de24880 20 RGWRados::pool_iterate: got zone_info.dff27d1e-df33-400e-a68a-7ba586947c99 2023-10-05T11:28:47.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:47.188+0000 7f6a7de24880 20 RGWRados::pool_iterate: got zonegroup_info.c78aa576-9d15-4e9d-b3c0-4af23a22062c 2023-10-05T11:28:47.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:47.188+0000 7f6a7de24880 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T11:28:47.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:47.188+0000 7f6a7de24880 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T11:28:47.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:47.188+0000 7f6a7de24880 20 rados->read ofs=0 len=0 2023-10-05T11:28:47.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:47.188+0000 7f6a7de24880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:28:47.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:47.188+0000 7f6a7de24880 20 rados->read ofs=0 len=0 2023-10-05T11:28:47.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:47.189+0000 7f6a7de24880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:28:47.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:47.189+0000 7f6a7de24880 20 rados->read ofs=0 len=0 2023-10-05T11:28:47.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:47.189+0000 7f6a7de24880 20 rados_obj.operate() r=0 bl.length=420 2023-10-05T11:28:47.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:47.189+0000 7f6a7de24880 20 zone default found 2023-10-05T11:28:47.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:47.189+0000 7f6a7de24880 4 Realm: () 2023-10-05T11:28:47.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:47.189+0000 7f6a7de24880 4 ZoneGroup: default (c78aa576-9d15-4e9d-b3c0-4af23a22062c) 2023-10-05T11:28:47.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:47.189+0000 7f6a7de24880 4 Zone: default (dff27d1e-df33-400e-a68a-7ba586947c99) 2023-10-05T11:28:47.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:47.189+0000 7f6a7de24880 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T11:28:47.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:47.189+0000 7f6a7de24880 20 zonegroup default 2023-10-05T11:28:47.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:47.189+0000 7f6a7de24880 20 rados->read ofs=0 len=0 2023-10-05T11:28:47.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:47.190+0000 7f6a7de24880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:28:47.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:47.190+0000 7f6a7de24880 20 rados->read ofs=0 len=0 2023-10-05T11:28:47.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:47.190+0000 7f6a7de24880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:28:47.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:47.190+0000 7f6a7de24880 20 rados->read ofs=0 len=0 2023-10-05T11:28:47.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:47.190+0000 7f6a7de24880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:28:47.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:47.190+0000 7f6a7de24880 20 started sync module instance, tier type = 2023-10-05T11:28:47.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:47.190+0000 7f6a7de24880 20 started zone id=dff27d1e-df33-400e-a68a-7ba586947c99 (name=default) with tier type = 2023-10-05T11:28:47.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:47.200+0000 7f6a7cdd1640 0 -- 172.21.15.12:0/4085525069 >> [v2:172.21.15.12:6824/2171933159,v1:172.21.15.12:6825/2171933159] conn(0x56395e409000 msgr2=0x56395e30c100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:28:47.206 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:47.203+0000 7f6a7de24880 20 add_watcher() i=0 2023-10-05T11:28:47.206 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:47.203+0000 7f6a7de24880 20 add_watcher() i=1 2023-10-05T11:28:47.206 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:47.203+0000 7f6a7de24880 20 add_watcher() i=2 2023-10-05T11:28:47.206 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:47.203+0000 7f6a7de24880 20 add_watcher() i=3 2023-10-05T11:28:47.206 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:47.203+0000 7f6a7de24880 20 add_watcher() i=4 2023-10-05T11:28:47.206 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:47.203+0000 7f6a7de24880 20 add_watcher() i=5 2023-10-05T11:28:47.209 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:47.206+0000 7f6a7de24880 20 add_watcher() i=6 2023-10-05T11:28:47.209 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:47.206+0000 7f6a7de24880 20 add_watcher() i=7 2023-10-05T11:28:47.209 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:47.206+0000 7f6a7de24880 2 all 8 watchers are set, enabling cache 2023-10-05T11:28:47.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:47.208+0000 7f6a6359e640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:28:47.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:47.208+0000 7f6a7de24880 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T11:28:47.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:47.208+0000 7f6a7de24880 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T11:28:47.216 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:47.213+0000 7f6a7de24880 5 note: GC not initialized 2023-10-05T11:28:47.216 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:47.213+0000 7f6a5ed95640 20 reqs_thread_entry: start 2023-10-05T11:28:47.216 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:47.213+0000 7f6a7de24880 20 init_complete bucket index max shards: 11 2023-10-05T11:28:47.216 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:47.213+0000 7f6a7de24880 20 Filter name: none 2023-10-05T11:28:47.216 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:47.213+0000 7f6a5cd91640 20 reqs_thread_entry: start 2023-10-05T11:28:47.226 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:47.223+0000 7f6a6359e640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:28:47.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:47.226+0000 7f6a7de24880 20 remove_watcher() i=0 2023-10-05T11:28:47.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:47.226+0000 7f6a7de24880 2 removed watcher, disabling cache 2023-10-05T11:28:47.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:47.227+0000 7f6a7de24880 20 remove_watcher() i=1 2023-10-05T11:28:47.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:47.228+0000 7f6a7de24880 20 remove_watcher() i=2 2023-10-05T11:28:47.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:47.230+0000 7f6a7de24880 20 remove_watcher() i=3 2023-10-05T11:28:47.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:47.231+0000 7f6a7de24880 20 remove_watcher() i=4 2023-10-05T11:28:47.234 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:47.232+0000 7f6a7de24880 20 remove_watcher() i=5 2023-10-05T11:28:47.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:47.233+0000 7f6a7de24880 20 remove_watcher() i=6 2023-10-05T11:28:47.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:47.234+0000 7f6a7de24880 20 remove_watcher() i=7 2023-10-05T11:28:47.241 INFO:teuthology.orchestra.run.smithi012.stdout:[] 2023-10-05T11:28:47.242 DEBUG:tasks.util.rgw: json result: [] 2023-10-05T11:28:47.242 INFO:tasks.rgw:Configuring storage class type = LUKEWARM 2023-10-05T11:28:47.242 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM'] 2023-10-05T11:28:47.242 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM'] 2023-10-05T11:28:47.242 DEBUG:teuthology.orchestra.run.smithi012:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup placement add --rgw-zone default --placement-id default-placement --storage-class LUKEWARM 2023-10-05T11:28:47.330 INFO:teuthology.orchestra.run.smithi012.stderr:ignoring --setuser ceph since I am not root 2023-10-05T11:28:47.331 INFO:teuthology.orchestra.run.smithi012.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T11:28:47.341 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:47.338+0000 7f5ae8f2e880 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T11:28:47.341 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:47.338+0000 7f5ae8f2e880 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T11:28:47.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:47.341+0000 7f5ac9020640 20 reqs_thread_entry: start 2023-10-05T11:28:47.352 INFO:teuthology.orchestra.run.smithi012.stdout:[{"key":"default-placement","val":{"name":"default-placement","tags":[],"storage_classes":["LUKEWARM","STANDARD"]}}] 2023-10-05T11:28:47.353 DEBUG:tasks.util.rgw: json result: [{'key': 'default-placement', 'val': {'name': 'default-placement', 'tags': [], 'storage_classes': ['LUKEWARM', 'STANDARD']}}] 2023-10-05T11:28:47.353 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM', '--data-pool', 'default.rgw.buckets.data.lukewarm'] 2023-10-05T11:28:47.353 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM', '--data-pool', 'default.rgw.buckets.data.lukewarm'] 2023-10-05T11:28:47.353 DEBUG:teuthology.orchestra.run.smithi012:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement add --rgw-zone default --placement-id default-placement --storage-class LUKEWARM --data-pool default.rgw.buckets.data.lukewarm 2023-10-05T11:28:47.405 INFO:teuthology.orchestra.run.smithi012.stderr:ignoring --setuser ceph since I am not root 2023-10-05T11:28:47.405 INFO:teuthology.orchestra.run.smithi012.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T11:28:47.415 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:47.413+0000 7f45f5c0a880 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T11:28:47.415 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:47.413+0000 7f45f5c0a880 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T11:28:47.418 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:47.416+0000 7f45d7b76640 20 reqs_thread_entry: start 2023-10-05T11:28:47.429 INFO:teuthology.orchestra.run.smithi012.stdout:{"id":"dff27d1e-df33-400e-a68a-7ba586947c99","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"LUKEWARM":{"data_pool":"default.rgw.buckets.data.lukewarm"},"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":"","notif_pool":"default.rgw.log:notif"} 2023-10-05T11:28:47.429 DEBUG:tasks.util.rgw: json result: {'id': 'dff27d1e-df33-400e-a68a-7ba586947c99', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'LUKEWARM': {'data_pool': 'default.rgw.buckets.data.lukewarm'}, 'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': '', 'notif_pool': 'default.rgw.log:notif'} 2023-10-05T11:28:47.429 INFO:tasks.rgw:Configuring storage class type = FROZEN 2023-10-05T11:28:47.429 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN'] 2023-10-05T11:28:47.429 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN'] 2023-10-05T11:28:47.429 DEBUG:teuthology.orchestra.run.smithi012:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup placement add --rgw-zone default --placement-id default-placement --storage-class FROZEN 2023-10-05T11:28:47.478 INFO:teuthology.orchestra.run.smithi012.stderr:ignoring --setuser ceph since I am not root 2023-10-05T11:28:47.478 INFO:teuthology.orchestra.run.smithi012.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T11:28:47.489 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:47.486+0000 7f4cee920880 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T11:28:47.489 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:47.486+0000 7f4cee920880 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T11:28:47.492 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:47.489+0000 7f4cce988640 20 reqs_thread_entry: start 2023-10-05T11:28:47.500 INFO:teuthology.orchestra.run.smithi012.stdout:[{"key":"default-placement","val":{"name":"default-placement","tags":[],"storage_classes":["FROZEN","LUKEWARM","STANDARD"]}}] 2023-10-05T11:28:47.500 DEBUG:tasks.util.rgw: json result: [{'key': 'default-placement', 'val': {'name': 'default-placement', 'tags': [], 'storage_classes': ['FROZEN', 'LUKEWARM', 'STANDARD']}}] 2023-10-05T11:28:47.501 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN', '--data-pool', 'default.rgw.buckets.data.frozen'] 2023-10-05T11:28:47.501 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN', '--data-pool', 'default.rgw.buckets.data.frozen'] 2023-10-05T11:28:47.501 DEBUG:teuthology.orchestra.run.smithi012:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement add --rgw-zone default --placement-id default-placement --storage-class FROZEN --data-pool default.rgw.buckets.data.frozen 2023-10-05T11:28:47.550 INFO:teuthology.orchestra.run.smithi012.stderr:ignoring --setuser ceph since I am not root 2023-10-05T11:28:47.550 INFO:teuthology.orchestra.run.smithi012.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T11:28:47.560 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:47.558+0000 7fc13ed2a880 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T11:28:47.560 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:47.558+0000 7fc13ed2a880 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T11:28:47.564 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:28:47.561+0000 7fc11ede3640 20 reqs_thread_entry: start 2023-10-05T11:28:47.573 INFO:teuthology.orchestra.run.smithi012.stdout:{"id":"dff27d1e-df33-400e-a68a-7ba586947c99","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"FROZEN":{"data_pool":"default.rgw.buckets.data.frozen"},"LUKEWARM":{"data_pool":"default.rgw.buckets.data.lukewarm"},"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":"","notif_pool":"default.rgw.log:notif"} 2023-10-05T11:28:47.574 DEBUG:tasks.util.rgw: json result: {'id': 'dff27d1e-df33-400e-a68a-7ba586947c99', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'FROZEN': {'data_pool': 'default.rgw.buckets.data.frozen'}, 'LUKEWARM': {'data_pool': 'default.rgw.buckets.data.lukewarm'}, 'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': '', 'notif_pool': 'default.rgw.log:notif'} 2023-10-05T11:28:47.574 INFO:tasks.rgw:Starting rgw... 2023-10-05T11:28:47.574 INFO:tasks.rgw:rgw client.0 config is {'valgrind': ['--tool=memcheck', '--max-threads=1024']} 2023-10-05T11:28:47.575 INFO:tasks.rgw:Using beast as radosgw frontend 2023-10-05T11:28:47.575 DEBUG:tasks.ceph_manager:running ceph.client.0 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/ceph.client.0.log', '--time-stamp=yes', '--vgdb=yes', '--tool=memcheck', '--max-threads=1024'] 2023-10-05T11:28:47.575 INFO:tasks.rgw.client.0:Restarting daemon 2023-10-05T11:28:47.575 DEBUG:teuthology.orchestra.run.smithi012:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/ceph.client.0.log --time-stamp=yes --vgdb=yes --tool=memcheck --max-threads=1024 radosgw --rgw-frontends 'beast port=80' -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.ceph.client.0.stdout 2>&1 2023-10-05T11:28:47.578 INFO:tasks.rgw.client.0:Started 2023-10-05T11:28:47.578 INFO:tasks.rgw:Polling client.0 until it starts accepting connections on http://smithi012.front.sepia.ceph.com:80/ 2023-10-05T11:28:47.578 DEBUG:teuthology.orchestra.run.smithi012:> curl http://smithi012.front.sepia.ceph.com:80/ 2023-10-05T11:28:47.601 DEBUG:teuthology.orchestra.run:got remote process result: 7 2023-10-05T11:28:47.602 INFO:teuthology.orchestra.run.smithi012.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2023-10-05T11:28:47.602 INFO:teuthology.orchestra.run.smithi012.stderr: Dload Upload Total Spent Left Speed 2023-10-05T11:28:47.602 INFO:teuthology.orchestra.run.smithi012.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2023-10-05T11:28:47.602 INFO:teuthology.orchestra.run.smithi012.stderr:curl: (7) Failed to connect to smithi012.front.sepia.ceph.com port 80: Connection refused 2023-10-05T11:28:48.603 DEBUG:teuthology.orchestra.run.smithi012:> curl http://smithi012.front.sepia.ceph.com:80/ 2023-10-05T11:28:48.622 INFO:teuthology.orchestra.run.smithi012.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2023-10-05T11:28:48.622 INFO:teuthology.orchestra.run.smithi012.stderr: Dload Upload Total Spent Left Speed 2023-10-05T11:28:48.624 DEBUG:teuthology.orchestra.run:got remote process result: 7 2023-10-05T11:28:48.624 INFO:teuthology.orchestra.run.smithi012.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2023-10-05T11:28:48.624 INFO:teuthology.orchestra.run.smithi012.stderr:curl: (7) Failed to connect to smithi012.front.sepia.ceph.com port 80: Connection refused 2023-10-05T11:28:50.626 DEBUG:teuthology.orchestra.run.smithi012:> curl http://smithi012.front.sepia.ceph.com:80/ 2023-10-05T11:28:50.645 INFO:teuthology.orchestra.run.smithi012.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2023-10-05T11:28:50.645 INFO:teuthology.orchestra.run.smithi012.stderr: Dload Upload Total Spent Left Speed 2023-10-05T11:28:50.645 INFO:teuthology.orchestra.run.smithi012.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2023-10-05T11:28:50.646 DEBUG:teuthology.orchestra.run:got remote process result: 7 2023-10-05T11:28:50.646 INFO:teuthology.orchestra.run.smithi012.stderr:curl: (7) Failed to connect to smithi012.front.sepia.ceph.com port 80: Connection refused 2023-10-05T11:28:54.647 DEBUG:teuthology.orchestra.run.smithi012:> curl http://smithi012.front.sepia.ceph.com:80/ 2023-10-05T11:28:54.667 INFO:teuthology.orchestra.run.smithi012.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2023-10-05T11:28:54.667 INFO:teuthology.orchestra.run.smithi012.stderr: Dload Upload Total Spent Left Speed 2023-10-05T11:28:54.668 DEBUG:teuthology.orchestra.run:got remote process result: 7 2023-10-05T11:28:54.669 INFO:teuthology.orchestra.run.smithi012.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2023-10-05T11:28:54.669 INFO:teuthology.orchestra.run.smithi012.stderr:curl: (7) Failed to connect to smithi012.front.sepia.ceph.com port 80: Connection refused 2023-10-05T11:29:02.670 DEBUG:teuthology.orchestra.run.smithi012:> curl http://smithi012.front.sepia.ceph.com:80/ 2023-10-05T11:29:02.688 INFO:teuthology.orchestra.run.smithi012.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2023-10-05T11:29:02.689 INFO:teuthology.orchestra.run.smithi012.stderr: Dload Upload Total Spent Left Speed 2023-10-05T11:29:11.410 INFO:teuthology.orchestra.run.smithi012.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- 0:00:01 --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- 0:00:02 --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- 0:00:03 --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- 0:00:04 --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- 0:00:05 --:--:-- 0 100 38 0 38 0 0 5 0 --:--:-- 0:00:06 --:--:-- 6 100 38 0 38 0 0 4 0 --:--:-- 0:00:07 --:--:-- 6 100 179 0 179 0 0 20 0 --:--:-- 0:00:08 --:--:-- 33 100 214 0 214 0 0 24 0 --:--:-- 0:00:08 --:--:-- 47 2023-10-05T11:29:11.411 INFO:teuthology.orchestra.run.smithi012.stdout:anonymous 2023-10-05T11:29:11.411 INFO:teuthology.run_tasks:Running task tox... 2023-10-05T11:29:11.422 INFO:tasks.tox:Deploying tox from pip... 2023-10-05T11:29:11.423 DEBUG:teuthology.orchestra.run.smithi012:> python3 -m venv /home/ubuntu/cephtest/tox-venv 2023-10-05T11:29:13.945 DEBUG:teuthology.orchestra.run.smithi012:> source /home/ubuntu/cephtest/tox-venv/bin/activate && pip install tox==3.15.0 2023-10-05T11:29:14.512 INFO:teuthology.orchestra.run.smithi012.stdout:Collecting tox==3.15.0 2023-10-05T11:29:14.624 INFO:teuthology.orchestra.run.smithi012.stdout: Downloading tox-3.15.0-py2.py3-none-any.whl (82 kB) 2023-10-05T11:29:14.812 INFO:teuthology.orchestra.run.smithi012.stdout:Collecting py<2,>=1.4.17 2023-10-05T11:29:14.848 INFO:teuthology.orchestra.run.smithi012.stdout: Downloading py-1.11.0-py2.py3-none-any.whl (98 kB) 2023-10-05T11:29:14.963 INFO:teuthology.orchestra.run.smithi012.stdout:Collecting pluggy<1,>=0.12.0 2023-10-05T11:29:14.996 INFO:teuthology.orchestra.run.smithi012.stdout: Downloading pluggy-0.13.1-py2.py3-none-any.whl (18 kB) 2023-10-05T11:29:15.187 INFO:teuthology.orchestra.run.smithi012.stdout:Collecting packaging>=14 2023-10-05T11:29:15.215 INFO:teuthology.orchestra.run.smithi012.stdout: Downloading packaging-23.2-py3-none-any.whl (53 kB) 2023-10-05T11:29:15.536 INFO:teuthology.orchestra.run.smithi012.stdout:Collecting virtualenv!=20.0.0,!=20.0.1,!=20.0.2,!=20.0.3,!=20.0.4,!=20.0.5,!=20.0.6,!=20.0.7,>=16.0.0 2023-10-05T11:29:15.580 INFO:teuthology.orchestra.run.smithi012.stdout: Downloading virtualenv-20.24.5-py3-none-any.whl (3.7 MB) 2023-10-05T11:29:16.088 INFO:teuthology.orchestra.run.smithi012.stdout:Collecting toml>=0.9.4 2023-10-05T11:29:16.109 INFO:teuthology.orchestra.run.smithi012.stdout: Downloading toml-0.10.2-py2.py3-none-any.whl (16 kB) 2023-10-05T11:29:16.223 INFO:teuthology.orchestra.run.smithi012.stdout:Collecting filelock<4,>=3.0.0 2023-10-05T11:29:16.247 INFO:teuthology.orchestra.run.smithi012.stdout: Downloading filelock-3.12.4-py3-none-any.whl (11 kB) 2023-10-05T11:29:16.338 INFO:teuthology.orchestra.run.smithi012.stdout:Collecting six<2,>=1.14.0 2023-10-05T11:29:16.363 INFO:teuthology.orchestra.run.smithi012.stdout: Downloading six-1.16.0-py2.py3-none-any.whl (11 kB) 2023-10-05T11:29:16.517 INFO:teuthology.orchestra.run.smithi012.stdout:Collecting platformdirs<4,>=3.9.1 2023-10-05T11:29:16.553 INFO:teuthology.orchestra.run.smithi012.stdout: Downloading platformdirs-3.11.0-py3-none-any.whl (17 kB) 2023-10-05T11:29:16.660 INFO:teuthology.orchestra.run.smithi012.stdout:Collecting distlib<1,>=0.3.7 2023-10-05T11:29:16.707 INFO:teuthology.orchestra.run.smithi012.stdout: Downloading distlib-0.3.7-py2.py3-none-any.whl (468 kB) 2023-10-05T11:29:16.878 INFO:teuthology.orchestra.run.smithi012.stdout:Installing collected packages: platformdirs, filelock, distlib, virtualenv, toml, six, py, pluggy, packaging, tox 2023-10-05T11:29:17.682 INFO:teuthology.orchestra.run.smithi012.stdout:Successfully installed distlib-0.3.7 filelock-3.12.4 packaging-23.2 platformdirs-3.11.0 pluggy-0.13.1 py-1.11.0 six-1.16.0 toml-0.10.2 tox-3.15.0 virtualenv-20.24.5 2023-10-05T11:29:17.888 INFO:teuthology.orchestra.run.smithi012.stderr:WARNING: You are using pip version 21.2.3; however, version 23.2.1 is available. 2023-10-05T11:29:17.888 INFO:teuthology.orchestra.run.smithi012.stderr:You should consider upgrading via the '/home/ubuntu/cephtest/tox-venv/bin/python3 -m pip install --upgrade pip' command. 2023-10-05T11:29:17.949 INFO:teuthology.run_tasks:Running task workunit... 2023-10-05T11:29:17.965 INFO:tasks.workunit:Pulling workunits from ref 38321be854743c0d616618a9ea8aa0b1d4dbc0bf 2023-10-05T11:29:17.966 INFO:tasks.workunit:Making a separate scratch dir for every client... 2023-10-05T11:29:17.966 DEBUG:teuthology.orchestra.run.smithi012:> stat -- /home/ubuntu/cephtest/mnt.0 2023-10-05T11:29:17.981 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-05T11:29:17.981 INFO:teuthology.orchestra.run.smithi012.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2023-10-05T11:29:17.982 DEBUG:teuthology.orchestra.run.smithi012:> mkdir -- /home/ubuntu/cephtest/mnt.0 2023-10-05T11:29:18.036 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2023-10-05T11:29:18.037 DEBUG:teuthology.orchestra.run.smithi012:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2023-10-05T11:29:18.092 INFO:tasks.workunit:timeout=3h 2023-10-05T11:29:18.092 INFO:tasks.workunit:cleanup=True 2023-10-05T11:29:18.092 DEBUG:teuthology.orchestra.run.smithi012:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/pritha-srivastava/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 38321be854743c0d616618a9ea8aa0b1d4dbc0bf 2023-10-05T11:29:18.147 INFO:tasks.workunit.client.0.smithi012.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2023-10-05T11:30:02.592 INFO:tasks.workunit.client.0.smithi012.stderr:Note: switching to '38321be854743c0d616618a9ea8aa0b1d4dbc0bf'. 2023-10-05T11:30:02.592 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:30:02.592 INFO:tasks.workunit.client.0.smithi012.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2023-10-05T11:30:02.592 INFO:tasks.workunit.client.0.smithi012.stderr:changes and commit them, and you can discard any commits you make in this 2023-10-05T11:30:02.592 INFO:tasks.workunit.client.0.smithi012.stderr:state without impacting any branches by switching back to a branch. 2023-10-05T11:30:02.592 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:30:02.592 INFO:tasks.workunit.client.0.smithi012.stderr:If you want to create a new branch to retain commits you create, you may 2023-10-05T11:30:02.593 INFO:tasks.workunit.client.0.smithi012.stderr:do so (now or later) by using -c with the switch command. Example: 2023-10-05T11:30:02.593 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:30:02.593 INFO:tasks.workunit.client.0.smithi012.stderr: git switch -c 2023-10-05T11:30:02.593 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:30:02.593 INFO:tasks.workunit.client.0.smithi012.stderr:Or undo this operation with: 2023-10-05T11:30:02.593 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:30:02.593 INFO:tasks.workunit.client.0.smithi012.stderr: git switch - 2023-10-05T11:30:02.593 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:30:02.593 INFO:tasks.workunit.client.0.smithi012.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2023-10-05T11:30:02.593 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:30:02.593 INFO:tasks.workunit.client.0.smithi012.stderr:HEAD is now at 38321be8547 rgw/d3n: fixes for failures seen in test_multipart_upload. 2023-10-05T11:30:02.596 DEBUG:teuthology.orchestra.run.smithi012:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2023-10-05T11:30:02.657 INFO:tasks.workunit.client.0.smithi012.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2023-10-05T11:30:02.660 INFO:tasks.workunit.client.0.smithi012.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-10-05T11:30:02.660 INFO:tasks.workunit.client.0.smithi012.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2023-10-05T11:30:03.316 INFO:tasks.workunit.client.0.smithi012.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2023-10-05T11:30:03.382 INFO:tasks.workunit.client.0.smithi012.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2023-10-05T11:30:03.423 INFO:tasks.workunit.client.0.smithi012.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-10-05T11:30:03.425 INFO:tasks.workunit.client.0.smithi012.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-10-05T11:30:03.425 INFO:tasks.workunit.client.0.smithi012.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2023-10-05T11:30:03.466 INFO:tasks.workunit.client.0.smithi012.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-10-05T11:30:03.469 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-10-05T11:30:03.469 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2023-10-05T11:30:03.524 INFO:tasks.workunit:Running workunits matching rgw/run-datacache.sh on client.0... 2023-10-05T11:30:03.525 INFO:tasks.workunit:Running workunit rgw/run-datacache.sh... 2023-10-05T11:30:03.526 DEBUG:teuthology.orchestra.run.smithi012:workunit test rgw/run-datacache.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=38321be854743c0d616618a9ea8aa0b1d4dbc0bf TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 RGW_DATACACHE_PATH=/tmp/rgw_datacache adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-datacache.sh 2023-10-05T11:30:03.597 INFO:tasks.workunit.client.0.smithi012.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-datacache.sh 2023-10-05T11:30:03.598 INFO:tasks.workunit.client.0.smithi012.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2023-10-05T11:30:03.598 INFO:tasks.workunit.client.0.smithi012.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2023-10-05T11:30:05.967 INFO:tasks.workunit.client.0.smithi012.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2023-10-05T11:30:05.967 INFO:tasks.workunit.client.0.smithi012.stderr:++ deactivate nondestructive 2023-10-05T11:30:05.967 INFO:tasks.workunit.client.0.smithi012.stderr:++ '[' -n '' ']' 2023-10-05T11:30:05.967 INFO:tasks.workunit.client.0.smithi012.stderr:++ '[' -n '' ']' 2023-10-05T11:30:05.967 INFO:tasks.workunit.client.0.smithi012.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2023-10-05T11:30:05.967 INFO:tasks.workunit.client.0.smithi012.stderr:++ hash -r 2023-10-05T11:30:05.967 INFO:tasks.workunit.client.0.smithi012.stderr:++ '[' -n '' ']' 2023-10-05T11:30:05.967 INFO:tasks.workunit.client.0.smithi012.stderr:++ unset VIRTUAL_ENV 2023-10-05T11:30:05.967 INFO:tasks.workunit.client.0.smithi012.stderr:++ '[' '!' nondestructive = nondestructive ']' 2023-10-05T11:30:05.967 INFO:tasks.workunit.client.0.smithi012.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2023-10-05T11:30:05.968 INFO:tasks.workunit.client.0.smithi012.stderr:++ export VIRTUAL_ENV 2023-10-05T11:30:05.968 INFO:tasks.workunit.client.0.smithi012.stderr:++ _OLD_VIRTUAL_PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2023-10-05T11:30:05.969 INFO:tasks.workunit.client.0.smithi012.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2023-10-05T11:30:05.969 INFO:tasks.workunit.client.0.smithi012.stderr:++ export PATH 2023-10-05T11:30:05.969 INFO:tasks.workunit.client.0.smithi012.stderr:++ '[' -n '' ']' 2023-10-05T11:30:05.969 INFO:tasks.workunit.client.0.smithi012.stderr:++ '[' -z '' ']' 2023-10-05T11:30:05.969 INFO:tasks.workunit.client.0.smithi012.stderr:++ _OLD_VIRTUAL_PS1= 2023-10-05T11:30:05.969 INFO:tasks.workunit.client.0.smithi012.stderr:++ PS1='(rgw) ' 2023-10-05T11:30:05.969 INFO:tasks.workunit.client.0.smithi012.stderr:++ export PS1 2023-10-05T11:30:05.969 INFO:tasks.workunit.client.0.smithi012.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2023-10-05T11:30:05.969 INFO:tasks.workunit.client.0.smithi012.stderr:++ hash -r 2023-10-05T11:30:05.969 INFO:tasks.workunit.client.0.smithi012.stderr:+ pip install pip --upgrade 2023-10-05T11:30:06.206 INFO:tasks.workunit.client.0.smithi012.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.9/site-packages (21.2.3) 2023-10-05T11:30:06.451 INFO:tasks.workunit.client.0.smithi012.stdout:Collecting pip 2023-10-05T11:30:06.581 INFO:tasks.workunit.client.0.smithi012.stdout: Downloading pip-23.2.1-py3-none-any.whl (2.1 MB) 2023-10-05T11:30:06.937 INFO:tasks.workunit.client.0.smithi012.stdout:Installing collected packages: pip 2023-10-05T11:30:06.937 INFO:tasks.workunit.client.0.smithi012.stdout: Attempting uninstall: pip 2023-10-05T11:30:06.937 INFO:tasks.workunit.client.0.smithi012.stdout: Found existing installation: pip 21.2.3 2023-10-05T11:30:07.104 INFO:tasks.workunit.client.0.smithi012.stdout: Uninstalling pip-21.2.3: 2023-10-05T11:30:07.110 INFO:tasks.workunit.client.0.smithi012.stdout: Successfully uninstalled pip-21.2.3 2023-10-05T11:30:08.103 INFO:tasks.workunit.client.0.smithi012.stdout:Successfully installed pip-23.2.1 2023-10-05T11:30:08.368 INFO:tasks.workunit.client.0.smithi012.stderr:+ pip install configobj 2023-10-05T11:30:08.848 INFO:tasks.workunit.client.0.smithi012.stdout:Collecting configobj 2023-10-05T11:30:08.930 INFO:tasks.workunit.client.0.smithi012.stdout: Downloading configobj-5.0.8-py2.py3-none-any.whl (36 kB) 2023-10-05T11:30:09.030 INFO:tasks.workunit.client.0.smithi012.stdout:Collecting six (from configobj) 2023-10-05T11:30:09.031 INFO:tasks.workunit.client.0.smithi012.stdout: Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2023-10-05T11:30:09.055 INFO:tasks.workunit.client.0.smithi012.stdout:Installing collected packages: six, configobj 2023-10-05T11:30:09.170 INFO:tasks.workunit.client.0.smithi012.stdout:Successfully installed configobj-5.0.8 six-1.16.0 2023-10-05T11:30:09.227 INFO:tasks.workunit.client.0.smithi012.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_datacache.py 2023-10-05T11:30:09.261 INFO:tasks.workunit.client.0.smithi012.stderr:DEBUG:root:datacache dir from config is: /tmp/rgw_datacache 2023-10-05T11:30:09.261 INFO:tasks.workunit.client.0.smithi012.stderr:DEBUG:root:exec_cmd(pwd) 2023-10-05T11:30:09.263 INFO:tasks.workunit.client.0.smithi012.stderr:INFO:root:command succeeded 2023-10-05T11:30:09.263 INFO:tasks.workunit.client.0.smithi012.stderr:INFO:root:b'/home/ubuntu/cephtest/mnt.0/client.0/tmp\n' 2023-10-05T11:30:09.263 INFO:tasks.workunit.client.0.smithi012.stderr:DEBUG:root:pwd is: /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-10-05T11:30:09.263 INFO:tasks.workunit.client.0.smithi012.stderr:DEBUG:root:exec_cmd(sudo netstat -nltp | egrep "rados|valgr") 2023-10-05T11:30:09.324 INFO:tasks.workunit.client.0.smithi012.stderr:INFO:root:command succeeded 2023-10-05T11:30:09.324 INFO:tasks.workunit.client.0.smithi012.stderr:INFO:root:b'tcp 0 0 0.0.0.0:80 0.0.0.0:* LISTEN 91894/valgrind \ntcp6 0 0 :::80 :::* LISTEN 91894/valgrind \n' 2023-10-05T11:30:09.324 INFO:tasks.workunit.client.0.smithi012.stderr:INFO:root:radosgw port: 80 2023-10-05T11:30:09.324 INFO:tasks.workunit.client.0.smithi012.stderr:INFO:root:radosgw endpoint is: 127.0.0.1 2023-10-05T11:30:09.325 INFO:tasks.workunit.client.0.smithi012.stderr:DEBUG:root:exec_cmd(dd if=/dev/urandom of=/home/ubuntu/cephtest/mnt.0/client.0/tmp/7M.dat bs=1M count=7) 2023-10-05T11:30:09.346 INFO:tasks.workunit.client.0.smithi012.stderr:INFO:root:command succeeded 2023-10-05T11:30:09.346 INFO:tasks.workunit.client.0.smithi012.stderr:INFO:root:b'' 2023-10-05T11:30:09.346 INFO:tasks.workunit.client.0.smithi012.stderr:DEBUG:root:file size is: 7340032 2023-10-05T11:30:09.346 INFO:tasks.workunit.client.0.smithi012.stderr:DEBUG:root:exec_cmd(radosgw-admin user create --uid rgw_datacache_user --display-name DatacacheUser --access-key NX5QOQKC6BH2IDN8HC7A --secret LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn) 2023-10-05T11:30:09.476 INFO:tasks.workunit.client.0.smithi012.stderr:INFO:root:command succeeded 2023-10-05T11:30:09.477 INFO:tasks.workunit.client.0.smithi012.stderr:INFO:root:b'{\n "user_id": "rgw_datacache_user",\n "display_name": "DatacacheUser",\n "email": "",\n "suspended": 0,\n "max_buckets": 1000,\n "subusers": [],\n "keys": [\n {\n "user": "rgw_datacache_user",\n "access_key": "NX5QOQKC6BH2IDN8HC7A",\n "secret_key": "LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn"\n }\n ],\n "swift_keys": [],\n "caps": [],\n "op_mask": "read, write, delete",\n "default_placement": "",\n "default_storage_class": "",\n "placement_tags": [],\n "bucket_quota": {\n "enabled": false,\n "check_on_raw": false,\n "max_size": -1,\n "max_size_kb": 0,\n "max_objects": -1\n },\n "user_quota": {\n "enabled": false,\n "check_on_raw": false,\n "max_size": -1,\n "max_size_kb": 0,\n "max_objects": -1\n },\n "temp_url_keys": [],\n "type": "rgw",\n "mfa_ids": []\n}\n\n' 2023-10-05T11:30:09.477 INFO:tasks.workunit.client.0.smithi012.stderr:INFO:root:Creating s3cmd config... 2023-10-05T11:30:09.477 INFO:tasks.workunit.client.0.smithi012.stderr:INFO:root:proto for s3cmd config is http 2023-10-05T11:30:09.477 INFO:tasks.workunit.client.0.smithi012.stderr:INFO:root:s3cmd config written 2023-10-05T11:30:09.477 INFO:tasks.workunit.client.0.smithi012.stderr:DEBUG:root:exec_cmd(s3cmd --access_key=NX5QOQKC6BH2IDN8HC7A --secret_key=LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn --config=/home/ubuntu/cephtest/mnt.0/client.0/tmp/s3cfg --no-check-hostname --host=127.0.0.1 mb s3://datacachebucket) 2023-10-05T11:30:10.062 INFO:tasks.workunit.client.0.smithi012.stderr:INFO:root:command succeeded 2023-10-05T11:30:10.062 INFO:tasks.workunit.client.0.smithi012.stderr:INFO:root:b"Bucket 's3://datacachebucket/' created\n" 2023-10-05T11:30:10.063 INFO:tasks.workunit.client.0.smithi012.stderr:DEBUG:root:exec_cmd(s3cmd --access_key=NX5QOQKC6BH2IDN8HC7A --secret_key=LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn --config=/home/ubuntu/cephtest/mnt.0/client.0/tmp/s3cfg --no-check-hostname --host=127.0.0.1 put /home/ubuntu/cephtest/mnt.0/client.0/tmp/7M.dat s3://datacachebucket) 2023-10-05T11:30:11.647 INFO:tasks.workunit.client.0.smithi012.stderr:INFO:root:command succeeded 2023-10-05T11:30:11.647 INFO:tasks.workunit.client.0.smithi012.stderr:INFO:root:b"upload: '/home/ubuntu/cephtest/mnt.0/client.0/tmp/7M.dat' -> 's3://datacachebucket/7M.dat' (7340032 bytes in 1.4 seconds, 5.11 MB/s) [1 of 1]\n" 2023-10-05T11:30:11.648 INFO:tasks.workunit.client.0.smithi012.stderr:DEBUG:root:exec_cmd(s3cmd --access_key=NX5QOQKC6BH2IDN8HC7A --secret_key=LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn --config=/home/ubuntu/cephtest/mnt.0/client.0/tmp/s3cfg --no-check-hostname --host=127.0.0.1 get s3://datacachebucket/7M.dat /home/ubuntu/cephtest/mnt.0/client.0/tmp/7M-get.dat --force) 2023-10-05T11:30:12.194 INFO:tasks.workunit.client.0.smithi012.stderr:INFO:root:command succeeded 2023-10-05T11:30:12.195 INFO:tasks.workunit.client.0.smithi012.stderr:INFO:root:b"download: 's3://datacachebucket/7M.dat' -> '/home/ubuntu/cephtest/mnt.0/client.0/tmp/7M-get.dat' (7340032 bytes in 0.3 seconds, 22.75 MB/s)\n" 2023-10-05T11:30:12.195 INFO:tasks.workunit.client.0.smithi012.stderr:DEBUG:root:exec_cmd(radosgw-admin object stat --bucket=datacachebucket --object=7M.dat) 2023-10-05T11:30:12.308 INFO:tasks.workunit.client.0.smithi012.stderr:INFO:root:command succeeded 2023-10-05T11:30:12.308 INFO:tasks.workunit.client.0.smithi012.stderr:INFO:root:b'{\n "name": "7M.dat",\n "size": 7368844,\n "policy": {\n "acl": {\n "acl_user_map": [\n {\n "user": "rgw_datacache_user",\n "acl": 15\n }\n ],\n "acl_group_map": [],\n "grant_map": [\n {\n "id": "rgw_datacache_user",\n "grant": {\n "type": {\n "type": 0\n },\n "id": "rgw_datacache_user",\n "email": "",\n "permission": {\n "flags": 15\n },\n "name": "DatacacheUser",\n "group": 0,\n "url_spec": ""\n }\n }\n ]\n },\n "owner": {\n "id": "rgw_datacache_user",\n "display_name": "DatacacheUser"\n }\n },\n "compression": {\n "compression_type": "lz4",\n "orig_size": 7340032,\n "blocks": [\n {\n "old_ofs": 0,\n "new_ofs": 0,\n "len": 4210766\n },\n {\n "old_ofs": 4194304,\n "new_ofs": 4210766,\n "len": 3158078\n }\n ]\n },\n "etag": "9bd5bcdb48f152ba3827fec567645bfc",\n "tag": "dff27d1e-df33-400e-a68a-7ba586947c99.4543.14307601766663568845",\n "manifest": {\n "objs": [],\n "obj_size": 7368844,\n "explicit_objs": false,\n "head_size": 0,\n "max_head_size": 0,\n "prefix": ".fDrTevhhm5PlZCPE6wOKM36i5LnUTHy_",\n "rules": [\n {\n "key": 0,\n "val": {\n "start_part_num": 0,\n "start_ofs": 0,\n "part_size": 0,\n "stripe_max_size": 4190208,\n "override_prefix": ""\n }\n }\n ],\n "tail_instance": "",\n "tail_placement": {\n "bucket": {\n "name": "datacachebucket",\n "marker": "dff27d1e-df33-400e-a68a-7ba586947c99.4604.1",\n "bucket_id": "dff27d1e-df33-400e-a68a-7ba586947c99.4604.1",\n "tenant": "",\n "explicit_placement": {\n "data_pool": "",\n "data_extra_pool": "",\n "index_pool": ""\n }\n },\n "placement_rule": "default-placement"\n },\n "tier_type": "",\n "begin_iter": {\n "part_ofs": 0,\n "stripe_ofs": 0,\n "ofs": 0,\n "stripe_size": 4190208,\n "cur_part_id": 0,\n "cur_stripe": 0,\n "cur_override_prefix": "",\n "location": {\n "placement_rule": "default-placement",\n "obj": {\n "bucket": {\n "name": "datacachebucket",\n "marker": "dff27d1e-df33-400e-a68a-7ba586947c99.4604.1",\n "bucket_id": "dff27d1e-df33-400e-a68a-7ba586947c99.4604.1",\n "tenant": "",\n "explicit_placement": {\n "data_pool": "",\n "data_extra_pool": "",\n "index_pool": ""\n }\n },\n "key": {\n "name": ".fDrTevhhm5PlZCPE6wOKM36i5LnUTHy_0",\n "instance": "",\n "ns": "shadow"\n }\n },\n "raw_obj": {\n "pool": "",\n "oid": "",\n "loc": ""\n },\n "is_raw": false\n }\n },\n "end_iter": {\n "part_ofs": 0,\n "stripe_ofs": 4190208,\n "ofs": 7368844,\n "stripe_size": 3178636,\n "cur_part_id": 0,\n "cur_stripe": 1,\n "cur_override_prefix": "",\n "location": {\n "placement_rule": "default-placement",\n "obj": {\n "bucket": {\n "name": "datacachebucket",\n "marker": "dff27d1e-df33-400e-a68a-7ba586947c99.4604.1",\n "bucket_id": "dff27d1e-df33-400e-a68a-7ba586947c99.4604.1",\n "tenant": "",\n "explicit_placement": {\n "data_pool": "",\n "data_extra_pool": "",\n "index_pool": ""\n }\n },\n "key": {\n "name": ".fDrTevhhm5PlZCPE6wOKM36i5LnUTHy_1",\n "instance": "",\n "ns": "shadow"\n }\n },\n "raw_obj": {\n "pool": "",\n "oid": "",\n "loc": ""\n },\n "is_raw": false\n }\n }\n },\n "pg_ver": 0,\n "source_zone": 0,\n "torrent": "",\n "attrs": {\n "user.rgw.content_type": "application/octet-stream",\n "user.rgw.storage_class": "STANDARD",\n "user.rgw.tail_tag": "dff27d1e-df33-400e-a68a-7ba586947c99.4543.14307601766663568845",\n "user.rgw.x-amz-content-sha256": "800470ea42cfddb2b4b7ca966372985753ca1d601a79988aa0f9705e3d5fc358",\n "user.rgw.x-amz-date": "20231005T113010Z",\n "user.rgw.x-amz-meta-s3cmd-attrs": "atime:1696505409/ctime:1696505409/gid:1301/gname:ubuntu/md5:9bd5bcdb48f152ba3827fec567645bfc/mode:33188/mtime:1696505409/uid:1000/uname:ubuntu"\n }\n}\n' 2023-10-05T11:30:12.308 INFO:tasks.workunit.client.0.smithi012.stderr:INFO:root:Num parts is: 2 2023-10-05T11:30:12.309 INFO:tasks.workunit.client.0.smithi012.stderr:DEBUG:root:exec_cmd(find /tmp/rgw_datacache -type f | wc -l) 2023-10-05T11:30:12.323 INFO:tasks.workunit.client.0.smithi012.stderr:INFO:root:command succeeded 2023-10-05T11:30:12.323 INFO:tasks.workunit.client.0.smithi012.stderr:INFO:root:b'2\n' 2023-10-05T11:30:12.323 INFO:tasks.workunit.client.0.smithi012.stderr:DEBUG:root:Check cache dir content: 2 2023-10-05T11:30:12.323 INFO:tasks.workunit.client.0.smithi012.stderr:DEBUG:root:exec_cmd(ls -l /tmp/rgw_datacache) 2023-10-05T11:30:12.325 INFO:tasks.workunit.client.0.smithi012.stderr:INFO:root:command succeeded 2023-10-05T11:30:12.325 INFO:tasks.workunit.client.0.smithi012.stderr:INFO:root:b'total 7200\n-rw-r--r--. 1 ceph ceph 4194304 Oct 5 11:30 dff27d1e-df33-400e-a68a-7ba586947c99.4604.1_7M.dat_0_4194304\n-rw-r--r--. 1 ceph ceph 3174540 Oct 5 11:30 dff27d1e-df33-400e-a68a-7ba586947c99.4604.1_7M.dat_4194304_3174540\n' 2023-10-05T11:30:12.325 INFO:tasks.workunit.client.0.smithi012.stderr:DEBUG:root:Cached object name is: dff27d1e-df33-400e-a68a-7ba586947c99.4604.1_7M.dat_0_4194304 2023-10-05T11:30:12.325 INFO:tasks.workunit.client.0.smithi012.stderr:DEBUG:root:exec_cmd(find /tmp/rgw_datacache -name dff27d1e-df33-400e-a68a-7ba586947c99.4604.1_7M.dat_0_4194304) 2023-10-05T11:30:12.327 INFO:tasks.workunit.client.0.smithi012.stderr:INFO:root:command succeeded 2023-10-05T11:30:12.328 INFO:tasks.workunit.client.0.smithi012.stderr:INFO:root:b'/tmp/rgw_datacache/dff27d1e-df33-400e-a68a-7ba586947c99.4604.1_7M.dat_0_4194304\n' 2023-10-05T11:30:12.328 INFO:tasks.workunit.client.0.smithi012.stderr:DEBUG:root:Path of file in datacache is: /tmp/rgw_datacache/dff27d1e-df33-400e-a68a-7ba586947c99.4604.1_7M.dat_0_4194304 2023-10-05T11:30:12.328 INFO:tasks.workunit.client.0.smithi012.stderr:DEBUG:root:Cached object name is: dff27d1e-df33-400e-a68a-7ba586947c99.4604.1_7M.dat_4194304_3145728 2023-10-05T11:30:12.328 INFO:tasks.workunit.client.0.smithi012.stderr:DEBUG:root:exec_cmd(find /tmp/rgw_datacache -name dff27d1e-df33-400e-a68a-7ba586947c99.4604.1_7M.dat_4194304_3145728) 2023-10-05T11:30:12.330 INFO:tasks.workunit.client.0.smithi012.stderr:INFO:root:command succeeded 2023-10-05T11:30:12.330 INFO:tasks.workunit.client.0.smithi012.stderr:INFO:root:b'' 2023-10-05T11:30:12.330 INFO:tasks.workunit.client.0.smithi012.stderr:DEBUG:root:Path of file in datacache is: 2023-10-05T11:30:12.330 INFO:tasks.workunit.client.0.smithi012.stderr:DEBUG:root:RGW Datacache test SUCCESS 2023-10-05T11:30:12.330 INFO:tasks.workunit.client.0.smithi012.stderr:INFO:root:Completed Datacache tests 2023-10-05T11:30:12.335 INFO:tasks.workunit.client.0.smithi012.stderr:+ deactivate 2023-10-05T11:30:12.336 INFO:tasks.workunit.client.0.smithi012.stderr:+ '[' -n /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin ']' 2023-10-05T11:30:12.336 INFO:tasks.workunit.client.0.smithi012.stderr:+ PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2023-10-05T11:30:12.336 INFO:tasks.workunit.client.0.smithi012.stderr:+ export PATH 2023-10-05T11:30:12.336 INFO:tasks.workunit.client.0.smithi012.stderr:+ unset _OLD_VIRTUAL_PATH 2023-10-05T11:30:12.336 INFO:tasks.workunit.client.0.smithi012.stderr:+ '[' -n '' ']' 2023-10-05T11:30:12.336 INFO:tasks.workunit.client.0.smithi012.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2023-10-05T11:30:12.336 INFO:tasks.workunit.client.0.smithi012.stderr:+ hash -r 2023-10-05T11:30:12.336 INFO:tasks.workunit.client.0.smithi012.stderr:+ '[' -n '' ']' 2023-10-05T11:30:12.336 INFO:tasks.workunit.client.0.smithi012.stderr:+ unset VIRTUAL_ENV 2023-10-05T11:30:12.336 INFO:tasks.workunit.client.0.smithi012.stderr:+ '[' '!' '' = nondestructive ']' 2023-10-05T11:30:12.336 INFO:tasks.workunit.client.0.smithi012.stderr:+ unset -f deactivate 2023-10-05T11:30:12.337 INFO:tasks.workunit.client.0.smithi012.stderr:+ echo OK. 2023-10-05T11:30:12.337 INFO:tasks.workunit.client.0.smithi012.stdout:OK. 2023-10-05T11:30:12.338 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-10-05T11:30:12.338 DEBUG:teuthology.orchestra.run.smithi012:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-10-05T11:30:12.411 INFO:tasks.workunit:Stopping ['rgw/run-datacache.sh'] on client.0... 2023-10-05T11:30:12.411 DEBUG:teuthology.orchestra.run.smithi012:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2023-10-05T11:30:12.730 DEBUG:teuthology.parallel:result is None 2023-10-05T11:30:12.731 DEBUG:teuthology.orchestra.run.smithi012:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2023-10-05T11:30:12.761 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2023-10-05T11:30:12.761 DEBUG:teuthology.orchestra.run.smithi012:> rmdir -- /home/ubuntu/cephtest/mnt.0 2023-10-05T11:30:12.824 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2023-10-05T11:30:12.824 INFO:teuthology.run_tasks:Running task workunit... 2023-10-05T11:30:12.834 INFO:tasks.workunit:Pulling workunits from ref 38321be854743c0d616618a9ea8aa0b1d4dbc0bf 2023-10-05T11:30:12.834 INFO:tasks.workunit:Making a separate scratch dir for every client... 2023-10-05T11:30:12.834 DEBUG:teuthology.orchestra.run.smithi012:> stat -- /home/ubuntu/cephtest/mnt.0 2023-10-05T11:30:12.879 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-05T11:30:12.879 INFO:teuthology.orchestra.run.smithi012.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2023-10-05T11:30:12.880 DEBUG:teuthology.orchestra.run.smithi012:> mkdir -- /home/ubuntu/cephtest/mnt.0 2023-10-05T11:30:12.934 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2023-10-05T11:30:12.934 DEBUG:teuthology.orchestra.run.smithi012:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2023-10-05T11:30:12.989 INFO:tasks.workunit:timeout=3h 2023-10-05T11:30:12.989 INFO:tasks.workunit:cleanup=True 2023-10-05T11:30:12.990 DEBUG:teuthology.orchestra.run.smithi012:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/pritha-srivastava/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 38321be854743c0d616618a9ea8aa0b1d4dbc0bf 2023-10-05T11:30:13.045 INFO:tasks.workunit.client.0.smithi012.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2023-10-05T11:30:54.677 INFO:tasks.workunit.client.0.smithi012.stderr:Note: switching to '38321be854743c0d616618a9ea8aa0b1d4dbc0bf'. 2023-10-05T11:30:54.677 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:30:54.678 INFO:tasks.workunit.client.0.smithi012.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2023-10-05T11:30:54.678 INFO:tasks.workunit.client.0.smithi012.stderr:changes and commit them, and you can discard any commits you make in this 2023-10-05T11:30:54.678 INFO:tasks.workunit.client.0.smithi012.stderr:state without impacting any branches by switching back to a branch. 2023-10-05T11:30:54.678 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:30:54.678 INFO:tasks.workunit.client.0.smithi012.stderr:If you want to create a new branch to retain commits you create, you may 2023-10-05T11:30:54.678 INFO:tasks.workunit.client.0.smithi012.stderr:do so (now or later) by using -c with the switch command. Example: 2023-10-05T11:30:54.678 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:30:54.678 INFO:tasks.workunit.client.0.smithi012.stderr: git switch -c 2023-10-05T11:30:54.678 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:30:54.678 INFO:tasks.workunit.client.0.smithi012.stderr:Or undo this operation with: 2023-10-05T11:30:54.678 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:30:54.679 INFO:tasks.workunit.client.0.smithi012.stderr: git switch - 2023-10-05T11:30:54.679 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:30:54.679 INFO:tasks.workunit.client.0.smithi012.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2023-10-05T11:30:54.679 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:30:54.679 INFO:tasks.workunit.client.0.smithi012.stderr:HEAD is now at 38321be8547 rgw/d3n: fixes for failures seen in test_multipart_upload. 2023-10-05T11:30:54.682 DEBUG:teuthology.orchestra.run.smithi012:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2023-10-05T11:30:54.738 INFO:tasks.workunit.client.0.smithi012.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2023-10-05T11:30:54.740 INFO:tasks.workunit.client.0.smithi012.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-10-05T11:30:54.740 INFO:tasks.workunit.client.0.smithi012.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2023-10-05T11:30:54.790 INFO:tasks.workunit.client.0.smithi012.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2023-10-05T11:30:54.841 INFO:tasks.workunit.client.0.smithi012.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2023-10-05T11:30:54.881 INFO:tasks.workunit.client.0.smithi012.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-10-05T11:30:54.882 INFO:tasks.workunit.client.0.smithi012.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-10-05T11:30:54.883 INFO:tasks.workunit.client.0.smithi012.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2023-10-05T11:30:54.923 INFO:tasks.workunit.client.0.smithi012.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-10-05T11:30:54.927 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-10-05T11:30:54.927 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2023-10-05T11:30:54.983 INFO:tasks.workunit:Running workunits matching rgw/run-bucket-check.sh on client.0... 2023-10-05T11:30:54.984 INFO:tasks.workunit:Running workunit rgw/run-bucket-check.sh... 2023-10-05T11:30:54.984 DEBUG:teuthology.orchestra.run.smithi012:workunit test rgw/run-bucket-check.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=38321be854743c0d616618a9ea8aa0b1d4dbc0bf TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-bucket-check.sh 2023-10-05T11:30:55.042 INFO:tasks.workunit.client.0.smithi012.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-bucket-check.sh 2023-10-05T11:30:55.042 INFO:tasks.workunit.client.0.smithi012.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2023-10-05T11:30:55.042 INFO:tasks.workunit.client.0.smithi012.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2023-10-05T11:30:57.480 INFO:tasks.workunit.client.0.smithi012.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2023-10-05T11:30:57.480 INFO:tasks.workunit.client.0.smithi012.stderr:++ deactivate nondestructive 2023-10-05T11:30:57.480 INFO:tasks.workunit.client.0.smithi012.stderr:++ '[' -n '' ']' 2023-10-05T11:30:57.481 INFO:tasks.workunit.client.0.smithi012.stderr:++ '[' -n '' ']' 2023-10-05T11:30:57.481 INFO:tasks.workunit.client.0.smithi012.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2023-10-05T11:30:57.481 INFO:tasks.workunit.client.0.smithi012.stderr:++ hash -r 2023-10-05T11:30:57.481 INFO:tasks.workunit.client.0.smithi012.stderr:++ '[' -n '' ']' 2023-10-05T11:30:57.481 INFO:tasks.workunit.client.0.smithi012.stderr:++ unset VIRTUAL_ENV 2023-10-05T11:30:57.481 INFO:tasks.workunit.client.0.smithi012.stderr:++ '[' '!' nondestructive = nondestructive ']' 2023-10-05T11:30:57.481 INFO:tasks.workunit.client.0.smithi012.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2023-10-05T11:30:57.481 INFO:tasks.workunit.client.0.smithi012.stderr:++ export VIRTUAL_ENV 2023-10-05T11:30:57.481 INFO:tasks.workunit.client.0.smithi012.stderr:++ _OLD_VIRTUAL_PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2023-10-05T11:30:57.482 INFO:tasks.workunit.client.0.smithi012.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2023-10-05T11:30:57.482 INFO:tasks.workunit.client.0.smithi012.stderr:++ export PATH 2023-10-05T11:30:57.482 INFO:tasks.workunit.client.0.smithi012.stderr:++ '[' -n '' ']' 2023-10-05T11:30:57.483 INFO:tasks.workunit.client.0.smithi012.stderr:++ '[' -z '' ']' 2023-10-05T11:30:57.483 INFO:tasks.workunit.client.0.smithi012.stderr:++ _OLD_VIRTUAL_PS1= 2023-10-05T11:30:57.483 INFO:tasks.workunit.client.0.smithi012.stderr:++ PS1='(rgw) ' 2023-10-05T11:30:57.483 INFO:tasks.workunit.client.0.smithi012.stderr:++ export PS1 2023-10-05T11:30:57.483 INFO:tasks.workunit.client.0.smithi012.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2023-10-05T11:30:57.483 INFO:tasks.workunit.client.0.smithi012.stderr:++ hash -r 2023-10-05T11:30:57.483 INFO:tasks.workunit.client.0.smithi012.stderr:+ pip install pip --upgrade 2023-10-05T11:30:57.721 INFO:tasks.workunit.client.0.smithi012.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.9/site-packages (21.2.3) 2023-10-05T11:30:57.979 INFO:tasks.workunit.client.0.smithi012.stdout:Collecting pip 2023-10-05T11:30:57.985 INFO:tasks.workunit.client.0.smithi012.stdout: Using cached pip-23.2.1-py3-none-any.whl (2.1 MB) 2023-10-05T11:30:58.034 INFO:tasks.workunit.client.0.smithi012.stdout:Installing collected packages: pip 2023-10-05T11:30:58.034 INFO:tasks.workunit.client.0.smithi012.stdout: Attempting uninstall: pip 2023-10-05T11:30:58.034 INFO:tasks.workunit.client.0.smithi012.stdout: Found existing installation: pip 21.2.3 2023-10-05T11:30:58.195 INFO:tasks.workunit.client.0.smithi012.stdout: Uninstalling pip-21.2.3: 2023-10-05T11:30:58.200 INFO:tasks.workunit.client.0.smithi012.stdout: Successfully uninstalled pip-21.2.3 2023-10-05T11:30:59.206 INFO:tasks.workunit.client.0.smithi012.stdout:Successfully installed pip-23.2.1 2023-10-05T11:30:59.254 INFO:tasks.workunit.client.0.smithi012.stderr:+ pip install boto3 2023-10-05T11:31:00.243 INFO:tasks.workunit.client.0.smithi012.stdout:Collecting boto3 2023-10-05T11:31:00.243 INFO:tasks.workunit.client.0.smithi012.stdout: Obtaining dependency information for boto3 from https://files.pythonhosted.org/packages/da/7e/ea3b898a2f7f8b698eb93d808cca4202e2e5ee1887715b28b42fb9b5c71c/boto3-1.28.60-py3-none-any.whl.metadata 2023-10-05T11:31:00.349 INFO:tasks.workunit.client.0.smithi012.stdout: Downloading boto3-1.28.60-py3-none-any.whl.metadata (6.7 kB) 2023-10-05T11:31:01.105 INFO:tasks.workunit.client.0.smithi012.stdout:Collecting botocore<1.32.0,>=1.31.60 (from boto3) 2023-10-05T11:31:01.106 INFO:tasks.workunit.client.0.smithi012.stdout: Obtaining dependency information for botocore<1.32.0,>=1.31.60 from https://files.pythonhosted.org/packages/5d/fa/fb73dceac7f2fd4ad82020696e241315e1ed9525810900ca8e35b7cf9b74/botocore-1.31.60-py3-none-any.whl.metadata 2023-10-05T11:31:01.123 INFO:tasks.workunit.client.0.smithi012.stdout: Downloading botocore-1.31.60-py3-none-any.whl.metadata (6.0 kB) 2023-10-05T11:31:01.240 INFO:tasks.workunit.client.0.smithi012.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2023-10-05T11:31:01.266 INFO:tasks.workunit.client.0.smithi012.stdout: Downloading jmespath-1.0.1-py3-none-any.whl (20 kB) 2023-10-05T11:31:01.362 INFO:tasks.workunit.client.0.smithi012.stdout:Collecting s3transfer<0.8.0,>=0.7.0 (from boto3) 2023-10-05T11:31:01.362 INFO:tasks.workunit.client.0.smithi012.stdout: Obtaining dependency information for s3transfer<0.8.0,>=0.7.0 from https://files.pythonhosted.org/packages/5a/4b/fec9ce18f8874a96c5061422625ba86c3ee1e6587ccd92ff9f5bf7bd91b2/s3transfer-0.7.0-py3-none-any.whl.metadata 2023-10-05T11:31:01.395 INFO:tasks.workunit.client.0.smithi012.stdout: Downloading s3transfer-0.7.0-py3-none-any.whl.metadata (1.8 kB) 2023-10-05T11:31:01.488 INFO:tasks.workunit.client.0.smithi012.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.32.0,>=1.31.60->boto3) 2023-10-05T11:31:01.510 INFO:tasks.workunit.client.0.smithi012.stdout: Downloading python_dateutil-2.8.2-py2.py3-none-any.whl (247 kB) 2023-10-05T11:31:01.657 INFO:tasks.workunit.client.0.smithi012.stdout: ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 247.7/247.7 kB 1.8 MB/s eta 0:00:00 2023-10-05T11:31:01.761 INFO:tasks.workunit.client.0.smithi012.stdout:Collecting urllib3<1.27,>=1.25.4 (from botocore<1.32.0,>=1.31.60->boto3) 2023-10-05T11:31:01.761 INFO:tasks.workunit.client.0.smithi012.stdout: Obtaining dependency information for urllib3<1.27,>=1.25.4 from https://files.pythonhosted.org/packages/48/fe/a5c6cc46e9fe9171d7ecf0f33ee7aae14642f8d74baa7af4d7840f9358be/urllib3-1.26.17-py2.py3-none-any.whl.metadata 2023-10-05T11:31:01.777 INFO:tasks.workunit.client.0.smithi012.stdout: Downloading urllib3-1.26.17-py2.py3-none-any.whl.metadata (48 kB) 2023-10-05T11:31:01.824 INFO:tasks.workunit.client.0.smithi012.stdout: ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 48.7/48.7 kB 949.5 kB/s eta 0:00:00 2023-10-05T11:31:02.037 INFO:tasks.workunit.client.0.smithi012.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.32.0,>=1.31.60->boto3) 2023-10-05T11:31:02.038 INFO:tasks.workunit.client.0.smithi012.stdout: Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2023-10-05T11:31:02.082 INFO:tasks.workunit.client.0.smithi012.stdout:Downloading boto3-1.28.60-py3-none-any.whl (135 kB) 2023-10-05T11:31:02.150 INFO:tasks.workunit.client.0.smithi012.stdout: ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 135.8/135.8 kB 2.0 MB/s eta 0:00:00 2023-10-05T11:31:02.173 INFO:tasks.workunit.client.0.smithi012.stdout:Downloading botocore-1.31.60-py3-none-any.whl (11.2 MB) 2023-10-05T11:31:03.144 INFO:tasks.workunit.client.0.smithi012.stdout: ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 11.2/11.2 MB 13.4 MB/s eta 0:00:00 2023-10-05T11:31:03.162 INFO:tasks.workunit.client.0.smithi012.stdout:Downloading s3transfer-0.7.0-py3-none-any.whl (79 kB) 2023-10-05T11:31:03.192 INFO:tasks.workunit.client.0.smithi012.stdout: ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 79.8/79.8 kB 2.5 MB/s eta 0:00:00 2023-10-05T11:31:03.210 INFO:tasks.workunit.client.0.smithi012.stdout:Downloading urllib3-1.26.17-py2.py3-none-any.whl (143 kB) 2023-10-05T11:31:03.268 INFO:tasks.workunit.client.0.smithi012.stdout: ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 143.4/143.4 kB 2.4 MB/s eta 0:00:00 2023-10-05T11:31:03.371 INFO:tasks.workunit.client.0.smithi012.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2023-10-05T11:31:04.710 INFO:tasks.workunit.client.0.smithi012.stdout:Successfully installed boto3-1.28.60 botocore-1.31.60 jmespath-1.0.1 python-dateutil-2.8.2 s3transfer-0.7.0 six-1.16.0 urllib3-1.26.17 2023-10-05T11:31:04.837 INFO:tasks.workunit.client.0.smithi012.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_bucket_check.py 2023-10-05T11:31:04.973 INFO:tasks.workunit.client.0.smithi012.stderr:radosgw-admin user create --uid check-tester --display-name "Check Testing" --access-key OJODXSLNX4LUNHQG99PA --secret 3l6ffld34qaymfomuh832j94738aie2x4p2o8h6n 2023-10-05T11:31:05.008 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setuser ceph since I am not root 2023-10-05T11:31:05.009 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T11:31:05.021 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:05.018+0000 7f2c4dda2880 20 rados->read ofs=0 len=0 2023-10-05T11:31:05.023 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:05.020+0000 7f2c4dda2880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:05.023 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:05.020+0000 7f2c4dda2880 20 realm 2023-10-05T11:31:05.023 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:05.020+0000 7f2c4dda2880 20 rados->read ofs=0 len=0 2023-10-05T11:31:05.023 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:05.020+0000 7f2c4dda2880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:05.023 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:05.020+0000 7f2c4dda2880 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T11:31:05.023 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:05.020+0000 7f2c4dda2880 20 rados->read ofs=0 len=0 2023-10-05T11:31:05.023 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:05.020+0000 7f2c4dda2880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:05.023 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:05.020+0000 7f2c4dda2880 20 rados->read ofs=0 len=0 2023-10-05T11:31:05.024 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:05.021+0000 7f2c4dda2880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:31:05.024 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:05.021+0000 7f2c4dda2880 20 rados->read ofs=0 len=0 2023-10-05T11:31:05.025 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:05.022+0000 7f2c4dda2880 20 rados_obj.operate() r=0 bl.length=1020 2023-10-05T11:31:05.025 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:05.022+0000 7f2c4dda2880 20 searching for the correct realm 2023-10-05T11:31:05.036 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:05.033+0000 7f2c4cd48640 0 -- 172.21.15.12:0/1163908463 >> [v2:172.21.15.12:6824/2171933159,v1:172.21.15.12:6825/2171933159] conn(0x55ea63e6c000 msgr2=0x55ea631d5700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:31:05.037 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:05.034+0000 7f2c4dda2880 20 RGWRados::pool_iterate: got zone_info.dff27d1e-df33-400e-a68a-7ba586947c99 2023-10-05T11:31:05.037 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:05.034+0000 7f2c4dda2880 20 RGWRados::pool_iterate: got zonegroup_info.c78aa576-9d15-4e9d-b3c0-4af23a22062c 2023-10-05T11:31:05.037 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:05.034+0000 7f2c4dda2880 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T11:31:05.037 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:05.034+0000 7f2c4dda2880 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T11:31:05.037 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:05.034+0000 7f2c4dda2880 20 rados->read ofs=0 len=0 2023-10-05T11:31:05.037 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:05.034+0000 7f2c4dda2880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:05.038 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:05.034+0000 7f2c4dda2880 20 rados->read ofs=0 len=0 2023-10-05T11:31:05.039 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:05.035+0000 7f2c4dda2880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:31:05.039 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:05.035+0000 7f2c4dda2880 20 rados->read ofs=0 len=0 2023-10-05T11:31:05.039 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:05.035+0000 7f2c4dda2880 20 rados_obj.operate() r=0 bl.length=454 2023-10-05T11:31:05.039 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:05.035+0000 7f2c4dda2880 20 zone default found 2023-10-05T11:31:05.039 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:05.035+0000 7f2c4dda2880 4 Realm: () 2023-10-05T11:31:05.039 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:05.035+0000 7f2c4dda2880 4 ZoneGroup: default (c78aa576-9d15-4e9d-b3c0-4af23a22062c) 2023-10-05T11:31:05.039 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:05.035+0000 7f2c4dda2880 4 Zone: default (dff27d1e-df33-400e-a68a-7ba586947c99) 2023-10-05T11:31:05.039 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:05.035+0000 7f2c4dda2880 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T11:31:05.040 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:05.035+0000 7f2c4dda2880 20 zonegroup default 2023-10-05T11:31:05.040 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:05.035+0000 7f2c4dda2880 20 rados->read ofs=0 len=0 2023-10-05T11:31:05.040 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:05.035+0000 7f2c4dda2880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:05.040 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:05.035+0000 7f2c4dda2880 20 rados->read ofs=0 len=0 2023-10-05T11:31:05.040 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:05.036+0000 7f2c4dda2880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:05.040 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:05.036+0000 7f2c4dda2880 20 rados->read ofs=0 len=0 2023-10-05T11:31:05.040 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:05.036+0000 7f2c4dda2880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:05.040 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:05.036+0000 7f2c4dda2880 20 started sync module instance, tier type = 2023-10-05T11:31:05.040 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:05.036+0000 7f2c4dda2880 20 started zone id=dff27d1e-df33-400e-a68a-7ba586947c99 (name=default) with tier type = 2023-10-05T11:31:05.057 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:05.054+0000 7f2c4cd48640 0 -- 172.21.15.12:0/1163908463 >> [v2:172.21.15.170:6800/4137726411,v1:172.21.15.170:6801/4137726411] conn(0x55ea63295c00 msgr2=0x55ea63287600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:31:05.060 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:05.057+0000 7f2c4dda2880 20 add_watcher() i=0 2023-10-05T11:31:05.060 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:05.057+0000 7f2c4dda2880 20 add_watcher() i=1 2023-10-05T11:31:05.060 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:05.057+0000 7f2c4dda2880 20 add_watcher() i=2 2023-10-05T11:31:05.060 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:05.057+0000 7f2c4dda2880 20 add_watcher() i=3 2023-10-05T11:31:05.060 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:05.057+0000 7f2c4dda2880 20 add_watcher() i=4 2023-10-05T11:31:05.060 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:05.057+0000 7f2c4dda2880 20 add_watcher() i=5 2023-10-05T11:31:05.063 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:05.061+0000 7f2c4dda2880 20 add_watcher() i=6 2023-10-05T11:31:05.063 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:05.061+0000 7f2c4dda2880 20 add_watcher() i=7 2023-10-05T11:31:05.064 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:05.061+0000 7f2c4dda2880 2 all 8 watchers are set, enabling cache 2023-10-05T11:31:05.067 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:05.064+0000 7f2c33515640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:31:05.067 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:05.065+0000 7f2c4dda2880 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T11:31:05.067 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:05.065+0000 7f2c4dda2880 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T11:31:05.073 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:05.070+0000 7f2c4dda2880 5 note: GC not initialized 2023-10-05T11:31:05.073 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:05.070+0000 7f2c2ed0c640 20 reqs_thread_entry: start 2023-10-05T11:31:05.073 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:05.070+0000 7f2c4dda2880 20 init_complete bucket index max shards: 11 2023-10-05T11:31:05.073 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:05.070+0000 7f2c4dda2880 20 Filter name: none 2023-10-05T11:31:05.074 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:05.071+0000 7f2c2cd08640 20 reqs_thread_entry: start 2023-10-05T11:31:05.074 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:05.071+0000 7f2c4dda2880 10 cache get: name=default.rgw.meta+users.uid+check-tester : miss 2023-10-05T11:31:05.074 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:05.071+0000 7f2c4dda2880 20 rados->read ofs=0 len=0 2023-10-05T11:31:05.074 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:05.071+0000 7f2c4dda2880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:05.074 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:05.071+0000 7f2c4dda2880 10 cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x0 2023-10-05T11:31:05.075 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:05.071+0000 7f2c4dda2880 10 adding default.rgw.meta+users.uid+check-tester to cache LRU end 2023-10-05T11:31:05.075 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:05.071+0000 7f2c4dda2880 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : miss 2023-10-05T11:31:05.075 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:05.071+0000 7f2c4dda2880 20 rados->read ofs=0 len=0 2023-10-05T11:31:05.075 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:05.071+0000 7f2c4dda2880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:05.075 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:05.071+0000 7f2c4dda2880 10 cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x0 2023-10-05T11:31:05.075 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:05.071+0000 7f2c4dda2880 10 adding default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2023-10-05T11:31:05.075 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:05.071+0000 7f2c4dda2880 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : hit (negative entry) 2023-10-05T11:31:05.075 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:05.071+0000 7f2c4dda2880 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : hit (negative entry) 2023-10-05T11:31:05.076 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:05.073+0000 7f2c4dda2880 10 cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x17 2023-10-05T11:31:05.076 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:05.073+0000 7f2c4dda2880 10 moving default.rgw.meta+users.uid+check-tester to cache LRU end 2023-10-05T11:31:05.076 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:05.073+0000 7f2c4dda2880 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:check-tester, ofs0, ns] 2023-10-05T11:31:05.076 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:05.073+0000 7f2c46d3c640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888066 cookie 94465175441408 notifier 4658 bl.length()=559 2023-10-05T11:31:05.076 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:05.073+0000 7f2c46d3c640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x17 2023-10-05T11:31:05.076 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:05.073+0000 7f2c46d3c640 10 rgw watcher librados: moving default.rgw.meta+users.uid+check-tester to cache LRU end 2023-10-05T11:31:05.079 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:05.077+0000 7f2c4dda2880 10 cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x7 2023-10-05T11:31:05.079 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:05.077+0000 7f2c4dda2880 10 moving default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2023-10-05T11:31:05.079 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:05.077+0000 7f2c4dda2880 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.keys:OJODXSLNX4LUNHQG99PA, ofs0, ns] 2023-10-05T11:31:05.080 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:05.077+0000 7f2c46d3c640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888064 cookie 94465175439360 notifier 4658 bl.length()=186 2023-10-05T11:31:05.080 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:05.077+0000 7f2c46d3c640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x7 2023-10-05T11:31:05.080 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:05.077+0000 7f2c46d3c640 10 rgw watcher librados: moving default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2023-10-05T11:31:05.082 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:05.079+0000 7f2c33515640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:31:05.084 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:05.082+0000 7f2c4dda2880 20 remove_watcher() i=0 2023-10-05T11:31:05.084 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:05.082+0000 7f2c4dda2880 2 removed watcher, disabling cache 2023-10-05T11:31:05.086 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:05.083+0000 7f2c4dda2880 20 remove_watcher() i=1 2023-10-05T11:31:05.089 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:05.086+0000 7f2c4dda2880 20 remove_watcher() i=2 2023-10-05T11:31:05.090 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:05.088+0000 7f2c4dda2880 20 remove_watcher() i=3 2023-10-05T11:31:05.095 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:05.092+0000 7f2c4dda2880 20 remove_watcher() i=4 2023-10-05T11:31:05.096 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:05.093+0000 7f2c4dda2880 20 remove_watcher() i=5 2023-10-05T11:31:05.099 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:05.096+0000 7f2c4dda2880 20 remove_watcher() i=6 2023-10-05T11:31:05.100 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:05.097+0000 7f2c4dda2880 20 remove_watcher() i=7 2023-10-05T11:31:05.959 INFO:tasks.workunit.client.0.smithi012.stderr:TEST: recalculated bucket check stats are correct 2023-10-05T11:31:05.959 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:31:05.960 INFO:tasks.workunit.client.0.smithi012.stderr:radosgw-admin bucket check --fix --bucket check-bucket 2023-10-05T11:31:05.990 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setuser ceph since I am not root 2023-10-05T11:31:05.991 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T11:31:06.004 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.001+0000 7f2af4b36880 20 rados->read ofs=0 len=0 2023-10-05T11:31:06.005 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.002+0000 7f2af4b36880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:06.005 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.002+0000 7f2af4b36880 20 realm 2023-10-05T11:31:06.005 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.002+0000 7f2af4b36880 20 rados->read ofs=0 len=0 2023-10-05T11:31:06.005 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.002+0000 7f2af4b36880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:06.005 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.002+0000 7f2af4b36880 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T11:31:06.006 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.002+0000 7f2af4b36880 20 rados->read ofs=0 len=0 2023-10-05T11:31:06.006 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.003+0000 7f2af4b36880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:06.006 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.003+0000 7f2af4b36880 20 rados->read ofs=0 len=0 2023-10-05T11:31:06.006 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.003+0000 7f2af4b36880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:31:06.006 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.003+0000 7f2af4b36880 20 rados->read ofs=0 len=0 2023-10-05T11:31:06.007 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.004+0000 7f2af4b36880 20 rados_obj.operate() r=0 bl.length=1020 2023-10-05T11:31:06.007 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.004+0000 7f2af4b36880 20 searching for the correct realm 2023-10-05T11:31:06.016 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.014+0000 7f2af14e1640 0 -- 172.21.15.12:0/4076396379 >> [v2:172.21.15.170:6814/3150808418,v1:172.21.15.170:6816/3150808418] conn(0x5623266e3c00 msgr2=0x562325af0c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-10-05T11:31:06.019 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.015+0000 7f2af4b36880 20 RGWRados::pool_iterate: got zone_info.dff27d1e-df33-400e-a68a-7ba586947c99 2023-10-05T11:31:06.019 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.015+0000 7f2af4b36880 20 RGWRados::pool_iterate: got zonegroup_info.c78aa576-9d15-4e9d-b3c0-4af23a22062c 2023-10-05T11:31:06.019 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.015+0000 7f2af4b36880 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T11:31:06.019 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.015+0000 7f2af4b36880 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T11:31:06.019 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.015+0000 7f2af4b36880 20 rados->read ofs=0 len=0 2023-10-05T11:31:06.019 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.016+0000 7f2af4b36880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:06.019 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.016+0000 7f2af4b36880 20 rados->read ofs=0 len=0 2023-10-05T11:31:06.020 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.016+0000 7f2af4b36880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:31:06.020 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.016+0000 7f2af4b36880 20 rados->read ofs=0 len=0 2023-10-05T11:31:06.020 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.016+0000 7f2af4b36880 20 rados_obj.operate() r=0 bl.length=454 2023-10-05T11:31:06.020 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.016+0000 7f2af4b36880 20 zone default found 2023-10-05T11:31:06.020 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.016+0000 7f2af4b36880 4 Realm: () 2023-10-05T11:31:06.020 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.016+0000 7f2af4b36880 4 ZoneGroup: default (c78aa576-9d15-4e9d-b3c0-4af23a22062c) 2023-10-05T11:31:06.020 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.016+0000 7f2af4b36880 4 Zone: default (dff27d1e-df33-400e-a68a-7ba586947c99) 2023-10-05T11:31:06.020 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.016+0000 7f2af4b36880 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T11:31:06.020 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.016+0000 7f2af4b36880 20 zonegroup default 2023-10-05T11:31:06.020 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.016+0000 7f2af4b36880 20 rados->read ofs=0 len=0 2023-10-05T11:31:06.020 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.016+0000 7f2af4b36880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:06.020 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.016+0000 7f2af4b36880 20 rados->read ofs=0 len=0 2023-10-05T11:31:06.021 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.017+0000 7f2af4b36880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:06.021 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.017+0000 7f2af4b36880 20 rados->read ofs=0 len=0 2023-10-05T11:31:06.021 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.017+0000 7f2af4b36880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:06.021 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.017+0000 7f2af4b36880 20 started sync module instance, tier type = 2023-10-05T11:31:06.022 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.017+0000 7f2af4b36880 20 started zone id=dff27d1e-df33-400e-a68a-7ba586947c99 (name=default) with tier type = 2023-10-05T11:31:06.025 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.023+0000 7f2af1ce2640 0 -- 172.21.15.12:0/4076396379 >> [v2:172.21.15.170:6800/4137726411,v1:172.21.15.170:6801/4137726411] conn(0x5623266e2800 msgr2=0x562325bad600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-10-05T11:31:06.029 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.026+0000 7f2af4b36880 20 add_watcher() i=0 2023-10-05T11:31:06.029 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.026+0000 7f2af4b36880 20 add_watcher() i=1 2023-10-05T11:31:06.029 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.026+0000 7f2af4b36880 20 add_watcher() i=2 2023-10-05T11:31:06.029 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.026+0000 7f2af4b36880 20 add_watcher() i=3 2023-10-05T11:31:06.029 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.026+0000 7f2af4b36880 20 add_watcher() i=4 2023-10-05T11:31:06.029 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.026+0000 7f2af4b36880 20 add_watcher() i=5 2023-10-05T11:31:06.029 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.026+0000 7f2af4b36880 20 add_watcher() i=6 2023-10-05T11:31:06.030 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.027+0000 7f2af4b36880 20 add_watcher() i=7 2023-10-05T11:31:06.030 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.027+0000 7f2af4b36880 2 all 8 watchers are set, enabling cache 2023-10-05T11:31:06.031 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.029+0000 7f2ad84af640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:31:06.032 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.029+0000 7f2af4b36880 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T11:31:06.032 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.029+0000 7f2af4b36880 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T11:31:06.038 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.035+0000 7f2af4b36880 5 note: GC not initialized 2023-10-05T11:31:06.038 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.035+0000 7f2ad3ca6640 20 reqs_thread_entry: start 2023-10-05T11:31:06.038 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.035+0000 7f2af4b36880 20 init_complete bucket index max shards: 11 2023-10-05T11:31:06.038 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.035+0000 7f2af4b36880 20 Filter name: none 2023-10-05T11:31:06.038 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.035+0000 7f2ad1ca2640 20 reqs_thread_entry: start 2023-10-05T11:31:06.038 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.035+0000 7f2af4b36880 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2023-10-05T11:31:06.038 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.035+0000 7f2af4b36880 20 rados->read ofs=0 len=0 2023-10-05T11:31:06.039 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.036+0000 7f2af4b36880 20 rados_obj.operate() r=0 bl.length=190 2023-10-05T11:31:06.039 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.036+0000 7f2af4b36880 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2023-10-05T11:31:06.039 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.036+0000 7f2af4b36880 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2023-10-05T11:31:06.040 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.036+0000 7f2af4b36880 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:dff27d1e-df33-400e-a68a-7ba586947c99.4604.2 : miss 2023-10-05T11:31:06.040 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.036+0000 7f2af4b36880 20 rados->read ofs=0 len=0 2023-10-05T11:31:06.040 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.036+0000 7f2af4b36880 20 rados_obj.operate() r=0 bl.length=368 2023-10-05T11:31:06.040 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.036+0000 7f2af4b36880 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:dff27d1e-df33-400e-a68a-7ba586947c99.4604.2 info.flags=0x17 2023-10-05T11:31:06.040 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.036+0000 7f2af4b36880 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:dff27d1e-df33-400e-a68a-7ba586947c99.4604.2 to cache LRU end 2023-10-05T11:31:06.040 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.036+0000 7f2af4b36880 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T11:31:06.040 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.036+0000 7f2af4b36880 10 updating xattr: name=user.rgw.acl bl.length()=179 2023-10-05T11:31:06.040 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.036+0000 7f2af4b36880 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:dff27d1e-df33-400e-a68a-7ba586947c99.4604.2 2023-10-05T11:31:06.040 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.036+0000 7f2af4b36880 20 list_objects_ordered: starting attempt 1 2023-10-05T11:31:06.040 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.036+0000 7f2af4b36880 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2023-10-05T11:31:06.041 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.037+0000 7f2af4b36880 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2023-10-05T11:31:06.041 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.037+0000 7f2af4b36880 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2023-10-05T11:31:06.041 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.037+0000 7f2af4b36880 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2023-10-05T11:31:06.041 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.037+0000 7f2af4b36880 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2023-10-05T11:31:06.045 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.042+0000 7f2ad84af640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:31:06.047 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.044+0000 7f2af4b36880 20 remove_watcher() i=0 2023-10-05T11:31:06.047 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.044+0000 7f2af4b36880 2 removed watcher, disabling cache 2023-10-05T11:31:06.048 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.046+0000 7f2af4b36880 20 remove_watcher() i=1 2023-10-05T11:31:06.049 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.047+0000 7f2af4b36880 20 remove_watcher() i=2 2023-10-05T11:31:06.050 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.048+0000 7f2af4b36880 20 remove_watcher() i=3 2023-10-05T11:31:06.051 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.049+0000 7f2af4b36880 20 remove_watcher() i=4 2023-10-05T11:31:06.052 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.050+0000 7f2af4b36880 20 remove_watcher() i=5 2023-10-05T11:31:06.053 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.051+0000 7f2af4b36880 20 remove_watcher() i=6 2023-10-05T11:31:06.054 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.052+0000 7f2af4b36880 20 remove_watcher() i=7 2023-10-05T11:31:06.060 INFO:tasks.workunit.client.0.smithi012.stderr:radosgw-admin bucket stats --bucket check-bucket 2023-10-05T11:31:06.089 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setuser ceph since I am not root 2023-10-05T11:31:06.089 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T11:31:06.102 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.099+0000 7fdc35d1e880 20 rados->read ofs=0 len=0 2023-10-05T11:31:06.103 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.100+0000 7fdc35d1e880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:06.103 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.100+0000 7fdc35d1e880 20 realm 2023-10-05T11:31:06.104 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.100+0000 7fdc35d1e880 20 rados->read ofs=0 len=0 2023-10-05T11:31:06.104 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.101+0000 7fdc35d1e880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:06.104 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.101+0000 7fdc35d1e880 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T11:31:06.104 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.101+0000 7fdc35d1e880 20 rados->read ofs=0 len=0 2023-10-05T11:31:06.104 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.101+0000 7fdc35d1e880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:06.104 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.101+0000 7fdc35d1e880 20 rados->read ofs=0 len=0 2023-10-05T11:31:06.104 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.102+0000 7fdc35d1e880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:31:06.104 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.102+0000 7fdc35d1e880 20 rados->read ofs=0 len=0 2023-10-05T11:31:06.105 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.103+0000 7fdc35d1e880 20 rados_obj.operate() r=0 bl.length=1020 2023-10-05T11:31:06.105 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.103+0000 7fdc35d1e880 20 searching for the correct realm 2023-10-05T11:31:06.114 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.111+0000 7fdc344c3640 0 -- 172.21.15.12:0/219961022 >> [v2:172.21.15.12:6800/732466381,v1:172.21.15.12:6801/732466381] conn(0x55b115620800 msgr2=0x55b115626b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:31:06.116 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.113+0000 7fdc35d1e880 20 RGWRados::pool_iterate: got zone_info.dff27d1e-df33-400e-a68a-7ba586947c99 2023-10-05T11:31:06.116 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.113+0000 7fdc35d1e880 20 RGWRados::pool_iterate: got zonegroup_info.c78aa576-9d15-4e9d-b3c0-4af23a22062c 2023-10-05T11:31:06.116 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.113+0000 7fdc35d1e880 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T11:31:06.116 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.113+0000 7fdc35d1e880 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T11:31:06.116 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.113+0000 7fdc35d1e880 20 rados->read ofs=0 len=0 2023-10-05T11:31:06.116 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.113+0000 7fdc35d1e880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:06.116 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.113+0000 7fdc35d1e880 20 rados->read ofs=0 len=0 2023-10-05T11:31:06.117 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.114+0000 7fdc35d1e880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:31:06.117 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.114+0000 7fdc35d1e880 20 rados->read ofs=0 len=0 2023-10-05T11:31:06.117 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.114+0000 7fdc35d1e880 20 rados_obj.operate() r=0 bl.length=454 2023-10-05T11:31:06.117 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.114+0000 7fdc35d1e880 20 zone default found 2023-10-05T11:31:06.117 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.114+0000 7fdc35d1e880 4 Realm: () 2023-10-05T11:31:06.118 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.114+0000 7fdc35d1e880 4 ZoneGroup: default (c78aa576-9d15-4e9d-b3c0-4af23a22062c) 2023-10-05T11:31:06.118 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.114+0000 7fdc35d1e880 4 Zone: default (dff27d1e-df33-400e-a68a-7ba586947c99) 2023-10-05T11:31:06.118 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.114+0000 7fdc35d1e880 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T11:31:06.118 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.114+0000 7fdc35d1e880 20 zonegroup default 2023-10-05T11:31:06.118 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.114+0000 7fdc35d1e880 20 rados->read ofs=0 len=0 2023-10-05T11:31:06.118 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.114+0000 7fdc35d1e880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:06.118 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.114+0000 7fdc35d1e880 20 rados->read ofs=0 len=0 2023-10-05T11:31:06.118 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.115+0000 7fdc35d1e880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:06.118 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.115+0000 7fdc35d1e880 20 rados->read ofs=0 len=0 2023-10-05T11:31:06.119 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.115+0000 7fdc35d1e880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:06.119 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.115+0000 7fdc35d1e880 20 started sync module instance, tier type = 2023-10-05T11:31:06.119 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.115+0000 7fdc35d1e880 20 started zone id=dff27d1e-df33-400e-a68a-7ba586947c99 (name=default) with tier type = 2023-10-05T11:31:06.123 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.121+0000 7fdc344c3640 0 -- 172.21.15.12:0/219961022 >> [v2:172.21.15.12:6800/732466381,v1:172.21.15.12:6801/732466381] conn(0x55b11572b000 msgr2=0x55b115628100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:31:06.127 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.125+0000 7fdc35d1e880 20 add_watcher() i=0 2023-10-05T11:31:06.127 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.125+0000 7fdc35d1e880 20 add_watcher() i=1 2023-10-05T11:31:06.127 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.125+0000 7fdc35d1e880 20 add_watcher() i=2 2023-10-05T11:31:06.127 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.125+0000 7fdc35d1e880 20 add_watcher() i=3 2023-10-05T11:31:06.128 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.125+0000 7fdc35d1e880 20 add_watcher() i=4 2023-10-05T11:31:06.128 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.125+0000 7fdc35d1e880 20 add_watcher() i=5 2023-10-05T11:31:06.128 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.125+0000 7fdc35d1e880 20 add_watcher() i=6 2023-10-05T11:31:06.129 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.126+0000 7fdc35d1e880 20 add_watcher() i=7 2023-10-05T11:31:06.129 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.126+0000 7fdc35d1e880 2 all 8 watchers are set, enabling cache 2023-10-05T11:31:06.131 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.128+0000 7fdc1b491640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:31:06.131 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.128+0000 7fdc35d1e880 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T11:31:06.131 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.128+0000 7fdc35d1e880 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T11:31:06.137 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.134+0000 7fdc35d1e880 5 note: GC not initialized 2023-10-05T11:31:06.137 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.134+0000 7fdc16c88640 20 reqs_thread_entry: start 2023-10-05T11:31:06.137 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.134+0000 7fdc35d1e880 20 init_complete bucket index max shards: 11 2023-10-05T11:31:06.137 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.134+0000 7fdc35d1e880 20 Filter name: none 2023-10-05T11:31:06.137 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.134+0000 7fdc14c84640 20 reqs_thread_entry: start 2023-10-05T11:31:06.137 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.134+0000 7fdc35d1e880 20 rados->read ofs=0 len=0 2023-10-05T11:31:06.138 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.135+0000 7fdc35d1e880 20 rados_obj.operate() r=0 bl.length=190 2023-10-05T11:31:06.138 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.135+0000 7fdc35d1e880 20 rados->read ofs=0 len=0 2023-10-05T11:31:06.139 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.135+0000 7fdc35d1e880 20 rados_obj.operate() r=0 bl.length=368 2023-10-05T11:31:06.139 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.135+0000 7fdc35d1e880 20 couldn't put binfo cache entry, might have raced with data changes 2023-10-05T11:31:06.139 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.135+0000 7fdc35d1e880 20 rados->read ofs=0 len=0 2023-10-05T11:31:06.139 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.135+0000 7fdc35d1e880 20 rados_obj.operate() r=0 bl.length=190 2023-10-05T11:31:06.139 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.135+0000 7fdc35d1e880 20 rados->read ofs=0 len=0 2023-10-05T11:31:06.139 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.136+0000 7fdc35d1e880 20 rados_obj.operate() r=0 bl.length=368 2023-10-05T11:31:06.139 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.136+0000 7fdc35d1e880 20 couldn't put binfo cache entry, might have raced with data changes 2023-10-05T11:31:06.140 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.137+0000 7fdc35d1e880 20 rados->read ofs=0 len=0 2023-10-05T11:31:06.140 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.137+0000 7fdc35d1e880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:06.140 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.137+0000 7fdc1b491640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:31:06.142 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.140+0000 7fdc35d1e880 20 remove_watcher() i=0 2023-10-05T11:31:06.142 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.140+0000 7fdc35d1e880 2 removed watcher, disabling cache 2023-10-05T11:31:06.143 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.141+0000 7fdc35d1e880 20 remove_watcher() i=1 2023-10-05T11:31:06.145 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.142+0000 7fdc35d1e880 20 remove_watcher() i=2 2023-10-05T11:31:06.146 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.144+0000 7fdc35d1e880 20 remove_watcher() i=3 2023-10-05T11:31:06.147 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.145+0000 7fdc35d1e880 20 remove_watcher() i=4 2023-10-05T11:31:06.148 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.146+0000 7fdc35d1e880 20 remove_watcher() i=5 2023-10-05T11:31:06.149 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.147+0000 7fdc35d1e880 20 remove_watcher() i=6 2023-10-05T11:31:06.150 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.148+0000 7fdc35d1e880 20 remove_watcher() i=7 2023-10-05T11:31:06.155 INFO:tasks.workunit.client.0.smithi012.stderr:{'rgw.main': {'size': 54, 'size_actual': 24576, 'size_utilized': 76, 'size_kb': 1, 'size_kb_actual': 24, 'size_kb_utilized': 1, 'num_objects': 6}} 2023-10-05T11:31:06.155 INFO:tasks.workunit.client.0.smithi012.stderr:TEST: bucket check unlinked does not report normal entries 2023-10-05T11:31:06.155 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:31:06.156 INFO:tasks.workunit.client.0.smithi012.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2023-10-05T11:31:06.188 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setuser ceph since I am not root 2023-10-05T11:31:06.188 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T11:31:06.202 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.199+0000 7f9aafc44880 20 rados->read ofs=0 len=0 2023-10-05T11:31:06.203 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.200+0000 7f9aafc44880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:06.203 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.200+0000 7f9aafc44880 20 realm 2023-10-05T11:31:06.204 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.200+0000 7f9aafc44880 20 rados->read ofs=0 len=0 2023-10-05T11:31:06.204 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.201+0000 7f9aafc44880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:06.204 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.201+0000 7f9aafc44880 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T11:31:06.204 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.201+0000 7f9aafc44880 20 rados->read ofs=0 len=0 2023-10-05T11:31:06.204 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.201+0000 7f9aafc44880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:06.204 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.201+0000 7f9aafc44880 20 rados->read ofs=0 len=0 2023-10-05T11:31:06.204 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.202+0000 7f9aafc44880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:31:06.204 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.202+0000 7f9aafc44880 20 rados->read ofs=0 len=0 2023-10-05T11:31:06.205 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.202+0000 7f9aafc44880 20 rados_obj.operate() r=0 bl.length=1020 2023-10-05T11:31:06.205 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.202+0000 7f9aafc44880 20 searching for the correct realm 2023-10-05T11:31:06.212 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.210+0000 7f9aae3f0640 0 -- 172.21.15.12:0/1061108155 >> [v2:172.21.15.170:6814/3150808418,v1:172.21.15.170:6816/3150808418] conn(0x55caf3235000 msgr2=0x55caf2590c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:31:06.216 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.212+0000 7f9aafc44880 20 RGWRados::pool_iterate: got zone_info.dff27d1e-df33-400e-a68a-7ba586947c99 2023-10-05T11:31:06.216 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.212+0000 7f9aafc44880 20 RGWRados::pool_iterate: got zonegroup_info.c78aa576-9d15-4e9d-b3c0-4af23a22062c 2023-10-05T11:31:06.216 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.212+0000 7f9aafc44880 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T11:31:06.216 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.212+0000 7f9aafc44880 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T11:31:06.216 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.212+0000 7f9aafc44880 20 rados->read ofs=0 len=0 2023-10-05T11:31:06.216 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.212+0000 7f9aafc44880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:06.216 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.212+0000 7f9aafc44880 20 rados->read ofs=0 len=0 2023-10-05T11:31:06.216 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.213+0000 7f9aafc44880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:31:06.217 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.213+0000 7f9aafc44880 20 rados->read ofs=0 len=0 2023-10-05T11:31:06.217 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.213+0000 7f9aafc44880 20 rados_obj.operate() r=0 bl.length=454 2023-10-05T11:31:06.217 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.213+0000 7f9aafc44880 20 zone default found 2023-10-05T11:31:06.217 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.213+0000 7f9aafc44880 4 Realm: () 2023-10-05T11:31:06.217 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.213+0000 7f9aafc44880 4 ZoneGroup: default (c78aa576-9d15-4e9d-b3c0-4af23a22062c) 2023-10-05T11:31:06.217 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.213+0000 7f9aafc44880 4 Zone: default (dff27d1e-df33-400e-a68a-7ba586947c99) 2023-10-05T11:31:06.217 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.213+0000 7f9aafc44880 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T11:31:06.217 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.213+0000 7f9aafc44880 20 zonegroup default 2023-10-05T11:31:06.217 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.213+0000 7f9aafc44880 20 rados->read ofs=0 len=0 2023-10-05T11:31:06.217 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.213+0000 7f9aafc44880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:06.217 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.213+0000 7f9aafc44880 20 rados->read ofs=0 len=0 2023-10-05T11:31:06.218 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.214+0000 7f9aafc44880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:06.218 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.214+0000 7f9aafc44880 20 rados->read ofs=0 len=0 2023-10-05T11:31:06.218 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.214+0000 7f9aaebf1640 0 -- 172.21.15.12:0/1061108155 >> [v2:172.21.15.12:6824/2171933159,v1:172.21.15.12:6825/2171933159] conn(0x55caf3235000 msgr2=0x55caf2590c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:31:06.418 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.415+0000 7f9aafc44880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:06.418 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.415+0000 7f9aafc44880 20 started sync module instance, tier type = 2023-10-05T11:31:06.418 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.415+0000 7f9aafc44880 20 started zone id=dff27d1e-df33-400e-a68a-7ba586947c99 (name=default) with tier type = 2023-10-05T11:31:06.437 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.435+0000 7f9aafc44880 20 add_watcher() i=0 2023-10-05T11:31:06.438 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.435+0000 7f9aafc44880 20 add_watcher() i=1 2023-10-05T11:31:06.438 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.435+0000 7f9aafc44880 20 add_watcher() i=2 2023-10-05T11:31:06.438 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.435+0000 7f9aafc44880 20 add_watcher() i=3 2023-10-05T11:31:06.438 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.435+0000 7f9aafc44880 20 add_watcher() i=4 2023-10-05T11:31:06.438 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.435+0000 7f9aafc44880 20 add_watcher() i=5 2023-10-05T11:31:06.438 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.435+0000 7f9aafc44880 20 add_watcher() i=6 2023-10-05T11:31:06.440 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.437+0000 7f9aafc44880 20 add_watcher() i=7 2023-10-05T11:31:06.440 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.437+0000 7f9aafc44880 2 all 8 watchers are set, enabling cache 2023-10-05T11:31:06.441 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.439+0000 7f9a953be640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:31:06.442 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.439+0000 7f9aafc44880 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T11:31:06.442 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.439+0000 7f9aafc44880 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T11:31:06.448 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.445+0000 7f9aafc44880 5 note: GC not initialized 2023-10-05T11:31:06.448 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.445+0000 7f9a90bb5640 20 reqs_thread_entry: start 2023-10-05T11:31:06.448 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.445+0000 7f9aafc44880 20 init_complete bucket index max shards: 11 2023-10-05T11:31:06.448 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.445+0000 7f9aafc44880 20 Filter name: none 2023-10-05T11:31:06.448 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.445+0000 7f9a8ebb1640 20 reqs_thread_entry: start 2023-10-05T11:31:06.448 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.445+0000 7f9aafc44880 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2023-10-05T11:31:06.448 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.445+0000 7f9aafc44880 20 rados->read ofs=0 len=0 2023-10-05T11:31:06.449 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.446+0000 7f9aafc44880 20 rados_obj.operate() r=0 bl.length=190 2023-10-05T11:31:06.449 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.446+0000 7f9aafc44880 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2023-10-05T11:31:06.449 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.446+0000 7f9aafc44880 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2023-10-05T11:31:06.450 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.446+0000 7f9aafc44880 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:dff27d1e-df33-400e-a68a-7ba586947c99.4604.2 : miss 2023-10-05T11:31:06.450 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.446+0000 7f9aafc44880 20 rados->read ofs=0 len=0 2023-10-05T11:31:06.450 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.446+0000 7f9aafc44880 20 rados_obj.operate() r=0 bl.length=368 2023-10-05T11:31:06.450 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.446+0000 7f9aafc44880 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:dff27d1e-df33-400e-a68a-7ba586947c99.4604.2 info.flags=0x17 2023-10-05T11:31:06.450 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.446+0000 7f9aafc44880 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:dff27d1e-df33-400e-a68a-7ba586947c99.4604.2 to cache LRU end 2023-10-05T11:31:06.450 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.446+0000 7f9aafc44880 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T11:31:06.450 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.446+0000 7f9aafc44880 10 updating xattr: name=user.rgw.acl bl.length()=179 2023-10-05T11:31:06.450 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.446+0000 7f9aafc44880 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:dff27d1e-df33-400e-a68a-7ba586947c99.4604.2 2023-10-05T11:31:06.450 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.446+0000 7f9aafc44880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.0 2023-10-05T11:31:06.450 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.447+0000 7f9aafc44880 1 NOTICE: finished shard 0 (0 entries found) 2023-10-05T11:31:06.450 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.447+0000 7f9aafc44880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.1 2023-10-05T11:31:06.451 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.447+0000 7f9aafc44880 1 NOTICE: finished shard 1 (0 entries found) 2023-10-05T11:31:06.451 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.447+0000 7f9aafc44880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.2 2023-10-05T11:31:06.451 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.448+0000 7f9aafc44880 1 NOTICE: finished shard 2 (0 entries found) 2023-10-05T11:31:06.451 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.448+0000 7f9aafc44880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.3 2023-10-05T11:31:06.451 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.448+0000 7f9aafc44880 1 NOTICE: finished shard 3 (0 entries found) 2023-10-05T11:31:06.451 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.448+0000 7f9aafc44880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.4 2023-10-05T11:31:06.452 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.449+0000 7f9aafc44880 1 NOTICE: finished shard 4 (0 entries found) 2023-10-05T11:31:06.452 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.449+0000 7f9aafc44880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.5 2023-10-05T11:31:06.452 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.449+0000 7f9aafc44880 1 NOTICE: finished shard 5 (0 entries found) 2023-10-05T11:31:06.452 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.449+0000 7f9aafc44880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.6 2023-10-05T11:31:06.453 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.450+0000 7f9aafc44880 1 NOTICE: finished shard 6 (0 entries found) 2023-10-05T11:31:06.453 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.450+0000 7f9aafc44880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.7 2023-10-05T11:31:06.453 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.450+0000 7f9aafc44880 1 NOTICE: finished shard 7 (0 entries found) 2023-10-05T11:31:06.453 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.450+0000 7f9aafc44880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.8 2023-10-05T11:31:06.453 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.451+0000 7f9aafc44880 1 NOTICE: finished shard 8 (0 entries found) 2023-10-05T11:31:06.454 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.451+0000 7f9aafc44880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.9 2023-10-05T11:31:06.454 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.451+0000 7f9aafc44880 1 NOTICE: finished shard 9 (0 entries found) 2023-10-05T11:31:06.454 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.451+0000 7f9aafc44880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.10 2023-10-05T11:31:06.454 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.451+0000 7f9aafc44880 1 NOTICE: finished shard 10 (0 entries found) 2023-10-05T11:31:06.454 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.451+0000 7f9aafc44880 1 NOTICE: finished all shards (0 entries found) 2023-10-05T11:31:06.455 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.452+0000 7f9a953be640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:31:06.457 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.455+0000 7f9aafc44880 20 remove_watcher() i=0 2023-10-05T11:31:06.458 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.455+0000 7f9aafc44880 2 removed watcher, disabling cache 2023-10-05T11:31:06.458 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.456+0000 7f9aafc44880 20 remove_watcher() i=1 2023-10-05T11:31:06.459 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.457+0000 7f9aafc44880 20 remove_watcher() i=2 2023-10-05T11:31:06.460 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.458+0000 7f9aafc44880 20 remove_watcher() i=3 2023-10-05T11:31:06.461 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.459+0000 7f9aafc44880 20 remove_watcher() i=4 2023-10-05T11:31:06.463 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.460+0000 7f9aafc44880 20 remove_watcher() i=5 2023-10-05T11:31:06.466 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.463+0000 7f9aafc44880 20 remove_watcher() i=6 2023-10-05T11:31:06.467 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:06.464+0000 7f9aafc44880 20 remove_watcher() i=7 2023-10-05T11:31:06.473 INFO:tasks.workunit.client.0.smithi012.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2023-10-05T11:31:06.869 INFO:tasks.workunit.client.0.smithi012.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2023-10-05T11:31:08.361 INFO:tasks.workunit.client.0.smithi012.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2023-10-05T11:31:08.363 INFO:tasks.workunit.client.0.smithi012.stderr:radosgw-admin bi list --bucket check-bucket --object c 2023-10-05T11:31:08.395 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setuser ceph since I am not root 2023-10-05T11:31:08.395 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T11:31:08.410 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.407+0000 7fe64e523880 20 rados->read ofs=0 len=0 2023-10-05T11:31:08.412 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.409+0000 7fe64e523880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:08.412 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.409+0000 7fe64e523880 20 realm 2023-10-05T11:31:08.412 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.409+0000 7fe64e523880 20 rados->read ofs=0 len=0 2023-10-05T11:31:08.412 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.409+0000 7fe64e523880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:08.412 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.409+0000 7fe64e523880 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T11:31:08.412 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.409+0000 7fe64e523880 20 rados->read ofs=0 len=0 2023-10-05T11:31:08.412 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.409+0000 7fe64e523880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:08.412 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.409+0000 7fe64e523880 20 rados->read ofs=0 len=0 2023-10-05T11:31:08.413 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.410+0000 7fe64e523880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:31:08.413 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.410+0000 7fe64e523880 20 rados->read ofs=0 len=0 2023-10-05T11:31:08.414 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.411+0000 7fe64e523880 20 rados_obj.operate() r=0 bl.length=1020 2023-10-05T11:31:08.414 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.411+0000 7fe64e523880 20 searching for the correct realm 2023-10-05T11:31:08.424 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.422+0000 7fe64ae6e640 0 -- 172.21.15.12:0/2263644498 >> [v2:172.21.15.12:6800/732466381,v1:172.21.15.12:6801/732466381] conn(0x562b6c779800 msgr2=0x562b6c680b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:31:08.426 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.423+0000 7fe64e523880 20 RGWRados::pool_iterate: got zone_info.dff27d1e-df33-400e-a68a-7ba586947c99 2023-10-05T11:31:08.426 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.423+0000 7fe64e523880 20 RGWRados::pool_iterate: got zonegroup_info.c78aa576-9d15-4e9d-b3c0-4af23a22062c 2023-10-05T11:31:08.426 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.423+0000 7fe64e523880 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T11:31:08.426 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.423+0000 7fe64e523880 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T11:31:08.426 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.423+0000 7fe64e523880 20 rados->read ofs=0 len=0 2023-10-05T11:31:08.427 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.424+0000 7fe64e523880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:08.427 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.424+0000 7fe64e523880 20 rados->read ofs=0 len=0 2023-10-05T11:31:08.427 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.424+0000 7fe64e523880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:31:08.427 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.424+0000 7fe64e523880 20 rados->read ofs=0 len=0 2023-10-05T11:31:08.427 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.424+0000 7fe64e523880 20 rados_obj.operate() r=0 bl.length=454 2023-10-05T11:31:08.427 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.424+0000 7fe64e523880 20 zone default found 2023-10-05T11:31:08.428 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.424+0000 7fe64e523880 4 Realm: () 2023-10-05T11:31:08.428 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.424+0000 7fe64e523880 4 ZoneGroup: default (c78aa576-9d15-4e9d-b3c0-4af23a22062c) 2023-10-05T11:31:08.428 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.424+0000 7fe64e523880 4 Zone: default (dff27d1e-df33-400e-a68a-7ba586947c99) 2023-10-05T11:31:08.428 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.424+0000 7fe64e523880 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T11:31:08.428 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.424+0000 7fe64e523880 20 zonegroup default 2023-10-05T11:31:08.428 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.424+0000 7fe64e523880 20 rados->read ofs=0 len=0 2023-10-05T11:31:08.428 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.425+0000 7fe64e523880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:08.428 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.425+0000 7fe64e523880 20 rados->read ofs=0 len=0 2023-10-05T11:31:08.429 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.425+0000 7fe64e523880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:08.429 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.425+0000 7fe64e523880 20 rados->read ofs=0 len=0 2023-10-05T11:31:08.429 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.425+0000 7fe64e523880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:08.429 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.425+0000 7fe64e523880 20 started sync module instance, tier type = 2023-10-05T11:31:08.429 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.425+0000 7fe64e523880 20 started zone id=dff27d1e-df33-400e-a68a-7ba586947c99 (name=default) with tier type = 2023-10-05T11:31:08.434 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.432+0000 7fe64b66f640 0 -- 172.21.15.12:0/2263644498 >> [v2:172.21.15.170:6800/4137726411,v1:172.21.15.170:6801/4137726411] conn(0x562b6c779c00 msgr2=0x562b6c681600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:31:08.445 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.442+0000 7fe64e523880 20 add_watcher() i=0 2023-10-05T11:31:08.581 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.442+0000 7fe64e523880 20 add_watcher() i=1 2023-10-05T11:31:08.581 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.442+0000 7fe64e523880 20 add_watcher() i=2 2023-10-05T11:31:08.581 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.442+0000 7fe64e523880 20 add_watcher() i=3 2023-10-05T11:31:08.581 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.442+0000 7fe64e523880 20 add_watcher() i=4 2023-10-05T11:31:08.581 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.442+0000 7fe64e523880 20 add_watcher() i=5 2023-10-05T11:31:08.581 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.442+0000 7fe64e523880 20 add_watcher() i=6 2023-10-05T11:31:08.586 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.445+0000 7fe64e523880 20 add_watcher() i=7 2023-10-05T11:31:08.586 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.445+0000 7fe64e523880 2 all 8 watchers are set, enabling cache 2023-10-05T11:31:08.586 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.448+0000 7fe631e3c640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:31:08.586 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.448+0000 7fe64e523880 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T11:31:08.586 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.448+0000 7fe64e523880 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T11:31:08.586 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.454+0000 7fe64e523880 5 note: GC not initialized 2023-10-05T11:31:08.586 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.454+0000 7fe62d633640 20 reqs_thread_entry: start 2023-10-05T11:31:08.586 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.454+0000 7fe64e523880 20 init_complete bucket index max shards: 11 2023-10-05T11:31:08.586 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.454+0000 7fe64e523880 20 Filter name: none 2023-10-05T11:31:08.587 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.454+0000 7fe62b62f640 20 reqs_thread_entry: start 2023-10-05T11:31:08.587 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.454+0000 7fe64e523880 20 rados->read ofs=0 len=0 2023-10-05T11:31:08.587 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.455+0000 7fe64e523880 20 rados_obj.operate() r=0 bl.length=190 2023-10-05T11:31:08.587 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.455+0000 7fe64e523880 20 rados->read ofs=0 len=0 2023-10-05T11:31:08.587 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.455+0000 7fe64e523880 20 rados_obj.operate() r=0 bl.length=368 2023-10-05T11:31:08.587 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.455+0000 7fe64e523880 20 couldn't put binfo cache entry, might have raced with data changes 2023-10-05T11:31:08.587 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.455+0000 7fe64e523880 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2023-10-05T11:31:08.587 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.455+0000 7fe64e523880 20 INFO: main: starting shard=0 2023-10-05T11:31:08.587 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.455+0000 7fe64e523880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.0 2023-10-05T11:31:08.587 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.456+0000 7fe64e523880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:31:08.588 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.456+0000 7fe64e523880 20 INFO: main: starting shard=1 2023-10-05T11:31:08.588 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.456+0000 7fe64e523880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.1 2023-10-05T11:31:08.588 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.457+0000 7fe64e523880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:31:08.588 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.457+0000 7fe64e523880 20 INFO: main: starting shard=2 2023-10-05T11:31:08.588 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.457+0000 7fe64e523880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.2 2023-10-05T11:31:08.588 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.457+0000 7fe64e523880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:31:08.588 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.457+0000 7fe64e523880 20 INFO: main: starting shard=3 2023-10-05T11:31:08.588 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.457+0000 7fe64e523880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.3 2023-10-05T11:31:08.588 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.458+0000 7fe64e523880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:31:08.589 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.458+0000 7fe64e523880 20 INFO: main: starting shard=4 2023-10-05T11:31:08.589 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.458+0000 7fe64e523880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.4 2023-10-05T11:31:08.589 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.458+0000 7fe64e523880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:31:08.589 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.458+0000 7fe64e523880 20 INFO: main: starting shard=5 2023-10-05T11:31:08.589 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.458+0000 7fe64e523880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.5 2023-10-05T11:31:08.589 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.459+0000 7fe64e523880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:31:08.589 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.459+0000 7fe64e523880 20 INFO: main: starting shard=6 2023-10-05T11:31:08.589 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.459+0000 7fe64e523880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.6 2023-10-05T11:31:08.589 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.459+0000 7fe64e523880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:31:08.589 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.459+0000 7fe64e523880 20 INFO: main: starting shard=7 2023-10-05T11:31:08.589 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.459+0000 7fe64e523880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.7 2023-10-05T11:31:08.590 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.460+0000 7fe64e523880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:31:08.590 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.460+0000 7fe64e523880 20 INFO: main: starting shard=8 2023-10-05T11:31:08.590 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.460+0000 7fe64e523880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.8 2023-10-05T11:31:08.590 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.460+0000 7fe64e523880 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2023-10-05T11:31:08.590 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.461+0000 7fe64e523880 20 INFO: main: starting shard=9 2023-10-05T11:31:08.590 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.461+0000 7fe64e523880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.9 2023-10-05T11:31:08.590 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.461+0000 7fe64e523880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:31:08.590 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.461+0000 7fe64e523880 20 INFO: main: starting shard=10 2023-10-05T11:31:08.590 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.461+0000 7fe64e523880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.10 2023-10-05T11:31:08.590 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.462+0000 7fe64e523880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:31:08.590 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.462+0000 7fe64e523880 20 INFO: main: done 2023-10-05T11:31:08.590 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.462+0000 7fe631e3c640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:31:08.591 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.465+0000 7fe64e523880 20 remove_watcher() i=0 2023-10-05T11:31:08.591 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.465+0000 7fe64e523880 2 removed watcher, disabling cache 2023-10-05T11:31:08.591 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.466+0000 7fe64e523880 20 remove_watcher() i=1 2023-10-05T11:31:08.591 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.467+0000 7fe64e523880 20 remove_watcher() i=2 2023-10-05T11:31:08.591 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.468+0000 7fe64e523880 20 remove_watcher() i=3 2023-10-05T11:31:08.591 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.470+0000 7fe64e523880 20 remove_watcher() i=4 2023-10-05T11:31:08.591 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.471+0000 7fe64e523880 20 remove_watcher() i=5 2023-10-05T11:31:08.591 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.474+0000 7fe64e523880 20 remove_watcher() i=6 2023-10-05T11:31:08.591 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.475+0000 7fe64e523880 20 remove_watcher() i=7 2023-10-05T11:31:08.608 INFO:tasks.workunit.client.0.smithi012.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2023-10-05T11:31:08.609 INFO:tasks.workunit.client.0.smithi012.stderr:radosgw-admin bi list --bucket check-bucket --object d 2023-10-05T11:31:08.639 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setuser ceph since I am not root 2023-10-05T11:31:08.640 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T11:31:08.652 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.650+0000 7fe1cc51e880 20 rados->read ofs=0 len=0 2023-10-05T11:31:08.654 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.651+0000 7fe1cc51e880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:08.654 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.651+0000 7fe1cc51e880 20 realm 2023-10-05T11:31:08.654 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.651+0000 7fe1cc51e880 20 rados->read ofs=0 len=0 2023-10-05T11:31:08.654 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.651+0000 7fe1cc51e880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:08.654 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.651+0000 7fe1cc51e880 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T11:31:08.654 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.651+0000 7fe1cc51e880 20 rados->read ofs=0 len=0 2023-10-05T11:31:08.654 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.651+0000 7fe1cc51e880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:08.654 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.651+0000 7fe1cc51e880 20 rados->read ofs=0 len=0 2023-10-05T11:31:08.655 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.652+0000 7fe1cc51e880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:31:08.655 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.652+0000 7fe1cc51e880 20 rados->read ofs=0 len=0 2023-10-05T11:31:08.655 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.653+0000 7fe1cc51e880 20 rados_obj.operate() r=0 bl.length=1020 2023-10-05T11:31:08.656 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.653+0000 7fe1cc51e880 20 searching for the correct realm 2023-10-05T11:31:08.665 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.663+0000 7fe1cb4c4640 0 -- 172.21.15.12:0/779839948 >> [v2:172.21.15.12:6824/2171933159,v1:172.21.15.12:6825/2171933159] conn(0x561b167d7c00 msgr2=0x561b16735700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:31:08.666 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.663+0000 7fe1cc51e880 20 RGWRados::pool_iterate: got zone_info.dff27d1e-df33-400e-a68a-7ba586947c99 2023-10-05T11:31:08.666 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.663+0000 7fe1cc51e880 20 RGWRados::pool_iterate: got zonegroup_info.c78aa576-9d15-4e9d-b3c0-4af23a22062c 2023-10-05T11:31:08.666 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.663+0000 7fe1cc51e880 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T11:31:08.666 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.663+0000 7fe1cc51e880 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T11:31:08.666 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.663+0000 7fe1cc51e880 20 rados->read ofs=0 len=0 2023-10-05T11:31:08.667 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.664+0000 7fe1cc51e880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:08.667 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.664+0000 7fe1cc51e880 20 rados->read ofs=0 len=0 2023-10-05T11:31:08.667 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.664+0000 7fe1cc51e880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:31:08.667 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.664+0000 7fe1cc51e880 20 rados->read ofs=0 len=0 2023-10-05T11:31:08.668 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.664+0000 7fe1cc51e880 20 rados_obj.operate() r=0 bl.length=454 2023-10-05T11:31:08.668 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.664+0000 7fe1cc51e880 20 zone default found 2023-10-05T11:31:08.668 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.664+0000 7fe1cc51e880 4 Realm: () 2023-10-05T11:31:08.668 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.664+0000 7fe1cc51e880 4 ZoneGroup: default (c78aa576-9d15-4e9d-b3c0-4af23a22062c) 2023-10-05T11:31:08.668 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.664+0000 7fe1cc51e880 4 Zone: default (dff27d1e-df33-400e-a68a-7ba586947c99) 2023-10-05T11:31:08.668 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.664+0000 7fe1cc51e880 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T11:31:08.668 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.664+0000 7fe1cc51e880 20 zonegroup default 2023-10-05T11:31:08.669 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.664+0000 7fe1cc51e880 20 rados->read ofs=0 len=0 2023-10-05T11:31:08.669 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.665+0000 7fe1cc51e880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:08.669 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.665+0000 7fe1cc51e880 20 rados->read ofs=0 len=0 2023-10-05T11:31:08.669 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.665+0000 7fe1cc51e880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:08.669 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.665+0000 7fe1cc51e880 20 rados->read ofs=0 len=0 2023-10-05T11:31:08.669 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.665+0000 7fe1cc51e880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:08.669 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.665+0000 7fe1cc51e880 20 started sync module instance, tier type = 2023-10-05T11:31:08.669 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.665+0000 7fe1cc51e880 20 started zone id=dff27d1e-df33-400e-a68a-7ba586947c99 (name=default) with tier type = 2023-10-05T11:31:08.676 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.673+0000 7fe1cb4c4640 0 -- 172.21.15.12:0/779839948 >> [v2:172.21.15.12:6824/2171933159,v1:172.21.15.12:6825/2171933159] conn(0x561b168f4c00 msgr2=0x561b167ea100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:31:08.678 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.675+0000 7fe1cc51e880 20 add_watcher() i=0 2023-10-05T11:31:08.678 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.675+0000 7fe1cc51e880 20 add_watcher() i=1 2023-10-05T11:31:08.678 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.675+0000 7fe1cc51e880 20 add_watcher() i=2 2023-10-05T11:31:08.678 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.675+0000 7fe1cc51e880 20 add_watcher() i=3 2023-10-05T11:31:08.678 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.675+0000 7fe1cc51e880 20 add_watcher() i=4 2023-10-05T11:31:08.679 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.675+0000 7fe1cc51e880 20 add_watcher() i=5 2023-10-05T11:31:08.679 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.676+0000 7fe1cc51e880 20 add_watcher() i=6 2023-10-05T11:31:08.680 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.677+0000 7fe1cc51e880 20 add_watcher() i=7 2023-10-05T11:31:08.680 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.677+0000 7fe1cc51e880 2 all 8 watchers are set, enabling cache 2023-10-05T11:31:08.681 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.679+0000 7fe1b1c91640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:31:08.682 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.679+0000 7fe1cc51e880 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T11:31:08.682 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.679+0000 7fe1cc51e880 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T11:31:08.687 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.685+0000 7fe1cc51e880 5 note: GC not initialized 2023-10-05T11:31:08.688 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.685+0000 7fe1ad488640 20 reqs_thread_entry: start 2023-10-05T11:31:08.688 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.685+0000 7fe1cc51e880 20 init_complete bucket index max shards: 11 2023-10-05T11:31:08.688 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.685+0000 7fe1cc51e880 20 Filter name: none 2023-10-05T11:31:08.688 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.685+0000 7fe1ab484640 20 reqs_thread_entry: start 2023-10-05T11:31:08.688 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.685+0000 7fe1cc51e880 20 rados->read ofs=0 len=0 2023-10-05T11:31:08.689 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.685+0000 7fe1cc51e880 20 rados_obj.operate() r=0 bl.length=190 2023-10-05T11:31:08.689 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.685+0000 7fe1cc51e880 20 rados->read ofs=0 len=0 2023-10-05T11:31:08.689 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.686+0000 7fe1cc51e880 20 rados_obj.operate() r=0 bl.length=368 2023-10-05T11:31:08.689 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.686+0000 7fe1cc51e880 20 couldn't put binfo cache entry, might have raced with data changes 2023-10-05T11:31:08.689 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.686+0000 7fe1cc51e880 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2023-10-05T11:31:08.689 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.686+0000 7fe1cc51e880 20 INFO: main: starting shard=0 2023-10-05T11:31:08.689 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.686+0000 7fe1cc51e880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.0 2023-10-05T11:31:08.690 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.686+0000 7fe1cc51e880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:31:08.690 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.686+0000 7fe1cc51e880 20 INFO: main: starting shard=1 2023-10-05T11:31:08.690 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.686+0000 7fe1cc51e880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.1 2023-10-05T11:31:08.690 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.687+0000 7fe1cc51e880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:31:08.691 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.687+0000 7fe1cc51e880 20 INFO: main: starting shard=2 2023-10-05T11:31:08.691 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.687+0000 7fe1cc51e880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.2 2023-10-05T11:31:08.691 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.687+0000 7fe1cc51e880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:31:08.691 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.687+0000 7fe1cc51e880 20 INFO: main: starting shard=3 2023-10-05T11:31:08.691 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.687+0000 7fe1cc51e880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.3 2023-10-05T11:31:08.691 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.688+0000 7fe1cc51e880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:31:08.691 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.688+0000 7fe1cc51e880 20 INFO: main: starting shard=4 2023-10-05T11:31:08.691 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.688+0000 7fe1cc51e880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.4 2023-10-05T11:31:08.692 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.688+0000 7fe1cc51e880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:31:08.692 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.688+0000 7fe1cc51e880 20 INFO: main: starting shard=5 2023-10-05T11:31:08.692 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.688+0000 7fe1cc51e880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.5 2023-10-05T11:31:08.692 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.689+0000 7fe1cc51e880 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2023-10-05T11:31:08.692 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.689+0000 7fe1cc51e880 20 INFO: main: starting shard=6 2023-10-05T11:31:08.692 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.689+0000 7fe1cc51e880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.6 2023-10-05T11:31:08.693 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.690+0000 7fe1cc51e880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:31:08.693 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.690+0000 7fe1cc51e880 20 INFO: main: starting shard=7 2023-10-05T11:31:08.693 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.690+0000 7fe1cc51e880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.7 2023-10-05T11:31:08.693 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.690+0000 7fe1cc51e880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:31:08.693 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.690+0000 7fe1cc51e880 20 INFO: main: starting shard=8 2023-10-05T11:31:08.693 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.690+0000 7fe1cc51e880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.8 2023-10-05T11:31:08.694 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.690+0000 7fe1cc51e880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:31:08.694 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.690+0000 7fe1cc51e880 20 INFO: main: starting shard=9 2023-10-05T11:31:08.694 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.691+0000 7fe1cc51e880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.9 2023-10-05T11:31:08.694 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.691+0000 7fe1cc51e880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:31:08.694 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.691+0000 7fe1cc51e880 20 INFO: main: starting shard=10 2023-10-05T11:31:08.694 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.691+0000 7fe1cc51e880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.10 2023-10-05T11:31:08.695 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.691+0000 7fe1cc51e880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:31:08.695 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.691+0000 7fe1cc51e880 20 INFO: main: done 2023-10-05T11:31:08.695 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.692+0000 7fe1b1c91640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:31:08.697 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.694+0000 7fe1cc51e880 20 remove_watcher() i=0 2023-10-05T11:31:08.697 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.694+0000 7fe1cc51e880 2 removed watcher, disabling cache 2023-10-05T11:31:08.698 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.696+0000 7fe1cc51e880 20 remove_watcher() i=1 2023-10-05T11:31:08.700 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.697+0000 7fe1cc51e880 20 remove_watcher() i=2 2023-10-05T11:31:08.701 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.698+0000 7fe1cc51e880 20 remove_watcher() i=3 2023-10-05T11:31:08.702 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.700+0000 7fe1cc51e880 20 remove_watcher() i=4 2023-10-05T11:31:08.703 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.701+0000 7fe1cc51e880 20 remove_watcher() i=5 2023-10-05T11:31:08.704 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.702+0000 7fe1cc51e880 20 remove_watcher() i=6 2023-10-05T11:31:08.705 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.703+0000 7fe1cc51e880 20 remove_watcher() i=7 2023-10-05T11:31:08.811 INFO:tasks.workunit.client.0.smithi012.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2023-10-05T11:31:08.812 INFO:tasks.workunit.client.0.smithi012.stderr:radosgw-admin bi list --bucket check-bucket --object e 2023-10-05T11:31:08.842 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setuser ceph since I am not root 2023-10-05T11:31:08.842 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T11:31:08.857 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.854+0000 7fb2fe936880 20 rados->read ofs=0 len=0 2023-10-05T11:31:08.858 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.855+0000 7fb2fe936880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:08.858 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.855+0000 7fb2fe936880 20 realm 2023-10-05T11:31:08.858 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.855+0000 7fb2fe936880 20 rados->read ofs=0 len=0 2023-10-05T11:31:08.858 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.855+0000 7fb2fe936880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:08.858 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.855+0000 7fb2fe936880 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T11:31:08.859 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.855+0000 7fb2fe936880 20 rados->read ofs=0 len=0 2023-10-05T11:31:08.859 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.856+0000 7fb2fe936880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:08.859 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:08.856+0000 7fb2fe936880 20 rados->read ofs=0 len=0 2023-10-05T11:31:09.060 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.058+0000 7fb2fe936880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:31:09.060 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.058+0000 7fb2fe936880 20 rados->read ofs=0 len=0 2023-10-05T11:31:09.061 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.058+0000 7fb2fe936880 20 rados_obj.operate() r=0 bl.length=1020 2023-10-05T11:31:09.061 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.059+0000 7fb2fe936880 20 searching for the correct realm 2023-10-05T11:31:09.068 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.066+0000 7fb2fbae2640 0 -- 172.21.15.12:0/1279001725 >> [v2:172.21.15.170:6800/4137726411,v1:172.21.15.170:6801/4137726411] conn(0x557e49c69c00 msgr2=0x557e49d39700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:31:09.072 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.069+0000 7fb2fe936880 20 RGWRados::pool_iterate: got zone_info.dff27d1e-df33-400e-a68a-7ba586947c99 2023-10-05T11:31:09.072 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.069+0000 7fb2fe936880 20 RGWRados::pool_iterate: got zonegroup_info.c78aa576-9d15-4e9d-b3c0-4af23a22062c 2023-10-05T11:31:09.072 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.069+0000 7fb2fe936880 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T11:31:09.073 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.069+0000 7fb2fe936880 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T11:31:09.073 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.069+0000 7fb2fe936880 20 rados->read ofs=0 len=0 2023-10-05T11:31:09.073 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.070+0000 7fb2fe936880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:09.073 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.070+0000 7fb2fe936880 20 rados->read ofs=0 len=0 2023-10-05T11:31:09.074 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.070+0000 7fb2fe936880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:31:09.074 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.070+0000 7fb2fe936880 20 rados->read ofs=0 len=0 2023-10-05T11:31:09.074 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.070+0000 7fb2fe936880 20 rados_obj.operate() r=0 bl.length=454 2023-10-05T11:31:09.074 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.070+0000 7fb2fe936880 20 zone default found 2023-10-05T11:31:09.075 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.070+0000 7fb2fe936880 4 Realm: () 2023-10-05T11:31:09.075 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.070+0000 7fb2fe936880 4 ZoneGroup: default (c78aa576-9d15-4e9d-b3c0-4af23a22062c) 2023-10-05T11:31:09.075 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.070+0000 7fb2fe936880 4 Zone: default (dff27d1e-df33-400e-a68a-7ba586947c99) 2023-10-05T11:31:09.075 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.070+0000 7fb2fe936880 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T11:31:09.075 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.070+0000 7fb2fe936880 20 zonegroup default 2023-10-05T11:31:09.075 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.070+0000 7fb2fe936880 20 rados->read ofs=0 len=0 2023-10-05T11:31:09.075 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.071+0000 7fb2fb2e1640 0 -- 172.21.15.12:0/1279001725 >> [v2:172.21.15.12:6808/396693578,v1:172.21.15.12:6809/396693578] conn(0x557e49d5f000 msgr2=0x557e49d68000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:31:09.075 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.071+0000 7fb2fe936880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:09.075 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.071+0000 7fb2fe936880 20 rados->read ofs=0 len=0 2023-10-05T11:31:09.075 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.071+0000 7fb2fe936880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:09.075 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.071+0000 7fb2fe936880 20 rados->read ofs=0 len=0 2023-10-05T11:31:09.076 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.071+0000 7fb2fe936880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:09.076 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.071+0000 7fb2fe936880 20 started sync module instance, tier type = 2023-10-05T11:31:09.076 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.071+0000 7fb2fe936880 20 started zone id=dff27d1e-df33-400e-a68a-7ba586947c99 (name=default) with tier type = 2023-10-05T11:31:09.085 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.082+0000 7fb2fe936880 20 add_watcher() i=0 2023-10-05T11:31:09.085 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.082+0000 7fb2fe936880 20 add_watcher() i=1 2023-10-05T11:31:09.085 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.082+0000 7fb2fe936880 20 add_watcher() i=2 2023-10-05T11:31:09.085 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.082+0000 7fb2fe936880 20 add_watcher() i=3 2023-10-05T11:31:09.085 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.082+0000 7fb2fe936880 20 add_watcher() i=4 2023-10-05T11:31:09.085 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.082+0000 7fb2fe936880 20 add_watcher() i=5 2023-10-05T11:31:09.085 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.082+0000 7fb2fe936880 20 add_watcher() i=6 2023-10-05T11:31:09.086 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.083+0000 7fb2fe936880 20 add_watcher() i=7 2023-10-05T11:31:09.086 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.083+0000 7fb2fe936880 2 all 8 watchers are set, enabling cache 2023-10-05T11:31:09.088 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.085+0000 7fb2e22af640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:31:09.088 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.085+0000 7fb2fe936880 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T11:31:09.088 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.085+0000 7fb2fe936880 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T11:31:09.094 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.091+0000 7fb2fe936880 5 note: GC not initialized 2023-10-05T11:31:09.094 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.091+0000 7fb2ddaa6640 20 reqs_thread_entry: start 2023-10-05T11:31:09.094 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.091+0000 7fb2fe936880 20 init_complete bucket index max shards: 11 2023-10-05T11:31:09.094 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.091+0000 7fb2fe936880 20 Filter name: none 2023-10-05T11:31:09.094 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.091+0000 7fb2dbaa2640 20 reqs_thread_entry: start 2023-10-05T11:31:09.094 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.091+0000 7fb2fe936880 20 rados->read ofs=0 len=0 2023-10-05T11:31:09.095 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.092+0000 7fb2fe936880 20 rados_obj.operate() r=0 bl.length=190 2023-10-05T11:31:09.095 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.092+0000 7fb2fe936880 20 rados->read ofs=0 len=0 2023-10-05T11:31:09.095 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.092+0000 7fb2fe936880 20 rados_obj.operate() r=0 bl.length=368 2023-10-05T11:31:09.095 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.092+0000 7fb2fe936880 20 couldn't put binfo cache entry, might have raced with data changes 2023-10-05T11:31:09.096 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.092+0000 7fb2fe936880 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2023-10-05T11:31:09.096 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.092+0000 7fb2fe936880 20 INFO: main: starting shard=0 2023-10-05T11:31:09.096 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.092+0000 7fb2fe936880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.0 2023-10-05T11:31:09.096 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.093+0000 7fb2fe936880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:31:09.096 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.093+0000 7fb2fe936880 20 INFO: main: starting shard=1 2023-10-05T11:31:09.096 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.093+0000 7fb2fe936880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.1 2023-10-05T11:31:09.097 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.093+0000 7fb2fe936880 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2023-10-05T11:31:09.097 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.093+0000 7fb2fe936880 20 INFO: main: starting shard=2 2023-10-05T11:31:09.097 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.093+0000 7fb2fe936880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.2 2023-10-05T11:31:09.097 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.094+0000 7fb2fe936880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:31:09.097 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.094+0000 7fb2fe936880 20 INFO: main: starting shard=3 2023-10-05T11:31:09.097 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.094+0000 7fb2fe936880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.3 2023-10-05T11:31:09.097 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.094+0000 7fb2fe936880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:31:09.097 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.094+0000 7fb2fe936880 20 INFO: main: starting shard=4 2023-10-05T11:31:09.097 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.094+0000 7fb2fe936880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.4 2023-10-05T11:31:09.098 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.095+0000 7fb2fe936880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:31:09.098 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.095+0000 7fb2fe936880 20 INFO: main: starting shard=5 2023-10-05T11:31:09.098 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.095+0000 7fb2fe936880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.5 2023-10-05T11:31:09.099 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.095+0000 7fb2fe936880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:31:09.099 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.095+0000 7fb2fe936880 20 INFO: main: starting shard=6 2023-10-05T11:31:09.099 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.095+0000 7fb2fe936880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.6 2023-10-05T11:31:09.099 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.095+0000 7fb2fe936880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:31:09.099 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.095+0000 7fb2fe936880 20 INFO: main: starting shard=7 2023-10-05T11:31:09.099 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.095+0000 7fb2fe936880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.7 2023-10-05T11:31:09.099 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.096+0000 7fb2fe936880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:31:09.099 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.096+0000 7fb2fe936880 20 INFO: main: starting shard=8 2023-10-05T11:31:09.099 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.096+0000 7fb2fe936880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.8 2023-10-05T11:31:09.100 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.096+0000 7fb2fe936880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:31:09.100 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.096+0000 7fb2fe936880 20 INFO: main: starting shard=9 2023-10-05T11:31:09.100 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.096+0000 7fb2fe936880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.9 2023-10-05T11:31:09.100 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.097+0000 7fb2fe936880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:31:09.100 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.097+0000 7fb2fe936880 20 INFO: main: starting shard=10 2023-10-05T11:31:09.100 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.097+0000 7fb2fe936880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.10 2023-10-05T11:31:09.100 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.097+0000 7fb2fe936880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:31:09.100 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.097+0000 7fb2fe936880 20 INFO: main: done 2023-10-05T11:31:09.101 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.098+0000 7fb2e22af640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:31:09.103 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.100+0000 7fb2fe936880 20 remove_watcher() i=0 2023-10-05T11:31:09.103 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.100+0000 7fb2fe936880 2 removed watcher, disabling cache 2023-10-05T11:31:09.104 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.101+0000 7fb2fe936880 20 remove_watcher() i=1 2023-10-05T11:31:09.105 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.102+0000 7fb2fe936880 20 remove_watcher() i=2 2023-10-05T11:31:09.106 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.103+0000 7fb2fe936880 20 remove_watcher() i=3 2023-10-05T11:31:09.107 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.104+0000 7fb2fe936880 20 remove_watcher() i=4 2023-10-05T11:31:09.108 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.106+0000 7fb2fe936880 20 remove_watcher() i=5 2023-10-05T11:31:09.110 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.107+0000 7fb2fe936880 20 remove_watcher() i=6 2023-10-05T11:31:09.111 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.108+0000 7fb2fe936880 20 remove_watcher() i=7 2023-10-05T11:31:09.215 INFO:tasks.workunit.client.0.smithi012.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2023-10-05T11:31:09.216 INFO:tasks.workunit.client.0.smithi012.stderr:radosgw-admin bi list --bucket check-bucket --object f 2023-10-05T11:31:09.247 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setuser ceph since I am not root 2023-10-05T11:31:09.247 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T11:31:09.260 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.257+0000 7f8c49412880 20 rados->read ofs=0 len=0 2023-10-05T11:31:09.262 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.259+0000 7f8c49412880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:09.262 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.259+0000 7f8c49412880 20 realm 2023-10-05T11:31:09.262 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.259+0000 7f8c49412880 20 rados->read ofs=0 len=0 2023-10-05T11:31:09.262 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.259+0000 7f8c49412880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:09.262 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.259+0000 7f8c49412880 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T11:31:09.262 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.259+0000 7f8c49412880 20 rados->read ofs=0 len=0 2023-10-05T11:31:09.262 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.259+0000 7f8c49412880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:09.262 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.259+0000 7f8c49412880 20 rados->read ofs=0 len=0 2023-10-05T11:31:09.263 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.260+0000 7f8c49412880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:31:09.263 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.260+0000 7f8c49412880 20 rados->read ofs=0 len=0 2023-10-05T11:31:09.263 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.261+0000 7f8c49412880 20 rados_obj.operate() r=0 bl.length=1020 2023-10-05T11:31:09.263 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.261+0000 7f8c49412880 20 searching for the correct realm 2023-10-05T11:31:09.273 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.271+0000 7f8c458a4640 0 -- 172.21.15.12:0/603818650 >> [v2:172.21.15.170:6814/3150808418,v1:172.21.15.170:6816/3150808418] conn(0x55acdf0eb000 msgr2=0x55acde448c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:31:09.275 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.272+0000 7f8c49412880 20 RGWRados::pool_iterate: got zone_info.dff27d1e-df33-400e-a68a-7ba586947c99 2023-10-05T11:31:09.276 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.272+0000 7f8c49412880 20 RGWRados::pool_iterate: got zonegroup_info.c78aa576-9d15-4e9d-b3c0-4af23a22062c 2023-10-05T11:31:09.276 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.272+0000 7f8c49412880 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T11:31:09.276 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.272+0000 7f8c49412880 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T11:31:09.276 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.272+0000 7f8c49412880 20 rados->read ofs=0 len=0 2023-10-05T11:31:09.276 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.272+0000 7f8c49412880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:09.276 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.272+0000 7f8c49412880 20 rados->read ofs=0 len=0 2023-10-05T11:31:09.276 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.272+0000 7f8c49412880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:31:09.276 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.272+0000 7f8c49412880 20 rados->read ofs=0 len=0 2023-10-05T11:31:09.276 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.273+0000 7f8c49412880 20 rados_obj.operate() r=0 bl.length=454 2023-10-05T11:31:09.276 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.273+0000 7f8c49412880 20 zone default found 2023-10-05T11:31:09.276 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.273+0000 7f8c49412880 4 Realm: () 2023-10-05T11:31:09.277 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.273+0000 7f8c49412880 4 ZoneGroup: default (c78aa576-9d15-4e9d-b3c0-4af23a22062c) 2023-10-05T11:31:09.277 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.273+0000 7f8c49412880 4 Zone: default (dff27d1e-df33-400e-a68a-7ba586947c99) 2023-10-05T11:31:09.277 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.273+0000 7f8c49412880 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T11:31:09.277 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.273+0000 7f8c49412880 20 zonegroup default 2023-10-05T11:31:09.277 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.273+0000 7f8c49412880 20 rados->read ofs=0 len=0 2023-10-05T11:31:09.277 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.273+0000 7f8c49412880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:09.277 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.273+0000 7f8c49412880 20 rados->read ofs=0 len=0 2023-10-05T11:31:09.278 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.273+0000 7f8c49412880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:09.278 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.273+0000 7f8c49412880 20 rados->read ofs=0 len=0 2023-10-05T11:31:09.278 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.273+0000 7f8c49412880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:09.278 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.273+0000 7f8c49412880 20 started sync module instance, tier type = 2023-10-05T11:31:09.278 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.273+0000 7f8c49412880 20 started zone id=dff27d1e-df33-400e-a68a-7ba586947c99 (name=default) with tier type = 2023-10-05T11:31:09.284 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.281+0000 7f8c460a5640 0 -- 172.21.15.12:0/603818650 >> [v2:172.21.15.12:6824/2171933159,v1:172.21.15.12:6825/2171933159] conn(0x55acde5e3400 msgr2=0x55acde449700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:31:09.292 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.289+0000 7f8c49412880 20 add_watcher() i=0 2023-10-05T11:31:09.292 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.289+0000 7f8c49412880 20 add_watcher() i=1 2023-10-05T11:31:09.292 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.289+0000 7f8c49412880 20 add_watcher() i=2 2023-10-05T11:31:09.292 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.289+0000 7f8c49412880 20 add_watcher() i=3 2023-10-05T11:31:09.292 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.289+0000 7f8c49412880 20 add_watcher() i=4 2023-10-05T11:31:09.292 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.289+0000 7f8c49412880 20 add_watcher() i=5 2023-10-05T11:31:09.292 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.289+0000 7f8c49412880 20 add_watcher() i=6 2023-10-05T11:31:09.293 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.290+0000 7f8c49412880 20 add_watcher() i=7 2023-10-05T11:31:09.293 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.290+0000 7f8c49412880 2 all 8 watchers are set, enabling cache 2023-10-05T11:31:09.294 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.292+0000 7f8c2c872640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:31:09.294 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.292+0000 7f8c49412880 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T11:31:09.294 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.292+0000 7f8c49412880 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T11:31:09.300 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.297+0000 7f8c49412880 5 note: GC not initialized 2023-10-05T11:31:09.300 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.297+0000 7f8c28069640 20 reqs_thread_entry: start 2023-10-05T11:31:09.300 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.297+0000 7f8c49412880 20 init_complete bucket index max shards: 11 2023-10-05T11:31:09.300 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.298+0000 7f8c49412880 20 Filter name: none 2023-10-05T11:31:09.301 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.298+0000 7f8c26065640 20 reqs_thread_entry: start 2023-10-05T11:31:09.301 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.298+0000 7f8c49412880 20 rados->read ofs=0 len=0 2023-10-05T11:31:09.302 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.298+0000 7f8c49412880 20 rados_obj.operate() r=0 bl.length=190 2023-10-05T11:31:09.302 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.298+0000 7f8c49412880 20 rados->read ofs=0 len=0 2023-10-05T11:31:09.302 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.298+0000 7f8c49412880 20 rados_obj.operate() r=0 bl.length=368 2023-10-05T11:31:09.302 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.298+0000 7f8c49412880 20 couldn't put binfo cache entry, might have raced with data changes 2023-10-05T11:31:09.302 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.299+0000 7f8c49412880 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2023-10-05T11:31:09.302 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.299+0000 7f8c49412880 20 INFO: main: starting shard=0 2023-10-05T11:31:09.303 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.299+0000 7f8c49412880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.0 2023-10-05T11:31:09.303 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.299+0000 7f8c49412880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:31:09.303 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.299+0000 7f8c49412880 20 INFO: main: starting shard=1 2023-10-05T11:31:09.303 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.299+0000 7f8c49412880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.1 2023-10-05T11:31:09.304 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.299+0000 7f8c49412880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:31:09.304 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.299+0000 7f8c49412880 20 INFO: main: starting shard=2 2023-10-05T11:31:09.304 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.299+0000 7f8c49412880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.2 2023-10-05T11:31:09.304 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.300+0000 7f8c49412880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:31:09.304 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.300+0000 7f8c49412880 20 INFO: main: starting shard=3 2023-10-05T11:31:09.304 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.300+0000 7f8c49412880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.3 2023-10-05T11:31:09.305 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.300+0000 7f8c49412880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:31:09.305 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.300+0000 7f8c49412880 20 INFO: main: starting shard=4 2023-10-05T11:31:09.305 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.300+0000 7f8c49412880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.4 2023-10-05T11:31:09.305 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.301+0000 7f8c49412880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:31:09.305 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.301+0000 7f8c49412880 20 INFO: main: starting shard=5 2023-10-05T11:31:09.305 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.301+0000 7f8c49412880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.5 2023-10-05T11:31:09.306 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.301+0000 7f8c49412880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:31:09.306 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.301+0000 7f8c49412880 20 INFO: main: starting shard=6 2023-10-05T11:31:09.307 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.301+0000 7f8c49412880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.6 2023-10-05T11:31:09.307 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.302+0000 7f8c49412880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:31:09.307 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.302+0000 7f8c49412880 20 INFO: main: starting shard=7 2023-10-05T11:31:09.307 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.302+0000 7f8c49412880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.7 2023-10-05T11:31:09.307 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.302+0000 7f8c49412880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:31:09.307 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.302+0000 7f8c49412880 20 INFO: main: starting shard=8 2023-10-05T11:31:09.307 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.302+0000 7f8c49412880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.8 2023-10-05T11:31:09.307 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.303+0000 7f8c49412880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:31:09.307 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.303+0000 7f8c49412880 20 INFO: main: starting shard=9 2023-10-05T11:31:09.307 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.303+0000 7f8c49412880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.9 2023-10-05T11:31:09.307 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.303+0000 7f8c49412880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:31:09.308 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.303+0000 7f8c49412880 20 INFO: main: starting shard=10 2023-10-05T11:31:09.308 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.303+0000 7f8c49412880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.10 2023-10-05T11:31:09.308 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.303+0000 7f8c49412880 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2023-10-05T11:31:09.308 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.304+0000 7f8c49412880 20 INFO: main: done 2023-10-05T11:31:09.308 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.304+0000 7f8c2c872640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:31:09.309 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.306+0000 7f8c49412880 20 remove_watcher() i=0 2023-10-05T11:31:09.309 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.306+0000 7f8c49412880 2 removed watcher, disabling cache 2023-10-05T11:31:09.310 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.307+0000 7f8c49412880 20 remove_watcher() i=1 2023-10-05T11:31:09.311 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.308+0000 7f8c49412880 20 remove_watcher() i=2 2023-10-05T11:31:09.312 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.310+0000 7f8c49412880 20 remove_watcher() i=3 2023-10-05T11:31:09.313 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.311+0000 7f8c49412880 20 remove_watcher() i=4 2023-10-05T11:31:09.314 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.312+0000 7f8c49412880 20 remove_watcher() i=5 2023-10-05T11:31:09.315 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.313+0000 7f8c49412880 20 remove_watcher() i=6 2023-10-05T11:31:09.316 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:09.314+0000 7f8c49412880 20 remove_watcher() i=7 2023-10-05T11:31:09.341 INFO:tasks.workunit.client.0.smithi012.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2023-10-05T11:31:09.735 INFO:tasks.workunit.client.0.smithi012.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2023-10-05T11:31:10.129 INFO:tasks.workunit.client.0.smithi012.stderr:TEST: bucket check unlinked finds unlistable entries 2023-10-05T11:31:10.129 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:31:10.130 INFO:tasks.workunit.client.0.smithi012.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2023-10-05T11:31:10.162 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setuser ceph since I am not root 2023-10-05T11:31:10.162 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T11:31:10.175 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.172+0000 7faa5e736880 20 rados->read ofs=0 len=0 2023-10-05T11:31:10.176 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.174+0000 7faa5e736880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:10.176 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.174+0000 7faa5e736880 20 realm 2023-10-05T11:31:10.177 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.174+0000 7faa5e736880 20 rados->read ofs=0 len=0 2023-10-05T11:31:10.177 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.174+0000 7faa5e736880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:10.177 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.174+0000 7faa5e736880 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T11:31:10.177 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.174+0000 7faa5e736880 20 rados->read ofs=0 len=0 2023-10-05T11:31:10.177 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.174+0000 7faa5e736880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:10.177 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.174+0000 7faa5e736880 20 rados->read ofs=0 len=0 2023-10-05T11:31:10.178 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.175+0000 7faa5e736880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:31:10.178 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.175+0000 7faa5e736880 20 rados->read ofs=0 len=0 2023-10-05T11:31:10.179 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.176+0000 7faa5e736880 20 rados_obj.operate() r=0 bl.length=1020 2023-10-05T11:31:10.179 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.176+0000 7faa5e736880 20 searching for the correct realm 2023-10-05T11:31:10.188 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.186+0000 7faa5b8af640 0 -- 172.21.15.12:0/749688163 >> [v2:172.21.15.12:6813/3341239609,v1:172.21.15.12:6815/3341239609] conn(0x55f615e67800 msgr2=0x55f615274680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:31:10.191 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.188+0000 7faa5e736880 20 RGWRados::pool_iterate: got zone_info.dff27d1e-df33-400e-a68a-7ba586947c99 2023-10-05T11:31:10.191 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.188+0000 7faa5e736880 20 RGWRados::pool_iterate: got zonegroup_info.c78aa576-9d15-4e9d-b3c0-4af23a22062c 2023-10-05T11:31:10.191 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.188+0000 7faa5e736880 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T11:31:10.191 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.188+0000 7faa5e736880 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T11:31:10.191 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.188+0000 7faa5e736880 20 rados->read ofs=0 len=0 2023-10-05T11:31:10.191 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.188+0000 7faa5e736880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:10.191 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.188+0000 7faa5e736880 20 rados->read ofs=0 len=0 2023-10-05T11:31:10.192 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.188+0000 7faa5e736880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:31:10.192 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.188+0000 7faa5e736880 20 rados->read ofs=0 len=0 2023-10-05T11:31:10.192 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.189+0000 7faa5e736880 20 rados_obj.operate() r=0 bl.length=454 2023-10-05T11:31:10.193 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.189+0000 7faa5e736880 20 zone default found 2023-10-05T11:31:10.193 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.189+0000 7faa5e736880 4 Realm: () 2023-10-05T11:31:10.193 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.189+0000 7faa5e736880 4 ZoneGroup: default (c78aa576-9d15-4e9d-b3c0-4af23a22062c) 2023-10-05T11:31:10.193 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.189+0000 7faa5e736880 4 Zone: default (dff27d1e-df33-400e-a68a-7ba586947c99) 2023-10-05T11:31:10.193 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.189+0000 7faa5e736880 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T11:31:10.193 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.189+0000 7faa5e736880 20 zonegroup default 2023-10-05T11:31:10.193 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.189+0000 7faa5e736880 20 rados->read ofs=0 len=0 2023-10-05T11:31:10.193 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.189+0000 7faa5e736880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:10.193 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.189+0000 7faa5e736880 20 rados->read ofs=0 len=0 2023-10-05T11:31:10.193 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.189+0000 7faa5e736880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:10.193 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.189+0000 7faa5e736880 20 rados->read ofs=0 len=0 2023-10-05T11:31:10.193 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.190+0000 7faa5e736880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:10.194 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.190+0000 7faa5e736880 20 started sync module instance, tier type = 2023-10-05T11:31:10.194 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.190+0000 7faa5e736880 20 started zone id=dff27d1e-df33-400e-a68a-7ba586947c99 (name=default) with tier type = 2023-10-05T11:31:10.197 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.194+0000 7faa5a8ad640 0 -- 172.21.15.12:0/749688163 >> [v2:172.21.15.170:6824/75773779,v1:172.21.15.170:6825/75773779] conn(0x55f61543b000 msgr2=0x55f61532a100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:31:10.210 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.207+0000 7faa5e736880 20 add_watcher() i=0 2023-10-05T11:31:10.211 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.207+0000 7faa5e736880 20 add_watcher() i=1 2023-10-05T11:31:10.211 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.207+0000 7faa5e736880 20 add_watcher() i=2 2023-10-05T11:31:10.211 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.207+0000 7faa5e736880 20 add_watcher() i=3 2023-10-05T11:31:10.211 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.207+0000 7faa5e736880 20 add_watcher() i=4 2023-10-05T11:31:10.211 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.207+0000 7faa5e736880 20 add_watcher() i=5 2023-10-05T11:31:10.211 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.208+0000 7faa5e736880 20 add_watcher() i=6 2023-10-05T11:31:10.213 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.210+0000 7faa5e736880 20 add_watcher() i=7 2023-10-05T11:31:10.213 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.210+0000 7faa5e736880 2 all 8 watchers are set, enabling cache 2023-10-05T11:31:10.215 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.213+0000 7faa4207c640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:31:10.215 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.213+0000 7faa5e736880 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T11:31:10.216 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.213+0000 7faa5e736880 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T11:31:10.221 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.218+0000 7faa5e736880 5 note: GC not initialized 2023-10-05T11:31:10.222 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.219+0000 7faa3d873640 20 reqs_thread_entry: start 2023-10-05T11:31:10.222 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.219+0000 7faa5e736880 20 init_complete bucket index max shards: 11 2023-10-05T11:31:10.222 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.219+0000 7faa5e736880 20 Filter name: none 2023-10-05T11:31:10.222 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.219+0000 7faa3b86f640 20 reqs_thread_entry: start 2023-10-05T11:31:10.222 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.219+0000 7faa5e736880 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2023-10-05T11:31:10.222 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.219+0000 7faa5e736880 20 rados->read ofs=0 len=0 2023-10-05T11:31:10.222 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.219+0000 7faa5e736880 20 rados_obj.operate() r=0 bl.length=190 2023-10-05T11:31:10.223 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.219+0000 7faa5e736880 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2023-10-05T11:31:10.223 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.219+0000 7faa5e736880 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2023-10-05T11:31:10.223 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.219+0000 7faa5e736880 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:dff27d1e-df33-400e-a68a-7ba586947c99.4604.2 : miss 2023-10-05T11:31:10.223 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.219+0000 7faa5e736880 20 rados->read ofs=0 len=0 2023-10-05T11:31:10.224 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.220+0000 7faa5e736880 20 rados_obj.operate() r=0 bl.length=368 2023-10-05T11:31:10.224 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.220+0000 7faa5e736880 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:dff27d1e-df33-400e-a68a-7ba586947c99.4604.2 info.flags=0x17 2023-10-05T11:31:10.224 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.220+0000 7faa5e736880 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:dff27d1e-df33-400e-a68a-7ba586947c99.4604.2 to cache LRU end 2023-10-05T11:31:10.224 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.220+0000 7faa5e736880 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T11:31:10.224 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.220+0000 7faa5e736880 10 updating xattr: name=user.rgw.acl bl.length()=179 2023-10-05T11:31:10.224 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.220+0000 7faa5e736880 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:dff27d1e-df33-400e-a68a-7ba586947c99.4604.2 2023-10-05T11:31:10.224 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.220+0000 7faa5e736880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.0 2023-10-05T11:31:10.224 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.220+0000 7faa5e736880 1 NOTICE: finished shard 0 (0 entries found) 2023-10-05T11:31:10.225 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.220+0000 7faa5e736880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.1 2023-10-05T11:31:10.225 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.221+0000 7faa5e736880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.2 2023-10-05T11:31:10.225 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.222+0000 7faa5e736880 1 NOTICE: finished shard 2 (0 entries found) 2023-10-05T11:31:10.225 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.222+0000 7faa5e736880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.3 2023-10-05T11:31:10.225 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.222+0000 7faa5e736880 1 NOTICE: finished shard 3 (0 entries found) 2023-10-05T11:31:10.226 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.222+0000 7faa5e736880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.4 2023-10-05T11:31:10.226 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.223+0000 7faa5e736880 1 NOTICE: finished shard 4 (0 entries found) 2023-10-05T11:31:10.226 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.223+0000 7faa5e736880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.5 2023-10-05T11:31:10.226 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.223+0000 7faa5e736880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.6 2023-10-05T11:31:10.227 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.224+0000 7faa5e736880 1 NOTICE: finished shard 6 (0 entries found) 2023-10-05T11:31:10.227 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.224+0000 7faa5e736880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.7 2023-10-05T11:31:10.227 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.224+0000 7faa5e736880 1 NOTICE: finished shard 7 (0 entries found) 2023-10-05T11:31:10.227 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.224+0000 7faa5e736880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.8 2023-10-05T11:31:10.227 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.225+0000 7faa5e736880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.9 2023-10-05T11:31:10.228 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.225+0000 7faa5e736880 1 NOTICE: finished shard 9 (0 entries found) 2023-10-05T11:31:10.228 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.225+0000 7faa5e736880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.10 2023-10-05T11:31:10.228 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.226+0000 7faa5e736880 1 NOTICE: finished shard 1 (1 entries found) 2023-10-05T11:31:10.228 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.226+0000 7faa5e736880 1 NOTICE: finished shard 5 (1 entries found) 2023-10-05T11:31:10.228 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.226+0000 7faa5e736880 1 NOTICE: finished shard 8 (1 entries found) 2023-10-05T11:31:10.229 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.226+0000 7faa5e736880 1 NOTICE: finished shard 10 (1 entries found) 2023-10-05T11:31:10.229 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.226+0000 7faa5e736880 1 NOTICE: finished all shards (4 entries found) 2023-10-05T11:31:10.229 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.227+0000 7faa4207c640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:31:10.232 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.229+0000 7faa5e736880 20 remove_watcher() i=0 2023-10-05T11:31:10.232 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.229+0000 7faa5e736880 2 removed watcher, disabling cache 2023-10-05T11:31:10.233 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.230+0000 7faa5e736880 20 remove_watcher() i=1 2023-10-05T11:31:10.234 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.231+0000 7faa5e736880 20 remove_watcher() i=2 2023-10-05T11:31:10.235 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.233+0000 7faa5e736880 20 remove_watcher() i=3 2023-10-05T11:31:10.236 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.234+0000 7faa5e736880 20 remove_watcher() i=4 2023-10-05T11:31:10.237 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.235+0000 7faa5e736880 20 remove_watcher() i=5 2023-10-05T11:31:10.238 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.236+0000 7faa5e736880 20 remove_watcher() i=6 2023-10-05T11:31:10.240 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.237+0000 7faa5e736880 20 remove_watcher() i=7 2023-10-05T11:31:10.244 INFO:tasks.workunit.client.0.smithi012.stderr:TEST: unlinked entries are not listable 2023-10-05T11:31:10.244 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:31:10.361 INFO:tasks.workunit.client.0.smithi012.stderr:TEST: GET returns 404 for unlinked entry keys that have no other versions 2023-10-05T11:31:10.362 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:31:10.496 INFO:tasks.workunit.client.0.smithi012.stderr:TEST: bucket check unlinked fixes unlistable entries 2023-10-05T11:31:10.496 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:31:10.497 INFO:tasks.workunit.client.0.smithi012.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2023-10-05T11:31:10.533 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setuser ceph since I am not root 2023-10-05T11:31:10.533 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T11:31:10.545 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.542+0000 7fbd00136880 20 rados->read ofs=0 len=0 2023-10-05T11:31:10.547 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.544+0000 7fbd00136880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:10.547 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.544+0000 7fbd00136880 20 realm 2023-10-05T11:31:10.547 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.544+0000 7fbd00136880 20 rados->read ofs=0 len=0 2023-10-05T11:31:10.547 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.544+0000 7fbd00136880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:10.547 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.544+0000 7fbd00136880 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T11:31:10.547 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.544+0000 7fbd00136880 20 rados->read ofs=0 len=0 2023-10-05T11:31:10.547 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.544+0000 7fbd00136880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:10.547 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.544+0000 7fbd00136880 20 rados->read ofs=0 len=0 2023-10-05T11:31:10.548 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.545+0000 7fbd00136880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:31:10.548 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.545+0000 7fbd00136880 20 rados->read ofs=0 len=0 2023-10-05T11:31:10.548 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.546+0000 7fbd00136880 20 rados_obj.operate() r=0 bl.length=1020 2023-10-05T11:31:10.549 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.546+0000 7fbd00136880 20 searching for the correct realm 2023-10-05T11:31:10.560 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.557+0000 7fbcfd339640 0 -- 172.21.15.12:0/2616203190 >> [v2:172.21.15.170:6800/4137726411,v1:172.21.15.170:6801/4137726411] conn(0x55c2ae22c000 msgr2=0x55c2ae11f600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:31:10.560 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.558+0000 7fbd00136880 20 RGWRados::pool_iterate: got zone_info.dff27d1e-df33-400e-a68a-7ba586947c99 2023-10-05T11:31:10.561 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.558+0000 7fbd00136880 20 RGWRados::pool_iterate: got zonegroup_info.c78aa576-9d15-4e9d-b3c0-4af23a22062c 2023-10-05T11:31:10.561 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.558+0000 7fbd00136880 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T11:31:10.561 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.558+0000 7fbd00136880 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T11:31:10.561 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.558+0000 7fbd00136880 20 rados->read ofs=0 len=0 2023-10-05T11:31:10.561 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.558+0000 7fbd00136880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:10.561 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.558+0000 7fbd00136880 20 rados->read ofs=0 len=0 2023-10-05T11:31:10.562 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.558+0000 7fbd00136880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:31:10.562 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.558+0000 7fbd00136880 20 rados->read ofs=0 len=0 2023-10-05T11:31:10.562 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.558+0000 7fbd00136880 20 rados_obj.operate() r=0 bl.length=454 2023-10-05T11:31:10.563 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.559+0000 7fbd00136880 20 zone default found 2023-10-05T11:31:10.563 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.559+0000 7fbd00136880 4 Realm: () 2023-10-05T11:31:10.563 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.559+0000 7fbd00136880 4 ZoneGroup: default (c78aa576-9d15-4e9d-b3c0-4af23a22062c) 2023-10-05T11:31:10.563 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.559+0000 7fbd00136880 4 Zone: default (dff27d1e-df33-400e-a68a-7ba586947c99) 2023-10-05T11:31:10.563 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.559+0000 7fbd00136880 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T11:31:10.563 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.559+0000 7fbd00136880 20 zonegroup default 2023-10-05T11:31:10.563 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.559+0000 7fbd00136880 20 rados->read ofs=0 len=0 2023-10-05T11:31:10.563 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.559+0000 7fbd00136880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:10.563 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.559+0000 7fbd00136880 20 rados->read ofs=0 len=0 2023-10-05T11:31:10.563 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.559+0000 7fbd00136880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:10.563 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.559+0000 7fbd00136880 20 rados->read ofs=0 len=0 2023-10-05T11:31:10.563 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.559+0000 7fbd00136880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:10.564 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.559+0000 7fbd00136880 20 started sync module instance, tier type = 2023-10-05T11:31:10.564 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.559+0000 7fbd00136880 20 started zone id=dff27d1e-df33-400e-a68a-7ba586947c99 (name=default) with tier type = 2023-10-05T11:31:10.575 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.572+0000 7fbcfd339640 0 -- 172.21.15.12:0/2616203190 >> [v2:172.21.15.12:6824/2171933159,v1:172.21.15.12:6825/2171933159] conn(0x55c2ae214000 msgr2=0x55c2ae065700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:31:10.575 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.572+0000 7fbd00136880 20 add_watcher() i=0 2023-10-05T11:31:10.575 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.572+0000 7fbd00136880 20 add_watcher() i=1 2023-10-05T11:31:10.575 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.572+0000 7fbd00136880 20 add_watcher() i=2 2023-10-05T11:31:10.575 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.572+0000 7fbd00136880 20 add_watcher() i=3 2023-10-05T11:31:10.576 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.572+0000 7fbd00136880 20 add_watcher() i=4 2023-10-05T11:31:10.576 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.572+0000 7fbd00136880 20 add_watcher() i=5 2023-10-05T11:31:10.576 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.572+0000 7fbd00136880 20 add_watcher() i=6 2023-10-05T11:31:10.578 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.575+0000 7fbd00136880 20 add_watcher() i=7 2023-10-05T11:31:10.578 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.575+0000 7fbd00136880 2 all 8 watchers are set, enabling cache 2023-10-05T11:31:10.581 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.578+0000 7fbce3b06640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:31:10.581 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.578+0000 7fbd00136880 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T11:31:10.581 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.578+0000 7fbd00136880 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T11:31:10.589 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.584+0000 7fbd00136880 5 note: GC not initialized 2023-10-05T11:31:10.589 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.584+0000 7fbcdf2fd640 20 reqs_thread_entry: start 2023-10-05T11:31:10.589 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.584+0000 7fbd00136880 20 init_complete bucket index max shards: 11 2023-10-05T11:31:10.589 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.584+0000 7fbd00136880 20 Filter name: none 2023-10-05T11:31:10.589 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.584+0000 7fbcdd2f9640 20 reqs_thread_entry: start 2023-10-05T11:31:10.589 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.584+0000 7fbd00136880 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2023-10-05T11:31:10.589 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.584+0000 7fbd00136880 20 rados->read ofs=0 len=0 2023-10-05T11:31:10.589 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.585+0000 7fbd00136880 20 rados_obj.operate() r=0 bl.length=190 2023-10-05T11:31:10.589 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.585+0000 7fbd00136880 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2023-10-05T11:31:10.589 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.585+0000 7fbd00136880 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2023-10-05T11:31:10.590 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.585+0000 7fbd00136880 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:dff27d1e-df33-400e-a68a-7ba586947c99.4604.2 : miss 2023-10-05T11:31:10.590 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.585+0000 7fbd00136880 20 rados->read ofs=0 len=0 2023-10-05T11:31:10.590 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.585+0000 7fbd00136880 20 rados_obj.operate() r=0 bl.length=368 2023-10-05T11:31:10.590 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.585+0000 7fbd00136880 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:dff27d1e-df33-400e-a68a-7ba586947c99.4604.2 info.flags=0x17 2023-10-05T11:31:10.590 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.585+0000 7fbd00136880 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:dff27d1e-df33-400e-a68a-7ba586947c99.4604.2 to cache LRU end 2023-10-05T11:31:10.590 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.585+0000 7fbd00136880 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T11:31:10.590 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.585+0000 7fbd00136880 10 updating xattr: name=user.rgw.acl bl.length()=179 2023-10-05T11:31:10.590 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.585+0000 7fbd00136880 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:dff27d1e-df33-400e-a68a-7ba586947c99.4604.2 2023-10-05T11:31:10.590 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.585+0000 7fbd00136880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.0 2023-10-05T11:31:10.590 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.586+0000 7fbd00136880 1 NOTICE: finished shard 0 (0 entries removed) 2023-10-05T11:31:10.590 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.586+0000 7fbd00136880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.1 2023-10-05T11:31:10.591 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.586+0000 7fbd00136880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.2 2023-10-05T11:31:10.592 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.587+0000 7fbd00136880 1 NOTICE: finished shard 2 (0 entries removed) 2023-10-05T11:31:10.592 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.587+0000 7fbd00136880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.3 2023-10-05T11:31:10.592 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.588+0000 7fbd00136880 1 NOTICE: finished shard 3 (0 entries removed) 2023-10-05T11:31:10.592 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.588+0000 7fbd00136880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.4 2023-10-05T11:31:10.592 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.588+0000 7fbd00136880 1 NOTICE: finished shard 4 (0 entries removed) 2023-10-05T11:31:10.592 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.588+0000 7fbd00136880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.5 2023-10-05T11:31:10.592 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.589+0000 7fbd00136880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.6 2023-10-05T11:31:10.592 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.589+0000 7fbd00136880 1 NOTICE: finished shard 6 (0 entries removed) 2023-10-05T11:31:10.592 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.589+0000 7fbd00136880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.7 2023-10-05T11:31:10.593 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.589+0000 7fbd00136880 1 NOTICE: finished shard 7 (0 entries removed) 2023-10-05T11:31:10.593 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.589+0000 7fbd00136880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.8 2023-10-05T11:31:10.593 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.590+0000 7fbd00136880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.9 2023-10-05T11:31:10.593 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.590+0000 7fbd00136880 1 NOTICE: finished shard 9 (0 entries removed) 2023-10-05T11:31:10.593 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.590+0000 7fbd00136880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.10 2023-10-05T11:31:10.594 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.591+0000 7fbd00136880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.1 2023-10-05T11:31:10.594 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.591+0000 7fbd00136880 20 get_obj_state: rctx=0x55c2ae152cb0 obj=check-bucket:e state=0x55c2aeb96de8 s->prefetch_data=0 2023-10-05T11:31:10.594 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.591+0000 7fbd00136880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.5 2023-10-05T11:31:10.594 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.592+0000 7fbd00136880 20 get_obj_state: rctx=0x55c2ae153570 obj=check-bucket:d state=0x55c2aeb979e8 s->prefetch_data=0 2023-10-05T11:31:10.595 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.592+0000 7fbd00136880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.8 2023-10-05T11:31:10.595 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.592+0000 7fbd00136880 20 get_obj_state: rctx=0x55c2ae153ea0 obj=check-bucket:c state=0x55c2aeb985e8 s->prefetch_data=0 2023-10-05T11:31:10.595 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.592+0000 7fbd00136880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.10 2023-10-05T11:31:10.596 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.592+0000 7fbd00136880 20 get_obj_state: rctx=0x55c2ae153f10 obj=check-bucket:f state=0x55c2aeb991e8 s->prefetch_data=0 2023-10-05T11:31:10.596 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.592+0000 7fbd00136880 20 get_obj_state: setting s->obj_tag to urooc2avbvihp79u75b98l98l4taohb3 2023-10-05T11:31:10.596 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.592+0000 7fbd00136880 20 get_obj_state_impl: setting s->olh_tag to 6eqwykcov9zeymbo3ii7h0mt6lb9bgaf 2023-10-05T11:31:10.596 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.592+0000 7fbd00136880 20 bucket_index_guard_olh_op(): olh_state.olh_tag=6eqwykcov9zeymbo3ii7h0mt6lb9bgaf 2023-10-05T11:31:10.596 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.592+0000 7fbd00136880 20 get_obj_state: setting s->obj_tag to j0jkvfgolt4idfyov5asfq4muh6wmrl9 2023-10-05T11:31:10.596 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.592+0000 7fbd00136880 20 get_obj_state_impl: setting s->olh_tag to mbptz8pgk6bfjupp5go23o6ho1by3l8z 2023-10-05T11:31:10.596 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.592+0000 7fbd00136880 20 bucket_index_guard_olh_op(): olh_state.olh_tag=mbptz8pgk6bfjupp5go23o6ho1by3l8z 2023-10-05T11:31:10.596 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.593+0000 7fbd00136880 20 get_obj_state: setting s->obj_tag to 186a3rg2527bv9evzs6bdss07z48is6u 2023-10-05T11:31:10.596 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.593+0000 7fbd00136880 20 get_obj_state_impl: setting s->olh_tag to i64n4dewk886yd43l8xgg1yil2h75hjo 2023-10-05T11:31:10.597 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.593+0000 7fbd00136880 20 bucket_index_guard_olh_op(): olh_state.olh_tag=i64n4dewk886yd43l8xgg1yil2h75hjo 2023-10-05T11:31:10.597 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.593+0000 7fbd00136880 20 get_obj_state: setting s->obj_tag to 56fh0gm0y391owui3wookk7y13wiuklo 2023-10-05T11:31:10.597 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.593+0000 7fbd00136880 20 get_obj_state_impl: setting s->olh_tag to bf7xka6z8yg5yd1cfb69pqy920p6iw1s 2023-10-05T11:31:10.597 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.593+0000 7fbd00136880 20 bucket_index_guard_olh_op(): olh_state.olh_tag=bf7xka6z8yg5yd1cfb69pqy920p6iw1s 2023-10-05T11:31:10.597 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.594+0000 7fbd00136880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.5 2023-10-05T11:31:10.599 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.596+0000 7fbd00136880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.1 2023-10-05T11:31:10.599 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.597+0000 7fbd00136880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.10 2023-10-05T11:31:10.599 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.597+0000 7fbd00136880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.8 2023-10-05T11:31:10.601 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.599+0000 7fbd00136880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.1 2023-10-05T11:31:10.602 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.599+0000 7fbd00136880 20 olh_log_entry: epoch=2 op=2 key=e[] 2023-10-05T11:31:10.602 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.599+0000 7fbd00136880 20 olh_log_entry: epoch=2 op=3 key=e[1IHuBM5DeIaETFG88c5cWDn.wTEI2D.] 2023-10-05T11:31:10.603 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.599+0000 7fbd00136880 20 get_obj_state: rctx=0x55c2ae152cb0 obj=check-bucket:_:1IHuBM5DeIaETFG88c5cWDn.wTEI2D._e state=0x55c2ae4461e8 s->prefetch_data=0 2023-10-05T11:31:10.603 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.599+0000 7fbd00136880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.5 2023-10-05T11:31:10.603 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.600+0000 7fbd00136880 10 manifest: total_size = 12 2023-10-05T11:31:10.603 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.600+0000 7fbd00136880 20 get_obj_state: setting s->obj_tag to dff27d1e-df33-400e-a68a-7ba586947c99.4543.14894624726407849663 2023-10-05T11:31:10.603 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.600+0000 7fbd00136880 20 get_obj_state: rctx=0x55c2ae152cb0 obj=check-bucket:_:1IHuBM5DeIaETFG88c5cWDn.wTEI2D._e state=0x55c2ae4461e8 s->prefetch_data=0 2023-10-05T11:31:10.603 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.600+0000 7fbd00136880 20 prepare_atomic_modification: state is not atomic. state=0x55c2ae4461e8 2023-10-05T11:31:10.603 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.600+0000 7fbd00136880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.1 2023-10-05T11:31:10.603 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.600+0000 7fbd00136880 20 olh_log_entry: epoch=3 op=3 key=d[aE8UrzUQVQPkiZFGHJJRszbEWV-2Uxw] 2023-10-05T11:31:10.603 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.600+0000 7fbd00136880 20 get_obj_state: rctx=0x55c2ae153570 obj=check-bucket:_:aE8UrzUQVQPkiZFGHJJRszbEWV-2Uxw_d state=0x55c2ae446de8 s->prefetch_data=0 2023-10-05T11:31:10.604 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.600+0000 7fbd00136880 10 manifest: total_size = 22 2023-10-05T11:31:10.604 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.600+0000 7fbd00136880 20 get_obj_state: setting s->obj_tag to dff27d1e-df33-400e-a68a-7ba586947c99.4543.9142161536944156309 2023-10-05T11:31:10.604 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.600+0000 7fbd00136880 20 get_obj_state: rctx=0x55c2ae153570 obj=check-bucket:_:aE8UrzUQVQPkiZFGHJJRszbEWV-2Uxw_d state=0x55c2ae446de8 s->prefetch_data=0 2023-10-05T11:31:10.604 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.600+0000 7fbd00136880 20 prepare_atomic_modification: state is not atomic. state=0x55c2ae446de8 2023-10-05T11:31:10.604 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.600+0000 7fbd00136880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.5 2023-10-05T11:31:10.605 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.602+0000 7fbd00136880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.8 2023-10-05T11:31:10.605 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.602+0000 7fbd00136880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.10 2023-10-05T11:31:10.605 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.602+0000 7fbd00136880 20 olh_log_entry: epoch=3 op=3 key=c[up3YSF4BJfu0W3ofFBmmelYKl89NGPd] 2023-10-05T11:31:10.605 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.602+0000 7fbd00136880 20 get_obj_state: rctx=0x55c2ae153ea0 obj=check-bucket:_:up3YSF4BJfu0W3ofFBmmelYKl89NGPd_c state=0x55c2ae4479e8 s->prefetch_data=0 2023-10-05T11:31:10.606 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.602+0000 7fbd00136880 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-10-05T11:31:10.606 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.602+0000 7fbd00136880 20 RGWObjManifest::operator++(): result: ofs=12 stripe_ofs=12 part_ofs=0 rule->part_size=0 2023-10-05T11:31:10.606 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.603+0000 7fbd00136880 0 deleting objects inline since gc isn't initialized 2023-10-05T11:31:10.606 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.603+0000 7fbd00136880 5 delete_objs_inline: removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.2__shadow:1IHuBM5DeIaETFG88c5cWDn.wTEI2D._.Ub95z42FcyPviVUq2l6nVn9qmCKriag_0 2023-10-05T11:31:10.607 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.604+0000 7fbcf6b2c640 20 handle_completion(): completion ok for obj=e[1IHuBM5DeIaETFG88c5cWDn.wTEI2D.] 2023-10-05T11:31:10.611 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.607+0000 7fbd00136880 5 delete_objs_inline: refcount put returned error -2 2023-10-05T11:31:10.611 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.607+0000 7fbd00136880 20 olh_log_entry: epoch=2 op=2 key=f[] 2023-10-05T11:31:10.611 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.607+0000 7fbd00136880 20 olh_log_entry: epoch=2 op=3 key=f[PWERdWP0PALcvY9UPT5AVzW9DaQ5mWU] 2023-10-05T11:31:10.611 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.607+0000 7fbd00136880 20 get_obj_state: rctx=0x55c2ae153f10 obj=check-bucket:_:PWERdWP0PALcvY9UPT5AVzW9DaQ5mWU_f state=0x55c2ae4485e8 s->prefetch_data=0 2023-10-05T11:31:10.611 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.607+0000 7fbd00136880 10 manifest: total_size = 22 2023-10-05T11:31:10.611 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.607+0000 7fbd00136880 20 get_obj_state: setting s->obj_tag to dff27d1e-df33-400e-a68a-7ba586947c99.4543.12153087278549530359 2023-10-05T11:31:10.611 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.607+0000 7fbd00136880 20 get_obj_state: rctx=0x55c2ae153ea0 obj=check-bucket:_:up3YSF4BJfu0W3ofFBmmelYKl89NGPd_c state=0x55c2ae4479e8 s->prefetch_data=0 2023-10-05T11:31:10.611 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.607+0000 7fbd00136880 20 prepare_atomic_modification: state is not atomic. state=0x55c2ae4479e8 2023-10-05T11:31:10.611 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.607+0000 7fbd00136880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.8 2023-10-05T11:31:10.611 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.608+0000 7fbd00136880 10 manifest: total_size = 12 2023-10-05T11:31:10.611 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.608+0000 7fbd00136880 20 get_obj_state: setting s->obj_tag to dff27d1e-df33-400e-a68a-7ba586947c99.4543.14683468368482971927 2023-10-05T11:31:10.612 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.608+0000 7fbd00136880 20 get_obj_state: rctx=0x55c2ae153f10 obj=check-bucket:_:PWERdWP0PALcvY9UPT5AVzW9DaQ5mWU_f state=0x55c2ae4485e8 s->prefetch_data=0 2023-10-05T11:31:10.612 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.608+0000 7fbd00136880 20 prepare_atomic_modification: state is not atomic. state=0x55c2ae4485e8 2023-10-05T11:31:10.612 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.608+0000 7fbd00136880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.10 2023-10-05T11:31:10.612 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.609+0000 7fbd00136880 20 get_obj_state: rctx=0x55c2ae152cb0 obj=check-bucket:e state=0x55c2aeb96de8 s->prefetch_data=0 2023-10-05T11:31:10.612 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.609+0000 7fbd00136880 20 bucket_index_guard_olh_op(): olh_state.olh_tag=6eqwykcov9zeymbo3ii7h0mt6lb9bgaf 2023-10-05T11:31:10.615 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.611+0000 7fbd00136880 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-10-05T11:31:10.615 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.611+0000 7fbd00136880 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2023-10-05T11:31:10.615 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.611+0000 7fbd00136880 0 deleting objects inline since gc isn't initialized 2023-10-05T11:31:10.615 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.611+0000 7fbd00136880 5 delete_objs_inline: removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.2__shadow:aE8UrzUQVQPkiZFGHJJRszbEWV-2Uxw_.yR3PCpKhLxeN0TinlAGSrxgPr8mQjpN_0 2023-10-05T11:31:10.619 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.617+0000 7fbd00136880 5 delete_objs_inline: refcount put returned error -2 2023-10-05T11:31:10.622 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.619+0000 7fbcf6b2c640 20 handle_completion(): completion ok for obj=d[aE8UrzUQVQPkiZFGHJJRszbEWV-2Uxw] 2023-10-05T11:31:10.622 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.620+0000 7fbd00136880 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-10-05T11:31:10.622 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.620+0000 7fbd00136880 20 RGWObjManifest::operator++(): result: ofs=12 stripe_ofs=12 part_ofs=0 rule->part_size=0 2023-10-05T11:31:10.623 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.620+0000 7fbd00136880 0 deleting objects inline since gc isn't initialized 2023-10-05T11:31:10.623 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.620+0000 7fbd00136880 5 delete_objs_inline: removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.2__shadow:PWERdWP0PALcvY9UPT5AVzW9DaQ5mWU_.Fg1haynuAYBeUVD_3Akm6z4H3_7sPSI_0 2023-10-05T11:31:10.626 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.623+0000 7fbd00136880 5 delete_objs_inline: refcount put returned error -2 2023-10-05T11:31:10.626 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.623+0000 7fbd00136880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.5 2023-10-05T11:31:10.626 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.623+0000 7fbd00136880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.5 2023-10-05T11:31:10.626 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.623+0000 7fbd00136880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.1 2023-10-05T11:31:10.626 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.623+0000 7fbd00136880 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-10-05T11:31:10.626 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.623+0000 7fbd00136880 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2023-10-05T11:31:10.626 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.623+0000 7fbd00136880 0 deleting objects inline since gc isn't initialized 2023-10-05T11:31:10.626 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.623+0000 7fbd00136880 5 delete_objs_inline: removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.2__shadow:up3YSF4BJfu0W3ofFBmmelYKl89NGPd_.m4Sy8r0pNN-j_G5LC-bImChK593CjTH_0 2023-10-05T11:31:10.626 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.623+0000 7fbcf732d640 20 handle_completion(): completion ok for obj=f[PWERdWP0PALcvY9UPT5AVzW9DaQ5mWU] 2023-10-05T11:31:10.631 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.628+0000 7fbd00136880 5 delete_objs_inline: refcount put returned error -2 2023-10-05T11:31:10.631 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.628+0000 7fbd00136880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.1 2023-10-05T11:31:10.631 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.628+0000 7fbd00136880 1 NOTICE: finished shard 1 (1 entries removed) 2023-10-05T11:31:10.631 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.628+0000 7fbd00136880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.5 2023-10-05T11:31:10.631 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.628+0000 7fbd00136880 1 NOTICE: finished shard 5 (1 entries removed) 2023-10-05T11:31:10.631 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.628+0000 7fbd00136880 20 get_obj_state: rctx=0x55c2ae153f10 obj=check-bucket:f state=0x55c2aeb991e8 s->prefetch_data=0 2023-10-05T11:31:10.631 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.628+0000 7fbd00136880 20 bucket_index_guard_olh_op(): olh_state.olh_tag=bf7xka6z8yg5yd1cfb69pqy920p6iw1s 2023-10-05T11:31:10.631 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.628+0000 7fbcf732d640 20 handle_completion(): completion ok for obj=c[up3YSF4BJfu0W3ofFBmmelYKl89NGPd] 2023-10-05T11:31:10.633 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.630+0000 7fbd00136880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.8 2023-10-05T11:31:10.633 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.630+0000 7fbd00136880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.8 2023-10-05T11:31:10.634 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.632+0000 7fbd00136880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.10 2023-10-05T11:31:10.635 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.632+0000 7fbd00136880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.8 2023-10-05T11:31:10.635 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.632+0000 7fbd00136880 1 NOTICE: finished shard 8 (1 entries removed) 2023-10-05T11:31:10.637 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.635+0000 7fbd00136880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.10 2023-10-05T11:31:10.637 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.635+0000 7fbd00136880 1 NOTICE: finished shard 10 (1 entries removed) 2023-10-05T11:31:10.637 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.635+0000 7fbd00136880 1 NOTICE: finished all shards (4 entries removed) 2023-10-05T11:31:10.638 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.635+0000 7fbce3b06640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:31:10.640 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.637+0000 7fbd00136880 20 remove_watcher() i=0 2023-10-05T11:31:10.640 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.637+0000 7fbd00136880 2 removed watcher, disabling cache 2023-10-05T11:31:10.641 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.639+0000 7fbd00136880 20 remove_watcher() i=1 2023-10-05T11:31:10.642 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.640+0000 7fbd00136880 20 remove_watcher() i=2 2023-10-05T11:31:10.643 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.641+0000 7fbd00136880 20 remove_watcher() i=3 2023-10-05T11:31:10.644 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.642+0000 7fbd00136880 20 remove_watcher() i=4 2023-10-05T11:31:10.645 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.643+0000 7fbd00136880 20 remove_watcher() i=5 2023-10-05T11:31:10.647 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.644+0000 7fbd00136880 20 remove_watcher() i=6 2023-10-05T11:31:10.648 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.645+0000 7fbd00136880 20 remove_watcher() i=7 2023-10-05T11:31:10.715 INFO:tasks.workunit.client.0.smithi012.stderr:TEST: bucket check unlinked does not affect normal entries 2023-10-05T11:31:10.715 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:31:10.855 INFO:tasks.workunit.client.0.smithi012.stderr:TEST: bucket check unlinked does not find new unlistable entries after fix 2023-10-05T11:31:10.855 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:31:10.856 INFO:tasks.workunit.client.0.smithi012.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2023-10-05T11:31:10.888 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setuser ceph since I am not root 2023-10-05T11:31:10.888 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T11:31:10.901 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.898+0000 7efdfc726880 20 rados->read ofs=0 len=0 2023-10-05T11:31:10.902 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.900+0000 7efdfc726880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:10.902 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.900+0000 7efdfc726880 20 realm 2023-10-05T11:31:10.902 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.900+0000 7efdfc726880 20 rados->read ofs=0 len=0 2023-10-05T11:31:10.903 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.900+0000 7efdfc726880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:10.903 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.900+0000 7efdfc726880 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T11:31:10.903 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.900+0000 7efdfc726880 20 rados->read ofs=0 len=0 2023-10-05T11:31:10.903 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.900+0000 7efdfc726880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:10.903 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.900+0000 7efdfc726880 20 rados->read ofs=0 len=0 2023-10-05T11:31:10.904 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.901+0000 7efdfc726880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:31:10.904 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.901+0000 7efdfc726880 20 rados->read ofs=0 len=0 2023-10-05T11:31:10.904 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.902+0000 7efdfc726880 20 rados_obj.operate() r=0 bl.length=1020 2023-10-05T11:31:10.904 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.902+0000 7efdfc726880 20 searching for the correct realm 2023-10-05T11:31:10.914 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.911+0000 7efdf8fc8640 0 -- 172.21.15.12:0/4156614632 >> [v2:172.21.15.170:6814/3150808418,v1:172.21.15.170:6816/3150808418] conn(0x5576383edc00 msgr2=0x557637810c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:31:10.915 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.912+0000 7efdfc726880 20 RGWRados::pool_iterate: got zone_info.dff27d1e-df33-400e-a68a-7ba586947c99 2023-10-05T11:31:10.915 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.912+0000 7efdfc726880 20 RGWRados::pool_iterate: got zonegroup_info.c78aa576-9d15-4e9d-b3c0-4af23a22062c 2023-10-05T11:31:10.915 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.912+0000 7efdfc726880 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T11:31:10.915 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.912+0000 7efdfc726880 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T11:31:10.915 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.912+0000 7efdfc726880 20 rados->read ofs=0 len=0 2023-10-05T11:31:10.916 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.912+0000 7efdfc726880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:10.916 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.912+0000 7efdfc726880 20 rados->read ofs=0 len=0 2023-10-05T11:31:10.917 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.913+0000 7efdfc726880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:31:10.917 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.913+0000 7efdfc726880 20 rados->read ofs=0 len=0 2023-10-05T11:31:10.917 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.913+0000 7efdfc726880 20 rados_obj.operate() r=0 bl.length=454 2023-10-05T11:31:10.917 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.913+0000 7efdfc726880 20 zone default found 2023-10-05T11:31:10.917 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.913+0000 7efdfc726880 4 Realm: () 2023-10-05T11:31:10.917 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.913+0000 7efdfc726880 4 ZoneGroup: default (c78aa576-9d15-4e9d-b3c0-4af23a22062c) 2023-10-05T11:31:10.917 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.913+0000 7efdfc726880 4 Zone: default (dff27d1e-df33-400e-a68a-7ba586947c99) 2023-10-05T11:31:10.918 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.913+0000 7efdfc726880 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T11:31:10.918 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.913+0000 7efdfc726880 20 zonegroup default 2023-10-05T11:31:10.918 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.913+0000 7efdfc726880 20 rados->read ofs=0 len=0 2023-10-05T11:31:10.918 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.913+0000 7efdfc726880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:10.918 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.913+0000 7efdfc726880 20 rados->read ofs=0 len=0 2023-10-05T11:31:10.918 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.914+0000 7efdfc726880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:10.918 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.914+0000 7efdfc726880 20 rados->read ofs=0 len=0 2023-10-05T11:31:10.919 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.914+0000 7efdfc726880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:10.919 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.914+0000 7efdfc726880 20 started sync module instance, tier type = 2023-10-05T11:31:10.919 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.914+0000 7efdfc726880 20 started zone id=dff27d1e-df33-400e-a68a-7ba586947c99 (name=default) with tier type = 2023-10-05T11:31:10.923 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.921+0000 7efdf97c9640 0 -- 172.21.15.12:0/4156614632 >> [v2:172.21.15.12:6824/2171933159,v1:172.21.15.12:6825/2171933159] conn(0x5576379b2c00 msgr2=0x557637811700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:31:10.928 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.925+0000 7efdfc726880 20 add_watcher() i=0 2023-10-05T11:31:10.928 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.925+0000 7efdfc726880 20 add_watcher() i=1 2023-10-05T11:31:10.928 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.925+0000 7efdfc726880 20 add_watcher() i=2 2023-10-05T11:31:10.928 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.925+0000 7efdfc726880 20 add_watcher() i=3 2023-10-05T11:31:10.929 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.925+0000 7efdfc726880 20 add_watcher() i=4 2023-10-05T11:31:10.929 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.925+0000 7efdfc726880 20 add_watcher() i=5 2023-10-05T11:31:10.929 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.925+0000 7efdfc726880 20 add_watcher() i=6 2023-10-05T11:31:10.929 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.926+0000 7efdfc726880 20 add_watcher() i=7 2023-10-05T11:31:10.929 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.926+0000 7efdfc726880 2 all 8 watchers are set, enabling cache 2023-10-05T11:31:10.930 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.928+0000 7efddff96640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:31:10.931 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.928+0000 7efdfc726880 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T11:31:10.931 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.928+0000 7efdfc726880 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T11:31:10.937 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.934+0000 7efdfc726880 5 note: GC not initialized 2023-10-05T11:31:10.937 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.934+0000 7efddb78d640 20 reqs_thread_entry: start 2023-10-05T11:31:10.937 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.934+0000 7efdfc726880 20 init_complete bucket index max shards: 11 2023-10-05T11:31:10.937 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.934+0000 7efdfc726880 20 Filter name: none 2023-10-05T11:31:10.937 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.934+0000 7efdd9789640 20 reqs_thread_entry: start 2023-10-05T11:31:10.937 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.934+0000 7efdfc726880 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2023-10-05T11:31:10.937 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.934+0000 7efdfc726880 20 rados->read ofs=0 len=0 2023-10-05T11:31:10.939 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.935+0000 7efdfc726880 20 rados_obj.operate() r=0 bl.length=190 2023-10-05T11:31:10.939 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.935+0000 7efdfc726880 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2023-10-05T11:31:10.939 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.935+0000 7efdfc726880 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2023-10-05T11:31:10.939 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.935+0000 7efdfc726880 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:dff27d1e-df33-400e-a68a-7ba586947c99.4604.2 : miss 2023-10-05T11:31:10.939 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.935+0000 7efdfc726880 20 rados->read ofs=0 len=0 2023-10-05T11:31:10.939 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.935+0000 7efdfc726880 20 rados_obj.operate() r=0 bl.length=368 2023-10-05T11:31:10.939 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.935+0000 7efdfc726880 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:dff27d1e-df33-400e-a68a-7ba586947c99.4604.2 info.flags=0x17 2023-10-05T11:31:10.939 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.935+0000 7efdfc726880 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:dff27d1e-df33-400e-a68a-7ba586947c99.4604.2 to cache LRU end 2023-10-05T11:31:10.939 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.935+0000 7efdfc726880 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T11:31:10.939 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.935+0000 7efdfc726880 10 updating xattr: name=user.rgw.acl bl.length()=179 2023-10-05T11:31:10.939 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.935+0000 7efdfc726880 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:dff27d1e-df33-400e-a68a-7ba586947c99.4604.2 2023-10-05T11:31:10.940 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.935+0000 7efdfc726880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.0 2023-10-05T11:31:10.940 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.936+0000 7efdfc726880 1 NOTICE: finished shard 0 (0 entries found) 2023-10-05T11:31:10.940 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.936+0000 7efdfc726880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.1 2023-10-05T11:31:10.940 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.936+0000 7efdfc726880 1 NOTICE: finished shard 1 (0 entries found) 2023-10-05T11:31:10.940 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.936+0000 7efdfc726880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.2 2023-10-05T11:31:10.941 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.936+0000 7efdfc726880 1 NOTICE: finished shard 2 (0 entries found) 2023-10-05T11:31:10.941 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.936+0000 7efdfc726880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.3 2023-10-05T11:31:10.941 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.937+0000 7efdfc726880 1 NOTICE: finished shard 3 (0 entries found) 2023-10-05T11:31:10.941 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.937+0000 7efdfc726880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.4 2023-10-05T11:31:10.941 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.937+0000 7efdfc726880 1 NOTICE: finished shard 4 (0 entries found) 2023-10-05T11:31:10.941 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.937+0000 7efdfc726880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.5 2023-10-05T11:31:10.941 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.938+0000 7efdfc726880 1 NOTICE: finished shard 5 (0 entries found) 2023-10-05T11:31:10.941 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.938+0000 7efdfc726880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.6 2023-10-05T11:31:10.942 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.938+0000 7efdfc726880 1 NOTICE: finished shard 6 (0 entries found) 2023-10-05T11:31:10.942 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.938+0000 7efdfc726880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.7 2023-10-05T11:31:10.942 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.939+0000 7efdfc726880 1 NOTICE: finished shard 7 (0 entries found) 2023-10-05T11:31:10.942 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.939+0000 7efdfc726880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.8 2023-10-05T11:31:10.942 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.939+0000 7efdfc726880 1 NOTICE: finished shard 8 (0 entries found) 2023-10-05T11:31:10.942 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.939+0000 7efdfc726880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.9 2023-10-05T11:31:10.943 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.940+0000 7efdfc726880 1 NOTICE: finished shard 9 (0 entries found) 2023-10-05T11:31:10.943 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.940+0000 7efdfc726880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.10 2023-10-05T11:31:10.943 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.940+0000 7efdfc726880 1 NOTICE: finished shard 10 (0 entries found) 2023-10-05T11:31:10.943 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.940+0000 7efdfc726880 1 NOTICE: finished all shards (0 entries found) 2023-10-05T11:31:10.944 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.941+0000 7efddff96640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:31:10.946 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.944+0000 7efdfc726880 20 remove_watcher() i=0 2023-10-05T11:31:10.946 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.944+0000 7efdfc726880 2 removed watcher, disabling cache 2023-10-05T11:31:10.948 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.945+0000 7efdfc726880 20 remove_watcher() i=1 2023-10-05T11:31:10.949 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.946+0000 7efdfc726880 20 remove_watcher() i=2 2023-10-05T11:31:10.950 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.947+0000 7efdfc726880 20 remove_watcher() i=3 2023-10-05T11:31:10.951 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.948+0000 7efdfc726880 20 remove_watcher() i=4 2023-10-05T11:31:10.953 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.950+0000 7efdfc726880 20 remove_watcher() i=5 2023-10-05T11:31:10.954 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.951+0000 7efdfc726880 20 remove_watcher() i=6 2023-10-05T11:31:10.955 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:10.952+0000 7efdfc726880 20 remove_watcher() i=7 2023-10-05T11:31:11.145 INFO:tasks.workunit.client.0.smithi012.stderr:radosgw-admin bi list --bucket check-bucket --object d 2023-10-05T11:31:11.176 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setuser ceph since I am not root 2023-10-05T11:31:11.176 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T11:31:11.190 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.187+0000 7f3bd154b880 20 rados->read ofs=0 len=0 2023-10-05T11:31:11.192 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.188+0000 7f3bd154b880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:11.192 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.189+0000 7f3bd154b880 20 realm 2023-10-05T11:31:11.192 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.189+0000 7f3bd154b880 20 rados->read ofs=0 len=0 2023-10-05T11:31:11.192 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.189+0000 7f3bd154b880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:11.192 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.189+0000 7f3bd154b880 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T11:31:11.192 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.189+0000 7f3bd154b880 20 rados->read ofs=0 len=0 2023-10-05T11:31:11.192 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.189+0000 7f3bd154b880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:11.192 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.189+0000 7f3bd154b880 20 rados->read ofs=0 len=0 2023-10-05T11:31:11.193 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.190+0000 7f3bd154b880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:31:11.193 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.190+0000 7f3bd154b880 20 rados->read ofs=0 len=0 2023-10-05T11:31:11.193 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.190+0000 7f3bd154b880 20 rados_obj.operate() r=0 bl.length=1020 2023-10-05T11:31:11.193 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.190+0000 7f3bd154b880 20 searching for the correct realm 2023-10-05T11:31:11.200 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.198+0000 7f3bcfcf0640 0 -- 172.21.15.12:0/560564056 >> [v2:172.21.15.12:6808/396693578,v1:172.21.15.12:6809/396693578] conn(0x559cf7b88800 msgr2=0x559cf7b98580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:31:11.203 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.200+0000 7f3bd154b880 20 RGWRados::pool_iterate: got zone_info.dff27d1e-df33-400e-a68a-7ba586947c99 2023-10-05T11:31:11.203 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.200+0000 7f3bd154b880 20 RGWRados::pool_iterate: got zonegroup_info.c78aa576-9d15-4e9d-b3c0-4af23a22062c 2023-10-05T11:31:11.203 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.200+0000 7f3bd154b880 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T11:31:11.203 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.200+0000 7f3bd154b880 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T11:31:11.204 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.200+0000 7f3bd154b880 20 rados->read ofs=0 len=0 2023-10-05T11:31:11.204 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.201+0000 7f3bd154b880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:11.204 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.201+0000 7f3bd154b880 20 rados->read ofs=0 len=0 2023-10-05T11:31:11.205 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.201+0000 7f3bd154b880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:31:11.205 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.201+0000 7f3bd154b880 20 rados->read ofs=0 len=0 2023-10-05T11:31:11.205 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.201+0000 7f3bd154b880 20 rados_obj.operate() r=0 bl.length=454 2023-10-05T11:31:11.205 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.201+0000 7f3bd154b880 20 zone default found 2023-10-05T11:31:11.205 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.201+0000 7f3bd154b880 4 Realm: () 2023-10-05T11:31:11.205 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.201+0000 7f3bd154b880 4 ZoneGroup: default (c78aa576-9d15-4e9d-b3c0-4af23a22062c) 2023-10-05T11:31:11.205 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.201+0000 7f3bd154b880 4 Zone: default (dff27d1e-df33-400e-a68a-7ba586947c99) 2023-10-05T11:31:11.206 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.201+0000 7f3bd154b880 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T11:31:11.206 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.201+0000 7f3bd154b880 20 zonegroup default 2023-10-05T11:31:11.206 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.201+0000 7f3bd154b880 20 rados->read ofs=0 len=0 2023-10-05T11:31:11.206 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.201+0000 7f3bd154b880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:11.206 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.201+0000 7f3bd154b880 20 rados->read ofs=0 len=0 2023-10-05T11:31:11.206 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.202+0000 7f3bd154b880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:11.206 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.202+0000 7f3bd154b880 20 rados->read ofs=0 len=0 2023-10-05T11:31:11.206 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.202+0000 7f3bd154b880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:11.206 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.202+0000 7f3bd154b880 20 started sync module instance, tier type = 2023-10-05T11:31:11.206 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.202+0000 7f3bd154b880 20 started zone id=dff27d1e-df33-400e-a68a-7ba586947c99 (name=default) with tier type = 2023-10-05T11:31:11.207 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.203+0000 7f3bd04f1640 0 -- 172.21.15.12:0/560564056 >> [v2:172.21.15.170:6800/4137726411,v1:172.21.15.170:6801/4137726411] conn(0x559cf7b88400 msgr2=0x559cf7b98000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:31:11.215 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.213+0000 7f3bd154b880 20 add_watcher() i=0 2023-10-05T11:31:11.215 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.213+0000 7f3bd154b880 20 add_watcher() i=1 2023-10-05T11:31:11.216 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.213+0000 7f3bd154b880 20 add_watcher() i=2 2023-10-05T11:31:11.216 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.213+0000 7f3bd154b880 20 add_watcher() i=3 2023-10-05T11:31:11.216 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.213+0000 7f3bd154b880 20 add_watcher() i=4 2023-10-05T11:31:11.216 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.213+0000 7f3bd154b880 20 add_watcher() i=5 2023-10-05T11:31:11.216 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.213+0000 7f3bd154b880 20 add_watcher() i=6 2023-10-05T11:31:11.218 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.215+0000 7f3bd154b880 20 add_watcher() i=7 2023-10-05T11:31:11.218 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.215+0000 7f3bd154b880 2 all 8 watchers are set, enabling cache 2023-10-05T11:31:11.219 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.217+0000 7f3bb6cbe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:31:11.220 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.217+0000 7f3bd154b880 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T11:31:11.220 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.217+0000 7f3bd154b880 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T11:31:11.226 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.223+0000 7f3bd154b880 5 note: GC not initialized 2023-10-05T11:31:11.226 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.223+0000 7f3bb24b5640 20 reqs_thread_entry: start 2023-10-05T11:31:11.226 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.223+0000 7f3bd154b880 20 init_complete bucket index max shards: 11 2023-10-05T11:31:11.226 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.223+0000 7f3bd154b880 20 Filter name: none 2023-10-05T11:31:11.226 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.223+0000 7f3bb04b1640 20 reqs_thread_entry: start 2023-10-05T11:31:11.226 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.223+0000 7f3bd154b880 20 rados->read ofs=0 len=0 2023-10-05T11:31:11.227 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.224+0000 7f3bd154b880 20 rados_obj.operate() r=0 bl.length=190 2023-10-05T11:31:11.227 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.224+0000 7f3bd154b880 20 rados->read ofs=0 len=0 2023-10-05T11:31:11.227 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.224+0000 7f3bd154b880 20 rados_obj.operate() r=0 bl.length=368 2023-10-05T11:31:11.227 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.224+0000 7f3bd154b880 20 couldn't put binfo cache entry, might have raced with data changes 2023-10-05T11:31:11.227 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.224+0000 7f3bd154b880 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2023-10-05T11:31:11.227 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.224+0000 7f3bd154b880 20 INFO: main: starting shard=0 2023-10-05T11:31:11.228 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.224+0000 7f3bd154b880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.0 2023-10-05T11:31:11.228 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.224+0000 7f3bd154b880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:31:11.228 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.224+0000 7f3bd154b880 20 INFO: main: starting shard=1 2023-10-05T11:31:11.228 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.224+0000 7f3bd154b880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.1 2023-10-05T11:31:11.228 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.225+0000 7f3bd154b880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:31:11.229 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.225+0000 7f3bd154b880 20 INFO: main: starting shard=2 2023-10-05T11:31:11.229 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.225+0000 7f3bd154b880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.2 2023-10-05T11:31:11.229 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.225+0000 7f3bd154b880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:31:11.229 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.225+0000 7f3bd154b880 20 INFO: main: starting shard=3 2023-10-05T11:31:11.229 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.225+0000 7f3bd154b880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.3 2023-10-05T11:31:11.229 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.226+0000 7f3bd154b880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:31:11.229 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.226+0000 7f3bd154b880 20 INFO: main: starting shard=4 2023-10-05T11:31:11.229 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.226+0000 7f3bd154b880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.4 2023-10-05T11:31:11.230 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.226+0000 7f3bd154b880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:31:11.230 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.226+0000 7f3bd154b880 20 INFO: main: starting shard=5 2023-10-05T11:31:11.230 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.226+0000 7f3bd154b880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.5 2023-10-05T11:31:11.231 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.227+0000 7f3bd154b880 20 INFO: main: bi_list() returned without error; entries.size()=2, is_truncated=0, marker= 2023-10-05T11:31:11.231 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.227+0000 7f3bd154b880 20 INFO: main: starting shard=6 2023-10-05T11:31:11.231 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.227+0000 7f3bd154b880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.6 2023-10-05T11:31:11.231 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.227+0000 7f3bd154b880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:31:11.231 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.227+0000 7f3bd154b880 20 INFO: main: starting shard=7 2023-10-05T11:31:11.231 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.227+0000 7f3bd154b880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.7 2023-10-05T11:31:11.231 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.228+0000 7f3bd154b880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:31:11.231 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.228+0000 7f3bd154b880 20 INFO: main: starting shard=8 2023-10-05T11:31:11.231 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.228+0000 7f3bd154b880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.8 2023-10-05T11:31:11.232 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.228+0000 7f3bd154b880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:31:11.232 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.228+0000 7f3bd154b880 20 INFO: main: starting shard=9 2023-10-05T11:31:11.232 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.228+0000 7f3bd154b880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.9 2023-10-05T11:31:11.233 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.228+0000 7f3bd154b880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:31:11.233 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.228+0000 7f3bd154b880 20 INFO: main: starting shard=10 2023-10-05T11:31:11.233 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.228+0000 7f3bd154b880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.10 2023-10-05T11:31:11.233 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.229+0000 7f3bd154b880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:31:11.233 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.229+0000 7f3bd154b880 20 INFO: main: done 2023-10-05T11:31:11.233 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.230+0000 7f3bb6cbe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:31:11.234 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.232+0000 7f3bd154b880 20 remove_watcher() i=0 2023-10-05T11:31:11.234 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.232+0000 7f3bd154b880 2 removed watcher, disabling cache 2023-10-05T11:31:11.236 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.233+0000 7f3bd154b880 20 remove_watcher() i=1 2023-10-05T11:31:11.239 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.236+0000 7f3bd154b880 20 remove_watcher() i=2 2023-10-05T11:31:11.240 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.237+0000 7f3bd154b880 20 remove_watcher() i=3 2023-10-05T11:31:11.241 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.238+0000 7f3bd154b880 20 remove_watcher() i=4 2023-10-05T11:31:11.242 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.239+0000 7f3bd154b880 20 remove_watcher() i=5 2023-10-05T11:31:11.244 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.241+0000 7f3bd154b880 20 remove_watcher() i=6 2023-10-05T11:31:11.245 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.242+0000 7f3bd154b880 20 remove_watcher() i=7 2023-10-05T11:31:11.250 INFO:tasks.workunit.client.0.smithi012.stderr:radosgw-admin bi list --bucket check-bucket --object c 2023-10-05T11:31:11.282 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setuser ceph since I am not root 2023-10-05T11:31:11.282 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T11:31:11.294 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.291+0000 7f2f08936880 20 rados->read ofs=0 len=0 2023-10-05T11:31:11.296 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.293+0000 7f2f08936880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:11.296 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.293+0000 7f2f08936880 20 realm 2023-10-05T11:31:11.296 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.293+0000 7f2f08936880 20 rados->read ofs=0 len=0 2023-10-05T11:31:11.296 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.293+0000 7f2f08936880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:11.296 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.293+0000 7f2f08936880 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T11:31:11.296 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.293+0000 7f2f08936880 20 rados->read ofs=0 len=0 2023-10-05T11:31:11.296 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.293+0000 7f2f08936880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:11.296 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.293+0000 7f2f08936880 20 rados->read ofs=0 len=0 2023-10-05T11:31:11.297 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.294+0000 7f2f08936880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:31:11.297 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.294+0000 7f2f08936880 20 rados->read ofs=0 len=0 2023-10-05T11:31:11.297 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.295+0000 7f2f08936880 20 rados_obj.operate() r=0 bl.length=1020 2023-10-05T11:31:11.297 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.295+0000 7f2f08936880 20 searching for the correct realm 2023-10-05T11:31:11.305 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.303+0000 7f2f04b37640 0 -- 172.21.15.12:0/175600463 >> [v2:172.21.15.12:6813/3341239609,v1:172.21.15.12:6815/3341239609] conn(0x55afcecb3800 msgr2=0x55afce0b4680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-10-05T11:31:11.308 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.305+0000 7f2f08936880 20 RGWRados::pool_iterate: got zone_info.dff27d1e-df33-400e-a68a-7ba586947c99 2023-10-05T11:31:11.308 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.305+0000 7f2f08936880 20 RGWRados::pool_iterate: got zonegroup_info.c78aa576-9d15-4e9d-b3c0-4af23a22062c 2023-10-05T11:31:11.308 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.305+0000 7f2f08936880 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T11:31:11.308 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.305+0000 7f2f08936880 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T11:31:11.308 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.305+0000 7f2f08936880 20 rados->read ofs=0 len=0 2023-10-05T11:31:11.309 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.306+0000 7f2f08936880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:11.310 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.306+0000 7f2f08936880 20 rados->read ofs=0 len=0 2023-10-05T11:31:11.310 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.306+0000 7f2f08936880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:31:11.310 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.306+0000 7f2f08936880 20 rados->read ofs=0 len=0 2023-10-05T11:31:11.310 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.306+0000 7f2f08936880 20 rados_obj.operate() r=0 bl.length=454 2023-10-05T11:31:11.310 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.306+0000 7f2f08936880 20 zone default found 2023-10-05T11:31:11.310 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.306+0000 7f2f08936880 4 Realm: () 2023-10-05T11:31:11.310 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.306+0000 7f2f08936880 4 ZoneGroup: default (c78aa576-9d15-4e9d-b3c0-4af23a22062c) 2023-10-05T11:31:11.310 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.306+0000 7f2f08936880 4 Zone: default (dff27d1e-df33-400e-a68a-7ba586947c99) 2023-10-05T11:31:11.310 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.306+0000 7f2f08936880 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T11:31:11.310 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.306+0000 7f2f08936880 20 zonegroup default 2023-10-05T11:31:11.311 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.306+0000 7f2f08936880 20 rados->read ofs=0 len=0 2023-10-05T11:31:11.311 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.307+0000 7f2f08936880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:11.311 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.307+0000 7f2f08936880 20 rados->read ofs=0 len=0 2023-10-05T11:31:11.311 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.307+0000 7f2f08936880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:11.311 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.307+0000 7f2f08936880 20 rados->read ofs=0 len=0 2023-10-05T11:31:11.311 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.307+0000 7f2f08936880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:11.311 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.307+0000 7f2f08936880 20 started sync module instance, tier type = 2023-10-05T11:31:11.312 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.307+0000 7f2f08936880 20 started zone id=dff27d1e-df33-400e-a68a-7ba586947c99 (name=default) with tier type = 2023-10-05T11:31:11.313 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.311+0000 7f2f05338640 0 -- 172.21.15.12:0/175600463 >> [v2:172.21.15.170:6814/3150808418,v1:172.21.15.170:6816/3150808418] conn(0x55afcecb3c00 msgr2=0x55afce0b4c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:31:11.324 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.321+0000 7f2f08936880 20 add_watcher() i=0 2023-10-05T11:31:11.324 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.321+0000 7f2f08936880 20 add_watcher() i=1 2023-10-05T11:31:11.324 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.321+0000 7f2f08936880 20 add_watcher() i=2 2023-10-05T11:31:11.324 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.321+0000 7f2f08936880 20 add_watcher() i=3 2023-10-05T11:31:11.324 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.321+0000 7f2f08936880 20 add_watcher() i=4 2023-10-05T11:31:11.324 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.321+0000 7f2f08936880 20 add_watcher() i=5 2023-10-05T11:31:11.325 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.323+0000 7f2f08936880 20 add_watcher() i=6 2023-10-05T11:31:11.326 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.323+0000 7f2f08936880 20 add_watcher() i=7 2023-10-05T11:31:11.326 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.323+0000 7f2f08936880 2 all 8 watchers are set, enabling cache 2023-10-05T11:31:11.327 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.324+0000 7f2eec306640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:31:11.327 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.325+0000 7f2f08936880 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T11:31:11.327 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.325+0000 7f2f08936880 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T11:31:11.333 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.330+0000 7f2f08936880 5 note: GC not initialized 2023-10-05T11:31:11.333 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.330+0000 7f2ee7afd640 20 reqs_thread_entry: start 2023-10-05T11:31:11.333 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.330+0000 7f2f08936880 20 init_complete bucket index max shards: 11 2023-10-05T11:31:11.333 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.330+0000 7f2f08936880 20 Filter name: none 2023-10-05T11:31:11.333 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.330+0000 7f2ee5af9640 20 reqs_thread_entry: start 2023-10-05T11:31:11.334 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.331+0000 7f2f08936880 20 rados->read ofs=0 len=0 2023-10-05T11:31:11.334 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.331+0000 7f2f08936880 20 rados_obj.operate() r=0 bl.length=190 2023-10-05T11:31:11.335 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.331+0000 7f2f08936880 20 rados->read ofs=0 len=0 2023-10-05T11:31:11.335 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.331+0000 7f2f08936880 20 rados_obj.operate() r=0 bl.length=368 2023-10-05T11:31:11.335 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.331+0000 7f2f08936880 20 couldn't put binfo cache entry, might have raced with data changes 2023-10-05T11:31:11.335 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.331+0000 7f2f08936880 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2023-10-05T11:31:11.335 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.331+0000 7f2f08936880 20 INFO: main: starting shard=0 2023-10-05T11:31:11.335 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.331+0000 7f2f08936880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.0 2023-10-05T11:31:11.335 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.332+0000 7f2f08936880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:31:11.335 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.332+0000 7f2f08936880 20 INFO: main: starting shard=1 2023-10-05T11:31:11.335 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.332+0000 7f2f08936880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.1 2023-10-05T11:31:11.336 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.332+0000 7f2f08936880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:31:11.336 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.332+0000 7f2f08936880 20 INFO: main: starting shard=2 2023-10-05T11:31:11.336 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.332+0000 7f2f08936880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.2 2023-10-05T11:31:11.336 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.333+0000 7f2f08936880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:31:11.337 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.333+0000 7f2f08936880 20 INFO: main: starting shard=3 2023-10-05T11:31:11.337 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.333+0000 7f2f08936880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.3 2023-10-05T11:31:11.337 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.333+0000 7f2f08936880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:31:11.337 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.333+0000 7f2f08936880 20 INFO: main: starting shard=4 2023-10-05T11:31:11.337 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.333+0000 7f2f08936880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.4 2023-10-05T11:31:11.337 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.334+0000 7f2f08936880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:31:11.337 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.334+0000 7f2f08936880 20 INFO: main: starting shard=5 2023-10-05T11:31:11.337 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.334+0000 7f2f08936880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.5 2023-10-05T11:31:11.338 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.334+0000 7f2f08936880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:31:11.338 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.334+0000 7f2f08936880 20 INFO: main: starting shard=6 2023-10-05T11:31:11.338 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.334+0000 7f2f08936880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.6 2023-10-05T11:31:11.338 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.334+0000 7f2f08936880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:31:11.339 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.334+0000 7f2f08936880 20 INFO: main: starting shard=7 2023-10-05T11:31:11.339 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.334+0000 7f2f08936880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.7 2023-10-05T11:31:11.339 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.335+0000 7f2f08936880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:31:11.339 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.335+0000 7f2f08936880 20 INFO: main: starting shard=8 2023-10-05T11:31:11.339 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.335+0000 7f2f08936880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.8 2023-10-05T11:31:11.339 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.335+0000 7f2f08936880 20 INFO: main: bi_list() returned without error; entries.size()=2, is_truncated=0, marker= 2023-10-05T11:31:11.339 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.335+0000 7f2f08936880 20 INFO: main: starting shard=9 2023-10-05T11:31:11.339 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.335+0000 7f2f08936880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.9 2023-10-05T11:31:11.339 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.336+0000 7f2f08936880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:31:11.339 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.336+0000 7f2f08936880 20 INFO: main: starting shard=10 2023-10-05T11:31:11.339 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.336+0000 7f2f08936880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.10 2023-10-05T11:31:11.340 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.336+0000 7f2f08936880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:31:11.340 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.336+0000 7f2f08936880 20 INFO: main: done 2023-10-05T11:31:11.340 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.337+0000 7f2eec306640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:31:11.341 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.339+0000 7f2f08936880 20 remove_watcher() i=0 2023-10-05T11:31:11.341 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.339+0000 7f2f08936880 2 removed watcher, disabling cache 2023-10-05T11:31:11.342 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.340+0000 7f2f08936880 20 remove_watcher() i=1 2023-10-05T11:31:11.343 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.341+0000 7f2f08936880 20 remove_watcher() i=2 2023-10-05T11:31:11.344 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.342+0000 7f2f08936880 20 remove_watcher() i=3 2023-10-05T11:31:11.345 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.343+0000 7f2f08936880 20 remove_watcher() i=4 2023-10-05T11:31:11.346 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.344+0000 7f2f08936880 20 remove_watcher() i=5 2023-10-05T11:31:11.348 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.346+0000 7f2f08936880 20 remove_watcher() i=6 2023-10-05T11:31:11.349 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.346+0000 7f2f08936880 20 remove_watcher() i=7 2023-10-05T11:31:11.353 INFO:tasks.workunit.client.0.smithi012.stderr:TEST: bucket check olh finds leftover OLH entries 2023-10-05T11:31:11.354 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:31:11.355 INFO:tasks.workunit.client.0.smithi012.stderr:radosgw-admin bucket check olh --bucket check-bucket --dump-keys 2023-10-05T11:31:11.385 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setuser ceph since I am not root 2023-10-05T11:31:11.385 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T11:31:11.398 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.395+0000 7f29ebc8b880 20 rados->read ofs=0 len=0 2023-10-05T11:31:11.399 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.396+0000 7f29ebc8b880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:11.399 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.397+0000 7f29ebc8b880 20 realm 2023-10-05T11:31:11.400 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.397+0000 7f29ebc8b880 20 rados->read ofs=0 len=0 2023-10-05T11:31:11.400 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.397+0000 7f29ebc8b880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:11.400 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.397+0000 7f29ebc8b880 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T11:31:11.400 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.397+0000 7f29ebc8b880 20 rados->read ofs=0 len=0 2023-10-05T11:31:11.400 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.397+0000 7f29ebc8b880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:11.400 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.397+0000 7f29ebc8b880 20 rados->read ofs=0 len=0 2023-10-05T11:31:11.400 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.398+0000 7f29ebc8b880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:31:11.401 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.398+0000 7f29ebc8b880 20 rados->read ofs=0 len=0 2023-10-05T11:31:11.401 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.399+0000 7f29ebc8b880 20 rados_obj.operate() r=0 bl.length=1020 2023-10-05T11:31:11.401 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.399+0000 7f29ebc8b880 20 searching for the correct realm 2023-10-05T11:31:11.410 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.407+0000 7f29ea430640 0 -- 172.21.15.12:0/3018957971 >> [v2:172.21.15.12:6800/732466381,v1:172.21.15.12:6801/732466381] conn(0x558868623800 msgr2=0x558868532b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:31:11.411 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.409+0000 7f29ebc8b880 20 RGWRados::pool_iterate: got zone_info.dff27d1e-df33-400e-a68a-7ba586947c99 2023-10-05T11:31:11.412 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.409+0000 7f29ebc8b880 20 RGWRados::pool_iterate: got zonegroup_info.c78aa576-9d15-4e9d-b3c0-4af23a22062c 2023-10-05T11:31:11.412 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.409+0000 7f29ebc8b880 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T11:31:11.412 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.409+0000 7f29ebc8b880 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T11:31:11.412 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.409+0000 7f29ebc8b880 20 rados->read ofs=0 len=0 2023-10-05T11:31:11.412 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.409+0000 7f29ebc8b880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:11.412 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.409+0000 7f29ebc8b880 20 rados->read ofs=0 len=0 2023-10-05T11:31:11.413 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.409+0000 7f29ebc8b880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:31:11.413 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.409+0000 7f29ebc8b880 20 rados->read ofs=0 len=0 2023-10-05T11:31:11.413 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.409+0000 7f29ebc8b880 20 rados_obj.operate() r=0 bl.length=454 2023-10-05T11:31:11.413 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.410+0000 7f29ebc8b880 20 zone default found 2023-10-05T11:31:11.414 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.410+0000 7f29ebc8b880 4 Realm: () 2023-10-05T11:31:11.414 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.410+0000 7f29ebc8b880 4 ZoneGroup: default (c78aa576-9d15-4e9d-b3c0-4af23a22062c) 2023-10-05T11:31:11.414 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.410+0000 7f29ebc8b880 4 Zone: default (dff27d1e-df33-400e-a68a-7ba586947c99) 2023-10-05T11:31:11.414 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.410+0000 7f29ebc8b880 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T11:31:11.414 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.410+0000 7f29ebc8b880 20 zonegroup default 2023-10-05T11:31:11.414 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.410+0000 7f29ebc8b880 20 rados->read ofs=0 len=0 2023-10-05T11:31:11.414 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.410+0000 7f29ebc8b880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:11.414 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.410+0000 7f29ebc8b880 20 rados->read ofs=0 len=0 2023-10-05T11:31:11.414 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.410+0000 7f29ebc8b880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:11.414 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.410+0000 7f29ebc8b880 20 rados->read ofs=0 len=0 2023-10-05T11:31:11.414 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.410+0000 7f29ebc8b880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:11.415 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.410+0000 7f29ebc8b880 20 started sync module instance, tier type = 2023-10-05T11:31:11.415 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.410+0000 7f29ebc8b880 20 started zone id=dff27d1e-df33-400e-a68a-7ba586947c99 (name=default) with tier type = 2023-10-05T11:31:11.419 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.416+0000 7f29ea430640 0 -- 172.21.15.12:0/3018957971 >> [v2:172.21.15.12:6800/732466381,v1:172.21.15.12:6801/732466381] conn(0x558868639400 msgr2=0x558868534100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:31:11.427 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.425+0000 7f29ebc8b880 20 add_watcher() i=0 2023-10-05T11:31:11.427 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.425+0000 7f29ebc8b880 20 add_watcher() i=1 2023-10-05T11:31:11.428 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.425+0000 7f29ebc8b880 20 add_watcher() i=2 2023-10-05T11:31:11.428 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.425+0000 7f29ebc8b880 20 add_watcher() i=3 2023-10-05T11:31:11.428 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.425+0000 7f29ebc8b880 20 add_watcher() i=4 2023-10-05T11:31:11.428 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.425+0000 7f29ebc8b880 20 add_watcher() i=5 2023-10-05T11:31:11.428 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.425+0000 7f29ebc8b880 20 add_watcher() i=6 2023-10-05T11:31:11.430 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.427+0000 7f29ebc8b880 20 add_watcher() i=7 2023-10-05T11:31:11.430 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.427+0000 7f29ebc8b880 2 all 8 watchers are set, enabling cache 2023-10-05T11:31:11.431 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.429+0000 7f29d13fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:31:11.432 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.429+0000 7f29ebc8b880 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T11:31:11.432 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.429+0000 7f29ebc8b880 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T11:31:11.437 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.434+0000 7f29ebc8b880 5 note: GC not initialized 2023-10-05T11:31:11.437 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.435+0000 7f29ccbf5640 20 reqs_thread_entry: start 2023-10-05T11:31:11.438 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.435+0000 7f29ebc8b880 20 init_complete bucket index max shards: 11 2023-10-05T11:31:11.438 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.435+0000 7f29ebc8b880 20 Filter name: none 2023-10-05T11:31:11.438 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.435+0000 7f29cabf1640 20 reqs_thread_entry: start 2023-10-05T11:31:11.438 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.435+0000 7f29ebc8b880 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2023-10-05T11:31:11.438 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.435+0000 7f29ebc8b880 20 rados->read ofs=0 len=0 2023-10-05T11:31:11.439 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.435+0000 7f29ebc8b880 20 rados_obj.operate() r=0 bl.length=190 2023-10-05T11:31:11.439 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.435+0000 7f29ebc8b880 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2023-10-05T11:31:11.439 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.435+0000 7f29ebc8b880 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2023-10-05T11:31:11.439 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.435+0000 7f29ebc8b880 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:dff27d1e-df33-400e-a68a-7ba586947c99.4604.2 : miss 2023-10-05T11:31:11.439 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.435+0000 7f29ebc8b880 20 rados->read ofs=0 len=0 2023-10-05T11:31:11.439 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.436+0000 7f29ebc8b880 20 rados_obj.operate() r=0 bl.length=368 2023-10-05T11:31:11.440 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.436+0000 7f29ebc8b880 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:dff27d1e-df33-400e-a68a-7ba586947c99.4604.2 info.flags=0x17 2023-10-05T11:31:11.440 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.436+0000 7f29ebc8b880 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:dff27d1e-df33-400e-a68a-7ba586947c99.4604.2 to cache LRU end 2023-10-05T11:31:11.440 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.436+0000 7f29ebc8b880 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T11:31:11.440 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.436+0000 7f29ebc8b880 10 updating xattr: name=user.rgw.acl bl.length()=179 2023-10-05T11:31:11.440 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.436+0000 7f29ebc8b880 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:dff27d1e-df33-400e-a68a-7ba586947c99.4604.2 2023-10-05T11:31:11.440 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.436+0000 7f29ebc8b880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.0 2023-10-05T11:31:11.440 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.436+0000 7f29ebc8b880 1 NOTICE: finished shard 0 (0 entries found) 2023-10-05T11:31:11.440 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.436+0000 7f29ebc8b880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.1 2023-10-05T11:31:11.441 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.437+0000 7f29ebc8b880 1 NOTICE: finished shard 1 (0 entries found) 2023-10-05T11:31:11.441 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.437+0000 7f29ebc8b880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.2 2023-10-05T11:31:11.441 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.437+0000 7f29ebc8b880 1 NOTICE: finished shard 2 (0 entries found) 2023-10-05T11:31:11.441 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.437+0000 7f29ebc8b880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.3 2023-10-05T11:31:11.441 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.438+0000 7f29ebc8b880 1 NOTICE: finished shard 3 (0 entries found) 2023-10-05T11:31:11.441 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.438+0000 7f29ebc8b880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.4 2023-10-05T11:31:11.441 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.438+0000 7f29ebc8b880 1 NOTICE: finished shard 4 (0 entries found) 2023-10-05T11:31:11.441 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.438+0000 7f29ebc8b880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.5 2023-10-05T11:31:11.442 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.439+0000 7f29ebc8b880 1 NOTICE: finished shard 5 (1 entries found) 2023-10-05T11:31:11.442 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.439+0000 7f29ebc8b880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.6 2023-10-05T11:31:11.442 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.439+0000 7f29ebc8b880 1 NOTICE: finished shard 6 (0 entries found) 2023-10-05T11:31:11.442 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.439+0000 7f29ebc8b880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.7 2023-10-05T11:31:11.442 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.440+0000 7f29ebc8b880 1 NOTICE: finished shard 7 (0 entries found) 2023-10-05T11:31:11.443 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.440+0000 7f29ebc8b880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.8 2023-10-05T11:31:11.443 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.440+0000 7f29ebc8b880 1 NOTICE: finished shard 8 (1 entries found) 2023-10-05T11:31:11.443 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.440+0000 7f29ebc8b880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.9 2023-10-05T11:31:11.443 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.440+0000 7f29ebc8b880 1 NOTICE: finished shard 9 (0 entries found) 2023-10-05T11:31:11.443 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.440+0000 7f29ebc8b880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.10 2023-10-05T11:31:11.444 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.441+0000 7f29ebc8b880 1 NOTICE: finished shard 10 (0 entries found) 2023-10-05T11:31:11.444 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.441+0000 7f29ebc8b880 1 NOTICE: finished all shards (2 entries found) 2023-10-05T11:31:11.444 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.442+0000 7f29d13fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:31:11.446 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.444+0000 7f29ebc8b880 20 remove_watcher() i=0 2023-10-05T11:31:11.446 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.444+0000 7f29ebc8b880 2 removed watcher, disabling cache 2023-10-05T11:31:11.447 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.445+0000 7f29ebc8b880 20 remove_watcher() i=1 2023-10-05T11:31:11.448 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.446+0000 7f29ebc8b880 20 remove_watcher() i=2 2023-10-05T11:31:11.449 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.446+0000 7f29ebc8b880 20 remove_watcher() i=3 2023-10-05T11:31:11.450 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.448+0000 7f29ebc8b880 20 remove_watcher() i=4 2023-10-05T11:31:11.451 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.449+0000 7f29ebc8b880 20 remove_watcher() i=5 2023-10-05T11:31:11.453 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.450+0000 7f29ebc8b880 20 remove_watcher() i=6 2023-10-05T11:31:11.454 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.451+0000 7f29ebc8b880 20 remove_watcher() i=7 2023-10-05T11:31:11.458 INFO:tasks.workunit.client.0.smithi012.stderr:TEST: bucket check olh fixes leftover OLH entries 2023-10-05T11:31:11.458 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:31:11.460 INFO:tasks.workunit.client.0.smithi012.stderr:radosgw-admin bucket check olh --bucket check-bucket --fix --rgw-olh-pending-timeout-sec 0 --dump-keys 2023-10-05T11:31:11.492 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setuser ceph since I am not root 2023-10-05T11:31:11.492 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T11:31:11.505 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.503+0000 7f98bd931880 20 rados->read ofs=0 len=0 2023-10-05T11:31:11.507 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.504+0000 7f98bd931880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:11.507 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.504+0000 7f98bd931880 20 realm 2023-10-05T11:31:11.507 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.504+0000 7f98bd931880 20 rados->read ofs=0 len=0 2023-10-05T11:31:11.507 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.504+0000 7f98bd931880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:11.507 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.504+0000 7f98bd931880 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T11:31:11.508 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.504+0000 7f98bd931880 20 rados->read ofs=0 len=0 2023-10-05T11:31:11.508 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.504+0000 7f98bd931880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:11.508 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.504+0000 7f98bd931880 20 rados->read ofs=0 len=0 2023-10-05T11:31:11.508 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.505+0000 7f98bd931880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:31:11.508 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.505+0000 7f98bd931880 20 rados->read ofs=0 len=0 2023-10-05T11:31:11.509 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.506+0000 7f98bd931880 20 rados_obj.operate() r=0 bl.length=1020 2023-10-05T11:31:11.509 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.506+0000 7f98bd931880 20 searching for the correct realm 2023-10-05T11:31:11.518 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.516+0000 7f98ba311640 0 -- 172.21.15.12:0/1795327575 >> [v2:172.21.15.170:6814/3150808418,v1:172.21.15.170:6816/3150808418] conn(0x55d8b4193c00 msgr2=0x55d8b35a3180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:31:11.519 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.517+0000 7f98bd931880 20 RGWRados::pool_iterate: got zone_info.dff27d1e-df33-400e-a68a-7ba586947c99 2023-10-05T11:31:11.520 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.517+0000 7f98bd931880 20 RGWRados::pool_iterate: got zonegroup_info.c78aa576-9d15-4e9d-b3c0-4af23a22062c 2023-10-05T11:31:11.520 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.517+0000 7f98bd931880 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T11:31:11.520 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.517+0000 7f98bd931880 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T11:31:11.520 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.517+0000 7f98bd931880 20 rados->read ofs=0 len=0 2023-10-05T11:31:11.520 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.517+0000 7f98bd931880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:11.520 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.517+0000 7f98bd931880 20 rados->read ofs=0 len=0 2023-10-05T11:31:11.521 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.517+0000 7f98bd931880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:31:11.521 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.517+0000 7f98bd931880 20 rados->read ofs=0 len=0 2023-10-05T11:31:11.521 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.517+0000 7f98bd931880 20 rados_obj.operate() r=0 bl.length=454 2023-10-05T11:31:11.521 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.517+0000 7f98bd931880 20 zone default found 2023-10-05T11:31:11.521 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.517+0000 7f98bd931880 4 Realm: () 2023-10-05T11:31:11.522 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.517+0000 7f98bd931880 4 ZoneGroup: default (c78aa576-9d15-4e9d-b3c0-4af23a22062c) 2023-10-05T11:31:11.522 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.517+0000 7f98bd931880 4 Zone: default (dff27d1e-df33-400e-a68a-7ba586947c99) 2023-10-05T11:31:11.522 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.517+0000 7f98bd931880 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T11:31:11.522 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.517+0000 7f98bd931880 20 zonegroup default 2023-10-05T11:31:11.522 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.517+0000 7f98bd931880 20 rados->read ofs=0 len=0 2023-10-05T11:31:11.522 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.518+0000 7f98bd931880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:11.522 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.518+0000 7f98bd931880 20 rados->read ofs=0 len=0 2023-10-05T11:31:11.522 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.518+0000 7f98bd931880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:11.522 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.518+0000 7f98bd931880 20 rados->read ofs=0 len=0 2023-10-05T11:31:11.522 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.518+0000 7f98bd931880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:11.522 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.518+0000 7f98bd931880 20 started sync module instance, tier type = 2023-10-05T11:31:11.522 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.518+0000 7f98bd931880 20 started zone id=dff27d1e-df33-400e-a68a-7ba586947c99 (name=default) with tier type = 2023-10-05T11:31:11.527 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.525+0000 7f98bab12640 0 -- 172.21.15.12:0/1795327575 >> [v2:172.21.15.170:6800/4137726411,v1:172.21.15.170:6801/4137726411] conn(0x55d8b3744800 msgr2=0x55d8b3739700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:31:11.530 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.527+0000 7f98bd931880 20 add_watcher() i=0 2023-10-05T11:31:11.530 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.527+0000 7f98bd931880 20 add_watcher() i=1 2023-10-05T11:31:11.530 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.527+0000 7f98bd931880 20 add_watcher() i=2 2023-10-05T11:31:11.530 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.527+0000 7f98bd931880 20 add_watcher() i=3 2023-10-05T11:31:11.530 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.527+0000 7f98bd931880 20 add_watcher() i=4 2023-10-05T11:31:11.531 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.527+0000 7f98bd931880 20 add_watcher() i=5 2023-10-05T11:31:11.531 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.528+0000 7f98bd931880 20 add_watcher() i=6 2023-10-05T11:31:11.531 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.528+0000 7f98bd931880 20 add_watcher() i=7 2023-10-05T11:31:11.531 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.528+0000 7f98bd931880 2 all 8 watchers are set, enabling cache 2023-10-05T11:31:11.533 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.530+0000 7f98a12df640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:31:11.533 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.530+0000 7f98bd931880 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T11:31:11.533 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.530+0000 7f98bd931880 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T11:31:11.539 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.536+0000 7f98bd931880 5 note: GC not initialized 2023-10-05T11:31:11.539 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.536+0000 7f989cad6640 20 reqs_thread_entry: start 2023-10-05T11:31:11.539 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.536+0000 7f98bd931880 20 init_complete bucket index max shards: 11 2023-10-05T11:31:11.539 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.536+0000 7f98bd931880 20 Filter name: none 2023-10-05T11:31:11.539 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.536+0000 7f989aad2640 20 reqs_thread_entry: start 2023-10-05T11:31:11.539 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.536+0000 7f98bd931880 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2023-10-05T11:31:11.539 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.536+0000 7f98bd931880 20 rados->read ofs=0 len=0 2023-10-05T11:31:11.540 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.536+0000 7f98bd931880 20 rados_obj.operate() r=0 bl.length=190 2023-10-05T11:31:11.540 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.536+0000 7f98bd931880 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2023-10-05T11:31:11.540 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.536+0000 7f98bd931880 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2023-10-05T11:31:11.540 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.536+0000 7f98bd931880 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:dff27d1e-df33-400e-a68a-7ba586947c99.4604.2 : miss 2023-10-05T11:31:11.540 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.536+0000 7f98bd931880 20 rados->read ofs=0 len=0 2023-10-05T11:31:11.540 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.537+0000 7f98bd931880 20 rados_obj.operate() r=0 bl.length=368 2023-10-05T11:31:11.540 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.537+0000 7f98bd931880 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:dff27d1e-df33-400e-a68a-7ba586947c99.4604.2 info.flags=0x17 2023-10-05T11:31:11.541 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.537+0000 7f98bd931880 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:dff27d1e-df33-400e-a68a-7ba586947c99.4604.2 to cache LRU end 2023-10-05T11:31:11.541 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.537+0000 7f98bd931880 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T11:31:11.541 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.537+0000 7f98bd931880 10 updating xattr: name=user.rgw.acl bl.length()=179 2023-10-05T11:31:11.541 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.537+0000 7f98bd931880 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:dff27d1e-df33-400e-a68a-7ba586947c99.4604.2 2023-10-05T11:31:11.541 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.537+0000 7f98bd931880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.0 2023-10-05T11:31:11.541 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.537+0000 7f98bd931880 1 NOTICE: finished shard 0 (0 entries removed) 2023-10-05T11:31:11.541 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.537+0000 7f98bd931880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.1 2023-10-05T11:31:11.542 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.538+0000 7f98bd931880 1 NOTICE: finished shard 1 (0 entries removed) 2023-10-05T11:31:11.542 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.538+0000 7f98bd931880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.2 2023-10-05T11:31:11.542 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.538+0000 7f98bd931880 1 NOTICE: finished shard 2 (0 entries removed) 2023-10-05T11:31:11.542 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.538+0000 7f98bd931880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.3 2023-10-05T11:31:11.542 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.539+0000 7f98bd931880 1 NOTICE: finished shard 3 (0 entries removed) 2023-10-05T11:31:11.542 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.539+0000 7f98bd931880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.4 2023-10-05T11:31:11.542 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.539+0000 7f98bd931880 1 NOTICE: finished shard 4 (0 entries removed) 2023-10-05T11:31:11.542 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.539+0000 7f98bd931880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.5 2023-10-05T11:31:11.543 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.540+0000 7f98bd931880 20 get_obj_state: rctx=0x55d8b3663b90 obj=check-bucket:d state=0x55d8b40d8de8 s->prefetch_data=0 2023-10-05T11:31:11.543 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.540+0000 7f98bd931880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.6 2023-10-05T11:31:11.543 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.540+0000 7f98bd931880 1 NOTICE: finished shard 6 (0 entries removed) 2023-10-05T11:31:11.543 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.540+0000 7f98bd931880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.7 2023-10-05T11:31:11.543 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.540+0000 7f98bd931880 1 NOTICE: finished shard 7 (0 entries removed) 2023-10-05T11:31:11.543 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.540+0000 7f98bd931880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.8 2023-10-05T11:31:11.544 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.541+0000 7f98bd931880 20 get_obj_state: rctx=0x55d8b3663c00 obj=check-bucket:c state=0x55d8b40d99e8 s->prefetch_data=0 2023-10-05T11:31:11.544 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.541+0000 7f98bd931880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.9 2023-10-05T11:31:11.544 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.541+0000 7f98bd931880 1 NOTICE: finished shard 9 (0 entries removed) 2023-10-05T11:31:11.544 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.541+0000 7f98bd931880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.10 2023-10-05T11:31:11.545 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.542+0000 7f98bd931880 1 NOTICE: finished shard 10 (0 entries removed) 2023-10-05T11:31:11.545 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.542+0000 7f98bd931880 20 get_obj_state: setting s->obj_tag to j0jkvfgolt4idfyov5asfq4muh6wmrl9 2023-10-05T11:31:11.546 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.542+0000 7f98bd931880 20 get_obj_state_impl: setting s->olh_tag to mbptz8pgk6bfjupp5go23o6ho1by3l8z 2023-10-05T11:31:11.546 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.542+0000 7f98bd931880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.5 2023-10-05T11:31:11.546 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.542+0000 7f98bd931880 20 get_obj_state: setting s->obj_tag to 186a3rg2527bv9evzs6bdss07z48is6u 2023-10-05T11:31:11.546 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.542+0000 7f98bd931880 20 get_obj_state_impl: setting s->olh_tag to i64n4dewk886yd43l8xgg1yil2h75hjo 2023-10-05T11:31:11.546 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.542+0000 7f98bd931880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.8 2023-10-05T11:31:11.546 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.542+0000 7f98bd931880 20 olh_log_entry: epoch=4 op=2 key=d[] 2023-10-05T11:31:11.546 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.542+0000 7f98bd931880 20 olh_log_entry: epoch=4 op=3 key=d[oxWdYwHHZ8mi.1scDNq0.q8qWHgJn-w] 2023-10-05T11:31:11.546 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.542+0000 7f98bd931880 20 get_obj_state: rctx=0x55d8b38df7f0 obj=check-bucket:_:oxWdYwHHZ8mi.1scDNq0.q8qWHgJn-w_d state=0x55d8b40da5e8 s->prefetch_data=0 2023-10-05T11:31:11.546 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.542+0000 7f98bd931880 20 olh_log_entry: epoch=4 op=2 key=c[] 2023-10-05T11:31:11.546 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.542+0000 7f98bd931880 20 olh_log_entry: epoch=4 op=3 key=c[SfjhQZycotRva.Ii6aOJ5xxm0Z9Vuu3] 2023-10-05T11:31:11.546 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.542+0000 7f98bd931880 20 get_obj_state: rctx=0x55d8b39037f0 obj=check-bucket:_:SfjhQZycotRva.Ii6aOJ5xxm0Z9Vuu3_c state=0x55d8b40db1e8 s->prefetch_data=0 2023-10-05T11:31:11.547 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.544+0000 7f98bd931880 20 get_obj_state: rctx=0x55d8b38df7f0 obj=check-bucket:d state=0x55d8b40db1e8 s->prefetch_data=0 2023-10-05T11:31:11.548 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.545+0000 7f98bd931880 20 get_obj_state: setting s->obj_tag to j0jkvfgolt4idfyov5asfq4muh6wmrl9 2023-10-05T11:31:11.548 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.545+0000 7f98bd931880 20 get_obj_state_impl: setting s->olh_tag to mbptz8pgk6bfjupp5go23o6ho1by3l8z 2023-10-05T11:31:11.548 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.545+0000 7f98bd931880 20 bucket_index_guard_olh_op(): olh_state.olh_tag=mbptz8pgk6bfjupp5go23o6ho1by3l8z 2023-10-05T11:31:11.548 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.545+0000 7f98bd931880 20 get_obj_state: rctx=0x55d8b39037f0 obj=check-bucket:c state=0x55d8b40da5e8 s->prefetch_data=0 2023-10-05T11:31:11.548 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.546+0000 7f98bd931880 20 get_obj_state: setting s->obj_tag to 186a3rg2527bv9evzs6bdss07z48is6u 2023-10-05T11:31:11.548 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.546+0000 7f98bd931880 20 get_obj_state_impl: setting s->olh_tag to i64n4dewk886yd43l8xgg1yil2h75hjo 2023-10-05T11:31:11.549 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.546+0000 7f98bd931880 20 bucket_index_guard_olh_op(): olh_state.olh_tag=i64n4dewk886yd43l8xgg1yil2h75hjo 2023-10-05T11:31:11.553 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.550+0000 7f98bd931880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.5 2023-10-05T11:31:11.553 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.550+0000 7f98bd931880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.8 2023-10-05T11:31:11.555 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.552+0000 7f98bd931880 1 NOTICE: finished shard 8 (1 entries removed) 2023-10-05T11:31:11.555 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.552+0000 7f98bd931880 1 NOTICE: finished shard 5 (1 entries removed) 2023-10-05T11:31:11.555 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.552+0000 7f98bd931880 1 NOTICE: finished all shards (2 entries removed) 2023-10-05T11:31:11.555 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.553+0000 7f98a12df640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:31:11.557 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.555+0000 7f98bd931880 20 remove_watcher() i=0 2023-10-05T11:31:11.557 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.555+0000 7f98bd931880 2 removed watcher, disabling cache 2023-10-05T11:31:11.558 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.556+0000 7f98bd931880 20 remove_watcher() i=1 2023-10-05T11:31:11.559 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.557+0000 7f98bd931880 20 remove_watcher() i=2 2023-10-05T11:31:11.560 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.558+0000 7f98bd931880 20 remove_watcher() i=3 2023-10-05T11:31:11.561 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.559+0000 7f98bd931880 20 remove_watcher() i=4 2023-10-05T11:31:11.562 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.560+0000 7f98bd931880 20 remove_watcher() i=5 2023-10-05T11:31:11.564 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.561+0000 7f98bd931880 20 remove_watcher() i=6 2023-10-05T11:31:11.565 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.562+0000 7f98bd931880 20 remove_watcher() i=7 2023-10-05T11:31:11.571 INFO:tasks.workunit.client.0.smithi012.stderr:radosgw-admin bi list --bucket check-bucket --object d 2023-10-05T11:31:11.601 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setuser ceph since I am not root 2023-10-05T11:31:11.601 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T11:31:11.613 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.611+0000 7fcb75f36880 20 rados->read ofs=0 len=0 2023-10-05T11:31:11.615 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.612+0000 7fcb75f36880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:11.615 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.612+0000 7fcb75f36880 20 realm 2023-10-05T11:31:11.616 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.612+0000 7fcb75f36880 20 rados->read ofs=0 len=0 2023-10-05T11:31:11.616 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.613+0000 7fcb75f36880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:11.616 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.613+0000 7fcb75f36880 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T11:31:11.616 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.613+0000 7fcb75f36880 20 rados->read ofs=0 len=0 2023-10-05T11:31:11.616 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.613+0000 7fcb75f36880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:11.616 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.613+0000 7fcb75f36880 20 rados->read ofs=0 len=0 2023-10-05T11:31:11.616 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.614+0000 7fcb75f36880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:31:11.616 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.614+0000 7fcb75f36880 20 rados->read ofs=0 len=0 2023-10-05T11:31:11.617 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.614+0000 7fcb75f36880 20 rados_obj.operate() r=0 bl.length=1020 2023-10-05T11:31:11.617 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.614+0000 7fcb75f36880 20 searching for the correct realm 2023-10-05T11:31:11.626 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.624+0000 7fcb7308b640 0 -- 172.21.15.12:0/3439124446 >> [v2:172.21.15.12:6824/2171933159,v1:172.21.15.12:6825/2171933159] conn(0x55d1d0c14000 msgr2=0x55d1cff73700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:31:11.627 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.624+0000 7fcb75f36880 20 RGWRados::pool_iterate: got zone_info.dff27d1e-df33-400e-a68a-7ba586947c99 2023-10-05T11:31:11.627 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.624+0000 7fcb75f36880 20 RGWRados::pool_iterate: got zonegroup_info.c78aa576-9d15-4e9d-b3c0-4af23a22062c 2023-10-05T11:31:11.627 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.624+0000 7fcb75f36880 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T11:31:11.627 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.624+0000 7fcb75f36880 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T11:31:11.627 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.624+0000 7fcb75f36880 20 rados->read ofs=0 len=0 2023-10-05T11:31:11.628 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.625+0000 7fcb75f36880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:11.628 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.625+0000 7fcb75f36880 20 rados->read ofs=0 len=0 2023-10-05T11:31:11.629 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.625+0000 7fcb75f36880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:31:11.629 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.625+0000 7fcb75f36880 20 rados->read ofs=0 len=0 2023-10-05T11:31:11.629 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.625+0000 7fcb75f36880 20 rados_obj.operate() r=0 bl.length=454 2023-10-05T11:31:11.629 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.625+0000 7fcb75f36880 20 zone default found 2023-10-05T11:31:11.629 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.625+0000 7fcb75f36880 4 Realm: () 2023-10-05T11:31:11.629 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.625+0000 7fcb75f36880 4 ZoneGroup: default (c78aa576-9d15-4e9d-b3c0-4af23a22062c) 2023-10-05T11:31:11.629 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.625+0000 7fcb75f36880 4 Zone: default (dff27d1e-df33-400e-a68a-7ba586947c99) 2023-10-05T11:31:11.629 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.625+0000 7fcb75f36880 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T11:31:11.629 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.625+0000 7fcb75f36880 20 zonegroup default 2023-10-05T11:31:11.630 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.625+0000 7fcb75f36880 20 rados->read ofs=0 len=0 2023-10-05T11:31:11.630 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.625+0000 7fcb75f36880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:11.630 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.625+0000 7fcb75f36880 20 rados->read ofs=0 len=0 2023-10-05T11:31:11.630 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.626+0000 7fcb75f36880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:11.630 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.626+0000 7fcb75f36880 20 rados->read ofs=0 len=0 2023-10-05T11:31:11.630 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.626+0000 7fcb75f36880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:11.630 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.626+0000 7fcb75f36880 20 started sync module instance, tier type = 2023-10-05T11:31:11.630 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.626+0000 7fcb75f36880 20 started zone id=dff27d1e-df33-400e-a68a-7ba586947c99 (name=default) with tier type = 2023-10-05T11:31:11.635 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.633+0000 7fcb7308b640 0 -- 172.21.15.12:0/3439124446 >> [v2:172.21.15.12:6824/2171933159,v1:172.21.15.12:6825/2171933159] conn(0x55d1d0037c00 msgr2=0x55d1d0024100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-10-05T11:31:11.639 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.636+0000 7fcb75f36880 20 add_watcher() i=0 2023-10-05T11:31:11.639 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.636+0000 7fcb75f36880 20 add_watcher() i=1 2023-10-05T11:31:11.639 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.636+0000 7fcb75f36880 20 add_watcher() i=2 2023-10-05T11:31:11.639 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.636+0000 7fcb75f36880 20 add_watcher() i=3 2023-10-05T11:31:11.639 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.636+0000 7fcb75f36880 20 add_watcher() i=4 2023-10-05T11:31:11.639 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.636+0000 7fcb75f36880 20 add_watcher() i=5 2023-10-05T11:31:11.639 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.636+0000 7fcb75f36880 20 add_watcher() i=6 2023-10-05T11:31:11.640 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.637+0000 7fcb75f36880 20 add_watcher() i=7 2023-10-05T11:31:11.640 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.637+0000 7fcb75f36880 2 all 8 watchers are set, enabling cache 2023-10-05T11:31:11.641 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.639+0000 7fcb59858640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:31:11.642 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.639+0000 7fcb75f36880 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T11:31:11.642 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.639+0000 7fcb75f36880 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T11:31:11.648 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.644+0000 7fcb75f36880 5 note: GC not initialized 2023-10-05T11:31:11.648 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.645+0000 7fcb5504f640 20 reqs_thread_entry: start 2023-10-05T11:31:11.648 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.645+0000 7fcb75f36880 20 init_complete bucket index max shards: 11 2023-10-05T11:31:11.648 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.645+0000 7fcb75f36880 20 Filter name: none 2023-10-05T11:31:11.648 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.645+0000 7fcb5304b640 20 reqs_thread_entry: start 2023-10-05T11:31:11.648 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.645+0000 7fcb75f36880 20 rados->read ofs=0 len=0 2023-10-05T11:31:11.649 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.645+0000 7fcb75f36880 20 rados_obj.operate() r=0 bl.length=190 2023-10-05T11:31:11.649 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.645+0000 7fcb75f36880 20 rados->read ofs=0 len=0 2023-10-05T11:31:11.649 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.646+0000 7fcb75f36880 20 rados_obj.operate() r=0 bl.length=368 2023-10-05T11:31:11.649 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.646+0000 7fcb75f36880 20 couldn't put binfo cache entry, might have raced with data changes 2023-10-05T11:31:11.649 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.646+0000 7fcb75f36880 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2023-10-05T11:31:11.649 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.646+0000 7fcb75f36880 20 INFO: main: starting shard=0 2023-10-05T11:31:11.649 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.646+0000 7fcb75f36880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.0 2023-10-05T11:31:11.650 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.646+0000 7fcb75f36880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:31:11.650 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.646+0000 7fcb75f36880 20 INFO: main: starting shard=1 2023-10-05T11:31:11.650 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.646+0000 7fcb75f36880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.1 2023-10-05T11:31:11.650 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.647+0000 7fcb75f36880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:31:11.651 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.647+0000 7fcb75f36880 20 INFO: main: starting shard=2 2023-10-05T11:31:11.651 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.647+0000 7fcb75f36880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.2 2023-10-05T11:31:11.651 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.647+0000 7fcb75f36880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:31:11.651 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.647+0000 7fcb75f36880 20 INFO: main: starting shard=3 2023-10-05T11:31:11.651 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.647+0000 7fcb75f36880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.3 2023-10-05T11:31:11.651 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.647+0000 7fcb75f36880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:31:11.651 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.647+0000 7fcb75f36880 20 INFO: main: starting shard=4 2023-10-05T11:31:11.651 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.647+0000 7fcb75f36880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.4 2023-10-05T11:31:11.651 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.648+0000 7fcb75f36880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:31:11.651 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.648+0000 7fcb75f36880 20 INFO: main: starting shard=5 2023-10-05T11:31:11.651 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.648+0000 7fcb75f36880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.5 2023-10-05T11:31:11.652 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.649+0000 7fcb75f36880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:31:11.652 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.649+0000 7fcb75f36880 20 INFO: main: starting shard=6 2023-10-05T11:31:11.652 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.649+0000 7fcb75f36880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.6 2023-10-05T11:31:11.652 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.649+0000 7fcb75f36880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:31:11.653 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.649+0000 7fcb75f36880 20 INFO: main: starting shard=7 2023-10-05T11:31:11.653 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.649+0000 7fcb75f36880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.7 2023-10-05T11:31:11.653 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.650+0000 7fcb75f36880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:31:11.653 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.650+0000 7fcb75f36880 20 INFO: main: starting shard=8 2023-10-05T11:31:11.653 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.650+0000 7fcb75f36880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.8 2023-10-05T11:31:11.654 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.650+0000 7fcb75f36880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:31:11.654 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.650+0000 7fcb75f36880 20 INFO: main: starting shard=9 2023-10-05T11:31:11.654 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.650+0000 7fcb75f36880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.9 2023-10-05T11:31:11.654 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.650+0000 7fcb75f36880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:31:11.654 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.650+0000 7fcb75f36880 20 INFO: main: starting shard=10 2023-10-05T11:31:11.654 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.650+0000 7fcb75f36880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.10 2023-10-05T11:31:11.654 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.651+0000 7fcb75f36880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:31:11.654 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.651+0000 7fcb75f36880 20 INFO: main: done 2023-10-05T11:31:11.655 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.652+0000 7fcb59858640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:31:11.656 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.654+0000 7fcb75f36880 20 remove_watcher() i=0 2023-10-05T11:31:11.657 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.654+0000 7fcb75f36880 2 removed watcher, disabling cache 2023-10-05T11:31:11.657 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.655+0000 7fcb75f36880 20 remove_watcher() i=1 2023-10-05T11:31:11.658 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.656+0000 7fcb75f36880 20 remove_watcher() i=2 2023-10-05T11:31:11.659 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.657+0000 7fcb75f36880 20 remove_watcher() i=3 2023-10-05T11:31:11.661 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.658+0000 7fcb75f36880 20 remove_watcher() i=4 2023-10-05T11:31:11.662 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.659+0000 7fcb75f36880 20 remove_watcher() i=5 2023-10-05T11:31:11.663 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.660+0000 7fcb75f36880 20 remove_watcher() i=6 2023-10-05T11:31:11.664 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.661+0000 7fcb75f36880 20 remove_watcher() i=7 2023-10-05T11:31:11.670 INFO:tasks.workunit.client.0.smithi012.stderr:radosgw-admin bi list --bucket check-bucket --object c 2023-10-05T11:31:11.700 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setuser ceph since I am not root 2023-10-05T11:31:11.700 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T11:31:11.712 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.710+0000 7fecb1b28880 20 rados->read ofs=0 len=0 2023-10-05T11:31:11.915 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.912+0000 7fecb1b28880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:11.915 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.912+0000 7fecb1b28880 20 realm 2023-10-05T11:31:11.916 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.912+0000 7fecb1b28880 20 rados->read ofs=0 len=0 2023-10-05T11:31:11.916 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.912+0000 7fecb1b28880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:11.916 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.912+0000 7fecb1b28880 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T11:31:11.916 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.912+0000 7fecb1b28880 20 rados->read ofs=0 len=0 2023-10-05T11:31:11.916 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.913+0000 7fecb1b28880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:11.916 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.913+0000 7fecb1b28880 20 rados->read ofs=0 len=0 2023-10-05T11:31:11.917 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.914+0000 7fecb1b28880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:31:11.917 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.914+0000 7fecb1b28880 20 rados->read ofs=0 len=0 2023-10-05T11:31:11.917 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.914+0000 7fecb1b28880 20 rados_obj.operate() r=0 bl.length=1020 2023-10-05T11:31:11.917 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.914+0000 7fecb1b28880 20 searching for the correct realm 2023-10-05T11:31:11.926 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.923+0000 7fecae41c640 0 -- 172.21.15.12:0/1728626104 >> [v2:172.21.15.12:6808/396693578,v1:172.21.15.12:6809/396693578] conn(0x561303798400 msgr2=0x561303699b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:31:11.928 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.925+0000 7fecb1b28880 20 RGWRados::pool_iterate: got zone_info.dff27d1e-df33-400e-a68a-7ba586947c99 2023-10-05T11:31:11.928 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.925+0000 7fecb1b28880 20 RGWRados::pool_iterate: got zonegroup_info.c78aa576-9d15-4e9d-b3c0-4af23a22062c 2023-10-05T11:31:11.928 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.925+0000 7fecb1b28880 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T11:31:11.928 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.925+0000 7fecb1b28880 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T11:31:11.929 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.925+0000 7fecb1b28880 20 rados->read ofs=0 len=0 2023-10-05T11:31:11.929 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.925+0000 7fecb1b28880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:11.929 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.925+0000 7fecb1b28880 20 rados->read ofs=0 len=0 2023-10-05T11:31:11.930 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.926+0000 7fecb1b28880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:31:11.930 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.926+0000 7fecb1b28880 20 rados->read ofs=0 len=0 2023-10-05T11:31:11.930 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.926+0000 7fecb1b28880 20 rados_obj.operate() r=0 bl.length=454 2023-10-05T11:31:11.930 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.926+0000 7fecb1b28880 20 zone default found 2023-10-05T11:31:11.930 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.926+0000 7fecb1b28880 4 Realm: () 2023-10-05T11:31:11.931 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.926+0000 7fecb1b28880 4 ZoneGroup: default (c78aa576-9d15-4e9d-b3c0-4af23a22062c) 2023-10-05T11:31:11.931 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.926+0000 7fecb1b28880 4 Zone: default (dff27d1e-df33-400e-a68a-7ba586947c99) 2023-10-05T11:31:11.931 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.926+0000 7fecb1b28880 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T11:31:11.931 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.926+0000 7fecb1b28880 20 zonegroup default 2023-10-05T11:31:11.931 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.926+0000 7fecb1b28880 20 rados->read ofs=0 len=0 2023-10-05T11:31:11.931 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.926+0000 7fecb1b28880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:11.931 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.926+0000 7fecb1b28880 20 rados->read ofs=0 len=0 2023-10-05T11:31:11.931 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.927+0000 7fecb1b28880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:11.931 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.927+0000 7fecb1b28880 20 rados->read ofs=0 len=0 2023-10-05T11:31:11.931 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.927+0000 7fecb1b28880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:11.932 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.927+0000 7fecb1b28880 20 started sync module instance, tier type = 2023-10-05T11:31:11.932 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.927+0000 7fecb1b28880 20 started zone id=dff27d1e-df33-400e-a68a-7ba586947c99 (name=default) with tier type = 2023-10-05T11:31:11.935 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.932+0000 7fecae41c640 0 -- 172.21.15.12:0/1728626104 >> [v2:172.21.15.12:6800/732466381,v1:172.21.15.12:6801/732466381] conn(0x561303693c00 msgr2=0x561303698b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:31:11.940 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.937+0000 7fecb1b28880 20 add_watcher() i=0 2023-10-05T11:31:11.940 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.937+0000 7fecb1b28880 20 add_watcher() i=1 2023-10-05T11:31:11.940 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.937+0000 7fecb1b28880 20 add_watcher() i=2 2023-10-05T11:31:11.940 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.937+0000 7fecb1b28880 20 add_watcher() i=3 2023-10-05T11:31:11.941 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.937+0000 7fecb1b28880 20 add_watcher() i=4 2023-10-05T11:31:11.941 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.937+0000 7fecb1b28880 20 add_watcher() i=5 2023-10-05T11:31:11.941 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.937+0000 7fecb1b28880 20 add_watcher() i=6 2023-10-05T11:31:11.941 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.939+0000 7fecb1b28880 20 add_watcher() i=7 2023-10-05T11:31:11.941 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.939+0000 7fecb1b28880 2 all 8 watchers are set, enabling cache 2023-10-05T11:31:11.944 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.942+0000 7fec953ea640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:31:11.944 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.942+0000 7fecb1b28880 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T11:31:11.945 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.942+0000 7fecb1b28880 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T11:31:11.950 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.947+0000 7fecb1b28880 5 note: GC not initialized 2023-10-05T11:31:11.951 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.947+0000 7fec90be1640 20 reqs_thread_entry: start 2023-10-05T11:31:11.951 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.948+0000 7fecb1b28880 20 init_complete bucket index max shards: 11 2023-10-05T11:31:11.951 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.948+0000 7fecb1b28880 20 Filter name: none 2023-10-05T11:31:11.951 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.948+0000 7fec8ebdd640 20 reqs_thread_entry: start 2023-10-05T11:31:11.951 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.948+0000 7fecb1b28880 20 rados->read ofs=0 len=0 2023-10-05T11:31:11.952 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.948+0000 7fecb1b28880 20 rados_obj.operate() r=0 bl.length=190 2023-10-05T11:31:11.952 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.948+0000 7fecb1b28880 20 rados->read ofs=0 len=0 2023-10-05T11:31:11.952 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.949+0000 7fecb1b28880 20 rados_obj.operate() r=0 bl.length=368 2023-10-05T11:31:11.952 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.949+0000 7fecb1b28880 20 couldn't put binfo cache entry, might have raced with data changes 2023-10-05T11:31:11.952 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.949+0000 7fecb1b28880 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2023-10-05T11:31:11.952 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.949+0000 7fecb1b28880 20 INFO: main: starting shard=0 2023-10-05T11:31:11.952 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.949+0000 7fecb1b28880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.0 2023-10-05T11:31:11.953 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.949+0000 7fecb1b28880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:31:11.953 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.949+0000 7fecb1b28880 20 INFO: main: starting shard=1 2023-10-05T11:31:11.953 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.949+0000 7fecb1b28880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.1 2023-10-05T11:31:11.954 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.950+0000 7fecb1b28880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:31:11.954 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.950+0000 7fecb1b28880 20 INFO: main: starting shard=2 2023-10-05T11:31:11.954 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.950+0000 7fecb1b28880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.2 2023-10-05T11:31:11.954 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.950+0000 7fecb1b28880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:31:11.954 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.950+0000 7fecb1b28880 20 INFO: main: starting shard=3 2023-10-05T11:31:11.954 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.950+0000 7fecb1b28880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.3 2023-10-05T11:31:11.954 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.951+0000 7fecb1b28880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:31:11.954 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.951+0000 7fecb1b28880 20 INFO: main: starting shard=4 2023-10-05T11:31:11.955 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.951+0000 7fecb1b28880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.4 2023-10-05T11:31:11.955 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.951+0000 7fecb1b28880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:31:11.955 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.951+0000 7fecb1b28880 20 INFO: main: starting shard=5 2023-10-05T11:31:11.955 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.951+0000 7fecb1b28880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.5 2023-10-05T11:31:11.956 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.952+0000 7fecb1b28880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:31:11.956 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.952+0000 7fecb1b28880 20 INFO: main: starting shard=6 2023-10-05T11:31:11.956 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.952+0000 7fecb1b28880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.6 2023-10-05T11:31:11.956 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.952+0000 7fecb1b28880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:31:11.956 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.952+0000 7fecb1b28880 20 INFO: main: starting shard=7 2023-10-05T11:31:11.956 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.952+0000 7fecb1b28880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.7 2023-10-05T11:31:11.956 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.952+0000 7fecb1b28880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:31:11.956 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.952+0000 7fecb1b28880 20 INFO: main: starting shard=8 2023-10-05T11:31:11.956 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.952+0000 7fecb1b28880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.8 2023-10-05T11:31:11.956 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.953+0000 7fecb1b28880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:31:11.956 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.953+0000 7fecb1b28880 20 INFO: main: starting shard=9 2023-10-05T11:31:11.956 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.953+0000 7fecb1b28880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.9 2023-10-05T11:31:11.957 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.953+0000 7fecb1b28880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:31:11.957 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.953+0000 7fecb1b28880 20 INFO: main: starting shard=10 2023-10-05T11:31:11.957 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.953+0000 7fecb1b28880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.10 2023-10-05T11:31:11.957 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.954+0000 7fecb1b28880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:31:11.957 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.954+0000 7fecb1b28880 20 INFO: main: done 2023-10-05T11:31:11.958 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.954+0000 7fec953ea640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:31:11.959 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.957+0000 7fecb1b28880 20 remove_watcher() i=0 2023-10-05T11:31:11.959 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.957+0000 7fecb1b28880 2 removed watcher, disabling cache 2023-10-05T11:31:11.960 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.958+0000 7fecb1b28880 20 remove_watcher() i=1 2023-10-05T11:31:11.961 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.959+0000 7fecb1b28880 20 remove_watcher() i=2 2023-10-05T11:31:11.963 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.960+0000 7fecb1b28880 20 remove_watcher() i=3 2023-10-05T11:31:11.964 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.961+0000 7fecb1b28880 20 remove_watcher() i=4 2023-10-05T11:31:11.965 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.962+0000 7fecb1b28880 20 remove_watcher() i=5 2023-10-05T11:31:11.966 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.963+0000 7fecb1b28880 20 remove_watcher() i=6 2023-10-05T11:31:11.967 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:11.964+0000 7fecb1b28880 20 remove_watcher() i=7 2023-10-05T11:31:11.971 INFO:tasks.workunit.client.0.smithi012.stderr:TEST: bucket check olh does not find new leftover OLH entries after fix 2023-10-05T11:31:11.971 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:31:11.972 INFO:tasks.workunit.client.0.smithi012.stderr:radosgw-admin bucket check olh --bucket check-bucket --dump-keys 2023-10-05T11:31:12.002 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setuser ceph since I am not root 2023-10-05T11:31:12.003 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T11:31:12.016 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:12.013+0000 7f5fd5e13880 20 rados->read ofs=0 len=0 2023-10-05T11:31:12.017 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:12.014+0000 7f5fd5e13880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:12.017 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:12.014+0000 7f5fd5e13880 20 realm 2023-10-05T11:31:12.018 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:12.014+0000 7f5fd5e13880 20 rados->read ofs=0 len=0 2023-10-05T11:31:12.018 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:12.015+0000 7f5fd5e13880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:12.018 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:12.015+0000 7f5fd5e13880 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T11:31:12.018 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:12.015+0000 7f5fd5e13880 20 rados->read ofs=0 len=0 2023-10-05T11:31:12.018 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:12.015+0000 7f5fd5e13880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:12.018 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:12.015+0000 7f5fd5e13880 20 rados->read ofs=0 len=0 2023-10-05T11:31:12.019 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:12.016+0000 7f5fd5e13880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:31:12.019 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:12.016+0000 7f5fd5e13880 20 rados->read ofs=0 len=0 2023-10-05T11:31:12.019 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:12.017+0000 7f5fd5e13880 20 rados_obj.operate() r=0 bl.length=1020 2023-10-05T11:31:12.019 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:12.017+0000 7f5fd5e13880 20 searching for the correct realm 2023-10-05T11:31:12.027 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:12.025+0000 7f5fd2afa640 0 -- 172.21.15.12:0/3282350663 >> [v2:172.21.15.12:6813/3341239609,v1:172.21.15.12:6815/3341239609] conn(0x55750ecefc00 msgr2=0x55750e102c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:31:12.029 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:12.027+0000 7f5fd5e13880 20 RGWRados::pool_iterate: got zone_info.dff27d1e-df33-400e-a68a-7ba586947c99 2023-10-05T11:31:12.030 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:12.027+0000 7f5fd5e13880 20 RGWRados::pool_iterate: got zonegroup_info.c78aa576-9d15-4e9d-b3c0-4af23a22062c 2023-10-05T11:31:12.030 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:12.027+0000 7f5fd5e13880 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T11:31:12.030 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:12.027+0000 7f5fd5e13880 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T11:31:12.030 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:12.027+0000 7f5fd5e13880 20 rados->read ofs=0 len=0 2023-10-05T11:31:12.030 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:12.027+0000 7f5fd5e13880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:12.030 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:12.027+0000 7f5fd5e13880 20 rados->read ofs=0 len=0 2023-10-05T11:31:12.030 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:12.027+0000 7f5fd5e13880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:31:12.030 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:12.027+0000 7f5fd5e13880 20 rados->read ofs=0 len=0 2023-10-05T11:31:12.031 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:12.027+0000 7f5fd5e13880 20 rados_obj.operate() r=0 bl.length=454 2023-10-05T11:31:12.031 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:12.027+0000 7f5fd5e13880 20 zone default found 2023-10-05T11:31:12.031 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:12.027+0000 7f5fd5e13880 4 Realm: () 2023-10-05T11:31:12.032 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:12.027+0000 7f5fd5e13880 4 ZoneGroup: default (c78aa576-9d15-4e9d-b3c0-4af23a22062c) 2023-10-05T11:31:12.032 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:12.027+0000 7f5fd5e13880 4 Zone: default (dff27d1e-df33-400e-a68a-7ba586947c99) 2023-10-05T11:31:12.032 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:12.027+0000 7f5fd5e13880 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T11:31:12.032 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:12.027+0000 7f5fd5e13880 20 zonegroup default 2023-10-05T11:31:12.032 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:12.027+0000 7f5fd5e13880 20 rados->read ofs=0 len=0 2023-10-05T11:31:12.032 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:12.028+0000 7f5fd5e13880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:12.032 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:12.028+0000 7f5fd5e13880 20 rados->read ofs=0 len=0 2023-10-05T11:31:12.032 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:12.028+0000 7f5fd5e13880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:12.032 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:12.028+0000 7f5fd5e13880 20 rados->read ofs=0 len=0 2023-10-05T11:31:12.032 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:12.028+0000 7f5fd5e13880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:12.032 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:12.028+0000 7f5fd5e13880 20 started sync module instance, tier type = 2023-10-05T11:31:12.032 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:12.028+0000 7f5fd5e13880 20 started zone id=dff27d1e-df33-400e-a68a-7ba586947c99 (name=default) with tier type = 2023-10-05T11:31:12.035 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:12.032+0000 7f5fd1af8640 0 -- 172.21.15.12:0/3282350663 >> [v2:172.21.15.170:6824/75773779,v1:172.21.15.170:6825/75773779] conn(0x55750e2af800 msgr2=0x55750e294580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:31:12.045 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:12.042+0000 7f5fd5e13880 20 add_watcher() i=0 2023-10-05T11:31:12.045 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:12.042+0000 7f5fd5e13880 20 add_watcher() i=1 2023-10-05T11:31:12.045 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:12.042+0000 7f5fd5e13880 20 add_watcher() i=2 2023-10-05T11:31:12.045 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:12.042+0000 7f5fd5e13880 20 add_watcher() i=3 2023-10-05T11:31:12.045 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:12.042+0000 7f5fd5e13880 20 add_watcher() i=4 2023-10-05T11:31:12.045 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:12.042+0000 7f5fd5e13880 20 add_watcher() i=5 2023-10-05T11:31:12.047 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:12.045+0000 7f5fd5e13880 20 add_watcher() i=6 2023-10-05T11:31:12.047 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:12.045+0000 7f5fd5e13880 20 add_watcher() i=7 2023-10-05T11:31:12.048 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:12.045+0000 7f5fd5e13880 2 all 8 watchers are set, enabling cache 2023-10-05T11:31:12.050 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:12.048+0000 7f5fb92c7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:31:12.051 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:12.048+0000 7f5fd5e13880 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T11:31:12.051 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:12.048+0000 7f5fd5e13880 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T11:31:12.057 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:12.053+0000 7f5fd5e13880 5 note: GC not initialized 2023-10-05T11:31:12.057 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:12.054+0000 7f5fb4abe640 20 reqs_thread_entry: start 2023-10-05T11:31:12.057 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:12.054+0000 7f5fd5e13880 20 init_complete bucket index max shards: 11 2023-10-05T11:31:12.057 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:12.054+0000 7f5fd5e13880 20 Filter name: none 2023-10-05T11:31:12.057 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:12.054+0000 7f5fb2aba640 20 reqs_thread_entry: start 2023-10-05T11:31:12.057 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:12.054+0000 7f5fd5e13880 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2023-10-05T11:31:12.057 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:12.054+0000 7f5fd5e13880 20 rados->read ofs=0 len=0 2023-10-05T11:31:12.058 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:12.054+0000 7f5fd5e13880 20 rados_obj.operate() r=0 bl.length=190 2023-10-05T11:31:12.058 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:12.054+0000 7f5fd5e13880 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2023-10-05T11:31:12.058 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:12.054+0000 7f5fd5e13880 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2023-10-05T11:31:12.059 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:12.054+0000 7f5fd5e13880 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:dff27d1e-df33-400e-a68a-7ba586947c99.4604.2 : miss 2023-10-05T11:31:12.059 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:12.054+0000 7f5fd5e13880 20 rados->read ofs=0 len=0 2023-10-05T11:31:12.059 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:12.055+0000 7f5fd5e13880 20 rados_obj.operate() r=0 bl.length=368 2023-10-05T11:31:12.059 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:12.055+0000 7f5fd5e13880 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:dff27d1e-df33-400e-a68a-7ba586947c99.4604.2 info.flags=0x17 2023-10-05T11:31:12.059 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:12.055+0000 7f5fd5e13880 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:dff27d1e-df33-400e-a68a-7ba586947c99.4604.2 to cache LRU end 2023-10-05T11:31:12.059 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:12.055+0000 7f5fd5e13880 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T11:31:12.059 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:12.055+0000 7f5fd5e13880 10 updating xattr: name=user.rgw.acl bl.length()=179 2023-10-05T11:31:12.059 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:12.055+0000 7f5fd5e13880 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:dff27d1e-df33-400e-a68a-7ba586947c99.4604.2 2023-10-05T11:31:12.059 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:12.055+0000 7f5fd5e13880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.0 2023-10-05T11:31:12.059 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:12.055+0000 7f5fd5e13880 1 NOTICE: finished shard 0 (0 entries found) 2023-10-05T11:31:12.059 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:12.055+0000 7f5fd5e13880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.1 2023-10-05T11:31:12.059 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:12.056+0000 7f5fd5e13880 1 NOTICE: finished shard 1 (0 entries found) 2023-10-05T11:31:12.060 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:12.056+0000 7f5fd5e13880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.2 2023-10-05T11:31:12.060 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:12.056+0000 7f5fd5e13880 1 NOTICE: finished shard 2 (0 entries found) 2023-10-05T11:31:12.060 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:12.056+0000 7f5fd5e13880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.3 2023-10-05T11:31:12.060 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:12.057+0000 7f5fd5e13880 1 NOTICE: finished shard 3 (0 entries found) 2023-10-05T11:31:12.061 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:12.057+0000 7f5fd5e13880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.4 2023-10-05T11:31:12.061 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:12.057+0000 7f5fd5e13880 1 NOTICE: finished shard 4 (0 entries found) 2023-10-05T11:31:12.061 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:12.057+0000 7f5fd5e13880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.5 2023-10-05T11:31:12.061 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:12.058+0000 7f5fd5e13880 1 NOTICE: finished shard 5 (0 entries found) 2023-10-05T11:31:12.061 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:12.058+0000 7f5fd5e13880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.6 2023-10-05T11:31:12.062 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:12.058+0000 7f5fd5e13880 1 NOTICE: finished shard 6 (0 entries found) 2023-10-05T11:31:12.062 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:12.058+0000 7f5fd5e13880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.7 2023-10-05T11:31:12.062 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:12.058+0000 7f5fd5e13880 1 NOTICE: finished shard 7 (0 entries found) 2023-10-05T11:31:12.062 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:12.058+0000 7f5fd5e13880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.8 2023-10-05T11:31:12.062 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:12.059+0000 7f5fd5e13880 1 NOTICE: finished shard 8 (0 entries found) 2023-10-05T11:31:12.062 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:12.059+0000 7f5fd5e13880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.9 2023-10-05T11:31:12.062 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:12.059+0000 7f5fd5e13880 1 NOTICE: finished shard 9 (0 entries found) 2023-10-05T11:31:12.063 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:12.059+0000 7f5fd5e13880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.10 2023-10-05T11:31:12.063 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:12.060+0000 7f5fd5e13880 1 NOTICE: finished shard 10 (0 entries found) 2023-10-05T11:31:12.063 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:12.060+0000 7f5fd5e13880 1 NOTICE: finished all shards (0 entries found) 2023-10-05T11:31:12.063 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:12.060+0000 7f5fb92c7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:31:12.065 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:12.062+0000 7f5fd5e13880 20 remove_watcher() i=0 2023-10-05T11:31:12.065 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:12.062+0000 7f5fd5e13880 2 removed watcher, disabling cache 2023-10-05T11:31:12.066 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:12.064+0000 7f5fd5e13880 20 remove_watcher() i=1 2023-10-05T11:31:12.067 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:12.065+0000 7f5fd5e13880 20 remove_watcher() i=2 2023-10-05T11:31:12.068 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:12.066+0000 7f5fd5e13880 20 remove_watcher() i=3 2023-10-05T11:31:12.069 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:12.067+0000 7f5fd5e13880 20 remove_watcher() i=4 2023-10-05T11:31:12.070 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:12.068+0000 7f5fd5e13880 20 remove_watcher() i=5 2023-10-05T11:31:12.073 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:12.071+0000 7f5fd5e13880 20 remove_watcher() i=6 2023-10-05T11:31:12.074 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:12.072+0000 7f5fd5e13880 20 remove_watcher() i=7 2023-10-05T11:31:12.079 INFO:tasks.workunit.client.0.smithi012.stderr:TEST: verify that bucket check fixes do not affect null version objects 2023-10-05T11:31:12.079 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:31:12.184 INFO:tasks.workunit.client.0.smithi012.stderr:TEST: bucket check stats are correct in the presence of unlinked entries 2023-10-05T11:31:12.184 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:31:12.841 INFO:tasks.workunit.client.0.smithi012.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2023-10-05T11:31:13.237 INFO:tasks.workunit.client.0.smithi012.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2023-10-05T11:31:14.727 INFO:tasks.workunit.client.0.smithi012.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2023-10-05T11:31:14.728 INFO:tasks.workunit.client.0.smithi012.stderr:radosgw-admin bi list --bucket check-bucket --object c 2023-10-05T11:31:14.764 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setuser ceph since I am not root 2023-10-05T11:31:14.764 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T11:31:14.778 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:14.776+0000 7fca66a0a880 20 rados->read ofs=0 len=0 2023-10-05T11:31:14.780 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:14.777+0000 7fca66a0a880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:14.780 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:14.777+0000 7fca66a0a880 20 realm 2023-10-05T11:31:14.780 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:14.777+0000 7fca66a0a880 20 rados->read ofs=0 len=0 2023-10-05T11:31:14.780 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:14.777+0000 7fca66a0a880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:14.781 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:14.777+0000 7fca66a0a880 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T11:31:14.781 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:14.777+0000 7fca66a0a880 20 rados->read ofs=0 len=0 2023-10-05T11:31:14.781 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:14.778+0000 7fca66a0a880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:14.781 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:14.778+0000 7fca66a0a880 20 rados->read ofs=0 len=0 2023-10-05T11:31:14.781 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:14.779+0000 7fca66a0a880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:31:14.781 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:14.779+0000 7fca66a0a880 20 rados->read ofs=0 len=0 2023-10-05T11:31:14.782 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:14.780+0000 7fca66a0a880 20 rados_obj.operate() r=0 bl.length=1020 2023-10-05T11:31:14.782 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:14.780+0000 7fca66a0a880 20 searching for the correct realm 2023-10-05T11:31:14.793 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:14.790+0000 7fca659b7640 0 -- 172.21.15.12:0/521713213 >> [v2:172.21.15.12:6813/3341239609,v1:172.21.15.12:6815/3341239609] conn(0x563a01acd000 msgr2=0x563a019c4100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:31:14.795 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:14.793+0000 7fca66a0a880 20 RGWRados::pool_iterate: got zone_info.dff27d1e-df33-400e-a68a-7ba586947c99 2023-10-05T11:31:14.795 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:14.793+0000 7fca66a0a880 20 RGWRados::pool_iterate: got zonegroup_info.c78aa576-9d15-4e9d-b3c0-4af23a22062c 2023-10-05T11:31:14.796 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:14.793+0000 7fca66a0a880 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T11:31:14.796 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:14.793+0000 7fca66a0a880 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T11:31:14.796 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:14.793+0000 7fca66a0a880 20 rados->read ofs=0 len=0 2023-10-05T11:31:14.796 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:14.793+0000 7fca66a0a880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:14.796 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:14.793+0000 7fca66a0a880 20 rados->read ofs=0 len=0 2023-10-05T11:31:14.797 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:14.793+0000 7fca66a0a880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:31:14.797 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:14.793+0000 7fca66a0a880 20 rados->read ofs=0 len=0 2023-10-05T11:31:14.797 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:14.794+0000 7fca66a0a880 20 rados_obj.operate() r=0 bl.length=454 2023-10-05T11:31:14.797 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:14.794+0000 7fca66a0a880 20 zone default found 2023-10-05T11:31:14.797 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:14.794+0000 7fca66a0a880 4 Realm: () 2023-10-05T11:31:14.797 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:14.794+0000 7fca66a0a880 4 ZoneGroup: default (c78aa576-9d15-4e9d-b3c0-4af23a22062c) 2023-10-05T11:31:14.798 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:14.794+0000 7fca66a0a880 4 Zone: default (dff27d1e-df33-400e-a68a-7ba586947c99) 2023-10-05T11:31:14.798 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:14.794+0000 7fca66a0a880 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T11:31:14.798 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:14.794+0000 7fca66a0a880 20 zonegroup default 2023-10-05T11:31:14.798 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:14.794+0000 7fca66a0a880 20 rados->read ofs=0 len=0 2023-10-05T11:31:14.798 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:14.794+0000 7fca66a0a880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:14.798 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:14.794+0000 7fca66a0a880 20 rados->read ofs=0 len=0 2023-10-05T11:31:14.798 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:14.794+0000 7fca66a0a880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:14.798 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:14.794+0000 7fca66a0a880 20 rados->read ofs=0 len=0 2023-10-05T11:31:14.798 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:14.794+0000 7fca66a0a880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:14.798 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:14.794+0000 7fca66a0a880 20 started sync module instance, tier type = 2023-10-05T11:31:14.798 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:14.794+0000 7fca66a0a880 20 started zone id=dff27d1e-df33-400e-a68a-7ba586947c99 (name=default) with tier type = 2023-10-05T11:31:14.801 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:14.799+0000 7fca649b5640 0 -- 172.21.15.12:0/521713213 >> [v2:172.21.15.170:6824/75773779,v1:172.21.15.170:6825/75773779] conn(0x563a01aa9000 msgr2=0x563a0190b180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:31:14.809 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:14.806+0000 7fca66a0a880 20 add_watcher() i=0 2023-10-05T11:31:14.809 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:14.806+0000 7fca66a0a880 20 add_watcher() i=1 2023-10-05T11:31:14.809 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:14.806+0000 7fca66a0a880 20 add_watcher() i=2 2023-10-05T11:31:14.809 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:14.806+0000 7fca66a0a880 20 add_watcher() i=3 2023-10-05T11:31:14.809 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:14.806+0000 7fca66a0a880 20 add_watcher() i=4 2023-10-05T11:31:14.809 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:14.806+0000 7fca66a0a880 20 add_watcher() i=5 2023-10-05T11:31:14.809 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:14.806+0000 7fca66a0a880 20 add_watcher() i=6 2023-10-05T11:31:14.810 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:14.807+0000 7fca66a0a880 20 add_watcher() i=7 2023-10-05T11:31:14.810 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:14.807+0000 7fca66a0a880 2 all 8 watchers are set, enabling cache 2023-10-05T11:31:14.812 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:14.809+0000 7fca4c184640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:31:14.812 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:14.809+0000 7fca66a0a880 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T11:31:14.812 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:14.809+0000 7fca66a0a880 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T11:31:14.818 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:14.815+0000 7fca66a0a880 5 note: GC not initialized 2023-10-05T11:31:14.818 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:14.815+0000 7fca4797b640 20 reqs_thread_entry: start 2023-10-05T11:31:14.818 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:14.815+0000 7fca66a0a880 20 init_complete bucket index max shards: 11 2023-10-05T11:31:14.819 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:14.815+0000 7fca66a0a880 20 Filter name: none 2023-10-05T11:31:14.819 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:14.816+0000 7fca45977640 20 reqs_thread_entry: start 2023-10-05T11:31:14.819 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:14.816+0000 7fca66a0a880 20 rados->read ofs=0 len=0 2023-10-05T11:31:14.820 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:14.816+0000 7fca66a0a880 20 rados_obj.operate() r=0 bl.length=190 2023-10-05T11:31:14.820 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:14.816+0000 7fca66a0a880 20 rados->read ofs=0 len=0 2023-10-05T11:31:14.820 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:14.817+0000 7fca66a0a880 20 rados_obj.operate() r=0 bl.length=368 2023-10-05T11:31:14.820 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:14.817+0000 7fca66a0a880 20 couldn't put binfo cache entry, might have raced with data changes 2023-10-05T11:31:14.820 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:14.817+0000 7fca66a0a880 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2023-10-05T11:31:14.820 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:14.817+0000 7fca66a0a880 20 INFO: main: starting shard=0 2023-10-05T11:31:14.820 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:14.817+0000 7fca66a0a880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.0 2023-10-05T11:31:14.820 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:14.817+0000 7fca66a0a880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:31:14.821 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:14.817+0000 7fca66a0a880 20 INFO: main: starting shard=1 2023-10-05T11:31:14.821 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:14.817+0000 7fca66a0a880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.1 2023-10-05T11:31:14.821 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:14.818+0000 7fca66a0a880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:31:14.821 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:14.818+0000 7fca66a0a880 20 INFO: main: starting shard=2 2023-10-05T11:31:14.822 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:14.818+0000 7fca66a0a880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.2 2023-10-05T11:31:14.822 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:14.818+0000 7fca66a0a880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:31:14.822 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:14.818+0000 7fca66a0a880 20 INFO: main: starting shard=3 2023-10-05T11:31:14.822 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:14.818+0000 7fca66a0a880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.3 2023-10-05T11:31:14.822 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:14.819+0000 7fca66a0a880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:31:14.822 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:14.819+0000 7fca66a0a880 20 INFO: main: starting shard=4 2023-10-05T11:31:14.822 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:14.819+0000 7fca66a0a880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.4 2023-10-05T11:31:14.823 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:14.819+0000 7fca66a0a880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:31:14.823 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:14.819+0000 7fca66a0a880 20 INFO: main: starting shard=5 2023-10-05T11:31:14.823 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:14.819+0000 7fca66a0a880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.5 2023-10-05T11:31:14.823 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:14.819+0000 7fca66a0a880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:31:14.823 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:14.820+0000 7fca66a0a880 20 INFO: main: starting shard=6 2023-10-05T11:31:14.823 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:14.820+0000 7fca66a0a880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.6 2023-10-05T11:31:14.823 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:14.820+0000 7fca66a0a880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:31:14.823 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:14.820+0000 7fca66a0a880 20 INFO: main: starting shard=7 2023-10-05T11:31:14.823 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:14.820+0000 7fca66a0a880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.7 2023-10-05T11:31:14.824 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:14.821+0000 7fca66a0a880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:31:14.824 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:14.821+0000 7fca66a0a880 20 INFO: main: starting shard=8 2023-10-05T11:31:14.824 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:14.821+0000 7fca66a0a880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.8 2023-10-05T11:31:14.824 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:14.821+0000 7fca66a0a880 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2023-10-05T11:31:14.824 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:14.821+0000 7fca66a0a880 20 INFO: main: starting shard=9 2023-10-05T11:31:14.824 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:14.821+0000 7fca66a0a880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.9 2023-10-05T11:31:14.824 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:14.822+0000 7fca66a0a880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:31:14.825 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:14.822+0000 7fca66a0a880 20 INFO: main: starting shard=10 2023-10-05T11:31:14.825 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:14.822+0000 7fca66a0a880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.10 2023-10-05T11:31:14.825 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:14.822+0000 7fca66a0a880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:31:14.825 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:14.822+0000 7fca66a0a880 20 INFO: main: done 2023-10-05T11:31:14.825 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:14.823+0000 7fca4c184640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:31:14.827 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:14.825+0000 7fca66a0a880 20 remove_watcher() i=0 2023-10-05T11:31:14.828 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:14.825+0000 7fca66a0a880 2 removed watcher, disabling cache 2023-10-05T11:31:14.829 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:14.826+0000 7fca66a0a880 20 remove_watcher() i=1 2023-10-05T11:31:14.830 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:14.827+0000 7fca66a0a880 20 remove_watcher() i=2 2023-10-05T11:31:14.831 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:14.829+0000 7fca66a0a880 20 remove_watcher() i=3 2023-10-05T11:31:14.832 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:14.830+0000 7fca66a0a880 20 remove_watcher() i=4 2023-10-05T11:31:14.834 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:14.831+0000 7fca66a0a880 20 remove_watcher() i=5 2023-10-05T11:31:14.835 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:14.832+0000 7fca66a0a880 20 remove_watcher() i=6 2023-10-05T11:31:14.835 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:14.833+0000 7fca66a0a880 20 remove_watcher() i=7 2023-10-05T11:31:14.962 INFO:tasks.workunit.client.0.smithi012.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2023-10-05T11:31:14.963 INFO:tasks.workunit.client.0.smithi012.stderr:radosgw-admin bi list --bucket check-bucket --object d 2023-10-05T11:31:14.994 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setuser ceph since I am not root 2023-10-05T11:31:14.994 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T11:31:15.007 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.004+0000 7fe120013880 20 rados->read ofs=0 len=0 2023-10-05T11:31:15.009 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.006+0000 7fe120013880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:15.009 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.006+0000 7fe120013880 20 realm 2023-10-05T11:31:15.009 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.006+0000 7fe120013880 20 rados->read ofs=0 len=0 2023-10-05T11:31:15.009 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.006+0000 7fe120013880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:15.009 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.006+0000 7fe120013880 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T11:31:15.009 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.006+0000 7fe120013880 20 rados->read ofs=0 len=0 2023-10-05T11:31:15.009 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.006+0000 7fe120013880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:15.009 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.006+0000 7fe120013880 20 rados->read ofs=0 len=0 2023-10-05T11:31:15.010 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.007+0000 7fe120013880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:31:15.010 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.007+0000 7fe120013880 20 rados->read ofs=0 len=0 2023-10-05T11:31:15.010 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.008+0000 7fe120013880 20 rados_obj.operate() r=0 bl.length=1020 2023-10-05T11:31:15.010 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.008+0000 7fe120013880 20 searching for the correct realm 2023-10-05T11:31:15.022 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.019+0000 7fe11cd8b640 0 -- 172.21.15.12:0/324847353 >> [v2:172.21.15.170:6800/4137726411,v1:172.21.15.170:6801/4137726411] conn(0x557ff3730000 msgr2=0x557ff362f600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:31:15.022 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.019+0000 7fe120013880 20 RGWRados::pool_iterate: got zone_info.dff27d1e-df33-400e-a68a-7ba586947c99 2023-10-05T11:31:15.022 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.019+0000 7fe120013880 20 RGWRados::pool_iterate: got zonegroup_info.c78aa576-9d15-4e9d-b3c0-4af23a22062c 2023-10-05T11:31:15.022 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.019+0000 7fe120013880 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T11:31:15.022 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.019+0000 7fe120013880 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T11:31:15.022 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.019+0000 7fe120013880 20 rados->read ofs=0 len=0 2023-10-05T11:31:15.022 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.019+0000 7fe120013880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:15.022 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.019+0000 7fe120013880 20 rados->read ofs=0 len=0 2023-10-05T11:31:15.024 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.019+0000 7fe120013880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:31:15.024 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.019+0000 7fe120013880 20 rados->read ofs=0 len=0 2023-10-05T11:31:15.024 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.020+0000 7fe120013880 20 rados_obj.operate() r=0 bl.length=454 2023-10-05T11:31:15.024 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.020+0000 7fe120013880 20 zone default found 2023-10-05T11:31:15.024 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.020+0000 7fe120013880 4 Realm: () 2023-10-05T11:31:15.024 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.020+0000 7fe120013880 4 ZoneGroup: default (c78aa576-9d15-4e9d-b3c0-4af23a22062c) 2023-10-05T11:31:15.024 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.020+0000 7fe120013880 4 Zone: default (dff27d1e-df33-400e-a68a-7ba586947c99) 2023-10-05T11:31:15.024 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.020+0000 7fe120013880 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T11:31:15.024 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.020+0000 7fe120013880 20 zonegroup default 2023-10-05T11:31:15.024 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.020+0000 7fe120013880 20 rados->read ofs=0 len=0 2023-10-05T11:31:15.025 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.020+0000 7fe120013880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:15.025 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.020+0000 7fe120013880 20 rados->read ofs=0 len=0 2023-10-05T11:31:15.025 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.020+0000 7fe120013880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:15.025 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.020+0000 7fe120013880 20 rados->read ofs=0 len=0 2023-10-05T11:31:15.025 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.020+0000 7fe120013880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:15.025 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.020+0000 7fe120013880 20 started sync module instance, tier type = 2023-10-05T11:31:15.025 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.020+0000 7fe120013880 20 started zone id=dff27d1e-df33-400e-a68a-7ba586947c99 (name=default) with tier type = 2023-10-05T11:31:15.032 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.029+0000 7fe11c58a640 0 -- 172.21.15.12:0/324847353 >> [v2:172.21.15.12:6808/396693578,v1:172.21.15.12:6809/396693578] conn(0x557ff3730400 msgr2=0x557ff362fb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:31:15.032 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.029+0000 7fe120013880 20 add_watcher() i=0 2023-10-05T11:31:15.033 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.029+0000 7fe120013880 20 add_watcher() i=1 2023-10-05T11:31:15.033 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.029+0000 7fe120013880 20 add_watcher() i=2 2023-10-05T11:31:15.033 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.029+0000 7fe120013880 20 add_watcher() i=3 2023-10-05T11:31:15.033 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.029+0000 7fe120013880 20 add_watcher() i=4 2023-10-05T11:31:15.033 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.029+0000 7fe120013880 20 add_watcher() i=5 2023-10-05T11:31:15.033 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.031+0000 7fe120013880 20 add_watcher() i=6 2023-10-05T11:31:15.033 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.031+0000 7fe120013880 20 add_watcher() i=7 2023-10-05T11:31:15.034 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.031+0000 7fe120013880 2 all 8 watchers are set, enabling cache 2023-10-05T11:31:15.035 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.033+0000 7fe103558640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:31:15.036 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.033+0000 7fe120013880 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T11:31:15.036 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.033+0000 7fe120013880 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T11:31:15.041 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.038+0000 7fe120013880 5 note: GC not initialized 2023-10-05T11:31:15.041 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.038+0000 7fe0fed4f640 20 reqs_thread_entry: start 2023-10-05T11:31:15.042 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.039+0000 7fe120013880 20 init_complete bucket index max shards: 11 2023-10-05T11:31:15.042 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.039+0000 7fe120013880 20 Filter name: none 2023-10-05T11:31:15.042 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.039+0000 7fe0fcd4b640 20 reqs_thread_entry: start 2023-10-05T11:31:15.042 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.039+0000 7fe120013880 20 rados->read ofs=0 len=0 2023-10-05T11:31:15.043 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.039+0000 7fe120013880 20 rados_obj.operate() r=0 bl.length=190 2023-10-05T11:31:15.043 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.039+0000 7fe120013880 20 rados->read ofs=0 len=0 2023-10-05T11:31:15.043 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.040+0000 7fe120013880 20 rados_obj.operate() r=0 bl.length=368 2023-10-05T11:31:15.043 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.040+0000 7fe120013880 20 couldn't put binfo cache entry, might have raced with data changes 2023-10-05T11:31:15.044 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.040+0000 7fe120013880 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2023-10-05T11:31:15.044 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.040+0000 7fe120013880 20 INFO: main: starting shard=0 2023-10-05T11:31:15.045 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.040+0000 7fe120013880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.0 2023-10-05T11:31:15.045 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.040+0000 7fe120013880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:31:15.045 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.040+0000 7fe120013880 20 INFO: main: starting shard=1 2023-10-05T11:31:15.046 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.040+0000 7fe120013880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.1 2023-10-05T11:31:15.047 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.041+0000 7fe120013880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:31:15.048 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.041+0000 7fe120013880 20 INFO: main: starting shard=2 2023-10-05T11:31:15.048 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.041+0000 7fe120013880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.2 2023-10-05T11:31:15.048 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.041+0000 7fe120013880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:31:15.048 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.041+0000 7fe120013880 20 INFO: main: starting shard=3 2023-10-05T11:31:15.048 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.041+0000 7fe120013880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.3 2023-10-05T11:31:15.048 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.042+0000 7fe120013880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:31:15.048 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.042+0000 7fe120013880 20 INFO: main: starting shard=4 2023-10-05T11:31:15.048 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.042+0000 7fe120013880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.4 2023-10-05T11:31:15.048 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.042+0000 7fe120013880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:31:15.048 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.042+0000 7fe120013880 20 INFO: main: starting shard=5 2023-10-05T11:31:15.049 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.042+0000 7fe120013880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.5 2023-10-05T11:31:15.049 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.043+0000 7fe120013880 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2023-10-05T11:31:15.049 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.043+0000 7fe120013880 20 INFO: main: starting shard=6 2023-10-05T11:31:15.049 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.043+0000 7fe120013880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.6 2023-10-05T11:31:15.049 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.044+0000 7fe120013880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:31:15.049 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.044+0000 7fe120013880 20 INFO: main: starting shard=7 2023-10-05T11:31:15.049 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.044+0000 7fe120013880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.7 2023-10-05T11:31:15.049 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.044+0000 7fe120013880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:31:15.049 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.044+0000 7fe120013880 20 INFO: main: starting shard=8 2023-10-05T11:31:15.049 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.044+0000 7fe120013880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.8 2023-10-05T11:31:15.049 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.044+0000 7fe120013880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:31:15.049 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.044+0000 7fe120013880 20 INFO: main: starting shard=9 2023-10-05T11:31:15.050 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.044+0000 7fe120013880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.9 2023-10-05T11:31:15.050 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.045+0000 7fe120013880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:31:15.050 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.045+0000 7fe120013880 20 INFO: main: starting shard=10 2023-10-05T11:31:15.050 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.045+0000 7fe120013880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.10 2023-10-05T11:31:15.050 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.045+0000 7fe120013880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:31:15.050 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.045+0000 7fe120013880 20 INFO: main: done 2023-10-05T11:31:15.051 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.046+0000 7fe103558640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:31:15.051 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.048+0000 7fe120013880 20 remove_watcher() i=0 2023-10-05T11:31:15.051 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.049+0000 7fe120013880 2 removed watcher, disabling cache 2023-10-05T11:31:15.052 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.050+0000 7fe120013880 20 remove_watcher() i=1 2023-10-05T11:31:15.053 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.051+0000 7fe120013880 20 remove_watcher() i=2 2023-10-05T11:31:15.054 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.052+0000 7fe120013880 20 remove_watcher() i=3 2023-10-05T11:31:15.055 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.053+0000 7fe120013880 20 remove_watcher() i=4 2023-10-05T11:31:15.056 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.054+0000 7fe120013880 20 remove_watcher() i=5 2023-10-05T11:31:15.057 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.055+0000 7fe120013880 20 remove_watcher() i=6 2023-10-05T11:31:15.058 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.056+0000 7fe120013880 20 remove_watcher() i=7 2023-10-05T11:31:15.180 INFO:tasks.workunit.client.0.smithi012.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2023-10-05T11:31:15.181 INFO:tasks.workunit.client.0.smithi012.stderr:radosgw-admin bi list --bucket check-bucket --object e 2023-10-05T11:31:15.211 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setuser ceph since I am not root 2023-10-05T11:31:15.211 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T11:31:15.223 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.221+0000 7f97c788b880 20 rados->read ofs=0 len=0 2023-10-05T11:31:15.225 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.222+0000 7f97c788b880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:15.225 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.222+0000 7f97c788b880 20 realm 2023-10-05T11:31:15.225 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.222+0000 7f97c788b880 20 rados->read ofs=0 len=0 2023-10-05T11:31:15.225 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.222+0000 7f97c788b880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:15.225 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.222+0000 7f97c788b880 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T11:31:15.225 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.222+0000 7f97c788b880 20 rados->read ofs=0 len=0 2023-10-05T11:31:15.226 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.222+0000 7f97c788b880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:15.226 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.222+0000 7f97c788b880 20 rados->read ofs=0 len=0 2023-10-05T11:31:15.226 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.223+0000 7f97c788b880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:31:15.226 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.223+0000 7f97c788b880 20 rados->read ofs=0 len=0 2023-10-05T11:31:15.227 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.224+0000 7f97c788b880 20 rados_obj.operate() r=0 bl.length=1020 2023-10-05T11:31:15.227 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.224+0000 7f97c788b880 20 searching for the correct realm 2023-10-05T11:31:15.236 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.234+0000 7f97c6030640 0 -- 172.21.15.12:0/4080182315 >> [v2:172.21.15.170:6814/3150808418,v1:172.21.15.170:6816/3150808418] conn(0x55947d23bc00 msgr2=0x55947c640c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:31:15.238 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.235+0000 7f97c788b880 20 RGWRados::pool_iterate: got zone_info.dff27d1e-df33-400e-a68a-7ba586947c99 2023-10-05T11:31:15.238 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.235+0000 7f97c788b880 20 RGWRados::pool_iterate: got zonegroup_info.c78aa576-9d15-4e9d-b3c0-4af23a22062c 2023-10-05T11:31:15.238 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.235+0000 7f97c788b880 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T11:31:15.239 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.235+0000 7f97c788b880 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T11:31:15.239 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.235+0000 7f97c788b880 20 rados->read ofs=0 len=0 2023-10-05T11:31:15.239 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.235+0000 7f97c788b880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:15.239 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.235+0000 7f97c788b880 20 rados->read ofs=0 len=0 2023-10-05T11:31:15.239 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.236+0000 7f97c788b880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:31:15.239 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.236+0000 7f97c788b880 20 rados->read ofs=0 len=0 2023-10-05T11:31:15.240 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.236+0000 7f97c788b880 20 rados_obj.operate() r=0 bl.length=454 2023-10-05T11:31:15.240 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.236+0000 7f97c788b880 20 zone default found 2023-10-05T11:31:15.240 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.236+0000 7f97c788b880 4 Realm: () 2023-10-05T11:31:15.240 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.236+0000 7f97c788b880 4 ZoneGroup: default (c78aa576-9d15-4e9d-b3c0-4af23a22062c) 2023-10-05T11:31:15.240 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.236+0000 7f97c788b880 4 Zone: default (dff27d1e-df33-400e-a68a-7ba586947c99) 2023-10-05T11:31:15.240 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.236+0000 7f97c788b880 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T11:31:15.241 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.236+0000 7f97c788b880 20 zonegroup default 2023-10-05T11:31:15.241 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.236+0000 7f97c788b880 20 rados->read ofs=0 len=0 2023-10-05T11:31:15.241 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.236+0000 7f97c788b880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:15.241 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.236+0000 7f97c788b880 20 rados->read ofs=0 len=0 2023-10-05T11:31:15.241 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.237+0000 7f97c788b880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:15.241 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.237+0000 7f97c788b880 20 rados->read ofs=0 len=0 2023-10-05T11:31:15.241 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.237+0000 7f97c788b880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:15.241 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.237+0000 7f97c788b880 20 started sync module instance, tier type = 2023-10-05T11:31:15.241 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.237+0000 7f97c788b880 20 started zone id=dff27d1e-df33-400e-a68a-7ba586947c99 (name=default) with tier type = 2023-10-05T11:31:15.245 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.243+0000 7f97c6831640 0 -- 172.21.15.12:0/4080182315 >> [v2:172.21.15.170:6800/4137726411,v1:172.21.15.170:6801/4137726411] conn(0x55947c6f1800 msgr2=0x55947c6ff600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:31:15.249 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.246+0000 7f97c788b880 20 add_watcher() i=0 2023-10-05T11:31:15.249 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.246+0000 7f97c788b880 20 add_watcher() i=1 2023-10-05T11:31:15.249 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.246+0000 7f97c788b880 20 add_watcher() i=2 2023-10-05T11:31:15.249 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.246+0000 7f97c788b880 20 add_watcher() i=3 2023-10-05T11:31:15.250 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.246+0000 7f97c788b880 20 add_watcher() i=4 2023-10-05T11:31:15.250 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.246+0000 7f97c788b880 20 add_watcher() i=5 2023-10-05T11:31:15.250 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.246+0000 7f97c788b880 20 add_watcher() i=6 2023-10-05T11:31:15.250 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.247+0000 7f97c788b880 20 add_watcher() i=7 2023-10-05T11:31:15.250 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.247+0000 7f97c788b880 2 all 8 watchers are set, enabling cache 2023-10-05T11:31:15.252 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.249+0000 7f97acffe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:31:15.252 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.249+0000 7f97c788b880 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T11:31:15.252 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.249+0000 7f97c788b880 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T11:31:15.257 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.255+0000 7f97c788b880 5 note: GC not initialized 2023-10-05T11:31:15.258 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.255+0000 7f97a87f5640 20 reqs_thread_entry: start 2023-10-05T11:31:15.258 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.255+0000 7f97c788b880 20 init_complete bucket index max shards: 11 2023-10-05T11:31:15.258 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.255+0000 7f97c788b880 20 Filter name: none 2023-10-05T11:31:15.258 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.255+0000 7f97a67f1640 20 reqs_thread_entry: start 2023-10-05T11:31:15.258 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.255+0000 7f97c788b880 20 rados->read ofs=0 len=0 2023-10-05T11:31:15.259 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.255+0000 7f97c788b880 20 rados_obj.operate() r=0 bl.length=190 2023-10-05T11:31:15.259 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.255+0000 7f97c788b880 20 rados->read ofs=0 len=0 2023-10-05T11:31:15.259 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.256+0000 7f97c788b880 20 rados_obj.operate() r=0 bl.length=368 2023-10-05T11:31:15.259 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.256+0000 7f97c788b880 20 couldn't put binfo cache entry, might have raced with data changes 2023-10-05T11:31:15.259 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.256+0000 7f97c788b880 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2023-10-05T11:31:15.259 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.256+0000 7f97c788b880 20 INFO: main: starting shard=0 2023-10-05T11:31:15.259 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.256+0000 7f97c788b880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.0 2023-10-05T11:31:15.259 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.256+0000 7f97c788b880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:31:15.260 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.256+0000 7f97c788b880 20 INFO: main: starting shard=1 2023-10-05T11:31:15.260 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.256+0000 7f97c788b880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.1 2023-10-05T11:31:15.260 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.257+0000 7f97c788b880 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2023-10-05T11:31:15.260 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.257+0000 7f97c788b880 20 INFO: main: starting shard=2 2023-10-05T11:31:15.261 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.257+0000 7f97c788b880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.2 2023-10-05T11:31:15.261 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.257+0000 7f97c788b880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:31:15.261 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.257+0000 7f97c788b880 20 INFO: main: starting shard=3 2023-10-05T11:31:15.261 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.257+0000 7f97c788b880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.3 2023-10-05T11:31:15.261 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.258+0000 7f97c788b880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:31:15.261 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.258+0000 7f97c788b880 20 INFO: main: starting shard=4 2023-10-05T11:31:15.261 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.258+0000 7f97c788b880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.4 2023-10-05T11:31:15.262 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.258+0000 7f97c788b880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:31:15.262 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.258+0000 7f97c788b880 20 INFO: main: starting shard=5 2023-10-05T11:31:15.262 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.258+0000 7f97c788b880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.5 2023-10-05T11:31:15.262 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.259+0000 7f97c788b880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:31:15.262 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.259+0000 7f97c788b880 20 INFO: main: starting shard=6 2023-10-05T11:31:15.262 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.259+0000 7f97c788b880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.6 2023-10-05T11:31:15.262 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.259+0000 7f97c788b880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:31:15.262 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.259+0000 7f97c788b880 20 INFO: main: starting shard=7 2023-10-05T11:31:15.263 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.259+0000 7f97c788b880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.7 2023-10-05T11:31:15.263 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.260+0000 7f97c788b880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:31:15.263 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.260+0000 7f97c788b880 20 INFO: main: starting shard=8 2023-10-05T11:31:15.264 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.260+0000 7f97c788b880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.8 2023-10-05T11:31:15.264 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.260+0000 7f97c788b880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:31:15.264 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.260+0000 7f97c788b880 20 INFO: main: starting shard=9 2023-10-05T11:31:15.264 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.260+0000 7f97c788b880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.9 2023-10-05T11:31:15.264 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.261+0000 7f97c788b880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:31:15.264 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.261+0000 7f97c788b880 20 INFO: main: starting shard=10 2023-10-05T11:31:15.264 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.261+0000 7f97c788b880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.10 2023-10-05T11:31:15.264 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.261+0000 7f97c788b880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:31:15.265 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.261+0000 7f97c788b880 20 INFO: main: done 2023-10-05T11:31:15.265 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.262+0000 7f97acffe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:31:15.267 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.264+0000 7f97c788b880 20 remove_watcher() i=0 2023-10-05T11:31:15.267 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.264+0000 7f97c788b880 2 removed watcher, disabling cache 2023-10-05T11:31:15.268 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.265+0000 7f97c788b880 20 remove_watcher() i=1 2023-10-05T11:31:15.269 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.266+0000 7f97c788b880 20 remove_watcher() i=2 2023-10-05T11:31:15.270 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.267+0000 7f97c788b880 20 remove_watcher() i=3 2023-10-05T11:31:15.271 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.268+0000 7f97c788b880 20 remove_watcher() i=4 2023-10-05T11:31:15.272 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.270+0000 7f97c788b880 20 remove_watcher() i=5 2023-10-05T11:31:15.274 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.271+0000 7f97c788b880 20 remove_watcher() i=6 2023-10-05T11:31:15.275 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.272+0000 7f97c788b880 20 remove_watcher() i=7 2023-10-05T11:31:15.383 INFO:tasks.workunit.client.0.smithi012.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2023-10-05T11:31:15.384 INFO:tasks.workunit.client.0.smithi012.stderr:radosgw-admin bi list --bucket check-bucket --object f 2023-10-05T11:31:15.415 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setuser ceph since I am not root 2023-10-05T11:31:15.415 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T11:31:15.428 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.425+0000 7fa9deac0880 20 rados->read ofs=0 len=0 2023-10-05T11:31:15.429 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.427+0000 7fa9deac0880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:15.430 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.427+0000 7fa9deac0880 20 realm 2023-10-05T11:31:15.430 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.427+0000 7fa9deac0880 20 rados->read ofs=0 len=0 2023-10-05T11:31:15.430 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.427+0000 7fa9deac0880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:15.430 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.427+0000 7fa9deac0880 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T11:31:15.430 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.427+0000 7fa9deac0880 20 rados->read ofs=0 len=0 2023-10-05T11:31:15.430 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.427+0000 7fa9deac0880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:15.430 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.427+0000 7fa9deac0880 20 rados->read ofs=0 len=0 2023-10-05T11:31:15.431 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.428+0000 7fa9deac0880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:31:15.431 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.428+0000 7fa9deac0880 20 rados->read ofs=0 len=0 2023-10-05T11:31:15.431 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.429+0000 7fa9deac0880 20 rados_obj.operate() r=0 bl.length=1020 2023-10-05T11:31:15.431 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.429+0000 7fa9deac0880 20 searching for the correct realm 2023-10-05T11:31:15.441 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.438+0000 7fa9dda6d640 0 -- 172.21.15.12:0/376283912 >> [v2:172.21.15.12:6824/2171933159,v1:172.21.15.12:6825/2171933159] conn(0x555a12e9ec00 msgr2=0x555a12dcd700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:31:15.441 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.439+0000 7fa9deac0880 20 RGWRados::pool_iterate: got zone_info.dff27d1e-df33-400e-a68a-7ba586947c99 2023-10-05T11:31:15.441 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.439+0000 7fa9deac0880 20 RGWRados::pool_iterate: got zonegroup_info.c78aa576-9d15-4e9d-b3c0-4af23a22062c 2023-10-05T11:31:15.441 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.439+0000 7fa9deac0880 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T11:31:15.442 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.439+0000 7fa9deac0880 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T11:31:15.442 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.439+0000 7fa9deac0880 20 rados->read ofs=0 len=0 2023-10-05T11:31:15.442 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.439+0000 7fa9deac0880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:15.442 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.439+0000 7fa9deac0880 20 rados->read ofs=0 len=0 2023-10-05T11:31:15.443 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.439+0000 7fa9deac0880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:31:15.443 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.439+0000 7fa9deac0880 20 rados->read ofs=0 len=0 2023-10-05T11:31:15.443 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.439+0000 7fa9deac0880 20 rados_obj.operate() r=0 bl.length=454 2023-10-05T11:31:15.443 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.439+0000 7fa9deac0880 20 zone default found 2023-10-05T11:31:15.443 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.439+0000 7fa9deac0880 4 Realm: () 2023-10-05T11:31:15.444 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.439+0000 7fa9deac0880 4 ZoneGroup: default (c78aa576-9d15-4e9d-b3c0-4af23a22062c) 2023-10-05T11:31:15.444 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.439+0000 7fa9deac0880 4 Zone: default (dff27d1e-df33-400e-a68a-7ba586947c99) 2023-10-05T11:31:15.444 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.439+0000 7fa9deac0880 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T11:31:15.444 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.439+0000 7fa9deac0880 20 zonegroup default 2023-10-05T11:31:15.444 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.439+0000 7fa9deac0880 20 rados->read ofs=0 len=0 2023-10-05T11:31:15.444 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.440+0000 7fa9deac0880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:15.444 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.440+0000 7fa9deac0880 20 rados->read ofs=0 len=0 2023-10-05T11:31:15.444 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.440+0000 7fa9deac0880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:15.444 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.440+0000 7fa9deac0880 20 rados->read ofs=0 len=0 2023-10-05T11:31:15.444 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.440+0000 7fa9deac0880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:15.444 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.440+0000 7fa9deac0880 20 started sync module instance, tier type = 2023-10-05T11:31:15.444 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.440+0000 7fa9deac0880 20 started zone id=dff27d1e-df33-400e-a68a-7ba586947c99 (name=default) with tier type = 2023-10-05T11:31:15.454 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.451+0000 7fa9dda6d640 0 -- 172.21.15.12:0/376283912 >> [v2:172.21.15.12:6824/2171933159,v1:172.21.15.12:6825/2171933159] conn(0x555a12f90c00 msgr2=0x555a12e8a100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:31:15.455 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.453+0000 7fa9deac0880 20 add_watcher() i=0 2023-10-05T11:31:15.455 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.453+0000 7fa9deac0880 20 add_watcher() i=1 2023-10-05T11:31:15.455 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.453+0000 7fa9deac0880 20 add_watcher() i=2 2023-10-05T11:31:15.456 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.453+0000 7fa9deac0880 20 add_watcher() i=3 2023-10-05T11:31:15.456 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.453+0000 7fa9deac0880 20 add_watcher() i=4 2023-10-05T11:31:15.457 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.454+0000 7fa9deac0880 20 add_watcher() i=5 2023-10-05T11:31:15.459 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.457+0000 7fa9deac0880 20 add_watcher() i=6 2023-10-05T11:31:15.460 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.457+0000 7fa9deac0880 20 add_watcher() i=7 2023-10-05T11:31:15.460 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.457+0000 7fa9deac0880 2 all 8 watchers are set, enabling cache 2023-10-05T11:31:15.461 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.459+0000 7fa9c423a640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:31:15.461 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.459+0000 7fa9deac0880 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T11:31:15.462 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.459+0000 7fa9deac0880 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T11:31:15.467 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.464+0000 7fa9deac0880 5 note: GC not initialized 2023-10-05T11:31:15.467 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.464+0000 7fa9bfa31640 20 reqs_thread_entry: start 2023-10-05T11:31:15.467 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.464+0000 7fa9deac0880 20 init_complete bucket index max shards: 11 2023-10-05T11:31:15.467 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.464+0000 7fa9deac0880 20 Filter name: none 2023-10-05T11:31:15.468 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.465+0000 7fa9bda2d640 20 reqs_thread_entry: start 2023-10-05T11:31:15.468 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.465+0000 7fa9deac0880 20 rados->read ofs=0 len=0 2023-10-05T11:31:15.469 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.465+0000 7fa9deac0880 20 rados_obj.operate() r=0 bl.length=190 2023-10-05T11:31:15.469 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.465+0000 7fa9deac0880 20 rados->read ofs=0 len=0 2023-10-05T11:31:15.469 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.465+0000 7fa9deac0880 20 rados_obj.operate() r=0 bl.length=368 2023-10-05T11:31:15.469 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.465+0000 7fa9deac0880 20 couldn't put binfo cache entry, might have raced with data changes 2023-10-05T11:31:15.469 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.465+0000 7fa9deac0880 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2023-10-05T11:31:15.469 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.465+0000 7fa9deac0880 20 INFO: main: starting shard=0 2023-10-05T11:31:15.469 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.465+0000 7fa9deac0880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.0 2023-10-05T11:31:15.469 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.466+0000 7fa9deac0880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:31:15.469 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.466+0000 7fa9deac0880 20 INFO: main: starting shard=1 2023-10-05T11:31:15.469 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.466+0000 7fa9deac0880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.1 2023-10-05T11:31:15.470 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.466+0000 7fa9deac0880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:31:15.470 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.466+0000 7fa9deac0880 20 INFO: main: starting shard=2 2023-10-05T11:31:15.470 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.466+0000 7fa9deac0880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.2 2023-10-05T11:31:15.470 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.467+0000 7fa9deac0880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:31:15.470 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.467+0000 7fa9deac0880 20 INFO: main: starting shard=3 2023-10-05T11:31:15.471 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.467+0000 7fa9deac0880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.3 2023-10-05T11:31:15.471 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.467+0000 7fa9deac0880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:31:15.471 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.467+0000 7fa9deac0880 20 INFO: main: starting shard=4 2023-10-05T11:31:15.471 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.467+0000 7fa9deac0880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.4 2023-10-05T11:31:15.471 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.468+0000 7fa9deac0880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:31:15.471 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.468+0000 7fa9deac0880 20 INFO: main: starting shard=5 2023-10-05T11:31:15.472 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.468+0000 7fa9deac0880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.5 2023-10-05T11:31:15.472 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.468+0000 7fa9deac0880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:31:15.472 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.468+0000 7fa9deac0880 20 INFO: main: starting shard=6 2023-10-05T11:31:15.472 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.468+0000 7fa9deac0880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.6 2023-10-05T11:31:15.472 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.469+0000 7fa9deac0880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:31:15.472 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.469+0000 7fa9deac0880 20 INFO: main: starting shard=7 2023-10-05T11:31:15.472 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.469+0000 7fa9deac0880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.7 2023-10-05T11:31:15.473 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.469+0000 7fa9deac0880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:31:15.473 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.469+0000 7fa9deac0880 20 INFO: main: starting shard=8 2023-10-05T11:31:15.473 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.469+0000 7fa9deac0880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.8 2023-10-05T11:31:15.473 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.470+0000 7fa9deac0880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:31:15.473 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.470+0000 7fa9deac0880 20 INFO: main: starting shard=9 2023-10-05T11:31:15.473 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.470+0000 7fa9deac0880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.9 2023-10-05T11:31:15.473 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.470+0000 7fa9deac0880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:31:15.473 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.470+0000 7fa9deac0880 20 INFO: main: starting shard=10 2023-10-05T11:31:15.474 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.470+0000 7fa9deac0880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.10 2023-10-05T11:31:15.474 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.471+0000 7fa9deac0880 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2023-10-05T11:31:15.474 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.471+0000 7fa9deac0880 20 INFO: main: done 2023-10-05T11:31:15.474 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.471+0000 7fa9c423a640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:31:15.476 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.473+0000 7fa9deac0880 20 remove_watcher() i=0 2023-10-05T11:31:15.476 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.473+0000 7fa9deac0880 2 removed watcher, disabling cache 2023-10-05T11:31:15.477 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.475+0000 7fa9deac0880 20 remove_watcher() i=1 2023-10-05T11:31:15.478 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.476+0000 7fa9deac0880 20 remove_watcher() i=2 2023-10-05T11:31:15.479 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.477+0000 7fa9deac0880 20 remove_watcher() i=3 2023-10-05T11:31:15.480 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.478+0000 7fa9deac0880 20 remove_watcher() i=4 2023-10-05T11:31:15.482 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.480+0000 7fa9deac0880 20 remove_watcher() i=5 2023-10-05T11:31:15.485 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.482+0000 7fa9deac0880 20 remove_watcher() i=6 2023-10-05T11:31:15.486 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:15.483+0000 7fa9deac0880 20 remove_watcher() i=7 2023-10-05T11:31:15.515 INFO:tasks.workunit.client.0.smithi012.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2023-10-05T11:31:15.915 INFO:tasks.workunit.client.0.smithi012.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2023-10-05T11:31:16.308 INFO:tasks.workunit.client.0.smithi012.stderr:radosgw-admin bucket check --fix --bucket check-bucket 2023-10-05T11:31:16.337 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setuser ceph since I am not root 2023-10-05T11:31:16.337 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T11:31:16.350 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.347+0000 7f06bb69b880 20 rados->read ofs=0 len=0 2023-10-05T11:31:16.352 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.349+0000 7f06bb69b880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:16.352 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.349+0000 7f06bb69b880 20 realm 2023-10-05T11:31:16.352 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.349+0000 7f06bb69b880 20 rados->read ofs=0 len=0 2023-10-05T11:31:16.352 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.349+0000 7f06bb69b880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:16.352 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.349+0000 7f06bb69b880 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T11:31:16.352 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.349+0000 7f06bb69b880 20 rados->read ofs=0 len=0 2023-10-05T11:31:16.352 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.349+0000 7f06bb69b880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:16.352 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.349+0000 7f06bb69b880 20 rados->read ofs=0 len=0 2023-10-05T11:31:16.353 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.350+0000 7f06bb69b880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:31:16.353 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.350+0000 7f06bb69b880 20 rados->read ofs=0 len=0 2023-10-05T11:31:16.354 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.351+0000 7f06bb69b880 20 rados_obj.operate() r=0 bl.length=1020 2023-10-05T11:31:16.354 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.351+0000 7f06bb69b880 20 searching for the correct realm 2023-10-05T11:31:16.363 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.361+0000 7f06b9e40640 0 -- 172.21.15.12:0/4136102428 >> [v2:172.21.15.170:6814/3150808418,v1:172.21.15.170:6816/3150808418] conn(0x556ac4691c00 msgr2=0x556ac3a9ec00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:31:16.365 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.362+0000 7f06bb69b880 20 RGWRados::pool_iterate: got zone_info.dff27d1e-df33-400e-a68a-7ba586947c99 2023-10-05T11:31:16.365 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.362+0000 7f06bb69b880 20 RGWRados::pool_iterate: got zonegroup_info.c78aa576-9d15-4e9d-b3c0-4af23a22062c 2023-10-05T11:31:16.365 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.362+0000 7f06bb69b880 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T11:31:16.365 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.362+0000 7f06bb69b880 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T11:31:16.365 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.362+0000 7f06bb69b880 20 rados->read ofs=0 len=0 2023-10-05T11:31:16.365 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.362+0000 7f06bb69b880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:16.365 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.362+0000 7f06bb69b880 20 rados->read ofs=0 len=0 2023-10-05T11:31:16.366 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.362+0000 7f06bb69b880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:31:16.366 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.362+0000 7f06bb69b880 20 rados->read ofs=0 len=0 2023-10-05T11:31:16.367 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.363+0000 7f06bb69b880 20 rados_obj.operate() r=0 bl.length=454 2023-10-05T11:31:16.367 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.363+0000 7f06bb69b880 20 zone default found 2023-10-05T11:31:16.367 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.363+0000 7f06bb69b880 4 Realm: () 2023-10-05T11:31:16.367 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.363+0000 7f06bb69b880 4 ZoneGroup: default (c78aa576-9d15-4e9d-b3c0-4af23a22062c) 2023-10-05T11:31:16.367 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.363+0000 7f06bb69b880 4 Zone: default (dff27d1e-df33-400e-a68a-7ba586947c99) 2023-10-05T11:31:16.367 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.363+0000 7f06bb69b880 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T11:31:16.367 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.363+0000 7f06bb69b880 20 zonegroup default 2023-10-05T11:31:16.367 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.363+0000 7f06bb69b880 20 rados->read ofs=0 len=0 2023-10-05T11:31:16.367 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.363+0000 7f06bb69b880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:16.367 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.363+0000 7f06bb69b880 20 rados->read ofs=0 len=0 2023-10-05T11:31:16.367 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.363+0000 7f06bb69b880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:16.367 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.363+0000 7f06bb69b880 20 rados->read ofs=0 len=0 2023-10-05T11:31:16.368 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.364+0000 7f06bb69b880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:16.368 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.364+0000 7f06bb69b880 20 started sync module instance, tier type = 2023-10-05T11:31:16.368 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.364+0000 7f06bb69b880 20 started zone id=dff27d1e-df33-400e-a68a-7ba586947c99 (name=default) with tier type = 2023-10-05T11:31:16.375 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.372+0000 7f06ba641640 0 -- 172.21.15.12:0/4136102428 >> [v2:172.21.15.170:6800/4137726411,v1:172.21.15.170:6801/4137726411] conn(0x556ac3c5e000 msgr2=0x556ac3b5f600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:31:16.381 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.378+0000 7f06bb69b880 20 add_watcher() i=0 2023-10-05T11:31:16.381 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.378+0000 7f06bb69b880 20 add_watcher() i=1 2023-10-05T11:31:16.381 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.378+0000 7f06bb69b880 20 add_watcher() i=2 2023-10-05T11:31:16.381 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.378+0000 7f06bb69b880 20 add_watcher() i=3 2023-10-05T11:31:16.381 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.378+0000 7f06bb69b880 20 add_watcher() i=4 2023-10-05T11:31:16.381 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.378+0000 7f06bb69b880 20 add_watcher() i=5 2023-10-05T11:31:16.381 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.378+0000 7f06bb69b880 20 add_watcher() i=6 2023-10-05T11:31:16.381 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.379+0000 7f06bb69b880 20 add_watcher() i=7 2023-10-05T11:31:16.382 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.379+0000 7f06bb69b880 2 all 8 watchers are set, enabling cache 2023-10-05T11:31:16.383 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.381+0000 7f06a0e0e640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:31:16.384 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.381+0000 7f06bb69b880 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T11:31:16.384 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.381+0000 7f06bb69b880 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T11:31:16.389 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.386+0000 7f06bb69b880 5 note: GC not initialized 2023-10-05T11:31:16.390 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.387+0000 7f069c605640 20 reqs_thread_entry: start 2023-10-05T11:31:16.390 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.387+0000 7f06bb69b880 20 init_complete bucket index max shards: 11 2023-10-05T11:31:16.390 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.387+0000 7f06bb69b880 20 Filter name: none 2023-10-05T11:31:16.390 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.387+0000 7f069a601640 20 reqs_thread_entry: start 2023-10-05T11:31:16.390 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.387+0000 7f06bb69b880 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2023-10-05T11:31:16.390 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.387+0000 7f06bb69b880 20 rados->read ofs=0 len=0 2023-10-05T11:31:16.391 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.387+0000 7f06bb69b880 20 rados_obj.operate() r=0 bl.length=190 2023-10-05T11:31:16.391 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.387+0000 7f06bb69b880 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2023-10-05T11:31:16.392 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.387+0000 7f06bb69b880 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2023-10-05T11:31:16.392 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.387+0000 7f06bb69b880 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:dff27d1e-df33-400e-a68a-7ba586947c99.4604.2 : miss 2023-10-05T11:31:16.392 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.387+0000 7f06bb69b880 20 rados->read ofs=0 len=0 2023-10-05T11:31:16.392 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.388+0000 7f06bb69b880 20 rados_obj.operate() r=0 bl.length=368 2023-10-05T11:31:16.392 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.388+0000 7f06bb69b880 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:dff27d1e-df33-400e-a68a-7ba586947c99.4604.2 info.flags=0x17 2023-10-05T11:31:16.392 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.388+0000 7f06bb69b880 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:dff27d1e-df33-400e-a68a-7ba586947c99.4604.2 to cache LRU end 2023-10-05T11:31:16.392 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.388+0000 7f06bb69b880 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T11:31:16.392 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.388+0000 7f06bb69b880 10 updating xattr: name=user.rgw.acl bl.length()=179 2023-10-05T11:31:16.392 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.388+0000 7f06bb69b880 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:dff27d1e-df33-400e-a68a-7ba586947c99.4604.2 2023-10-05T11:31:16.392 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.388+0000 7f06bb69b880 20 list_objects_ordered: starting attempt 1 2023-10-05T11:31:16.392 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.388+0000 7f06bb69b880 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2023-10-05T11:31:16.393 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.389+0000 7f06bb69b880 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2023-10-05T11:31:16.393 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.389+0000 7f06bb69b880 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2023-10-05T11:31:16.393 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.389+0000 7f06bb69b880 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2023-10-05T11:31:16.393 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.389+0000 7f06bb69b880 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2023-10-05T11:31:16.398 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.395+0000 7f06a0e0e640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:31:16.400 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.398+0000 7f06bb69b880 20 remove_watcher() i=0 2023-10-05T11:31:16.400 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.398+0000 7f06bb69b880 2 removed watcher, disabling cache 2023-10-05T11:31:16.401 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.399+0000 7f06bb69b880 20 remove_watcher() i=1 2023-10-05T11:31:16.402 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.400+0000 7f06bb69b880 20 remove_watcher() i=2 2023-10-05T11:31:16.403 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.401+0000 7f06bb69b880 20 remove_watcher() i=3 2023-10-05T11:31:16.404 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.402+0000 7f06bb69b880 20 remove_watcher() i=4 2023-10-05T11:31:16.405 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.403+0000 7f06bb69b880 20 remove_watcher() i=5 2023-10-05T11:31:16.406 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.404+0000 7f06bb69b880 20 remove_watcher() i=6 2023-10-05T11:31:16.407 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.405+0000 7f06bb69b880 20 remove_watcher() i=7 2023-10-05T11:31:16.413 INFO:tasks.workunit.client.0.smithi012.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2023-10-05T11:31:16.447 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setuser ceph since I am not root 2023-10-05T11:31:16.447 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T11:31:16.460 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.457+0000 7fc772e13880 20 rados->read ofs=0 len=0 2023-10-05T11:31:16.462 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.459+0000 7fc772e13880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:16.462 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.459+0000 7fc772e13880 20 realm 2023-10-05T11:31:16.462 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.459+0000 7fc772e13880 20 rados->read ofs=0 len=0 2023-10-05T11:31:16.462 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.459+0000 7fc772e13880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:16.462 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.459+0000 7fc772e13880 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T11:31:16.462 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.459+0000 7fc772e13880 20 rados->read ofs=0 len=0 2023-10-05T11:31:16.462 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.459+0000 7fc772e13880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:16.462 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.459+0000 7fc772e13880 20 rados->read ofs=0 len=0 2023-10-05T11:31:16.463 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.460+0000 7fc772e13880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:31:16.463 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.460+0000 7fc772e13880 20 rados->read ofs=0 len=0 2023-10-05T11:31:16.463 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.461+0000 7fc772e13880 20 rados_obj.operate() r=0 bl.length=1020 2023-10-05T11:31:16.464 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.461+0000 7fc772e13880 20 searching for the correct realm 2023-10-05T11:31:16.473 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.471+0000 7fc76fa8f640 0 -- 172.21.15.12:0/2558879114 >> [v2:172.21.15.12:6824/2171933159,v1:172.21.15.12:6825/2171933159] conn(0x556a452b5c00 msgr2=0x556a45203700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:31:16.474 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.471+0000 7fc772e13880 20 RGWRados::pool_iterate: got zone_info.dff27d1e-df33-400e-a68a-7ba586947c99 2023-10-05T11:31:16.474 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.471+0000 7fc772e13880 20 RGWRados::pool_iterate: got zonegroup_info.c78aa576-9d15-4e9d-b3c0-4af23a22062c 2023-10-05T11:31:16.474 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.471+0000 7fc772e13880 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T11:31:16.475 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.471+0000 7fc772e13880 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T11:31:16.475 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.471+0000 7fc772e13880 20 rados->read ofs=0 len=0 2023-10-05T11:31:16.475 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.472+0000 7fc772e13880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:16.475 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.472+0000 7fc772e13880 20 rados->read ofs=0 len=0 2023-10-05T11:31:16.475 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.472+0000 7fc772e13880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:31:16.475 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.472+0000 7fc772e13880 20 rados->read ofs=0 len=0 2023-10-05T11:31:16.476 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.472+0000 7fc772e13880 20 rados_obj.operate() r=0 bl.length=454 2023-10-05T11:31:16.476 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.472+0000 7fc772e13880 20 zone default found 2023-10-05T11:31:16.476 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.472+0000 7fc772e13880 4 Realm: () 2023-10-05T11:31:16.476 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.472+0000 7fc772e13880 4 ZoneGroup: default (c78aa576-9d15-4e9d-b3c0-4af23a22062c) 2023-10-05T11:31:16.476 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.472+0000 7fc772e13880 4 Zone: default (dff27d1e-df33-400e-a68a-7ba586947c99) 2023-10-05T11:31:16.477 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.472+0000 7fc772e13880 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T11:31:16.477 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.472+0000 7fc772e13880 20 zonegroup default 2023-10-05T11:31:16.477 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.472+0000 7fc772e13880 20 rados->read ofs=0 len=0 2023-10-05T11:31:16.477 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.472+0000 7fc772e13880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:16.477 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.472+0000 7fc772e13880 20 rados->read ofs=0 len=0 2023-10-05T11:31:16.477 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.473+0000 7fc772e13880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:16.477 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.473+0000 7fc772e13880 20 rados->read ofs=0 len=0 2023-10-05T11:31:16.477 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.473+0000 7fc772e13880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:16.477 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.473+0000 7fc772e13880 20 started sync module instance, tier type = 2023-10-05T11:31:16.477 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.473+0000 7fc772e13880 20 started zone id=dff27d1e-df33-400e-a68a-7ba586947c99 (name=default) with tier type = 2023-10-05T11:31:16.482 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.480+0000 7fc76fa8f640 0 -- 172.21.15.12:0/2558879114 >> [v2:172.21.15.12:6824/2171933159,v1:172.21.15.12:6825/2171933159] conn(0x556a453c5c00 msgr2=0x556a452bc100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-10-05T11:31:16.486 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.483+0000 7fc772e13880 20 add_watcher() i=0 2023-10-05T11:31:16.486 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.483+0000 7fc772e13880 20 add_watcher() i=1 2023-10-05T11:31:16.486 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.483+0000 7fc772e13880 20 add_watcher() i=2 2023-10-05T11:31:16.486 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.483+0000 7fc772e13880 20 add_watcher() i=3 2023-10-05T11:31:16.487 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.483+0000 7fc772e13880 20 add_watcher() i=4 2023-10-05T11:31:16.487 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.483+0000 7fc772e13880 20 add_watcher() i=5 2023-10-05T11:31:16.487 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.483+0000 7fc772e13880 20 add_watcher() i=6 2023-10-05T11:31:16.487 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.484+0000 7fc772e13880 20 add_watcher() i=7 2023-10-05T11:31:16.487 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.484+0000 7fc772e13880 2 all 8 watchers are set, enabling cache 2023-10-05T11:31:16.489 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.486+0000 7fc75625c640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:31:16.489 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.487+0000 7fc772e13880 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T11:31:16.489 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.487+0000 7fc772e13880 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T11:31:16.495 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.492+0000 7fc772e13880 5 note: GC not initialized 2023-10-05T11:31:16.495 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.492+0000 7fc751a53640 20 reqs_thread_entry: start 2023-10-05T11:31:16.495 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.492+0000 7fc772e13880 20 init_complete bucket index max shards: 11 2023-10-05T11:31:16.495 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.492+0000 7fc772e13880 20 Filter name: none 2023-10-05T11:31:16.495 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.492+0000 7fc74fa4f640 20 reqs_thread_entry: start 2023-10-05T11:31:16.495 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.492+0000 7fc772e13880 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2023-10-05T11:31:16.496 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.492+0000 7fc772e13880 20 rados->read ofs=0 len=0 2023-10-05T11:31:16.497 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.493+0000 7fc772e13880 20 rados_obj.operate() r=0 bl.length=190 2023-10-05T11:31:16.497 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.493+0000 7fc772e13880 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2023-10-05T11:31:16.497 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.493+0000 7fc772e13880 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2023-10-05T11:31:16.497 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.493+0000 7fc772e13880 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:dff27d1e-df33-400e-a68a-7ba586947c99.4604.2 : miss 2023-10-05T11:31:16.497 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.493+0000 7fc772e13880 20 rados->read ofs=0 len=0 2023-10-05T11:31:16.497 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.493+0000 7fc772e13880 20 rados_obj.operate() r=0 bl.length=368 2023-10-05T11:31:16.497 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.493+0000 7fc772e13880 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:dff27d1e-df33-400e-a68a-7ba586947c99.4604.2 info.flags=0x17 2023-10-05T11:31:16.497 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.493+0000 7fc772e13880 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:dff27d1e-df33-400e-a68a-7ba586947c99.4604.2 to cache LRU end 2023-10-05T11:31:16.497 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.493+0000 7fc772e13880 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T11:31:16.497 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.493+0000 7fc772e13880 10 updating xattr: name=user.rgw.acl bl.length()=179 2023-10-05T11:31:16.498 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.493+0000 7fc772e13880 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:dff27d1e-df33-400e-a68a-7ba586947c99.4604.2 2023-10-05T11:31:16.498 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.493+0000 7fc772e13880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.0 2023-10-05T11:31:16.498 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.494+0000 7fc772e13880 1 NOTICE: finished shard 0 (0 entries removed) 2023-10-05T11:31:16.498 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.494+0000 7fc772e13880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.1 2023-10-05T11:31:16.498 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.494+0000 7fc772e13880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.2 2023-10-05T11:31:16.499 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.495+0000 7fc772e13880 1 NOTICE: finished shard 2 (0 entries removed) 2023-10-05T11:31:16.499 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.495+0000 7fc772e13880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.3 2023-10-05T11:31:16.499 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.495+0000 7fc772e13880 1 NOTICE: finished shard 3 (0 entries removed) 2023-10-05T11:31:16.499 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.495+0000 7fc772e13880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.4 2023-10-05T11:31:16.499 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.496+0000 7fc772e13880 1 NOTICE: finished shard 4 (0 entries removed) 2023-10-05T11:31:16.499 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.496+0000 7fc772e13880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.5 2023-10-05T11:31:16.499 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.496+0000 7fc772e13880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.6 2023-10-05T11:31:16.500 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.497+0000 7fc772e13880 1 NOTICE: finished shard 6 (0 entries removed) 2023-10-05T11:31:16.500 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.497+0000 7fc772e13880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.7 2023-10-05T11:31:16.500 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.497+0000 7fc772e13880 1 NOTICE: finished shard 7 (0 entries removed) 2023-10-05T11:31:16.500 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.497+0000 7fc772e13880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.8 2023-10-05T11:31:16.500 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.498+0000 7fc772e13880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.9 2023-10-05T11:31:16.501 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.498+0000 7fc772e13880 1 NOTICE: finished shard 9 (0 entries removed) 2023-10-05T11:31:16.501 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.498+0000 7fc772e13880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.10 2023-10-05T11:31:16.502 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.499+0000 7fc772e13880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.1 2023-10-05T11:31:16.502 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.499+0000 7fc772e13880 20 get_obj_state: rctx=0x556a45df1f80 obj=check-bucket:e state=0x556a45d34de8 s->prefetch_data=0 2023-10-05T11:31:16.502 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.499+0000 7fc772e13880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.5 2023-10-05T11:31:16.503 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.499+0000 7fc772e13880 20 get_obj_state: rctx=0x556a452ccee0 obj=check-bucket:d state=0x556a45d359e8 s->prefetch_data=0 2023-10-05T11:31:16.503 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.499+0000 7fc772e13880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.8 2023-10-05T11:31:16.503 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.500+0000 7fc772e13880 20 get_obj_state: rctx=0x556a452cdb90 obj=check-bucket:c state=0x556a45d365e8 s->prefetch_data=0 2023-10-05T11:31:16.503 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.500+0000 7fc772e13880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.10 2023-10-05T11:31:16.503 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.500+0000 7fc772e13880 20 get_obj_state: rctx=0x556a452cdc00 obj=check-bucket:f state=0x556a45d371e8 s->prefetch_data=0 2023-10-05T11:31:16.503 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.500+0000 7fc772e13880 20 get_obj_state: setting s->obj_tag to t33zjpiezh0qj8eoz8zjdhkxnxejetpm 2023-10-05T11:31:16.503 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.500+0000 7fc772e13880 20 get_obj_state_impl: setting s->olh_tag to xrqlkqu115gsdc55dwg97xjmwre5muj4 2023-10-05T11:31:16.504 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.500+0000 7fc772e13880 20 bucket_index_guard_olh_op(): olh_state.olh_tag=xrqlkqu115gsdc55dwg97xjmwre5muj4 2023-10-05T11:31:16.504 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.500+0000 7fc772e13880 20 get_obj_state: setting s->obj_tag to 5j3klmc3p7i3s019ifsnfdpz1uerja0c 2023-10-05T11:31:16.504 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.500+0000 7fc772e13880 20 get_obj_state_impl: setting s->olh_tag to nr59uunznfeerkmf1dgm3jpuvcwzy3xg 2023-10-05T11:31:16.504 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.500+0000 7fc772e13880 20 bucket_index_guard_olh_op(): olh_state.olh_tag=nr59uunznfeerkmf1dgm3jpuvcwzy3xg 2023-10-05T11:31:16.504 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.500+0000 7fc772e13880 20 get_obj_state: setting s->obj_tag to 8lksz7ny4tt7ody5hxh592xo5q3xkgrf 2023-10-05T11:31:16.504 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.500+0000 7fc772e13880 20 get_obj_state_impl: setting s->olh_tag to tcbhy30oabrw6j8gcum7v19o9mfiamyr 2023-10-05T11:31:16.504 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.500+0000 7fc772e13880 20 bucket_index_guard_olh_op(): olh_state.olh_tag=tcbhy30oabrw6j8gcum7v19o9mfiamyr 2023-10-05T11:31:16.504 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.500+0000 7fc772e13880 20 get_obj_state: setting s->obj_tag to yvsc5zrcaj7cahyms247zqlr1sh514ha 2023-10-05T11:31:16.504 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.500+0000 7fc772e13880 20 get_obj_state_impl: setting s->olh_tag to gmltan03dx55czwbnsmjsf50zgqwpq2j 2023-10-05T11:31:16.504 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.500+0000 7fc772e13880 20 bucket_index_guard_olh_op(): olh_state.olh_tag=gmltan03dx55czwbnsmjsf50zgqwpq2j 2023-10-05T11:31:16.505 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.502+0000 7fc772e13880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.5 2023-10-05T11:31:16.506 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.503+0000 7fc772e13880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.1 2023-10-05T11:31:16.506 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.503+0000 7fc772e13880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.10 2023-10-05T11:31:16.506 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.503+0000 7fc772e13880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.8 2023-10-05T11:31:16.507 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.504+0000 7fc772e13880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.5 2023-10-05T11:31:16.507 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.504+0000 7fc772e13880 20 olh_log_entry: epoch=3 op=3 key=d[SuY5L65ITy.uOpwcHeCozuChuQkJ9Qd] 2023-10-05T11:31:16.507 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.504+0000 7fc772e13880 20 get_obj_state: rctx=0x556a452ccee0 obj=check-bucket:_:SuY5L65ITy.uOpwcHeCozuChuQkJ9Qd_d state=0x556a455f61e8 s->prefetch_data=0 2023-10-05T11:31:16.509 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.505+0000 7fc772e13880 10 manifest: total_size = 22 2023-10-05T11:31:16.509 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.505+0000 7fc772e13880 20 get_obj_state: setting s->obj_tag to dff27d1e-df33-400e-a68a-7ba586947c99.4543.3848537664459964443 2023-10-05T11:31:16.509 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.505+0000 7fc772e13880 20 get_obj_state: rctx=0x556a452ccee0 obj=check-bucket:_:SuY5L65ITy.uOpwcHeCozuChuQkJ9Qd_d state=0x556a455f61e8 s->prefetch_data=0 2023-10-05T11:31:16.509 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.505+0000 7fc772e13880 20 prepare_atomic_modification: state is not atomic. state=0x556a455f61e8 2023-10-05T11:31:16.509 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.505+0000 7fc772e13880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.5 2023-10-05T11:31:16.509 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.505+0000 7fc772e13880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.10 2023-10-05T11:31:16.509 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.505+0000 7fc772e13880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.1 2023-10-05T11:31:16.509 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.505+0000 7fc772e13880 20 olh_log_entry: epoch=2 op=2 key=f[] 2023-10-05T11:31:16.510 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.505+0000 7fc772e13880 20 olh_log_entry: epoch=2 op=3 key=f[35tqTrVobHxdIynFnCpGhE0IAsH3bAs] 2023-10-05T11:31:16.510 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.505+0000 7fc772e13880 20 get_obj_state: rctx=0x556a452cdc00 obj=check-bucket:_:35tqTrVobHxdIynFnCpGhE0IAsH3bAs_f state=0x556a455f6de8 s->prefetch_data=0 2023-10-05T11:31:16.510 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.505+0000 7fc772e13880 20 olh_log_entry: epoch=2 op=2 key=e[] 2023-10-05T11:31:16.510 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.505+0000 7fc772e13880 20 olh_log_entry: epoch=2 op=3 key=e[vLW6rnRh.mGtpYxEOr8VSO9W0NODM77] 2023-10-05T11:31:16.510 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.505+0000 7fc772e13880 20 get_obj_state: rctx=0x556a45df1f80 obj=check-bucket:_:vLW6rnRh.mGtpYxEOr8VSO9W0NODM77_e state=0x556a455f79e8 s->prefetch_data=0 2023-10-05T11:31:16.510 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.505+0000 7fc772e13880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.8 2023-10-05T11:31:16.510 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.505+0000 7fc772e13880 10 manifest: total_size = 12 2023-10-05T11:31:16.510 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.505+0000 7fc772e13880 20 get_obj_state: setting s->obj_tag to dff27d1e-df33-400e-a68a-7ba586947c99.4543.10709054445267588903 2023-10-05T11:31:16.510 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.505+0000 7fc772e13880 20 get_obj_state: rctx=0x556a452cdc00 obj=check-bucket:_:35tqTrVobHxdIynFnCpGhE0IAsH3bAs_f state=0x556a455f6de8 s->prefetch_data=0 2023-10-05T11:31:16.510 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.505+0000 7fc772e13880 20 prepare_atomic_modification: state is not atomic. state=0x556a455f6de8 2023-10-05T11:31:16.510 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.505+0000 7fc772e13880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.10 2023-10-05T11:31:16.510 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.506+0000 7fc772e13880 10 manifest: total_size = 12 2023-10-05T11:31:16.511 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.506+0000 7fc772e13880 20 get_obj_state: setting s->obj_tag to dff27d1e-df33-400e-a68a-7ba586947c99.4543.16839733307838856531 2023-10-05T11:31:16.511 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.506+0000 7fc772e13880 20 get_obj_state: rctx=0x556a45df1f80 obj=check-bucket:_:vLW6rnRh.mGtpYxEOr8VSO9W0NODM77_e state=0x556a455f79e8 s->prefetch_data=0 2023-10-05T11:31:16.511 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.506+0000 7fc772e13880 20 prepare_atomic_modification: state is not atomic. state=0x556a455f79e8 2023-10-05T11:31:16.511 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.506+0000 7fc772e13880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.1 2023-10-05T11:31:16.511 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.506+0000 7fc772e13880 20 olh_log_entry: epoch=3 op=3 key=c[T1U-CtpOFabsb75ShcDcMikIOjeK1sG] 2023-10-05T11:31:16.511 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.506+0000 7fc772e13880 20 get_obj_state: rctx=0x556a452cdb90 obj=check-bucket:_:T1U-CtpOFabsb75ShcDcMikIOjeK1sG_c state=0x556a455f85e8 s->prefetch_data=0 2023-10-05T11:31:16.511 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.506+0000 7fc772e13880 10 manifest: total_size = 12 2023-10-05T11:31:16.511 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.506+0000 7fc772e13880 20 get_obj_state: setting s->obj_tag to dff27d1e-df33-400e-a68a-7ba586947c99.4543.10669964336339421027 2023-10-05T11:31:16.511 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.506+0000 7fc772e13880 20 get_obj_state: rctx=0x556a452cdb90 obj=check-bucket:_:T1U-CtpOFabsb75ShcDcMikIOjeK1sG_c state=0x556a455f85e8 s->prefetch_data=0 2023-10-05T11:31:16.511 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.506+0000 7fc772e13880 20 prepare_atomic_modification: state is not atomic. state=0x556a455f85e8 2023-10-05T11:31:16.511 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.506+0000 7fc772e13880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.8 2023-10-05T11:31:16.512 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.509+0000 7fc772e13880 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-10-05T11:31:16.512 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.509+0000 7fc772e13880 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2023-10-05T11:31:16.512 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.509+0000 7fc772e13880 0 deleting objects inline since gc isn't initialized 2023-10-05T11:31:16.512 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.509+0000 7fc772e13880 5 delete_objs_inline: removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.2__shadow:SuY5L65ITy.uOpwcHeCozuChuQkJ9Qd_.eVJGYHTT2ErAv59hrkaYDupJ55a8Rqw_0 2023-10-05T11:31:16.513 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.510+0000 7fc769282640 20 handle_completion(): completion ok for obj=d[SuY5L65ITy.uOpwcHeCozuChuQkJ9Qd] 2023-10-05T11:31:16.514 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.511+0000 7fc772e13880 5 delete_objs_inline: refcount put returned error -2 2023-10-05T11:31:16.514 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.511+0000 7fc772e13880 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-10-05T11:31:16.514 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.511+0000 7fc772e13880 20 RGWObjManifest::operator++(): result: ofs=12 stripe_ofs=12 part_ofs=0 rule->part_size=0 2023-10-05T11:31:16.514 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.511+0000 7fc772e13880 0 deleting objects inline since gc isn't initialized 2023-10-05T11:31:16.514 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.511+0000 7fc772e13880 5 delete_objs_inline: removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.2__shadow:vLW6rnRh.mGtpYxEOr8VSO9W0NODM77_.Be3hiscLZZ8GvGWncPjFl_KhAXYxa_X_0 2023-10-05T11:31:16.515 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.513+0000 7fc769a83640 20 handle_completion(): completion ok for obj=e[vLW6rnRh.mGtpYxEOr8VSO9W0NODM77] 2023-10-05T11:31:16.516 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.513+0000 7fc772e13880 5 delete_objs_inline: refcount put returned error -2 2023-10-05T11:31:16.516 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.513+0000 7fc772e13880 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-10-05T11:31:16.516 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.513+0000 7fc772e13880 20 RGWObjManifest::operator++(): result: ofs=12 stripe_ofs=12 part_ofs=0 rule->part_size=0 2023-10-05T11:31:16.516 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.513+0000 7fc772e13880 0 deleting objects inline since gc isn't initialized 2023-10-05T11:31:16.516 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.513+0000 7fc772e13880 5 delete_objs_inline: removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.2__shadow:35tqTrVobHxdIynFnCpGhE0IAsH3bAs_.DI_T_M66TzvOlBwLRV4uDF247oZ42Dn_0 2023-10-05T11:31:16.517 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.514+0000 7fc769a83640 20 handle_completion(): completion ok for obj=f[35tqTrVobHxdIynFnCpGhE0IAsH3bAs] 2023-10-05T11:31:16.517 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.515+0000 7fc772e13880 5 delete_objs_inline: refcount put returned error -2 2023-10-05T11:31:16.518 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.515+0000 7fc772e13880 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-10-05T11:31:16.518 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.515+0000 7fc772e13880 20 RGWObjManifest::operator++(): result: ofs=12 stripe_ofs=12 part_ofs=0 rule->part_size=0 2023-10-05T11:31:16.518 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.515+0000 7fc772e13880 0 deleting objects inline since gc isn't initialized 2023-10-05T11:31:16.518 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.515+0000 7fc772e13880 5 delete_objs_inline: removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.2__shadow:T1U-CtpOFabsb75ShcDcMikIOjeK1sG_.P_vMY0h08trz937Zv0bQQ8LXmXOs_GS_0 2023-10-05T11:31:16.520 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.517+0000 7fc769282640 20 handle_completion(): completion ok for obj=c[T1U-CtpOFabsb75ShcDcMikIOjeK1sG] 2023-10-05T11:31:16.520 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.517+0000 7fc772e13880 5 delete_objs_inline: refcount put returned error -2 2023-10-05T11:31:16.520 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.517+0000 7fc772e13880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.5 2023-10-05T11:31:16.520 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.517+0000 7fc772e13880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.5 2023-10-05T11:31:16.520 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.517+0000 7fc772e13880 20 get_obj_state: rctx=0x556a45df1f80 obj=check-bucket:e state=0x556a45d34de8 s->prefetch_data=0 2023-10-05T11:31:16.520 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.517+0000 7fc772e13880 20 bucket_index_guard_olh_op(): olh_state.olh_tag=xrqlkqu115gsdc55dwg97xjmwre5muj4 2023-10-05T11:31:16.520 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.517+0000 7fc772e13880 20 get_obj_state: rctx=0x556a452cdc00 obj=check-bucket:f state=0x556a45d371e8 s->prefetch_data=0 2023-10-05T11:31:16.520 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.517+0000 7fc772e13880 20 bucket_index_guard_olh_op(): olh_state.olh_tag=gmltan03dx55czwbnsmjsf50zgqwpq2j 2023-10-05T11:31:16.522 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.519+0000 7fc772e13880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.8 2023-10-05T11:31:16.522 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.519+0000 7fc772e13880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.8 2023-10-05T11:31:16.522 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.519+0000 7fc772e13880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.5 2023-10-05T11:31:16.522 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.519+0000 7fc772e13880 1 NOTICE: finished shard 5 (1 entries removed) 2023-10-05T11:31:16.524 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.521+0000 7fc772e13880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.1 2023-10-05T11:31:16.524 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.521+0000 7fc772e13880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.10 2023-10-05T11:31:16.524 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.522+0000 7fc772e13880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.8 2023-10-05T11:31:16.525 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.522+0000 7fc772e13880 1 NOTICE: finished shard 8 (1 entries removed) 2023-10-05T11:31:16.526 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.523+0000 7fc772e13880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.1 2023-10-05T11:31:16.526 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.523+0000 7fc772e13880 1 NOTICE: finished shard 1 (1 entries removed) 2023-10-05T11:31:16.526 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.523+0000 7fc772e13880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.2.10 2023-10-05T11:31:16.526 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.523+0000 7fc772e13880 1 NOTICE: finished shard 10 (1 entries removed) 2023-10-05T11:31:16.526 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.523+0000 7fc772e13880 1 NOTICE: finished all shards (4 entries removed) 2023-10-05T11:31:16.527 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.524+0000 7fc75625c640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:31:16.528 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.526+0000 7fc772e13880 20 remove_watcher() i=0 2023-10-05T11:31:16.529 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.526+0000 7fc772e13880 2 removed watcher, disabling cache 2023-10-05T11:31:16.529 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.527+0000 7fc772e13880 20 remove_watcher() i=1 2023-10-05T11:31:16.530 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.528+0000 7fc772e13880 20 remove_watcher() i=2 2023-10-05T11:31:16.531 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.529+0000 7fc772e13880 20 remove_watcher() i=3 2023-10-05T11:31:16.533 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.530+0000 7fc772e13880 20 remove_watcher() i=4 2023-10-05T11:31:16.534 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.531+0000 7fc772e13880 20 remove_watcher() i=5 2023-10-05T11:31:16.535 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.532+0000 7fc772e13880 20 remove_watcher() i=6 2023-10-05T11:31:16.536 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.533+0000 7fc772e13880 20 remove_watcher() i=7 2023-10-05T11:31:16.755 INFO:tasks.workunit.client.0.smithi012.stderr:radosgw-admin bucket stats --bucket check-bucket 2023-10-05T11:31:16.784 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setuser ceph since I am not root 2023-10-05T11:31:16.784 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T11:31:16.798 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.795+0000 7f585e412880 20 rados->read ofs=0 len=0 2023-10-05T11:31:16.799 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.796+0000 7f585e412880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:16.799 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.796+0000 7f585e412880 20 realm 2023-10-05T11:31:16.799 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.796+0000 7f585e412880 20 rados->read ofs=0 len=0 2023-10-05T11:31:16.799 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.796+0000 7f585e412880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:16.799 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.796+0000 7f585e412880 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T11:31:16.799 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.796+0000 7f585e412880 20 rados->read ofs=0 len=0 2023-10-05T11:31:16.799 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.796+0000 7f585e412880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:16.799 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.796+0000 7f585e412880 20 rados->read ofs=0 len=0 2023-10-05T11:31:16.800 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.797+0000 7f585e412880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:31:16.800 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.797+0000 7f585e412880 20 rados->read ofs=0 len=0 2023-10-05T11:31:16.800 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.798+0000 7f585e412880 20 rados_obj.operate() r=0 bl.length=1020 2023-10-05T11:31:16.800 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.798+0000 7f585e412880 20 searching for the correct realm 2023-10-05T11:31:16.810 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.807+0000 7f585a8a4640 0 -- 172.21.15.12:0/1655314309 >> [v2:172.21.15.170:6814/3150808418,v1:172.21.15.170:6816/3150808418] conn(0x555babb4fc00 msgr2=0x555baaf5ec00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:31:16.811 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.809+0000 7f585e412880 20 RGWRados::pool_iterate: got zone_info.dff27d1e-df33-400e-a68a-7ba586947c99 2023-10-05T11:31:16.811 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.809+0000 7f585e412880 20 RGWRados::pool_iterate: got zonegroup_info.c78aa576-9d15-4e9d-b3c0-4af23a22062c 2023-10-05T11:31:16.811 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.809+0000 7f585e412880 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T11:31:16.812 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.809+0000 7f585e412880 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T11:31:16.812 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.809+0000 7f585e412880 20 rados->read ofs=0 len=0 2023-10-05T11:31:16.812 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.809+0000 7f585e412880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:16.812 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.809+0000 7f585e412880 20 rados->read ofs=0 len=0 2023-10-05T11:31:16.813 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.809+0000 7f585e412880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:31:16.813 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.809+0000 7f585e412880 20 rados->read ofs=0 len=0 2023-10-05T11:31:16.813 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.809+0000 7f585e412880 20 rados_obj.operate() r=0 bl.length=454 2023-10-05T11:31:16.813 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.809+0000 7f585e412880 20 zone default found 2023-10-05T11:31:16.813 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.809+0000 7f585e412880 4 Realm: () 2023-10-05T11:31:16.813 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.809+0000 7f585e412880 4 ZoneGroup: default (c78aa576-9d15-4e9d-b3c0-4af23a22062c) 2023-10-05T11:31:16.813 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.809+0000 7f585e412880 4 Zone: default (dff27d1e-df33-400e-a68a-7ba586947c99) 2023-10-05T11:31:16.814 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.809+0000 7f585e412880 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T11:31:16.814 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.809+0000 7f585e412880 20 zonegroup default 2023-10-05T11:31:16.814 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.809+0000 7f585e412880 20 rados->read ofs=0 len=0 2023-10-05T11:31:16.814 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.810+0000 7f585e412880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:16.814 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.810+0000 7f585e412880 20 rados->read ofs=0 len=0 2023-10-05T11:31:16.814 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.810+0000 7f585e412880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:16.814 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.810+0000 7f585e412880 20 rados->read ofs=0 len=0 2023-10-05T11:31:16.814 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.810+0000 7f585e412880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:16.814 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.810+0000 7f585e412880 20 started sync module instance, tier type = 2023-10-05T11:31:16.814 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.810+0000 7f585e412880 20 started zone id=dff27d1e-df33-400e-a68a-7ba586947c99 (name=default) with tier type = 2023-10-05T11:31:16.820 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.817+0000 7f585b0a5640 0 -- 172.21.15.12:0/1655314309 >> [v2:172.21.15.12:6824/2171933159,v1:172.21.15.12:6825/2171933159] conn(0x555babb33800 msgr2=0x555baaf5f700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:31:16.822 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.820+0000 7f585e412880 20 add_watcher() i=0 2023-10-05T11:31:16.822 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.820+0000 7f585e412880 20 add_watcher() i=1 2023-10-05T11:31:16.823 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.820+0000 7f585e412880 20 add_watcher() i=2 2023-10-05T11:31:16.823 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.820+0000 7f585e412880 20 add_watcher() i=3 2023-10-05T11:31:16.823 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.820+0000 7f585e412880 20 add_watcher() i=4 2023-10-05T11:31:16.823 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.820+0000 7f585e412880 20 add_watcher() i=5 2023-10-05T11:31:16.823 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.820+0000 7f585e412880 20 add_watcher() i=6 2023-10-05T11:31:16.823 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.821+0000 7f585e412880 20 add_watcher() i=7 2023-10-05T11:31:16.823 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.821+0000 7f585e412880 2 all 8 watchers are set, enabling cache 2023-10-05T11:31:16.825 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.822+0000 7f5841872640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:31:16.825 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.823+0000 7f585e412880 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T11:31:16.825 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.823+0000 7f585e412880 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T11:31:16.831 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.828+0000 7f585e412880 5 note: GC not initialized 2023-10-05T11:31:16.831 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.828+0000 7f583d069640 20 reqs_thread_entry: start 2023-10-05T11:31:16.831 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.828+0000 7f585e412880 20 init_complete bucket index max shards: 11 2023-10-05T11:31:16.831 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.828+0000 7f585e412880 20 Filter name: none 2023-10-05T11:31:16.831 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.829+0000 7f583b065640 20 reqs_thread_entry: start 2023-10-05T11:31:16.831 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.829+0000 7f585e412880 20 rados->read ofs=0 len=0 2023-10-05T11:31:16.832 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.829+0000 7f585e412880 20 rados_obj.operate() r=0 bl.length=190 2023-10-05T11:31:16.833 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.829+0000 7f585e412880 20 rados->read ofs=0 len=0 2023-10-05T11:31:16.833 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.829+0000 7f585e412880 20 rados_obj.operate() r=0 bl.length=368 2023-10-05T11:31:16.833 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.829+0000 7f585e412880 20 couldn't put binfo cache entry, might have raced with data changes 2023-10-05T11:31:16.833 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.829+0000 7f585e412880 20 rados->read ofs=0 len=0 2023-10-05T11:31:16.833 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.830+0000 7f585e412880 20 rados_obj.operate() r=0 bl.length=190 2023-10-05T11:31:16.833 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.830+0000 7f585e412880 20 rados->read ofs=0 len=0 2023-10-05T11:31:16.834 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.830+0000 7f585e412880 20 rados_obj.operate() r=0 bl.length=368 2023-10-05T11:31:16.834 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.830+0000 7f585e412880 20 couldn't put binfo cache entry, might have raced with data changes 2023-10-05T11:31:16.834 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.831+0000 7f585e412880 20 rados->read ofs=0 len=0 2023-10-05T11:31:16.834 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.831+0000 7f585e412880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:31:16.835 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.832+0000 7f5841872640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:31:16.837 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.834+0000 7f585e412880 20 remove_watcher() i=0 2023-10-05T11:31:16.837 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.834+0000 7f585e412880 2 removed watcher, disabling cache 2023-10-05T11:31:16.838 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.835+0000 7f585e412880 20 remove_watcher() i=1 2023-10-05T11:31:16.839 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.836+0000 7f585e412880 20 remove_watcher() i=2 2023-10-05T11:31:16.840 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.837+0000 7f585e412880 20 remove_watcher() i=3 2023-10-05T11:31:16.841 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.838+0000 7f585e412880 20 remove_watcher() i=4 2023-10-05T11:31:16.842 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.839+0000 7f585e412880 20 remove_watcher() i=5 2023-10-05T11:31:16.843 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.840+0000 7f585e412880 20 remove_watcher() i=6 2023-10-05T11:31:16.844 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:31:16.842+0000 7f585e412880 20 remove_watcher() i=7 2023-10-05T11:31:16.849 INFO:tasks.workunit.client.0.smithi012.stderr:{'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}} 2023-10-05T11:31:16.849 INFO:tasks.workunit.client.0.smithi012.stderr:Deleting bucket check-bucket 2023-10-05T11:31:17.079 INFO:tasks.workunit.client.0.smithi012.stderr:Completed bucket check tests 2023-10-05T11:31:17.079 INFO:tasks.workunit.client.0.smithi012.stdout:connected to http://localhost:80 2023-10-05T11:31:17.135 INFO:tasks.workunit.client.0.smithi012.stderr:+ deactivate 2023-10-05T11:31:17.135 INFO:tasks.workunit.client.0.smithi012.stderr:+ '[' -n /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin ']' 2023-10-05T11:31:17.135 INFO:tasks.workunit.client.0.smithi012.stderr:+ PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2023-10-05T11:31:17.135 INFO:tasks.workunit.client.0.smithi012.stderr:+ export PATH 2023-10-05T11:31:17.135 INFO:tasks.workunit.client.0.smithi012.stderr:+ unset _OLD_VIRTUAL_PATH 2023-10-05T11:31:17.135 INFO:tasks.workunit.client.0.smithi012.stderr:+ '[' -n '' ']' 2023-10-05T11:31:17.135 INFO:tasks.workunit.client.0.smithi012.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2023-10-05T11:31:17.135 INFO:tasks.workunit.client.0.smithi012.stderr:+ hash -r 2023-10-05T11:31:17.135 INFO:tasks.workunit.client.0.smithi012.stderr:+ '[' -n '' ']' 2023-10-05T11:31:17.135 INFO:tasks.workunit.client.0.smithi012.stderr:+ unset VIRTUAL_ENV 2023-10-05T11:31:17.136 INFO:tasks.workunit.client.0.smithi012.stderr:+ '[' '!' '' = nondestructive ']' 2023-10-05T11:31:17.136 INFO:tasks.workunit.client.0.smithi012.stderr:+ unset -f deactivate 2023-10-05T11:31:17.136 INFO:tasks.workunit.client.0.smithi012.stderr:+ echo OK. 2023-10-05T11:31:17.136 INFO:tasks.workunit.client.0.smithi012.stdout:OK. 2023-10-05T11:31:17.137 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-10-05T11:31:17.137 DEBUG:teuthology.orchestra.run.smithi012:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-10-05T11:31:17.207 INFO:tasks.workunit:Stopping ['rgw/run-bucket-check.sh'] on client.0... 2023-10-05T11:31:17.207 DEBUG:teuthology.orchestra.run.smithi012:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2023-10-05T11:31:17.580 DEBUG:teuthology.parallel:result is None 2023-10-05T11:31:17.581 DEBUG:teuthology.orchestra.run.smithi012:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2023-10-05T11:31:17.612 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2023-10-05T11:31:17.612 DEBUG:teuthology.orchestra.run.smithi012:> rmdir -- /home/ubuntu/cephtest/mnt.0 2023-10-05T11:31:17.666 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2023-10-05T11:31:17.667 INFO:teuthology.run_tasks:Running task workunit... 2023-10-05T11:31:17.676 INFO:tasks.workunit:Pulling workunits from ref 38321be854743c0d616618a9ea8aa0b1d4dbc0bf 2023-10-05T11:31:17.677 INFO:tasks.workunit:Making a separate scratch dir for every client... 2023-10-05T11:31:17.677 DEBUG:teuthology.orchestra.run.smithi012:> stat -- /home/ubuntu/cephtest/mnt.0 2023-10-05T11:31:17.721 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-05T11:31:17.722 INFO:teuthology.orchestra.run.smithi012.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2023-10-05T11:31:17.725 DEBUG:teuthology.orchestra.run.smithi012:> mkdir -- /home/ubuntu/cephtest/mnt.0 2023-10-05T11:31:17.777 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2023-10-05T11:31:17.778 DEBUG:teuthology.orchestra.run.smithi012:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2023-10-05T11:31:17.833 INFO:tasks.workunit:timeout=3h 2023-10-05T11:31:17.833 INFO:tasks.workunit:cleanup=True 2023-10-05T11:31:17.834 DEBUG:teuthology.orchestra.run.smithi012:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/pritha-srivastava/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 38321be854743c0d616618a9ea8aa0b1d4dbc0bf 2023-10-05T11:31:17.889 INFO:tasks.workunit.client.0.smithi012.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2023-10-05T11:32:05.533 INFO:tasks.workunit.client.0.smithi012.stderr:Note: switching to '38321be854743c0d616618a9ea8aa0b1d4dbc0bf'. 2023-10-05T11:32:05.534 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:32:05.534 INFO:tasks.workunit.client.0.smithi012.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2023-10-05T11:32:05.534 INFO:tasks.workunit.client.0.smithi012.stderr:changes and commit them, and you can discard any commits you make in this 2023-10-05T11:32:05.534 INFO:tasks.workunit.client.0.smithi012.stderr:state without impacting any branches by switching back to a branch. 2023-10-05T11:32:05.534 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:32:05.534 INFO:tasks.workunit.client.0.smithi012.stderr:If you want to create a new branch to retain commits you create, you may 2023-10-05T11:32:05.534 INFO:tasks.workunit.client.0.smithi012.stderr:do so (now or later) by using -c with the switch command. Example: 2023-10-05T11:32:05.534 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:32:05.534 INFO:tasks.workunit.client.0.smithi012.stderr: git switch -c 2023-10-05T11:32:05.534 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:32:05.535 INFO:tasks.workunit.client.0.smithi012.stderr:Or undo this operation with: 2023-10-05T11:32:05.535 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:32:05.535 INFO:tasks.workunit.client.0.smithi012.stderr: git switch - 2023-10-05T11:32:05.535 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:32:05.535 INFO:tasks.workunit.client.0.smithi012.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2023-10-05T11:32:05.535 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:32:05.535 INFO:tasks.workunit.client.0.smithi012.stderr:HEAD is now at 38321be8547 rgw/d3n: fixes for failures seen in test_multipart_upload. 2023-10-05T11:32:05.538 DEBUG:teuthology.orchestra.run.smithi012:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2023-10-05T11:32:05.594 INFO:tasks.workunit.client.0.smithi012.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2023-10-05T11:32:05.596 INFO:tasks.workunit.client.0.smithi012.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-10-05T11:32:05.597 INFO:tasks.workunit.client.0.smithi012.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2023-10-05T11:32:05.647 INFO:tasks.workunit.client.0.smithi012.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2023-10-05T11:32:05.697 INFO:tasks.workunit.client.0.smithi012.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2023-10-05T11:32:05.737 INFO:tasks.workunit.client.0.smithi012.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-10-05T11:32:05.738 INFO:tasks.workunit.client.0.smithi012.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-10-05T11:32:05.739 INFO:tasks.workunit.client.0.smithi012.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2023-10-05T11:32:05.778 INFO:tasks.workunit.client.0.smithi012.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-10-05T11:32:05.781 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-10-05T11:32:05.782 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2023-10-05T11:32:05.837 INFO:tasks.workunit:Running workunits matching cls/test_cls_lock.sh on client.0... 2023-10-05T11:32:05.838 INFO:tasks.workunit:Running workunit cls/test_cls_lock.sh... 2023-10-05T11:32:05.838 DEBUG:teuthology.orchestra.run.smithi012:workunit test cls/test_cls_lock.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=38321be854743c0d616618a9ea8aa0b1d4dbc0bf TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_lock.sh 2023-10-05T11:32:05.905 INFO:tasks.workunit.client.0.smithi012.stdout:Running main() from gmock_main.cc 2023-10-05T11:32:05.906 INFO:tasks.workunit.client.0.smithi012.stdout:[==========] Running 11 tests from 1 test suite. 2023-10-05T11:32:05.906 INFO:tasks.workunit.client.0.smithi012.stdout:[----------] Global test environment set-up. 2023-10-05T11:32:05.906 INFO:tasks.workunit.client.0.smithi012.stdout:[----------] 11 tests from ClsLock 2023-10-05T11:32:05.906 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] ClsLock.TestMultiLocking 2023-10-05T11:32:07.971 INFO:tasks.workunit.client.0.smithi012.stdout:lock: mylock 2023-10-05T11:32:07.971 INFO:tasks.workunit.client.0.smithi012.stdout: lock_type: exclusive 2023-10-05T11:32:07.971 INFO:tasks.workunit.client.0.smithi012.stdout: tag: 2023-10-05T11:32:07.971 INFO:tasks.workunit.client.0.smithi012.stdout: lockers: 2023-10-05T11:32:07.971 INFO:tasks.workunit.client.0.smithi012.stdout: client.5198 expiration=2023-10-05T11:34:07.963648+0000 addr=v1:172.21.15.12:0/3459390506 cookie= 2023-10-05T11:32:07.977 INFO:tasks.workunit.client.0.smithi012.stdout:lock: mylock 2023-10-05T11:32:07.977 INFO:tasks.workunit.client.0.smithi012.stdout: lock_type: shared 2023-10-05T11:32:07.977 INFO:tasks.workunit.client.0.smithi012.stdout: tag: 2023-10-05T11:32:07.977 INFO:tasks.workunit.client.0.smithi012.stdout: lockers: 2023-10-05T11:32:07.977 INFO:tasks.workunit.client.0.smithi012.stdout: client.5198 expiration=2023-10-05T11:34:07.973175+0000 addr=v1:172.21.15.12:0/3459390506 cookie= 2023-10-05T11:32:07.977 INFO:tasks.workunit.client.0.smithi012.stdout: client.5316 expiration=0.000000 addr=v1:172.21.15.12:0/2096652078 cookie= 2023-10-05T11:32:07.979 INFO:tasks.workunit.client.0.smithi012.stdout:lock: mylock 2023-10-05T11:32:07.979 INFO:tasks.workunit.client.0.smithi012.stdout: lock_type: shared 2023-10-05T11:32:07.979 INFO:tasks.workunit.client.0.smithi012.stdout: tag: 2023-10-05T11:32:07.979 INFO:tasks.workunit.client.0.smithi012.stdout: lockers: 2023-10-05T11:32:07.980 INFO:tasks.workunit.client.0.smithi012.stdout: client.5316 expiration=0.000000 addr=v1:172.21.15.12:0/2096652078 cookie= 2023-10-05T11:32:08.638 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] ClsLock.TestMultiLocking (2733 ms) 2023-10-05T11:32:08.639 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] ClsLock.TestMeta 2023-10-05T11:32:10.681 INFO:tasks.workunit.client.0.smithi012.stdout:lock: mylock 2023-10-05T11:32:10.681 INFO:tasks.workunit.client.0.smithi012.stdout: lock_type: shared 2023-10-05T11:32:10.681 INFO:tasks.workunit.client.0.smithi012.stdout: tag: 2023-10-05T11:32:10.681 INFO:tasks.workunit.client.0.smithi012.stdout: lockers: 2023-10-05T11:32:10.682 INFO:tasks.workunit.client.0.smithi012.stdout: client.5216 expiration=0.000000 addr=v1:172.21.15.12:0/2593265808 cookie= 2023-10-05T11:32:10.684 INFO:tasks.workunit.client.0.smithi012.stdout:lock: mylock 2023-10-05T11:32:10.684 INFO:tasks.workunit.client.0.smithi012.stdout: lock_type: exclusive 2023-10-05T11:32:10.684 INFO:tasks.workunit.client.0.smithi012.stdout: tag: new_tag 2023-10-05T11:32:10.684 INFO:tasks.workunit.client.0.smithi012.stdout: lockers: 2023-10-05T11:32:10.684 INFO:tasks.workunit.client.0.smithi012.stdout: client.5210 expiration=0.000000 addr=v1:172.21.15.12:0/1029214865 cookie= 2023-10-05T11:32:11.649 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] ClsLock.TestMeta (3010 ms) 2023-10-05T11:32:11.649 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] ClsLock.TestCookie 2023-10-05T11:32:13.700 INFO:tasks.workunit.client.0.smithi012.stdout:lock: mylock 2023-10-05T11:32:13.700 INFO:tasks.workunit.client.0.smithi012.stdout: lock_type: exclusive 2023-10-05T11:32:13.700 INFO:tasks.workunit.client.0.smithi012.stdout: tag: 2023-10-05T11:32:13.700 INFO:tasks.workunit.client.0.smithi012.stdout: lockers: 2023-10-05T11:32:13.705 INFO:tasks.workunit.client.0.smithi012.stdout:lock: mylock 2023-10-05T11:32:13.705 INFO:tasks.workunit.client.0.smithi012.stdout: lock_type: shared 2023-10-05T11:32:13.706 INFO:tasks.workunit.client.0.smithi012.stdout: tag: 2023-10-05T11:32:13.706 INFO:tasks.workunit.client.0.smithi012.stdout: lockers: 2023-10-05T11:32:13.706 INFO:tasks.workunit.client.0.smithi012.stdout: client.5219 expiration=0.000000 addr=v1:172.21.15.12:0/2281799970 cookie= 2023-10-05T11:32:13.706 INFO:tasks.workunit.client.0.smithi012.stdout: client.5219 expiration=0.000000 addr=v1:172.21.15.12:0/2281799970 cookie=new cookie 2023-10-05T11:32:14.676 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] ClsLock.TestCookie (3028 ms) 2023-10-05T11:32:14.676 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] ClsLock.TestMultipleLocks 2023-10-05T11:32:17.697 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] ClsLock.TestMultipleLocks (3020 ms) 2023-10-05T11:32:17.698 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] ClsLock.TestLockDuration 2023-10-05T11:32:25.736 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] ClsLock.TestLockDuration (8039 ms) 2023-10-05T11:32:25.736 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] ClsLock.TestAssertLocked 2023-10-05T11:32:28.758 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] ClsLock.TestAssertLocked (3021 ms) 2023-10-05T11:32:28.758 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] ClsLock.TestSetCookie 2023-10-05T11:32:31.769 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] ClsLock.TestSetCookie (3013 ms) 2023-10-05T11:32:31.770 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] ClsLock.TestRenew 2023-10-05T11:32:52.825 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] ClsLock.TestRenew (21055 ms) 2023-10-05T11:32:52.825 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralBasic 2023-10-05T11:32:59.864 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] ClsLock.TestExclusiveEphemeralBasic (7040 ms) 2023-10-05T11:32:59.864 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralStealEphemeral 2023-10-05T11:33:07.579 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] ClsLock.TestExclusiveEphemeralStealEphemeral (7714 ms) 2023-10-05T11:33:07.579 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralStealExclusive 2023-10-05T11:33:15.616 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] ClsLock.TestExclusiveEphemeralStealExclusive (8035 ms) 2023-10-05T11:33:15.616 INFO:tasks.workunit.client.0.smithi012.stdout:[----------] 11 tests from ClsLock (69708 ms total) 2023-10-05T11:33:15.616 INFO:tasks.workunit.client.0.smithi012.stdout: 2023-10-05T11:33:15.617 INFO:tasks.workunit.client.0.smithi012.stdout:[----------] Global test environment tear-down 2023-10-05T11:33:15.617 INFO:tasks.workunit.client.0.smithi012.stdout:[==========] 11 tests from 1 test suite ran. (69708 ms total) 2023-10-05T11:33:15.617 INFO:tasks.workunit.client.0.smithi012.stdout:[ PASSED ] 11 tests. 2023-10-05T11:33:15.619 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-10-05T11:33:15.619 DEBUG:teuthology.orchestra.run.smithi012:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-10-05T11:33:15.692 INFO:tasks.workunit:Running workunits matching cls/test_cls_log.sh on client.0... 2023-10-05T11:33:15.694 INFO:tasks.workunit:Running workunit cls/test_cls_log.sh... 2023-10-05T11:33:15.694 DEBUG:teuthology.orchestra.run.smithi012:workunit test cls/test_cls_log.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=38321be854743c0d616618a9ea8aa0b1d4dbc0bf TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_log.sh 2023-10-05T11:33:15.764 INFO:tasks.workunit.client.0.smithi012.stdout:Running main() from gmock_main.cc 2023-10-05T11:33:15.764 INFO:tasks.workunit.client.0.smithi012.stdout:[==========] Running 4 tests from 1 test suite. 2023-10-05T11:33:15.764 INFO:tasks.workunit.client.0.smithi012.stdout:[----------] Global test environment set-up. 2023-10-05T11:33:15.764 INFO:tasks.workunit.client.0.smithi012.stdout:[----------] 4 tests from cls_log 2023-10-05T11:33:15.765 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] cls_log.test_log_add_same_time 2023-10-05T11:33:18.640 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] cls_log.test_log_add_same_time (2876 ms) 2023-10-05T11:33:18.641 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] cls_log.test_log_add_different_time 2023-10-05T11:33:21.643 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] cls_log.test_log_add_different_time (3003 ms) 2023-10-05T11:33:21.644 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] cls_log.trim_by_time 2023-10-05T11:33:24.665 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] cls_log.trim_by_time (3022 ms) 2023-10-05T11:33:24.666 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] cls_log.trim_by_marker 2023-10-05T11:33:27.670 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] cls_log.trim_by_marker (3004 ms) 2023-10-05T11:33:27.670 INFO:tasks.workunit.client.0.smithi012.stdout:[----------] 4 tests from cls_log (11905 ms total) 2023-10-05T11:33:27.670 INFO:tasks.workunit.client.0.smithi012.stdout: 2023-10-05T11:33:27.671 INFO:tasks.workunit.client.0.smithi012.stdout:[----------] Global test environment tear-down 2023-10-05T11:33:27.671 INFO:tasks.workunit.client.0.smithi012.stdout:[==========] 4 tests from 1 test suite ran. (11905 ms total) 2023-10-05T11:33:27.671 INFO:tasks.workunit.client.0.smithi012.stdout:[ PASSED ] 4 tests. 2023-10-05T11:33:27.675 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-10-05T11:33:27.675 DEBUG:teuthology.orchestra.run.smithi012:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-10-05T11:33:27.750 INFO:tasks.workunit:Running workunits matching cls/test_cls_refcount.sh on client.0... 2023-10-05T11:33:27.751 INFO:tasks.workunit:Running workunit cls/test_cls_refcount.sh... 2023-10-05T11:33:27.751 DEBUG:teuthology.orchestra.run.smithi012:workunit test cls/test_cls_refcount.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=38321be854743c0d616618a9ea8aa0b1d4dbc0bf TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_refcount.sh 2023-10-05T11:33:27.822 INFO:tasks.workunit.client.0.smithi012.stdout:Running main() from gmock_main.cc 2023-10-05T11:33:27.822 INFO:tasks.workunit.client.0.smithi012.stdout:[==========] Running 10 tests from 1 test suite. 2023-10-05T11:33:27.823 INFO:tasks.workunit.client.0.smithi012.stdout:[----------] Global test environment set-up. 2023-10-05T11:33:27.823 INFO:tasks.workunit.client.0.smithi012.stdout:[----------] 10 tests from cls_refcount 2023-10-05T11:33:27.823 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] cls_refcount.test_implicit 2023-10-05T11:33:30.705 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] cls_refcount.test_implicit (2881 ms) 2023-10-05T11:33:30.705 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] cls_refcount.test_implicit_idempotent 2023-10-05T11:33:33.729 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] cls_refcount.test_implicit_idempotent (3023 ms) 2023-10-05T11:33:33.729 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] cls_refcount.test_put_snap 2023-10-05T11:33:42.797 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] cls_refcount.test_put_snap (9071 ms) 2023-10-05T11:33:42.797 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] cls_refcount.test_explicit 2023-10-05T11:33:45.817 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] cls_refcount.test_explicit (3020 ms) 2023-10-05T11:33:45.817 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] cls_refcount.set 2023-10-05T11:33:48.844 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] cls_refcount.set (3026 ms) 2023-10-05T11:33:48.844 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] cls_refcount.test_implicit_ec 2023-10-05T11:33:55.865 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] cls_refcount.test_implicit_ec (7022 ms) 2023-10-05T11:33:55.865 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] cls_refcount.test_implicit_idempotent_ec 2023-10-05T11:34:02.899 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] cls_refcount.test_implicit_idempotent_ec (7034 ms) 2023-10-05T11:34:02.899 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] cls_refcount.test_put_snap_ec 2023-10-05T11:34:15.608 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] cls_refcount.test_put_snap_ec (12708 ms) 2023-10-05T11:34:15.609 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] cls_refcount.test_explicit_ec 2023-10-05T11:34:22.633 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] cls_refcount.test_explicit_ec (7026 ms) 2023-10-05T11:34:22.634 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] cls_refcount.set_ec 2023-10-05T11:34:29.661 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] cls_refcount.set_ec (7028 ms) 2023-10-05T11:34:29.661 INFO:tasks.workunit.client.0.smithi012.stdout:[----------] 10 tests from cls_refcount (61839 ms total) 2023-10-05T11:34:29.661 INFO:tasks.workunit.client.0.smithi012.stdout: 2023-10-05T11:34:29.662 INFO:tasks.workunit.client.0.smithi012.stdout:[----------] Global test environment tear-down 2023-10-05T11:34:29.662 INFO:tasks.workunit.client.0.smithi012.stdout:[==========] 10 tests from 1 test suite ran. (61839 ms total) 2023-10-05T11:34:29.662 INFO:tasks.workunit.client.0.smithi012.stdout:[ PASSED ] 10 tests. 2023-10-05T11:34:29.664 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-10-05T11:34:29.664 DEBUG:teuthology.orchestra.run.smithi012:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-10-05T11:34:29.740 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw.sh on client.0... 2023-10-05T11:34:29.741 INFO:tasks.workunit:Running workunit cls/test_cls_rgw.sh... 2023-10-05T11:34:29.741 DEBUG:teuthology.orchestra.run.smithi012:workunit test cls/test_cls_rgw.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=38321be854743c0d616618a9ea8aa0b1d4dbc0bf TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw.sh 2023-10-05T11:34:29.813 INFO:tasks.workunit.client.0.smithi012.stdout:Running main() from gmock_main.cc 2023-10-05T11:34:29.813 INFO:tasks.workunit.client.0.smithi012.stdout:[==========] Running 16 tests from 1 test suite. 2023-10-05T11:34:29.813 INFO:tasks.workunit.client.0.smithi012.stdout:[----------] Global test environment set-up. 2023-10-05T11:34:29.813 INFO:tasks.workunit.client.0.smithi012.stdout:[----------] 16 tests from cls_rgw 2023-10-05T11:34:31.669 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] cls_rgw.index_basic 2023-10-05T11:34:31.718 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] cls_rgw.index_basic (50 ms) 2023-10-05T11:34:31.718 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] cls_rgw.index_multiple_obj_writers 2023-10-05T11:34:31.750 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] cls_rgw.index_multiple_obj_writers (32 ms) 2023-10-05T11:34:31.750 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] cls_rgw.index_remove_object 2023-10-05T11:34:31.793 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] cls_rgw.index_remove_object (43 ms) 2023-10-05T11:34:31.793 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] cls_rgw.index_suggest 2023-10-05T11:34:33.311 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] cls_rgw.index_suggest (1518 ms) 2023-10-05T11:34:33.311 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] cls_rgw.index_suggest_complete 2023-10-05T11:34:33.318 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] cls_rgw.index_suggest_complete (7 ms) 2023-10-05T11:34:33.318 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] cls_rgw.index_list 2023-10-05T11:34:33.344 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] cls_rgw.index_list (26 ms) 2023-10-05T11:34:33.344 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] cls_rgw.index_list_delimited 2023-10-05T11:34:54.281 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] cls_rgw.index_list_delimited (20936 ms) 2023-10-05T11:34:54.281 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] cls_rgw.bi_list 2023-10-05T11:34:54.355 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] cls_rgw.bi_list (75 ms) 2023-10-05T11:34:54.355 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] cls_rgw.gc_set 2023-10-05T11:34:54.365 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] cls_rgw.gc_set (10 ms) 2023-10-05T11:34:54.365 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] cls_rgw.gc_list 2023-10-05T11:34:54.376 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] cls_rgw.gc_list (10 ms) 2023-10-05T11:34:54.376 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] cls_rgw.gc_defer 2023-10-05T11:35:01.745 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] cls_rgw.gc_defer (7369 ms) 2023-10-05T11:35:01.745 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] cls_rgw.usage_basic 2023-10-05T11:35:01.821 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] cls_rgw.usage_basic (77 ms) 2023-10-05T11:35:01.822 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] cls_rgw.usage_clear_no_obj 2023-10-05T11:35:01.822 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] cls_rgw.usage_clear_no_obj (2 ms) 2023-10-05T11:35:01.823 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] cls_rgw.usage_clear 2023-10-05T11:35:01.920 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] cls_rgw.usage_clear (97 ms) 2023-10-05T11:35:01.920 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] cls_rgw.bi_log_trim 2023-10-05T11:35:01.967 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] cls_rgw.bi_log_trim (47 ms) 2023-10-05T11:35:01.967 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] cls_rgw.index_racing_removes 2023-10-05T11:35:01.984 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] cls_rgw.index_racing_removes (16 ms) 2023-10-05T11:35:02.753 INFO:tasks.workunit.client.0.smithi012.stdout:[----------] 16 tests from cls_rgw (30315 ms total) 2023-10-05T11:35:02.753 INFO:tasks.workunit.client.0.smithi012.stdout: 2023-10-05T11:35:02.753 INFO:tasks.workunit.client.0.smithi012.stdout:[----------] Global test environment tear-down 2023-10-05T11:35:02.753 INFO:tasks.workunit.client.0.smithi012.stdout:[==========] 16 tests from 1 test suite ran. (32941 ms total) 2023-10-05T11:35:02.753 INFO:tasks.workunit.client.0.smithi012.stdout:[ PASSED ] 16 tests. 2023-10-05T11:35:02.757 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-10-05T11:35:02.757 DEBUG:teuthology.orchestra.run.smithi012:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-10-05T11:35:02.833 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw_gc.sh on client.0... 2023-10-05T11:35:02.834 INFO:tasks.workunit:Running workunit cls/test_cls_rgw_gc.sh... 2023-10-05T11:35:02.834 DEBUG:teuthology.orchestra.run.smithi012:workunit test cls/test_cls_rgw_gc.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=38321be854743c0d616618a9ea8aa0b1d4dbc0bf TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw_gc.sh 2023-10-05T11:35:02.907 INFO:tasks.workunit.client.0.smithi012.stdout:Running main() from gmock_main.cc 2023-10-05T11:35:02.907 INFO:tasks.workunit.client.0.smithi012.stdout:[==========] Running 9 tests from 1 test suite. 2023-10-05T11:35:02.907 INFO:tasks.workunit.client.0.smithi012.stdout:[----------] Global test environment set-up. 2023-10-05T11:35:02.907 INFO:tasks.workunit.client.0.smithi012.stdout:[----------] 9 tests from cls_rgw_gc 2023-10-05T11:35:02.907 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] cls_rgw_gc.init 2023-10-05T11:35:04.754 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] cls_rgw_gc.init (1847 ms) 2023-10-05T11:35:04.755 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops1 2023-10-05T11:35:04.776 INFO:tasks.workunit.client.0.smithi012.stderr:[ ] list info tag = chain-0 2023-10-05T11:35:04.776 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] cls_rgw_gc.gc_queue_ops1 (22 ms) 2023-10-05T11:35:04.776 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops2 2023-10-05T11:35:04.785 INFO:tasks.workunit.client.0.smithi012.stderr:[ ] next_marker is: = 0/4263 2023-10-05T11:35:04.785 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] cls_rgw_gc.gc_queue_ops2 (9 ms) 2023-10-05T11:35:04.785 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops5 2023-10-05T11:35:04.795 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] cls_rgw_gc.gc_queue_ops5 (9 ms) 2023-10-05T11:35:04.795 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops6 2023-10-05T11:35:04.802 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] cls_rgw_gc.gc_queue_ops6 (8 ms) 2023-10-05T11:35:04.802 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops7 2023-10-05T11:35:04.995 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] cls_rgw_gc.gc_queue_ops7 (193 ms) 2023-10-05T11:35:04.995 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops8 2023-10-05T11:35:05.003 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] cls_rgw_gc.gc_queue_ops8 (8 ms) 2023-10-05T11:35:05.004 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops9 2023-10-05T11:35:05.011 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] cls_rgw_gc.gc_queue_ops9 (8 ms) 2023-10-05T11:35:05.011 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] cls_rgw_gc.finalize 2023-10-05T11:35:05.767 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] cls_rgw_gc.finalize (754 ms) 2023-10-05T11:35:05.768 INFO:tasks.workunit.client.0.smithi012.stdout:[----------] 9 tests from cls_rgw_gc (2858 ms total) 2023-10-05T11:35:05.768 INFO:tasks.workunit.client.0.smithi012.stdout: 2023-10-05T11:35:05.768 INFO:tasks.workunit.client.0.smithi012.stdout:[----------] Global test environment tear-down 2023-10-05T11:35:05.768 INFO:tasks.workunit.client.0.smithi012.stdout:[==========] 9 tests from 1 test suite ran. (2858 ms total) 2023-10-05T11:35:05.768 INFO:tasks.workunit.client.0.smithi012.stdout:[ PASSED ] 9 tests. 2023-10-05T11:35:05.769 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-10-05T11:35:05.769 DEBUG:teuthology.orchestra.run.smithi012:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-10-05T11:35:05.848 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw_stats.sh on client.0... 2023-10-05T11:35:05.850 INFO:tasks.workunit:Running workunit cls/test_cls_rgw_stats.sh... 2023-10-05T11:35:05.850 DEBUG:teuthology.orchestra.run.smithi012:workunit test cls/test_cls_rgw_stats.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=38321be854743c0d616618a9ea8aa0b1d4dbc0bf TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw_stats.sh 2023-10-05T11:35:05.931 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setuser ceph since I am not root 2023-10-05T11:35:05.931 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T11:35:05.931 INFO:tasks.workunit.client.0.smithi012.stdout:[==========] Running 1 test from 1 test suite. 2023-10-05T11:35:05.932 INFO:tasks.workunit.client.0.smithi012.stdout:[----------] Global test environment set-up. 2023-10-05T11:35:07.780 INFO:tasks.workunit.client.0.smithi012.stdout:[----------] 1 test from cls_rgw_stats 2023-10-05T11:35:07.780 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] cls_rgw_stats.simulate 2023-10-05T11:35:07.800 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:07.797+0000 7f26f5634780 1 > prepared operation key=WTCWG1C1SF89 tag=5XOH0H4UEOOV type=write size=210214 2023-10-05T11:35:07.803 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:07.800+0000 7f26f5634780 1 > prepared part key=_multipart_5V0Q651D4VN2.2~1QVLZTUHDZFY.0 size=1048576 2023-10-05T11:35:07.804 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:07.801+0000 7f26f5634780 1 > prepared part key=_multipart_5V0Q651D4VN2.2~1QVLZTUHDZFY.1 size=1048576 2023-10-05T11:35:07.806 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:07.802+0000 7f26f5634780 1 > prepared part key=_multipart_5V0Q651D4VN2.2~1QVLZTUHDZFY.2 size=517481 2023-10-05T11:35:07.806 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:07.802+0000 7f26f5634780 1 > prepared multipart upload key=5V0Q651D4VN2 upload=1QVLZTUHDZFY tag=H3HA6TY76UC2 type=write size=3663209 2023-10-05T11:35:07.809 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:07.805+0000 7f26f5634780 1 > prepared part key=_multipart_IC7T3ZK81WQS.2~9FT8OLBQFVV4.0 size=300234 2023-10-05T11:35:07.809 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:07.805+0000 7f26f5634780 1 > prepared multipart upload key=IC7T3ZK81WQS upload=9FT8OLBQFVV4 tag=487GNPAX3VD9 type=write size=1348810 2023-10-05T11:35:07.810 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:07.807+0000 7f26f5634780 1 > prepared operation key=BU3KSHTINB36 tag=37HD84M9000Y type=write size=586464 2023-10-05T11:35:07.813 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:07.810+0000 7f26f5634780 1 > prepared part key=_multipart_WTCWG1C1SF89.2~3GZGZB45BL12.0 size=1048576 2023-10-05T11:35:07.814 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:07.811+0000 7f26f5634780 1 > prepared part key=_multipart_WTCWG1C1SF89.2~3GZGZB45BL12.1 size=673429 2023-10-05T11:35:07.814 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:07.811+0000 7f26f5634780 1 > prepared multipart upload key=WTCWG1C1SF89 upload=3GZGZB45BL12 tag=14WPVXQOKQQ4 type=write size=2770581 2023-10-05T11:35:07.817 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:07.814+0000 7f26f5634780 1 > prepared part key=_multipart_4IBQJLJR7LD8.2~0XNOK6C36RYC.0 size=872718 2023-10-05T11:35:07.817 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:07.814+0000 7f26f5634780 1 > prepared multipart upload key=4IBQJLJR7LD8 upload=0XNOK6C36RYC tag=LZVQYN1NN3YR type=write size=1921294 2023-10-05T11:35:07.819 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:07.815+0000 7f26f5634780 1 > prepared operation key=QYQDXVIGZ7O8 tag=M84UDTQ81CG4 type=write size=859016 2023-10-05T11:35:07.820 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:07.817+0000 7f26f5634780 1 > prepared operation key=U6172JUYW7J6 tag=ZQZSEVEY061P type=write size=1017485 2023-10-05T11:35:07.822 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:07.818+0000 7f26f5634780 1 > prepared operation key=7TOP5A52M9YP tag=HREKHB0XXMIT type=write size=444692 2023-10-05T11:35:07.827 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:07.824+0000 7f26f5634780 1 > prepared part key=_multipart_U6172JUYW7J6.2~J53D2L0K4H5R.0 size=566667 2023-10-05T11:35:07.827 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:07.824+0000 7f26f5634780 1 > prepared multipart upload key=U6172JUYW7J6 upload=J53D2L0K4H5R tag=U0ZX6UF3AJUG type=write size=1615243 2023-10-05T11:35:07.828 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:07.825+0000 7f26f5634780 1 > prepared operation key=7W9LL5HSU3BG tag=I9BJJQNZI2RU type=del size=3923968 2023-10-05T11:35:07.832 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:07.828+0000 7f26f5634780 1 > prepared part key=_multipart_VJTFYDETLSFD.2~JUSMC1TJVM42.0 size=803842 2023-10-05T11:35:07.832 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:07.828+0000 7f26f5634780 1 > prepared multipart upload key=VJTFYDETLSFD upload=JUSMC1TJVM42 tag=FEX2XFSY8EIL type=write size=1852418 2023-10-05T11:35:07.834 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:07.831+0000 7f26f5634780 1 > prepared part key=_multipart_S3DKYDFT4IO2.2~CJSYHU1UKXGO.0 size=1048576 2023-10-05T11:35:07.835 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:07.832+0000 7f26f5634780 1 > prepared part key=_multipart_S3DKYDFT4IO2.2~CJSYHU1UKXGO.1 size=78068 2023-10-05T11:35:07.836 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:07.832+0000 7f26f5634780 1 > prepared multipart upload key=S3DKYDFT4IO2 upload=CJSYHU1UKXGO tag=YQ9V5U9OWZDZ type=write size=2175220 2023-10-05T11:35:07.837 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:07.834+0000 7f26f5634780 1 > prepared operation key=4IBQJLJR7LD8 tag=2UWX05N20AAV type=del size=3744989 2023-10-05T11:35:07.839 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:07.835+0000 7f26f5634780 1 > prepared operation key=PNV0Q6ZPLYV0 tag=AR28A0FR5SSZ type=del size=1055670 2023-10-05T11:35:07.840 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:07.837+0000 7f26f5634780 1 > prepared operation key=2U0NRDGDNUTA tag=SF1SWB4OBZ8Z type=del size=103591 2023-10-05T11:35:07.843 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:07.840+0000 7f26f5634780 1 < suggested remove operation key=WTCWG1C1SF89 tag=5XOH0H4UEOOV type=write 2023-10-05T11:35:07.845 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:07.841+0000 7f26f5634780 1 > prepared operation key=LLR5J3X15W5R tag=3V361TLACBC4 type=del size=2321025 2023-10-05T11:35:07.846 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:07.843+0000 7f26f5634780 1 < completed part key=_multipart_5V0Q651D4VN2.2~1QVLZTUHDZFY.0 size=1048576 2023-10-05T11:35:07.847 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:07.844+0000 7f26f5634780 1 < completed part key=_multipart_5V0Q651D4VN2.2~1QVLZTUHDZFY.1 size=1048576 2023-10-05T11:35:07.849 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:07.845+0000 7f26f5634780 1 < completed part key=_multipart_5V0Q651D4VN2.2~1QVLZTUHDZFY.2 size=517481 2023-10-05T11:35:07.851 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:07.848+0000 7f26f5634780 1 < completed multipart upload key=5V0Q651D4VN2 upload=1QVLZTUHDZFY tag=H3HA6TY76UC2 type=write size=3663209 2023-10-05T11:35:07.853 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:07.850+0000 7f26f5634780 1 > prepared operation key=9S0YW7PPSJ8G tag=8EGRJXKIXIWO type=write size=25153 2023-10-05T11:35:07.854 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:07.851+0000 7f26f5634780 1 < completed part key=_multipart_IC7T3ZK81WQS.2~9FT8OLBQFVV4.0 size=300234 2023-10-05T11:35:07.857 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:07.853+0000 7f26f5634780 1 < completed multipart upload key=IC7T3ZK81WQS upload=9FT8OLBQFVV4 tag=487GNPAX3VD9 type=write size=1348810 2023-10-05T11:35:07.858 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:07.855+0000 7f26f5634780 1 > prepared operation key=5V0Q651D4VN2 tag=VDA5EMTRVKBV type=del size=2317718 2023-10-05T11:35:07.861 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:07.857+0000 7f26f5634780 1 < suggested update operation key=BU3KSHTINB36 tag=37HD84M9000Y type=write size=586464 2023-10-05T11:35:07.862 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:07.859+0000 7f26f5634780 1 > prepared operation key=0PWYKC7S6YJ4 tag=V6VG6CPH67G2 type=del size=523247 2023-10-05T11:35:07.864 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:07.860+0000 7f26f5634780 1 < completed part key=_multipart_WTCWG1C1SF89.2~3GZGZB45BL12.0 size=1048576 2023-10-05T11:35:07.864 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:07.860+0000 7f26f5634780 1 < canceled part key=_multipart_WTCWG1C1SF89.2~3GZGZB45BL12.1 size=673429 2023-10-05T11:35:07.866 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:07.862+0000 7f26f5634780 1 < canceled multipart upload key=WTCWG1C1SF89 upload=3GZGZB45BL12 tag=14WPVXQOKQQ4 type=write size=2770581 2023-10-05T11:35:07.867 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:07.864+0000 7f26f5634780 1 > prepared operation key=IC7T3ZK81WQS tag=5J3L2S55O6WJ type=del size=1432050 2023-10-05T11:35:07.869 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:07.865+0000 7f26f5634780 1 < completed part key=_multipart_4IBQJLJR7LD8.2~0XNOK6C36RYC.0 size=872718 2023-10-05T11:35:07.871 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:07.867+0000 7f26f5634780 1 < completed multipart upload key=4IBQJLJR7LD8 upload=0XNOK6C36RYC tag=LZVQYN1NN3YR type=write size=1921294 2023-10-05T11:35:07.872 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:07.869+0000 7f26f5634780 1 > prepared operation key=FOMNIIY47UUM tag=GQRIRMB00VBR type=del size=901295 2023-10-05T11:35:07.873 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:07.870+0000 7f26f5634780 1 < completed write operation key=QYQDXVIGZ7O8 tag=M84UDTQ81CG4 type=write size=859016 2023-10-05T11:35:07.875 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:07.871+0000 7f26f5634780 1 > prepared operation key=S3DKYDFT4IO2 tag=7BX2VHU6ZWM5 type=write size=147858 2023-10-05T11:35:07.876 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:07.873+0000 7f26f5634780 1 < completed write operation key=U6172JUYW7J6 tag=ZQZSEVEY061P type=write size=1017485 2023-10-05T11:35:07.877 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:07.874+0000 7f26f5634780 1 > prepared operation key=QYQDXVIGZ7O8 tag=QVIZ63CMN32C type=del size=1151625 2023-10-05T11:35:07.879 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:07.875+0000 7f26f5634780 1 < completed write operation key=7TOP5A52M9YP tag=HREKHB0XXMIT type=write size=444692 2023-10-05T11:35:07.881 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:07.877+0000 7f26f5634780 1 > prepared part key=_multipart_AV0XKXX1IR4B.2~252R9FZ0HUCZ.0 size=1048576 2023-10-05T11:35:07.882 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:07.879+0000 7f26f5634780 1 > prepared part key=_multipart_AV0XKXX1IR4B.2~252R9FZ0HUCZ.1 size=380765 2023-10-05T11:35:07.882 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:07.879+0000 7f26f5634780 1 > prepared multipart upload key=AV0XKXX1IR4B upload=252R9FZ0HUCZ tag=RO65ZTOOVLWR type=write size=2477917 2023-10-05T11:35:07.883 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:07.880+0000 7f26f5634780 1 < completed part key=_multipart_U6172JUYW7J6.2~J53D2L0K4H5R.0 size=566667 2023-10-05T11:35:07.885 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:07.882+0000 7f26f5634780 1 < completed multipart upload key=U6172JUYW7J6 upload=J53D2L0K4H5R tag=U0ZX6UF3AJUG type=write size=1615243 2023-10-05T11:35:07.888 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:07.885+0000 7f26f5634780 1 > prepared part key=_multipart_8IPCP77WVVZT.2~O4242YDWSTAR.0 size=649928 2023-10-05T11:35:07.888 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:07.885+0000 7f26f5634780 1 > prepared multipart upload key=8IPCP77WVVZT upload=O4242YDWSTAR tag=3AT53S4FYW07 type=write size=1698504 2023-10-05T11:35:07.889 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:07.886+0000 7f26f5634780 1 < completed delete operation key=7W9LL5HSU3BG tag=I9BJJQNZI2RU type=del 2023-10-05T11:35:07.891 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:07.887+0000 7f26f5634780 1 > prepared operation key=WTCWG1C1SF89 tag=AKTS758NE19C type=write size=14068 2023-10-05T11:35:07.892 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:07.889+0000 7f26f5634780 1 < completed part key=_multipart_VJTFYDETLSFD.2~JUSMC1TJVM42.0 size=803842 2023-10-05T11:35:07.894 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:07.891+0000 7f26f5634780 1 < completed multipart upload key=VJTFYDETLSFD upload=JUSMC1TJVM42 tag=FEX2XFSY8EIL type=write size=1852418 2023-10-05T11:35:07.896 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:07.892+0000 7f26f5634780 1 > prepared operation key=IKCNZOTVWOC6 tag=7LA18MB8ORPA type=del size=1669659 2023-10-05T11:35:07.897 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:07.894+0000 7f26f5634780 1 < completed part key=_multipart_S3DKYDFT4IO2.2~CJSYHU1UKXGO.0 size=1048576 2023-10-05T11:35:07.898 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:07.895+0000 7f26f5634780 1 < completed part key=_multipart_S3DKYDFT4IO2.2~CJSYHU1UKXGO.1 size=78068 2023-10-05T11:35:07.901 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:07.897+0000 7f26f5634780 1 < completed multipart upload key=S3DKYDFT4IO2 upload=CJSYHU1UKXGO tag=YQ9V5U9OWZDZ type=write size=2175220 2023-10-05T11:35:07.902 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:07.899+0000 7f26f5634780 1 > prepared operation key=2U0NRDGDNUTA tag=RYPP4RI474RX type=write size=765778 2023-10-05T11:35:07.904 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:07.901+0000 7f26f5634780 1 < completed delete operation key=4IBQJLJR7LD8 tag=2UWX05N20AAV type=del 2023-10-05T11:35:07.906 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:07.902+0000 7f26f5634780 1 > prepared operation key=9S0YW7PPSJ8G tag=9G1HM4CWQ8ZW type=del size=4029561 2023-10-05T11:35:07.907 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:07.904+0000 7f26f5634780 1 < completed delete operation key=PNV0Q6ZPLYV0 tag=AR28A0FR5SSZ type=del 2023-10-05T11:35:07.909 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:07.905+0000 7f26f5634780 1 > prepared operation key=WYN9BG66LA3K tag=YZPSS84YAHXP type=del size=1141348 2023-10-05T11:35:07.910 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:07.907+0000 7f26f5634780 1 < completed delete operation key=2U0NRDGDNUTA tag=SF1SWB4OBZ8Z type=del 2023-10-05T11:35:07.913 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:07.909+0000 7f26f5634780 1 > prepared part key=_multipart_PC8WTJ8AYJ24.2~X1SN8I172FB9.0 size=1048576 2023-10-05T11:35:07.914 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:07.910+0000 7f26f5634780 1 > prepared part key=_multipart_PC8WTJ8AYJ24.2~X1SN8I172FB9.1 size=973860 2023-10-05T11:35:07.914 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:07.910+0000 7f26f5634780 1 > prepared multipart upload key=PC8WTJ8AYJ24 upload=X1SN8I172FB9 tag=FE8T4KDNBH7V type=write size=3071012 2023-10-05T11:35:07.915 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:07.912+0000 7f26f5634780 1 < completed delete operation key=LLR5J3X15W5R tag=3V361TLACBC4 type=del 2023-10-05T11:35:07.918 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:07.914+0000 7f26f5634780 1 > prepared part key=_multipart_PNV0Q6ZPLYV0.2~2HKTDTRKZ63I.0 size=1048576 2023-10-05T11:35:07.918 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:07.915+0000 7f26f5634780 1 > prepared part key=_multipart_PNV0Q6ZPLYV0.2~2HKTDTRKZ63I.1 size=476329 2023-10-05T11:35:07.918 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:07.915+0000 7f26f5634780 1 > prepared multipart upload key=PNV0Q6ZPLYV0 upload=2HKTDTRKZ63I tag=PU31M9EQUT95 type=write size=2573481 2023-10-05T11:35:07.920 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:07.916+0000 7f26f5634780 1 < canceled operation key=9S0YW7PPSJ8G tag=8EGRJXKIXIWO type=write size=25153 2023-10-05T11:35:07.921 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:07.917+0000 7f26f5634780 1 > prepared operation key=LLR5J3X15W5R tag=H61RB7KH0OZT type=del size=2256235 2023-10-05T11:35:07.922 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:07.919+0000 7f26f5634780 1 < completed delete operation key=5V0Q651D4VN2 tag=VDA5EMTRVKBV type=del 2023-10-05T11:35:07.923 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:07.920+0000 7f26f5634780 1 > prepared operation key=IKCNZOTVWOC6 tag=2V073PDSNUV7 type=del size=1497088 2023-10-05T11:35:07.926 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:07.923+0000 7f26f5634780 1 < suggested remove operation key=0PWYKC7S6YJ4 tag=V6VG6CPH67G2 type=del 2023-10-05T11:35:07.928 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:07.924+0000 7f26f5634780 1 > prepared operation key=5OPHKTHXVN5U tag=R7Y0T8M0O7NF type=del size=2151701 2023-10-05T11:35:07.930 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:07.927+0000 7f26f5634780 1 < suggested remove operation key=IC7T3ZK81WQS tag=5J3L2S55O6WJ type=del 2023-10-05T11:35:07.933 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:07.929+0000 7f26f5634780 1 > prepared part key=_multipart_PC8WTJ8AYJ24.2~D46FJX0ESDKY.0 size=1048576 2023-10-05T11:35:07.934 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:07.930+0000 7f26f5634780 1 > prepared part key=_multipart_PC8WTJ8AYJ24.2~D46FJX0ESDKY.1 size=1011892 2023-10-05T11:35:07.934 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:07.930+0000 7f26f5634780 1 > prepared multipart upload key=PC8WTJ8AYJ24 upload=D46FJX0ESDKY tag=W508J4SZFXG1 type=write size=3109044 2023-10-05T11:35:07.935 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:07.931+0000 7f26f5634780 1 < completed delete operation key=FOMNIIY47UUM tag=GQRIRMB00VBR type=del 2023-10-05T11:35:07.936 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:07.933+0000 7f26f5634780 1 > prepared operation key=4D3H60UTIXH3 tag=EY93UWMVHAT9 type=del size=3824950 2023-10-05T11:35:07.937 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:07.934+0000 7f26f5634780 1 < canceled operation key=S3DKYDFT4IO2 tag=7BX2VHU6ZWM5 type=write size=147858 2023-10-05T11:35:07.938 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:07.935+0000 7f26f5634780 1 > prepared operation key=FOMNIIY47UUM tag=LY69SWRTGGJG type=del size=612274 2023-10-05T11:35:07.940 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:07.936+0000 7f26f5634780 1 < completed delete operation key=QYQDXVIGZ7O8 tag=QVIZ63CMN32C type=del 2023-10-05T11:35:07.942 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:07.938+0000 7f26f5634780 1 > prepared part key=_multipart_QYQDXVIGZ7O8.2~VTH0LL01M3P3.0 size=845229 2023-10-05T11:35:07.942 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:07.938+0000 7f26f5634780 1 > prepared multipart upload key=QYQDXVIGZ7O8 upload=VTH0LL01M3P3 tag=5MX5KZ6EVVY2 type=write size=1893805 2023-10-05T11:35:07.943 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:07.940+0000 7f26f5634780 1 < completed part key=_multipart_AV0XKXX1IR4B.2~252R9FZ0HUCZ.0 size=1048576 2023-10-05T11:35:07.943 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:07.940+0000 7f26f5634780 1 < canceled part key=_multipart_AV0XKXX1IR4B.2~252R9FZ0HUCZ.1 size=380765 2023-10-05T11:35:07.945 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:07.942+0000 7f26f5634780 1 < canceled multipart upload key=AV0XKXX1IR4B upload=252R9FZ0HUCZ tag=RO65ZTOOVLWR type=write size=2477917 2023-10-05T11:35:07.949 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:07.945+0000 7f26f5634780 1 > prepared part key=_multipart_NV4Q36UOLX8A.2~3HHAMEG1UB7E.0 size=1048576 2023-10-05T11:35:07.950 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:07.947+0000 7f26f5634780 1 > prepared part key=_multipart_NV4Q36UOLX8A.2~3HHAMEG1UB7E.1 size=1048576 2023-10-05T11:35:07.951 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:07.948+0000 7f26f5634780 1 > prepared part key=_multipart_NV4Q36UOLX8A.2~3HHAMEG1UB7E.2 size=125423 2023-10-05T11:35:07.951 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:07.948+0000 7f26f5634780 1 > prepared multipart upload key=NV4Q36UOLX8A upload=3HHAMEG1UB7E tag=2EUK4JQ93YAW type=write size=3271151 2023-10-05T11:35:07.952 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:07.949+0000 7f26f5634780 1 < completed part key=_multipart_8IPCP77WVVZT.2~O4242YDWSTAR.0 size=649928 2023-10-05T11:35:07.955 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:07.951+0000 7f26f5634780 1 < completed multipart upload key=8IPCP77WVVZT upload=O4242YDWSTAR tag=3AT53S4FYW07 type=write size=1698504 2023-10-05T11:35:07.956 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:07.953+0000 7f26f5634780 1 > prepared operation key=WYN9BG66LA3K tag=RNFLMEX0PY6O type=del size=3124035 2023-10-05T11:35:07.958 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:07.954+0000 7f26f5634780 1 < completed write operation key=WTCWG1C1SF89 tag=AKTS758NE19C type=write size=14068 2023-10-05T11:35:07.960 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:07.957+0000 7f26f5634780 1 > prepared part key=_multipart_6DP3UJ4CW1MO.2~0576U6P9OJ62.0 size=1048576 2023-10-05T11:35:07.961 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:07.958+0000 7f26f5634780 1 > prepared part key=_multipart_6DP3UJ4CW1MO.2~0576U6P9OJ62.1 size=1048576 2023-10-05T11:35:07.963 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:07.959+0000 7f26f5634780 1 > prepared part key=_multipart_6DP3UJ4CW1MO.2~0576U6P9OJ62.2 size=407896 2023-10-05T11:35:07.963 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:07.959+0000 7f26f5634780 1 > prepared multipart upload key=6DP3UJ4CW1MO upload=0576U6P9OJ62 tag=CKQ2UIZNXL11 type=write size=3553624 2023-10-05T11:35:07.964 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:07.961+0000 7f26f5634780 1 < completed delete operation key=IKCNZOTVWOC6 tag=7LA18MB8ORPA type=del 2023-10-05T11:35:07.965 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:07.962+0000 7f26f5634780 1 > prepared operation key=9S0YW7PPSJ8G tag=T7SI91L3J551 type=del size=2216348 2023-10-05T11:35:07.966 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:07.963+0000 7f26f5634780 1 < completed write operation key=2U0NRDGDNUTA tag=RYPP4RI474RX type=write size=765778 2023-10-05T11:35:07.968 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:07.965+0000 7f26f5634780 1 > prepared part key=_multipart_9S0YW7PPSJ8G.2~JBMTW2UEKFAU.0 size=487453 2023-10-05T11:35:07.969 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:07.965+0000 7f26f5634780 1 > prepared multipart upload key=9S0YW7PPSJ8G upload=JBMTW2UEKFAU tag=C269RKSMZ0OM type=write size=1536029 2023-10-05T11:35:07.970 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:07.966+0000 7f26f5634780 1 < canceled operation key=9S0YW7PPSJ8G tag=9G1HM4CWQ8ZW type=del size=4029561 2023-10-05T11:35:07.971 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:07.968+0000 7f26f5634780 1 > prepared operation key=MEY4SZRHU9NZ tag=498OM0LFP6ZG type=del size=2928159 2023-10-05T11:35:07.972 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:07.969+0000 7f26f5634780 1 < completed delete operation key=WYN9BG66LA3K tag=YZPSS84YAHXP type=del 2023-10-05T11:35:07.974 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:07.970+0000 7f26f5634780 1 > prepared operation key=LLR5J3X15W5R tag=SHZBVDZFUJHC type=del size=3844488 2023-10-05T11:35:07.975 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:07.972+0000 7f26f5634780 1 < completed part key=_multipart_PC8WTJ8AYJ24.2~X1SN8I172FB9.0 size=1048576 2023-10-05T11:35:07.976 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:07.973+0000 7f26f5634780 1 < completed part key=_multipart_PC8WTJ8AYJ24.2~X1SN8I172FB9.1 size=973860 2023-10-05T11:35:07.979 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:07.975+0000 7f26f5634780 1 < completed multipart upload key=PC8WTJ8AYJ24 upload=X1SN8I172FB9 tag=FE8T4KDNBH7V type=write size=3071012 2023-10-05T11:35:07.980 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:07.977+0000 7f26f5634780 1 > prepared operation key=WYN9BG66LA3K tag=KFQFN2026AY3 type=del size=954937 2023-10-05T11:35:07.981 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:07.977+0000 7f26f5634780 1 < canceled part key=_multipart_PNV0Q6ZPLYV0.2~2HKTDTRKZ63I.0 size=1048576 2023-10-05T11:35:07.981 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:07.977+0000 7f26f5634780 1 < canceled part key=_multipart_PNV0Q6ZPLYV0.2~2HKTDTRKZ63I.1 size=476329 2023-10-05T11:35:07.983 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:07.979+0000 7f26f5634780 1 < canceled multipart upload key=PNV0Q6ZPLYV0 upload=2HKTDTRKZ63I tag=PU31M9EQUT95 type=write size=2573481 2023-10-05T11:35:07.985 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:07.982+0000 7f26f5634780 1 > prepared part key=_multipart_2D4PDQQT54ZA.2~5L9SMPH4HHNS.0 size=1048576 2023-10-05T11:35:07.986 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:07.983+0000 7f26f5634780 1 > prepared part key=_multipart_2D4PDQQT54ZA.2~5L9SMPH4HHNS.1 size=1048576 2023-10-05T11:35:07.987 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:07.984+0000 7f26f5634780 1 > prepared part key=_multipart_2D4PDQQT54ZA.2~5L9SMPH4HHNS.2 size=912225 2023-10-05T11:35:07.987 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:07.984+0000 7f26f5634780 1 > prepared multipart upload key=2D4PDQQT54ZA upload=5L9SMPH4HHNS tag=5HDQ91UQAMDD type=write size=4057953 2023-10-05T11:35:07.988 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:07.985+0000 7f26f5634780 1 < completed delete operation key=LLR5J3X15W5R tag=H61RB7KH0OZT type=del 2023-10-05T11:35:07.991 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:07.987+0000 7f26f5634780 1 > prepared part key=_multipart_IKCNZOTVWOC6.2~54LI8ZLC61RB.0 size=671416 2023-10-05T11:35:07.991 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:07.987+0000 7f26f5634780 1 > prepared multipart upload key=IKCNZOTVWOC6 upload=54LI8ZLC61RB tag=2NYV79WVWE4K type=write size=1719992 2023-10-05T11:35:07.992 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:07.989+0000 7f26f5634780 1 < completed delete operation key=IKCNZOTVWOC6 tag=2V073PDSNUV7 type=del 2023-10-05T11:35:07.993 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:07.990+0000 7f26f5634780 1 > prepared operation key=BU3KSHTINB36 tag=CFS80AKI1HL7 type=del size=2098550 2023-10-05T11:35:07.995 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:07.991+0000 7f26f5634780 1 < completed delete operation key=5OPHKTHXVN5U tag=R7Y0T8M0O7NF type=del 2023-10-05T11:35:07.997 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:07.994+0000 7f26f5634780 1 > prepared part key=_multipart_5V0Q651D4VN2.2~3XEI79LHFE5R.0 size=1048576 2023-10-05T11:35:07.998 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:07.995+0000 7f26f5634780 1 > prepared part key=_multipart_5V0Q651D4VN2.2~3XEI79LHFE5R.1 size=1048576 2023-10-05T11:35:07.999 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:07.996+0000 7f26f5634780 1 > prepared part key=_multipart_5V0Q651D4VN2.2~3XEI79LHFE5R.2 size=641000 2023-10-05T11:35:07.999 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:07.996+0000 7f26f5634780 1 > prepared multipart upload key=5V0Q651D4VN2 upload=3XEI79LHFE5R tag=5IKI1BS4I0SN type=write size=3786728 2023-10-05T11:35:08.000 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:07.997+0000 7f26f5634780 1 < completed part key=_multipart_PC8WTJ8AYJ24.2~D46FJX0ESDKY.0 size=1048576 2023-10-05T11:35:08.001 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:07.998+0000 7f26f5634780 1 < completed part key=_multipart_PC8WTJ8AYJ24.2~D46FJX0ESDKY.1 size=1011892 2023-10-05T11:35:08.004 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.000+0000 7f26f5634780 1 < completed multipart upload key=PC8WTJ8AYJ24 upload=D46FJX0ESDKY tag=W508J4SZFXG1 type=write size=3109044 2023-10-05T11:35:08.005 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.002+0000 7f26f5634780 1 > prepared operation key=0PWYKC7S6YJ4 tag=A3YOPJ386S6S type=del size=1744492 2023-10-05T11:35:08.006 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.003+0000 7f26f5634780 1 < completed delete operation key=4D3H60UTIXH3 tag=EY93UWMVHAT9 type=del 2023-10-05T11:35:08.009 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.005+0000 7f26f5634780 1 > prepared part key=_multipart_LLR5J3X15W5R.2~EZYR80FXC2MW.0 size=1048576 2023-10-05T11:35:08.010 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.006+0000 7f26f5634780 1 > prepared part key=_multipart_LLR5J3X15W5R.2~EZYR80FXC2MW.1 size=1048576 2023-10-05T11:35:08.011 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.007+0000 7f26f5634780 1 > prepared part key=_multipart_LLR5J3X15W5R.2~EZYR80FXC2MW.2 size=607105 2023-10-05T11:35:08.011 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.007+0000 7f26f5634780 1 > prepared multipart upload key=LLR5J3X15W5R upload=EZYR80FXC2MW tag=ZWO0EBFLI2C4 type=write size=3752833 2023-10-05T11:35:08.012 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.009+0000 7f26f5634780 1 < completed delete operation key=FOMNIIY47UUM tag=LY69SWRTGGJG type=del 2023-10-05T11:35:08.013 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.010+0000 7f26f5634780 1 > prepared operation key=IC7T3ZK81WQS tag=50JHQH452BFC type=del size=2066176 2023-10-05T11:35:08.015 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.011+0000 7f26f5634780 1 < completed part key=_multipart_QYQDXVIGZ7O8.2~VTH0LL01M3P3.0 size=845229 2023-10-05T11:35:08.017 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.013+0000 7f26f5634780 1 < completed multipart upload key=QYQDXVIGZ7O8 upload=VTH0LL01M3P3 tag=5MX5KZ6EVVY2 type=write size=1893805 2023-10-05T11:35:08.018 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.014+0000 7f26f5634780 1 > prepared operation key=W2GWVGX42QLD tag=Y1EFETRD3JPI type=write size=829401 2023-10-05T11:35:08.019 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.016+0000 7f26f5634780 1 < completed part key=_multipart_NV4Q36UOLX8A.2~3HHAMEG1UB7E.0 size=1048576 2023-10-05T11:35:08.020 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.017+0000 7f26f5634780 1 < completed part key=_multipart_NV4Q36UOLX8A.2~3HHAMEG1UB7E.1 size=1048576 2023-10-05T11:35:08.021 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.018+0000 7f26f5634780 1 < completed part key=_multipart_NV4Q36UOLX8A.2~3HHAMEG1UB7E.2 size=125423 2023-10-05T11:35:08.023 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.020+0000 7f26f5634780 1 < completed multipart upload key=NV4Q36UOLX8A upload=3HHAMEG1UB7E tag=2EUK4JQ93YAW type=write size=3271151 2023-10-05T11:35:08.024 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.021+0000 7f26f5634780 1 > prepared operation key=QYQDXVIGZ7O8 tag=OVYM50B7Q9WD type=del size=2695050 2023-10-05T11:35:08.027 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.023+0000 7f26f5634780 1 < suggested remove operation key=WYN9BG66LA3K tag=RNFLMEX0PY6O type=del 2023-10-05T11:35:08.028 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.024+0000 7f26f5634780 1 > prepared operation key=IKCNZOTVWOC6 tag=SHWDHM44YDWC type=del size=2088972 2023-10-05T11:35:08.029 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.026+0000 7f26f5634780 1 < completed part key=_multipart_6DP3UJ4CW1MO.2~0576U6P9OJ62.0 size=1048576 2023-10-05T11:35:08.030 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.027+0000 7f26f5634780 1 < completed part key=_multipart_6DP3UJ4CW1MO.2~0576U6P9OJ62.1 size=1048576 2023-10-05T11:35:08.031 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.028+0000 7f26f5634780 1 < completed part key=_multipart_6DP3UJ4CW1MO.2~0576U6P9OJ62.2 size=407896 2023-10-05T11:35:08.033 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.030+0000 7f26f5634780 1 < completed multipart upload key=6DP3UJ4CW1MO upload=0576U6P9OJ62 tag=CKQ2UIZNXL11 type=write size=3553624 2023-10-05T11:35:08.035 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.031+0000 7f26f5634780 1 > prepared operation key=PC8WTJ8AYJ24 tag=DNFC8KVKKTJZ type=del size=1992758 2023-10-05T11:35:08.036 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.032+0000 7f26f5634780 1 < completed delete operation key=9S0YW7PPSJ8G tag=T7SI91L3J551 type=del 2023-10-05T11:35:08.037 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.034+0000 7f26f5634780 1 > prepared operation key=2D4PDQQT54ZA tag=9OVG41OGRBR4 type=del size=492352 2023-10-05T11:35:08.037 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.034+0000 7f26f5634780 1 < canceled part key=_multipart_9S0YW7PPSJ8G.2~JBMTW2UEKFAU.0 size=487453 2023-10-05T11:35:08.040 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.036+0000 7f26f5634780 1 < canceled multipart upload key=9S0YW7PPSJ8G upload=JBMTW2UEKFAU tag=C269RKSMZ0OM type=write size=1536029 2023-10-05T11:35:08.041 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.038+0000 7f26f5634780 1 > prepared operation key=NV4Q36UOLX8A tag=XD0920FN2S41 type=del size=2929850 2023-10-05T11:35:08.043 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.040+0000 7f26f5634780 1 < suggested remove operation key=MEY4SZRHU9NZ tag=498OM0LFP6ZG type=del 2023-10-05T11:35:08.044 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.041+0000 7f26f5634780 1 > prepared operation key=PC8WTJ8AYJ24 tag=4AVWVR5Q4O23 type=del size=685023 2023-10-05T11:35:08.046 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.042+0000 7f26f5634780 1 < completed delete operation key=LLR5J3X15W5R tag=SHZBVDZFUJHC type=del 2023-10-05T11:35:08.047 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.044+0000 7f26f5634780 1 > prepared operation key=W2GWVGX42QLD tag=DOYU0N37ZMWS type=del size=848326 2023-10-05T11:35:08.048 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.045+0000 7f26f5634780 -1 < failed to complete operation key=WYN9BG66LA3K tag=KFQFN2026AY3 type=del size=954937: (22) Invalid argument 2023-10-05T11:35:08.050 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.047+0000 7f26f5634780 1 > prepared part key=_multipart_8IPCP77WVVZT.2~NR2X39P91KG1.0 size=1048576 2023-10-05T11:35:08.051 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.048+0000 7f26f5634780 1 > prepared part key=_multipart_8IPCP77WVVZT.2~NR2X39P91KG1.1 size=1048576 2023-10-05T11:35:08.052 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.049+0000 7f26f5634780 1 > prepared part key=_multipart_8IPCP77WVVZT.2~NR2X39P91KG1.2 size=817046 2023-10-05T11:35:08.052 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.049+0000 7f26f5634780 1 > prepared multipart upload key=8IPCP77WVVZT upload=NR2X39P91KG1 tag=LG6ZXJHCQP3K type=write size=3962774 2023-10-05T11:35:08.054 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.050+0000 7f26f5634780 1 < completed part key=_multipart_2D4PDQQT54ZA.2~5L9SMPH4HHNS.0 size=1048576 2023-10-05T11:35:08.054 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.050+0000 7f26f5634780 1 < canceled part key=_multipart_2D4PDQQT54ZA.2~5L9SMPH4HHNS.1 size=1048576 2023-10-05T11:35:08.055 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.051+0000 7f26f5634780 1 < completed part key=_multipart_2D4PDQQT54ZA.2~5L9SMPH4HHNS.2 size=912225 2023-10-05T11:35:08.057 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.053+0000 7f26f5634780 1 < canceled multipart upload key=2D4PDQQT54ZA upload=5L9SMPH4HHNS tag=5HDQ91UQAMDD type=write size=4057953 2023-10-05T11:35:08.058 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.055+0000 7f26f5634780 1 > prepared operation key=0PWYKC7S6YJ4 tag=L3YJVV4CAYX7 type=del size=1990174 2023-10-05T11:35:08.059 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.056+0000 7f26f5634780 1 < completed part key=_multipart_IKCNZOTVWOC6.2~54LI8ZLC61RB.0 size=671416 2023-10-05T11:35:08.061 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.058+0000 7f26f5634780 1 < completed multipart upload key=IKCNZOTVWOC6 upload=54LI8ZLC61RB tag=2NYV79WVWE4K type=write size=1719992 2023-10-05T11:35:08.063 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.059+0000 7f26f5634780 1 > prepared operation key=IC7T3ZK81WQS tag=BH3FQSRFD7DD type=del size=1236751 2023-10-05T11:35:08.065 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.062+0000 7f26f5634780 1 < suggested update operation key=BU3KSHTINB36 tag=CFS80AKI1HL7 type=del size=2098550 2023-10-05T11:35:08.067 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.064+0000 7f26f5634780 1 > prepared operation key=S3DKYDFT4IO2 tag=PC1N30D3Q7Z3 type=del size=1148149 2023-10-05T11:35:08.069 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.065+0000 7f26f5634780 1 < completed part key=_multipart_5V0Q651D4VN2.2~3XEI79LHFE5R.0 size=1048576 2023-10-05T11:35:08.069 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.065+0000 7f26f5634780 1 < canceled part key=_multipart_5V0Q651D4VN2.2~3XEI79LHFE5R.1 size=1048576 2023-10-05T11:35:08.071 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.068+0000 7f26f5634780 1 < completed part key=_multipart_5V0Q651D4VN2.2~3XEI79LHFE5R.2 size=641000 2023-10-05T11:35:08.073 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.070+0000 7f26f5634780 1 < canceled multipart upload key=5V0Q651D4VN2 upload=3XEI79LHFE5R tag=5IKI1BS4I0SN type=write size=3786728 2023-10-05T11:35:08.074 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.071+0000 7f26f5634780 1 > prepared operation key=PC8WTJ8AYJ24 tag=252BLNNIJ3KA type=del size=521912 2023-10-05T11:35:08.077 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.074+0000 7f26f5634780 1 < suggested remove operation key=0PWYKC7S6YJ4 tag=A3YOPJ386S6S type=del 2023-10-05T11:35:08.079 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.076+0000 7f26f5634780 1 > prepared part key=_multipart_AV0XKXX1IR4B.2~N0E22HK14AGH.0 size=752055 2023-10-05T11:35:08.079 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.076+0000 7f26f5634780 1 > prepared multipart upload key=AV0XKXX1IR4B upload=N0E22HK14AGH tag=9KFMS2CF0CP0 type=write size=1800631 2023-10-05T11:35:08.081 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.077+0000 7f26f5634780 1 < completed part key=_multipart_LLR5J3X15W5R.2~EZYR80FXC2MW.0 size=1048576 2023-10-05T11:35:08.081 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.077+0000 7f26f5634780 1 < canceled part key=_multipart_LLR5J3X15W5R.2~EZYR80FXC2MW.1 size=1048576 2023-10-05T11:35:08.082 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.078+0000 7f26f5634780 1 < completed part key=_multipart_LLR5J3X15W5R.2~EZYR80FXC2MW.2 size=607105 2023-10-05T11:35:08.084 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.080+0000 7f26f5634780 1 < canceled multipart upload key=LLR5J3X15W5R upload=EZYR80FXC2MW tag=ZWO0EBFLI2C4 type=write size=3752833 2023-10-05T11:35:08.086 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.083+0000 7f26f5634780 1 > prepared part key=_multipart_BU3KSHTINB36.2~NGYBA38OWCEL.0 size=1048576 2023-10-05T11:35:08.087 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.084+0000 7f26f5634780 1 > prepared part key=_multipart_BU3KSHTINB36.2~NGYBA38OWCEL.1 size=559538 2023-10-05T11:35:08.087 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.084+0000 7f26f5634780 1 > prepared multipart upload key=BU3KSHTINB36 upload=NGYBA38OWCEL tag=C4OCUNW57A0C type=write size=2656690 2023-10-05T11:35:08.089 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.085+0000 7f26f5634780 1 < completed delete operation key=IC7T3ZK81WQS tag=50JHQH452BFC type=del 2023-10-05T11:35:08.090 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.087+0000 7f26f5634780 1 > prepared operation key=7W9LL5HSU3BG tag=SWMR5GJPUSS9 type=write size=612706 2023-10-05T11:35:08.091 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.088+0000 7f26f5634780 1 < completed write operation key=W2GWVGX42QLD tag=Y1EFETRD3JPI type=write size=829401 2023-10-05T11:35:08.092 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.089+0000 7f26f5634780 1 > prepared operation key=4IBQJLJR7LD8 tag=VY85Y3BSKJJZ type=del size=3481656 2023-10-05T11:35:08.094 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.090+0000 7f26f5634780 1 < canceled operation key=QYQDXVIGZ7O8 tag=OVYM50B7Q9WD type=del size=2695050 2023-10-05T11:35:08.096 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.092+0000 7f26f5634780 1 > prepared part key=_multipart_FOMNIIY47UUM.2~VZ2HDBX7U7AO.0 size=1048576 2023-10-05T11:35:08.096 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.093+0000 7f26f5634780 1 > prepared part key=_multipart_FOMNIIY47UUM.2~VZ2HDBX7U7AO.1 size=298092 2023-10-05T11:35:08.097 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.093+0000 7f26f5634780 1 > prepared multipart upload key=FOMNIIY47UUM upload=VZ2HDBX7U7AO tag=0G9DLLDONIRK type=write size=2395244 2023-10-05T11:35:08.099 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.096+0000 7f26f5634780 1 < suggested remove operation key=IKCNZOTVWOC6 tag=SHWDHM44YDWC type=del 2023-10-05T11:35:08.100 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.097+0000 7f26f5634780 1 > prepared operation key=5OPHKTHXVN5U tag=232R0DXSMFN8 type=del size=2144506 2023-10-05T11:35:08.102 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.099+0000 7f26f5634780 1 < completed delete operation key=PC8WTJ8AYJ24 tag=DNFC8KVKKTJZ type=del 2023-10-05T11:35:08.104 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.101+0000 7f26f5634780 1 > prepared part key=_multipart_5V0Q651D4VN2.2~4398B7HAQWVF.0 size=1048576 2023-10-05T11:35:08.105 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.102+0000 7f26f5634780 1 > prepared part key=_multipart_5V0Q651D4VN2.2~4398B7HAQWVF.1 size=1048576 2023-10-05T11:35:08.106 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.103+0000 7f26f5634780 1 > prepared part key=_multipart_5V0Q651D4VN2.2~4398B7HAQWVF.2 size=886287 2023-10-05T11:35:08.106 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.103+0000 7f26f5634780 1 > prepared multipart upload key=5V0Q651D4VN2 upload=4398B7HAQWVF tag=7FKZYQ7LOB2I type=write size=4032015 2023-10-05T11:35:08.109 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.105+0000 7f26f5634780 1 < suggested update operation key=2D4PDQQT54ZA tag=9OVG41OGRBR4 type=del size=492352 2023-10-05T11:35:08.109 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.106+0000 7f26f5634780 1 > prepared operation key=5OPHKTHXVN5U tag=59B75MHVHHC1 type=write size=644941 2023-10-05T11:35:08.112 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.108+0000 7f26f5634780 1 < suggested remove operation key=NV4Q36UOLX8A tag=XD0920FN2S41 type=del 2023-10-05T11:35:08.114 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.111+0000 7f26f5634780 1 > prepared part key=_multipart_4IBQJLJR7LD8.2~Q4JJK8ZYPPI4.0 size=1048576 2023-10-05T11:35:08.115 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.112+0000 7f26f5634780 1 > prepared part key=_multipart_4IBQJLJR7LD8.2~Q4JJK8ZYPPI4.1 size=1048576 2023-10-05T11:35:08.116 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.113+0000 7f26f5634780 1 > prepared part key=_multipart_4IBQJLJR7LD8.2~Q4JJK8ZYPPI4.2 size=32891 2023-10-05T11:35:08.116 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.113+0000 7f26f5634780 1 > prepared multipart upload key=4IBQJLJR7LD8 upload=Q4JJK8ZYPPI4 tag=01R86O6MD1S3 type=write size=3178619 2023-10-05T11:35:08.119 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.115+0000 7f26f5634780 1 < suggested update operation key=PC8WTJ8AYJ24 tag=4AVWVR5Q4O23 type=del size=685023 2023-10-05T11:35:08.120 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.116+0000 7f26f5634780 1 > prepared operation key=BTZUVE8R96XT tag=G7WPEUSG0F2N type=del size=3020339 2023-10-05T11:35:08.122 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.119+0000 7f26f5634780 1 < suggested update operation key=W2GWVGX42QLD tag=DOYU0N37ZMWS type=del size=848326 2023-10-05T11:35:08.123 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.120+0000 7f26f5634780 1 > prepared operation key=NV4Q36UOLX8A tag=T4U80BHZWXJY type=del size=1165839 2023-10-05T11:35:08.125 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.121+0000 7f26f5634780 1 < completed part key=_multipart_8IPCP77WVVZT.2~NR2X39P91KG1.0 size=1048576 2023-10-05T11:35:08.126 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.122+0000 7f26f5634780 1 < completed part key=_multipart_8IPCP77WVVZT.2~NR2X39P91KG1.1 size=1048576 2023-10-05T11:35:08.127 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.123+0000 7f26f5634780 1 < completed part key=_multipart_8IPCP77WVVZT.2~NR2X39P91KG1.2 size=817046 2023-10-05T11:35:08.128 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.125+0000 7f26f5634780 1 < completed multipart upload key=8IPCP77WVVZT upload=NR2X39P91KG1 tag=LG6ZXJHCQP3K type=write size=3962774 2023-10-05T11:35:08.131 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.127+0000 7f26f5634780 1 > prepared part key=_multipart_5V0Q651D4VN2.2~43BPASOZA262.0 size=658176 2023-10-05T11:35:08.131 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.127+0000 7f26f5634780 1 > prepared multipart upload key=5V0Q651D4VN2 upload=43BPASOZA262 tag=59XYD8L0U023 type=write size=1706752 2023-10-05T11:35:08.132 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.128+0000 7f26f5634780 -1 < failed to complete operation key=0PWYKC7S6YJ4 tag=L3YJVV4CAYX7 type=del size=1990174: (22) Invalid argument 2023-10-05T11:35:08.133 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.130+0000 7f26f5634780 1 > prepared operation key=QYQDXVIGZ7O8 tag=RALVUE1324RB type=del size=3601364 2023-10-05T11:35:08.134 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.131+0000 7f26f5634780 1 < completed delete operation key=IC7T3ZK81WQS tag=BH3FQSRFD7DD type=del 2023-10-05T11:35:08.136 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.132+0000 7f26f5634780 1 > prepared operation key=U6172JUYW7J6 tag=R23PWDBQFJU5 type=del size=3890545 2023-10-05T11:35:08.136 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.133+0000 7f26f5634780 1 < completed delete operation key=S3DKYDFT4IO2 tag=PC1N30D3Q7Z3 type=del 2023-10-05T11:35:08.138 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.134+0000 7f26f5634780 1 > prepared operation key=8IPCP77WVVZT tag=MXXCF371N4V6 type=del size=3351026 2023-10-05T11:35:08.139 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.135+0000 7f26f5634780 -1 < failed to complete operation key=PC8WTJ8AYJ24 tag=252BLNNIJ3KA type=del size=521912: (22) Invalid argument 2023-10-05T11:35:08.140 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.137+0000 7f26f5634780 1 > prepared operation key=VJTFYDETLSFD tag=OE0D2KNCO7FA type=write size=329125 2023-10-05T11:35:08.141 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.138+0000 7f26f5634780 1 < completed part key=_multipart_AV0XKXX1IR4B.2~N0E22HK14AGH.0 size=752055 2023-10-05T11:35:08.143 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.140+0000 7f26f5634780 1 < completed multipart upload key=AV0XKXX1IR4B upload=N0E22HK14AGH tag=9KFMS2CF0CP0 type=write size=1800631 2023-10-05T11:35:08.144 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.141+0000 7f26f5634780 1 > prepared operation key=BU3KSHTINB36 tag=BCUPZ4OAI3WS type=del size=2564385 2023-10-05T11:35:08.146 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.142+0000 7f26f5634780 1 < completed part key=_multipart_BU3KSHTINB36.2~NGYBA38OWCEL.0 size=1048576 2023-10-05T11:35:08.147 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.143+0000 7f26f5634780 1 < completed part key=_multipart_BU3KSHTINB36.2~NGYBA38OWCEL.1 size=559538 2023-10-05T11:35:08.148 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.145+0000 7f26f5634780 1 < completed multipart upload key=BU3KSHTINB36 upload=NGYBA38OWCEL tag=C4OCUNW57A0C type=write size=2656690 2023-10-05T11:35:08.150 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.146+0000 7f26f5634780 1 > prepared operation key=761J2C7GHWU5 tag=WLD49AJ09CQ6 type=write size=65135 2023-10-05T11:35:08.151 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.148+0000 7f26f5634780 1 < completed write operation key=7W9LL5HSU3BG tag=SWMR5GJPUSS9 type=write size=612706 2023-10-05T11:35:08.152 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.149+0000 7f26f5634780 1 > prepared operation key=8IPCP77WVVZT tag=MT9JBPK1SO9L type=del size=2041311 2023-10-05T11:35:08.153 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.150+0000 7f26f5634780 1 < completed delete operation key=4IBQJLJR7LD8 tag=VY85Y3BSKJJZ type=del 2023-10-05T11:35:08.154 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.151+0000 7f26f5634780 1 > prepared operation key=FOMNIIY47UUM tag=ASGL6JU0KH03 type=del size=936516 2023-10-05T11:35:08.156 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.152+0000 7f26f5634780 1 < completed part key=_multipart_FOMNIIY47UUM.2~VZ2HDBX7U7AO.0 size=1048576 2023-10-05T11:35:08.157 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.153+0000 7f26f5634780 1 < completed part key=_multipart_FOMNIIY47UUM.2~VZ2HDBX7U7AO.1 size=298092 2023-10-05T11:35:08.159 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.155+0000 7f26f5634780 1 < completed multipart upload key=FOMNIIY47UUM upload=VZ2HDBX7U7AO tag=0G9DLLDONIRK type=write size=2395244 2023-10-05T11:35:08.160 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.156+0000 7f26f5634780 1 > prepared operation key=J5EIH25Y471T tag=3H69VQMS3HBN type=write size=223770 2023-10-05T11:35:08.161 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.158+0000 7f26f5634780 1 < completed delete operation key=5OPHKTHXVN5U tag=232R0DXSMFN8 type=del 2023-10-05T11:35:08.162 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.159+0000 7f26f5634780 1 > prepared operation key=W2GWVGX42QLD tag=XAR0L9JM95X0 type=del size=1081013 2023-10-05T11:35:08.163 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.160+0000 7f26f5634780 1 < completed part key=_multipart_5V0Q651D4VN2.2~4398B7HAQWVF.0 size=1048576 2023-10-05T11:35:08.165 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.161+0000 7f26f5634780 1 < completed part key=_multipart_5V0Q651D4VN2.2~4398B7HAQWVF.1 size=1048576 2023-10-05T11:35:08.165 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.162+0000 7f26f5634780 1 < completed part key=_multipart_5V0Q651D4VN2.2~4398B7HAQWVF.2 size=886287 2023-10-05T11:35:08.168 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.164+0000 7f26f5634780 1 < completed multipart upload key=5V0Q651D4VN2 upload=4398B7HAQWVF tag=7FKZYQ7LOB2I type=write size=4032015 2023-10-05T11:35:08.169 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.166+0000 7f26f5634780 1 > prepared operation key=FOMNIIY47UUM tag=VQJ1VQWUL5QO type=del size=2149361 2023-10-05T11:35:08.170 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.167+0000 7f26f5634780 1 < completed write operation key=5OPHKTHXVN5U tag=59B75MHVHHC1 type=write size=644941 2023-10-05T11:35:08.173 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.170+0000 7f26f5634780 1 > prepared operation key=VJTFYDETLSFD tag=VTDRXOB62AB0 type=del size=2632473 2023-10-05T11:35:08.174 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.171+0000 7f26f5634780 1 < completed part key=_multipart_4IBQJLJR7LD8.2~Q4JJK8ZYPPI4.0 size=1048576 2023-10-05T11:35:08.175 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.172+0000 7f26f5634780 1 < completed part key=_multipart_4IBQJLJR7LD8.2~Q4JJK8ZYPPI4.1 size=1048576 2023-10-05T11:35:08.176 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.173+0000 7f26f5634780 1 < completed part key=_multipart_4IBQJLJR7LD8.2~Q4JJK8ZYPPI4.2 size=32891 2023-10-05T11:35:08.178 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.175+0000 7f26f5634780 1 < completed multipart upload key=4IBQJLJR7LD8 upload=Q4JJK8ZYPPI4 tag=01R86O6MD1S3 type=write size=3178619 2023-10-05T11:35:08.181 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.177+0000 7f26f5634780 1 > prepared part key=_multipart_PC8WTJ8AYJ24.2~YXTHQGT1MVSQ.0 size=1048576 2023-10-05T11:35:08.182 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.178+0000 7f26f5634780 1 > prepared part key=_multipart_PC8WTJ8AYJ24.2~YXTHQGT1MVSQ.1 size=310627 2023-10-05T11:35:08.182 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.178+0000 7f26f5634780 1 > prepared multipart upload key=PC8WTJ8AYJ24 upload=YXTHQGT1MVSQ tag=MWC686C20S4G type=write size=2407779 2023-10-05T11:35:08.183 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.179+0000 7f26f5634780 1 < completed delete operation key=BTZUVE8R96XT tag=G7WPEUSG0F2N type=del 2023-10-05T11:35:08.185 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.181+0000 7f26f5634780 1 > prepared operation key=2U0NRDGDNUTA tag=9DW6ZB4O4BWI type=write size=332493 2023-10-05T11:35:08.187 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.184+0000 7f26f5634780 1 < completed delete operation key=NV4Q36UOLX8A tag=T4U80BHZWXJY type=del 2023-10-05T11:35:08.190 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.187+0000 7f26f5634780 1 > prepared part key=_multipart_VJTFYDETLSFD.2~GDKJPM4OA85O.0 size=1048576 2023-10-05T11:35:08.191 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.188+0000 7f26f5634780 1 > prepared part key=_multipart_VJTFYDETLSFD.2~GDKJPM4OA85O.1 size=993133 2023-10-05T11:35:08.191 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.188+0000 7f26f5634780 1 > prepared multipart upload key=VJTFYDETLSFD upload=GDKJPM4OA85O tag=L603VLUFF4ZP type=write size=3090285 2023-10-05T11:35:08.193 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.189+0000 7f26f5634780 1 < completed part key=_multipart_5V0Q651D4VN2.2~43BPASOZA262.0 size=658176 2023-10-05T11:35:08.195 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.192+0000 7f26f5634780 1 < completed multipart upload key=5V0Q651D4VN2 upload=43BPASOZA262 tag=59XYD8L0U023 type=write size=1706752 2023-10-05T11:35:08.197 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.193+0000 7f26f5634780 1 > prepared operation key=QYQDXVIGZ7O8 tag=HPSS4HMF66A8 type=del size=1966621 2023-10-05T11:35:08.198 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.195+0000 7f26f5634780 1 < canceled operation key=QYQDXVIGZ7O8 tag=RALVUE1324RB type=del size=3601364 2023-10-05T11:35:08.200 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.197+0000 7f26f5634780 1 > prepared part key=_multipart_MEY4SZRHU9NZ.2~PKA9J1TD71K4.0 size=842483 2023-10-05T11:35:08.200 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.197+0000 7f26f5634780 1 > prepared multipart upload key=MEY4SZRHU9NZ upload=PKA9J1TD71K4 tag=N1GP17QOT43T type=write size=1891059 2023-10-05T11:35:08.202 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.198+0000 7f26f5634780 1 < completed delete operation key=U6172JUYW7J6 tag=R23PWDBQFJU5 type=del 2023-10-05T11:35:08.203 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.200+0000 7f26f5634780 1 > prepared operation key=IC7T3ZK81WQS tag=64A76Q2JE7AC type=del size=2207472 2023-10-05T11:35:08.206 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.202+0000 7f26f5634780 1 < suggested remove operation key=8IPCP77WVVZT tag=MXXCF371N4V6 type=del 2023-10-05T11:35:08.208 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.204+0000 7f26f5634780 1 > prepared part key=_multipart_2U0NRDGDNUTA.2~XB4QGGNGLDWO.0 size=1048576 2023-10-05T11:35:08.209 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.205+0000 7f26f5634780 1 > prepared part key=_multipart_2U0NRDGDNUTA.2~XB4QGGNGLDWO.1 size=498045 2023-10-05T11:35:08.209 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.205+0000 7f26f5634780 1 > prepared multipart upload key=2U0NRDGDNUTA upload=XB4QGGNGLDWO tag=0Y03LM26GHMT type=write size=2595197 2023-10-05T11:35:08.210 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.207+0000 7f26f5634780 1 < completed write operation key=VJTFYDETLSFD tag=OE0D2KNCO7FA type=write size=329125 2023-10-05T11:35:08.212 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.209+0000 7f26f5634780 1 > prepared part key=_multipart_QYQDXVIGZ7O8.2~X2FA71Q3ZGGR.0 size=1048576 2023-10-05T11:35:08.213 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.210+0000 7f26f5634780 1 > prepared part key=_multipart_QYQDXVIGZ7O8.2~X2FA71Q3ZGGR.1 size=898809 2023-10-05T11:35:08.213 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.210+0000 7f26f5634780 1 > prepared multipart upload key=QYQDXVIGZ7O8 upload=X2FA71Q3ZGGR tag=F26G2HKQ22AR type=write size=2995961 2023-10-05T11:35:08.214 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.211+0000 7f26f5634780 1 < completed delete operation key=BU3KSHTINB36 tag=BCUPZ4OAI3WS type=del 2023-10-05T11:35:08.217 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.213+0000 7f26f5634780 1 > prepared part key=_multipart_J5EIH25Y471T.2~EY21LS0UKS16.0 size=1048576 2023-10-05T11:35:08.218 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.214+0000 7f26f5634780 1 > prepared part key=_multipart_J5EIH25Y471T.2~EY21LS0UKS16.1 size=199505 2023-10-05T11:35:08.218 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.214+0000 7f26f5634780 1 > prepared multipart upload key=J5EIH25Y471T upload=EY21LS0UKS16 tag=TYMWZXFKIE1S type=write size=2296657 2023-10-05T11:35:08.219 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.216+0000 7f26f5634780 1 < completed write operation key=761J2C7GHWU5 tag=WLD49AJ09CQ6 type=write size=65135 2023-10-05T11:35:08.221 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.218+0000 7f26f5634780 1 > prepared part key=_multipart_PC8WTJ8AYJ24.2~Z9VVEZF508XS.0 size=1048576 2023-10-05T11:35:08.222 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.219+0000 7f26f5634780 1 > prepared part key=_multipart_PC8WTJ8AYJ24.2~Z9VVEZF508XS.1 size=1048576 2023-10-05T11:35:08.223 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.220+0000 7f26f5634780 1 > prepared part key=_multipart_PC8WTJ8AYJ24.2~Z9VVEZF508XS.2 size=67332 2023-10-05T11:35:08.223 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.220+0000 7f26f5634780 1 > prepared multipart upload key=PC8WTJ8AYJ24 upload=Z9VVEZF508XS tag=TRTH4TEQ5IWU type=write size=3213060 2023-10-05T11:35:08.224 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.221+0000 7f26f5634780 -1 < failed to complete operation key=8IPCP77WVVZT tag=MT9JBPK1SO9L type=del size=2041311: (22) Invalid argument 2023-10-05T11:35:08.227 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.223+0000 7f26f5634780 1 > prepared part key=_multipart_WYN9BG66LA3K.2~922NP9U4MCQE.0 size=1048576 2023-10-05T11:35:08.228 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.224+0000 7f26f5634780 1 > prepared part key=_multipart_WYN9BG66LA3K.2~922NP9U4MCQE.1 size=1048576 2023-10-05T11:35:08.229 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.226+0000 7f26f5634780 1 > prepared part key=_multipart_WYN9BG66LA3K.2~922NP9U4MCQE.2 size=48892 2023-10-05T11:35:08.229 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.226+0000 7f26f5634780 1 > prepared multipart upload key=WYN9BG66LA3K upload=922NP9U4MCQE tag=XQ4JLOQFPTP1 type=write size=3194620 2023-10-05T11:35:08.232 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.228+0000 7f26f5634780 1 < suggested update operation key=FOMNIIY47UUM tag=ASGL6JU0KH03 type=del size=936516 2023-10-05T11:35:08.233 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.230+0000 7f26f5634780 1 > prepared operation key=J5EIH25Y471T tag=HTCNXE8NSPOG type=del size=169964 2023-10-05T11:35:08.234 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.231+0000 7f26f5634780 1 < completed write operation key=J5EIH25Y471T tag=3H69VQMS3HBN type=write size=223770 2023-10-05T11:35:08.235 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.232+0000 7f26f5634780 1 > prepared operation key=6DP3UJ4CW1MO tag=60TZX49LQQO5 type=del size=3314761 2023-10-05T11:35:08.237 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.233+0000 7f26f5634780 1 < completed delete operation key=W2GWVGX42QLD tag=XAR0L9JM95X0 type=del 2023-10-05T11:35:08.239 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.235+0000 7f26f5634780 1 > prepared part key=_multipart_NV4Q36UOLX8A.2~FEFW2ZXTF5V6.0 size=1048576 2023-10-05T11:35:08.240 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.236+0000 7f26f5634780 1 > prepared part key=_multipart_NV4Q36UOLX8A.2~FEFW2ZXTF5V6.1 size=776464 2023-10-05T11:35:08.240 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.236+0000 7f26f5634780 1 > prepared multipart upload key=NV4Q36UOLX8A upload=FEFW2ZXTF5V6 tag=N79TGKPWQUBH type=write size=2873616 2023-10-05T11:35:08.241 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.237+0000 7f26f5634780 -1 < failed to complete operation key=FOMNIIY47UUM tag=VQJ1VQWUL5QO type=del size=2149361: (22) Invalid argument 2023-10-05T11:35:08.242 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.239+0000 7f26f5634780 1 > prepared operation key=WYN9BG66LA3K tag=AW4QG0Y8R8ED type=del size=1122793 2023-10-05T11:35:08.244 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.240+0000 7f26f5634780 1 < completed delete operation key=VJTFYDETLSFD tag=VTDRXOB62AB0 type=del 2023-10-05T11:35:08.245 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.241+0000 7f26f5634780 1 > prepared operation key=761J2C7GHWU5 tag=XG012U6S2W3V type=del size=1043427 2023-10-05T11:35:08.246 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.243+0000 7f26f5634780 1 < completed part key=_multipart_PC8WTJ8AYJ24.2~YXTHQGT1MVSQ.0 size=1048576 2023-10-05T11:35:08.247 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.244+0000 7f26f5634780 1 < completed part key=_multipart_PC8WTJ8AYJ24.2~YXTHQGT1MVSQ.1 size=310627 2023-10-05T11:35:08.249 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.246+0000 7f26f5634780 1 < completed multipart upload key=PC8WTJ8AYJ24 upload=YXTHQGT1MVSQ tag=MWC686C20S4G type=write size=2407779 2023-10-05T11:35:08.251 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.248+0000 7f26f5634780 1 > prepared part key=_multipart_LLR5J3X15W5R.2~AXQH7BQ7T1FC.0 size=55225 2023-10-05T11:35:08.251 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.248+0000 7f26f5634780 1 > prepared multipart upload key=LLR5J3X15W5R upload=AXQH7BQ7T1FC tag=0ZAX4JDJJNP5 type=write size=1103801 2023-10-05T11:35:08.253 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.249+0000 7f26f5634780 1 < completed write operation key=2U0NRDGDNUTA tag=9DW6ZB4O4BWI type=write size=332493 2023-10-05T11:35:08.254 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.251+0000 7f26f5634780 1 > prepared operation key=8IPCP77WVVZT tag=5M43BMDGFJ3P type=del size=1593172 2023-10-05T11:35:08.255 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.252+0000 7f26f5634780 1 < completed part key=_multipart_VJTFYDETLSFD.2~GDKJPM4OA85O.0 size=1048576 2023-10-05T11:35:08.255 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.252+0000 7f26f5634780 1 < canceled part key=_multipart_VJTFYDETLSFD.2~GDKJPM4OA85O.1 size=993133 2023-10-05T11:35:08.257 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.254+0000 7f26f5634780 1 < canceled multipart upload key=VJTFYDETLSFD upload=GDKJPM4OA85O tag=L603VLUFF4ZP type=write size=3090285 2023-10-05T11:35:08.259 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.255+0000 7f26f5634780 1 > prepared operation key=LLR5J3X15W5R tag=UY6CDXBJ0FVQ type=del size=1802221 2023-10-05T11:35:08.260 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.257+0000 7f26f5634780 1 < completed delete operation key=QYQDXVIGZ7O8 tag=HPSS4HMF66A8 type=del 2023-10-05T11:35:08.262 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.259+0000 7f26f5634780 1 > prepared part key=_multipart_4D3H60UTIXH3.2~CHMDXSWD111G.0 size=1048576 2023-10-05T11:35:08.263 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.260+0000 7f26f5634780 1 > prepared part key=_multipart_4D3H60UTIXH3.2~CHMDXSWD111G.1 size=1048576 2023-10-05T11:35:08.264 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.261+0000 7f26f5634780 1 > prepared part key=_multipart_4D3H60UTIXH3.2~CHMDXSWD111G.2 size=557705 2023-10-05T11:35:08.264 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.261+0000 7f26f5634780 1 > prepared multipart upload key=4D3H60UTIXH3 upload=CHMDXSWD111G tag=HNLL7R2Q6XUD type=write size=3703433 2023-10-05T11:35:08.264 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.261+0000 7f26f5634780 1 < canceled part key=_multipart_MEY4SZRHU9NZ.2~PKA9J1TD71K4.0 size=842483 2023-10-05T11:35:08.266 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.263+0000 7f26f5634780 1 < canceled multipart upload key=MEY4SZRHU9NZ upload=PKA9J1TD71K4 tag=N1GP17QOT43T type=write size=1891059 2023-10-05T11:35:08.267 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.264+0000 7f26f5634780 1 > prepared operation key=4D3H60UTIXH3 tag=GVG38Z7ZKNCP type=write size=97 2023-10-05T11:35:08.269 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.265+0000 7f26f5634780 1 < completed delete operation key=IC7T3ZK81WQS tag=64A76Q2JE7AC type=del 2023-10-05T11:35:08.270 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.267+0000 7f26f5634780 1 > prepared operation key=LLR5J3X15W5R tag=1MWUIXEAV686 type=del size=3443470 2023-10-05T11:35:08.271 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.268+0000 7f26f5634780 1 < completed part key=_multipart_2U0NRDGDNUTA.2~XB4QGGNGLDWO.0 size=1048576 2023-10-05T11:35:08.272 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.269+0000 7f26f5634780 1 < completed part key=_multipart_2U0NRDGDNUTA.2~XB4QGGNGLDWO.1 size=498045 2023-10-05T11:35:08.274 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.271+0000 7f26f5634780 1 < completed multipart upload key=2U0NRDGDNUTA upload=XB4QGGNGLDWO tag=0Y03LM26GHMT type=write size=2595197 2023-10-05T11:35:08.276 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.273+0000 7f26f5634780 1 > prepared part key=_multipart_NV4Q36UOLX8A.2~BPJUPZ83JYHR.0 size=1048576 2023-10-05T11:35:08.277 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.274+0000 7f26f5634780 1 > prepared part key=_multipart_NV4Q36UOLX8A.2~BPJUPZ83JYHR.1 size=849487 2023-10-05T11:35:08.277 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.274+0000 7f26f5634780 1 > prepared multipart upload key=NV4Q36UOLX8A upload=BPJUPZ83JYHR tag=1OBLLWOS4IW1 type=write size=2946639 2023-10-05T11:35:08.278 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.275+0000 7f26f5634780 1 < completed part key=_multipart_QYQDXVIGZ7O8.2~X2FA71Q3ZGGR.0 size=1048576 2023-10-05T11:35:08.279 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.276+0000 7f26f5634780 1 < completed part key=_multipart_QYQDXVIGZ7O8.2~X2FA71Q3ZGGR.1 size=898809 2023-10-05T11:35:08.281 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.278+0000 7f26f5634780 1 < completed multipart upload key=QYQDXVIGZ7O8 upload=X2FA71Q3ZGGR tag=F26G2HKQ22AR type=write size=2995961 2023-10-05T11:35:08.283 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.279+0000 7f26f5634780 1 > prepared operation key=PNV0Q6ZPLYV0 tag=SEH0QG0CT7WK type=del size=340169 2023-10-05T11:35:08.284 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.281+0000 7f26f5634780 1 < completed part key=_multipart_J5EIH25Y471T.2~EY21LS0UKS16.0 size=1048576 2023-10-05T11:35:08.285 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.282+0000 7f26f5634780 1 < completed part key=_multipart_J5EIH25Y471T.2~EY21LS0UKS16.1 size=199505 2023-10-05T11:35:08.287 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.284+0000 7f26f5634780 1 < completed multipart upload key=J5EIH25Y471T upload=EY21LS0UKS16 tag=TYMWZXFKIE1S type=write size=2296657 2023-10-05T11:35:08.290 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.287+0000 7f26f5634780 1 > prepared part key=_multipart_4IBQJLJR7LD8.2~NBDXNNK7PVKS.0 size=403695 2023-10-05T11:35:08.290 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.287+0000 7f26f5634780 1 > prepared multipart upload key=4IBQJLJR7LD8 upload=NBDXNNK7PVKS tag=3VONBQX8ET55 type=write size=1452271 2023-10-05T11:35:08.290 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.287+0000 7f26f5634780 1 < canceled part key=_multipart_PC8WTJ8AYJ24.2~Z9VVEZF508XS.0 size=1048576 2023-10-05T11:35:08.291 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.288+0000 7f26f5634780 1 < completed part key=_multipart_PC8WTJ8AYJ24.2~Z9VVEZF508XS.1 size=1048576 2023-10-05T11:35:08.292 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.289+0000 7f26f5634780 1 < completed part key=_multipart_PC8WTJ8AYJ24.2~Z9VVEZF508XS.2 size=67332 2023-10-05T11:35:08.295 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.291+0000 7f26f5634780 1 < canceled multipart upload key=PC8WTJ8AYJ24 upload=Z9VVEZF508XS tag=TRTH4TEQ5IWU type=write size=3213060 2023-10-05T11:35:08.297 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.294+0000 7f26f5634780 1 > prepared part key=_multipart_4D3H60UTIXH3.2~XEA8W2BLV7PF.0 size=1048576 2023-10-05T11:35:08.298 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.295+0000 7f26f5634780 1 > prepared part key=_multipart_4D3H60UTIXH3.2~XEA8W2BLV7PF.1 size=920256 2023-10-05T11:35:08.298 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.295+0000 7f26f5634780 1 > prepared multipart upload key=4D3H60UTIXH3 upload=XEA8W2BLV7PF tag=04YB7UROTQII type=write size=3017408 2023-10-05T11:35:08.299 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.296+0000 7f26f5634780 1 < completed part key=_multipart_WYN9BG66LA3K.2~922NP9U4MCQE.0 size=1048576 2023-10-05T11:35:08.300 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.297+0000 7f26f5634780 1 < completed part key=_multipart_WYN9BG66LA3K.2~922NP9U4MCQE.1 size=1048576 2023-10-05T11:35:08.302 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.299+0000 7f26f5634780 1 < completed part key=_multipart_WYN9BG66LA3K.2~922NP9U4MCQE.2 size=48892 2023-10-05T11:35:08.305 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.302+0000 7f26f5634780 1 < completed multipart upload key=WYN9BG66LA3K upload=922NP9U4MCQE tag=XQ4JLOQFPTP1 type=write size=3194620 2023-10-05T11:35:08.308 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.304+0000 7f26f5634780 1 > prepared operation key=5V0Q651D4VN2 tag=4XCNMNYBQGH2 type=del size=2637225 2023-10-05T11:35:08.309 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.305+0000 7f26f5634780 1 < completed delete operation key=J5EIH25Y471T tag=HTCNXE8NSPOG type=del 2023-10-05T11:35:08.310 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.307+0000 7f26f5634780 1 > prepared operation key=J5EIH25Y471T tag=TRO0KR484R3D type=del size=2018466 2023-10-05T11:35:08.311 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.308+0000 7f26f5634780 1 < completed delete operation key=6DP3UJ4CW1MO tag=60TZX49LQQO5 type=del 2023-10-05T11:35:08.312 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.309+0000 7f26f5634780 1 > prepared operation key=9S0YW7PPSJ8G tag=ZG1G2QZK6DZ8 type=del size=2199383 2023-10-05T11:35:08.314 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.310+0000 7f26f5634780 1 < completed part key=_multipart_NV4Q36UOLX8A.2~FEFW2ZXTF5V6.0 size=1048576 2023-10-05T11:35:08.315 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.311+0000 7f26f5634780 1 < completed part key=_multipart_NV4Q36UOLX8A.2~FEFW2ZXTF5V6.1 size=776464 2023-10-05T11:35:08.317 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.313+0000 7f26f5634780 1 < completed multipart upload key=NV4Q36UOLX8A upload=FEFW2ZXTF5V6 tag=N79TGKPWQUBH type=write size=2873616 2023-10-05T11:35:08.318 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.315+0000 7f26f5634780 1 > prepared operation key=WTCWG1C1SF89 tag=U1312YJX3BR5 type=del size=1789708 2023-10-05T11:35:08.319 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.316+0000 7f26f5634780 1 < completed delete operation key=WYN9BG66LA3K tag=AW4QG0Y8R8ED type=del 2023-10-05T11:35:08.321 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.318+0000 7f26f5634780 1 > prepared part key=_multipart_PNV0Q6ZPLYV0.2~LYWYMV4ML05M.0 size=1048576 2023-10-05T11:35:08.322 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.319+0000 7f26f5634780 1 > prepared part key=_multipart_PNV0Q6ZPLYV0.2~LYWYMV4ML05M.1 size=1048576 2023-10-05T11:35:08.323 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.320+0000 7f26f5634780 1 > prepared part key=_multipart_PNV0Q6ZPLYV0.2~LYWYMV4ML05M.2 size=285796 2023-10-05T11:35:08.323 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.320+0000 7f26f5634780 1 > prepared multipart upload key=PNV0Q6ZPLYV0 upload=LYWYMV4ML05M tag=3G53IUM61D1H type=write size=3431524 2023-10-05T11:35:08.324 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.321+0000 7f26f5634780 1 < completed delete operation key=761J2C7GHWU5 tag=XG012U6S2W3V type=del 2023-10-05T11:35:08.327 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.323+0000 7f26f5634780 1 > prepared part key=_multipart_4D3H60UTIXH3.2~2J921LP6XUE4.0 size=1048576 2023-10-05T11:35:08.328 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.324+0000 7f26f5634780 1 > prepared part key=_multipart_4D3H60UTIXH3.2~2J921LP6XUE4.1 size=446725 2023-10-05T11:35:08.328 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.324+0000 7f26f5634780 1 > prepared multipart upload key=4D3H60UTIXH3 upload=2J921LP6XUE4 tag=912X6IWMF702 type=write size=2543877 2023-10-05T11:35:08.329 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.326+0000 7f26f5634780 1 < completed part key=_multipart_LLR5J3X15W5R.2~AXQH7BQ7T1FC.0 size=55225 2023-10-05T11:35:08.331 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.328+0000 7f26f5634780 1 < completed multipart upload key=LLR5J3X15W5R upload=AXQH7BQ7T1FC tag=0ZAX4JDJJNP5 type=write size=1103801 2023-10-05T11:35:08.332 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.329+0000 7f26f5634780 1 > prepared operation key=FOMNIIY47UUM tag=M5M0NEK9OQ3A type=write size=684470 2023-10-05T11:35:08.334 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.330+0000 7f26f5634780 1 < completed delete operation key=8IPCP77WVVZT tag=5M43BMDGFJ3P type=del 2023-10-05T11:35:08.335 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.332+0000 7f26f5634780 1 > prepared operation key=7TOP5A52M9YP tag=D7VTM5IRV0M8 type=del size=2077897 2023-10-05T11:35:08.336 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.333+0000 7f26f5634780 1 < canceled operation key=LLR5J3X15W5R tag=UY6CDXBJ0FVQ type=del size=1802221 2023-10-05T11:35:08.338 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.334+0000 7f26f5634780 1 > prepared operation key=4IBQJLJR7LD8 tag=DLOK3Z5GS5D5 type=del size=810776 2023-10-05T11:35:08.339 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.335+0000 7f26f5634780 1 < completed part key=_multipart_4D3H60UTIXH3.2~CHMDXSWD111G.0 size=1048576 2023-10-05T11:35:08.340 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.336+0000 7f26f5634780 1 < completed part key=_multipart_4D3H60UTIXH3.2~CHMDXSWD111G.1 size=1048576 2023-10-05T11:35:08.341 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.337+0000 7f26f5634780 1 < completed part key=_multipart_4D3H60UTIXH3.2~CHMDXSWD111G.2 size=557705 2023-10-05T11:35:08.343 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.339+0000 7f26f5634780 1 < completed multipart upload key=4D3H60UTIXH3 upload=CHMDXSWD111G tag=HNLL7R2Q6XUD type=write size=3703433 2023-10-05T11:35:08.344 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.341+0000 7f26f5634780 1 > prepared operation key=IC7T3ZK81WQS tag=ET9Z2BO7NJGM type=del size=1983798 2023-10-05T11:35:08.345 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.342+0000 7f26f5634780 1 < completed write operation key=4D3H60UTIXH3 tag=GVG38Z7ZKNCP type=write size=97 2023-10-05T11:35:08.347 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.344+0000 7f26f5634780 1 > prepared part key=_multipart_NV4Q36UOLX8A.2~HGXAFIPDEHFZ.0 size=935026 2023-10-05T11:35:08.348 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.344+0000 7f26f5634780 1 > prepared multipart upload key=NV4Q36UOLX8A upload=HGXAFIPDEHFZ tag=075VU1WJZCNF type=write size=1983602 2023-10-05T11:35:08.349 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.345+0000 7f26f5634780 1 < completed delete operation key=LLR5J3X15W5R tag=1MWUIXEAV686 type=del 2023-10-05T11:35:08.351 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.348+0000 7f26f5634780 1 > prepared part key=_multipart_9S0YW7PPSJ8G.2~P1QMZA8T4CH6.0 size=747845 2023-10-05T11:35:08.351 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.348+0000 7f26f5634780 1 > prepared multipart upload key=9S0YW7PPSJ8G upload=P1QMZA8T4CH6 tag=JBYQSRTDH5K9 type=write size=1796421 2023-10-05T11:35:08.352 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.349+0000 7f26f5634780 1 < completed part key=_multipart_NV4Q36UOLX8A.2~BPJUPZ83JYHR.0 size=1048576 2023-10-05T11:35:08.353 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.350+0000 7f26f5634780 1 < completed part key=_multipart_NV4Q36UOLX8A.2~BPJUPZ83JYHR.1 size=849487 2023-10-05T11:35:08.355 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.352+0000 7f26f5634780 1 < completed multipart upload key=NV4Q36UOLX8A upload=BPJUPZ83JYHR tag=1OBLLWOS4IW1 type=write size=2946639 2023-10-05T11:35:08.357 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.354+0000 7f26f5634780 1 > prepared part key=_multipart_2U0NRDGDNUTA.2~I6GB4O3T7CNN.0 size=1048576 2023-10-05T11:35:08.358 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.355+0000 7f26f5634780 1 > prepared part key=_multipart_2U0NRDGDNUTA.2~I6GB4O3T7CNN.1 size=1048576 2023-10-05T11:35:08.359 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.356+0000 7f26f5634780 1 > prepared part key=_multipart_2U0NRDGDNUTA.2~I6GB4O3T7CNN.2 size=359364 2023-10-05T11:35:08.359 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.356+0000 7f26f5634780 1 > prepared multipart upload key=2U0NRDGDNUTA upload=I6GB4O3T7CNN tag=ZE2NTT3DEO64 type=write size=3505092 2023-10-05T11:35:08.361 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.357+0000 7f26f5634780 1 < completed delete operation key=PNV0Q6ZPLYV0 tag=SEH0QG0CT7WK type=del 2023-10-05T11:35:08.362 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.358+0000 7f26f5634780 1 > prepared operation key=4D3H60UTIXH3 tag=X81T3EG19LCV type=del size=2059148 2023-10-05T11:35:08.362 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.359+0000 7f26f5634780 1 < canceled part key=_multipart_4IBQJLJR7LD8.2~NBDXNNK7PVKS.0 size=403695 2023-10-05T11:35:08.364 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.361+0000 7f26f5634780 1 < canceled multipart upload key=4IBQJLJR7LD8 upload=NBDXNNK7PVKS tag=3VONBQX8ET55 type=write size=1452271 2023-10-05T11:35:08.365 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.362+0000 7f26f5634780 1 > prepared operation key=MEY4SZRHU9NZ tag=TSQJGNNRQK9S type=del size=2502577 2023-10-05T11:35:08.367 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.363+0000 7f26f5634780 1 < completed part key=_multipart_4D3H60UTIXH3.2~XEA8W2BLV7PF.0 size=1048576 2023-10-05T11:35:08.367 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.364+0000 7f26f5634780 1 < completed part key=_multipart_4D3H60UTIXH3.2~XEA8W2BLV7PF.1 size=920256 2023-10-05T11:35:08.370 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.366+0000 7f26f5634780 1 < completed multipart upload key=4D3H60UTIXH3 upload=XEA8W2BLV7PF tag=04YB7UROTQII type=write size=3017408 2023-10-05T11:35:08.371 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.367+0000 7f26f5634780 1 > prepared operation key=MEY4SZRHU9NZ tag=N6R0K0CTIYD1 type=del size=2562496 2023-10-05T11:35:08.373 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.370+0000 7f26f5634780 1 < suggested update operation key=5V0Q651D4VN2 tag=4XCNMNYBQGH2 type=del size=2637225 2023-10-05T11:35:08.374 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.371+0000 7f26f5634780 1 > prepared operation key=BTZUVE8R96XT tag=88XGALYJGOSJ type=del size=4134335 2023-10-05T11:35:08.375 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.372+0000 7f26f5634780 1 < completed delete operation key=J5EIH25Y471T tag=TRO0KR484R3D type=del 2023-10-05T11:35:08.377 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.373+0000 7f26f5634780 1 > prepared operation key=BU3KSHTINB36 tag=JIGEKS17ZUNW type=write size=392252 2023-10-05T11:35:08.378 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.375+0000 7f26f5634780 1 < completed delete operation key=9S0YW7PPSJ8G tag=ZG1G2QZK6DZ8 type=del 2023-10-05T11:35:08.380 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.377+0000 7f26f5634780 1 > prepared part key=_multipart_LLR5J3X15W5R.2~0Q4Q3Z8DGJL0.0 size=883793 2023-10-05T11:35:08.380 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.377+0000 7f26f5634780 1 > prepared multipart upload key=LLR5J3X15W5R upload=0Q4Q3Z8DGJL0 tag=R0LVUV8OHT99 type=write size=1932369 2023-10-05T11:35:08.382 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.378+0000 7f26f5634780 1 < canceled operation key=WTCWG1C1SF89 tag=U1312YJX3BR5 type=del size=1789708 2023-10-05T11:35:08.384 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.380+0000 7f26f5634780 1 > prepared part key=_multipart_4IBQJLJR7LD8.2~EK0S82C3CEI8.0 size=1048576 2023-10-05T11:35:08.385 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.381+0000 7f26f5634780 1 > prepared part key=_multipart_4IBQJLJR7LD8.2~EK0S82C3CEI8.1 size=384943 2023-10-05T11:35:08.385 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.381+0000 7f26f5634780 1 > prepared multipart upload key=4IBQJLJR7LD8 upload=EK0S82C3CEI8 tag=XLXHSK126RZY type=write size=2482095 2023-10-05T11:35:08.386 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.382+0000 7f26f5634780 1 < completed part key=_multipart_PNV0Q6ZPLYV0.2~LYWYMV4ML05M.0 size=1048576 2023-10-05T11:35:08.387 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.383+0000 7f26f5634780 1 < completed part key=_multipart_PNV0Q6ZPLYV0.2~LYWYMV4ML05M.1 size=1048576 2023-10-05T11:35:08.387 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.384+0000 7f26f5634780 1 < completed part key=_multipart_PNV0Q6ZPLYV0.2~LYWYMV4ML05M.2 size=285796 2023-10-05T11:35:08.389 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.386+0000 7f26f5634780 1 < completed multipart upload key=PNV0Q6ZPLYV0 upload=LYWYMV4ML05M tag=3G53IUM61D1H type=write size=3431524 2023-10-05T11:35:08.391 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.387+0000 7f26f5634780 1 > prepared operation key=BTZUVE8R96XT tag=9E8VPXVWIN4Z type=del size=3723210 2023-10-05T11:35:08.392 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.389+0000 7f26f5634780 1 < completed part key=_multipart_4D3H60UTIXH3.2~2J921LP6XUE4.0 size=1048576 2023-10-05T11:35:08.393 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.390+0000 7f26f5634780 1 < completed part key=_multipart_4D3H60UTIXH3.2~2J921LP6XUE4.1 size=446725 2023-10-05T11:35:08.395 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.392+0000 7f26f5634780 1 < completed multipart upload key=4D3H60UTIXH3 upload=2J921LP6XUE4 tag=912X6IWMF702 type=write size=2543877 2023-10-05T11:35:08.396 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.393+0000 7f26f5634780 1 > prepared operation key=7W9LL5HSU3BG tag=Z2K8VZX00A4C type=del size=1758284 2023-10-05T11:35:08.398 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.394+0000 7f26f5634780 1 < completed write operation key=FOMNIIY47UUM tag=M5M0NEK9OQ3A type=write size=684470 2023-10-05T11:35:08.399 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.396+0000 7f26f5634780 1 > prepared operation key=4D3H60UTIXH3 tag=UNLR7NZS9WF7 type=del size=3785101 2023-10-05T11:35:08.400 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.397+0000 7f26f5634780 1 < completed delete operation key=7TOP5A52M9YP tag=D7VTM5IRV0M8 type=del 2023-10-05T11:35:08.402 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.398+0000 7f26f5634780 1 > prepared operation key=4IBQJLJR7LD8 tag=GQC1AINAZZGL type=del size=181052 2023-10-05T11:35:08.403 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.399+0000 7f26f5634780 1 < canceled operation key=4IBQJLJR7LD8 tag=DLOK3Z5GS5D5 type=del size=810776 2023-10-05T11:35:08.404 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.401+0000 7f26f5634780 1 > prepared operation key=MEY4SZRHU9NZ tag=SCJ86CAVWMHE type=write size=1048228 2023-10-05T11:35:08.406 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.403+0000 7f26f5634780 1 < suggested update operation key=IC7T3ZK81WQS tag=ET9Z2BO7NJGM type=del size=1983798 2023-10-05T11:35:08.408 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.404+0000 7f26f5634780 1 > prepared operation key=BU3KSHTINB36 tag=3MSXMSSKL42F type=del size=3672082 2023-10-05T11:35:08.409 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.406+0000 7f26f5634780 1 < completed part key=_multipart_NV4Q36UOLX8A.2~HGXAFIPDEHFZ.0 size=935026 2023-10-05T11:35:08.411 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.408+0000 7f26f5634780 1 < completed multipart upload key=NV4Q36UOLX8A upload=HGXAFIPDEHFZ tag=075VU1WJZCNF type=write size=1983602 2023-10-05T11:35:08.412 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.409+0000 7f26f5634780 1 > prepared operation key=761J2C7GHWU5 tag=AVK7GJV23S9T type=del size=1505038 2023-10-05T11:35:08.412 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.409+0000 7f26f5634780 1 < canceled part key=_multipart_9S0YW7PPSJ8G.2~P1QMZA8T4CH6.0 size=747845 2023-10-05T11:35:08.414 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.411+0000 7f26f5634780 1 < canceled multipart upload key=9S0YW7PPSJ8G upload=P1QMZA8T4CH6 tag=JBYQSRTDH5K9 type=write size=1796421 2023-10-05T11:35:08.417 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.413+0000 7f26f5634780 1 > prepared part key=_multipart_J5EIH25Y471T.2~8W1SS1VHNQ8L.0 size=1048576 2023-10-05T11:35:08.417 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.414+0000 7f26f5634780 1 > prepared part key=_multipart_J5EIH25Y471T.2~8W1SS1VHNQ8L.1 size=1048576 2023-10-05T11:35:08.419 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.416+0000 7f26f5634780 1 > prepared part key=_multipart_J5EIH25Y471T.2~8W1SS1VHNQ8L.2 size=529317 2023-10-05T11:35:08.419 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.416+0000 7f26f5634780 1 > prepared multipart upload key=J5EIH25Y471T upload=8W1SS1VHNQ8L tag=MRS1TSBTXXGY type=write size=3675045 2023-10-05T11:35:08.420 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.417+0000 7f26f5634780 1 < completed part key=_multipart_2U0NRDGDNUTA.2~I6GB4O3T7CNN.0 size=1048576 2023-10-05T11:35:08.421 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.417+0000 7f26f5634780 1 < canceled part key=_multipart_2U0NRDGDNUTA.2~I6GB4O3T7CNN.1 size=1048576 2023-10-05T11:35:08.422 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.418+0000 7f26f5634780 1 < completed part key=_multipart_2U0NRDGDNUTA.2~I6GB4O3T7CNN.2 size=359364 2023-10-05T11:35:08.423 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.420+0000 7f26f5634780 1 < canceled multipart upload key=2U0NRDGDNUTA upload=I6GB4O3T7CNN tag=ZE2NTT3DEO64 type=write size=3505092 2023-10-05T11:35:08.425 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.421+0000 7f26f5634780 1 > prepared operation key=PNV0Q6ZPLYV0 tag=ABYO87GPU4PL type=del size=3824261 2023-10-05T11:35:08.427 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.424+0000 7f26f5634780 1 < suggested remove operation key=4D3H60UTIXH3 tag=X81T3EG19LCV type=del 2023-10-05T11:35:08.429 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.426+0000 7f26f5634780 1 > prepared part key=_multipart_4D3H60UTIXH3.2~6S2CTXJW5WOW.0 size=614605 2023-10-05T11:35:08.429 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.426+0000 7f26f5634780 1 > prepared multipart upload key=4D3H60UTIXH3 upload=6S2CTXJW5WOW tag=0ZHETUODMNYR type=write size=1663181 2023-10-05T11:35:08.430 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.427+0000 7f26f5634780 1 < completed delete operation key=MEY4SZRHU9NZ tag=TSQJGNNRQK9S type=del 2023-10-05T11:35:08.431 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.428+0000 7f26f5634780 1 > prepared operation key=IKCNZOTVWOC6 tag=PA0EFL5ZFVM1 type=del size=1811508 2023-10-05T11:35:08.433 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.429+0000 7f26f5634780 1 < completed delete operation key=MEY4SZRHU9NZ tag=N6R0K0CTIYD1 type=del 2023-10-05T11:35:08.434 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.430+0000 7f26f5634780 1 > prepared operation key=PNV0Q6ZPLYV0 tag=N7NL8WC6YHKB type=del size=2213313 2023-10-05T11:35:08.435 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.432+0000 7f26f5634780 1 < completed delete operation key=BTZUVE8R96XT tag=88XGALYJGOSJ type=del 2023-10-05T11:35:08.436 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.433+0000 7f26f5634780 1 > prepared operation key=9S0YW7PPSJ8G tag=B822VMZR6RAY type=del size=778703 2023-10-05T11:35:08.438 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.435+0000 7f26f5634780 1 < suggested remove operation key=BU3KSHTINB36 tag=JIGEKS17ZUNW type=write 2023-10-05T11:35:08.441 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.437+0000 7f26f5634780 1 > prepared part key=_multipart_PC8WTJ8AYJ24.2~F9E6YACYF50M.0 size=1048576 2023-10-05T11:35:08.441 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.438+0000 7f26f5634780 1 > prepared part key=_multipart_PC8WTJ8AYJ24.2~F9E6YACYF50M.1 size=1048576 2023-10-05T11:35:08.442 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.439+0000 7f26f5634780 1 > prepared part key=_multipart_PC8WTJ8AYJ24.2~F9E6YACYF50M.2 size=910611 2023-10-05T11:35:08.443 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.439+0000 7f26f5634780 1 > prepared multipart upload key=PC8WTJ8AYJ24 upload=F9E6YACYF50M tag=VTQ1V2LCGSRZ type=write size=4056339 2023-10-05T11:35:08.444 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.440+0000 7f26f5634780 1 < completed part key=_multipart_LLR5J3X15W5R.2~0Q4Q3Z8DGJL0.0 size=883793 2023-10-05T11:35:08.446 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.442+0000 7f26f5634780 1 < completed multipart upload key=LLR5J3X15W5R upload=0Q4Q3Z8DGJL0 tag=R0LVUV8OHT99 type=write size=1932369 2023-10-05T11:35:08.447 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.443+0000 7f26f5634780 1 > prepared operation key=761J2C7GHWU5 tag=K4V0OWYW77UD type=del size=3182099 2023-10-05T11:35:08.447 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.444+0000 7f26f5634780 1 < canceled part key=_multipart_4IBQJLJR7LD8.2~EK0S82C3CEI8.0 size=1048576 2023-10-05T11:35:08.448 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.445+0000 7f26f5634780 1 < completed part key=_multipart_4IBQJLJR7LD8.2~EK0S82C3CEI8.1 size=384943 2023-10-05T11:35:08.450 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.447+0000 7f26f5634780 1 < canceled multipart upload key=4IBQJLJR7LD8 upload=EK0S82C3CEI8 tag=XLXHSK126RZY type=write size=2482095 2023-10-05T11:35:08.451 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.448+0000 7f26f5634780 1 > prepared operation key=LLR5J3X15W5R tag=3TN00RRSXNF5 type=del size=3127165 2023-10-05T11:35:08.453 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.449+0000 7f26f5634780 1 < completed delete operation key=BTZUVE8R96XT tag=9E8VPXVWIN4Z type=del 2023-10-05T11:35:08.454 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.450+0000 7f26f5634780 1 > prepared operation key=W2GWVGX42QLD tag=ENH2CEXUBDYX type=del size=2509267 2023-10-05T11:35:08.456 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.453+0000 7f26f5634780 1 < suggested remove operation key=7W9LL5HSU3BG tag=Z2K8VZX00A4C type=del 2023-10-05T11:35:08.457 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.454+0000 7f26f5634780 1 > prepared operation key=4D3H60UTIXH3 tag=R9FL5Y695P2I type=del size=3435538 2023-10-05T11:35:08.458 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.455+0000 7f26f5634780 -1 < failed to complete operation key=4D3H60UTIXH3 tag=UNLR7NZS9WF7 type=del size=3785101: (22) Invalid argument 2023-10-05T11:35:08.459 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.456+0000 7f26f5634780 1 > prepared operation key=5V0Q651D4VN2 tag=PHYMNR0LO8U2 type=del size=3684090 2023-10-05T11:35:08.460 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.457+0000 7f26f5634780 1 < completed delete operation key=4IBQJLJR7LD8 tag=GQC1AINAZZGL type=del 2023-10-05T11:35:08.462 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.458+0000 7f26f5634780 1 > prepared operation key=761J2C7GHWU5 tag=RJJTNGG3G3AI type=del size=2421272 2023-10-05T11:35:08.463 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.459+0000 7f26f5634780 1 < completed write operation key=MEY4SZRHU9NZ tag=SCJ86CAVWMHE type=write size=1048228 2023-10-05T11:35:08.464 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.461+0000 7f26f5634780 1 > prepared operation key=FOMNIIY47UUM tag=RH08I4TDB1EO type=del size=2723057 2023-10-05T11:35:08.464 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.461+0000 7f26f5634780 -1 < no bi entry to suggest for operation key=BU3KSHTINB36 tag=3MSXMSSKL42F type=del size=3672082: (2) No such file or directory 2023-10-05T11:35:08.467 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.463+0000 7f26f5634780 1 > prepared part key=_multipart_8IPCP77WVVZT.2~0TO2SKXXA97B.0 size=1048576 2023-10-05T11:35:08.467 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.464+0000 7f26f5634780 1 > prepared part key=_multipart_8IPCP77WVVZT.2~0TO2SKXXA97B.1 size=987989 2023-10-05T11:35:08.467 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.464+0000 7f26f5634780 1 > prepared multipart upload key=8IPCP77WVVZT upload=0TO2SKXXA97B tag=INTAX86W9VHT type=write size=3085141 2023-10-05T11:35:08.469 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.465+0000 7f26f5634780 1 < completed delete operation key=761J2C7GHWU5 tag=AVK7GJV23S9T type=del 2023-10-05T11:35:08.471 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.468+0000 7f26f5634780 1 > prepared part key=_multipart_PC8WTJ8AYJ24.2~1V22JNKC2JA0.0 size=1048576 2023-10-05T11:35:08.472 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.468+0000 7f26f5634780 1 > prepared part key=_multipart_PC8WTJ8AYJ24.2~1V22JNKC2JA0.1 size=1048576 2023-10-05T11:35:08.473 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.469+0000 7f26f5634780 1 > prepared part key=_multipart_PC8WTJ8AYJ24.2~1V22JNKC2JA0.2 size=400495 2023-10-05T11:35:08.473 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.469+0000 7f26f5634780 1 > prepared multipart upload key=PC8WTJ8AYJ24 upload=1V22JNKC2JA0 tag=ICLRRRY70B1H type=write size=3546223 2023-10-05T11:35:08.474 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.471+0000 7f26f5634780 1 < completed part key=_multipart_J5EIH25Y471T.2~8W1SS1VHNQ8L.0 size=1048576 2023-10-05T11:35:08.475 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.472+0000 7f26f5634780 1 < completed part key=_multipart_J5EIH25Y471T.2~8W1SS1VHNQ8L.1 size=1048576 2023-10-05T11:35:08.476 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.473+0000 7f26f5634780 1 < completed part key=_multipart_J5EIH25Y471T.2~8W1SS1VHNQ8L.2 size=529317 2023-10-05T11:35:08.478 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.475+0000 7f26f5634780 1 < completed multipart upload key=J5EIH25Y471T upload=8W1SS1VHNQ8L tag=MRS1TSBTXXGY type=write size=3675045 2023-10-05T11:35:08.479 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.476+0000 7f26f5634780 1 > prepared operation key=IC7T3ZK81WQS tag=9CYMU93FDTEI type=del size=4026781 2023-10-05T11:35:08.482 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.478+0000 7f26f5634780 1 < suggested remove operation key=PNV0Q6ZPLYV0 tag=ABYO87GPU4PL type=del 2023-10-05T11:35:08.484 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.481+0000 7f26f5634780 1 > prepared part key=_multipart_PC8WTJ8AYJ24.2~EQWB6GPM9N8D.0 size=276386 2023-10-05T11:35:08.484 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.481+0000 7f26f5634780 1 > prepared multipart upload key=PC8WTJ8AYJ24 upload=EQWB6GPM9N8D tag=C6N6K73XP82A type=write size=1324962 2023-10-05T11:35:08.485 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.482+0000 7f26f5634780 1 < completed part key=_multipart_4D3H60UTIXH3.2~6S2CTXJW5WOW.0 size=614605 2023-10-05T11:35:08.487 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.484+0000 7f26f5634780 1 < completed multipart upload key=4D3H60UTIXH3 upload=6S2CTXJW5WOW tag=0ZHETUODMNYR type=write size=1663181 2023-10-05T11:35:08.488 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.485+0000 7f26f5634780 1 > prepared operation key=VJTFYDETLSFD tag=6XUJZCS6NECQ type=write size=75978 2023-10-05T11:35:08.490 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.486+0000 7f26f5634780 1 < completed delete operation key=IKCNZOTVWOC6 tag=PA0EFL5ZFVM1 type=del 2023-10-05T11:35:08.491 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.487+0000 7f26f5634780 1 > prepared operation key=AV0XKXX1IR4B tag=ANB1ZAWYVLI2 type=del size=4143831 2023-10-05T11:35:08.492 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.488+0000 7f26f5634780 -1 < failed to complete operation key=PNV0Q6ZPLYV0 tag=N7NL8WC6YHKB type=del size=2213313: (22) Invalid argument 2023-10-05T11:35:08.493 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.490+0000 7f26f5634780 1 > prepared operation key=BTZUVE8R96XT tag=SXRYDOTNDKYQ type=del size=3605875 2023-10-05T11:35:08.494 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.491+0000 7f26f5634780 1 < completed delete operation key=9S0YW7PPSJ8G tag=B822VMZR6RAY type=del 2023-10-05T11:35:08.496 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.492+0000 7f26f5634780 1 > prepared operation key=BTZUVE8R96XT tag=VFGXB7BK6MHZ type=del size=880044 2023-10-05T11:35:08.497 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.493+0000 7f26f5634780 1 < completed part key=_multipart_PC8WTJ8AYJ24.2~F9E6YACYF50M.0 size=1048576 2023-10-05T11:35:08.498 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.494+0000 7f26f5634780 1 < completed part key=_multipart_PC8WTJ8AYJ24.2~F9E6YACYF50M.1 size=1048576 2023-10-05T11:35:08.499 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.495+0000 7f26f5634780 1 < completed part key=_multipart_PC8WTJ8AYJ24.2~F9E6YACYF50M.2 size=910611 2023-10-05T11:35:08.501 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.498+0000 7f26f5634780 1 < completed multipart upload key=PC8WTJ8AYJ24 upload=F9E6YACYF50M tag=VTQ1V2LCGSRZ type=write size=4056339 2023-10-05T11:35:08.503 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.500+0000 7f26f5634780 1 > prepared part key=_multipart_U6172JUYW7J6.2~RLU5MYPK8DX4.0 size=1048576 2023-10-05T11:35:08.504 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.501+0000 7f26f5634780 1 > prepared part key=_multipart_U6172JUYW7J6.2~RLU5MYPK8DX4.1 size=1048576 2023-10-05T11:35:08.505 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.502+0000 7f26f5634780 1 > prepared part key=_multipart_U6172JUYW7J6.2~RLU5MYPK8DX4.2 size=16675 2023-10-05T11:35:08.505 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.502+0000 7f26f5634780 1 > prepared multipart upload key=U6172JUYW7J6 upload=RLU5MYPK8DX4 tag=07OIIQRB5L5I type=write size=3162403 2023-10-05T11:35:08.507 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.503+0000 7f26f5634780 1 < completed delete operation key=761J2C7GHWU5 tag=K4V0OWYW77UD type=del 2023-10-05T11:35:08.509 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.505+0000 7f26f5634780 1 > prepared part key=_multipart_AV0XKXX1IR4B.2~HZDYKHQKEZX6.0 size=257058 2023-10-05T11:35:08.509 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.505+0000 7f26f5634780 1 > prepared multipart upload key=AV0XKXX1IR4B upload=HZDYKHQKEZX6 tag=8EHNSJJKXVHA type=write size=1305634 2023-10-05T11:35:08.511 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.508+0000 7f26f5634780 1 < completed delete operation key=LLR5J3X15W5R tag=3TN00RRSXNF5 type=del 2023-10-05T11:35:08.513 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.509+0000 7f26f5634780 1 > prepared operation key=NV4Q36UOLX8A tag=QWC6J3X2DYTZ type=del size=651680 2023-10-05T11:35:08.515 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.512+0000 7f26f5634780 1 < suggested remove operation key=W2GWVGX42QLD tag=ENH2CEXUBDYX type=del 2023-10-05T11:35:08.518 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.514+0000 7f26f5634780 1 > prepared part key=_multipart_7TOP5A52M9YP.2~QMLHMYP2TGI3.0 size=1048576 2023-10-05T11:35:08.519 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.515+0000 7f26f5634780 1 > prepared part key=_multipart_7TOP5A52M9YP.2~QMLHMYP2TGI3.1 size=447135 2023-10-05T11:35:08.519 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.515+0000 7f26f5634780 1 > prepared multipart upload key=7TOP5A52M9YP upload=QMLHMYP2TGI3 tag=6QXMDGUR4S0E type=write size=2544287 2023-10-05T11:35:08.520 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.517+0000 7f26f5634780 1 < completed delete operation key=4D3H60UTIXH3 tag=R9FL5Y695P2I type=del 2023-10-05T11:35:08.521 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.518+0000 7f26f5634780 1 > prepared operation key=U6172JUYW7J6 tag=T0H5AWXDTXB0 type=del size=3779136 2023-10-05T11:35:08.523 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.520+0000 7f26f5634780 1 < completed delete operation key=5V0Q651D4VN2 tag=PHYMNR0LO8U2 type=del 2023-10-05T11:35:08.525 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.521+0000 7f26f5634780 1 > prepared operation key=5V0Q651D4VN2 tag=JT7C2A5M4QX4 type=del size=2861943 2023-10-05T11:35:08.526 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.522+0000 7f26f5634780 1 < completed delete operation key=761J2C7GHWU5 tag=RJJTNGG3G3AI type=del 2023-10-05T11:35:08.527 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.524+0000 7f26f5634780 1 > prepared operation key=W2GWVGX42QLD tag=3QC01GN3UDP1 type=del size=3939710 2023-10-05T11:35:08.528 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.525+0000 7f26f5634780 1 < completed delete operation key=FOMNIIY47UUM tag=RH08I4TDB1EO type=del 2023-10-05T11:35:08.530 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.526+0000 7f26f5634780 1 > prepared operation key=0PWYKC7S6YJ4 tag=WR4W2UN37NJU type=del size=449042 2023-10-05T11:35:08.531 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.527+0000 7f26f5634780 1 < completed part key=_multipart_8IPCP77WVVZT.2~0TO2SKXXA97B.0 size=1048576 2023-10-05T11:35:08.531 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.527+0000 7f26f5634780 1 < canceled part key=_multipart_8IPCP77WVVZT.2~0TO2SKXXA97B.1 size=987989 2023-10-05T11:35:08.533 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.529+0000 7f26f5634780 1 < canceled multipart upload key=8IPCP77WVVZT upload=0TO2SKXXA97B tag=INTAX86W9VHT type=write size=3085141 2023-10-05T11:35:08.534 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.531+0000 7f26f5634780 1 > prepared operation key=6DP3UJ4CW1MO tag=8W3VDITE9AZ6 type=del size=1414804 2023-10-05T11:35:08.536 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.533+0000 7f26f5634780 1 < completed part key=_multipart_PC8WTJ8AYJ24.2~1V22JNKC2JA0.0 size=1048576 2023-10-05T11:35:08.537 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.534+0000 7f26f5634780 1 < completed part key=_multipart_PC8WTJ8AYJ24.2~1V22JNKC2JA0.1 size=1048576 2023-10-05T11:35:08.538 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.535+0000 7f26f5634780 1 < completed part key=_multipart_PC8WTJ8AYJ24.2~1V22JNKC2JA0.2 size=400495 2023-10-05T11:35:08.541 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.537+0000 7f26f5634780 1 < completed multipart upload key=PC8WTJ8AYJ24 upload=1V22JNKC2JA0 tag=ICLRRRY70B1H type=write size=3546223 2023-10-05T11:35:08.542 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.538+0000 7f26f5634780 1 > prepared operation key=7TOP5A52M9YP tag=WZ66EQXVRRAU type=del size=3048590 2023-10-05T11:35:08.544 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.541+0000 7f26f5634780 1 < suggested update operation key=IC7T3ZK81WQS tag=9CYMU93FDTEI type=del size=4026781 2023-10-05T11:35:08.546 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.543+0000 7f26f5634780 1 > prepared part key=_multipart_MEY4SZRHU9NZ.2~HMT2D01404K6.0 size=170210 2023-10-05T11:35:08.546 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.543+0000 7f26f5634780 1 > prepared multipart upload key=MEY4SZRHU9NZ upload=HMT2D01404K6 tag=IU99TAM88T5W type=write size=1218786 2023-10-05T11:35:08.547 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.544+0000 7f26f5634780 1 < completed part key=_multipart_PC8WTJ8AYJ24.2~EQWB6GPM9N8D.0 size=276386 2023-10-05T11:35:08.550 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.546+0000 7f26f5634780 1 < completed multipart upload key=PC8WTJ8AYJ24 upload=EQWB6GPM9N8D tag=C6N6K73XP82A type=write size=1324962 2023-10-05T11:35:08.551 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.547+0000 7f26f5634780 1 > prepared operation key=7TOP5A52M9YP tag=5O2FCKGD7KMH type=write size=1020176 2023-10-05T11:35:08.552 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.548+0000 7f26f5634780 1 < completed write operation key=VJTFYDETLSFD tag=6XUJZCS6NECQ type=write size=75978 2023-10-05T11:35:08.553 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.550+0000 7f26f5634780 1 > prepared operation key=S3DKYDFT4IO2 tag=YHC72LTHOODJ type=del size=638069 2023-10-05T11:35:08.554 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.551+0000 7f26f5634780 1 < completed delete operation key=AV0XKXX1IR4B tag=ANB1ZAWYVLI2 type=del 2023-10-05T11:35:08.555 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.552+0000 7f26f5634780 1 > prepared operation key=U6172JUYW7J6 tag=6W8HWH6VUHXD type=write size=653825 2023-10-05T11:35:08.557 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.553+0000 7f26f5634780 1 < completed delete operation key=BTZUVE8R96XT tag=SXRYDOTNDKYQ type=del 2023-10-05T11:35:08.558 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.555+0000 7f26f5634780 1 > prepared operation key=0PWYKC7S6YJ4 tag=W2P75W9UVIZB type=del size=2308171 2023-10-05T11:35:08.559 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.556+0000 7f26f5634780 1 < canceled operation key=BTZUVE8R96XT tag=VFGXB7BK6MHZ type=del size=880044 2023-10-05T11:35:08.560 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.557+0000 7f26f5634780 1 > prepared operation key=BU3KSHTINB36 tag=13IU844R3FWJ type=del size=3499874 2023-10-05T11:35:08.562 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.558+0000 7f26f5634780 1 < completed part key=_multipart_U6172JUYW7J6.2~RLU5MYPK8DX4.0 size=1048576 2023-10-05T11:35:08.563 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.559+0000 7f26f5634780 1 < completed part key=_multipart_U6172JUYW7J6.2~RLU5MYPK8DX4.1 size=1048576 2023-10-05T11:35:08.564 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.560+0000 7f26f5634780 1 < completed part key=_multipart_U6172JUYW7J6.2~RLU5MYPK8DX4.2 size=16675 2023-10-05T11:35:08.566 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.562+0000 7f26f5634780 1 < completed multipart upload key=U6172JUYW7J6 upload=RLU5MYPK8DX4 tag=07OIIQRB5L5I type=write size=3162403 2023-10-05T11:35:08.567 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.564+0000 7f26f5634780 1 > prepared operation key=W2GWVGX42QLD tag=T13Y1UUDVFC4 type=del size=1263693 2023-10-05T11:35:08.568 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.565+0000 7f26f5634780 1 < completed part key=_multipart_AV0XKXX1IR4B.2~HZDYKHQKEZX6.0 size=257058 2023-10-05T11:35:08.570 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.567+0000 7f26f5634780 1 < completed multipart upload key=AV0XKXX1IR4B upload=HZDYKHQKEZX6 tag=8EHNSJJKXVHA type=write size=1305634 2023-10-05T11:35:08.572 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.569+0000 7f26f5634780 1 > prepared part key=_multipart_J5EIH25Y471T.2~TRS0BSQL5VGY.0 size=1048576 2023-10-05T11:35:08.573 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.570+0000 7f26f5634780 1 > prepared part key=_multipart_J5EIH25Y471T.2~TRS0BSQL5VGY.1 size=1048576 2023-10-05T11:35:08.574 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.571+0000 7f26f5634780 1 > prepared part key=_multipart_J5EIH25Y471T.2~TRS0BSQL5VGY.2 size=150400 2023-10-05T11:35:08.574 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.571+0000 7f26f5634780 1 > prepared multipart upload key=J5EIH25Y471T upload=TRS0BSQL5VGY tag=SO25KXIK5P2O type=write size=3296128 2023-10-05T11:35:08.576 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.573+0000 7f26f5634780 1 < suggested update operation key=NV4Q36UOLX8A tag=QWC6J3X2DYTZ type=del size=651680 2023-10-05T11:35:08.578 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.575+0000 7f26f5634780 1 > prepared part key=_multipart_2D4PDQQT54ZA.2~EZ3WA3D7FOTC.0 size=1048576 2023-10-05T11:35:08.579 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.576+0000 7f26f5634780 1 > prepared part key=_multipart_2D4PDQQT54ZA.2~EZ3WA3D7FOTC.1 size=1048576 2023-10-05T11:35:08.580 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.577+0000 7f26f5634780 1 > prepared part key=_multipart_2D4PDQQT54ZA.2~EZ3WA3D7FOTC.2 size=178788 2023-10-05T11:35:08.580 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.577+0000 7f26f5634780 1 > prepared multipart upload key=2D4PDQQT54ZA upload=EZ3WA3D7FOTC tag=R89NWQ11RNM8 type=write size=3324516 2023-10-05T11:35:08.581 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.578+0000 7f26f5634780 1 < completed part key=_multipart_7TOP5A52M9YP.2~QMLHMYP2TGI3.0 size=1048576 2023-10-05T11:35:08.582 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.579+0000 7f26f5634780 1 < completed part key=_multipart_7TOP5A52M9YP.2~QMLHMYP2TGI3.1 size=447135 2023-10-05T11:35:08.584 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.581+0000 7f26f5634780 1 < completed multipart upload key=7TOP5A52M9YP upload=QMLHMYP2TGI3 tag=6QXMDGUR4S0E type=write size=2544287 2023-10-05T11:35:08.585 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.582+0000 7f26f5634780 1 > prepared operation key=BU3KSHTINB36 tag=BS2FYV2CWMBA type=del size=2087138 2023-10-05T11:35:08.587 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.583+0000 7f26f5634780 1 < canceled operation key=U6172JUYW7J6 tag=T0H5AWXDTXB0 type=del size=3779136 2023-10-05T11:35:08.588 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.584+0000 7f26f5634780 1 > prepared operation key=NV4Q36UOLX8A tag=DXDJ7UHXANEC type=del size=2951720 2023-10-05T11:35:08.589 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.586+0000 7f26f5634780 1 < completed delete operation key=5V0Q651D4VN2 tag=JT7C2A5M4QX4 type=del 2023-10-05T11:35:08.590 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.587+0000 7f26f5634780 1 > prepared operation key=U6172JUYW7J6 tag=NJOOFJNNA7OJ type=write size=590668 2023-10-05T11:35:08.592 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.589+0000 7f26f5634780 1 < suggested remove operation key=W2GWVGX42QLD tag=3QC01GN3UDP1 type=del 2023-10-05T11:35:08.594 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.591+0000 7f26f5634780 1 > prepared part key=_multipart_8IPCP77WVVZT.2~9P1020BIQE32.0 size=435228 2023-10-05T11:35:08.594 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.591+0000 7f26f5634780 1 > prepared multipart upload key=8IPCP77WVVZT upload=9P1020BIQE32 tag=LA3F9Q3601MT type=write size=1483804 2023-10-05T11:35:08.597 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.593+0000 7f26f5634780 1 < suggested update operation key=0PWYKC7S6YJ4 tag=WR4W2UN37NJU type=del size=449042 2023-10-05T11:35:08.599 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.596+0000 7f26f5634780 1 > prepared part key=_multipart_S3DKYDFT4IO2.2~PUNAU0TTHPSA.0 size=62752 2023-10-05T11:35:08.599 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.596+0000 7f26f5634780 1 > prepared multipart upload key=S3DKYDFT4IO2 upload=PUNAU0TTHPSA tag=IF29422NVM67 type=write size=1111328 2023-10-05T11:35:08.600 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.597+0000 7f26f5634780 1 < completed delete operation key=6DP3UJ4CW1MO tag=8W3VDITE9AZ6 type=del 2023-10-05T11:35:08.601 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.598+0000 7f26f5634780 1 > prepared operation key=S3DKYDFT4IO2 tag=EMXSQ59I0W6V type=del size=784357 2023-10-05T11:35:08.602 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.599+0000 7f26f5634780 1 < completed delete operation key=7TOP5A52M9YP tag=WZ66EQXVRRAU type=del 2023-10-05T11:35:08.605 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.601+0000 7f26f5634780 1 > prepared part key=_multipart_IKCNZOTVWOC6.2~N1ULJJC9W21C.0 size=30218 2023-10-05T11:35:08.605 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.601+0000 7f26f5634780 1 > prepared multipart upload key=IKCNZOTVWOC6 upload=N1ULJJC9W21C tag=DNQRHHXUQBV7 type=write size=1078794 2023-10-05T11:35:08.606 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.603+0000 7f26f5634780 1 < completed part key=_multipart_MEY4SZRHU9NZ.2~HMT2D01404K6.0 size=170210 2023-10-05T11:35:08.608 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.605+0000 7f26f5634780 1 < completed multipart upload key=MEY4SZRHU9NZ upload=HMT2D01404K6 tag=IU99TAM88T5W type=write size=1218786 2023-10-05T11:35:08.609 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.606+0000 7f26f5634780 1 > prepared operation key=761J2C7GHWU5 tag=RPCFDKB0C8Z2 type=del size=4106865 2023-10-05T11:35:08.610 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.607+0000 7f26f5634780 1 < completed write operation key=7TOP5A52M9YP tag=5O2FCKGD7KMH type=write size=1020176 2023-10-05T11:35:08.612 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.608+0000 7f26f5634780 1 > prepared operation key=QYQDXVIGZ7O8 tag=89L01EFP69KA type=del size=1084611 2023-10-05T11:35:08.613 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.610+0000 7f26f5634780 1 < completed delete operation key=S3DKYDFT4IO2 tag=YHC72LTHOODJ type=del 2023-10-05T11:35:08.614 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.611+0000 7f26f5634780 1 > prepared operation key=BU3KSHTINB36 tag=VYTEJ0LSE6B7 type=del size=3815384 2023-10-05T11:35:08.615 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.612+0000 7f26f5634780 1 < completed write operation key=U6172JUYW7J6 tag=6W8HWH6VUHXD type=write size=653825 2023-10-05T11:35:08.618 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.614+0000 7f26f5634780 1 > prepared part key=_multipart_QYQDXVIGZ7O8.2~B18X5N1047Y2.0 size=1048576 2023-10-05T11:35:08.618 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.615+0000 7f26f5634780 1 > prepared part key=_multipart_QYQDXVIGZ7O8.2~B18X5N1047Y2.1 size=1048576 2023-10-05T11:35:08.619 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.616+0000 7f26f5634780 1 > prepared part key=_multipart_QYQDXVIGZ7O8.2~B18X5N1047Y2.2 size=385770 2023-10-05T11:35:08.619 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.616+0000 7f26f5634780 1 > prepared multipart upload key=QYQDXVIGZ7O8 upload=B18X5N1047Y2 tag=L38CS1N34I9R type=write size=3531498 2023-10-05T11:35:08.620 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.617+0000 7f26f5634780 -1 < failed to complete operation key=0PWYKC7S6YJ4 tag=W2P75W9UVIZB type=del size=2308171: (22) Invalid argument 2023-10-05T11:35:08.622 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.618+0000 7f26f5634780 1 > prepared operation key=LLR5J3X15W5R tag=QC4BJQZF734P type=del size=3696908 2023-10-05T11:35:08.623 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.619+0000 7f26f5634780 1 < completed delete operation key=BU3KSHTINB36 tag=13IU844R3FWJ type=del 2023-10-05T11:35:08.625 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.622+0000 7f26f5634780 1 > prepared part key=_multipart_VJTFYDETLSFD.2~BLTKSY7PD2MO.0 size=498020 2023-10-05T11:35:08.625 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.622+0000 7f26f5634780 1 > prepared multipart upload key=VJTFYDETLSFD upload=BLTKSY7PD2MO tag=RQ2S19B8TDVX type=write size=1546596 2023-10-05T11:35:08.626 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.622+0000 7f26f5634780 -1 < no bi entry to suggest for operation key=W2GWVGX42QLD tag=T13Y1UUDVFC4 type=del size=1263693: (2) No such file or directory 2023-10-05T11:35:08.628 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.624+0000 7f26f5634780 1 > prepared part key=_multipart_S3DKYDFT4IO2.2~T2V8P4WY6RKP.0 size=1048576 2023-10-05T11:35:08.629 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.625+0000 7f26f5634780 1 > prepared part key=_multipart_S3DKYDFT4IO2.2~T2V8P4WY6RKP.1 size=1048576 2023-10-05T11:35:08.630 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.626+0000 7f26f5634780 1 > prepared part key=_multipart_S3DKYDFT4IO2.2~T2V8P4WY6RKP.2 size=57811 2023-10-05T11:35:08.630 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.626+0000 7f26f5634780 1 > prepared multipart upload key=S3DKYDFT4IO2 upload=T2V8P4WY6RKP tag=OVDYDHWRNK68 type=write size=3203539 2023-10-05T11:35:08.631 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.628+0000 7f26f5634780 1 < completed part key=_multipart_J5EIH25Y471T.2~TRS0BSQL5VGY.0 size=1048576 2023-10-05T11:35:08.631 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.628+0000 7f26f5634780 1 < canceled part key=_multipart_J5EIH25Y471T.2~TRS0BSQL5VGY.1 size=1048576 2023-10-05T11:35:08.632 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.629+0000 7f26f5634780 1 < completed part key=_multipart_J5EIH25Y471T.2~TRS0BSQL5VGY.2 size=150400 2023-10-05T11:35:08.634 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.631+0000 7f26f5634780 1 < canceled multipart upload key=J5EIH25Y471T upload=TRS0BSQL5VGY tag=SO25KXIK5P2O type=write size=3296128 2023-10-05T11:35:08.636 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.632+0000 7f26f5634780 1 > prepared operation key=LLR5J3X15W5R tag=DH5IOAAIBC0G type=del size=3562117 2023-10-05T11:35:08.637 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.633+0000 7f26f5634780 1 < completed part key=_multipart_2D4PDQQT54ZA.2~EZ3WA3D7FOTC.0 size=1048576 2023-10-05T11:35:08.638 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.634+0000 7f26f5634780 1 < completed part key=_multipart_2D4PDQQT54ZA.2~EZ3WA3D7FOTC.1 size=1048576 2023-10-05T11:35:08.639 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.636+0000 7f26f5634780 1 < completed part key=_multipart_2D4PDQQT54ZA.2~EZ3WA3D7FOTC.2 size=178788 2023-10-05T11:35:08.641 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.638+0000 7f26f5634780 1 < completed multipart upload key=2D4PDQQT54ZA upload=EZ3WA3D7FOTC tag=R89NWQ11RNM8 type=write size=3324516 2023-10-05T11:35:08.643 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.640+0000 7f26f5634780 1 > prepared part key=_multipart_W2GWVGX42QLD.2~C5E8TS37ZLDN.0 size=1048576 2023-10-05T11:35:08.644 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.641+0000 7f26f5634780 1 > prepared part key=_multipart_W2GWVGX42QLD.2~C5E8TS37ZLDN.1 size=404247 2023-10-05T11:35:08.644 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.641+0000 7f26f5634780 1 > prepared multipart upload key=W2GWVGX42QLD upload=C5E8TS37ZLDN tag=79SA3R9G545S type=write size=2501399 2023-10-05T11:35:08.646 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.642+0000 7f26f5634780 1 < completed delete operation key=BU3KSHTINB36 tag=BS2FYV2CWMBA type=del 2023-10-05T11:35:08.647 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.643+0000 7f26f5634780 1 > prepared operation key=9S0YW7PPSJ8G tag=E9OBGQN890I1 type=del size=1232868 2023-10-05T11:35:08.649 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.645+0000 7f26f5634780 1 < completed delete operation key=NV4Q36UOLX8A tag=DXDJ7UHXANEC type=del 2023-10-05T11:35:08.651 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.648+0000 7f26f5634780 1 > prepared operation key=8IPCP77WVVZT tag=G3M2FVF61RQA type=del size=590707 2023-10-05T11:35:08.653 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.649+0000 7f26f5634780 1 < completed write operation key=U6172JUYW7J6 tag=NJOOFJNNA7OJ type=write size=590668 2023-10-05T11:35:08.654 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.650+0000 7f26f5634780 1 > prepared operation key=LLR5J3X15W5R tag=D2MD1AT28FP6 type=del size=4115503 2023-10-05T11:35:08.654 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.651+0000 7f26f5634780 1 < canceled part key=_multipart_8IPCP77WVVZT.2~9P1020BIQE32.0 size=435228 2023-10-05T11:35:08.656 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.653+0000 7f26f5634780 1 < canceled multipart upload key=8IPCP77WVVZT upload=9P1020BIQE32 tag=LA3F9Q3601MT type=write size=1483804 2023-10-05T11:35:08.657 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.654+0000 7f26f5634780 1 > prepared operation key=6DP3UJ4CW1MO tag=S4JSYEI999AZ type=del size=979940 2023-10-05T11:35:08.658 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.654+0000 7f26f5634780 1 < canceled part key=_multipart_S3DKYDFT4IO2.2~PUNAU0TTHPSA.0 size=62752 2023-10-05T11:35:08.659 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.656+0000 7f26f5634780 1 < canceled multipart upload key=S3DKYDFT4IO2 upload=PUNAU0TTHPSA tag=IF29422NVM67 type=write size=1111328 2023-10-05T11:35:08.661 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.657+0000 7f26f5634780 1 > prepared operation key=W2GWVGX42QLD tag=9SKI75ERTDS1 type=del size=3670704 2023-10-05T11:35:08.663 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.660+0000 7f26f5634780 1 < suggested update operation key=S3DKYDFT4IO2 tag=EMXSQ59I0W6V type=del size=784357 2023-10-05T11:35:08.664 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.661+0000 7f26f5634780 1 > prepared operation key=FOMNIIY47UUM tag=N6P7HD85MCX3 type=write size=930195 2023-10-05T11:35:08.666 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.662+0000 7f26f5634780 1 < completed part key=_multipart_IKCNZOTVWOC6.2~N1ULJJC9W21C.0 size=30218 2023-10-05T11:35:08.667 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.664+0000 7f26f5634780 1 < completed multipart upload key=IKCNZOTVWOC6 upload=N1ULJJC9W21C tag=DNQRHHXUQBV7 type=write size=1078794 2023-10-05T11:35:08.669 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.665+0000 7f26f5634780 1 > prepared operation key=WTCWG1C1SF89 tag=NCR2ER5WE1VZ type=del size=3073913 2023-10-05T11:35:08.670 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.667+0000 7f26f5634780 1 < completed delete operation key=761J2C7GHWU5 tag=RPCFDKB0C8Z2 type=del 2023-10-05T11:35:08.672 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.669+0000 7f26f5634780 1 > prepared part key=_multipart_IKCNZOTVWOC6.2~BY3GZN6Y2QQT.0 size=836745 2023-10-05T11:35:08.672 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.669+0000 7f26f5634780 1 > prepared multipart upload key=IKCNZOTVWOC6 upload=BY3GZN6Y2QQT tag=KD6S810L0X4R type=write size=1885321 2023-10-05T11:35:08.674 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.670+0000 7f26f5634780 1 < completed delete operation key=QYQDXVIGZ7O8 tag=89L01EFP69KA type=del 2023-10-05T11:35:08.675 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.671+0000 7f26f5634780 1 > prepared operation key=IC7T3ZK81WQS tag=1OHZFE5LV2JQ type=del size=1488315 2023-10-05T11:35:08.677 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.674+0000 7f26f5634780 1 < suggested update operation key=BU3KSHTINB36 tag=VYTEJ0LSE6B7 type=del size=3815384 2023-10-05T11:35:08.678 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.675+0000 7f26f5634780 1 > prepared operation key=7TOP5A52M9YP tag=K281R4VQID18 type=del size=597558 2023-10-05T11:35:08.680 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.676+0000 7f26f5634780 1 < completed part key=_multipart_QYQDXVIGZ7O8.2~B18X5N1047Y2.0 size=1048576 2023-10-05T11:35:08.680 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.677+0000 7f26f5634780 1 < completed part key=_multipart_QYQDXVIGZ7O8.2~B18X5N1047Y2.1 size=1048576 2023-10-05T11:35:08.681 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.678+0000 7f26f5634780 1 < completed part key=_multipart_QYQDXVIGZ7O8.2~B18X5N1047Y2.2 size=385770 2023-10-05T11:35:08.683 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.680+0000 7f26f5634780 1 < completed multipart upload key=QYQDXVIGZ7O8 upload=B18X5N1047Y2 tag=L38CS1N34I9R type=write size=3531498 2023-10-05T11:35:08.685 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.681+0000 7f26f5634780 1 > prepared operation key=2U0NRDGDNUTA tag=GXC1QAY9R4T3 type=del size=1476632 2023-10-05T11:35:08.686 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.682+0000 7f26f5634780 1 < completed delete operation key=LLR5J3X15W5R tag=QC4BJQZF734P type=del 2023-10-05T11:35:08.688 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.685+0000 7f26f5634780 1 > prepared part key=_multipart_U6172JUYW7J6.2~KWVP6KZZVJBI.0 size=1048576 2023-10-05T11:35:08.689 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.686+0000 7f26f5634780 1 > prepared part key=_multipart_U6172JUYW7J6.2~KWVP6KZZVJBI.1 size=863158 2023-10-05T11:35:08.689 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.686+0000 7f26f5634780 1 > prepared multipart upload key=U6172JUYW7J6 upload=KWVP6KZZVJBI tag=LOKQIOADD9ED type=write size=2960310 2023-10-05T11:35:08.689 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.686+0000 7f26f5634780 1 < canceled part key=_multipart_VJTFYDETLSFD.2~BLTKSY7PD2MO.0 size=498020 2023-10-05T11:35:08.691 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.688+0000 7f26f5634780 1 < canceled multipart upload key=VJTFYDETLSFD upload=BLTKSY7PD2MO tag=RQ2S19B8TDVX type=write size=1546596 2023-10-05T11:35:08.692 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.689+0000 7f26f5634780 1 > prepared operation key=WTCWG1C1SF89 tag=FRYPE0H56UYW type=del size=3637775 2023-10-05T11:35:08.694 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.690+0000 7f26f5634780 1 < completed part key=_multipart_S3DKYDFT4IO2.2~T2V8P4WY6RKP.0 size=1048576 2023-10-05T11:35:08.695 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.692+0000 7f26f5634780 1 < completed part key=_multipart_S3DKYDFT4IO2.2~T2V8P4WY6RKP.1 size=1048576 2023-10-05T11:35:08.696 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.693+0000 7f26f5634780 1 < completed part key=_multipart_S3DKYDFT4IO2.2~T2V8P4WY6RKP.2 size=57811 2023-10-05T11:35:08.698 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.695+0000 7f26f5634780 1 < completed multipart upload key=S3DKYDFT4IO2 upload=T2V8P4WY6RKP tag=OVDYDHWRNK68 type=write size=3203539 2023-10-05T11:35:08.699 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.696+0000 7f26f5634780 1 > prepared operation key=6DP3UJ4CW1MO tag=CGTYVYGKFHME type=del size=9730 2023-10-05T11:35:08.701 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.697+0000 7f26f5634780 1 < completed delete operation key=LLR5J3X15W5R tag=DH5IOAAIBC0G type=del 2023-10-05T11:35:08.702 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.698+0000 7f26f5634780 1 > prepared operation key=IKCNZOTVWOC6 tag=09MCJOXQURFG type=del size=396063 2023-10-05T11:35:08.703 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.700+0000 7f26f5634780 1 < completed part key=_multipart_W2GWVGX42QLD.2~C5E8TS37ZLDN.0 size=1048576 2023-10-05T11:35:08.704 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.701+0000 7f26f5634780 1 < completed part key=_multipart_W2GWVGX42QLD.2~C5E8TS37ZLDN.1 size=404247 2023-10-05T11:35:08.706 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.703+0000 7f26f5634780 1 < completed multipart upload key=W2GWVGX42QLD upload=C5E8TS37ZLDN tag=79SA3R9G545S type=write size=2501399 2023-10-05T11:35:08.708 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.705+0000 7f26f5634780 1 > prepared part key=_multipart_WTCWG1C1SF89.2~CV60W2G36BXQ.0 size=1048576 2023-10-05T11:35:08.709 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.706+0000 7f26f5634780 1 > prepared part key=_multipart_WTCWG1C1SF89.2~CV60W2G36BXQ.1 size=446688 2023-10-05T11:35:08.709 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.706+0000 7f26f5634780 1 > prepared multipart upload key=WTCWG1C1SF89 upload=CV60W2G36BXQ tag=JSU9S04FGA5M type=write size=2543840 2023-10-05T11:35:08.710 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.707+0000 7f26f5634780 1 < completed delete operation key=9S0YW7PPSJ8G tag=E9OBGQN890I1 type=del 2023-10-05T11:35:08.711 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.708+0000 7f26f5634780 1 > prepared operation key=FOMNIIY47UUM tag=LI9DKE26MI9Z type=write size=241768 2023-10-05T11:35:08.712 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.709+0000 7f26f5634780 1 < completed delete operation key=8IPCP77WVVZT tag=G3M2FVF61RQA type=del 2023-10-05T11:35:08.715 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.711+0000 7f26f5634780 1 > prepared part key=_multipart_WTCWG1C1SF89.2~0HNIFA6BE4F7.0 size=689660 2023-10-05T11:35:08.715 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.711+0000 7f26f5634780 1 > prepared multipart upload key=WTCWG1C1SF89 upload=0HNIFA6BE4F7 tag=0LMZPBZI9PNL type=write size=1738236 2023-10-05T11:35:08.716 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.713+0000 7f26f5634780 1 < completed delete operation key=LLR5J3X15W5R tag=D2MD1AT28FP6 type=del 2023-10-05T11:35:08.717 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.714+0000 7f26f5634780 1 > prepared operation key=BTZUVE8R96XT tag=TU6U1508AVSL type=del size=2538 2023-10-05T11:35:08.719 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.716+0000 7f26f5634780 1 < suggested update operation key=6DP3UJ4CW1MO tag=S4JSYEI999AZ type=del size=979940 2023-10-05T11:35:08.720 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.717+0000 7f26f5634780 1 > prepared operation key=5V0Q651D4VN2 tag=2B50YD0FZ7IH type=del size=3264200 2023-10-05T11:35:08.722 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.718+0000 7f26f5634780 1 < completed delete operation key=W2GWVGX42QLD tag=9SKI75ERTDS1 type=del 2023-10-05T11:35:08.723 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.720+0000 7f26f5634780 1 > prepared operation key=2D4PDQQT54ZA tag=FRL6M8B2U7U3 type=del size=3641079 2023-10-05T11:35:08.724 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.721+0000 7f26f5634780 1 < completed write operation key=FOMNIIY47UUM tag=N6P7HD85MCX3 type=write size=930195 2023-10-05T11:35:08.727 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.723+0000 7f26f5634780 1 > prepared part key=_multipart_0PWYKC7S6YJ4.2~CIUG53QB6453.0 size=138158 2023-10-05T11:35:08.727 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.723+0000 7f26f5634780 1 > prepared multipart upload key=0PWYKC7S6YJ4 upload=CIUG53QB6453 tag=46URZPK97CVX type=write size=1186734 2023-10-05T11:35:08.728 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.725+0000 7f26f5634780 1 < canceled operation key=WTCWG1C1SF89 tag=NCR2ER5WE1VZ type=del size=3073913 2023-10-05T11:35:08.730 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.726+0000 7f26f5634780 1 > prepared operation key=U6172JUYW7J6 tag=DCDH28KVRWTD type=write size=615304 2023-10-05T11:35:08.731 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.728+0000 7f26f5634780 1 < completed part key=_multipart_IKCNZOTVWOC6.2~BY3GZN6Y2QQT.0 size=836745 2023-10-05T11:35:08.733 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.730+0000 7f26f5634780 1 < completed multipart upload key=IKCNZOTVWOC6 upload=BY3GZN6Y2QQT tag=KD6S810L0X4R type=write size=1885321 2023-10-05T11:35:08.738 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.732+0000 7f26f5634780 1 > prepared part key=_multipart_4D3H60UTIXH3.2~WDXEKY1437HJ.0 size=1048576 2023-10-05T11:35:08.738 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.733+0000 7f26f5634780 1 > prepared part key=_multipart_4D3H60UTIXH3.2~WDXEKY1437HJ.1 size=1027885 2023-10-05T11:35:08.738 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.733+0000 7f26f5634780 1 > prepared multipart upload key=4D3H60UTIXH3 upload=WDXEKY1437HJ tag=AR0BC9EKDJL9 type=write size=3125037 2023-10-05T11:35:08.738 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.735+0000 7f26f5634780 1 < completed delete operation key=IC7T3ZK81WQS tag=1OHZFE5LV2JQ type=del 2023-10-05T11:35:08.740 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.736+0000 7f26f5634780 1 > prepared operation key=7W9LL5HSU3BG tag=W9R9DO84S9JO type=del size=1546818 2023-10-05T11:35:08.742 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.739+0000 7f26f5634780 1 < suggested update operation key=7TOP5A52M9YP tag=K281R4VQID18 type=del size=597558 2023-10-05T11:35:08.745 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.742+0000 7f26f5634780 1 > prepared part key=_multipart_PNV0Q6ZPLYV0.2~L18PDRL3901Y.0 size=1048576 2023-10-05T11:35:08.746 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.743+0000 7f26f5634780 1 > prepared part key=_multipart_PNV0Q6ZPLYV0.2~L18PDRL3901Y.1 size=785137 2023-10-05T11:35:08.746 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.743+0000 7f26f5634780 1 > prepared multipart upload key=PNV0Q6ZPLYV0 upload=L18PDRL3901Y tag=XRW60DZ5NJAG type=write size=2882289 2023-10-05T11:35:08.747 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.744+0000 7f26f5634780 1 < canceled operation key=2U0NRDGDNUTA tag=GXC1QAY9R4T3 type=del size=1476632 2023-10-05T11:35:08.749 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.745+0000 7f26f5634780 1 > prepared operation key=9S0YW7PPSJ8G tag=0M5DINGNO76Z type=del size=3933978 2023-10-05T11:35:08.749 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.746+0000 7f26f5634780 1 < canceled part key=_multipart_U6172JUYW7J6.2~KWVP6KZZVJBI.0 size=1048576 2023-10-05T11:35:08.749 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.746+0000 7f26f5634780 1 < canceled part key=_multipart_U6172JUYW7J6.2~KWVP6KZZVJBI.1 size=863158 2023-10-05T11:35:08.751 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.748+0000 7f26f5634780 1 < canceled multipart upload key=U6172JUYW7J6 upload=KWVP6KZZVJBI tag=LOKQIOADD9ED type=write size=2960310 2023-10-05T11:35:08.752 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.749+0000 7f26f5634780 1 > prepared operation key=VJTFYDETLSFD tag=VZAUTAQ2ZNG9 type=del size=2835451 2023-10-05T11:35:08.754 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.750+0000 7f26f5634780 1 < completed delete operation key=WTCWG1C1SF89 tag=FRYPE0H56UYW type=del 2023-10-05T11:35:08.756 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.753+0000 7f26f5634780 1 > prepared part key=_multipart_U6172JUYW7J6.2~CFZV667UOC2S.0 size=351314 2023-10-05T11:35:08.756 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.753+0000 7f26f5634780 1 > prepared multipart upload key=U6172JUYW7J6 upload=CFZV667UOC2S tag=9JKUILPTZ0HY type=write size=1399890 2023-10-05T11:35:08.757 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.754+0000 7f26f5634780 -1 < failed to complete operation key=6DP3UJ4CW1MO tag=CGTYVYGKFHME type=del size=9730: (22) Invalid argument 2023-10-05T11:35:08.758 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.755+0000 7f26f5634780 1 > prepared operation key=BU3KSHTINB36 tag=H7QCTTUAR5U8 type=del size=3819611 2023-10-05T11:35:08.760 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.756+0000 7f26f5634780 1 < completed delete operation key=IKCNZOTVWOC6 tag=09MCJOXQURFG type=del 2023-10-05T11:35:08.761 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.757+0000 7f26f5634780 1 > prepared operation key=BTZUVE8R96XT tag=AX4N10533GLJ type=write size=434584 2023-10-05T11:35:08.761 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.758+0000 7f26f5634780 1 < canceled part key=_multipart_WTCWG1C1SF89.2~CV60W2G36BXQ.0 size=1048576 2023-10-05T11:35:08.762 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.759+0000 7f26f5634780 1 < completed part key=_multipart_WTCWG1C1SF89.2~CV60W2G36BXQ.1 size=446688 2023-10-05T11:35:08.764 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.761+0000 7f26f5634780 1 < canceled multipart upload key=WTCWG1C1SF89 upload=CV60W2G36BXQ tag=JSU9S04FGA5M type=write size=2543840 2023-10-05T11:35:08.766 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.763+0000 7f26f5634780 1 > prepared part key=_multipart_761J2C7GHWU5.2~CHKE6LN63QII.0 size=1048576 2023-10-05T11:35:08.768 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.765+0000 7f26f5634780 1 > prepared part key=_multipart_761J2C7GHWU5.2~CHKE6LN63QII.1 size=1048576 2023-10-05T11:35:08.769 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.766+0000 7f26f5634780 1 > prepared part key=_multipart_761J2C7GHWU5.2~CHKE6LN63QII.2 size=919259 2023-10-05T11:35:08.769 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.766+0000 7f26f5634780 1 > prepared multipart upload key=761J2C7GHWU5 upload=CHKE6LN63QII tag=NEFX2GKNQ3NY type=write size=4064987 2023-10-05T11:35:08.770 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.767+0000 7f26f5634780 1 < completed write operation key=FOMNIIY47UUM tag=LI9DKE26MI9Z type=write size=241768 2023-10-05T11:35:08.772 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.769+0000 7f26f5634780 1 > prepared part key=_multipart_MEY4SZRHU9NZ.2~Z5PNFYSSG19S.0 size=1048576 2023-10-05T11:35:08.773 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.770+0000 7f26f5634780 1 > prepared part key=_multipart_MEY4SZRHU9NZ.2~Z5PNFYSSG19S.1 size=495516 2023-10-05T11:35:08.773 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.770+0000 7f26f5634780 1 > prepared multipart upload key=MEY4SZRHU9NZ upload=Z5PNFYSSG19S tag=PZMA0QMMQE0S type=write size=2592668 2023-10-05T11:35:08.774 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.771+0000 7f26f5634780 1 < completed part key=_multipart_WTCWG1C1SF89.2~0HNIFA6BE4F7.0 size=689660 2023-10-05T11:35:08.777 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.774+0000 7f26f5634780 1 < completed multipart upload key=WTCWG1C1SF89 upload=0HNIFA6BE4F7 tag=0LMZPBZI9PNL type=write size=1738236 2023-10-05T11:35:08.780 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.777+0000 7f26f5634780 1 > prepared operation key=8IPCP77WVVZT tag=719PX1ZVIZI6 type=del size=2958439 2023-10-05T11:35:08.783 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.780+0000 7f26f5634780 1 < completed delete operation key=BTZUVE8R96XT tag=TU6U1508AVSL type=del 2023-10-05T11:35:08.784 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.781+0000 7f26f5634780 1 > prepared operation key=4D3H60UTIXH3 tag=BG84VJET6D13 type=del size=2435477 2023-10-05T11:35:08.787 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.784+0000 7f26f5634780 1 < suggested update operation key=5V0Q651D4VN2 tag=2B50YD0FZ7IH type=del size=3264200 2023-10-05T11:35:08.789 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.785+0000 7f26f5634780 1 > prepared operation key=5V0Q651D4VN2 tag=L6V8ONWFICZK type=del size=1678917 2023-10-05T11:35:08.790 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.787+0000 7f26f5634780 1 < completed delete operation key=2D4PDQQT54ZA tag=FRL6M8B2U7U3 type=del 2023-10-05T11:35:08.791 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.788+0000 7f26f5634780 1 > prepared operation key=PNV0Q6ZPLYV0 tag=RDHCD5PLAKTY type=write size=404413 2023-10-05T11:35:08.793 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.789+0000 7f26f5634780 1 < completed part key=_multipart_0PWYKC7S6YJ4.2~CIUG53QB6453.0 size=138158 2023-10-05T11:35:08.795 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.791+0000 7f26f5634780 1 < completed multipart upload key=0PWYKC7S6YJ4 upload=CIUG53QB6453 tag=46URZPK97CVX type=write size=1186734 2023-10-05T11:35:08.796 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.793+0000 7f26f5634780 1 > prepared operation key=J5EIH25Y471T tag=6BZD0DM0FX03 type=del size=4028037 2023-10-05T11:35:08.798 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.795+0000 7f26f5634780 1 < suggested remove operation key=U6172JUYW7J6 tag=DCDH28KVRWTD type=write 2023-10-05T11:35:08.800 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.796+0000 7f26f5634780 1 > prepared operation key=AV0XKXX1IR4B tag=M2FY6MA724SF type=del size=1837067 2023-10-05T11:35:08.801 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.798+0000 7f26f5634780 1 < completed part key=_multipart_4D3H60UTIXH3.2~WDXEKY1437HJ.0 size=1048576 2023-10-05T11:35:08.802 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.799+0000 7f26f5634780 1 < completed part key=_multipart_4D3H60UTIXH3.2~WDXEKY1437HJ.1 size=1027885 2023-10-05T11:35:08.804 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.801+0000 7f26f5634780 1 < completed multipart upload key=4D3H60UTIXH3 upload=WDXEKY1437HJ tag=AR0BC9EKDJL9 type=write size=3125037 2023-10-05T11:35:08.805 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.802+0000 7f26f5634780 1 > prepared operation key=PC8WTJ8AYJ24 tag=D7VGZQKUX7SW type=del size=4042358 2023-10-05T11:35:08.807 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.803+0000 7f26f5634780 1 < completed delete operation key=7W9LL5HSU3BG tag=W9R9DO84S9JO type=del 2023-10-05T11:35:08.808 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.804+0000 7f26f5634780 1 > prepared operation key=0PWYKC7S6YJ4 tag=D6UBDG6JBA3J type=del size=2889857 2023-10-05T11:35:08.809 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.806+0000 7f26f5634780 1 < completed part key=_multipart_PNV0Q6ZPLYV0.2~L18PDRL3901Y.0 size=1048576 2023-10-05T11:35:08.810 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.807+0000 7f26f5634780 1 < completed part key=_multipart_PNV0Q6ZPLYV0.2~L18PDRL3901Y.1 size=785137 2023-10-05T11:35:08.812 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.809+0000 7f26f5634780 1 < completed multipart upload key=PNV0Q6ZPLYV0 upload=L18PDRL3901Y tag=XRW60DZ5NJAG type=write size=2882289 2023-10-05T11:35:08.814 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.810+0000 7f26f5634780 1 > prepared operation key=FOMNIIY47UUM tag=A8UFU2GQC4CQ type=del size=3418749 2023-10-05T11:35:08.815 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.812+0000 7f26f5634780 1 < completed delete operation key=9S0YW7PPSJ8G tag=0M5DINGNO76Z type=del 2023-10-05T11:35:08.816 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.813+0000 7f26f5634780 1 > prepared operation key=VJTFYDETLSFD tag=65PCXNK2L2I6 type=del size=3551041 2023-10-05T11:35:08.817 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.814+0000 7f26f5634780 1 < completed delete operation key=VJTFYDETLSFD tag=VZAUTAQ2ZNG9 type=del 2023-10-05T11:35:08.819 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.815+0000 7f26f5634780 1 > prepared operation key=MEY4SZRHU9NZ tag=2H16MRALXD9W type=del size=4111032 2023-10-05T11:35:08.820 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.816+0000 7f26f5634780 1 < completed part key=_multipart_U6172JUYW7J6.2~CFZV667UOC2S.0 size=351314 2023-10-05T11:35:08.822 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.818+0000 7f26f5634780 1 < completed multipart upload key=U6172JUYW7J6 upload=CFZV667UOC2S tag=9JKUILPTZ0HY type=write size=1399890 2023-10-05T11:35:08.825 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.821+0000 7f26f5634780 1 > prepared operation key=2D4PDQQT54ZA tag=BU22HY1K2CRA type=del size=2019967 2023-10-05T11:35:08.827 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.824+0000 7f26f5634780 1 < completed delete operation key=BU3KSHTINB36 tag=H7QCTTUAR5U8 type=del 2023-10-05T11:35:08.829 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.825+0000 7f26f5634780 1 > prepared operation key=LLR5J3X15W5R tag=K81PJ7VV0JWZ type=del size=2908727 2023-10-05T11:35:08.830 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.827+0000 7f26f5634780 1 < completed write operation key=BTZUVE8R96XT tag=AX4N10533GLJ type=write size=434584 2023-10-05T11:35:08.831 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.828+0000 7f26f5634780 1 > prepared operation key=U6172JUYW7J6 tag=GVH25P38OQ9Y type=del size=4079612 2023-10-05T11:35:08.833 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.829+0000 7f26f5634780 1 < completed part key=_multipart_761J2C7GHWU5.2~CHKE6LN63QII.0 size=1048576 2023-10-05T11:35:08.834 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.830+0000 7f26f5634780 1 < completed part key=_multipart_761J2C7GHWU5.2~CHKE6LN63QII.1 size=1048576 2023-10-05T11:35:08.835 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.831+0000 7f26f5634780 1 < completed part key=_multipart_761J2C7GHWU5.2~CHKE6LN63QII.2 size=919259 2023-10-05T11:35:08.837 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.833+0000 7f26f5634780 1 < completed multipart upload key=761J2C7GHWU5 upload=CHKE6LN63QII tag=NEFX2GKNQ3NY type=write size=4064987 2023-10-05T11:35:08.838 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.835+0000 7f26f5634780 1 > prepared operation key=AV0XKXX1IR4B tag=2VELJQCYO3U0 type=del size=2911735 2023-10-05T11:35:08.839 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.836+0000 7f26f5634780 1 < completed part key=_multipart_MEY4SZRHU9NZ.2~Z5PNFYSSG19S.0 size=1048576 2023-10-05T11:35:08.841 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.837+0000 7f26f5634780 1 < completed part key=_multipart_MEY4SZRHU9NZ.2~Z5PNFYSSG19S.1 size=495516 2023-10-05T11:35:08.843 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.839+0000 7f26f5634780 1 < completed multipart upload key=MEY4SZRHU9NZ upload=Z5PNFYSSG19S tag=PZMA0QMMQE0S type=write size=2592668 2023-10-05T11:35:08.844 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.841+0000 7f26f5634780 1 > prepared operation key=8IPCP77WVVZT tag=OIDN11TLMAUR type=del size=1671747 2023-10-05T11:35:08.845 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.842+0000 7f26f5634780 1 < completed delete operation key=8IPCP77WVVZT tag=719PX1ZVIZI6 type=del 2023-10-05T11:35:08.847 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.844+0000 7f26f5634780 1 > prepared part key=_multipart_PC8WTJ8AYJ24.2~SS4JMVAC6DT1.0 size=1048576 2023-10-05T11:35:08.848 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.845+0000 7f26f5634780 1 > prepared part key=_multipart_PC8WTJ8AYJ24.2~SS4JMVAC6DT1.1 size=583413 2023-10-05T11:35:08.849 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.845+0000 7f26f5634780 1 > prepared multipart upload key=PC8WTJ8AYJ24 upload=SS4JMVAC6DT1 tag=IX83U2YQHZM6 type=write size=2680565 2023-10-05T11:35:08.850 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.846+0000 7f26f5634780 1 < completed delete operation key=4D3H60UTIXH3 tag=BG84VJET6D13 type=del 2023-10-05T11:35:08.851 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.847+0000 7f26f5634780 1 > prepared operation key=9S0YW7PPSJ8G tag=9OKWXG1A3ZW9 type=del size=745098 2023-10-05T11:35:08.852 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.849+0000 7f26f5634780 1 < completed delete operation key=5V0Q651D4VN2 tag=L6V8ONWFICZK type=del 2023-10-05T11:35:08.853 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.850+0000 7f26f5634780 1 > prepared operation key=8IPCP77WVVZT tag=ASEJXYX2EJWP type=del size=1917961 2023-10-05T11:35:08.855 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.851+0000 7f26f5634780 1 < completed write operation key=PNV0Q6ZPLYV0 tag=RDHCD5PLAKTY type=write size=404413 2023-10-05T11:35:08.857 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.854+0000 7f26f5634780 1 > prepared part key=_multipart_9S0YW7PPSJ8G.2~2R4QKM22CV9O.0 size=1048576 2023-10-05T11:35:08.858 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.855+0000 7f26f5634780 1 > prepared part key=_multipart_9S0YW7PPSJ8G.2~2R4QKM22CV9O.1 size=1036950 2023-10-05T11:35:08.858 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.855+0000 7f26f5634780 1 > prepared multipart upload key=9S0YW7PPSJ8G upload=2R4QKM22CV9O tag=GA8Z154BPKVY type=write size=3134102 2023-10-05T11:35:08.861 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.857+0000 7f26f5634780 1 < suggested update operation key=J5EIH25Y471T tag=6BZD0DM0FX03 type=del size=4028037 2023-10-05T11:35:08.862 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.859+0000 7f26f5634780 1 > prepared operation key=MEY4SZRHU9NZ tag=0ZKX5788TR3C type=del size=777611 2023-10-05T11:35:08.864 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.860+0000 7f26f5634780 1 < completed delete operation key=AV0XKXX1IR4B tag=M2FY6MA724SF type=del 2023-10-05T11:35:08.866 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.863+0000 7f26f5634780 1 > prepared part key=_multipart_6DP3UJ4CW1MO.2~DPVP5GU8GCBI.0 size=1048576 2023-10-05T11:35:08.867 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.864+0000 7f26f5634780 1 > prepared part key=_multipart_6DP3UJ4CW1MO.2~DPVP5GU8GCBI.1 size=1048576 2023-10-05T11:35:08.868 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.865+0000 7f26f5634780 1 > prepared part key=_multipart_6DP3UJ4CW1MO.2~DPVP5GU8GCBI.2 size=943243 2023-10-05T11:35:08.868 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.865+0000 7f26f5634780 1 > prepared multipart upload key=6DP3UJ4CW1MO upload=DPVP5GU8GCBI tag=266TDJHHRDV1 type=write size=4088971 2023-10-05T11:35:08.869 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.866+0000 7f26f5634780 1 < completed delete operation key=PC8WTJ8AYJ24 tag=D7VGZQKUX7SW type=del 2023-10-05T11:35:08.872 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.868+0000 7f26f5634780 1 > prepared part key=_multipart_MEY4SZRHU9NZ.2~Y1OKZPI8R0QH.0 size=1048576 2023-10-05T11:35:08.872 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.869+0000 7f26f5634780 1 > prepared part key=_multipart_MEY4SZRHU9NZ.2~Y1OKZPI8R0QH.1 size=1048576 2023-10-05T11:35:08.873 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.870+0000 7f26f5634780 1 > prepared part key=_multipart_MEY4SZRHU9NZ.2~Y1OKZPI8R0QH.2 size=684288 2023-10-05T11:35:08.873 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.870+0000 7f26f5634780 1 > prepared multipart upload key=MEY4SZRHU9NZ upload=Y1OKZPI8R0QH tag=PTLK6O3NKHDR type=write size=3830016 2023-10-05T11:35:08.876 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.873+0000 7f26f5634780 1 < suggested remove operation key=0PWYKC7S6YJ4 tag=D6UBDG6JBA3J type=del 2023-10-05T11:35:08.877 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.874+0000 7f26f5634780 1 > prepared operation key=2U0NRDGDNUTA tag=HWLKP4JBB1PF type=write size=814099 2023-10-05T11:35:08.878 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.875+0000 7f26f5634780 1 < completed delete operation key=FOMNIIY47UUM tag=A8UFU2GQC4CQ type=del 2023-10-05T11:35:08.880 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.876+0000 7f26f5634780 1 > prepared operation key=761J2C7GHWU5 tag=ZQU1PTTV53OK type=del size=917460 2023-10-05T11:35:08.882 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.879+0000 7f26f5634780 1 < suggested update operation key=VJTFYDETLSFD tag=65PCXNK2L2I6 type=del size=3551041 2023-10-05T11:35:08.885 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.881+0000 7f26f5634780 1 > prepared part key=_multipart_PC8WTJ8AYJ24.2~C1SAF7WLXKZE.0 size=1048576 2023-10-05T11:35:08.886 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.882+0000 7f26f5634780 1 > prepared part key=_multipart_PC8WTJ8AYJ24.2~C1SAF7WLXKZE.1 size=1020208 2023-10-05T11:35:08.886 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.882+0000 7f26f5634780 1 > prepared multipart upload key=PC8WTJ8AYJ24 upload=C1SAF7WLXKZE tag=7MT294MZ661G type=write size=3117360 2023-10-05T11:35:08.888 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.885+0000 7f26f5634780 1 < suggested update operation key=MEY4SZRHU9NZ tag=2H16MRALXD9W type=del size=4111032 2023-10-05T11:35:08.891 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.887+0000 7f26f5634780 1 > prepared part key=_multipart_4D3H60UTIXH3.2~X2NEVDNYK95Q.0 size=1048576 2023-10-05T11:35:08.891 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.888+0000 7f26f5634780 1 > prepared part key=_multipart_4D3H60UTIXH3.2~X2NEVDNYK95Q.1 size=1048576 2023-10-05T11:35:08.892 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.889+0000 7f26f5634780 1 > prepared part key=_multipart_4D3H60UTIXH3.2~X2NEVDNYK95Q.2 size=195373 2023-10-05T11:35:08.893 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.889+0000 7f26f5634780 1 > prepared multipart upload key=4D3H60UTIXH3 upload=X2NEVDNYK95Q tag=V2M3QTMQ1Q3D type=write size=3341101 2023-10-05T11:35:08.895 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.891+0000 7f26f5634780 1 < completed delete operation key=2D4PDQQT54ZA tag=BU22HY1K2CRA type=del 2023-10-05T11:35:08.897 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.894+0000 7f26f5634780 1 > prepared part key=_multipart_VJTFYDETLSFD.2~LR2534TT2ECW.0 size=1048576 2023-10-05T11:35:08.898 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.894+0000 7f26f5634780 1 > prepared part key=_multipart_VJTFYDETLSFD.2~LR2534TT2ECW.1 size=1048576 2023-10-05T11:35:08.899 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.895+0000 7f26f5634780 1 > prepared part key=_multipart_VJTFYDETLSFD.2~LR2534TT2ECW.2 size=556872 2023-10-05T11:35:08.899 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.895+0000 7f26f5634780 1 > prepared multipart upload key=VJTFYDETLSFD upload=LR2534TT2ECW tag=0DKJM6DMMLR0 type=write size=3702600 2023-10-05T11:35:08.900 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.897+0000 7f26f5634780 1 < completed delete operation key=LLR5J3X15W5R tag=K81PJ7VV0JWZ type=del 2023-10-05T11:35:08.901 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.898+0000 7f26f5634780 1 > prepared operation key=0PWYKC7S6YJ4 tag=3HLJI7G5S2DZ type=write size=627573 2023-10-05T11:35:08.903 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.899+0000 7f26f5634780 1 < completed delete operation key=U6172JUYW7J6 tag=GVH25P38OQ9Y type=del 2023-10-05T11:35:08.905 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.901+0000 7f26f5634780 1 > prepared part key=_multipart_BU3KSHTINB36.2~BXO63HI8EROG.0 size=1048576 2023-10-05T11:35:08.906 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.902+0000 7f26f5634780 1 > prepared part key=_multipart_BU3KSHTINB36.2~BXO63HI8EROG.1 size=1048576 2023-10-05T11:35:08.907 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.903+0000 7f26f5634780 1 > prepared part key=_multipart_BU3KSHTINB36.2~BXO63HI8EROG.2 size=932927 2023-10-05T11:35:08.907 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.903+0000 7f26f5634780 1 > prepared multipart upload key=BU3KSHTINB36 upload=BXO63HI8EROG tag=3Q8LZHV3KF8Z type=write size=4078655 2023-10-05T11:35:08.908 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.905+0000 7f26f5634780 1 < completed delete operation key=AV0XKXX1IR4B tag=2VELJQCYO3U0 type=del 2023-10-05T11:35:08.910 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.907+0000 7f26f5634780 1 > prepared part key=_multipart_PNV0Q6ZPLYV0.2~C15ZC9XU3HTE.0 size=926690 2023-10-05T11:35:08.910 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.907+0000 7f26f5634780 1 > prepared multipart upload key=PNV0Q6ZPLYV0 upload=C15ZC9XU3HTE tag=QY2QT47N16EX type=write size=1975266 2023-10-05T11:35:08.911 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.908+0000 7f26f5634780 1 < completed delete operation key=8IPCP77WVVZT tag=OIDN11TLMAUR type=del 2023-10-05T11:35:08.912 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.909+0000 7f26f5634780 1 > prepared operation key=2D4PDQQT54ZA tag=QNC91T9UAUDO type=del size=141518 2023-10-05T11:35:08.914 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.910+0000 7f26f5634780 1 < completed part key=_multipart_PC8WTJ8AYJ24.2~SS4JMVAC6DT1.0 size=1048576 2023-10-05T11:35:08.915 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.911+0000 7f26f5634780 1 < completed part key=_multipart_PC8WTJ8AYJ24.2~SS4JMVAC6DT1.1 size=583413 2023-10-05T11:35:08.917 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.913+0000 7f26f5634780 1 < completed multipart upload key=PC8WTJ8AYJ24 upload=SS4JMVAC6DT1 tag=IX83U2YQHZM6 type=write size=2680565 2023-10-05T11:35:08.918 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.915+0000 7f26f5634780 1 > prepared operation key=7TOP5A52M9YP tag=D3MP15BAV8ZZ type=del size=2128695 2023-10-05T11:35:08.920 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.917+0000 7f26f5634780 1 < suggested remove operation key=9S0YW7PPSJ8G tag=9OKWXG1A3ZW9 type=del 2023-10-05T11:35:08.922 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.919+0000 7f26f5634780 1 > prepared part key=_multipart_J5EIH25Y471T.2~0IG122ICAXPX.0 size=1048576 2023-10-05T11:35:08.923 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.920+0000 7f26f5634780 1 > prepared part key=_multipart_J5EIH25Y471T.2~0IG122ICAXPX.1 size=1048576 2023-10-05T11:35:08.926 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.923+0000 7f26f5634780 1 > prepared part key=_multipart_J5EIH25Y471T.2~0IG122ICAXPX.2 size=645049 2023-10-05T11:35:08.926 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.923+0000 7f26f5634780 1 > prepared multipart upload key=J5EIH25Y471T upload=0IG122ICAXPX tag=40HX25IHMUKH type=write size=3790777 2023-10-05T11:35:08.927 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.924+0000 7f26f5634780 1 < completed delete operation key=8IPCP77WVVZT tag=ASEJXYX2EJWP type=del 2023-10-05T11:35:08.928 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.925+0000 7f26f5634780 1 > prepared operation key=PNV0Q6ZPLYV0 tag=P8I1I8EP37YW type=del size=470419 2023-10-05T11:35:08.929 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.926+0000 7f26f5634780 1 < completed part key=_multipart_9S0YW7PPSJ8G.2~2R4QKM22CV9O.0 size=1048576 2023-10-05T11:35:08.931 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.927+0000 7f26f5634780 1 < completed part key=_multipart_9S0YW7PPSJ8G.2~2R4QKM22CV9O.1 size=1036950 2023-10-05T11:35:08.935 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.932+0000 7f26f5634780 1 < completed multipart upload key=9S0YW7PPSJ8G upload=2R4QKM22CV9O tag=GA8Z154BPKVY type=write size=3134102 2023-10-05T11:35:08.937 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.933+0000 7f26f5634780 1 > prepared operation key=761J2C7GHWU5 tag=HAMGXHE92207 type=write size=641434 2023-10-05T11:35:08.942 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.935+0000 7f26f5634780 1 < suggested remove operation key=MEY4SZRHU9NZ tag=0ZKX5788TR3C type=del 2023-10-05T11:35:08.942 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.937+0000 7f26f5634780 1 > prepared operation key=IC7T3ZK81WQS tag=T5Z5OF2ARRNW type=del size=3247321 2023-10-05T11:35:08.942 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.938+0000 7f26f5634780 1 < completed part key=_multipart_6DP3UJ4CW1MO.2~DPVP5GU8GCBI.0 size=1048576 2023-10-05T11:35:08.943 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.939+0000 7f26f5634780 1 < completed part key=_multipart_6DP3UJ4CW1MO.2~DPVP5GU8GCBI.1 size=1048576 2023-10-05T11:35:08.943 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.940+0000 7f26f5634780 1 < completed part key=_multipart_6DP3UJ4CW1MO.2~DPVP5GU8GCBI.2 size=943243 2023-10-05T11:35:08.945 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.941+0000 7f26f5634780 1 < completed multipart upload key=6DP3UJ4CW1MO upload=DPVP5GU8GCBI tag=266TDJHHRDV1 type=write size=4088971 2023-10-05T11:35:08.946 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.943+0000 7f26f5634780 1 > prepared operation key=2U0NRDGDNUTA tag=9R7I8S1W3SVT type=del size=350981 2023-10-05T11:35:08.947 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.944+0000 7f26f5634780 1 < completed part key=_multipart_MEY4SZRHU9NZ.2~Y1OKZPI8R0QH.0 size=1048576 2023-10-05T11:35:08.948 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.945+0000 7f26f5634780 1 < completed part key=_multipart_MEY4SZRHU9NZ.2~Y1OKZPI8R0QH.1 size=1048576 2023-10-05T11:35:08.949 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.946+0000 7f26f5634780 1 < completed part key=_multipart_MEY4SZRHU9NZ.2~Y1OKZPI8R0QH.2 size=684288 2023-10-05T11:35:08.951 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.948+0000 7f26f5634780 1 < completed multipart upload key=MEY4SZRHU9NZ upload=Y1OKZPI8R0QH tag=PTLK6O3NKHDR type=write size=3830016 2023-10-05T11:35:08.953 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.950+0000 7f26f5634780 1 > prepared part key=_multipart_2D4PDQQT54ZA.2~KUKDTO0IHF8A.0 size=1048576 2023-10-05T11:35:08.954 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.950+0000 7f26f5634780 1 > prepared part key=_multipart_2D4PDQQT54ZA.2~KUKDTO0IHF8A.1 size=47787 2023-10-05T11:35:08.954 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.950+0000 7f26f5634780 1 > prepared multipart upload key=2D4PDQQT54ZA upload=KUKDTO0IHF8A tag=B8FB6SCC1OMH type=write size=2144939 2023-10-05T11:35:08.956 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.953+0000 7f26f5634780 1 < suggested update operation key=2U0NRDGDNUTA tag=HWLKP4JBB1PF type=write size=814099 2023-10-05T11:35:08.958 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.955+0000 7f26f5634780 1 > prepared part key=_multipart_J5EIH25Y471T.2~ZL49Q5JBA8V0.0 size=1048576 2023-10-05T11:35:08.959 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.956+0000 7f26f5634780 1 > prepared part key=_multipart_J5EIH25Y471T.2~ZL49Q5JBA8V0.1 size=1048576 2023-10-05T11:35:08.960 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.956+0000 7f26f5634780 1 > prepared part key=_multipart_J5EIH25Y471T.2~ZL49Q5JBA8V0.2 size=234990 2023-10-05T11:35:08.960 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.956+0000 7f26f5634780 1 > prepared multipart upload key=J5EIH25Y471T upload=ZL49Q5JBA8V0 tag=0RULJ9U2SG37 type=write size=3380718 2023-10-05T11:35:08.961 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.958+0000 7f26f5634780 1 < completed delete operation key=761J2C7GHWU5 tag=ZQU1PTTV53OK type=del 2023-10-05T11:35:08.963 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.960+0000 7f26f5634780 1 > prepared part key=_multipart_7TOP5A52M9YP.2~1XZOQIAFLKC0.0 size=1048576 2023-10-05T11:35:08.964 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.961+0000 7f26f5634780 1 > prepared part key=_multipart_7TOP5A52M9YP.2~1XZOQIAFLKC0.1 size=1048576 2023-10-05T11:35:08.965 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.962+0000 7f26f5634780 1 > prepared part key=_multipart_7TOP5A52M9YP.2~1XZOQIAFLKC0.2 size=340012 2023-10-05T11:35:08.965 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.962+0000 7f26f5634780 1 > prepared multipart upload key=7TOP5A52M9YP upload=1XZOQIAFLKC0 tag=B13GC0S2S44D type=write size=3485740 2023-10-05T11:35:08.966 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.963+0000 7f26f5634780 1 < completed part key=_multipart_PC8WTJ8AYJ24.2~C1SAF7WLXKZE.0 size=1048576 2023-10-05T11:35:08.967 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.964+0000 7f26f5634780 1 < completed part key=_multipart_PC8WTJ8AYJ24.2~C1SAF7WLXKZE.1 size=1020208 2023-10-05T11:35:08.969 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.966+0000 7f26f5634780 1 < completed multipart upload key=PC8WTJ8AYJ24 upload=C1SAF7WLXKZE tag=7MT294MZ661G type=write size=3117360 2023-10-05T11:35:08.970 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.967+0000 7f26f5634780 1 > prepared operation key=761J2C7GHWU5 tag=TPCKLIOB7DXR type=del size=2963986 2023-10-05T11:35:08.972 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.968+0000 7f26f5634780 1 < completed part key=_multipart_4D3H60UTIXH3.2~X2NEVDNYK95Q.0 size=1048576 2023-10-05T11:35:08.973 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.969+0000 7f26f5634780 1 < completed part key=_multipart_4D3H60UTIXH3.2~X2NEVDNYK95Q.1 size=1048576 2023-10-05T11:35:08.974 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.971+0000 7f26f5634780 1 < completed part key=_multipart_4D3H60UTIXH3.2~X2NEVDNYK95Q.2 size=195373 2023-10-05T11:35:08.976 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.973+0000 7f26f5634780 1 < completed multipart upload key=4D3H60UTIXH3 upload=X2NEVDNYK95Q tag=V2M3QTMQ1Q3D type=write size=3341101 2023-10-05T11:35:08.979 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.975+0000 7f26f5634780 1 > prepared part key=_multipart_QYQDXVIGZ7O8.2~2ICY7HO8L738.0 size=154401 2023-10-05T11:35:08.979 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.975+0000 7f26f5634780 1 > prepared multipart upload key=QYQDXVIGZ7O8 upload=2ICY7HO8L738 tag=G723J7A003YD type=write size=1202977 2023-10-05T11:35:08.979 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.976+0000 7f26f5634780 1 < canceled part key=_multipart_VJTFYDETLSFD.2~LR2534TT2ECW.0 size=1048576 2023-10-05T11:35:08.980 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.977+0000 7f26f5634780 1 < completed part key=_multipart_VJTFYDETLSFD.2~LR2534TT2ECW.1 size=1048576 2023-10-05T11:35:08.981 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.978+0000 7f26f5634780 1 < completed part key=_multipart_VJTFYDETLSFD.2~LR2534TT2ECW.2 size=556872 2023-10-05T11:35:08.983 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.980+0000 7f26f5634780 1 < canceled multipart upload key=VJTFYDETLSFD upload=LR2534TT2ECW tag=0DKJM6DMMLR0 type=write size=3702600 2023-10-05T11:35:08.986 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.982+0000 7f26f5634780 1 > prepared part key=_multipart_MEY4SZRHU9NZ.2~K51Q5WPUA56B.0 size=815172 2023-10-05T11:35:08.986 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.982+0000 7f26f5634780 1 > prepared multipart upload key=MEY4SZRHU9NZ upload=K51Q5WPUA56B tag=PKRVPUL6N830 type=write size=1863748 2023-10-05T11:35:08.987 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.984+0000 7f26f5634780 1 < completed write operation key=0PWYKC7S6YJ4 tag=3HLJI7G5S2DZ type=write size=627573 2023-10-05T11:35:08.988 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.985+0000 7f26f5634780 1 > prepared operation key=4D3H60UTIXH3 tag=85DHX3ZC77Y1 type=write size=822508 2023-10-05T11:35:08.989 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.986+0000 7f26f5634780 1 < completed part key=_multipart_BU3KSHTINB36.2~BXO63HI8EROG.0 size=1048576 2023-10-05T11:35:08.990 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.987+0000 7f26f5634780 1 < completed part key=_multipart_BU3KSHTINB36.2~BXO63HI8EROG.1 size=1048576 2023-10-05T11:35:08.991 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.988+0000 7f26f5634780 1 < completed part key=_multipart_BU3KSHTINB36.2~BXO63HI8EROG.2 size=932927 2023-10-05T11:35:08.993 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.990+0000 7f26f5634780 1 < completed multipart upload key=BU3KSHTINB36 upload=BXO63HI8EROG tag=3Q8LZHV3KF8Z type=write size=4078655 2023-10-05T11:35:08.995 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.992+0000 7f26f5634780 1 > prepared operation key=4D3H60UTIXH3 tag=024BAX50TMH6 type=del size=1715506 2023-10-05T11:35:08.996 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.993+0000 7f26f5634780 1 < completed part key=_multipart_PNV0Q6ZPLYV0.2~C15ZC9XU3HTE.0 size=926690 2023-10-05T11:35:08.999 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.995+0000 7f26f5634780 1 < completed multipart upload key=PNV0Q6ZPLYV0 upload=C15ZC9XU3HTE tag=QY2QT47N16EX type=write size=1975266 2023-10-05T11:35:09.001 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.998+0000 7f26f5634780 1 > prepared part key=_multipart_6DP3UJ4CW1MO.2~XQ56RF0YYFKI.0 size=1048576 2023-10-05T11:35:09.002 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:08.999+0000 7f26f5634780 1 > prepared part key=_multipart_6DP3UJ4CW1MO.2~XQ56RF0YYFKI.1 size=1048576 2023-10-05T11:35:09.003 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.000+0000 7f26f5634780 1 > prepared part key=_multipart_6DP3UJ4CW1MO.2~XQ56RF0YYFKI.2 size=128611 2023-10-05T11:35:09.003 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.000+0000 7f26f5634780 1 > prepared multipart upload key=6DP3UJ4CW1MO upload=XQ56RF0YYFKI tag=T2QCVRVG0XZR type=write size=3274339 2023-10-05T11:35:09.004 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.001+0000 7f26f5634780 1 < completed delete operation key=2D4PDQQT54ZA tag=QNC91T9UAUDO type=del 2023-10-05T11:35:09.007 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.003+0000 7f26f5634780 1 > prepared part key=_multipart_7W9LL5HSU3BG.2~XHHA06UOYUJU.0 size=768279 2023-10-05T11:35:09.007 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.003+0000 7f26f5634780 1 > prepared multipart upload key=7W9LL5HSU3BG upload=XHHA06UOYUJU tag=IZV5LE2GDRQO type=write size=1816855 2023-10-05T11:35:09.010 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.006+0000 7f26f5634780 1 < suggested update operation key=7TOP5A52M9YP tag=D3MP15BAV8ZZ type=del size=2128695 2023-10-05T11:35:09.011 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.008+0000 7f26f5634780 1 > prepared operation key=FOMNIIY47UUM tag=F5KS292G0FNI type=del size=1818761 2023-10-05T11:35:09.012 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.009+0000 7f26f5634780 1 < completed part key=_multipart_J5EIH25Y471T.2~0IG122ICAXPX.0 size=1048576 2023-10-05T11:35:09.013 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.010+0000 7f26f5634780 1 < completed part key=_multipart_J5EIH25Y471T.2~0IG122ICAXPX.1 size=1048576 2023-10-05T11:35:09.014 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.011+0000 7f26f5634780 1 < completed part key=_multipart_J5EIH25Y471T.2~0IG122ICAXPX.2 size=645049 2023-10-05T11:35:09.016 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.013+0000 7f26f5634780 1 < completed multipart upload key=J5EIH25Y471T upload=0IG122ICAXPX tag=40HX25IHMUKH type=write size=3790777 2023-10-05T11:35:09.017 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.014+0000 7f26f5634780 1 > prepared operation key=PNV0Q6ZPLYV0 tag=7UUXHFPW14VX type=del size=2106599 2023-10-05T11:35:09.018 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.015+0000 7f26f5634780 1 < completed delete operation key=PNV0Q6ZPLYV0 tag=P8I1I8EP37YW type=del 2023-10-05T11:35:09.020 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.017+0000 7f26f5634780 1 > prepared part key=_multipart_PC8WTJ8AYJ24.2~2W1RZZL1SW9U.0 size=1048576 2023-10-05T11:35:09.021 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.018+0000 7f26f5634780 1 > prepared part key=_multipart_PC8WTJ8AYJ24.2~2W1RZZL1SW9U.1 size=709734 2023-10-05T11:35:09.022 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.018+0000 7f26f5634780 1 > prepared multipart upload key=PC8WTJ8AYJ24 upload=2W1RZZL1SW9U tag=05IS058BGRMS type=write size=2806886 2023-10-05T11:35:09.023 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.019+0000 7f26f5634780 1 < completed write operation key=761J2C7GHWU5 tag=HAMGXHE92207 type=write size=641434 2023-10-05T11:35:09.024 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.020+0000 7f26f5634780 1 > prepared operation key=J5EIH25Y471T tag=LITNQUB1KUCI type=del size=938713 2023-10-05T11:35:09.026 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.023+0000 7f26f5634780 1 < suggested update operation key=IC7T3ZK81WQS tag=T5Z5OF2ARRNW type=del size=3247321 2023-10-05T11:35:09.027 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.024+0000 7f26f5634780 1 > prepared operation key=IC7T3ZK81WQS tag=2NOROU2U7EXI type=write size=425492 2023-10-05T11:35:09.028 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.025+0000 7f26f5634780 -1 < failed to complete operation key=2U0NRDGDNUTA tag=9R7I8S1W3SVT type=del size=350981: (22) Invalid argument 2023-10-05T11:35:09.029 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.026+0000 7f26f5634780 1 > prepared operation key=7W9LL5HSU3BG tag=9HXMK8GGLHWH type=del size=1793324 2023-10-05T11:35:09.031 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.027+0000 7f26f5634780 1 < completed part key=_multipart_2D4PDQQT54ZA.2~KUKDTO0IHF8A.0 size=1048576 2023-10-05T11:35:09.032 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.028+0000 7f26f5634780 1 < completed part key=_multipart_2D4PDQQT54ZA.2~KUKDTO0IHF8A.1 size=47787 2023-10-05T11:35:09.034 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.030+0000 7f26f5634780 1 < completed multipart upload key=2D4PDQQT54ZA upload=KUKDTO0IHF8A tag=B8FB6SCC1OMH type=write size=2144939 2023-10-05T11:35:09.035 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.031+0000 7f26f5634780 1 > prepared operation key=LLR5J3X15W5R tag=NJ3X2P6077XK type=del size=204136 2023-10-05T11:35:09.036 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.033+0000 7f26f5634780 1 < completed part key=_multipart_J5EIH25Y471T.2~ZL49Q5JBA8V0.0 size=1048576 2023-10-05T11:35:09.037 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.034+0000 7f26f5634780 1 < completed part key=_multipart_J5EIH25Y471T.2~ZL49Q5JBA8V0.1 size=1048576 2023-10-05T11:35:09.038 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.034+0000 7f26f5634780 1 < completed part key=_multipart_J5EIH25Y471T.2~ZL49Q5JBA8V0.2 size=234990 2023-10-05T11:35:09.040 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.036+0000 7f26f5634780 1 < completed multipart upload key=J5EIH25Y471T upload=ZL49Q5JBA8V0 tag=0RULJ9U2SG37 type=write size=3380718 2023-10-05T11:35:09.041 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.038+0000 7f26f5634780 1 > prepared operation key=9S0YW7PPSJ8G tag=J39CUUIVYAOV type=del size=751879 2023-10-05T11:35:09.042 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.039+0000 7f26f5634780 1 < completed part key=_multipart_7TOP5A52M9YP.2~1XZOQIAFLKC0.0 size=1048576 2023-10-05T11:35:09.043 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.040+0000 7f26f5634780 1 < completed part key=_multipart_7TOP5A52M9YP.2~1XZOQIAFLKC0.1 size=1048576 2023-10-05T11:35:09.043 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.040+0000 7f26f5634780 1 < canceled part key=_multipart_7TOP5A52M9YP.2~1XZOQIAFLKC0.2 size=340012 2023-10-05T11:35:09.045 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.042+0000 7f26f5634780 1 < canceled multipart upload key=7TOP5A52M9YP upload=1XZOQIAFLKC0 tag=B13GC0S2S44D type=write size=3485740 2023-10-05T11:35:09.046 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.043+0000 7f26f5634780 1 > prepared operation key=VJTFYDETLSFD tag=SKC6P6BPRNZ4 type=del size=938588 2023-10-05T11:35:09.047 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.044+0000 7f26f5634780 1 < completed delete operation key=761J2C7GHWU5 tag=TPCKLIOB7DXR type=del 2023-10-05T11:35:09.049 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.045+0000 7f26f5634780 1 > prepared operation key=5V0Q651D4VN2 tag=FXFCK38GYZX8 type=del size=457162 2023-10-05T11:35:09.050 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.047+0000 7f26f5634780 1 < completed part key=_multipart_QYQDXVIGZ7O8.2~2ICY7HO8L738.0 size=154401 2023-10-05T11:35:09.052 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.049+0000 7f26f5634780 1 < completed multipart upload key=QYQDXVIGZ7O8 upload=2ICY7HO8L738 tag=G723J7A003YD type=write size=1202977 2023-10-05T11:35:09.053 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.050+0000 7f26f5634780 1 > prepared operation key=PC8WTJ8AYJ24 tag=278XCTY3CQOJ type=del size=1960440 2023-10-05T11:35:09.054 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.051+0000 7f26f5634780 1 < completed part key=_multipart_MEY4SZRHU9NZ.2~K51Q5WPUA56B.0 size=815172 2023-10-05T11:35:09.056 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.053+0000 7f26f5634780 1 < completed multipart upload key=MEY4SZRHU9NZ upload=K51Q5WPUA56B tag=PKRVPUL6N830 type=write size=1863748 2023-10-05T11:35:09.059 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.055+0000 7f26f5634780 1 > prepared part key=_multipart_J5EIH25Y471T.2~2WO4MK6AP7IR.0 size=1048576 2023-10-05T11:35:09.060 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.056+0000 7f26f5634780 1 > prepared part key=_multipart_J5EIH25Y471T.2~2WO4MK6AP7IR.1 size=1048576 2023-10-05T11:35:09.060 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.057+0000 7f26f5634780 1 > prepared part key=_multipart_J5EIH25Y471T.2~2WO4MK6AP7IR.2 size=54931 2023-10-05T11:35:09.061 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.057+0000 7f26f5634780 1 > prepared multipart upload key=J5EIH25Y471T upload=2WO4MK6AP7IR tag=QWE6YZI7A2NC type=write size=3200659 2023-10-05T11:35:09.062 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.058+0000 7f26f5634780 1 < completed write operation key=4D3H60UTIXH3 tag=85DHX3ZC77Y1 type=write size=822508 2023-10-05T11:35:09.064 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.060+0000 7f26f5634780 1 > prepared part key=_multipart_PNV0Q6ZPLYV0.2~55ZKEA9AZSX2.0 size=32546 2023-10-05T11:35:09.064 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.060+0000 7f26f5634780 1 > prepared multipart upload key=PNV0Q6ZPLYV0 upload=55ZKEA9AZSX2 tag=WU3II3XV6H7I type=write size=1081122 2023-10-05T11:35:09.065 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.062+0000 7f26f5634780 1 < completed delete operation key=4D3H60UTIXH3 tag=024BAX50TMH6 type=del 2023-10-05T11:35:09.067 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.064+0000 7f26f5634780 1 > prepared part key=_multipart_5OPHKTHXVN5U.2~1H01I9PMJQ14.0 size=506306 2023-10-05T11:35:09.067 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.064+0000 7f26f5634780 1 > prepared multipart upload key=5OPHKTHXVN5U upload=1H01I9PMJQ14 tag=I6TOVQHQVE6R type=write size=1554882 2023-10-05T11:35:09.069 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.066+0000 7f26f5634780 1 < completed part key=_multipart_6DP3UJ4CW1MO.2~XQ56RF0YYFKI.0 size=1048576 2023-10-05T11:35:09.070 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.067+0000 7f26f5634780 1 < completed part key=_multipart_6DP3UJ4CW1MO.2~XQ56RF0YYFKI.1 size=1048576 2023-10-05T11:35:09.071 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.068+0000 7f26f5634780 1 < completed part key=_multipart_6DP3UJ4CW1MO.2~XQ56RF0YYFKI.2 size=128611 2023-10-05T11:35:09.073 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.070+0000 7f26f5634780 1 < completed multipart upload key=6DP3UJ4CW1MO upload=XQ56RF0YYFKI tag=T2QCVRVG0XZR type=write size=3274339 2023-10-05T11:35:09.075 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.072+0000 7f26f5634780 1 > prepared part key=_multipart_IC7T3ZK81WQS.2~8E438MWC3MD5.0 size=1048576 2023-10-05T11:35:09.076 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.073+0000 7f26f5634780 1 > prepared part key=_multipart_IC7T3ZK81WQS.2~8E438MWC3MD5.1 size=1048576 2023-10-05T11:35:09.077 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.074+0000 7f26f5634780 1 > prepared part key=_multipart_IC7T3ZK81WQS.2~8E438MWC3MD5.2 size=714283 2023-10-05T11:35:09.077 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.074+0000 7f26f5634780 1 > prepared multipart upload key=IC7T3ZK81WQS upload=8E438MWC3MD5 tag=A95IGD7CZXLD type=write size=3860011 2023-10-05T11:35:09.078 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.075+0000 7f26f5634780 1 < completed part key=_multipart_7W9LL5HSU3BG.2~XHHA06UOYUJU.0 size=768279 2023-10-05T11:35:09.080 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.077+0000 7f26f5634780 1 < completed multipart upload key=7W9LL5HSU3BG upload=XHHA06UOYUJU tag=IZV5LE2GDRQO type=write size=1816855 2023-10-05T11:35:09.082 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.078+0000 7f26f5634780 1 > prepared operation key=WTCWG1C1SF89 tag=BUIGKIHK0FGJ type=del size=3883002 2023-10-05T11:35:09.084 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.081+0000 7f26f5634780 1 < suggested update operation key=FOMNIIY47UUM tag=F5KS292G0FNI type=del size=1818761 2023-10-05T11:35:09.085 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.082+0000 7f26f5634780 1 > prepared operation key=2U0NRDGDNUTA tag=IJPXWDBEMX5G type=write size=61139 2023-10-05T11:35:09.087 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.083+0000 7f26f5634780 1 < completed delete operation key=PNV0Q6ZPLYV0 tag=7UUXHFPW14VX type=del 2023-10-05T11:35:09.088 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.084+0000 7f26f5634780 1 > prepared operation key=LLR5J3X15W5R tag=X9E6EJDNI6CX type=del size=63834 2023-10-05T11:35:09.089 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.086+0000 7f26f5634780 1 < completed part key=_multipart_PC8WTJ8AYJ24.2~2W1RZZL1SW9U.0 size=1048576 2023-10-05T11:35:09.090 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.087+0000 7f26f5634780 1 < completed part key=_multipart_PC8WTJ8AYJ24.2~2W1RZZL1SW9U.1 size=709734 2023-10-05T11:35:09.092 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.089+0000 7f26f5634780 1 < completed multipart upload key=PC8WTJ8AYJ24 upload=2W1RZZL1SW9U tag=05IS058BGRMS type=write size=2806886 2023-10-05T11:35:09.093 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.090+0000 7f26f5634780 1 > prepared operation key=PNV0Q6ZPLYV0 tag=D9I07AN5XBM3 type=write size=255527 2023-10-05T11:35:09.095 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.091+0000 7f26f5634780 1 < completed delete operation key=J5EIH25Y471T tag=LITNQUB1KUCI type=del 2023-10-05T11:35:09.096 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.093+0000 7f26f5634780 1 > prepared operation key=5OPHKTHXVN5U tag=U2WE9M38UC76 type=del size=326423 2023-10-05T11:35:09.097 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.094+0000 7f26f5634780 1 < completed write operation key=IC7T3ZK81WQS tag=2NOROU2U7EXI type=write size=425492 2023-10-05T11:35:09.098 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.095+0000 7f26f5634780 1 > prepared operation key=2D4PDQQT54ZA tag=IY3NXVY8WW9G type=del size=2578461 2023-10-05T11:35:09.100 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.096+0000 7f26f5634780 1 < completed delete operation key=7W9LL5HSU3BG tag=9HXMK8GGLHWH type=del 2023-10-05T11:35:09.101 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.098+0000 7f26f5634780 1 > prepared operation key=7W9LL5HSU3BG tag=1G5D31QJ7MWE type=del size=2029391 2023-10-05T11:35:09.102 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.099+0000 7f26f5634780 1 < canceled operation key=LLR5J3X15W5R tag=NJ3X2P6077XK type=del size=204136 2023-10-05T11:35:09.104 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.100+0000 7f26f5634780 1 > prepared operation key=5OPHKTHXVN5U tag=Y5HA2GGNGL29 type=del size=936096 2023-10-05T11:35:09.105 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.102+0000 7f26f5634780 1 < completed delete operation key=9S0YW7PPSJ8G tag=J39CUUIVYAOV type=del 2023-10-05T11:35:09.107 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.104+0000 7f26f5634780 1 > prepared part key=_multipart_VJTFYDETLSFD.2~WB7EUBD05IX8.0 size=1048576 2023-10-05T11:35:09.108 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.105+0000 7f26f5634780 1 > prepared part key=_multipart_VJTFYDETLSFD.2~WB7EUBD05IX8.1 size=940433 2023-10-05T11:35:09.108 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.105+0000 7f26f5634780 1 > prepared multipart upload key=VJTFYDETLSFD upload=WB7EUBD05IX8 tag=BOG0P3OZLFEV type=write size=3037585 2023-10-05T11:35:09.111 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.107+0000 7f26f5634780 1 < suggested update operation key=VJTFYDETLSFD tag=SKC6P6BPRNZ4 type=del size=938588 2023-10-05T11:35:09.112 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.109+0000 7f26f5634780 1 > prepared operation key=BU3KSHTINB36 tag=PA9FTAI6O5R4 type=del size=1870999 2023-10-05T11:35:09.113 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.110+0000 7f26f5634780 1 < completed delete operation key=5V0Q651D4VN2 tag=FXFCK38GYZX8 type=del 2023-10-05T11:35:09.115 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.112+0000 7f26f5634780 1 > prepared part key=_multipart_MEY4SZRHU9NZ.2~JLO00DL3H4OJ.0 size=1048576 2023-10-05T11:35:09.116 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.113+0000 7f26f5634780 1 > prepared part key=_multipart_MEY4SZRHU9NZ.2~JLO00DL3H4OJ.1 size=32364 2023-10-05T11:35:09.117 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.113+0000 7f26f5634780 1 > prepared multipart upload key=MEY4SZRHU9NZ upload=JLO00DL3H4OJ tag=639WD0B4R6UM type=write size=2129516 2023-10-05T11:35:09.118 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.114+0000 7f26f5634780 1 < completed delete operation key=PC8WTJ8AYJ24 tag=278XCTY3CQOJ type=del 2023-10-05T11:35:09.119 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.116+0000 7f26f5634780 1 > prepared operation key=BTZUVE8R96XT tag=3L4Y4VD9JZNZ type=del size=1710753 2023-10-05T11:35:09.120 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.117+0000 7f26f5634780 1 < completed part key=_multipart_J5EIH25Y471T.2~2WO4MK6AP7IR.0 size=1048576 2023-10-05T11:35:09.121 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.118+0000 7f26f5634780 1 < completed part key=_multipart_J5EIH25Y471T.2~2WO4MK6AP7IR.1 size=1048576 2023-10-05T11:35:09.123 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.120+0000 7f26f5634780 1 < completed part key=_multipart_J5EIH25Y471T.2~2WO4MK6AP7IR.2 size=54931 2023-10-05T11:35:09.125 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.121+0000 7f26f5634780 1 < completed multipart upload key=J5EIH25Y471T upload=2WO4MK6AP7IR tag=QWE6YZI7A2NC type=write size=3200659 2023-10-05T11:35:09.127 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.124+0000 7f26f5634780 1 > prepared part key=_multipart_7W9LL5HSU3BG.2~QSF952IO39QC.0 size=342808 2023-10-05T11:35:09.127 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.124+0000 7f26f5634780 1 > prepared multipart upload key=7W9LL5HSU3BG upload=QSF952IO39QC tag=PW5LV9AA6VQG type=write size=1391384 2023-10-05T11:35:09.128 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.125+0000 7f26f5634780 1 < completed part key=_multipart_PNV0Q6ZPLYV0.2~55ZKEA9AZSX2.0 size=32546 2023-10-05T11:35:09.130 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.127+0000 7f26f5634780 1 < completed multipart upload key=PNV0Q6ZPLYV0 upload=55ZKEA9AZSX2 tag=WU3II3XV6H7I type=write size=1081122 2023-10-05T11:35:09.132 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.128+0000 7f26f5634780 1 > prepared operation key=7W9LL5HSU3BG tag=UB2EGLS1LC1V type=del size=4065614 2023-10-05T11:35:09.133 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.129+0000 7f26f5634780 1 < completed part key=_multipart_5OPHKTHXVN5U.2~1H01I9PMJQ14.0 size=506306 2023-10-05T11:35:09.135 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.131+0000 7f26f5634780 1 < completed multipart upload key=5OPHKTHXVN5U upload=1H01I9PMJQ14 tag=I6TOVQHQVE6R type=write size=1554882 2023-10-05T11:35:09.137 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.134+0000 7f26f5634780 1 > prepared part key=_multipart_S3DKYDFT4IO2.2~A1EG2HKGEAUI.0 size=1048576 2023-10-05T11:35:09.138 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.135+0000 7f26f5634780 1 > prepared part key=_multipart_S3DKYDFT4IO2.2~A1EG2HKGEAUI.1 size=1048576 2023-10-05T11:35:09.139 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.136+0000 7f26f5634780 1 > prepared part key=_multipart_S3DKYDFT4IO2.2~A1EG2HKGEAUI.2 size=704839 2023-10-05T11:35:09.139 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.136+0000 7f26f5634780 1 > prepared multipart upload key=S3DKYDFT4IO2 upload=A1EG2HKGEAUI tag=6A26K8DJT833 type=write size=3850567 2023-10-05T11:35:09.140 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.137+0000 7f26f5634780 1 < completed part key=_multipart_IC7T3ZK81WQS.2~8E438MWC3MD5.0 size=1048576 2023-10-05T11:35:09.141 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.138+0000 7f26f5634780 1 < completed part key=_multipart_IC7T3ZK81WQS.2~8E438MWC3MD5.1 size=1048576 2023-10-05T11:35:09.142 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.139+0000 7f26f5634780 1 < completed part key=_multipart_IC7T3ZK81WQS.2~8E438MWC3MD5.2 size=714283 2023-10-05T11:35:09.144 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.141+0000 7f26f5634780 1 < completed multipart upload key=IC7T3ZK81WQS upload=8E438MWC3MD5 tag=A95IGD7CZXLD type=write size=3860011 2023-10-05T11:35:09.145 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.142+0000 7f26f5634780 1 > prepared operation key=761J2C7GHWU5 tag=0ZEZNK216588 type=del size=1471350 2023-10-05T11:35:09.147 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.143+0000 7f26f5634780 1 < completed delete operation key=WTCWG1C1SF89 tag=BUIGKIHK0FGJ type=del 2023-10-05T11:35:09.148 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.144+0000 7f26f5634780 1 > prepared operation key=WTCWG1C1SF89 tag=UXH44S1DHDXO type=del size=782064 2023-10-05T11:35:09.149 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.145+0000 7f26f5634780 1 < completed write operation key=2U0NRDGDNUTA tag=IJPXWDBEMX5G type=write size=61139 2023-10-05T11:35:09.151 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.147+0000 7f26f5634780 1 > prepared part key=_multipart_MEY4SZRHU9NZ.2~6CIA7UQNU50P.0 size=1048576 2023-10-05T11:35:09.152 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.148+0000 7f26f5634780 1 > prepared part key=_multipart_MEY4SZRHU9NZ.2~6CIA7UQNU50P.1 size=1048576 2023-10-05T11:35:09.153 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.149+0000 7f26f5634780 1 > prepared part key=_multipart_MEY4SZRHU9NZ.2~6CIA7UQNU50P.2 size=504511 2023-10-05T11:35:09.153 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.149+0000 7f26f5634780 1 > prepared multipart upload key=MEY4SZRHU9NZ upload=6CIA7UQNU50P tag=ONF2WLU27UEU type=write size=3650239 2023-10-05T11:35:09.154 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.151+0000 7f26f5634780 1 < completed delete operation key=LLR5J3X15W5R tag=X9E6EJDNI6CX type=del 2023-10-05T11:35:09.155 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.152+0000 7f26f5634780 1 > prepared operation key=761J2C7GHWU5 tag=A7F86CQAL7JK type=del size=729146 2023-10-05T11:35:09.156 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.153+0000 7f26f5634780 1 < canceled operation key=PNV0Q6ZPLYV0 tag=D9I07AN5XBM3 type=write size=255527 2023-10-05T11:35:09.158 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.155+0000 7f26f5634780 1 > prepared part key=_multipart_9S0YW7PPSJ8G.2~TEJIRWGIFTC3.0 size=1048576 2023-10-05T11:35:09.159 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.156+0000 7f26f5634780 1 > prepared part key=_multipart_9S0YW7PPSJ8G.2~TEJIRWGIFTC3.1 size=258241 2023-10-05T11:35:09.160 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.156+0000 7f26f5634780 1 > prepared multipart upload key=9S0YW7PPSJ8G upload=TEJIRWGIFTC3 tag=O3KGLM6Q5FFY type=write size=2355393 2023-10-05T11:35:09.160 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.157+0000 7f26f5634780 1 < completed delete operation key=5OPHKTHXVN5U tag=U2WE9M38UC76 type=del 2023-10-05T11:35:09.162 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.158+0000 7f26f5634780 1 > prepared operation key=7TOP5A52M9YP tag=OEOYYYRNQINP type=write size=591021 2023-10-05T11:35:09.163 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.160+0000 7f26f5634780 1 < completed delete operation key=2D4PDQQT54ZA tag=IY3NXVY8WW9G type=del 2023-10-05T11:35:09.165 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.162+0000 7f26f5634780 1 > prepared part key=_multipart_WYN9BG66LA3K.2~9PLZRN072UU7.0 size=1048576 2023-10-05T11:35:09.166 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.163+0000 7f26f5634780 1 > prepared part key=_multipart_WYN9BG66LA3K.2~9PLZRN072UU7.1 size=1048576 2023-10-05T11:35:09.167 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.163+0000 7f26f5634780 1 > prepared part key=_multipart_WYN9BG66LA3K.2~9PLZRN072UU7.2 size=778768 2023-10-05T11:35:09.167 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.164+0000 7f26f5634780 1 > prepared multipart upload key=WYN9BG66LA3K upload=9PLZRN072UU7 tag=X5ZSRXN8WW8V type=write size=3924496 2023-10-05T11:35:09.170 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.166+0000 7f26f5634780 1 < suggested update operation key=7W9LL5HSU3BG tag=1G5D31QJ7MWE type=del size=2029391 2023-10-05T11:35:09.171 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.167+0000 7f26f5634780 1 > prepared operation key=PC8WTJ8AYJ24 tag=K5AS5BSZ4S9K type=del size=458616 2023-10-05T11:35:09.173 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.170+0000 7f26f5634780 1 < suggested update operation key=5OPHKTHXVN5U tag=Y5HA2GGNGL29 type=del size=936096 2023-10-05T11:35:09.176 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.172+0000 7f26f5634780 1 > prepared part key=_multipart_4IBQJLJR7LD8.2~UUJV2CSEQ80W.0 size=1048576 2023-10-05T11:35:09.176 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.173+0000 7f26f5634780 1 > prepared part key=_multipart_4IBQJLJR7LD8.2~UUJV2CSEQ80W.1 size=544375 2023-10-05T11:35:09.176 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.173+0000 7f26f5634780 1 > prepared multipart upload key=4IBQJLJR7LD8 upload=UUJV2CSEQ80W tag=1E34EJEZAH6R type=write size=2641527 2023-10-05T11:35:09.178 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.174+0000 7f26f5634780 1 < completed part key=_multipart_VJTFYDETLSFD.2~WB7EUBD05IX8.0 size=1048576 2023-10-05T11:35:09.178 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.174+0000 7f26f5634780 1 < canceled part key=_multipart_VJTFYDETLSFD.2~WB7EUBD05IX8.1 size=940433 2023-10-05T11:35:09.180 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.176+0000 7f26f5634780 1 < canceled multipart upload key=VJTFYDETLSFD upload=WB7EUBD05IX8 tag=BOG0P3OZLFEV type=write size=3037585 2023-10-05T11:35:09.181 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.177+0000 7f26f5634780 1 > prepared operation key=WYN9BG66LA3K tag=1OGLGW5BS0DD type=del size=370707 2023-10-05T11:35:09.182 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.179+0000 7f26f5634780 1 < completed delete operation key=BU3KSHTINB36 tag=PA9FTAI6O5R4 type=del 2023-10-05T11:35:09.183 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.180+0000 7f26f5634780 1 > prepared operation key=U6172JUYW7J6 tag=G0WM1SDVDAWK type=del size=432198 2023-10-05T11:35:09.185 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.181+0000 7f26f5634780 1 < completed part key=_multipart_MEY4SZRHU9NZ.2~JLO00DL3H4OJ.0 size=1048576 2023-10-05T11:35:09.186 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.182+0000 7f26f5634780 1 < completed part key=_multipart_MEY4SZRHU9NZ.2~JLO00DL3H4OJ.1 size=32364 2023-10-05T11:35:09.187 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.184+0000 7f26f5634780 1 < completed multipart upload key=MEY4SZRHU9NZ upload=JLO00DL3H4OJ tag=639WD0B4R6UM type=write size=2129516 2023-10-05T11:35:09.190 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.186+0000 7f26f5634780 1 > prepared part key=_multipart_4IBQJLJR7LD8.2~PP9A9GQ12RVR.0 size=148672 2023-10-05T11:35:09.190 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.186+0000 7f26f5634780 1 > prepared multipart upload key=4IBQJLJR7LD8 upload=PP9A9GQ12RVR tag=NMUTZ90RP6I6 type=write size=1197248 2023-10-05T11:35:09.193 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.190+0000 7f26f5634780 1 < suggested update operation key=BTZUVE8R96XT tag=3L4Y4VD9JZNZ type=del size=1710753 2023-10-05T11:35:09.194 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.191+0000 7f26f5634780 1 > prepared operation key=VJTFYDETLSFD tag=ZGZCQ1THIUZV type=del size=1184945 2023-10-05T11:35:09.196 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.192+0000 7f26f5634780 1 < completed part key=_multipart_7W9LL5HSU3BG.2~QSF952IO39QC.0 size=342808 2023-10-05T11:35:09.198 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.194+0000 7f26f5634780 1 < completed multipart upload key=7W9LL5HSU3BG upload=QSF952IO39QC tag=PW5LV9AA6VQG type=write size=1391384 2023-10-05T11:35:09.200 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.197+0000 7f26f5634780 1 > prepared part key=_multipart_8IPCP77WVVZT.2~5958OAUZ28OR.0 size=1048576 2023-10-05T11:35:09.201 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.198+0000 7f26f5634780 1 > prepared part key=_multipart_8IPCP77WVVZT.2~5958OAUZ28OR.1 size=844935 2023-10-05T11:35:09.201 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.198+0000 7f26f5634780 1 > prepared multipart upload key=8IPCP77WVVZT upload=5958OAUZ28OR tag=4PQ30808Y8WZ type=write size=2942087 2023-10-05T11:35:09.203 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.200+0000 7f26f5634780 1 < suggested remove operation key=7W9LL5HSU3BG tag=UB2EGLS1LC1V type=del 2023-10-05T11:35:09.205 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.201+0000 7f26f5634780 1 > prepared operation key=2D4PDQQT54ZA tag=QMZ1JLLX46X3 type=del size=230443 2023-10-05T11:35:09.206 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.202+0000 7f26f5634780 1 < completed part key=_multipart_S3DKYDFT4IO2.2~A1EG2HKGEAUI.0 size=1048576 2023-10-05T11:35:09.206 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.202+0000 7f26f5634780 1 < canceled part key=_multipart_S3DKYDFT4IO2.2~A1EG2HKGEAUI.1 size=1048576 2023-10-05T11:35:09.207 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.204+0000 7f26f5634780 1 < completed part key=_multipart_S3DKYDFT4IO2.2~A1EG2HKGEAUI.2 size=704839 2023-10-05T11:35:09.209 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.206+0000 7f26f5634780 1 < canceled multipart upload key=S3DKYDFT4IO2 upload=A1EG2HKGEAUI tag=6A26K8DJT833 type=write size=3850567 2023-10-05T11:35:09.212 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.208+0000 7f26f5634780 1 > prepared part key=_multipart_PNV0Q6ZPLYV0.2~2B2S6K81FE4K.0 size=702354 2023-10-05T11:35:09.212 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.208+0000 7f26f5634780 1 > prepared multipart upload key=PNV0Q6ZPLYV0 upload=2B2S6K81FE4K tag=CXWFRY3LSTYK type=write size=1750930 2023-10-05T11:35:09.213 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.209+0000 7f26f5634780 1 < completed delete operation key=761J2C7GHWU5 tag=0ZEZNK216588 type=del 2023-10-05T11:35:09.214 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.211+0000 7f26f5634780 1 > prepared operation key=FOMNIIY47UUM tag=YNMW0KBU661W type=del size=313748 2023-10-05T11:35:09.215 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.212+0000 7f26f5634780 1 < completed delete operation key=WTCWG1C1SF89 tag=UXH44S1DHDXO type=del 2023-10-05T11:35:09.216 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.213+0000 7f26f5634780 1 > prepared operation key=U6172JUYW7J6 tag=XQXPL87EWJWG type=del size=201526 2023-10-05T11:35:09.218 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.214+0000 7f26f5634780 1 < completed part key=_multipart_MEY4SZRHU9NZ.2~6CIA7UQNU50P.0 size=1048576 2023-10-05T11:35:09.219 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.215+0000 7f26f5634780 1 < completed part key=_multipart_MEY4SZRHU9NZ.2~6CIA7UQNU50P.1 size=1048576 2023-10-05T11:35:09.220 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.216+0000 7f26f5634780 1 < completed part key=_multipart_MEY4SZRHU9NZ.2~6CIA7UQNU50P.2 size=504511 2023-10-05T11:35:09.222 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.218+0000 7f26f5634780 1 < completed multipart upload key=MEY4SZRHU9NZ upload=6CIA7UQNU50P tag=ONF2WLU27UEU type=write size=3650239 2023-10-05T11:35:09.224 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.221+0000 7f26f5634780 1 > prepared part key=_multipart_4D3H60UTIXH3.2~FH615UG5Q70D.0 size=420951 2023-10-05T11:35:09.224 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.221+0000 7f26f5634780 1 > prepared multipart upload key=4D3H60UTIXH3 upload=FH615UG5Q70D tag=8SX4CLYF0ONF type=write size=1469527 2023-10-05T11:35:09.225 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.222+0000 7f26f5634780 1 < canceled operation key=761J2C7GHWU5 tag=A7F86CQAL7JK type=del size=729146 2023-10-05T11:35:09.226 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.223+0000 7f26f5634780 1 > prepared operation key=QYQDXVIGZ7O8 tag=315VPN68CS31 type=del size=2537820 2023-10-05T11:35:09.228 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.224+0000 7f26f5634780 1 < completed part key=_multipart_9S0YW7PPSJ8G.2~TEJIRWGIFTC3.0 size=1048576 2023-10-05T11:35:09.229 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.225+0000 7f26f5634780 1 < completed part key=_multipart_9S0YW7PPSJ8G.2~TEJIRWGIFTC3.1 size=258241 2023-10-05T11:35:09.231 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.228+0000 7f26f5634780 1 < completed multipart upload key=9S0YW7PPSJ8G upload=TEJIRWGIFTC3 tag=O3KGLM6Q5FFY type=write size=2355393 2023-10-05T11:35:09.233 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.230+0000 7f26f5634780 1 > prepared part key=_multipart_FOMNIIY47UUM.2~4S7WL6MD4DJU.0 size=1048576 2023-10-05T11:35:09.234 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.231+0000 7f26f5634780 1 > prepared part key=_multipart_FOMNIIY47UUM.2~4S7WL6MD4DJU.1 size=664907 2023-10-05T11:35:09.234 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.231+0000 7f26f5634780 1 > prepared multipart upload key=FOMNIIY47UUM upload=4S7WL6MD4DJU tag=BVARE3S5L1D9 type=write size=2762059 2023-10-05T11:35:09.238 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.234+0000 7f26f5634780 1 < suggested remove operation key=7TOP5A52M9YP tag=OEOYYYRNQINP type=write 2023-10-05T11:35:09.239 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.235+0000 7f26f5634780 1 > prepared operation key=IC7T3ZK81WQS tag=M7U8NJQJYKJ3 type=del size=1005674 2023-10-05T11:35:09.240 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.236+0000 7f26f5634780 1 < completed part key=_multipart_WYN9BG66LA3K.2~9PLZRN072UU7.0 size=1048576 2023-10-05T11:35:09.241 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.237+0000 7f26f5634780 1 < completed part key=_multipart_WYN9BG66LA3K.2~9PLZRN072UU7.1 size=1048576 2023-10-05T11:35:09.242 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.238+0000 7f26f5634780 1 < completed part key=_multipart_WYN9BG66LA3K.2~9PLZRN072UU7.2 size=778768 2023-10-05T11:35:09.244 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.240+0000 7f26f5634780 1 < completed multipart upload key=WYN9BG66LA3K upload=9PLZRN072UU7 tag=X5ZSRXN8WW8V type=write size=3924496 2023-10-05T11:35:09.245 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.241+0000 7f26f5634780 1 > prepared operation key=5V0Q651D4VN2 tag=G8Z28VYWW9OW type=del size=3862125 2023-10-05T11:35:09.246 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.243+0000 7f26f5634780 1 < completed delete operation key=PC8WTJ8AYJ24 tag=K5AS5BSZ4S9K type=del 2023-10-05T11:35:09.247 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.244+0000 7f26f5634780 1 > prepared operation key=NV4Q36UOLX8A tag=4NKWWPJ365HQ type=del size=944359 2023-10-05T11:35:09.248 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.245+0000 7f26f5634780 1 < completed part key=_multipart_4IBQJLJR7LD8.2~UUJV2CSEQ80W.0 size=1048576 2023-10-05T11:35:09.249 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.246+0000 7f26f5634780 1 < completed part key=_multipart_4IBQJLJR7LD8.2~UUJV2CSEQ80W.1 size=544375 2023-10-05T11:35:09.251 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.248+0000 7f26f5634780 1 < completed multipart upload key=4IBQJLJR7LD8 upload=UUJV2CSEQ80W tag=1E34EJEZAH6R type=write size=2641527 2023-10-05T11:35:09.253 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.250+0000 7f26f5634780 1 > prepared part key=_multipart_AV0XKXX1IR4B.2~2JHPUD1NP481.0 size=1048576 2023-10-05T11:35:09.254 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.251+0000 7f26f5634780 1 > prepared part key=_multipart_AV0XKXX1IR4B.2~2JHPUD1NP481.1 size=1048576 2023-10-05T11:35:09.255 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.252+0000 7f26f5634780 1 > prepared part key=_multipart_AV0XKXX1IR4B.2~2JHPUD1NP481.2 size=868007 2023-10-05T11:35:09.255 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.252+0000 7f26f5634780 1 > prepared multipart upload key=AV0XKXX1IR4B upload=2JHPUD1NP481 tag=TISK3O85H7KV type=write size=4013735 2023-10-05T11:35:09.256 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.253+0000 7f26f5634780 1 < canceled operation key=WYN9BG66LA3K tag=1OGLGW5BS0DD type=del size=370707 2023-10-05T11:35:09.258 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.254+0000 7f26f5634780 1 > prepared operation key=IC7T3ZK81WQS tag=OACFZSWGPN3N type=write size=472519 2023-10-05T11:35:09.259 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.255+0000 7f26f5634780 1 < completed delete operation key=U6172JUYW7J6 tag=G0WM1SDVDAWK type=del 2023-10-05T11:35:09.261 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.257+0000 7f26f5634780 1 > prepared part key=_multipart_WTCWG1C1SF89.2~9V5YHCQZGAZJ.0 size=1048576 2023-10-05T11:35:09.262 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.258+0000 7f26f5634780 1 > prepared part key=_multipart_WTCWG1C1SF89.2~9V5YHCQZGAZJ.1 size=1048576 2023-10-05T11:35:09.263 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.259+0000 7f26f5634780 1 > prepared part key=_multipart_WTCWG1C1SF89.2~9V5YHCQZGAZJ.2 size=494875 2023-10-05T11:35:09.263 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.259+0000 7f26f5634780 1 > prepared multipart upload key=WTCWG1C1SF89 upload=9V5YHCQZGAZJ tag=BQ3E2ZHS8UYD type=write size=3640603 2023-10-05T11:35:09.264 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.261+0000 7f26f5634780 1 < completed part key=_multipart_4IBQJLJR7LD8.2~PP9A9GQ12RVR.0 size=148672 2023-10-05T11:35:09.266 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.263+0000 7f26f5634780 1 < completed multipart upload key=4IBQJLJR7LD8 upload=PP9A9GQ12RVR tag=NMUTZ90RP6I6 type=write size=1197248 2023-10-05T11:35:09.267 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.264+0000 7f26f5634780 1 > prepared operation key=2D4PDQQT54ZA tag=F8D1ARVFDGAV type=del size=3219608 2023-10-05T11:35:09.268 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.265+0000 7f26f5634780 1 < canceled operation key=VJTFYDETLSFD tag=ZGZCQ1THIUZV type=del size=1184945 2023-10-05T11:35:09.271 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.267+0000 7f26f5634780 1 > prepared part key=_multipart_6DP3UJ4CW1MO.2~SD3O55BUKS4G.0 size=1048576 2023-10-05T11:35:09.272 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.268+0000 7f26f5634780 1 > prepared part key=_multipart_6DP3UJ4CW1MO.2~SD3O55BUKS4G.1 size=856479 2023-10-05T11:35:09.272 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.268+0000 7f26f5634780 1 > prepared multipart upload key=6DP3UJ4CW1MO upload=SD3O55BUKS4G tag=RK85IN7DQQJN type=write size=2953631 2023-10-05T11:35:09.273 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.269+0000 7f26f5634780 1 < completed part key=_multipart_8IPCP77WVVZT.2~5958OAUZ28OR.0 size=1048576 2023-10-05T11:35:09.274 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.270+0000 7f26f5634780 1 < completed part key=_multipart_8IPCP77WVVZT.2~5958OAUZ28OR.1 size=844935 2023-10-05T11:35:09.276 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.272+0000 7f26f5634780 1 < completed multipart upload key=8IPCP77WVVZT upload=5958OAUZ28OR tag=4PQ30808Y8WZ type=write size=2942087 2023-10-05T11:35:09.278 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.275+0000 7f26f5634780 1 > prepared part key=_multipart_5V0Q651D4VN2.2~Q7SKHWH41DMV.0 size=1048576 2023-10-05T11:35:09.279 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.276+0000 7f26f5634780 1 > prepared part key=_multipart_5V0Q651D4VN2.2~Q7SKHWH41DMV.1 size=239784 2023-10-05T11:35:09.279 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.276+0000 7f26f5634780 1 > prepared multipart upload key=5V0Q651D4VN2 upload=Q7SKHWH41DMV tag=7Y3LXODEPDYS type=write size=2336936 2023-10-05T11:35:09.280 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.277+0000 7f26f5634780 1 < canceled operation key=2D4PDQQT54ZA tag=QMZ1JLLX46X3 type=del size=230443 2023-10-05T11:35:09.282 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.279+0000 7f26f5634780 1 > prepared part key=_multipart_QYQDXVIGZ7O8.2~FSWRZ99B77RE.0 size=472634 2023-10-05T11:35:09.283 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.279+0000 7f26f5634780 1 > prepared multipart upload key=QYQDXVIGZ7O8 upload=FSWRZ99B77RE tag=0RZP91XFBG7I type=write size=1521210 2023-10-05T11:35:09.283 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.280+0000 7f26f5634780 1 < completed part key=_multipart_PNV0Q6ZPLYV0.2~2B2S6K81FE4K.0 size=702354 2023-10-05T11:35:09.286 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.282+0000 7f26f5634780 1 < completed multipart upload key=PNV0Q6ZPLYV0 upload=2B2S6K81FE4K tag=CXWFRY3LSTYK type=write size=1750930 2023-10-05T11:35:09.287 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.284+0000 7f26f5634780 1 > prepared operation key=2U0NRDGDNUTA tag=PHZK91Y7S3OY type=del size=3705347 2023-10-05T11:35:09.288 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.285+0000 7f26f5634780 1 < completed delete operation key=FOMNIIY47UUM tag=YNMW0KBU661W type=del 2023-10-05T11:35:09.289 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.286+0000 7f26f5634780 1 > prepared operation key=IKCNZOTVWOC6 tag=UD61RWH9PPSF type=write size=483958 2023-10-05T11:35:09.290 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.287+0000 7f26f5634780 1 < completed delete operation key=U6172JUYW7J6 tag=XQXPL87EWJWG type=del 2023-10-05T11:35:09.291 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.288+0000 7f26f5634780 1 > prepared operation key=AV0XKXX1IR4B tag=1TBQ0RFNIH7R type=del size=3795114 2023-10-05T11:35:09.293 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.289+0000 7f26f5634780 1 < completed part key=_multipart_4D3H60UTIXH3.2~FH615UG5Q70D.0 size=420951 2023-10-05T11:35:09.295 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.292+0000 7f26f5634780 1 < completed multipart upload key=4D3H60UTIXH3 upload=FH615UG5Q70D tag=8SX4CLYF0ONF type=write size=1469527 2023-10-05T11:35:09.296 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.293+0000 7f26f5634780 1 > prepared operation key=IC7T3ZK81WQS tag=9OYZGWUSV1D6 type=del size=3827329 2023-10-05T11:35:09.297 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.294+0000 7f26f5634780 1 < completed delete operation key=QYQDXVIGZ7O8 tag=315VPN68CS31 type=del 2023-10-05T11:35:09.300 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.296+0000 7f26f5634780 1 > prepared part key=_multipart_BTZUVE8R96XT.2~4W012RAO58XW.0 size=682546 2023-10-05T11:35:09.300 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.296+0000 7f26f5634780 1 > prepared multipart upload key=BTZUVE8R96XT upload=4W012RAO58XW tag=RMDQMS6BJXIH type=write size=1731122 2023-10-05T11:35:09.301 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.297+0000 7f26f5634780 1 < completed part key=_multipart_FOMNIIY47UUM.2~4S7WL6MD4DJU.0 size=1048576 2023-10-05T11:35:09.302 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.299+0000 7f26f5634780 1 < completed part key=_multipart_FOMNIIY47UUM.2~4S7WL6MD4DJU.1 size=664907 2023-10-05T11:35:09.304 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.301+0000 7f26f5634780 1 < completed multipart upload key=FOMNIIY47UUM upload=4S7WL6MD4DJU tag=BVARE3S5L1D9 type=write size=2762059 2023-10-05T11:35:09.305 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.302+0000 7f26f5634780 1 > prepared operation key=9S0YW7PPSJ8G tag=9OE2840HIN0H type=del size=773476 2023-10-05T11:35:09.306 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.303+0000 7f26f5634780 1 < completed delete operation key=IC7T3ZK81WQS tag=M7U8NJQJYKJ3 type=del 2023-10-05T11:35:09.309 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.304+0000 7f26f5634780 1 > prepared operation key=9S0YW7PPSJ8G tag=T1X8E33VTYII type=del size=1881228 2023-10-05T11:35:09.309 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.305+0000 7f26f5634780 1 < completed delete operation key=5V0Q651D4VN2 tag=G8Z28VYWW9OW type=del 2023-10-05T11:35:09.310 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.307+0000 7f26f5634780 1 > prepared operation key=0PWYKC7S6YJ4 tag=461YAL6MDK01 type=del size=2155586 2023-10-05T11:35:09.311 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.308+0000 7f26f5634780 1 < completed delete operation key=NV4Q36UOLX8A tag=4NKWWPJ365HQ type=del 2023-10-05T11:35:09.314 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.311+0000 7f26f5634780 1 > prepared part key=_multipart_BU3KSHTINB36.2~DEJ76C594UVO.0 size=1048576 2023-10-05T11:35:09.315 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.312+0000 7f26f5634780 1 > prepared part key=_multipart_BU3KSHTINB36.2~DEJ76C594UVO.1 size=642200 2023-10-05T11:35:09.315 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.312+0000 7f26f5634780 1 > prepared multipart upload key=BU3KSHTINB36 upload=DEJ76C594UVO tag=TTEZGOJ9GRX4 type=write size=2739352 2023-10-05T11:35:09.316 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.313+0000 7f26f5634780 1 < completed part key=_multipart_AV0XKXX1IR4B.2~2JHPUD1NP481.0 size=1048576 2023-10-05T11:35:09.317 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.314+0000 7f26f5634780 1 < completed part key=_multipart_AV0XKXX1IR4B.2~2JHPUD1NP481.1 size=1048576 2023-10-05T11:35:09.318 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.315+0000 7f26f5634780 1 < completed part key=_multipart_AV0XKXX1IR4B.2~2JHPUD1NP481.2 size=868007 2023-10-05T11:35:09.320 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.317+0000 7f26f5634780 1 < completed multipart upload key=AV0XKXX1IR4B upload=2JHPUD1NP481 tag=TISK3O85H7KV type=write size=4013735 2023-10-05T11:35:09.321 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.318+0000 7f26f5634780 1 > prepared operation key=WYN9BG66LA3K tag=VWGO49P3PTI2 type=write size=90834 2023-10-05T11:35:09.324 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.321+0000 7f26f5634780 1 < suggested remove operation key=IC7T3ZK81WQS tag=OACFZSWGPN3N type=write 2023-10-05T11:35:09.325 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.322+0000 7f26f5634780 1 > prepared operation key=4D3H60UTIXH3 tag=ETYHZNRVZB4T type=del size=3272050 2023-10-05T11:35:09.326 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.323+0000 7f26f5634780 1 < completed part key=_multipart_WTCWG1C1SF89.2~9V5YHCQZGAZJ.0 size=1048576 2023-10-05T11:35:09.327 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.324+0000 7f26f5634780 1 < completed part key=_multipart_WTCWG1C1SF89.2~9V5YHCQZGAZJ.1 size=1048576 2023-10-05T11:35:09.328 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.325+0000 7f26f5634780 1 < completed part key=_multipart_WTCWG1C1SF89.2~9V5YHCQZGAZJ.2 size=494875 2023-10-05T11:35:09.330 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.327+0000 7f26f5634780 1 < completed multipart upload key=WTCWG1C1SF89 upload=9V5YHCQZGAZJ tag=BQ3E2ZHS8UYD type=write size=3640603 2023-10-05T11:35:09.332 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.328+0000 7f26f5634780 1 > prepared operation key=9S0YW7PPSJ8G tag=IXWAE09FKECH type=del size=4069320 2023-10-05T11:35:09.333 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.330+0000 7f26f5634780 1 < completed delete operation key=2D4PDQQT54ZA tag=F8D1ARVFDGAV type=del 2023-10-05T11:35:09.334 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.331+0000 7f26f5634780 1 > prepared operation key=FOMNIIY47UUM tag=FM5DGWAG3BEN type=del size=447358 2023-10-05T11:35:09.336 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.332+0000 7f26f5634780 1 < completed part key=_multipart_6DP3UJ4CW1MO.2~SD3O55BUKS4G.0 size=1048576 2023-10-05T11:35:09.337 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.333+0000 7f26f5634780 1 < completed part key=_multipart_6DP3UJ4CW1MO.2~SD3O55BUKS4G.1 size=856479 2023-10-05T11:35:09.339 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.335+0000 7f26f5634780 1 < completed multipart upload key=6DP3UJ4CW1MO upload=SD3O55BUKS4G tag=RK85IN7DQQJN type=write size=2953631 2023-10-05T11:35:09.341 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.338+0000 7f26f5634780 1 > prepared part key=_multipart_9S0YW7PPSJ8G.2~0CE51BG2E514.0 size=1048576 2023-10-05T11:35:09.342 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.339+0000 7f26f5634780 1 > prepared part key=_multipart_9S0YW7PPSJ8G.2~0CE51BG2E514.1 size=1048576 2023-10-05T11:35:09.343 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.339+0000 7f26f5634780 1 > prepared part key=_multipart_9S0YW7PPSJ8G.2~0CE51BG2E514.2 size=17248 2023-10-05T11:35:09.343 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.339+0000 7f26f5634780 1 > prepared multipart upload key=9S0YW7PPSJ8G upload=0CE51BG2E514 tag=TGXD424ZZU3R type=write size=3162976 2023-10-05T11:35:09.344 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.341+0000 7f26f5634780 1 < completed part key=_multipart_5V0Q651D4VN2.2~Q7SKHWH41DMV.0 size=1048576 2023-10-05T11:35:09.345 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.342+0000 7f26f5634780 1 < completed part key=_multipart_5V0Q651D4VN2.2~Q7SKHWH41DMV.1 size=239784 2023-10-05T11:35:09.348 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.345+0000 7f26f5634780 1 < completed multipart upload key=5V0Q651D4VN2 upload=Q7SKHWH41DMV tag=7Y3LXODEPDYS type=write size=2336936 2023-10-05T11:35:09.350 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.347+0000 7f26f5634780 1 > prepared part key=_multipart_PNV0Q6ZPLYV0.2~R1B0DPR4Q4UK.0 size=376453 2023-10-05T11:35:09.350 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.347+0000 7f26f5634780 1 > prepared multipart upload key=PNV0Q6ZPLYV0 upload=R1B0DPR4Q4UK tag=8ZGY5903FS00 type=write size=1425029 2023-10-05T11:35:09.351 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.347+0000 7f26f5634780 1 < canceled part key=_multipart_QYQDXVIGZ7O8.2~FSWRZ99B77RE.0 size=472634 2023-10-05T11:35:09.352 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.349+0000 7f26f5634780 1 < canceled multipart upload key=QYQDXVIGZ7O8 upload=FSWRZ99B77RE tag=0RZP91XFBG7I type=write size=1521210 2023-10-05T11:35:09.354 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.350+0000 7f26f5634780 1 > prepared operation key=LLR5J3X15W5R tag=SR8J7D6YNNBL type=del size=1485097 2023-10-05T11:35:09.355 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.352+0000 7f26f5634780 1 < completed delete operation key=2U0NRDGDNUTA tag=PHZK91Y7S3OY type=del 2023-10-05T11:35:09.356 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.353+0000 7f26f5634780 1 > prepared operation key=0PWYKC7S6YJ4 tag=5LF8UP139US5 type=del size=2341918 2023-10-05T11:35:09.357 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.354+0000 7f26f5634780 1 < completed write operation key=IKCNZOTVWOC6 tag=UD61RWH9PPSF type=write size=483958 2023-10-05T11:35:09.359 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.355+0000 7f26f5634780 1 > prepared operation key=WTCWG1C1SF89 tag=6TAOUGPWJYNO type=write size=391325 2023-10-05T11:35:09.360 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.357+0000 7f26f5634780 1 < canceled operation key=AV0XKXX1IR4B tag=1TBQ0RFNIH7R type=del size=3795114 2023-10-05T11:35:09.362 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.359+0000 7f26f5634780 1 > prepared part key=_multipart_WYN9BG66LA3K.2~IZ2RDDI3JAA0.0 size=1048576 2023-10-05T11:35:09.363 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.360+0000 7f26f5634780 1 > prepared part key=_multipart_WYN9BG66LA3K.2~IZ2RDDI3JAA0.1 size=955778 2023-10-05T11:35:09.363 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.360+0000 7f26f5634780 1 > prepared multipart upload key=WYN9BG66LA3K upload=IZ2RDDI3JAA0 tag=5TIQL9NN386C type=write size=3052930 2023-10-05T11:35:09.364 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.361+0000 7f26f5634780 -1 < failed to complete operation key=IC7T3ZK81WQS tag=9OYZGWUSV1D6 type=del size=3827329: (22) Invalid argument 2023-10-05T11:35:09.367 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.363+0000 7f26f5634780 1 > prepared part key=_multipart_W2GWVGX42QLD.2~7WXAXPV3IRL9.0 size=1048576 2023-10-05T11:35:09.367 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.364+0000 7f26f5634780 1 > prepared part key=_multipart_W2GWVGX42QLD.2~7WXAXPV3IRL9.1 size=1048576 2023-10-05T11:35:09.368 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.365+0000 7f26f5634780 1 > prepared part key=_multipart_W2GWVGX42QLD.2~7WXAXPV3IRL9.2 size=219193 2023-10-05T11:35:09.368 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.365+0000 7f26f5634780 1 > prepared multipart upload key=W2GWVGX42QLD upload=7WXAXPV3IRL9 tag=X8LDVNL7IDC0 type=write size=3364921 2023-10-05T11:35:09.370 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.366+0000 7f26f5634780 1 < completed part key=_multipart_BTZUVE8R96XT.2~4W012RAO58XW.0 size=682546 2023-10-05T11:35:09.372 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.368+0000 7f26f5634780 1 < completed multipart upload key=BTZUVE8R96XT upload=4W012RAO58XW tag=RMDQMS6BJXIH type=write size=1731122 2023-10-05T11:35:09.374 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.370+0000 7f26f5634780 1 > prepared part key=_multipart_FOMNIIY47UUM.2~809MTITKRR82.0 size=374546 2023-10-05T11:35:09.374 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.370+0000 7f26f5634780 1 > prepared multipart upload key=FOMNIIY47UUM upload=809MTITKRR82 tag=U0V3LK7KEJAR type=write size=1423122 2023-10-05T11:35:09.375 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.372+0000 7f26f5634780 1 < completed delete operation key=9S0YW7PPSJ8G tag=9OE2840HIN0H type=del 2023-10-05T11:35:09.377 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.374+0000 7f26f5634780 1 > prepared part key=_multipart_AV0XKXX1IR4B.2~JUML848C4GI8.0 size=1048576 2023-10-05T11:35:09.378 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.375+0000 7f26f5634780 1 > prepared part key=_multipart_AV0XKXX1IR4B.2~JUML848C4GI8.1 size=698798 2023-10-05T11:35:09.378 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.375+0000 7f26f5634780 1 > prepared multipart upload key=AV0XKXX1IR4B upload=JUML848C4GI8 tag=M0Q6CPWGQZP3 type=write size=2795950 2023-10-05T11:35:09.379 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.376+0000 7f26f5634780 1 < completed delete operation key=9S0YW7PPSJ8G tag=T1X8E33VTYII type=del 2023-10-05T11:35:09.380 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.377+0000 7f26f5634780 1 > prepared operation key=4IBQJLJR7LD8 tag=NBBT3SGDXRWA type=del size=278026 2023-10-05T11:35:09.382 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.378+0000 7f26f5634780 1 < completed delete operation key=0PWYKC7S6YJ4 tag=461YAL6MDK01 type=del 2023-10-05T11:35:09.383 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.379+0000 7f26f5634780 1 > prepared operation key=5OPHKTHXVN5U tag=MX2YT0NY0HI6 type=del size=3624882 2023-10-05T11:35:09.384 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.380+0000 7f26f5634780 1 < completed part key=_multipart_BU3KSHTINB36.2~DEJ76C594UVO.0 size=1048576 2023-10-05T11:35:09.385 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.381+0000 7f26f5634780 1 < completed part key=_multipart_BU3KSHTINB36.2~DEJ76C594UVO.1 size=642200 2023-10-05T11:35:09.387 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.384+0000 7f26f5634780 1 < completed multipart upload key=BU3KSHTINB36 upload=DEJ76C594UVO tag=TTEZGOJ9GRX4 type=write size=2739352 2023-10-05T11:35:09.389 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.386+0000 7f26f5634780 1 > prepared part key=_multipart_WTCWG1C1SF89.2~177FT0OKY1SQ.0 size=1048576 2023-10-05T11:35:09.390 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.387+0000 7f26f5634780 1 > prepared part key=_multipart_WTCWG1C1SF89.2~177FT0OKY1SQ.1 size=1048576 2023-10-05T11:35:09.391 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.388+0000 7f26f5634780 1 > prepared part key=_multipart_WTCWG1C1SF89.2~177FT0OKY1SQ.2 size=248139 2023-10-05T11:35:09.391 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.388+0000 7f26f5634780 1 > prepared multipart upload key=WTCWG1C1SF89 upload=177FT0OKY1SQ tag=Q1OI56AKRK8O type=write size=3393867 2023-10-05T11:35:09.392 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.389+0000 7f26f5634780 1 < canceled operation key=WYN9BG66LA3K tag=VWGO49P3PTI2 type=write size=90834 2023-10-05T11:35:09.393 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.390+0000 7f26f5634780 1 > prepared operation key=IKCNZOTVWOC6 tag=2XZNS0PZIIHU type=del size=1820729 2023-10-05T11:35:09.395 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.391+0000 7f26f5634780 1 < completed delete operation key=4D3H60UTIXH3 tag=ETYHZNRVZB4T type=del 2023-10-05T11:35:09.396 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.392+0000 7f26f5634780 1 > prepared operation key=2U0NRDGDNUTA tag=TJF7CVG76WKX type=del size=4109070 2023-10-05T11:35:09.398 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.395+0000 7f26f5634780 1 < suggested remove operation key=9S0YW7PPSJ8G tag=IXWAE09FKECH type=del 2023-10-05T11:35:09.400 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.396+0000 7f26f5634780 1 > prepared operation key=2D4PDQQT54ZA tag=F1Y0XDD5R5UT type=del size=1362355 2023-10-05T11:35:09.401 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.397+0000 7f26f5634780 1 < completed delete operation key=FOMNIIY47UUM tag=FM5DGWAG3BEN type=del 2023-10-05T11:35:09.402 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.399+0000 7f26f5634780 1 > prepared operation key=WTCWG1C1SF89 tag=61243XDM63UW type=del size=2561929 2023-10-05T11:35:09.403 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.400+0000 7f26f5634780 1 < completed part key=_multipart_9S0YW7PPSJ8G.2~0CE51BG2E514.0 size=1048576 2023-10-05T11:35:09.404 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.401+0000 7f26f5634780 1 < completed part key=_multipart_9S0YW7PPSJ8G.2~0CE51BG2E514.1 size=1048576 2023-10-05T11:35:09.404 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.401+0000 7f26f5634780 1 < canceled part key=_multipart_9S0YW7PPSJ8G.2~0CE51BG2E514.2 size=17248 2023-10-05T11:35:09.406 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.403+0000 7f26f5634780 1 < canceled multipart upload key=9S0YW7PPSJ8G upload=0CE51BG2E514 tag=TGXD424ZZU3R type=write size=3162976 2023-10-05T11:35:09.407 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.404+0000 7f26f5634780 1 > prepared operation key=VJTFYDETLSFD tag=GC4XRHVUNW6R type=del size=1640522 2023-10-05T11:35:09.409 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.405+0000 7f26f5634780 1 < completed part key=_multipart_PNV0Q6ZPLYV0.2~R1B0DPR4Q4UK.0 size=376453 2023-10-05T11:35:09.411 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.407+0000 7f26f5634780 1 < completed multipart upload key=PNV0Q6ZPLYV0 upload=R1B0DPR4Q4UK tag=8ZGY5903FS00 type=write size=1425029 2023-10-05T11:35:09.412 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.408+0000 7f26f5634780 1 > prepared operation key=0PWYKC7S6YJ4 tag=0MFHV0A3HCHE type=del size=2773475 2023-10-05T11:35:09.413 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.410+0000 7f26f5634780 1 < completed delete operation key=LLR5J3X15W5R tag=SR8J7D6YNNBL type=del 2023-10-05T11:35:09.414 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.411+0000 7f26f5634780 1 > prepared operation key=PC8WTJ8AYJ24 tag=LFGF1UQPTP8V type=write size=288254 2023-10-05T11:35:09.415 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.412+0000 7f26f5634780 1 < completed delete operation key=0PWYKC7S6YJ4 tag=5LF8UP139US5 type=del 2023-10-05T11:35:09.418 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.414+0000 7f26f5634780 1 > prepared part key=_multipart_8IPCP77WVVZT.2~CSAZS77FISHY.0 size=1048576 2023-10-05T11:35:09.419 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.415+0000 7f26f5634780 1 > prepared part key=_multipart_8IPCP77WVVZT.2~CSAZS77FISHY.1 size=159684 2023-10-05T11:35:09.419 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.415+0000 7f26f5634780 1 > prepared multipart upload key=8IPCP77WVVZT upload=CSAZS77FISHY tag=29WXUNKH6JN5 type=write size=2256836 2023-10-05T11:35:09.420 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.417+0000 7f26f5634780 1 < completed write operation key=WTCWG1C1SF89 tag=6TAOUGPWJYNO type=write size=391325 2023-10-05T11:35:09.421 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.418+0000 7f26f5634780 1 > prepared operation key=LLR5J3X15W5R tag=SWC9E6V696K4 type=del size=1705609 2023-10-05T11:35:09.422 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.419+0000 7f26f5634780 1 < completed part key=_multipart_WYN9BG66LA3K.2~IZ2RDDI3JAA0.0 size=1048576 2023-10-05T11:35:09.423 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.420+0000 7f26f5634780 1 < completed part key=_multipart_WYN9BG66LA3K.2~IZ2RDDI3JAA0.1 size=955778 2023-10-05T11:35:09.426 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.422+0000 7f26f5634780 1 < completed multipart upload key=WYN9BG66LA3K upload=IZ2RDDI3JAA0 tag=5TIQL9NN386C type=write size=3052930 2023-10-05T11:35:09.427 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.423+0000 7f26f5634780 1 > prepared operation key=5OPHKTHXVN5U tag=H1PPLR1YG7BW type=del size=1101291 2023-10-05T11:35:09.428 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.425+0000 7f26f5634780 1 < completed part key=_multipart_W2GWVGX42QLD.2~7WXAXPV3IRL9.0 size=1048576 2023-10-05T11:35:09.429 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.426+0000 7f26f5634780 1 < completed part key=_multipart_W2GWVGX42QLD.2~7WXAXPV3IRL9.1 size=1048576 2023-10-05T11:35:09.430 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.427+0000 7f26f5634780 1 < completed part key=_multipart_W2GWVGX42QLD.2~7WXAXPV3IRL9.2 size=219193 2023-10-05T11:35:09.432 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.429+0000 7f26f5634780 1 < completed multipart upload key=W2GWVGX42QLD upload=7WXAXPV3IRL9 tag=X8LDVNL7IDC0 type=write size=3364921 2023-10-05T11:35:09.435 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.431+0000 7f26f5634780 1 > prepared part key=_multipart_9S0YW7PPSJ8G.2~7M6FG5OA969C.0 size=1048576 2023-10-05T11:35:09.436 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.432+0000 7f26f5634780 1 > prepared part key=_multipart_9S0YW7PPSJ8G.2~7M6FG5OA969C.1 size=4942 2023-10-05T11:35:09.436 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.432+0000 7f26f5634780 1 > prepared multipart upload key=9S0YW7PPSJ8G upload=7M6FG5OA969C tag=MW50LTDT1XX8 type=write size=2102094 2023-10-05T11:35:09.437 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.434+0000 7f26f5634780 1 < completed part key=_multipart_FOMNIIY47UUM.2~809MTITKRR82.0 size=374546 2023-10-05T11:35:09.439 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.436+0000 7f26f5634780 1 < completed multipart upload key=FOMNIIY47UUM upload=809MTITKRR82 tag=U0V3LK7KEJAR type=write size=1423122 2023-10-05T11:35:09.440 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.437+0000 7f26f5634780 1 > prepared operation key=IKCNZOTVWOC6 tag=WQHLE91C9E3J type=del size=3557563 2023-10-05T11:35:09.442 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.438+0000 7f26f5634780 1 < completed part key=_multipart_AV0XKXX1IR4B.2~JUML848C4GI8.0 size=1048576 2023-10-05T11:35:09.443 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.439+0000 7f26f5634780 1 < completed part key=_multipart_AV0XKXX1IR4B.2~JUML848C4GI8.1 size=698798 2023-10-05T11:35:09.445 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.441+0000 7f26f5634780 1 < completed multipart upload key=AV0XKXX1IR4B upload=JUML848C4GI8 tag=M0Q6CPWGQZP3 type=write size=2795950 2023-10-05T11:35:09.446 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.443+0000 7f26f5634780 1 > prepared operation key=VJTFYDETLSFD tag=FNJH2ZX92MJ5 type=del size=558968 2023-10-05T11:35:09.448 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.444+0000 7f26f5634780 1 < completed delete operation key=4IBQJLJR7LD8 tag=NBBT3SGDXRWA type=del 2023-10-05T11:35:09.449 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.446+0000 7f26f5634780 1 > prepared operation key=IKCNZOTVWOC6 tag=GLYRR5H17J69 type=del size=799227 2023-10-05T11:35:09.450 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.447+0000 7f26f5634780 1 < completed delete operation key=5OPHKTHXVN5U tag=MX2YT0NY0HI6 type=del 2023-10-05T11:35:09.452 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.448+0000 7f26f5634780 1 > prepared operation key=5V0Q651D4VN2 tag=7GAJ7ZCD6FCF type=del size=2396430 2023-10-05T11:35:09.453 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.450+0000 7f26f5634780 1 < completed part key=_multipart_WTCWG1C1SF89.2~177FT0OKY1SQ.0 size=1048576 2023-10-05T11:35:09.454 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.451+0000 7f26f5634780 1 < completed part key=_multipart_WTCWG1C1SF89.2~177FT0OKY1SQ.1 size=1048576 2023-10-05T11:35:09.456 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.452+0000 7f26f5634780 1 < completed part key=_multipart_WTCWG1C1SF89.2~177FT0OKY1SQ.2 size=248139 2023-10-05T11:35:09.457 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.454+0000 7f26f5634780 1 < completed multipart upload key=WTCWG1C1SF89 upload=177FT0OKY1SQ tag=Q1OI56AKRK8O type=write size=3393867 2023-10-05T11:35:09.458 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.455+0000 7f26f5634780 1 > prepared operation key=2U0NRDGDNUTA tag=RFBLABS66R93 type=del size=1234203 2023-10-05T11:35:09.460 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.456+0000 7f26f5634780 1 < completed delete operation key=IKCNZOTVWOC6 tag=2XZNS0PZIIHU type=del 2023-10-05T11:35:09.461 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.458+0000 7f26f5634780 1 > prepared operation key=QYQDXVIGZ7O8 tag=2V5DBQ9FU8JI type=del size=1600345 2023-10-05T11:35:09.464 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.461+0000 7f26f5634780 1 < suggested remove operation key=2U0NRDGDNUTA tag=TJF7CVG76WKX type=del 2023-10-05T11:35:09.465 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.462+0000 7f26f5634780 1 > prepared operation key=7TOP5A52M9YP tag=0V30JB1JEF47 type=del size=1286695 2023-10-05T11:35:09.467 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.463+0000 7f26f5634780 1 < completed delete operation key=2D4PDQQT54ZA tag=F1Y0XDD5R5UT type=del 2023-10-05T11:35:09.468 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.465+0000 7f26f5634780 1 > prepared part key=_multipart_7TOP5A52M9YP.2~IG3TIE17H49L.0 size=174182 2023-10-05T11:35:09.469 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.465+0000 7f26f5634780 1 > prepared multipart upload key=7TOP5A52M9YP upload=IG3TIE17H49L tag=B4OMZ3P5SXYZ type=write size=1222758 2023-10-05T11:35:09.471 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.467+0000 7f26f5634780 1 < suggested update operation key=WTCWG1C1SF89 tag=61243XDM63UW type=del size=2561929 2023-10-05T11:35:09.472 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.469+0000 7f26f5634780 1 > prepared operation key=9S0YW7PPSJ8G tag=5TQ9IC1F6JIL type=del size=1680354 2023-10-05T11:35:09.474 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.471+0000 7f26f5634780 1 < suggested update operation key=VJTFYDETLSFD tag=GC4XRHVUNW6R type=del size=1640522 2023-10-05T11:35:09.476 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.472+0000 7f26f5634780 1 > prepared operation key=WYN9BG66LA3K tag=GOQP676M5RX1 type=del size=4173701 2023-10-05T11:35:09.477 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.473+0000 7f26f5634780 1 < completed delete operation key=0PWYKC7S6YJ4 tag=0MFHV0A3HCHE type=del 2023-10-05T11:35:09.478 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.474+0000 7f26f5634780 1 > prepared operation key=U6172JUYW7J6 tag=WPZS1PFOI0GD type=del size=2318116 2023-10-05T11:35:09.479 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.476+0000 7f26f5634780 1 < completed write operation key=PC8WTJ8AYJ24 tag=LFGF1UQPTP8V type=write size=288254 2023-10-05T11:35:09.480 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.477+0000 7f26f5634780 1 > prepared operation key=6DP3UJ4CW1MO tag=VJP9S1FNCB5E type=write size=655228 2023-10-05T11:35:09.481 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.478+0000 7f26f5634780 1 < completed part key=_multipart_8IPCP77WVVZT.2~CSAZS77FISHY.0 size=1048576 2023-10-05T11:35:09.483 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.479+0000 7f26f5634780 1 < completed part key=_multipart_8IPCP77WVVZT.2~CSAZS77FISHY.1 size=159684 2023-10-05T11:35:09.485 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.481+0000 7f26f5634780 1 < completed multipart upload key=8IPCP77WVVZT upload=CSAZS77FISHY tag=29WXUNKH6JN5 type=write size=2256836 2023-10-05T11:35:09.487 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.483+0000 7f26f5634780 1 > prepared part key=_multipart_BTZUVE8R96XT.2~UJVO2ZBSDV59.0 size=1048576 2023-10-05T11:35:09.488 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.484+0000 7f26f5634780 1 > prepared part key=_multipart_BTZUVE8R96XT.2~UJVO2ZBSDV59.1 size=727808 2023-10-05T11:35:09.488 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.484+0000 7f26f5634780 1 > prepared multipart upload key=BTZUVE8R96XT upload=UJVO2ZBSDV59 tag=3ZIIJ1GW2Z5M type=write size=2824960 2023-10-05T11:35:09.489 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.486+0000 7f26f5634780 1 < completed delete operation key=LLR5J3X15W5R tag=SWC9E6V696K4 type=del 2023-10-05T11:35:09.490 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.487+0000 7f26f5634780 1 > prepared operation key=5OPHKTHXVN5U tag=LTVB2RMR68MO type=del size=1416574 2023-10-05T11:35:09.493 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.489+0000 7f26f5634780 1 < suggested remove operation key=5OPHKTHXVN5U tag=H1PPLR1YG7BW type=del 2023-10-05T11:35:09.495 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.492+0000 7f26f5634780 1 > prepared part key=_multipart_MEY4SZRHU9NZ.2~H356L4IPBOM7.0 size=1048576 2023-10-05T11:35:09.497 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.494+0000 7f26f5634780 1 > prepared part key=_multipart_MEY4SZRHU9NZ.2~H356L4IPBOM7.1 size=1048576 2023-10-05T11:35:09.498 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.494+0000 7f26f5634780 1 > prepared part key=_multipart_MEY4SZRHU9NZ.2~H356L4IPBOM7.2 size=644314 2023-10-05T11:35:09.498 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.494+0000 7f26f5634780 1 > prepared multipart upload key=MEY4SZRHU9NZ upload=H356L4IPBOM7 tag=O1HZZJ4EWG99 type=write size=3790042 2023-10-05T11:35:09.499 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.496+0000 7f26f5634780 1 < completed part key=_multipart_9S0YW7PPSJ8G.2~7M6FG5OA969C.0 size=1048576 2023-10-05T11:35:09.500 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.497+0000 7f26f5634780 1 < completed part key=_multipart_9S0YW7PPSJ8G.2~7M6FG5OA969C.1 size=4942 2023-10-05T11:35:09.502 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.499+0000 7f26f5634780 1 < completed multipart upload key=9S0YW7PPSJ8G upload=7M6FG5OA969C tag=MW50LTDT1XX8 type=write size=2102094 2023-10-05T11:35:09.504 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.500+0000 7f26f5634780 1 > prepared operation key=J5EIH25Y471T tag=WP3JW75JZNEJ type=del size=3880910 2023-10-05T11:35:09.505 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.501+0000 7f26f5634780 1 < completed delete operation key=IKCNZOTVWOC6 tag=WQHLE91C9E3J type=del 2023-10-05T11:35:09.506 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.502+0000 7f26f5634780 1 > prepared operation key=MEY4SZRHU9NZ tag=7P2DGRX37F2Y type=write size=758063 2023-10-05T11:35:09.507 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.504+0000 7f26f5634780 -1 < failed to complete operation key=VJTFYDETLSFD tag=FNJH2ZX92MJ5 type=del size=558968: (22) Invalid argument 2023-10-05T11:35:09.508 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.505+0000 7f26f5634780 1 > prepared operation key=7W9LL5HSU3BG tag=I71XTAI443K1 type=write size=195965 2023-10-05T11:35:09.510 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.506+0000 7f26f5634780 1 < completed delete operation key=IKCNZOTVWOC6 tag=GLYRR5H17J69 type=del 2023-10-05T11:35:09.511 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.507+0000 7f26f5634780 1 > prepared operation key=5V0Q651D4VN2 tag=WUK6RUMHQIT9 type=del size=1961057 2023-10-05T11:35:09.512 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.509+0000 7f26f5634780 1 < completed delete operation key=5V0Q651D4VN2 tag=7GAJ7ZCD6FCF type=del 2023-10-05T11:35:09.513 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.510+0000 7f26f5634780 1 > prepared operation key=IC7T3ZK81WQS tag=KP6JYN6SEIAD type=del size=2670252 2023-10-05T11:35:09.514 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.511+0000 7f26f5634780 -1 < failed to complete operation key=2U0NRDGDNUTA tag=RFBLABS66R93 type=del size=1234203: (22) Invalid argument 2023-10-05T11:35:09.516 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.513+0000 7f26f5634780 1 > prepared part key=_multipart_IKCNZOTVWOC6.2~VA77OI9260QG.0 size=1048576 2023-10-05T11:35:09.517 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.514+0000 7f26f5634780 1 > prepared part key=_multipart_IKCNZOTVWOC6.2~VA77OI9260QG.1 size=1048576 2023-10-05T11:35:09.518 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.515+0000 7f26f5634780 1 > prepared part key=_multipart_IKCNZOTVWOC6.2~VA77OI9260QG.2 size=1041373 2023-10-05T11:35:09.518 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.515+0000 7f26f5634780 1 > prepared multipart upload key=IKCNZOTVWOC6 upload=VA77OI9260QG tag=6DBXBC9DP85E type=write size=4187101 2023-10-05T11:35:09.519 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.516+0000 7f26f5634780 1 < completed delete operation key=QYQDXVIGZ7O8 tag=2V5DBQ9FU8JI type=del 2023-10-05T11:35:09.520 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.517+0000 7f26f5634780 1 > prepared operation key=VJTFYDETLSFD tag=9TQMIO0Z9QNN type=del size=1706136 2023-10-05T11:35:09.522 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.518+0000 7f26f5634780 1 < completed delete operation key=7TOP5A52M9YP tag=0V30JB1JEF47 type=del 2023-10-05T11:35:09.523 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.519+0000 7f26f5634780 1 > prepared operation key=4IBQJLJR7LD8 tag=P3EEZ66D1QIF type=write size=975829 2023-10-05T11:35:09.524 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.521+0000 7f26f5634780 1 < completed part key=_multipart_7TOP5A52M9YP.2~IG3TIE17H49L.0 size=174182 2023-10-05T11:35:09.526 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.523+0000 7f26f5634780 1 < completed multipart upload key=7TOP5A52M9YP upload=IG3TIE17H49L tag=B4OMZ3P5SXYZ type=write size=1222758 2023-10-05T11:35:09.528 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.525+0000 7f26f5634780 1 > prepared part key=_multipart_7W9LL5HSU3BG.2~4T7Q9NE4GYTZ.0 size=1048576 2023-10-05T11:35:09.529 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.526+0000 7f26f5634780 1 > prepared part key=_multipart_7W9LL5HSU3BG.2~4T7Q9NE4GYTZ.1 size=808953 2023-10-05T11:35:09.529 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.526+0000 7f26f5634780 1 > prepared multipart upload key=7W9LL5HSU3BG upload=4T7Q9NE4GYTZ tag=GT2QNU2861X3 type=write size=2906105 2023-10-05T11:35:09.531 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.527+0000 7f26f5634780 1 < completed delete operation key=9S0YW7PPSJ8G tag=5TQ9IC1F6JIL type=del 2023-10-05T11:35:09.533 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.530+0000 7f26f5634780 1 > prepared part key=_multipart_AV0XKXX1IR4B.2~GOX3UAH1IW9M.0 size=1048576 2023-10-05T11:35:09.534 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.531+0000 7f26f5634780 1 > prepared part key=_multipart_AV0XKXX1IR4B.2~GOX3UAH1IW9M.1 size=1048576 2023-10-05T11:35:09.535 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.532+0000 7f26f5634780 1 > prepared part key=_multipart_AV0XKXX1IR4B.2~GOX3UAH1IW9M.2 size=256845 2023-10-05T11:35:09.535 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.532+0000 7f26f5634780 1 > prepared multipart upload key=AV0XKXX1IR4B upload=GOX3UAH1IW9M tag=LPIVVK3ZHK96 type=write size=3402573 2023-10-05T11:35:09.537 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.533+0000 7f26f5634780 1 < completed delete operation key=WYN9BG66LA3K tag=GOQP676M5RX1 type=del 2023-10-05T11:35:09.539 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.536+0000 7f26f5634780 1 > prepared part key=_multipart_U6172JUYW7J6.2~WLYQ2JHJ0EUD.0 size=1048576 2023-10-05T11:35:09.540 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.537+0000 7f26f5634780 1 > prepared part key=_multipart_U6172JUYW7J6.2~WLYQ2JHJ0EUD.1 size=1048576 2023-10-05T11:35:09.541 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.538+0000 7f26f5634780 1 > prepared part key=_multipart_U6172JUYW7J6.2~WLYQ2JHJ0EUD.2 size=1920 2023-10-05T11:35:09.541 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.538+0000 7f26f5634780 1 > prepared multipart upload key=U6172JUYW7J6 upload=WLYQ2JHJ0EUD tag=RAX5CCJDYL0V type=write size=3147648 2023-10-05T11:35:09.542 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.539+0000 7f26f5634780 1 < completed delete operation key=U6172JUYW7J6 tag=WPZS1PFOI0GD type=del 2023-10-05T11:35:09.545 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.541+0000 7f26f5634780 1 > prepared part key=_multipart_PC8WTJ8AYJ24.2~MA2OL8VBRBW3.0 size=1048576 2023-10-05T11:35:09.546 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.542+0000 7f26f5634780 1 > prepared part key=_multipart_PC8WTJ8AYJ24.2~MA2OL8VBRBW3.1 size=878514 2023-10-05T11:35:09.546 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.542+0000 7f26f5634780 1 > prepared multipart upload key=PC8WTJ8AYJ24 upload=MA2OL8VBRBW3 tag=HMFCUN8D6EXJ type=write size=2975666 2023-10-05T11:35:09.547 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.543+0000 7f26f5634780 1 < completed write operation key=6DP3UJ4CW1MO tag=VJP9S1FNCB5E type=write size=655228 2023-10-05T11:35:09.549 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.546+0000 7f26f5634780 1 > prepared part key=_multipart_7TOP5A52M9YP.2~0QOHWYX3MHT0.0 size=590392 2023-10-05T11:35:09.549 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.546+0000 7f26f5634780 1 > prepared multipart upload key=7TOP5A52M9YP upload=0QOHWYX3MHT0 tag=20WX1QQGHAFW type=write size=1638968 2023-10-05T11:35:09.550 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.547+0000 7f26f5634780 1 < completed part key=_multipart_BTZUVE8R96XT.2~UJVO2ZBSDV59.0 size=1048576 2023-10-05T11:35:09.550 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.547+0000 7f26f5634780 1 < canceled part key=_multipart_BTZUVE8R96XT.2~UJVO2ZBSDV59.1 size=727808 2023-10-05T11:35:09.553 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.549+0000 7f26f5634780 1 < canceled multipart upload key=BTZUVE8R96XT upload=UJVO2ZBSDV59 tag=3ZIIJ1GW2Z5M type=write size=2824960 2023-10-05T11:35:09.554 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.551+0000 7f26f5634780 1 > prepared operation key=W2GWVGX42QLD tag=5WE8E4PU6K42 type=del size=33931 2023-10-05T11:35:09.555 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.552+0000 7f26f5634780 -1 < failed to complete operation key=5OPHKTHXVN5U tag=LTVB2RMR68MO type=del size=1416574: (22) Invalid argument 2023-10-05T11:35:09.556 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.553+0000 7f26f5634780 1 > prepared operation key=W2GWVGX42QLD tag=51TBBSNTV3NQ type=write size=835354 2023-10-05T11:35:09.558 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.554+0000 7f26f5634780 1 < completed part key=_multipart_MEY4SZRHU9NZ.2~H356L4IPBOM7.0 size=1048576 2023-10-05T11:35:09.559 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.555+0000 7f26f5634780 1 < completed part key=_multipart_MEY4SZRHU9NZ.2~H356L4IPBOM7.1 size=1048576 2023-10-05T11:35:09.559 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.556+0000 7f26f5634780 1 < completed part key=_multipart_MEY4SZRHU9NZ.2~H356L4IPBOM7.2 size=644314 2023-10-05T11:35:09.562 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.558+0000 7f26f5634780 1 < completed multipart upload key=MEY4SZRHU9NZ upload=H356L4IPBOM7 tag=O1HZZJ4EWG99 type=write size=3790042 2023-10-05T11:35:09.563 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.560+0000 7f26f5634780 1 > prepared operation key=7W9LL5HSU3BG tag=2F52Q34CM634 type=del size=2525637 2023-10-05T11:35:09.564 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.561+0000 7f26f5634780 1 < completed delete operation key=J5EIH25Y471T tag=WP3JW75JZNEJ type=del 2023-10-05T11:35:09.567 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.563+0000 7f26f5634780 1 > prepared part key=_multipart_4D3H60UTIXH3.2~UTG2RB3A9TIJ.0 size=1048576 2023-10-05T11:35:09.567 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.564+0000 7f26f5634780 1 > prepared part key=_multipart_4D3H60UTIXH3.2~UTG2RB3A9TIJ.1 size=804731 2023-10-05T11:35:09.568 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.564+0000 7f26f5634780 1 > prepared multipart upload key=4D3H60UTIXH3 upload=UTG2RB3A9TIJ tag=ZP4KD33FNU2G type=write size=2901883 2023-10-05T11:35:09.569 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.565+0000 7f26f5634780 1 < completed write operation key=MEY4SZRHU9NZ tag=7P2DGRX37F2Y type=write size=758063 2023-10-05T11:35:09.571 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.568+0000 7f26f5634780 1 > prepared part key=_multipart_LLR5J3X15W5R.2~69DJL8JSCA8U.0 size=19424 2023-10-05T11:35:09.571 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.568+0000 7f26f5634780 1 > prepared multipart upload key=LLR5J3X15W5R upload=69DJL8JSCA8U tag=7S9978AVPPYX type=write size=1068000 2023-10-05T11:35:09.573 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.570+0000 7f26f5634780 1 < suggested remove operation key=7W9LL5HSU3BG tag=I71XTAI443K1 type=write 2023-10-05T11:35:09.575 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.571+0000 7f26f5634780 1 > prepared operation key=5OPHKTHXVN5U tag=SYNWU47EFJ3N type=del size=3260548 2023-10-05T11:35:09.576 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.573+0000 7f26f5634780 1 < completed delete operation key=5V0Q651D4VN2 tag=WUK6RUMHQIT9 type=del 2023-10-05T11:35:09.577 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.574+0000 7f26f5634780 1 > prepared operation key=5OPHKTHXVN5U tag=5UQX1936E4HC type=del size=4191356 2023-10-05T11:35:09.579 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.576+0000 7f26f5634780 1 < completed delete operation key=IC7T3ZK81WQS tag=KP6JYN6SEIAD type=del 2023-10-05T11:35:09.581 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.578+0000 7f26f5634780 1 > prepared part key=_multipart_761J2C7GHWU5.2~MV39R39EK5QC.0 size=1048576 2023-10-05T11:35:09.582 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.579+0000 7f26f5634780 1 > prepared part key=_multipart_761J2C7GHWU5.2~MV39R39EK5QC.1 size=1048576 2023-10-05T11:35:09.583 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.580+0000 7f26f5634780 1 > prepared part key=_multipart_761J2C7GHWU5.2~MV39R39EK5QC.2 size=853017 2023-10-05T11:35:09.583 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.580+0000 7f26f5634780 1 > prepared multipart upload key=761J2C7GHWU5 upload=MV39R39EK5QC tag=Q320AFDETYO8 type=write size=3998745 2023-10-05T11:35:09.584 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.580+0000 7f26f5634780 1 < canceled part key=_multipart_IKCNZOTVWOC6.2~VA77OI9260QG.0 size=1048576 2023-10-05T11:35:09.584 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.581+0000 7f26f5634780 1 < completed part key=_multipart_IKCNZOTVWOC6.2~VA77OI9260QG.1 size=1048576 2023-10-05T11:35:09.585 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.582+0000 7f26f5634780 1 < completed part key=_multipart_IKCNZOTVWOC6.2~VA77OI9260QG.2 size=1041373 2023-10-05T11:35:09.587 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.584+0000 7f26f5634780 1 < canceled multipart upload key=IKCNZOTVWOC6 upload=VA77OI9260QG tag=6DBXBC9DP85E type=write size=4187101 2023-10-05T11:35:09.588 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.585+0000 7f26f5634780 1 > prepared operation key=5V0Q651D4VN2 tag=4VNE8Z2QWICT type=del size=2608023 2023-10-05T11:35:09.593 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.589+0000 7f26f5634780 1 < suggested remove operation key=VJTFYDETLSFD tag=9TQMIO0Z9QNN type=del 2023-10-05T11:35:09.594 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.591+0000 7f26f5634780 1 > prepared operation key=J5EIH25Y471T tag=46H7ORLSZ931 type=del size=2565626 2023-10-05T11:35:09.595 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.592+0000 7f26f5634780 1 < completed write operation key=4IBQJLJR7LD8 tag=P3EEZ66D1QIF type=write size=975829 2023-10-05T11:35:09.597 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.593+0000 7f26f5634780 1 > prepared operation key=2D4PDQQT54ZA tag=59TTBTNKB78R type=write size=559330 2023-10-05T11:35:09.598 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.594+0000 7f26f5634780 1 < completed part key=_multipart_7W9LL5HSU3BG.2~4T7Q9NE4GYTZ.0 size=1048576 2023-10-05T11:35:09.599 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.595+0000 7f26f5634780 1 < completed part key=_multipart_7W9LL5HSU3BG.2~4T7Q9NE4GYTZ.1 size=808953 2023-10-05T11:35:09.601 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.597+0000 7f26f5634780 1 < completed multipart upload key=7W9LL5HSU3BG upload=4T7Q9NE4GYTZ tag=GT2QNU2861X3 type=write size=2906105 2023-10-05T11:35:09.602 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.599+0000 7f26f5634780 1 > prepared operation key=IC7T3ZK81WQS tag=91MF23YBUQNE type=del size=3587174 2023-10-05T11:35:09.602 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.599+0000 7f26f5634780 1 < canceled part key=_multipart_AV0XKXX1IR4B.2~GOX3UAH1IW9M.0 size=1048576 2023-10-05T11:35:09.603 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.600+0000 7f26f5634780 1 < completed part key=_multipart_AV0XKXX1IR4B.2~GOX3UAH1IW9M.1 size=1048576 2023-10-05T11:35:09.604 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.601+0000 7f26f5634780 1 < completed part key=_multipart_AV0XKXX1IR4B.2~GOX3UAH1IW9M.2 size=256845 2023-10-05T11:35:09.606 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.603+0000 7f26f5634780 1 < canceled multipart upload key=AV0XKXX1IR4B upload=GOX3UAH1IW9M tag=LPIVVK3ZHK96 type=write size=3402573 2023-10-05T11:35:09.607 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.604+0000 7f26f5634780 1 > prepared operation key=NV4Q36UOLX8A tag=1ZYZ09JN25KU type=del size=1221046 2023-10-05T11:35:09.609 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.605+0000 7f26f5634780 1 < completed part key=_multipart_U6172JUYW7J6.2~WLYQ2JHJ0EUD.0 size=1048576 2023-10-05T11:35:09.610 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.606+0000 7f26f5634780 1 < completed part key=_multipart_U6172JUYW7J6.2~WLYQ2JHJ0EUD.1 size=1048576 2023-10-05T11:35:09.611 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.607+0000 7f26f5634780 1 < completed part key=_multipart_U6172JUYW7J6.2~WLYQ2JHJ0EUD.2 size=1920 2023-10-05T11:35:09.613 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.610+0000 7f26f5634780 1 < completed multipart upload key=U6172JUYW7J6 upload=WLYQ2JHJ0EUD tag=RAX5CCJDYL0V type=write size=3147648 2023-10-05T11:35:09.614 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.611+0000 7f26f5634780 1 > prepared operation key=BU3KSHTINB36 tag=7XQHN60IIZGW type=del size=1198639 2023-10-05T11:35:09.615 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.612+0000 7f26f5634780 1 < completed part key=_multipart_PC8WTJ8AYJ24.2~MA2OL8VBRBW3.0 size=1048576 2023-10-05T11:35:09.616 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.612+0000 7f26f5634780 1 < canceled part key=_multipart_PC8WTJ8AYJ24.2~MA2OL8VBRBW3.1 size=878514 2023-10-05T11:35:09.618 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.614+0000 7f26f5634780 1 < canceled multipart upload key=PC8WTJ8AYJ24 upload=MA2OL8VBRBW3 tag=HMFCUN8D6EXJ type=write size=2975666 2023-10-05T11:35:09.620 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.617+0000 7f26f5634780 1 > prepared part key=_multipart_PNV0Q6ZPLYV0.2~G7VCI84XTVGO.0 size=1048576 2023-10-05T11:35:09.621 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.618+0000 7f26f5634780 1 > prepared part key=_multipart_PNV0Q6ZPLYV0.2~G7VCI84XTVGO.1 size=507852 2023-10-05T11:35:09.621 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.618+0000 7f26f5634780 1 > prepared multipart upload key=PNV0Q6ZPLYV0 upload=G7VCI84XTVGO tag=HAUYGK78NKUS type=write size=2605004 2023-10-05T11:35:09.623 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.619+0000 7f26f5634780 1 < completed part key=_multipart_7TOP5A52M9YP.2~0QOHWYX3MHT0.0 size=590392 2023-10-05T11:35:09.625 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.621+0000 7f26f5634780 1 < completed multipart upload key=7TOP5A52M9YP upload=0QOHWYX3MHT0 tag=20WX1QQGHAFW type=write size=1638968 2023-10-05T11:35:09.627 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.624+0000 7f26f5634780 1 > prepared part key=_multipart_5V0Q651D4VN2.2~LDY55D0AT8QI.0 size=1048576 2023-10-05T11:35:09.628 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.624+0000 7f26f5634780 1 > prepared part key=_multipart_5V0Q651D4VN2.2~LDY55D0AT8QI.1 size=422381 2023-10-05T11:35:09.628 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.624+0000 7f26f5634780 1 > prepared multipart upload key=5V0Q651D4VN2 upload=LDY55D0AT8QI tag=GVVO8QA6WQG3 type=write size=2519533 2023-10-05T11:35:09.629 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.626+0000 7f26f5634780 1 < completed delete operation key=W2GWVGX42QLD tag=5WE8E4PU6K42 type=del 2023-10-05T11:35:09.630 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.627+0000 7f26f5634780 1 > prepared operation key=WTCWG1C1SF89 tag=QRNNT41I7112 type=del size=1181948 2023-10-05T11:35:09.632 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.628+0000 7f26f5634780 1 < completed write operation key=W2GWVGX42QLD tag=51TBBSNTV3NQ type=write size=835354 2023-10-05T11:35:09.634 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.631+0000 7f26f5634780 1 > prepared part key=_multipart_J5EIH25Y471T.2~DMA54VW6TFZM.0 size=1048576 2023-10-05T11:35:09.635 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.632+0000 7f26f5634780 1 > prepared part key=_multipart_J5EIH25Y471T.2~DMA54VW6TFZM.1 size=1048576 2023-10-05T11:35:09.636 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.633+0000 7f26f5634780 1 > prepared part key=_multipart_J5EIH25Y471T.2~DMA54VW6TFZM.2 size=142912 2023-10-05T11:35:09.636 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.633+0000 7f26f5634780 1 > prepared multipart upload key=J5EIH25Y471T upload=DMA54VW6TFZM tag=TG3JJPW6RJAA type=write size=3288640 2023-10-05T11:35:09.639 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.635+0000 7f26f5634780 1 < suggested update operation key=7W9LL5HSU3BG tag=2F52Q34CM634 type=del size=2525637 2023-10-05T11:35:09.640 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.636+0000 7f26f5634780 1 > prepared operation key=5V0Q651D4VN2 tag=VG018B4IVC0F type=write size=449216 2023-10-05T11:35:09.641 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.638+0000 7f26f5634780 1 < completed part key=_multipart_4D3H60UTIXH3.2~UTG2RB3A9TIJ.0 size=1048576 2023-10-05T11:35:09.642 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.639+0000 7f26f5634780 1 < completed part key=_multipart_4D3H60UTIXH3.2~UTG2RB3A9TIJ.1 size=804731 2023-10-05T11:35:09.645 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.641+0000 7f26f5634780 1 < completed multipart upload key=4D3H60UTIXH3 upload=UTG2RB3A9TIJ tag=ZP4KD33FNU2G type=write size=2901883 2023-10-05T11:35:09.646 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.642+0000 7f26f5634780 1 > prepared operation key=7W9LL5HSU3BG tag=QUQ09D23BIB2 type=del size=2598788 2023-10-05T11:35:09.647 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.644+0000 7f26f5634780 1 < completed part key=_multipart_LLR5J3X15W5R.2~69DJL8JSCA8U.0 size=19424 2023-10-05T11:35:09.649 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.646+0000 7f26f5634780 1 < completed multipart upload key=LLR5J3X15W5R upload=69DJL8JSCA8U tag=7S9978AVPPYX type=write size=1068000 2023-10-05T11:35:09.650 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.647+0000 7f26f5634780 1 > prepared operation key=LLR5J3X15W5R tag=B2BGEVJ95K0W type=del size=1951988 2023-10-05T11:35:09.652 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.648+0000 7f26f5634780 1 < completed delete operation key=5OPHKTHXVN5U tag=SYNWU47EFJ3N type=del 2023-10-05T11:35:09.653 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.650+0000 7f26f5634780 1 > prepared operation key=7TOP5A52M9YP tag=R5P26CXXR70K type=del size=2806820 2023-10-05T11:35:09.656 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.652+0000 7f26f5634780 1 < suggested remove operation key=5OPHKTHXVN5U tag=5UQX1936E4HC type=del 2023-10-05T11:35:09.658 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.655+0000 7f26f5634780 1 > prepared part key=_multipart_BTZUVE8R96XT.2~7KV81QZNOQK6.0 size=589533 2023-10-05T11:35:09.658 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.655+0000 7f26f5634780 1 > prepared multipart upload key=BTZUVE8R96XT upload=7KV81QZNOQK6 tag=EC4YUR3OBV5Y type=write size=1638109 2023-10-05T11:35:09.659 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.656+0000 7f26f5634780 1 < completed part key=_multipart_761J2C7GHWU5.2~MV39R39EK5QC.0 size=1048576 2023-10-05T11:35:09.660 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.656+0000 7f26f5634780 1 < canceled part key=_multipart_761J2C7GHWU5.2~MV39R39EK5QC.1 size=1048576 2023-10-05T11:35:09.660 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.656+0000 7f26f5634780 1 < canceled part key=_multipart_761J2C7GHWU5.2~MV39R39EK5QC.2 size=853017 2023-10-05T11:35:09.661 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.658+0000 7f26f5634780 1 < canceled multipart upload key=761J2C7GHWU5 upload=MV39R39EK5QC tag=Q320AFDETYO8 type=write size=3998745 2023-10-05T11:35:09.664 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.660+0000 7f26f5634780 1 > prepared part key=_multipart_J5EIH25Y471T.2~X1QOVX3BTIBA.0 size=1048576 2023-10-05T11:35:09.664 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.661+0000 7f26f5634780 1 > prepared part key=_multipart_J5EIH25Y471T.2~X1QOVX3BTIBA.1 size=1048576 2023-10-05T11:35:09.665 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.662+0000 7f26f5634780 1 > prepared part key=_multipart_J5EIH25Y471T.2~X1QOVX3BTIBA.2 size=755023 2023-10-05T11:35:09.665 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.662+0000 7f26f5634780 1 > prepared multipart upload key=J5EIH25Y471T upload=X1QOVX3BTIBA tag=79GLJEI6AJLU type=write size=3900751 2023-10-05T11:35:09.668 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.664+0000 7f26f5634780 1 < suggested update operation key=5V0Q651D4VN2 tag=4VNE8Z2QWICT type=del size=2608023 2023-10-05T11:35:09.670 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.666+0000 7f26f5634780 1 > prepared part key=_multipart_LLR5J3X15W5R.2~T930YWT8U96I.0 size=4463 2023-10-05T11:35:09.670 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.666+0000 7f26f5634780 1 > prepared multipart upload key=LLR5J3X15W5R upload=T930YWT8U96I tag=LTHEXACHC5RU type=write size=1053039 2023-10-05T11:35:09.671 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.668+0000 7f26f5634780 1 < completed delete operation key=J5EIH25Y471T tag=46H7ORLSZ931 type=del 2023-10-05T11:35:09.672 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.669+0000 7f26f5634780 1 > prepared operation key=8IPCP77WVVZT tag=1Q0045TSZO41 type=write size=682030 2023-10-05T11:35:09.673 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.670+0000 7f26f5634780 1 < completed write operation key=2D4PDQQT54ZA tag=59TTBTNKB78R type=write size=559330 2023-10-05T11:35:09.675 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.671+0000 7f26f5634780 1 > prepared operation key=AV0XKXX1IR4B tag=TFL0PXASVZZ9 type=del size=3876915 2023-10-05T11:35:09.676 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.673+0000 7f26f5634780 1 < completed delete operation key=IC7T3ZK81WQS tag=91MF23YBUQNE type=del 2023-10-05T11:35:09.678 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.675+0000 7f26f5634780 1 > prepared part key=_multipart_LLR5J3X15W5R.2~HIMQ9MEH5L9G.0 size=200718 2023-10-05T11:35:09.678 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.675+0000 7f26f5634780 1 > prepared multipart upload key=LLR5J3X15W5R upload=HIMQ9MEH5L9G tag=3RQ9NF5COMDC type=write size=1249294 2023-10-05T11:35:09.680 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.677+0000 7f26f5634780 1 < suggested remove operation key=NV4Q36UOLX8A tag=1ZYZ09JN25KU type=del 2023-10-05T11:35:09.682 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.678+0000 7f26f5634780 1 > prepared operation key=BTZUVE8R96XT tag=83ZR2VX06KX0 type=del size=1963577 2023-10-05T11:35:09.683 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.679+0000 7f26f5634780 1 < completed delete operation key=BU3KSHTINB36 tag=7XQHN60IIZGW type=del 2023-10-05T11:35:09.685 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.682+0000 7f26f5634780 1 > prepared part key=_multipart_WTCWG1C1SF89.2~G8KPRCAJJYSN.0 size=1048576 2023-10-05T11:35:09.686 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.683+0000 7f26f5634780 1 > prepared part key=_multipart_WTCWG1C1SF89.2~G8KPRCAJJYSN.1 size=641638 2023-10-05T11:35:09.686 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.683+0000 7f26f5634780 1 > prepared multipart upload key=WTCWG1C1SF89 upload=G8KPRCAJJYSN tag=HP6EUMEI57R9 type=write size=2738790 2023-10-05T11:35:09.687 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.684+0000 7f26f5634780 1 < completed part key=_multipart_PNV0Q6ZPLYV0.2~G7VCI84XTVGO.0 size=1048576 2023-10-05T11:35:09.688 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.685+0000 7f26f5634780 1 < completed part key=_multipart_PNV0Q6ZPLYV0.2~G7VCI84XTVGO.1 size=507852 2023-10-05T11:35:09.690 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.687+0000 7f26f5634780 1 < completed multipart upload key=PNV0Q6ZPLYV0 upload=G7VCI84XTVGO tag=HAUYGK78NKUS type=write size=2605004 2023-10-05T11:35:09.692 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.689+0000 7f26f5634780 1 > prepared part key=_multipart_J5EIH25Y471T.2~JDB35C4ZP46K.0 size=1048576 2023-10-05T11:35:09.693 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.690+0000 7f26f5634780 1 > prepared part key=_multipart_J5EIH25Y471T.2~JDB35C4ZP46K.1 size=683768 2023-10-05T11:35:09.693 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.690+0000 7f26f5634780 1 > prepared multipart upload key=J5EIH25Y471T upload=JDB35C4ZP46K tag=4GPJA5GIMA9K type=write size=2780920 2023-10-05T11:35:09.695 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.692+0000 7f26f5634780 1 < completed part key=_multipart_5V0Q651D4VN2.2~LDY55D0AT8QI.0 size=1048576 2023-10-05T11:35:09.696 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.692+0000 7f26f5634780 1 < completed part key=_multipart_5V0Q651D4VN2.2~LDY55D0AT8QI.1 size=422381 2023-10-05T11:35:09.698 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.695+0000 7f26f5634780 1 < completed multipart upload key=5V0Q651D4VN2 upload=LDY55D0AT8QI tag=GVVO8QA6WQG3 type=write size=2519533 2023-10-05T11:35:09.700 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.697+0000 7f26f5634780 1 > prepared part key=_multipart_U6172JUYW7J6.2~8I0TKK6MWSCN.0 size=1048576 2023-10-05T11:35:09.701 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.698+0000 7f26f5634780 1 > prepared part key=_multipart_U6172JUYW7J6.2~8I0TKK6MWSCN.1 size=1048576 2023-10-05T11:35:09.702 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.699+0000 7f26f5634780 1 > prepared part key=_multipart_U6172JUYW7J6.2~8I0TKK6MWSCN.2 size=949672 2023-10-05T11:35:09.702 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.699+0000 7f26f5634780 1 > prepared multipart upload key=U6172JUYW7J6 upload=8I0TKK6MWSCN tag=P29KOHL2AIQO type=write size=4095400 2023-10-05T11:35:09.703 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.700+0000 7f26f5634780 1 < completed delete operation key=WTCWG1C1SF89 tag=QRNNT41I7112 type=del 2023-10-05T11:35:09.705 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.702+0000 7f26f5634780 1 > prepared part key=_multipart_IC7T3ZK81WQS.2~RBQNIIL0MJ4F.0 size=1048576 2023-10-05T11:35:09.706 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.703+0000 7f26f5634780 1 > prepared part key=_multipart_IC7T3ZK81WQS.2~RBQNIIL0MJ4F.1 size=336347 2023-10-05T11:35:09.707 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.703+0000 7f26f5634780 1 > prepared multipart upload key=IC7T3ZK81WQS upload=RBQNIIL0MJ4F tag=XGWMMK9NAX69 type=write size=2433499 2023-10-05T11:35:09.708 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.704+0000 7f26f5634780 1 < completed part key=_multipart_J5EIH25Y471T.2~DMA54VW6TFZM.0 size=1048576 2023-10-05T11:35:09.709 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.705+0000 7f26f5634780 1 < completed part key=_multipart_J5EIH25Y471T.2~DMA54VW6TFZM.1 size=1048576 2023-10-05T11:35:09.710 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.706+0000 7f26f5634780 1 < completed part key=_multipart_J5EIH25Y471T.2~DMA54VW6TFZM.2 size=142912 2023-10-05T11:35:09.712 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.708+0000 7f26f5634780 1 < completed multipart upload key=J5EIH25Y471T upload=DMA54VW6TFZM tag=TG3JJPW6RJAA type=write size=3288640 2023-10-05T11:35:09.713 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.710+0000 7f26f5634780 1 > prepared operation key=2U0NRDGDNUTA tag=O4M0PXPQDTOV type=del size=1962261 2023-10-05T11:35:09.714 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.711+0000 7f26f5634780 -1 < failed to complete operation key=5V0Q651D4VN2 tag=VG018B4IVC0F type=write size=449216: (22) Invalid argument 2023-10-05T11:35:09.715 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.712+0000 7f26f5634780 1 > prepared operation key=0PWYKC7S6YJ4 tag=8PTX27TA15PZ type=del size=2192112 2023-10-05T11:35:09.717 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.713+0000 7f26f5634780 1 < completed delete operation key=7W9LL5HSU3BG tag=QUQ09D23BIB2 type=del 2023-10-05T11:35:09.718 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.714+0000 7f26f5634780 1 > prepared operation key=VJTFYDETLSFD tag=WHDLB712OZH0 type=write size=10543 2023-10-05T11:35:09.720 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.717+0000 7f26f5634780 1 < suggested update operation key=LLR5J3X15W5R tag=B2BGEVJ95K0W type=del size=1951988 2023-10-05T11:35:09.721 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.718+0000 7f26f5634780 1 > prepared operation key=U6172JUYW7J6 tag=2WDZCC6U43S0 type=del size=278468 2023-10-05T11:35:09.722 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.719+0000 7f26f5634780 1 < completed delete operation key=7TOP5A52M9YP tag=R5P26CXXR70K type=del 2023-10-05T11:35:09.724 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.720+0000 7f26f5634780 1 > prepared operation key=MEY4SZRHU9NZ tag=TS501W4TVHF1 type=del size=2694810 2023-10-05T11:35:09.725 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.722+0000 7f26f5634780 1 < completed part key=_multipart_BTZUVE8R96XT.2~7KV81QZNOQK6.0 size=589533 2023-10-05T11:35:09.727 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.724+0000 7f26f5634780 1 < completed multipart upload key=BTZUVE8R96XT upload=7KV81QZNOQK6 tag=EC4YUR3OBV5Y type=write size=1638109 2023-10-05T11:35:09.729 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.726+0000 7f26f5634780 1 > prepared part key=_multipart_FOMNIIY47UUM.2~WS34GRPBOSTR.0 size=872629 2023-10-05T11:35:09.730 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.726+0000 7f26f5634780 1 > prepared multipart upload key=FOMNIIY47UUM upload=WS34GRPBOSTR tag=2ALYVF67VNW1 type=write size=1921205 2023-10-05T11:35:09.731 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.727+0000 7f26f5634780 1 < completed part key=_multipart_J5EIH25Y471T.2~X1QOVX3BTIBA.0 size=1048576 2023-10-05T11:35:09.732 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.728+0000 7f26f5634780 1 < completed part key=_multipart_J5EIH25Y471T.2~X1QOVX3BTIBA.1 size=1048576 2023-10-05T11:35:09.733 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.729+0000 7f26f5634780 1 < completed part key=_multipart_J5EIH25Y471T.2~X1QOVX3BTIBA.2 size=755023 2023-10-05T11:35:09.735 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.731+0000 7f26f5634780 1 < completed multipart upload key=J5EIH25Y471T upload=X1QOVX3BTIBA tag=79GLJEI6AJLU type=write size=3900751 2023-10-05T11:35:09.736 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.732+0000 7f26f5634780 1 > prepared operation key=LLR5J3X15W5R tag=6B1WB5QLBCXL type=del size=2069581 2023-10-05T11:35:09.737 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.734+0000 7f26f5634780 1 < completed part key=_multipart_LLR5J3X15W5R.2~T930YWT8U96I.0 size=4463 2023-10-05T11:35:09.739 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.736+0000 7f26f5634780 1 < completed multipart upload key=LLR5J3X15W5R upload=T930YWT8U96I tag=LTHEXACHC5RU type=write size=1053039 2023-10-05T11:35:09.741 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.738+0000 7f26f5634780 1 > prepared part key=_multipart_9S0YW7PPSJ8G.2~34ROGRMC21MN.0 size=803508 2023-10-05T11:35:09.742 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.738+0000 7f26f5634780 1 > prepared multipart upload key=9S0YW7PPSJ8G upload=34ROGRMC21MN tag=BON0NBEUU60I type=write size=1852084 2023-10-05T11:35:09.743 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.739+0000 7f26f5634780 1 < completed write operation key=8IPCP77WVVZT tag=1Q0045TSZO41 type=write size=682030 2023-10-05T11:35:09.744 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.740+0000 7f26f5634780 1 > prepared operation key=NV4Q36UOLX8A tag=02ZUIMFF62V8 type=del size=386596 2023-10-05T11:35:09.745 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.742+0000 7f26f5634780 1 < canceled operation key=AV0XKXX1IR4B tag=TFL0PXASVZZ9 type=del size=3876915 2023-10-05T11:35:09.748 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.744+0000 7f26f5634780 1 > prepared part key=_multipart_7TOP5A52M9YP.2~DF7RTF6ZU7F6.0 size=1048576 2023-10-05T11:35:09.748 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.745+0000 7f26f5634780 1 > prepared part key=_multipart_7TOP5A52M9YP.2~DF7RTF6ZU7F6.1 size=1048576 2023-10-05T11:35:09.750 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.746+0000 7f26f5634780 1 > prepared part key=_multipart_7TOP5A52M9YP.2~DF7RTF6ZU7F6.2 size=1047478 2023-10-05T11:35:09.750 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.746+0000 7f26f5634780 1 > prepared multipart upload key=7TOP5A52M9YP upload=DF7RTF6ZU7F6 tag=0LU1E2100OM1 type=write size=4193206 2023-10-05T11:35:09.751 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.747+0000 7f26f5634780 1 < completed part key=_multipart_LLR5J3X15W5R.2~HIMQ9MEH5L9G.0 size=200718 2023-10-05T11:35:09.753 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.749+0000 7f26f5634780 1 < completed multipart upload key=LLR5J3X15W5R upload=HIMQ9MEH5L9G tag=3RQ9NF5COMDC type=write size=1249294 2023-10-05T11:35:09.754 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.751+0000 7f26f5634780 1 > prepared operation key=IKCNZOTVWOC6 tag=14UWQZBPQME3 type=del size=3811464 2023-10-05T11:35:09.755 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.752+0000 7f26f5634780 1 < canceled operation key=BTZUVE8R96XT tag=83ZR2VX06KX0 type=del size=1963577 2023-10-05T11:35:09.758 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.754+0000 7f26f5634780 1 > prepared part key=_multipart_LLR5J3X15W5R.2~UGE57SP6T7KN.0 size=1048576 2023-10-05T11:35:09.758 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.755+0000 7f26f5634780 1 > prepared part key=_multipart_LLR5J3X15W5R.2~UGE57SP6T7KN.1 size=28645 2023-10-05T11:35:09.759 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.755+0000 7f26f5634780 1 > prepared multipart upload key=LLR5J3X15W5R upload=UGE57SP6T7KN tag=2YCOFQTM3C4F type=write size=2125797 2023-10-05T11:35:09.760 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.756+0000 7f26f5634780 1 < completed part key=_multipart_WTCWG1C1SF89.2~G8KPRCAJJYSN.0 size=1048576 2023-10-05T11:35:09.761 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.757+0000 7f26f5634780 1 < completed part key=_multipart_WTCWG1C1SF89.2~G8KPRCAJJYSN.1 size=641638 2023-10-05T11:35:09.763 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.759+0000 7f26f5634780 1 < completed multipart upload key=WTCWG1C1SF89 upload=G8KPRCAJJYSN tag=HP6EUMEI57R9 type=write size=2738790 2023-10-05T11:35:09.765 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.761+0000 7f26f5634780 1 > prepared part key=_multipart_S3DKYDFT4IO2.2~9M1TTEZRMUTX.0 size=782547 2023-10-05T11:35:09.765 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.761+0000 7f26f5634780 1 > prepared multipart upload key=S3DKYDFT4IO2 upload=9M1TTEZRMUTX tag=TFFC25X8SOEK type=write size=1831123 2023-10-05T11:35:09.766 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.763+0000 7f26f5634780 1 < completed part key=_multipart_J5EIH25Y471T.2~JDB35C4ZP46K.0 size=1048576 2023-10-05T11:35:09.767 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.764+0000 7f26f5634780 1 < completed part key=_multipart_J5EIH25Y471T.2~JDB35C4ZP46K.1 size=683768 2023-10-05T11:35:09.769 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.766+0000 7f26f5634780 1 < completed multipart upload key=J5EIH25Y471T upload=JDB35C4ZP46K tag=4GPJA5GIMA9K type=write size=2780920 2023-10-05T11:35:09.771 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.768+0000 7f26f5634780 1 > prepared part key=_multipart_IC7T3ZK81WQS.2~947864JHHXIF.0 size=1048576 2023-10-05T11:35:09.773 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.769+0000 7f26f5634780 1 > prepared part key=_multipart_IC7T3ZK81WQS.2~947864JHHXIF.1 size=1048576 2023-10-05T11:35:09.774 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.770+0000 7f26f5634780 1 > prepared part key=_multipart_IC7T3ZK81WQS.2~947864JHHXIF.2 size=664792 2023-10-05T11:35:09.774 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.770+0000 7f26f5634780 1 > prepared multipart upload key=IC7T3ZK81WQS upload=947864JHHXIF tag=W6A6Z95YRZMV type=write size=3810520 2023-10-05T11:35:09.775 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.771+0000 7f26f5634780 1 < completed part key=_multipart_U6172JUYW7J6.2~8I0TKK6MWSCN.0 size=1048576 2023-10-05T11:35:09.776 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.773+0000 7f26f5634780 1 < completed part key=_multipart_U6172JUYW7J6.2~8I0TKK6MWSCN.1 size=1048576 2023-10-05T11:35:09.777 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.774+0000 7f26f5634780 1 < completed part key=_multipart_U6172JUYW7J6.2~8I0TKK6MWSCN.2 size=949672 2023-10-05T11:35:09.779 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.776+0000 7f26f5634780 1 < completed multipart upload key=U6172JUYW7J6 upload=8I0TKK6MWSCN tag=P29KOHL2AIQO type=write size=4095400 2023-10-05T11:35:09.781 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.778+0000 7f26f5634780 1 > prepared operation key=8IPCP77WVVZT tag=2FXOTNYJL4OB type=del size=2290850 2023-10-05T11:35:09.783 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.779+0000 7f26f5634780 1 < completed part key=_multipart_IC7T3ZK81WQS.2~RBQNIIL0MJ4F.0 size=1048576 2023-10-05T11:35:09.783 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.780+0000 7f26f5634780 1 < completed part key=_multipart_IC7T3ZK81WQS.2~RBQNIIL0MJ4F.1 size=336347 2023-10-05T11:35:09.786 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.782+0000 7f26f5634780 1 < completed multipart upload key=IC7T3ZK81WQS upload=RBQNIIL0MJ4F tag=XGWMMK9NAX69 type=write size=2433499 2023-10-05T11:35:09.787 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.783+0000 7f26f5634780 1 > prepared operation key=J5EIH25Y471T tag=II81XQ5YL9ID type=del size=716287 2023-10-05T11:35:09.788 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.785+0000 7f26f5634780 1 < completed delete operation key=2U0NRDGDNUTA tag=O4M0PXPQDTOV type=del 2023-10-05T11:35:09.789 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.786+0000 7f26f5634780 1 > prepared operation key=2U0NRDGDNUTA tag=WD2QILELX0GU type=del size=1301836 2023-10-05T11:35:09.791 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.787+0000 7f26f5634780 1 < completed delete operation key=0PWYKC7S6YJ4 tag=8PTX27TA15PZ type=del 2023-10-05T11:35:09.792 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.788+0000 7f26f5634780 1 > prepared operation key=5OPHKTHXVN5U tag=PRVNTKCM0VGL type=write size=700868 2023-10-05T11:35:09.793 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.790+0000 7f26f5634780 1 < completed write operation key=VJTFYDETLSFD tag=WHDLB712OZH0 type=write size=10543 2023-10-05T11:35:09.795 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.791+0000 7f26f5634780 1 > prepared operation key=0PWYKC7S6YJ4 tag=HV86FBFH4664 type=del size=3516309 2023-10-05T11:35:09.796 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.792+0000 7f26f5634780 1 < completed delete operation key=U6172JUYW7J6 tag=2WDZCC6U43S0 type=del 2023-10-05T11:35:09.798 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.794+0000 7f26f5634780 1 > prepared part key=_multipart_6DP3UJ4CW1MO.2~DVKMX0BPVX1X.0 size=1048576 2023-10-05T11:35:09.799 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.795+0000 7f26f5634780 1 > prepared part key=_multipart_6DP3UJ4CW1MO.2~DVKMX0BPVX1X.1 size=1048576 2023-10-05T11:35:09.800 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.796+0000 7f26f5634780 1 > prepared part key=_multipart_6DP3UJ4CW1MO.2~DVKMX0BPVX1X.2 size=393975 2023-10-05T11:35:09.800 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.796+0000 7f26f5634780 1 > prepared multipart upload key=6DP3UJ4CW1MO upload=DVKMX0BPVX1X tag=BWRGLBJM3G7D type=write size=3539703 2023-10-05T11:35:09.802 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.798+0000 7f26f5634780 1 < suggested remove operation key=MEY4SZRHU9NZ tag=TS501W4TVHF1 type=del 2023-10-05T11:35:09.803 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.800+0000 7f26f5634780 1 > prepared operation key=BTZUVE8R96XT tag=TD1QU2AMXPGC type=del size=484425 2023-10-05T11:35:09.804 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.801+0000 7f26f5634780 1 < completed part key=_multipart_FOMNIIY47UUM.2~WS34GRPBOSTR.0 size=872629 2023-10-05T11:35:09.806 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.803+0000 7f26f5634780 1 < completed multipart upload key=FOMNIIY47UUM upload=WS34GRPBOSTR tag=2ALYVF67VNW1 type=write size=1921205 2023-10-05T11:35:09.808 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.805+0000 7f26f5634780 1 > prepared operation key=2U0NRDGDNUTA tag=JC8C2XOBO03J type=del size=748652 2023-10-05T11:35:09.810 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.806+0000 7f26f5634780 1 < canceled operation key=LLR5J3X15W5R tag=6B1WB5QLBCXL type=del size=2069581 2023-10-05T11:35:09.811 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.807+0000 7f26f5634780 1 > prepared operation key=4D3H60UTIXH3 tag=BG81TV2G1BQK type=del size=2015150 2023-10-05T11:35:09.812 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.809+0000 7f26f5634780 1 < completed part key=_multipart_9S0YW7PPSJ8G.2~34ROGRMC21MN.0 size=803508 2023-10-05T11:35:09.814 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.811+0000 7f26f5634780 1 < completed multipart upload key=9S0YW7PPSJ8G upload=34ROGRMC21MN tag=BON0NBEUU60I type=write size=1852084 2023-10-05T11:35:09.816 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.813+0000 7f26f5634780 1 > prepared part key=_multipart_WTCWG1C1SF89.2~CR08I8YYKZB7.0 size=636416 2023-10-05T11:35:09.816 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.813+0000 7f26f5634780 1 > prepared multipart upload key=WTCWG1C1SF89 upload=CR08I8YYKZB7 tag=PQOR5Q0FJUUW type=write size=1684992 2023-10-05T11:35:09.818 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.814+0000 7f26f5634780 1 < completed delete operation key=NV4Q36UOLX8A tag=02ZUIMFF62V8 type=del 2023-10-05T11:35:09.820 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.816+0000 7f26f5634780 1 > prepared part key=_multipart_BTZUVE8R96XT.2~OOXC2CBSPK60.0 size=384279 2023-10-05T11:35:09.820 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.816+0000 7f26f5634780 1 > prepared multipart upload key=BTZUVE8R96XT upload=OOXC2CBSPK60 tag=FAEQL7ZES3ZO type=write size=1432855 2023-10-05T11:35:09.821 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.818+0000 7f26f5634780 1 < completed part key=_multipart_7TOP5A52M9YP.2~DF7RTF6ZU7F6.0 size=1048576 2023-10-05T11:35:09.822 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.819+0000 7f26f5634780 1 < completed part key=_multipart_7TOP5A52M9YP.2~DF7RTF6ZU7F6.1 size=1048576 2023-10-05T11:35:09.823 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.820+0000 7f26f5634780 1 < completed part key=_multipart_7TOP5A52M9YP.2~DF7RTF6ZU7F6.2 size=1047478 2023-10-05T11:35:09.827 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.824+0000 7f26f5634780 1 < completed multipart upload key=7TOP5A52M9YP upload=DF7RTF6ZU7F6 tag=0LU1E2100OM1 type=write size=4193206 2023-10-05T11:35:09.829 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.826+0000 7f26f5634780 1 > prepared part key=_multipart_IKCNZOTVWOC6.2~HTKI91YTLBG0.0 size=921160 2023-10-05T11:35:09.829 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.826+0000 7f26f5634780 1 > prepared multipart upload key=IKCNZOTVWOC6 upload=HTKI91YTLBG0 tag=D4LIRPHG7T8O type=write size=1969736 2023-10-05T11:35:09.831 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.827+0000 7f26f5634780 1 < completed delete operation key=IKCNZOTVWOC6 tag=14UWQZBPQME3 type=del 2023-10-05T11:35:09.833 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.829+0000 7f26f5634780 1 > prepared part key=_multipart_PNV0Q6ZPLYV0.2~PD2MVVJ9HG39.0 size=1048576 2023-10-05T11:35:09.834 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.830+0000 7f26f5634780 1 > prepared part key=_multipart_PNV0Q6ZPLYV0.2~PD2MVVJ9HG39.1 size=880629 2023-10-05T11:35:09.834 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.830+0000 7f26f5634780 1 > prepared multipart upload key=PNV0Q6ZPLYV0 upload=PD2MVVJ9HG39 tag=T8WKL9WI84OV type=write size=2977781 2023-10-05T11:35:09.835 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.832+0000 7f26f5634780 1 < completed part key=_multipart_LLR5J3X15W5R.2~UGE57SP6T7KN.0 size=1048576 2023-10-05T11:35:09.836 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.833+0000 7f26f5634780 1 < completed part key=_multipart_LLR5J3X15W5R.2~UGE57SP6T7KN.1 size=28645 2023-10-05T11:35:09.838 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.835+0000 7f26f5634780 1 < completed multipart upload key=LLR5J3X15W5R upload=UGE57SP6T7KN tag=2YCOFQTM3C4F type=write size=2125797 2023-10-05T11:35:09.840 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.837+0000 7f26f5634780 1 > prepared part key=_multipart_6DP3UJ4CW1MO.2~QICI5T97G5JB.0 size=778183 2023-10-05T11:35:09.840 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.837+0000 7f26f5634780 1 > prepared multipart upload key=6DP3UJ4CW1MO upload=QICI5T97G5JB tag=IB4UOATMLA5J type=write size=1826759 2023-10-05T11:35:09.841 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.838+0000 7f26f5634780 1 < completed part key=_multipart_S3DKYDFT4IO2.2~9M1TTEZRMUTX.0 size=782547 2023-10-05T11:35:09.843 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.840+0000 7f26f5634780 1 < completed multipart upload key=S3DKYDFT4IO2 upload=9M1TTEZRMUTX tag=TFFC25X8SOEK type=write size=1831123 2023-10-05T11:35:09.845 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.842+0000 7f26f5634780 1 > prepared part key=_multipart_PNV0Q6ZPLYV0.2~VNRRBU2EZFBK.0 size=79869 2023-10-05T11:35:09.845 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.842+0000 7f26f5634780 1 > prepared multipart upload key=PNV0Q6ZPLYV0 upload=VNRRBU2EZFBK tag=L8R1QUZL2LUS type=write size=1128445 2023-10-05T11:35:09.846 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.843+0000 7f26f5634780 1 < completed part key=_multipart_IC7T3ZK81WQS.2~947864JHHXIF.0 size=1048576 2023-10-05T11:35:09.847 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.844+0000 7f26f5634780 1 < completed part key=_multipart_IC7T3ZK81WQS.2~947864JHHXIF.1 size=1048576 2023-10-05T11:35:09.849 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.845+0000 7f26f5634780 1 < completed part key=_multipart_IC7T3ZK81WQS.2~947864JHHXIF.2 size=664792 2023-10-05T11:35:09.850 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.847+0000 7f26f5634780 1 < completed multipart upload key=IC7T3ZK81WQS upload=947864JHHXIF tag=W6A6Z95YRZMV type=write size=3810520 2023-10-05T11:35:09.853 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.849+0000 7f26f5634780 1 > prepared part key=_multipart_6DP3UJ4CW1MO.2~1JH0F7YBX5TY.0 size=1048576 2023-10-05T11:35:09.854 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.850+0000 7f26f5634780 1 > prepared part key=_multipart_6DP3UJ4CW1MO.2~1JH0F7YBX5TY.1 size=848352 2023-10-05T11:35:09.854 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.850+0000 7f26f5634780 1 > prepared multipart upload key=6DP3UJ4CW1MO upload=1JH0F7YBX5TY tag=84AXJSPO3CVZ type=write size=2945504 2023-10-05T11:35:09.855 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.851+0000 7f26f5634780 1 < completed delete operation key=8IPCP77WVVZT tag=2FXOTNYJL4OB type=del 2023-10-05T11:35:09.856 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.853+0000 7f26f5634780 1 > prepared operation key=9S0YW7PPSJ8G tag=4S9PT56380JW type=del size=4191718 2023-10-05T11:35:09.857 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.854+0000 7f26f5634780 1 < completed delete operation key=J5EIH25Y471T tag=II81XQ5YL9ID type=del 2023-10-05T11:35:09.858 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.855+0000 7f26f5634780 1 > prepared operation key=NV4Q36UOLX8A tag=D2BUKT30OQVP type=del size=663820 2023-10-05T11:35:09.860 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.856+0000 7f26f5634780 1 < completed delete operation key=2U0NRDGDNUTA tag=WD2QILELX0GU type=del 2023-10-05T11:35:09.862 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.858+0000 7f26f5634780 1 > prepared part key=_multipart_5OPHKTHXVN5U.2~H04TQF2C1O0T.0 size=310201 2023-10-05T11:35:09.862 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.858+0000 7f26f5634780 1 > prepared multipart upload key=5OPHKTHXVN5U upload=H04TQF2C1O0T tag=CTLKCR9ZFEWW type=write size=1358777 2023-10-05T11:35:09.864 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.861+0000 7f26f5634780 1 < suggested update operation key=5OPHKTHXVN5U tag=PRVNTKCM0VGL type=write size=700868 2023-10-05T11:35:09.866 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.863+0000 7f26f5634780 1 > prepared part key=_multipart_PNV0Q6ZPLYV0.2~TP1H1N7OS6RN.0 size=728087 2023-10-05T11:35:09.867 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.863+0000 7f26f5634780 1 > prepared multipart upload key=PNV0Q6ZPLYV0 upload=TP1H1N7OS6RN tag=61QI8JKYNJ9W type=write size=1776663 2023-10-05T11:35:09.868 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.864+0000 7f26f5634780 1 < completed delete operation key=0PWYKC7S6YJ4 tag=HV86FBFH4664 type=del 2023-10-05T11:35:09.869 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.866+0000 7f26f5634780 1 > prepared operation key=FOMNIIY47UUM tag=8RLXC50O8ULY type=del size=2812572 2023-10-05T11:35:09.870 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.867+0000 7f26f5634780 1 < completed part key=_multipart_6DP3UJ4CW1MO.2~DVKMX0BPVX1X.0 size=1048576 2023-10-05T11:35:09.871 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.868+0000 7f26f5634780 1 < completed part key=_multipart_6DP3UJ4CW1MO.2~DVKMX0BPVX1X.1 size=1048576 2023-10-05T11:35:09.872 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.869+0000 7f26f5634780 1 < completed part key=_multipart_6DP3UJ4CW1MO.2~DVKMX0BPVX1X.2 size=393975 2023-10-05T11:35:09.874 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.871+0000 7f26f5634780 1 < completed multipart upload key=6DP3UJ4CW1MO upload=DVKMX0BPVX1X tag=BWRGLBJM3G7D type=write size=3539703 2023-10-05T11:35:09.877 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.873+0000 7f26f5634780 1 > prepared part key=_multipart_5OPHKTHXVN5U.2~UZ0MWY6APDW2.0 size=1048576 2023-10-05T11:35:09.878 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.874+0000 7f26f5634780 1 > prepared part key=_multipart_5OPHKTHXVN5U.2~UZ0MWY6APDW2.1 size=718271 2023-10-05T11:35:09.878 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.874+0000 7f26f5634780 1 > prepared multipart upload key=5OPHKTHXVN5U upload=UZ0MWY6APDW2 tag=6T17HW23UZS9 type=write size=2815423 2023-10-05T11:35:09.879 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.875+0000 7f26f5634780 1 < completed delete operation key=BTZUVE8R96XT tag=TD1QU2AMXPGC type=del 2023-10-05T11:35:09.881 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.878+0000 7f26f5634780 1 > prepared part key=_multipart_AV0XKXX1IR4B.2~U7SM3GA2CRU2.0 size=1048576 2023-10-05T11:35:09.882 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.878+0000 7f26f5634780 1 > prepared part key=_multipart_AV0XKXX1IR4B.2~U7SM3GA2CRU2.1 size=1048576 2023-10-05T11:35:09.883 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.879+0000 7f26f5634780 1 > prepared part key=_multipart_AV0XKXX1IR4B.2~U7SM3GA2CRU2.2 size=431400 2023-10-05T11:35:09.883 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.879+0000 7f26f5634780 1 > prepared multipart upload key=AV0XKXX1IR4B upload=U7SM3GA2CRU2 tag=LY8JBRB4GK16 type=write size=3577128 2023-10-05T11:35:09.884 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.881+0000 7f26f5634780 1 < completed delete operation key=2U0NRDGDNUTA tag=JC8C2XOBO03J type=del 2023-10-05T11:35:09.885 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.882+0000 7f26f5634780 1 > prepared operation key=FOMNIIY47UUM tag=A7QH9WFVTEF0 type=del size=1506274 2023-10-05T11:35:09.886 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.883+0000 7f26f5634780 1 < canceled operation key=4D3H60UTIXH3 tag=BG81TV2G1BQK type=del size=2015150 2023-10-05T11:35:09.888 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.885+0000 7f26f5634780 1 > prepared part key=_multipart_WYN9BG66LA3K.2~ZNM679BIUMAF.0 size=1048576 2023-10-05T11:35:09.889 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.886+0000 7f26f5634780 1 > prepared part key=_multipart_WYN9BG66LA3K.2~ZNM679BIUMAF.1 size=1048576 2023-10-05T11:35:09.890 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.887+0000 7f26f5634780 1 > prepared part key=_multipart_WYN9BG66LA3K.2~ZNM679BIUMAF.2 size=386748 2023-10-05T11:35:09.891 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.887+0000 7f26f5634780 1 > prepared multipart upload key=WYN9BG66LA3K upload=ZNM679BIUMAF tag=X04759ZWYDNL type=write size=3532476 2023-10-05T11:35:09.892 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.888+0000 7f26f5634780 1 < completed part key=_multipart_WTCWG1C1SF89.2~CR08I8YYKZB7.0 size=636416 2023-10-05T11:35:09.894 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.890+0000 7f26f5634780 1 < completed multipart upload key=WTCWG1C1SF89 upload=CR08I8YYKZB7 tag=PQOR5Q0FJUUW type=write size=1684992 2023-10-05T11:35:09.895 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.892+0000 7f26f5634780 1 > prepared operation key=QYQDXVIGZ7O8 tag=PCPFT9QU0A3L type=del size=1629284 2023-10-05T11:35:09.896 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.893+0000 7f26f5634780 1 < completed part key=_multipart_BTZUVE8R96XT.2~OOXC2CBSPK60.0 size=384279 2023-10-05T11:35:09.898 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.895+0000 7f26f5634780 1 < completed multipart upload key=BTZUVE8R96XT upload=OOXC2CBSPK60 tag=FAEQL7ZES3ZO type=write size=1432855 2023-10-05T11:35:09.900 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.896+0000 7f26f5634780 1 > prepared operation key=5OPHKTHXVN5U tag=RKXT4I29XD8Y type=del size=4004101 2023-10-05T11:35:09.901 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.897+0000 7f26f5634780 1 < completed part key=_multipart_IKCNZOTVWOC6.2~HTKI91YTLBG0.0 size=921160 2023-10-05T11:35:09.903 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.899+0000 7f26f5634780 1 < completed multipart upload key=IKCNZOTVWOC6 upload=HTKI91YTLBG0 tag=D4LIRPHG7T8O type=write size=1969736 2023-10-05T11:35:09.905 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.902+0000 7f26f5634780 1 > prepared part key=_multipart_BTZUVE8R96XT.2~2M1HZ16S2INY.0 size=164368 2023-10-05T11:35:09.905 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.902+0000 7f26f5634780 1 > prepared multipart upload key=BTZUVE8R96XT upload=2M1HZ16S2INY tag=F7EKDZ8HAVA0 type=write size=1212944 2023-10-05T11:35:09.906 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.903+0000 7f26f5634780 1 < completed part key=_multipart_PNV0Q6ZPLYV0.2~PD2MVVJ9HG39.0 size=1048576 2023-10-05T11:35:09.907 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.904+0000 7f26f5634780 1 < completed part key=_multipart_PNV0Q6ZPLYV0.2~PD2MVVJ9HG39.1 size=880629 2023-10-05T11:35:09.909 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.906+0000 7f26f5634780 1 < completed multipart upload key=PNV0Q6ZPLYV0 upload=PD2MVVJ9HG39 tag=T8WKL9WI84OV type=write size=2977781 2023-10-05T11:35:09.910 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.907+0000 7f26f5634780 1 > prepared operation key=9S0YW7PPSJ8G tag=15C5KK1ZJ332 type=write size=1016312 2023-10-05T11:35:09.912 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.908+0000 7f26f5634780 1 < completed part key=_multipart_6DP3UJ4CW1MO.2~QICI5T97G5JB.0 size=778183 2023-10-05T11:35:09.914 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.910+0000 7f26f5634780 1 < completed multipart upload key=6DP3UJ4CW1MO upload=QICI5T97G5JB tag=IB4UOATMLA5J type=write size=1826759 2023-10-05T11:35:09.915 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.911+0000 7f26f5634780 1 > prepared operation key=5V0Q651D4VN2 tag=6TGCE2DOSF6L type=del size=2303448 2023-10-05T11:35:09.916 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.913+0000 7f26f5634780 1 < completed part key=_multipart_PNV0Q6ZPLYV0.2~VNRRBU2EZFBK.0 size=79869 2023-10-05T11:35:09.918 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.915+0000 7f26f5634780 1 < completed multipart upload key=PNV0Q6ZPLYV0 upload=VNRRBU2EZFBK tag=L8R1QUZL2LUS type=write size=1128445 2023-10-05T11:35:09.919 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.916+0000 7f26f5634780 1 > prepared operation key=4D3H60UTIXH3 tag=5MUWWNCVU46C type=del size=3514892 2023-10-05T11:35:09.919 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.916+0000 7f26f5634780 1 < canceled part key=_multipart_6DP3UJ4CW1MO.2~1JH0F7YBX5TY.0 size=1048576 2023-10-05T11:35:09.921 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.918+0000 7f26f5634780 1 < completed part key=_multipart_6DP3UJ4CW1MO.2~1JH0F7YBX5TY.1 size=848352 2023-10-05T11:35:09.923 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.920+0000 7f26f5634780 1 < canceled multipart upload key=6DP3UJ4CW1MO upload=1JH0F7YBX5TY tag=84AXJSPO3CVZ type=write size=2945504 2023-10-05T11:35:09.924 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.921+0000 7f26f5634780 1 > prepared operation key=WYN9BG66LA3K tag=60M8VQ7TLMG8 type=del size=987270 2023-10-05T11:35:09.926 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.922+0000 7f26f5634780 1 < completed delete operation key=9S0YW7PPSJ8G tag=4S9PT56380JW type=del 2023-10-05T11:35:09.927 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.924+0000 7f26f5634780 1 > prepared operation key=PNV0Q6ZPLYV0 tag=RQAK0T002N6O type=del size=2638826 2023-10-05T11:35:09.928 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.925+0000 7f26f5634780 1 < completed delete operation key=NV4Q36UOLX8A tag=D2BUKT30OQVP type=del 2023-10-05T11:35:09.931 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.927+0000 7f26f5634780 1 > prepared part key=_multipart_5V0Q651D4VN2.2~4KXDU7Z4EQ98.0 size=1048576 2023-10-05T11:35:09.932 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.928+0000 7f26f5634780 1 > prepared part key=_multipart_5V0Q651D4VN2.2~4KXDU7Z4EQ98.1 size=478197 2023-10-05T11:35:09.932 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.928+0000 7f26f5634780 1 > prepared multipart upload key=5V0Q651D4VN2 upload=4KXDU7Z4EQ98 tag=VTWOX8AQV1T9 type=write size=2575349 2023-10-05T11:35:09.933 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.930+0000 7f26f5634780 1 < completed part key=_multipart_5OPHKTHXVN5U.2~H04TQF2C1O0T.0 size=310201 2023-10-05T11:35:09.935 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.932+0000 7f26f5634780 1 < completed multipart upload key=5OPHKTHXVN5U upload=H04TQF2C1O0T tag=CTLKCR9ZFEWW type=write size=1358777 2023-10-05T11:35:09.936 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.933+0000 7f26f5634780 1 > prepared operation key=9S0YW7PPSJ8G tag=O2U4VHY1AIVZ type=write size=21428 2023-10-05T11:35:09.938 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.934+0000 7f26f5634780 1 < completed part key=_multipart_PNV0Q6ZPLYV0.2~TP1H1N7OS6RN.0 size=728087 2023-10-05T11:35:09.940 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.936+0000 7f26f5634780 1 < completed multipart upload key=PNV0Q6ZPLYV0 upload=TP1H1N7OS6RN tag=61QI8JKYNJ9W type=write size=1776663 2023-10-05T11:35:09.941 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.938+0000 7f26f5634780 1 > prepared operation key=7W9LL5HSU3BG tag=7BDA4EZUO6G1 type=del size=362327 2023-10-05T11:35:09.942 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.939+0000 7f26f5634780 1 < canceled operation key=FOMNIIY47UUM tag=8RLXC50O8ULY type=del size=2812572 2023-10-05T11:35:09.944 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.941+0000 7f26f5634780 1 > prepared part key=_multipart_7TOP5A52M9YP.2~YAGMS4SRRRFU.0 size=960120 2023-10-05T11:35:09.945 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.941+0000 7f26f5634780 1 > prepared multipart upload key=7TOP5A52M9YP upload=YAGMS4SRRRFU tag=JE5MR5DWS9KI type=write size=2008696 2023-10-05T11:35:09.946 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.942+0000 7f26f5634780 1 < completed part key=_multipart_5OPHKTHXVN5U.2~UZ0MWY6APDW2.0 size=1048576 2023-10-05T11:35:09.947 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.943+0000 7f26f5634780 1 < completed part key=_multipart_5OPHKTHXVN5U.2~UZ0MWY6APDW2.1 size=718271 2023-10-05T11:35:09.949 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.945+0000 7f26f5634780 1 < completed multipart upload key=5OPHKTHXVN5U upload=UZ0MWY6APDW2 tag=6T17HW23UZS9 type=write size=2815423 2023-10-05T11:35:09.950 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.947+0000 7f26f5634780 1 > prepared operation key=FOMNIIY47UUM tag=ALS88K9XVCJL type=del size=1469964 2023-10-05T11:35:09.951 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.948+0000 7f26f5634780 1 < completed part key=_multipart_AV0XKXX1IR4B.2~U7SM3GA2CRU2.0 size=1048576 2023-10-05T11:35:09.952 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.949+0000 7f26f5634780 1 < completed part key=_multipart_AV0XKXX1IR4B.2~U7SM3GA2CRU2.1 size=1048576 2023-10-05T11:35:09.953 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.950+0000 7f26f5634780 1 < completed part key=_multipart_AV0XKXX1IR4B.2~U7SM3GA2CRU2.2 size=431400 2023-10-05T11:35:09.955 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.952+0000 7f26f5634780 1 < completed multipart upload key=AV0XKXX1IR4B upload=U7SM3GA2CRU2 tag=LY8JBRB4GK16 type=write size=3577128 2023-10-05T11:35:09.956 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.953+0000 7f26f5634780 1 > prepared operation key=PNV0Q6ZPLYV0 tag=12U43ZHJ0KWL type=del size=1040599 2023-10-05T11:35:09.958 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.954+0000 7f26f5634780 1 < completed delete operation key=FOMNIIY47UUM tag=A7QH9WFVTEF0 type=del 2023-10-05T11:35:09.961 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.957+0000 7f26f5634780 1 > prepared part key=_multipart_9S0YW7PPSJ8G.2~MNFR8IA3AO5V.0 size=1048576 2023-10-05T11:35:09.961 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.957+0000 7f26f5634780 1 > prepared part key=_multipart_9S0YW7PPSJ8G.2~MNFR8IA3AO5V.1 size=1048576 2023-10-05T11:35:09.962 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.958+0000 7f26f5634780 1 > prepared part key=_multipart_9S0YW7PPSJ8G.2~MNFR8IA3AO5V.2 size=255241 2023-10-05T11:35:09.962 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.958+0000 7f26f5634780 1 > prepared multipart upload key=9S0YW7PPSJ8G upload=MNFR8IA3AO5V tag=0N8ZGWV6OJ0W type=write size=3400969 2023-10-05T11:35:09.963 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.960+0000 7f26f5634780 1 < completed part key=_multipart_WYN9BG66LA3K.2~ZNM679BIUMAF.0 size=1048576 2023-10-05T11:35:09.963 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.960+0000 7f26f5634780 1 < canceled part key=_multipart_WYN9BG66LA3K.2~ZNM679BIUMAF.1 size=1048576 2023-10-05T11:35:09.966 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.963+0000 7f26f5634780 1 < completed part key=_multipart_WYN9BG66LA3K.2~ZNM679BIUMAF.2 size=386748 2023-10-05T11:35:09.968 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.965+0000 7f26f5634780 1 < canceled multipart upload key=WYN9BG66LA3K upload=ZNM679BIUMAF tag=X04759ZWYDNL type=write size=3532476 2023-10-05T11:35:09.969 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.966+0000 7f26f5634780 1 > prepared operation key=2D4PDQQT54ZA tag=ZUQA8VN5MDBE type=del size=2881824 2023-10-05T11:35:09.972 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.968+0000 7f26f5634780 1 < suggested remove operation key=QYQDXVIGZ7O8 tag=PCPFT9QU0A3L type=del 2023-10-05T11:35:09.973 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.969+0000 7f26f5634780 1 > prepared operation key=QYQDXVIGZ7O8 tag=K4HWR6YVW2PS type=del size=2192446 2023-10-05T11:35:09.976 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.972+0000 7f26f5634780 1 < suggested update operation key=5OPHKTHXVN5U tag=RKXT4I29XD8Y type=del size=4004101 2023-10-05T11:35:09.977 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.974+0000 7f26f5634780 1 > prepared operation key=BTZUVE8R96XT tag=FZ3S8A94R4OG type=del size=4017511 2023-10-05T11:35:09.978 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.975+0000 7f26f5634780 1 < completed part key=_multipart_BTZUVE8R96XT.2~2M1HZ16S2INY.0 size=164368 2023-10-05T11:35:09.980 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.977+0000 7f26f5634780 1 < completed multipart upload key=BTZUVE8R96XT upload=2M1HZ16S2INY tag=F7EKDZ8HAVA0 type=write size=1212944 2023-10-05T11:35:09.983 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.979+0000 7f26f5634780 1 > prepared part key=_multipart_WTCWG1C1SF89.2~Y26TTV4XB6PF.0 size=254311 2023-10-05T11:35:09.983 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.979+0000 7f26f5634780 1 > prepared multipart upload key=WTCWG1C1SF89 upload=Y26TTV4XB6PF tag=L0WYULMHBNWC type=write size=1302887 2023-10-05T11:35:09.984 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.981+0000 7f26f5634780 1 < completed write operation key=9S0YW7PPSJ8G tag=15C5KK1ZJ332 type=write size=1016312 2023-10-05T11:35:09.985 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.982+0000 7f26f5634780 1 > prepared operation key=PNV0Q6ZPLYV0 tag=MZAK5UZL2IOX type=del size=2413078 2023-10-05T11:35:09.986 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.983+0000 7f26f5634780 1 < completed delete operation key=5V0Q651D4VN2 tag=6TGCE2DOSF6L type=del 2023-10-05T11:35:09.989 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.985+0000 7f26f5634780 1 > prepared part key=_multipart_WYN9BG66LA3K.2~N180Y217NHIF.0 size=1048576 2023-10-05T11:35:09.990 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.986+0000 7f26f5634780 1 > prepared part key=_multipart_WYN9BG66LA3K.2~N180Y217NHIF.1 size=1048576 2023-10-05T11:35:09.991 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.987+0000 7f26f5634780 1 > prepared part key=_multipart_WYN9BG66LA3K.2~N180Y217NHIF.2 size=507345 2023-10-05T11:35:09.991 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.987+0000 7f26f5634780 1 > prepared multipart upload key=WYN9BG66LA3K upload=N180Y217NHIF tag=MUQ03929TPJ2 type=write size=3653073 2023-10-05T11:35:09.992 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.988+0000 7f26f5634780 1 < completed delete operation key=4D3H60UTIXH3 tag=5MUWWNCVU46C type=del 2023-10-05T11:35:09.994 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.991+0000 7f26f5634780 1 > prepared part key=_multipart_8IPCP77WVVZT.2~N77T6WQ8ME3S.0 size=1048576 2023-10-05T11:35:09.995 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.991+0000 7f26f5634780 1 > prepared part key=_multipart_8IPCP77WVVZT.2~N77T6WQ8ME3S.1 size=970376 2023-10-05T11:35:09.995 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.991+0000 7f26f5634780 1 > prepared multipart upload key=8IPCP77WVVZT upload=N77T6WQ8ME3S tag=MG7H73SZDHUD type=write size=3067528 2023-10-05T11:35:09.996 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.993+0000 7f26f5634780 1 < completed delete operation key=WYN9BG66LA3K tag=60M8VQ7TLMG8 type=del 2023-10-05T11:35:09.997 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.994+0000 7f26f5634780 1 > prepared operation key=9S0YW7PPSJ8G tag=2JS0QJVXXO9F type=del size=4013563 2023-10-05T11:35:09.999 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.995+0000 7f26f5634780 1 < completed delete operation key=PNV0Q6ZPLYV0 tag=RQAK0T002N6O type=del 2023-10-05T11:35:10.000 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.996+0000 7f26f5634780 1 > prepared operation key=QYQDXVIGZ7O8 tag=0RX9XSWDXLQG type=del size=4075277 2023-10-05T11:35:10.001 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.998+0000 7f26f5634780 1 < completed part key=_multipart_5V0Q651D4VN2.2~4KXDU7Z4EQ98.0 size=1048576 2023-10-05T11:35:10.002 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:09.999+0000 7f26f5634780 1 < completed part key=_multipart_5V0Q651D4VN2.2~4KXDU7Z4EQ98.1 size=478197 2023-10-05T11:35:10.004 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.001+0000 7f26f5634780 1 < completed multipart upload key=5V0Q651D4VN2 upload=4KXDU7Z4EQ98 tag=VTWOX8AQV1T9 type=write size=2575349 2023-10-05T11:35:10.006 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.002+0000 7f26f5634780 1 > prepared operation key=AV0XKXX1IR4B tag=NAER27WZ648X type=del size=3196163 2023-10-05T11:35:10.007 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.003+0000 7f26f5634780 1 < completed write operation key=9S0YW7PPSJ8G tag=O2U4VHY1AIVZ type=write size=21428 2023-10-05T11:35:10.008 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.005+0000 7f26f5634780 1 > prepared operation key=IC7T3ZK81WQS tag=DZ93TJRQC6LI type=write size=636227 2023-10-05T11:35:10.009 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.006+0000 7f26f5634780 1 < completed delete operation key=7W9LL5HSU3BG tag=7BDA4EZUO6G1 type=del 2023-10-05T11:35:10.011 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.007+0000 7f26f5634780 1 > prepared operation key=WYN9BG66LA3K tag=GALVOWBT76AS type=del size=1950551 2023-10-05T11:35:10.012 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.009+0000 7f26f5634780 1 < completed part key=_multipart_7TOP5A52M9YP.2~YAGMS4SRRRFU.0 size=960120 2023-10-05T11:35:10.014 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.011+0000 7f26f5634780 1 < completed multipart upload key=7TOP5A52M9YP upload=YAGMS4SRRRFU tag=JE5MR5DWS9KI type=write size=2008696 2023-10-05T11:35:10.015 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.012+0000 7f26f5634780 1 > prepared operation key=5OPHKTHXVN5U tag=UP961DRIDJU0 type=del size=2071559 2023-10-05T11:35:10.017 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.013+0000 7f26f5634780 1 < completed delete operation key=FOMNIIY47UUM tag=ALS88K9XVCJL type=del 2023-10-05T11:35:10.019 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.015+0000 7f26f5634780 1 > prepared part key=_multipart_PC8WTJ8AYJ24.2~342SWJI7QHE6.0 size=1048576 2023-10-05T11:35:10.020 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.016+0000 7f26f5634780 1 > prepared part key=_multipart_PC8WTJ8AYJ24.2~342SWJI7QHE6.1 size=1048576 2023-10-05T11:35:10.021 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.017+0000 7f26f5634780 1 > prepared part key=_multipart_PC8WTJ8AYJ24.2~342SWJI7QHE6.2 size=1005751 2023-10-05T11:35:10.021 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.017+0000 7f26f5634780 1 > prepared multipart upload key=PC8WTJ8AYJ24 upload=342SWJI7QHE6 tag=H7HI1Z0SE9YM type=write size=4151479 2023-10-05T11:35:10.022 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.019+0000 7f26f5634780 1 < completed delete operation key=PNV0Q6ZPLYV0 tag=12U43ZHJ0KWL type=del 2023-10-05T11:35:10.023 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.020+0000 7f26f5634780 1 > prepared operation key=2D4PDQQT54ZA tag=K2Q0UGTM3RL4 type=write size=513004 2023-10-05T11:35:10.024 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.021+0000 7f26f5634780 1 < completed part key=_multipart_9S0YW7PPSJ8G.2~MNFR8IA3AO5V.0 size=1048576 2023-10-05T11:35:10.025 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.022+0000 7f26f5634780 1 < completed part key=_multipart_9S0YW7PPSJ8G.2~MNFR8IA3AO5V.1 size=1048576 2023-10-05T11:35:10.026 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.023+0000 7f26f5634780 1 < completed part key=_multipart_9S0YW7PPSJ8G.2~MNFR8IA3AO5V.2 size=255241 2023-10-05T11:35:10.028 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.025+0000 7f26f5634780 1 < completed multipart upload key=9S0YW7PPSJ8G upload=MNFR8IA3AO5V tag=0N8ZGWV6OJ0W type=write size=3400969 2023-10-05T11:35:10.031 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.028+0000 7f26f5634780 1 > prepared part key=_multipart_4D3H60UTIXH3.2~W37J5MZV8CYL.0 size=163624 2023-10-05T11:35:10.031 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.028+0000 7f26f5634780 1 > prepared multipart upload key=4D3H60UTIXH3 upload=W37J5MZV8CYL tag=R67KOCXQV0O2 type=write size=1212200 2023-10-05T11:35:10.032 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.029+0000 7f26f5634780 1 < completed delete operation key=2D4PDQQT54ZA tag=ZUQA8VN5MDBE type=del 2023-10-05T11:35:10.034 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.030+0000 7f26f5634780 1 > prepared operation key=761J2C7GHWU5 tag=RH2FTYPBSLBP type=del size=3183454 2023-10-05T11:35:10.035 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.032+0000 7f26f5634780 1 < completed delete operation key=QYQDXVIGZ7O8 tag=K4HWR6YVW2PS type=del 2023-10-05T11:35:10.038 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.034+0000 7f26f5634780 1 > prepared part key=_multipart_5V0Q651D4VN2.2~LOWUHIMVIHBZ.0 size=1048576 2023-10-05T11:35:10.039 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.036+0000 7f26f5634780 1 > prepared part key=_multipart_5V0Q651D4VN2.2~LOWUHIMVIHBZ.1 size=1048576 2023-10-05T11:35:10.040 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.037+0000 7f26f5634780 1 > prepared part key=_multipart_5V0Q651D4VN2.2~LOWUHIMVIHBZ.2 size=954210 2023-10-05T11:35:10.040 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.037+0000 7f26f5634780 1 > prepared multipart upload key=5V0Q651D4VN2 upload=LOWUHIMVIHBZ tag=J1ULGW7FFMC0 type=write size=4099938 2023-10-05T11:35:10.042 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.038+0000 7f26f5634780 1 < completed delete operation key=BTZUVE8R96XT tag=FZ3S8A94R4OG type=del 2023-10-05T11:35:10.044 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.040+0000 7f26f5634780 1 > prepared part key=_multipart_IC7T3ZK81WQS.2~V4EP5KUWGZSG.0 size=506251 2023-10-05T11:35:10.044 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.040+0000 7f26f5634780 1 > prepared multipart upload key=IC7T3ZK81WQS upload=V4EP5KUWGZSG tag=Q100P2DQYVK9 type=write size=1554827 2023-10-05T11:35:10.045 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.042+0000 7f26f5634780 1 < completed part key=_multipart_WTCWG1C1SF89.2~Y26TTV4XB6PF.0 size=254311 2023-10-05T11:35:10.047 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.044+0000 7f26f5634780 1 < completed multipart upload key=WTCWG1C1SF89 upload=Y26TTV4XB6PF tag=L0WYULMHBNWC type=write size=1302887 2023-10-05T11:35:10.050 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.046+0000 7f26f5634780 1 > prepared part key=_multipart_8IPCP77WVVZT.2~X6CAZTB2GUT1.0 size=237652 2023-10-05T11:35:10.050 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.046+0000 7f26f5634780 1 > prepared multipart upload key=8IPCP77WVVZT upload=X6CAZTB2GUT1 tag=SLLH2HOPRK9N type=write size=1286228 2023-10-05T11:35:10.051 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.048+0000 7f26f5634780 1 < completed delete operation key=PNV0Q6ZPLYV0 tag=MZAK5UZL2IOX type=del 2023-10-05T11:35:10.052 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.049+0000 7f26f5634780 1 > prepared operation key=IKCNZOTVWOC6 tag=LG5XEL185QT9 type=del size=2569334 2023-10-05T11:35:10.054 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.050+0000 7f26f5634780 1 < completed part key=_multipart_WYN9BG66LA3K.2~N180Y217NHIF.0 size=1048576 2023-10-05T11:35:10.055 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.051+0000 7f26f5634780 1 < completed part key=_multipart_WYN9BG66LA3K.2~N180Y217NHIF.1 size=1048576 2023-10-05T11:35:10.055 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.051+0000 7f26f5634780 1 < canceled part key=_multipart_WYN9BG66LA3K.2~N180Y217NHIF.2 size=507345 2023-10-05T11:35:10.057 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.053+0000 7f26f5634780 1 < canceled multipart upload key=WYN9BG66LA3K upload=N180Y217NHIF tag=MUQ03929TPJ2 type=write size=3653073 2023-10-05T11:35:10.058 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.054+0000 7f26f5634780 1 > prepared operation key=QYQDXVIGZ7O8 tag=MGCH9JV8CQ0K type=del size=1372178 2023-10-05T11:35:10.059 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.056+0000 7f26f5634780 1 < completed part key=_multipart_8IPCP77WVVZT.2~N77T6WQ8ME3S.0 size=1048576 2023-10-05T11:35:10.060 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.057+0000 7f26f5634780 1 < completed part key=_multipart_8IPCP77WVVZT.2~N77T6WQ8ME3S.1 size=970376 2023-10-05T11:35:10.062 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.059+0000 7f26f5634780 1 < completed multipart upload key=8IPCP77WVVZT upload=N77T6WQ8ME3S tag=MG7H73SZDHUD type=write size=3067528 2023-10-05T11:35:10.064 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.061+0000 7f26f5634780 1 > prepared part key=_multipart_W2GWVGX42QLD.2~YQ3FMF321SXU.0 size=1048576 2023-10-05T11:35:10.065 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.062+0000 7f26f5634780 1 > prepared part key=_multipart_W2GWVGX42QLD.2~YQ3FMF321SXU.1 size=443695 2023-10-05T11:35:10.065 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.062+0000 7f26f5634780 1 > prepared multipart upload key=W2GWVGX42QLD upload=YQ3FMF321SXU tag=V25OPJG7EQTO type=write size=2540847 2023-10-05T11:35:10.066 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.063+0000 7f26f5634780 1 < completed delete operation key=9S0YW7PPSJ8G tag=2JS0QJVXXO9F type=del 2023-10-05T11:35:10.067 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.064+0000 7f26f5634780 1 > prepared operation key=7TOP5A52M9YP tag=7PH01X4FJTBD type=del size=2804825 2023-10-05T11:35:10.070 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.066+0000 7f26f5634780 1 < suggested remove operation key=QYQDXVIGZ7O8 tag=0RX9XSWDXLQG type=del 2023-10-05T11:35:10.072 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.069+0000 7f26f5634780 1 > prepared part key=_multipart_S3DKYDFT4IO2.2~BJ1986I1D7Z5.0 size=631131 2023-10-05T11:35:10.072 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.069+0000 7f26f5634780 1 > prepared multipart upload key=S3DKYDFT4IO2 upload=BJ1986I1D7Z5 tag=RE8D16NWH3C7 type=write size=1679707 2023-10-05T11:35:10.073 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.070+0000 7f26f5634780 1 < completed delete operation key=AV0XKXX1IR4B tag=NAER27WZ648X type=del 2023-10-05T11:35:10.074 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.071+0000 7f26f5634780 1 > prepared operation key=761J2C7GHWU5 tag=4VWGGVFMI0BG type=write size=239754 2023-10-05T11:35:10.076 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.072+0000 7f26f5634780 1 < completed write operation key=IC7T3ZK81WQS tag=DZ93TJRQC6LI type=write size=636227 2023-10-05T11:35:10.077 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.073+0000 7f26f5634780 1 > prepared operation key=PC8WTJ8AYJ24 tag=YYQZV2V4S66A type=del size=2966609 2023-10-05T11:35:10.079 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.076+0000 7f26f5634780 1 < suggested remove operation key=WYN9BG66LA3K tag=GALVOWBT76AS type=del 2023-10-05T11:35:10.080 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.077+0000 7f26f5634780 1 > prepared operation key=U6172JUYW7J6 tag=3LUQ5QKEDWLX type=del size=66247 2023-10-05T11:35:10.081 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.078+0000 7f26f5634780 1 < completed delete operation key=5OPHKTHXVN5U tag=UP961DRIDJU0 type=del 2023-10-05T11:35:10.083 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.080+0000 7f26f5634780 1 > prepared part key=_multipart_J5EIH25Y471T.2~7X65SKI3IUVH.0 size=1048576 2023-10-05T11:35:10.084 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.081+0000 7f26f5634780 1 > prepared part key=_multipart_J5EIH25Y471T.2~7X65SKI3IUVH.1 size=1048576 2023-10-05T11:35:10.085 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.082+0000 7f26f5634780 1 > prepared part key=_multipart_J5EIH25Y471T.2~7X65SKI3IUVH.2 size=1035620 2023-10-05T11:35:10.086 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.082+0000 7f26f5634780 1 > prepared multipart upload key=J5EIH25Y471T upload=7X65SKI3IUVH tag=0L1Z5DLLE1P8 type=write size=4181348 2023-10-05T11:35:10.087 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.083+0000 7f26f5634780 1 < completed part key=_multipart_PC8WTJ8AYJ24.2~342SWJI7QHE6.0 size=1048576 2023-10-05T11:35:10.088 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.084+0000 7f26f5634780 1 < completed part key=_multipart_PC8WTJ8AYJ24.2~342SWJI7QHE6.1 size=1048576 2023-10-05T11:35:10.089 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.085+0000 7f26f5634780 1 < completed part key=_multipart_PC8WTJ8AYJ24.2~342SWJI7QHE6.2 size=1005751 2023-10-05T11:35:10.091 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.087+0000 7f26f5634780 1 < completed multipart upload key=PC8WTJ8AYJ24 upload=342SWJI7QHE6 tag=H7HI1Z0SE9YM type=write size=4151479 2023-10-05T11:35:10.092 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.089+0000 7f26f5634780 1 > prepared operation key=FOMNIIY47UUM tag=OWI4FVIYQ1BU type=write size=939925 2023-10-05T11:35:10.094 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.090+0000 7f26f5634780 1 < canceled operation key=2D4PDQQT54ZA tag=K2Q0UGTM3RL4 type=write size=513004 2023-10-05T11:35:10.096 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.092+0000 7f26f5634780 1 > prepared part key=_multipart_6DP3UJ4CW1MO.2~MGSX6KN82HJ3.0 size=1048576 2023-10-05T11:35:10.097 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.093+0000 7f26f5634780 1 > prepared part key=_multipart_6DP3UJ4CW1MO.2~MGSX6KN82HJ3.1 size=1048576 2023-10-05T11:35:10.098 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.094+0000 7f26f5634780 1 > prepared part key=_multipart_6DP3UJ4CW1MO.2~MGSX6KN82HJ3.2 size=232320 2023-10-05T11:35:10.098 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.094+0000 7f26f5634780 1 > prepared multipart upload key=6DP3UJ4CW1MO upload=MGSX6KN82HJ3 tag=8GK3NU4ATMEY type=write size=3378048 2023-10-05T11:35:10.099 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.096+0000 7f26f5634780 1 < completed part key=_multipart_4D3H60UTIXH3.2~W37J5MZV8CYL.0 size=163624 2023-10-05T11:35:10.101 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.098+0000 7f26f5634780 1 < completed multipart upload key=4D3H60UTIXH3 upload=W37J5MZV8CYL tag=R67KOCXQV0O2 type=write size=1212200 2023-10-05T11:35:10.102 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.099+0000 7f26f5634780 1 > prepared operation key=0PWYKC7S6YJ4 tag=N3GMSFO63BS3 type=del size=2065701 2023-10-05T11:35:10.104 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.100+0000 7f26f5634780 1 < completed delete operation key=761J2C7GHWU5 tag=RH2FTYPBSLBP type=del 2023-10-05T11:35:10.105 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.102+0000 7f26f5634780 1 > prepared operation key=VJTFYDETLSFD tag=BN1THKE5S324 type=del size=2235016 2023-10-05T11:35:10.107 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.103+0000 7f26f5634780 1 < completed part key=_multipart_5V0Q651D4VN2.2~LOWUHIMVIHBZ.0 size=1048576 2023-10-05T11:35:10.107 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.104+0000 7f26f5634780 1 < completed part key=_multipart_5V0Q651D4VN2.2~LOWUHIMVIHBZ.1 size=1048576 2023-10-05T11:35:10.108 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.105+0000 7f26f5634780 1 < completed part key=_multipart_5V0Q651D4VN2.2~LOWUHIMVIHBZ.2 size=954210 2023-10-05T11:35:10.111 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.107+0000 7f26f5634780 1 < completed multipart upload key=5V0Q651D4VN2 upload=LOWUHIMVIHBZ tag=J1ULGW7FFMC0 type=write size=4099938 2023-10-05T11:35:10.113 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.110+0000 7f26f5634780 1 > prepared part key=_multipart_7TOP5A52M9YP.2~THYCV9XI6PH1.0 size=1048576 2023-10-05T11:35:10.114 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.111+0000 7f26f5634780 1 > prepared part key=_multipart_7TOP5A52M9YP.2~THYCV9XI6PH1.1 size=227213 2023-10-05T11:35:10.114 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.111+0000 7f26f5634780 1 > prepared multipart upload key=7TOP5A52M9YP upload=THYCV9XI6PH1 tag=4OXPBII8EY1A type=write size=2324365 2023-10-05T11:35:10.115 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.112+0000 7f26f5634780 1 < completed part key=_multipart_IC7T3ZK81WQS.2~V4EP5KUWGZSG.0 size=506251 2023-10-05T11:35:10.118 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.114+0000 7f26f5634780 1 < completed multipart upload key=IC7T3ZK81WQS upload=V4EP5KUWGZSG tag=Q100P2DQYVK9 type=write size=1554827 2023-10-05T11:35:10.119 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.116+0000 7f26f5634780 1 > prepared operation key=6DP3UJ4CW1MO tag=PLUT27UBQK0Q type=del size=3086165 2023-10-05T11:35:10.120 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.117+0000 7f26f5634780 1 < completed part key=_multipart_8IPCP77WVVZT.2~X6CAZTB2GUT1.0 size=237652 2023-10-05T11:35:10.122 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.119+0000 7f26f5634780 1 < completed multipart upload key=8IPCP77WVVZT upload=X6CAZTB2GUT1 tag=SLLH2HOPRK9N type=write size=1286228 2023-10-05T11:35:10.125 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.121+0000 7f26f5634780 1 > prepared part key=_multipart_FOMNIIY47UUM.2~63NQHV0A6EOY.0 size=462210 2023-10-05T11:35:10.125 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.121+0000 7f26f5634780 1 > prepared multipart upload key=FOMNIIY47UUM upload=63NQHV0A6EOY tag=O3DGYANSUPW2 type=write size=1510786 2023-10-05T11:35:10.126 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.123+0000 7f26f5634780 1 < canceled operation key=IKCNZOTVWOC6 tag=LG5XEL185QT9 type=del size=2569334 2023-10-05T11:35:10.128 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.125+0000 7f26f5634780 1 > prepared part key=_multipart_4D3H60UTIXH3.2~YYYQOHTCFM2I.0 size=1048576 2023-10-05T11:35:10.129 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.126+0000 7f26f5634780 1 > prepared part key=_multipart_4D3H60UTIXH3.2~YYYQOHTCFM2I.1 size=294295 2023-10-05T11:35:10.129 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.126+0000 7f26f5634780 1 > prepared multipart upload key=4D3H60UTIXH3 upload=YYYQOHTCFM2I tag=715YZRTROCY7 type=write size=2391447 2023-10-05T11:35:10.130 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.127+0000 7f26f5634780 -1 < failed to complete operation key=QYQDXVIGZ7O8 tag=MGCH9JV8CQ0K type=del size=1372178: (22) Invalid argument 2023-10-05T11:35:10.131 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.128+0000 7f26f5634780 1 > prepared operation key=U6172JUYW7J6 tag=BZ6KFRTJXGCP type=write size=18452 2023-10-05T11:35:10.133 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.129+0000 7f26f5634780 1 < completed part key=_multipart_W2GWVGX42QLD.2~YQ3FMF321SXU.0 size=1048576 2023-10-05T11:35:10.134 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.130+0000 7f26f5634780 1 < completed part key=_multipart_W2GWVGX42QLD.2~YQ3FMF321SXU.1 size=443695 2023-10-05T11:35:10.136 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.132+0000 7f26f5634780 1 < completed multipart upload key=W2GWVGX42QLD upload=YQ3FMF321SXU tag=V25OPJG7EQTO type=write size=2540847 2023-10-05T11:35:10.138 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.134+0000 7f26f5634780 1 > prepared part key=_multipart_7W9LL5HSU3BG.2~1MW56ZHTC105.0 size=1048576 2023-10-05T11:35:10.139 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.135+0000 7f26f5634780 1 > prepared part key=_multipart_7W9LL5HSU3BG.2~1MW56ZHTC105.1 size=1048576 2023-10-05T11:35:10.140 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.136+0000 7f26f5634780 1 > prepared part key=_multipart_7W9LL5HSU3BG.2~1MW56ZHTC105.2 size=199654 2023-10-05T11:35:10.140 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.136+0000 7f26f5634780 1 > prepared multipart upload key=7W9LL5HSU3BG upload=1MW56ZHTC105 tag=54X1LCIAFKXD type=write size=3345382 2023-10-05T11:35:10.142 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.139+0000 7f26f5634780 1 < suggested update operation key=7TOP5A52M9YP tag=7PH01X4FJTBD type=del size=2804825 2023-10-05T11:35:10.144 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.141+0000 7f26f5634780 1 > prepared part key=_multipart_9S0YW7PPSJ8G.2~XX5EM2TQM4PA.0 size=782810 2023-10-05T11:35:10.145 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.141+0000 7f26f5634780 1 > prepared multipart upload key=9S0YW7PPSJ8G upload=XX5EM2TQM4PA tag=ZVK8GL8AINJV type=write size=1831386 2023-10-05T11:35:10.146 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.142+0000 7f26f5634780 1 < completed part key=_multipart_S3DKYDFT4IO2.2~BJ1986I1D7Z5.0 size=631131 2023-10-05T11:35:10.148 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.144+0000 7f26f5634780 1 < completed multipart upload key=S3DKYDFT4IO2 upload=BJ1986I1D7Z5 tag=RE8D16NWH3C7 type=write size=1679707 2023-10-05T11:35:10.149 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.145+0000 7f26f5634780 1 > prepared operation key=MEY4SZRHU9NZ tag=XWWEUC98HBLY type=del size=1427101 2023-10-05T11:35:10.150 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.147+0000 7f26f5634780 1 < completed write operation key=761J2C7GHWU5 tag=4VWGGVFMI0BG type=write size=239754 2023-10-05T11:35:10.151 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.148+0000 7f26f5634780 1 > prepared operation key=9S0YW7PPSJ8G tag=3IACMUH2YU15 type=del size=3255524 2023-10-05T11:35:10.153 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.150+0000 7f26f5634780 1 < completed delete operation key=PC8WTJ8AYJ24 tag=YYQZV2V4S66A type=del 2023-10-05T11:35:10.156 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.152+0000 7f26f5634780 1 > prepared part key=_multipart_761J2C7GHWU5.2~QIF90XE7BHOZ.0 size=1048576 2023-10-05T11:35:10.157 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.153+0000 7f26f5634780 1 > prepared part key=_multipart_761J2C7GHWU5.2~QIF90XE7BHOZ.1 size=666634 2023-10-05T11:35:10.157 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.153+0000 7f26f5634780 1 > prepared multipart upload key=761J2C7GHWU5 upload=QIF90XE7BHOZ tag=KMJDJO36N0A8 type=write size=2763786 2023-10-05T11:35:10.159 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.156+0000 7f26f5634780 1 < suggested update operation key=U6172JUYW7J6 tag=3LUQ5QKEDWLX type=del size=66247 2023-10-05T11:35:10.160 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.157+0000 7f26f5634780 1 > prepared operation key=4IBQJLJR7LD8 tag=SRLNVE5Y4GFX type=del size=3518345 2023-10-05T11:35:10.161 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.158+0000 7f26f5634780 1 < completed part key=_multipart_J5EIH25Y471T.2~7X65SKI3IUVH.0 size=1048576 2023-10-05T11:35:10.162 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.159+0000 7f26f5634780 1 < completed part key=_multipart_J5EIH25Y471T.2~7X65SKI3IUVH.1 size=1048576 2023-10-05T11:35:10.163 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.160+0000 7f26f5634780 1 < completed part key=_multipart_J5EIH25Y471T.2~7X65SKI3IUVH.2 size=1035620 2023-10-05T11:35:10.166 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.163+0000 7f26f5634780 1 < completed multipart upload key=J5EIH25Y471T upload=7X65SKI3IUVH tag=0L1Z5DLLE1P8 type=write size=4181348 2023-10-05T11:35:10.169 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.164+0000 7f26f5634780 1 > prepared operation key=IKCNZOTVWOC6 tag=HSZ3I2GZJN8D type=del size=3395719 2023-10-05T11:35:10.169 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.165+0000 7f26f5634780 1 < completed write operation key=FOMNIIY47UUM tag=OWI4FVIYQ1BU type=write size=939925 2023-10-05T11:35:10.170 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.166+0000 7f26f5634780 1 > prepared operation key=4IBQJLJR7LD8 tag=QH22LLXZ6JNK type=del size=2284286 2023-10-05T11:35:10.171 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.168+0000 7f26f5634780 1 < completed part key=_multipart_6DP3UJ4CW1MO.2~MGSX6KN82HJ3.0 size=1048576 2023-10-05T11:35:10.172 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.169+0000 7f26f5634780 1 < completed part key=_multipart_6DP3UJ4CW1MO.2~MGSX6KN82HJ3.1 size=1048576 2023-10-05T11:35:10.173 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.170+0000 7f26f5634780 1 < completed part key=_multipart_6DP3UJ4CW1MO.2~MGSX6KN82HJ3.2 size=232320 2023-10-05T11:35:10.175 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.172+0000 7f26f5634780 1 < completed multipart upload key=6DP3UJ4CW1MO upload=MGSX6KN82HJ3 tag=8GK3NU4ATMEY type=write size=3378048 2023-10-05T11:35:10.178 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.174+0000 7f26f5634780 1 > prepared part key=_multipart_PC8WTJ8AYJ24.2~KK6FDCSTAW0A.0 size=1048576 2023-10-05T11:35:10.179 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.175+0000 7f26f5634780 1 > prepared part key=_multipart_PC8WTJ8AYJ24.2~KK6FDCSTAW0A.1 size=423864 2023-10-05T11:35:10.179 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.175+0000 7f26f5634780 1 > prepared multipart upload key=PC8WTJ8AYJ24 upload=KK6FDCSTAW0A tag=CTT2UMLSLPC2 type=write size=2521016 2023-10-05T11:35:10.181 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.177+0000 7f26f5634780 1 < suggested remove operation key=0PWYKC7S6YJ4 tag=N3GMSFO63BS3 type=del 2023-10-05T11:35:10.182 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.179+0000 7f26f5634780 1 > prepared operation key=8IPCP77WVVZT tag=5IEX4SOHP4K2 type=write size=653102 2023-10-05T11:35:10.183 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.180+0000 7f26f5634780 1 < completed delete operation key=VJTFYDETLSFD tag=BN1THKE5S324 type=del 2023-10-05T11:35:10.184 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.181+0000 7f26f5634780 1 > prepared operation key=9S0YW7PPSJ8G tag=3KPJE0UAFCR2 type=write size=39631 2023-10-05T11:35:10.186 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.182+0000 7f26f5634780 1 < completed part key=_multipart_7TOP5A52M9YP.2~THYCV9XI6PH1.0 size=1048576 2023-10-05T11:35:10.187 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.183+0000 7f26f5634780 1 < completed part key=_multipart_7TOP5A52M9YP.2~THYCV9XI6PH1.1 size=227213 2023-10-05T11:35:10.189 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.185+0000 7f26f5634780 1 < completed multipart upload key=7TOP5A52M9YP upload=THYCV9XI6PH1 tag=4OXPBII8EY1A type=write size=2324365 2023-10-05T11:35:10.191 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.187+0000 7f26f5634780 1 > prepared part key=_multipart_5OPHKTHXVN5U.2~I09FPY376ZVX.0 size=1048576 2023-10-05T11:35:10.192 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.188+0000 7f26f5634780 1 > prepared part key=_multipart_5OPHKTHXVN5U.2~I09FPY376ZVX.1 size=537958 2023-10-05T11:35:10.192 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.188+0000 7f26f5634780 1 > prepared multipart upload key=5OPHKTHXVN5U upload=I09FPY376ZVX tag=0Q75PILOZN2I type=write size=2635110 2023-10-05T11:35:10.193 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.189+0000 7f26f5634780 1 < completed delete operation key=6DP3UJ4CW1MO tag=PLUT27UBQK0Q type=del 2023-10-05T11:35:10.194 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.191+0000 7f26f5634780 1 > prepared operation key=2D4PDQQT54ZA tag=ETFMFYHX0KL8 type=del size=3680979 2023-10-05T11:35:10.196 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.193+0000 7f26f5634780 1 < completed part key=_multipart_FOMNIIY47UUM.2~63NQHV0A6EOY.0 size=462210 2023-10-05T11:35:10.198 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.195+0000 7f26f5634780 1 < completed multipart upload key=FOMNIIY47UUM upload=63NQHV0A6EOY tag=O3DGYANSUPW2 type=write size=1510786 2023-10-05T11:35:10.200 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.196+0000 7f26f5634780 1 > prepared operation key=8IPCP77WVVZT tag=5STE8W1O40XE type=del size=3896635 2023-10-05T11:35:10.201 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.197+0000 7f26f5634780 1 < completed part key=_multipart_4D3H60UTIXH3.2~YYYQOHTCFM2I.0 size=1048576 2023-10-05T11:35:10.202 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.199+0000 7f26f5634780 1 < completed part key=_multipart_4D3H60UTIXH3.2~YYYQOHTCFM2I.1 size=294295 2023-10-05T11:35:10.204 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.201+0000 7f26f5634780 1 < completed multipart upload key=4D3H60UTIXH3 upload=YYYQOHTCFM2I tag=715YZRTROCY7 type=write size=2391447 2023-10-05T11:35:10.206 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.203+0000 7f26f5634780 1 > prepared part key=_multipart_6DP3UJ4CW1MO.2~EMOIIJSUU8QP.0 size=600331 2023-10-05T11:35:10.206 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.203+0000 7f26f5634780 1 > prepared multipart upload key=6DP3UJ4CW1MO upload=EMOIIJSUU8QP tag=NFNZT9HUKR31 type=write size=1648907 2023-10-05T11:35:10.208 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.204+0000 7f26f5634780 -1 < failed to complete operation key=U6172JUYW7J6 tag=BZ6KFRTJXGCP type=write size=18452: (22) Invalid argument 2023-10-05T11:35:10.210 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.206+0000 7f26f5634780 1 > prepared part key=_multipart_IKCNZOTVWOC6.2~WTITACDZHZRK.0 size=1048576 2023-10-05T11:35:10.211 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.207+0000 7f26f5634780 1 > prepared part key=_multipart_IKCNZOTVWOC6.2~WTITACDZHZRK.1 size=1048576 2023-10-05T11:35:10.212 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.208+0000 7f26f5634780 1 > prepared part key=_multipart_IKCNZOTVWOC6.2~WTITACDZHZRK.2 size=932859 2023-10-05T11:35:10.212 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.208+0000 7f26f5634780 1 > prepared multipart upload key=IKCNZOTVWOC6 upload=WTITACDZHZRK tag=WS32P4TORSEJ type=write size=4078587 2023-10-05T11:35:10.213 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.210+0000 7f26f5634780 1 < completed part key=_multipart_7W9LL5HSU3BG.2~1MW56ZHTC105.0 size=1048576 2023-10-05T11:35:10.214 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.211+0000 7f26f5634780 1 < completed part key=_multipart_7W9LL5HSU3BG.2~1MW56ZHTC105.1 size=1048576 2023-10-05T11:35:10.215 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.212+0000 7f26f5634780 1 < completed part key=_multipart_7W9LL5HSU3BG.2~1MW56ZHTC105.2 size=199654 2023-10-05T11:35:10.217 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.214+0000 7f26f5634780 1 < completed multipart upload key=7W9LL5HSU3BG upload=1MW56ZHTC105 tag=54X1LCIAFKXD type=write size=3345382 2023-10-05T11:35:10.220 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.216+0000 7f26f5634780 1 > prepared part key=_multipart_9S0YW7PPSJ8G.2~IET94KTOZ1LQ.0 size=1048576 2023-10-05T11:35:10.221 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.217+0000 7f26f5634780 1 > prepared part key=_multipart_9S0YW7PPSJ8G.2~IET94KTOZ1LQ.1 size=1048576 2023-10-05T11:35:10.222 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.218+0000 7f26f5634780 1 > prepared part key=_multipart_9S0YW7PPSJ8G.2~IET94KTOZ1LQ.2 size=514900 2023-10-05T11:35:10.222 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.218+0000 7f26f5634780 1 > prepared multipart upload key=9S0YW7PPSJ8G upload=IET94KTOZ1LQ tag=EY362V6H4ZMP type=write size=3660628 2023-10-05T11:35:10.223 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.220+0000 7f26f5634780 1 < completed part key=_multipart_9S0YW7PPSJ8G.2~XX5EM2TQM4PA.0 size=782810 2023-10-05T11:35:10.225 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.222+0000 7f26f5634780 1 < completed multipart upload key=9S0YW7PPSJ8G upload=XX5EM2TQM4PA tag=ZVK8GL8AINJV type=write size=1831386 2023-10-05T11:35:10.227 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.224+0000 7f26f5634780 1 > prepared part key=_multipart_4IBQJLJR7LD8.2~5HU71QMDI9JJ.0 size=727249 2023-10-05T11:35:10.228 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.224+0000 7f26f5634780 1 > prepared multipart upload key=4IBQJLJR7LD8 upload=5HU71QMDI9JJ tag=R5T1H1GJZN09 type=write size=1775825 2023-10-05T11:35:10.229 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.225+0000 7f26f5634780 1 < canceled operation key=MEY4SZRHU9NZ tag=XWWEUC98HBLY type=del size=1427101 2023-10-05T11:35:10.230 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.227+0000 7f26f5634780 1 > prepared operation key=761J2C7GHWU5 tag=JSWHYG5BGEYM type=del size=1539138 2023-10-05T11:35:10.231 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.228+0000 7f26f5634780 1 < completed delete operation key=9S0YW7PPSJ8G tag=3IACMUH2YU15 type=del 2023-10-05T11:35:10.232 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.229+0000 7f26f5634780 1 > prepared operation key=MEY4SZRHU9NZ tag=VQ1PFLQ26S1S type=del size=2162157 2023-10-05T11:35:10.233 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.229+0000 7f26f5634780 1 < canceled part key=_multipart_761J2C7GHWU5.2~QIF90XE7BHOZ.0 size=1048576 2023-10-05T11:35:10.234 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.230+0000 7f26f5634780 1 < completed part key=_multipart_761J2C7GHWU5.2~QIF90XE7BHOZ.1 size=666634 2023-10-05T11:35:10.236 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.232+0000 7f26f5634780 1 < canceled multipart upload key=761J2C7GHWU5 upload=QIF90XE7BHOZ tag=KMJDJO36N0A8 type=write size=2763786 2023-10-05T11:35:10.238 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.235+0000 7f26f5634780 1 > prepared part key=_multipart_J5EIH25Y471T.2~0PZLCRBG2DVQ.0 size=1014252 2023-10-05T11:35:10.238 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.235+0000 7f26f5634780 1 > prepared multipart upload key=J5EIH25Y471T upload=0PZLCRBG2DVQ tag=Y94SCZY4GN9B type=write size=2062828 2023-10-05T11:35:10.240 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.236+0000 7f26f5634780 1 < completed delete operation key=4IBQJLJR7LD8 tag=SRLNVE5Y4GFX type=del 2023-10-05T11:35:10.241 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.237+0000 7f26f5634780 1 > prepared operation key=WTCWG1C1SF89 tag=0HOM1DWWDFQQ type=del size=2252504 2023-10-05T11:35:10.242 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.239+0000 7f26f5634780 1 < completed delete operation key=IKCNZOTVWOC6 tag=HSZ3I2GZJN8D type=del 2023-10-05T11:35:10.243 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.240+0000 7f26f5634780 1 > prepared operation key=BTZUVE8R96XT tag=8UKHP7M6ZPYM type=write size=563238 2023-10-05T11:35:10.244 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.241+0000 7f26f5634780 1 < completed delete operation key=4IBQJLJR7LD8 tag=QH22LLXZ6JNK type=del 2023-10-05T11:35:10.247 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.243+0000 7f26f5634780 1 > prepared part key=_multipart_4D3H60UTIXH3.2~HIQ7DZVBT7R4.0 size=135847 2023-10-05T11:35:10.247 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.243+0000 7f26f5634780 1 > prepared multipart upload key=4D3H60UTIXH3 upload=HIQ7DZVBT7R4 tag=NAKPL323JR13 type=write size=1184423 2023-10-05T11:35:10.248 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.244+0000 7f26f5634780 1 < completed part key=_multipart_PC8WTJ8AYJ24.2~KK6FDCSTAW0A.0 size=1048576 2023-10-05T11:35:10.249 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.245+0000 7f26f5634780 1 < completed part key=_multipart_PC8WTJ8AYJ24.2~KK6FDCSTAW0A.1 size=423864 2023-10-05T11:35:10.251 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.247+0000 7f26f5634780 1 < completed multipart upload key=PC8WTJ8AYJ24 upload=KK6FDCSTAW0A tag=CTT2UMLSLPC2 type=write size=2521016 2023-10-05T11:35:10.252 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.248+0000 7f26f5634780 1 > prepared operation key=J5EIH25Y471T tag=YFKXW3KJPEQW type=del size=3741167 2023-10-05T11:35:10.253 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.250+0000 7f26f5634780 1 < completed write operation key=8IPCP77WVVZT tag=5IEX4SOHP4K2 type=write size=653102 2023-10-05T11:35:10.254 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.251+0000 7f26f5634780 1 > prepared operation key=9S0YW7PPSJ8G tag=KXOXZEQB0FF8 type=del size=68526 2023-10-05T11:35:10.255 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.252+0000 7f26f5634780 1 < canceled operation key=9S0YW7PPSJ8G tag=3KPJE0UAFCR2 type=write size=39631 2023-10-05T11:35:10.257 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.253+0000 7f26f5634780 1 > prepared operation key=4D3H60UTIXH3 tag=CH9BEC6PEISW type=del size=2430420 2023-10-05T11:35:10.258 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.254+0000 7f26f5634780 1 < completed part key=_multipart_5OPHKTHXVN5U.2~I09FPY376ZVX.0 size=1048576 2023-10-05T11:35:10.259 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.255+0000 7f26f5634780 1 < completed part key=_multipart_5OPHKTHXVN5U.2~I09FPY376ZVX.1 size=537958 2023-10-05T11:35:10.261 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.258+0000 7f26f5634780 1 < completed multipart upload key=5OPHKTHXVN5U upload=I09FPY376ZVX tag=0Q75PILOZN2I type=write size=2635110 2023-10-05T11:35:10.263 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.260+0000 7f26f5634780 1 > prepared part key=_multipart_QYQDXVIGZ7O8.2~GBOLCIASE6J3.0 size=1048576 2023-10-05T11:35:10.264 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.261+0000 7f26f5634780 1 > prepared part key=_multipart_QYQDXVIGZ7O8.2~GBOLCIASE6J3.1 size=448797 2023-10-05T11:35:10.264 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.261+0000 7f26f5634780 1 > prepared multipart upload key=QYQDXVIGZ7O8 upload=GBOLCIASE6J3 tag=PTW491F21AQP type=write size=2545949 2023-10-05T11:35:10.265 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.262+0000 7f26f5634780 1 < completed delete operation key=2D4PDQQT54ZA tag=ETFMFYHX0KL8 type=del 2023-10-05T11:35:10.267 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.263+0000 7f26f5634780 1 > prepared operation key=7W9LL5HSU3BG tag=BC9HGDR1566P type=del size=869067 2023-10-05T11:35:10.269 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.265+0000 7f26f5634780 1 < completed delete operation key=8IPCP77WVVZT tag=5STE8W1O40XE type=del 2023-10-05T11:35:10.273 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.269+0000 7f26f5634780 1 > prepared part key=_multipart_8IPCP77WVVZT.2~DZSMWPSUHVM8.0 size=1048576 2023-10-05T11:35:10.273 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.270+0000 7f26f5634780 1 > prepared part key=_multipart_8IPCP77WVVZT.2~DZSMWPSUHVM8.1 size=807668 2023-10-05T11:35:10.274 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.270+0000 7f26f5634780 1 > prepared multipart upload key=8IPCP77WVVZT upload=DZSMWPSUHVM8 tag=1DTK46U4L4ZG type=write size=2904820 2023-10-05T11:35:10.275 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.271+0000 7f26f5634780 1 < completed part key=_multipart_6DP3UJ4CW1MO.2~EMOIIJSUU8QP.0 size=600331 2023-10-05T11:35:10.279 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.275+0000 7f26f5634780 1 < completed multipart upload key=6DP3UJ4CW1MO upload=EMOIIJSUU8QP tag=NFNZT9HUKR31 type=write size=1648907 2023-10-05T11:35:10.280 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.277+0000 7f26f5634780 1 > prepared operation key=WTCWG1C1SF89 tag=5RH98A9GH1ZG type=write size=553170 2023-10-05T11:35:10.281 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.278+0000 7f26f5634780 1 < completed part key=_multipart_IKCNZOTVWOC6.2~WTITACDZHZRK.0 size=1048576 2023-10-05T11:35:10.282 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.279+0000 7f26f5634780 1 < completed part key=_multipart_IKCNZOTVWOC6.2~WTITACDZHZRK.1 size=1048576 2023-10-05T11:35:10.283 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.280+0000 7f26f5634780 1 < completed part key=_multipart_IKCNZOTVWOC6.2~WTITACDZHZRK.2 size=932859 2023-10-05T11:35:10.285 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.282+0000 7f26f5634780 1 < completed multipart upload key=IKCNZOTVWOC6 upload=WTITACDZHZRK tag=WS32P4TORSEJ type=write size=4078587 2023-10-05T11:35:10.287 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.283+0000 7f26f5634780 1 > prepared operation key=4IBQJLJR7LD8 tag=UQ215MJ0XY8Z type=write size=394065 2023-10-05T11:35:10.288 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.285+0000 7f26f5634780 1 < completed part key=_multipart_9S0YW7PPSJ8G.2~IET94KTOZ1LQ.0 size=1048576 2023-10-05T11:35:10.289 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.286+0000 7f26f5634780 1 < completed part key=_multipart_9S0YW7PPSJ8G.2~IET94KTOZ1LQ.1 size=1048576 2023-10-05T11:35:10.290 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.287+0000 7f26f5634780 1 < completed part key=_multipart_9S0YW7PPSJ8G.2~IET94KTOZ1LQ.2 size=514900 2023-10-05T11:35:10.292 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.289+0000 7f26f5634780 1 < completed multipart upload key=9S0YW7PPSJ8G upload=IET94KTOZ1LQ tag=EY362V6H4ZMP type=write size=3660628 2023-10-05T11:35:10.294 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.291+0000 7f26f5634780 1 > prepared part key=_multipart_MEY4SZRHU9NZ.2~MRFQ7JQM35KG.0 size=1048576 2023-10-05T11:35:10.295 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.292+0000 7f26f5634780 1 > prepared part key=_multipart_MEY4SZRHU9NZ.2~MRFQ7JQM35KG.1 size=1048576 2023-10-05T11:35:10.296 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.293+0000 7f26f5634780 1 > prepared part key=_multipart_MEY4SZRHU9NZ.2~MRFQ7JQM35KG.2 size=605754 2023-10-05T11:35:10.296 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.293+0000 7f26f5634780 1 > prepared multipart upload key=MEY4SZRHU9NZ upload=MRFQ7JQM35KG tag=O5H3H04RQTP5 type=write size=3751482 2023-10-05T11:35:10.298 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.294+0000 7f26f5634780 1 < completed part key=_multipart_4IBQJLJR7LD8.2~5HU71QMDI9JJ.0 size=727249 2023-10-05T11:35:10.300 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.296+0000 7f26f5634780 1 < completed multipart upload key=4IBQJLJR7LD8 upload=5HU71QMDI9JJ tag=R5T1H1GJZN09 type=write size=1775825 2023-10-05T11:35:10.302 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.298+0000 7f26f5634780 1 > prepared part key=_multipart_MEY4SZRHU9NZ.2~KXKF8YXDAZVT.0 size=1048576 2023-10-05T11:35:10.303 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.299+0000 7f26f5634780 1 > prepared part key=_multipart_MEY4SZRHU9NZ.2~KXKF8YXDAZVT.1 size=137789 2023-10-05T11:35:10.303 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.299+0000 7f26f5634780 1 > prepared multipart upload key=MEY4SZRHU9NZ upload=KXKF8YXDAZVT tag=NSX2IDBS33BB type=write size=2234941 2023-10-05T11:35:10.305 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.302+0000 7f26f5634780 1 < suggested update operation key=761J2C7GHWU5 tag=JSWHYG5BGEYM type=del size=1539138 2023-10-05T11:35:10.308 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.304+0000 7f26f5634780 1 > prepared part key=_multipart_5V0Q651D4VN2.2~59NGVPG3V04F.0 size=1048576 2023-10-05T11:35:10.309 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.305+0000 7f26f5634780 1 > prepared part key=_multipart_5V0Q651D4VN2.2~59NGVPG3V04F.1 size=45587 2023-10-05T11:35:10.309 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.305+0000 7f26f5634780 1 > prepared multipart upload key=5V0Q651D4VN2 upload=59NGVPG3V04F tag=2NZOD6X51TFT type=write size=2142739 2023-10-05T11:35:10.310 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.307+0000 7f26f5634780 1 < completed delete operation key=MEY4SZRHU9NZ tag=VQ1PFLQ26S1S type=del 2023-10-05T11:35:10.313 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.309+0000 7f26f5634780 1 > prepared part key=_multipart_WYN9BG66LA3K.2~S2X3QU2LDQRV.0 size=190307 2023-10-05T11:35:10.313 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.309+0000 7f26f5634780 1 > prepared multipart upload key=WYN9BG66LA3K upload=S2X3QU2LDQRV tag=Z8R9JCWO31FG type=write size=1238883 2023-10-05T11:35:10.314 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.310+0000 7f26f5634780 1 < completed part key=_multipart_J5EIH25Y471T.2~0PZLCRBG2DVQ.0 size=1014252 2023-10-05T11:35:10.316 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.312+0000 7f26f5634780 1 < completed multipart upload key=J5EIH25Y471T upload=0PZLCRBG2DVQ tag=Y94SCZY4GN9B type=write size=2062828 2023-10-05T11:35:10.317 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.314+0000 7f26f5634780 1 > prepared operation key=VJTFYDETLSFD tag=YDZATCWVOJM0 type=del size=1536905 2023-10-05T11:35:10.318 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.315+0000 7f26f5634780 1 < completed delete operation key=WTCWG1C1SF89 tag=0HOM1DWWDFQQ type=del 2023-10-05T11:35:10.319 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.316+0000 7f26f5634780 1 > prepared operation key=BTZUVE8R96XT tag=SAOO7LABKAY9 type=del size=3635573 2023-10-05T11:35:10.321 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.317+0000 7f26f5634780 1 < completed write operation key=BTZUVE8R96XT tag=8UKHP7M6ZPYM type=write size=563238 2023-10-05T11:35:10.322 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.319+0000 7f26f5634780 1 > prepared operation key=4IBQJLJR7LD8 tag=W09UXUFE3VDW type=del size=352730 2023-10-05T11:35:10.323 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.320+0000 7f26f5634780 1 < completed part key=_multipart_4D3H60UTIXH3.2~HIQ7DZVBT7R4.0 size=135847 2023-10-05T11:35:10.326 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.322+0000 7f26f5634780 1 < completed multipart upload key=4D3H60UTIXH3 upload=HIQ7DZVBT7R4 tag=NAKPL323JR13 type=write size=1184423 2023-10-05T11:35:10.327 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.323+0000 7f26f5634780 1 > prepared operation key=PNV0Q6ZPLYV0 tag=542GTUNE9V3I type=del size=3337831 2023-10-05T11:35:10.328 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.325+0000 7f26f5634780 1 < completed delete operation key=J5EIH25Y471T tag=YFKXW3KJPEQW type=del 2023-10-05T11:35:10.329 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.326+0000 7f26f5634780 1 > prepared operation key=0PWYKC7S6YJ4 tag=X2CXCA1F3BI8 type=del size=2872850 2023-10-05T11:35:10.330 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.327+0000 7f26f5634780 1 < completed delete operation key=9S0YW7PPSJ8G tag=KXOXZEQB0FF8 type=del 2023-10-05T11:35:10.332 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.328+0000 7f26f5634780 1 > prepared operation key=LLR5J3X15W5R tag=1OWY69AVD9GM type=del size=3297880 2023-10-05T11:35:10.334 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.331+0000 7f26f5634780 1 < suggested update operation key=4D3H60UTIXH3 tag=CH9BEC6PEISW type=del size=2430420 2023-10-05T11:35:10.336 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.332+0000 7f26f5634780 1 > prepared operation key=WYN9BG66LA3K tag=KOPNXC9LHE80 type=del size=2526255 2023-10-05T11:35:10.337 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.333+0000 7f26f5634780 1 < completed part key=_multipart_QYQDXVIGZ7O8.2~GBOLCIASE6J3.0 size=1048576 2023-10-05T11:35:10.338 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.334+0000 7f26f5634780 1 < completed part key=_multipart_QYQDXVIGZ7O8.2~GBOLCIASE6J3.1 size=448797 2023-10-05T11:35:10.340 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.336+0000 7f26f5634780 1 < completed multipart upload key=QYQDXVIGZ7O8 upload=GBOLCIASE6J3 tag=PTW491F21AQP type=write size=2545949 2023-10-05T11:35:10.342 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.339+0000 7f26f5634780 1 > prepared part key=_multipart_5V0Q651D4VN2.2~VQAV8ZOE0E1O.0 size=773156 2023-10-05T11:35:10.342 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.339+0000 7f26f5634780 1 > prepared multipart upload key=5V0Q651D4VN2 upload=VQAV8ZOE0E1O tag=X42QB5L1V1EX type=write size=1821732 2023-10-05T11:35:10.343 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.340+0000 7f26f5634780 1 < completed delete operation key=7W9LL5HSU3BG tag=BC9HGDR1566P type=del 2023-10-05T11:35:10.345 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.341+0000 7f26f5634780 1 > prepared operation key=7W9LL5HSU3BG tag=BQ9MRRM5DRDQ type=del size=1059624 2023-10-05T11:35:10.346 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.342+0000 7f26f5634780 1 < completed part key=_multipart_8IPCP77WVVZT.2~DZSMWPSUHVM8.0 size=1048576 2023-10-05T11:35:10.346 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.342+0000 7f26f5634780 1 < canceled part key=_multipart_8IPCP77WVVZT.2~DZSMWPSUHVM8.1 size=807668 2023-10-05T11:35:10.348 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.344+0000 7f26f5634780 1 < canceled multipart upload key=8IPCP77WVVZT upload=DZSMWPSUHVM8 tag=1DTK46U4L4ZG type=write size=2904820 2023-10-05T11:35:10.349 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.346+0000 7f26f5634780 1 > prepared operation key=QYQDXVIGZ7O8 tag=M54JZ5KQSUTC type=del size=3298606 2023-10-05T11:35:10.350 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.347+0000 7f26f5634780 1 < canceled operation key=WTCWG1C1SF89 tag=5RH98A9GH1ZG type=write size=553170 2023-10-05T11:35:10.352 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.349+0000 7f26f5634780 1 > prepared part key=_multipart_5V0Q651D4VN2.2~YIZUMN9V29AL.0 size=1048576 2023-10-05T11:35:10.354 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.350+0000 7f26f5634780 1 > prepared part key=_multipart_5V0Q651D4VN2.2~YIZUMN9V29AL.1 size=1048576 2023-10-05T11:35:10.354 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.351+0000 7f26f5634780 1 > prepared part key=_multipart_5V0Q651D4VN2.2~YIZUMN9V29AL.2 size=628041 2023-10-05T11:35:10.354 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.351+0000 7f26f5634780 1 > prepared multipart upload key=5V0Q651D4VN2 upload=YIZUMN9V29AL tag=OO0PFG71VV3M type=write size=3773769 2023-10-05T11:35:10.356 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.352+0000 7f26f5634780 1 < completed write operation key=4IBQJLJR7LD8 tag=UQ215MJ0XY8Z type=write size=394065 2023-10-05T11:35:10.357 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.354+0000 7f26f5634780 1 > prepared operation key=4D3H60UTIXH3 tag=IUQ1JBE84OED type=write size=330722 2023-10-05T11:35:10.358 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.355+0000 7f26f5634780 1 < completed part key=_multipart_MEY4SZRHU9NZ.2~MRFQ7JQM35KG.0 size=1048576 2023-10-05T11:35:10.359 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.356+0000 7f26f5634780 1 < completed part key=_multipart_MEY4SZRHU9NZ.2~MRFQ7JQM35KG.1 size=1048576 2023-10-05T11:35:10.360 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.357+0000 7f26f5634780 1 < completed part key=_multipart_MEY4SZRHU9NZ.2~MRFQ7JQM35KG.2 size=605754 2023-10-05T11:35:10.362 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.359+0000 7f26f5634780 1 < completed multipart upload key=MEY4SZRHU9NZ upload=MRFQ7JQM35KG tag=O5H3H04RQTP5 type=write size=3751482 2023-10-05T11:35:10.363 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.360+0000 7f26f5634780 1 > prepared operation key=MEY4SZRHU9NZ tag=7RMGRI06OV8F type=del size=2390867 2023-10-05T11:35:10.365 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.361+0000 7f26f5634780 1 < completed part key=_multipart_MEY4SZRHU9NZ.2~KXKF8YXDAZVT.0 size=1048576 2023-10-05T11:35:10.366 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.362+0000 7f26f5634780 1 < completed part key=_multipart_MEY4SZRHU9NZ.2~KXKF8YXDAZVT.1 size=137789 2023-10-05T11:35:10.368 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.364+0000 7f26f5634780 1 < completed multipart upload key=MEY4SZRHU9NZ upload=KXKF8YXDAZVT tag=NSX2IDBS33BB type=write size=2234941 2023-10-05T11:35:10.370 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.366+0000 7f26f5634780 1 > prepared part key=_multipart_4D3H60UTIXH3.2~ZYDP5JIN2RJ4.0 size=1048576 2023-10-05T11:35:10.371 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.367+0000 7f26f5634780 1 > prepared part key=_multipart_4D3H60UTIXH3.2~ZYDP5JIN2RJ4.1 size=1048576 2023-10-05T11:35:10.371 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.368+0000 7f26f5634780 1 > prepared part key=_multipart_4D3H60UTIXH3.2~ZYDP5JIN2RJ4.2 size=529251 2023-10-05T11:35:10.372 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.368+0000 7f26f5634780 1 > prepared multipart upload key=4D3H60UTIXH3 upload=ZYDP5JIN2RJ4 tag=NQTHQSQALJQR type=write size=3674979 2023-10-05T11:35:10.373 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.369+0000 7f26f5634780 1 < completed part key=_multipart_5V0Q651D4VN2.2~59NGVPG3V04F.0 size=1048576 2023-10-05T11:35:10.374 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.370+0000 7f26f5634780 1 < completed part key=_multipart_5V0Q651D4VN2.2~59NGVPG3V04F.1 size=45587 2023-10-05T11:35:10.376 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.372+0000 7f26f5634780 1 < completed multipart upload key=5V0Q651D4VN2 upload=59NGVPG3V04F tag=2NZOD6X51TFT type=write size=2142739 2023-10-05T11:35:10.377 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.373+0000 7f26f5634780 1 > prepared operation key=IC7T3ZK81WQS tag=1IB15UWOWXZS type=del size=2469510 2023-10-05T11:35:10.378 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.375+0000 7f26f5634780 1 < completed part key=_multipart_WYN9BG66LA3K.2~S2X3QU2LDQRV.0 size=190307 2023-10-05T11:35:10.380 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.377+0000 7f26f5634780 1 < completed multipart upload key=WYN9BG66LA3K upload=S2X3QU2LDQRV tag=Z8R9JCWO31FG type=write size=1238883 2023-10-05T11:35:10.381 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.378+0000 7f26f5634780 1 > prepared operation key=BTZUVE8R96XT tag=JHQFRP6OJKG5 type=del size=2850918 2023-10-05T11:35:10.382 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.379+0000 7f26f5634780 1 < completed delete operation key=VJTFYDETLSFD tag=YDZATCWVOJM0 type=del 2023-10-05T11:35:10.384 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.380+0000 7f26f5634780 1 > prepared operation key=S3DKYDFT4IO2 tag=1W0MN33FY6X8 type=del size=431795 2023-10-05T11:35:10.386 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.382+0000 7f26f5634780 1 < completed delete operation key=BTZUVE8R96XT tag=SAOO7LABKAY9 type=del 2023-10-05T11:35:10.387 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.384+0000 7f26f5634780 1 > prepared operation key=WTCWG1C1SF89 tag=YBMSCRUZWQVP type=write size=684096 2023-10-05T11:35:10.388 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.385+0000 7f26f5634780 1 < completed delete operation key=4IBQJLJR7LD8 tag=W09UXUFE3VDW type=del 2023-10-05T11:35:10.391 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.387+0000 7f26f5634780 1 > prepared part key=_multipart_S3DKYDFT4IO2.2~7NFSBR5CRT6J.0 size=1048576 2023-10-05T11:35:10.392 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.388+0000 7f26f5634780 1 > prepared part key=_multipart_S3DKYDFT4IO2.2~7NFSBR5CRT6J.1 size=500959 2023-10-05T11:35:10.392 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.388+0000 7f26f5634780 1 > prepared multipart upload key=S3DKYDFT4IO2 upload=7NFSBR5CRT6J tag=6KBDJ05QY573 type=write size=2598111 2023-10-05T11:35:10.393 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.390+0000 7f26f5634780 1 < completed delete operation key=PNV0Q6ZPLYV0 tag=542GTUNE9V3I type=del 2023-10-05T11:35:10.395 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.392+0000 7f26f5634780 1 > prepared part key=_multipart_5OPHKTHXVN5U.2~2XKRXJYSTOVQ.0 size=1048576 2023-10-05T11:35:10.396 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.393+0000 7f26f5634780 1 > prepared part key=_multipart_5OPHKTHXVN5U.2~2XKRXJYSTOVQ.1 size=269081 2023-10-05T11:35:10.396 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.393+0000 7f26f5634780 1 > prepared multipart upload key=5OPHKTHXVN5U upload=2XKRXJYSTOVQ tag=EYKS4NJEOS0Y type=write size=2366233 2023-10-05T11:35:10.399 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.396+0000 7f26f5634780 1 < suggested remove operation key=0PWYKC7S6YJ4 tag=X2CXCA1F3BI8 type=del 2023-10-05T11:35:10.401 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.398+0000 7f26f5634780 1 > prepared part key=_multipart_761J2C7GHWU5.2~AZ547PQ3XYIB.0 size=486819 2023-10-05T11:35:10.401 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.398+0000 7f26f5634780 1 > prepared multipart upload key=761J2C7GHWU5 upload=AZ547PQ3XYIB tag=2G14ICSITXRS type=write size=1535395 2023-10-05T11:35:10.402 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.399+0000 7f26f5634780 1 < completed delete operation key=LLR5J3X15W5R tag=1OWY69AVD9GM type=del 2023-10-05T11:35:10.404 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.400+0000 7f26f5634780 1 > prepared operation key=7W9LL5HSU3BG tag=I4ACLB2VU6GL type=del size=3672502 2023-10-05T11:35:10.405 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.402+0000 7f26f5634780 1 < completed delete operation key=WYN9BG66LA3K tag=KOPNXC9LHE80 type=del 2023-10-05T11:35:10.406 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.403+0000 7f26f5634780 1 > prepared operation key=PNV0Q6ZPLYV0 tag=HKSN2G3FQLYQ type=del size=695523 2023-10-05T11:35:10.408 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.404+0000 7f26f5634780 1 < completed part key=_multipart_5V0Q651D4VN2.2~VQAV8ZOE0E1O.0 size=773156 2023-10-05T11:35:10.410 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.406+0000 7f26f5634780 1 < completed multipart upload key=5V0Q651D4VN2 upload=VQAV8ZOE0E1O tag=X42QB5L1V1EX type=write size=1821732 2023-10-05T11:35:10.411 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.407+0000 7f26f5634780 1 > prepared operation key=PC8WTJ8AYJ24 tag=JEY6O4HAZTAM type=del size=389174 2023-10-05T11:35:10.412 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.409+0000 7f26f5634780 1 < completed delete operation key=7W9LL5HSU3BG tag=BQ9MRRM5DRDQ type=del 2023-10-05T11:35:10.414 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.411+0000 7f26f5634780 1 > prepared part key=_multipart_QYQDXVIGZ7O8.2~VPOK07793F5F.0 size=553402 2023-10-05T11:35:10.414 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.411+0000 7f26f5634780 1 > prepared multipart upload key=QYQDXVIGZ7O8 upload=VPOK07793F5F tag=W7M8DXLFCXOD type=write size=1601978 2023-10-05T11:35:10.415 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.412+0000 7f26f5634780 1 < completed delete operation key=QYQDXVIGZ7O8 tag=M54JZ5KQSUTC type=del 2023-10-05T11:35:10.418 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.414+0000 7f26f5634780 1 > prepared part key=_multipart_U6172JUYW7J6.2~28JOA1SROHFD.0 size=1048576 2023-10-05T11:35:10.418 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.415+0000 7f26f5634780 1 > prepared part key=_multipart_U6172JUYW7J6.2~28JOA1SROHFD.1 size=1048576 2023-10-05T11:35:10.419 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.416+0000 7f26f5634780 1 > prepared part key=_multipart_U6172JUYW7J6.2~28JOA1SROHFD.2 size=581404 2023-10-05T11:35:10.419 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.416+0000 7f26f5634780 1 > prepared multipart upload key=U6172JUYW7J6 upload=28JOA1SROHFD tag=2GVCTS5YU09P type=write size=3727132 2023-10-05T11:35:10.421 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.417+0000 7f26f5634780 1 < completed part key=_multipart_5V0Q651D4VN2.2~YIZUMN9V29AL.0 size=1048576 2023-10-05T11:35:10.423 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.420+0000 7f26f5634780 1 < completed part key=_multipart_5V0Q651D4VN2.2~YIZUMN9V29AL.1 size=1048576 2023-10-05T11:35:10.425 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.421+0000 7f26f5634780 1 < completed part key=_multipart_5V0Q651D4VN2.2~YIZUMN9V29AL.2 size=628041 2023-10-05T11:35:10.427 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.423+0000 7f26f5634780 1 < completed multipart upload key=5V0Q651D4VN2 upload=YIZUMN9V29AL tag=OO0PFG71VV3M type=write size=3773769 2023-10-05T11:35:10.428 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.425+0000 7f26f5634780 1 > prepared operation key=9S0YW7PPSJ8G tag=MLW95220L4O9 type=del size=1983919 2023-10-05T11:35:10.431 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.427+0000 7f26f5634780 1 < suggested remove operation key=4D3H60UTIXH3 tag=IUQ1JBE84OED type=write 2023-10-05T11:35:10.433 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.430+0000 7f26f5634780 1 > prepared part key=_multipart_IC7T3ZK81WQS.2~ZNANMX3CN385.0 size=1048576 2023-10-05T11:35:10.434 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.431+0000 7f26f5634780 1 > prepared part key=_multipart_IC7T3ZK81WQS.2~ZNANMX3CN385.1 size=232829 2023-10-05T11:35:10.434 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.431+0000 7f26f5634780 1 > prepared multipart upload key=IC7T3ZK81WQS upload=ZNANMX3CN385 tag=1C2H6LWGI3WY type=write size=2329981 2023-10-05T11:35:10.437 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.433+0000 7f26f5634780 1 < suggested remove operation key=MEY4SZRHU9NZ tag=7RMGRI06OV8F type=del 2023-10-05T11:35:10.438 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.434+0000 7f26f5634780 1 > prepared operation key=W2GWVGX42QLD tag=T74C089NWJ6X type=del size=2951635 2023-10-05T11:35:10.439 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.436+0000 7f26f5634780 1 < completed part key=_multipart_4D3H60UTIXH3.2~ZYDP5JIN2RJ4.0 size=1048576 2023-10-05T11:35:10.439 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.436+0000 7f26f5634780 1 < canceled part key=_multipart_4D3H60UTIXH3.2~ZYDP5JIN2RJ4.1 size=1048576 2023-10-05T11:35:10.440 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.437+0000 7f26f5634780 1 < completed part key=_multipart_4D3H60UTIXH3.2~ZYDP5JIN2RJ4.2 size=529251 2023-10-05T11:35:10.442 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.439+0000 7f26f5634780 1 < canceled multipart upload key=4D3H60UTIXH3 upload=ZYDP5JIN2RJ4 tag=NQTHQSQALJQR type=write size=3674979 2023-10-05T11:35:10.443 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.440+0000 7f26f5634780 1 > prepared operation key=U6172JUYW7J6 tag=ST39631PN0ME type=del size=1654189 2023-10-05T11:35:10.445 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.441+0000 7f26f5634780 1 < completed delete operation key=IC7T3ZK81WQS tag=1IB15UWOWXZS type=del 2023-10-05T11:35:10.446 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.442+0000 7f26f5634780 1 > prepared operation key=IKCNZOTVWOC6 tag=S35HO32N4DJH type=del size=4043744 2023-10-05T11:35:10.447 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.444+0000 7f26f5634780 1 < canceled operation key=BTZUVE8R96XT tag=JHQFRP6OJKG5 type=del size=2850918 2023-10-05T11:35:10.448 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.445+0000 7f26f5634780 1 > prepared operation key=4IBQJLJR7LD8 tag=I7ZU2JLOR1FF type=del size=2640768 2023-10-05T11:35:10.451 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.447+0000 7f26f5634780 1 < suggested update operation key=S3DKYDFT4IO2 tag=1W0MN33FY6X8 type=del size=431795 2023-10-05T11:35:10.452 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.448+0000 7f26f5634780 1 > prepared operation key=PNV0Q6ZPLYV0 tag=TQCXFTJLUD24 type=del size=894634 2023-10-05T11:35:10.453 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.450+0000 7f26f5634780 1 < completed write operation key=WTCWG1C1SF89 tag=YBMSCRUZWQVP type=write size=684096 2023-10-05T11:35:10.454 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.451+0000 7f26f5634780 1 > prepared operation key=BTZUVE8R96XT tag=MIH981V5R59O type=del size=988221 2023-10-05T11:35:10.456 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.452+0000 7f26f5634780 1 < completed part key=_multipart_S3DKYDFT4IO2.2~7NFSBR5CRT6J.0 size=1048576 2023-10-05T11:35:10.457 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.453+0000 7f26f5634780 1 < completed part key=_multipart_S3DKYDFT4IO2.2~7NFSBR5CRT6J.1 size=500959 2023-10-05T11:35:10.459 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.456+0000 7f26f5634780 1 < completed multipart upload key=S3DKYDFT4IO2 upload=7NFSBR5CRT6J tag=6KBDJ05QY573 type=write size=2598111 2023-10-05T11:35:10.461 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.458+0000 7f26f5634780 1 > prepared part key=_multipart_0PWYKC7S6YJ4.2~NQZLK4CASQMI.0 size=272418 2023-10-05T11:35:10.461 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.458+0000 7f26f5634780 1 > prepared multipart upload key=0PWYKC7S6YJ4 upload=NQZLK4CASQMI tag=BM5C0C8IK5OS type=write size=1320994 2023-10-05T11:35:10.462 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.458+0000 7f26f5634780 1 < canceled part key=_multipart_5OPHKTHXVN5U.2~2XKRXJYSTOVQ.0 size=1048576 2023-10-05T11:35:10.463 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.459+0000 7f26f5634780 1 < completed part key=_multipart_5OPHKTHXVN5U.2~2XKRXJYSTOVQ.1 size=269081 2023-10-05T11:35:10.465 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.462+0000 7f26f5634780 1 < canceled multipart upload key=5OPHKTHXVN5U upload=2XKRXJYSTOVQ tag=EYKS4NJEOS0Y type=write size=2366233 2023-10-05T11:35:10.466 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.463+0000 7f26f5634780 1 > prepared operation key=4IBQJLJR7LD8 tag=VJ4LLB23D089 type=del size=873655 2023-10-05T11:35:10.468 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.464+0000 7f26f5634780 1 < completed part key=_multipart_761J2C7GHWU5.2~AZ547PQ3XYIB.0 size=486819 2023-10-05T11:35:10.470 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.466+0000 7f26f5634780 1 < completed multipart upload key=761J2C7GHWU5 upload=AZ547PQ3XYIB tag=2G14ICSITXRS type=write size=1535395 2023-10-05T11:35:10.471 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.467+0000 7f26f5634780 1 > prepared operation key=8IPCP77WVVZT tag=KQ616GX28TL2 type=del size=3410159 2023-10-05T11:35:10.473 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.470+0000 7f26f5634780 1 < suggested update operation key=7W9LL5HSU3BG tag=I4ACLB2VU6GL type=del size=3672502 2023-10-05T11:35:10.474 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.471+0000 7f26f5634780 1 > prepared operation key=PC8WTJ8AYJ24 tag=C71ANSEWIDCS type=del size=290092 2023-10-05T11:35:10.476 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.473+0000 7f26f5634780 1 < suggested update operation key=PNV0Q6ZPLYV0 tag=HKSN2G3FQLYQ type=del size=695523 2023-10-05T11:35:10.478 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.474+0000 7f26f5634780 1 > prepared operation key=761J2C7GHWU5 tag=F8FY8SG2EWPZ type=write size=13842 2023-10-05T11:35:10.479 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.475+0000 7f26f5634780 1 < completed delete operation key=PC8WTJ8AYJ24 tag=JEY6O4HAZTAM type=del 2023-10-05T11:35:10.480 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.477+0000 7f26f5634780 1 > prepared operation key=5OPHKTHXVN5U tag=9I3CW59YNYXF type=del size=345618 2023-10-05T11:35:10.481 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.478+0000 7f26f5634780 1 < completed part key=_multipart_QYQDXVIGZ7O8.2~VPOK07793F5F.0 size=553402 2023-10-05T11:35:10.483 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.480+0000 7f26f5634780 1 < completed multipart upload key=QYQDXVIGZ7O8 upload=VPOK07793F5F tag=W7M8DXLFCXOD type=write size=1601978 2023-10-05T11:35:10.485 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.482+0000 7f26f5634780 1 > prepared part key=_multipart_0PWYKC7S6YJ4.2~HV7QLX71AP3Q.0 size=864966 2023-10-05T11:35:10.485 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.482+0000 7f26f5634780 1 > prepared multipart upload key=0PWYKC7S6YJ4 upload=HV7QLX71AP3Q tag=S204HI0B3PBR type=write size=1913542 2023-10-05T11:35:10.486 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.483+0000 7f26f5634780 1 < completed part key=_multipart_U6172JUYW7J6.2~28JOA1SROHFD.0 size=1048576 2023-10-05T11:35:10.487 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.484+0000 7f26f5634780 1 < completed part key=_multipart_U6172JUYW7J6.2~28JOA1SROHFD.1 size=1048576 2023-10-05T11:35:10.488 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.484+0000 7f26f5634780 1 < canceled part key=_multipart_U6172JUYW7J6.2~28JOA1SROHFD.2 size=581404 2023-10-05T11:35:10.489 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.486+0000 7f26f5634780 1 < canceled multipart upload key=U6172JUYW7J6 upload=28JOA1SROHFD tag=2GVCTS5YU09P type=write size=3727132 2023-10-05T11:35:10.491 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.487+0000 7f26f5634780 1 > prepared operation key=2U0NRDGDNUTA tag=GRWW0GELEPTE type=del size=2249057 2023-10-05T11:35:10.492 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.489+0000 7f26f5634780 1 < completed delete operation key=9S0YW7PPSJ8G tag=MLW95220L4O9 type=del 2023-10-05T11:35:10.493 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.490+0000 7f26f5634780 1 > prepared operation key=2D4PDQQT54ZA tag=3XCDNU1LINZO type=write size=200982 2023-10-05T11:35:10.495 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.491+0000 7f26f5634780 1 < completed part key=_multipart_IC7T3ZK81WQS.2~ZNANMX3CN385.0 size=1048576 2023-10-05T11:35:10.496 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.492+0000 7f26f5634780 1 < completed part key=_multipart_IC7T3ZK81WQS.2~ZNANMX3CN385.1 size=232829 2023-10-05T11:35:10.498 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.494+0000 7f26f5634780 1 < completed multipart upload key=IC7T3ZK81WQS upload=ZNANMX3CN385 tag=1C2H6LWGI3WY type=write size=2329981 2023-10-05T11:35:10.500 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.496+0000 7f26f5634780 1 > prepared part key=_multipart_7TOP5A52M9YP.2~9SDIUPU6XCAT.0 size=1048576 2023-10-05T11:35:10.501 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.497+0000 7f26f5634780 1 > prepared part key=_multipart_7TOP5A52M9YP.2~9SDIUPU6XCAT.1 size=905979 2023-10-05T11:35:10.501 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.497+0000 7f26f5634780 1 > prepared multipart upload key=7TOP5A52M9YP upload=9SDIUPU6XCAT tag=CW4GLTFIPUPM type=write size=3003131 2023-10-05T11:35:10.502 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.499+0000 7f26f5634780 1 < completed delete operation key=W2GWVGX42QLD tag=T74C089NWJ6X type=del 2023-10-05T11:35:10.504 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.501+0000 7f26f5634780 1 > prepared operation key=BTZUVE8R96XT tag=PBQ7YC0Z7O1V type=del size=22469 2023-10-05T11:35:10.505 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.502+0000 7f26f5634780 1 < completed delete operation key=U6172JUYW7J6 tag=ST39631PN0ME type=del 2023-10-05T11:35:10.506 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.503+0000 7f26f5634780 1 > prepared operation key=PC8WTJ8AYJ24 tag=2XQ763R3A1R9 type=del size=3508044 2023-10-05T11:35:10.508 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.504+0000 7f26f5634780 1 < completed delete operation key=IKCNZOTVWOC6 tag=S35HO32N4DJH type=del 2023-10-05T11:35:10.510 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.506+0000 7f26f5634780 1 > prepared part key=_multipart_WTCWG1C1SF89.2~20PCLS49F9RI.0 size=1048576 2023-10-05T11:35:10.511 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.507+0000 7f26f5634780 1 > prepared part key=_multipart_WTCWG1C1SF89.2~20PCLS49F9RI.1 size=1048576 2023-10-05T11:35:10.511 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.508+0000 7f26f5634780 1 > prepared part key=_multipart_WTCWG1C1SF89.2~20PCLS49F9RI.2 size=314191 2023-10-05T11:35:10.512 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.508+0000 7f26f5634780 1 > prepared multipart upload key=WTCWG1C1SF89 upload=20PCLS49F9RI tag=86PKC312W43Z type=write size=3459919 2023-10-05T11:35:10.514 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.510+0000 7f26f5634780 1 < suggested update operation key=4IBQJLJR7LD8 tag=I7ZU2JLOR1FF type=del size=2640768 2023-10-05T11:35:10.516 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.513+0000 7f26f5634780 1 > prepared part key=_multipart_PNV0Q6ZPLYV0.2~CUXU34NUEPIH.0 size=1048576 2023-10-05T11:35:10.517 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.514+0000 7f26f5634780 1 > prepared part key=_multipart_PNV0Q6ZPLYV0.2~CUXU34NUEPIH.1 size=793328 2023-10-05T11:35:10.517 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.514+0000 7f26f5634780 1 > prepared multipart upload key=PNV0Q6ZPLYV0 upload=CUXU34NUEPIH tag=4EHPAIJ1VAFR type=write size=2890480 2023-10-05T11:35:10.518 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.515+0000 7f26f5634780 -1 < failed to complete operation key=PNV0Q6ZPLYV0 tag=TQCXFTJLUD24 type=del size=894634: (22) Invalid argument 2023-10-05T11:35:10.519 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.516+0000 7f26f5634780 1 > prepared operation key=4D3H60UTIXH3 tag=EM35OVRU5DI7 type=del size=241788 2023-10-05T11:35:10.521 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.517+0000 7f26f5634780 1 < completed delete operation key=BTZUVE8R96XT tag=MIH981V5R59O type=del 2023-10-05T11:35:10.522 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.519+0000 7f26f5634780 1 > prepared operation key=0PWYKC7S6YJ4 tag=MRMCVQ2TTFBQ type=write size=183750 2023-10-05T11:35:10.523 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.520+0000 7f26f5634780 1 < completed part key=_multipart_0PWYKC7S6YJ4.2~NQZLK4CASQMI.0 size=272418 2023-10-05T11:35:10.525 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.522+0000 7f26f5634780 1 < completed multipart upload key=0PWYKC7S6YJ4 upload=NQZLK4CASQMI tag=BM5C0C8IK5OS type=write size=1320994 2023-10-05T11:35:10.528 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.524+0000 7f26f5634780 1 > prepared part key=_multipart_8IPCP77WVVZT.2~5MKOVAWOS0N7.0 size=361660 2023-10-05T11:35:10.528 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.524+0000 7f26f5634780 1 > prepared multipart upload key=8IPCP77WVVZT upload=5MKOVAWOS0N7 tag=83E7LMNS8LBQ type=write size=1410236 2023-10-05T11:35:10.529 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.525+0000 7f26f5634780 -1 < failed to complete operation key=4IBQJLJR7LD8 tag=VJ4LLB23D089 type=del size=873655: (22) Invalid argument 2023-10-05T11:35:10.531 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.527+0000 7f26f5634780 1 > prepared part key=_multipart_8IPCP77WVVZT.2~04NN0E46ZBM6.0 size=1048576 2023-10-05T11:35:10.532 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.528+0000 7f26f5634780 1 > prepared part key=_multipart_8IPCP77WVVZT.2~04NN0E46ZBM6.1 size=1048576 2023-10-05T11:35:10.533 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.529+0000 7f26f5634780 1 > prepared part key=_multipart_8IPCP77WVVZT.2~04NN0E46ZBM6.2 size=132017 2023-10-05T11:35:10.533 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.529+0000 7f26f5634780 1 > prepared multipart upload key=8IPCP77WVVZT upload=04NN0E46ZBM6 tag=HIF5TP063BLM type=write size=3277745 2023-10-05T11:35:10.534 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.530+0000 7f26f5634780 1 < completed delete operation key=8IPCP77WVVZT tag=KQ616GX28TL2 type=del 2023-10-05T11:35:10.535 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.532+0000 7f26f5634780 1 > prepared operation key=S3DKYDFT4IO2 tag=Y97114TPBM5Y type=del size=2252092 2023-10-05T11:35:10.536 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.533+0000 7f26f5634780 1 < completed delete operation key=PC8WTJ8AYJ24 tag=C71ANSEWIDCS type=del 2023-10-05T11:35:10.539 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.535+0000 7f26f5634780 1 > prepared operation key=W2GWVGX42QLD tag=HZ7CG5GXSZGB type=del size=363002 2023-10-05T11:35:10.540 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.537+0000 7f26f5634780 1 < completed write operation key=761J2C7GHWU5 tag=F8FY8SG2EWPZ type=write size=13842 2023-10-05T11:35:10.541 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.538+0000 7f26f5634780 1 > prepared operation key=NV4Q36UOLX8A tag=DAQ3394V15RL type=del size=1602825 2023-10-05T11:35:10.544 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.540+0000 7f26f5634780 1 < suggested update operation key=5OPHKTHXVN5U tag=9I3CW59YNYXF type=del size=345618 2023-10-05T11:35:10.546 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.543+0000 7f26f5634780 1 > prepared part key=_multipart_NV4Q36UOLX8A.2~981FRJ6SSS2O.0 size=1048576 2023-10-05T11:35:10.547 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.544+0000 7f26f5634780 1 > prepared part key=_multipart_NV4Q36UOLX8A.2~981FRJ6SSS2O.1 size=1048576 2023-10-05T11:35:10.548 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.545+0000 7f26f5634780 1 > prepared part key=_multipart_NV4Q36UOLX8A.2~981FRJ6SSS2O.2 size=52171 2023-10-05T11:35:10.548 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.545+0000 7f26f5634780 1 > prepared multipart upload key=NV4Q36UOLX8A upload=981FRJ6SSS2O tag=JZ8HUSIWYO9F type=write size=3197899 2023-10-05T11:35:10.549 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.546+0000 7f26f5634780 1 < completed part key=_multipart_0PWYKC7S6YJ4.2~HV7QLX71AP3Q.0 size=864966 2023-10-05T11:35:10.551 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.548+0000 7f26f5634780 1 < completed multipart upload key=0PWYKC7S6YJ4 upload=HV7QLX71AP3Q tag=S204HI0B3PBR type=write size=1913542 2023-10-05T11:35:10.554 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.550+0000 7f26f5634780 1 > prepared part key=_multipart_LLR5J3X15W5R.2~DXTZ721784EC.0 size=1048576 2023-10-05T11:35:10.555 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.551+0000 7f26f5634780 1 > prepared part key=_multipart_LLR5J3X15W5R.2~DXTZ721784EC.1 size=1048576 2023-10-05T11:35:10.556 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.552+0000 7f26f5634780 1 > prepared part key=_multipart_LLR5J3X15W5R.2~DXTZ721784EC.2 size=858961 2023-10-05T11:35:10.556 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.552+0000 7f26f5634780 1 > prepared multipart upload key=LLR5J3X15W5R upload=DXTZ721784EC tag=L203J9VRFRIF type=write size=4004689 2023-10-05T11:35:10.557 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.554+0000 7f26f5634780 1 < completed delete operation key=2U0NRDGDNUTA tag=GRWW0GELEPTE type=del 2023-10-05T11:35:10.558 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.555+0000 7f26f5634780 1 > prepared operation key=2U0NRDGDNUTA tag=T78HC20IVLT2 type=del size=1229329 2023-10-05T11:35:10.559 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.556+0000 7f26f5634780 1 < completed write operation key=2D4PDQQT54ZA tag=3XCDNU1LINZO type=write size=200982 2023-10-05T11:35:10.560 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.557+0000 7f26f5634780 1 > prepared operation key=QYQDXVIGZ7O8 tag=OE5L5CMQQY8A type=del size=3323948 2023-10-05T11:35:10.562 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.558+0000 7f26f5634780 1 < completed part key=_multipart_7TOP5A52M9YP.2~9SDIUPU6XCAT.0 size=1048576 2023-10-05T11:35:10.563 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.560+0000 7f26f5634780 1 < completed part key=_multipart_7TOP5A52M9YP.2~9SDIUPU6XCAT.1 size=905979 2023-10-05T11:35:10.565 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.562+0000 7f26f5634780 1 < completed multipart upload key=7TOP5A52M9YP upload=9SDIUPU6XCAT tag=CW4GLTFIPUPM type=write size=3003131 2023-10-05T11:35:10.566 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.563+0000 7f26f5634780 1 > prepared operation key=S3DKYDFT4IO2 tag=XDOFTQ17EDHK type=del size=117920 2023-10-05T11:35:10.568 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.564+0000 7f26f5634780 1 < completed delete operation key=BTZUVE8R96XT tag=PBQ7YC0Z7O1V type=del 2023-10-05T11:35:10.569 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.565+0000 7f26f5634780 1 > prepared operation key=761J2C7GHWU5 tag=U6L5HDVWLBAF type=del size=1798744 2023-10-05T11:35:10.570 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.567+0000 7f26f5634780 1 < completed delete operation key=PC8WTJ8AYJ24 tag=2XQ763R3A1R9 type=del 2023-10-05T11:35:10.571 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.568+0000 7f26f5634780 1 > prepared operation key=VJTFYDETLSFD tag=B8Y6YJXUICO4 type=write size=173117 2023-10-05T11:35:10.573 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.569+0000 7f26f5634780 1 < completed part key=_multipart_WTCWG1C1SF89.2~20PCLS49F9RI.0 size=1048576 2023-10-05T11:35:10.573 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.570+0000 7f26f5634780 1 < completed part key=_multipart_WTCWG1C1SF89.2~20PCLS49F9RI.1 size=1048576 2023-10-05T11:35:10.575 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.571+0000 7f26f5634780 1 < completed part key=_multipart_WTCWG1C1SF89.2~20PCLS49F9RI.2 size=314191 2023-10-05T11:35:10.577 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.573+0000 7f26f5634780 1 < completed multipart upload key=WTCWG1C1SF89 upload=20PCLS49F9RI tag=86PKC312W43Z type=write size=3459919 2023-10-05T11:35:10.579 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.575+0000 7f26f5634780 1 > prepared part key=_multipart_W2GWVGX42QLD.2~Y4C1HF2METR9.0 size=1048576 2023-10-05T11:35:10.581 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.576+0000 7f26f5634780 1 > prepared part key=_multipart_W2GWVGX42QLD.2~Y4C1HF2METR9.1 size=1048576 2023-10-05T11:35:10.581 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.577+0000 7f26f5634780 1 > prepared part key=_multipart_W2GWVGX42QLD.2~Y4C1HF2METR9.2 size=963461 2023-10-05T11:35:10.582 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.577+0000 7f26f5634780 1 > prepared multipart upload key=W2GWVGX42QLD upload=Y4C1HF2METR9 tag=NWA91QL4I3AE type=write size=4109189 2023-10-05T11:35:10.582 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.578+0000 7f26f5634780 1 < completed part key=_multipart_PNV0Q6ZPLYV0.2~CUXU34NUEPIH.0 size=1048576 2023-10-05T11:35:10.583 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.579+0000 7f26f5634780 1 < completed part key=_multipart_PNV0Q6ZPLYV0.2~CUXU34NUEPIH.1 size=793328 2023-10-05T11:35:10.585 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.582+0000 7f26f5634780 1 < completed multipart upload key=PNV0Q6ZPLYV0 upload=CUXU34NUEPIH tag=4EHPAIJ1VAFR type=write size=2890480 2023-10-05T11:35:10.586 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.583+0000 7f26f5634780 1 > prepared operation key=5OPHKTHXVN5U tag=ZJUAYA2UA5E7 type=del size=1837895 2023-10-05T11:35:10.589 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.585+0000 7f26f5634780 1 < suggested remove operation key=4D3H60UTIXH3 tag=EM35OVRU5DI7 type=del 2023-10-05T11:35:10.591 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.588+0000 7f26f5634780 1 > prepared part key=_multipart_PNV0Q6ZPLYV0.2~W0G1CSF9TVA9.0 size=1048576 2023-10-05T11:35:10.592 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.589+0000 7f26f5634780 1 > prepared part key=_multipart_PNV0Q6ZPLYV0.2~W0G1CSF9TVA9.1 size=1048576 2023-10-05T11:35:10.593 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.590+0000 7f26f5634780 1 > prepared part key=_multipart_PNV0Q6ZPLYV0.2~W0G1CSF9TVA9.2 size=845551 2023-10-05T11:35:10.593 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.590+0000 7f26f5634780 1 > prepared multipart upload key=PNV0Q6ZPLYV0 upload=W0G1CSF9TVA9 tag=DGQIPFVSVFDN type=write size=3991279 2023-10-05T11:35:10.596 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.592+0000 7f26f5634780 1 < suggested remove operation key=0PWYKC7S6YJ4 tag=MRMCVQ2TTFBQ type=write 2023-10-05T11:35:10.598 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.595+0000 7f26f5634780 1 > prepared part key=_multipart_761J2C7GHWU5.2~NMOXFFX48KQ4.0 size=1048576 2023-10-05T11:35:10.599 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.596+0000 7f26f5634780 1 > prepared part key=_multipart_761J2C7GHWU5.2~NMOXFFX48KQ4.1 size=1048576 2023-10-05T11:35:10.600 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.597+0000 7f26f5634780 1 > prepared part key=_multipart_761J2C7GHWU5.2~NMOXFFX48KQ4.2 size=708161 2023-10-05T11:35:10.600 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.597+0000 7f26f5634780 1 > prepared multipart upload key=761J2C7GHWU5 upload=NMOXFFX48KQ4 tag=XWP6EETPMB9Z type=write size=3853889 2023-10-05T11:35:10.602 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.598+0000 7f26f5634780 1 < completed part key=_multipart_8IPCP77WVVZT.2~5MKOVAWOS0N7.0 size=361660 2023-10-05T11:35:10.604 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.600+0000 7f26f5634780 1 < completed multipart upload key=8IPCP77WVVZT upload=5MKOVAWOS0N7 tag=83E7LMNS8LBQ type=write size=1410236 2023-10-05T11:35:10.606 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.603+0000 7f26f5634780 1 > prepared part key=_multipart_NV4Q36UOLX8A.2~3PIJH1N2P1FB.0 size=1048576 2023-10-05T11:35:10.607 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.604+0000 7f26f5634780 1 > prepared part key=_multipart_NV4Q36UOLX8A.2~3PIJH1N2P1FB.1 size=1048576 2023-10-05T11:35:10.608 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.605+0000 7f26f5634780 1 > prepared part key=_multipart_NV4Q36UOLX8A.2~3PIJH1N2P1FB.2 size=531499 2023-10-05T11:35:10.608 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.605+0000 7f26f5634780 1 > prepared multipart upload key=NV4Q36UOLX8A upload=3PIJH1N2P1FB tag=1DO9PSP8HG3J type=write size=3677227 2023-10-05T11:35:10.609 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.606+0000 7f26f5634780 1 < completed part key=_multipart_8IPCP77WVVZT.2~04NN0E46ZBM6.0 size=1048576 2023-10-05T11:35:10.610 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.606+0000 7f26f5634780 1 < canceled part key=_multipart_8IPCP77WVVZT.2~04NN0E46ZBM6.1 size=1048576 2023-10-05T11:35:10.610 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.606+0000 7f26f5634780 1 < canceled part key=_multipart_8IPCP77WVVZT.2~04NN0E46ZBM6.2 size=132017 2023-10-05T11:35:10.612 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.608+0000 7f26f5634780 1 < canceled multipart upload key=8IPCP77WVVZT upload=04NN0E46ZBM6 tag=HIF5TP063BLM type=write size=3277745 2023-10-05T11:35:10.613 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.609+0000 7f26f5634780 1 > prepared operation key=W2GWVGX42QLD tag=GX2HN0N3OY1O type=write size=947521 2023-10-05T11:35:10.614 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.611+0000 7f26f5634780 1 < completed delete operation key=S3DKYDFT4IO2 tag=Y97114TPBM5Y type=del 2023-10-05T11:35:10.616 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.613+0000 7f26f5634780 1 > prepared part key=_multipart_PC8WTJ8AYJ24.2~NVADTVOY96UC.0 size=1048576 2023-10-05T11:35:10.618 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.614+0000 7f26f5634780 1 > prepared part key=_multipart_PC8WTJ8AYJ24.2~NVADTVOY96UC.1 size=75976 2023-10-05T11:35:10.618 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.614+0000 7f26f5634780 1 > prepared multipart upload key=PC8WTJ8AYJ24 upload=NVADTVOY96UC tag=QUDPVTX0B3YT type=write size=2173128 2023-10-05T11:35:10.620 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.616+0000 7f26f5634780 1 < completed delete operation key=W2GWVGX42QLD tag=HZ7CG5GXSZGB type=del 2023-10-05T11:35:10.623 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.620+0000 7f26f5634780 1 > prepared part key=_multipart_PNV0Q6ZPLYV0.2~A2YYB2WI4892.0 size=1048576 2023-10-05T11:35:10.625 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.622+0000 7f26f5634780 1 > prepared part key=_multipart_PNV0Q6ZPLYV0.2~A2YYB2WI4892.1 size=73995 2023-10-05T11:35:10.625 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.622+0000 7f26f5634780 1 > prepared multipart upload key=PNV0Q6ZPLYV0 upload=A2YYB2WI4892 tag=FWFNEQU7WCQH type=write size=2171147 2023-10-05T11:35:10.626 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.623+0000 7f26f5634780 1 < canceled operation key=NV4Q36UOLX8A tag=DAQ3394V15RL type=del size=1602825 2023-10-05T11:35:10.629 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.625+0000 7f26f5634780 1 > prepared part key=_multipart_7TOP5A52M9YP.2~E44HGSYJ2IRC.0 size=1048576 2023-10-05T11:35:10.629 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.626+0000 7f26f5634780 1 > prepared part key=_multipart_7TOP5A52M9YP.2~E44HGSYJ2IRC.1 size=1048576 2023-10-05T11:35:10.630 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.627+0000 7f26f5634780 1 > prepared part key=_multipart_7TOP5A52M9YP.2~E44HGSYJ2IRC.2 size=343569 2023-10-05T11:35:10.631 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.627+0000 7f26f5634780 1 > prepared multipart upload key=7TOP5A52M9YP upload=E44HGSYJ2IRC tag=SHOB5ULYPMRU type=write size=3489297 2023-10-05T11:35:10.632 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.628+0000 7f26f5634780 1 < completed part key=_multipart_NV4Q36UOLX8A.2~981FRJ6SSS2O.0 size=1048576 2023-10-05T11:35:10.633 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.629+0000 7f26f5634780 1 < completed part key=_multipart_NV4Q36UOLX8A.2~981FRJ6SSS2O.1 size=1048576 2023-10-05T11:35:10.634 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.630+0000 7f26f5634780 1 < completed part key=_multipart_NV4Q36UOLX8A.2~981FRJ6SSS2O.2 size=52171 2023-10-05T11:35:10.636 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.632+0000 7f26f5634780 1 < completed multipart upload key=NV4Q36UOLX8A upload=981FRJ6SSS2O tag=JZ8HUSIWYO9F type=write size=3197899 2023-10-05T11:35:10.637 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.633+0000 7f26f5634780 1 > prepared operation key=W2GWVGX42QLD tag=279A8GHJVD1F type=del size=2143815 2023-10-05T11:35:10.638 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.635+0000 7f26f5634780 1 < completed part key=_multipart_LLR5J3X15W5R.2~DXTZ721784EC.0 size=1048576 2023-10-05T11:35:10.639 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.636+0000 7f26f5634780 1 < completed part key=_multipart_LLR5J3X15W5R.2~DXTZ721784EC.1 size=1048576 2023-10-05T11:35:10.640 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.637+0000 7f26f5634780 1 < completed part key=_multipart_LLR5J3X15W5R.2~DXTZ721784EC.2 size=858961 2023-10-05T11:35:10.642 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.639+0000 7f26f5634780 1 < completed multipart upload key=LLR5J3X15W5R upload=DXTZ721784EC tag=L203J9VRFRIF type=write size=4004689 2023-10-05T11:35:10.643 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.640+0000 7f26f5634780 1 > prepared operation key=WYN9BG66LA3K tag=PCFBHLMA0FPU type=del size=3201141 2023-10-05T11:35:10.645 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.642+0000 7f26f5634780 1 < suggested remove operation key=2U0NRDGDNUTA tag=T78HC20IVLT2 type=del 2023-10-05T11:35:10.647 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.643+0000 7f26f5634780 1 > prepared operation key=761J2C7GHWU5 tag=Q09WI1ST13CF type=write size=992900 2023-10-05T11:35:10.648 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.644+0000 7f26f5634780 1 < completed delete operation key=QYQDXVIGZ7O8 tag=OE5L5CMQQY8A type=del 2023-10-05T11:35:10.650 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.646+0000 7f26f5634780 1 > prepared part key=_multipart_8IPCP77WVVZT.2~H779N1Z2FS66.0 size=736955 2023-10-05T11:35:10.650 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.646+0000 7f26f5634780 1 > prepared multipart upload key=8IPCP77WVVZT upload=H779N1Z2FS66 tag=U1MC2D9KWSCB type=write size=1785531 2023-10-05T11:35:10.651 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.648+0000 7f26f5634780 1 < completed delete operation key=S3DKYDFT4IO2 tag=XDOFTQ17EDHK type=del 2023-10-05T11:35:10.654 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.650+0000 7f26f5634780 1 > prepared part key=_multipart_U6172JUYW7J6.2~LBKQFKRNE1M6.0 size=1048576 2023-10-05T11:35:10.654 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.651+0000 7f26f5634780 1 > prepared part key=_multipart_U6172JUYW7J6.2~LBKQFKRNE1M6.1 size=294364 2023-10-05T11:35:10.654 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.651+0000 7f26f5634780 1 > prepared multipart upload key=U6172JUYW7J6 upload=LBKQFKRNE1M6 tag=MO8FGRZSAELY type=write size=2391516 2023-10-05T11:35:10.656 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.652+0000 7f26f5634780 1 < completed delete operation key=761J2C7GHWU5 tag=U6L5HDVWLBAF type=del 2023-10-05T11:35:10.657 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.653+0000 7f26f5634780 1 > prepared operation key=IKCNZOTVWOC6 tag=VKM0XGVJ9N0M type=del size=3509264 2023-10-05T11:35:10.658 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.655+0000 7f26f5634780 1 < completed write operation key=VJTFYDETLSFD tag=B8Y6YJXUICO4 type=write size=173117 2023-10-05T11:35:10.659 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.656+0000 7f26f5634780 1 > prepared operation key=IKCNZOTVWOC6 tag=AHT1CE0LI8JG type=del size=2178946 2023-10-05T11:35:10.661 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.657+0000 7f26f5634780 1 < completed part key=_multipart_W2GWVGX42QLD.2~Y4C1HF2METR9.0 size=1048576 2023-10-05T11:35:10.662 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.658+0000 7f26f5634780 1 < completed part key=_multipart_W2GWVGX42QLD.2~Y4C1HF2METR9.1 size=1048576 2023-10-05T11:35:10.663 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.659+0000 7f26f5634780 1 < completed part key=_multipart_W2GWVGX42QLD.2~Y4C1HF2METR9.2 size=963461 2023-10-05T11:35:10.665 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.661+0000 7f26f5634780 1 < completed multipart upload key=W2GWVGX42QLD upload=Y4C1HF2METR9 tag=NWA91QL4I3AE type=write size=4109189 2023-10-05T11:35:10.666 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.663+0000 7f26f5634780 1 > prepared operation key=WTCWG1C1SF89 tag=BM17ZXCLVWA9 type=del size=2249497 2023-10-05T11:35:10.667 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.664+0000 7f26f5634780 1 < completed delete operation key=5OPHKTHXVN5U tag=ZJUAYA2UA5E7 type=del 2023-10-05T11:35:10.669 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.665+0000 7f26f5634780 1 > prepared operation key=PC8WTJ8AYJ24 tag=WIYVJT8J317Y type=del size=2736551 2023-10-05T11:35:10.670 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.667+0000 7f26f5634780 1 < completed part key=_multipart_PNV0Q6ZPLYV0.2~W0G1CSF9TVA9.0 size=1048576 2023-10-05T11:35:10.671 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.668+0000 7f26f5634780 1 < completed part key=_multipart_PNV0Q6ZPLYV0.2~W0G1CSF9TVA9.1 size=1048576 2023-10-05T11:35:10.672 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.669+0000 7f26f5634780 1 < completed part key=_multipart_PNV0Q6ZPLYV0.2~W0G1CSF9TVA9.2 size=845551 2023-10-05T11:35:10.674 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.671+0000 7f26f5634780 1 < completed multipart upload key=PNV0Q6ZPLYV0 upload=W0G1CSF9TVA9 tag=DGQIPFVSVFDN type=write size=3991279 2023-10-05T11:35:10.676 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.673+0000 7f26f5634780 1 > prepared part key=_multipart_AV0XKXX1IR4B.2~825VU8X893M7.0 size=1048576 2023-10-05T11:35:10.677 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.674+0000 7f26f5634780 1 > prepared part key=_multipart_AV0XKXX1IR4B.2~825VU8X893M7.1 size=634989 2023-10-05T11:35:10.678 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.674+0000 7f26f5634780 1 > prepared multipart upload key=AV0XKXX1IR4B upload=825VU8X893M7 tag=6L91QT14D0M0 type=write size=2732141 2023-10-05T11:35:10.679 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.675+0000 7f26f5634780 1 < completed part key=_multipart_761J2C7GHWU5.2~NMOXFFX48KQ4.0 size=1048576 2023-10-05T11:35:10.680 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.676+0000 7f26f5634780 1 < completed part key=_multipart_761J2C7GHWU5.2~NMOXFFX48KQ4.1 size=1048576 2023-10-05T11:35:10.681 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.677+0000 7f26f5634780 1 < completed part key=_multipart_761J2C7GHWU5.2~NMOXFFX48KQ4.2 size=708161 2023-10-05T11:35:10.683 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.679+0000 7f26f5634780 1 < completed multipart upload key=761J2C7GHWU5 upload=NMOXFFX48KQ4 tag=XWP6EETPMB9Z type=write size=3853889 2023-10-05T11:35:10.684 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.680+0000 7f26f5634780 1 > prepared operation key=W2GWVGX42QLD tag=VRW7Y942V1GW type=del size=3291405 2023-10-05T11:35:10.685 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.682+0000 7f26f5634780 1 < completed part key=_multipart_NV4Q36UOLX8A.2~3PIJH1N2P1FB.0 size=1048576 2023-10-05T11:35:10.686 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.683+0000 7f26f5634780 1 < completed part key=_multipart_NV4Q36UOLX8A.2~3PIJH1N2P1FB.1 size=1048576 2023-10-05T11:35:10.687 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.684+0000 7f26f5634780 1 < completed part key=_multipart_NV4Q36UOLX8A.2~3PIJH1N2P1FB.2 size=531499 2023-10-05T11:35:10.689 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.686+0000 7f26f5634780 1 < completed multipart upload key=NV4Q36UOLX8A upload=3PIJH1N2P1FB tag=1DO9PSP8HG3J type=write size=3677227 2023-10-05T11:35:10.691 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.688+0000 7f26f5634780 1 > prepared part key=_multipart_PC8WTJ8AYJ24.2~3IWL520WM6C1.0 size=577588 2023-10-05T11:35:10.692 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.688+0000 7f26f5634780 1 > prepared multipart upload key=PC8WTJ8AYJ24 upload=3IWL520WM6C1 tag=FMLLOIEM5W7J type=write size=1626164 2023-10-05T11:35:10.692 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.689+0000 7f26f5634780 1 < completed write operation key=W2GWVGX42QLD tag=GX2HN0N3OY1O type=write size=947521 2023-10-05T11:35:10.694 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.690+0000 7f26f5634780 1 > prepared operation key=AV0XKXX1IR4B tag=IRYAP5L04EUU type=del size=75580 2023-10-05T11:35:10.695 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.691+0000 7f26f5634780 1 < completed part key=_multipart_PC8WTJ8AYJ24.2~NVADTVOY96UC.0 size=1048576 2023-10-05T11:35:10.696 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.692+0000 7f26f5634780 1 < completed part key=_multipart_PC8WTJ8AYJ24.2~NVADTVOY96UC.1 size=75976 2023-10-05T11:35:10.698 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.694+0000 7f26f5634780 1 < completed multipart upload key=PC8WTJ8AYJ24 upload=NVADTVOY96UC tag=QUDPVTX0B3YT type=write size=2173128 2023-10-05T11:35:10.699 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.695+0000 7f26f5634780 1 > prepared operation key=2U0NRDGDNUTA tag=3IK008YAZJTG type=del size=481009 2023-10-05T11:35:10.700 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.697+0000 7f26f5634780 1 < completed part key=_multipart_PNV0Q6ZPLYV0.2~A2YYB2WI4892.0 size=1048576 2023-10-05T11:35:10.701 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.698+0000 7f26f5634780 1 < completed part key=_multipart_PNV0Q6ZPLYV0.2~A2YYB2WI4892.1 size=73995 2023-10-05T11:35:10.703 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.700+0000 7f26f5634780 1 < completed multipart upload key=PNV0Q6ZPLYV0 upload=A2YYB2WI4892 tag=FWFNEQU7WCQH type=write size=2171147 2023-10-05T11:35:10.704 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.701+0000 7f26f5634780 1 > prepared operation key=IC7T3ZK81WQS tag=ZGD34F69IOEU type=write size=289030 2023-10-05T11:35:10.705 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.702+0000 7f26f5634780 1 < completed part key=_multipart_7TOP5A52M9YP.2~E44HGSYJ2IRC.0 size=1048576 2023-10-05T11:35:10.706 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.703+0000 7f26f5634780 1 < completed part key=_multipart_7TOP5A52M9YP.2~E44HGSYJ2IRC.1 size=1048576 2023-10-05T11:35:10.707 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.704+0000 7f26f5634780 1 < completed part key=_multipart_7TOP5A52M9YP.2~E44HGSYJ2IRC.2 size=343569 2023-10-05T11:35:10.709 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.706+0000 7f26f5634780 1 < completed multipart upload key=7TOP5A52M9YP upload=E44HGSYJ2IRC tag=SHOB5ULYPMRU type=write size=3489297 2023-10-05T11:35:10.711 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.708+0000 7f26f5634780 1 > prepared part key=_multipart_7TOP5A52M9YP.2~4MNPAA8LFI1N.0 size=1048576 2023-10-05T11:35:10.712 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.709+0000 7f26f5634780 1 > prepared part key=_multipart_7TOP5A52M9YP.2~4MNPAA8LFI1N.1 size=642075 2023-10-05T11:35:10.712 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.709+0000 7f26f5634780 1 > prepared multipart upload key=7TOP5A52M9YP upload=4MNPAA8LFI1N tag=0BPI2LGHDUAY type=write size=2739227 2023-10-05T11:35:10.713 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.710+0000 7f26f5634780 1 < completed delete operation key=W2GWVGX42QLD tag=279A8GHJVD1F type=del 2023-10-05T11:35:10.716 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.712+0000 7f26f5634780 1 > prepared part key=_multipart_NV4Q36UOLX8A.2~810AV8WZ99IM.0 size=621151 2023-10-05T11:35:10.716 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.712+0000 7f26f5634780 1 > prepared multipart upload key=NV4Q36UOLX8A upload=810AV8WZ99IM tag=1F8MERC7N9Y1 type=write size=1669727 2023-10-05T11:35:10.717 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.714+0000 7f26f5634780 1 < completed delete operation key=WYN9BG66LA3K tag=PCFBHLMA0FPU type=del 2023-10-05T11:35:10.719 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.716+0000 7f26f5634780 1 > prepared part key=_multipart_BU3KSHTINB36.2~FGXMT0ER4VAW.0 size=568164 2023-10-05T11:35:10.719 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.716+0000 7f26f5634780 1 > prepared multipart upload key=BU3KSHTINB36 upload=FGXMT0ER4VAW tag=O0GAF1HMELDE type=write size=1616740 2023-10-05T11:35:10.720 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.717+0000 7f26f5634780 1 < completed write operation key=761J2C7GHWU5 tag=Q09WI1ST13CF type=write size=992900 2023-10-05T11:35:10.721 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.718+0000 7f26f5634780 1 > prepared operation key=8IPCP77WVVZT tag=PNQR7FTI09U1 type=del size=3945706 2023-10-05T11:35:10.723 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.719+0000 7f26f5634780 1 < completed part key=_multipart_8IPCP77WVVZT.2~H779N1Z2FS66.0 size=736955 2023-10-05T11:35:10.725 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.721+0000 7f26f5634780 1 < completed multipart upload key=8IPCP77WVVZT upload=H779N1Z2FS66 tag=U1MC2D9KWSCB type=write size=1785531 2023-10-05T11:35:10.727 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.724+0000 7f26f5634780 1 > prepared part key=_multipart_VJTFYDETLSFD.2~L8GI80JRYJCK.0 size=1048576 2023-10-05T11:35:10.728 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.725+0000 7f26f5634780 1 > prepared part key=_multipart_VJTFYDETLSFD.2~L8GI80JRYJCK.1 size=426854 2023-10-05T11:35:10.728 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.725+0000 7f26f5634780 1 > prepared multipart upload key=VJTFYDETLSFD upload=L8GI80JRYJCK tag=R8X1BWIGSBEL type=write size=2524006 2023-10-05T11:35:10.729 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.726+0000 7f26f5634780 1 < completed part key=_multipart_U6172JUYW7J6.2~LBKQFKRNE1M6.0 size=1048576 2023-10-05T11:35:10.730 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.727+0000 7f26f5634780 1 < completed part key=_multipart_U6172JUYW7J6.2~LBKQFKRNE1M6.1 size=294364 2023-10-05T11:35:10.733 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.730+0000 7f26f5634780 1 < completed multipart upload key=U6172JUYW7J6 upload=LBKQFKRNE1M6 tag=MO8FGRZSAELY type=write size=2391516 2023-10-05T11:35:10.735 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.732+0000 7f26f5634780 1 > prepared part key=_multipart_BU3KSHTINB36.2~E84KIVFFG8X6.0 size=1048576 2023-10-05T11:35:10.736 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.733+0000 7f26f5634780 1 > prepared part key=_multipart_BU3KSHTINB36.2~E84KIVFFG8X6.1 size=1048576 2023-10-05T11:35:10.737 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.734+0000 7f26f5634780 1 > prepared part key=_multipart_BU3KSHTINB36.2~E84KIVFFG8X6.2 size=57903 2023-10-05T11:35:10.737 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.734+0000 7f26f5634780 1 > prepared multipart upload key=BU3KSHTINB36 upload=E84KIVFFG8X6 tag=51RUFZCH0SN8 type=write size=3203631 2023-10-05T11:35:10.740 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.736+0000 7f26f5634780 1 < suggested update operation key=IKCNZOTVWOC6 tag=VKM0XGVJ9N0M type=del size=3509264 2023-10-05T11:35:10.741 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.737+0000 7f26f5634780 1 > prepared operation key=WTCWG1C1SF89 tag=TKKUGJS56WLJ type=write size=641800 2023-10-05T11:35:10.742 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.738+0000 7f26f5634780 -1 < failed to complete operation key=IKCNZOTVWOC6 tag=AHT1CE0LI8JG type=del size=2178946: (22) Invalid argument 2023-10-05T11:35:10.744 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.741+0000 7f26f5634780 1 > prepared part key=_multipart_761J2C7GHWU5.2~HNXFXVOLZ9LF.0 size=848798 2023-10-05T11:35:10.744 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.741+0000 7f26f5634780 1 > prepared multipart upload key=761J2C7GHWU5 upload=HNXFXVOLZ9LF tag=B4YYZD1NIXG2 type=write size=1897374 2023-10-05T11:35:10.746 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.743+0000 7f26f5634780 1 < suggested update operation key=WTCWG1C1SF89 tag=BM17ZXCLVWA9 type=del size=2249497 2023-10-05T11:35:10.750 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.747+0000 7f26f5634780 1 > prepared part key=_multipart_VJTFYDETLSFD.2~E2PZL51OTP4P.0 size=52054 2023-10-05T11:35:10.750 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.747+0000 7f26f5634780 1 > prepared multipart upload key=VJTFYDETLSFD upload=E2PZL51OTP4P tag=NYKNH8UPYUG2 type=write size=1100630 2023-10-05T11:35:10.751 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.748+0000 7f26f5634780 1 < completed delete operation key=PC8WTJ8AYJ24 tag=WIYVJT8J317Y type=del 2023-10-05T11:35:10.753 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.750+0000 7f26f5634780 1 > prepared part key=_multipart_WYN9BG66LA3K.2~P1LU7U0BGGII.0 size=177853 2023-10-05T11:35:10.754 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.750+0000 7f26f5634780 1 > prepared multipart upload key=WYN9BG66LA3K upload=P1LU7U0BGGII tag=L3K230ZF3H14 type=write size=1226429 2023-10-05T11:35:10.755 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.751+0000 7f26f5634780 1 < completed part key=_multipart_AV0XKXX1IR4B.2~825VU8X893M7.0 size=1048576 2023-10-05T11:35:10.756 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.752+0000 7f26f5634780 1 < completed part key=_multipart_AV0XKXX1IR4B.2~825VU8X893M7.1 size=634989 2023-10-05T11:35:10.758 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.754+0000 7f26f5634780 1 < completed multipart upload key=AV0XKXX1IR4B upload=825VU8X893M7 tag=6L91QT14D0M0 type=write size=2732141 2023-10-05T11:35:10.760 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.757+0000 7f26f5634780 1 > prepared part key=_multipart_2U0NRDGDNUTA.2~TXNMFPZ9CAD9.0 size=320561 2023-10-05T11:35:10.760 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.757+0000 7f26f5634780 1 > prepared multipart upload key=2U0NRDGDNUTA upload=TXNMFPZ9CAD9 tag=OQE7DCJH0T1F type=write size=1369137 2023-10-05T11:35:10.761 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.758+0000 7f26f5634780 1 < completed delete operation key=W2GWVGX42QLD tag=VRW7Y942V1GW type=del 2023-10-05T11:35:10.764 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.760+0000 7f26f5634780 1 > prepared part key=_multipart_2U0NRDGDNUTA.2~G7GY01M5XKRR.0 size=1048576 2023-10-05T11:35:10.765 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.761+0000 7f26f5634780 1 > prepared part key=_multipart_2U0NRDGDNUTA.2~G7GY01M5XKRR.1 size=1048576 2023-10-05T11:35:10.766 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.762+0000 7f26f5634780 1 > prepared part key=_multipart_2U0NRDGDNUTA.2~G7GY01M5XKRR.2 size=821678 2023-10-05T11:35:10.766 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.762+0000 7f26f5634780 1 > prepared multipart upload key=2U0NRDGDNUTA upload=G7GY01M5XKRR tag=KB71BAJVDJKH type=write size=3967406 2023-10-05T11:35:10.767 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.763+0000 7f26f5634780 1 < completed part key=_multipart_PC8WTJ8AYJ24.2~3IWL520WM6C1.0 size=577588 2023-10-05T11:35:10.769 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.766+0000 7f26f5634780 1 < completed multipart upload key=PC8WTJ8AYJ24 upload=3IWL520WM6C1 tag=FMLLOIEM5W7J type=write size=1626164 2023-10-05T11:35:10.771 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.768+0000 7f26f5634780 1 > prepared part key=_multipart_IC7T3ZK81WQS.2~TGCJBWQQ5END.0 size=195 2023-10-05T11:35:10.771 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.768+0000 7f26f5634780 1 > prepared multipart upload key=IC7T3ZK81WQS upload=TGCJBWQQ5END tag=AUOD0JFT7U60 type=write size=1048771 2023-10-05T11:35:10.773 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.769+0000 7f26f5634780 1 < completed delete operation key=AV0XKXX1IR4B tag=IRYAP5L04EUU type=del 2023-10-05T11:35:10.775 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.771+0000 7f26f5634780 1 > prepared part key=_multipart_8IPCP77WVVZT.2~GZIAUZJDSG4I.0 size=1048576 2023-10-05T11:35:10.776 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.772+0000 7f26f5634780 1 > prepared part key=_multipart_8IPCP77WVVZT.2~GZIAUZJDSG4I.1 size=933834 2023-10-05T11:35:10.776 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.772+0000 7f26f5634780 1 > prepared multipart upload key=8IPCP77WVVZT upload=GZIAUZJDSG4I tag=9X888C03SRXD type=write size=3030986 2023-10-05T11:35:10.777 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.773+0000 7f26f5634780 1 < completed delete operation key=2U0NRDGDNUTA tag=3IK008YAZJTG type=del 2023-10-05T11:35:10.778 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.775+0000 7f26f5634780 1 > prepared operation key=2D4PDQQT54ZA tag=8274OCBWDL2P type=write size=494485 2023-10-05T11:35:10.781 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.777+0000 7f26f5634780 1 < completed write operation key=IC7T3ZK81WQS tag=ZGD34F69IOEU type=write size=289030 2023-10-05T11:35:10.782 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.779+0000 7f26f5634780 1 > prepared operation key=WTCWG1C1SF89 tag=YE1NKAAJ78I1 type=del size=164629 2023-10-05T11:35:10.783 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.780+0000 7f26f5634780 1 < completed part key=_multipart_7TOP5A52M9YP.2~4MNPAA8LFI1N.0 size=1048576 2023-10-05T11:35:10.784 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.781+0000 7f26f5634780 1 < completed part key=_multipart_7TOP5A52M9YP.2~4MNPAA8LFI1N.1 size=642075 2023-10-05T11:35:10.786 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.783+0000 7f26f5634780 1 < completed multipart upload key=7TOP5A52M9YP upload=4MNPAA8LFI1N tag=0BPI2LGHDUAY type=write size=2739227 2023-10-05T11:35:10.789 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.785+0000 7f26f5634780 1 > prepared part key=_multipart_MEY4SZRHU9NZ.2~X3V0IO433B9M.0 size=146044 2023-10-05T11:35:10.789 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.785+0000 7f26f5634780 1 > prepared multipart upload key=MEY4SZRHU9NZ upload=X3V0IO433B9M tag=BW38B7H6JR6C type=write size=1194620 2023-10-05T11:35:10.789 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.786+0000 7f26f5634780 1 < completed part key=_multipart_NV4Q36UOLX8A.2~810AV8WZ99IM.0 size=621151 2023-10-05T11:35:10.791 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.788+0000 7f26f5634780 1 < completed multipart upload key=NV4Q36UOLX8A upload=810AV8WZ99IM tag=1F8MERC7N9Y1 type=write size=1669727 2023-10-05T11:35:10.793 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.789+0000 7f26f5634780 1 > prepared operation key=BTZUVE8R96XT tag=HLAE9C19H0GW type=del size=3271109 2023-10-05T11:35:10.793 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.790+0000 7f26f5634780 1 < canceled part key=_multipart_BU3KSHTINB36.2~FGXMT0ER4VAW.0 size=568164 2023-10-05T11:35:10.795 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.792+0000 7f26f5634780 1 < canceled multipart upload key=BU3KSHTINB36 upload=FGXMT0ER4VAW tag=O0GAF1HMELDE type=write size=1616740 2023-10-05T11:35:10.796 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.793+0000 7f26f5634780 1 > prepared operation key=5V0Q651D4VN2 tag=33PGGBB3R973 type=del size=250985 2023-10-05T11:35:10.798 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.794+0000 7f26f5634780 1 < completed delete operation key=8IPCP77WVVZT tag=PNQR7FTI09U1 type=del 2023-10-05T11:35:10.799 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.795+0000 7f26f5634780 1 > prepared operation key=U6172JUYW7J6 tag=K7VVF0S4ZMHC type=write size=951956 2023-10-05T11:35:10.800 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.796+0000 7f26f5634780 1 < completed part key=_multipart_VJTFYDETLSFD.2~L8GI80JRYJCK.0 size=1048576 2023-10-05T11:35:10.800 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.796+0000 7f26f5634780 1 < canceled part key=_multipart_VJTFYDETLSFD.2~L8GI80JRYJCK.1 size=426854 2023-10-05T11:35:10.802 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.798+0000 7f26f5634780 1 < canceled multipart upload key=VJTFYDETLSFD upload=L8GI80JRYJCK tag=R8X1BWIGSBEL type=write size=2524006 2023-10-05T11:35:10.803 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.800+0000 7f26f5634780 1 > prepared operation key=761J2C7GHWU5 tag=YEM49XNZO83N type=del size=915593 2023-10-05T11:35:10.804 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.801+0000 7f26f5634780 1 < completed part key=_multipart_BU3KSHTINB36.2~E84KIVFFG8X6.0 size=1048576 2023-10-05T11:35:10.804 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.801+0000 7f26f5634780 1 < canceled part key=_multipart_BU3KSHTINB36.2~E84KIVFFG8X6.1 size=1048576 2023-10-05T11:35:10.805 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.802+0000 7f26f5634780 1 < completed part key=_multipart_BU3KSHTINB36.2~E84KIVFFG8X6.2 size=57903 2023-10-05T11:35:10.807 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.804+0000 7f26f5634780 1 < canceled multipart upload key=BU3KSHTINB36 upload=E84KIVFFG8X6 tag=51RUFZCH0SN8 type=write size=3203631 2023-10-05T11:35:10.808 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.805+0000 7f26f5634780 1 > prepared operation key=IC7T3ZK81WQS tag=8U2RNU4U4MW2 type=del size=134701 2023-10-05T11:35:10.809 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.806+0000 7f26f5634780 -1 < failed to complete operation key=WTCWG1C1SF89 tag=TKKUGJS56WLJ type=write size=641800: (22) Invalid argument 2023-10-05T11:35:10.812 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.808+0000 7f26f5634780 1 > prepared part key=_multipart_5V0Q651D4VN2.2~1BHYUHK03PII.0 size=1048576 2023-10-05T11:35:10.813 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.809+0000 7f26f5634780 1 > prepared part key=_multipart_5V0Q651D4VN2.2~1BHYUHK03PII.1 size=430977 2023-10-05T11:35:10.813 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.809+0000 7f26f5634780 1 > prepared multipart upload key=5V0Q651D4VN2 upload=1BHYUHK03PII tag=QE1NBTLFMEPI type=write size=2528129 2023-10-05T11:35:10.814 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.810+0000 7f26f5634780 1 < completed part key=_multipart_761J2C7GHWU5.2~HNXFXVOLZ9LF.0 size=848798 2023-10-05T11:35:10.816 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.812+0000 7f26f5634780 1 < completed multipart upload key=761J2C7GHWU5 upload=HNXFXVOLZ9LF tag=B4YYZD1NIXG2 type=write size=1897374 2023-10-05T11:35:10.817 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.814+0000 7f26f5634780 1 > prepared operation key=BTZUVE8R96XT tag=6I1VB73NUQ9O type=del size=3381545 2023-10-05T11:35:10.818 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.815+0000 7f26f5634780 1 < completed part key=_multipart_VJTFYDETLSFD.2~E2PZL51OTP4P.0 size=52054 2023-10-05T11:35:10.820 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.817+0000 7f26f5634780 1 < completed multipart upload key=VJTFYDETLSFD upload=E2PZL51OTP4P tag=NYKNH8UPYUG2 type=write size=1100630 2023-10-05T11:35:10.822 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.819+0000 7f26f5634780 1 > prepared part key=_multipart_0PWYKC7S6YJ4.2~05RU7UHJ950I.0 size=1048576 2023-10-05T11:35:10.823 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.820+0000 7f26f5634780 1 > prepared part key=_multipart_0PWYKC7S6YJ4.2~05RU7UHJ950I.1 size=1048576 2023-10-05T11:35:10.824 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.821+0000 7f26f5634780 1 > prepared part key=_multipart_0PWYKC7S6YJ4.2~05RU7UHJ950I.2 size=604302 2023-10-05T11:35:10.824 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.821+0000 7f26f5634780 1 > prepared multipart upload key=0PWYKC7S6YJ4 upload=05RU7UHJ950I tag=ZW26URQ0MIYN type=write size=3750030 2023-10-05T11:35:10.825 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.822+0000 7f26f5634780 1 < completed part key=_multipart_WYN9BG66LA3K.2~P1LU7U0BGGII.0 size=177853 2023-10-05T11:35:10.827 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.824+0000 7f26f5634780 1 < completed multipart upload key=WYN9BG66LA3K upload=P1LU7U0BGGII tag=L3K230ZF3H14 type=write size=1226429 2023-10-05T11:35:10.829 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.826+0000 7f26f5634780 1 > prepared part key=_multipart_7W9LL5HSU3BG.2~K43ZKL31GW1S.0 size=1048576 2023-10-05T11:35:10.830 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.827+0000 7f26f5634780 1 > prepared part key=_multipart_7W9LL5HSU3BG.2~K43ZKL31GW1S.1 size=359229 2023-10-05T11:35:10.830 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.827+0000 7f26f5634780 1 > prepared multipart upload key=7W9LL5HSU3BG upload=K43ZKL31GW1S tag=Z5ZOVHON96T5 type=write size=2456381 2023-10-05T11:35:10.831 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.828+0000 7f26f5634780 1 < completed part key=_multipart_2U0NRDGDNUTA.2~TXNMFPZ9CAD9.0 size=320561 2023-10-05T11:35:10.833 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.830+0000 7f26f5634780 1 < completed multipart upload key=2U0NRDGDNUTA upload=TXNMFPZ9CAD9 tag=OQE7DCJH0T1F type=write size=1369137 2023-10-05T11:35:10.835 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.831+0000 7f26f5634780 1 > prepared operation key=IKCNZOTVWOC6 tag=HBX5V1HC47QD type=del size=4148126 2023-10-05T11:35:10.836 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.832+0000 7f26f5634780 1 < completed part key=_multipart_2U0NRDGDNUTA.2~G7GY01M5XKRR.0 size=1048576 2023-10-05T11:35:10.837 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.833+0000 7f26f5634780 1 < completed part key=_multipart_2U0NRDGDNUTA.2~G7GY01M5XKRR.1 size=1048576 2023-10-05T11:35:10.838 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.834+0000 7f26f5634780 1 < completed part key=_multipart_2U0NRDGDNUTA.2~G7GY01M5XKRR.2 size=821678 2023-10-05T11:35:10.840 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.836+0000 7f26f5634780 1 < completed multipart upload key=2U0NRDGDNUTA upload=G7GY01M5XKRR tag=KB71BAJVDJKH type=write size=3967406 2023-10-05T11:35:10.841 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.838+0000 7f26f5634780 1 > prepared operation key=S3DKYDFT4IO2 tag=UY2XTZHY5CRD type=del size=477800 2023-10-05T11:35:10.842 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.839+0000 7f26f5634780 1 < completed part key=_multipart_IC7T3ZK81WQS.2~TGCJBWQQ5END.0 size=195 2023-10-05T11:35:10.845 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.842+0000 7f26f5634780 1 < completed multipart upload key=IC7T3ZK81WQS upload=TGCJBWQQ5END tag=AUOD0JFT7U60 type=write size=1048771 2023-10-05T11:35:10.846 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.843+0000 7f26f5634780 1 > prepared operation key=7TOP5A52M9YP tag=R6975PRHSBWI type=del size=2653082 2023-10-05T11:35:10.848 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.844+0000 7f26f5634780 1 < completed part key=_multipart_8IPCP77WVVZT.2~GZIAUZJDSG4I.0 size=1048576 2023-10-05T11:35:10.849 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.845+0000 7f26f5634780 1 < completed part key=_multipart_8IPCP77WVVZT.2~GZIAUZJDSG4I.1 size=933834 2023-10-05T11:35:10.851 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.847+0000 7f26f5634780 1 < completed multipart upload key=8IPCP77WVVZT upload=GZIAUZJDSG4I tag=9X888C03SRXD type=write size=3030986 2023-10-05T11:35:10.852 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.848+0000 7f26f5634780 1 > prepared operation key=2U0NRDGDNUTA tag=F55PI8LVQW00 type=del size=561116 2023-10-05T11:35:10.853 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.849+0000 7f26f5634780 1 < canceled operation key=2D4PDQQT54ZA tag=8274OCBWDL2P type=write size=494485 2023-10-05T11:35:10.854 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.851+0000 7f26f5634780 1 > prepared operation key=IKCNZOTVWOC6 tag=96FEP7ROAWK7 type=del size=1343722 2023-10-05T11:35:10.855 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.852+0000 7f26f5634780 1 < completed delete operation key=WTCWG1C1SF89 tag=YE1NKAAJ78I1 type=del 2023-10-05T11:35:10.857 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.854+0000 7f26f5634780 1 > prepared part key=_multipart_761J2C7GHWU5.2~2NVSP2F4WI0G.0 size=1048576 2023-10-05T11:35:10.859 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.855+0000 7f26f5634780 1 > prepared part key=_multipart_761J2C7GHWU5.2~2NVSP2F4WI0G.1 size=226479 2023-10-05T11:35:10.859 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.855+0000 7f26f5634780 1 > prepared multipart upload key=761J2C7GHWU5 upload=2NVSP2F4WI0G tag=XP4UBJGQF8SV type=write size=2323631 2023-10-05T11:35:10.860 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.857+0000 7f26f5634780 1 < completed part key=_multipart_MEY4SZRHU9NZ.2~X3V0IO433B9M.0 size=146044 2023-10-05T11:35:10.862 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.859+0000 7f26f5634780 1 < completed multipart upload key=MEY4SZRHU9NZ upload=X3V0IO433B9M tag=BW38B7H6JR6C type=write size=1194620 2023-10-05T11:35:10.863 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.860+0000 7f26f5634780 1 > prepared operation key=PNV0Q6ZPLYV0 tag=V8QKK4PX3PMW type=write size=259744 2023-10-05T11:35:10.864 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.861+0000 7f26f5634780 1 < completed delete operation key=BTZUVE8R96XT tag=HLAE9C19H0GW type=del 2023-10-05T11:35:10.866 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.862+0000 7f26f5634780 1 > prepared operation key=AV0XKXX1IR4B tag=Z9LBGQRSTURR type=del size=2615803 2023-10-05T11:35:10.867 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.863+0000 7f26f5634780 1 < completed delete operation key=5V0Q651D4VN2 tag=33PGGBB3R973 type=del 2023-10-05T11:35:10.869 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.866+0000 7f26f5634780 1 > prepared part key=_multipart_7W9LL5HSU3BG.2~U49LXBKSFYN9.0 size=1048576 2023-10-05T11:35:10.870 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.867+0000 7f26f5634780 1 > prepared part key=_multipart_7W9LL5HSU3BG.2~U49LXBKSFYN9.1 size=1048576 2023-10-05T11:35:10.871 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.868+0000 7f26f5634780 1 > prepared part key=_multipart_7W9LL5HSU3BG.2~U49LXBKSFYN9.2 size=802610 2023-10-05T11:35:10.871 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.868+0000 7f26f5634780 1 > prepared multipart upload key=7W9LL5HSU3BG upload=U49LXBKSFYN9 tag=V8AVCTL2AM2Q type=write size=3948338 2023-10-05T11:35:10.872 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.869+0000 7f26f5634780 1 < completed write operation key=U6172JUYW7J6 tag=K7VVF0S4ZMHC type=write size=951956 2023-10-05T11:35:10.874 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.871+0000 7f26f5634780 1 > prepared part key=_multipart_VJTFYDETLSFD.2~VL4K70P7J0W1.0 size=207724 2023-10-05T11:35:10.875 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.871+0000 7f26f5634780 1 > prepared multipart upload key=VJTFYDETLSFD upload=VL4K70P7J0W1 tag=M7OO3SGZCTK0 type=write size=1256300 2023-10-05T11:35:10.877 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.873+0000 7f26f5634780 1 < suggested remove operation key=761J2C7GHWU5 tag=YEM49XNZO83N type=del 2023-10-05T11:35:10.879 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.876+0000 7f26f5634780 1 > prepared part key=_multipart_2U0NRDGDNUTA.2~NBCMXJTAP774.0 size=247225 2023-10-05T11:35:10.879 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.876+0000 7f26f5634780 1 > prepared multipart upload key=2U0NRDGDNUTA upload=NBCMXJTAP774 tag=LZH5F4KW70TH type=write size=1295801 2023-10-05T11:35:10.882 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.878+0000 7f26f5634780 1 < suggested remove operation key=IC7T3ZK81WQS tag=8U2RNU4U4MW2 type=del 2023-10-05T11:35:10.884 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.880+0000 7f26f5634780 1 > prepared part key=_multipart_IKCNZOTVWOC6.2~TA4C19FMJV4V.0 size=510304 2023-10-05T11:35:10.884 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.880+0000 7f26f5634780 1 > prepared multipart upload key=IKCNZOTVWOC6 upload=TA4C19FMJV4V tag=G1QNHI9V7SFP type=write size=1558880 2023-10-05T11:35:10.885 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.882+0000 7f26f5634780 1 < completed part key=_multipart_5V0Q651D4VN2.2~1BHYUHK03PII.0 size=1048576 2023-10-05T11:35:10.886 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.883+0000 7f26f5634780 1 < completed part key=_multipart_5V0Q651D4VN2.2~1BHYUHK03PII.1 size=430977 2023-10-05T11:35:10.888 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.884+0000 7f26f5634780 1 < completed multipart upload key=5V0Q651D4VN2 upload=1BHYUHK03PII tag=QE1NBTLFMEPI type=write size=2528129 2023-10-05T11:35:10.890 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.887+0000 7f26f5634780 1 > prepared part key=_multipart_BTZUVE8R96XT.2~UZWJCF5ZMIIC.0 size=1048576 2023-10-05T11:35:10.891 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.888+0000 7f26f5634780 1 > prepared part key=_multipart_BTZUVE8R96XT.2~UZWJCF5ZMIIC.1 size=714030 2023-10-05T11:35:10.891 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.888+0000 7f26f5634780 1 > prepared multipart upload key=BTZUVE8R96XT upload=UZWJCF5ZMIIC tag=FP1DH80JYAT3 type=write size=2811182 2023-10-05T11:35:10.892 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.889+0000 7f26f5634780 1 < completed delete operation key=BTZUVE8R96XT tag=6I1VB73NUQ9O type=del 2023-10-05T11:35:10.894 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.891+0000 7f26f5634780 1 > prepared part key=_multipart_PC8WTJ8AYJ24.2~SQM9TYAFZGW9.0 size=849354 2023-10-05T11:35:10.894 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.891+0000 7f26f5634780 1 > prepared multipart upload key=PC8WTJ8AYJ24 upload=SQM9TYAFZGW9 tag=IJMINJUMOWEP type=write size=1897930 2023-10-05T11:35:10.896 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.892+0000 7f26f5634780 1 < completed part key=_multipart_0PWYKC7S6YJ4.2~05RU7UHJ950I.0 size=1048576 2023-10-05T11:35:10.897 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.893+0000 7f26f5634780 1 < completed part key=_multipart_0PWYKC7S6YJ4.2~05RU7UHJ950I.1 size=1048576 2023-10-05T11:35:10.897 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.894+0000 7f26f5634780 1 < completed part key=_multipart_0PWYKC7S6YJ4.2~05RU7UHJ950I.2 size=604302 2023-10-05T11:35:10.899 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.896+0000 7f26f5634780 1 < completed multipart upload key=0PWYKC7S6YJ4 upload=05RU7UHJ950I tag=ZW26URQ0MIYN type=write size=3750030 2023-10-05T11:35:10.901 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.897+0000 7f26f5634780 1 > prepared operation key=AV0XKXX1IR4B tag=9GKH3VQEXDWB type=del size=2423959 2023-10-05T11:35:10.901 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.898+0000 7f26f5634780 1 < canceled part key=_multipart_7W9LL5HSU3BG.2~K43ZKL31GW1S.0 size=1048576 2023-10-05T11:35:10.902 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.898+0000 7f26f5634780 1 < completed part key=_multipart_7W9LL5HSU3BG.2~K43ZKL31GW1S.1 size=359229 2023-10-05T11:35:10.904 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.901+0000 7f26f5634780 1 < canceled multipart upload key=7W9LL5HSU3BG upload=K43ZKL31GW1S tag=Z5ZOVHON96T5 type=write size=2456381 2023-10-05T11:35:10.906 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.903+0000 7f26f5634780 1 > prepared part key=_multipart_5OPHKTHXVN5U.2~9OGRVA0E9DJ9.0 size=1048576 2023-10-05T11:35:10.907 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.904+0000 7f26f5634780 1 > prepared part key=_multipart_5OPHKTHXVN5U.2~9OGRVA0E9DJ9.1 size=386026 2023-10-05T11:35:10.908 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.904+0000 7f26f5634780 1 > prepared multipart upload key=5OPHKTHXVN5U upload=9OGRVA0E9DJ9 tag=Q4L71QE33JDM type=write size=2483178 2023-10-05T11:35:10.909 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.905+0000 7f26f5634780 1 < completed delete operation key=IKCNZOTVWOC6 tag=HBX5V1HC47QD type=del 2023-10-05T11:35:10.911 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.908+0000 7f26f5634780 1 > prepared part key=_multipart_4D3H60UTIXH3.2~6MC98Q2STAA6.0 size=1048576 2023-10-05T11:35:10.912 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.909+0000 7f26f5634780 1 > prepared part key=_multipart_4D3H60UTIXH3.2~6MC98Q2STAA6.1 size=1048576 2023-10-05T11:35:10.913 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.910+0000 7f26f5634780 1 > prepared part key=_multipart_4D3H60UTIXH3.2~6MC98Q2STAA6.2 size=509927 2023-10-05T11:35:10.913 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.910+0000 7f26f5634780 1 > prepared multipart upload key=4D3H60UTIXH3 upload=6MC98Q2STAA6 tag=M94ACOBZY827 type=write size=3655655 2023-10-05T11:35:10.914 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.911+0000 7f26f5634780 1 < completed delete operation key=S3DKYDFT4IO2 tag=UY2XTZHY5CRD type=del 2023-10-05T11:35:10.917 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.913+0000 7f26f5634780 1 > prepared part key=_multipart_BU3KSHTINB36.2~T03F2YXN2YSX.0 size=188172 2023-10-05T11:35:10.917 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.913+0000 7f26f5634780 1 > prepared multipart upload key=BU3KSHTINB36 upload=T03F2YXN2YSX tag=RDW2ETVFE6Y7 type=write size=1236748 2023-10-05T11:35:10.918 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.915+0000 7f26f5634780 1 < canceled operation key=7TOP5A52M9YP tag=R6975PRHSBWI type=del size=2653082 2023-10-05T11:35:10.919 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.916+0000 7f26f5634780 1 > prepared operation key=5V0Q651D4VN2 tag=170UBTC8X4ZY type=del size=1787711 2023-10-05T11:35:10.921 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.917+0000 7f26f5634780 1 < completed delete operation key=2U0NRDGDNUTA tag=F55PI8LVQW00 type=del 2023-10-05T11:35:10.922 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.918+0000 7f26f5634780 1 > prepared operation key=WTCWG1C1SF89 tag=E0LVU0UYEWKX type=del size=3808879 2023-10-05T11:35:10.923 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.920+0000 7f26f5634780 1 < completed delete operation key=IKCNZOTVWOC6 tag=96FEP7ROAWK7 type=del 2023-10-05T11:35:10.924 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.921+0000 7f26f5634780 1 > prepared operation key=IC7T3ZK81WQS tag=LP2PSXBYG34Z type=write size=271712 2023-10-05T11:35:10.925 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.922+0000 7f26f5634780 1 < completed part key=_multipart_761J2C7GHWU5.2~2NVSP2F4WI0G.0 size=1048576 2023-10-05T11:35:10.926 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.923+0000 7f26f5634780 1 < completed part key=_multipart_761J2C7GHWU5.2~2NVSP2F4WI0G.1 size=226479 2023-10-05T11:35:10.928 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.925+0000 7f26f5634780 1 < completed multipart upload key=761J2C7GHWU5 upload=2NVSP2F4WI0G tag=XP4UBJGQF8SV type=write size=2323631 2023-10-05T11:35:10.930 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.926+0000 7f26f5634780 1 > prepared operation key=PC8WTJ8AYJ24 tag=U0RXVG6YN8QZ type=del size=3690612 2023-10-05T11:35:10.931 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.928+0000 7f26f5634780 1 < completed write operation key=PNV0Q6ZPLYV0 tag=V8QKK4PX3PMW type=write size=259744 2023-10-05T11:35:10.933 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.930+0000 7f26f5634780 1 > prepared part key=_multipart_8IPCP77WVVZT.2~8LVS0NJV1QGR.0 size=1048576 2023-10-05T11:35:10.934 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.931+0000 7f26f5634780 1 > prepared part key=_multipart_8IPCP77WVVZT.2~8LVS0NJV1QGR.1 size=1048576 2023-10-05T11:35:10.935 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.931+0000 7f26f5634780 1 > prepared part key=_multipart_8IPCP77WVVZT.2~8LVS0NJV1QGR.2 size=358029 2023-10-05T11:35:10.935 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.931+0000 7f26f5634780 1 > prepared multipart upload key=8IPCP77WVVZT upload=8LVS0NJV1QGR tag=P4D66QEW1PME type=write size=3503757 2023-10-05T11:35:10.936 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.933+0000 7f26f5634780 1 < completed delete operation key=AV0XKXX1IR4B tag=Z9LBGQRSTURR type=del 2023-10-05T11:35:10.937 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.934+0000 7f26f5634780 1 > prepared operation key=IKCNZOTVWOC6 tag=HUZBRB3SEBLW type=write size=857796 2023-10-05T11:35:10.939 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.935+0000 7f26f5634780 1 < completed part key=_multipart_7W9LL5HSU3BG.2~U49LXBKSFYN9.0 size=1048576 2023-10-05T11:35:10.940 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.936+0000 7f26f5634780 1 < completed part key=_multipart_7W9LL5HSU3BG.2~U49LXBKSFYN9.1 size=1048576 2023-10-05T11:35:10.941 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.937+0000 7f26f5634780 1 < completed part key=_multipart_7W9LL5HSU3BG.2~U49LXBKSFYN9.2 size=802610 2023-10-05T11:35:10.943 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.940+0000 7f26f5634780 1 < completed multipart upload key=7W9LL5HSU3BG upload=U49LXBKSFYN9 tag=V8AVCTL2AM2Q type=write size=3948338 2023-10-05T11:35:10.944 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.941+0000 7f26f5634780 1 > prepared operation key=J5EIH25Y471T tag=GFP7TBQQI2WR type=del size=3893147 2023-10-05T11:35:10.945 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.942+0000 7f26f5634780 1 < completed part key=_multipart_VJTFYDETLSFD.2~VL4K70P7J0W1.0 size=207724 2023-10-05T11:35:10.947 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.944+0000 7f26f5634780 1 < completed multipart upload key=VJTFYDETLSFD upload=VL4K70P7J0W1 tag=M7OO3SGZCTK0 type=write size=1256300 2023-10-05T11:35:10.948 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.945+0000 7f26f5634780 1 > prepared operation key=VJTFYDETLSFD tag=AC7F4XG3VD3K type=del size=2386798 2023-10-05T11:35:10.950 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.946+0000 7f26f5634780 1 < completed part key=_multipart_2U0NRDGDNUTA.2~NBCMXJTAP774.0 size=247225 2023-10-05T11:35:10.952 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.948+0000 7f26f5634780 1 < completed multipart upload key=2U0NRDGDNUTA upload=NBCMXJTAP774 tag=LZH5F4KW70TH type=write size=1295801 2023-10-05T11:35:10.954 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.951+0000 7f26f5634780 1 > prepared part key=_multipart_W2GWVGX42QLD.2~YZCR2DFCMJD0.0 size=1048576 2023-10-05T11:35:10.955 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.952+0000 7f26f5634780 1 > prepared part key=_multipart_W2GWVGX42QLD.2~YZCR2DFCMJD0.1 size=615503 2023-10-05T11:35:10.955 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.952+0000 7f26f5634780 1 > prepared multipart upload key=W2GWVGX42QLD upload=YZCR2DFCMJD0 tag=JIJX75YWP20V type=write size=2712655 2023-10-05T11:35:10.957 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.953+0000 7f26f5634780 1 < completed part key=_multipart_IKCNZOTVWOC6.2~TA4C19FMJV4V.0 size=510304 2023-10-05T11:35:10.960 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.957+0000 7f26f5634780 1 < completed multipart upload key=IKCNZOTVWOC6 upload=TA4C19FMJV4V tag=G1QNHI9V7SFP type=write size=1558880 2023-10-05T11:35:10.962 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.959+0000 7f26f5634780 1 > prepared part key=_multipart_5OPHKTHXVN5U.2~775R0MYPTCYW.0 size=1048576 2023-10-05T11:35:10.963 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.960+0000 7f26f5634780 1 > prepared part key=_multipart_5OPHKTHXVN5U.2~775R0MYPTCYW.1 size=1048576 2023-10-05T11:35:10.964 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.961+0000 7f26f5634780 1 > prepared part key=_multipart_5OPHKTHXVN5U.2~775R0MYPTCYW.2 size=148796 2023-10-05T11:35:10.964 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.961+0000 7f26f5634780 1 > prepared multipart upload key=5OPHKTHXVN5U upload=775R0MYPTCYW tag=UTJ09MFOUWH5 type=write size=3294524 2023-10-05T11:35:10.965 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.962+0000 7f26f5634780 1 < completed part key=_multipart_BTZUVE8R96XT.2~UZWJCF5ZMIIC.0 size=1048576 2023-10-05T11:35:10.966 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.963+0000 7f26f5634780 1 < completed part key=_multipart_BTZUVE8R96XT.2~UZWJCF5ZMIIC.1 size=714030 2023-10-05T11:35:10.969 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.965+0000 7f26f5634780 1 < completed multipart upload key=BTZUVE8R96XT upload=UZWJCF5ZMIIC tag=FP1DH80JYAT3 type=write size=2811182 2023-10-05T11:35:10.971 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.967+0000 7f26f5634780 1 > prepared part key=_multipart_BU3KSHTINB36.2~BITJ1865X5HU.0 size=1048576 2023-10-05T11:35:10.972 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.968+0000 7f26f5634780 1 > prepared part key=_multipart_BU3KSHTINB36.2~BITJ1865X5HU.1 size=1048576 2023-10-05T11:35:10.973 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.969+0000 7f26f5634780 1 > prepared part key=_multipart_BU3KSHTINB36.2~BITJ1865X5HU.2 size=1023100 2023-10-05T11:35:10.973 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.969+0000 7f26f5634780 1 > prepared multipart upload key=BU3KSHTINB36 upload=BITJ1865X5HU tag=Q3MOGM23WAZN type=write size=4168828 2023-10-05T11:35:10.974 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.971+0000 7f26f5634780 1 < completed part key=_multipart_PC8WTJ8AYJ24.2~SQM9TYAFZGW9.0 size=849354 2023-10-05T11:35:10.976 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.973+0000 7f26f5634780 1 < completed multipart upload key=PC8WTJ8AYJ24 upload=SQM9TYAFZGW9 tag=IJMINJUMOWEP type=write size=1897930 2023-10-05T11:35:10.978 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.974+0000 7f26f5634780 1 > prepared operation key=IC7T3ZK81WQS tag=BS15OM43DDRS type=del size=3707927 2023-10-05T11:35:10.979 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.976+0000 7f26f5634780 1 < canceled operation key=AV0XKXX1IR4B tag=9GKH3VQEXDWB type=del size=2423959 2023-10-05T11:35:10.980 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.977+0000 7f26f5634780 1 > prepared operation key=FOMNIIY47UUM tag=XGX09EY8VQ2N type=del size=3655014 2023-10-05T11:35:10.982 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.978+0000 7f26f5634780 1 < completed part key=_multipart_5OPHKTHXVN5U.2~9OGRVA0E9DJ9.0 size=1048576 2023-10-05T11:35:10.983 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.980+0000 7f26f5634780 1 < completed part key=_multipart_5OPHKTHXVN5U.2~9OGRVA0E9DJ9.1 size=386026 2023-10-05T11:35:10.985 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.982+0000 7f26f5634780 1 < completed multipart upload key=5OPHKTHXVN5U upload=9OGRVA0E9DJ9 tag=Q4L71QE33JDM type=write size=2483178 2023-10-05T11:35:10.986 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.983+0000 7f26f5634780 1 > prepared operation key=VJTFYDETLSFD tag=DUOAJFYUHC1K type=write size=1044455 2023-10-05T11:35:10.987 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.983+0000 7f26f5634780 1 < canceled part key=_multipart_4D3H60UTIXH3.2~6MC98Q2STAA6.0 size=1048576 2023-10-05T11:35:10.989 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.984+0000 7f26f5634780 1 < completed part key=_multipart_4D3H60UTIXH3.2~6MC98Q2STAA6.1 size=1048576 2023-10-05T11:35:10.989 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.985+0000 7f26f5634780 1 < completed part key=_multipart_4D3H60UTIXH3.2~6MC98Q2STAA6.2 size=509927 2023-10-05T11:35:10.991 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.987+0000 7f26f5634780 1 < canceled multipart upload key=4D3H60UTIXH3 upload=6MC98Q2STAA6 tag=M94ACOBZY827 type=write size=3655655 2023-10-05T11:35:10.992 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.989+0000 7f26f5634780 1 > prepared operation key=MEY4SZRHU9NZ tag=4DOXGH67YU1G type=del size=2624505 2023-10-05T11:35:10.993 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.990+0000 7f26f5634780 1 < completed part key=_multipart_BU3KSHTINB36.2~T03F2YXN2YSX.0 size=188172 2023-10-05T11:35:10.995 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.992+0000 7f26f5634780 1 < completed multipart upload key=BU3KSHTINB36 upload=T03F2YXN2YSX tag=RDW2ETVFE6Y7 type=write size=1236748 2023-10-05T11:35:10.996 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.993+0000 7f26f5634780 1 > prepared operation key=5V0Q651D4VN2 tag=7NSD058HKFC8 type=write size=877616 2023-10-05T11:35:10.998 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.994+0000 7f26f5634780 1 < completed delete operation key=5V0Q651D4VN2 tag=170UBTC8X4ZY type=del 2023-10-05T11:35:10.999 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.996+0000 7f26f5634780 1 > prepared operation key=VJTFYDETLSFD tag=E8WAP49KLZT8 type=del size=1526963 2023-10-05T11:35:11.000 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.997+0000 7f26f5634780 1 < completed delete operation key=WTCWG1C1SF89 tag=E0LVU0UYEWKX type=del 2023-10-05T11:35:11.002 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:10.998+0000 7f26f5634780 1 > prepared operation key=IC7T3ZK81WQS tag=SGQV97ZZGJ16 type=del size=2359295 2023-10-05T11:35:11.003 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.000+0000 7f26f5634780 1 < completed write operation key=IC7T3ZK81WQS tag=LP2PSXBYG34Z type=write size=271712 2023-10-05T11:35:11.005 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.002+0000 7f26f5634780 1 > prepared part key=_multipart_LLR5J3X15W5R.2~TA9CEVOLMUFB.0 size=1048576 2023-10-05T11:35:11.006 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.003+0000 7f26f5634780 1 > prepared part key=_multipart_LLR5J3X15W5R.2~TA9CEVOLMUFB.1 size=1048576 2023-10-05T11:35:11.007 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.004+0000 7f26f5634780 1 > prepared part key=_multipart_LLR5J3X15W5R.2~TA9CEVOLMUFB.2 size=678783 2023-10-05T11:35:11.007 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.004+0000 7f26f5634780 1 > prepared multipart upload key=LLR5J3X15W5R upload=TA9CEVOLMUFB tag=TGJ198ZT3A43 type=write size=3824511 2023-10-05T11:35:11.010 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.007+0000 7f26f5634780 1 < suggested remove operation key=PC8WTJ8AYJ24 tag=U0RXVG6YN8QZ type=del 2023-10-05T11:35:11.011 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.008+0000 7f26f5634780 1 > prepared operation key=U6172JUYW7J6 tag=DQ49AIVZUQ3N type=del size=1625900 2023-10-05T11:35:11.012 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.009+0000 7f26f5634780 1 < completed part key=_multipart_8IPCP77WVVZT.2~8LVS0NJV1QGR.0 size=1048576 2023-10-05T11:35:11.014 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.010+0000 7f26f5634780 1 < completed part key=_multipart_8IPCP77WVVZT.2~8LVS0NJV1QGR.1 size=1048576 2023-10-05T11:35:11.014 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.011+0000 7f26f5634780 1 < completed part key=_multipart_8IPCP77WVVZT.2~8LVS0NJV1QGR.2 size=358029 2023-10-05T11:35:11.017 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.013+0000 7f26f5634780 1 < completed multipart upload key=8IPCP77WVVZT upload=8LVS0NJV1QGR tag=P4D66QEW1PME type=write size=3503757 2023-10-05T11:35:11.019 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.015+0000 7f26f5634780 1 > prepared part key=_multipart_QYQDXVIGZ7O8.2~T12MJ0FAPF7X.0 size=1048576 2023-10-05T11:35:11.020 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.016+0000 7f26f5634780 1 > prepared part key=_multipart_QYQDXVIGZ7O8.2~T12MJ0FAPF7X.1 size=74521 2023-10-05T11:35:11.020 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.016+0000 7f26f5634780 1 > prepared multipart upload key=QYQDXVIGZ7O8 upload=T12MJ0FAPF7X tag=AONWMQTRMUGZ type=write size=2171673 2023-10-05T11:35:11.022 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.019+0000 7f26f5634780 1 < suggested update operation key=IKCNZOTVWOC6 tag=HUZBRB3SEBLW type=write size=857796 2023-10-05T11:35:11.023 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.020+0000 7f26f5634780 1 > prepared operation key=BU3KSHTINB36 tag=4UHDHNR98GR9 type=del size=4078719 2023-10-05T11:35:11.025 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.021+0000 7f26f5634780 1 < completed delete operation key=J5EIH25Y471T tag=GFP7TBQQI2WR type=del 2023-10-05T11:35:11.027 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.023+0000 7f26f5634780 1 > prepared part key=_multipart_8IPCP77WVVZT.2~XKV0AU6K9TAV.0 size=363478 2023-10-05T11:35:11.027 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.023+0000 7f26f5634780 1 > prepared multipart upload key=8IPCP77WVVZT upload=XKV0AU6K9TAV tag=WD3JFO625WT5 type=write size=1412054 2023-10-05T11:35:11.029 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.026+0000 7f26f5634780 1 < suggested update operation key=VJTFYDETLSFD tag=AC7F4XG3VD3K type=del size=2386798 2023-10-05T11:35:11.030 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.027+0000 7f26f5634780 1 > prepared operation key=2D4PDQQT54ZA tag=359AZ6UQ6O2T type=del size=2625119 2023-10-05T11:35:11.032 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.028+0000 7f26f5634780 1 < completed part key=_multipart_W2GWVGX42QLD.2~YZCR2DFCMJD0.0 size=1048576 2023-10-05T11:35:11.033 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.029+0000 7f26f5634780 1 < completed part key=_multipart_W2GWVGX42QLD.2~YZCR2DFCMJD0.1 size=615503 2023-10-05T11:35:11.035 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.031+0000 7f26f5634780 1 < completed multipart upload key=W2GWVGX42QLD upload=YZCR2DFCMJD0 tag=JIJX75YWP20V type=write size=2712655 2023-10-05T11:35:11.036 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.032+0000 7f26f5634780 1 > prepared operation key=2U0NRDGDNUTA tag=XDM447E4E6ZN type=del size=4117341 2023-10-05T11:35:11.037 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.034+0000 7f26f5634780 1 < completed part key=_multipart_5OPHKTHXVN5U.2~775R0MYPTCYW.0 size=1048576 2023-10-05T11:35:11.038 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.035+0000 7f26f5634780 1 < completed part key=_multipart_5OPHKTHXVN5U.2~775R0MYPTCYW.1 size=1048576 2023-10-05T11:35:11.039 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.036+0000 7f26f5634780 1 < completed part key=_multipart_5OPHKTHXVN5U.2~775R0MYPTCYW.2 size=148796 2023-10-05T11:35:11.041 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.038+0000 7f26f5634780 1 < completed multipart upload key=5OPHKTHXVN5U upload=775R0MYPTCYW tag=UTJ09MFOUWH5 type=write size=3294524 2023-10-05T11:35:11.042 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.039+0000 7f26f5634780 1 > prepared operation key=W2GWVGX42QLD tag=XS72KSQ44CGH type=write size=610885 2023-10-05T11:35:11.043 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.039+0000 7f26f5634780 1 < canceled part key=_multipart_BU3KSHTINB36.2~BITJ1865X5HU.0 size=1048576 2023-10-05T11:35:11.044 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.040+0000 7f26f5634780 1 < completed part key=_multipart_BU3KSHTINB36.2~BITJ1865X5HU.1 size=1048576 2023-10-05T11:35:11.045 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.041+0000 7f26f5634780 1 < completed part key=_multipart_BU3KSHTINB36.2~BITJ1865X5HU.2 size=1023100 2023-10-05T11:35:11.047 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.043+0000 7f26f5634780 1 < canceled multipart upload key=BU3KSHTINB36 upload=BITJ1865X5HU tag=Q3MOGM23WAZN type=write size=4168828 2023-10-05T11:35:11.048 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.044+0000 7f26f5634780 1 > prepared operation key=QYQDXVIGZ7O8 tag=R1G67V5P8R6O type=del size=4142553 2023-10-05T11:35:11.050 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.047+0000 7f26f5634780 1 < suggested remove operation key=IC7T3ZK81WQS tag=BS15OM43DDRS type=del 2023-10-05T11:35:11.052 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.049+0000 7f26f5634780 1 > prepared part key=_multipart_BU3KSHTINB36.2~VIKQAPEN68IL.0 size=114390 2023-10-05T11:35:11.053 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.049+0000 7f26f5634780 1 > prepared multipart upload key=BU3KSHTINB36 upload=VIKQAPEN68IL tag=L60JSKIK1P0G type=write size=1162966 2023-10-05T11:35:11.054 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.050+0000 7f26f5634780 1 < canceled operation key=FOMNIIY47UUM tag=XGX09EY8VQ2N type=del size=3655014 2023-10-05T11:35:11.055 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.052+0000 7f26f5634780 1 > prepared operation key=2D4PDQQT54ZA tag=ZDW2WC1Q2E41 type=write size=343690 2023-10-05T11:35:11.056 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.053+0000 7f26f5634780 -1 < failed to complete operation key=VJTFYDETLSFD tag=DUOAJFYUHC1K type=write size=1044455: (22) Invalid argument 2023-10-05T11:35:11.057 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.054+0000 7f26f5634780 1 > prepared operation key=J5EIH25Y471T tag=QF7QJV23MYDS type=del size=3568620 2023-10-05T11:35:11.059 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.055+0000 7f26f5634780 1 < completed delete operation key=MEY4SZRHU9NZ tag=4DOXGH67YU1G type=del 2023-10-05T11:35:11.061 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.058+0000 7f26f5634780 1 > prepared part key=_multipart_7W9LL5HSU3BG.2~BYXEMZM2ZHBM.0 size=1048576 2023-10-05T11:35:11.062 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.059+0000 7f26f5634780 1 > prepared part key=_multipart_7W9LL5HSU3BG.2~BYXEMZM2ZHBM.1 size=272560 2023-10-05T11:35:11.062 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.059+0000 7f26f5634780 1 > prepared multipart upload key=7W9LL5HSU3BG upload=BYXEMZM2ZHBM tag=MHX8YD9CBFVE type=write size=2369712 2023-10-05T11:35:11.065 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.061+0000 7f26f5634780 1 < suggested update operation key=5V0Q651D4VN2 tag=7NSD058HKFC8 type=write size=877616 2023-10-05T11:35:11.066 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.062+0000 7f26f5634780 1 > prepared operation key=4IBQJLJR7LD8 tag=I39I7NOWBQNK type=del size=1384262 2023-10-05T11:35:11.067 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.064+0000 7f26f5634780 -1 < failed to complete operation key=VJTFYDETLSFD tag=E8WAP49KLZT8 type=del size=1526963: (22) Invalid argument 2023-10-05T11:35:11.069 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.066+0000 7f26f5634780 1 > prepared part key=_multipart_VJTFYDETLSFD.2~RUZLP3MBMD8S.0 size=1048576 2023-10-05T11:35:11.070 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.067+0000 7f26f5634780 1 > prepared part key=_multipart_VJTFYDETLSFD.2~RUZLP3MBMD8S.1 size=1048576 2023-10-05T11:35:11.071 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.067+0000 7f26f5634780 1 > prepared part key=_multipart_VJTFYDETLSFD.2~RUZLP3MBMD8S.2 size=777202 2023-10-05T11:35:11.071 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.067+0000 7f26f5634780 1 > prepared multipart upload key=VJTFYDETLSFD upload=RUZLP3MBMD8S tag=MJ8N7J3KZMYU type=write size=3922930 2023-10-05T11:35:11.072 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.069+0000 7f26f5634780 -1 < failed to complete operation key=IC7T3ZK81WQS tag=SGQV97ZZGJ16 type=del size=2359295: (22) Invalid argument 2023-10-05T11:35:11.074 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.071+0000 7f26f5634780 1 > prepared operation key=S3DKYDFT4IO2 tag=2KF54PS0XCJA type=write size=732310 2023-10-05T11:35:11.075 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.072+0000 7f26f5634780 1 < completed part key=_multipart_LLR5J3X15W5R.2~TA9CEVOLMUFB.0 size=1048576 2023-10-05T11:35:11.076 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.073+0000 7f26f5634780 1 < completed part key=_multipart_LLR5J3X15W5R.2~TA9CEVOLMUFB.1 size=1048576 2023-10-05T11:35:11.077 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.074+0000 7f26f5634780 1 < completed part key=_multipart_LLR5J3X15W5R.2~TA9CEVOLMUFB.2 size=678783 2023-10-05T11:35:11.079 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.076+0000 7f26f5634780 1 < completed multipart upload key=LLR5J3X15W5R upload=TA9CEVOLMUFB tag=TGJ198ZT3A43 type=write size=3824511 2023-10-05T11:35:11.080 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.077+0000 7f26f5634780 1 > prepared operation key=0PWYKC7S6YJ4 tag=63GH27VOSEL5 type=del size=3494166 2023-10-05T11:35:11.082 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.079+0000 7f26f5634780 1 < suggested update operation key=U6172JUYW7J6 tag=DQ49AIVZUQ3N type=del size=1625900 2023-10-05T11:35:11.084 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.080+0000 7f26f5634780 1 > prepared operation key=J5EIH25Y471T tag=G9O5QKTUYJ7B type=del size=2393851 2023-10-05T11:35:11.085 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.082+0000 7f26f5634780 1 < completed part key=_multipart_QYQDXVIGZ7O8.2~T12MJ0FAPF7X.0 size=1048576 2023-10-05T11:35:11.086 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.083+0000 7f26f5634780 1 < completed part key=_multipart_QYQDXVIGZ7O8.2~T12MJ0FAPF7X.1 size=74521 2023-10-05T11:35:11.088 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.085+0000 7f26f5634780 1 < completed multipart upload key=QYQDXVIGZ7O8 upload=T12MJ0FAPF7X tag=AONWMQTRMUGZ type=write size=2171673 2023-10-05T11:35:11.090 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.086+0000 7f26f5634780 1 > prepared operation key=5V0Q651D4VN2 tag=DLLC5I7DVU3D type=del size=2723595 2023-10-05T11:35:11.091 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.087+0000 7f26f5634780 1 < completed delete operation key=BU3KSHTINB36 tag=4UHDHNR98GR9 type=del 2023-10-05T11:35:11.093 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.090+0000 7f26f5634780 1 > prepared part key=_multipart_5OPHKTHXVN5U.2~39W34259KUZ4.0 size=1048576 2023-10-05T11:35:11.094 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.091+0000 7f26f5634780 1 > prepared part key=_multipart_5OPHKTHXVN5U.2~39W34259KUZ4.1 size=1048576 2023-10-05T11:35:11.095 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.092+0000 7f26f5634780 1 > prepared part key=_multipart_5OPHKTHXVN5U.2~39W34259KUZ4.2 size=711147 2023-10-05T11:35:11.095 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.092+0000 7f26f5634780 1 > prepared multipart upload key=5OPHKTHXVN5U upload=39W34259KUZ4 tag=EMRGOHJEAH9T type=write size=3856875 2023-10-05T11:35:11.097 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.093+0000 7f26f5634780 1 < completed part key=_multipart_8IPCP77WVVZT.2~XKV0AU6K9TAV.0 size=363478 2023-10-05T11:35:11.099 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.095+0000 7f26f5634780 1 < completed multipart upload key=8IPCP77WVVZT upload=XKV0AU6K9TAV tag=WD3JFO625WT5 type=write size=1412054 2023-10-05T11:35:11.101 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.098+0000 7f26f5634780 1 > prepared part key=_multipart_PNV0Q6ZPLYV0.2~BTA1I8EOX6HY.0 size=1048576 2023-10-05T11:35:11.102 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.099+0000 7f26f5634780 1 > prepared part key=_multipart_PNV0Q6ZPLYV0.2~BTA1I8EOX6HY.1 size=797557 2023-10-05T11:35:11.102 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.099+0000 7f26f5634780 1 > prepared multipart upload key=PNV0Q6ZPLYV0 upload=BTA1I8EOX6HY tag=QUQMV576VLIU type=write size=2894709 2023-10-05T11:35:11.104 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.100+0000 7f26f5634780 1 < completed delete operation key=2D4PDQQT54ZA tag=359AZ6UQ6O2T type=del 2023-10-05T11:35:11.105 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.101+0000 7f26f5634780 1 > prepared operation key=PC8WTJ8AYJ24 tag=IB0O1191Y45R type=del size=1642817 2023-10-05T11:35:11.106 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.103+0000 7f26f5634780 1 < canceled operation key=2U0NRDGDNUTA tag=XDM447E4E6ZN type=del size=4117341 2023-10-05T11:35:11.107 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.104+0000 7f26f5634780 1 > prepared operation key=W2GWVGX42QLD tag=FRUMV80V31C6 type=del size=1356246 2023-10-05T11:35:11.109 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.105+0000 7f26f5634780 1 < completed write operation key=W2GWVGX42QLD tag=XS72KSQ44CGH type=write size=610885 2023-10-05T11:35:11.110 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.107+0000 7f26f5634780 1 > prepared operation key=IKCNZOTVWOC6 tag=YKE3J4DSBSVH type=del size=4158214 2023-10-05T11:35:11.111 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.108+0000 7f26f5634780 1 < completed delete operation key=QYQDXVIGZ7O8 tag=R1G67V5P8R6O type=del 2023-10-05T11:35:11.113 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.109+0000 7f26f5634780 1 > prepared operation key=0PWYKC7S6YJ4 tag=2C4CVCT8YR1Y type=del size=736007 2023-10-05T11:35:11.114 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.111+0000 7f26f5634780 1 < completed part key=_multipart_BU3KSHTINB36.2~VIKQAPEN68IL.0 size=114390 2023-10-05T11:35:11.117 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.113+0000 7f26f5634780 1 < completed multipart upload key=BU3KSHTINB36 upload=VIKQAPEN68IL tag=L60JSKIK1P0G type=write size=1162966 2023-10-05T11:35:11.118 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.115+0000 7f26f5634780 1 > prepared operation key=8IPCP77WVVZT tag=3WA1GHTJ52AU type=del size=3085987 2023-10-05T11:35:11.120 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.116+0000 7f26f5634780 1 < completed write operation key=2D4PDQQT54ZA tag=ZDW2WC1Q2E41 type=write size=343690 2023-10-05T11:35:11.122 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.119+0000 7f26f5634780 1 > prepared part key=_multipart_W2GWVGX42QLD.2~AARRTMEZ3F13.0 size=574297 2023-10-05T11:35:11.123 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.119+0000 7f26f5634780 1 > prepared multipart upload key=W2GWVGX42QLD upload=AARRTMEZ3F13 tag=LIXCM3T0K2C9 type=write size=1622873 2023-10-05T11:35:11.124 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.120+0000 7f26f5634780 1 < completed delete operation key=J5EIH25Y471T tag=QF7QJV23MYDS type=del 2023-10-05T11:35:11.125 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.122+0000 7f26f5634780 1 > prepared operation key=FOMNIIY47UUM tag=FCXW5E3BP8W1 type=del size=1393657 2023-10-05T11:35:11.127 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.123+0000 7f26f5634780 1 < completed part key=_multipart_7W9LL5HSU3BG.2~BYXEMZM2ZHBM.0 size=1048576 2023-10-05T11:35:11.128 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.124+0000 7f26f5634780 1 < completed part key=_multipart_7W9LL5HSU3BG.2~BYXEMZM2ZHBM.1 size=272560 2023-10-05T11:35:11.129 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.126+0000 7f26f5634780 1 < completed multipart upload key=7W9LL5HSU3BG upload=BYXEMZM2ZHBM tag=MHX8YD9CBFVE type=write size=2369712 2023-10-05T11:35:11.131 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.127+0000 7f26f5634780 1 > prepared operation key=FOMNIIY47UUM tag=HI6WOM18H5HU type=del size=4075889 2023-10-05T11:35:11.132 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.129+0000 7f26f5634780 1 < completed delete operation key=4IBQJLJR7LD8 tag=I39I7NOWBQNK type=del 2023-10-05T11:35:11.133 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.130+0000 7f26f5634780 1 > prepared operation key=J5EIH25Y471T tag=CBPPFG87TX7K type=write size=433357 2023-10-05T11:35:11.134 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.131+0000 7f26f5634780 1 < completed part key=_multipart_VJTFYDETLSFD.2~RUZLP3MBMD8S.0 size=1048576 2023-10-05T11:35:11.135 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.132+0000 7f26f5634780 1 < completed part key=_multipart_VJTFYDETLSFD.2~RUZLP3MBMD8S.1 size=1048576 2023-10-05T11:35:11.136 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.133+0000 7f26f5634780 1 < completed part key=_multipart_VJTFYDETLSFD.2~RUZLP3MBMD8S.2 size=777202 2023-10-05T11:35:11.138 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.135+0000 7f26f5634780 1 < completed multipart upload key=VJTFYDETLSFD upload=RUZLP3MBMD8S tag=MJ8N7J3KZMYU type=write size=3922930 2023-10-05T11:35:11.140 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.136+0000 7f26f5634780 1 > prepared operation key=WYN9BG66LA3K tag=4CXWSIOIV9JA type=del size=3688933 2023-10-05T11:35:11.141 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.138+0000 7f26f5634780 1 < canceled operation key=S3DKYDFT4IO2 tag=2KF54PS0XCJA type=write size=732310 2023-10-05T11:35:11.143 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.139+0000 7f26f5634780 1 > prepared operation key=PNV0Q6ZPLYV0 tag=EM4HJLHC3AP0 type=del size=1382609 2023-10-05T11:35:11.144 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.141+0000 7f26f5634780 1 < completed delete operation key=0PWYKC7S6YJ4 tag=63GH27VOSEL5 type=del 2023-10-05T11:35:11.147 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.143+0000 7f26f5634780 1 > prepared part key=_multipart_U6172JUYW7J6.2~Q9ND0E14ADXB.0 size=30932 2023-10-05T11:35:11.147 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.143+0000 7f26f5634780 1 > prepared multipart upload key=U6172JUYW7J6 upload=Q9ND0E14ADXB tag=Z4Y7Z57A9SLN type=write size=1079508 2023-10-05T11:35:11.149 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.146+0000 7f26f5634780 1 < suggested remove operation key=J5EIH25Y471T tag=G9O5QKTUYJ7B type=del 2023-10-05T11:35:11.152 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.148+0000 7f26f5634780 1 > prepared part key=_multipart_7TOP5A52M9YP.2~VK1V64N7YQT6.0 size=1048576 2023-10-05T11:35:11.153 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.149+0000 7f26f5634780 1 > prepared part key=_multipart_7TOP5A52M9YP.2~VK1V64N7YQT6.1 size=1048576 2023-10-05T11:35:11.154 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.150+0000 7f26f5634780 1 > prepared part key=_multipart_7TOP5A52M9YP.2~VK1V64N7YQT6.2 size=190785 2023-10-05T11:35:11.154 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.150+0000 7f26f5634780 1 > prepared multipart upload key=7TOP5A52M9YP upload=VK1V64N7YQT6 tag=PIXQEW8039YT type=write size=3336513 2023-10-05T11:35:11.155 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.152+0000 7f26f5634780 1 < completed delete operation key=5V0Q651D4VN2 tag=DLLC5I7DVU3D type=del 2023-10-05T11:35:11.157 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.153+0000 7f26f5634780 1 > prepared operation key=BTZUVE8R96XT tag=C1NCK21Y5F7P type=del size=1355810 2023-10-05T11:35:11.158 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.155+0000 7f26f5634780 1 < completed part key=_multipart_5OPHKTHXVN5U.2~39W34259KUZ4.0 size=1048576 2023-10-05T11:35:11.159 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.156+0000 7f26f5634780 1 < completed part key=_multipart_5OPHKTHXVN5U.2~39W34259KUZ4.1 size=1048576 2023-10-05T11:35:11.160 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.157+0000 7f26f5634780 1 < completed part key=_multipart_5OPHKTHXVN5U.2~39W34259KUZ4.2 size=711147 2023-10-05T11:35:11.162 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.159+0000 7f26f5634780 1 < completed multipart upload key=5OPHKTHXVN5U upload=39W34259KUZ4 tag=EMRGOHJEAH9T type=write size=3856875 2023-10-05T11:35:11.163 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.160+0000 7f26f5634780 1 > prepared operation key=5OPHKTHXVN5U tag=N3L4QHNDDZ0W type=write size=240521 2023-10-05T11:35:11.165 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.161+0000 7f26f5634780 1 < completed part key=_multipart_PNV0Q6ZPLYV0.2~BTA1I8EOX6HY.0 size=1048576 2023-10-05T11:35:11.166 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.162+0000 7f26f5634780 1 < completed part key=_multipart_PNV0Q6ZPLYV0.2~BTA1I8EOX6HY.1 size=797557 2023-10-05T11:35:11.168 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.164+0000 7f26f5634780 1 < completed multipart upload key=PNV0Q6ZPLYV0 upload=BTA1I8EOX6HY tag=QUQMV576VLIU type=write size=2894709 2023-10-05T11:35:11.169 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.165+0000 7f26f5634780 1 > prepared operation key=5OPHKTHXVN5U tag=TGAU931LWTTO type=del size=2947889 2023-10-05T11:35:11.170 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.167+0000 7f26f5634780 1 < completed delete operation key=PC8WTJ8AYJ24 tag=IB0O1191Y45R type=del 2023-10-05T11:35:11.172 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.168+0000 7f26f5634780 1 > prepared operation key=4D3H60UTIXH3 tag=CWVO2XZ1MJOY type=del size=4061429 2023-10-05T11:35:11.173 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.169+0000 7f26f5634780 1 < completed delete operation key=W2GWVGX42QLD tag=FRUMV80V31C6 type=del 2023-10-05T11:35:11.174 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.170+0000 7f26f5634780 1 > prepared operation key=WTCWG1C1SF89 tag=74OSLR8DH0A9 type=del size=2679848 2023-10-05T11:35:11.175 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.172+0000 7f26f5634780 1 < completed delete operation key=IKCNZOTVWOC6 tag=YKE3J4DSBSVH type=del 2023-10-05T11:35:11.177 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.174+0000 7f26f5634780 1 > prepared part key=_multipart_PNV0Q6ZPLYV0.2~ESZQ387AFHXU.0 size=287464 2023-10-05T11:35:11.177 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.174+0000 7f26f5634780 1 > prepared multipart upload key=PNV0Q6ZPLYV0 upload=ESZQ387AFHXU tag=A6M3YU7KR4R1 type=write size=1336040 2023-10-05T11:35:11.180 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.176+0000 7f26f5634780 1 < suggested update operation key=0PWYKC7S6YJ4 tag=2C4CVCT8YR1Y type=del size=736007 2023-10-05T11:35:11.181 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.178+0000 7f26f5634780 1 > prepared operation key=W2GWVGX42QLD tag=QSP7JPO0LMUR type=del size=159747 2023-10-05T11:35:11.182 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.179+0000 7f26f5634780 1 < completed delete operation key=8IPCP77WVVZT tag=3WA1GHTJ52AU type=del 2023-10-05T11:35:11.184 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.180+0000 7f26f5634780 1 > prepared operation key=9S0YW7PPSJ8G tag=GT58B2WOWH6P type=del size=2242542 2023-10-05T11:35:11.185 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.181+0000 7f26f5634780 1 < completed part key=_multipart_W2GWVGX42QLD.2~AARRTMEZ3F13.0 size=574297 2023-10-05T11:35:11.187 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.183+0000 7f26f5634780 1 < completed multipart upload key=W2GWVGX42QLD upload=AARRTMEZ3F13 tag=LIXCM3T0K2C9 type=write size=1622873 2023-10-05T11:35:11.188 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.185+0000 7f26f5634780 1 > prepared operation key=5OPHKTHXVN5U tag=QB4CZ0XLM32L type=del size=913211 2023-10-05T11:35:11.190 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.187+0000 7f26f5634780 1 < suggested update operation key=FOMNIIY47UUM tag=FCXW5E3BP8W1 type=del size=1393657 2023-10-05T11:35:11.191 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.188+0000 7f26f5634780 1 > prepared operation key=4IBQJLJR7LD8 tag=LC4U3DG0NP6M type=del size=2162307 2023-10-05T11:35:11.193 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.189+0000 7f26f5634780 -1 < failed to complete operation key=FOMNIIY47UUM tag=HI6WOM18H5HU type=del size=4075889: (22) Invalid argument 2023-10-05T11:35:11.197 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.192+0000 7f26f5634780 1 > prepared operation key=9S0YW7PPSJ8G tag=S8XCBYUWGJUG type=del size=1595840 2023-10-05T11:35:11.198 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.192+0000 7f26f5634780 -1 < no bi entry to suggest for operation key=J5EIH25Y471T tag=CBPPFG87TX7K type=write size=433357: (2) No such file or directory 2023-10-05T11:35:11.198 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.193+0000 7f26f5634780 1 > prepared operation key=S3DKYDFT4IO2 tag=COIMYX39Z4VI type=del size=1370301 2023-10-05T11:35:11.200 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.196+0000 7f26f5634780 1 < suggested remove operation key=WYN9BG66LA3K tag=4CXWSIOIV9JA type=del 2023-10-05T11:35:11.202 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.198+0000 7f26f5634780 1 > prepared part key=_multipart_PC8WTJ8AYJ24.2~46I7MR2U0898.0 size=578327 2023-10-05T11:35:11.202 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.198+0000 7f26f5634780 1 > prepared multipart upload key=PC8WTJ8AYJ24 upload=46I7MR2U0898 tag=HRDNU6MLV6DS type=write size=1626903 2023-10-05T11:35:11.203 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.199+0000 7f26f5634780 1 < completed delete operation key=PNV0Q6ZPLYV0 tag=EM4HJLHC3AP0 type=del 2023-10-05T11:35:11.204 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.201+0000 7f26f5634780 1 > prepared operation key=761J2C7GHWU5 tag=X8UN9XOLIDRK type=del size=1137696 2023-10-05T11:35:11.206 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.202+0000 7f26f5634780 1 < completed part key=_multipart_U6172JUYW7J6.2~Q9ND0E14ADXB.0 size=30932 2023-10-05T11:35:11.209 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.206+0000 7f26f5634780 1 < completed multipart upload key=U6172JUYW7J6 upload=Q9ND0E14ADXB tag=Z4Y7Z57A9SLN type=write size=1079508 2023-10-05T11:35:11.211 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.207+0000 7f26f5634780 1 > prepared operation key=U6172JUYW7J6 tag=2Y2T4KRE9Y8E type=del size=457487 2023-10-05T11:35:11.212 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.208+0000 7f26f5634780 1 < completed part key=_multipart_7TOP5A52M9YP.2~VK1V64N7YQT6.0 size=1048576 2023-10-05T11:35:11.213 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.209+0000 7f26f5634780 1 < completed part key=_multipart_7TOP5A52M9YP.2~VK1V64N7YQT6.1 size=1048576 2023-10-05T11:35:11.214 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.210+0000 7f26f5634780 1 < completed part key=_multipart_7TOP5A52M9YP.2~VK1V64N7YQT6.2 size=190785 2023-10-05T11:35:11.216 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.212+0000 7f26f5634780 1 < completed multipart upload key=7TOP5A52M9YP upload=VK1V64N7YQT6 tag=PIXQEW8039YT type=write size=3336513 2023-10-05T11:35:11.218 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.214+0000 7f26f5634780 1 > prepared part key=_multipart_9S0YW7PPSJ8G.2~G88RX313UFM2.0 size=1048576 2023-10-05T11:35:11.219 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.215+0000 7f26f5634780 1 > prepared part key=_multipart_9S0YW7PPSJ8G.2~G88RX313UFM2.1 size=194221 2023-10-05T11:35:11.219 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.215+0000 7f26f5634780 1 > prepared multipart upload key=9S0YW7PPSJ8G upload=G88RX313UFM2 tag=917CRSSGQ92H type=write size=2291373 2023-10-05T11:35:11.220 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.216+0000 7f26f5634780 1 < completed delete operation key=BTZUVE8R96XT tag=C1NCK21Y5F7P type=del 2023-10-05T11:35:11.221 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.218+0000 7f26f5634780 1 > prepared operation key=7W9LL5HSU3BG tag=G04S297WJF71 type=write size=707431 2023-10-05T11:35:11.223 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.220+0000 7f26f5634780 1 < suggested remove operation key=5OPHKTHXVN5U tag=N3L4QHNDDZ0W type=write 2023-10-05T11:35:11.224 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.221+0000 7f26f5634780 1 > prepared operation key=NV4Q36UOLX8A tag=Q1KH2R7MJ47S type=del size=2855916 2023-10-05T11:35:11.226 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.222+0000 7f26f5634780 -1 < failed to complete operation key=5OPHKTHXVN5U tag=TGAU931LWTTO type=del size=2947889: (22) Invalid argument 2023-10-05T11:35:11.227 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.223+0000 7f26f5634780 1 > prepared operation key=NV4Q36UOLX8A tag=Z5LI1NO5MHLB type=del size=2104318 2023-10-05T11:35:11.228 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.225+0000 7f26f5634780 1 < completed delete operation key=4D3H60UTIXH3 tag=CWVO2XZ1MJOY type=del 2023-10-05T11:35:11.229 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.226+0000 7f26f5634780 1 > prepared operation key=8IPCP77WVVZT tag=0LKDBB3LH80G type=del size=2554638 2023-10-05T11:35:11.230 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.227+0000 7f26f5634780 1 < completed delete operation key=WTCWG1C1SF89 tag=74OSLR8DH0A9 type=del 2023-10-05T11:35:11.232 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.228+0000 7f26f5634780 1 > prepared operation key=7TOP5A52M9YP tag=D83YK1K1EYGB type=del size=2259985 2023-10-05T11:35:11.233 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.229+0000 7f26f5634780 1 < completed part key=_multipart_PNV0Q6ZPLYV0.2~ESZQ387AFHXU.0 size=287464 2023-10-05T11:35:11.235 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.232+0000 7f26f5634780 1 < completed multipart upload key=PNV0Q6ZPLYV0 upload=ESZQ387AFHXU tag=A6M3YU7KR4R1 type=write size=1336040 2023-10-05T11:35:11.236 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.233+0000 7f26f5634780 1 > prepared operation key=QYQDXVIGZ7O8 tag=3OU7NTPOQ1AS type=del size=1649719 2023-10-05T11:35:11.237 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.234+0000 7f26f5634780 1 < completed delete operation key=W2GWVGX42QLD tag=QSP7JPO0LMUR type=del 2023-10-05T11:35:11.239 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.235+0000 7f26f5634780 1 > prepared operation key=8IPCP77WVVZT tag=477S8VBO370H type=del size=2684861 2023-10-05T11:35:11.240 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.237+0000 7f26f5634780 1 < completed delete operation key=9S0YW7PPSJ8G tag=GT58B2WOWH6P type=del 2023-10-05T11:35:11.242 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.238+0000 7f26f5634780 1 > prepared operation key=PNV0Q6ZPLYV0 tag=OECVI63WUZEC type=del size=2239647 2023-10-05T11:35:11.243 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.240+0000 7f26f5634780 -1 < failed to complete operation key=5OPHKTHXVN5U tag=QB4CZ0XLM32L type=del size=913211: (22) Invalid argument 2023-10-05T11:35:11.244 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.241+0000 7f26f5634780 1 > prepared operation key=5OPHKTHXVN5U tag=29K8Y21YXY5I type=del size=3288438 2023-10-05T11:35:11.245 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.242+0000 7f26f5634780 1 < completed delete operation key=4IBQJLJR7LD8 tag=LC4U3DG0NP6M type=del 2023-10-05T11:35:11.247 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.243+0000 7f26f5634780 1 > prepared operation key=J5EIH25Y471T tag=Q2LID7BDNXH3 type=del size=2847279 2023-10-05T11:35:11.248 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.245+0000 7f26f5634780 1 < canceled operation key=9S0YW7PPSJ8G tag=S8XCBYUWGJUG type=del size=1595840 2023-10-05T11:35:11.250 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.247+0000 7f26f5634780 1 > prepared part key=_multipart_7W9LL5HSU3BG.2~B4HYWN8JMS52.0 size=1048576 2023-10-05T11:35:11.251 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.248+0000 7f26f5634780 1 > prepared part key=_multipart_7W9LL5HSU3BG.2~B4HYWN8JMS52.1 size=1048576 2023-10-05T11:35:11.252 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.249+0000 7f26f5634780 1 > prepared part key=_multipart_7W9LL5HSU3BG.2~B4HYWN8JMS52.2 size=621069 2023-10-05T11:35:11.252 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.249+0000 7f26f5634780 1 > prepared multipart upload key=7W9LL5HSU3BG upload=B4HYWN8JMS52 tag=12DQVFSNCO2D type=write size=3766797 2023-10-05T11:35:11.253 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.250+0000 7f26f5634780 1 < completed delete operation key=S3DKYDFT4IO2 tag=COIMYX39Z4VI type=del 2023-10-05T11:35:11.256 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.252+0000 7f26f5634780 1 > prepared part key=_multipart_4D3H60UTIXH3.2~IZ3FALYG7JLB.0 size=1048576 2023-10-05T11:35:11.257 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.253+0000 7f26f5634780 1 > prepared part key=_multipart_4D3H60UTIXH3.2~IZ3FALYG7JLB.1 size=1048576 2023-10-05T11:35:11.258 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.254+0000 7f26f5634780 1 > prepared part key=_multipart_4D3H60UTIXH3.2~IZ3FALYG7JLB.2 size=347350 2023-10-05T11:35:11.258 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.254+0000 7f26f5634780 1 > prepared multipart upload key=4D3H60UTIXH3 upload=IZ3FALYG7JLB tag=MB400L3R990Z type=write size=3493078 2023-10-05T11:35:11.259 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.255+0000 7f26f5634780 1 < completed part key=_multipart_PC8WTJ8AYJ24.2~46I7MR2U0898.0 size=578327 2023-10-05T11:35:11.261 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.258+0000 7f26f5634780 1 < completed multipart upload key=PC8WTJ8AYJ24 upload=46I7MR2U0898 tag=HRDNU6MLV6DS type=write size=1626903 2023-10-05T11:35:11.263 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.260+0000 7f26f5634780 1 > prepared part key=_multipart_S3DKYDFT4IO2.2~W7LH7QSKQ7I4.0 size=1048576 2023-10-05T11:35:11.264 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.261+0000 7f26f5634780 1 > prepared part key=_multipart_S3DKYDFT4IO2.2~W7LH7QSKQ7I4.1 size=680293 2023-10-05T11:35:11.264 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.261+0000 7f26f5634780 1 > prepared multipart upload key=S3DKYDFT4IO2 upload=W7LH7QSKQ7I4 tag=G5O60ZE3N185 type=write size=2777445 2023-10-05T11:35:11.265 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.262+0000 7f26f5634780 1 < completed delete operation key=761J2C7GHWU5 tag=X8UN9XOLIDRK type=del 2023-10-05T11:35:11.268 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.264+0000 7f26f5634780 1 > prepared part key=_multipart_IC7T3ZK81WQS.2~S1TH7T8Q0FO0.0 size=1048576 2023-10-05T11:35:11.268 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.265+0000 7f26f5634780 1 > prepared part key=_multipart_IC7T3ZK81WQS.2~S1TH7T8Q0FO0.1 size=708963 2023-10-05T11:35:11.269 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.265+0000 7f26f5634780 1 > prepared multipart upload key=IC7T3ZK81WQS upload=S1TH7T8Q0FO0 tag=M9VN108R21RP type=write size=2806115 2023-10-05T11:35:11.270 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.266+0000 7f26f5634780 1 < completed delete operation key=U6172JUYW7J6 tag=2Y2T4KRE9Y8E type=del 2023-10-05T11:35:11.272 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.268+0000 7f26f5634780 1 > prepared part key=_multipart_IKCNZOTVWOC6.2~F59C8N9J0AQV.0 size=1048576 2023-10-05T11:35:11.273 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.269+0000 7f26f5634780 1 > prepared part key=_multipart_IKCNZOTVWOC6.2~F59C8N9J0AQV.1 size=443985 2023-10-05T11:35:11.273 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.269+0000 7f26f5634780 1 > prepared multipart upload key=IKCNZOTVWOC6 upload=F59C8N9J0AQV tag=XX05S1A68JTJ type=write size=2541137 2023-10-05T11:35:11.274 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.271+0000 7f26f5634780 1 < completed part key=_multipart_9S0YW7PPSJ8G.2~G88RX313UFM2.0 size=1048576 2023-10-05T11:35:11.275 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.272+0000 7f26f5634780 1 < completed part key=_multipart_9S0YW7PPSJ8G.2~G88RX313UFM2.1 size=194221 2023-10-05T11:35:11.277 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.274+0000 7f26f5634780 1 < completed multipart upload key=9S0YW7PPSJ8G upload=G88RX313UFM2 tag=917CRSSGQ92H type=write size=2291373 2023-10-05T11:35:11.279 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.276+0000 7f26f5634780 1 > prepared part key=_multipart_761J2C7GHWU5.2~B7CKNHUJC0MO.0 size=1048576 2023-10-05T11:35:11.280 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.277+0000 7f26f5634780 1 > prepared part key=_multipart_761J2C7GHWU5.2~B7CKNHUJC0MO.1 size=196293 2023-10-05T11:35:11.280 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.277+0000 7f26f5634780 1 > prepared multipart upload key=761J2C7GHWU5 upload=B7CKNHUJC0MO tag=OEK41U121GJG type=write size=2293445 2023-10-05T11:35:11.282 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.279+0000 7f26f5634780 1 < suggested update operation key=7W9LL5HSU3BG tag=G04S297WJF71 type=write size=707431 2023-10-05T11:35:11.285 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.281+0000 7f26f5634780 1 > prepared part key=_multipart_J5EIH25Y471T.2~0Z55B7C0P5CU.0 size=448583 2023-10-05T11:35:11.285 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.281+0000 7f26f5634780 1 > prepared multipart upload key=J5EIH25Y471T upload=0Z55B7C0P5CU tag=6O75RJJ33ASZ type=write size=1497159 2023-10-05T11:35:11.286 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.282+0000 7f26f5634780 1 < completed delete operation key=NV4Q36UOLX8A tag=Q1KH2R7MJ47S type=del 2023-10-05T11:35:11.287 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.284+0000 7f26f5634780 1 > prepared operation key=PNV0Q6ZPLYV0 tag=OY2BGEJ0BDIT type=del size=628887 2023-10-05T11:35:11.288 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.285+0000 7f26f5634780 1 < canceled operation key=NV4Q36UOLX8A tag=Z5LI1NO5MHLB type=del size=2104318 2023-10-05T11:35:11.290 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.286+0000 7f26f5634780 1 > prepared operation key=2D4PDQQT54ZA tag=6SJA7CRXQJPF type=write size=886388 2023-10-05T11:35:11.291 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.287+0000 7f26f5634780 1 < completed delete operation key=8IPCP77WVVZT tag=0LKDBB3LH80G type=del 2023-10-05T11:35:11.292 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.288+0000 7f26f5634780 1 > prepared operation key=S3DKYDFT4IO2 tag=KFGZOQ091F1G type=del size=3576625 2023-10-05T11:35:11.293 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.290+0000 7f26f5634780 1 < completed delete operation key=7TOP5A52M9YP tag=D83YK1K1EYGB type=del 2023-10-05T11:35:11.294 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.291+0000 7f26f5634780 1 > prepared operation key=4IBQJLJR7LD8 tag=L32WUSL88W1Y type=del size=3147018 2023-10-05T11:35:11.296 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.292+0000 7f26f5634780 1 < completed delete operation key=QYQDXVIGZ7O8 tag=3OU7NTPOQ1AS type=del 2023-10-05T11:35:11.297 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.294+0000 7f26f5634780 1 > prepared operation key=761J2C7GHWU5 tag=EJ31MMD3LR4O type=write size=679572 2023-10-05T11:35:11.298 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.295+0000 7f26f5634780 1 < completed delete operation key=8IPCP77WVVZT tag=477S8VBO370H type=del 2023-10-05T11:35:11.300 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.297+0000 7f26f5634780 1 > prepared part key=_multipart_7W9LL5HSU3BG.2~2559G617RJS7.0 size=1048576 2023-10-05T11:35:11.302 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.298+0000 7f26f5634780 1 > prepared part key=_multipart_7W9LL5HSU3BG.2~2559G617RJS7.1 size=1048576 2023-10-05T11:35:11.303 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.299+0000 7f26f5634780 1 > prepared part key=_multipart_7W9LL5HSU3BG.2~2559G617RJS7.2 size=694742 2023-10-05T11:35:11.303 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.299+0000 7f26f5634780 1 > prepared multipart upload key=7W9LL5HSU3BG upload=2559G617RJS7 tag=PZ24EMLM990H type=write size=3840470 2023-10-05T11:35:11.304 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.300+0000 7f26f5634780 1 < canceled operation key=PNV0Q6ZPLYV0 tag=OECVI63WUZEC type=del size=2239647 2023-10-05T11:35:11.305 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.302+0000 7f26f5634780 1 > prepared operation key=7TOP5A52M9YP tag=YEF9RT63PMIU type=del size=1716876 2023-10-05T11:35:11.308 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.304+0000 7f26f5634780 1 < suggested remove operation key=5OPHKTHXVN5U tag=29K8Y21YXY5I type=del 2023-10-05T11:35:11.310 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.306+0000 7f26f5634780 1 > prepared part key=_multipart_4D3H60UTIXH3.2~P8H4OEZ858AD.0 size=1048576 2023-10-05T11:35:11.311 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.307+0000 7f26f5634780 1 > prepared part key=_multipart_4D3H60UTIXH3.2~P8H4OEZ858AD.1 size=1048576 2023-10-05T11:35:11.312 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.309+0000 7f26f5634780 1 > prepared part key=_multipart_4D3H60UTIXH3.2~P8H4OEZ858AD.2 size=976539 2023-10-05T11:35:11.313 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.309+0000 7f26f5634780 1 > prepared multipart upload key=4D3H60UTIXH3 upload=P8H4OEZ858AD tag=M674GRG2V0HD type=write size=4122267 2023-10-05T11:35:11.314 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.310+0000 7f26f5634780 1 < canceled operation key=J5EIH25Y471T tag=Q2LID7BDNXH3 type=del size=2847279 2023-10-05T11:35:11.315 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.311+0000 7f26f5634780 1 > prepared operation key=IKCNZOTVWOC6 tag=Y1YJMV47I3ML type=del size=1484948 2023-10-05T11:35:11.316 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.313+0000 7f26f5634780 1 < completed part key=_multipart_7W9LL5HSU3BG.2~B4HYWN8JMS52.0 size=1048576 2023-10-05T11:35:11.317 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.314+0000 7f26f5634780 1 < completed part key=_multipart_7W9LL5HSU3BG.2~B4HYWN8JMS52.1 size=1048576 2023-10-05T11:35:11.318 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.314+0000 7f26f5634780 1 < completed part key=_multipart_7W9LL5HSU3BG.2~B4HYWN8JMS52.2 size=621069 2023-10-05T11:35:11.320 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.317+0000 7f26f5634780 1 < completed multipart upload key=7W9LL5HSU3BG upload=B4HYWN8JMS52 tag=12DQVFSNCO2D type=write size=3766797 2023-10-05T11:35:11.322 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.318+0000 7f26f5634780 1 > prepared operation key=WTCWG1C1SF89 tag=VL8Y2QG6Y049 type=del size=405247 2023-10-05T11:35:11.323 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.319+0000 7f26f5634780 1 < completed part key=_multipart_4D3H60UTIXH3.2~IZ3FALYG7JLB.0 size=1048576 2023-10-05T11:35:11.325 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.320+0000 7f26f5634780 1 < completed part key=_multipart_4D3H60UTIXH3.2~IZ3FALYG7JLB.1 size=1048576 2023-10-05T11:35:11.325 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.321+0000 7f26f5634780 1 < completed part key=_multipart_4D3H60UTIXH3.2~IZ3FALYG7JLB.2 size=347350 2023-10-05T11:35:11.327 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.324+0000 7f26f5634780 1 < completed multipart upload key=4D3H60UTIXH3 upload=IZ3FALYG7JLB tag=MB400L3R990Z type=write size=3493078 2023-10-05T11:35:11.328 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.325+0000 7f26f5634780 1 > prepared operation key=BU3KSHTINB36 tag=4F5C3VJE178S type=del size=3140422 2023-10-05T11:35:11.330 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.326+0000 7f26f5634780 1 < completed part key=_multipart_S3DKYDFT4IO2.2~W7LH7QSKQ7I4.0 size=1048576 2023-10-05T11:35:11.331 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.327+0000 7f26f5634780 1 < completed part key=_multipart_S3DKYDFT4IO2.2~W7LH7QSKQ7I4.1 size=680293 2023-10-05T11:35:11.333 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.329+0000 7f26f5634780 1 < completed multipart upload key=S3DKYDFT4IO2 upload=W7LH7QSKQ7I4 tag=G5O60ZE3N185 type=write size=2777445 2023-10-05T11:35:11.334 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.331+0000 7f26f5634780 1 > prepared operation key=8IPCP77WVVZT tag=O41JQBS2IM66 type=del size=119820 2023-10-05T11:35:11.336 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.332+0000 7f26f5634780 1 < completed part key=_multipart_IC7T3ZK81WQS.2~S1TH7T8Q0FO0.0 size=1048576 2023-10-05T11:35:11.337 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.333+0000 7f26f5634780 1 < completed part key=_multipart_IC7T3ZK81WQS.2~S1TH7T8Q0FO0.1 size=708963 2023-10-05T11:35:11.339 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.335+0000 7f26f5634780 1 < completed multipart upload key=IC7T3ZK81WQS upload=S1TH7T8Q0FO0 tag=M9VN108R21RP type=write size=2806115 2023-10-05T11:35:11.340 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.336+0000 7f26f5634780 1 > prepared operation key=U6172JUYW7J6 tag=HXWNL5X60BTN type=del size=1513003 2023-10-05T11:35:11.341 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.338+0000 7f26f5634780 1 < completed part key=_multipart_IKCNZOTVWOC6.2~F59C8N9J0AQV.0 size=1048576 2023-10-05T11:35:11.342 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.339+0000 7f26f5634780 1 < completed part key=_multipart_IKCNZOTVWOC6.2~F59C8N9J0AQV.1 size=443985 2023-10-05T11:35:11.345 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.341+0000 7f26f5634780 1 < completed multipart upload key=IKCNZOTVWOC6 upload=F59C8N9J0AQV tag=XX05S1A68JTJ type=write size=2541137 2023-10-05T11:35:11.347 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.344+0000 7f26f5634780 1 > prepared part key=_multipart_5V0Q651D4VN2.2~VT1G0J0S20FG.0 size=1048576 2023-10-05T11:35:11.348 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.345+0000 7f26f5634780 1 > prepared part key=_multipart_5V0Q651D4VN2.2~VT1G0J0S20FG.1 size=751392 2023-10-05T11:35:11.348 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.345+0000 7f26f5634780 1 > prepared multipart upload key=5V0Q651D4VN2 upload=VT1G0J0S20FG tag=NFS2AW56PFT1 type=write size=2848544 2023-10-05T11:35:11.349 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.346+0000 7f26f5634780 1 < completed part key=_multipart_761J2C7GHWU5.2~B7CKNHUJC0MO.0 size=1048576 2023-10-05T11:35:11.350 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.346+0000 7f26f5634780 1 < canceled part key=_multipart_761J2C7GHWU5.2~B7CKNHUJC0MO.1 size=196293 2023-10-05T11:35:11.352 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.348+0000 7f26f5634780 1 < canceled multipart upload key=761J2C7GHWU5 upload=B7CKNHUJC0MO tag=OEK41U121GJG type=write size=2293445 2023-10-05T11:35:11.353 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.350+0000 7f26f5634780 1 > prepared operation key=S3DKYDFT4IO2 tag=ISBYQ2MB5ZWA type=write size=155575 2023-10-05T11:35:11.354 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.351+0000 7f26f5634780 1 < completed part key=_multipart_J5EIH25Y471T.2~0Z55B7C0P5CU.0 size=448583 2023-10-05T11:35:11.356 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.353+0000 7f26f5634780 1 < completed multipart upload key=J5EIH25Y471T upload=0Z55B7C0P5CU tag=6O75RJJ33ASZ type=write size=1497159 2023-10-05T11:35:11.358 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.354+0000 7f26f5634780 1 > prepared operation key=S3DKYDFT4IO2 tag=Z09YWGE23C5A type=del size=1651318 2023-10-05T11:35:11.359 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.355+0000 7f26f5634780 1 < canceled operation key=PNV0Q6ZPLYV0 tag=OY2BGEJ0BDIT type=del size=628887 2023-10-05T11:35:11.360 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.357+0000 7f26f5634780 1 > prepared operation key=BU3KSHTINB36 tag=T0TTJ57OYQPO type=write size=697341 2023-10-05T11:35:11.361 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.358+0000 7f26f5634780 1 < completed write operation key=2D4PDQQT54ZA tag=6SJA7CRXQJPF type=write size=886388 2023-10-05T11:35:11.363 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.359+0000 7f26f5634780 1 > prepared operation key=J5EIH25Y471T tag=97V2BUJXZR9D type=del size=1380388 2023-10-05T11:35:11.364 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.360+0000 7f26f5634780 1 < completed delete operation key=S3DKYDFT4IO2 tag=KFGZOQ091F1G type=del 2023-10-05T11:35:11.365 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.362+0000 7f26f5634780 1 > prepared operation key=NV4Q36UOLX8A tag=GQH9JELY5WQV type=del size=905575 2023-10-05T11:35:11.366 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.363+0000 7f26f5634780 1 < completed delete operation key=4IBQJLJR7LD8 tag=L32WUSL88W1Y type=del 2023-10-05T11:35:11.368 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.364+0000 7f26f5634780 1 > prepared operation key=PC8WTJ8AYJ24 tag=SQH0VMS4OV01 type=del size=2151773 2023-10-05T11:35:11.369 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.366+0000 7f26f5634780 1 < completed write operation key=761J2C7GHWU5 tag=EJ31MMD3LR4O type=write size=679572 2023-10-05T11:35:11.370 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.367+0000 7f26f5634780 1 > prepared operation key=2D4PDQQT54ZA tag=FQFXUT6C2NYV type=del size=1599985 2023-10-05T11:35:11.371 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.368+0000 7f26f5634780 1 < completed part key=_multipart_7W9LL5HSU3BG.2~2559G617RJS7.0 size=1048576 2023-10-05T11:35:11.372 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.369+0000 7f26f5634780 1 < completed part key=_multipart_7W9LL5HSU3BG.2~2559G617RJS7.1 size=1048576 2023-10-05T11:35:11.373 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.370+0000 7f26f5634780 1 < completed part key=_multipart_7W9LL5HSU3BG.2~2559G617RJS7.2 size=694742 2023-10-05T11:35:11.376 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.372+0000 7f26f5634780 1 < completed multipart upload key=7W9LL5HSU3BG upload=2559G617RJS7 tag=PZ24EMLM990H type=write size=3840470 2023-10-05T11:35:11.377 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.373+0000 7f26f5634780 1 > prepared operation key=PC8WTJ8AYJ24 tag=5X17A4CZ6ORS type=write size=1045008 2023-10-05T11:35:11.379 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.376+0000 7f26f5634780 1 < suggested remove operation key=7TOP5A52M9YP tag=YEF9RT63PMIU type=del 2023-10-05T11:35:11.381 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.378+0000 7f26f5634780 1 > prepared part key=_multipart_8IPCP77WVVZT.2~5C3JLWV3TFK3.0 size=1048576 2023-10-05T11:35:11.382 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.379+0000 7f26f5634780 1 > prepared part key=_multipart_8IPCP77WVVZT.2~5C3JLWV3TFK3.1 size=709018 2023-10-05T11:35:11.382 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.379+0000 7f26f5634780 1 > prepared multipart upload key=8IPCP77WVVZT upload=5C3JLWV3TFK3 tag=1CP8M0N3HWIK type=write size=2806170 2023-10-05T11:35:11.383 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.380+0000 7f26f5634780 1 < completed part key=_multipart_4D3H60UTIXH3.2~P8H4OEZ858AD.0 size=1048576 2023-10-05T11:35:11.384 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.381+0000 7f26f5634780 1 < completed part key=_multipart_4D3H60UTIXH3.2~P8H4OEZ858AD.1 size=1048576 2023-10-05T11:35:11.385 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.382+0000 7f26f5634780 1 < completed part key=_multipart_4D3H60UTIXH3.2~P8H4OEZ858AD.2 size=976539 2023-10-05T11:35:11.387 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.384+0000 7f26f5634780 1 < completed multipart upload key=4D3H60UTIXH3 upload=P8H4OEZ858AD tag=M674GRG2V0HD type=write size=4122267 2023-10-05T11:35:11.390 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.386+0000 7f26f5634780 1 > prepared part key=_multipart_5OPHKTHXVN5U.2~2PLP4X86JY32.0 size=568570 2023-10-05T11:35:11.390 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.386+0000 7f26f5634780 1 > prepared multipart upload key=5OPHKTHXVN5U upload=2PLP4X86JY32 tag=070ZHY0KPY42 type=write size=1617146 2023-10-05T11:35:11.391 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.388+0000 7f26f5634780 1 < completed delete operation key=IKCNZOTVWOC6 tag=Y1YJMV47I3ML type=del 2023-10-05T11:35:11.392 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.389+0000 7f26f5634780 1 > prepared operation key=MEY4SZRHU9NZ tag=OK61KSSNKODJ type=del size=1446223 2023-10-05T11:35:11.393 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.390+0000 7f26f5634780 1 < completed delete operation key=WTCWG1C1SF89 tag=VL8Y2QG6Y049 type=del 2023-10-05T11:35:11.395 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.392+0000 7f26f5634780 1 > prepared part key=_multipart_WTCWG1C1SF89.2~TOMAU6LCU3LM.0 size=1048576 2023-10-05T11:35:11.396 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.393+0000 7f26f5634780 1 > prepared part key=_multipart_WTCWG1C1SF89.2~TOMAU6LCU3LM.1 size=414717 2023-10-05T11:35:11.397 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.393+0000 7f26f5634780 1 > prepared multipart upload key=WTCWG1C1SF89 upload=TOMAU6LCU3LM tag=M63VYIOX2V31 type=write size=2511869 2023-10-05T11:35:11.398 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.394+0000 7f26f5634780 1 < completed delete operation key=BU3KSHTINB36 tag=4F5C3VJE178S type=del 2023-10-05T11:35:11.399 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.395+0000 7f26f5634780 1 > prepared operation key=6DP3UJ4CW1MO tag=LNWD6ALB1ZY2 type=del size=1784076 2023-10-05T11:35:11.400 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.397+0000 7f26f5634780 1 < canceled operation key=8IPCP77WVVZT tag=O41JQBS2IM66 type=del size=119820 2023-10-05T11:35:11.402 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.399+0000 7f26f5634780 1 > prepared part key=_multipart_WYN9BG66LA3K.2~DOIE3N4Z3XOW.0 size=276459 2023-10-05T11:35:11.402 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.399+0000 7f26f5634780 1 > prepared multipart upload key=WYN9BG66LA3K upload=DOIE3N4Z3XOW tag=SE5G3217IG5N type=write size=1325035 2023-10-05T11:35:11.404 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.401+0000 7f26f5634780 1 < suggested update operation key=U6172JUYW7J6 tag=HXWNL5X60BTN type=del size=1513003 2023-10-05T11:35:11.405 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.402+0000 7f26f5634780 1 > prepared operation key=WYN9BG66LA3K tag=02QOIQDQH803 type=del size=660058 2023-10-05T11:35:11.407 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.403+0000 7f26f5634780 1 < completed part key=_multipart_5V0Q651D4VN2.2~VT1G0J0S20FG.0 size=1048576 2023-10-05T11:35:11.407 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.403+0000 7f26f5634780 1 < canceled part key=_multipart_5V0Q651D4VN2.2~VT1G0J0S20FG.1 size=751392 2023-10-05T11:35:11.408 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.405+0000 7f26f5634780 1 < canceled multipart upload key=5V0Q651D4VN2 upload=VT1G0J0S20FG tag=NFS2AW56PFT1 type=write size=2848544 2023-10-05T11:35:11.410 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.407+0000 7f26f5634780 1 > prepared part key=_multipart_W2GWVGX42QLD.2~UDTJ8OINBGIS.0 size=1048576 2023-10-05T11:35:11.411 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.408+0000 7f26f5634780 1 > prepared part key=_multipart_W2GWVGX42QLD.2~UDTJ8OINBGIS.1 size=1048576 2023-10-05T11:35:11.414 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.410+0000 7f26f5634780 1 > prepared part key=_multipart_W2GWVGX42QLD.2~UDTJ8OINBGIS.2 size=910908 2023-10-05T11:35:11.414 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.410+0000 7f26f5634780 1 > prepared multipart upload key=W2GWVGX42QLD upload=UDTJ8OINBGIS tag=ALE6AWON4O8Z type=write size=4056636 2023-10-05T11:35:11.415 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.412+0000 7f26f5634780 1 < completed write operation key=S3DKYDFT4IO2 tag=ISBYQ2MB5ZWA type=write size=155575 2023-10-05T11:35:11.417 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.414+0000 7f26f5634780 1 > prepared part key=_multipart_761J2C7GHWU5.2~3ABXE5LMDQE1.0 size=1029744 2023-10-05T11:35:11.417 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.414+0000 7f26f5634780 1 > prepared multipart upload key=761J2C7GHWU5 upload=3ABXE5LMDQE1 tag=17PKV5SUWVMV type=write size=2078320 2023-10-05T11:35:11.418 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.415+0000 7f26f5634780 1 < completed delete operation key=S3DKYDFT4IO2 tag=Z09YWGE23C5A type=del 2023-10-05T11:35:11.421 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.417+0000 7f26f5634780 1 > prepared part key=_multipart_W2GWVGX42QLD.2~E0FMFWRPD64R.0 size=1048576 2023-10-05T11:35:11.422 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.418+0000 7f26f5634780 1 > prepared part key=_multipart_W2GWVGX42QLD.2~E0FMFWRPD64R.1 size=39025 2023-10-05T11:35:11.422 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.418+0000 7f26f5634780 1 > prepared multipart upload key=W2GWVGX42QLD upload=E0FMFWRPD64R tag=3RVELLCKGBDO type=write size=2136177 2023-10-05T11:35:11.424 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.421+0000 7f26f5634780 1 < suggested update operation key=BU3KSHTINB36 tag=T0TTJ57OYQPO type=write size=697341 2023-10-05T11:35:11.426 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.423+0000 7f26f5634780 1 > prepared operation key=FOMNIIY47UUM tag=GZ5N15KVVS82 type=write size=522843 2023-10-05T11:35:11.427 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.424+0000 7f26f5634780 1 < completed delete operation key=J5EIH25Y471T tag=97V2BUJXZR9D type=del 2023-10-05T11:35:11.430 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.427+0000 7f26f5634780 1 > prepared operation key=BU3KSHTINB36 tag=DH28TG6BNN0R type=write size=677590 2023-10-05T11:35:11.431 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.428+0000 7f26f5634780 1 < completed delete operation key=NV4Q36UOLX8A tag=GQH9JELY5WQV type=del 2023-10-05T11:35:11.434 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.431+0000 7f26f5634780 1 > prepared operation key=7W9LL5HSU3BG tag=O1B9C60O368X type=del size=438975 2023-10-05T11:35:11.436 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.432+0000 7f26f5634780 1 < completed delete operation key=PC8WTJ8AYJ24 tag=SQH0VMS4OV01 type=del 2023-10-05T11:35:11.437 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.434+0000 7f26f5634780 1 > prepared operation key=J5EIH25Y471T tag=ZBTZG5BP6MCG type=write size=473995 2023-10-05T11:35:11.439 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.435+0000 7f26f5634780 1 < completed delete operation key=2D4PDQQT54ZA tag=FQFXUT6C2NYV type=del 2023-10-05T11:35:11.441 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.438+0000 7f26f5634780 1 > prepared part key=_multipart_LLR5J3X15W5R.2~HWEN58O9U31L.0 size=1048576 2023-10-05T11:35:11.442 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.439+0000 7f26f5634780 1 > prepared part key=_multipart_LLR5J3X15W5R.2~HWEN58O9U31L.1 size=617936 2023-10-05T11:35:11.443 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.439+0000 7f26f5634780 1 > prepared multipart upload key=LLR5J3X15W5R upload=HWEN58O9U31L tag=1DIHG8VZJ5JC type=write size=2715088 2023-10-05T11:35:11.444 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.441+0000 7f26f5634780 1 < completed write operation key=PC8WTJ8AYJ24 tag=5X17A4CZ6ORS type=write size=1045008 2023-10-05T11:35:11.445 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.442+0000 7f26f5634780 1 > prepared operation key=9S0YW7PPSJ8G tag=190Q1ZXTB82Z type=write size=527625 2023-10-05T11:35:11.447 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.443+0000 7f26f5634780 1 < completed part key=_multipart_8IPCP77WVVZT.2~5C3JLWV3TFK3.0 size=1048576 2023-10-05T11:35:11.447 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.443+0000 7f26f5634780 1 < canceled part key=_multipart_8IPCP77WVVZT.2~5C3JLWV3TFK3.1 size=709018 2023-10-05T11:35:11.449 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.446+0000 7f26f5634780 1 < canceled multipart upload key=8IPCP77WVVZT upload=5C3JLWV3TFK3 tag=1CP8M0N3HWIK type=write size=2806170 2023-10-05T11:35:11.450 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.447+0000 7f26f5634780 1 > prepared operation key=S3DKYDFT4IO2 tag=6O01J4TMJIZV type=del size=720437 2023-10-05T11:35:11.452 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.449+0000 7f26f5634780 1 < completed part key=_multipart_5OPHKTHXVN5U.2~2PLP4X86JY32.0 size=568570 2023-10-05T11:35:11.454 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.451+0000 7f26f5634780 1 < completed multipart upload key=5OPHKTHXVN5U upload=2PLP4X86JY32 tag=070ZHY0KPY42 type=write size=1617146 2023-10-05T11:35:11.458 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.454+0000 7f26f5634780 1 > prepared part key=_multipart_MEY4SZRHU9NZ.2~U9PCTJMHWVBH.0 size=1048576 2023-10-05T11:35:11.459 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.455+0000 7f26f5634780 1 > prepared part key=_multipart_MEY4SZRHU9NZ.2~U9PCTJMHWVBH.1 size=357905 2023-10-05T11:35:11.459 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.455+0000 7f26f5634780 1 > prepared multipart upload key=MEY4SZRHU9NZ upload=U9PCTJMHWVBH tag=KSXT50FSE7Z1 type=write size=2455057 2023-10-05T11:35:11.460 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.457+0000 7f26f5634780 1 < completed delete operation key=MEY4SZRHU9NZ tag=OK61KSSNKODJ type=del 2023-10-05T11:35:11.462 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.458+0000 7f26f5634780 1 > prepared operation key=7W9LL5HSU3BG tag=1A8TDBCXB4J8 type=del size=2180338 2023-10-05T11:35:11.463 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.459+0000 7f26f5634780 1 < completed part key=_multipart_WTCWG1C1SF89.2~TOMAU6LCU3LM.0 size=1048576 2023-10-05T11:35:11.463 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.459+0000 7f26f5634780 1 < canceled part key=_multipart_WTCWG1C1SF89.2~TOMAU6LCU3LM.1 size=414717 2023-10-05T11:35:11.465 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.462+0000 7f26f5634780 1 < canceled multipart upload key=WTCWG1C1SF89 upload=TOMAU6LCU3LM tag=M63VYIOX2V31 type=write size=2511869 2023-10-05T11:35:11.467 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.464+0000 7f26f5634780 1 > prepared part key=_multipart_WYN9BG66LA3K.2~SYA0G3LQYUB0.0 size=1048576 2023-10-05T11:35:11.468 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.465+0000 7f26f5634780 1 > prepared part key=_multipart_WYN9BG66LA3K.2~SYA0G3LQYUB0.1 size=1048576 2023-10-05T11:35:11.469 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.466+0000 7f26f5634780 1 > prepared part key=_multipart_WYN9BG66LA3K.2~SYA0G3LQYUB0.2 size=491871 2023-10-05T11:35:11.470 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.466+0000 7f26f5634780 1 > prepared multipart upload key=WYN9BG66LA3K upload=SYA0G3LQYUB0 tag=9WN0W7MBTW1M type=write size=3637599 2023-10-05T11:35:11.471 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.467+0000 7f26f5634780 1 < completed delete operation key=6DP3UJ4CW1MO tag=LNWD6ALB1ZY2 type=del 2023-10-05T11:35:11.472 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.469+0000 7f26f5634780 1 > prepared operation key=NV4Q36UOLX8A tag=2PF7N4WSSGXS type=del size=608856 2023-10-05T11:35:11.473 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.470+0000 7f26f5634780 1 < completed part key=_multipart_WYN9BG66LA3K.2~DOIE3N4Z3XOW.0 size=276459 2023-10-05T11:35:11.476 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.473+0000 7f26f5634780 1 < completed multipart upload key=WYN9BG66LA3K upload=DOIE3N4Z3XOW tag=SE5G3217IG5N type=write size=1325035 2023-10-05T11:35:11.478 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.474+0000 7f26f5634780 1 > prepared operation key=6DP3UJ4CW1MO tag=0DB11QUXWN0X type=del size=926746 2023-10-05T11:35:11.479 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.476+0000 7f26f5634780 1 < completed delete operation key=WYN9BG66LA3K tag=02QOIQDQH803 type=del 2023-10-05T11:35:11.481 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.477+0000 7f26f5634780 1 > prepared operation key=7W9LL5HSU3BG tag=O0KURA3HKPDO type=del size=1110107 2023-10-05T11:35:11.482 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.479+0000 7f26f5634780 1 < completed part key=_multipart_W2GWVGX42QLD.2~UDTJ8OINBGIS.0 size=1048576 2023-10-05T11:35:11.483 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.480+0000 7f26f5634780 1 < completed part key=_multipart_W2GWVGX42QLD.2~UDTJ8OINBGIS.1 size=1048576 2023-10-05T11:35:11.484 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.481+0000 7f26f5634780 1 < completed part key=_multipart_W2GWVGX42QLD.2~UDTJ8OINBGIS.2 size=910908 2023-10-05T11:35:11.487 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.483+0000 7f26f5634780 1 < completed multipart upload key=W2GWVGX42QLD upload=UDTJ8OINBGIS tag=ALE6AWON4O8Z type=write size=4056636 2023-10-05T11:35:11.488 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.485+0000 7f26f5634780 1 > prepared operation key=WTCWG1C1SF89 tag=HQ9N79TNRVQK type=del size=4130703 2023-10-05T11:35:11.489 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.486+0000 7f26f5634780 1 < completed part key=_multipart_761J2C7GHWU5.2~3ABXE5LMDQE1.0 size=1029744 2023-10-05T11:35:11.492 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.488+0000 7f26f5634780 1 < completed multipart upload key=761J2C7GHWU5 upload=3ABXE5LMDQE1 tag=17PKV5SUWVMV type=write size=2078320 2023-10-05T11:35:11.494 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.491+0000 7f26f5634780 1 > prepared part key=_multipart_S3DKYDFT4IO2.2~Y2F7GANY3QRP.0 size=770329 2023-10-05T11:35:11.494 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.491+0000 7f26f5634780 1 > prepared multipart upload key=S3DKYDFT4IO2 upload=Y2F7GANY3QRP tag=S1UMKN94C8LS type=write size=1818905 2023-10-05T11:35:11.496 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.492+0000 7f26f5634780 1 < completed part key=_multipart_W2GWVGX42QLD.2~E0FMFWRPD64R.0 size=1048576 2023-10-05T11:35:11.497 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.493+0000 7f26f5634780 1 < completed part key=_multipart_W2GWVGX42QLD.2~E0FMFWRPD64R.1 size=39025 2023-10-05T11:35:11.499 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.496+0000 7f26f5634780 1 < completed multipart upload key=W2GWVGX42QLD upload=E0FMFWRPD64R tag=3RVELLCKGBDO type=write size=2136177 2023-10-05T11:35:11.500 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.497+0000 7f26f5634780 1 > prepared operation key=5V0Q651D4VN2 tag=XXKF1YRO40IL type=del size=4160532 2023-10-05T11:35:11.503 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.500+0000 7f26f5634780 1 < suggested update operation key=FOMNIIY47UUM tag=GZ5N15KVVS82 type=write size=522843 2023-10-05T11:35:11.504 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.501+0000 7f26f5634780 1 > prepared operation key=BTZUVE8R96XT tag=NM6GF40PFKZX type=del size=2062147 2023-10-05T11:35:11.506 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.502+0000 7f26f5634780 1 < canceled operation key=BU3KSHTINB36 tag=DH28TG6BNN0R type=write size=677590 2023-10-05T11:35:11.507 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.504+0000 7f26f5634780 1 > prepared operation key=MEY4SZRHU9NZ tag=WWG7Q4OWYN1T type=write size=839567 2023-10-05T11:35:11.508 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.505+0000 7f26f5634780 1 < completed delete operation key=7W9LL5HSU3BG tag=O1B9C60O368X type=del 2023-10-05T11:35:11.510 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.506+0000 7f26f5634780 1 > prepared operation key=4IBQJLJR7LD8 tag=1935U9DT5451 type=del size=1166324 2023-10-05T11:35:11.511 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.507+0000 7f26f5634780 1 < completed write operation key=J5EIH25Y471T tag=ZBTZG5BP6MCG type=write size=473995 2023-10-05T11:35:11.513 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.509+0000 7f26f5634780 1 > prepared part key=_multipart_IC7T3ZK81WQS.2~4GC8CG21O6JD.0 size=1048576 2023-10-05T11:35:11.514 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.510+0000 7f26f5634780 1 > prepared part key=_multipart_IC7T3ZK81WQS.2~4GC8CG21O6JD.1 size=1048576 2023-10-05T11:35:11.515 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.511+0000 7f26f5634780 1 > prepared part key=_multipart_IC7T3ZK81WQS.2~4GC8CG21O6JD.2 size=876904 2023-10-05T11:35:11.515 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.511+0000 7f26f5634780 1 > prepared multipart upload key=IC7T3ZK81WQS upload=4GC8CG21O6JD tag=MGN4EH91HGK7 type=write size=4022632 2023-10-05T11:35:11.516 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.512+0000 7f26f5634780 1 < completed part key=_multipart_LLR5J3X15W5R.2~HWEN58O9U31L.0 size=1048576 2023-10-05T11:35:11.517 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.513+0000 7f26f5634780 1 < completed part key=_multipart_LLR5J3X15W5R.2~HWEN58O9U31L.1 size=617936 2023-10-05T11:35:11.519 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.515+0000 7f26f5634780 1 < completed multipart upload key=LLR5J3X15W5R upload=HWEN58O9U31L tag=1DIHG8VZJ5JC type=write size=2715088 2023-10-05T11:35:11.520 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.516+0000 7f26f5634780 1 > prepared operation key=5V0Q651D4VN2 tag=RY3I21F94KOU type=write size=585310 2023-10-05T11:35:11.521 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.517+0000 7f26f5634780 1 < completed write operation key=9S0YW7PPSJ8G tag=190Q1ZXTB82Z type=write size=527625 2023-10-05T11:35:11.523 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.519+0000 7f26f5634780 1 > prepared part key=_multipart_LLR5J3X15W5R.2~J9J04138PK3L.0 size=1048576 2023-10-05T11:35:11.524 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.520+0000 7f26f5634780 1 > prepared part key=_multipart_LLR5J3X15W5R.2~J9J04138PK3L.1 size=897152 2023-10-05T11:35:11.524 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.520+0000 7f26f5634780 1 > prepared multipart upload key=LLR5J3X15W5R upload=J9J04138PK3L tag=3WFSSWOI1WIV type=write size=2994304 2023-10-05T11:35:11.525 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.522+0000 7f26f5634780 1 < canceled operation key=S3DKYDFT4IO2 tag=6O01J4TMJIZV type=del size=720437 2023-10-05T11:35:11.526 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.523+0000 7f26f5634780 1 > prepared operation key=VJTFYDETLSFD tag=5S8RN83WGCID type=del size=3718202 2023-10-05T11:35:11.527 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.524+0000 7f26f5634780 1 < completed part key=_multipart_MEY4SZRHU9NZ.2~U9PCTJMHWVBH.0 size=1048576 2023-10-05T11:35:11.528 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.525+0000 7f26f5634780 1 < completed part key=_multipart_MEY4SZRHU9NZ.2~U9PCTJMHWVBH.1 size=357905 2023-10-05T11:35:11.531 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.528+0000 7f26f5634780 1 < completed multipart upload key=MEY4SZRHU9NZ upload=U9PCTJMHWVBH tag=KSXT50FSE7Z1 type=write size=2455057 2023-10-05T11:35:11.533 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.530+0000 7f26f5634780 1 > prepared part key=_multipart_FOMNIIY47UUM.2~4OA2VRRW9YZH.0 size=1048576 2023-10-05T11:35:11.534 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.531+0000 7f26f5634780 1 > prepared part key=_multipart_FOMNIIY47UUM.2~4OA2VRRW9YZH.1 size=1048576 2023-10-05T11:35:11.536 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.532+0000 7f26f5634780 1 > prepared part key=_multipart_FOMNIIY47UUM.2~4OA2VRRW9YZH.2 size=437990 2023-10-05T11:35:11.536 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.532+0000 7f26f5634780 1 > prepared multipart upload key=FOMNIIY47UUM upload=4OA2VRRW9YZH tag=BLQEIO8RQR99 type=write size=3583718 2023-10-05T11:35:11.538 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.535+0000 7f26f5634780 1 < suggested remove operation key=7W9LL5HSU3BG tag=1A8TDBCXB4J8 type=del 2023-10-05T11:35:11.540 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.537+0000 7f26f5634780 1 > prepared part key=_multipart_2D4PDQQT54ZA.2~Z0URULXNMAWA.0 size=1048576 2023-10-05T11:35:11.541 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.538+0000 7f26f5634780 1 > prepared part key=_multipart_2D4PDQQT54ZA.2~Z0URULXNMAWA.1 size=53725 2023-10-05T11:35:11.541 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.538+0000 7f26f5634780 1 > prepared multipart upload key=2D4PDQQT54ZA upload=Z0URULXNMAWA tag=LC11TLAS0BG2 type=write size=2150877 2023-10-05T11:35:11.542 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.539+0000 7f26f5634780 1 < completed part key=_multipart_WYN9BG66LA3K.2~SYA0G3LQYUB0.0 size=1048576 2023-10-05T11:35:11.543 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.540+0000 7f26f5634780 1 < completed part key=_multipart_WYN9BG66LA3K.2~SYA0G3LQYUB0.1 size=1048576 2023-10-05T11:35:11.544 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.541+0000 7f26f5634780 1 < completed part key=_multipart_WYN9BG66LA3K.2~SYA0G3LQYUB0.2 size=491871 2023-10-05T11:35:11.546 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.543+0000 7f26f5634780 1 < completed multipart upload key=WYN9BG66LA3K upload=SYA0G3LQYUB0 tag=9WN0W7MBTW1M type=write size=3637599 2023-10-05T11:35:11.548 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.545+0000 7f26f5634780 1 > prepared part key=_multipart_7TOP5A52M9YP.2~DN4TPIF6C08S.0 size=1048576 2023-10-05T11:35:11.549 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.546+0000 7f26f5634780 1 > prepared part key=_multipart_7TOP5A52M9YP.2~DN4TPIF6C08S.1 size=104601 2023-10-05T11:35:11.549 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.546+0000 7f26f5634780 1 > prepared multipart upload key=7TOP5A52M9YP upload=DN4TPIF6C08S tag=P8EYONK26TQS type=write size=2201753 2023-10-05T11:35:11.550 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.547+0000 7f26f5634780 1 < completed delete operation key=NV4Q36UOLX8A tag=2PF7N4WSSGXS type=del 2023-10-05T11:35:11.551 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.548+0000 7f26f5634780 1 > prepared operation key=VJTFYDETLSFD tag=4HC4A7T8NN9F type=del size=307799 2023-10-05T11:35:11.554 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.550+0000 7f26f5634780 1 < completed delete operation key=6DP3UJ4CW1MO tag=0DB11QUXWN0X type=del 2023-10-05T11:35:11.557 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.554+0000 7f26f5634780 1 > prepared part key=_multipart_VJTFYDETLSFD.2~R40P98HL0TU1.0 size=1048576 2023-10-05T11:35:11.558 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.555+0000 7f26f5634780 1 > prepared part key=_multipart_VJTFYDETLSFD.2~R40P98HL0TU1.1 size=211994 2023-10-05T11:35:11.559 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.555+0000 7f26f5634780 1 > prepared multipart upload key=VJTFYDETLSFD upload=R40P98HL0TU1 tag=KQ66B6XAMS9C type=write size=2309146 2023-10-05T11:35:11.560 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.556+0000 7f26f5634780 -1 < failed to complete operation key=7W9LL5HSU3BG tag=O0KURA3HKPDO type=del size=1110107: (22) Invalid argument 2023-10-05T11:35:11.561 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.558+0000 7f26f5634780 1 > prepared operation key=BTZUVE8R96XT tag=78JRDMEK40WI type=write size=775518 2023-10-05T11:35:11.562 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.559+0000 7f26f5634780 1 < completed delete operation key=WTCWG1C1SF89 tag=HQ9N79TNRVQK type=del 2023-10-05T11:35:11.563 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.560+0000 7f26f5634780 1 > prepared operation key=BU3KSHTINB36 tag=QJD2YP8M9BT9 type=write size=807050 2023-10-05T11:35:11.565 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.561+0000 7f26f5634780 1 < completed part key=_multipart_S3DKYDFT4IO2.2~Y2F7GANY3QRP.0 size=770329 2023-10-05T11:35:11.567 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.564+0000 7f26f5634780 1 < completed multipart upload key=S3DKYDFT4IO2 upload=Y2F7GANY3QRP tag=S1UMKN94C8LS type=write size=1818905 2023-10-05T11:35:11.568 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.565+0000 7f26f5634780 1 > prepared operation key=PC8WTJ8AYJ24 tag=8CAZICPQXNZP type=del size=4169216 2023-10-05T11:35:11.570 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.567+0000 7f26f5634780 1 < completed delete operation key=5V0Q651D4VN2 tag=XXKF1YRO40IL type=del 2023-10-05T11:35:11.572 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.569+0000 7f26f5634780 1 > prepared part key=_multipart_U6172JUYW7J6.2~UWG7MSYVWYJU.0 size=1048576 2023-10-05T11:35:11.574 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.570+0000 7f26f5634780 1 > prepared part key=_multipart_U6172JUYW7J6.2~UWG7MSYVWYJU.1 size=615627 2023-10-05T11:35:11.574 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.570+0000 7f26f5634780 1 > prepared multipart upload key=U6172JUYW7J6 upload=UWG7MSYVWYJU tag=MZSPCA3IRLPH type=write size=2712779 2023-10-05T11:35:11.576 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.573+0000 7f26f5634780 1 < suggested update operation key=BTZUVE8R96XT tag=NM6GF40PFKZX type=del size=2062147 2023-10-05T11:35:11.578 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.575+0000 7f26f5634780 1 > prepared part key=_multipart_LLR5J3X15W5R.2~J9FIAI8WX2BS.0 size=1048576 2023-10-05T11:35:11.579 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.576+0000 7f26f5634780 1 > prepared part key=_multipart_LLR5J3X15W5R.2~J9FIAI8WX2BS.1 size=1048576 2023-10-05T11:35:11.581 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.577+0000 7f26f5634780 1 > prepared part key=_multipart_LLR5J3X15W5R.2~J9FIAI8WX2BS.2 size=928240 2023-10-05T11:35:11.581 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.577+0000 7f26f5634780 1 > prepared multipart upload key=LLR5J3X15W5R upload=J9FIAI8WX2BS tag=RDA8WV3F57L2 type=write size=4073968 2023-10-05T11:35:11.582 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.578+0000 7f26f5634780 1 < completed write operation key=MEY4SZRHU9NZ tag=WWG7Q4OWYN1T type=write size=839567 2023-10-05T11:35:11.584 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.581+0000 7f26f5634780 1 > prepared part key=_multipart_W2GWVGX42QLD.2~SIPC5LLU01JK.0 size=1048576 2023-10-05T11:35:11.585 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.581+0000 7f26f5634780 1 > prepared part key=_multipart_W2GWVGX42QLD.2~SIPC5LLU01JK.1 size=1048576 2023-10-05T11:35:11.586 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.582+0000 7f26f5634780 1 > prepared part key=_multipart_W2GWVGX42QLD.2~SIPC5LLU01JK.2 size=921276 2023-10-05T11:35:11.586 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.582+0000 7f26f5634780 1 > prepared multipart upload key=W2GWVGX42QLD upload=SIPC5LLU01JK tag=9PA7SKXECRVB type=write size=4067004 2023-10-05T11:35:11.587 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.584+0000 7f26f5634780 1 < canceled operation key=4IBQJLJR7LD8 tag=1935U9DT5451 type=del size=1166324 2023-10-05T11:35:11.588 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.585+0000 7f26f5634780 1 > prepared operation key=4IBQJLJR7LD8 tag=QH5L0GQD1PB5 type=del size=3980462 2023-10-05T11:35:11.590 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.586+0000 7f26f5634780 1 < completed part key=_multipart_IC7T3ZK81WQS.2~4GC8CG21O6JD.0 size=1048576 2023-10-05T11:35:11.591 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.587+0000 7f26f5634780 1 < completed part key=_multipart_IC7T3ZK81WQS.2~4GC8CG21O6JD.1 size=1048576 2023-10-05T11:35:11.592 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.588+0000 7f26f5634780 1 < completed part key=_multipart_IC7T3ZK81WQS.2~4GC8CG21O6JD.2 size=876904 2023-10-05T11:35:11.594 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.591+0000 7f26f5634780 1 < completed multipart upload key=IC7T3ZK81WQS upload=4GC8CG21O6JD tag=MGN4EH91HGK7 type=write size=4022632 2023-10-05T11:35:11.595 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.592+0000 7f26f5634780 1 > prepared operation key=2D4PDQQT54ZA tag=CWZF2Q4RLXZ5 type=del size=3721324 2023-10-05T11:35:11.597 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.594+0000 7f26f5634780 1 < completed write operation key=5V0Q651D4VN2 tag=RY3I21F94KOU type=write size=585310 2023-10-05T11:35:11.601 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.595+0000 7f26f5634780 1 > prepared operation key=WTCWG1C1SF89 tag=3JCIUFUU9P1E type=del size=3043549 2023-10-05T11:35:11.602 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.597+0000 7f26f5634780 1 < completed part key=_multipart_LLR5J3X15W5R.2~J9J04138PK3L.0 size=1048576 2023-10-05T11:35:11.602 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.598+0000 7f26f5634780 1 < completed part key=_multipart_LLR5J3X15W5R.2~J9J04138PK3L.1 size=897152 2023-10-05T11:35:11.603 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.600+0000 7f26f5634780 1 < completed multipart upload key=LLR5J3X15W5R upload=J9J04138PK3L tag=3WFSSWOI1WIV type=write size=2994304 2023-10-05T11:35:11.605 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.601+0000 7f26f5634780 1 > prepared operation key=S3DKYDFT4IO2 tag=7W5YWRVV7JMS type=write size=752236 2023-10-05T11:35:11.606 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.602+0000 7f26f5634780 1 < completed delete operation key=VJTFYDETLSFD tag=5S8RN83WGCID type=del 2023-10-05T11:35:11.608 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.605+0000 7f26f5634780 1 > prepared part key=_multipart_2U0NRDGDNUTA.2~GZZVULKKVZ59.0 size=1048576 2023-10-05T11:35:11.609 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.605+0000 7f26f5634780 1 > prepared part key=_multipart_2U0NRDGDNUTA.2~GZZVULKKVZ59.1 size=656529 2023-10-05T11:35:11.609 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.605+0000 7f26f5634780 1 > prepared multipart upload key=2U0NRDGDNUTA upload=GZZVULKKVZ59 tag=WTLDTYZBRDTY type=write size=2753681 2023-10-05T11:35:11.610 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.607+0000 7f26f5634780 1 < completed part key=_multipart_FOMNIIY47UUM.2~4OA2VRRW9YZH.0 size=1048576 2023-10-05T11:35:11.611 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.608+0000 7f26f5634780 1 < completed part key=_multipart_FOMNIIY47UUM.2~4OA2VRRW9YZH.1 size=1048576 2023-10-05T11:35:11.612 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.609+0000 7f26f5634780 1 < completed part key=_multipart_FOMNIIY47UUM.2~4OA2VRRW9YZH.2 size=437990 2023-10-05T11:35:11.614 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.611+0000 7f26f5634780 1 < completed multipart upload key=FOMNIIY47UUM upload=4OA2VRRW9YZH tag=BLQEIO8RQR99 type=write size=3583718 2023-10-05T11:35:11.615 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.612+0000 7f26f5634780 1 > prepared operation key=2D4PDQQT54ZA tag=6JCLSWH4LE1V type=write size=801009 2023-10-05T11:35:11.616 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.613+0000 7f26f5634780 1 < completed part key=_multipart_2D4PDQQT54ZA.2~Z0URULXNMAWA.0 size=1048576 2023-10-05T11:35:11.617 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.613+0000 7f26f5634780 1 < canceled part key=_multipart_2D4PDQQT54ZA.2~Z0URULXNMAWA.1 size=53725 2023-10-05T11:35:11.618 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.615+0000 7f26f5634780 1 < canceled multipart upload key=2D4PDQQT54ZA upload=Z0URULXNMAWA tag=LC11TLAS0BG2 type=write size=2150877 2023-10-05T11:35:11.620 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.617+0000 7f26f5634780 1 > prepared part key=_multipart_QYQDXVIGZ7O8.2~BYRZ62ZRWFKB.0 size=241336 2023-10-05T11:35:11.621 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.617+0000 7f26f5634780 1 > prepared multipart upload key=QYQDXVIGZ7O8 upload=BYRZ62ZRWFKB tag=G7N5N55GR9NJ type=write size=1289912 2023-10-05T11:35:11.622 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.618+0000 7f26f5634780 1 < completed part key=_multipart_7TOP5A52M9YP.2~DN4TPIF6C08S.0 size=1048576 2023-10-05T11:35:11.622 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.619+0000 7f26f5634780 1 < completed part key=_multipart_7TOP5A52M9YP.2~DN4TPIF6C08S.1 size=104601 2023-10-05T11:35:11.625 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.621+0000 7f26f5634780 1 < completed multipart upload key=7TOP5A52M9YP upload=DN4TPIF6C08S tag=P8EYONK26TQS type=write size=2201753 2023-10-05T11:35:11.626 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.623+0000 7f26f5634780 1 > prepared operation key=6DP3UJ4CW1MO tag=BGAZK2I9L8ET type=del size=3085958 2023-10-05T11:35:11.627 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.624+0000 7f26f5634780 1 < completed delete operation key=VJTFYDETLSFD tag=4HC4A7T8NN9F type=del 2023-10-05T11:35:11.629 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.625+0000 7f26f5634780 1 > prepared operation key=5OPHKTHXVN5U tag=IEFBPBZDP0F1 type=del size=456025 2023-10-05T11:35:11.630 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.626+0000 7f26f5634780 1 < completed part key=_multipart_VJTFYDETLSFD.2~R40P98HL0TU1.0 size=1048576 2023-10-05T11:35:11.630 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.626+0000 7f26f5634780 1 < canceled part key=_multipart_VJTFYDETLSFD.2~R40P98HL0TU1.1 size=211994 2023-10-05T11:35:11.631 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.628+0000 7f26f5634780 1 < canceled multipart upload key=VJTFYDETLSFD upload=R40P98HL0TU1 tag=KQ66B6XAMS9C type=write size=2309146 2023-10-05T11:35:11.633 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.629+0000 7f26f5634780 1 > prepared operation key=U6172JUYW7J6 tag=AEK1DEHWXZYO type=del size=3371607 2023-10-05T11:35:11.634 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.631+0000 7f26f5634780 -1 < failed to complete operation key=BTZUVE8R96XT tag=78JRDMEK40WI type=write size=775518: (22) Invalid argument 2023-10-05T11:35:11.636 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.632+0000 7f26f5634780 1 > prepared operation key=4D3H60UTIXH3 tag=Y70PJWV0ELBZ type=del size=3048381 2023-10-05T11:35:11.637 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.634+0000 7f26f5634780 1 < completed write operation key=BU3KSHTINB36 tag=QJD2YP8M9BT9 type=write size=807050 2023-10-05T11:35:11.639 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.635+0000 7f26f5634780 1 > prepared operation key=S3DKYDFT4IO2 tag=O6PG3PQUPOQ4 type=del size=48520 2023-10-05T11:35:11.640 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.637+0000 7f26f5634780 1 < canceled operation key=PC8WTJ8AYJ24 tag=8CAZICPQXNZP type=del size=4169216 2023-10-05T11:35:11.641 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.638+0000 7f26f5634780 1 > prepared operation key=WTCWG1C1SF89 tag=6WAJRAL14FXP type=del size=3444460 2023-10-05T11:35:11.643 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.639+0000 7f26f5634780 1 < completed part key=_multipart_U6172JUYW7J6.2~UWG7MSYVWYJU.0 size=1048576 2023-10-05T11:35:11.644 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.641+0000 7f26f5634780 1 < completed part key=_multipart_U6172JUYW7J6.2~UWG7MSYVWYJU.1 size=615627 2023-10-05T11:35:11.646 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.643+0000 7f26f5634780 1 < completed multipart upload key=U6172JUYW7J6 upload=UWG7MSYVWYJU tag=MZSPCA3IRLPH type=write size=2712779 2023-10-05T11:35:11.647 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.644+0000 7f26f5634780 1 > prepared operation key=4D3H60UTIXH3 tag=NSV8OXV3939C type=del size=3069455 2023-10-05T11:35:11.648 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.645+0000 7f26f5634780 1 < completed part key=_multipart_LLR5J3X15W5R.2~J9FIAI8WX2BS.0 size=1048576 2023-10-05T11:35:11.649 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.646+0000 7f26f5634780 1 < completed part key=_multipart_LLR5J3X15W5R.2~J9FIAI8WX2BS.1 size=1048576 2023-10-05T11:35:11.650 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.647+0000 7f26f5634780 1 < completed part key=_multipart_LLR5J3X15W5R.2~J9FIAI8WX2BS.2 size=928240 2023-10-05T11:35:11.652 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.649+0000 7f26f5634780 1 < completed multipart upload key=LLR5J3X15W5R upload=J9FIAI8WX2BS tag=RDA8WV3F57L2 type=write size=4073968 2023-10-05T11:35:11.654 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.651+0000 7f26f5634780 1 > prepared part key=_multipart_W2GWVGX42QLD.2~U4ZF39GW9EFN.0 size=1048576 2023-10-05T11:35:11.655 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.652+0000 7f26f5634780 1 > prepared part key=_multipart_W2GWVGX42QLD.2~U4ZF39GW9EFN.1 size=1048576 2023-10-05T11:35:11.656 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.653+0000 7f26f5634780 1 > prepared part key=_multipart_W2GWVGX42QLD.2~U4ZF39GW9EFN.2 size=1047073 2023-10-05T11:35:11.656 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.653+0000 7f26f5634780 1 > prepared multipart upload key=W2GWVGX42QLD upload=U4ZF39GW9EFN tag=L1443UOOUCP1 type=write size=4192801 2023-10-05T11:35:11.657 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.654+0000 7f26f5634780 1 < completed part key=_multipart_W2GWVGX42QLD.2~SIPC5LLU01JK.0 size=1048576 2023-10-05T11:35:11.658 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.654+0000 7f26f5634780 1 < canceled part key=_multipart_W2GWVGX42QLD.2~SIPC5LLU01JK.1 size=1048576 2023-10-05T11:35:11.658 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.655+0000 7f26f5634780 1 < completed part key=_multipart_W2GWVGX42QLD.2~SIPC5LLU01JK.2 size=921276 2023-10-05T11:35:11.660 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.657+0000 7f26f5634780 1 < canceled multipart upload key=W2GWVGX42QLD upload=SIPC5LLU01JK tag=9PA7SKXECRVB type=write size=4067004 2023-10-05T11:35:11.662 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.658+0000 7f26f5634780 1 > prepared operation key=4D3H60UTIXH3 tag=5F9GRQ59VNWT type=write size=85549 2023-10-05T11:35:11.664 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.661+0000 7f26f5634780 1 < suggested update operation key=4IBQJLJR7LD8 tag=QH5L0GQD1PB5 type=del size=3980462 2023-10-05T11:35:11.666 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.663+0000 7f26f5634780 1 > prepared part key=_multipart_8IPCP77WVVZT.2~TGXFH1SAKA8A.0 size=1048576 2023-10-05T11:35:11.667 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.664+0000 7f26f5634780 1 > prepared part key=_multipart_8IPCP77WVVZT.2~TGXFH1SAKA8A.1 size=930544 2023-10-05T11:35:11.667 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.664+0000 7f26f5634780 1 > prepared multipart upload key=8IPCP77WVVZT upload=TGXFH1SAKA8A tag=PXEAE3P1WCPP type=write size=3027696 2023-10-05T11:35:11.669 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.665+0000 7f26f5634780 1 < completed delete operation key=2D4PDQQT54ZA tag=CWZF2Q4RLXZ5 type=del 2023-10-05T11:35:11.670 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.666+0000 7f26f5634780 1 > prepared operation key=PNV0Q6ZPLYV0 tag=4LRG9PYQ158T type=del size=3556190 2023-10-05T11:35:11.673 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.670+0000 7f26f5634780 1 < suggested update operation key=WTCWG1C1SF89 tag=3JCIUFUU9P1E type=del size=3043549 2023-10-05T11:35:11.675 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.672+0000 7f26f5634780 1 > prepared operation key=MEY4SZRHU9NZ tag=JHM1QF1BDLQM type=del size=4022854 2023-10-05T11:35:11.676 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.673+0000 7f26f5634780 1 < completed write operation key=S3DKYDFT4IO2 tag=7W5YWRVV7JMS type=write size=752236 2023-10-05T11:35:11.678 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.674+0000 7f26f5634780 1 > prepared operation key=IKCNZOTVWOC6 tag=1180L1DEQC96 type=del size=1667847 2023-10-05T11:35:11.679 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.675+0000 7f26f5634780 1 < completed part key=_multipart_2U0NRDGDNUTA.2~GZZVULKKVZ59.0 size=1048576 2023-10-05T11:35:11.680 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.676+0000 7f26f5634780 1 < completed part key=_multipart_2U0NRDGDNUTA.2~GZZVULKKVZ59.1 size=656529 2023-10-05T11:35:11.682 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.679+0000 7f26f5634780 1 < completed multipart upload key=2U0NRDGDNUTA upload=GZZVULKKVZ59 tag=WTLDTYZBRDTY type=write size=2753681 2023-10-05T11:35:11.684 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.681+0000 7f26f5634780 1 > prepared part key=_multipart_9S0YW7PPSJ8G.2~XDD2IOIM5CWY.0 size=1048576 2023-10-05T11:35:11.685 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.682+0000 7f26f5634780 1 > prepared part key=_multipart_9S0YW7PPSJ8G.2~XDD2IOIM5CWY.1 size=1048576 2023-10-05T11:35:11.686 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.683+0000 7f26f5634780 1 > prepared part key=_multipart_9S0YW7PPSJ8G.2~XDD2IOIM5CWY.2 size=223830 2023-10-05T11:35:11.686 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.683+0000 7f26f5634780 1 > prepared multipart upload key=9S0YW7PPSJ8G upload=XDD2IOIM5CWY tag=A5QA2YA632EY type=write size=3369558 2023-10-05T11:35:11.687 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.684+0000 7f26f5634780 1 < completed write operation key=2D4PDQQT54ZA tag=6JCLSWH4LE1V type=write size=801009 2023-10-05T11:35:11.689 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.686+0000 7f26f5634780 1 > prepared part key=_multipart_BU3KSHTINB36.2~ELZ3OCJV9EFQ.0 size=1048576 2023-10-05T11:35:11.691 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.687+0000 7f26f5634780 1 > prepared part key=_multipart_BU3KSHTINB36.2~ELZ3OCJV9EFQ.1 size=1048576 2023-10-05T11:35:11.692 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.688+0000 7f26f5634780 1 > prepared part key=_multipart_BU3KSHTINB36.2~ELZ3OCJV9EFQ.2 size=106771 2023-10-05T11:35:11.692 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.688+0000 7f26f5634780 1 > prepared multipart upload key=BU3KSHTINB36 upload=ELZ3OCJV9EFQ tag=924A3INP7RUS type=write size=3252499 2023-10-05T11:35:11.693 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.690+0000 7f26f5634780 1 < completed part key=_multipart_QYQDXVIGZ7O8.2~BYRZ62ZRWFKB.0 size=241336 2023-10-05T11:35:11.695 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.692+0000 7f26f5634780 1 < completed multipart upload key=QYQDXVIGZ7O8 upload=BYRZ62ZRWFKB tag=G7N5N55GR9NJ type=write size=1289912 2023-10-05T11:35:11.697 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.693+0000 7f26f5634780 1 > prepared operation key=4D3H60UTIXH3 tag=UY2NEUGXEZTZ type=write size=591151 2023-10-05T11:35:11.699 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.696+0000 7f26f5634780 1 < suggested update operation key=6DP3UJ4CW1MO tag=BGAZK2I9L8ET type=del size=3085958 2023-10-05T11:35:11.701 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.698+0000 7f26f5634780 1 > prepared operation key=5V0Q651D4VN2 tag=OA5X063BDZFU type=del size=262979 2023-10-05T11:35:11.702 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.699+0000 7f26f5634780 1 < completed delete operation key=5OPHKTHXVN5U tag=IEFBPBZDP0F1 type=del 2023-10-05T11:35:11.705 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.702+0000 7f26f5634780 1 > prepared part key=_multipart_0PWYKC7S6YJ4.2~L98KWNPLU051.0 size=553749 2023-10-05T11:35:11.705 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.702+0000 7f26f5634780 1 > prepared multipart upload key=0PWYKC7S6YJ4 upload=L98KWNPLU051 tag=GUE0P7SF4H1O type=write size=1602325 2023-10-05T11:35:11.708 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.705+0000 7f26f5634780 1 < suggested update operation key=U6172JUYW7J6 tag=AEK1DEHWXZYO type=del size=3371607 2023-10-05T11:35:11.710 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.707+0000 7f26f5634780 1 > prepared part key=_multipart_BU3KSHTINB36.2~I5A923QETXPY.0 size=1048576 2023-10-05T11:35:11.712 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.708+0000 7f26f5634780 1 > prepared part key=_multipart_BU3KSHTINB36.2~I5A923QETXPY.1 size=174445 2023-10-05T11:35:11.712 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.708+0000 7f26f5634780 1 > prepared multipart upload key=BU3KSHTINB36 upload=I5A923QETXPY tag=J7C8PLL2OQNG type=write size=2271597 2023-10-05T11:35:11.713 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.710+0000 7f26f5634780 1 < completed delete operation key=4D3H60UTIXH3 tag=Y70PJWV0ELBZ type=del 2023-10-05T11:35:11.714 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.711+0000 7f26f5634780 1 > prepared operation key=PNV0Q6ZPLYV0 tag=XGLKFOCR6TS2 type=del size=300506 2023-10-05T11:35:11.716 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.713+0000 7f26f5634780 1 < completed delete operation key=S3DKYDFT4IO2 tag=O6PG3PQUPOQ4 type=del 2023-10-05T11:35:11.717 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.714+0000 7f26f5634780 1 > prepared operation key=0PWYKC7S6YJ4 tag=U4NVPHONGHSQ type=del size=3494190 2023-10-05T11:35:11.720 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.717+0000 7f26f5634780 1 < suggested remove operation key=WTCWG1C1SF89 tag=6WAJRAL14FXP type=del 2023-10-05T11:35:11.722 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.718+0000 7f26f5634780 1 > prepared operation key=WYN9BG66LA3K tag=AJ3CRC7Q8HIN type=del size=3992828 2023-10-05T11:35:11.723 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.720+0000 7f26f5634780 1 < completed delete operation key=4D3H60UTIXH3 tag=NSV8OXV3939C type=del 2023-10-05T11:35:11.724 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.721+0000 7f26f5634780 1 > prepared operation key=PNV0Q6ZPLYV0 tag=S0KBIBRWI2E7 type=del size=3506560 2023-10-05T11:35:11.726 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.723+0000 7f26f5634780 1 < completed part key=_multipart_W2GWVGX42QLD.2~U4ZF39GW9EFN.0 size=1048576 2023-10-05T11:35:11.727 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.724+0000 7f26f5634780 1 < completed part key=_multipart_W2GWVGX42QLD.2~U4ZF39GW9EFN.1 size=1048576 2023-10-05T11:35:11.728 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.725+0000 7f26f5634780 1 < completed part key=_multipart_W2GWVGX42QLD.2~U4ZF39GW9EFN.2 size=1047073 2023-10-05T11:35:11.730 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.727+0000 7f26f5634780 1 < completed multipart upload key=W2GWVGX42QLD upload=U4ZF39GW9EFN tag=L1443UOOUCP1 type=write size=4192801 2023-10-05T11:35:11.731 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.728+0000 7f26f5634780 1 > prepared operation key=4D3H60UTIXH3 tag=BK6W0KTO4XUO type=del size=338320 2023-10-05T11:35:11.733 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.729+0000 7f26f5634780 1 < canceled operation key=4D3H60UTIXH3 tag=5F9GRQ59VNWT type=write size=85549 2023-10-05T11:35:11.734 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.730+0000 7f26f5634780 1 > prepared operation key=PC8WTJ8AYJ24 tag=1E0JRJOZV45G type=write size=25261 2023-10-05T11:35:11.734 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.731+0000 7f26f5634780 1 < canceled part key=_multipart_8IPCP77WVVZT.2~TGXFH1SAKA8A.0 size=1048576 2023-10-05T11:35:11.735 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.732+0000 7f26f5634780 1 < completed part key=_multipart_8IPCP77WVVZT.2~TGXFH1SAKA8A.1 size=930544 2023-10-05T11:35:11.737 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.734+0000 7f26f5634780 1 < canceled multipart upload key=8IPCP77WVVZT upload=TGXFH1SAKA8A tag=PXEAE3P1WCPP type=write size=3027696 2023-10-05T11:35:11.739 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.735+0000 7f26f5634780 1 > prepared operation key=PC8WTJ8AYJ24 tag=CC8Z0T3BOLEO type=del size=2358688 2023-10-05T11:35:11.740 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.737+0000 7f26f5634780 1 < canceled operation key=PNV0Q6ZPLYV0 tag=4LRG9PYQ158T type=del size=3556190 2023-10-05T11:35:11.741 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.738+0000 7f26f5634780 1 > prepared operation key=761J2C7GHWU5 tag=9NZ401BQYRSO type=del size=476796 2023-10-05T11:35:11.742 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.739+0000 7f26f5634780 1 < completed delete operation key=MEY4SZRHU9NZ tag=JHM1QF1BDLQM type=del 2023-10-05T11:35:11.744 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.740+0000 7f26f5634780 1 > prepared operation key=IC7T3ZK81WQS tag=XWKX6DH22WND type=write size=441657 2023-10-05T11:35:11.745 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.742+0000 7f26f5634780 1 < completed delete operation key=IKCNZOTVWOC6 tag=1180L1DEQC96 type=del 2023-10-05T11:35:11.747 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.744+0000 7f26f5634780 1 > prepared part key=_multipart_2U0NRDGDNUTA.2~NKI8NVVU1W3Q.0 size=432463 2023-10-05T11:35:11.748 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.744+0000 7f26f5634780 1 > prepared multipart upload key=2U0NRDGDNUTA upload=NKI8NVVU1W3Q tag=AKNVZVV3FYJ1 type=write size=1481039 2023-10-05T11:35:11.748 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.744+0000 7f26f5634780 1 < canceled part key=_multipart_9S0YW7PPSJ8G.2~XDD2IOIM5CWY.0 size=1048576 2023-10-05T11:35:11.749 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.745+0000 7f26f5634780 1 < completed part key=_multipart_9S0YW7PPSJ8G.2~XDD2IOIM5CWY.1 size=1048576 2023-10-05T11:35:11.749 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.745+0000 7f26f5634780 1 < canceled part key=_multipart_9S0YW7PPSJ8G.2~XDD2IOIM5CWY.2 size=223830 2023-10-05T11:35:11.751 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.747+0000 7f26f5634780 1 < canceled multipart upload key=9S0YW7PPSJ8G upload=XDD2IOIM5CWY tag=A5QA2YA632EY type=write size=3369558 2023-10-05T11:35:11.753 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.749+0000 7f26f5634780 1 > prepared part key=_multipart_8IPCP77WVVZT.2~Y1QV986FAD1B.0 size=608265 2023-10-05T11:35:11.753 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.749+0000 7f26f5634780 1 > prepared multipart upload key=8IPCP77WVVZT upload=Y1QV986FAD1B tag=AB44874HRAVK type=write size=1656841 2023-10-05T11:35:11.754 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.751+0000 7f26f5634780 1 < completed part key=_multipart_BU3KSHTINB36.2~ELZ3OCJV9EFQ.0 size=1048576 2023-10-05T11:35:11.755 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.752+0000 7f26f5634780 1 < completed part key=_multipart_BU3KSHTINB36.2~ELZ3OCJV9EFQ.1 size=1048576 2023-10-05T11:35:11.756 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.753+0000 7f26f5634780 1 < completed part key=_multipart_BU3KSHTINB36.2~ELZ3OCJV9EFQ.2 size=106771 2023-10-05T11:35:11.759 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.755+0000 7f26f5634780 1 < completed multipart upload key=BU3KSHTINB36 upload=ELZ3OCJV9EFQ tag=924A3INP7RUS type=write size=3252499 2023-10-05T11:35:11.760 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.756+0000 7f26f5634780 1 > prepared operation key=WTCWG1C1SF89 tag=TVZTA9XXHDLY type=del size=143198 2023-10-05T11:35:11.761 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.758+0000 7f26f5634780 1 < completed write operation key=4D3H60UTIXH3 tag=UY2NEUGXEZTZ type=write size=591151 2023-10-05T11:35:11.762 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.759+0000 7f26f5634780 1 > prepared operation key=PNV0Q6ZPLYV0 tag=RBL943G81TOH type=del size=3385769 2023-10-05T11:35:11.764 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.760+0000 7f26f5634780 1 < completed delete operation key=5V0Q651D4VN2 tag=OA5X063BDZFU type=del 2023-10-05T11:35:11.766 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.763+0000 7f26f5634780 1 > prepared part key=_multipart_NV4Q36UOLX8A.2~TG3KDR0QC3OT.0 size=58283 2023-10-05T11:35:11.766 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.763+0000 7f26f5634780 1 > prepared multipart upload key=NV4Q36UOLX8A upload=TG3KDR0QC3OT tag=6QVYN98PHKLB type=write size=1106859 2023-10-05T11:35:11.767 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.764+0000 7f26f5634780 1 < completed part key=_multipart_0PWYKC7S6YJ4.2~L98KWNPLU051.0 size=553749 2023-10-05T11:35:11.769 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.766+0000 7f26f5634780 1 < completed multipart upload key=0PWYKC7S6YJ4 upload=L98KWNPLU051 tag=GUE0P7SF4H1O type=write size=1602325 2023-10-05T11:35:11.771 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.768+0000 7f26f5634780 1 > prepared part key=_multipart_MEY4SZRHU9NZ.2~H7EFOYT224Q5.0 size=1048576 2023-10-05T11:35:11.772 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.769+0000 7f26f5634780 1 > prepared part key=_multipart_MEY4SZRHU9NZ.2~H7EFOYT224Q5.1 size=873588 2023-10-05T11:35:11.772 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.769+0000 7f26f5634780 1 > prepared multipart upload key=MEY4SZRHU9NZ upload=H7EFOYT224Q5 tag=9SNRYRU3BMBN type=write size=2970740 2023-10-05T11:35:11.773 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.770+0000 7f26f5634780 1 < completed part key=_multipart_BU3KSHTINB36.2~I5A923QETXPY.0 size=1048576 2023-10-05T11:35:11.774 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.771+0000 7f26f5634780 1 < completed part key=_multipart_BU3KSHTINB36.2~I5A923QETXPY.1 size=174445 2023-10-05T11:35:11.776 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.773+0000 7f26f5634780 1 < completed multipart upload key=BU3KSHTINB36 upload=I5A923QETXPY tag=J7C8PLL2OQNG type=write size=2271597 2023-10-05T11:35:11.779 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.775+0000 7f26f5634780 1 > prepared part key=_multipart_U6172JUYW7J6.2~8LN0T6PP3MH1.0 size=34952 2023-10-05T11:35:11.779 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.775+0000 7f26f5634780 1 > prepared multipart upload key=U6172JUYW7J6 upload=8LN0T6PP3MH1 tag=YEKB1A32PWAT type=write size=1083528 2023-10-05T11:35:11.782 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.779+0000 7f26f5634780 1 < completed delete operation key=PNV0Q6ZPLYV0 tag=XGLKFOCR6TS2 type=del 2023-10-05T11:35:11.785 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.782+0000 7f26f5634780 1 > prepared part key=_multipart_BU3KSHTINB36.2~8KZ919WPBZI1.0 size=1048576 2023-10-05T11:35:11.786 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.783+0000 7f26f5634780 1 > prepared part key=_multipart_BU3KSHTINB36.2~8KZ919WPBZI1.1 size=1048576 2023-10-05T11:35:11.787 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.784+0000 7f26f5634780 1 > prepared part key=_multipart_BU3KSHTINB36.2~8KZ919WPBZI1.2 size=137906 2023-10-05T11:35:11.787 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.784+0000 7f26f5634780 1 > prepared multipart upload key=BU3KSHTINB36 upload=8KZ919WPBZI1 tag=T66BDJ7AX08L type=write size=3283634 2023-10-05T11:35:11.789 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.786+0000 7f26f5634780 1 < suggested update operation key=0PWYKC7S6YJ4 tag=U4NVPHONGHSQ type=del size=3494190 2023-10-05T11:35:11.790 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.787+0000 7f26f5634780 1 > prepared operation key=WYN9BG66LA3K tag=NCDTRM76JK6N type=del size=511526 2023-10-05T11:35:11.792 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.788+0000 7f26f5634780 1 < completed delete operation key=WYN9BG66LA3K tag=AJ3CRC7Q8HIN type=del 2023-10-05T11:35:11.793 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.790+0000 7f26f5634780 1 > prepared operation key=BTZUVE8R96XT tag=RFA4VRPSFZ67 type=write size=715591 2023-10-05T11:35:11.794 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.791+0000 7f26f5634780 1 < completed delete operation key=PNV0Q6ZPLYV0 tag=S0KBIBRWI2E7 type=del 2023-10-05T11:35:11.797 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.793+0000 7f26f5634780 1 > prepared operation key=PNV0Q6ZPLYV0 tag=UURDPUIJYHEQ type=del size=2681155 2023-10-05T11:35:11.798 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.795+0000 7f26f5634780 1 < completed delete operation key=4D3H60UTIXH3 tag=BK6W0KTO4XUO type=del 2023-10-05T11:35:11.801 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.798+0000 7f26f5634780 1 > prepared part key=_multipart_8IPCP77WVVZT.2~1YY2P13882N7.0 size=1048576 2023-10-05T11:35:11.802 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.799+0000 7f26f5634780 1 > prepared part key=_multipart_8IPCP77WVVZT.2~1YY2P13882N7.1 size=289974 2023-10-05T11:35:11.802 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.799+0000 7f26f5634780 1 > prepared multipart upload key=8IPCP77WVVZT upload=1YY2P13882N7 tag=Y5W7JYU4Y92E type=write size=2387126 2023-10-05T11:35:11.804 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.800+0000 7f26f5634780 1 < completed write operation key=PC8WTJ8AYJ24 tag=1E0JRJOZV45G type=write size=25261 2023-10-05T11:35:11.805 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.802+0000 7f26f5634780 1 > prepared operation key=J5EIH25Y471T tag=ER96MIYX294A type=write size=861995 2023-10-05T11:35:11.806 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.803+0000 7f26f5634780 1 < completed delete operation key=PC8WTJ8AYJ24 tag=CC8Z0T3BOLEO type=del 2023-10-05T11:35:11.809 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.805+0000 7f26f5634780 1 > prepared part key=_multipart_MEY4SZRHU9NZ.2~T8G9XY86715X.0 size=381103 2023-10-05T11:35:11.809 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.805+0000 7f26f5634780 1 > prepared multipart upload key=MEY4SZRHU9NZ upload=T8G9XY86715X tag=HRXN18L8FRTB type=write size=1429679 2023-10-05T11:35:11.810 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.806+0000 7f26f5634780 1 < completed delete operation key=761J2C7GHWU5 tag=9NZ401BQYRSO type=del 2023-10-05T11:35:11.811 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.807+0000 7f26f5634780 1 > prepared operation key=5OPHKTHXVN5U tag=SFVPWVN4TBVI type=del size=1607149 2023-10-05T11:35:11.812 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.809+0000 7f26f5634780 1 < completed write operation key=IC7T3ZK81WQS tag=XWKX6DH22WND type=write size=441657 2023-10-05T11:35:11.813 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.810+0000 7f26f5634780 1 > prepared operation key=QYQDXVIGZ7O8 tag=NNG8EA7A6Z1Z type=write size=454381 2023-10-05T11:35:11.815 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.811+0000 7f26f5634780 1 < completed part key=_multipart_2U0NRDGDNUTA.2~NKI8NVVU1W3Q.0 size=432463 2023-10-05T11:35:11.817 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.813+0000 7f26f5634780 1 < completed multipart upload key=2U0NRDGDNUTA upload=NKI8NVVU1W3Q tag=AKNVZVV3FYJ1 type=write size=1481039 2023-10-05T11:35:11.818 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.815+0000 7f26f5634780 1 > prepared operation key=PC8WTJ8AYJ24 tag=91T9A9R3NZJZ type=del size=1285269 2023-10-05T11:35:11.819 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.816+0000 7f26f5634780 1 < completed part key=_multipart_8IPCP77WVVZT.2~Y1QV986FAD1B.0 size=608265 2023-10-05T11:35:11.821 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.818+0000 7f26f5634780 1 < completed multipart upload key=8IPCP77WVVZT upload=Y1QV986FAD1B tag=AB44874HRAVK type=write size=1656841 2023-10-05T11:35:11.824 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.820+0000 7f26f5634780 1 > prepared part key=_multipart_J5EIH25Y471T.2~SBIG3ZNDVKR2.0 size=1048576 2023-10-05T11:35:11.825 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.821+0000 7f26f5634780 1 > prepared part key=_multipart_J5EIH25Y471T.2~SBIG3ZNDVKR2.1 size=939613 2023-10-05T11:35:11.825 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.821+0000 7f26f5634780 1 > prepared multipart upload key=J5EIH25Y471T upload=SBIG3ZNDVKR2 tag=HSTU9F5VYOX0 type=write size=3036765 2023-10-05T11:35:11.826 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.822+0000 7f26f5634780 1 < completed delete operation key=WTCWG1C1SF89 tag=TVZTA9XXHDLY type=del 2023-10-05T11:35:11.827 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.824+0000 7f26f5634780 1 > prepared operation key=LLR5J3X15W5R tag=1Y0FBLON7MBU type=write size=898798 2023-10-05T11:35:11.828 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.825+0000 7f26f5634780 1 < completed delete operation key=PNV0Q6ZPLYV0 tag=RBL943G81TOH type=del 2023-10-05T11:35:11.829 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.826+0000 7f26f5634780 1 > prepared operation key=W2GWVGX42QLD tag=0TZ4LNQPGLBV type=del size=1452664 2023-10-05T11:35:11.831 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.827+0000 7f26f5634780 1 < completed part key=_multipart_NV4Q36UOLX8A.2~TG3KDR0QC3OT.0 size=58283 2023-10-05T11:35:11.833 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.829+0000 7f26f5634780 1 < completed multipart upload key=NV4Q36UOLX8A upload=TG3KDR0QC3OT tag=6QVYN98PHKLB type=write size=1106859 2023-10-05T11:35:11.834 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.831+0000 7f26f5634780 1 > prepared operation key=BTZUVE8R96XT tag=7G4OD53KYEVZ type=del size=2102368 2023-10-05T11:35:11.835 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.832+0000 7f26f5634780 1 < completed part key=_multipart_MEY4SZRHU9NZ.2~H7EFOYT224Q5.0 size=1048576 2023-10-05T11:35:11.836 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.833+0000 7f26f5634780 1 < completed part key=_multipart_MEY4SZRHU9NZ.2~H7EFOYT224Q5.1 size=873588 2023-10-05T11:35:11.838 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.835+0000 7f26f5634780 1 < completed multipart upload key=MEY4SZRHU9NZ upload=H7EFOYT224Q5 tag=9SNRYRU3BMBN type=write size=2970740 2023-10-05T11:35:11.839 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.836+0000 7f26f5634780 1 > prepared operation key=BU3KSHTINB36 tag=I27T7C6R9HLQ type=del size=2168392 2023-10-05T11:35:11.840 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.837+0000 7f26f5634780 1 < completed part key=_multipart_U6172JUYW7J6.2~8LN0T6PP3MH1.0 size=34952 2023-10-05T11:35:11.843 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.839+0000 7f26f5634780 1 < completed multipart upload key=U6172JUYW7J6 upload=8LN0T6PP3MH1 tag=YEKB1A32PWAT type=write size=1083528 2023-10-05T11:35:11.845 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.842+0000 7f26f5634780 1 > prepared part key=_multipart_VJTFYDETLSFD.2~BZ708MJ0SVJO.0 size=1048576 2023-10-05T11:35:11.846 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.843+0000 7f26f5634780 1 > prepared part key=_multipart_VJTFYDETLSFD.2~BZ708MJ0SVJO.1 size=879543 2023-10-05T11:35:11.846 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.843+0000 7f26f5634780 1 > prepared multipart upload key=VJTFYDETLSFD upload=BZ708MJ0SVJO tag=6J5LM41TLM0V type=write size=2976695 2023-10-05T11:35:11.847 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.844+0000 7f26f5634780 1 < completed part key=_multipart_BU3KSHTINB36.2~8KZ919WPBZI1.0 size=1048576 2023-10-05T11:35:11.848 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.845+0000 7f26f5634780 1 < completed part key=_multipart_BU3KSHTINB36.2~8KZ919WPBZI1.1 size=1048576 2023-10-05T11:35:11.849 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.846+0000 7f26f5634780 1 < completed part key=_multipart_BU3KSHTINB36.2~8KZ919WPBZI1.2 size=137906 2023-10-05T11:35:11.852 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.848+0000 7f26f5634780 1 < completed multipart upload key=BU3KSHTINB36 upload=8KZ919WPBZI1 tag=T66BDJ7AX08L type=write size=3283634 2023-10-05T11:35:11.854 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.850+0000 7f26f5634780 1 > prepared part key=_multipart_MEY4SZRHU9NZ.2~P5QVWWDLOPPI.0 size=985016 2023-10-05T11:35:11.854 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.850+0000 7f26f5634780 1 > prepared multipart upload key=MEY4SZRHU9NZ upload=P5QVWWDLOPPI tag=VBEM0VFD1LGU type=write size=2033592 2023-10-05T11:35:11.855 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.852+0000 7f26f5634780 1 < completed delete operation key=WYN9BG66LA3K tag=NCDTRM76JK6N type=del 2023-10-05T11:35:11.857 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.854+0000 7f26f5634780 1 > prepared part key=_multipart_W2GWVGX42QLD.2~L3SHL92M8L0Q.0 size=1048576 2023-10-05T11:35:11.858 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.855+0000 7f26f5634780 1 > prepared part key=_multipart_W2GWVGX42QLD.2~L3SHL92M8L0Q.1 size=630933 2023-10-05T11:35:11.858 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.855+0000 7f26f5634780 1 > prepared multipart upload key=W2GWVGX42QLD upload=L3SHL92M8L0Q tag=I153425N7HPJ type=write size=2728085 2023-10-05T11:35:11.860 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.856+0000 7f26f5634780 1 < completed write operation key=BTZUVE8R96XT tag=RFA4VRPSFZ67 type=write size=715591 2023-10-05T11:35:11.862 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.858+0000 7f26f5634780 1 > prepared part key=_multipart_FOMNIIY47UUM.2~8C6083Y2TSRO.0 size=1048576 2023-10-05T11:35:11.863 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.859+0000 7f26f5634780 1 > prepared part key=_multipart_FOMNIIY47UUM.2~8C6083Y2TSRO.1 size=1048576 2023-10-05T11:35:11.864 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.860+0000 7f26f5634780 1 > prepared part key=_multipart_FOMNIIY47UUM.2~8C6083Y2TSRO.2 size=104092 2023-10-05T11:35:11.864 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.860+0000 7f26f5634780 1 > prepared multipart upload key=FOMNIIY47UUM upload=8C6083Y2TSRO tag=7HPY8TWG351D type=write size=3249820 2023-10-05T11:35:11.865 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.862+0000 7f26f5634780 1 < completed delete operation key=PNV0Q6ZPLYV0 tag=UURDPUIJYHEQ type=del 2023-10-05T11:35:11.866 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.863+0000 7f26f5634780 1 > prepared operation key=W2GWVGX42QLD tag=9JZY356B51MK type=del size=3746293 2023-10-05T11:35:11.868 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.864+0000 7f26f5634780 1 < completed part key=_multipart_8IPCP77WVVZT.2~1YY2P13882N7.0 size=1048576 2023-10-05T11:35:11.868 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.865+0000 7f26f5634780 1 < completed part key=_multipart_8IPCP77WVVZT.2~1YY2P13882N7.1 size=289974 2023-10-05T11:35:11.871 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.867+0000 7f26f5634780 1 < completed multipart upload key=8IPCP77WVVZT upload=1YY2P13882N7 tag=Y5W7JYU4Y92E type=write size=2387126 2023-10-05T11:35:11.872 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.868+0000 7f26f5634780 1 > prepared operation key=2U0NRDGDNUTA tag=XGCHUJBUU8WX type=del size=2262687 2023-10-05T11:35:11.874 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.871+0000 7f26f5634780 1 < suggested update operation key=J5EIH25Y471T tag=ER96MIYX294A type=write size=861995 2023-10-05T11:35:11.876 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.873+0000 7f26f5634780 1 > prepared part key=_multipart_NV4Q36UOLX8A.2~CG9YVMDV6ZH1.0 size=211498 2023-10-05T11:35:11.876 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.873+0000 7f26f5634780 1 > prepared multipart upload key=NV4Q36UOLX8A upload=CG9YVMDV6ZH1 tag=Q442AD725QZO type=write size=1260074 2023-10-05T11:35:11.877 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.874+0000 7f26f5634780 1 < completed part key=_multipart_MEY4SZRHU9NZ.2~T8G9XY86715X.0 size=381103 2023-10-05T11:35:11.879 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.876+0000 7f26f5634780 1 < completed multipart upload key=MEY4SZRHU9NZ upload=T8G9XY86715X tag=HRXN18L8FRTB type=write size=1429679 2023-10-05T11:35:11.880 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.877+0000 7f26f5634780 1 > prepared operation key=AV0XKXX1IR4B tag=ZD9OJLYU40HT type=write size=682417 2023-10-05T11:35:11.883 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.879+0000 7f26f5634780 1 < suggested update operation key=5OPHKTHXVN5U tag=SFVPWVN4TBVI type=del size=1607149 2023-10-05T11:35:11.884 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.881+0000 7f26f5634780 1 > prepared operation key=7W9LL5HSU3BG tag=Z26GGRPJ7PKK type=write size=159404 2023-10-05T11:35:11.885 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.882+0000 7f26f5634780 1 < completed write operation key=QYQDXVIGZ7O8 tag=NNG8EA7A6Z1Z type=write size=454381 2023-10-05T11:35:11.886 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.883+0000 7f26f5634780 1 > prepared operation key=WYN9BG66LA3K tag=UA64KBOYGOCP type=del size=4107049 2023-10-05T11:35:11.888 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.885+0000 7f26f5634780 1 < suggested remove operation key=PC8WTJ8AYJ24 tag=91T9A9R3NZJZ type=del 2023-10-05T11:35:11.890 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.886+0000 7f26f5634780 1 > prepared operation key=J5EIH25Y471T tag=QIPSA27PY5S6 type=del size=292635 2023-10-05T11:35:11.891 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.888+0000 7f26f5634780 1 < completed part key=_multipart_J5EIH25Y471T.2~SBIG3ZNDVKR2.0 size=1048576 2023-10-05T11:35:11.891 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.888+0000 7f26f5634780 1 < canceled part key=_multipart_J5EIH25Y471T.2~SBIG3ZNDVKR2.1 size=939613 2023-10-05T11:35:11.893 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.889+0000 7f26f5634780 1 < canceled multipart upload key=J5EIH25Y471T upload=SBIG3ZNDVKR2 tag=HSTU9F5VYOX0 type=write size=3036765 2023-10-05T11:35:11.894 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.891+0000 7f26f5634780 1 > prepared operation key=5V0Q651D4VN2 tag=V8XJPTRCWT25 type=del size=3900154 2023-10-05T11:35:11.895 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.892+0000 7f26f5634780 1 < completed write operation key=LLR5J3X15W5R tag=1Y0FBLON7MBU type=write size=898798 2023-10-05T11:35:11.896 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.893+0000 7f26f5634780 1 > prepared operation key=PC8WTJ8AYJ24 tag=GQDMPZO1Z84M type=del size=310637 2023-10-05T11:35:11.898 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.894+0000 7f26f5634780 1 < completed delete operation key=W2GWVGX42QLD tag=0TZ4LNQPGLBV type=del 2023-10-05T11:35:11.900 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.896+0000 7f26f5634780 1 > prepared part key=_multipart_IKCNZOTVWOC6.2~AXXKLZNX0ZKK.0 size=1048576 2023-10-05T11:35:11.901 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.897+0000 7f26f5634780 1 > prepared part key=_multipart_IKCNZOTVWOC6.2~AXXKLZNX0ZKK.1 size=113104 2023-10-05T11:35:11.901 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.897+0000 7f26f5634780 1 > prepared multipart upload key=IKCNZOTVWOC6 upload=AXXKLZNX0ZKK tag=DWA45AKZ343I type=write size=2210256 2023-10-05T11:35:11.902 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.899+0000 7f26f5634780 1 < completed delete operation key=BTZUVE8R96XT tag=7G4OD53KYEVZ type=del 2023-10-05T11:35:11.903 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.900+0000 7f26f5634780 1 > prepared operation key=U6172JUYW7J6 tag=XNSYUCGFEJY7 type=del size=3515649 2023-10-05T11:35:11.904 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.901+0000 7f26f5634780 1 < canceled operation key=BU3KSHTINB36 tag=I27T7C6R9HLQ type=del size=2168392 2023-10-05T11:35:11.906 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.902+0000 7f26f5634780 1 > prepared operation key=BTZUVE8R96XT tag=HOCF9PVOQK6O type=del size=4119512 2023-10-05T11:35:11.906 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.903+0000 7f26f5634780 1 < canceled part key=_multipart_VJTFYDETLSFD.2~BZ708MJ0SVJO.0 size=1048576 2023-10-05T11:35:11.907 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.904+0000 7f26f5634780 1 < completed part key=_multipart_VJTFYDETLSFD.2~BZ708MJ0SVJO.1 size=879543 2023-10-05T11:35:11.909 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.906+0000 7f26f5634780 1 < canceled multipart upload key=VJTFYDETLSFD upload=BZ708MJ0SVJO tag=6J5LM41TLM0V type=write size=2976695 2023-10-05T11:35:11.910 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.907+0000 7f26f5634780 1 > prepared operation key=5OPHKTHXVN5U tag=KK9Q2H41EL12 type=del size=1802738 2023-10-05T11:35:11.913 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.910+0000 7f26f5634780 1 < completed part key=_multipart_MEY4SZRHU9NZ.2~P5QVWWDLOPPI.0 size=985016 2023-10-05T11:35:11.918 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.915+0000 7f26f5634780 1 < completed multipart upload key=MEY4SZRHU9NZ upload=P5QVWWDLOPPI tag=VBEM0VFD1LGU type=write size=2033592 2023-10-05T11:35:11.920 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.916+0000 7f26f5634780 1 > prepared operation key=4D3H60UTIXH3 tag=L0M9KA410F98 type=del size=1475664 2023-10-05T11:35:11.921 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.917+0000 7f26f5634780 1 < completed part key=_multipart_W2GWVGX42QLD.2~L3SHL92M8L0Q.0 size=1048576 2023-10-05T11:35:11.921 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.917+0000 7f26f5634780 1 < canceled part key=_multipart_W2GWVGX42QLD.2~L3SHL92M8L0Q.1 size=630933 2023-10-05T11:35:11.923 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.920+0000 7f26f5634780 1 < canceled multipart upload key=W2GWVGX42QLD upload=L3SHL92M8L0Q tag=I153425N7HPJ type=write size=2728085 2023-10-05T11:35:11.926 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.922+0000 7f26f5634780 1 > prepared part key=_multipart_U6172JUYW7J6.2~YUL3R3KJCMZ2.0 size=1048576 2023-10-05T11:35:11.927 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.923+0000 7f26f5634780 1 > prepared part key=_multipart_U6172JUYW7J6.2~YUL3R3KJCMZ2.1 size=842015 2023-10-05T11:35:11.927 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.923+0000 7f26f5634780 1 > prepared multipart upload key=U6172JUYW7J6 upload=YUL3R3KJCMZ2 tag=W243HGE40123 type=write size=2939167 2023-10-05T11:35:11.928 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.925+0000 7f26f5634780 1 < completed part key=_multipart_FOMNIIY47UUM.2~8C6083Y2TSRO.0 size=1048576 2023-10-05T11:35:11.928 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.925+0000 7f26f5634780 1 < canceled part key=_multipart_FOMNIIY47UUM.2~8C6083Y2TSRO.1 size=1048576 2023-10-05T11:35:11.929 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.926+0000 7f26f5634780 1 < completed part key=_multipart_FOMNIIY47UUM.2~8C6083Y2TSRO.2 size=104092 2023-10-05T11:35:11.931 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.928+0000 7f26f5634780 1 < canceled multipart upload key=FOMNIIY47UUM upload=8C6083Y2TSRO tag=7HPY8TWG351D type=write size=3249820 2023-10-05T11:35:11.932 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.929+0000 7f26f5634780 1 > prepared operation key=W2GWVGX42QLD tag=TO2APDY0MQIF type=del size=1053168 2023-10-05T11:35:11.934 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.930+0000 7f26f5634780 1 < completed delete operation key=W2GWVGX42QLD tag=9JZY356B51MK type=del 2023-10-05T11:35:11.935 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.931+0000 7f26f5634780 1 > prepared operation key=W2GWVGX42QLD tag=YEXMFU7MIYZO type=del size=3584087 2023-10-05T11:35:11.936 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.933+0000 7f26f5634780 1 < completed delete operation key=2U0NRDGDNUTA tag=XGCHUJBUU8WX type=del 2023-10-05T11:35:11.938 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.935+0000 7f26f5634780 1 > prepared part key=_multipart_2D4PDQQT54ZA.2~E2KXFONGHF86.0 size=1048576 2023-10-05T11:35:11.939 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.936+0000 7f26f5634780 1 > prepared part key=_multipart_2D4PDQQT54ZA.2~E2KXFONGHF86.1 size=1048576 2023-10-05T11:35:11.940 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.937+0000 7f26f5634780 1 > prepared part key=_multipart_2D4PDQQT54ZA.2~E2KXFONGHF86.2 size=842583 2023-10-05T11:35:11.940 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.937+0000 7f26f5634780 1 > prepared multipart upload key=2D4PDQQT54ZA upload=E2KXFONGHF86 tag=FMENLVIOGFIQ type=write size=3988311 2023-10-05T11:35:11.941 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.938+0000 7f26f5634780 1 < completed part key=_multipart_NV4Q36UOLX8A.2~CG9YVMDV6ZH1.0 size=211498 2023-10-05T11:35:11.943 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.940+0000 7f26f5634780 1 < completed multipart upload key=NV4Q36UOLX8A upload=CG9YVMDV6ZH1 tag=Q442AD725QZO type=write size=1260074 2023-10-05T11:35:11.944 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.941+0000 7f26f5634780 1 > prepared operation key=4IBQJLJR7LD8 tag=WOUZNEFX5Y6E type=del size=2840571 2023-10-05T11:35:11.947 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.944+0000 7f26f5634780 1 < suggested remove operation key=AV0XKXX1IR4B tag=ZD9OJLYU40HT type=write 2023-10-05T11:35:11.948 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.945+0000 7f26f5634780 1 > prepared operation key=FOMNIIY47UUM tag=W7R41RCQGW3R type=del size=1089682 2023-10-05T11:35:11.949 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.946+0000 7f26f5634780 1 < completed write operation key=7W9LL5HSU3BG tag=Z26GGRPJ7PKK type=write size=159404 2023-10-05T11:35:11.951 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.947+0000 7f26f5634780 1 > prepared operation key=BU3KSHTINB36 tag=NF8XPUN7DT48 type=del size=702954 2023-10-05T11:35:11.952 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.949+0000 7f26f5634780 1 < completed delete operation key=WYN9BG66LA3K tag=UA64KBOYGOCP type=del 2023-10-05T11:35:11.953 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.950+0000 7f26f5634780 1 > prepared operation key=5OPHKTHXVN5U tag=6FHI0HZ6DWDS type=del size=1132317 2023-10-05T11:35:11.954 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.951+0000 7f26f5634780 1 < completed delete operation key=J5EIH25Y471T tag=QIPSA27PY5S6 type=del 2023-10-05T11:35:11.956 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.952+0000 7f26f5634780 1 > prepared operation key=AV0XKXX1IR4B tag=8I4B0J0KT1R9 type=del size=3490521 2023-10-05T11:35:11.957 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.953+0000 7f26f5634780 1 < completed delete operation key=5V0Q651D4VN2 tag=V8XJPTRCWT25 type=del 2023-10-05T11:35:11.958 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.955+0000 7f26f5634780 1 > prepared operation key=IKCNZOTVWOC6 tag=CTJ301NMMX8F type=del size=2617680 2023-10-05T11:35:11.959 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.956+0000 7f26f5634780 1 < completed delete operation key=PC8WTJ8AYJ24 tag=GQDMPZO1Z84M type=del 2023-10-05T11:35:11.960 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.957+0000 7f26f5634780 1 > prepared operation key=QYQDXVIGZ7O8 tag=SXI4M1Q6EJNC type=del size=2097896 2023-10-05T11:35:11.961 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.957+0000 7f26f5634780 1 < canceled part key=_multipart_IKCNZOTVWOC6.2~AXXKLZNX0ZKK.0 size=1048576 2023-10-05T11:35:11.962 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.958+0000 7f26f5634780 1 < completed part key=_multipart_IKCNZOTVWOC6.2~AXXKLZNX0ZKK.1 size=113104 2023-10-05T11:35:11.963 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.960+0000 7f26f5634780 1 < canceled multipart upload key=IKCNZOTVWOC6 upload=AXXKLZNX0ZKK tag=DWA45AKZ343I type=write size=2210256 2023-10-05T11:35:11.965 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.962+0000 7f26f5634780 1 > prepared part key=_multipart_4IBQJLJR7LD8.2~69CDQPZVBM30.0 size=1048576 2023-10-05T11:35:11.967 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.963+0000 7f26f5634780 1 > prepared part key=_multipart_4IBQJLJR7LD8.2~69CDQPZVBM30.1 size=125713 2023-10-05T11:35:11.967 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.963+0000 7f26f5634780 1 > prepared multipart upload key=4IBQJLJR7LD8 upload=69CDQPZVBM30 tag=3C0IPFU50U30 type=write size=2222865 2023-10-05T11:35:11.967 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.964+0000 7f26f5634780 1 < completed delete operation key=U6172JUYW7J6 tag=XNSYUCGFEJY7 type=del 2023-10-05T11:35:11.969 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.965+0000 7f26f5634780 1 > prepared operation key=2D4PDQQT54ZA tag=5Q7THQB347LU type=del size=3719679 2023-10-05T11:35:11.970 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.966+0000 7f26f5634780 1 < canceled operation key=BTZUVE8R96XT tag=HOCF9PVOQK6O type=del size=4119512 2023-10-05T11:35:11.972 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.969+0000 7f26f5634780 1 > prepared part key=_multipart_6DP3UJ4CW1MO.2~5A15Q122E5CE.0 size=1048576 2023-10-05T11:35:11.973 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.969+0000 7f26f5634780 1 > prepared part key=_multipart_6DP3UJ4CW1MO.2~5A15Q122E5CE.1 size=285048 2023-10-05T11:35:11.973 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.969+0000 7f26f5634780 1 > prepared multipart upload key=6DP3UJ4CW1MO upload=5A15Q122E5CE tag=LESLKC6PZ68W type=write size=2382200 2023-10-05T11:35:11.974 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.971+0000 7f26f5634780 1 < canceled operation key=5OPHKTHXVN5U tag=KK9Q2H41EL12 type=del size=1802738 2023-10-05T11:35:11.975 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.972+0000 7f26f5634780 1 > prepared operation key=6DP3UJ4CW1MO tag=CTB95Z4WNUEK type=del size=1719234 2023-10-05T11:35:11.977 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.973+0000 7f26f5634780 1 < completed delete operation key=4D3H60UTIXH3 tag=L0M9KA410F98 type=del 2023-10-05T11:35:11.978 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.974+0000 7f26f5634780 1 > prepared operation key=WYN9BG66LA3K tag=UNPEE6UJTVC0 type=del size=1460282 2023-10-05T11:35:11.978 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.975+0000 7f26f5634780 1 < canceled part key=_multipart_U6172JUYW7J6.2~YUL3R3KJCMZ2.0 size=1048576 2023-10-05T11:35:11.979 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.976+0000 7f26f5634780 1 < completed part key=_multipart_U6172JUYW7J6.2~YUL3R3KJCMZ2.1 size=842015 2023-10-05T11:35:11.981 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.978+0000 7f26f5634780 1 < canceled multipart upload key=U6172JUYW7J6 upload=YUL3R3KJCMZ2 tag=W243HGE40123 type=write size=2939167 2023-10-05T11:35:11.984 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.980+0000 7f26f5634780 1 > prepared part key=_multipart_IKCNZOTVWOC6.2~N88SV2KX1UT3.0 size=816889 2023-10-05T11:35:11.984 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.980+0000 7f26f5634780 1 > prepared multipart upload key=IKCNZOTVWOC6 upload=N88SV2KX1UT3 tag=ZZZ7DJSEYBH6 type=write size=1865465 2023-10-05T11:35:11.985 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.982+0000 7f26f5634780 1 < completed delete operation key=W2GWVGX42QLD tag=TO2APDY0MQIF type=del 2023-10-05T11:35:11.987 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.983+0000 7f26f5634780 1 > prepared operation key=IKCNZOTVWOC6 tag=HEGMMTM8CDCB type=del size=2691265 2023-10-05T11:35:11.989 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.986+0000 7f26f5634780 1 < suggested update operation key=W2GWVGX42QLD tag=YEXMFU7MIYZO type=del size=3584087 2023-10-05T11:35:11.991 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.988+0000 7f26f5634780 1 > prepared part key=_multipart_7TOP5A52M9YP.2~P5YFCWB40WIB.0 size=1048576 2023-10-05T11:35:11.992 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.989+0000 7f26f5634780 1 > prepared part key=_multipart_7TOP5A52M9YP.2~P5YFCWB40WIB.1 size=396835 2023-10-05T11:35:11.992 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.989+0000 7f26f5634780 1 > prepared multipart upload key=7TOP5A52M9YP upload=P5YFCWB40WIB tag=ABJUJOA1HN75 type=write size=2493987 2023-10-05T11:35:11.994 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.990+0000 7f26f5634780 1 < completed part key=_multipart_2D4PDQQT54ZA.2~E2KXFONGHF86.0 size=1048576 2023-10-05T11:35:11.994 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.991+0000 7f26f5634780 1 < completed part key=_multipart_2D4PDQQT54ZA.2~E2KXFONGHF86.1 size=1048576 2023-10-05T11:35:11.995 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.992+0000 7f26f5634780 1 < completed part key=_multipart_2D4PDQQT54ZA.2~E2KXFONGHF86.2 size=842583 2023-10-05T11:35:11.998 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.994+0000 7f26f5634780 1 < completed multipart upload key=2D4PDQQT54ZA upload=E2KXFONGHF86 tag=FMENLVIOGFIQ type=write size=3988311 2023-10-05T11:35:11.999 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.996+0000 7f26f5634780 1 > prepared operation key=5V0Q651D4VN2 tag=T2M2XILIOZC3 type=write size=965114 2023-10-05T11:35:12.000 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.997+0000 7f26f5634780 1 < completed delete operation key=4IBQJLJR7LD8 tag=WOUZNEFX5Y6E type=del 2023-10-05T11:35:12.002 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.999+0000 7f26f5634780 1 > prepared part key=_multipart_0PWYKC7S6YJ4.2~BDXHYVR6H4XJ.0 size=877556 2023-10-05T11:35:12.003 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:11.999+0000 7f26f5634780 1 > prepared multipart upload key=0PWYKC7S6YJ4 upload=BDXHYVR6H4XJ tag=JPYOFQA2439Y type=write size=1926132 2023-10-05T11:35:12.005 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.001+0000 7f26f5634780 1 < suggested update operation key=FOMNIIY47UUM tag=W7R41RCQGW3R type=del size=1089682 2023-10-05T11:35:12.006 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.003+0000 7f26f5634780 1 > prepared operation key=WYN9BG66LA3K tag=E66RX8S6Y8BS type=del size=1058337 2023-10-05T11:35:12.007 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.004+0000 7f26f5634780 1 < completed delete operation key=BU3KSHTINB36 tag=NF8XPUN7DT48 type=del 2023-10-05T11:35:12.008 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.005+0000 7f26f5634780 1 > prepared operation key=4D3H60UTIXH3 tag=HBSW85RE1BI4 type=del size=1186354 2023-10-05T11:35:12.010 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.006+0000 7f26f5634780 1 < completed delete operation key=5OPHKTHXVN5U tag=6FHI0HZ6DWDS type=del 2023-10-05T11:35:12.013 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.009+0000 7f26f5634780 1 > prepared part key=_multipart_BU3KSHTINB36.2~9LHCLA2YLDBP.0 size=1048576 2023-10-05T11:35:12.013 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.010+0000 7f26f5634780 1 > prepared part key=_multipart_BU3KSHTINB36.2~9LHCLA2YLDBP.1 size=1048576 2023-10-05T11:35:12.014 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.011+0000 7f26f5634780 1 > prepared part key=_multipart_BU3KSHTINB36.2~9LHCLA2YLDBP.2 size=670890 2023-10-05T11:35:12.014 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.011+0000 7f26f5634780 1 > prepared multipart upload key=BU3KSHTINB36 upload=9LHCLA2YLDBP tag=ZF9HXWGC985B type=write size=3816618 2023-10-05T11:35:12.015 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.012+0000 7f26f5634780 1 < completed delete operation key=AV0XKXX1IR4B tag=8I4B0J0KT1R9 type=del 2023-10-05T11:35:12.017 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.014+0000 7f26f5634780 1 > prepared part key=_multipart_S3DKYDFT4IO2.2~C9F2W7RNKNXN.0 size=902496 2023-10-05T11:35:12.017 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.014+0000 7f26f5634780 1 > prepared multipart upload key=S3DKYDFT4IO2 upload=C9F2W7RNKNXN tag=G1HGG01ECX17 type=write size=1951072 2023-10-05T11:35:12.019 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.015+0000 7f26f5634780 1 < completed delete operation key=IKCNZOTVWOC6 tag=CTJ301NMMX8F type=del 2023-10-05T11:35:12.021 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.017+0000 7f26f5634780 1 > prepared part key=_multipart_IKCNZOTVWOC6.2~WKTQHS3TOFN0.0 size=1048576 2023-10-05T11:35:12.022 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.018+0000 7f26f5634780 1 > prepared part key=_multipart_IKCNZOTVWOC6.2~WKTQHS3TOFN0.1 size=1048576 2023-10-05T11:35:12.023 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.019+0000 7f26f5634780 1 > prepared part key=_multipart_IKCNZOTVWOC6.2~WKTQHS3TOFN0.2 size=422739 2023-10-05T11:35:12.023 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.019+0000 7f26f5634780 1 > prepared multipart upload key=IKCNZOTVWOC6 upload=WKTQHS3TOFN0 tag=NWY48KN0Q4YO type=write size=3568467 2023-10-05T11:35:12.025 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.021+0000 7f26f5634780 1 < suggested remove operation key=QYQDXVIGZ7O8 tag=SXI4M1Q6EJNC type=del 2023-10-05T11:35:12.026 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.023+0000 7f26f5634780 1 > prepared operation key=FOMNIIY47UUM tag=BYH4PX5DIXGP type=del size=2129201 2023-10-05T11:35:12.027 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.024+0000 7f26f5634780 1 < completed part key=_multipart_4IBQJLJR7LD8.2~69CDQPZVBM30.0 size=1048576 2023-10-05T11:35:12.028 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.025+0000 7f26f5634780 1 < completed part key=_multipart_4IBQJLJR7LD8.2~69CDQPZVBM30.1 size=125713 2023-10-05T11:35:12.031 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.028+0000 7f26f5634780 1 < completed multipart upload key=4IBQJLJR7LD8 upload=69CDQPZVBM30 tag=3C0IPFU50U30 type=write size=2222865 2023-10-05T11:35:12.032 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.029+0000 7f26f5634780 1 > prepared operation key=W2GWVGX42QLD tag=3KZH0VQJF517 type=write size=245784 2023-10-05T11:35:12.034 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.030+0000 7f26f5634780 1 < completed delete operation key=2D4PDQQT54ZA tag=5Q7THQB347LU type=del 2023-10-05T11:35:12.035 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.031+0000 7f26f5634780 1 > prepared operation key=J5EIH25Y471T tag=OS69W0V1UWFI type=del size=1254256 2023-10-05T11:35:12.036 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.033+0000 7f26f5634780 1 < completed part key=_multipart_6DP3UJ4CW1MO.2~5A15Q122E5CE.0 size=1048576 2023-10-05T11:35:12.037 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.034+0000 7f26f5634780 1 < completed part key=_multipart_6DP3UJ4CW1MO.2~5A15Q122E5CE.1 size=285048 2023-10-05T11:35:12.039 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.036+0000 7f26f5634780 1 < completed multipart upload key=6DP3UJ4CW1MO upload=5A15Q122E5CE tag=LESLKC6PZ68W type=write size=2382200 2023-10-05T11:35:12.040 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.037+0000 7f26f5634780 1 > prepared operation key=761J2C7GHWU5 tag=HGUPBN6RHI0T type=del size=3840331 2023-10-05T11:35:12.042 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.038+0000 7f26f5634780 1 < completed delete operation key=6DP3UJ4CW1MO tag=CTB95Z4WNUEK type=del 2023-10-05T11:35:12.044 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.041+0000 7f26f5634780 1 > prepared part key=_multipart_IKCNZOTVWOC6.2~DJVOX373G17H.0 size=663666 2023-10-05T11:35:12.044 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.041+0000 7f26f5634780 1 > prepared multipart upload key=IKCNZOTVWOC6 upload=DJVOX373G17H tag=HJO2C50RDRB7 type=write size=1712242 2023-10-05T11:35:12.046 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.042+0000 7f26f5634780 1 < completed delete operation key=WYN9BG66LA3K tag=UNPEE6UJTVC0 type=del 2023-10-05T11:35:12.047 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.044+0000 7f26f5634780 1 > prepared operation key=QYQDXVIGZ7O8 tag=U0EEYU3YKPUL type=del size=3718240 2023-10-05T11:35:12.049 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.045+0000 7f26f5634780 1 < completed part key=_multipart_IKCNZOTVWOC6.2~N88SV2KX1UT3.0 size=816889 2023-10-05T11:35:12.051 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.048+0000 7f26f5634780 1 < completed multipart upload key=IKCNZOTVWOC6 upload=N88SV2KX1UT3 tag=ZZZ7DJSEYBH6 type=write size=1865465 2023-10-05T11:35:12.053 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.050+0000 7f26f5634780 1 > prepared part key=_multipart_VJTFYDETLSFD.2~12EJOEXU2IOZ.0 size=1048576 2023-10-05T11:35:12.054 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.051+0000 7f26f5634780 1 > prepared part key=_multipart_VJTFYDETLSFD.2~12EJOEXU2IOZ.1 size=135270 2023-10-05T11:35:12.054 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.051+0000 7f26f5634780 1 > prepared multipart upload key=VJTFYDETLSFD upload=12EJOEXU2IOZ tag=CZ2MPFVKPSMI type=write size=2232422 2023-10-05T11:35:12.055 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.052+0000 7f26f5634780 1 < canceled operation key=IKCNZOTVWOC6 tag=HEGMMTM8CDCB type=del size=2691265 2023-10-05T11:35:12.057 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.054+0000 7f26f5634780 1 > prepared part key=_multipart_6DP3UJ4CW1MO.2~MYQC6DWDLROX.0 size=592044 2023-10-05T11:35:12.057 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.054+0000 7f26f5634780 1 > prepared multipart upload key=6DP3UJ4CW1MO upload=MYQC6DWDLROX tag=GT11KQSF9FVB type=write size=1640620 2023-10-05T11:35:12.059 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.055+0000 7f26f5634780 1 < completed part key=_multipart_7TOP5A52M9YP.2~P5YFCWB40WIB.0 size=1048576 2023-10-05T11:35:12.060 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.056+0000 7f26f5634780 1 < completed part key=_multipart_7TOP5A52M9YP.2~P5YFCWB40WIB.1 size=396835 2023-10-05T11:35:12.062 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.058+0000 7f26f5634780 1 < completed multipart upload key=7TOP5A52M9YP upload=P5YFCWB40WIB tag=ABJUJOA1HN75 type=write size=2493987 2023-10-05T11:35:12.063 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.060+0000 7f26f5634780 1 > prepared operation key=4D3H60UTIXH3 tag=AU4PQIOKEIJZ type=del size=2165525 2023-10-05T11:35:12.064 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.061+0000 7f26f5634780 1 < completed write operation key=5V0Q651D4VN2 tag=T2M2XILIOZC3 type=write size=965114 2023-10-05T11:35:12.066 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.063+0000 7f26f5634780 1 > prepared part key=_multipart_QYQDXVIGZ7O8.2~62BQD2J7MPOB.0 size=1048576 2023-10-05T11:35:12.067 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.064+0000 7f26f5634780 1 > prepared part key=_multipart_QYQDXVIGZ7O8.2~62BQD2J7MPOB.1 size=1036114 2023-10-05T11:35:12.068 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.064+0000 7f26f5634780 1 > prepared multipart upload key=QYQDXVIGZ7O8 upload=62BQD2J7MPOB tag=RWQJZEOT5RC7 type=write size=3133266 2023-10-05T11:35:12.069 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.065+0000 7f26f5634780 1 < completed part key=_multipart_0PWYKC7S6YJ4.2~BDXHYVR6H4XJ.0 size=877556 2023-10-05T11:35:12.071 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.067+0000 7f26f5634780 1 < completed multipart upload key=0PWYKC7S6YJ4 upload=BDXHYVR6H4XJ tag=JPYOFQA2439Y type=write size=1926132 2023-10-05T11:35:12.073 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.069+0000 7f26f5634780 1 > prepared part key=_multipart_BU3KSHTINB36.2~IJOL8NTCGV4B.0 size=1048576 2023-10-05T11:35:12.074 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.070+0000 7f26f5634780 1 > prepared part key=_multipart_BU3KSHTINB36.2~IJOL8NTCGV4B.1 size=149036 2023-10-05T11:35:12.074 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.070+0000 7f26f5634780 1 > prepared multipart upload key=BU3KSHTINB36 upload=IJOL8NTCGV4B tag=TBTV7ZML58IS type=write size=2246188 2023-10-05T11:35:12.076 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.073+0000 7f26f5634780 1 < suggested update operation key=WYN9BG66LA3K tag=E66RX8S6Y8BS type=del size=1058337 2023-10-05T11:35:12.078 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.075+0000 7f26f5634780 1 > prepared part key=_multipart_0PWYKC7S6YJ4.2~EOQQIZFDAYXH.0 size=1048576 2023-10-05T11:35:12.079 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.076+0000 7f26f5634780 1 > prepared part key=_multipart_0PWYKC7S6YJ4.2~EOQQIZFDAYXH.1 size=1048576 2023-10-05T11:35:12.080 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.077+0000 7f26f5634780 1 > prepared part key=_multipart_0PWYKC7S6YJ4.2~EOQQIZFDAYXH.2 size=423813 2023-10-05T11:35:12.080 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.077+0000 7f26f5634780 1 > prepared multipart upload key=0PWYKC7S6YJ4 upload=EOQQIZFDAYXH tag=RAEEGQA9X3YJ type=write size=3569541 2023-10-05T11:35:12.081 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.078+0000 7f26f5634780 1 < completed delete operation key=4D3H60UTIXH3 tag=HBSW85RE1BI4 type=del 2023-10-05T11:35:12.083 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.079+0000 7f26f5634780 1 > prepared operation key=IKCNZOTVWOC6 tag=42ZO5X4SVKZO type=del size=2402431 2023-10-05T11:35:12.084 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.081+0000 7f26f5634780 1 < completed part key=_multipart_BU3KSHTINB36.2~9LHCLA2YLDBP.0 size=1048576 2023-10-05T11:35:12.085 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.081+0000 7f26f5634780 1 < completed part key=_multipart_BU3KSHTINB36.2~9LHCLA2YLDBP.1 size=1048576 2023-10-05T11:35:12.086 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.082+0000 7f26f5634780 1 < completed part key=_multipart_BU3KSHTINB36.2~9LHCLA2YLDBP.2 size=670890 2023-10-05T11:35:12.088 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.084+0000 7f26f5634780 1 < completed multipart upload key=BU3KSHTINB36 upload=9LHCLA2YLDBP tag=ZF9HXWGC985B type=write size=3816618 2023-10-05T11:35:12.090 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.087+0000 7f26f5634780 1 > prepared part key=_multipart_4IBQJLJR7LD8.2~KI4GQRJHN17L.0 size=299168 2023-10-05T11:35:12.090 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.087+0000 7f26f5634780 1 > prepared multipart upload key=4IBQJLJR7LD8 upload=KI4GQRJHN17L tag=1GE2ADLR96M0 type=write size=1347744 2023-10-05T11:35:12.091 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.088+0000 7f26f5634780 1 < completed part key=_multipart_S3DKYDFT4IO2.2~C9F2W7RNKNXN.0 size=902496 2023-10-05T11:35:12.093 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.090+0000 7f26f5634780 1 < completed multipart upload key=S3DKYDFT4IO2 upload=C9F2W7RNKNXN tag=G1HGG01ECX17 type=write size=1951072 2023-10-05T11:35:12.095 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.092+0000 7f26f5634780 1 > prepared part key=_multipart_9S0YW7PPSJ8G.2~FJ7G533ICU9E.0 size=1048576 2023-10-05T11:35:12.096 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.093+0000 7f26f5634780 1 > prepared part key=_multipart_9S0YW7PPSJ8G.2~FJ7G533ICU9E.1 size=319093 2023-10-05T11:35:12.096 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.093+0000 7f26f5634780 1 > prepared multipart upload key=9S0YW7PPSJ8G upload=FJ7G533ICU9E tag=Q7WETBSQIMEO type=write size=2416245 2023-10-05T11:35:12.097 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.094+0000 7f26f5634780 1 < completed part key=_multipart_IKCNZOTVWOC6.2~WKTQHS3TOFN0.0 size=1048576 2023-10-05T11:35:12.098 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.095+0000 7f26f5634780 1 < completed part key=_multipart_IKCNZOTVWOC6.2~WKTQHS3TOFN0.1 size=1048576 2023-10-05T11:35:12.099 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.096+0000 7f26f5634780 1 < completed part key=_multipart_IKCNZOTVWOC6.2~WKTQHS3TOFN0.2 size=422739 2023-10-05T11:35:12.101 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.098+0000 7f26f5634780 1 < completed multipart upload key=IKCNZOTVWOC6 upload=WKTQHS3TOFN0 tag=NWY48KN0Q4YO type=write size=3568467 2023-10-05T11:35:12.102 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.099+0000 7f26f5634780 1 > prepared operation key=9S0YW7PPSJ8G tag=SFGBZVSJ6IIE type=del size=619697 2023-10-05T11:35:12.104 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.100+0000 7f26f5634780 1 < completed delete operation key=FOMNIIY47UUM tag=BYH4PX5DIXGP type=del 2023-10-05T11:35:12.106 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.102+0000 7f26f5634780 1 > prepared part key=_multipart_WTCWG1C1SF89.2~8BO0GBC0K1ZB.0 size=1048576 2023-10-05T11:35:12.107 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.103+0000 7f26f5634780 1 > prepared part key=_multipart_WTCWG1C1SF89.2~8BO0GBC0K1ZB.1 size=754668 2023-10-05T11:35:12.107 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.103+0000 7f26f5634780 1 > prepared multipart upload key=WTCWG1C1SF89 upload=8BO0GBC0K1ZB tag=WNVGGMQ9UFN9 type=write size=2851820 2023-10-05T11:35:12.109 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.106+0000 7f26f5634780 1 < suggested remove operation key=W2GWVGX42QLD tag=3KZH0VQJF517 type=write 2023-10-05T11:35:12.110 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.107+0000 7f26f5634780 1 > prepared operation key=6DP3UJ4CW1MO tag=C7NIR9D9BSDB type=del size=3507009 2023-10-05T11:35:12.111 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.108+0000 7f26f5634780 1 < completed delete operation key=J5EIH25Y471T tag=OS69W0V1UWFI type=del 2023-10-05T11:35:12.114 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.110+0000 7f26f5634780 1 > prepared part key=_multipart_BTZUVE8R96XT.2~NN4QB10F6H1Q.0 size=1048576 2023-10-05T11:35:12.115 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.111+0000 7f26f5634780 1 > prepared part key=_multipart_BTZUVE8R96XT.2~NN4QB10F6H1Q.1 size=86007 2023-10-05T11:35:12.115 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.111+0000 7f26f5634780 1 > prepared multipart upload key=BTZUVE8R96XT upload=NN4QB10F6H1Q tag=HMMJF9QZW4X9 type=write size=2183159 2023-10-05T11:35:12.116 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.113+0000 7f26f5634780 1 < canceled operation key=761J2C7GHWU5 tag=HGUPBN6RHI0T type=del size=3840331 2023-10-05T11:35:12.118 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.115+0000 7f26f5634780 1 > prepared part key=_multipart_7W9LL5HSU3BG.2~CVN4NWGRDTVP.0 size=1048576 2023-10-05T11:35:12.119 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.116+0000 7f26f5634780 1 > prepared part key=_multipart_7W9LL5HSU3BG.2~CVN4NWGRDTVP.1 size=568166 2023-10-05T11:35:12.119 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.116+0000 7f26f5634780 1 > prepared multipart upload key=7W9LL5HSU3BG upload=CVN4NWGRDTVP tag=ZAKXTZHKD4PI type=write size=2665318 2023-10-05T11:35:12.120 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.117+0000 7f26f5634780 1 < completed part key=_multipart_IKCNZOTVWOC6.2~DJVOX373G17H.0 size=663666 2023-10-05T11:35:12.122 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.119+0000 7f26f5634780 1 < completed multipart upload key=IKCNZOTVWOC6 upload=DJVOX373G17H tag=HJO2C50RDRB7 type=write size=1712242 2023-10-05T11:35:12.123 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.120+0000 7f26f5634780 1 > prepared operation key=QYQDXVIGZ7O8 tag=KQL2RQTZJT0A type=del size=2900114 2023-10-05T11:35:12.125 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.121+0000 7f26f5634780 1 < completed delete operation key=QYQDXVIGZ7O8 tag=U0EEYU3YKPUL type=del 2023-10-05T11:35:12.127 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.124+0000 7f26f5634780 1 > prepared part key=_multipart_7W9LL5HSU3BG.2~IC42L71U23AO.0 size=1048576 2023-10-05T11:35:12.128 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.125+0000 7f26f5634780 1 > prepared part key=_multipart_7W9LL5HSU3BG.2~IC42L71U23AO.1 size=1048576 2023-10-05T11:35:12.129 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.126+0000 7f26f5634780 1 > prepared part key=_multipart_7W9LL5HSU3BG.2~IC42L71U23AO.2 size=592064 2023-10-05T11:35:12.129 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.126+0000 7f26f5634780 1 > prepared multipart upload key=7W9LL5HSU3BG upload=IC42L71U23AO tag=ZVVMX0AHMUAL type=write size=3737792 2023-10-05T11:35:12.130 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.127+0000 7f26f5634780 1 < completed part key=_multipart_VJTFYDETLSFD.2~12EJOEXU2IOZ.0 size=1048576 2023-10-05T11:35:12.131 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.128+0000 7f26f5634780 1 < completed part key=_multipart_VJTFYDETLSFD.2~12EJOEXU2IOZ.1 size=135270 2023-10-05T11:35:12.134 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.130+0000 7f26f5634780 1 < completed multipart upload key=VJTFYDETLSFD upload=12EJOEXU2IOZ tag=CZ2MPFVKPSMI type=write size=2232422 2023-10-05T11:35:12.135 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.131+0000 7f26f5634780 1 > prepared operation key=0PWYKC7S6YJ4 tag=VC5DOOQAV06N type=write size=174038 2023-10-05T11:35:12.135 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.132+0000 7f26f5634780 1 < canceled part key=_multipart_6DP3UJ4CW1MO.2~MYQC6DWDLROX.0 size=592044 2023-10-05T11:35:12.137 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.134+0000 7f26f5634780 1 < canceled multipart upload key=6DP3UJ4CW1MO upload=MYQC6DWDLROX tag=GT11KQSF9FVB type=write size=1640620 2023-10-05T11:35:12.139 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.136+0000 7f26f5634780 1 > prepared part key=_multipart_PNV0Q6ZPLYV0.2~GWEUT1ZFVLRG.0 size=1048576 2023-10-05T11:35:12.140 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.137+0000 7f26f5634780 1 > prepared part key=_multipart_PNV0Q6ZPLYV0.2~GWEUT1ZFVLRG.1 size=1048576 2023-10-05T11:35:12.141 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.138+0000 7f26f5634780 1 > prepared part key=_multipart_PNV0Q6ZPLYV0.2~GWEUT1ZFVLRG.2 size=754407 2023-10-05T11:35:12.141 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.138+0000 7f26f5634780 1 > prepared multipart upload key=PNV0Q6ZPLYV0 upload=GWEUT1ZFVLRG tag=VA5UNOMHEHWJ type=write size=3900135 2023-10-05T11:35:12.143 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.140+0000 7f26f5634780 1 < completed delete operation key=4D3H60UTIXH3 tag=AU4PQIOKEIJZ type=del 2023-10-05T11:35:12.145 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.141+0000 7f26f5634780 1 > prepared operation key=6DP3UJ4CW1MO tag=73ES68RBWON2 type=del size=2154659 2023-10-05T11:35:12.145 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.141+0000 7f26f5634780 1 < canceled part key=_multipart_QYQDXVIGZ7O8.2~62BQD2J7MPOB.0 size=1048576 2023-10-05T11:35:12.146 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.142+0000 7f26f5634780 1 < completed part key=_multipart_QYQDXVIGZ7O8.2~62BQD2J7MPOB.1 size=1036114 2023-10-05T11:35:12.148 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.144+0000 7f26f5634780 1 < canceled multipart upload key=QYQDXVIGZ7O8 upload=62BQD2J7MPOB tag=RWQJZEOT5RC7 type=write size=3133266 2023-10-05T11:35:12.150 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.146+0000 7f26f5634780 1 > prepared part key=_multipart_MEY4SZRHU9NZ.2~434E5UA74X3U.0 size=1048576 2023-10-05T11:35:12.151 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.147+0000 7f26f5634780 1 > prepared part key=_multipart_MEY4SZRHU9NZ.2~434E5UA74X3U.1 size=943819 2023-10-05T11:35:12.151 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.147+0000 7f26f5634780 1 > prepared multipart upload key=MEY4SZRHU9NZ upload=434E5UA74X3U tag=6YT8JG0NSLOZ type=write size=3040971 2023-10-05T11:35:12.152 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.148+0000 7f26f5634780 1 < completed part key=_multipart_BU3KSHTINB36.2~IJOL8NTCGV4B.0 size=1048576 2023-10-05T11:35:12.153 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.150+0000 7f26f5634780 1 < completed part key=_multipart_BU3KSHTINB36.2~IJOL8NTCGV4B.1 size=149036 2023-10-05T11:35:12.155 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.152+0000 7f26f5634780 1 < completed multipart upload key=BU3KSHTINB36 upload=IJOL8NTCGV4B tag=TBTV7ZML58IS type=write size=2246188 2023-10-05T11:35:12.156 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.153+0000 7f26f5634780 1 > prepared operation key=2D4PDQQT54ZA tag=D4EG4I0V97E0 type=del size=3056592 2023-10-05T11:35:12.157 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.154+0000 7f26f5634780 1 < completed part key=_multipart_0PWYKC7S6YJ4.2~EOQQIZFDAYXH.0 size=1048576 2023-10-05T11:35:12.158 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.155+0000 7f26f5634780 1 < completed part key=_multipart_0PWYKC7S6YJ4.2~EOQQIZFDAYXH.1 size=1048576 2023-10-05T11:35:12.159 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.156+0000 7f26f5634780 1 < completed part key=_multipart_0PWYKC7S6YJ4.2~EOQQIZFDAYXH.2 size=423813 2023-10-05T11:35:12.161 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.158+0000 7f26f5634780 1 < completed multipart upload key=0PWYKC7S6YJ4 upload=EOQQIZFDAYXH tag=RAEEGQA9X3YJ type=write size=3569541 2023-10-05T11:35:12.163 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.160+0000 7f26f5634780 1 > prepared part key=_multipart_4IBQJLJR7LD8.2~S0LCJINNLU1T.0 size=136255 2023-10-05T11:35:12.163 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.160+0000 7f26f5634780 1 > prepared multipart upload key=4IBQJLJR7LD8 upload=S0LCJINNLU1T tag=MLBUJOVKY9G9 type=write size=1184831 2023-10-05T11:35:12.166 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.162+0000 7f26f5634780 1 < completed delete operation key=IKCNZOTVWOC6 tag=42ZO5X4SVKZO type=del 2023-10-05T11:35:12.167 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.164+0000 7f26f5634780 1 > prepared operation key=6DP3UJ4CW1MO tag=7VHUNFJK83J7 type=del size=912991 2023-10-05T11:35:12.169 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.165+0000 7f26f5634780 1 < completed part key=_multipart_4IBQJLJR7LD8.2~KI4GQRJHN17L.0 size=299168 2023-10-05T11:35:12.171 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.167+0000 7f26f5634780 1 < completed multipart upload key=4IBQJLJR7LD8 upload=KI4GQRJHN17L tag=1GE2ADLR96M0 type=write size=1347744 2023-10-05T11:35:12.173 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.169+0000 7f26f5634780 1 > prepared part key=_multipart_4IBQJLJR7LD8.2~4RLOZQGY8PM3.0 size=1048576 2023-10-05T11:35:12.174 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.170+0000 7f26f5634780 1 > prepared part key=_multipart_4IBQJLJR7LD8.2~4RLOZQGY8PM3.1 size=679872 2023-10-05T11:35:12.174 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.170+0000 7f26f5634780 1 > prepared multipart upload key=4IBQJLJR7LD8 upload=4RLOZQGY8PM3 tag=6PWT5ZTDZMGJ type=write size=2777024 2023-10-05T11:35:12.174 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.171+0000 7f26f5634780 1 < canceled part key=_multipart_9S0YW7PPSJ8G.2~FJ7G533ICU9E.0 size=1048576 2023-10-05T11:35:12.175 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.172+0000 7f26f5634780 1 < completed part key=_multipart_9S0YW7PPSJ8G.2~FJ7G533ICU9E.1 size=319093 2023-10-05T11:35:12.177 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.174+0000 7f26f5634780 1 < canceled multipart upload key=9S0YW7PPSJ8G upload=FJ7G533ICU9E tag=Q7WETBSQIMEO type=write size=2416245 2023-10-05T11:35:12.179 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.176+0000 7f26f5634780 1 > prepared part key=_multipart_5V0Q651D4VN2.2~GMNMMQ3KDHX1.0 size=1048576 2023-10-05T11:35:12.180 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.177+0000 7f26f5634780 1 > prepared part key=_multipart_5V0Q651D4VN2.2~GMNMMQ3KDHX1.1 size=1048576 2023-10-05T11:35:12.181 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.178+0000 7f26f5634780 1 > prepared part key=_multipart_5V0Q651D4VN2.2~GMNMMQ3KDHX1.2 size=187862 2023-10-05T11:35:12.181 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.178+0000 7f26f5634780 1 > prepared multipart upload key=5V0Q651D4VN2 upload=GMNMMQ3KDHX1 tag=LJM0Y9HS98U0 type=write size=3333590 2023-10-05T11:35:12.182 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.179+0000 7f26f5634780 1 < completed delete operation key=9S0YW7PPSJ8G tag=SFGBZVSJ6IIE type=del 2023-10-05T11:35:12.184 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.181+0000 7f26f5634780 1 > prepared part key=_multipart_PC8WTJ8AYJ24.2~8VNLXT0MGLWT.0 size=358919 2023-10-05T11:35:12.185 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.181+0000 7f26f5634780 1 > prepared multipart upload key=PC8WTJ8AYJ24 upload=8VNLXT0MGLWT tag=PTEFSKJ24U87 type=write size=1407495 2023-10-05T11:35:12.186 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.182+0000 7f26f5634780 1 < completed part key=_multipart_WTCWG1C1SF89.2~8BO0GBC0K1ZB.0 size=1048576 2023-10-05T11:35:12.186 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.183+0000 7f26f5634780 1 < completed part key=_multipart_WTCWG1C1SF89.2~8BO0GBC0K1ZB.1 size=754668 2023-10-05T11:35:12.189 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.185+0000 7f26f5634780 1 < completed multipart upload key=WTCWG1C1SF89 upload=8BO0GBC0K1ZB tag=WNVGGMQ9UFN9 type=write size=2851820 2023-10-05T11:35:12.190 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.186+0000 7f26f5634780 1 > prepared operation key=J5EIH25Y471T tag=12MQU9BTV4U0 type=del size=1351505 2023-10-05T11:35:12.191 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.188+0000 7f26f5634780 1 < canceled operation key=6DP3UJ4CW1MO tag=C7NIR9D9BSDB type=del size=3507009 2023-10-05T11:35:12.193 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.190+0000 7f26f5634780 1 > prepared part key=_multipart_WYN9BG66LA3K.2~T6WTLKYCSAY4.0 size=1048576 2023-10-05T11:35:12.194 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.191+0000 7f26f5634780 1 > prepared part key=_multipart_WYN9BG66LA3K.2~T6WTLKYCSAY4.1 size=1048576 2023-10-05T11:35:12.195 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.192+0000 7f26f5634780 1 > prepared part key=_multipart_WYN9BG66LA3K.2~T6WTLKYCSAY4.2 size=264670 2023-10-05T11:35:12.195 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.192+0000 7f26f5634780 1 > prepared multipart upload key=WYN9BG66LA3K upload=T6WTLKYCSAY4 tag=W6KC2YA2GBT0 type=write size=3410398 2023-10-05T11:35:12.196 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.193+0000 7f26f5634780 1 < completed part key=_multipart_BTZUVE8R96XT.2~NN4QB10F6H1Q.0 size=1048576 2023-10-05T11:35:12.196 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.193+0000 7f26f5634780 1 < canceled part key=_multipart_BTZUVE8R96XT.2~NN4QB10F6H1Q.1 size=86007 2023-10-05T11:35:12.199 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.195+0000 7f26f5634780 1 < canceled multipart upload key=BTZUVE8R96XT upload=NN4QB10F6H1Q tag=HMMJF9QZW4X9 type=write size=2183159 2023-10-05T11:35:12.200 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.196+0000 7f26f5634780 1 > prepared operation key=4IBQJLJR7LD8 tag=UQ53NU02MXBG type=del size=1196041 2023-10-05T11:35:12.201 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.197+0000 7f26f5634780 1 < completed part key=_multipart_7W9LL5HSU3BG.2~CVN4NWGRDTVP.0 size=1048576 2023-10-05T11:35:12.202 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.198+0000 7f26f5634780 1 < completed part key=_multipart_7W9LL5HSU3BG.2~CVN4NWGRDTVP.1 size=568166 2023-10-05T11:35:12.204 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.201+0000 7f26f5634780 1 < completed multipart upload key=7W9LL5HSU3BG upload=CVN4NWGRDTVP tag=ZAKXTZHKD4PI type=write size=2665318 2023-10-05T11:35:12.205 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.202+0000 7f26f5634780 1 > prepared operation key=LLR5J3X15W5R tag=X3GSUFW4M7T0 type=del size=1751602 2023-10-05T11:35:12.208 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.204+0000 7f26f5634780 1 < suggested update operation key=QYQDXVIGZ7O8 tag=KQL2RQTZJT0A type=del size=2900114 2023-10-05T11:35:12.209 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.206+0000 7f26f5634780 1 > prepared operation key=IKCNZOTVWOC6 tag=Q69TVR19KB07 type=del size=453547 2023-10-05T11:35:12.210 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.207+0000 7f26f5634780 1 < completed part key=_multipart_7W9LL5HSU3BG.2~IC42L71U23AO.0 size=1048576 2023-10-05T11:35:12.211 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.208+0000 7f26f5634780 1 < completed part key=_multipart_7W9LL5HSU3BG.2~IC42L71U23AO.1 size=1048576 2023-10-05T11:35:12.212 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.209+0000 7f26f5634780 1 < completed part key=_multipart_7W9LL5HSU3BG.2~IC42L71U23AO.2 size=592064 2023-10-05T11:35:12.214 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.211+0000 7f26f5634780 1 < completed multipart upload key=7W9LL5HSU3BG upload=IC42L71U23AO tag=ZVVMX0AHMUAL type=write size=3737792 2023-10-05T11:35:12.216 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.213+0000 7f26f5634780 1 > prepared part key=_multipart_2D4PDQQT54ZA.2~RVV7GU3TS8HQ.0 size=1048576 2023-10-05T11:35:12.217 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.214+0000 7f26f5634780 1 > prepared part key=_multipart_2D4PDQQT54ZA.2~RVV7GU3TS8HQ.1 size=442267 2023-10-05T11:35:12.217 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.214+0000 7f26f5634780 1 > prepared multipart upload key=2D4PDQQT54ZA upload=RVV7GU3TS8HQ tag=XJLCTO5SR6KC type=write size=2539419 2023-10-05T11:35:12.218 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.215+0000 7f26f5634780 1 < completed write operation key=0PWYKC7S6YJ4 tag=VC5DOOQAV06N type=write size=174038 2023-10-05T11:35:12.220 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.217+0000 7f26f5634780 1 > prepared part key=_multipart_VJTFYDETLSFD.2~AI3VYDDDBWSO.0 size=1048576 2023-10-05T11:35:12.221 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.218+0000 7f26f5634780 1 > prepared part key=_multipart_VJTFYDETLSFD.2~AI3VYDDDBWSO.1 size=980106 2023-10-05T11:35:12.222 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.218+0000 7f26f5634780 1 > prepared multipart upload key=VJTFYDETLSFD upload=AI3VYDDDBWSO tag=8BCANPP1MHH0 type=write size=3077258 2023-10-05T11:35:12.222 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.219+0000 7f26f5634780 1 < completed part key=_multipart_PNV0Q6ZPLYV0.2~GWEUT1ZFVLRG.0 size=1048576 2023-10-05T11:35:12.223 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.220+0000 7f26f5634780 1 < completed part key=_multipart_PNV0Q6ZPLYV0.2~GWEUT1ZFVLRG.1 size=1048576 2023-10-05T11:35:12.225 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.221+0000 7f26f5634780 1 < completed part key=_multipart_PNV0Q6ZPLYV0.2~GWEUT1ZFVLRG.2 size=754407 2023-10-05T11:35:12.227 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.223+0000 7f26f5634780 1 < completed multipart upload key=PNV0Q6ZPLYV0 upload=GWEUT1ZFVLRG tag=VA5UNOMHEHWJ type=write size=3900135 2023-10-05T11:35:12.229 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.225+0000 7f26f5634780 1 > prepared part key=_multipart_VJTFYDETLSFD.2~CEIH358UZJZ9.0 size=651073 2023-10-05T11:35:12.229 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.225+0000 7f26f5634780 1 > prepared multipart upload key=VJTFYDETLSFD upload=CEIH358UZJZ9 tag=6PVCA3GI9D6V type=write size=1699649 2023-10-05T11:35:12.230 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.227+0000 7f26f5634780 1 < completed delete operation key=6DP3UJ4CW1MO tag=73ES68RBWON2 type=del 2023-10-05T11:35:12.232 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.229+0000 7f26f5634780 1 > prepared part key=_multipart_5V0Q651D4VN2.2~SARNK5ZZWTZY.0 size=1048576 2023-10-05T11:35:12.233 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.230+0000 7f26f5634780 1 > prepared part key=_multipart_5V0Q651D4VN2.2~SARNK5ZZWTZY.1 size=434300 2023-10-05T11:35:12.233 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.230+0000 7f26f5634780 1 > prepared multipart upload key=5V0Q651D4VN2 upload=SARNK5ZZWTZY tag=4HD87PMP9170 type=write size=2531452 2023-10-05T11:35:12.235 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.231+0000 7f26f5634780 1 < completed part key=_multipart_MEY4SZRHU9NZ.2~434E5UA74X3U.0 size=1048576 2023-10-05T11:35:12.236 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.232+0000 7f26f5634780 1 < completed part key=_multipart_MEY4SZRHU9NZ.2~434E5UA74X3U.1 size=943819 2023-10-05T11:35:12.238 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.235+0000 7f26f5634780 1 < completed multipart upload key=MEY4SZRHU9NZ upload=434E5UA74X3U tag=6YT8JG0NSLOZ type=write size=3040971 2023-10-05T11:35:12.239 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.236+0000 7f26f5634780 1 > prepared operation key=PNV0Q6ZPLYV0 tag=FZAPX742N59N type=del size=1453320 2023-10-05T11:35:12.242 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.239+0000 7f26f5634780 1 < suggested remove operation key=2D4PDQQT54ZA tag=D4EG4I0V97E0 type=del 2023-10-05T11:35:12.244 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.241+0000 7f26f5634780 1 > prepared part key=_multipart_0PWYKC7S6YJ4.2~XVWUY2SLPOVG.0 size=1048576 2023-10-05T11:35:12.245 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.242+0000 7f26f5634780 1 > prepared part key=_multipart_0PWYKC7S6YJ4.2~XVWUY2SLPOVG.1 size=1048576 2023-10-05T11:35:12.246 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.243+0000 7f26f5634780 1 > prepared part key=_multipart_0PWYKC7S6YJ4.2~XVWUY2SLPOVG.2 size=175054 2023-10-05T11:35:12.246 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.243+0000 7f26f5634780 1 > prepared multipart upload key=0PWYKC7S6YJ4 upload=XVWUY2SLPOVG tag=82CDQC9ZXVJA type=write size=3320782 2023-10-05T11:35:12.247 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.244+0000 7f26f5634780 1 < completed part key=_multipart_4IBQJLJR7LD8.2~S0LCJINNLU1T.0 size=136255 2023-10-05T11:35:12.250 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.246+0000 7f26f5634780 1 < completed multipart upload key=4IBQJLJR7LD8 upload=S0LCJINNLU1T tag=MLBUJOVKY9G9 type=write size=1184831 2023-10-05T11:35:12.251 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.247+0000 7f26f5634780 1 > prepared operation key=U6172JUYW7J6 tag=VMEELKE92ZD8 type=write size=714959 2023-10-05T11:35:12.252 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.249+0000 7f26f5634780 1 < completed delete operation key=6DP3UJ4CW1MO tag=7VHUNFJK83J7 type=del 2023-10-05T11:35:12.254 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.250+0000 7f26f5634780 1 > prepared operation key=FOMNIIY47UUM tag=NCKX79T7IWCA type=del size=722784 2023-10-05T11:35:12.257 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.253+0000 7f26f5634780 1 < completed part key=_multipart_4IBQJLJR7LD8.2~4RLOZQGY8PM3.0 size=1048576 2023-10-05T11:35:12.258 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.254+0000 7f26f5634780 1 < completed part key=_multipart_4IBQJLJR7LD8.2~4RLOZQGY8PM3.1 size=679872 2023-10-05T11:35:12.260 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.256+0000 7f26f5634780 1 < completed multipart upload key=4IBQJLJR7LD8 upload=4RLOZQGY8PM3 tag=6PWT5ZTDZMGJ type=write size=2777024 2023-10-05T11:35:12.261 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.257+0000 7f26f5634780 1 > prepared operation key=9S0YW7PPSJ8G tag=61EKUZA6C9KM type=write size=389130 2023-10-05T11:35:12.262 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.259+0000 7f26f5634780 1 < completed part key=_multipart_5V0Q651D4VN2.2~GMNMMQ3KDHX1.0 size=1048576 2023-10-05T11:35:12.263 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.260+0000 7f26f5634780 1 < completed part key=_multipart_5V0Q651D4VN2.2~GMNMMQ3KDHX1.1 size=1048576 2023-10-05T11:35:12.264 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.261+0000 7f26f5634780 1 < completed part key=_multipart_5V0Q651D4VN2.2~GMNMMQ3KDHX1.2 size=187862 2023-10-05T11:35:12.266 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.263+0000 7f26f5634780 1 < completed multipart upload key=5V0Q651D4VN2 upload=GMNMMQ3KDHX1 tag=LJM0Y9HS98U0 type=write size=3333590 2023-10-05T11:35:12.268 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.265+0000 7f26f5634780 1 > prepared part key=_multipart_MEY4SZRHU9NZ.2~V2ND47PIOXRX.0 size=728665 2023-10-05T11:35:12.268 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.265+0000 7f26f5634780 1 > prepared multipart upload key=MEY4SZRHU9NZ upload=V2ND47PIOXRX tag=87DM096TI9YW type=write size=1777241 2023-10-05T11:35:12.269 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.266+0000 7f26f5634780 1 < completed part key=_multipart_PC8WTJ8AYJ24.2~8VNLXT0MGLWT.0 size=358919 2023-10-05T11:35:12.271 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.268+0000 7f26f5634780 1 < completed multipart upload key=PC8WTJ8AYJ24 upload=8VNLXT0MGLWT tag=PTEFSKJ24U87 type=write size=1407495 2023-10-05T11:35:12.273 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.270+0000 7f26f5634780 1 > prepared part key=_multipart_7W9LL5HSU3BG.2~05ZLMDH4QN10.0 size=1048576 2023-10-05T11:35:12.274 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.271+0000 7f26f5634780 1 > prepared part key=_multipart_7W9LL5HSU3BG.2~05ZLMDH4QN10.1 size=747103 2023-10-05T11:35:12.274 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.271+0000 7f26f5634780 1 > prepared multipart upload key=7W9LL5HSU3BG upload=05ZLMDH4QN10 tag=FAB1Q7PBCTYR type=write size=2844255 2023-10-05T11:35:12.275 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.272+0000 7f26f5634780 1 < completed delete operation key=J5EIH25Y471T tag=12MQU9BTV4U0 type=del 2023-10-05T11:35:12.276 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.273+0000 7f26f5634780 1 > prepared operation key=J5EIH25Y471T tag=CI52XNQ8Q6HW type=del size=1568104 2023-10-05T11:35:12.278 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.274+0000 7f26f5634780 1 < completed part key=_multipart_WYN9BG66LA3K.2~T6WTLKYCSAY4.0 size=1048576 2023-10-05T11:35:12.279 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.275+0000 7f26f5634780 1 < completed part key=_multipart_WYN9BG66LA3K.2~T6WTLKYCSAY4.1 size=1048576 2023-10-05T11:35:12.279 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.276+0000 7f26f5634780 1 < completed part key=_multipart_WYN9BG66LA3K.2~T6WTLKYCSAY4.2 size=264670 2023-10-05T11:35:12.282 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.278+0000 7f26f5634780 1 < completed multipart upload key=WYN9BG66LA3K upload=T6WTLKYCSAY4 tag=W6KC2YA2GBT0 type=write size=3410398 2023-10-05T11:35:12.284 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.281+0000 7f26f5634780 1 > prepared part key=_multipart_9S0YW7PPSJ8G.2~0H8AA9GSQ67W.0 size=185365 2023-10-05T11:35:12.284 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.281+0000 7f26f5634780 1 > prepared multipart upload key=9S0YW7PPSJ8G upload=0H8AA9GSQ67W tag=X7YCW36KBWC2 type=write size=1233941 2023-10-05T11:35:12.285 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.282+0000 7f26f5634780 1 < completed delete operation key=4IBQJLJR7LD8 tag=UQ53NU02MXBG type=del 2023-10-05T11:35:12.287 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.283+0000 7f26f5634780 1 > prepared operation key=VJTFYDETLSFD tag=6HYSWQF5PLV3 type=del size=2462072 2023-10-05T11:35:12.288 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.284+0000 7f26f5634780 1 < completed delete operation key=LLR5J3X15W5R tag=X3GSUFW4M7T0 type=del 2023-10-05T11:35:12.290 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.287+0000 7f26f5634780 1 > prepared part key=_multipart_LLR5J3X15W5R.2~9KQQ6S04QL0P.0 size=722506 2023-10-05T11:35:12.290 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.287+0000 7f26f5634780 1 > prepared multipart upload key=LLR5J3X15W5R upload=9KQQ6S04QL0P tag=12I0D5JFIHVF type=write size=1771082 2023-10-05T11:35:12.291 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.288+0000 7f26f5634780 1 < canceled operation key=IKCNZOTVWOC6 tag=Q69TVR19KB07 type=del size=453547 2023-10-05T11:35:12.293 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.289+0000 7f26f5634780 1 > prepared operation key=WYN9BG66LA3K tag=B2BADVS7I756 type=del size=3334274 2023-10-05T11:35:12.294 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.290+0000 7f26f5634780 1 < completed part key=_multipart_2D4PDQQT54ZA.2~RVV7GU3TS8HQ.0 size=1048576 2023-10-05T11:35:12.295 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.291+0000 7f26f5634780 1 < completed part key=_multipart_2D4PDQQT54ZA.2~RVV7GU3TS8HQ.1 size=442267 2023-10-05T11:35:12.296 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.293+0000 7f26f5634780 1 < completed multipart upload key=2D4PDQQT54ZA upload=RVV7GU3TS8HQ tag=XJLCTO5SR6KC type=write size=2539419 2023-10-05T11:35:12.298 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.295+0000 7f26f5634780 1 > prepared part key=_multipart_4D3H60UTIXH3.2~TCQLBDFQOUTJ.0 size=785338 2023-10-05T11:35:12.299 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.295+0000 7f26f5634780 1 > prepared multipart upload key=4D3H60UTIXH3 upload=TCQLBDFQOUTJ tag=H6SXI9CU5P36 type=write size=1833914 2023-10-05T11:35:12.300 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.296+0000 7f26f5634780 1 < completed part key=_multipart_VJTFYDETLSFD.2~AI3VYDDDBWSO.0 size=1048576 2023-10-05T11:35:12.301 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.297+0000 7f26f5634780 1 < completed part key=_multipart_VJTFYDETLSFD.2~AI3VYDDDBWSO.1 size=980106 2023-10-05T11:35:12.303 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.299+0000 7f26f5634780 1 < completed multipart upload key=VJTFYDETLSFD upload=AI3VYDDDBWSO tag=8BCANPP1MHH0 type=write size=3077258 2023-10-05T11:35:12.304 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.300+0000 7f26f5634780 1 > prepared operation key=2D4PDQQT54ZA tag=SXLQ81PU907C type=del size=2506648 2023-10-05T11:35:12.305 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.302+0000 7f26f5634780 1 < completed part key=_multipart_VJTFYDETLSFD.2~CEIH358UZJZ9.0 size=651073 2023-10-05T11:35:12.307 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.303+0000 7f26f5634780 1 < completed multipart upload key=VJTFYDETLSFD upload=CEIH358UZJZ9 tag=6PVCA3GI9D6V type=write size=1699649 2023-10-05T11:35:12.308 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.305+0000 7f26f5634780 1 > prepared operation key=LLR5J3X15W5R tag=04B5CXP2L4UB type=del size=1389925 2023-10-05T11:35:12.309 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.306+0000 7f26f5634780 1 < completed part key=_multipart_5V0Q651D4VN2.2~SARNK5ZZWTZY.0 size=1048576 2023-10-05T11:35:12.310 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.307+0000 7f26f5634780 1 < completed part key=_multipart_5V0Q651D4VN2.2~SARNK5ZZWTZY.1 size=434300 2023-10-05T11:35:12.312 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.309+0000 7f26f5634780 1 < completed multipart upload key=5V0Q651D4VN2 upload=SARNK5ZZWTZY tag=4HD87PMP9170 type=write size=2531452 2023-10-05T11:35:12.313 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.310+0000 7f26f5634780 1 > prepared operation key=BTZUVE8R96XT tag=N2KHMNGBM01K type=del size=2942065 2023-10-05T11:35:12.316 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.312+0000 7f26f5634780 1 < suggested update operation key=PNV0Q6ZPLYV0 tag=FZAPX742N59N type=del size=1453320 2023-10-05T11:35:12.317 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.314+0000 7f26f5634780 1 > prepared operation key=8IPCP77WVVZT tag=30DSB9Q43RQF type=del size=2180662 2023-10-05T11:35:12.317 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.314+0000 7f26f5634780 1 < canceled part key=_multipart_0PWYKC7S6YJ4.2~XVWUY2SLPOVG.0 size=1048576 2023-10-05T11:35:12.318 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.315+0000 7f26f5634780 1 < completed part key=_multipart_0PWYKC7S6YJ4.2~XVWUY2SLPOVG.1 size=1048576 2023-10-05T11:35:12.319 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.316+0000 7f26f5634780 1 < completed part key=_multipart_0PWYKC7S6YJ4.2~XVWUY2SLPOVG.2 size=175054 2023-10-05T11:35:12.321 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.318+0000 7f26f5634780 1 < canceled multipart upload key=0PWYKC7S6YJ4 upload=XVWUY2SLPOVG tag=82CDQC9ZXVJA type=write size=3320782 2023-10-05T11:35:12.322 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.319+0000 7f26f5634780 1 > prepared operation key=IKCNZOTVWOC6 tag=6I6CSJZ5OUPM type=del size=3907349 2023-10-05T11:35:12.324 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.320+0000 7f26f5634780 1 < completed write operation key=U6172JUYW7J6 tag=VMEELKE92ZD8 type=write size=714959 2023-10-05T11:35:12.325 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.321+0000 7f26f5634780 1 > prepared operation key=7W9LL5HSU3BG tag=552TQUG3WBDC type=del size=2739253 2023-10-05T11:35:12.326 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.322+0000 7f26f5634780 1 < canceled operation key=FOMNIIY47UUM tag=NCKX79T7IWCA type=del size=722784 2023-10-05T11:35:12.327 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.324+0000 7f26f5634780 1 > prepared operation key=LLR5J3X15W5R tag=M3AR0WWYDU7J type=del size=472097 2023-10-05T11:35:12.328 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.325+0000 7f26f5634780 1 < canceled operation key=9S0YW7PPSJ8G tag=61EKUZA6C9KM type=write size=389130 2023-10-05T11:35:12.330 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.326+0000 7f26f5634780 1 > prepared operation key=2U0NRDGDNUTA tag=9PMLYDISMNW6 type=del size=581399 2023-10-05T11:35:12.331 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.327+0000 7f26f5634780 1 < completed part key=_multipart_MEY4SZRHU9NZ.2~V2ND47PIOXRX.0 size=728665 2023-10-05T11:35:12.333 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.329+0000 7f26f5634780 1 < completed multipart upload key=MEY4SZRHU9NZ upload=V2ND47PIOXRX tag=87DM096TI9YW type=write size=1777241 2023-10-05T11:35:12.334 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.331+0000 7f26f5634780 1 > prepared operation key=2U0NRDGDNUTA tag=7F7VS07E0636 type=write size=702731 2023-10-05T11:35:12.335 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.332+0000 7f26f5634780 1 < completed part key=_multipart_7W9LL5HSU3BG.2~05ZLMDH4QN10.0 size=1048576 2023-10-05T11:35:12.336 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.333+0000 7f26f5634780 1 < completed part key=_multipart_7W9LL5HSU3BG.2~05ZLMDH4QN10.1 size=747103 2023-10-05T11:35:12.339 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.335+0000 7f26f5634780 1 < completed multipart upload key=7W9LL5HSU3BG upload=05ZLMDH4QN10 tag=FAB1Q7PBCTYR type=write size=2844255 2023-10-05T11:35:12.340 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.337+0000 7f26f5634780 1 > prepared operation key=LLR5J3X15W5R tag=WXU9NCRZVNW3 type=del size=1349934 2023-10-05T11:35:12.342 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.338+0000 7f26f5634780 1 < completed delete operation key=J5EIH25Y471T tag=CI52XNQ8Q6HW type=del 2023-10-05T11:35:12.344 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.341+0000 7f26f5634780 1 > prepared part key=_multipart_QYQDXVIGZ7O8.2~C12Y6JUN73CU.0 size=1048576 2023-10-05T11:35:12.346 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.342+0000 7f26f5634780 1 > prepared part key=_multipart_QYQDXVIGZ7O8.2~C12Y6JUN73CU.1 size=484839 2023-10-05T11:35:12.346 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.342+0000 7f26f5634780 1 > prepared multipart upload key=QYQDXVIGZ7O8 upload=C12Y6JUN73CU tag=AXQEHH05XX47 type=write size=2581991 2023-10-05T11:35:12.346 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.343+0000 7f26f5634780 1 < canceled part key=_multipart_9S0YW7PPSJ8G.2~0H8AA9GSQ67W.0 size=185365 2023-10-05T11:35:12.348 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.345+0000 7f26f5634780 1 < canceled multipart upload key=9S0YW7PPSJ8G upload=0H8AA9GSQ67W tag=X7YCW36KBWC2 type=write size=1233941 2023-10-05T11:35:12.350 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.346+0000 7f26f5634780 1 > prepared operation key=4D3H60UTIXH3 tag=CV0HBH06UKWG type=del size=3619641 2023-10-05T11:35:12.351 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.348+0000 7f26f5634780 1 < completed delete operation key=VJTFYDETLSFD tag=6HYSWQF5PLV3 type=del 2023-10-05T11:35:12.353 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.349+0000 7f26f5634780 1 > prepared operation key=BTZUVE8R96XT tag=365CI4EEMLH3 type=del size=3845710 2023-10-05T11:35:12.353 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.349+0000 7f26f5634780 1 < canceled part key=_multipart_LLR5J3X15W5R.2~9KQQ6S04QL0P.0 size=722506 2023-10-05T11:35:12.355 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.352+0000 7f26f5634780 1 < canceled multipart upload key=LLR5J3X15W5R upload=9KQQ6S04QL0P tag=12I0D5JFIHVF type=write size=1771082 2023-10-05T11:35:12.358 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.354+0000 7f26f5634780 1 > prepared operation key=WTCWG1C1SF89 tag=C19VRKUL9H42 type=del size=730571 2023-10-05T11:35:12.359 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.356+0000 7f26f5634780 1 < completed delete operation key=WYN9BG66LA3K tag=B2BADVS7I756 type=del 2023-10-05T11:35:12.361 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.357+0000 7f26f5634780 1 > prepared operation key=2D4PDQQT54ZA tag=JAHAMQQO32TG type=write size=689358 2023-10-05T11:35:12.362 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.359+0000 7f26f5634780 1 < completed part key=_multipart_4D3H60UTIXH3.2~TCQLBDFQOUTJ.0 size=785338 2023-10-05T11:35:12.365 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.362+0000 7f26f5634780 1 < completed multipart upload key=4D3H60UTIXH3 upload=TCQLBDFQOUTJ tag=H6SXI9CU5P36 type=write size=1833914 2023-10-05T11:35:12.366 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.363+0000 7f26f5634780 1 > prepared operation key=IKCNZOTVWOC6 tag=EA1EMMDOM2VL type=del size=236730 2023-10-05T11:35:12.367 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.364+0000 7f26f5634780 1 < completed delete operation key=2D4PDQQT54ZA tag=SXLQ81PU907C type=del 2023-10-05T11:35:12.370 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.366+0000 7f26f5634780 1 > prepared part key=_multipart_761J2C7GHWU5.2~LKYFERQX5SLM.0 size=703971 2023-10-05T11:35:12.370 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.366+0000 7f26f5634780 1 > prepared multipart upload key=761J2C7GHWU5 upload=LKYFERQX5SLM tag=1PUWBJA7PYKP type=write size=1752547 2023-10-05T11:35:12.371 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.368+0000 7f26f5634780 1 < completed delete operation key=LLR5J3X15W5R tag=04B5CXP2L4UB type=del 2023-10-05T11:35:12.372 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.369+0000 7f26f5634780 1 > prepared operation key=J5EIH25Y471T tag=FRL77LWALN1U type=del size=99750 2023-10-05T11:35:12.375 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.372+0000 7f26f5634780 1 < completed delete operation key=BTZUVE8R96XT tag=N2KHMNGBM01K type=del 2023-10-05T11:35:12.378 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.374+0000 7f26f5634780 1 > prepared part key=_multipart_5OPHKTHXVN5U.2~3Y3TTPJZKIO3.0 size=1048576 2023-10-05T11:35:12.378 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.375+0000 7f26f5634780 1 > prepared part key=_multipart_5OPHKTHXVN5U.2~3Y3TTPJZKIO3.1 size=172524 2023-10-05T11:35:12.379 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.375+0000 7f26f5634780 1 > prepared multipart upload key=5OPHKTHXVN5U upload=3Y3TTPJZKIO3 tag=QVHKMIMGCNYG type=write size=2269676 2023-10-05T11:35:12.380 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.376+0000 7f26f5634780 1 < canceled operation key=8IPCP77WVVZT tag=30DSB9Q43RQF type=del size=2180662 2023-10-05T11:35:12.381 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.377+0000 7f26f5634780 1 > prepared operation key=BU3KSHTINB36 tag=D8MDJ7AH1EO0 type=del size=936008 2023-10-05T11:35:12.382 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.379+0000 7f26f5634780 1 < completed delete operation key=IKCNZOTVWOC6 tag=6I6CSJZ5OUPM type=del 2023-10-05T11:35:12.384 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.381+0000 7f26f5634780 1 > prepared part key=_multipart_761J2C7GHWU5.2~ZEFJGX76OKHX.0 size=344184 2023-10-05T11:35:12.385 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.381+0000 7f26f5634780 1 > prepared multipart upload key=761J2C7GHWU5 upload=ZEFJGX76OKHX tag=JSAYBAVUUON4 type=write size=1392760 2023-10-05T11:35:12.385 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.382+0000 7f26f5634780 1 < canceled operation key=7W9LL5HSU3BG tag=552TQUG3WBDC type=del size=2739253 2023-10-05T11:35:12.387 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.383+0000 7f26f5634780 1 > prepared operation key=BTZUVE8R96XT tag=OPZ8MVN30NCC type=write size=548071 2023-10-05T11:35:12.388 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.385+0000 7f26f5634780 1 < completed delete operation key=LLR5J3X15W5R tag=M3AR0WWYDU7J type=del 2023-10-05T11:35:12.389 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.386+0000 7f26f5634780 1 > prepared operation key=S3DKYDFT4IO2 tag=TWKNP302E02M type=del size=2644394 2023-10-05T11:35:12.390 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.387+0000 7f26f5634780 1 < completed delete operation key=2U0NRDGDNUTA tag=9PMLYDISMNW6 type=del 2023-10-05T11:35:12.393 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.389+0000 7f26f5634780 1 > prepared part key=_multipart_VJTFYDETLSFD.2~QC2PQM7CN7SM.0 size=709218 2023-10-05T11:35:12.393 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.389+0000 7f26f5634780 1 > prepared multipart upload key=VJTFYDETLSFD upload=QC2PQM7CN7SM tag=TCEBPW6YVHZZ type=write size=1757794 2023-10-05T11:35:12.394 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.390+0000 7f26f5634780 1 < completed write operation key=2U0NRDGDNUTA tag=7F7VS07E0636 type=write size=702731 2023-10-05T11:35:12.396 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.393+0000 7f26f5634780 1 > prepared part key=_multipart_VJTFYDETLSFD.2~O0AMXF39YKMA.0 size=1048576 2023-10-05T11:35:12.397 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.393+0000 7f26f5634780 1 > prepared part key=_multipart_VJTFYDETLSFD.2~O0AMXF39YKMA.1 size=868265 2023-10-05T11:35:12.397 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.393+0000 7f26f5634780 1 > prepared multipart upload key=VJTFYDETLSFD upload=O0AMXF39YKMA tag=AWYOEK8QJ5MS type=write size=2965417 2023-10-05T11:35:12.398 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.395+0000 7f26f5634780 1 < completed delete operation key=LLR5J3X15W5R tag=WXU9NCRZVNW3 type=del 2023-10-05T11:35:12.400 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.397+0000 7f26f5634780 1 > prepared part key=_multipart_BTZUVE8R96XT.2~PH3HNRPI98ON.0 size=786632 2023-10-05T11:35:12.400 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.397+0000 7f26f5634780 1 > prepared multipart upload key=BTZUVE8R96XT upload=PH3HNRPI98ON tag=3X5HILNTA7JI type=write size=1835208 2023-10-05T11:35:12.402 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.398+0000 7f26f5634780 1 < completed part key=_multipart_QYQDXVIGZ7O8.2~C12Y6JUN73CU.0 size=1048576 2023-10-05T11:35:12.403 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.399+0000 7f26f5634780 1 < completed part key=_multipart_QYQDXVIGZ7O8.2~C12Y6JUN73CU.1 size=484839 2023-10-05T11:35:12.405 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.401+0000 7f26f5634780 1 < completed multipart upload key=QYQDXVIGZ7O8 upload=C12Y6JUN73CU tag=AXQEHH05XX47 type=write size=2581991 2023-10-05T11:35:12.407 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.403+0000 7f26f5634780 1 > prepared part key=_multipart_NV4Q36UOLX8A.2~WVAH44OF5AWF.0 size=1048576 2023-10-05T11:35:12.408 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.404+0000 7f26f5634780 1 > prepared part key=_multipart_NV4Q36UOLX8A.2~WVAH44OF5AWF.1 size=382098 2023-10-05T11:35:12.408 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.404+0000 7f26f5634780 1 > prepared multipart upload key=NV4Q36UOLX8A upload=WVAH44OF5AWF tag=HXPB8BE32O8S type=write size=2479250 2023-10-05T11:35:12.410 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.407+0000 7f26f5634780 1 < suggested remove operation key=4D3H60UTIXH3 tag=CV0HBH06UKWG type=del 2023-10-05T11:35:12.411 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.408+0000 7f26f5634780 1 > prepared operation key=0PWYKC7S6YJ4 tag=AGJIF8I01IRK type=del size=3323611 2023-10-05T11:35:12.412 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.409+0000 7f26f5634780 1 < canceled operation key=BTZUVE8R96XT tag=365CI4EEMLH3 type=del size=3845710 2023-10-05T11:35:12.414 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.410+0000 7f26f5634780 1 > prepared operation key=6DP3UJ4CW1MO tag=E1XH206NNT09 type=del size=3014042 2023-10-05T11:35:12.415 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.412+0000 7f26f5634780 1 < completed delete operation key=WTCWG1C1SF89 tag=C19VRKUL9H42 type=del 2023-10-05T11:35:12.416 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.413+0000 7f26f5634780 1 > prepared operation key=IC7T3ZK81WQS tag=RNYKBRBC7DH1 type=del size=3304890 2023-10-05T11:35:12.418 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.415+0000 7f26f5634780 1 < suggested update operation key=2D4PDQQT54ZA tag=JAHAMQQO32TG type=write size=689358 2023-10-05T11:35:12.420 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.416+0000 7f26f5634780 1 > prepared operation key=LLR5J3X15W5R tag=8W3PY5FANY4K type=del size=1977915 2023-10-05T11:35:12.422 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.419+0000 7f26f5634780 1 < suggested remove operation key=IKCNZOTVWOC6 tag=EA1EMMDOM2VL type=del 2023-10-05T11:35:12.423 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.420+0000 7f26f5634780 1 > prepared operation key=LLR5J3X15W5R tag=7UIZZ4V52XCO type=write size=447760 2023-10-05T11:35:12.425 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.421+0000 7f26f5634780 1 < completed part key=_multipart_761J2C7GHWU5.2~LKYFERQX5SLM.0 size=703971 2023-10-05T11:35:12.426 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.423+0000 7f26f5634780 1 < completed multipart upload key=761J2C7GHWU5 upload=LKYFERQX5SLM tag=1PUWBJA7PYKP type=write size=1752547 2023-10-05T11:35:12.428 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.424+0000 7f26f5634780 1 > prepared operation key=2U0NRDGDNUTA tag=BSTXNQ9WUTMJ type=del size=692453 2023-10-05T11:35:12.429 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.426+0000 7f26f5634780 1 < completed delete operation key=J5EIH25Y471T tag=FRL77LWALN1U type=del 2023-10-05T11:35:12.430 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.427+0000 7f26f5634780 1 > prepared operation key=WTCWG1C1SF89 tag=E7NLUBQSOS0A type=del size=1327990 2023-10-05T11:35:12.432 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.428+0000 7f26f5634780 1 < completed part key=_multipart_5OPHKTHXVN5U.2~3Y3TTPJZKIO3.0 size=1048576 2023-10-05T11:35:12.433 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.429+0000 7f26f5634780 1 < completed part key=_multipart_5OPHKTHXVN5U.2~3Y3TTPJZKIO3.1 size=172524 2023-10-05T11:35:12.435 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.431+0000 7f26f5634780 1 < completed multipart upload key=5OPHKTHXVN5U upload=3Y3TTPJZKIO3 tag=QVHKMIMGCNYG type=write size=2269676 2023-10-05T11:35:12.436 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.433+0000 7f26f5634780 1 > prepared operation key=LLR5J3X15W5R tag=LCS5LADYYHET type=del size=883827 2023-10-05T11:35:12.437 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.434+0000 7f26f5634780 1 < completed delete operation key=BU3KSHTINB36 tag=D8MDJ7AH1EO0 type=del 2023-10-05T11:35:12.438 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.435+0000 7f26f5634780 1 > prepared operation key=2D4PDQQT54ZA tag=AW5M8RUWE00B type=del size=225550 2023-10-05T11:35:12.439 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.435+0000 7f26f5634780 1 < canceled part key=_multipart_761J2C7GHWU5.2~ZEFJGX76OKHX.0 size=344184 2023-10-05T11:35:12.441 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.437+0000 7f26f5634780 1 < canceled multipart upload key=761J2C7GHWU5 upload=ZEFJGX76OKHX tag=JSAYBAVUUON4 type=write size=1392760 2023-10-05T11:35:12.442 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.438+0000 7f26f5634780 1 > prepared operation key=9S0YW7PPSJ8G tag=3WWE9AI56BO9 type=del size=3710875 2023-10-05T11:35:12.443 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.440+0000 7f26f5634780 1 < completed write operation key=BTZUVE8R96XT tag=OPZ8MVN30NCC type=write size=548071 2023-10-05T11:35:12.445 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.442+0000 7f26f5634780 1 > prepared part key=_multipart_FOMNIIY47UUM.2~EFSR9565GYQZ.0 size=1048576 2023-10-05T11:35:12.447 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.443+0000 7f26f5634780 1 > prepared part key=_multipart_FOMNIIY47UUM.2~EFSR9565GYQZ.1 size=492403 2023-10-05T11:35:12.447 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.443+0000 7f26f5634780 1 > prepared multipart upload key=FOMNIIY47UUM upload=EFSR9565GYQZ tag=TT4PTECAXO2T type=write size=2589555 2023-10-05T11:35:12.448 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.445+0000 7f26f5634780 1 < completed delete operation key=S3DKYDFT4IO2 tag=TWKNP302E02M type=del 2023-10-05T11:35:12.449 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.446+0000 7f26f5634780 1 > prepared operation key=PNV0Q6ZPLYV0 tag=8Q86BHXFEWI8 type=del size=185584 2023-10-05T11:35:12.451 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.447+0000 7f26f5634780 1 < completed part key=_multipart_VJTFYDETLSFD.2~QC2PQM7CN7SM.0 size=709218 2023-10-05T11:35:12.453 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.449+0000 7f26f5634780 1 < completed multipart upload key=VJTFYDETLSFD upload=QC2PQM7CN7SM tag=TCEBPW6YVHZZ type=write size=1757794 2023-10-05T11:35:12.454 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.451+0000 7f26f5634780 1 > prepared operation key=8IPCP77WVVZT tag=7OO7CYHIF7U3 type=del size=2966676 2023-10-05T11:35:12.455 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.452+0000 7f26f5634780 1 < completed part key=_multipart_VJTFYDETLSFD.2~O0AMXF39YKMA.0 size=1048576 2023-10-05T11:35:12.456 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.453+0000 7f26f5634780 1 < completed part key=_multipart_VJTFYDETLSFD.2~O0AMXF39YKMA.1 size=868265 2023-10-05T11:35:12.458 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.455+0000 7f26f5634780 1 < completed multipart upload key=VJTFYDETLSFD upload=O0AMXF39YKMA tag=AWYOEK8QJ5MS type=write size=2965417 2023-10-05T11:35:12.461 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.457+0000 7f26f5634780 1 > prepared part key=_multipart_QYQDXVIGZ7O8.2~YJTEWMX2L1ZX.0 size=1048576 2023-10-05T11:35:12.462 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.458+0000 7f26f5634780 1 > prepared part key=_multipart_QYQDXVIGZ7O8.2~YJTEWMX2L1ZX.1 size=89046 2023-10-05T11:35:12.462 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.458+0000 7f26f5634780 1 > prepared multipart upload key=QYQDXVIGZ7O8 upload=YJTEWMX2L1ZX tag=85Q83YOG281S type=write size=2186198 2023-10-05T11:35:12.463 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.460+0000 7f26f5634780 1 < completed part key=_multipart_BTZUVE8R96XT.2~PH3HNRPI98ON.0 size=786632 2023-10-05T11:35:12.465 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.462+0000 7f26f5634780 1 < completed multipart upload key=BTZUVE8R96XT upload=PH3HNRPI98ON tag=3X5HILNTA7JI type=write size=1835208 2023-10-05T11:35:12.466 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.463+0000 7f26f5634780 1 > prepared operation key=AV0XKXX1IR4B tag=C8UBAR8EIXSD type=del size=3140453 2023-10-05T11:35:12.468 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.464+0000 7f26f5634780 1 < completed part key=_multipart_NV4Q36UOLX8A.2~WVAH44OF5AWF.0 size=1048576 2023-10-05T11:35:12.469 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.465+0000 7f26f5634780 1 < completed part key=_multipart_NV4Q36UOLX8A.2~WVAH44OF5AWF.1 size=382098 2023-10-05T11:35:12.471 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.467+0000 7f26f5634780 1 < completed multipart upload key=NV4Q36UOLX8A upload=WVAH44OF5AWF tag=HXPB8BE32O8S type=write size=2479250 2023-10-05T11:35:12.472 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.469+0000 7f26f5634780 1 > prepared operation key=7W9LL5HSU3BG tag=F5DTOXHX3YL5 type=del size=8876 2023-10-05T11:35:12.473 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.470+0000 7f26f5634780 1 < completed delete operation key=0PWYKC7S6YJ4 tag=AGJIF8I01IRK type=del 2023-10-05T11:35:12.475 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.471+0000 7f26f5634780 1 > prepared operation key=761J2C7GHWU5 tag=KT20H2OWKL3Z type=del size=3996235 2023-10-05T11:35:12.476 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.472+0000 7f26f5634780 1 < canceled operation key=6DP3UJ4CW1MO tag=E1XH206NNT09 type=del size=3014042 2023-10-05T11:35:12.477 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.474+0000 7f26f5634780 1 > prepared operation key=4D3H60UTIXH3 tag=G4OQJ7Q355KX type=del size=1862411 2023-10-05T11:35:12.480 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.476+0000 7f26f5634780 1 < suggested remove operation key=IC7T3ZK81WQS tag=RNYKBRBC7DH1 type=del 2023-10-05T11:35:12.482 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.479+0000 7f26f5634780 1 > prepared part key=_multipart_2D4PDQQT54ZA.2~1VGAGFRSLGKL.0 size=1048576 2023-10-05T11:35:12.483 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.480+0000 7f26f5634780 1 > prepared part key=_multipart_2D4PDQQT54ZA.2~1VGAGFRSLGKL.1 size=164778 2023-10-05T11:35:12.483 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.480+0000 7f26f5634780 1 > prepared multipart upload key=2D4PDQQT54ZA upload=1VGAGFRSLGKL tag=FRS40MICCLEQ type=write size=2261930 2023-10-05T11:35:12.484 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.481+0000 7f26f5634780 1 < canceled operation key=LLR5J3X15W5R tag=8W3PY5FANY4K type=del size=1977915 2023-10-05T11:35:12.486 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.482+0000 7f26f5634780 1 > prepared operation key=6DP3UJ4CW1MO tag=J2HFLX0LWKSJ type=del size=3820885 2023-10-05T11:35:12.487 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.483+0000 7f26f5634780 1 < completed write operation key=LLR5J3X15W5R tag=7UIZZ4V52XCO type=write size=447760 2023-10-05T11:35:12.488 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.485+0000 7f26f5634780 1 > prepared operation key=7TOP5A52M9YP tag=EYAQB4AJN9I0 type=write size=670813 2023-10-05T11:35:12.489 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.486+0000 7f26f5634780 1 < completed delete operation key=2U0NRDGDNUTA tag=BSTXNQ9WUTMJ type=del 2023-10-05T11:35:12.491 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.487+0000 7f26f5634780 1 > prepared operation key=BTZUVE8R96XT tag=5QRTBEMLXF0T type=del size=27438 2023-10-05T11:35:12.493 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.490+0000 7f26f5634780 1 < completed delete operation key=WTCWG1C1SF89 tag=E7NLUBQSOS0A type=del 2023-10-05T11:35:12.495 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.492+0000 7f26f5634780 1 > prepared part key=_multipart_FOMNIIY47UUM.2~CV3CE511MIF0.0 size=1048576 2023-10-05T11:35:12.496 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.493+0000 7f26f5634780 1 > prepared part key=_multipart_FOMNIIY47UUM.2~CV3CE511MIF0.1 size=1048576 2023-10-05T11:35:12.497 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.494+0000 7f26f5634780 1 > prepared part key=_multipart_FOMNIIY47UUM.2~CV3CE511MIF0.2 size=498316 2023-10-05T11:35:12.497 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.494+0000 7f26f5634780 1 > prepared multipart upload key=FOMNIIY47UUM upload=CV3CE511MIF0 tag=TJNZAFSQH4FN type=write size=3644044 2023-10-05T11:35:12.498 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.495+0000 7f26f5634780 1 < completed delete operation key=LLR5J3X15W5R tag=LCS5LADYYHET type=del 2023-10-05T11:35:12.501 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.497+0000 7f26f5634780 1 > prepared part key=_multipart_2U0NRDGDNUTA.2~1FFS1W7GXZ07.0 size=468687 2023-10-05T11:35:12.501 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.497+0000 7f26f5634780 1 > prepared multipart upload key=2U0NRDGDNUTA upload=1FFS1W7GXZ07 tag=QC3WAJK20739 type=write size=1517263 2023-10-05T11:35:12.502 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.498+0000 7f26f5634780 1 < completed delete operation key=2D4PDQQT54ZA tag=AW5M8RUWE00B type=del 2023-10-05T11:35:12.503 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.500+0000 7f26f5634780 1 > prepared operation key=IKCNZOTVWOC6 tag=0HUAKM8TXXA2 type=del size=3699329 2023-10-05T11:35:12.504 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.501+0000 7f26f5634780 1 < completed delete operation key=9S0YW7PPSJ8G tag=3WWE9AI56BO9 type=del 2023-10-05T11:35:12.507 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.503+0000 7f26f5634780 1 > prepared part key=_multipart_9S0YW7PPSJ8G.2~C8Q358LWDZYU.0 size=576943 2023-10-05T11:35:12.507 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.503+0000 7f26f5634780 1 > prepared multipart upload key=9S0YW7PPSJ8G upload=C8Q358LWDZYU tag=W3J8IPP1MZ4A type=write size=1625519 2023-10-05T11:35:12.508 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.504+0000 7f26f5634780 1 < completed part key=_multipart_FOMNIIY47UUM.2~EFSR9565GYQZ.0 size=1048576 2023-10-05T11:35:12.508 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.504+0000 7f26f5634780 1 < canceled part key=_multipart_FOMNIIY47UUM.2~EFSR9565GYQZ.1 size=492403 2023-10-05T11:35:12.510 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.506+0000 7f26f5634780 1 < canceled multipart upload key=FOMNIIY47UUM upload=EFSR9565GYQZ tag=TT4PTECAXO2T type=write size=2589555 2023-10-05T11:35:12.511 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.508+0000 7f26f5634780 1 > prepared operation key=7W9LL5HSU3BG tag=Q1V45G0UC3YW type=del size=123547 2023-10-05T11:35:12.512 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.509+0000 7f26f5634780 1 < canceled operation key=PNV0Q6ZPLYV0 tag=8Q86BHXFEWI8 type=del size=185584 2023-10-05T11:35:12.514 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.510+0000 7f26f5634780 1 > prepared operation key=761J2C7GHWU5 tag=9M9CMK9UTMW1 type=write size=512384 2023-10-05T11:35:12.516 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.513+0000 7f26f5634780 1 < suggested update operation key=8IPCP77WVVZT tag=7OO7CYHIF7U3 type=del size=2966676 2023-10-05T11:35:12.518 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.515+0000 7f26f5634780 1 > prepared part key=_multipart_S3DKYDFT4IO2.2~ZNGEMVKSL7N3.0 size=1048576 2023-10-05T11:35:12.519 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.516+0000 7f26f5634780 1 > prepared part key=_multipart_S3DKYDFT4IO2.2~ZNGEMVKSL7N3.1 size=384819 2023-10-05T11:35:12.519 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.516+0000 7f26f5634780 1 > prepared multipart upload key=S3DKYDFT4IO2 upload=ZNGEMVKSL7N3 tag=H6N0TA5KBHZ4 type=write size=2481971 2023-10-05T11:35:12.519 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.516+0000 7f26f5634780 1 < canceled part key=_multipart_QYQDXVIGZ7O8.2~YJTEWMX2L1ZX.0 size=1048576 2023-10-05T11:35:12.520 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.517+0000 7f26f5634780 1 < completed part key=_multipart_QYQDXVIGZ7O8.2~YJTEWMX2L1ZX.1 size=89046 2023-10-05T11:35:12.522 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.519+0000 7f26f5634780 1 < canceled multipart upload key=QYQDXVIGZ7O8 upload=YJTEWMX2L1ZX tag=85Q83YOG281S type=write size=2186198 2023-10-05T11:35:12.524 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.521+0000 7f26f5634780 1 > prepared part key=_multipart_5OPHKTHXVN5U.2~NKG84FB60IVB.0 size=314634 2023-10-05T11:35:12.524 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.521+0000 7f26f5634780 1 > prepared multipart upload key=5OPHKTHXVN5U upload=NKG84FB60IVB tag=6I7RUSAH44SF type=write size=1363210 2023-10-05T11:35:12.525 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.522+0000 7f26f5634780 1 < completed delete operation key=AV0XKXX1IR4B tag=C8UBAR8EIXSD type=del 2023-10-05T11:35:12.527 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.523+0000 7f26f5634780 1 > prepared operation key=BTZUVE8R96XT tag=A3ER27YDS006 type=del size=1402444 2023-10-05T11:35:12.528 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.525+0000 7f26f5634780 1 < completed delete operation key=7W9LL5HSU3BG tag=F5DTOXHX3YL5 type=del 2023-10-05T11:35:12.530 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.527+0000 7f26f5634780 1 > prepared part key=_multipart_9S0YW7PPSJ8G.2~KV1MF9PMLGNQ.0 size=1048576 2023-10-05T11:35:12.531 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.528+0000 7f26f5634780 1 > prepared part key=_multipart_9S0YW7PPSJ8G.2~KV1MF9PMLGNQ.1 size=302803 2023-10-05T11:35:12.531 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.528+0000 7f26f5634780 1 > prepared multipart upload key=9S0YW7PPSJ8G upload=KV1MF9PMLGNQ tag=EXMOGZRQCTV4 type=write size=2399955 2023-10-05T11:35:12.532 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.529+0000 7f26f5634780 1 < canceled operation key=761J2C7GHWU5 tag=KT20H2OWKL3Z type=del size=3996235 2023-10-05T11:35:12.534 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.530+0000 7f26f5634780 1 > prepared operation key=5OPHKTHXVN5U tag=IUKAADHY8DY4 type=del size=3798965 2023-10-05T11:35:12.536 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.533+0000 7f26f5634780 1 < suggested update operation key=4D3H60UTIXH3 tag=G4OQJ7Q355KX type=del size=1862411 2023-10-05T11:35:12.537 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.534+0000 7f26f5634780 1 > prepared operation key=6DP3UJ4CW1MO tag=O8DW1KW03UIB type=write size=288127 2023-10-05T11:35:12.538 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.535+0000 7f26f5634780 1 < completed part key=_multipart_2D4PDQQT54ZA.2~1VGAGFRSLGKL.0 size=1048576 2023-10-05T11:35:12.539 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.536+0000 7f26f5634780 1 < completed part key=_multipart_2D4PDQQT54ZA.2~1VGAGFRSLGKL.1 size=164778 2023-10-05T11:35:12.542 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.538+0000 7f26f5634780 1 < completed multipart upload key=2D4PDQQT54ZA upload=1VGAGFRSLGKL tag=FRS40MICCLEQ type=write size=2261930 2023-10-05T11:35:12.543 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.539+0000 7f26f5634780 1 > prepared operation key=W2GWVGX42QLD tag=HVC0LCHLGJ2O type=del size=696794 2023-10-05T11:35:12.544 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.541+0000 7f26f5634780 1 < completed delete operation key=6DP3UJ4CW1MO tag=J2HFLX0LWKSJ type=del 2023-10-05T11:35:12.546 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.543+0000 7f26f5634780 1 > prepared part key=_multipart_AV0XKXX1IR4B.2~8LR3E9S2VKU2.0 size=1048576 2023-10-05T11:35:12.547 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.544+0000 7f26f5634780 1 > prepared part key=_multipart_AV0XKXX1IR4B.2~8LR3E9S2VKU2.1 size=1048576 2023-10-05T11:35:12.548 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.545+0000 7f26f5634780 1 > prepared part key=_multipart_AV0XKXX1IR4B.2~8LR3E9S2VKU2.2 size=428184 2023-10-05T11:35:12.548 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.545+0000 7f26f5634780 1 > prepared multipart upload key=AV0XKXX1IR4B upload=8LR3E9S2VKU2 tag=JA6R61WTWVL3 type=write size=3573912 2023-10-05T11:35:12.549 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.546+0000 7f26f5634780 1 < canceled operation key=7TOP5A52M9YP tag=EYAQB4AJN9I0 type=write size=670813 2023-10-05T11:35:12.550 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.547+0000 7f26f5634780 1 > prepared operation key=MEY4SZRHU9NZ tag=5K2MHIO5J03P type=del size=1876167 2023-10-05T11:35:12.552 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.548+0000 7f26f5634780 1 < completed delete operation key=BTZUVE8R96XT tag=5QRTBEMLXF0T type=del 2023-10-05T11:35:12.554 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.551+0000 7f26f5634780 1 > prepared part key=_multipart_BTZUVE8R96XT.2~5OYDGQ2LXLJ0.0 size=1048576 2023-10-05T11:35:12.556 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.552+0000 7f26f5634780 1 > prepared part key=_multipart_BTZUVE8R96XT.2~5OYDGQ2LXLJ0.1 size=1048576 2023-10-05T11:35:12.557 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.553+0000 7f26f5634780 1 > prepared part key=_multipart_BTZUVE8R96XT.2~5OYDGQ2LXLJ0.2 size=15815 2023-10-05T11:35:12.557 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.553+0000 7f26f5634780 1 > prepared multipart upload key=BTZUVE8R96XT upload=5OYDGQ2LXLJ0 tag=1PO75XM7O338 type=write size=3161543 2023-10-05T11:35:12.558 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.555+0000 7f26f5634780 1 < completed part key=_multipart_FOMNIIY47UUM.2~CV3CE511MIF0.0 size=1048576 2023-10-05T11:35:12.559 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.556+0000 7f26f5634780 1 < completed part key=_multipart_FOMNIIY47UUM.2~CV3CE511MIF0.1 size=1048576 2023-10-05T11:35:12.561 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.557+0000 7f26f5634780 1 < completed part key=_multipart_FOMNIIY47UUM.2~CV3CE511MIF0.2 size=498316 2023-10-05T11:35:12.563 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.560+0000 7f26f5634780 1 < completed multipart upload key=FOMNIIY47UUM upload=CV3CE511MIF0 tag=TJNZAFSQH4FN type=write size=3644044 2023-10-05T11:35:12.565 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.561+0000 7f26f5634780 1 > prepared operation key=761J2C7GHWU5 tag=LFCBNSRYGSJN type=del size=1678327 2023-10-05T11:35:12.565 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.562+0000 7f26f5634780 1 < canceled part key=_multipart_2U0NRDGDNUTA.2~1FFS1W7GXZ07.0 size=468687 2023-10-05T11:35:12.567 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.564+0000 7f26f5634780 1 < canceled multipart upload key=2U0NRDGDNUTA upload=1FFS1W7GXZ07 tag=QC3WAJK20739 type=write size=1517263 2023-10-05T11:35:12.569 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.565+0000 7f26f5634780 1 > prepared operation key=IC7T3ZK81WQS tag=BM0ZJ02WIB7O type=del size=3661955 2023-10-05T11:35:12.572 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.568+0000 7f26f5634780 1 < suggested update operation key=IKCNZOTVWOC6 tag=0HUAKM8TXXA2 type=del size=3699329 2023-10-05T11:35:12.573 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.570+0000 7f26f5634780 1 > prepared operation key=2U0NRDGDNUTA tag=02INSEFVEXES type=del size=3291835 2023-10-05T11:35:12.575 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.571+0000 7f26f5634780 1 < completed part key=_multipart_9S0YW7PPSJ8G.2~C8Q358LWDZYU.0 size=576943 2023-10-05T11:35:12.577 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.574+0000 7f26f5634780 1 < completed multipart upload key=9S0YW7PPSJ8G upload=C8Q358LWDZYU tag=W3J8IPP1MZ4A type=write size=1625519 2023-10-05T11:35:12.580 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.577+0000 7f26f5634780 1 > prepared part key=_multipart_761J2C7GHWU5.2~KIH6CFCCBAKL.0 size=1048576 2023-10-05T11:35:12.581 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.578+0000 7f26f5634780 1 > prepared part key=_multipart_761J2C7GHWU5.2~KIH6CFCCBAKL.1 size=1048576 2023-10-05T11:35:12.582 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.579+0000 7f26f5634780 1 > prepared part key=_multipart_761J2C7GHWU5.2~KIH6CFCCBAKL.2 size=415564 2023-10-05T11:35:12.582 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.579+0000 7f26f5634780 1 > prepared multipart upload key=761J2C7GHWU5 upload=KIH6CFCCBAKL tag=YO0NYT4V69YJ type=write size=3561292 2023-10-05T11:35:12.584 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.580+0000 7f26f5634780 1 < completed delete operation key=7W9LL5HSU3BG tag=Q1V45G0UC3YW type=del 2023-10-05T11:35:12.585 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.582+0000 7f26f5634780 1 > prepared operation key=AV0XKXX1IR4B tag=NG0PZXKC71PI type=write size=323306 2023-10-05T11:35:12.587 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.583+0000 7f26f5634780 1 < completed write operation key=761J2C7GHWU5 tag=9M9CMK9UTMW1 type=write size=512384 2023-10-05T11:35:12.588 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.584+0000 7f26f5634780 1 > prepared operation key=U6172JUYW7J6 tag=UF0X8M4WIAEP type=write size=215607 2023-10-05T11:35:12.589 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.586+0000 7f26f5634780 1 < completed part key=_multipart_S3DKYDFT4IO2.2~ZNGEMVKSL7N3.0 size=1048576 2023-10-05T11:35:12.591 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.587+0000 7f26f5634780 1 < completed part key=_multipart_S3DKYDFT4IO2.2~ZNGEMVKSL7N3.1 size=384819 2023-10-05T11:35:12.593 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.590+0000 7f26f5634780 1 < completed multipart upload key=S3DKYDFT4IO2 upload=ZNGEMVKSL7N3 tag=H6N0TA5KBHZ4 type=write size=2481971 2023-10-05T11:35:12.594 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.591+0000 7f26f5634780 1 > prepared operation key=8IPCP77WVVZT tag=WU49EE24UKWD type=write size=681669 2023-10-05T11:35:12.596 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.592+0000 7f26f5634780 1 < completed part key=_multipart_5OPHKTHXVN5U.2~NKG84FB60IVB.0 size=314634 2023-10-05T11:35:12.598 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.595+0000 7f26f5634780 1 < completed multipart upload key=5OPHKTHXVN5U upload=NKG84FB60IVB tag=6I7RUSAH44SF type=write size=1363210 2023-10-05T11:35:12.599 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.596+0000 7f26f5634780 1 > prepared operation key=8IPCP77WVVZT tag=7H1IPFA06P4L type=del size=552408 2023-10-05T11:35:12.602 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.599+0000 7f26f5634780 1 < suggested remove operation key=BTZUVE8R96XT tag=A3ER27YDS006 type=del 2023-10-05T11:35:12.603 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.600+0000 7f26f5634780 1 > prepared operation key=LLR5J3X15W5R tag=NML0VBN94HMO type=del size=158881 2023-10-05T11:35:12.605 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.601+0000 7f26f5634780 1 < completed part key=_multipart_9S0YW7PPSJ8G.2~KV1MF9PMLGNQ.0 size=1048576 2023-10-05T11:35:12.606 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.603+0000 7f26f5634780 1 < completed part key=_multipart_9S0YW7PPSJ8G.2~KV1MF9PMLGNQ.1 size=302803 2023-10-05T11:35:12.608 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.605+0000 7f26f5634780 1 < completed multipart upload key=9S0YW7PPSJ8G upload=KV1MF9PMLGNQ tag=EXMOGZRQCTV4 type=write size=2399955 2023-10-05T11:35:12.609 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.606+0000 7f26f5634780 1 > prepared operation key=IKCNZOTVWOC6 tag=0H6QE0F06M43 type=del size=112896 2023-10-05T11:35:12.611 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.607+0000 7f26f5634780 1 < completed delete operation key=5OPHKTHXVN5U tag=IUKAADHY8DY4 type=del 2023-10-05T11:35:12.612 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.609+0000 7f26f5634780 1 > prepared operation key=0PWYKC7S6YJ4 tag=S1SYA1ZKGU19 type=del size=2446630 2023-10-05T11:35:12.614 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.610+0000 7f26f5634780 1 < completed write operation key=6DP3UJ4CW1MO tag=O8DW1KW03UIB type=write size=288127 2023-10-05T11:35:12.616 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.613+0000 7f26f5634780 1 > prepared operation key=FOMNIIY47UUM tag=JOV1KCKG3MF1 type=del size=1409808 2023-10-05T11:35:12.618 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.615+0000 7f26f5634780 1 < suggested remove operation key=W2GWVGX42QLD tag=HVC0LCHLGJ2O type=del 2023-10-05T11:35:12.620 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.616+0000 7f26f5634780 1 > prepared operation key=PC8WTJ8AYJ24 tag=35OVMSTFUPFS type=del size=2286651 2023-10-05T11:35:12.621 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.617+0000 7f26f5634780 1 < completed part key=_multipart_AV0XKXX1IR4B.2~8LR3E9S2VKU2.0 size=1048576 2023-10-05T11:35:12.622 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.618+0000 7f26f5634780 1 < completed part key=_multipart_AV0XKXX1IR4B.2~8LR3E9S2VKU2.1 size=1048576 2023-10-05T11:35:12.623 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.619+0000 7f26f5634780 1 < completed part key=_multipart_AV0XKXX1IR4B.2~8LR3E9S2VKU2.2 size=428184 2023-10-05T11:35:12.624 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.621+0000 7f26f5634780 1 < completed multipart upload key=AV0XKXX1IR4B upload=8LR3E9S2VKU2 tag=JA6R61WTWVL3 type=write size=3573912 2023-10-05T11:35:12.626 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.622+0000 7f26f5634780 1 > prepared operation key=4D3H60UTIXH3 tag=LSDPWHXOXVMA type=del size=2607400 2023-10-05T11:35:12.627 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.623+0000 7f26f5634780 1 < completed delete operation key=MEY4SZRHU9NZ tag=5K2MHIO5J03P type=del 2023-10-05T11:35:12.629 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.625+0000 7f26f5634780 1 > prepared operation key=J5EIH25Y471T tag=LZN5MID4ESHC type=del size=3042981 2023-10-05T11:35:12.629 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.626+0000 7f26f5634780 1 < completed part key=_multipart_BTZUVE8R96XT.2~5OYDGQ2LXLJ0.0 size=1048576 2023-10-05T11:35:12.631 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.627+0000 7f26f5634780 1 < completed part key=_multipart_BTZUVE8R96XT.2~5OYDGQ2LXLJ0.1 size=1048576 2023-10-05T11:35:12.631 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.628+0000 7f26f5634780 1 < completed part key=_multipart_BTZUVE8R96XT.2~5OYDGQ2LXLJ0.2 size=15815 2023-10-05T11:35:12.633 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.630+0000 7f26f5634780 1 < completed multipart upload key=BTZUVE8R96XT upload=5OYDGQ2LXLJ0 tag=1PO75XM7O338 type=write size=3161543 2023-10-05T11:35:12.634 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.631+0000 7f26f5634780 1 > prepared operation key=FOMNIIY47UUM tag=0CX10CI33UK2 type=del size=508253 2023-10-05T11:35:12.635 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.632+0000 7f26f5634780 1 < completed delete operation key=761J2C7GHWU5 tag=LFCBNSRYGSJN type=del 2023-10-05T11:35:12.637 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.633+0000 7f26f5634780 1 > prepared operation key=U6172JUYW7J6 tag=ER5XCHR8MJU7 type=del size=1661935 2023-10-05T11:35:12.638 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.634+0000 7f26f5634780 1 < completed delete operation key=IC7T3ZK81WQS tag=BM0ZJ02WIB7O type=del 2023-10-05T11:35:12.640 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.636+0000 7f26f5634780 1 > prepared part key=_multipart_LLR5J3X15W5R.2~RLYRFUFP2402.0 size=267482 2023-10-05T11:35:12.640 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.636+0000 7f26f5634780 1 > prepared multipart upload key=LLR5J3X15W5R upload=RLYRFUFP2402 tag=90YMB211ID9S type=write size=1316058 2023-10-05T11:35:12.642 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.639+0000 7f26f5634780 1 < suggested remove operation key=2U0NRDGDNUTA tag=02INSEFVEXES type=del 2023-10-05T11:35:12.644 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.641+0000 7f26f5634780 1 > prepared part key=_multipart_0PWYKC7S6YJ4.2~N7JOZSQHR35Y.0 size=1048576 2023-10-05T11:35:12.645 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.642+0000 7f26f5634780 1 > prepared part key=_multipart_0PWYKC7S6YJ4.2~N7JOZSQHR35Y.1 size=1048576 2023-10-05T11:35:12.647 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.643+0000 7f26f5634780 1 > prepared part key=_multipart_0PWYKC7S6YJ4.2~N7JOZSQHR35Y.2 size=491716 2023-10-05T11:35:12.647 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.643+0000 7f26f5634780 1 > prepared multipart upload key=0PWYKC7S6YJ4 upload=N7JOZSQHR35Y tag=20DK8SD6F9N7 type=write size=3637444 2023-10-05T11:35:12.648 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.645+0000 7f26f5634780 1 < completed part key=_multipart_761J2C7GHWU5.2~KIH6CFCCBAKL.0 size=1048576 2023-10-05T11:35:12.649 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.645+0000 7f26f5634780 1 < completed part key=_multipart_761J2C7GHWU5.2~KIH6CFCCBAKL.1 size=1048576 2023-10-05T11:35:12.650 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.647+0000 7f26f5634780 1 < completed part key=_multipart_761J2C7GHWU5.2~KIH6CFCCBAKL.2 size=415564 2023-10-05T11:35:12.653 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.650+0000 7f26f5634780 1 < completed multipart upload key=761J2C7GHWU5 upload=KIH6CFCCBAKL tag=YO0NYT4V69YJ type=write size=3561292 2023-10-05T11:35:12.656 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.652+0000 7f26f5634780 1 > prepared part key=_multipart_NV4Q36UOLX8A.2~UE1LOO4EBXF2.0 size=1048576 2023-10-05T11:35:12.656 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.653+0000 7f26f5634780 1 > prepared part key=_multipart_NV4Q36UOLX8A.2~UE1LOO4EBXF2.1 size=1048576 2023-10-05T11:35:12.658 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.654+0000 7f26f5634780 1 > prepared part key=_multipart_NV4Q36UOLX8A.2~UE1LOO4EBXF2.2 size=270092 2023-10-05T11:35:12.658 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.654+0000 7f26f5634780 1 > prepared multipart upload key=NV4Q36UOLX8A upload=UE1LOO4EBXF2 tag=HAYQB8HX1ZC0 type=write size=3415820 2023-10-05T11:35:12.659 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.655+0000 7f26f5634780 1 < completed write operation key=AV0XKXX1IR4B tag=NG0PZXKC71PI type=write size=323306 2023-10-05T11:35:12.660 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.656+0000 7f26f5634780 1 > prepared operation key=BU3KSHTINB36 tag=H2UNJANT12BL type=del size=683268 2023-10-05T11:35:12.661 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.658+0000 7f26f5634780 1 < completed write operation key=U6172JUYW7J6 tag=UF0X8M4WIAEP type=write size=215607 2023-10-05T11:35:12.662 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.659+0000 7f26f5634780 1 > prepared operation key=PNV0Q6ZPLYV0 tag=XY4S6VQS8XLM type=del size=1153547 2023-10-05T11:35:12.663 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.660+0000 7f26f5634780 1 < completed write operation key=8IPCP77WVVZT tag=WU49EE24UKWD type=write size=681669 2023-10-05T11:35:12.665 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.661+0000 7f26f5634780 1 > prepared operation key=IKCNZOTVWOC6 tag=SJMZA59HKADU type=write size=903492 2023-10-05T11:35:12.666 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.662+0000 7f26f5634780 1 < completed delete operation key=8IPCP77WVVZT tag=7H1IPFA06P4L type=del 2023-10-05T11:35:12.667 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.664+0000 7f26f5634780 1 > prepared operation key=6DP3UJ4CW1MO tag=Q9LP6V7P2U03 type=del size=49096 2023-10-05T11:35:12.668 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.665+0000 7f26f5634780 1 < completed delete operation key=LLR5J3X15W5R tag=NML0VBN94HMO type=del 2023-10-05T11:35:12.669 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.666+0000 7f26f5634780 1 > prepared operation key=4D3H60UTIXH3 tag=3IEYDFFUHULA type=del size=2803178 2023-10-05T11:35:12.671 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.668+0000 7f26f5634780 1 < completed delete operation key=IKCNZOTVWOC6 tag=0H6QE0F06M43 type=del 2023-10-05T11:35:12.672 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.669+0000 7f26f5634780 1 > prepared operation key=IKCNZOTVWOC6 tag=XKCJ6QUIA0HH type=del size=3024015 2023-10-05T11:35:12.673 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.670+0000 7f26f5634780 1 < completed delete operation key=0PWYKC7S6YJ4 tag=S1SYA1ZKGU19 type=del 2023-10-05T11:35:12.676 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.672+0000 7f26f5634780 1 > prepared part key=_multipart_BTZUVE8R96XT.2~2DGE46ZGA0LV.0 size=281120 2023-10-05T11:35:12.676 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.672+0000 7f26f5634780 1 > prepared multipart upload key=BTZUVE8R96XT upload=2DGE46ZGA0LV tag=F3BLX8EARC49 type=write size=1329696 2023-10-05T11:35:12.677 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.673+0000 7f26f5634780 1 < completed delete operation key=FOMNIIY47UUM tag=JOV1KCKG3MF1 type=del 2023-10-05T11:35:12.678 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.675+0000 7f26f5634780 1 > prepared operation key=LLR5J3X15W5R tag=Z3QS66V2WV07 type=del size=708802 2023-10-05T11:35:12.679 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.676+0000 7f26f5634780 1 < completed delete operation key=PC8WTJ8AYJ24 tag=35OVMSTFUPFS type=del 2023-10-05T11:35:12.681 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.678+0000 7f26f5634780 1 > prepared part key=_multipart_4D3H60UTIXH3.2~FIQLQFB4SEWR.0 size=183876 2023-10-05T11:35:12.682 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.678+0000 7f26f5634780 1 > prepared multipart upload key=4D3H60UTIXH3 upload=FIQLQFB4SEWR tag=8K99TMZYED46 type=write size=1232452 2023-10-05T11:35:12.683 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.679+0000 7f26f5634780 1 < completed delete operation key=4D3H60UTIXH3 tag=LSDPWHXOXVMA type=del 2023-10-05T11:35:12.685 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.682+0000 7f26f5634780 1 > prepared part key=_multipart_PNV0Q6ZPLYV0.2~J4JRCPDX4WXB.0 size=1048576 2023-10-05T11:35:12.686 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.683+0000 7f26f5634780 1 > prepared part key=_multipart_PNV0Q6ZPLYV0.2~J4JRCPDX4WXB.1 size=1048576 2023-10-05T11:35:12.687 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.684+0000 7f26f5634780 1 > prepared part key=_multipart_PNV0Q6ZPLYV0.2~J4JRCPDX4WXB.2 size=970448 2023-10-05T11:35:12.688 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.684+0000 7f26f5634780 1 > prepared multipart upload key=PNV0Q6ZPLYV0 upload=J4JRCPDX4WXB tag=JXJEQJLN3CBM type=write size=4116176 2023-10-05T11:35:12.688 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.685+0000 7f26f5634780 1 < completed delete operation key=J5EIH25Y471T tag=LZN5MID4ESHC type=del 2023-10-05T11:35:12.691 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.688+0000 7f26f5634780 1 > prepared part key=_multipart_S3DKYDFT4IO2.2~2A8REO0IN49W.0 size=1048576 2023-10-05T11:35:12.692 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.689+0000 7f26f5634780 1 > prepared part key=_multipart_S3DKYDFT4IO2.2~2A8REO0IN49W.1 size=614312 2023-10-05T11:35:12.692 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.689+0000 7f26f5634780 1 > prepared multipart upload key=S3DKYDFT4IO2 upload=2A8REO0IN49W tag=IBWNIKYXOZ2R type=write size=2711464 2023-10-05T11:35:12.693 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.690+0000 7f26f5634780 1 < completed delete operation key=FOMNIIY47UUM tag=0CX10CI33UK2 type=del 2023-10-05T11:35:12.696 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.692+0000 7f26f5634780 1 > prepared part key=_multipart_6DP3UJ4CW1MO.2~S6YF6RN2N1FW.0 size=1048576 2023-10-05T11:35:12.697 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.693+0000 7f26f5634780 1 > prepared part key=_multipart_6DP3UJ4CW1MO.2~S6YF6RN2N1FW.1 size=868749 2023-10-05T11:35:12.697 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.693+0000 7f26f5634780 1 > prepared multipart upload key=6DP3UJ4CW1MO upload=S6YF6RN2N1FW tag=4LUEJ8QC2AC8 type=write size=2965901 2023-10-05T11:35:12.698 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.695+0000 7f26f5634780 1 < completed delete operation key=U6172JUYW7J6 tag=ER5XCHR8MJU7 type=del 2023-10-05T11:35:12.699 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.696+0000 7f26f5634780 1 > prepared operation key=W2GWVGX42QLD tag=IR3D3WTJSSI0 type=del size=1762704 2023-10-05T11:35:12.701 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.697+0000 7f26f5634780 1 < completed part key=_multipart_LLR5J3X15W5R.2~RLYRFUFP2402.0 size=267482 2023-10-05T11:35:12.703 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.699+0000 7f26f5634780 1 < completed multipart upload key=LLR5J3X15W5R upload=RLYRFUFP2402 tag=90YMB211ID9S type=write size=1316058 2023-10-05T11:35:12.705 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.702+0000 7f26f5634780 1 > prepared part key=_multipart_761J2C7GHWU5.2~RQ9D4EHNWMKI.0 size=1048576 2023-10-05T11:35:12.706 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.702+0000 7f26f5634780 1 > prepared part key=_multipart_761J2C7GHWU5.2~RQ9D4EHNWMKI.1 size=1048576 2023-10-05T11:35:12.707 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.703+0000 7f26f5634780 1 > prepared part key=_multipart_761J2C7GHWU5.2~RQ9D4EHNWMKI.2 size=13042 2023-10-05T11:35:12.707 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.703+0000 7f26f5634780 1 > prepared multipart upload key=761J2C7GHWU5 upload=RQ9D4EHNWMKI tag=YLI9DWODYYS9 type=write size=3158770 2023-10-05T11:35:12.708 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.705+0000 7f26f5634780 1 < completed part key=_multipart_0PWYKC7S6YJ4.2~N7JOZSQHR35Y.0 size=1048576 2023-10-05T11:35:12.709 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.706+0000 7f26f5634780 1 < completed part key=_multipart_0PWYKC7S6YJ4.2~N7JOZSQHR35Y.1 size=1048576 2023-10-05T11:35:12.710 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.707+0000 7f26f5634780 1 < completed part key=_multipart_0PWYKC7S6YJ4.2~N7JOZSQHR35Y.2 size=491716 2023-10-05T11:35:12.712 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.709+0000 7f26f5634780 1 < completed multipart upload key=0PWYKC7S6YJ4 upload=N7JOZSQHR35Y tag=20DK8SD6F9N7 type=write size=3637444 2023-10-05T11:35:12.715 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.711+0000 7f26f5634780 1 > prepared part key=_multipart_BTZUVE8R96XT.2~30LNNLHHNTVA.0 size=1048576 2023-10-05T11:35:12.715 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.712+0000 7f26f5634780 1 > prepared part key=_multipart_BTZUVE8R96XT.2~30LNNLHHNTVA.1 size=966433 2023-10-05T11:35:12.716 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.712+0000 7f26f5634780 1 > prepared multipart upload key=BTZUVE8R96XT upload=30LNNLHHNTVA tag=4D0DCG1NTGGP type=write size=3063585 2023-10-05T11:35:12.717 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.713+0000 7f26f5634780 1 < completed part key=_multipart_NV4Q36UOLX8A.2~UE1LOO4EBXF2.0 size=1048576 2023-10-05T11:35:12.717 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.713+0000 7f26f5634780 1 < canceled part key=_multipart_NV4Q36UOLX8A.2~UE1LOO4EBXF2.1 size=1048576 2023-10-05T11:35:12.718 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.714+0000 7f26f5634780 1 < completed part key=_multipart_NV4Q36UOLX8A.2~UE1LOO4EBXF2.2 size=270092 2023-10-05T11:35:12.720 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.716+0000 7f26f5634780 1 < canceled multipart upload key=NV4Q36UOLX8A upload=UE1LOO4EBXF2 tag=HAYQB8HX1ZC0 type=write size=3415820 2023-10-05T11:35:12.721 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.718+0000 7f26f5634780 1 > prepared operation key=W2GWVGX42QLD tag=ISLQUXPM8KSG type=del size=2545140 2023-10-05T11:35:12.722 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.719+0000 7f26f5634780 1 < completed delete operation key=BU3KSHTINB36 tag=H2UNJANT12BL type=del 2023-10-05T11:35:12.724 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.720+0000 7f26f5634780 1 > prepared operation key=LLR5J3X15W5R tag=ZSTWMM3UTU0I type=del size=3514832 2023-10-05T11:35:12.725 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.722+0000 7f26f5634780 1 < completed delete operation key=PNV0Q6ZPLYV0 tag=XY4S6VQS8XLM type=del 2023-10-05T11:35:12.726 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.723+0000 7f26f5634780 1 > prepared operation key=PC8WTJ8AYJ24 tag=KRF96UJGIKC3 type=write size=414609 2023-10-05T11:35:12.729 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.725+0000 7f26f5634780 1 < suggested update operation key=IKCNZOTVWOC6 tag=SJMZA59HKADU type=write size=903492 2023-10-05T11:35:12.730 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.726+0000 7f26f5634780 1 > prepared operation key=WYN9BG66LA3K tag=4RK8HRYIH0WW type=del size=267163 2023-10-05T11:35:12.732 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.729+0000 7f26f5634780 1 < completed delete operation key=6DP3UJ4CW1MO tag=Q9LP6V7P2U03 type=del 2023-10-05T11:35:12.733 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.730+0000 7f26f5634780 1 > prepared operation key=LLR5J3X15W5R tag=J0XOCKBD5QRY type=del size=1087426 2023-10-05T11:35:12.734 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.731+0000 7f26f5634780 1 < completed delete operation key=4D3H60UTIXH3 tag=3IEYDFFUHULA type=del 2023-10-05T11:35:12.735 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.732+0000 7f26f5634780 1 > prepared operation key=2U0NRDGDNUTA tag=68MJTI6N3QN0 type=del size=1524176 2023-10-05T11:35:12.737 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.733+0000 7f26f5634780 -1 < failed to complete operation key=IKCNZOTVWOC6 tag=XKCJ6QUIA0HH type=del size=3024015: (22) Invalid argument 2023-10-05T11:35:12.738 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.735+0000 7f26f5634780 1 > prepared operation key=4D3H60UTIXH3 tag=G4P792ZDON62 type=write size=338708 2023-10-05T11:35:12.739 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.736+0000 7f26f5634780 1 < completed part key=_multipart_BTZUVE8R96XT.2~2DGE46ZGA0LV.0 size=281120 2023-10-05T11:35:12.741 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.738+0000 7f26f5634780 1 < completed multipart upload key=BTZUVE8R96XT upload=2DGE46ZGA0LV tag=F3BLX8EARC49 type=write size=1329696 2023-10-05T11:35:12.744 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.740+0000 7f26f5634780 1 > prepared part key=_multipart_2U0NRDGDNUTA.2~ZDWG0XVR2RI0.0 size=1048576 2023-10-05T11:35:12.745 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.741+0000 7f26f5634780 1 > prepared part key=_multipart_2U0NRDGDNUTA.2~ZDWG0XVR2RI0.1 size=701894 2023-10-05T11:35:12.745 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.741+0000 7f26f5634780 1 > prepared multipart upload key=2U0NRDGDNUTA upload=ZDWG0XVR2RI0 tag=RUIQ42RMUMQU type=write size=2799046 2023-10-05T11:35:12.747 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.744+0000 7f26f5634780 1 < suggested update operation key=LLR5J3X15W5R tag=Z3QS66V2WV07 type=del size=708802 2023-10-05T11:35:12.749 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.746+0000 7f26f5634780 1 > prepared part key=_multipart_MEY4SZRHU9NZ.2~U8L02THLKSJB.0 size=1048576 2023-10-05T11:35:12.750 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.747+0000 7f26f5634780 1 > prepared part key=_multipart_MEY4SZRHU9NZ.2~U8L02THLKSJB.1 size=1048576 2023-10-05T11:35:12.751 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.748+0000 7f26f5634780 1 > prepared part key=_multipart_MEY4SZRHU9NZ.2~U8L02THLKSJB.2 size=27161 2023-10-05T11:35:12.751 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.748+0000 7f26f5634780 1 > prepared multipart upload key=MEY4SZRHU9NZ upload=U8L02THLKSJB tag=460BAMUKVK5Z type=write size=3172889 2023-10-05T11:35:12.752 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.749+0000 7f26f5634780 1 < completed part key=_multipart_4D3H60UTIXH3.2~FIQLQFB4SEWR.0 size=183876 2023-10-05T11:35:12.754 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.751+0000 7f26f5634780 1 < completed multipart upload key=4D3H60UTIXH3 upload=FIQLQFB4SEWR tag=8K99TMZYED46 type=write size=1232452 2023-10-05T11:35:12.757 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.753+0000 7f26f5634780 1 > prepared part key=_multipart_2U0NRDGDNUTA.2~CXWCU4QKTKXP.0 size=740338 2023-10-05T11:35:12.757 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.753+0000 7f26f5634780 1 > prepared multipart upload key=2U0NRDGDNUTA upload=CXWCU4QKTKXP tag=5M59JPO73JPX type=write size=1788914 2023-10-05T11:35:12.758 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.754+0000 7f26f5634780 1 < completed part key=_multipart_PNV0Q6ZPLYV0.2~J4JRCPDX4WXB.0 size=1048576 2023-10-05T11:35:12.759 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.755+0000 7f26f5634780 1 < completed part key=_multipart_PNV0Q6ZPLYV0.2~J4JRCPDX4WXB.1 size=1048576 2023-10-05T11:35:12.760 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.757+0000 7f26f5634780 1 < completed part key=_multipart_PNV0Q6ZPLYV0.2~J4JRCPDX4WXB.2 size=970448 2023-10-05T11:35:12.762 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.759+0000 7f26f5634780 1 < completed multipart upload key=PNV0Q6ZPLYV0 upload=J4JRCPDX4WXB tag=JXJEQJLN3CBM type=write size=4116176 2023-10-05T11:35:12.764 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.760+0000 7f26f5634780 1 > prepared operation key=QYQDXVIGZ7O8 tag=GD8EW8QT6C4Z type=write size=20101 2023-10-05T11:35:12.765 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.762+0000 7f26f5634780 1 < completed part key=_multipart_S3DKYDFT4IO2.2~2A8REO0IN49W.0 size=1048576 2023-10-05T11:35:12.766 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.763+0000 7f26f5634780 1 < completed part key=_multipart_S3DKYDFT4IO2.2~2A8REO0IN49W.1 size=614312 2023-10-05T11:35:12.769 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.765+0000 7f26f5634780 1 < completed multipart upload key=S3DKYDFT4IO2 upload=2A8REO0IN49W tag=IBWNIKYXOZ2R type=write size=2711464 2023-10-05T11:35:12.771 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.768+0000 7f26f5634780 1 > prepared part key=_multipart_VJTFYDETLSFD.2~A0B7KY62D1O2.0 size=489513 2023-10-05T11:35:12.771 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.768+0000 7f26f5634780 1 > prepared multipart upload key=VJTFYDETLSFD upload=A0B7KY62D1O2 tag=IBK4BDUF4IZO type=write size=1538089 2023-10-05T11:35:12.772 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.769+0000 7f26f5634780 1 < completed part key=_multipart_6DP3UJ4CW1MO.2~S6YF6RN2N1FW.0 size=1048576 2023-10-05T11:35:12.773 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.770+0000 7f26f5634780 1 < completed part key=_multipart_6DP3UJ4CW1MO.2~S6YF6RN2N1FW.1 size=868749 2023-10-05T11:35:12.775 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.772+0000 7f26f5634780 1 < completed multipart upload key=6DP3UJ4CW1MO upload=S6YF6RN2N1FW tag=4LUEJ8QC2AC8 type=write size=2965901 2023-10-05T11:35:12.777 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.773+0000 7f26f5634780 1 > prepared operation key=AV0XKXX1IR4B tag=IMPTPY2XPCRL type=del size=3048812 2023-10-05T11:35:12.778 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.774+0000 7f26f5634780 1 < canceled operation key=W2GWVGX42QLD tag=IR3D3WTJSSI0 type=del size=1762704 2023-10-05T11:35:12.779 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.776+0000 7f26f5634780 1 > prepared operation key=4D3H60UTIXH3 tag=URMS3TXV4OB2 type=del size=1127097 2023-10-05T11:35:12.781 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.777+0000 7f26f5634780 1 < completed part key=_multipart_761J2C7GHWU5.2~RQ9D4EHNWMKI.0 size=1048576 2023-10-05T11:35:12.782 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.779+0000 7f26f5634780 1 < completed part key=_multipart_761J2C7GHWU5.2~RQ9D4EHNWMKI.1 size=1048576 2023-10-05T11:35:12.783 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.780+0000 7f26f5634780 1 < completed part key=_multipart_761J2C7GHWU5.2~RQ9D4EHNWMKI.2 size=13042 2023-10-05T11:35:12.785 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.782+0000 7f26f5634780 1 < completed multipart upload key=761J2C7GHWU5 upload=RQ9D4EHNWMKI tag=YLI9DWODYYS9 type=write size=3158770 2023-10-05T11:35:12.788 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.784+0000 7f26f5634780 1 > prepared part key=_multipart_LLR5J3X15W5R.2~UCY3AL4GC5QB.0 size=1048576 2023-10-05T11:35:12.788 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.785+0000 7f26f5634780 1 > prepared part key=_multipart_LLR5J3X15W5R.2~UCY3AL4GC5QB.1 size=103853 2023-10-05T11:35:12.789 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.785+0000 7f26f5634780 1 > prepared multipart upload key=LLR5J3X15W5R upload=UCY3AL4GC5QB tag=OAXE5EG6S8M7 type=write size=2201005 2023-10-05T11:35:12.790 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.786+0000 7f26f5634780 1 < completed part key=_multipart_BTZUVE8R96XT.2~30LNNLHHNTVA.0 size=1048576 2023-10-05T11:35:12.791 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.787+0000 7f26f5634780 1 < completed part key=_multipart_BTZUVE8R96XT.2~30LNNLHHNTVA.1 size=966433 2023-10-05T11:35:12.793 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.789+0000 7f26f5634780 1 < completed multipart upload key=BTZUVE8R96XT upload=30LNNLHHNTVA tag=4D0DCG1NTGGP type=write size=3063585 2023-10-05T11:35:12.794 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.791+0000 7f26f5634780 1 > prepared operation key=BTZUVE8R96XT tag=5C5S133J1LYQ type=del size=2527996 2023-10-05T11:35:12.797 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.793+0000 7f26f5634780 1 < suggested update operation key=W2GWVGX42QLD tag=ISLQUXPM8KSG type=del size=2545140 2023-10-05T11:35:12.799 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.795+0000 7f26f5634780 1 > prepared part key=_multipart_2U0NRDGDNUTA.2~R7YBRAZJE969.0 size=1048576 2023-10-05T11:35:12.800 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.796+0000 7f26f5634780 1 > prepared part key=_multipart_2U0NRDGDNUTA.2~R7YBRAZJE969.1 size=28656 2023-10-05T11:35:12.800 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.796+0000 7f26f5634780 1 > prepared multipart upload key=2U0NRDGDNUTA upload=R7YBRAZJE969 tag=PR80M9C2DKML type=write size=2125808 2023-10-05T11:35:12.801 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.798+0000 7f26f5634780 -1 < failed to complete operation key=LLR5J3X15W5R tag=ZSTWMM3UTU0I type=del size=3514832: (22) Invalid argument 2023-10-05T11:35:12.802 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.799+0000 7f26f5634780 1 > prepared operation key=NV4Q36UOLX8A tag=QM02901M7NEI type=del size=1872501 2023-10-05T11:35:12.803 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.800+0000 7f26f5634780 1 < completed write operation key=PC8WTJ8AYJ24 tag=KRF96UJGIKC3 type=write size=414609 2023-10-05T11:35:12.805 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.801+0000 7f26f5634780 1 > prepared operation key=WTCWG1C1SF89 tag=43ET208CJU7B type=del size=3893289 2023-10-05T11:35:12.806 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.803+0000 7f26f5634780 1 < completed delete operation key=WYN9BG66LA3K tag=4RK8HRYIH0WW type=del 2023-10-05T11:35:12.807 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.804+0000 7f26f5634780 1 > prepared operation key=QYQDXVIGZ7O8 tag=8Q25Q42IAWGC type=write size=717089 2023-10-05T11:35:12.809 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.805+0000 7f26f5634780 -1 < failed to complete operation key=LLR5J3X15W5R tag=J0XOCKBD5QRY type=del size=1087426: (22) Invalid argument 2023-10-05T11:35:12.811 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.808+0000 7f26f5634780 1 > prepared part key=_multipart_FOMNIIY47UUM.2~NAXIWVRL1ECG.0 size=906031 2023-10-05T11:35:12.811 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.808+0000 7f26f5634780 1 > prepared multipart upload key=FOMNIIY47UUM upload=NAXIWVRL1ECG tag=P9DREWOZ0A21 type=write size=1954607 2023-10-05T11:35:12.812 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.809+0000 7f26f5634780 1 < canceled operation key=2U0NRDGDNUTA tag=68MJTI6N3QN0 type=del size=1524176 2023-10-05T11:35:12.813 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.810+0000 7f26f5634780 1 > prepared operation key=7W9LL5HSU3BG tag=YPZY6F4MUWN8 type=del size=3302484 2023-10-05T11:35:12.815 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.811+0000 7f26f5634780 1 < completed write operation key=4D3H60UTIXH3 tag=G4P792ZDON62 type=write size=338708 2023-10-05T11:35:12.816 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.813+0000 7f26f5634780 1 > prepared operation key=5OPHKTHXVN5U tag=D9XJ89SRWBB7 type=del size=2492241 2023-10-05T11:35:12.817 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.814+0000 7f26f5634780 1 < completed part key=_multipart_2U0NRDGDNUTA.2~ZDWG0XVR2RI0.0 size=1048576 2023-10-05T11:35:12.818 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.815+0000 7f26f5634780 1 < completed part key=_multipart_2U0NRDGDNUTA.2~ZDWG0XVR2RI0.1 size=701894 2023-10-05T11:35:12.821 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.817+0000 7f26f5634780 1 < completed multipart upload key=2U0NRDGDNUTA upload=ZDWG0XVR2RI0 tag=RUIQ42RMUMQU type=write size=2799046 2023-10-05T11:35:12.822 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.818+0000 7f26f5634780 1 > prepared operation key=MEY4SZRHU9NZ tag=0CTN51DMW3OJ type=write size=652012 2023-10-05T11:35:12.823 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.820+0000 7f26f5634780 1 < completed part key=_multipart_MEY4SZRHU9NZ.2~U8L02THLKSJB.0 size=1048576 2023-10-05T11:35:12.824 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.821+0000 7f26f5634780 1 < completed part key=_multipart_MEY4SZRHU9NZ.2~U8L02THLKSJB.1 size=1048576 2023-10-05T11:35:12.825 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.822+0000 7f26f5634780 1 < completed part key=_multipart_MEY4SZRHU9NZ.2~U8L02THLKSJB.2 size=27161 2023-10-05T11:35:12.829 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.824+0000 7f26f5634780 1 < completed multipart upload key=MEY4SZRHU9NZ upload=U8L02THLKSJB tag=460BAMUKVK5Z type=write size=3172889 2023-10-05T11:35:12.830 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.825+0000 7f26f5634780 1 > prepared operation key=4IBQJLJR7LD8 tag=Z0I7LUEC55PF type=write size=66602 2023-10-05T11:35:12.830 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.826+0000 7f26f5634780 1 < completed part key=_multipart_2U0NRDGDNUTA.2~CXWCU4QKTKXP.0 size=740338 2023-10-05T11:35:12.832 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.828+0000 7f26f5634780 1 < completed multipart upload key=2U0NRDGDNUTA upload=CXWCU4QKTKXP tag=5M59JPO73JPX type=write size=1788914 2023-10-05T11:35:12.834 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.830+0000 7f26f5634780 1 > prepared part key=_multipart_VJTFYDETLSFD.2~NRZZSKSWRYWV.0 size=505759 2023-10-05T11:35:12.834 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.830+0000 7f26f5634780 1 > prepared multipart upload key=VJTFYDETLSFD upload=NRZZSKSWRYWV tag=I41QQ2302DRF type=write size=1554335 2023-10-05T11:35:12.836 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.833+0000 7f26f5634780 1 < suggested remove operation key=QYQDXVIGZ7O8 tag=GD8EW8QT6C4Z type=write 2023-10-05T11:35:12.837 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.834+0000 7f26f5634780 1 > prepared operation key=8IPCP77WVVZT tag=5W79P2360T5L type=del size=2408295 2023-10-05T11:35:12.839 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.835+0000 7f26f5634780 1 < completed part key=_multipart_VJTFYDETLSFD.2~A0B7KY62D1O2.0 size=489513 2023-10-05T11:35:12.840 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.837+0000 7f26f5634780 1 < completed multipart upload key=VJTFYDETLSFD upload=A0B7KY62D1O2 tag=IBK4BDUF4IZO type=write size=1538089 2023-10-05T11:35:12.842 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.838+0000 7f26f5634780 1 > prepared operation key=7W9LL5HSU3BG tag=G7OACVOVBF1H type=del size=1578226 2023-10-05T11:35:12.843 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.839+0000 7f26f5634780 1 < completed delete operation key=AV0XKXX1IR4B tag=IMPTPY2XPCRL type=del 2023-10-05T11:35:12.844 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.841+0000 7f26f5634780 1 > prepared operation key=6DP3UJ4CW1MO tag=HCT93OI86CEE type=write size=667192 2023-10-05T11:35:12.847 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.843+0000 7f26f5634780 1 < suggested remove operation key=4D3H60UTIXH3 tag=URMS3TXV4OB2 type=del 2023-10-05T11:35:12.849 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.846+0000 7f26f5634780 1 > prepared operation key=6DP3UJ4CW1MO tag=1P2OEB83VN28 type=write size=334214 2023-10-05T11:35:12.851 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.847+0000 7f26f5634780 1 < completed part key=_multipart_LLR5J3X15W5R.2~UCY3AL4GC5QB.0 size=1048576 2023-10-05T11:35:12.852 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.848+0000 7f26f5634780 1 < completed part key=_multipart_LLR5J3X15W5R.2~UCY3AL4GC5QB.1 size=103853 2023-10-05T11:35:12.853 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.850+0000 7f26f5634780 1 < completed multipart upload key=LLR5J3X15W5R upload=UCY3AL4GC5QB tag=OAXE5EG6S8M7 type=write size=2201005 2023-10-05T11:35:12.855 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.852+0000 7f26f5634780 1 > prepared operation key=761J2C7GHWU5 tag=AR9IV117SMWO type=del size=2351766 2023-10-05T11:35:12.856 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.853+0000 7f26f5634780 1 < completed delete operation key=BTZUVE8R96XT tag=5C5S133J1LYQ type=del 2023-10-05T11:35:12.858 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.854+0000 7f26f5634780 1 > prepared operation key=S3DKYDFT4IO2 tag=YKUZYSPJF3J4 type=del size=3796669 2023-10-05T11:35:12.859 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.855+0000 7f26f5634780 1 < completed part key=_multipart_2U0NRDGDNUTA.2~R7YBRAZJE969.0 size=1048576 2023-10-05T11:35:12.860 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.856+0000 7f26f5634780 1 < completed part key=_multipart_2U0NRDGDNUTA.2~R7YBRAZJE969.1 size=28656 2023-10-05T11:35:12.862 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.858+0000 7f26f5634780 1 < completed multipart upload key=2U0NRDGDNUTA upload=R7YBRAZJE969 tag=PR80M9C2DKML type=write size=2125808 2023-10-05T11:35:12.864 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.861+0000 7f26f5634780 1 > prepared part key=_multipart_5OPHKTHXVN5U.2~VVKPNZHNG4QM.0 size=1048576 2023-10-05T11:35:12.865 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.862+0000 7f26f5634780 1 > prepared part key=_multipart_5OPHKTHXVN5U.2~VVKPNZHNG4QM.1 size=159619 2023-10-05T11:35:12.865 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.862+0000 7f26f5634780 1 > prepared multipart upload key=5OPHKTHXVN5U upload=VVKPNZHNG4QM tag=87Y4NPZV29NR type=write size=2256771 2023-10-05T11:35:12.866 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.863+0000 7f26f5634780 1 < completed delete operation key=NV4Q36UOLX8A tag=QM02901M7NEI type=del 2023-10-05T11:35:12.867 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.864+0000 7f26f5634780 1 > prepared operation key=4D3H60UTIXH3 tag=IZXF021NJXKF type=del size=2604579 2023-10-05T11:35:12.869 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.865+0000 7f26f5634780 1 < completed delete operation key=WTCWG1C1SF89 tag=43ET208CJU7B type=del 2023-10-05T11:35:12.871 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.868+0000 7f26f5634780 1 > prepared part key=_multipart_9S0YW7PPSJ8G.2~CCN5KR535S96.0 size=65932 2023-10-05T11:35:12.871 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.868+0000 7f26f5634780 1 > prepared multipart upload key=9S0YW7PPSJ8G upload=CCN5KR535S96 tag=IJ0XX36NS91B type=write size=1114508 2023-10-05T11:35:12.871 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.868+0000 7f26f5634780 -1 < no bi entry to suggest for operation key=QYQDXVIGZ7O8 tag=8Q25Q42IAWGC type=write size=717089: (2) No such file or directory 2023-10-05T11:35:12.873 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.870+0000 7f26f5634780 1 > prepared part key=_multipart_MEY4SZRHU9NZ.2~Q3YPNFDEB67R.0 size=708589 2023-10-05T11:35:12.874 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.870+0000 7f26f5634780 1 > prepared multipart upload key=MEY4SZRHU9NZ upload=Q3YPNFDEB67R tag=2BFQP08K7UN9 type=write size=1757165 2023-10-05T11:35:12.875 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.871+0000 7f26f5634780 1 < completed part key=_multipart_FOMNIIY47UUM.2~NAXIWVRL1ECG.0 size=906031 2023-10-05T11:35:12.877 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.873+0000 7f26f5634780 1 < completed multipart upload key=FOMNIIY47UUM upload=NAXIWVRL1ECG tag=P9DREWOZ0A21 type=write size=1954607 2023-10-05T11:35:12.878 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.875+0000 7f26f5634780 1 > prepared operation key=S3DKYDFT4IO2 tag=EL4BYLL6D996 type=write size=337495 2023-10-05T11:35:12.879 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.876+0000 7f26f5634780 1 < completed delete operation key=7W9LL5HSU3BG tag=YPZY6F4MUWN8 type=del 2023-10-05T11:35:12.881 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.878+0000 7f26f5634780 1 > prepared part key=_multipart_2U0NRDGDNUTA.2~J7ODFU1LX6DV.0 size=1048576 2023-10-05T11:35:12.882 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.879+0000 7f26f5634780 1 > prepared part key=_multipart_2U0NRDGDNUTA.2~J7ODFU1LX6DV.1 size=551839 2023-10-05T11:35:12.882 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.879+0000 7f26f5634780 1 > prepared multipart upload key=2U0NRDGDNUTA upload=J7ODFU1LX6DV tag=GX8BIT4M3XMT type=write size=2648991 2023-10-05T11:35:12.883 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.880+0000 7f26f5634780 1 < canceled operation key=5OPHKTHXVN5U tag=D9XJ89SRWBB7 type=del size=2492241 2023-10-05T11:35:12.884 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.881+0000 7f26f5634780 1 > prepared operation key=S3DKYDFT4IO2 tag=XXRGMPQHMMSW type=del size=2841177 2023-10-05T11:35:12.886 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.882+0000 7f26f5634780 1 < completed write operation key=MEY4SZRHU9NZ tag=0CTN51DMW3OJ type=write size=652012 2023-10-05T11:35:12.887 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.884+0000 7f26f5634780 1 > prepared operation key=PNV0Q6ZPLYV0 tag=K0K7D6HUZ7Z7 type=write size=644372 2023-10-05T11:35:12.888 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.885+0000 7f26f5634780 1 < canceled operation key=4IBQJLJR7LD8 tag=Z0I7LUEC55PF type=write size=66602 2023-10-05T11:35:12.891 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.887+0000 7f26f5634780 1 > prepared part key=_multipart_J5EIH25Y471T.2~Q1G61K1KTG92.0 size=581300 2023-10-05T11:35:12.891 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.887+0000 7f26f5634780 1 > prepared multipart upload key=J5EIH25Y471T upload=Q1G61K1KTG92 tag=P00VZDJM5P3L type=write size=1629876 2023-10-05T11:35:12.893 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.890+0000 7f26f5634780 1 < completed part key=_multipart_VJTFYDETLSFD.2~NRZZSKSWRYWV.0 size=505759 2023-10-05T11:35:12.895 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.892+0000 7f26f5634780 1 < completed multipart upload key=VJTFYDETLSFD upload=NRZZSKSWRYWV tag=I41QQ2302DRF type=write size=1554335 2023-10-05T11:35:12.897 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.893+0000 7f26f5634780 1 > prepared operation key=BU3KSHTINB36 tag=G7TWJNNZTEAB type=del size=2122477 2023-10-05T11:35:12.898 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.895+0000 7f26f5634780 1 < completed delete operation key=8IPCP77WVVZT tag=5W79P2360T5L type=del 2023-10-05T11:35:12.899 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.896+0000 7f26f5634780 1 > prepared operation key=FOMNIIY47UUM tag=BWJPK7GAJTIO type=del size=1433898 2023-10-05T11:35:12.900 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.897+0000 7f26f5634780 1 < completed delete operation key=7W9LL5HSU3BG tag=G7OACVOVBF1H type=del 2023-10-05T11:35:12.902 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.898+0000 7f26f5634780 1 > prepared operation key=6DP3UJ4CW1MO tag=KP474D7UY02G type=del size=438747 2023-10-05T11:35:12.903 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.900+0000 7f26f5634780 1 < completed write operation key=6DP3UJ4CW1MO tag=HCT93OI86CEE type=write size=667192 2023-10-05T11:35:12.904 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.901+0000 7f26f5634780 1 > prepared operation key=2U0NRDGDNUTA tag=VFMX7ZBHSON2 type=del size=2573820 2023-10-05T11:35:12.907 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.903+0000 7f26f5634780 1 < completed write operation key=6DP3UJ4CW1MO tag=1P2OEB83VN28 type=write size=334214 2023-10-05T11:35:12.909 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.906+0000 7f26f5634780 1 > prepared part key=_multipart_2D4PDQQT54ZA.2~E4I487XW4U4A.0 size=8773 2023-10-05T11:35:12.909 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.906+0000 7f26f5634780 1 > prepared multipart upload key=2D4PDQQT54ZA upload=E4I487XW4U4A tag=SOXIBGA2EZ0X type=write size=1057349 2023-10-05T11:35:12.910 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.907+0000 7f26f5634780 1 < completed delete operation key=761J2C7GHWU5 tag=AR9IV117SMWO type=del 2023-10-05T11:35:12.912 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.909+0000 7f26f5634780 1 > prepared operation key=LLR5J3X15W5R tag=68NVIKCHWXEL type=del size=1905147 2023-10-05T11:35:12.914 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.911+0000 7f26f5634780 1 < suggested remove operation key=S3DKYDFT4IO2 tag=YKUZYSPJF3J4 type=del 2023-10-05T11:35:12.916 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.913+0000 7f26f5634780 1 > prepared operation key=6DP3UJ4CW1MO tag=TE6YUMCW9BOZ type=write size=878377 2023-10-05T11:35:12.917 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.914+0000 7f26f5634780 1 < completed part key=_multipart_5OPHKTHXVN5U.2~VVKPNZHNG4QM.0 size=1048576 2023-10-05T11:35:12.918 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.915+0000 7f26f5634780 1 < completed part key=_multipart_5OPHKTHXVN5U.2~VVKPNZHNG4QM.1 size=159619 2023-10-05T11:35:12.920 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.917+0000 7f26f5634780 1 < completed multipart upload key=5OPHKTHXVN5U upload=VVKPNZHNG4QM tag=87Y4NPZV29NR type=write size=2256771 2023-10-05T11:35:12.923 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.919+0000 7f26f5634780 1 > prepared part key=_multipart_5OPHKTHXVN5U.2~COO2ZG21Z79S.0 size=707863 2023-10-05T11:35:12.923 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.919+0000 7f26f5634780 1 > prepared multipart upload key=5OPHKTHXVN5U upload=COO2ZG21Z79S tag=WU51T4QY7SQU type=write size=1756439 2023-10-05T11:35:12.924 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.920+0000 7f26f5634780 1 < completed delete operation key=4D3H60UTIXH3 tag=IZXF021NJXKF type=del 2023-10-05T11:35:12.925 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.922+0000 7f26f5634780 1 > prepared operation key=VJTFYDETLSFD tag=A9F2CPM3TXKH type=write size=634035 2023-10-05T11:35:12.927 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.924+0000 7f26f5634780 1 < completed part key=_multipart_9S0YW7PPSJ8G.2~CCN5KR535S96.0 size=65932 2023-10-05T11:35:12.929 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.926+0000 7f26f5634780 1 < completed multipart upload key=9S0YW7PPSJ8G upload=CCN5KR535S96 tag=IJ0XX36NS91B type=write size=1114508 2023-10-05T11:35:12.931 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.927+0000 7f26f5634780 1 > prepared operation key=WYN9BG66LA3K tag=HZR5HCGNN8U9 type=del size=3187295 2023-10-05T11:35:12.932 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.929+0000 7f26f5634780 1 < completed part key=_multipart_MEY4SZRHU9NZ.2~Q3YPNFDEB67R.0 size=708589 2023-10-05T11:35:12.934 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.931+0000 7f26f5634780 1 < completed multipart upload key=MEY4SZRHU9NZ upload=Q3YPNFDEB67R tag=2BFQP08K7UN9 type=write size=1757165 2023-10-05T11:35:12.936 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.932+0000 7f26f5634780 1 > prepared operation key=0PWYKC7S6YJ4 tag=IFYHTIFU1GP9 type=del size=993379 2023-10-05T11:35:12.937 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.933+0000 7f26f5634780 -1 < failed to complete operation key=S3DKYDFT4IO2 tag=EL4BYLL6D996 type=write size=337495: (22) Invalid argument 2023-10-05T11:35:12.938 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.935+0000 7f26f5634780 1 > prepared operation key=U6172JUYW7J6 tag=JJCCIBS28682 type=del size=4166532 2023-10-05T11:35:12.939 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.936+0000 7f26f5634780 1 < completed part key=_multipart_2U0NRDGDNUTA.2~J7ODFU1LX6DV.0 size=1048576 2023-10-05T11:35:12.940 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.937+0000 7f26f5634780 1 < completed part key=_multipart_2U0NRDGDNUTA.2~J7ODFU1LX6DV.1 size=551839 2023-10-05T11:35:12.942 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.939+0000 7f26f5634780 1 < completed multipart upload key=2U0NRDGDNUTA upload=J7ODFU1LX6DV tag=GX8BIT4M3XMT type=write size=2648991 2023-10-05T11:35:12.943 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.940+0000 7f26f5634780 1 > prepared operation key=BU3KSHTINB36 tag=VSHJPHITMNPR type=del size=473 2023-10-05T11:35:12.945 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.941+0000 7f26f5634780 -1 < failed to complete operation key=S3DKYDFT4IO2 tag=XXRGMPQHMMSW type=del size=2841177: (22) Invalid argument 2023-10-05T11:35:12.946 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.943+0000 7f26f5634780 1 > prepared operation key=WTCWG1C1SF89 tag=T1T91KVTY52Q type=del size=2841153 2023-10-05T11:35:12.947 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.944+0000 7f26f5634780 1 < completed write operation key=PNV0Q6ZPLYV0 tag=K0K7D6HUZ7Z7 type=write size=644372 2023-10-05T11:35:12.948 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.945+0000 7f26f5634780 1 > prepared operation key=PC8WTJ8AYJ24 tag=F50D1YJZSAG8 type=del size=1092828 2023-10-05T11:35:12.949 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.946+0000 7f26f5634780 1 < completed part key=_multipart_J5EIH25Y471T.2~Q1G61K1KTG92.0 size=581300 2023-10-05T11:35:12.951 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.948+0000 7f26f5634780 1 < completed multipart upload key=J5EIH25Y471T upload=Q1G61K1KTG92 tag=P00VZDJM5P3L type=write size=1629876 2023-10-05T11:35:12.952 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.949+0000 7f26f5634780 1 > prepared operation key=7W9LL5HSU3BG tag=L82YYGXMAQYW type=del size=879105 2023-10-05T11:35:12.954 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.950+0000 7f26f5634780 1 < completed delete operation key=BU3KSHTINB36 tag=G7TWJNNZTEAB type=del 2023-10-05T11:35:12.956 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.952+0000 7f26f5634780 1 > prepared part key=_multipart_U6172JUYW7J6.2~VIHGZ1E1S6PI.0 size=1048576 2023-10-05T11:35:12.957 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.954+0000 7f26f5634780 1 > prepared part key=_multipart_U6172JUYW7J6.2~VIHGZ1E1S6PI.1 size=1048576 2023-10-05T11:35:12.958 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.954+0000 7f26f5634780 1 > prepared part key=_multipart_U6172JUYW7J6.2~VIHGZ1E1S6PI.2 size=360395 2023-10-05T11:35:12.958 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.954+0000 7f26f5634780 1 > prepared multipart upload key=U6172JUYW7J6 upload=VIHGZ1E1S6PI tag=8JEUT1040E4E type=write size=3506123 2023-10-05T11:35:12.959 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.956+0000 7f26f5634780 1 < completed delete operation key=FOMNIIY47UUM tag=BWJPK7GAJTIO type=del 2023-10-05T11:35:12.960 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.957+0000 7f26f5634780 1 > prepared operation key=IC7T3ZK81WQS tag=ARH22YPFUT3O type=del size=3929764 2023-10-05T11:35:12.963 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.959+0000 7f26f5634780 1 < suggested remove operation key=6DP3UJ4CW1MO tag=KP474D7UY02G type=del 2023-10-05T11:35:12.964 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.960+0000 7f26f5634780 1 > prepared operation key=2D4PDQQT54ZA tag=IXD0YLWWPSXG type=del size=3601422 2023-10-05T11:35:12.965 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.962+0000 7f26f5634780 1 < canceled operation key=2U0NRDGDNUTA tag=VFMX7ZBHSON2 type=del size=2573820 2023-10-05T11:35:12.967 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.964+0000 7f26f5634780 1 > prepared part key=_multipart_J5EIH25Y471T.2~GCDYHPCCJFQS.0 size=1048576 2023-10-05T11:35:12.968 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.965+0000 7f26f5634780 1 > prepared part key=_multipart_J5EIH25Y471T.2~GCDYHPCCJFQS.1 size=679645 2023-10-05T11:35:12.968 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.965+0000 7f26f5634780 1 > prepared multipart upload key=J5EIH25Y471T upload=GCDYHPCCJFQS tag=DEVM1KAXMY8F type=write size=2776797 2023-10-05T11:35:12.970 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.967+0000 7f26f5634780 1 < completed part key=_multipart_2D4PDQQT54ZA.2~E4I487XW4U4A.0 size=8773 2023-10-05T11:35:12.972 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.969+0000 7f26f5634780 1 < completed multipart upload key=2D4PDQQT54ZA upload=E4I487XW4U4A tag=SOXIBGA2EZ0X type=write size=1057349 2023-10-05T11:35:12.973 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.970+0000 7f26f5634780 1 > prepared operation key=WYN9BG66LA3K tag=R0SJYQ9LIOID type=del size=3883829 2023-10-05T11:35:12.975 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.971+0000 7f26f5634780 1 < completed delete operation key=LLR5J3X15W5R tag=68NVIKCHWXEL type=del 2023-10-05T11:35:12.976 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.973+0000 7f26f5634780 1 > prepared operation key=NV4Q36UOLX8A tag=UY1S0KGR4F6F type=del size=804715 2023-10-05T11:35:12.976 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.973+0000 7f26f5634780 -1 < no bi entry to suggest for operation key=6DP3UJ4CW1MO tag=TE6YUMCW9BOZ type=write size=878377: (2) No such file or directory 2023-10-05T11:35:12.978 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.974+0000 7f26f5634780 1 > prepared operation key=IC7T3ZK81WQS tag=KRNE9AD9R653 type=write size=889629 2023-10-05T11:35:12.979 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.975+0000 7f26f5634780 1 < completed part key=_multipart_5OPHKTHXVN5U.2~COO2ZG21Z79S.0 size=707863 2023-10-05T11:35:12.981 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.977+0000 7f26f5634780 1 < completed multipart upload key=5OPHKTHXVN5U upload=COO2ZG21Z79S tag=WU51T4QY7SQU type=write size=1756439 2023-10-05T11:35:12.983 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.979+0000 7f26f5634780 1 > prepared part key=_multipart_QYQDXVIGZ7O8.2~GRAPEDOO2QDR.0 size=888763 2023-10-05T11:35:12.983 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.979+0000 7f26f5634780 1 > prepared multipart upload key=QYQDXVIGZ7O8 upload=GRAPEDOO2QDR tag=NJWQRKXX2RU3 type=write size=1937339 2023-10-05T11:35:12.984 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.981+0000 7f26f5634780 1 < completed write operation key=VJTFYDETLSFD tag=A9F2CPM3TXKH type=write size=634035 2023-10-05T11:35:12.985 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.982+0000 7f26f5634780 1 > prepared operation key=PNV0Q6ZPLYV0 tag=KM0X3TOSDRGA type=del size=3568807 2023-10-05T11:35:12.986 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.983+0000 7f26f5634780 1 < completed delete operation key=WYN9BG66LA3K tag=HZR5HCGNN8U9 type=del 2023-10-05T11:35:12.988 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.984+0000 7f26f5634780 1 > prepared operation key=4D3H60UTIXH3 tag=VY7HR97779PI type=del size=181140 2023-10-05T11:35:12.989 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.985+0000 7f26f5634780 1 < completed delete operation key=0PWYKC7S6YJ4 tag=IFYHTIFU1GP9 type=del 2023-10-05T11:35:12.991 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.987+0000 7f26f5634780 1 > prepared part key=_multipart_7TOP5A52M9YP.2~HXS60GC2LSI8.0 size=1048576 2023-10-05T11:35:12.992 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.989+0000 7f26f5634780 1 > prepared part key=_multipart_7TOP5A52M9YP.2~HXS60GC2LSI8.1 size=1048576 2023-10-05T11:35:12.993 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.989+0000 7f26f5634780 1 > prepared part key=_multipart_7TOP5A52M9YP.2~HXS60GC2LSI8.2 size=304358 2023-10-05T11:35:12.993 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.989+0000 7f26f5634780 1 > prepared multipart upload key=7TOP5A52M9YP upload=HXS60GC2LSI8 tag=CL0FQKHKIQZI type=write size=3450086 2023-10-05T11:35:12.994 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.991+0000 7f26f5634780 1 < completed delete operation key=U6172JUYW7J6 tag=JJCCIBS28682 type=del 2023-10-05T11:35:12.996 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.993+0000 7f26f5634780 1 > prepared part key=_multipart_IC7T3ZK81WQS.2~EU1TA4EGYULQ.0 size=1048576 2023-10-05T11:35:12.997 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.994+0000 7f26f5634780 1 > prepared part key=_multipart_IC7T3ZK81WQS.2~EU1TA4EGYULQ.1 size=1048576 2023-10-05T11:35:12.998 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.995+0000 7f26f5634780 1 > prepared part key=_multipart_IC7T3ZK81WQS.2~EU1TA4EGYULQ.2 size=88599 2023-10-05T11:35:12.998 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.995+0000 7f26f5634780 1 > prepared multipart upload key=IC7T3ZK81WQS upload=EU1TA4EGYULQ tag=1AG41A3P12E0 type=write size=3234327 2023-10-05T11:35:13.000 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.996+0000 7f26f5634780 1 < completed delete operation key=BU3KSHTINB36 tag=VSHJPHITMNPR type=del 2023-10-05T11:35:13.001 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.997+0000 7f26f5634780 1 > prepared operation key=S3DKYDFT4IO2 tag=THP8MYAZGVM1 type=del size=31747 2023-10-05T11:35:13.002 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:12.999+0000 7f26f5634780 1 < completed delete operation key=WTCWG1C1SF89 tag=T1T91KVTY52Q type=del 2023-10-05T11:35:13.004 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.001+0000 7f26f5634780 1 > prepared part key=_multipart_S3DKYDFT4IO2.2~9S5DTR1GDSU9.0 size=1048576 2023-10-05T11:35:13.005 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.002+0000 7f26f5634780 1 > prepared part key=_multipart_S3DKYDFT4IO2.2~9S5DTR1GDSU9.1 size=928559 2023-10-05T11:35:13.005 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.002+0000 7f26f5634780 1 > prepared multipart upload key=S3DKYDFT4IO2 upload=9S5DTR1GDSU9 tag=7K7ELN8QT1ED type=write size=3025711 2023-10-05T11:35:13.007 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.003+0000 7f26f5634780 1 < completed delete operation key=PC8WTJ8AYJ24 tag=F50D1YJZSAG8 type=del 2023-10-05T11:35:13.008 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.004+0000 7f26f5634780 1 > prepared operation key=0PWYKC7S6YJ4 tag=9DUV1VJBPFRY type=del size=1688925 2023-10-05T11:35:13.009 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.006+0000 7f26f5634780 1 < completed delete operation key=7W9LL5HSU3BG tag=L82YYGXMAQYW type=del 2023-10-05T11:35:13.011 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.008+0000 7f26f5634780 1 > prepared part key=_multipart_PNV0Q6ZPLYV0.2~A1ADH8BJMQ2O.0 size=558012 2023-10-05T11:35:13.011 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.008+0000 7f26f5634780 1 > prepared multipart upload key=PNV0Q6ZPLYV0 upload=A1ADH8BJMQ2O tag=8058JMNR6IOX type=write size=1606588 2023-10-05T11:35:13.013 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.009+0000 7f26f5634780 1 < completed part key=_multipart_U6172JUYW7J6.2~VIHGZ1E1S6PI.0 size=1048576 2023-10-05T11:35:13.014 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.010+0000 7f26f5634780 1 < completed part key=_multipart_U6172JUYW7J6.2~VIHGZ1E1S6PI.1 size=1048576 2023-10-05T11:35:13.015 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.011+0000 7f26f5634780 1 < completed part key=_multipart_U6172JUYW7J6.2~VIHGZ1E1S6PI.2 size=360395 2023-10-05T11:35:13.017 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.014+0000 7f26f5634780 1 < completed multipart upload key=U6172JUYW7J6 upload=VIHGZ1E1S6PI tag=8JEUT1040E4E type=write size=3506123 2023-10-05T11:35:13.018 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.015+0000 7f26f5634780 1 > prepared operation key=LLR5J3X15W5R tag=ZWE7KS4SC0K7 type=del size=3114609 2023-10-05T11:35:13.021 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.018+0000 7f26f5634780 1 < suggested update operation key=IC7T3ZK81WQS tag=ARH22YPFUT3O type=del size=3929764 2023-10-05T11:35:13.023 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.019+0000 7f26f5634780 1 > prepared operation key=U6172JUYW7J6 tag=9VUAZLJ88RZ4 type=del size=3243366 2023-10-05T11:35:13.025 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.022+0000 7f26f5634780 1 < suggested update operation key=2D4PDQQT54ZA tag=IXD0YLWWPSXG type=del size=3601422 2023-10-05T11:35:13.028 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.024+0000 7f26f5634780 1 > prepared part key=_multipart_7W9LL5HSU3BG.2~CTX6YTXOHI7D.0 size=204509 2023-10-05T11:35:13.028 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.024+0000 7f26f5634780 1 > prepared multipart upload key=7W9LL5HSU3BG upload=CTX6YTXOHI7D tag=5CHJ6Y7N11GN type=write size=1253085 2023-10-05T11:35:13.029 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.026+0000 7f26f5634780 1 < completed part key=_multipart_J5EIH25Y471T.2~GCDYHPCCJFQS.0 size=1048576 2023-10-05T11:35:13.030 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.027+0000 7f26f5634780 1 < completed part key=_multipart_J5EIH25Y471T.2~GCDYHPCCJFQS.1 size=679645 2023-10-05T11:35:13.033 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.030+0000 7f26f5634780 1 < completed multipart upload key=J5EIH25Y471T upload=GCDYHPCCJFQS tag=DEVM1KAXMY8F type=write size=2776797 2023-10-05T11:35:13.037 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.031+0000 7f26f5634780 1 > prepared operation key=0PWYKC7S6YJ4 tag=O6L68X09IZ36 type=del size=2769831 2023-10-05T11:35:13.037 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.032+0000 7f26f5634780 1 < completed delete operation key=WYN9BG66LA3K tag=R0SJYQ9LIOID type=del 2023-10-05T11:35:13.038 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.034+0000 7f26f5634780 1 > prepared operation key=7W9LL5HSU3BG tag=D962JYXZ2YP4 type=del size=1158991 2023-10-05T11:35:13.040 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.037+0000 7f26f5634780 1 < suggested update operation key=NV4Q36UOLX8A tag=UY1S0KGR4F6F type=del size=804715 2023-10-05T11:35:13.042 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.038+0000 7f26f5634780 1 > prepared operation key=7TOP5A52M9YP tag=1FP2N6CSC6V4 type=del size=358957 2023-10-05T11:35:13.043 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.040+0000 7f26f5634780 -1 < failed to complete operation key=IC7T3ZK81WQS tag=KRNE9AD9R653 type=write size=889629: (22) Invalid argument 2023-10-05T11:35:13.045 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.042+0000 7f26f5634780 1 > prepared part key=_multipart_AV0XKXX1IR4B.2~YGXKZWF1UI0L.0 size=642168 2023-10-05T11:35:13.046 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.042+0000 7f26f5634780 1 > prepared multipart upload key=AV0XKXX1IR4B upload=YGXKZWF1UI0L tag=8DO2VE9AXYGU type=write size=1690744 2023-10-05T11:35:13.047 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.043+0000 7f26f5634780 1 < completed part key=_multipart_QYQDXVIGZ7O8.2~GRAPEDOO2QDR.0 size=888763 2023-10-05T11:35:13.049 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.045+0000 7f26f5634780 1 < completed multipart upload key=QYQDXVIGZ7O8 upload=GRAPEDOO2QDR tag=NJWQRKXX2RU3 type=write size=1937339 2023-10-05T11:35:13.050 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.047+0000 7f26f5634780 1 > prepared operation key=2U0NRDGDNUTA tag=010RK7T4IXFR type=del size=1119619 2023-10-05T11:35:13.052 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.048+0000 7f26f5634780 1 < completed delete operation key=PNV0Q6ZPLYV0 tag=KM0X3TOSDRGA type=del 2023-10-05T11:35:13.053 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.050+0000 7f26f5634780 1 > prepared operation key=WTCWG1C1SF89 tag=4X6CAGGMCSOB type=write size=431404 2023-10-05T11:35:13.055 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.051+0000 7f26f5634780 1 < completed delete operation key=4D3H60UTIXH3 tag=VY7HR97779PI type=del 2023-10-05T11:35:13.056 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.053+0000 7f26f5634780 1 > prepared operation key=WYN9BG66LA3K tag=7CDGM7DES72D type=write size=734941 2023-10-05T11:35:13.057 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.054+0000 7f26f5634780 1 < completed part key=_multipart_7TOP5A52M9YP.2~HXS60GC2LSI8.0 size=1048576 2023-10-05T11:35:13.059 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.055+0000 7f26f5634780 1 < completed part key=_multipart_7TOP5A52M9YP.2~HXS60GC2LSI8.1 size=1048576 2023-10-05T11:35:13.060 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.056+0000 7f26f5634780 1 < completed part key=_multipart_7TOP5A52M9YP.2~HXS60GC2LSI8.2 size=304358 2023-10-05T11:35:13.062 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.059+0000 7f26f5634780 1 < completed multipart upload key=7TOP5A52M9YP upload=HXS60GC2LSI8 tag=CL0FQKHKIQZI type=write size=3450086 2023-10-05T11:35:13.065 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.061+0000 7f26f5634780 1 > prepared part key=_multipart_WTCWG1C1SF89.2~2ZPAO0STE4QK.0 size=1048576 2023-10-05T11:35:13.066 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.062+0000 7f26f5634780 1 > prepared part key=_multipart_WTCWG1C1SF89.2~2ZPAO0STE4QK.1 size=1048576 2023-10-05T11:35:13.067 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.063+0000 7f26f5634780 1 > prepared part key=_multipart_WTCWG1C1SF89.2~2ZPAO0STE4QK.2 size=381190 2023-10-05T11:35:13.067 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.063+0000 7f26f5634780 1 > prepared multipart upload key=WTCWG1C1SF89 upload=2ZPAO0STE4QK tag=NV0TRTFWG39E type=write size=3526918 2023-10-05T11:35:13.068 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.065+0000 7f26f5634780 1 < completed part key=_multipart_IC7T3ZK81WQS.2~EU1TA4EGYULQ.0 size=1048576 2023-10-05T11:35:13.069 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.066+0000 7f26f5634780 1 < completed part key=_multipart_IC7T3ZK81WQS.2~EU1TA4EGYULQ.1 size=1048576 2023-10-05T11:35:13.070 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.067+0000 7f26f5634780 1 < completed part key=_multipart_IC7T3ZK81WQS.2~EU1TA4EGYULQ.2 size=88599 2023-10-05T11:35:13.072 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.069+0000 7f26f5634780 1 < completed multipart upload key=IC7T3ZK81WQS upload=EU1TA4EGYULQ tag=1AG41A3P12E0 type=write size=3234327 2023-10-05T11:35:13.075 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.071+0000 7f26f5634780 1 > prepared part key=_multipart_7W9LL5HSU3BG.2~UBG6EB1R50VM.0 size=383782 2023-10-05T11:35:13.075 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.071+0000 7f26f5634780 1 > prepared multipart upload key=7W9LL5HSU3BG upload=UBG6EB1R50VM tag=KN7UOPUZ12AN type=write size=1432358 2023-10-05T11:35:13.076 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.073+0000 7f26f5634780 1 < completed delete operation key=S3DKYDFT4IO2 tag=THP8MYAZGVM1 type=del 2023-10-05T11:35:13.077 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.074+0000 7f26f5634780 1 > prepared operation key=2D4PDQQT54ZA tag=FW12FO0AO1J5 type=del size=1418200 2023-10-05T11:35:13.078 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.075+0000 7f26f5634780 1 < completed part key=_multipart_S3DKYDFT4IO2.2~9S5DTR1GDSU9.0 size=1048576 2023-10-05T11:35:13.079 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.076+0000 7f26f5634780 1 < completed part key=_multipart_S3DKYDFT4IO2.2~9S5DTR1GDSU9.1 size=928559 2023-10-05T11:35:13.081 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.078+0000 7f26f5634780 1 < completed multipart upload key=S3DKYDFT4IO2 upload=9S5DTR1GDSU9 tag=7K7ELN8QT1ED type=write size=3025711 2023-10-05T11:35:13.083 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.080+0000 7f26f5634780 1 > prepared part key=_multipart_PC8WTJ8AYJ24.2~0Z9466AZMO5R.0 size=154880 2023-10-05T11:35:13.083 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.080+0000 7f26f5634780 1 > prepared multipart upload key=PC8WTJ8AYJ24 upload=0Z9466AZMO5R tag=5O4H3ZGYCUQ8 type=write size=1203456 2023-10-05T11:35:13.085 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.081+0000 7f26f5634780 1 < completed delete operation key=0PWYKC7S6YJ4 tag=9DUV1VJBPFRY type=del 2023-10-05T11:35:13.086 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.082+0000 7f26f5634780 1 > prepared operation key=4D3H60UTIXH3 tag=Q75XJSE4ZE4F type=del size=3309362 2023-10-05T11:35:13.086 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.083+0000 7f26f5634780 1 < canceled part key=_multipart_PNV0Q6ZPLYV0.2~A1ADH8BJMQ2O.0 size=558012 2023-10-05T11:35:13.088 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.084+0000 7f26f5634780 1 < canceled multipart upload key=PNV0Q6ZPLYV0 upload=A1ADH8BJMQ2O tag=8058JMNR6IOX type=write size=1606588 2023-10-05T11:35:13.089 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.086+0000 7f26f5634780 1 > prepared operation key=WTCWG1C1SF89 tag=XY7L4NHIX83G type=del size=2313806 2023-10-05T11:35:13.091 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.088+0000 7f26f5634780 1 < completed delete operation key=LLR5J3X15W5R tag=ZWE7KS4SC0K7 type=del 2023-10-05T11:35:13.093 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.089+0000 7f26f5634780 1 > prepared operation key=IC7T3ZK81WQS tag=UO5F16E7YK42 type=write size=694488 2023-10-05T11:35:13.095 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.091+0000 7f26f5634780 1 < completed delete operation key=U6172JUYW7J6 tag=9VUAZLJ88RZ4 type=del 2023-10-05T11:35:13.097 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.093+0000 7f26f5634780 1 > prepared part key=_multipart_5OPHKTHXVN5U.2~G1ZRD7CWZG5R.0 size=1048576 2023-10-05T11:35:13.098 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.094+0000 7f26f5634780 1 > prepared part key=_multipart_5OPHKTHXVN5U.2~G1ZRD7CWZG5R.1 size=153007 2023-10-05T11:35:13.098 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.094+0000 7f26f5634780 1 > prepared multipart upload key=5OPHKTHXVN5U upload=G1ZRD7CWZG5R tag=12ACXLK33D5O type=write size=2250159 2023-10-05T11:35:13.098 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.095+0000 7f26f5634780 1 < canceled part key=_multipart_7W9LL5HSU3BG.2~CTX6YTXOHI7D.0 size=204509 2023-10-05T11:35:13.100 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.096+0000 7f26f5634780 1 < canceled multipart upload key=7W9LL5HSU3BG upload=CTX6YTXOHI7D tag=5CHJ6Y7N11GN type=write size=1253085 2023-10-05T11:35:13.101 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.098+0000 7f26f5634780 1 > prepared operation key=0PWYKC7S6YJ4 tag=Q8943953IYOQ type=del size=2324364 2023-10-05T11:35:13.102 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.099+0000 7f26f5634780 1 < completed delete operation key=0PWYKC7S6YJ4 tag=O6L68X09IZ36 type=del 2023-10-05T11:35:13.105 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.101+0000 7f26f5634780 1 > prepared part key=_multipart_W2GWVGX42QLD.2~XOX1STEMC3GB.0 size=1048576 2023-10-05T11:35:13.106 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.102+0000 7f26f5634780 1 > prepared part key=_multipart_W2GWVGX42QLD.2~XOX1STEMC3GB.1 size=348000 2023-10-05T11:35:13.106 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.102+0000 7f26f5634780 1 > prepared multipart upload key=W2GWVGX42QLD upload=XOX1STEMC3GB tag=8GLT6A6BPPUL type=write size=2445152 2023-10-05T11:35:13.107 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.104+0000 7f26f5634780 1 < completed delete operation key=7W9LL5HSU3BG tag=D962JYXZ2YP4 type=del 2023-10-05T11:35:13.109 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.105+0000 7f26f5634780 1 > prepared operation key=MEY4SZRHU9NZ tag=QJEG9WAITR0U type=del size=905324 2023-10-05T11:35:13.110 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.107+0000 7f26f5634780 1 < completed delete operation key=7TOP5A52M9YP tag=1FP2N6CSC6V4 type=del 2023-10-05T11:35:13.112 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.108+0000 7f26f5634780 1 > prepared operation key=BTZUVE8R96XT tag=G056WF1BABFT type=write size=701045 2023-10-05T11:35:13.113 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.110+0000 7f26f5634780 1 < completed part key=_multipart_AV0XKXX1IR4B.2~YGXKZWF1UI0L.0 size=642168 2023-10-05T11:35:13.116 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.112+0000 7f26f5634780 1 < completed multipart upload key=AV0XKXX1IR4B upload=YGXKZWF1UI0L tag=8DO2VE9AXYGU type=write size=1690744 2023-10-05T11:35:13.118 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.115+0000 7f26f5634780 1 > prepared part key=_multipart_PNV0Q6ZPLYV0.2~SJCXGZRHIV7O.0 size=204496 2023-10-05T11:35:13.118 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.115+0000 7f26f5634780 1 > prepared multipart upload key=PNV0Q6ZPLYV0 upload=SJCXGZRHIV7O tag=59Q2F3NSIX6V type=write size=1253072 2023-10-05T11:35:13.119 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.116+0000 7f26f5634780 1 < completed delete operation key=2U0NRDGDNUTA tag=010RK7T4IXFR type=del 2023-10-05T11:35:13.121 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.117+0000 7f26f5634780 1 > prepared operation key=0PWYKC7S6YJ4 tag=Z5Z16T82T9US type=del size=1477488 2023-10-05T11:35:13.122 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.118+0000 7f26f5634780 1 < completed write operation key=WTCWG1C1SF89 tag=4X6CAGGMCSOB type=write size=431404 2023-10-05T11:35:13.123 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.120+0000 7f26f5634780 1 > prepared operation key=2D4PDQQT54ZA tag=412M7QWLA1WZ type=del size=3450560 2023-10-05T11:35:13.124 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.121+0000 7f26f5634780 1 < completed write operation key=WYN9BG66LA3K tag=7CDGM7DES72D type=write size=734941 2023-10-05T11:35:13.126 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.122+0000 7f26f5634780 1 > prepared operation key=7TOP5A52M9YP tag=V50XPUL1HKPZ type=del size=3810274 2023-10-05T11:35:13.127 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.123+0000 7f26f5634780 1 < completed part key=_multipart_WTCWG1C1SF89.2~2ZPAO0STE4QK.0 size=1048576 2023-10-05T11:35:13.128 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.125+0000 7f26f5634780 1 < completed part key=_multipart_WTCWG1C1SF89.2~2ZPAO0STE4QK.1 size=1048576 2023-10-05T11:35:13.129 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.126+0000 7f26f5634780 1 < completed part key=_multipart_WTCWG1C1SF89.2~2ZPAO0STE4QK.2 size=381190 2023-10-05T11:35:13.131 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.128+0000 7f26f5634780 1 < completed multipart upload key=WTCWG1C1SF89 upload=2ZPAO0STE4QK tag=NV0TRTFWG39E type=write size=3526918 2023-10-05T11:35:13.132 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.129+0000 7f26f5634780 1 > prepared operation key=PC8WTJ8AYJ24 tag=C2M4XE3GG8T5 type=del size=2683802 2023-10-05T11:35:13.134 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.130+0000 7f26f5634780 1 < completed part key=_multipart_7W9LL5HSU3BG.2~UBG6EB1R50VM.0 size=383782 2023-10-05T11:35:13.136 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.132+0000 7f26f5634780 1 < completed multipart upload key=7W9LL5HSU3BG upload=UBG6EB1R50VM tag=KN7UOPUZ12AN type=write size=1432358 2023-10-05T11:35:13.137 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.134+0000 7f26f5634780 1 > prepared operation key=4D3H60UTIXH3 tag=KPLGGCEO4FJ1 type=del size=1924546 2023-10-05T11:35:13.138 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.135+0000 7f26f5634780 1 < completed delete operation key=2D4PDQQT54ZA tag=FW12FO0AO1J5 type=del 2023-10-05T11:35:13.141 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.137+0000 7f26f5634780 1 > prepared part key=_multipart_VJTFYDETLSFD.2~1SWIUUXXORZT.0 size=1048576 2023-10-05T11:35:13.142 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.138+0000 7f26f5634780 1 > prepared part key=_multipart_VJTFYDETLSFD.2~1SWIUUXXORZT.1 size=102131 2023-10-05T11:35:13.142 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.138+0000 7f26f5634780 1 > prepared multipart upload key=VJTFYDETLSFD upload=1SWIUUXXORZT tag=IHTBDWXM9REB type=write size=2199283 2023-10-05T11:35:13.143 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.140+0000 7f26f5634780 1 < completed part key=_multipart_PC8WTJ8AYJ24.2~0Z9466AZMO5R.0 size=154880 2023-10-05T11:35:13.145 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.142+0000 7f26f5634780 1 < completed multipart upload key=PC8WTJ8AYJ24 upload=0Z9466AZMO5R tag=5O4H3ZGYCUQ8 type=write size=1203456 2023-10-05T11:35:13.146 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.143+0000 7f26f5634780 1 > prepared operation key=IKCNZOTVWOC6 tag=C4TW3PZXC7YD type=write size=746290 2023-10-05T11:35:13.148 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.144+0000 7f26f5634780 1 < completed delete operation key=4D3H60UTIXH3 tag=Q75XJSE4ZE4F type=del 2023-10-05T11:35:13.149 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.146+0000 7f26f5634780 1 > prepared operation key=W2GWVGX42QLD tag=E3T81LXOLKAQ type=write size=802317 2023-10-05T11:35:13.150 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.147+0000 7f26f5634780 1 < completed delete operation key=WTCWG1C1SF89 tag=XY7L4NHIX83G type=del 2023-10-05T11:35:13.151 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.148+0000 7f26f5634780 1 > prepared operation key=9S0YW7PPSJ8G tag=XH486AZ6XGHY type=del size=3793975 2023-10-05T11:35:13.154 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.150+0000 7f26f5634780 1 < suggested update operation key=IC7T3ZK81WQS tag=UO5F16E7YK42 type=write size=694488 2023-10-05T11:35:13.156 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.153+0000 7f26f5634780 1 > prepared part key=_multipart_MEY4SZRHU9NZ.2~990SQJKW15OY.0 size=1048576 2023-10-05T11:35:13.157 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.154+0000 7f26f5634780 1 > prepared part key=_multipart_MEY4SZRHU9NZ.2~990SQJKW15OY.1 size=1048576 2023-10-05T11:35:13.158 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.155+0000 7f26f5634780 1 > prepared part key=_multipart_MEY4SZRHU9NZ.2~990SQJKW15OY.2 size=927842 2023-10-05T11:35:13.159 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.155+0000 7f26f5634780 1 > prepared multipart upload key=MEY4SZRHU9NZ upload=990SQJKW15OY tag=109F6X2O6FZS type=write size=4073570 2023-10-05T11:35:13.160 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.156+0000 7f26f5634780 1 < completed part key=_multipart_5OPHKTHXVN5U.2~G1ZRD7CWZG5R.0 size=1048576 2023-10-05T11:35:13.161 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.158+0000 7f26f5634780 1 < completed part key=_multipart_5OPHKTHXVN5U.2~G1ZRD7CWZG5R.1 size=153007 2023-10-05T11:35:13.163 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.160+0000 7f26f5634780 1 < completed multipart upload key=5OPHKTHXVN5U upload=G1ZRD7CWZG5R tag=12ACXLK33D5O type=write size=2250159 2023-10-05T11:35:13.164 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.161+0000 7f26f5634780 1 > prepared operation key=AV0XKXX1IR4B tag=NG4261QI1MY9 type=del size=617323 2023-10-05T11:35:13.166 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.162+0000 7f26f5634780 1 < completed delete operation key=0PWYKC7S6YJ4 tag=Q8943953IYOQ type=del 2023-10-05T11:35:13.167 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.164+0000 7f26f5634780 1 > prepared operation key=7TOP5A52M9YP tag=ZA331NS8PS69 type=del size=3511967 2023-10-05T11:35:13.168 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.165+0000 7f26f5634780 1 < completed part key=_multipart_W2GWVGX42QLD.2~XOX1STEMC3GB.0 size=1048576 2023-10-05T11:35:13.168 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.165+0000 7f26f5634780 1 < canceled part key=_multipart_W2GWVGX42QLD.2~XOX1STEMC3GB.1 size=348000 2023-10-05T11:35:13.170 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.167+0000 7f26f5634780 1 < canceled multipart upload key=W2GWVGX42QLD upload=XOX1STEMC3GB tag=8GLT6A6BPPUL type=write size=2445152 2023-10-05T11:35:13.171 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.168+0000 7f26f5634780 1 > prepared operation key=WTCWG1C1SF89 tag=64KWHRTZAR2C type=del size=2652948 2023-10-05T11:35:13.173 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.169+0000 7f26f5634780 1 < completed delete operation key=MEY4SZRHU9NZ tag=QJEG9WAITR0U type=del 2023-10-05T11:35:13.174 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.170+0000 7f26f5634780 1 > prepared operation key=5V0Q651D4VN2 tag=7EG04BWUTULG type=del size=4028405 2023-10-05T11:35:13.175 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.172+0000 7f26f5634780 1 < completed write operation key=BTZUVE8R96XT tag=G056WF1BABFT type=write size=701045 2023-10-05T11:35:13.176 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.173+0000 7f26f5634780 1 > prepared operation key=PNV0Q6ZPLYV0 tag=DT1NCYJO0PC4 type=del size=1581361 2023-10-05T11:35:13.178 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.174+0000 7f26f5634780 1 < completed part key=_multipart_PNV0Q6ZPLYV0.2~SJCXGZRHIV7O.0 size=204496 2023-10-05T11:35:13.179 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.176+0000 7f26f5634780 1 < completed multipart upload key=PNV0Q6ZPLYV0 upload=SJCXGZRHIV7O tag=59Q2F3NSIX6V type=write size=1253072 2023-10-05T11:35:13.181 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.177+0000 7f26f5634780 1 > prepared operation key=PNV0Q6ZPLYV0 tag=XSH10IN5XJWB type=del size=1715460 2023-10-05T11:35:13.182 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.178+0000 7f26f5634780 1 < completed delete operation key=0PWYKC7S6YJ4 tag=Z5Z16T82T9US type=del 2023-10-05T11:35:13.183 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.179+0000 7f26f5634780 1 > prepared operation key=J5EIH25Y471T tag=1F7DFL5Q7M4R type=del size=2986532 2023-10-05T11:35:13.184 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.181+0000 7f26f5634780 1 < completed delete operation key=2D4PDQQT54ZA tag=412M7QWLA1WZ type=del 2023-10-05T11:35:13.185 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.182+0000 7f26f5634780 1 > prepared operation key=LLR5J3X15W5R tag=IM8B43OMGKG7 type=del size=1199893 2023-10-05T11:35:13.186 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.183+0000 7f26f5634780 1 < completed delete operation key=7TOP5A52M9YP tag=V50XPUL1HKPZ type=del 2023-10-05T11:35:13.187 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.184+0000 7f26f5634780 1 > prepared operation key=PNV0Q6ZPLYV0 tag=A08QGPSLF8WA type=del size=2602177 2023-10-05T11:35:13.189 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.185+0000 7f26f5634780 1 < completed delete operation key=PC8WTJ8AYJ24 tag=C2M4XE3GG8T5 type=del 2023-10-05T11:35:13.190 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.187+0000 7f26f5634780 1 > prepared operation key=IC7T3ZK81WQS tag=I4ZV4RP1Q5VW type=write size=388071 2023-10-05T11:35:13.191 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.188+0000 7f26f5634780 1 < completed delete operation key=4D3H60UTIXH3 tag=KPLGGCEO4FJ1 type=del 2023-10-05T11:35:13.193 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.190+0000 7f26f5634780 1 > prepared part key=_multipart_AV0XKXX1IR4B.2~QE3BJ3E214BB.0 size=155964 2023-10-05T11:35:13.193 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.190+0000 7f26f5634780 1 > prepared multipart upload key=AV0XKXX1IR4B upload=QE3BJ3E214BB tag=VG49KK59RVM8 type=write size=1204540 2023-10-05T11:35:13.194 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.191+0000 7f26f5634780 1 < completed part key=_multipart_VJTFYDETLSFD.2~1SWIUUXXORZT.0 size=1048576 2023-10-05T11:35:13.195 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.192+0000 7f26f5634780 1 < completed part key=_multipart_VJTFYDETLSFD.2~1SWIUUXXORZT.1 size=102131 2023-10-05T11:35:13.197 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.194+0000 7f26f5634780 1 < completed multipart upload key=VJTFYDETLSFD upload=1SWIUUXXORZT tag=IHTBDWXM9REB type=write size=2199283 2023-10-05T11:35:13.199 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.196+0000 7f26f5634780 1 > prepared part key=_multipart_VJTFYDETLSFD.2~M8629J21QRV9.0 size=1048576 2023-10-05T11:35:13.200 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.197+0000 7f26f5634780 1 > prepared part key=_multipart_VJTFYDETLSFD.2~M8629J21QRV9.1 size=1048576 2023-10-05T11:35:13.201 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.198+0000 7f26f5634780 1 > prepared part key=_multipart_VJTFYDETLSFD.2~M8629J21QRV9.2 size=346886 2023-10-05T11:35:13.201 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.198+0000 7f26f5634780 1 > prepared multipart upload key=VJTFYDETLSFD upload=M8629J21QRV9 tag=PAWHU43030ZW type=write size=3492614 2023-10-05T11:35:13.202 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.199+0000 7f26f5634780 1 < completed write operation key=IKCNZOTVWOC6 tag=C4TW3PZXC7YD type=write size=746290 2023-10-05T11:35:13.204 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.200+0000 7f26f5634780 1 > prepared operation key=IC7T3ZK81WQS tag=OZA80LVL3JQX type=del size=3192958 2023-10-05T11:35:13.205 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.201+0000 7f26f5634780 1 < completed write operation key=W2GWVGX42QLD tag=E3T81LXOLKAQ type=write size=802317 2023-10-05T11:35:13.206 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.202+0000 7f26f5634780 1 > prepared operation key=MEY4SZRHU9NZ tag=JK7CSW10E05X type=del size=1306417 2023-10-05T11:35:13.207 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.204+0000 7f26f5634780 1 < completed delete operation key=9S0YW7PPSJ8G tag=XH486AZ6XGHY type=del 2023-10-05T11:35:13.208 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.205+0000 7f26f5634780 1 > prepared operation key=WTCWG1C1SF89 tag=QC54KUZ18NK5 type=del size=2926771 2023-10-05T11:35:13.210 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.207+0000 7f26f5634780 1 < completed part key=_multipart_MEY4SZRHU9NZ.2~990SQJKW15OY.0 size=1048576 2023-10-05T11:35:13.211 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.208+0000 7f26f5634780 1 < completed part key=_multipart_MEY4SZRHU9NZ.2~990SQJKW15OY.1 size=1048576 2023-10-05T11:35:13.212 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.209+0000 7f26f5634780 1 < completed part key=_multipart_MEY4SZRHU9NZ.2~990SQJKW15OY.2 size=927842 2023-10-05T11:35:13.214 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.211+0000 7f26f5634780 1 < completed multipart upload key=MEY4SZRHU9NZ upload=990SQJKW15OY tag=109F6X2O6FZS type=write size=4073570 2023-10-05T11:35:13.216 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.213+0000 7f26f5634780 1 > prepared part key=_multipart_NV4Q36UOLX8A.2~ERXI5TWY64G0.0 size=1048576 2023-10-05T11:35:13.217 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.214+0000 7f26f5634780 1 > prepared part key=_multipart_NV4Q36UOLX8A.2~ERXI5TWY64G0.1 size=1048576 2023-10-05T11:35:13.218 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.215+0000 7f26f5634780 1 > prepared part key=_multipart_NV4Q36UOLX8A.2~ERXI5TWY64G0.2 size=885225 2023-10-05T11:35:13.218 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.215+0000 7f26f5634780 1 > prepared multipart upload key=NV4Q36UOLX8A upload=ERXI5TWY64G0 tag=WRQVGKZJM607 type=write size=4030953 2023-10-05T11:35:13.219 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.216+0000 7f26f5634780 1 < completed delete operation key=AV0XKXX1IR4B tag=NG4261QI1MY9 type=del 2023-10-05T11:35:13.221 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.218+0000 7f26f5634780 1 > prepared part key=_multipart_6DP3UJ4CW1MO.2~RB0HTGRQQSYV.0 size=174482 2023-10-05T11:35:13.221 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.218+0000 7f26f5634780 1 > prepared multipart upload key=6DP3UJ4CW1MO upload=RB0HTGRQQSYV tag=3N3ZRRYJ2ZHS type=write size=1223058 2023-10-05T11:35:13.223 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.219+0000 7f26f5634780 1 < completed delete operation key=7TOP5A52M9YP tag=ZA331NS8PS69 type=del 2023-10-05T11:35:13.224 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.220+0000 7f26f5634780 1 > prepared operation key=5V0Q651D4VN2 tag=R8YGBT2XB36L type=write size=310617 2023-10-05T11:35:13.226 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.223+0000 7f26f5634780 1 < suggested remove operation key=WTCWG1C1SF89 tag=64KWHRTZAR2C type=del 2023-10-05T11:35:13.228 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.225+0000 7f26f5634780 1 > prepared part key=_multipart_WTCWG1C1SF89.2~OK9JNPPU51VQ.0 size=347245 2023-10-05T11:35:13.228 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.225+0000 7f26f5634780 1 > prepared multipart upload key=WTCWG1C1SF89 upload=OK9JNPPU51VQ tag=VYCDV0CH3Q3J type=write size=1395821 2023-10-05T11:35:13.230 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.227+0000 7f26f5634780 1 < suggested remove operation key=5V0Q651D4VN2 tag=7EG04BWUTULG type=del 2023-10-05T11:35:13.233 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.229+0000 7f26f5634780 1 > prepared part key=_multipart_7TOP5A52M9YP.2~2HKWADUB7EKM.0 size=1048576 2023-10-05T11:35:13.234 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.230+0000 7f26f5634780 1 > prepared part key=_multipart_7TOP5A52M9YP.2~2HKWADUB7EKM.1 size=387396 2023-10-05T11:35:13.234 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.230+0000 7f26f5634780 1 > prepared multipart upload key=7TOP5A52M9YP upload=2HKWADUB7EKM tag=QL36JL7Q1162 type=write size=2484548 2023-10-05T11:35:13.235 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.232+0000 7f26f5634780 1 < completed delete operation key=PNV0Q6ZPLYV0 tag=DT1NCYJO0PC4 type=del 2023-10-05T11:35:13.236 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.233+0000 7f26f5634780 1 > prepared operation key=4D3H60UTIXH3 tag=PZ3BSRYHRB02 type=write size=759990 2023-10-05T11:35:13.237 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.234+0000 7f26f5634780 1 < completed delete operation key=PNV0Q6ZPLYV0 tag=XSH10IN5XJWB type=del 2023-10-05T11:35:13.242 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.235+0000 7f26f5634780 1 > prepared operation key=AV0XKXX1IR4B tag=W696KQCIDA2J type=del size=3907954 2023-10-05T11:35:13.242 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.237+0000 7f26f5634780 1 < completed delete operation key=J5EIH25Y471T tag=1F7DFL5Q7M4R type=del 2023-10-05T11:35:13.242 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.238+0000 7f26f5634780 1 > prepared operation key=VJTFYDETLSFD tag=LQWMQ63DB9KK type=write size=294696 2023-10-05T11:35:13.242 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.239+0000 7f26f5634780 1 < completed delete operation key=LLR5J3X15W5R tag=IM8B43OMGKG7 type=del 2023-10-05T11:35:13.244 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.241+0000 7f26f5634780 1 > prepared operation key=FOMNIIY47UUM tag=UTA3CE75V165 type=del size=3834793 2023-10-05T11:35:13.245 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.242+0000 7f26f5634780 1 < completed delete operation key=PNV0Q6ZPLYV0 tag=A08QGPSLF8WA type=del 2023-10-05T11:35:13.247 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.244+0000 7f26f5634780 1 > prepared part key=_multipart_IC7T3ZK81WQS.2~3KNYBSBAG3O5.0 size=1048576 2023-10-05T11:35:13.248 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.245+0000 7f26f5634780 1 > prepared part key=_multipart_IC7T3ZK81WQS.2~3KNYBSBAG3O5.1 size=395125 2023-10-05T11:35:13.249 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.245+0000 7f26f5634780 1 > prepared multipart upload key=IC7T3ZK81WQS upload=3KNYBSBAG3O5 tag=ZGP0045FE4AP type=write size=2492277 2023-10-05T11:35:13.250 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.246+0000 7f26f5634780 1 < completed write operation key=IC7T3ZK81WQS tag=I4ZV4RP1Q5VW type=write size=388071 2023-10-05T11:35:13.251 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.247+0000 7f26f5634780 1 > prepared operation key=IKCNZOTVWOC6 tag=DPCNWHZ1WJM2 type=del size=3874821 2023-10-05T11:35:13.252 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.249+0000 7f26f5634780 1 < completed part key=_multipart_AV0XKXX1IR4B.2~QE3BJ3E214BB.0 size=155964 2023-10-05T11:35:13.254 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.250+0000 7f26f5634780 1 < completed multipart upload key=AV0XKXX1IR4B upload=QE3BJ3E214BB tag=VG49KK59RVM8 type=write size=1204540 2023-10-05T11:35:13.256 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.253+0000 7f26f5634780 1 > prepared part key=_multipart_S3DKYDFT4IO2.2~1OKT9IU97QHK.0 size=1048576 2023-10-05T11:35:13.257 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.253+0000 7f26f5634780 1 > prepared part key=_multipart_S3DKYDFT4IO2.2~1OKT9IU97QHK.1 size=410455 2023-10-05T11:35:13.257 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.253+0000 7f26f5634780 1 > prepared multipart upload key=S3DKYDFT4IO2 upload=1OKT9IU97QHK tag=7KEBTF4CF6ML type=write size=2507607 2023-10-05T11:35:13.258 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.255+0000 7f26f5634780 1 < completed part key=_multipart_VJTFYDETLSFD.2~M8629J21QRV9.0 size=1048576 2023-10-05T11:35:13.259 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.256+0000 7f26f5634780 1 < completed part key=_multipart_VJTFYDETLSFD.2~M8629J21QRV9.1 size=1048576 2023-10-05T11:35:13.260 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.257+0000 7f26f5634780 1 < completed part key=_multipart_VJTFYDETLSFD.2~M8629J21QRV9.2 size=346886 2023-10-05T11:35:13.262 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.259+0000 7f26f5634780 1 < completed multipart upload key=VJTFYDETLSFD upload=M8629J21QRV9 tag=PAWHU43030ZW type=write size=3492614 2023-10-05T11:35:13.264 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.261+0000 7f26f5634780 1 > prepared part key=_multipart_6DP3UJ4CW1MO.2~R230NZZC21QW.0 size=1048576 2023-10-05T11:35:13.265 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.262+0000 7f26f5634780 1 > prepared part key=_multipart_6DP3UJ4CW1MO.2~R230NZZC21QW.1 size=27281 2023-10-05T11:35:13.265 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.262+0000 7f26f5634780 1 > prepared multipart upload key=6DP3UJ4CW1MO upload=R230NZZC21QW tag=GWCF9JHJ2SXN type=write size=2124433 2023-10-05T11:35:13.268 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.264+0000 7f26f5634780 1 < suggested update operation key=IC7T3ZK81WQS tag=OZA80LVL3JQX type=del size=3192958 2023-10-05T11:35:13.269 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.266+0000 7f26f5634780 1 > prepared operation key=9S0YW7PPSJ8G tag=E6NC9WXBZMHK type=write size=1037595 2023-10-05T11:35:13.271 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.267+0000 7f26f5634780 1 < completed delete operation key=MEY4SZRHU9NZ tag=JK7CSW10E05X type=del 2023-10-05T11:35:13.272 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.269+0000 7f26f5634780 1 > prepared operation key=6DP3UJ4CW1MO tag=KHIXH2NFCG5Y type=del size=818240 2023-10-05T11:35:13.273 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.270+0000 7f26f5634780 -1 < failed to complete operation key=WTCWG1C1SF89 tag=QC54KUZ18NK5 type=del size=2926771: (22) Invalid argument 2023-10-05T11:35:13.275 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.271+0000 7f26f5634780 1 > prepared operation key=W2GWVGX42QLD tag=4FIPRVHPPC37 type=del size=1404639 2023-10-05T11:35:13.276 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.273+0000 7f26f5634780 1 < completed part key=_multipart_NV4Q36UOLX8A.2~ERXI5TWY64G0.0 size=1048576 2023-10-05T11:35:13.277 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.274+0000 7f26f5634780 1 < completed part key=_multipart_NV4Q36UOLX8A.2~ERXI5TWY64G0.1 size=1048576 2023-10-05T11:35:13.278 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.275+0000 7f26f5634780 1 < completed part key=_multipart_NV4Q36UOLX8A.2~ERXI5TWY64G0.2 size=885225 2023-10-05T11:35:13.280 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.277+0000 7f26f5634780 1 < completed multipart upload key=NV4Q36UOLX8A upload=ERXI5TWY64G0 tag=WRQVGKZJM607 type=write size=4030953 2023-10-05T11:35:13.281 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.278+0000 7f26f5634780 1 > prepared operation key=4D3H60UTIXH3 tag=T47EMRAEZ8HJ type=del size=1206551 2023-10-05T11:35:13.283 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.279+0000 7f26f5634780 1 < completed part key=_multipart_6DP3UJ4CW1MO.2~RB0HTGRQQSYV.0 size=174482 2023-10-05T11:35:13.285 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.281+0000 7f26f5634780 1 < completed multipart upload key=6DP3UJ4CW1MO upload=RB0HTGRQQSYV tag=3N3ZRRYJ2ZHS type=write size=1223058 2023-10-05T11:35:13.286 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.282+0000 7f26f5634780 1 > prepared operation key=2D4PDQQT54ZA tag=PSVFR8QDNXXS type=del size=1426570 2023-10-05T11:35:13.286 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.283+0000 7f26f5634780 -1 < no bi entry to suggest for operation key=5V0Q651D4VN2 tag=R8YGBT2XB36L type=write size=310617: (2) No such file or directory 2023-10-05T11:35:13.288 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.284+0000 7f26f5634780 1 > prepared operation key=7W9LL5HSU3BG tag=8TS8PTSTLQ1G type=del size=3547530 2023-10-05T11:35:13.289 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.285+0000 7f26f5634780 1 < completed part key=_multipart_WTCWG1C1SF89.2~OK9JNPPU51VQ.0 size=347245 2023-10-05T11:35:13.290 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.287+0000 7f26f5634780 1 < completed multipart upload key=WTCWG1C1SF89 upload=OK9JNPPU51VQ tag=VYCDV0CH3Q3J type=write size=1395821 2023-10-05T11:35:13.292 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.288+0000 7f26f5634780 1 > prepared operation key=MEY4SZRHU9NZ tag=1ML716GMSQUQ type=del size=1050364 2023-10-05T11:35:13.293 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.290+0000 7f26f5634780 1 < completed part key=_multipart_7TOP5A52M9YP.2~2HKWADUB7EKM.0 size=1048576 2023-10-05T11:35:13.293 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.290+0000 7f26f5634780 1 < canceled part key=_multipart_7TOP5A52M9YP.2~2HKWADUB7EKM.1 size=387396 2023-10-05T11:35:13.295 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.292+0000 7f26f5634780 1 < canceled multipart upload key=7TOP5A52M9YP upload=2HKWADUB7EKM tag=QL36JL7Q1162 type=write size=2484548 2023-10-05T11:35:13.297 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.294+0000 7f26f5634780 1 > prepared part key=_multipart_7W9LL5HSU3BG.2~1GT3RXQB4O8R.0 size=1048576 2023-10-05T11:35:13.298 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.295+0000 7f26f5634780 1 > prepared part key=_multipart_7W9LL5HSU3BG.2~1GT3RXQB4O8R.1 size=663226 2023-10-05T11:35:13.298 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.295+0000 7f26f5634780 1 > prepared multipart upload key=7W9LL5HSU3BG upload=1GT3RXQB4O8R tag=VRVW85DQJ63O type=write size=2760378 2023-10-05T11:35:13.299 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.296+0000 7f26f5634780 1 < completed write operation key=4D3H60UTIXH3 tag=PZ3BSRYHRB02 type=write size=759990 2023-10-05T11:35:13.300 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.297+0000 7f26f5634780 1 > prepared operation key=PC8WTJ8AYJ24 tag=QWNBT3PUWT01 type=write size=288981 2023-10-05T11:35:13.301 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.298+0000 7f26f5634780 1 < completed delete operation key=AV0XKXX1IR4B tag=W696KQCIDA2J type=del 2023-10-05T11:35:13.303 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.299+0000 7f26f5634780 1 > prepared operation key=8IPCP77WVVZT tag=YAFEL6CKNSW8 type=write size=4791 2023-10-05T11:35:13.305 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.301+0000 7f26f5634780 1 < suggested update operation key=VJTFYDETLSFD tag=LQWMQ63DB9KK type=write size=294696 2023-10-05T11:35:13.307 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.304+0000 7f26f5634780 1 > prepared part key=_multipart_W2GWVGX42QLD.2~3PWE44P5C9BR.0 size=1048576 2023-10-05T11:35:13.308 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.305+0000 7f26f5634780 1 > prepared part key=_multipart_W2GWVGX42QLD.2~3PWE44P5C9BR.1 size=1048576 2023-10-05T11:35:13.309 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.305+0000 7f26f5634780 1 > prepared part key=_multipart_W2GWVGX42QLD.2~3PWE44P5C9BR.2 size=569966 2023-10-05T11:35:13.309 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.305+0000 7f26f5634780 1 > prepared multipart upload key=W2GWVGX42QLD upload=3PWE44P5C9BR tag=T9TB8J4I3VH2 type=write size=3715694 2023-10-05T11:35:13.310 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.307+0000 7f26f5634780 1 < canceled operation key=FOMNIIY47UUM tag=UTA3CE75V165 type=del size=3834793 2023-10-05T11:35:13.312 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.309+0000 7f26f5634780 1 > prepared part key=_multipart_MEY4SZRHU9NZ.2~8I7O8LDD7MD6.0 size=1048576 2023-10-05T11:35:13.313 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.310+0000 7f26f5634780 1 > prepared part key=_multipart_MEY4SZRHU9NZ.2~8I7O8LDD7MD6.1 size=285625 2023-10-05T11:35:13.313 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.310+0000 7f26f5634780 1 > prepared multipart upload key=MEY4SZRHU9NZ upload=8I7O8LDD7MD6 tag=Q5LWZFLXBQFH type=write size=2382777 2023-10-05T11:35:13.314 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.311+0000 7f26f5634780 1 < completed part key=_multipart_IC7T3ZK81WQS.2~3KNYBSBAG3O5.0 size=1048576 2023-10-05T11:35:13.315 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.312+0000 7f26f5634780 1 < completed part key=_multipart_IC7T3ZK81WQS.2~3KNYBSBAG3O5.1 size=395125 2023-10-05T11:35:13.317 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.314+0000 7f26f5634780 1 < completed multipart upload key=IC7T3ZK81WQS upload=3KNYBSBAG3O5 tag=ZGP0045FE4AP type=write size=2492277 2023-10-05T11:35:13.319 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.315+0000 7f26f5634780 1 > prepared operation key=IKCNZOTVWOC6 tag=LWSDI22VBWJA type=del size=1228115 2023-10-05T11:35:13.320 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.316+0000 7f26f5634780 1 < completed delete operation key=IKCNZOTVWOC6 tag=DPCNWHZ1WJM2 type=del 2023-10-05T11:35:13.321 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.318+0000 7f26f5634780 1 > prepared operation key=7W9LL5HSU3BG tag=IYLSBZKEHLG0 type=del size=3166034 2023-10-05T11:35:13.324 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.320+0000 7f26f5634780 1 < completed part key=_multipart_S3DKYDFT4IO2.2~1OKT9IU97QHK.0 size=1048576 2023-10-05T11:35:13.325 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.321+0000 7f26f5634780 1 < completed part key=_multipart_S3DKYDFT4IO2.2~1OKT9IU97QHK.1 size=410455 2023-10-05T11:35:13.327 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.323+0000 7f26f5634780 1 < completed multipart upload key=S3DKYDFT4IO2 upload=1OKT9IU97QHK tag=7KEBTF4CF6ML type=write size=2507607 2023-10-05T11:35:13.328 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.325+0000 7f26f5634780 1 > prepared operation key=8IPCP77WVVZT tag=H5G0IE9F7ZEV type=write size=150691 2023-10-05T11:35:13.329 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.326+0000 7f26f5634780 1 < completed part key=_multipart_6DP3UJ4CW1MO.2~R230NZZC21QW.0 size=1048576 2023-10-05T11:35:13.330 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.327+0000 7f26f5634780 1 < completed part key=_multipart_6DP3UJ4CW1MO.2~R230NZZC21QW.1 size=27281 2023-10-05T11:35:13.332 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.329+0000 7f26f5634780 1 < completed multipart upload key=6DP3UJ4CW1MO upload=R230NZZC21QW tag=GWCF9JHJ2SXN type=write size=2124433 2023-10-05T11:35:13.333 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.330+0000 7f26f5634780 1 > prepared operation key=VJTFYDETLSFD tag=QLQECU9OHKIR type=write size=611403 2023-10-05T11:35:13.336 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.332+0000 7f26f5634780 1 < suggested update operation key=9S0YW7PPSJ8G tag=E6NC9WXBZMHK type=write size=1037595 2023-10-05T11:35:13.338 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.334+0000 7f26f5634780 1 > prepared part key=_multipart_NV4Q36UOLX8A.2~2RGP7ZKF8YEV.0 size=1048576 2023-10-05T11:35:13.341 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.335+0000 7f26f5634780 1 > prepared part key=_multipart_NV4Q36UOLX8A.2~2RGP7ZKF8YEV.1 size=9449 2023-10-05T11:35:13.341 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.335+0000 7f26f5634780 1 > prepared multipart upload key=NV4Q36UOLX8A upload=2RGP7ZKF8YEV tag=8F2F2S5OJ4EO type=write size=2106601 2023-10-05T11:35:13.341 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.337+0000 7f26f5634780 1 < completed delete operation key=6DP3UJ4CW1MO tag=KHIXH2NFCG5Y type=del 2023-10-05T11:35:13.341 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.338+0000 7f26f5634780 1 > prepared operation key=VJTFYDETLSFD tag=5AA0O6VHUGMU type=write size=960992 2023-10-05T11:35:13.344 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.340+0000 7f26f5634780 1 < suggested remove operation key=W2GWVGX42QLD tag=4FIPRVHPPC37 type=del 2023-10-05T11:35:13.346 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.343+0000 7f26f5634780 1 > prepared part key=_multipart_BTZUVE8R96XT.2~ONXI88F0RGF2.0 size=1048576 2023-10-05T11:35:13.347 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.344+0000 7f26f5634780 1 > prepared part key=_multipart_BTZUVE8R96XT.2~ONXI88F0RGF2.1 size=975210 2023-10-05T11:35:13.347 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.344+0000 7f26f5634780 1 > prepared multipart upload key=BTZUVE8R96XT upload=ONXI88F0RGF2 tag=Z39YE7KC9B3K type=write size=3072362 2023-10-05T11:35:13.349 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.346+0000 7f26f5634780 1 < suggested remove operation key=4D3H60UTIXH3 tag=T47EMRAEZ8HJ type=del 2023-10-05T11:35:13.351 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.347+0000 7f26f5634780 1 > prepared operation key=2U0NRDGDNUTA tag=2NOD4AZLYQTX type=del size=1072540 2023-10-05T11:35:13.352 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.349+0000 7f26f5634780 1 < completed delete operation key=2D4PDQQT54ZA tag=PSVFR8QDNXXS type=del 2023-10-05T11:35:13.354 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.351+0000 7f26f5634780 1 > prepared part key=_multipart_7W9LL5HSU3BG.2~84AC6O7OH8JA.0 size=522186 2023-10-05T11:35:13.354 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.351+0000 7f26f5634780 1 > prepared multipart upload key=7W9LL5HSU3BG upload=84AC6O7OH8JA tag=CW3NGPC7XY3D type=write size=1570762 2023-10-05T11:35:13.355 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.352+0000 7f26f5634780 1 < completed delete operation key=7W9LL5HSU3BG tag=8TS8PTSTLQ1G type=del 2023-10-05T11:35:13.357 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.353+0000 7f26f5634780 1 > prepared operation key=0PWYKC7S6YJ4 tag=QHY262Y5RVM8 type=del size=2806360 2023-10-05T11:35:13.358 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.354+0000 7f26f5634780 1 < completed delete operation key=MEY4SZRHU9NZ tag=1ML716GMSQUQ type=del 2023-10-05T11:35:13.360 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.357+0000 7f26f5634780 1 > prepared part key=_multipart_6DP3UJ4CW1MO.2~S19AMI967HCO.0 size=147711 2023-10-05T11:35:13.360 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.357+0000 7f26f5634780 1 > prepared multipart upload key=6DP3UJ4CW1MO upload=S19AMI967HCO tag=EXXVQBRSD6KL type=write size=1196287 2023-10-05T11:35:13.361 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.358+0000 7f26f5634780 1 < completed part key=_multipart_7W9LL5HSU3BG.2~1GT3RXQB4O8R.0 size=1048576 2023-10-05T11:35:13.362 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.359+0000 7f26f5634780 1 < completed part key=_multipart_7W9LL5HSU3BG.2~1GT3RXQB4O8R.1 size=663226 2023-10-05T11:35:13.364 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.361+0000 7f26f5634780 1 < completed multipart upload key=7W9LL5HSU3BG upload=1GT3RXQB4O8R tag=VRVW85DQJ63O type=write size=2760378 2023-10-05T11:35:13.366 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.363+0000 7f26f5634780 1 > prepared part key=_multipart_FOMNIIY47UUM.2~TUNY6UT9KEBT.0 size=1048576 2023-10-05T11:35:13.367 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.364+0000 7f26f5634780 1 > prepared part key=_multipart_FOMNIIY47UUM.2~TUNY6UT9KEBT.1 size=1048576 2023-10-05T11:35:13.368 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.365+0000 7f26f5634780 1 > prepared part key=_multipart_FOMNIIY47UUM.2~TUNY6UT9KEBT.2 size=230980 2023-10-05T11:35:13.368 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.365+0000 7f26f5634780 1 > prepared multipart upload key=FOMNIIY47UUM upload=TUNY6UT9KEBT tag=OGT2Z2PZLJYH type=write size=3376708 2023-10-05T11:35:13.369 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.366+0000 7f26f5634780 1 < completed write operation key=PC8WTJ8AYJ24 tag=QWNBT3PUWT01 type=write size=288981 2023-10-05T11:35:13.371 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.368+0000 7f26f5634780 1 > prepared part key=_multipart_U6172JUYW7J6.2~4AZMZJI19TSQ.0 size=1048576 2023-10-05T11:35:13.373 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.369+0000 7f26f5634780 1 > prepared part key=_multipart_U6172JUYW7J6.2~4AZMZJI19TSQ.1 size=907072 2023-10-05T11:35:13.373 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.369+0000 7f26f5634780 1 > prepared multipart upload key=U6172JUYW7J6 upload=4AZMZJI19TSQ tag=LWG012OJMG9I type=write size=3004224 2023-10-05T11:35:13.374 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.370+0000 7f26f5634780 1 < completed write operation key=8IPCP77WVVZT tag=YAFEL6CKNSW8 type=write size=4791 2023-10-05T11:35:13.375 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.372+0000 7f26f5634780 1 > prepared operation key=PC8WTJ8AYJ24 tag=07OAFSXG2OI0 type=write size=467157 2023-10-05T11:35:13.376 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.373+0000 7f26f5634780 1 < completed part key=_multipart_W2GWVGX42QLD.2~3PWE44P5C9BR.0 size=1048576 2023-10-05T11:35:13.378 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.374+0000 7f26f5634780 1 < completed part key=_multipart_W2GWVGX42QLD.2~3PWE44P5C9BR.1 size=1048576 2023-10-05T11:35:13.378 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.374+0000 7f26f5634780 1 < canceled part key=_multipart_W2GWVGX42QLD.2~3PWE44P5C9BR.2 size=569966 2023-10-05T11:35:13.380 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.376+0000 7f26f5634780 1 < canceled multipart upload key=W2GWVGX42QLD upload=3PWE44P5C9BR tag=T9TB8J4I3VH2 type=write size=3715694 2023-10-05T11:35:13.381 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.378+0000 7f26f5634780 1 > prepared operation key=7W9LL5HSU3BG tag=DUJRQLFYBCBV type=del size=2159701 2023-10-05T11:35:13.382 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.379+0000 7f26f5634780 1 < completed part key=_multipart_MEY4SZRHU9NZ.2~8I7O8LDD7MD6.0 size=1048576 2023-10-05T11:35:13.383 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.380+0000 7f26f5634780 1 < completed part key=_multipart_MEY4SZRHU9NZ.2~8I7O8LDD7MD6.1 size=285625 2023-10-05T11:35:13.385 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.382+0000 7f26f5634780 1 < completed multipart upload key=MEY4SZRHU9NZ upload=8I7O8LDD7MD6 tag=Q5LWZFLXBQFH type=write size=2382777 2023-10-05T11:35:13.386 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.383+0000 7f26f5634780 1 > prepared operation key=6DP3UJ4CW1MO tag=1ZF88UYHNQSL type=del size=3896084 2023-10-05T11:35:13.388 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.384+0000 7f26f5634780 1 < completed delete operation key=IKCNZOTVWOC6 tag=LWSDI22VBWJA type=del 2023-10-05T11:35:13.390 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.387+0000 7f26f5634780 1 > prepared part key=_multipart_AV0XKXX1IR4B.2~A291W8CUO3N4.0 size=1048576 2023-10-05T11:35:13.391 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.388+0000 7f26f5634780 1 > prepared part key=_multipart_AV0XKXX1IR4B.2~A291W8CUO3N4.1 size=126292 2023-10-05T11:35:13.391 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.388+0000 7f26f5634780 1 > prepared multipart upload key=AV0XKXX1IR4B upload=A291W8CUO3N4 tag=FQDRTETYGONK type=write size=2223444 2023-10-05T11:35:13.393 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.390+0000 7f26f5634780 1 < suggested update operation key=7W9LL5HSU3BG tag=IYLSBZKEHLG0 type=del size=3166034 2023-10-05T11:35:13.394 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.391+0000 7f26f5634780 1 > prepared operation key=PC8WTJ8AYJ24 tag=UFPMHSN1FWR3 type=del size=1675906 2023-10-05T11:35:13.396 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.392+0000 7f26f5634780 1 < completed write operation key=8IPCP77WVVZT tag=H5G0IE9F7ZEV type=write size=150691 2023-10-05T11:35:13.397 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.394+0000 7f26f5634780 1 > prepared operation key=IKCNZOTVWOC6 tag=Z3MQ7XXPH5G7 type=del size=2452395 2023-10-05T11:35:13.398 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.395+0000 7f26f5634780 1 < completed write operation key=VJTFYDETLSFD tag=QLQECU9OHKIR type=write size=611403 2023-10-05T11:35:13.399 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.396+0000 7f26f5634780 1 > prepared operation key=7TOP5A52M9YP tag=JHOXLMM2ZIHH type=write size=285879 2023-10-05T11:35:13.401 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.397+0000 7f26f5634780 1 < completed part key=_multipart_NV4Q36UOLX8A.2~2RGP7ZKF8YEV.0 size=1048576 2023-10-05T11:35:13.402 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.398+0000 7f26f5634780 1 < completed part key=_multipart_NV4Q36UOLX8A.2~2RGP7ZKF8YEV.1 size=9449 2023-10-05T11:35:13.404 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.400+0000 7f26f5634780 1 < completed multipart upload key=NV4Q36UOLX8A upload=2RGP7ZKF8YEV tag=8F2F2S5OJ4EO type=write size=2106601 2023-10-05T11:35:13.406 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.402+0000 7f26f5634780 1 > prepared part key=_multipart_2D4PDQQT54ZA.2~TL08Q2UITOPB.0 size=1048576 2023-10-05T11:35:13.407 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.403+0000 7f26f5634780 1 > prepared part key=_multipart_2D4PDQQT54ZA.2~TL08Q2UITOPB.1 size=313639 2023-10-05T11:35:13.407 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.403+0000 7f26f5634780 1 > prepared multipart upload key=2D4PDQQT54ZA upload=TL08Q2UITOPB tag=33GB1MJYBSA7 type=write size=2410791 2023-10-05T11:35:13.408 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.405+0000 7f26f5634780 1 < completed write operation key=VJTFYDETLSFD tag=5AA0O6VHUGMU type=write size=960992 2023-10-05T11:35:13.410 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.407+0000 7f26f5634780 1 > prepared part key=_multipart_BTZUVE8R96XT.2~67KAO8MTK0X5.0 size=1048576 2023-10-05T11:35:13.411 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.408+0000 7f26f5634780 1 > prepared part key=_multipart_BTZUVE8R96XT.2~67KAO8MTK0X5.1 size=1048576 2023-10-05T11:35:13.412 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.409+0000 7f26f5634780 1 > prepared part key=_multipart_BTZUVE8R96XT.2~67KAO8MTK0X5.2 size=687225 2023-10-05T11:35:13.412 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.409+0000 7f26f5634780 1 > prepared multipart upload key=BTZUVE8R96XT upload=67KAO8MTK0X5 tag=93VQIANBZZNM type=write size=3832953 2023-10-05T11:35:13.412 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.409+0000 7f26f5634780 1 < canceled part key=_multipart_BTZUVE8R96XT.2~ONXI88F0RGF2.0 size=1048576 2023-10-05T11:35:13.413 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.410+0000 7f26f5634780 1 < completed part key=_multipart_BTZUVE8R96XT.2~ONXI88F0RGF2.1 size=975210 2023-10-05T11:35:13.415 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.412+0000 7f26f5634780 1 < canceled multipart upload key=BTZUVE8R96XT upload=ONXI88F0RGF2 tag=Z39YE7KC9B3K type=write size=3072362 2023-10-05T11:35:13.416 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.413+0000 7f26f5634780 1 > prepared operation key=IKCNZOTVWOC6 tag=TTVFADLX914S type=write size=1019985 2023-10-05T11:35:13.418 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.415+0000 7f26f5634780 1 < suggested update operation key=2U0NRDGDNUTA tag=2NOD4AZLYQTX type=del size=1072540 2023-10-05T11:35:13.420 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.416+0000 7f26f5634780 1 > prepared operation key=7TOP5A52M9YP tag=9R4TI19I4VEN type=write size=268484 2023-10-05T11:35:13.421 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.418+0000 7f26f5634780 1 < completed part key=_multipart_7W9LL5HSU3BG.2~84AC6O7OH8JA.0 size=522186 2023-10-05T11:35:13.423 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.420+0000 7f26f5634780 1 < completed multipart upload key=7W9LL5HSU3BG upload=84AC6O7OH8JA tag=CW3NGPC7XY3D type=write size=1570762 2023-10-05T11:35:13.426 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.422+0000 7f26f5634780 1 > prepared part key=_multipart_NV4Q36UOLX8A.2~75YGJOJJMD82.0 size=1048576 2023-10-05T11:35:13.427 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.423+0000 7f26f5634780 1 > prepared part key=_multipart_NV4Q36UOLX8A.2~75YGJOJJMD82.1 size=1048576 2023-10-05T11:35:13.428 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.424+0000 7f26f5634780 1 > prepared part key=_multipart_NV4Q36UOLX8A.2~75YGJOJJMD82.2 size=866608 2023-10-05T11:35:13.428 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.424+0000 7f26f5634780 1 > prepared multipart upload key=NV4Q36UOLX8A upload=75YGJOJJMD82 tag=J0OOZU8DMEM3 type=write size=4012336 2023-10-05T11:35:13.429 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.426+0000 7f26f5634780 1 < completed delete operation key=0PWYKC7S6YJ4 tag=QHY262Y5RVM8 type=del 2023-10-05T11:35:13.431 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.428+0000 7f26f5634780 1 > prepared part key=_multipart_BTZUVE8R96XT.2~ECECCNM4ACSO.0 size=427680 2023-10-05T11:35:13.432 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.428+0000 7f26f5634780 1 > prepared multipart upload key=BTZUVE8R96XT upload=ECECCNM4ACSO tag=97P34OCB56ZB type=write size=1476256 2023-10-05T11:35:13.433 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.430+0000 7f26f5634780 1 < completed part key=_multipart_6DP3UJ4CW1MO.2~S19AMI967HCO.0 size=147711 2023-10-05T11:35:13.435 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.432+0000 7f26f5634780 1 < completed multipart upload key=6DP3UJ4CW1MO upload=S19AMI967HCO tag=EXXVQBRSD6KL type=write size=1196287 2023-10-05T11:35:13.438 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.435+0000 7f26f5634780 1 > prepared part key=_multipart_4IBQJLJR7LD8.2~9IGD4MSQ6LOZ.0 size=1048576 2023-10-05T11:35:13.439 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.436+0000 7f26f5634780 1 > prepared part key=_multipart_4IBQJLJR7LD8.2~9IGD4MSQ6LOZ.1 size=109205 2023-10-05T11:35:13.439 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.436+0000 7f26f5634780 1 > prepared multipart upload key=4IBQJLJR7LD8 upload=9IGD4MSQ6LOZ tag=TQZDC5LR7B69 type=write size=2206357 2023-10-05T11:35:13.440 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.437+0000 7f26f5634780 1 < completed part key=_multipart_FOMNIIY47UUM.2~TUNY6UT9KEBT.0 size=1048576 2023-10-05T11:35:13.441 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.438+0000 7f26f5634780 1 < completed part key=_multipart_FOMNIIY47UUM.2~TUNY6UT9KEBT.1 size=1048576 2023-10-05T11:35:13.445 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.439+0000 7f26f5634780 1 < completed part key=_multipart_FOMNIIY47UUM.2~TUNY6UT9KEBT.2 size=230980 2023-10-05T11:35:13.445 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.441+0000 7f26f5634780 1 < completed multipart upload key=FOMNIIY47UUM upload=TUNY6UT9KEBT tag=OGT2Z2PZLJYH type=write size=3376708 2023-10-05T11:35:13.446 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.442+0000 7f26f5634780 1 > prepared operation key=2D4PDQQT54ZA tag=1201JAE5LHIO type=del size=824161 2023-10-05T11:35:13.446 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.443+0000 7f26f5634780 1 < canceled part key=_multipart_U6172JUYW7J6.2~4AZMZJI19TSQ.0 size=1048576 2023-10-05T11:35:13.447 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.444+0000 7f26f5634780 1 < completed part key=_multipart_U6172JUYW7J6.2~4AZMZJI19TSQ.1 size=907072 2023-10-05T11:35:13.449 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.446+0000 7f26f5634780 1 < canceled multipart upload key=U6172JUYW7J6 upload=4AZMZJI19TSQ tag=LWG012OJMG9I type=write size=3004224 2023-10-05T11:35:13.451 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.448+0000 7f26f5634780 1 > prepared part key=_multipart_761J2C7GHWU5.2~236MJZ4EGROT.0 size=1048576 2023-10-05T11:35:13.452 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.449+0000 7f26f5634780 1 > prepared part key=_multipart_761J2C7GHWU5.2~236MJZ4EGROT.1 size=1034172 2023-10-05T11:35:13.453 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.449+0000 7f26f5634780 1 > prepared multipart upload key=761J2C7GHWU5 upload=236MJZ4EGROT tag=YLLHVJNN4TX9 type=write size=3131324 2023-10-05T11:35:13.454 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.450+0000 7f26f5634780 1 < canceled operation key=PC8WTJ8AYJ24 tag=07OAFSXG2OI0 type=write size=467157 2023-10-05T11:35:13.455 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.452+0000 7f26f5634780 1 > prepared operation key=QYQDXVIGZ7O8 tag=68UH6OHMLAKX type=del size=2626679 2023-10-05T11:35:13.456 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.453+0000 7f26f5634780 -1 < failed to complete operation key=7W9LL5HSU3BG tag=DUJRQLFYBCBV type=del size=2159701: (22) Invalid argument 2023-10-05T11:35:13.457 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.454+0000 7f26f5634780 1 > prepared operation key=BTZUVE8R96XT tag=SZJD77KR47OZ type=del size=258399 2023-10-05T11:35:13.459 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.455+0000 7f26f5634780 1 < completed delete operation key=6DP3UJ4CW1MO tag=1ZF88UYHNQSL type=del 2023-10-05T11:35:13.461 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.458+0000 7f26f5634780 1 > prepared part key=_multipart_IKCNZOTVWOC6.2~WH6WBWDI9K3J.0 size=1048576 2023-10-05T11:35:13.462 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.459+0000 7f26f5634780 1 > prepared part key=_multipart_IKCNZOTVWOC6.2~WH6WBWDI9K3J.1 size=766525 2023-10-05T11:35:13.462 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.459+0000 7f26f5634780 1 > prepared multipart upload key=IKCNZOTVWOC6 upload=WH6WBWDI9K3J tag=L1VO3OZYGI9L type=write size=2863677 2023-10-05T11:35:13.463 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.460+0000 7f26f5634780 1 < completed part key=_multipart_AV0XKXX1IR4B.2~A291W8CUO3N4.0 size=1048576 2023-10-05T11:35:13.464 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.461+0000 7f26f5634780 1 < completed part key=_multipart_AV0XKXX1IR4B.2~A291W8CUO3N4.1 size=126292 2023-10-05T11:35:13.466 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.463+0000 7f26f5634780 1 < completed multipart upload key=AV0XKXX1IR4B upload=A291W8CUO3N4 tag=FQDRTETYGONK type=write size=2223444 2023-10-05T11:35:13.469 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.465+0000 7f26f5634780 1 > prepared part key=_multipart_FOMNIIY47UUM.2~2X9L47Q3UDI2.0 size=1048576 2023-10-05T11:35:13.470 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.466+0000 7f26f5634780 1 > prepared part key=_multipart_FOMNIIY47UUM.2~2X9L47Q3UDI2.1 size=20533 2023-10-05T11:35:13.470 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.466+0000 7f26f5634780 1 > prepared multipart upload key=FOMNIIY47UUM upload=2X9L47Q3UDI2 tag=RG1QD2KZJP7S type=write size=2117685 2023-10-05T11:35:13.472 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.469+0000 7f26f5634780 1 < suggested remove operation key=PC8WTJ8AYJ24 tag=UFPMHSN1FWR3 type=del 2023-10-05T11:35:13.474 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.471+0000 7f26f5634780 1 > prepared part key=_multipart_4IBQJLJR7LD8.2~OFGNQ6RXDAO5.0 size=1048576 2023-10-05T11:35:13.475 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.472+0000 7f26f5634780 1 > prepared part key=_multipart_4IBQJLJR7LD8.2~OFGNQ6RXDAO5.1 size=69359 2023-10-05T11:35:13.475 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.472+0000 7f26f5634780 1 > prepared multipart upload key=4IBQJLJR7LD8 upload=OFGNQ6RXDAO5 tag=EZKMSMKULBS6 type=write size=2166511 2023-10-05T11:35:13.476 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.473+0000 7f26f5634780 1 < completed delete operation key=IKCNZOTVWOC6 tag=Z3MQ7XXPH5G7 type=del 2023-10-05T11:35:13.479 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.475+0000 7f26f5634780 1 > prepared part key=_multipart_7W9LL5HSU3BG.2~MBFKMX3FZGAC.0 size=777001 2023-10-05T11:35:13.479 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.475+0000 7f26f5634780 1 > prepared multipart upload key=7W9LL5HSU3BG upload=MBFKMX3FZGAC tag=GTAPHUAML6NF type=write size=1825577 2023-10-05T11:35:13.480 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.476+0000 7f26f5634780 1 < completed write operation key=7TOP5A52M9YP tag=JHOXLMM2ZIHH type=write size=285879 2023-10-05T11:35:13.481 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.478+0000 7f26f5634780 1 > prepared operation key=MEY4SZRHU9NZ tag=OL33G4WBRLK1 type=del size=3954736 2023-10-05T11:35:13.481 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.478+0000 7f26f5634780 1 < canceled part key=_multipart_2D4PDQQT54ZA.2~TL08Q2UITOPB.0 size=1048576 2023-10-05T11:35:13.482 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.479+0000 7f26f5634780 1 < completed part key=_multipart_2D4PDQQT54ZA.2~TL08Q2UITOPB.1 size=313639 2023-10-05T11:35:13.484 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.481+0000 7f26f5634780 1 < canceled multipart upload key=2D4PDQQT54ZA upload=TL08Q2UITOPB tag=33GB1MJYBSA7 type=write size=2410791 2023-10-05T11:35:13.487 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.483+0000 7f26f5634780 1 > prepared part key=_multipart_0PWYKC7S6YJ4.2~K48KVIECK0PB.0 size=710511 2023-10-05T11:35:13.487 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.483+0000 7f26f5634780 1 > prepared multipart upload key=0PWYKC7S6YJ4 upload=K48KVIECK0PB tag=0BNZUSRGOZM6 type=write size=1759087 2023-10-05T11:35:13.487 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.484+0000 7f26f5634780 1 < canceled part key=_multipart_BTZUVE8R96XT.2~67KAO8MTK0X5.0 size=1048576 2023-10-05T11:35:13.488 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.485+0000 7f26f5634780 1 < completed part key=_multipart_BTZUVE8R96XT.2~67KAO8MTK0X5.1 size=1048576 2023-10-05T11:35:13.489 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.486+0000 7f26f5634780 1 < completed part key=_multipart_BTZUVE8R96XT.2~67KAO8MTK0X5.2 size=687225 2023-10-05T11:35:13.491 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.488+0000 7f26f5634780 1 < canceled multipart upload key=BTZUVE8R96XT upload=67KAO8MTK0X5 tag=93VQIANBZZNM type=write size=3832953 2023-10-05T11:35:13.492 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.489+0000 7f26f5634780 1 > prepared operation key=S3DKYDFT4IO2 tag=E5SWTPMFXJUP type=del size=388245 2023-10-05T11:35:13.493 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.490+0000 7f26f5634780 1 < completed write operation key=IKCNZOTVWOC6 tag=TTVFADLX914S type=write size=1019985 2023-10-05T11:35:13.495 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.491+0000 7f26f5634780 1 > prepared operation key=AV0XKXX1IR4B tag=BE5Y5NKMTV10 type=del size=1254694 2023-10-05T11:35:13.496 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.493+0000 7f26f5634780 1 < completed write operation key=7TOP5A52M9YP tag=9R4TI19I4VEN type=write size=268484 2023-10-05T11:35:13.497 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.494+0000 7f26f5634780 1 > prepared operation key=AV0XKXX1IR4B tag=485MQ0X3L3RW type=del size=3863423 2023-10-05T11:35:13.498 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.495+0000 7f26f5634780 1 < completed part key=_multipart_NV4Q36UOLX8A.2~75YGJOJJMD82.0 size=1048576 2023-10-05T11:35:13.499 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.496+0000 7f26f5634780 1 < completed part key=_multipart_NV4Q36UOLX8A.2~75YGJOJJMD82.1 size=1048576 2023-10-05T11:35:13.500 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.497+0000 7f26f5634780 1 < completed part key=_multipart_NV4Q36UOLX8A.2~75YGJOJJMD82.2 size=866608 2023-10-05T11:35:13.502 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.499+0000 7f26f5634780 1 < completed multipart upload key=NV4Q36UOLX8A upload=75YGJOJJMD82 tag=J0OOZU8DMEM3 type=write size=4012336 2023-10-05T11:35:13.504 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.501+0000 7f26f5634780 1 > prepared part key=_multipart_QYQDXVIGZ7O8.2~7HOKE9AOC1LP.0 size=1048576 2023-10-05T11:35:13.505 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.502+0000 7f26f5634780 1 > prepared part key=_multipart_QYQDXVIGZ7O8.2~7HOKE9AOC1LP.1 size=567244 2023-10-05T11:35:13.505 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.502+0000 7f26f5634780 1 > prepared multipart upload key=QYQDXVIGZ7O8 upload=7HOKE9AOC1LP tag=B2ENQYO1YHKL type=write size=2664396 2023-10-05T11:35:13.506 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.503+0000 7f26f5634780 1 < completed part key=_multipart_BTZUVE8R96XT.2~ECECCNM4ACSO.0 size=427680 2023-10-05T11:35:13.508 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.505+0000 7f26f5634780 1 < completed multipart upload key=BTZUVE8R96XT upload=ECECCNM4ACSO tag=97P34OCB56ZB type=write size=1476256 2023-10-05T11:35:13.510 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.506+0000 7f26f5634780 1 > prepared operation key=J5EIH25Y471T tag=9OPR45H74A8L type=del size=1914718 2023-10-05T11:35:13.511 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.507+0000 7f26f5634780 1 < completed part key=_multipart_4IBQJLJR7LD8.2~9IGD4MSQ6LOZ.0 size=1048576 2023-10-05T11:35:13.512 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.508+0000 7f26f5634780 1 < completed part key=_multipart_4IBQJLJR7LD8.2~9IGD4MSQ6LOZ.1 size=109205 2023-10-05T11:35:13.514 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.510+0000 7f26f5634780 1 < completed multipart upload key=4IBQJLJR7LD8 upload=9IGD4MSQ6LOZ tag=TQZDC5LR7B69 type=write size=2206357 2023-10-05T11:35:13.516 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.513+0000 7f26f5634780 1 > prepared part key=_multipart_PNV0Q6ZPLYV0.2~2K5UBYQRA169.0 size=152336 2023-10-05T11:35:13.516 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.513+0000 7f26f5634780 1 > prepared multipart upload key=PNV0Q6ZPLYV0 upload=2K5UBYQRA169 tag=RSS394JGA7ZZ type=write size=1200912 2023-10-05T11:35:13.517 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.514+0000 7f26f5634780 1 < completed delete operation key=2D4PDQQT54ZA tag=1201JAE5LHIO type=del 2023-10-05T11:35:13.518 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.515+0000 7f26f5634780 1 > prepared operation key=BTZUVE8R96XT tag=ET843WN3Z02G type=del size=219708 2023-10-05T11:35:13.520 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.516+0000 7f26f5634780 1 < completed part key=_multipart_761J2C7GHWU5.2~236MJZ4EGROT.0 size=1048576 2023-10-05T11:35:13.520 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.516+0000 7f26f5634780 1 < canceled part key=_multipart_761J2C7GHWU5.2~236MJZ4EGROT.1 size=1034172 2023-10-05T11:35:13.522 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.518+0000 7f26f5634780 1 < canceled multipart upload key=761J2C7GHWU5 upload=236MJZ4EGROT tag=YLLHVJNN4TX9 type=write size=3131324 2023-10-05T11:35:13.523 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.519+0000 7f26f5634780 1 > prepared operation key=J5EIH25Y471T tag=A67G9WWPL58W type=del size=1399344 2023-10-05T11:35:13.524 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.521+0000 7f26f5634780 1 < completed delete operation key=QYQDXVIGZ7O8 tag=68UH6OHMLAKX type=del 2023-10-05T11:35:13.525 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.522+0000 7f26f5634780 1 > prepared operation key=IC7T3ZK81WQS tag=88YFPKZIDVJK type=write size=74854 2023-10-05T11:35:13.526 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.523+0000 7f26f5634780 1 < completed delete operation key=BTZUVE8R96XT tag=SZJD77KR47OZ type=del 2023-10-05T11:35:13.528 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.525+0000 7f26f5634780 1 > prepared part key=_multipart_LLR5J3X15W5R.2~SGZQPREODIMH.0 size=682944 2023-10-05T11:35:13.529 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.525+0000 7f26f5634780 1 > prepared multipart upload key=LLR5J3X15W5R upload=SGZQPREODIMH tag=WAA7ERIWBWSB type=write size=1731520 2023-10-05T11:35:13.530 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.526+0000 7f26f5634780 1 < completed part key=_multipart_IKCNZOTVWOC6.2~WH6WBWDI9K3J.0 size=1048576 2023-10-05T11:35:13.530 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.526+0000 7f26f5634780 1 < canceled part key=_multipart_IKCNZOTVWOC6.2~WH6WBWDI9K3J.1 size=766525 2023-10-05T11:35:13.532 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.528+0000 7f26f5634780 1 < canceled multipart upload key=IKCNZOTVWOC6 upload=WH6WBWDI9K3J tag=L1VO3OZYGI9L type=write size=2863677 2023-10-05T11:35:13.533 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.529+0000 7f26f5634780 1 > prepared operation key=7W9LL5HSU3BG tag=Y8B1H33XXZ2N type=del size=612453 2023-10-05T11:35:13.534 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.531+0000 7f26f5634780 1 < completed part key=_multipart_FOMNIIY47UUM.2~2X9L47Q3UDI2.0 size=1048576 2023-10-05T11:35:13.535 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.532+0000 7f26f5634780 1 < completed part key=_multipart_FOMNIIY47UUM.2~2X9L47Q3UDI2.1 size=20533 2023-10-05T11:35:13.537 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.534+0000 7f26f5634780 1 < completed multipart upload key=FOMNIIY47UUM upload=2X9L47Q3UDI2 tag=RG1QD2KZJP7S type=write size=2117685 2023-10-05T11:35:13.538 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.535+0000 7f26f5634780 1 > prepared operation key=S3DKYDFT4IO2 tag=C2SKVTKEZ0AW type=del size=3702699 2023-10-05T11:35:13.539 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.536+0000 7f26f5634780 1 < completed part key=_multipart_4IBQJLJR7LD8.2~OFGNQ6RXDAO5.0 size=1048576 2023-10-05T11:35:13.540 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.537+0000 7f26f5634780 1 < completed part key=_multipart_4IBQJLJR7LD8.2~OFGNQ6RXDAO5.1 size=69359 2023-10-05T11:35:13.542 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.539+0000 7f26f5634780 1 < completed multipart upload key=4IBQJLJR7LD8 upload=OFGNQ6RXDAO5 tag=EZKMSMKULBS6 type=write size=2166511 2023-10-05T11:35:13.545 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.541+0000 7f26f5634780 1 > prepared part key=_multipart_FOMNIIY47UUM.2~JXFNZ5PMAZUP.0 size=1048576 2023-10-05T11:35:13.546 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.542+0000 7f26f5634780 1 > prepared part key=_multipart_FOMNIIY47UUM.2~JXFNZ5PMAZUP.1 size=1048576 2023-10-05T11:35:13.547 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.543+0000 7f26f5634780 1 > prepared part key=_multipart_FOMNIIY47UUM.2~JXFNZ5PMAZUP.2 size=937025 2023-10-05T11:35:13.547 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.543+0000 7f26f5634780 1 > prepared multipart upload key=FOMNIIY47UUM upload=JXFNZ5PMAZUP tag=829EIUBVWHZ5 type=write size=4082753 2023-10-05T11:35:13.547 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.543+0000 7f26f5634780 1 < canceled part key=_multipart_7W9LL5HSU3BG.2~MBFKMX3FZGAC.0 size=777001 2023-10-05T11:35:13.551 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.548+0000 7f26f5634780 1 < canceled multipart upload key=7W9LL5HSU3BG upload=MBFKMX3FZGAC tag=GTAPHUAML6NF type=write size=1825577 2023-10-05T11:35:13.553 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.549+0000 7f26f5634780 1 > prepared operation key=S3DKYDFT4IO2 tag=89SZTO6A97KM type=del size=650234 2023-10-05T11:35:13.554 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.551+0000 7f26f5634780 1 < completed delete operation key=MEY4SZRHU9NZ tag=OL33G4WBRLK1 type=del 2023-10-05T11:35:13.555 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.552+0000 7f26f5634780 1 > prepared operation key=BU3KSHTINB36 tag=FDJEMI66O3VB type=del size=3070468 2023-10-05T11:35:13.556 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.553+0000 7f26f5634780 1 < completed part key=_multipart_0PWYKC7S6YJ4.2~K48KVIECK0PB.0 size=710511 2023-10-05T11:35:13.558 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.555+0000 7f26f5634780 1 < completed multipart upload key=0PWYKC7S6YJ4 upload=K48KVIECK0PB tag=0BNZUSRGOZM6 type=write size=1759087 2023-10-05T11:35:13.560 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.556+0000 7f26f5634780 1 > prepared operation key=9S0YW7PPSJ8G tag=IWL5T4AN1K0K type=del size=3965715 2023-10-05T11:35:13.561 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.557+0000 7f26f5634780 1 < completed delete operation key=S3DKYDFT4IO2 tag=E5SWTPMFXJUP type=del 2023-10-05T11:35:13.563 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.560+0000 7f26f5634780 1 > prepared part key=_multipart_W2GWVGX42QLD.2~W40RIDXFJI7D.0 size=1016370 2023-10-05T11:35:13.563 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.560+0000 7f26f5634780 1 > prepared multipart upload key=W2GWVGX42QLD upload=W40RIDXFJI7D tag=QQ8E22HP98KY type=write size=2064946 2023-10-05T11:35:13.565 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.562+0000 7f26f5634780 1 < suggested remove operation key=AV0XKXX1IR4B tag=BE5Y5NKMTV10 type=del 2023-10-05T11:35:13.567 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.563+0000 7f26f5634780 1 > prepared operation key=QYQDXVIGZ7O8 tag=1EMXRDA1OVIJ type=del size=3010514 2023-10-05T11:35:13.568 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.564+0000 7f26f5634780 -1 < failed to complete operation key=AV0XKXX1IR4B tag=485MQ0X3L3RW type=del size=3863423: (22) Invalid argument 2023-10-05T11:35:13.570 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.567+0000 7f26f5634780 1 > prepared part key=_multipart_7W9LL5HSU3BG.2~M3OLV8HJ9B4Q.0 size=1048576 2023-10-05T11:35:13.571 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.568+0000 7f26f5634780 1 > prepared part key=_multipart_7W9LL5HSU3BG.2~M3OLV8HJ9B4Q.1 size=1048576 2023-10-05T11:35:13.572 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.569+0000 7f26f5634780 1 > prepared part key=_multipart_7W9LL5HSU3BG.2~M3OLV8HJ9B4Q.2 size=314504 2023-10-05T11:35:13.572 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.569+0000 7f26f5634780 1 > prepared multipart upload key=7W9LL5HSU3BG upload=M3OLV8HJ9B4Q tag=2WQ1FB3WAL0H type=write size=3460232 2023-10-05T11:35:13.573 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.570+0000 7f26f5634780 1 < completed part key=_multipart_QYQDXVIGZ7O8.2~7HOKE9AOC1LP.0 size=1048576 2023-10-05T11:35:13.574 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.571+0000 7f26f5634780 1 < completed part key=_multipart_QYQDXVIGZ7O8.2~7HOKE9AOC1LP.1 size=567244 2023-10-05T11:35:13.577 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.573+0000 7f26f5634780 1 < completed multipart upload key=QYQDXVIGZ7O8 upload=7HOKE9AOC1LP tag=B2ENQYO1YHKL type=write size=2664396 2023-10-05T11:35:13.579 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.575+0000 7f26f5634780 1 > prepared part key=_multipart_9S0YW7PPSJ8G.2~K8YA7W0KY1KK.0 size=930043 2023-10-05T11:35:13.579 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.575+0000 7f26f5634780 1 > prepared multipart upload key=9S0YW7PPSJ8G upload=K8YA7W0KY1KK tag=G5T8W2VN2B3M type=write size=1978619 2023-10-05T11:35:13.580 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.577+0000 7f26f5634780 1 < canceled operation key=J5EIH25Y471T tag=9OPR45H74A8L type=del size=1914718 2023-10-05T11:35:13.581 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.578+0000 7f26f5634780 1 > prepared operation key=0PWYKC7S6YJ4 tag=XIMZW0I9A4ZJ type=del size=3619435 2023-10-05T11:35:13.582 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.579+0000 7f26f5634780 1 < completed part key=_multipart_PNV0Q6ZPLYV0.2~2K5UBYQRA169.0 size=152336 2023-10-05T11:35:13.585 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.581+0000 7f26f5634780 1 < completed multipart upload key=PNV0Q6ZPLYV0 upload=2K5UBYQRA169 tag=RSS394JGA7ZZ type=write size=1200912 2023-10-05T11:35:13.586 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.582+0000 7f26f5634780 1 > prepared operation key=BU3KSHTINB36 tag=68857MENFNL9 type=del size=1502514 2023-10-05T11:35:13.587 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.584+0000 7f26f5634780 1 < completed delete operation key=BTZUVE8R96XT tag=ET843WN3Z02G type=del 2023-10-05T11:35:13.588 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.585+0000 7f26f5634780 1 > prepared operation key=J5EIH25Y471T tag=6VNTCTB3KJB9 type=del size=2921752 2023-10-05T11:35:13.590 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.586+0000 7f26f5634780 1 < completed delete operation key=J5EIH25Y471T tag=A67G9WWPL58W type=del 2023-10-05T11:35:13.591 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.587+0000 7f26f5634780 1 > prepared operation key=PC8WTJ8AYJ24 tag=VE7S0KO0XLMF type=del size=3217058 2023-10-05T11:35:13.592 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.589+0000 7f26f5634780 1 < completed write operation key=IC7T3ZK81WQS tag=88YFPKZIDVJK type=write size=74854 2023-10-05T11:35:13.593 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.590+0000 7f26f5634780 1 > prepared operation key=0PWYKC7S6YJ4 tag=4L27NM5MMIBR type=del size=1838194 2023-10-05T11:35:13.594 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.591+0000 7f26f5634780 1 < completed part key=_multipart_LLR5J3X15W5R.2~SGZQPREODIMH.0 size=682944 2023-10-05T11:35:13.596 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.593+0000 7f26f5634780 1 < completed multipart upload key=LLR5J3X15W5R upload=SGZQPREODIMH tag=WAA7ERIWBWSB type=write size=1731520 2023-10-05T11:35:13.598 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.594+0000 7f26f5634780 1 > prepared operation key=2D4PDQQT54ZA tag=U5HEFZS12G60 type=del size=3184896 2023-10-05T11:35:13.600 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.597+0000 7f26f5634780 1 < suggested remove operation key=7W9LL5HSU3BG tag=Y8B1H33XXZ2N type=del 2023-10-05T11:35:13.601 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.598+0000 7f26f5634780 1 > prepared operation key=AV0XKXX1IR4B tag=QX05C0PAU1OV type=del size=3326512 2023-10-05T11:35:13.603 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.599+0000 7f26f5634780 1 < completed delete operation key=S3DKYDFT4IO2 tag=C2SKVTKEZ0AW type=del 2023-10-05T11:35:13.605 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.601+0000 7f26f5634780 1 > prepared part key=_multipart_5V0Q651D4VN2.2~JX6ZZ5PERCHN.0 size=1048576 2023-10-05T11:35:13.606 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.602+0000 7f26f5634780 1 > prepared part key=_multipart_5V0Q651D4VN2.2~JX6ZZ5PERCHN.1 size=1048576 2023-10-05T11:35:13.607 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.603+0000 7f26f5634780 1 > prepared part key=_multipart_5V0Q651D4VN2.2~JX6ZZ5PERCHN.2 size=250817 2023-10-05T11:35:13.607 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.603+0000 7f26f5634780 1 > prepared multipart upload key=5V0Q651D4VN2 upload=JX6ZZ5PERCHN tag=LD32TSC9P9SP type=write size=3396545 2023-10-05T11:35:13.608 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.605+0000 7f26f5634780 1 < completed part key=_multipart_FOMNIIY47UUM.2~JXFNZ5PMAZUP.0 size=1048576 2023-10-05T11:35:13.609 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.606+0000 7f26f5634780 1 < completed part key=_multipart_FOMNIIY47UUM.2~JXFNZ5PMAZUP.1 size=1048576 2023-10-05T11:35:13.610 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.607+0000 7f26f5634780 1 < completed part key=_multipart_FOMNIIY47UUM.2~JXFNZ5PMAZUP.2 size=937025 2023-10-05T11:35:13.612 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.609+0000 7f26f5634780 1 < completed multipart upload key=FOMNIIY47UUM upload=JXFNZ5PMAZUP tag=829EIUBVWHZ5 type=write size=4082753 2023-10-05T11:35:13.613 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.610+0000 7f26f5634780 1 > prepared operation key=PNV0Q6ZPLYV0 tag=AKQNGDXT8GC0 type=del size=618895 2023-10-05T11:35:13.615 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.612+0000 7f26f5634780 1 < suggested update operation key=S3DKYDFT4IO2 tag=89SZTO6A97KM type=del size=650234 2023-10-05T11:35:13.617 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.613+0000 7f26f5634780 1 > prepared operation key=U6172JUYW7J6 tag=T60AQFCKSC48 type=del size=1637660 2023-10-05T11:35:13.618 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.615+0000 7f26f5634780 1 < completed delete operation key=BU3KSHTINB36 tag=FDJEMI66O3VB type=del 2023-10-05T11:35:13.619 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.616+0000 7f26f5634780 1 > prepared operation key=WYN9BG66LA3K tag=UXI1ZH7Y3STQ type=del size=4071959 2023-10-05T11:35:13.620 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.617+0000 7f26f5634780 1 < completed delete operation key=9S0YW7PPSJ8G tag=IWL5T4AN1K0K type=del 2023-10-05T11:35:13.622 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.619+0000 7f26f5634780 1 > prepared part key=_multipart_4IBQJLJR7LD8.2~1M8K25MZGYR0.0 size=1048576 2023-10-05T11:35:13.623 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.620+0000 7f26f5634780 1 > prepared part key=_multipart_4IBQJLJR7LD8.2~1M8K25MZGYR0.1 size=1048576 2023-10-05T11:35:13.624 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.621+0000 7f26f5634780 1 > prepared part key=_multipart_4IBQJLJR7LD8.2~1M8K25MZGYR0.2 size=854806 2023-10-05T11:35:13.624 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.621+0000 7f26f5634780 1 > prepared multipart upload key=4IBQJLJR7LD8 upload=1M8K25MZGYR0 tag=046DU6NHGYC1 type=write size=4000534 2023-10-05T11:35:13.625 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.622+0000 7f26f5634780 1 < completed part key=_multipart_W2GWVGX42QLD.2~W40RIDXFJI7D.0 size=1016370 2023-10-05T11:35:13.627 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.624+0000 7f26f5634780 1 < completed multipart upload key=W2GWVGX42QLD upload=W40RIDXFJI7D tag=QQ8E22HP98KY type=write size=2064946 2023-10-05T11:35:13.629 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.625+0000 7f26f5634780 1 > prepared operation key=W2GWVGX42QLD tag=EZHCVZXQX3WR type=del size=2533542 2023-10-05T11:35:13.630 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.627+0000 7f26f5634780 1 < completed delete operation key=QYQDXVIGZ7O8 tag=1EMXRDA1OVIJ type=del 2023-10-05T11:35:13.632 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.629+0000 7f26f5634780 1 > prepared part key=_multipart_5OPHKTHXVN5U.2~QZQJMN94HHL4.0 size=1048576 2023-10-05T11:35:13.633 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.630+0000 7f26f5634780 1 > prepared part key=_multipart_5OPHKTHXVN5U.2~QZQJMN94HHL4.1 size=1013347 2023-10-05T11:35:13.633 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.630+0000 7f26f5634780 1 > prepared multipart upload key=5OPHKTHXVN5U upload=QZQJMN94HHL4 tag=GBYRQB8NVAF0 type=write size=3110499 2023-10-05T11:35:13.635 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.631+0000 7f26f5634780 1 < completed part key=_multipart_7W9LL5HSU3BG.2~M3OLV8HJ9B4Q.0 size=1048576 2023-10-05T11:35:13.636 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.632+0000 7f26f5634780 1 < completed part key=_multipart_7W9LL5HSU3BG.2~M3OLV8HJ9B4Q.1 size=1048576 2023-10-05T11:35:13.636 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.632+0000 7f26f5634780 1 < canceled part key=_multipart_7W9LL5HSU3BG.2~M3OLV8HJ9B4Q.2 size=314504 2023-10-05T11:35:13.638 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.635+0000 7f26f5634780 1 < canceled multipart upload key=7W9LL5HSU3BG upload=M3OLV8HJ9B4Q tag=2WQ1FB3WAL0H type=write size=3460232 2023-10-05T11:35:13.639 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.636+0000 7f26f5634780 1 > prepared operation key=0PWYKC7S6YJ4 tag=7L0KC0WBLPF0 type=del size=3246132 2023-10-05T11:35:13.640 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.637+0000 7f26f5634780 1 < completed part key=_multipart_9S0YW7PPSJ8G.2~K8YA7W0KY1KK.0 size=930043 2023-10-05T11:35:13.642 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.639+0000 7f26f5634780 1 < completed multipart upload key=9S0YW7PPSJ8G upload=K8YA7W0KY1KK tag=G5T8W2VN2B3M type=write size=1978619 2023-10-05T11:35:13.645 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.641+0000 7f26f5634780 1 > prepared part key=_multipart_8IPCP77WVVZT.2~K5I209UQG2AB.0 size=486006 2023-10-05T11:35:13.645 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.641+0000 7f26f5634780 1 > prepared multipart upload key=8IPCP77WVVZT upload=K5I209UQG2AB tag=SUU0GQ8ZDGJA type=write size=1534582 2023-10-05T11:35:13.647 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.644+0000 7f26f5634780 1 < suggested remove operation key=0PWYKC7S6YJ4 tag=XIMZW0I9A4ZJ type=del 2023-10-05T11:35:13.648 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.645+0000 7f26f5634780 1 > prepared operation key=4IBQJLJR7LD8 tag=NXCZF3KR3CO5 type=del size=2114304 2023-10-05T11:35:13.649 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.646+0000 7f26f5634780 1 < completed delete operation key=BU3KSHTINB36 tag=68857MENFNL9 type=del 2023-10-05T11:35:13.651 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.647+0000 7f26f5634780 1 > prepared operation key=WYN9BG66LA3K tag=08ZSOT461ASU type=del size=4003216 2023-10-05T11:35:13.653 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.648+0000 7f26f5634780 1 < completed delete operation key=J5EIH25Y471T tag=6VNTCTB3KJB9 type=del 2023-10-05T11:35:13.654 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.650+0000 7f26f5634780 1 > prepared operation key=PNV0Q6ZPLYV0 tag=W0I6Y1IZF1QM type=del size=378749 2023-10-05T11:35:13.655 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.651+0000 7f26f5634780 1 < completed delete operation key=PC8WTJ8AYJ24 tag=VE7S0KO0XLMF type=del 2023-10-05T11:35:13.657 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.654+0000 7f26f5634780 1 > prepared part key=_multipart_761J2C7GHWU5.2~UZFB9VX1U4W6.0 size=597736 2023-10-05T11:35:13.657 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.654+0000 7f26f5634780 1 > prepared multipart upload key=761J2C7GHWU5 upload=UZFB9VX1U4W6 tag=A09YPV5JEJEL type=write size=1646312 2023-10-05T11:35:13.658 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.655+0000 7f26f5634780 -1 < failed to complete operation key=0PWYKC7S6YJ4 tag=4L27NM5MMIBR type=del size=1838194: (22) Invalid argument 2023-10-05T11:35:13.659 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.656+0000 7f26f5634780 1 > prepared operation key=NV4Q36UOLX8A tag=6GSU9YUAVE2O type=del size=220390 2023-10-05T11:35:13.661 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.657+0000 7f26f5634780 1 < completed delete operation key=2D4PDQQT54ZA tag=U5HEFZS12G60 type=del 2023-10-05T11:35:13.663 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.659+0000 7f26f5634780 1 > prepared part key=_multipart_MEY4SZRHU9NZ.2~DCMEOUYBIWPW.0 size=864350 2023-10-05T11:35:13.663 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.659+0000 7f26f5634780 1 > prepared multipart upload key=MEY4SZRHU9NZ upload=DCMEOUYBIWPW tag=PZAUAPWS0IK3 type=write size=1912926 2023-10-05T11:35:13.664 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.661+0000 7f26f5634780 1 < completed delete operation key=AV0XKXX1IR4B tag=QX05C0PAU1OV type=del 2023-10-05T11:35:13.668 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.664+0000 7f26f5634780 1 > prepared part key=_multipart_4IBQJLJR7LD8.2~7QU98EWHVK38.0 size=951000 2023-10-05T11:35:13.668 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.665+0000 7f26f5634780 1 > prepared multipart upload key=4IBQJLJR7LD8 upload=7QU98EWHVK38 tag=3UAMHVAG9ZLY type=write size=1999576 2023-10-05T11:35:13.669 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.666+0000 7f26f5634780 1 < completed part key=_multipart_5V0Q651D4VN2.2~JX6ZZ5PERCHN.0 size=1048576 2023-10-05T11:35:13.670 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.667+0000 7f26f5634780 1 < completed part key=_multipart_5V0Q651D4VN2.2~JX6ZZ5PERCHN.1 size=1048576 2023-10-05T11:35:13.671 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.668+0000 7f26f5634780 1 < completed part key=_multipart_5V0Q651D4VN2.2~JX6ZZ5PERCHN.2 size=250817 2023-10-05T11:35:13.673 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.670+0000 7f26f5634780 1 < completed multipart upload key=5V0Q651D4VN2 upload=JX6ZZ5PERCHN tag=LD32TSC9P9SP type=write size=3396545 2023-10-05T11:35:13.676 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.672+0000 7f26f5634780 1 > prepared part key=_multipart_4IBQJLJR7LD8.2~BU5O47CA5AI7.0 size=246048 2023-10-05T11:35:13.676 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.672+0000 7f26f5634780 1 > prepared multipart upload key=4IBQJLJR7LD8 upload=BU5O47CA5AI7 tag=DW7BV9V34ZLX type=write size=1294624 2023-10-05T11:35:13.677 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.673+0000 7f26f5634780 1 < completed delete operation key=PNV0Q6ZPLYV0 tag=AKQNGDXT8GC0 type=del 2023-10-05T11:35:13.679 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.676+0000 7f26f5634780 1 > prepared part key=_multipart_BTZUVE8R96XT.2~L5MY36TF3RQI.0 size=1048576 2023-10-05T11:35:13.680 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.677+0000 7f26f5634780 1 > prepared part key=_multipart_BTZUVE8R96XT.2~L5MY36TF3RQI.1 size=1048576 2023-10-05T11:35:13.681 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.678+0000 7f26f5634780 1 > prepared part key=_multipart_BTZUVE8R96XT.2~L5MY36TF3RQI.2 size=1000992 2023-10-05T11:35:13.681 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.678+0000 7f26f5634780 1 > prepared multipart upload key=BTZUVE8R96XT upload=L5MY36TF3RQI tag=6465KXHTNC4H type=write size=4146720 2023-10-05T11:35:13.682 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.679+0000 7f26f5634780 1 < completed delete operation key=U6172JUYW7J6 tag=T60AQFCKSC48 type=del 2023-10-05T11:35:13.685 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.682+0000 7f26f5634780 1 > prepared part key=_multipart_LLR5J3X15W5R.2~DPQ3WVUZGWVQ.0 size=1048576 2023-10-05T11:35:13.687 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.683+0000 7f26f5634780 1 > prepared part key=_multipart_LLR5J3X15W5R.2~DPQ3WVUZGWVQ.1 size=1048576 2023-10-05T11:35:13.687 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.684+0000 7f26f5634780 1 > prepared part key=_multipart_LLR5J3X15W5R.2~DPQ3WVUZGWVQ.2 size=942016 2023-10-05T11:35:13.688 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.684+0000 7f26f5634780 1 > prepared multipart upload key=LLR5J3X15W5R upload=DPQ3WVUZGWVQ tag=KIDBI364Q7UG type=write size=4087744 2023-10-05T11:35:13.689 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.685+0000 7f26f5634780 1 < canceled operation key=WYN9BG66LA3K tag=UXI1ZH7Y3STQ type=del size=4071959 2023-10-05T11:35:13.690 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.687+0000 7f26f5634780 1 > prepared operation key=VJTFYDETLSFD tag=TO7II7V5GSHM type=del size=3536012 2023-10-05T11:35:13.691 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.688+0000 7f26f5634780 1 < completed part key=_multipart_4IBQJLJR7LD8.2~1M8K25MZGYR0.0 size=1048576 2023-10-05T11:35:13.692 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.689+0000 7f26f5634780 1 < completed part key=_multipart_4IBQJLJR7LD8.2~1M8K25MZGYR0.1 size=1048576 2023-10-05T11:35:13.692 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.689+0000 7f26f5634780 1 < canceled part key=_multipart_4IBQJLJR7LD8.2~1M8K25MZGYR0.2 size=854806 2023-10-05T11:35:13.695 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.691+0000 7f26f5634780 1 < canceled multipart upload key=4IBQJLJR7LD8 upload=1M8K25MZGYR0 tag=046DU6NHGYC1 type=write size=4000534 2023-10-05T11:35:13.696 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.693+0000 7f26f5634780 1 > prepared part key=_multipart_MEY4SZRHU9NZ.2~VL58F5X4YZ3B.0 size=876803 2023-10-05T11:35:13.697 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.693+0000 7f26f5634780 1 > prepared multipart upload key=MEY4SZRHU9NZ upload=VL58F5X4YZ3B tag=YF4S31P819HN type=write size=1925379 2023-10-05T11:35:13.699 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.695+0000 7f26f5634780 1 < suggested update operation key=W2GWVGX42QLD tag=EZHCVZXQX3WR type=del size=2533542 2023-10-05T11:35:13.701 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.698+0000 7f26f5634780 1 > prepared part key=_multipart_7W9LL5HSU3BG.2~WVY90C63XGSM.0 size=393456 2023-10-05T11:35:13.701 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.698+0000 7f26f5634780 1 > prepared multipart upload key=7W9LL5HSU3BG upload=WVY90C63XGSM tag=D5PSDZ3PCIUN type=write size=1442032 2023-10-05T11:35:13.701 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.698+0000 7f26f5634780 1 < canceled part key=_multipart_5OPHKTHXVN5U.2~QZQJMN94HHL4.0 size=1048576 2023-10-05T11:35:13.702 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.699+0000 7f26f5634780 1 < completed part key=_multipart_5OPHKTHXVN5U.2~QZQJMN94HHL4.1 size=1013347 2023-10-05T11:35:13.704 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.701+0000 7f26f5634780 1 < canceled multipart upload key=5OPHKTHXVN5U upload=QZQJMN94HHL4 tag=GBYRQB8NVAF0 type=write size=3110499 2023-10-05T11:35:13.705 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.702+0000 7f26f5634780 1 > prepared operation key=PC8WTJ8AYJ24 tag=UL9S3AXG618G type=del size=3257788 2023-10-05T11:35:13.706 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.703+0000 7f26f5634780 -1 < failed to complete operation key=0PWYKC7S6YJ4 tag=7L0KC0WBLPF0 type=del size=3246132: (22) Invalid argument 2023-10-05T11:35:13.709 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.705+0000 7f26f5634780 1 > prepared part key=_multipart_S3DKYDFT4IO2.2~8SLI2EY45Z1G.0 size=889030 2023-10-05T11:35:13.709 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.705+0000 7f26f5634780 1 > prepared multipart upload key=S3DKYDFT4IO2 upload=8SLI2EY45Z1G tag=X0F2B0WKSVPW type=write size=1937606 2023-10-05T11:35:13.709 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.705+0000 7f26f5634780 1 < canceled part key=_multipart_8IPCP77WVVZT.2~K5I209UQG2AB.0 size=486006 2023-10-05T11:35:13.711 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.707+0000 7f26f5634780 1 < canceled multipart upload key=8IPCP77WVVZT upload=K5I209UQG2AB tag=SUU0GQ8ZDGJA type=write size=1534582 2023-10-05T11:35:13.712 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.709+0000 7f26f5634780 1 > prepared operation key=J5EIH25Y471T tag=X0LUD91L03QE type=del size=465454 2023-10-05T11:35:13.713 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.710+0000 7f26f5634780 1 < completed delete operation key=4IBQJLJR7LD8 tag=NXCZF3KR3CO5 type=del 2023-10-05T11:35:13.714 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.711+0000 7f26f5634780 1 > prepared operation key=7W9LL5HSU3BG tag=OQ40HW704P2H type=del size=2184596 2023-10-05T11:35:13.715 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.712+0000 7f26f5634780 1 < completed delete operation key=WYN9BG66LA3K tag=08ZSOT461ASU type=del 2023-10-05T11:35:13.717 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.713+0000 7f26f5634780 1 > prepared operation key=LLR5J3X15W5R tag=UHF9WVG3B3W4 type=write size=1001669 2023-10-05T11:35:13.718 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.714+0000 7f26f5634780 1 < completed delete operation key=PNV0Q6ZPLYV0 tag=W0I6Y1IZF1QM type=del 2023-10-05T11:35:13.719 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.716+0000 7f26f5634780 1 > prepared operation key=6DP3UJ4CW1MO tag=AO3F5UY86ZZC type=del size=747600 2023-10-05T11:35:13.720 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.717+0000 7f26f5634780 1 < completed part key=_multipart_761J2C7GHWU5.2~UZFB9VX1U4W6.0 size=597736 2023-10-05T11:35:13.722 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.719+0000 7f26f5634780 1 < completed multipart upload key=761J2C7GHWU5 upload=UZFB9VX1U4W6 tag=A09YPV5JEJEL type=write size=1646312 2023-10-05T11:35:13.723 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.720+0000 7f26f5634780 1 > prepared operation key=LLR5J3X15W5R tag=EDTIXZXW8O8H type=del size=392902 2023-10-05T11:35:13.725 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.721+0000 7f26f5634780 1 < completed delete operation key=NV4Q36UOLX8A tag=6GSU9YUAVE2O type=del 2023-10-05T11:35:13.727 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.724+0000 7f26f5634780 1 > prepared part key=_multipart_8IPCP77WVVZT.2~IU1TGO3MH7DV.0 size=546879 2023-10-05T11:35:13.727 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.724+0000 7f26f5634780 1 > prepared multipart upload key=8IPCP77WVVZT upload=IU1TGO3MH7DV tag=3O08TC03EX5Z type=write size=1595455 2023-10-05T11:35:13.728 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.725+0000 7f26f5634780 1 < completed part key=_multipart_MEY4SZRHU9NZ.2~DCMEOUYBIWPW.0 size=864350 2023-10-05T11:35:13.731 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.727+0000 7f26f5634780 1 < completed multipart upload key=MEY4SZRHU9NZ upload=DCMEOUYBIWPW tag=PZAUAPWS0IK3 type=write size=1912926 2023-10-05T11:35:13.733 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.730+0000 7f26f5634780 1 > prepared part key=_multipart_4IBQJLJR7LD8.2~D7XFJDYZDPYP.0 size=1048576 2023-10-05T11:35:13.734 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.731+0000 7f26f5634780 1 > prepared part key=_multipart_4IBQJLJR7LD8.2~D7XFJDYZDPYP.1 size=441813 2023-10-05T11:35:13.734 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.731+0000 7f26f5634780 1 > prepared multipart upload key=4IBQJLJR7LD8 upload=D7XFJDYZDPYP tag=IDZ8UYX3CAVC type=write size=2538965 2023-10-05T11:35:13.735 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.731+0000 7f26f5634780 1 < canceled part key=_multipart_4IBQJLJR7LD8.2~7QU98EWHVK38.0 size=951000 2023-10-05T11:35:13.737 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.733+0000 7f26f5634780 1 < canceled multipart upload key=4IBQJLJR7LD8 upload=7QU98EWHVK38 tag=3UAMHVAG9ZLY type=write size=1999576 2023-10-05T11:35:13.738 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.735+0000 7f26f5634780 1 > prepared operation key=LLR5J3X15W5R tag=28CDIBQ15ALD type=del size=3253806 2023-10-05T11:35:13.739 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.736+0000 7f26f5634780 1 < completed part key=_multipart_4IBQJLJR7LD8.2~BU5O47CA5AI7.0 size=246048 2023-10-05T11:35:13.741 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.738+0000 7f26f5634780 1 < completed multipart upload key=4IBQJLJR7LD8 upload=BU5O47CA5AI7 tag=DW7BV9V34ZLX type=write size=1294624 2023-10-05T11:35:13.743 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.740+0000 7f26f5634780 1 > prepared part key=_multipart_2D4PDQQT54ZA.2~3KC2AX33MJHJ.0 size=1048576 2023-10-05T11:35:13.745 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.741+0000 7f26f5634780 1 > prepared part key=_multipart_2D4PDQQT54ZA.2~3KC2AX33MJHJ.1 size=300154 2023-10-05T11:35:13.745 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.741+0000 7f26f5634780 1 > prepared multipart upload key=2D4PDQQT54ZA upload=3KC2AX33MJHJ tag=FFB59AZME8TD type=write size=2397306 2023-10-05T11:35:13.746 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.742+0000 7f26f5634780 1 < completed part key=_multipart_BTZUVE8R96XT.2~L5MY36TF3RQI.0 size=1048576 2023-10-05T11:35:13.747 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.743+0000 7f26f5634780 1 < completed part key=_multipart_BTZUVE8R96XT.2~L5MY36TF3RQI.1 size=1048576 2023-10-05T11:35:13.748 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.745+0000 7f26f5634780 1 < completed part key=_multipart_BTZUVE8R96XT.2~L5MY36TF3RQI.2 size=1000992 2023-10-05T11:35:13.750 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.747+0000 7f26f5634780 1 < completed multipart upload key=BTZUVE8R96XT upload=L5MY36TF3RQI tag=6465KXHTNC4H type=write size=4146720 2023-10-05T11:35:13.751 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.748+0000 7f26f5634780 1 > prepared operation key=J5EIH25Y471T tag=79X07COLMLHO type=write size=670997 2023-10-05T11:35:13.753 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.749+0000 7f26f5634780 1 < completed part key=_multipart_LLR5J3X15W5R.2~DPQ3WVUZGWVQ.0 size=1048576 2023-10-05T11:35:13.754 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.750+0000 7f26f5634780 1 < completed part key=_multipart_LLR5J3X15W5R.2~DPQ3WVUZGWVQ.1 size=1048576 2023-10-05T11:35:13.755 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.751+0000 7f26f5634780 1 < completed part key=_multipart_LLR5J3X15W5R.2~DPQ3WVUZGWVQ.2 size=942016 2023-10-05T11:35:13.757 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.754+0000 7f26f5634780 1 < completed multipart upload key=LLR5J3X15W5R upload=DPQ3WVUZGWVQ tag=KIDBI364Q7UG type=write size=4087744 2023-10-05T11:35:13.758 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.755+0000 7f26f5634780 1 > prepared operation key=AV0XKXX1IR4B tag=K9ZA6NJRJ29S type=write size=471584 2023-10-05T11:35:13.759 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.756+0000 7f26f5634780 1 < completed delete operation key=VJTFYDETLSFD tag=TO7II7V5GSHM type=del 2023-10-05T11:35:13.762 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.758+0000 7f26f5634780 1 > prepared part key=_multipart_VJTFYDETLSFD.2~P4RIUPP8026J.0 size=1048576 2023-10-05T11:35:13.763 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.759+0000 7f26f5634780 1 > prepared part key=_multipart_VJTFYDETLSFD.2~P4RIUPP8026J.1 size=1048576 2023-10-05T11:35:13.764 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.760+0000 7f26f5634780 1 > prepared part key=_multipart_VJTFYDETLSFD.2~P4RIUPP8026J.2 size=326066 2023-10-05T11:35:13.764 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.760+0000 7f26f5634780 1 > prepared multipart upload key=VJTFYDETLSFD upload=P4RIUPP8026J tag=VUXPWD3P2NL9 type=write size=3471794 2023-10-05T11:35:13.765 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.762+0000 7f26f5634780 1 < completed part key=_multipart_MEY4SZRHU9NZ.2~VL58F5X4YZ3B.0 size=876803 2023-10-05T11:35:13.767 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.764+0000 7f26f5634780 1 < completed multipart upload key=MEY4SZRHU9NZ upload=VL58F5X4YZ3B tag=YF4S31P819HN type=write size=1925379 2023-10-05T11:35:13.768 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.765+0000 7f26f5634780 1 > prepared operation key=BU3KSHTINB36 tag=FFTHHUV60H1Y type=del size=843232 2023-10-05T11:35:13.770 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.766+0000 7f26f5634780 1 < completed part key=_multipart_7W9LL5HSU3BG.2~WVY90C63XGSM.0 size=393456 2023-10-05T11:35:13.773 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.769+0000 7f26f5634780 1 < completed multipart upload key=7W9LL5HSU3BG upload=WVY90C63XGSM tag=D5PSDZ3PCIUN type=write size=1442032 2023-10-05T11:35:13.774 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.771+0000 7f26f5634780 1 > prepared operation key=S3DKYDFT4IO2 tag=SF0V7MS8RDC8 type=del size=742313 2023-10-05T11:35:13.775 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.772+0000 7f26f5634780 1 < completed delete operation key=PC8WTJ8AYJ24 tag=UL9S3AXG618G type=del 2023-10-05T11:35:13.777 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.773+0000 7f26f5634780 1 > prepared operation key=QYQDXVIGZ7O8 tag=2CCKO1UVJZ6E type=del size=1904480 2023-10-05T11:35:13.778 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.774+0000 7f26f5634780 1 < completed part key=_multipart_S3DKYDFT4IO2.2~8SLI2EY45Z1G.0 size=889030 2023-10-05T11:35:13.780 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.776+0000 7f26f5634780 1 < completed multipart upload key=S3DKYDFT4IO2 upload=8SLI2EY45Z1G tag=X0F2B0WKSVPW type=write size=1937606 2023-10-05T11:35:13.781 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.778+0000 7f26f5634780 1 > prepared operation key=5V0Q651D4VN2 tag=4S1802LUR80Q type=del size=328577 2023-10-05T11:35:13.785 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.781+0000 7f26f5634780 1 < canceled operation key=J5EIH25Y471T tag=X0LUD91L03QE type=del size=465454 2023-10-05T11:35:13.789 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.785+0000 7f26f5634780 1 > prepared part key=_multipart_FOMNIIY47UUM.2~X8JL20SY3M2O.0 size=1048576 2023-10-05T11:35:13.790 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.786+0000 7f26f5634780 1 > prepared part key=_multipart_FOMNIIY47UUM.2~X8JL20SY3M2O.1 size=691498 2023-10-05T11:35:13.790 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.786+0000 7f26f5634780 1 > prepared multipart upload key=FOMNIIY47UUM upload=X8JL20SY3M2O tag=64YY3B53Y152 type=write size=2788650 2023-10-05T11:35:13.791 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.787+0000 7f26f5634780 1 < completed delete operation key=7W9LL5HSU3BG tag=OQ40HW704P2H type=del 2023-10-05T11:35:13.792 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.789+0000 7f26f5634780 1 > prepared operation key=FOMNIIY47UUM tag=LUVNLPVZM5JO type=write size=746878 2023-10-05T11:35:13.920 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.790+0000 7f26f5634780 1 < completed write operation key=LLR5J3X15W5R tag=UHF9WVG3B3W4 type=write size=1001669 2023-10-05T11:35:13.920 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.791+0000 7f26f5634780 1 > prepared operation key=NV4Q36UOLX8A tag=BN8KQVDZGPOX type=del size=3501253 2023-10-05T11:35:13.921 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.793+0000 7f26f5634780 1 < completed delete operation key=6DP3UJ4CW1MO tag=AO3F5UY86ZZC type=del 2023-10-05T11:35:13.921 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.795+0000 7f26f5634780 1 > prepared part key=_multipart_S3DKYDFT4IO2.2~HBP31BYGD9U4.0 size=86170 2023-10-05T11:35:13.921 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.795+0000 7f26f5634780 1 > prepared multipart upload key=S3DKYDFT4IO2 upload=HBP31BYGD9U4 tag=8ABSUZX5HKLP type=write size=1134746 2023-10-05T11:35:13.921 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.797+0000 7f26f5634780 1 < suggested update operation key=LLR5J3X15W5R tag=EDTIXZXW8O8H type=del size=392902 2023-10-05T11:35:13.921 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.798+0000 7f26f5634780 1 > prepared operation key=NV4Q36UOLX8A tag=UM6B9I5GWQPS type=write size=722171 2023-10-05T11:35:13.921 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.800+0000 7f26f5634780 1 < completed part key=_multipart_8IPCP77WVVZT.2~IU1TGO3MH7DV.0 size=546879 2023-10-05T11:35:13.921 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.802+0000 7f26f5634780 1 < completed multipart upload key=8IPCP77WVVZT upload=IU1TGO3MH7DV tag=3O08TC03EX5Z type=write size=1595455 2023-10-05T11:35:13.921 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.804+0000 7f26f5634780 1 > prepared part key=_multipart_7W9LL5HSU3BG.2~YITH16UE9HBI.0 size=376787 2023-10-05T11:35:13.921 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.804+0000 7f26f5634780 1 > prepared multipart upload key=7W9LL5HSU3BG upload=YITH16UE9HBI tag=7QZJVZOXIVHQ type=write size=1425363 2023-10-05T11:35:13.921 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.805+0000 7f26f5634780 1 < completed part key=_multipart_4IBQJLJR7LD8.2~D7XFJDYZDPYP.0 size=1048576 2023-10-05T11:35:13.921 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.806+0000 7f26f5634780 1 < completed part key=_multipart_4IBQJLJR7LD8.2~D7XFJDYZDPYP.1 size=441813 2023-10-05T11:35:13.922 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.809+0000 7f26f5634780 1 < completed multipart upload key=4IBQJLJR7LD8 upload=D7XFJDYZDPYP tag=IDZ8UYX3CAVC type=write size=2538965 2023-10-05T11:35:13.922 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.811+0000 7f26f5634780 1 > prepared part key=_multipart_2D4PDQQT54ZA.2~X6POO59Z46YF.0 size=1048576 2023-10-05T11:35:13.922 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.812+0000 7f26f5634780 1 > prepared part key=_multipart_2D4PDQQT54ZA.2~X6POO59Z46YF.1 size=1048576 2023-10-05T11:35:13.922 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.813+0000 7f26f5634780 1 > prepared part key=_multipart_2D4PDQQT54ZA.2~X6POO59Z46YF.2 size=609115 2023-10-05T11:35:13.922 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.813+0000 7f26f5634780 1 > prepared multipart upload key=2D4PDQQT54ZA upload=X6POO59Z46YF tag=Q606MKJMWEVZ type=write size=3754843 2023-10-05T11:35:13.922 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.814+0000 7f26f5634780 -1 < failed to complete operation key=LLR5J3X15W5R tag=28CDIBQ15ALD type=del size=3253806: (22) Invalid argument 2023-10-05T11:35:13.922 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.815+0000 7f26f5634780 1 > prepared operation key=BTZUVE8R96XT tag=F07WBLXSFRFK type=del size=3432870 2023-10-05T11:35:13.922 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.816+0000 7f26f5634780 1 < completed part key=_multipart_2D4PDQQT54ZA.2~3KC2AX33MJHJ.0 size=1048576 2023-10-05T11:35:13.922 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.817+0000 7f26f5634780 1 < completed part key=_multipart_2D4PDQQT54ZA.2~3KC2AX33MJHJ.1 size=300154 2023-10-05T11:35:13.922 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.819+0000 7f26f5634780 1 < completed multipart upload key=2D4PDQQT54ZA upload=3KC2AX33MJHJ tag=FFB59AZME8TD type=write size=2397306 2023-10-05T11:35:13.923 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.821+0000 7f26f5634780 1 > prepared part key=_multipart_BU3KSHTINB36.2~E4RETZG24TU3.0 size=307393 2023-10-05T11:35:13.923 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.821+0000 7f26f5634780 1 > prepared multipart upload key=BU3KSHTINB36 upload=E4RETZG24TU3 tag=ZVKPWPZDKNRX type=write size=1355969 2023-10-05T11:35:13.923 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.823+0000 7f26f5634780 1 < completed write operation key=J5EIH25Y471T tag=79X07COLMLHO type=write size=670997 2023-10-05T11:35:13.923 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.824+0000 7f26f5634780 1 > prepared operation key=FOMNIIY47UUM tag=J5AZ55S4MQT0 type=del size=457672 2023-10-05T11:35:13.923 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.825+0000 7f26f5634780 1 < completed write operation key=AV0XKXX1IR4B tag=K9ZA6NJRJ29S type=write size=471584 2023-10-05T11:35:13.923 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.827+0000 7f26f5634780 1 > prepared part key=_multipart_4D3H60UTIXH3.2~17I90K3V6OOP.0 size=1048576 2023-10-05T11:35:13.923 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.828+0000 7f26f5634780 1 > prepared part key=_multipart_4D3H60UTIXH3.2~17I90K3V6OOP.1 size=554555 2023-10-05T11:35:13.923 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.828+0000 7f26f5634780 1 > prepared multipart upload key=4D3H60UTIXH3 upload=17I90K3V6OOP tag=N4KGD42WLLXP type=write size=2651707 2023-10-05T11:35:13.923 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.829+0000 7f26f5634780 1 < completed part key=_multipart_VJTFYDETLSFD.2~P4RIUPP8026J.0 size=1048576 2023-10-05T11:35:13.923 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.830+0000 7f26f5634780 1 < completed part key=_multipart_VJTFYDETLSFD.2~P4RIUPP8026J.1 size=1048576 2023-10-05T11:35:13.923 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.831+0000 7f26f5634780 1 < completed part key=_multipart_VJTFYDETLSFD.2~P4RIUPP8026J.2 size=326066 2023-10-05T11:35:13.923 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.833+0000 7f26f5634780 1 < completed multipart upload key=VJTFYDETLSFD upload=P4RIUPP8026J tag=VUXPWD3P2NL9 type=write size=3471794 2023-10-05T11:35:13.924 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.835+0000 7f26f5634780 1 > prepared part key=_multipart_WYN9BG66LA3K.2~VYTOK9LDQ23D.0 size=556308 2023-10-05T11:35:13.924 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.835+0000 7f26f5634780 1 > prepared multipart upload key=WYN9BG66LA3K upload=VYTOK9LDQ23D tag=YU89YNTDG8A3 type=write size=1604884 2023-10-05T11:35:13.924 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.837+0000 7f26f5634780 1 < completed delete operation key=BU3KSHTINB36 tag=FFTHHUV60H1Y type=del 2023-10-05T11:35:13.924 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.838+0000 7f26f5634780 1 > prepared operation key=AV0XKXX1IR4B tag=S2HF94G56ZPI type=del size=10325 2023-10-05T11:35:13.924 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.840+0000 7f26f5634780 1 < suggested remove operation key=S3DKYDFT4IO2 tag=SF0V7MS8RDC8 type=del 2023-10-05T11:35:13.924 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.842+0000 7f26f5634780 1 > prepared operation key=U6172JUYW7J6 tag=L6Q2KMJE59OA type=del size=2009554 2023-10-05T11:35:13.924 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.843+0000 7f26f5634780 1 < completed delete operation key=QYQDXVIGZ7O8 tag=2CCKO1UVJZ6E type=del 2023-10-05T11:35:13.924 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.844+0000 7f26f5634780 1 > prepared operation key=7TOP5A52M9YP tag=18F2HF73E58O type=del size=2977575 2023-10-05T11:35:13.924 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.846+0000 7f26f5634780 1 < suggested update operation key=5V0Q651D4VN2 tag=4S1802LUR80Q type=del size=328577 2023-10-05T11:35:13.924 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.849+0000 7f26f5634780 1 > prepared part key=_multipart_VJTFYDETLSFD.2~65TBBIBLYW61.0 size=1048576 2023-10-05T11:35:13.924 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.850+0000 7f26f5634780 1 > prepared part key=_multipart_VJTFYDETLSFD.2~65TBBIBLYW61.1 size=240034 2023-10-05T11:35:13.924 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.850+0000 7f26f5634780 1 > prepared multipart upload key=VJTFYDETLSFD upload=65TBBIBLYW61 tag=F37TXRRDRKRG type=write size=2337186 2023-10-05T11:35:13.925 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.850+0000 7f26f5634780 1 < canceled part key=_multipart_FOMNIIY47UUM.2~X8JL20SY3M2O.0 size=1048576 2023-10-05T11:35:13.925 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.851+0000 7f26f5634780 1 < completed part key=_multipart_FOMNIIY47UUM.2~X8JL20SY3M2O.1 size=691498 2023-10-05T11:35:13.925 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.853+0000 7f26f5634780 1 < canceled multipart upload key=FOMNIIY47UUM upload=X8JL20SY3M2O tag=64YY3B53Y152 type=write size=2788650 2023-10-05T11:35:13.925 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.855+0000 7f26f5634780 1 > prepared part key=_multipart_5V0Q651D4VN2.2~TZAUMM1P8W49.0 size=980484 2023-10-05T11:35:13.925 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.855+0000 7f26f5634780 1 > prepared multipart upload key=5V0Q651D4VN2 upload=TZAUMM1P8W49 tag=K7AUIBX0LR5L type=write size=2029060 2023-10-05T11:35:13.925 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.856+0000 7f26f5634780 1 < completed write operation key=FOMNIIY47UUM tag=LUVNLPVZM5JO type=write size=746878 2023-10-05T11:35:13.925 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.858+0000 7f26f5634780 1 > prepared operation key=S3DKYDFT4IO2 tag=G2OHE3GAT6WK type=del size=2926869 2023-10-05T11:35:13.925 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.859+0000 7f26f5634780 1 < completed delete operation key=NV4Q36UOLX8A tag=BN8KQVDZGPOX type=del 2023-10-05T11:35:13.925 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.860+0000 7f26f5634780 1 > prepared operation key=8IPCP77WVVZT tag=E9T8ST6IP75D type=del size=3110868 2023-10-05T11:35:13.925 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.861+0000 7f26f5634780 1 < completed part key=_multipart_S3DKYDFT4IO2.2~HBP31BYGD9U4.0 size=86170 2023-10-05T11:35:13.925 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.863+0000 7f26f5634780 1 < completed multipart upload key=S3DKYDFT4IO2 upload=HBP31BYGD9U4 tag=8ABSUZX5HKLP type=write size=1134746 2023-10-05T11:35:13.925 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.865+0000 7f26f5634780 1 > prepared part key=_multipart_LLR5J3X15W5R.2~Z4Q705K8IU4N.0 size=1048576 2023-10-05T11:35:13.926 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.866+0000 7f26f5634780 1 > prepared part key=_multipart_LLR5J3X15W5R.2~Z4Q705K8IU4N.1 size=1048576 2023-10-05T11:35:13.926 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.867+0000 7f26f5634780 1 > prepared part key=_multipart_LLR5J3X15W5R.2~Z4Q705K8IU4N.2 size=447357 2023-10-05T11:35:13.926 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.867+0000 7f26f5634780 1 > prepared multipart upload key=LLR5J3X15W5R upload=Z4Q705K8IU4N tag=OJGUBKXIZTAH type=write size=3593085 2023-10-05T11:35:13.926 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.869+0000 7f26f5634780 1 < completed write operation key=NV4Q36UOLX8A tag=UM6B9I5GWQPS type=write size=722171 2023-10-05T11:35:13.926 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.871+0000 7f26f5634780 1 > prepared part key=_multipart_NV4Q36UOLX8A.2~1ZT1R0GQBVEE.0 size=472980 2023-10-05T11:35:13.926 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.871+0000 7f26f5634780 1 > prepared multipart upload key=NV4Q36UOLX8A upload=1ZT1R0GQBVEE tag=VG03H19KCBI5 type=write size=1521556 2023-10-05T11:35:13.926 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.872+0000 7f26f5634780 1 < completed part key=_multipart_7W9LL5HSU3BG.2~YITH16UE9HBI.0 size=376787 2023-10-05T11:35:13.926 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.874+0000 7f26f5634780 1 < completed multipart upload key=7W9LL5HSU3BG upload=YITH16UE9HBI tag=7QZJVZOXIVHQ type=write size=1425363 2023-10-05T11:35:13.926 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.875+0000 7f26f5634780 1 > prepared operation key=7TOP5A52M9YP tag=158TTVZH6D35 type=del size=3120901 2023-10-05T11:35:13.926 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.876+0000 7f26f5634780 1 < completed part key=_multipart_2D4PDQQT54ZA.2~X6POO59Z46YF.0 size=1048576 2023-10-05T11:35:13.926 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.877+0000 7f26f5634780 1 < completed part key=_multipart_2D4PDQQT54ZA.2~X6POO59Z46YF.1 size=1048576 2023-10-05T11:35:13.927 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.878+0000 7f26f5634780 1 < completed part key=_multipart_2D4PDQQT54ZA.2~X6POO59Z46YF.2 size=609115 2023-10-05T11:35:13.927 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.880+0000 7f26f5634780 1 < completed multipart upload key=2D4PDQQT54ZA upload=X6POO59Z46YF tag=Q606MKJMWEVZ type=write size=3754843 2023-10-05T11:35:13.927 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.881+0000 7f26f5634780 1 > prepared operation key=BU3KSHTINB36 tag=QOY71Q11PYM3 type=del size=1869374 2023-10-05T11:35:13.927 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.883+0000 7f26f5634780 1 < suggested update operation key=BTZUVE8R96XT tag=F07WBLXSFRFK type=del size=3432870 2023-10-05T11:35:13.927 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.884+0000 7f26f5634780 1 > prepared operation key=9S0YW7PPSJ8G tag=KT2HZBH9QR5C type=del size=3381288 2023-10-05T11:35:13.927 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.886+0000 7f26f5634780 1 < completed part key=_multipart_BU3KSHTINB36.2~E4RETZG24TU3.0 size=307393 2023-10-05T11:35:13.927 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.888+0000 7f26f5634780 1 < completed multipart upload key=BU3KSHTINB36 upload=E4RETZG24TU3 tag=ZVKPWPZDKNRX type=write size=1355969 2023-10-05T11:35:13.927 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.890+0000 7f26f5634780 1 > prepared part key=_multipart_S3DKYDFT4IO2.2~16XLWA2NH0CY.0 size=262681 2023-10-05T11:35:13.927 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.890+0000 7f26f5634780 1 > prepared multipart upload key=S3DKYDFT4IO2 upload=16XLWA2NH0CY tag=2E1NPDRCHALU type=write size=1311257 2023-10-05T11:35:13.927 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.891+0000 7f26f5634780 1 < canceled operation key=FOMNIIY47UUM tag=J5AZ55S4MQT0 type=del size=457672 2023-10-05T11:35:13.927 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.893+0000 7f26f5634780 1 > prepared part key=_multipart_U6172JUYW7J6.2~JIN0IOIIGMEP.0 size=566229 2023-10-05T11:35:13.928 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.893+0000 7f26f5634780 1 > prepared multipart upload key=U6172JUYW7J6 upload=JIN0IOIIGMEP tag=HKEM3OFG3TFR type=write size=1614805 2023-10-05T11:35:13.928 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.893+0000 7f26f5634780 1 < canceled part key=_multipart_4D3H60UTIXH3.2~17I90K3V6OOP.0 size=1048576 2023-10-05T11:35:13.928 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.895+0000 7f26f5634780 1 < completed part key=_multipart_4D3H60UTIXH3.2~17I90K3V6OOP.1 size=554555 2023-10-05T11:35:13.928 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.899+0000 7f26f5634780 1 < canceled multipart upload key=4D3H60UTIXH3 upload=17I90K3V6OOP tag=N4KGD42WLLXP type=write size=2651707 2023-10-05T11:35:13.928 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.900+0000 7f26f5634780 1 > prepared operation key=9S0YW7PPSJ8G tag=9Q7XNU25DBAY type=del size=3623454 2023-10-05T11:35:13.928 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.901+0000 7f26f5634780 1 < completed part key=_multipart_WYN9BG66LA3K.2~VYTOK9LDQ23D.0 size=556308 2023-10-05T11:35:13.928 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.903+0000 7f26f5634780 1 < completed multipart upload key=WYN9BG66LA3K upload=VYTOK9LDQ23D tag=YU89YNTDG8A3 type=write size=1604884 2023-10-05T11:35:13.928 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.905+0000 7f26f5634780 1 > prepared operation key=2D4PDQQT54ZA tag=I32K8YPNOC18 type=write size=493028 2023-10-05T11:35:13.928 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.906+0000 7f26f5634780 1 < completed delete operation key=AV0XKXX1IR4B tag=S2HF94G56ZPI type=del 2023-10-05T11:35:13.928 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.907+0000 7f26f5634780 1 > prepared operation key=PNV0Q6ZPLYV0 tag=SLZ6G1E8NXF9 type=write size=3155 2023-10-05T11:35:13.928 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.908+0000 7f26f5634780 1 < completed delete operation key=U6172JUYW7J6 tag=L6Q2KMJE59OA type=del 2023-10-05T11:35:13.929 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.910+0000 7f26f5634780 1 > prepared operation key=8IPCP77WVVZT tag=I5BZMCG0JWYH type=write size=302931 2023-10-05T11:35:13.929 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.911+0000 7f26f5634780 1 < completed delete operation key=7TOP5A52M9YP tag=18F2HF73E58O type=del 2023-10-05T11:35:13.929 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.913+0000 7f26f5634780 1 > prepared part key=_multipart_BTZUVE8R96XT.2~KBJJ8YMEQ2QB.0 size=626526 2023-10-05T11:35:13.929 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.913+0000 7f26f5634780 1 > prepared multipart upload key=BTZUVE8R96XT upload=KBJJ8YMEQ2QB tag=C9QNLM66FH41 type=write size=1675102 2023-10-05T11:35:13.929 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.914+0000 7f26f5634780 1 < completed part key=_multipart_VJTFYDETLSFD.2~65TBBIBLYW61.0 size=1048576 2023-10-05T11:35:13.929 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.915+0000 7f26f5634780 1 < completed part key=_multipart_VJTFYDETLSFD.2~65TBBIBLYW61.1 size=240034 2023-10-05T11:35:13.930 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.917+0000 7f26f5634780 1 < completed multipart upload key=VJTFYDETLSFD upload=65TBBIBLYW61 tag=F37TXRRDRKRG type=write size=2337186 2023-10-05T11:35:13.930 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.918+0000 7f26f5634780 1 > prepared operation key=5OPHKTHXVN5U tag=FMAPDYHF1ON3 type=del size=538370 2023-10-05T11:35:13.930 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.919+0000 7f26f5634780 1 < canceled part key=_multipart_5V0Q651D4VN2.2~TZAUMM1P8W49.0 size=980484 2023-10-05T11:35:13.930 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.921+0000 7f26f5634780 1 < canceled multipart upload key=5V0Q651D4VN2 upload=TZAUMM1P8W49 tag=K7AUIBX0LR5L type=write size=2029060 2023-10-05T11:35:13.930 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.923+0000 7f26f5634780 1 > prepared part key=_multipart_W2GWVGX42QLD.2~AIY47UVA8Z1Q.0 size=1048576 2023-10-05T11:35:13.930 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.924+0000 7f26f5634780 1 > prepared part key=_multipart_W2GWVGX42QLD.2~AIY47UVA8Z1Q.1 size=1048576 2023-10-05T11:35:13.931 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.925+0000 7f26f5634780 1 > prepared part key=_multipart_W2GWVGX42QLD.2~AIY47UVA8Z1Q.2 size=549163 2023-10-05T11:35:13.931 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.925+0000 7f26f5634780 1 > prepared multipart upload key=W2GWVGX42QLD upload=AIY47UVA8Z1Q tag=EM6NEU8JUPP9 type=write size=3694891 2023-10-05T11:35:13.931 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.926+0000 7f26f5634780 1 < completed delete operation key=S3DKYDFT4IO2 tag=G2OHE3GAT6WK type=del 2023-10-05T11:35:13.931 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.927+0000 7f26f5634780 1 > prepared operation key=8IPCP77WVVZT tag=SOJZ9GJOC9T5 type=del size=4081603 2023-10-05T11:35:13.932 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.928+0000 7f26f5634780 1 < completed delete operation key=8IPCP77WVVZT tag=E9T8ST6IP75D type=del 2023-10-05T11:35:13.934 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.931+0000 7f26f5634780 1 > prepared part key=_multipart_WTCWG1C1SF89.2~3P3QUDCUC8T5.0 size=1048576 2023-10-05T11:35:13.935 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.932+0000 7f26f5634780 1 > prepared part key=_multipart_WTCWG1C1SF89.2~3P3QUDCUC8T5.1 size=1048576 2023-10-05T11:35:13.936 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.933+0000 7f26f5634780 1 > prepared part key=_multipart_WTCWG1C1SF89.2~3P3QUDCUC8T5.2 size=514465 2023-10-05T11:35:13.936 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.933+0000 7f26f5634780 1 > prepared multipart upload key=WTCWG1C1SF89 upload=3P3QUDCUC8T5 tag=YWC3L0YRAY1U type=write size=3660193 2023-10-05T11:35:13.937 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.934+0000 7f26f5634780 1 < completed part key=_multipart_LLR5J3X15W5R.2~Z4Q705K8IU4N.0 size=1048576 2023-10-05T11:35:13.938 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.935+0000 7f26f5634780 1 < completed part key=_multipart_LLR5J3X15W5R.2~Z4Q705K8IU4N.1 size=1048576 2023-10-05T11:35:13.938 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.935+0000 7f26f5634780 1 < canceled part key=_multipart_LLR5J3X15W5R.2~Z4Q705K8IU4N.2 size=447357 2023-10-05T11:35:13.940 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.937+0000 7f26f5634780 1 < canceled multipart upload key=LLR5J3X15W5R upload=Z4Q705K8IU4N tag=OJGUBKXIZTAH type=write size=3593085 2023-10-05T11:35:13.942 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.939+0000 7f26f5634780 1 > prepared part key=_multipart_4D3H60UTIXH3.2~SZ3X803OXRHG.0 size=1048576 2023-10-05T11:35:13.943 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.940+0000 7f26f5634780 1 > prepared part key=_multipart_4D3H60UTIXH3.2~SZ3X803OXRHG.1 size=1022530 2023-10-05T11:35:13.943 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.940+0000 7f26f5634780 1 > prepared multipart upload key=4D3H60UTIXH3 upload=SZ3X803OXRHG tag=QK6VGLJDX8PH type=write size=3119682 2023-10-05T11:35:13.944 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.941+0000 7f26f5634780 1 < completed part key=_multipart_NV4Q36UOLX8A.2~1ZT1R0GQBVEE.0 size=472980 2023-10-05T11:35:13.946 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.943+0000 7f26f5634780 1 < completed multipart upload key=NV4Q36UOLX8A upload=1ZT1R0GQBVEE tag=VG03H19KCBI5 type=write size=1521556 2023-10-05T11:35:13.948 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.944+0000 7f26f5634780 1 > prepared operation key=BTZUVE8R96XT tag=8P7T1OP1VO04 type=del size=2643387 2023-10-05T11:35:13.949 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.945+0000 7f26f5634780 1 < completed delete operation key=7TOP5A52M9YP tag=158TTVZH6D35 type=del 2023-10-05T11:35:13.950 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.947+0000 7f26f5634780 1 > prepared operation key=WTCWG1C1SF89 tag=6BUNLQ2XTJIL type=write size=507421 2023-10-05T11:35:13.951 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.948+0000 7f26f5634780 1 < completed delete operation key=BU3KSHTINB36 tag=QOY71Q11PYM3 type=del 2023-10-05T11:35:13.952 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.949+0000 7f26f5634780 1 > prepared operation key=LLR5J3X15W5R tag=3NFL7BO3THV7 type=del size=4098909 2023-10-05T11:35:13.954 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.950+0000 7f26f5634780 1 < completed delete operation key=9S0YW7PPSJ8G tag=KT2HZBH9QR5C type=del 2023-10-05T11:35:13.955 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.951+0000 7f26f5634780 1 > prepared operation key=W2GWVGX42QLD tag=4QIWIFO7YV99 type=del size=1753258 2023-10-05T11:35:13.956 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.953+0000 7f26f5634780 1 < completed part key=_multipart_S3DKYDFT4IO2.2~16XLWA2NH0CY.0 size=262681 2023-10-05T11:35:13.958 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.955+0000 7f26f5634780 1 < completed multipart upload key=S3DKYDFT4IO2 upload=16XLWA2NH0CY tag=2E1NPDRCHALU type=write size=1311257 2023-10-05T11:35:13.959 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.956+0000 7f26f5634780 1 > prepared operation key=VJTFYDETLSFD tag=CJ021X5G0HOE type=del size=3855878 2023-10-05T11:35:13.961 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.957+0000 7f26f5634780 1 < completed part key=_multipart_U6172JUYW7J6.2~JIN0IOIIGMEP.0 size=566229 2023-10-05T11:35:13.962 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.959+0000 7f26f5634780 1 < completed multipart upload key=U6172JUYW7J6 upload=JIN0IOIIGMEP tag=HKEM3OFG3TFR type=write size=1614805 2023-10-05T11:35:13.964 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.960+0000 7f26f5634780 1 > prepared operation key=IC7T3ZK81WQS tag=3Y70E8GGTE39 type=del size=3272879 2023-10-05T11:35:13.966 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.963+0000 7f26f5634780 1 < suggested update operation key=9S0YW7PPSJ8G tag=9Q7XNU25DBAY type=del size=3623454 2023-10-05T11:35:13.968 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.965+0000 7f26f5634780 1 > prepared part key=_multipart_4IBQJLJR7LD8.2~G5BKX2HLGHZL.0 size=17908 2023-10-05T11:35:13.968 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.965+0000 7f26f5634780 1 > prepared multipart upload key=4IBQJLJR7LD8 upload=G5BKX2HLGHZL tag=71MI0ES7GOSQ type=write size=1066484 2023-10-05T11:35:13.971 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.967+0000 7f26f5634780 1 < suggested update operation key=2D4PDQQT54ZA tag=I32K8YPNOC18 type=write size=493028 2023-10-05T11:35:13.973 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.969+0000 7f26f5634780 1 > prepared part key=_multipart_J5EIH25Y471T.2~0OG09LEBUJCO.0 size=1048576 2023-10-05T11:35:13.974 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.970+0000 7f26f5634780 1 > prepared part key=_multipart_J5EIH25Y471T.2~0OG09LEBUJCO.1 size=1048576 2023-10-05T11:35:13.975 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.971+0000 7f26f5634780 1 > prepared part key=_multipart_J5EIH25Y471T.2~0OG09LEBUJCO.2 size=102627 2023-10-05T11:35:13.975 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.971+0000 7f26f5634780 1 > prepared multipart upload key=J5EIH25Y471T upload=0OG09LEBUJCO tag=DWNPN1VSHU7O type=write size=3248355 2023-10-05T11:35:13.976 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.972+0000 7f26f5634780 1 < canceled operation key=PNV0Q6ZPLYV0 tag=SLZ6G1E8NXF9 type=write size=3155 2023-10-05T11:35:13.978 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.974+0000 7f26f5634780 1 > prepared part key=_multipart_4D3H60UTIXH3.2~3M6GMVLKIDUP.0 size=1048576 2023-10-05T11:35:13.979 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.975+0000 7f26f5634780 1 > prepared part key=_multipart_4D3H60UTIXH3.2~3M6GMVLKIDUP.1 size=1048576 2023-10-05T11:35:13.980 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.976+0000 7f26f5634780 1 > prepared part key=_multipart_4D3H60UTIXH3.2~3M6GMVLKIDUP.2 size=442084 2023-10-05T11:35:13.980 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.976+0000 7f26f5634780 1 > prepared multipart upload key=4D3H60UTIXH3 upload=3M6GMVLKIDUP tag=Q1EQ3YTX6VLV type=write size=3587812 2023-10-05T11:35:13.981 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.977+0000 7f26f5634780 1 < completed write operation key=8IPCP77WVVZT tag=I5BZMCG0JWYH type=write size=302931 2023-10-05T11:35:13.982 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.979+0000 7f26f5634780 1 > prepared operation key=7W9LL5HSU3BG tag=VT5XZ0Q70GBH type=write size=800302 2023-10-05T11:35:13.983 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.980+0000 7f26f5634780 1 < completed part key=_multipart_BTZUVE8R96XT.2~KBJJ8YMEQ2QB.0 size=626526 2023-10-05T11:35:13.985 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.982+0000 7f26f5634780 1 < completed multipart upload key=BTZUVE8R96XT upload=KBJJ8YMEQ2QB tag=C9QNLM66FH41 type=write size=1675102 2023-10-05T11:35:13.986 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.983+0000 7f26f5634780 1 > prepared operation key=J5EIH25Y471T tag=8C9JTJS6RLOO type=del size=592240 2023-10-05T11:35:13.988 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.984+0000 7f26f5634780 1 < completed delete operation key=5OPHKTHXVN5U tag=FMAPDYHF1ON3 type=del 2023-10-05T11:35:13.990 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.986+0000 7f26f5634780 1 > prepared part key=_multipart_BTZUVE8R96XT.2~L4VZFHMSPMWF.0 size=452521 2023-10-05T11:35:13.990 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.986+0000 7f26f5634780 1 > prepared multipart upload key=BTZUVE8R96XT upload=L4VZFHMSPMWF tag=2SWNUSMCQONN type=write size=1501097 2023-10-05T11:35:13.991 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.988+0000 7f26f5634780 1 < completed part key=_multipart_W2GWVGX42QLD.2~AIY47UVA8Z1Q.0 size=1048576 2023-10-05T11:35:13.992 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.989+0000 7f26f5634780 1 < completed part key=_multipart_W2GWVGX42QLD.2~AIY47UVA8Z1Q.1 size=1048576 2023-10-05T11:35:13.992 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.989+0000 7f26f5634780 1 < canceled part key=_multipart_W2GWVGX42QLD.2~AIY47UVA8Z1Q.2 size=549163 2023-10-05T11:35:13.994 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.991+0000 7f26f5634780 1 < canceled multipart upload key=W2GWVGX42QLD upload=AIY47UVA8Z1Q tag=EM6NEU8JUPP9 type=write size=3694891 2023-10-05T11:35:13.996 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.993+0000 7f26f5634780 1 > prepared part key=_multipart_U6172JUYW7J6.2~HZYJEK2EOTQ0.0 size=1048576 2023-10-05T11:35:13.997 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.994+0000 7f26f5634780 1 > prepared part key=_multipart_U6172JUYW7J6.2~HZYJEK2EOTQ0.1 size=631262 2023-10-05T11:35:13.998 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.994+0000 7f26f5634780 1 > prepared multipart upload key=U6172JUYW7J6 upload=HZYJEK2EOTQ0 tag=G6ZB9Y7K1KAU type=write size=2728414 2023-10-05T11:35:13.999 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.995+0000 7f26f5634780 1 < completed delete operation key=8IPCP77WVVZT tag=SOJZ9GJOC9T5 type=del 2023-10-05T11:35:14.000 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.997+0000 7f26f5634780 1 > prepared operation key=J5EIH25Y471T tag=A93KRXF1EUVL type=del size=895781 2023-10-05T11:35:14.001 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.998+0000 7f26f5634780 1 < completed part key=_multipart_WTCWG1C1SF89.2~3P3QUDCUC8T5.0 size=1048576 2023-10-05T11:35:14.002 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:13.999+0000 7f26f5634780 1 < completed part key=_multipart_WTCWG1C1SF89.2~3P3QUDCUC8T5.1 size=1048576 2023-10-05T11:35:14.003 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.000+0000 7f26f5634780 1 < completed part key=_multipart_WTCWG1C1SF89.2~3P3QUDCUC8T5.2 size=514465 2023-10-05T11:35:14.006 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.002+0000 7f26f5634780 1 < completed multipart upload key=WTCWG1C1SF89 upload=3P3QUDCUC8T5 tag=YWC3L0YRAY1U type=write size=3660193 2023-10-05T11:35:14.007 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.004+0000 7f26f5634780 1 > prepared operation key=2U0NRDGDNUTA tag=Z7KP2ZDMW2LW type=del size=3086849 2023-10-05T11:35:14.008 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.005+0000 7f26f5634780 1 < completed part key=_multipart_4D3H60UTIXH3.2~SZ3X803OXRHG.0 size=1048576 2023-10-05T11:35:14.009 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.006+0000 7f26f5634780 1 < completed part key=_multipart_4D3H60UTIXH3.2~SZ3X803OXRHG.1 size=1022530 2023-10-05T11:35:14.013 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.009+0000 7f26f5634780 1 < completed multipart upload key=4D3H60UTIXH3 upload=SZ3X803OXRHG tag=QK6VGLJDX8PH type=write size=3119682 2023-10-05T11:35:14.014 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.011+0000 7f26f5634780 1 > prepared operation key=5OPHKTHXVN5U tag=0FSGVJ2P0NE8 type=del size=561549 2023-10-05T11:35:14.017 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.013+0000 7f26f5634780 1 < completed delete operation key=BTZUVE8R96XT tag=8P7T1OP1VO04 type=del 2023-10-05T11:35:14.018 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.015+0000 7f26f5634780 1 > prepared operation key=5OPHKTHXVN5U tag=DESGXBOH2KX3 type=del size=1449459 2023-10-05T11:35:14.019 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.016+0000 7f26f5634780 1 < completed write operation key=WTCWG1C1SF89 tag=6BUNLQ2XTJIL type=write size=507421 2023-10-05T11:35:14.021 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.017+0000 7f26f5634780 1 > prepared operation key=PNV0Q6ZPLYV0 tag=WHQWSBLQ1LI8 type=del size=3403746 2023-10-05T11:35:14.022 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.019+0000 7f26f5634780 1 < completed delete operation key=LLR5J3X15W5R tag=3NFL7BO3THV7 type=del 2023-10-05T11:35:14.023 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.020+0000 7f26f5634780 1 > prepared operation key=QYQDXVIGZ7O8 tag=IEFFB6R8HAQG type=del size=3600244 2023-10-05T11:35:14.025 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.021+0000 7f26f5634780 1 < completed delete operation key=W2GWVGX42QLD tag=4QIWIFO7YV99 type=del 2023-10-05T11:35:14.026 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.023+0000 7f26f5634780 1 > prepared operation key=WTCWG1C1SF89 tag=6PUC6W680I4J type=del size=2324716 2023-10-05T11:35:14.028 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.025+0000 7f26f5634780 1 < suggested update operation key=VJTFYDETLSFD tag=CJ021X5G0HOE type=del size=3855878 2023-10-05T11:35:14.030 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.026+0000 7f26f5634780 1 > prepared operation key=PC8WTJ8AYJ24 tag=M8ZYWV678FHW type=del size=3142217 2023-10-05T11:35:14.031 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.028+0000 7f26f5634780 1 < completed delete operation key=IC7T3ZK81WQS tag=3Y70E8GGTE39 type=del 2023-10-05T11:35:14.032 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.029+0000 7f26f5634780 1 > prepared operation key=BU3KSHTINB36 tag=6YDBQ8APBB9B type=del size=4125753 2023-10-05T11:35:14.033 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.029+0000 7f26f5634780 1 < canceled part key=_multipart_4IBQJLJR7LD8.2~G5BKX2HLGHZL.0 size=17908 2023-10-05T11:35:14.035 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.031+0000 7f26f5634780 1 < canceled multipart upload key=4IBQJLJR7LD8 upload=G5BKX2HLGHZL tag=71MI0ES7GOSQ type=write size=1066484 2023-10-05T11:35:14.037 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.034+0000 7f26f5634780 1 > prepared part key=_multipart_BU3KSHTINB36.2~O0PB1ZV8AB4P.0 size=1048576 2023-10-05T11:35:14.038 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.035+0000 7f26f5634780 1 > prepared part key=_multipart_BU3KSHTINB36.2~O0PB1ZV8AB4P.1 size=238462 2023-10-05T11:35:14.038 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.035+0000 7f26f5634780 1 > prepared multipart upload key=BU3KSHTINB36 upload=O0PB1ZV8AB4P tag=4WG53PGO1E6L type=write size=2335614 2023-10-05T11:35:14.039 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.036+0000 7f26f5634780 1 < completed part key=_multipart_J5EIH25Y471T.2~0OG09LEBUJCO.0 size=1048576 2023-10-05T11:35:14.039 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.036+0000 7f26f5634780 1 < canceled part key=_multipart_J5EIH25Y471T.2~0OG09LEBUJCO.1 size=1048576 2023-10-05T11:35:14.040 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.037+0000 7f26f5634780 1 < completed part key=_multipart_J5EIH25Y471T.2~0OG09LEBUJCO.2 size=102627 2023-10-05T11:35:14.042 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.039+0000 7f26f5634780 1 < canceled multipart upload key=J5EIH25Y471T upload=0OG09LEBUJCO tag=DWNPN1VSHU7O type=write size=3248355 2023-10-05T11:35:14.043 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.040+0000 7f26f5634780 1 > prepared operation key=9S0YW7PPSJ8G tag=44PDKAO3WUGI type=del size=243404 2023-10-05T11:35:14.044 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.041+0000 7f26f5634780 1 < completed part key=_multipart_4D3H60UTIXH3.2~3M6GMVLKIDUP.0 size=1048576 2023-10-05T11:35:14.045 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.042+0000 7f26f5634780 1 < completed part key=_multipart_4D3H60UTIXH3.2~3M6GMVLKIDUP.1 size=1048576 2023-10-05T11:35:14.045 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.042+0000 7f26f5634780 1 < canceled part key=_multipart_4D3H60UTIXH3.2~3M6GMVLKIDUP.2 size=442084 2023-10-05T11:35:14.047 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.044+0000 7f26f5634780 1 < canceled multipart upload key=4D3H60UTIXH3 upload=3M6GMVLKIDUP tag=Q1EQ3YTX6VLV type=write size=3587812 2023-10-05T11:35:14.049 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.046+0000 7f26f5634780 1 > prepared part key=_multipart_8IPCP77WVVZT.2~4WT78CMGGN1Y.0 size=1048576 2023-10-05T11:35:14.050 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.047+0000 7f26f5634780 1 > prepared part key=_multipart_8IPCP77WVVZT.2~4WT78CMGGN1Y.1 size=1048576 2023-10-05T11:35:14.051 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.048+0000 7f26f5634780 1 > prepared part key=_multipart_8IPCP77WVVZT.2~4WT78CMGGN1Y.2 size=757962 2023-10-05T11:35:14.051 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.048+0000 7f26f5634780 1 > prepared multipart upload key=8IPCP77WVVZT upload=4WT78CMGGN1Y tag=Y2B6HGXFJ1B6 type=write size=3903690 2023-10-05T11:35:14.052 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.049+0000 7f26f5634780 1 < completed write operation key=7W9LL5HSU3BG tag=VT5XZ0Q70GBH type=write size=800302 2023-10-05T11:35:14.054 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.051+0000 7f26f5634780 1 > prepared part key=_multipart_BU3KSHTINB36.2~DINRVRTWX54Z.0 size=1048576 2023-10-05T11:35:14.055 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.052+0000 7f26f5634780 1 > prepared part key=_multipart_BU3KSHTINB36.2~DINRVRTWX54Z.1 size=637913 2023-10-05T11:35:14.055 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.052+0000 7f26f5634780 1 > prepared multipart upload key=BU3KSHTINB36 upload=DINRVRTWX54Z tag=9XQ47BQJOPV9 type=write size=2735065 2023-10-05T11:35:14.058 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.054+0000 7f26f5634780 1 < suggested remove operation key=J5EIH25Y471T tag=8C9JTJS6RLOO type=del 2023-10-05T11:35:14.060 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.056+0000 7f26f5634780 1 > prepared part key=_multipart_4IBQJLJR7LD8.2~T51GQHLDXZ1J.0 size=1048576 2023-10-05T11:35:14.061 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.057+0000 7f26f5634780 1 > prepared part key=_multipart_4IBQJLJR7LD8.2~T51GQHLDXZ1J.1 size=1009556 2023-10-05T11:35:14.061 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.057+0000 7f26f5634780 1 > prepared multipart upload key=4IBQJLJR7LD8 upload=T51GQHLDXZ1J tag=6RXYB0VGB8CY type=write size=3106708 2023-10-05T11:35:14.062 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.059+0000 7f26f5634780 1 < completed part key=_multipart_BTZUVE8R96XT.2~L4VZFHMSPMWF.0 size=452521 2023-10-05T11:35:14.064 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.061+0000 7f26f5634780 1 < completed multipart upload key=BTZUVE8R96XT upload=L4VZFHMSPMWF tag=2SWNUSMCQONN type=write size=1501097 2023-10-05T11:35:14.066 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.063+0000 7f26f5634780 1 > prepared part key=_multipart_S3DKYDFT4IO2.2~K9LVTBEKO0SK.0 size=717387 2023-10-05T11:35:14.066 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.063+0000 7f26f5634780 1 > prepared multipart upload key=S3DKYDFT4IO2 upload=K9LVTBEKO0SK tag=WM82LA0KSIYQ type=write size=1765963 2023-10-05T11:35:14.067 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.064+0000 7f26f5634780 1 < completed part key=_multipart_U6172JUYW7J6.2~HZYJEK2EOTQ0.0 size=1048576 2023-10-05T11:35:14.068 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.065+0000 7f26f5634780 1 < completed part key=_multipart_U6172JUYW7J6.2~HZYJEK2EOTQ0.1 size=631262 2023-10-05T11:35:14.071 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.067+0000 7f26f5634780 1 < completed multipart upload key=U6172JUYW7J6 upload=HZYJEK2EOTQ0 tag=G6ZB9Y7K1KAU type=write size=2728414 2023-10-05T11:35:14.072 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.068+0000 7f26f5634780 1 > prepared operation key=PC8WTJ8AYJ24 tag=612HK30VGF7U type=del size=3238643 2023-10-05T11:35:14.072 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.069+0000 7f26f5634780 -1 < no bi entry to suggest for operation key=J5EIH25Y471T tag=A93KRXF1EUVL type=del size=895781: (2) No such file or directory 2023-10-05T11:35:14.074 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.071+0000 7f26f5634780 1 > prepared part key=_multipart_MEY4SZRHU9NZ.2~82I7WS419VI7.0 size=1048576 2023-10-05T11:35:14.076 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.072+0000 7f26f5634780 1 > prepared part key=_multipart_MEY4SZRHU9NZ.2~82I7WS419VI7.1 size=471175 2023-10-05T11:35:14.076 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.072+0000 7f26f5634780 1 > prepared multipart upload key=MEY4SZRHU9NZ upload=82I7WS419VI7 tag=CO2J2AXD3JY1 type=write size=2568327 2023-10-05T11:35:14.077 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.073+0000 7f26f5634780 1 < completed delete operation key=2U0NRDGDNUTA tag=Z7KP2ZDMW2LW type=del 2023-10-05T11:35:14.079 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.076+0000 7f26f5634780 1 > prepared part key=_multipart_4D3H60UTIXH3.2~7RUCHYVGDL5R.0 size=1048576 2023-10-05T11:35:14.080 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.076+0000 7f26f5634780 1 > prepared part key=_multipart_4D3H60UTIXH3.2~7RUCHYVGDL5R.1 size=1048576 2023-10-05T11:35:14.081 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.077+0000 7f26f5634780 1 > prepared part key=_multipart_4D3H60UTIXH3.2~7RUCHYVGDL5R.2 size=715231 2023-10-05T11:35:14.081 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.077+0000 7f26f5634780 1 > prepared multipart upload key=4D3H60UTIXH3 upload=7RUCHYVGDL5R tag=JX52OLXTR7YE type=write size=3860959 2023-10-05T11:35:14.082 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.079+0000 7f26f5634780 1 < canceled operation key=5OPHKTHXVN5U tag=0FSGVJ2P0NE8 type=del size=561549 2023-10-05T11:35:14.083 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.080+0000 7f26f5634780 1 > prepared operation key=LLR5J3X15W5R tag=HD6KXT0NHRXO type=del size=2352347 2023-10-05T11:35:14.084 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.081+0000 7f26f5634780 1 < completed delete operation key=5OPHKTHXVN5U tag=DESGXBOH2KX3 type=del 2023-10-05T11:35:14.085 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.082+0000 7f26f5634780 1 > prepared operation key=QYQDXVIGZ7O8 tag=44239GPJYH3L type=del size=3410492 2023-10-05T11:35:14.087 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.083+0000 7f26f5634780 1 < completed delete operation key=PNV0Q6ZPLYV0 tag=WHQWSBLQ1LI8 type=del 2023-10-05T11:35:14.088 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.084+0000 7f26f5634780 1 > prepared operation key=QYQDXVIGZ7O8 tag=PU6BI7KM6B4T type=del size=366400 2023-10-05T11:35:14.089 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.086+0000 7f26f5634780 1 < completed delete operation key=QYQDXVIGZ7O8 tag=IEFFB6R8HAQG type=del 2023-10-05T11:35:14.091 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.088+0000 7f26f5634780 1 > prepared part key=_multipart_7W9LL5HSU3BG.2~ZNJR7MJDNLEJ.0 size=1048576 2023-10-05T11:35:14.092 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.089+0000 7f26f5634780 1 > prepared part key=_multipart_7W9LL5HSU3BG.2~ZNJR7MJDNLEJ.1 size=297344 2023-10-05T11:35:14.092 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.089+0000 7f26f5634780 1 > prepared multipart upload key=7W9LL5HSU3BG upload=ZNJR7MJDNLEJ tag=4UYDJ57129UM type=write size=2394496 2023-10-05T11:35:14.094 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.091+0000 7f26f5634780 1 < suggested remove operation key=WTCWG1C1SF89 tag=6PUC6W680I4J type=del 2023-10-05T11:35:14.096 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.093+0000 7f26f5634780 1 > prepared part key=_multipart_PNV0Q6ZPLYV0.2~AG8I90ED9N2U.0 size=1048576 2023-10-05T11:35:14.097 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.094+0000 7f26f5634780 1 > prepared part key=_multipart_PNV0Q6ZPLYV0.2~AG8I90ED9N2U.1 size=214727 2023-10-05T11:35:14.098 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.094+0000 7f26f5634780 1 > prepared multipart upload key=PNV0Q6ZPLYV0 upload=AG8I90ED9N2U tag=PRHEA867H0OB type=write size=2311879 2023-10-05T11:35:14.099 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.095+0000 7f26f5634780 1 < completed delete operation key=PC8WTJ8AYJ24 tag=M8ZYWV678FHW type=del 2023-10-05T11:35:14.100 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.097+0000 7f26f5634780 1 > prepared operation key=PNV0Q6ZPLYV0 tag=2AT38Z3D38YP type=del size=2864734 2023-10-05T11:35:14.101 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.098+0000 7f26f5634780 1 < completed delete operation key=BU3KSHTINB36 tag=6YDBQ8APBB9B type=del 2023-10-05T11:35:14.104 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.100+0000 7f26f5634780 1 > prepared part key=_multipart_S3DKYDFT4IO2.2~G1WWOC54UHQQ.0 size=736717 2023-10-05T11:35:14.104 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.100+0000 7f26f5634780 1 > prepared multipart upload key=S3DKYDFT4IO2 upload=G1WWOC54UHQQ tag=X09N0J2GMDBB type=write size=1785293 2023-10-05T11:35:14.105 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.102+0000 7f26f5634780 1 < completed part key=_multipart_BU3KSHTINB36.2~O0PB1ZV8AB4P.0 size=1048576 2023-10-05T11:35:14.106 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.103+0000 7f26f5634780 1 < completed part key=_multipart_BU3KSHTINB36.2~O0PB1ZV8AB4P.1 size=238462 2023-10-05T11:35:14.108 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.105+0000 7f26f5634780 1 < completed multipart upload key=BU3KSHTINB36 upload=O0PB1ZV8AB4P tag=4WG53PGO1E6L type=write size=2335614 2023-10-05T11:35:14.110 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.107+0000 7f26f5634780 1 > prepared part key=_multipart_PNV0Q6ZPLYV0.2~RFNZQ3Q78EGN.0 size=1048576 2023-10-05T11:35:14.111 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.108+0000 7f26f5634780 1 > prepared part key=_multipart_PNV0Q6ZPLYV0.2~RFNZQ3Q78EGN.1 size=1048576 2023-10-05T11:35:14.112 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.109+0000 7f26f5634780 1 > prepared part key=_multipart_PNV0Q6ZPLYV0.2~RFNZQ3Q78EGN.2 size=247522 2023-10-05T11:35:14.112 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.109+0000 7f26f5634780 1 > prepared multipart upload key=PNV0Q6ZPLYV0 upload=RFNZQ3Q78EGN tag=J36U820I9URU type=write size=3393250 2023-10-05T11:35:14.114 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.110+0000 7f26f5634780 1 < completed delete operation key=9S0YW7PPSJ8G tag=44PDKAO3WUGI type=del 2023-10-05T11:35:14.115 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.111+0000 7f26f5634780 1 > prepared operation key=761J2C7GHWU5 tag=ANPEEJTO4Q50 type=del size=3198132 2023-10-05T11:35:14.116 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.112+0000 7f26f5634780 1 < completed part key=_multipart_8IPCP77WVVZT.2~4WT78CMGGN1Y.0 size=1048576 2023-10-05T11:35:14.117 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.113+0000 7f26f5634780 1 < completed part key=_multipart_8IPCP77WVVZT.2~4WT78CMGGN1Y.1 size=1048576 2023-10-05T11:35:14.118 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.114+0000 7f26f5634780 1 < completed part key=_multipart_8IPCP77WVVZT.2~4WT78CMGGN1Y.2 size=757962 2023-10-05T11:35:14.120 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.116+0000 7f26f5634780 1 < completed multipart upload key=8IPCP77WVVZT upload=4WT78CMGGN1Y tag=Y2B6HGXFJ1B6 type=write size=3903690 2023-10-05T11:35:14.121 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.118+0000 7f26f5634780 1 > prepared operation key=IKCNZOTVWOC6 tag=1YTNMEG6TVPX type=write size=814669 2023-10-05T11:35:14.121 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.118+0000 7f26f5634780 1 < canceled part key=_multipart_BU3KSHTINB36.2~DINRVRTWX54Z.0 size=1048576 2023-10-05T11:35:14.122 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.119+0000 7f26f5634780 1 < completed part key=_multipart_BU3KSHTINB36.2~DINRVRTWX54Z.1 size=637913 2023-10-05T11:35:14.124 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.121+0000 7f26f5634780 1 < canceled multipart upload key=BU3KSHTINB36 upload=DINRVRTWX54Z tag=9XQ47BQJOPV9 type=write size=2735065 2023-10-05T11:35:14.125 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.122+0000 7f26f5634780 1 > prepared operation key=IKCNZOTVWOC6 tag=W9018TK9RQ96 type=write size=970227 2023-10-05T11:35:14.128 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.125+0000 7f26f5634780 1 < completed part key=_multipart_4IBQJLJR7LD8.2~T51GQHLDXZ1J.0 size=1048576 2023-10-05T11:35:14.129 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.126+0000 7f26f5634780 1 < completed part key=_multipart_4IBQJLJR7LD8.2~T51GQHLDXZ1J.1 size=1009556 2023-10-05T11:35:14.131 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.128+0000 7f26f5634780 1 < completed multipart upload key=4IBQJLJR7LD8 upload=T51GQHLDXZ1J tag=6RXYB0VGB8CY type=write size=3106708 2023-10-05T11:35:14.134 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.130+0000 7f26f5634780 1 > prepared part key=_multipart_4IBQJLJR7LD8.2~47XDMY3I5RGG.0 size=1048576 2023-10-05T11:35:14.135 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.131+0000 7f26f5634780 1 > prepared part key=_multipart_4IBQJLJR7LD8.2~47XDMY3I5RGG.1 size=1048576 2023-10-05T11:35:14.135 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.132+0000 7f26f5634780 1 > prepared part key=_multipart_4IBQJLJR7LD8.2~47XDMY3I5RGG.2 size=769605 2023-10-05T11:35:14.136 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.132+0000 7f26f5634780 1 > prepared multipart upload key=4IBQJLJR7LD8 upload=47XDMY3I5RGG tag=0THK60S7Z2QR type=write size=3915333 2023-10-05T11:35:14.137 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.133+0000 7f26f5634780 1 < completed part key=_multipart_S3DKYDFT4IO2.2~K9LVTBEKO0SK.0 size=717387 2023-10-05T11:35:14.138 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.135+0000 7f26f5634780 1 < completed multipart upload key=S3DKYDFT4IO2 upload=K9LVTBEKO0SK tag=WM82LA0KSIYQ type=write size=1765963 2023-10-05T11:35:14.140 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.136+0000 7f26f5634780 1 > prepared operation key=VJTFYDETLSFD tag=M9S20OZ6Y48B type=del size=105605 2023-10-05T11:35:14.141 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.138+0000 7f26f5634780 1 < completed delete operation key=PC8WTJ8AYJ24 tag=612HK30VGF7U type=del 2023-10-05T11:35:14.142 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.139+0000 7f26f5634780 1 > prepared operation key=VJTFYDETLSFD tag=4WZ9OTDJ3SLZ type=write size=679235 2023-10-05T11:35:14.143 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.140+0000 7f26f5634780 1 < completed part key=_multipart_MEY4SZRHU9NZ.2~82I7WS419VI7.0 size=1048576 2023-10-05T11:35:14.144 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.141+0000 7f26f5634780 1 < completed part key=_multipart_MEY4SZRHU9NZ.2~82I7WS419VI7.1 size=471175 2023-10-05T11:35:14.147 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.143+0000 7f26f5634780 1 < completed multipart upload key=MEY4SZRHU9NZ upload=82I7WS419VI7 tag=CO2J2AXD3JY1 type=write size=2568327 2023-10-05T11:35:14.149 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.146+0000 7f26f5634780 1 > prepared part key=_multipart_5OPHKTHXVN5U.2~S10WYI5Q2Q58.0 size=1048576 2023-10-05T11:35:14.150 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.147+0000 7f26f5634780 1 > prepared part key=_multipart_5OPHKTHXVN5U.2~S10WYI5Q2Q58.1 size=528544 2023-10-05T11:35:14.150 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.147+0000 7f26f5634780 1 > prepared multipart upload key=5OPHKTHXVN5U upload=S10WYI5Q2Q58 tag=NEBC91VFUK1U type=write size=2625696 2023-10-05T11:35:14.151 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.148+0000 7f26f5634780 1 < completed part key=_multipart_4D3H60UTIXH3.2~7RUCHYVGDL5R.0 size=1048576 2023-10-05T11:35:14.152 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.148+0000 7f26f5634780 1 < canceled part key=_multipart_4D3H60UTIXH3.2~7RUCHYVGDL5R.1 size=1048576 2023-10-05T11:35:14.153 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.149+0000 7f26f5634780 1 < completed part key=_multipart_4D3H60UTIXH3.2~7RUCHYVGDL5R.2 size=715231 2023-10-05T11:35:14.155 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.151+0000 7f26f5634780 1 < canceled multipart upload key=4D3H60UTIXH3 upload=7RUCHYVGDL5R tag=JX52OLXTR7YE type=write size=3860959 2023-10-05T11:35:14.156 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.153+0000 7f26f5634780 1 > prepared operation key=4D3H60UTIXH3 tag=3CI89CMBKXBP type=del size=3950576 2023-10-05T11:35:14.157 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.154+0000 7f26f5634780 1 < completed delete operation key=LLR5J3X15W5R tag=HD6KXT0NHRXO type=del 2023-10-05T11:35:14.158 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.155+0000 7f26f5634780 1 > prepared operation key=4IBQJLJR7LD8 tag=O14P4XXQWRYW type=del size=707025 2023-10-05T11:35:14.160 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.157+0000 7f26f5634780 1 < completed delete operation key=QYQDXVIGZ7O8 tag=44239GPJYH3L type=del 2023-10-05T11:35:14.161 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.158+0000 7f26f5634780 1 > prepared operation key=U6172JUYW7J6 tag=O4TL66IS0FL2 type=del size=863351 2023-10-05T11:35:14.162 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.159+0000 7f26f5634780 1 < completed delete operation key=QYQDXVIGZ7O8 tag=PU6BI7KM6B4T type=del 2023-10-05T11:35:14.164 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.160+0000 7f26f5634780 1 > prepared operation key=PNV0Q6ZPLYV0 tag=VWF0WT8MRFIH type=del size=2436744 2023-10-05T11:35:14.165 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.162+0000 7f26f5634780 1 < completed part key=_multipart_7W9LL5HSU3BG.2~ZNJR7MJDNLEJ.0 size=1048576 2023-10-05T11:35:14.165 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.162+0000 7f26f5634780 1 < canceled part key=_multipart_7W9LL5HSU3BG.2~ZNJR7MJDNLEJ.1 size=297344 2023-10-05T11:35:14.167 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.164+0000 7f26f5634780 1 < canceled multipart upload key=7W9LL5HSU3BG upload=ZNJR7MJDNLEJ tag=4UYDJ57129UM type=write size=2394496 2023-10-05T11:35:14.169 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.166+0000 7f26f5634780 1 > prepared part key=_multipart_QYQDXVIGZ7O8.2~NB18NL0NSMAC.0 size=824065 2023-10-05T11:35:14.169 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.166+0000 7f26f5634780 1 > prepared multipart upload key=QYQDXVIGZ7O8 upload=NB18NL0NSMAC tag=JZ1WRDOUUQS0 type=write size=1872641 2023-10-05T11:35:14.170 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.167+0000 7f26f5634780 1 < completed part key=_multipart_PNV0Q6ZPLYV0.2~AG8I90ED9N2U.0 size=1048576 2023-10-05T11:35:14.171 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.168+0000 7f26f5634780 1 < completed part key=_multipart_PNV0Q6ZPLYV0.2~AG8I90ED9N2U.1 size=214727 2023-10-05T11:35:14.174 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.170+0000 7f26f5634780 1 < completed multipart upload key=PNV0Q6ZPLYV0 upload=AG8I90ED9N2U tag=PRHEA867H0OB type=write size=2311879 2023-10-05T11:35:14.176 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.172+0000 7f26f5634780 1 > prepared part key=_multipart_WTCWG1C1SF89.2~TDST64TFRNUE.0 size=1048576 2023-10-05T11:35:14.177 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.173+0000 7f26f5634780 1 > prepared part key=_multipart_WTCWG1C1SF89.2~TDST64TFRNUE.1 size=683280 2023-10-05T11:35:14.177 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.173+0000 7f26f5634780 1 > prepared multipart upload key=WTCWG1C1SF89 upload=TDST64TFRNUE tag=CFEVUVYZ7DM3 type=write size=2780432 2023-10-05T11:35:14.178 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.175+0000 7f26f5634780 1 < completed delete operation key=PNV0Q6ZPLYV0 tag=2AT38Z3D38YP type=del 2023-10-05T11:35:14.180 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.176+0000 7f26f5634780 1 > prepared operation key=BU3KSHTINB36 tag=JWJICS5V4PBV type=del size=417603 2023-10-05T11:35:14.181 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.177+0000 7f26f5634780 1 < completed part key=_multipart_S3DKYDFT4IO2.2~G1WWOC54UHQQ.0 size=736717 2023-10-05T11:35:14.183 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.179+0000 7f26f5634780 1 < completed multipart upload key=S3DKYDFT4IO2 upload=G1WWOC54UHQQ tag=X09N0J2GMDBB type=write size=1785293 2023-10-05T11:35:14.185 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.182+0000 7f26f5634780 1 > prepared part key=_multipart_8IPCP77WVVZT.2~UDDK7A46FNAC.0 size=811821 2023-10-05T11:35:14.185 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.182+0000 7f26f5634780 1 > prepared multipart upload key=8IPCP77WVVZT upload=UDDK7A46FNAC tag=YJ5PM467LVXV type=write size=1860397 2023-10-05T11:35:14.186 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.183+0000 7f26f5634780 1 < completed part key=_multipart_PNV0Q6ZPLYV0.2~RFNZQ3Q78EGN.0 size=1048576 2023-10-05T11:35:14.187 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.184+0000 7f26f5634780 1 < completed part key=_multipart_PNV0Q6ZPLYV0.2~RFNZQ3Q78EGN.1 size=1048576 2023-10-05T11:35:14.188 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.185+0000 7f26f5634780 1 < completed part key=_multipart_PNV0Q6ZPLYV0.2~RFNZQ3Q78EGN.2 size=247522 2023-10-05T11:35:14.190 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.187+0000 7f26f5634780 1 < completed multipart upload key=PNV0Q6ZPLYV0 upload=RFNZQ3Q78EGN tag=J36U820I9URU type=write size=3393250 2023-10-05T11:35:14.193 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.189+0000 7f26f5634780 1 > prepared part key=_multipart_4IBQJLJR7LD8.2~GF0E90SI3V03.0 size=129997 2023-10-05T11:35:14.193 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.189+0000 7f26f5634780 1 > prepared multipart upload key=4IBQJLJR7LD8 upload=GF0E90SI3V03 tag=62T84RXHNQAA type=write size=1178573 2023-10-05T11:35:14.194 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.191+0000 7f26f5634780 1 < completed delete operation key=761J2C7GHWU5 tag=ANPEEJTO4Q50 type=del 2023-10-05T11:35:14.195 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.192+0000 7f26f5634780 1 > prepared operation key=2D4PDQQT54ZA tag=GP2ZF9IXOHRR type=del size=3754293 2023-10-05T11:35:14.196 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.193+0000 7f26f5634780 1 < completed write operation key=IKCNZOTVWOC6 tag=1YTNMEG6TVPX type=write size=814669 2023-10-05T11:35:14.197 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.194+0000 7f26f5634780 1 > prepared operation key=QYQDXVIGZ7O8 tag=7537A43W3XSN type=del size=1743921 2023-10-05T11:35:14.199 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.195+0000 7f26f5634780 1 < completed write operation key=IKCNZOTVWOC6 tag=W9018TK9RQ96 type=write size=970227 2023-10-05T11:35:14.200 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.197+0000 7f26f5634780 1 > prepared operation key=S3DKYDFT4IO2 tag=L69XWKGSZT4I type=del size=3894152 2023-10-05T11:35:14.201 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.198+0000 7f26f5634780 1 < completed part key=_multipart_4IBQJLJR7LD8.2~47XDMY3I5RGG.0 size=1048576 2023-10-05T11:35:14.202 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.199+0000 7f26f5634780 1 < completed part key=_multipart_4IBQJLJR7LD8.2~47XDMY3I5RGG.1 size=1048576 2023-10-05T11:35:14.203 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.200+0000 7f26f5634780 1 < completed part key=_multipart_4IBQJLJR7LD8.2~47XDMY3I5RGG.2 size=769605 2023-10-05T11:35:14.205 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.202+0000 7f26f5634780 1 < completed multipart upload key=4IBQJLJR7LD8 upload=47XDMY3I5RGG tag=0THK60S7Z2QR type=write size=3915333 2023-10-05T11:35:14.206 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.203+0000 7f26f5634780 1 > prepared operation key=BTZUVE8R96XT tag=7F0PWEZWT7F3 type=del size=1406258 2023-10-05T11:35:14.208 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.204+0000 7f26f5634780 1 < canceled operation key=VJTFYDETLSFD tag=M9S20OZ6Y48B type=del size=105605 2023-10-05T11:35:14.209 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.205+0000 7f26f5634780 1 > prepared operation key=5OPHKTHXVN5U tag=4S9IBSH0S4ZT type=del size=2286769 2023-10-05T11:35:14.210 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.206+0000 7f26f5634780 1 < completed write operation key=VJTFYDETLSFD tag=4WZ9OTDJ3SLZ type=write size=679235 2023-10-05T11:35:14.212 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.208+0000 7f26f5634780 1 > prepared part key=_multipart_LLR5J3X15W5R.2~OPU75XU4ALJ6.0 size=1048576 2023-10-05T11:35:14.213 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.209+0000 7f26f5634780 1 > prepared part key=_multipart_LLR5J3X15W5R.2~OPU75XU4ALJ6.1 size=851488 2023-10-05T11:35:14.213 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.209+0000 7f26f5634780 1 > prepared multipart upload key=LLR5J3X15W5R upload=OPU75XU4ALJ6 tag=0FW561SR2IKO type=write size=2948640 2023-10-05T11:35:14.214 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.211+0000 7f26f5634780 1 < completed part key=_multipart_5OPHKTHXVN5U.2~S10WYI5Q2Q58.0 size=1048576 2023-10-05T11:35:14.215 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.212+0000 7f26f5634780 1 < completed part key=_multipart_5OPHKTHXVN5U.2~S10WYI5Q2Q58.1 size=528544 2023-10-05T11:35:14.217 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.214+0000 7f26f5634780 1 < completed multipart upload key=5OPHKTHXVN5U upload=S10WYI5Q2Q58 tag=NEBC91VFUK1U type=write size=2625696 2023-10-05T11:35:14.218 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.215+0000 7f26f5634780 1 > prepared operation key=W2GWVGX42QLD tag=D72G4SBW1CAQ type=del size=3738095 2023-10-05T11:35:14.220 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.216+0000 7f26f5634780 1 < completed delete operation key=4D3H60UTIXH3 tag=3CI89CMBKXBP type=del 2023-10-05T11:35:14.222 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.219+0000 7f26f5634780 1 > prepared part key=_multipart_PC8WTJ8AYJ24.2~OZDQBMIVOM0H.0 size=1048576 2023-10-05T11:35:14.223 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.220+0000 7f26f5634780 1 > prepared part key=_multipart_PC8WTJ8AYJ24.2~OZDQBMIVOM0H.1 size=1048576 2023-10-05T11:35:14.224 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.221+0000 7f26f5634780 1 > prepared part key=_multipart_PC8WTJ8AYJ24.2~OZDQBMIVOM0H.2 size=872064 2023-10-05T11:35:14.224 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.221+0000 7f26f5634780 1 > prepared multipart upload key=PC8WTJ8AYJ24 upload=OZDQBMIVOM0H tag=A4MCYKGO19Y7 type=write size=4017792 2023-10-05T11:35:14.227 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.223+0000 7f26f5634780 1 < suggested remove operation key=4IBQJLJR7LD8 tag=O14P4XXQWRYW type=del 2023-10-05T11:35:14.229 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.226+0000 7f26f5634780 1 > prepared part key=_multipart_VJTFYDETLSFD.2~GIHO1QPVIL7K.0 size=1048576 2023-10-05T11:35:14.230 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.227+0000 7f26f5634780 1 > prepared part key=_multipart_VJTFYDETLSFD.2~GIHO1QPVIL7K.1 size=1048576 2023-10-05T11:35:14.231 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.228+0000 7f26f5634780 1 > prepared part key=_multipart_VJTFYDETLSFD.2~GIHO1QPVIL7K.2 size=277251 2023-10-05T11:35:14.231 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.228+0000 7f26f5634780 1 > prepared multipart upload key=VJTFYDETLSFD upload=GIHO1QPVIL7K tag=2J7DX8K7VO5G type=write size=3422979 2023-10-05T11:35:14.232 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.229+0000 7f26f5634780 1 < completed delete operation key=U6172JUYW7J6 tag=O4TL66IS0FL2 type=del 2023-10-05T11:35:14.233 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.230+0000 7f26f5634780 1 > prepared operation key=WTCWG1C1SF89 tag=ZUM1RPGJA40T type=del size=1736153 2023-10-05T11:35:14.235 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.231+0000 7f26f5634780 1 < completed delete operation key=PNV0Q6ZPLYV0 tag=VWF0WT8MRFIH type=del 2023-10-05T11:35:14.236 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.233+0000 7f26f5634780 1 > prepared operation key=2D4PDQQT54ZA tag=CSGG88LXLUWU type=del size=3171071 2023-10-05T11:35:14.237 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.234+0000 7f26f5634780 1 < completed part key=_multipart_QYQDXVIGZ7O8.2~NB18NL0NSMAC.0 size=824065 2023-10-05T11:35:14.239 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.236+0000 7f26f5634780 1 < completed multipart upload key=QYQDXVIGZ7O8 upload=NB18NL0NSMAC tag=JZ1WRDOUUQS0 type=write size=1872641 2023-10-05T11:35:14.241 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.237+0000 7f26f5634780 1 > prepared operation key=VJTFYDETLSFD tag=X005IML36SA2 type=del size=1746447 2023-10-05T11:35:14.243 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.240+0000 7f26f5634780 1 < completed part key=_multipart_WTCWG1C1SF89.2~TDST64TFRNUE.0 size=1048576 2023-10-05T11:35:14.244 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.241+0000 7f26f5634780 1 < completed part key=_multipart_WTCWG1C1SF89.2~TDST64TFRNUE.1 size=683280 2023-10-05T11:35:14.246 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.243+0000 7f26f5634780 1 < completed multipart upload key=WTCWG1C1SF89 upload=TDST64TFRNUE tag=CFEVUVYZ7DM3 type=write size=2780432 2023-10-05T11:35:14.248 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.245+0000 7f26f5634780 1 > prepared part key=_multipart_6DP3UJ4CW1MO.2~C70A5RK1FZE4.0 size=1048576 2023-10-05T11:35:14.249 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.246+0000 7f26f5634780 1 > prepared part key=_multipart_6DP3UJ4CW1MO.2~C70A5RK1FZE4.1 size=93 2023-10-05T11:35:14.249 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.246+0000 7f26f5634780 1 > prepared multipart upload key=6DP3UJ4CW1MO upload=C70A5RK1FZE4 tag=KWRGTD55IR1O type=write size=2097245 2023-10-05T11:35:14.250 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.247+0000 7f26f5634780 1 < completed delete operation key=BU3KSHTINB36 tag=JWJICS5V4PBV type=del 2023-10-05T11:35:14.252 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.248+0000 7f26f5634780 1 > prepared operation key=5OPHKTHXVN5U tag=JRVVDTJ0EUQ3 type=write size=94867 2023-10-05T11:35:14.253 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.249+0000 7f26f5634780 1 < completed part key=_multipart_8IPCP77WVVZT.2~UDDK7A46FNAC.0 size=811821 2023-10-05T11:35:14.255 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.252+0000 7f26f5634780 1 < completed multipart upload key=8IPCP77WVVZT upload=UDDK7A46FNAC tag=YJ5PM467LVXV type=write size=1860397 2023-10-05T11:35:14.256 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.253+0000 7f26f5634780 1 > prepared operation key=7TOP5A52M9YP tag=PK4GXI4YUZ0E type=del size=2438465 2023-10-05T11:35:14.256 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.253+0000 7f26f5634780 1 < canceled part key=_multipart_4IBQJLJR7LD8.2~GF0E90SI3V03.0 size=129997 2023-10-05T11:35:14.258 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.255+0000 7f26f5634780 1 < canceled multipart upload key=4IBQJLJR7LD8 upload=GF0E90SI3V03 tag=62T84RXHNQAA type=write size=1178573 2023-10-05T11:35:14.260 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.257+0000 7f26f5634780 1 > prepared part key=_multipart_FOMNIIY47UUM.2~R4RJNFTEFU5Q.0 size=1048576 2023-10-05T11:35:14.261 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.258+0000 7f26f5634780 1 > prepared part key=_multipart_FOMNIIY47UUM.2~R4RJNFTEFU5Q.1 size=1048576 2023-10-05T11:35:14.262 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.259+0000 7f26f5634780 1 > prepared part key=_multipart_FOMNIIY47UUM.2~R4RJNFTEFU5Q.2 size=1028013 2023-10-05T11:35:14.262 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.259+0000 7f26f5634780 1 > prepared multipart upload key=FOMNIIY47UUM upload=R4RJNFTEFU5Q tag=HDU3JAQNQ111 type=write size=4173741 2023-10-05T11:35:14.264 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.260+0000 7f26f5634780 1 < completed delete operation key=2D4PDQQT54ZA tag=GP2ZF9IXOHRR type=del 2023-10-05T11:35:14.265 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.261+0000 7f26f5634780 1 > prepared operation key=NV4Q36UOLX8A tag=10CBU2DOEFA7 type=del size=2215149 2023-10-05T11:35:14.266 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.263+0000 7f26f5634780 1 < completed delete operation key=QYQDXVIGZ7O8 tag=7537A43W3XSN type=del 2023-10-05T11:35:14.268 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.265+0000 7f26f5634780 1 > prepared part key=_multipart_6DP3UJ4CW1MO.2~XDGQM5WST5J9.0 size=221799 2023-10-05T11:35:14.268 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.265+0000 7f26f5634780 1 > prepared multipart upload key=6DP3UJ4CW1MO upload=XDGQM5WST5J9 tag=D7PHB8X7DPO5 type=write size=1270375 2023-10-05T11:35:14.269 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.266+0000 7f26f5634780 1 < completed delete operation key=S3DKYDFT4IO2 tag=L69XWKGSZT4I type=del 2023-10-05T11:35:14.271 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.268+0000 7f26f5634780 1 > prepared part key=_multipart_7TOP5A52M9YP.2~VHUE1UU5ON96.0 size=901237 2023-10-05T11:35:14.272 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.268+0000 7f26f5634780 1 > prepared multipart upload key=7TOP5A52M9YP upload=VHUE1UU5ON96 tag=5QZ47S7WPEWY type=write size=1949813 2023-10-05T11:35:14.273 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.269+0000 7f26f5634780 1 < completed delete operation key=BTZUVE8R96XT tag=7F0PWEZWT7F3 type=del 2023-10-05T11:35:14.274 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.270+0000 7f26f5634780 1 > prepared operation key=2D4PDQQT54ZA tag=G7HSD38MJOZE type=del size=3829629 2023-10-05T11:35:14.275 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.272+0000 7f26f5634780 1 < completed delete operation key=5OPHKTHXVN5U tag=4S9IBSH0S4ZT type=del 2023-10-05T11:35:14.276 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.273+0000 7f26f5634780 1 > prepared operation key=8IPCP77WVVZT tag=LMN96U8DMGK1 type=del size=602915 2023-10-05T11:35:14.277 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.274+0000 7f26f5634780 1 < completed part key=_multipart_LLR5J3X15W5R.2~OPU75XU4ALJ6.0 size=1048576 2023-10-05T11:35:14.278 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.275+0000 7f26f5634780 1 < completed part key=_multipart_LLR5J3X15W5R.2~OPU75XU4ALJ6.1 size=851488 2023-10-05T11:35:14.280 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.277+0000 7f26f5634780 1 < completed multipart upload key=LLR5J3X15W5R upload=OPU75XU4ALJ6 tag=0FW561SR2IKO type=write size=2948640 2023-10-05T11:35:14.282 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.279+0000 7f26f5634780 1 > prepared part key=_multipart_4D3H60UTIXH3.2~20LUON27BZ2K.0 size=1048576 2023-10-05T11:35:14.283 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.280+0000 7f26f5634780 1 > prepared part key=_multipart_4D3H60UTIXH3.2~20LUON27BZ2K.1 size=124122 2023-10-05T11:35:14.283 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.280+0000 7f26f5634780 1 > prepared multipart upload key=4D3H60UTIXH3 upload=20LUON27BZ2K tag=72NT8GCQ4ZVA type=write size=2221274 2023-10-05T11:35:14.284 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.281+0000 7f26f5634780 1 < completed delete operation key=W2GWVGX42QLD tag=D72G4SBW1CAQ type=del 2023-10-05T11:35:14.285 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.282+0000 7f26f5634780 1 > prepared operation key=2U0NRDGDNUTA tag=3VJ9V1NV6N5F type=del size=2486323 2023-10-05T11:35:14.286 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.283+0000 7f26f5634780 1 < completed part key=_multipart_PC8WTJ8AYJ24.2~OZDQBMIVOM0H.0 size=1048576 2023-10-05T11:35:14.287 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.284+0000 7f26f5634780 1 < completed part key=_multipart_PC8WTJ8AYJ24.2~OZDQBMIVOM0H.1 size=1048576 2023-10-05T11:35:14.288 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.285+0000 7f26f5634780 1 < completed part key=_multipart_PC8WTJ8AYJ24.2~OZDQBMIVOM0H.2 size=872064 2023-10-05T11:35:14.290 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.287+0000 7f26f5634780 1 < completed multipart upload key=PC8WTJ8AYJ24 upload=OZDQBMIVOM0H tag=A4MCYKGO19Y7 type=write size=4017792 2023-10-05T11:35:14.291 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.288+0000 7f26f5634780 1 > prepared operation key=MEY4SZRHU9NZ tag=Z3JTURG1V0G7 type=del size=4128368 2023-10-05T11:35:14.292 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.289+0000 7f26f5634780 1 < completed part key=_multipart_VJTFYDETLSFD.2~GIHO1QPVIL7K.0 size=1048576 2023-10-05T11:35:14.293 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.290+0000 7f26f5634780 1 < completed part key=_multipart_VJTFYDETLSFD.2~GIHO1QPVIL7K.1 size=1048576 2023-10-05T11:35:14.294 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.291+0000 7f26f5634780 1 < completed part key=_multipart_VJTFYDETLSFD.2~GIHO1QPVIL7K.2 size=277251 2023-10-05T11:35:14.296 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.293+0000 7f26f5634780 1 < completed multipart upload key=VJTFYDETLSFD upload=GIHO1QPVIL7K tag=2J7DX8K7VO5G type=write size=3422979 2023-10-05T11:35:14.299 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.295+0000 7f26f5634780 1 > prepared part key=_multipart_W2GWVGX42QLD.2~E5Q6KEFZ2J4H.0 size=1048576 2023-10-05T11:35:14.300 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.296+0000 7f26f5634780 1 > prepared part key=_multipart_W2GWVGX42QLD.2~E5Q6KEFZ2J4H.1 size=1048576 2023-10-05T11:35:14.301 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.297+0000 7f26f5634780 1 > prepared part key=_multipart_W2GWVGX42QLD.2~E5Q6KEFZ2J4H.2 size=165141 2023-10-05T11:35:14.301 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.297+0000 7f26f5634780 1 > prepared multipart upload key=W2GWVGX42QLD upload=E5Q6KEFZ2J4H tag=NFN86GK1VB7X type=write size=3310869 2023-10-05T11:35:14.302 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.299+0000 7f26f5634780 1 < canceled operation key=WTCWG1C1SF89 tag=ZUM1RPGJA40T type=del size=1736153 2023-10-05T11:35:14.304 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.300+0000 7f26f5634780 1 > prepared operation key=5V0Q651D4VN2 tag=SOY36PIMIZZS type=del size=1865941 2023-10-05T11:35:14.305 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.302+0000 7f26f5634780 1 < completed delete operation key=2D4PDQQT54ZA tag=CSGG88LXLUWU type=del 2023-10-05T11:35:14.307 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.303+0000 7f26f5634780 1 > prepared operation key=761J2C7GHWU5 tag=I90DGTROWI62 type=del size=2204410 2023-10-05T11:35:14.308 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.305+0000 7f26f5634780 1 < canceled operation key=VJTFYDETLSFD tag=X005IML36SA2 type=del size=1746447 2023-10-05T11:35:14.310 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.306+0000 7f26f5634780 1 > prepared operation key=PNV0Q6ZPLYV0 tag=XT766Q35KVTP type=del size=2067104 2023-10-05T11:35:14.311 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.308+0000 7f26f5634780 1 < completed part key=_multipart_6DP3UJ4CW1MO.2~C70A5RK1FZE4.0 size=1048576 2023-10-05T11:35:14.312 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.309+0000 7f26f5634780 1 < completed part key=_multipart_6DP3UJ4CW1MO.2~C70A5RK1FZE4.1 size=93 2023-10-05T11:35:14.314 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.311+0000 7f26f5634780 1 < completed multipart upload key=6DP3UJ4CW1MO upload=C70A5RK1FZE4 tag=KWRGTD55IR1O type=write size=2097245 2023-10-05T11:35:14.316 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.313+0000 7f26f5634780 1 > prepared part key=_multipart_0PWYKC7S6YJ4.2~LDH72PZWFWE1.0 size=465365 2023-10-05T11:35:14.317 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.313+0000 7f26f5634780 1 > prepared multipart upload key=0PWYKC7S6YJ4 upload=LDH72PZWFWE1 tag=SLSBVV80SLH6 type=write size=1513941 2023-10-05T11:35:14.318 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.314+0000 7f26f5634780 1 < completed write operation key=5OPHKTHXVN5U tag=JRVVDTJ0EUQ3 type=write size=94867 2023-10-05T11:35:14.319 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.316+0000 7f26f5634780 1 > prepared operation key=761J2C7GHWU5 tag=GL0CEBLRY1Z5 type=del size=2286856 2023-10-05T11:35:14.320 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.317+0000 7f26f5634780 1 < completed delete operation key=7TOP5A52M9YP tag=PK4GXI4YUZ0E type=del 2023-10-05T11:35:14.322 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.318+0000 7f26f5634780 1 > prepared operation key=761J2C7GHWU5 tag=87PRU5Z4XD7X type=del size=3165432 2023-10-05T11:35:14.323 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.320+0000 7f26f5634780 1 < completed part key=_multipart_FOMNIIY47UUM.2~R4RJNFTEFU5Q.0 size=1048576 2023-10-05T11:35:14.324 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.321+0000 7f26f5634780 1 < completed part key=_multipart_FOMNIIY47UUM.2~R4RJNFTEFU5Q.1 size=1048576 2023-10-05T11:35:14.325 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.322+0000 7f26f5634780 1 < completed part key=_multipart_FOMNIIY47UUM.2~R4RJNFTEFU5Q.2 size=1028013 2023-10-05T11:35:14.328 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.324+0000 7f26f5634780 1 < completed multipart upload key=FOMNIIY47UUM upload=R4RJNFTEFU5Q tag=HDU3JAQNQ111 type=write size=4173741 2023-10-05T11:35:14.329 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.326+0000 7f26f5634780 1 > prepared operation key=BU3KSHTINB36 tag=VG7590BNW1V5 type=del size=3330725 2023-10-05T11:35:14.331 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.327+0000 7f26f5634780 1 < completed delete operation key=NV4Q36UOLX8A tag=10CBU2DOEFA7 type=del 2023-10-05T11:35:14.332 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.328+0000 7f26f5634780 1 > prepared operation key=QYQDXVIGZ7O8 tag=VE0DSSR1JMQS type=del size=3321448 2023-10-05T11:35:14.333 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.330+0000 7f26f5634780 1 < completed part key=_multipart_6DP3UJ4CW1MO.2~XDGQM5WST5J9.0 size=221799 2023-10-05T11:35:14.335 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.332+0000 7f26f5634780 1 < completed multipart upload key=6DP3UJ4CW1MO upload=XDGQM5WST5J9 tag=D7PHB8X7DPO5 type=write size=1270375 2023-10-05T11:35:14.338 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.334+0000 7f26f5634780 1 > prepared part key=_multipart_S3DKYDFT4IO2.2~AH4PNGDK303J.0 size=1048576 2023-10-05T11:35:14.339 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.335+0000 7f26f5634780 1 > prepared part key=_multipart_S3DKYDFT4IO2.2~AH4PNGDK303J.1 size=1048576 2023-10-05T11:35:14.340 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.336+0000 7f26f5634780 1 > prepared part key=_multipart_S3DKYDFT4IO2.2~AH4PNGDK303J.2 size=667878 2023-10-05T11:35:14.340 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.336+0000 7f26f5634780 1 > prepared multipart upload key=S3DKYDFT4IO2 upload=AH4PNGDK303J tag=AAER8QNRCT1Z type=write size=3813606 2023-10-05T11:35:14.341 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.337+0000 7f26f5634780 1 < completed part key=_multipart_7TOP5A52M9YP.2~VHUE1UU5ON96.0 size=901237 2023-10-05T11:35:14.343 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.340+0000 7f26f5634780 1 < completed multipart upload key=7TOP5A52M9YP upload=VHUE1UU5ON96 tag=5QZ47S7WPEWY type=write size=1949813 2023-10-05T11:35:14.345 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.341+0000 7f26f5634780 1 > prepared operation key=MEY4SZRHU9NZ tag=OW6ETPVKZQWH type=del size=3252360 2023-10-05T11:35:14.346 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.343+0000 7f26f5634780 1 < canceled operation key=2D4PDQQT54ZA tag=G7HSD38MJOZE type=del size=3829629 2023-10-05T11:35:14.349 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.345+0000 7f26f5634780 1 > prepared part key=_multipart_2U0NRDGDNUTA.2~CSFKWHA7TFB1.0 size=1016125 2023-10-05T11:35:14.349 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.345+0000 7f26f5634780 1 > prepared multipart upload key=2U0NRDGDNUTA upload=CSFKWHA7TFB1 tag=ILZ300HCMZNR type=write size=2064701 2023-10-05T11:35:14.350 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.347+0000 7f26f5634780 1 < completed delete operation key=8IPCP77WVVZT tag=LMN96U8DMGK1 type=del 2023-10-05T11:35:14.352 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.348+0000 7f26f5634780 1 > prepared operation key=2D4PDQQT54ZA tag=YK16BD1J6UHV type=write size=1007707 2023-10-05T11:35:14.352 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.348+0000 7f26f5634780 1 < canceled part key=_multipart_4D3H60UTIXH3.2~20LUON27BZ2K.0 size=1048576 2023-10-05T11:35:14.354 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.351+0000 7f26f5634780 1 < completed part key=_multipart_4D3H60UTIXH3.2~20LUON27BZ2K.1 size=124122 2023-10-05T11:35:14.357 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.353+0000 7f26f5634780 1 < canceled multipart upload key=4D3H60UTIXH3 upload=20LUON27BZ2K tag=72NT8GCQ4ZVA type=write size=2221274 2023-10-05T11:35:14.359 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.356+0000 7f26f5634780 1 > prepared part key=_multipart_WTCWG1C1SF89.2~LI26IMEGB4QG.0 size=1048576 2023-10-05T11:35:14.362 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.358+0000 7f26f5634780 1 > prepared part key=_multipart_WTCWG1C1SF89.2~LI26IMEGB4QG.1 size=1048576 2023-10-05T11:35:14.363 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.359+0000 7f26f5634780 1 > prepared part key=_multipart_WTCWG1C1SF89.2~LI26IMEGB4QG.2 size=876027 2023-10-05T11:35:14.363 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.359+0000 7f26f5634780 1 > prepared multipart upload key=WTCWG1C1SF89 upload=LI26IMEGB4QG tag=3B37K6JKHUAV type=write size=4021755 2023-10-05T11:35:14.364 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.361+0000 7f26f5634780 1 < canceled operation key=2U0NRDGDNUTA tag=3VJ9V1NV6N5F type=del size=2486323 2023-10-05T11:35:14.366 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.362+0000 7f26f5634780 1 > prepared operation key=IC7T3ZK81WQS tag=8OISPFK7WF2B type=del size=2118855 2023-10-05T11:35:14.367 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.364+0000 7f26f5634780 1 < completed delete operation key=MEY4SZRHU9NZ tag=Z3JTURG1V0G7 type=del 2023-10-05T11:35:14.369 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.366+0000 7f26f5634780 1 > prepared part key=_multipart_VJTFYDETLSFD.2~5R0I6O5JSAR9.0 size=1048576 2023-10-05T11:35:14.370 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.367+0000 7f26f5634780 1 > prepared part key=_multipart_VJTFYDETLSFD.2~5R0I6O5JSAR9.1 size=1048576 2023-10-05T11:35:14.371 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.368+0000 7f26f5634780 1 > prepared part key=_multipart_VJTFYDETLSFD.2~5R0I6O5JSAR9.2 size=19049 2023-10-05T11:35:14.371 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.368+0000 7f26f5634780 1 > prepared multipart upload key=VJTFYDETLSFD upload=5R0I6O5JSAR9 tag=ML7833Z67YJY type=write size=3164777 2023-10-05T11:35:14.372 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.369+0000 7f26f5634780 1 < completed part key=_multipart_W2GWVGX42QLD.2~E5Q6KEFZ2J4H.0 size=1048576 2023-10-05T11:35:14.373 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.370+0000 7f26f5634780 1 < completed part key=_multipart_W2GWVGX42QLD.2~E5Q6KEFZ2J4H.1 size=1048576 2023-10-05T11:35:14.374 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.370+0000 7f26f5634780 1 < canceled part key=_multipart_W2GWVGX42QLD.2~E5Q6KEFZ2J4H.2 size=165141 2023-10-05T11:35:14.375 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.372+0000 7f26f5634780 1 < canceled multipart upload key=W2GWVGX42QLD upload=E5Q6KEFZ2J4H tag=NFN86GK1VB7X type=write size=3310869 2023-10-05T11:35:14.377 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.373+0000 7f26f5634780 1 > prepared operation key=7TOP5A52M9YP tag=4DACAP3DIPIL type=del size=2662566 2023-10-05T11:35:14.378 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.374+0000 7f26f5634780 1 < completed delete operation key=5V0Q651D4VN2 tag=SOY36PIMIZZS type=del 2023-10-05T11:35:14.380 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.376+0000 7f26f5634780 1 > prepared part key=_multipart_U6172JUYW7J6.2~HK2A9FE0MO2Y.0 size=445719 2023-10-05T11:35:14.380 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.376+0000 7f26f5634780 1 > prepared multipart upload key=U6172JUYW7J6 upload=HK2A9FE0MO2Y tag=69MB8WOMU2DN type=write size=1494295 2023-10-05T11:35:14.381 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.378+0000 7f26f5634780 1 < canceled operation key=761J2C7GHWU5 tag=I90DGTROWI62 type=del size=2204410 2023-10-05T11:35:14.383 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.380+0000 7f26f5634780 1 > prepared part key=_multipart_BU3KSHTINB36.2~WNPRJUMV33JV.0 size=1048576 2023-10-05T11:35:14.384 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.381+0000 7f26f5634780 1 > prepared part key=_multipart_BU3KSHTINB36.2~WNPRJUMV33JV.1 size=393573 2023-10-05T11:35:14.384 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.381+0000 7f26f5634780 1 > prepared multipart upload key=BU3KSHTINB36 upload=WNPRJUMV33JV tag=H1D1F2UMYNXK type=write size=2490725 2023-10-05T11:35:14.385 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.382+0000 7f26f5634780 1 < canceled operation key=PNV0Q6ZPLYV0 tag=XT766Q35KVTP type=del size=2067104 2023-10-05T11:35:14.387 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.384+0000 7f26f5634780 1 > prepared part key=_multipart_BTZUVE8R96XT.2~KY80AWV8OWR6.0 size=1048576 2023-10-05T11:35:14.388 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.385+0000 7f26f5634780 1 > prepared part key=_multipart_BTZUVE8R96XT.2~KY80AWV8OWR6.1 size=549507 2023-10-05T11:35:14.388 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.385+0000 7f26f5634780 1 > prepared multipart upload key=BTZUVE8R96XT upload=KY80AWV8OWR6 tag=6AIDNP1UBJGP type=write size=2646659 2023-10-05T11:35:14.390 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.386+0000 7f26f5634780 1 < completed part key=_multipart_0PWYKC7S6YJ4.2~LDH72PZWFWE1.0 size=465365 2023-10-05T11:35:14.392 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.388+0000 7f26f5634780 1 < completed multipart upload key=0PWYKC7S6YJ4 upload=LDH72PZWFWE1 tag=SLSBVV80SLH6 type=write size=1513941 2023-10-05T11:35:14.393 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.390+0000 7f26f5634780 1 > prepared part key=_multipart_9S0YW7PPSJ8G.2~RRIF5CXC65XY.0 size=1048576 2023-10-05T11:35:14.394 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.391+0000 7f26f5634780 1 > prepared part key=_multipart_9S0YW7PPSJ8G.2~RRIF5CXC65XY.1 size=1048576 2023-10-05T11:35:14.395 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.392+0000 7f26f5634780 1 > prepared part key=_multipart_9S0YW7PPSJ8G.2~RRIF5CXC65XY.2 size=260489 2023-10-05T11:35:14.395 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.392+0000 7f26f5634780 1 > prepared multipart upload key=9S0YW7PPSJ8G upload=RRIF5CXC65XY tag=7DHNDHERZ53B type=write size=3406217 2023-10-05T11:35:14.396 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.393+0000 7f26f5634780 1 < completed delete operation key=761J2C7GHWU5 tag=GL0CEBLRY1Z5 type=del 2023-10-05T11:35:14.398 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.394+0000 7f26f5634780 1 > prepared operation key=NV4Q36UOLX8A tag=NH5TB7I1Z47Z type=del size=894584 2023-10-05T11:35:14.399 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.395+0000 7f26f5634780 1 < completed delete operation key=761J2C7GHWU5 tag=87PRU5Z4XD7X type=del 2023-10-05T11:35:14.401 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.397+0000 7f26f5634780 1 > prepared part key=_multipart_W2GWVGX42QLD.2~M0X23GL32DYD.0 size=1048576 2023-10-05T11:35:14.402 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.398+0000 7f26f5634780 1 > prepared part key=_multipart_W2GWVGX42QLD.2~M0X23GL32DYD.1 size=1040533 2023-10-05T11:35:14.402 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.398+0000 7f26f5634780 1 > prepared multipart upload key=W2GWVGX42QLD upload=M0X23GL32DYD tag=7FT0X3HSWNO2 type=write size=3137685 2023-10-05T11:35:14.403 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.400+0000 7f26f5634780 1 < completed delete operation key=BU3KSHTINB36 tag=VG7590BNW1V5 type=del 2023-10-05T11:35:14.405 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.402+0000 7f26f5634780 1 > prepared part key=_multipart_4D3H60UTIXH3.2~3BF1W21KE1BZ.0 size=1048576 2023-10-05T11:35:14.406 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.403+0000 7f26f5634780 1 > prepared part key=_multipart_4D3H60UTIXH3.2~3BF1W21KE1BZ.1 size=1048576 2023-10-05T11:35:14.407 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.404+0000 7f26f5634780 1 > prepared part key=_multipart_4D3H60UTIXH3.2~3BF1W21KE1BZ.2 size=545655 2023-10-05T11:35:14.407 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.404+0000 7f26f5634780 1 > prepared multipart upload key=4D3H60UTIXH3 upload=3BF1W21KE1BZ tag=JUUDIHQX4H2Y type=write size=3691383 2023-10-05T11:35:14.409 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.405+0000 7f26f5634780 1 < completed delete operation key=QYQDXVIGZ7O8 tag=VE0DSSR1JMQS type=del 2023-10-05T11:35:14.410 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.406+0000 7f26f5634780 1 > prepared operation key=AV0XKXX1IR4B tag=L6ZLN7V0ZVW1 type=del size=2246915 2023-10-05T11:35:14.410 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.406+0000 7f26f5634780 1 < canceled part key=_multipart_S3DKYDFT4IO2.2~AH4PNGDK303J.0 size=1048576 2023-10-05T11:35:14.411 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.408+0000 7f26f5634780 1 < completed part key=_multipart_S3DKYDFT4IO2.2~AH4PNGDK303J.1 size=1048576 2023-10-05T11:35:14.412 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.408+0000 7f26f5634780 1 < completed part key=_multipart_S3DKYDFT4IO2.2~AH4PNGDK303J.2 size=667878 2023-10-05T11:35:14.414 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.410+0000 7f26f5634780 1 < canceled multipart upload key=S3DKYDFT4IO2 upload=AH4PNGDK303J tag=AAER8QNRCT1Z type=write size=3813606 2023-10-05T11:35:14.415 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.412+0000 7f26f5634780 1 > prepared operation key=J5EIH25Y471T tag=9ABRIRTFJWOD type=del size=2745124 2023-10-05T11:35:14.416 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.413+0000 7f26f5634780 1 < completed delete operation key=MEY4SZRHU9NZ tag=OW6ETPVKZQWH type=del 2023-10-05T11:35:14.418 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.414+0000 7f26f5634780 1 > prepared operation key=J5EIH25Y471T tag=Q0IYVAISQWD2 type=write size=559320 2023-10-05T11:35:14.419 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.415+0000 7f26f5634780 1 < completed part key=_multipart_2U0NRDGDNUTA.2~CSFKWHA7TFB1.0 size=1016125 2023-10-05T11:35:14.421 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.417+0000 7f26f5634780 1 < completed multipart upload key=2U0NRDGDNUTA upload=CSFKWHA7TFB1 tag=ILZ300HCMZNR type=write size=2064701 2023-10-05T11:35:14.423 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.420+0000 7f26f5634780 1 > prepared part key=_multipart_W2GWVGX42QLD.2~4JP5BETCINM5.0 size=1048576 2023-10-05T11:35:14.424 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.421+0000 7f26f5634780 1 > prepared part key=_multipart_W2GWVGX42QLD.2~4JP5BETCINM5.1 size=1048576 2023-10-05T11:35:14.425 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.422+0000 7f26f5634780 1 > prepared part key=_multipart_W2GWVGX42QLD.2~4JP5BETCINM5.2 size=343916 2023-10-05T11:35:14.425 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.422+0000 7f26f5634780 1 > prepared multipart upload key=W2GWVGX42QLD upload=4JP5BETCINM5 tag=GTCLJCIB3T00 type=write size=3489644 2023-10-05T11:35:14.426 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.423+0000 7f26f5634780 1 < canceled operation key=2D4PDQQT54ZA tag=YK16BD1J6UHV type=write size=1007707 2023-10-05T11:35:14.428 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.425+0000 7f26f5634780 1 > prepared part key=_multipart_U6172JUYW7J6.2~67KQ8QLF4MCB.0 size=1048576 2023-10-05T11:35:14.429 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.426+0000 7f26f5634780 1 > prepared part key=_multipart_U6172JUYW7J6.2~67KQ8QLF4MCB.1 size=1048576 2023-10-05T11:35:14.431 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.427+0000 7f26f5634780 1 > prepared part key=_multipart_U6172JUYW7J6.2~67KQ8QLF4MCB.2 size=594199 2023-10-05T11:35:14.431 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.427+0000 7f26f5634780 1 > prepared multipart upload key=U6172JUYW7J6 upload=67KQ8QLF4MCB tag=W7XIRZAUO91U type=write size=3739927 2023-10-05T11:35:14.432 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.428+0000 7f26f5634780 1 < completed part key=_multipart_WTCWG1C1SF89.2~LI26IMEGB4QG.0 size=1048576 2023-10-05T11:35:14.433 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.429+0000 7f26f5634780 1 < completed part key=_multipart_WTCWG1C1SF89.2~LI26IMEGB4QG.1 size=1048576 2023-10-05T11:35:14.434 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.430+0000 7f26f5634780 1 < completed part key=_multipart_WTCWG1C1SF89.2~LI26IMEGB4QG.2 size=876027 2023-10-05T11:35:14.436 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.432+0000 7f26f5634780 1 < completed multipart upload key=WTCWG1C1SF89 upload=LI26IMEGB4QG tag=3B37K6JKHUAV type=write size=4021755 2023-10-05T11:35:14.437 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.434+0000 7f26f5634780 1 > prepared operation key=IKCNZOTVWOC6 tag=8TCS17TJTQ8D type=del size=1429401 2023-10-05T11:35:14.438 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.435+0000 7f26f5634780 1 < completed delete operation key=IC7T3ZK81WQS tag=8OISPFK7WF2B type=del 2023-10-05T11:35:14.441 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.437+0000 7f26f5634780 1 > prepared part key=_multipart_J5EIH25Y471T.2~9UD7CTZPOECI.0 size=1048576 2023-10-05T11:35:14.442 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.438+0000 7f26f5634780 1 > prepared part key=_multipart_J5EIH25Y471T.2~9UD7CTZPOECI.1 size=1048576 2023-10-05T11:35:14.443 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.439+0000 7f26f5634780 1 > prepared part key=_multipart_J5EIH25Y471T.2~9UD7CTZPOECI.2 size=411588 2023-10-05T11:35:14.443 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.439+0000 7f26f5634780 1 > prepared multipart upload key=J5EIH25Y471T upload=9UD7CTZPOECI tag=KAX5MID51E76 type=write size=3557316 2023-10-05T11:35:14.444 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.441+0000 7f26f5634780 1 < completed part key=_multipart_VJTFYDETLSFD.2~5R0I6O5JSAR9.0 size=1048576 2023-10-05T11:35:14.444 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.441+0000 7f26f5634780 1 < canceled part key=_multipart_VJTFYDETLSFD.2~5R0I6O5JSAR9.1 size=1048576 2023-10-05T11:35:14.444 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.441+0000 7f26f5634780 1 < canceled part key=_multipart_VJTFYDETLSFD.2~5R0I6O5JSAR9.2 size=19049 2023-10-05T11:35:14.446 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.443+0000 7f26f5634780 1 < canceled multipart upload key=VJTFYDETLSFD upload=5R0I6O5JSAR9 tag=ML7833Z67YJY type=write size=3164777 2023-10-05T11:35:14.447 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.444+0000 7f26f5634780 1 > prepared operation key=4D3H60UTIXH3 tag=I7Q1KBKYMAW9 type=del size=2729094 2023-10-05T11:35:14.449 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.445+0000 7f26f5634780 1 < completed delete operation key=7TOP5A52M9YP tag=4DACAP3DIPIL type=del 2023-10-05T11:35:14.451 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.448+0000 7f26f5634780 1 > prepared part key=_multipart_PNV0Q6ZPLYV0.2~WPTOXO2ZNK2K.0 size=683033 2023-10-05T11:35:14.451 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.448+0000 7f26f5634780 1 > prepared multipart upload key=PNV0Q6ZPLYV0 upload=WPTOXO2ZNK2K tag=BBSH13AD6XA6 type=write size=1731609 2023-10-05T11:35:14.452 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.449+0000 7f26f5634780 1 < completed part key=_multipart_U6172JUYW7J6.2~HK2A9FE0MO2Y.0 size=445719 2023-10-05T11:35:14.454 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.451+0000 7f26f5634780 1 < completed multipart upload key=U6172JUYW7J6 upload=HK2A9FE0MO2Y tag=69MB8WOMU2DN type=write size=1494295 2023-10-05T11:35:14.455 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.452+0000 7f26f5634780 1 > prepared operation key=QYQDXVIGZ7O8 tag=KXX8EM1EZOS4 type=write size=914479 2023-10-05T11:35:14.457 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.453+0000 7f26f5634780 1 < completed part key=_multipart_BU3KSHTINB36.2~WNPRJUMV33JV.0 size=1048576 2023-10-05T11:35:14.458 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.454+0000 7f26f5634780 1 < completed part key=_multipart_BU3KSHTINB36.2~WNPRJUMV33JV.1 size=393573 2023-10-05T11:35:14.460 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.457+0000 7f26f5634780 1 < completed multipart upload key=BU3KSHTINB36 upload=WNPRJUMV33JV tag=H1D1F2UMYNXK type=write size=2490725 2023-10-05T11:35:14.462 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.458+0000 7f26f5634780 1 > prepared operation key=9S0YW7PPSJ8G tag=L0C4D2IENMIL type=del size=2876026 2023-10-05T11:35:14.462 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.458+0000 7f26f5634780 1 < canceled part key=_multipart_BTZUVE8R96XT.2~KY80AWV8OWR6.0 size=1048576 2023-10-05T11:35:14.462 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.459+0000 7f26f5634780 1 < completed part key=_multipart_BTZUVE8R96XT.2~KY80AWV8OWR6.1 size=549507 2023-10-05T11:35:14.465 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.461+0000 7f26f5634780 1 < canceled multipart upload key=BTZUVE8R96XT upload=KY80AWV8OWR6 tag=6AIDNP1UBJGP type=write size=2646659 2023-10-05T11:35:14.467 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.464+0000 7f26f5634780 1 > prepared part key=_multipart_IKCNZOTVWOC6.2~60GV2IQFFFO3.0 size=1048576 2023-10-05T11:35:14.468 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.464+0000 7f26f5634780 1 > prepared part key=_multipart_IKCNZOTVWOC6.2~60GV2IQFFFO3.1 size=754565 2023-10-05T11:35:14.468 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.464+0000 7f26f5634780 1 > prepared multipart upload key=IKCNZOTVWOC6 upload=60GV2IQFFFO3 tag=CVVTZI7O6J12 type=write size=2851717 2023-10-05T11:35:14.469 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.466+0000 7f26f5634780 1 < completed part key=_multipart_9S0YW7PPSJ8G.2~RRIF5CXC65XY.0 size=1048576 2023-10-05T11:35:14.470 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.467+0000 7f26f5634780 1 < completed part key=_multipart_9S0YW7PPSJ8G.2~RRIF5CXC65XY.1 size=1048576 2023-10-05T11:35:14.471 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.468+0000 7f26f5634780 1 < completed part key=_multipart_9S0YW7PPSJ8G.2~RRIF5CXC65XY.2 size=260489 2023-10-05T11:35:14.474 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.471+0000 7f26f5634780 1 < completed multipart upload key=9S0YW7PPSJ8G upload=RRIF5CXC65XY tag=7DHNDHERZ53B type=write size=3406217 2023-10-05T11:35:14.476 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.472+0000 7f26f5634780 1 > prepared operation key=2U0NRDGDNUTA tag=WIX4YFFUY127 type=del size=781486 2023-10-05T11:35:14.477 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.473+0000 7f26f5634780 1 < completed delete operation key=NV4Q36UOLX8A tag=NH5TB7I1Z47Z type=del 2023-10-05T11:35:14.478 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.475+0000 7f26f5634780 1 > prepared operation key=BTZUVE8R96XT tag=GLW81V65DIP0 type=del size=358897 2023-10-05T11:35:14.479 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.476+0000 7f26f5634780 1 < completed part key=_multipart_W2GWVGX42QLD.2~M0X23GL32DYD.0 size=1048576 2023-10-05T11:35:14.480 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.477+0000 7f26f5634780 1 < completed part key=_multipart_W2GWVGX42QLD.2~M0X23GL32DYD.1 size=1040533 2023-10-05T11:35:14.482 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.479+0000 7f26f5634780 1 < completed multipart upload key=W2GWVGX42QLD upload=M0X23GL32DYD tag=7FT0X3HSWNO2 type=write size=3137685 2023-10-05T11:35:14.484 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.481+0000 7f26f5634780 1 > prepared part key=_multipart_BTZUVE8R96XT.2~JAXUNSL9MQP4.0 size=1048576 2023-10-05T11:35:14.486 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.482+0000 7f26f5634780 1 > prepared part key=_multipart_BTZUVE8R96XT.2~JAXUNSL9MQP4.1 size=139354 2023-10-05T11:35:14.486 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.482+0000 7f26f5634780 1 > prepared multipart upload key=BTZUVE8R96XT upload=JAXUNSL9MQP4 tag=Z9X8HDQ25SOV type=write size=2236506 2023-10-05T11:35:14.487 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.483+0000 7f26f5634780 1 < completed part key=_multipart_4D3H60UTIXH3.2~3BF1W21KE1BZ.0 size=1048576 2023-10-05T11:35:14.488 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.484+0000 7f26f5634780 1 < completed part key=_multipart_4D3H60UTIXH3.2~3BF1W21KE1BZ.1 size=1048576 2023-10-05T11:35:14.489 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.485+0000 7f26f5634780 1 < completed part key=_multipart_4D3H60UTIXH3.2~3BF1W21KE1BZ.2 size=545655 2023-10-05T11:35:14.491 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.487+0000 7f26f5634780 1 < completed multipart upload key=4D3H60UTIXH3 upload=3BF1W21KE1BZ tag=JUUDIHQX4H2Y type=write size=3691383 2023-10-05T11:35:14.492 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.489+0000 7f26f5634780 1 > prepared operation key=5OPHKTHXVN5U tag=ER88X6NJPGUD type=del size=3608279 2023-10-05T11:35:14.493 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.490+0000 7f26f5634780 1 < completed delete operation key=AV0XKXX1IR4B tag=L6ZLN7V0ZVW1 type=del 2023-10-05T11:35:14.496 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.492+0000 7f26f5634780 1 > prepared part key=_multipart_9S0YW7PPSJ8G.2~E7864F3DISI3.0 size=1048576 2023-10-05T11:35:14.497 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.493+0000 7f26f5634780 1 > prepared part key=_multipart_9S0YW7PPSJ8G.2~E7864F3DISI3.1 size=1048576 2023-10-05T11:35:14.497 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.494+0000 7f26f5634780 1 > prepared part key=_multipart_9S0YW7PPSJ8G.2~E7864F3DISI3.2 size=933392 2023-10-05T11:35:14.498 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.494+0000 7f26f5634780 1 > prepared multipart upload key=9S0YW7PPSJ8G upload=E7864F3DISI3 tag=E36KW69X177Q type=write size=4079120 2023-10-05T11:35:14.499 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.495+0000 7f26f5634780 1 < completed delete operation key=J5EIH25Y471T tag=9ABRIRTFJWOD type=del 2023-10-05T11:35:14.500 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.497+0000 7f26f5634780 1 > prepared operation key=5V0Q651D4VN2 tag=500SJK8201LA type=del size=2226825 2023-10-05T11:35:14.501 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.498+0000 7f26f5634780 1 < completed write operation key=J5EIH25Y471T tag=Q0IYVAISQWD2 type=write size=559320 2023-10-05T11:35:14.503 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.499+0000 7f26f5634780 1 > prepared operation key=NV4Q36UOLX8A tag=TP51PL02T8XH type=del size=4035818 2023-10-05T11:35:14.504 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.500+0000 7f26f5634780 1 < completed part key=_multipart_W2GWVGX42QLD.2~4JP5BETCINM5.0 size=1048576 2023-10-05T11:35:14.504 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.501+0000 7f26f5634780 1 < canceled part key=_multipart_W2GWVGX42QLD.2~4JP5BETCINM5.1 size=1048576 2023-10-05T11:35:14.505 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.502+0000 7f26f5634780 1 < completed part key=_multipart_W2GWVGX42QLD.2~4JP5BETCINM5.2 size=343916 2023-10-05T11:35:14.507 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.504+0000 7f26f5634780 1 < canceled multipart upload key=W2GWVGX42QLD upload=4JP5BETCINM5 tag=GTCLJCIB3T00 type=write size=3489644 2023-10-05T11:35:14.508 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.505+0000 7f26f5634780 1 > prepared operation key=NV4Q36UOLX8A tag=US3DC5FTZKAN type=write size=541952 2023-10-05T11:35:14.510 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.506+0000 7f26f5634780 1 < completed part key=_multipart_U6172JUYW7J6.2~67KQ8QLF4MCB.0 size=1048576 2023-10-05T11:35:14.511 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.507+0000 7f26f5634780 1 < completed part key=_multipart_U6172JUYW7J6.2~67KQ8QLF4MCB.1 size=1048576 2023-10-05T11:35:14.512 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.509+0000 7f26f5634780 1 < completed part key=_multipart_U6172JUYW7J6.2~67KQ8QLF4MCB.2 size=594199 2023-10-05T11:35:14.514 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.511+0000 7f26f5634780 1 < completed multipart upload key=U6172JUYW7J6 upload=67KQ8QLF4MCB tag=W7XIRZAUO91U type=write size=3739927 2023-10-05T11:35:14.517 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.513+0000 7f26f5634780 1 > prepared part key=_multipart_MEY4SZRHU9NZ.2~0NRS71UF78QW.0 size=1048576 2023-10-05T11:35:14.518 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.514+0000 7f26f5634780 1 > prepared part key=_multipart_MEY4SZRHU9NZ.2~0NRS71UF78QW.1 size=1048576 2023-10-05T11:35:14.519 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.515+0000 7f26f5634780 1 > prepared part key=_multipart_MEY4SZRHU9NZ.2~0NRS71UF78QW.2 size=1040233 2023-10-05T11:35:14.519 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.515+0000 7f26f5634780 1 > prepared multipart upload key=MEY4SZRHU9NZ upload=0NRS71UF78QW tag=WKWHH8UBMX18 type=write size=4185961 2023-10-05T11:35:14.520 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.517+0000 7f26f5634780 1 < completed delete operation key=IKCNZOTVWOC6 tag=8TCS17TJTQ8D type=del 2023-10-05T11:35:14.521 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.518+0000 7f26f5634780 1 > prepared operation key=NV4Q36UOLX8A tag=XOCPZY312AVE type=del size=807985 2023-10-05T11:35:14.523 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.519+0000 7f26f5634780 1 < completed part key=_multipart_J5EIH25Y471T.2~9UD7CTZPOECI.0 size=1048576 2023-10-05T11:35:14.524 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.520+0000 7f26f5634780 1 < completed part key=_multipart_J5EIH25Y471T.2~9UD7CTZPOECI.1 size=1048576 2023-10-05T11:35:14.524 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.520+0000 7f26f5634780 1 < canceled part key=_multipart_J5EIH25Y471T.2~9UD7CTZPOECI.2 size=411588 2023-10-05T11:35:14.526 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.522+0000 7f26f5634780 1 < canceled multipart upload key=J5EIH25Y471T upload=9UD7CTZPOECI tag=KAX5MID51E76 type=write size=3557316 2023-10-05T11:35:14.527 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.524+0000 7f26f5634780 1 > prepared operation key=7W9LL5HSU3BG tag=3AS4M6SRTWIF type=del size=978838 2023-10-05T11:35:14.528 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.525+0000 7f26f5634780 1 < completed delete operation key=4D3H60UTIXH3 tag=I7Q1KBKYMAW9 type=del 2023-10-05T11:35:14.529 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.526+0000 7f26f5634780 1 > prepared operation key=4D3H60UTIXH3 tag=LHWB9HHKQ1PB type=del size=2172616 2023-10-05T11:35:14.531 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.527+0000 7f26f5634780 1 < completed part key=_multipart_PNV0Q6ZPLYV0.2~WPTOXO2ZNK2K.0 size=683033 2023-10-05T11:35:14.533 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.529+0000 7f26f5634780 1 < completed multipart upload key=PNV0Q6ZPLYV0 upload=WPTOXO2ZNK2K tag=BBSH13AD6XA6 type=write size=1731609 2023-10-05T11:35:14.534 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.530+0000 7f26f5634780 1 > prepared operation key=2U0NRDGDNUTA tag=2JT2EDJYRQEM type=del size=3990880 2023-10-05T11:35:14.535 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.532+0000 7f26f5634780 1 < completed write operation key=QYQDXVIGZ7O8 tag=KXX8EM1EZOS4 type=write size=914479 2023-10-05T11:35:14.537 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.533+0000 7f26f5634780 1 > prepared operation key=4D3H60UTIXH3 tag=41KJA5UDJ4X2 type=write size=933676 2023-10-05T11:35:14.539 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.536+0000 7f26f5634780 1 < canceled operation key=9S0YW7PPSJ8G tag=L0C4D2IENMIL type=del size=2876026 2023-10-05T11:35:14.540 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.537+0000 7f26f5634780 1 > prepared operation key=7TOP5A52M9YP tag=C9KV6RKZK2BU type=write size=533695 2023-10-05T11:35:14.542 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.538+0000 7f26f5634780 1 < completed part key=_multipart_IKCNZOTVWOC6.2~60GV2IQFFFO3.0 size=1048576 2023-10-05T11:35:14.542 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.538+0000 7f26f5634780 1 < canceled part key=_multipart_IKCNZOTVWOC6.2~60GV2IQFFFO3.1 size=754565 2023-10-05T11:35:14.544 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.540+0000 7f26f5634780 1 < canceled multipart upload key=IKCNZOTVWOC6 upload=60GV2IQFFFO3 tag=CVVTZI7O6J12 type=write size=2851717 2023-10-05T11:35:14.546 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.543+0000 7f26f5634780 1 > prepared part key=_multipart_QYQDXVIGZ7O8.2~Q0ABOEUUD2J0.0 size=363842 2023-10-05T11:35:14.546 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.543+0000 7f26f5634780 1 > prepared multipart upload key=QYQDXVIGZ7O8 upload=Q0ABOEUUD2J0 tag=24H7N0GA9PAB type=write size=1412418 2023-10-05T11:35:14.548 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.544+0000 7f26f5634780 1 < completed delete operation key=2U0NRDGDNUTA tag=WIX4YFFUY127 type=del 2023-10-05T11:35:14.549 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.546+0000 7f26f5634780 1 > prepared operation key=7W9LL5HSU3BG tag=DEDOP6AQIIPQ type=del size=4139613 2023-10-05T11:35:14.550 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.547+0000 7f26f5634780 1 < completed delete operation key=BTZUVE8R96XT tag=GLW81V65DIP0 type=del 2023-10-05T11:35:14.552 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.548+0000 7f26f5634780 1 > prepared operation key=S3DKYDFT4IO2 tag=9MUQQ1RUQ0U3 type=del size=1622265 2023-10-05T11:35:14.553 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.550+0000 7f26f5634780 1 < completed part key=_multipart_BTZUVE8R96XT.2~JAXUNSL9MQP4.0 size=1048576 2023-10-05T11:35:14.554 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.551+0000 7f26f5634780 1 < completed part key=_multipart_BTZUVE8R96XT.2~JAXUNSL9MQP4.1 size=139354 2023-10-05T11:35:14.556 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.553+0000 7f26f5634780 1 < completed multipart upload key=BTZUVE8R96XT upload=JAXUNSL9MQP4 tag=Z9X8HDQ25SOV type=write size=2236506 2023-10-05T11:35:14.557 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.554+0000 7f26f5634780 1 > prepared operation key=5OPHKTHXVN5U tag=P4Z4KJNGNU0M type=del size=2624772 2023-10-05T11:35:14.560 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.557+0000 7f26f5634780 1 < suggested update operation key=5OPHKTHXVN5U tag=ER88X6NJPGUD type=del size=3608279 2023-10-05T11:35:14.561 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.558+0000 7f26f5634780 1 > prepared operation key=7TOP5A52M9YP tag=POB3EPSNPR72 type=del size=23234 2023-10-05T11:35:14.562 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.559+0000 7f26f5634780 1 < completed part key=_multipart_9S0YW7PPSJ8G.2~E7864F3DISI3.0 size=1048576 2023-10-05T11:35:14.563 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.560+0000 7f26f5634780 1 < completed part key=_multipart_9S0YW7PPSJ8G.2~E7864F3DISI3.1 size=1048576 2023-10-05T11:35:14.564 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.561+0000 7f26f5634780 1 < completed part key=_multipart_9S0YW7PPSJ8G.2~E7864F3DISI3.2 size=933392 2023-10-05T11:35:14.566 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.563+0000 7f26f5634780 1 < completed multipart upload key=9S0YW7PPSJ8G upload=E7864F3DISI3 tag=E36KW69X177Q type=write size=4079120 2023-10-05T11:35:14.568 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.564+0000 7f26f5634780 1 > prepared operation key=6DP3UJ4CW1MO tag=FBDKNU25Q3O5 type=write size=441633 2023-10-05T11:35:14.570 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.567+0000 7f26f5634780 1 < suggested remove operation key=5V0Q651D4VN2 tag=500SJK8201LA type=del 2023-10-05T11:35:14.571 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.568+0000 7f26f5634780 1 > prepared operation key=PNV0Q6ZPLYV0 tag=Z2NBZQEQXKIQ type=write size=253702 2023-10-05T11:35:14.572 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.569+0000 7f26f5634780 1 < completed delete operation key=NV4Q36UOLX8A tag=TP51PL02T8XH type=del 2023-10-05T11:35:14.575 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.571+0000 7f26f5634780 1 > prepared part key=_multipart_WTCWG1C1SF89.2~60NIGLI704JM.0 size=1048576 2023-10-05T11:35:14.575 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.572+0000 7f26f5634780 1 > prepared part key=_multipart_WTCWG1C1SF89.2~60NIGLI704JM.1 size=282937 2023-10-05T11:35:14.576 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.572+0000 7f26f5634780 1 > prepared multipart upload key=WTCWG1C1SF89 upload=60NIGLI704JM tag=VBB0WFU0TV5B type=write size=2380089 2023-10-05T11:35:14.577 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.573+0000 7f26f5634780 1 < completed write operation key=NV4Q36UOLX8A tag=US3DC5FTZKAN type=write size=541952 2023-10-05T11:35:14.578 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.575+0000 7f26f5634780 1 > prepared operation key=761J2C7GHWU5 tag=LS5EICV97W6G type=del size=3163460 2023-10-05T11:35:14.579 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.576+0000 7f26f5634780 1 < completed part key=_multipart_MEY4SZRHU9NZ.2~0NRS71UF78QW.0 size=1048576 2023-10-05T11:35:14.580 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.577+0000 7f26f5634780 1 < completed part key=_multipart_MEY4SZRHU9NZ.2~0NRS71UF78QW.1 size=1048576 2023-10-05T11:35:14.581 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.578+0000 7f26f5634780 1 < completed part key=_multipart_MEY4SZRHU9NZ.2~0NRS71UF78QW.2 size=1040233 2023-10-05T11:35:14.583 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.580+0000 7f26f5634780 1 < completed multipart upload key=MEY4SZRHU9NZ upload=0NRS71UF78QW tag=WKWHH8UBMX18 type=write size=4185961 2023-10-05T11:35:14.584 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.581+0000 7f26f5634780 1 > prepared operation key=BTZUVE8R96XT tag=5326YTKUUCDB type=write size=93926 2023-10-05T11:35:14.586 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.582+0000 7f26f5634780 1 < completed delete operation key=NV4Q36UOLX8A tag=XOCPZY312AVE type=del 2023-10-05T11:35:14.587 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.583+0000 7f26f5634780 1 > prepared operation key=LLR5J3X15W5R tag=7KS1PZCJD63O type=del size=548671 2023-10-05T11:35:14.589 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.586+0000 7f26f5634780 1 < suggested remove operation key=7W9LL5HSU3BG tag=3AS4M6SRTWIF type=del 2023-10-05T11:35:14.592 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.588+0000 7f26f5634780 1 > prepared operation key=J5EIH25Y471T tag=7VG4DSH21MB2 type=del size=3637971 2023-10-05T11:35:14.594 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.591+0000 7f26f5634780 1 < suggested remove operation key=4D3H60UTIXH3 tag=LHWB9HHKQ1PB type=del 2023-10-05T11:35:14.596 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.592+0000 7f26f5634780 1 > prepared operation key=S3DKYDFT4IO2 tag=Y1MA8K4TF352 type=write size=630383 2023-10-05T11:35:14.597 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.593+0000 7f26f5634780 1 < canceled operation key=2U0NRDGDNUTA tag=2JT2EDJYRQEM type=del size=3990880 2023-10-05T11:35:14.598 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.595+0000 7f26f5634780 1 > prepared operation key=AV0XKXX1IR4B tag=3Y6X4WPEKL35 type=del size=869202 2023-10-05T11:35:14.599 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.595+0000 7f26f5634780 -1 < no bi entry to suggest for operation key=4D3H60UTIXH3 tag=41KJA5UDJ4X2 type=write size=933676: (2) No such file or directory 2023-10-05T11:35:14.600 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.596+0000 7f26f5634780 1 > prepared operation key=6DP3UJ4CW1MO tag=JORFOSS51ARF type=write size=189570 2023-10-05T11:35:14.602 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.599+0000 7f26f5634780 1 < suggested update operation key=7TOP5A52M9YP tag=C9KV6RKZK2BU type=write size=533695 2023-10-05T11:35:14.604 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.601+0000 7f26f5634780 1 > prepared part key=_multipart_AV0XKXX1IR4B.2~SJKA00FYQNHR.0 size=1048576 2023-10-05T11:35:14.605 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.602+0000 7f26f5634780 1 > prepared part key=_multipart_AV0XKXX1IR4B.2~SJKA00FYQNHR.1 size=1048576 2023-10-05T11:35:14.606 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.603+0000 7f26f5634780 1 > prepared part key=_multipart_AV0XKXX1IR4B.2~SJKA00FYQNHR.2 size=147755 2023-10-05T11:35:14.606 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.603+0000 7f26f5634780 1 > prepared multipart upload key=AV0XKXX1IR4B upload=SJKA00FYQNHR tag=R7J0BR8SMT0G type=write size=3293483 2023-10-05T11:35:14.607 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.604+0000 7f26f5634780 1 < completed part key=_multipart_QYQDXVIGZ7O8.2~Q0ABOEUUD2J0.0 size=363842 2023-10-05T11:35:14.609 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.606+0000 7f26f5634780 1 < completed multipart upload key=QYQDXVIGZ7O8 upload=Q0ABOEUUD2J0 tag=24H7N0GA9PAB type=write size=1412418 2023-10-05T11:35:14.611 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.607+0000 7f26f5634780 1 > prepared operation key=WYN9BG66LA3K tag=J153CYSMVV3B type=del size=2346759 2023-10-05T11:35:14.612 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.608+0000 7f26f5634780 -1 < failed to complete operation key=7W9LL5HSU3BG tag=DEDOP6AQIIPQ type=del size=4139613: (22) Invalid argument 2023-10-05T11:35:14.613 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.610+0000 7f26f5634780 1 > prepared operation key=MEY4SZRHU9NZ tag=QMR4BFH4KP80 type=del size=1166604 2023-10-05T11:35:14.614 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.611+0000 7f26f5634780 1 < completed delete operation key=S3DKYDFT4IO2 tag=9MUQQ1RUQ0U3 type=del 2023-10-05T11:35:14.617 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.613+0000 7f26f5634780 1 > prepared part key=_multipart_MEY4SZRHU9NZ.2~YY03Q233HY7Y.0 size=1048576 2023-10-05T11:35:14.618 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.614+0000 7f26f5634780 1 > prepared part key=_multipart_MEY4SZRHU9NZ.2~YY03Q233HY7Y.1 size=150794 2023-10-05T11:35:14.618 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.614+0000 7f26f5634780 1 > prepared multipart upload key=MEY4SZRHU9NZ upload=YY03Q233HY7Y tag=5CI3E8C17HHC type=write size=2247946 2023-10-05T11:35:14.620 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.617+0000 7f26f5634780 1 < suggested update operation key=5OPHKTHXVN5U tag=P4Z4KJNGNU0M type=del size=2624772 2023-10-05T11:35:14.621 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.618+0000 7f26f5634780 1 > prepared operation key=WTCWG1C1SF89 tag=BNMLP034SH4F type=del size=1010904 2023-10-05T11:35:14.623 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.619+0000 7f26f5634780 -1 < failed to complete operation key=7TOP5A52M9YP tag=POB3EPSNPR72 type=del size=23234: (22) Invalid argument 2023-10-05T11:35:14.624 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.621+0000 7f26f5634780 1 > prepared operation key=PNV0Q6ZPLYV0 tag=AU55RSIFMYT5 type=del size=662215 2023-10-05T11:35:14.625 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.622+0000 7f26f5634780 1 < completed write operation key=6DP3UJ4CW1MO tag=FBDKNU25Q3O5 type=write size=441633 2023-10-05T11:35:14.627 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.624+0000 7f26f5634780 1 > prepared part key=_multipart_W2GWVGX42QLD.2~FI4FH51TYPP4.0 size=1048576 2023-10-05T11:35:14.628 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.625+0000 7f26f5634780 1 > prepared part key=_multipart_W2GWVGX42QLD.2~FI4FH51TYPP4.1 size=828383 2023-10-05T11:35:14.628 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.625+0000 7f26f5634780 1 > prepared multipart upload key=W2GWVGX42QLD upload=FI4FH51TYPP4 tag=2BBCSW3PRCIT type=write size=2925535 2023-10-05T11:35:14.630 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.626+0000 7f26f5634780 1 < canceled operation key=PNV0Q6ZPLYV0 tag=Z2NBZQEQXKIQ type=write size=253702 2023-10-05T11:35:14.631 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.628+0000 7f26f5634780 1 > prepared operation key=LLR5J3X15W5R tag=YMBFZJ69FJ5A type=del size=2618363 2023-10-05T11:35:14.632 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.629+0000 7f26f5634780 1 < completed part key=_multipart_WTCWG1C1SF89.2~60NIGLI704JM.0 size=1048576 2023-10-05T11:35:14.633 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.630+0000 7f26f5634780 1 < completed part key=_multipart_WTCWG1C1SF89.2~60NIGLI704JM.1 size=282937 2023-10-05T11:35:14.635 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.632+0000 7f26f5634780 1 < completed multipart upload key=WTCWG1C1SF89 upload=60NIGLI704JM tag=VBB0WFU0TV5B type=write size=2380089 2023-10-05T11:35:14.637 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.634+0000 7f26f5634780 1 > prepared part key=_multipart_BTZUVE8R96XT.2~UMP491DXRYVO.0 size=1048576 2023-10-05T11:35:14.638 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.635+0000 7f26f5634780 1 > prepared part key=_multipart_BTZUVE8R96XT.2~UMP491DXRYVO.1 size=1048576 2023-10-05T11:35:14.639 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.636+0000 7f26f5634780 1 > prepared part key=_multipart_BTZUVE8R96XT.2~UMP491DXRYVO.2 size=232498 2023-10-05T11:35:14.640 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.636+0000 7f26f5634780 1 > prepared multipart upload key=BTZUVE8R96XT upload=UMP491DXRYVO tag=1M936KZU5DQQ type=write size=3378226 2023-10-05T11:35:14.641 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.638+0000 7f26f5634780 1 < completed delete operation key=761J2C7GHWU5 tag=LS5EICV97W6G type=del 2023-10-05T11:35:14.645 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.642+0000 7f26f5634780 1 > prepared part key=_multipart_PNV0Q6ZPLYV0.2~UUZC2QHPV92V.0 size=1048576 2023-10-05T11:35:14.646 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.643+0000 7f26f5634780 1 > prepared part key=_multipart_PNV0Q6ZPLYV0.2~UUZC2QHPV92V.1 size=713282 2023-10-05T11:35:14.646 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.643+0000 7f26f5634780 1 > prepared multipart upload key=PNV0Q6ZPLYV0 upload=UUZC2QHPV92V tag=MPHTM4K17KJM type=write size=2810434 2023-10-05T11:35:14.648 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.644+0000 7f26f5634780 1 < completed write operation key=BTZUVE8R96XT tag=5326YTKUUCDB type=write size=93926 2023-10-05T11:35:14.649 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.646+0000 7f26f5634780 1 > prepared operation key=7W9LL5HSU3BG tag=0UC6IW5AJ8N3 type=del size=3389620 2023-10-05T11:35:14.650 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.647+0000 7f26f5634780 1 < canceled operation key=LLR5J3X15W5R tag=7KS1PZCJD63O type=del size=548671 2023-10-05T11:35:14.651 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.648+0000 7f26f5634780 1 > prepared operation key=6DP3UJ4CW1MO tag=DQWUO49D3VIC type=del size=98305 2023-10-05T11:35:14.654 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.651+0000 7f26f5634780 1 < suggested update operation key=J5EIH25Y471T tag=7VG4DSH21MB2 type=del size=3637971 2023-10-05T11:35:14.656 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.653+0000 7f26f5634780 1 > prepared part key=_multipart_BU3KSHTINB36.2~7RJHCDAZPQ73.0 size=1048576 2023-10-05T11:35:14.657 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.654+0000 7f26f5634780 1 > prepared part key=_multipart_BU3KSHTINB36.2~7RJHCDAZPQ73.1 size=1048576 2023-10-05T11:35:14.658 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.655+0000 7f26f5634780 1 > prepared part key=_multipart_BU3KSHTINB36.2~7RJHCDAZPQ73.2 size=501054 2023-10-05T11:35:14.658 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.655+0000 7f26f5634780 1 > prepared multipart upload key=BU3KSHTINB36 upload=7RJHCDAZPQ73 tag=4FDB89EGSFRP type=write size=3646782 2023-10-05T11:35:14.660 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.656+0000 7f26f5634780 1 < completed write operation key=S3DKYDFT4IO2 tag=Y1MA8K4TF352 type=write size=630383 2023-10-05T11:35:14.661 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.657+0000 7f26f5634780 1 > prepared operation key=9S0YW7PPSJ8G tag=1VE2ULT73PT7 type=del size=1838243 2023-10-05T11:35:14.662 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.659+0000 7f26f5634780 1 < completed delete operation key=AV0XKXX1IR4B tag=3Y6X4WPEKL35 type=del 2023-10-05T11:35:14.663 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.660+0000 7f26f5634780 1 > prepared operation key=9S0YW7PPSJ8G tag=RCUUP2NOMPMU type=write size=963668 2023-10-05T11:35:14.665 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.661+0000 7f26f5634780 1 < completed write operation key=6DP3UJ4CW1MO tag=JORFOSS51ARF type=write size=189570 2023-10-05T11:35:14.667 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.664+0000 7f26f5634780 1 > prepared part key=_multipart_PC8WTJ8AYJ24.2~LVSYF6MMEX5G.0 size=860546 2023-10-05T11:35:14.667 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.664+0000 7f26f5634780 1 > prepared multipart upload key=PC8WTJ8AYJ24 upload=LVSYF6MMEX5G tag=FB5G5B700U6G type=write size=1909122 2023-10-05T11:35:14.668 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.665+0000 7f26f5634780 1 < completed part key=_multipart_AV0XKXX1IR4B.2~SJKA00FYQNHR.0 size=1048576 2023-10-05T11:35:14.668 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.665+0000 7f26f5634780 1 < canceled part key=_multipart_AV0XKXX1IR4B.2~SJKA00FYQNHR.1 size=1048576 2023-10-05T11:35:14.669 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.666+0000 7f26f5634780 1 < completed part key=_multipart_AV0XKXX1IR4B.2~SJKA00FYQNHR.2 size=147755 2023-10-05T11:35:14.673 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.668+0000 7f26f5634780 1 < canceled multipart upload key=AV0XKXX1IR4B upload=SJKA00FYQNHR tag=R7J0BR8SMT0G type=write size=3293483 2023-10-05T11:35:14.673 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.669+0000 7f26f5634780 1 > prepared operation key=S3DKYDFT4IO2 tag=1285BY7U0Y1T type=del size=3676812 2023-10-05T11:35:14.674 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.671+0000 7f26f5634780 1 < completed delete operation key=WYN9BG66LA3K tag=J153CYSMVV3B type=del 2023-10-05T11:35:14.676 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.673+0000 7f26f5634780 1 > prepared part key=_multipart_IC7T3ZK81WQS.2~OUVQTXQL4TGR.0 size=1048576 2023-10-05T11:35:14.677 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.674+0000 7f26f5634780 1 > prepared part key=_multipart_IC7T3ZK81WQS.2~OUVQTXQL4TGR.1 size=1048576 2023-10-05T11:35:14.679 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.675+0000 7f26f5634780 1 > prepared part key=_multipart_IC7T3ZK81WQS.2~OUVQTXQL4TGR.2 size=386765 2023-10-05T11:35:14.679 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.675+0000 7f26f5634780 1 > prepared multipart upload key=IC7T3ZK81WQS upload=OUVQTXQL4TGR tag=NPMXNKQUPL2Y type=write size=3532493 2023-10-05T11:35:14.679 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.676+0000 7f26f5634780 1 < completed delete operation key=MEY4SZRHU9NZ tag=QMR4BFH4KP80 type=del 2023-10-05T11:35:14.681 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.677+0000 7f26f5634780 1 > prepared operation key=FOMNIIY47UUM tag=44GIFY6HOIIT type=del size=4191792 2023-10-05T11:35:14.682 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.679+0000 7f26f5634780 1 < completed part key=_multipart_MEY4SZRHU9NZ.2~YY03Q233HY7Y.0 size=1048576 2023-10-05T11:35:14.683 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.680+0000 7f26f5634780 1 < completed part key=_multipart_MEY4SZRHU9NZ.2~YY03Q233HY7Y.1 size=150794 2023-10-05T11:35:14.685 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.682+0000 7f26f5634780 1 < completed multipart upload key=MEY4SZRHU9NZ upload=YY03Q233HY7Y tag=5CI3E8C17HHC type=write size=2247946 2023-10-05T11:35:14.687 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.683+0000 7f26f5634780 1 > prepared operation key=2D4PDQQT54ZA tag=S4QLIHEOIDZX type=del size=3582537 2023-10-05T11:35:14.688 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.685+0000 7f26f5634780 1 < completed delete operation key=WTCWG1C1SF89 tag=BNMLP034SH4F type=del 2023-10-05T11:35:14.690 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.687+0000 7f26f5634780 1 > prepared part key=_multipart_IC7T3ZK81WQS.2~CE5U2AKSH6L4.0 size=944201 2023-10-05T11:35:14.690 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.687+0000 7f26f5634780 1 > prepared multipart upload key=IC7T3ZK81WQS upload=CE5U2AKSH6L4 tag=D6X7WL5YBJO0 type=write size=1992777 2023-10-05T11:35:14.692 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.688+0000 7f26f5634780 1 < completed delete operation key=PNV0Q6ZPLYV0 tag=AU55RSIFMYT5 type=del 2023-10-05T11:35:14.693 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.689+0000 7f26f5634780 1 > prepared operation key=IC7T3ZK81WQS tag=JY0T0AFOROA7 type=del size=819643 2023-10-05T11:35:14.694 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.691+0000 7f26f5634780 1 < completed part key=_multipart_W2GWVGX42QLD.2~FI4FH51TYPP4.0 size=1048576 2023-10-05T11:35:14.695 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.692+0000 7f26f5634780 1 < completed part key=_multipart_W2GWVGX42QLD.2~FI4FH51TYPP4.1 size=828383 2023-10-05T11:35:14.697 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.694+0000 7f26f5634780 1 < completed multipart upload key=W2GWVGX42QLD upload=FI4FH51TYPP4 tag=2BBCSW3PRCIT type=write size=2925535 2023-10-05T11:35:14.700 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.696+0000 7f26f5634780 1 > prepared part key=_multipart_U6172JUYW7J6.2~L0O714O3F3ZQ.0 size=1048576 2023-10-05T11:35:14.700 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.697+0000 7f26f5634780 1 > prepared part key=_multipart_U6172JUYW7J6.2~L0O714O3F3ZQ.1 size=1048576 2023-10-05T11:35:14.701 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.698+0000 7f26f5634780 1 > prepared part key=_multipart_U6172JUYW7J6.2~L0O714O3F3ZQ.2 size=1035446 2023-10-05T11:35:14.702 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.698+0000 7f26f5634780 1 > prepared multipart upload key=U6172JUYW7J6 upload=L0O714O3F3ZQ tag=EVZTR99RBSLV type=write size=4181174 2023-10-05T11:35:14.703 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.699+0000 7f26f5634780 1 < completed delete operation key=LLR5J3X15W5R tag=YMBFZJ69FJ5A type=del 2023-10-05T11:35:14.704 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.700+0000 7f26f5634780 1 > prepared operation key=7TOP5A52M9YP tag=M4BGNMPT1M75 type=del size=93851 2023-10-05T11:35:14.705 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.702+0000 7f26f5634780 1 < completed part key=_multipart_BTZUVE8R96XT.2~UMP491DXRYVO.0 size=1048576 2023-10-05T11:35:14.705 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.702+0000 7f26f5634780 1 < canceled part key=_multipart_BTZUVE8R96XT.2~UMP491DXRYVO.1 size=1048576 2023-10-05T11:35:14.706 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.703+0000 7f26f5634780 1 < completed part key=_multipart_BTZUVE8R96XT.2~UMP491DXRYVO.2 size=232498 2023-10-05T11:35:14.708 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.705+0000 7f26f5634780 1 < canceled multipart upload key=BTZUVE8R96XT upload=UMP491DXRYVO tag=1M936KZU5DQQ type=write size=3378226 2023-10-05T11:35:14.709 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.706+0000 7f26f5634780 1 > prepared operation key=761J2C7GHWU5 tag=36DM2Y2KSNON type=write size=519840 2023-10-05T11:35:14.712 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.709+0000 7f26f5634780 1 < completed part key=_multipart_PNV0Q6ZPLYV0.2~UUZC2QHPV92V.0 size=1048576 2023-10-05T11:35:14.713 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.710+0000 7f26f5634780 1 < completed part key=_multipart_PNV0Q6ZPLYV0.2~UUZC2QHPV92V.1 size=713282 2023-10-05T11:35:14.715 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.712+0000 7f26f5634780 1 < completed multipart upload key=PNV0Q6ZPLYV0 upload=UUZC2QHPV92V tag=MPHTM4K17KJM type=write size=2810434 2023-10-05T11:35:14.717 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.714+0000 7f26f5634780 1 > prepared part key=_multipart_WTCWG1C1SF89.2~V3HWH4ULM2WH.0 size=1048576 2023-10-05T11:35:14.718 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.715+0000 7f26f5634780 1 > prepared part key=_multipart_WTCWG1C1SF89.2~V3HWH4ULM2WH.1 size=408001 2023-10-05T11:35:14.718 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.715+0000 7f26f5634780 1 > prepared multipart upload key=WTCWG1C1SF89 upload=V3HWH4ULM2WH tag=WQYU2E4YKBEU type=write size=2505153 2023-10-05T11:35:14.719 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.716+0000 7f26f5634780 1 < completed delete operation key=7W9LL5HSU3BG tag=0UC6IW5AJ8N3 type=del 2023-10-05T11:35:14.721 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.718+0000 7f26f5634780 1 > prepared part key=_multipart_0PWYKC7S6YJ4.2~7J7BTUXCZ9H6.0 size=464218 2023-10-05T11:35:14.722 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.718+0000 7f26f5634780 1 > prepared multipart upload key=0PWYKC7S6YJ4 upload=7J7BTUXCZ9H6 tag=4KRDMCZOBOLU type=write size=1512794 2023-10-05T11:35:14.723 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.719+0000 7f26f5634780 1 < canceled operation key=6DP3UJ4CW1MO tag=DQWUO49D3VIC type=del size=98305 2023-10-05T11:35:14.725 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.722+0000 7f26f5634780 1 > prepared part key=_multipart_W2GWVGX42QLD.2~3QZ41ESYZUCG.0 size=1048576 2023-10-05T11:35:14.726 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.722+0000 7f26f5634780 1 > prepared part key=_multipart_W2GWVGX42QLD.2~3QZ41ESYZUCG.1 size=1048576 2023-10-05T11:35:14.727 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.723+0000 7f26f5634780 1 > prepared part key=_multipart_W2GWVGX42QLD.2~3QZ41ESYZUCG.2 size=89385 2023-10-05T11:35:14.727 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.723+0000 7f26f5634780 1 > prepared multipart upload key=W2GWVGX42QLD upload=3QZ41ESYZUCG tag=5A5QNYYFDB3Z type=write size=3235113 2023-10-05T11:35:14.728 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.725+0000 7f26f5634780 1 < completed part key=_multipart_BU3KSHTINB36.2~7RJHCDAZPQ73.0 size=1048576 2023-10-05T11:35:14.729 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.726+0000 7f26f5634780 1 < completed part key=_multipart_BU3KSHTINB36.2~7RJHCDAZPQ73.1 size=1048576 2023-10-05T11:35:14.730 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.727+0000 7f26f5634780 1 < completed part key=_multipart_BU3KSHTINB36.2~7RJHCDAZPQ73.2 size=501054 2023-10-05T11:35:14.732 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.729+0000 7f26f5634780 1 < completed multipart upload key=BU3KSHTINB36 upload=7RJHCDAZPQ73 tag=4FDB89EGSFRP type=write size=3646782 2023-10-05T11:35:14.734 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.731+0000 7f26f5634780 1 > prepared part key=_multipart_761J2C7GHWU5.2~PAYV65KB1U8E.0 size=1048576 2023-10-05T11:35:14.735 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.732+0000 7f26f5634780 1 > prepared part key=_multipart_761J2C7GHWU5.2~PAYV65KB1U8E.1 size=1048576 2023-10-05T11:35:14.736 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.733+0000 7f26f5634780 1 > prepared part key=_multipart_761J2C7GHWU5.2~PAYV65KB1U8E.2 size=572543 2023-10-05T11:35:14.736 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.733+0000 7f26f5634780 1 > prepared multipart upload key=761J2C7GHWU5 upload=PAYV65KB1U8E tag=GG10OLGN8PR5 type=write size=3718271 2023-10-05T11:35:14.737 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.734+0000 7f26f5634780 1 < completed delete operation key=9S0YW7PPSJ8G tag=1VE2ULT73PT7 type=del 2023-10-05T11:35:14.739 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.736+0000 7f26f5634780 1 > prepared operation key=U6172JUYW7J6 tag=ZWDIP0RRLD1D type=del size=3984237 2023-10-05T11:35:14.740 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.737+0000 7f26f5634780 1 < canceled operation key=9S0YW7PPSJ8G tag=RCUUP2NOMPMU type=write size=963668 2023-10-05T11:35:14.742 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.739+0000 7f26f5634780 1 > prepared part key=_multipart_U6172JUYW7J6.2~Z3W2N709NDEA.0 size=1048576 2023-10-05T11:35:14.743 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.740+0000 7f26f5634780 1 > prepared part key=_multipart_U6172JUYW7J6.2~Z3W2N709NDEA.1 size=98070 2023-10-05T11:35:14.743 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.740+0000 7f26f5634780 1 > prepared multipart upload key=U6172JUYW7J6 upload=Z3W2N709NDEA tag=G2JGOQ3EL77W type=write size=2195222 2023-10-05T11:35:14.745 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.741+0000 7f26f5634780 1 < completed part key=_multipart_PC8WTJ8AYJ24.2~LVSYF6MMEX5G.0 size=860546 2023-10-05T11:35:14.747 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.743+0000 7f26f5634780 1 < completed multipart upload key=PC8WTJ8AYJ24 upload=LVSYF6MMEX5G tag=FB5G5B700U6G type=write size=1909122 2023-10-05T11:35:14.749 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.745+0000 7f26f5634780 1 > prepared part key=_multipart_9S0YW7PPSJ8G.2~MOSVV9ESOXM8.0 size=728579 2023-10-05T11:35:14.749 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.745+0000 7f26f5634780 1 > prepared multipart upload key=9S0YW7PPSJ8G upload=MOSVV9ESOXM8 tag=TID1TH1UQ0L5 type=write size=1777155 2023-10-05T11:35:14.750 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.747+0000 7f26f5634780 1 < completed delete operation key=S3DKYDFT4IO2 tag=1285BY7U0Y1T type=del 2023-10-05T11:35:14.751 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.748+0000 7f26f5634780 1 > prepared operation key=6DP3UJ4CW1MO tag=0BAXZHZOL7R0 type=del size=2321693 2023-10-05T11:35:14.752 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.748+0000 7f26f5634780 1 < canceled part key=_multipart_IC7T3ZK81WQS.2~OUVQTXQL4TGR.0 size=1048576 2023-10-05T11:35:14.753 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.749+0000 7f26f5634780 1 < completed part key=_multipart_IC7T3ZK81WQS.2~OUVQTXQL4TGR.1 size=1048576 2023-10-05T11:35:14.754 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.750+0000 7f26f5634780 1 < completed part key=_multipart_IC7T3ZK81WQS.2~OUVQTXQL4TGR.2 size=386765 2023-10-05T11:35:14.755 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.752+0000 7f26f5634780 1 < canceled multipart upload key=IC7T3ZK81WQS upload=OUVQTXQL4TGR tag=NPMXNKQUPL2Y type=write size=3532493 2023-10-05T11:35:14.757 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.753+0000 7f26f5634780 1 > prepared operation key=BTZUVE8R96XT tag=OQE16RD6TAQ1 type=del size=458223 2023-10-05T11:35:14.758 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.754+0000 7f26f5634780 1 < completed delete operation key=FOMNIIY47UUM tag=44GIFY6HOIIT type=del 2023-10-05T11:35:14.759 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.756+0000 7f26f5634780 1 > prepared operation key=PNV0Q6ZPLYV0 tag=6LFSG6BYL6Z6 type=del size=2708606 2023-10-05T11:35:14.760 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.757+0000 7f26f5634780 1 < completed delete operation key=2D4PDQQT54ZA tag=S4QLIHEOIDZX type=del 2023-10-05T11:35:14.763 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.759+0000 7f26f5634780 1 > prepared part key=_multipart_4D3H60UTIXH3.2~HBW04H2EEKOS.0 size=748551 2023-10-05T11:35:14.763 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.759+0000 7f26f5634780 1 > prepared multipart upload key=4D3H60UTIXH3 upload=HBW04H2EEKOS tag=WNHM6EU1RA8E type=write size=1797127 2023-10-05T11:35:14.764 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.761+0000 7f26f5634780 1 < completed part key=_multipart_IC7T3ZK81WQS.2~CE5U2AKSH6L4.0 size=944201 2023-10-05T11:35:14.766 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.763+0000 7f26f5634780 1 < completed multipart upload key=IC7T3ZK81WQS upload=CE5U2AKSH6L4 tag=D6X7WL5YBJO0 type=write size=1992777 2023-10-05T11:35:14.768 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.765+0000 7f26f5634780 1 > prepared part key=_multipart_MEY4SZRHU9NZ.2~ZLUNCZMR6RYP.0 size=1048576 2023-10-05T11:35:14.769 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.766+0000 7f26f5634780 1 > prepared part key=_multipart_MEY4SZRHU9NZ.2~ZLUNCZMR6RYP.1 size=241539 2023-10-05T11:35:14.769 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.766+0000 7f26f5634780 1 > prepared multipart upload key=MEY4SZRHU9NZ upload=ZLUNCZMR6RYP tag=C6GG9PP9H4HJ type=write size=2338691 2023-10-05T11:35:14.770 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.767+0000 7f26f5634780 1 < canceled operation key=IC7T3ZK81WQS tag=JY0T0AFOROA7 type=del size=819643 2023-10-05T11:35:14.773 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.769+0000 7f26f5634780 1 > prepared part key=_multipart_4D3H60UTIXH3.2~EUJ69U2QRP1T.0 size=602958 2023-10-05T11:35:14.773 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.769+0000 7f26f5634780 1 > prepared multipart upload key=4D3H60UTIXH3 upload=EUJ69U2QRP1T tag=LGOOJ1QC4TFE type=write size=1651534 2023-10-05T11:35:14.774 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.770+0000 7f26f5634780 1 < completed part key=_multipart_U6172JUYW7J6.2~L0O714O3F3ZQ.0 size=1048576 2023-10-05T11:35:14.775 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.771+0000 7f26f5634780 1 < completed part key=_multipart_U6172JUYW7J6.2~L0O714O3F3ZQ.1 size=1048576 2023-10-05T11:35:14.776 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.772+0000 7f26f5634780 1 < completed part key=_multipart_U6172JUYW7J6.2~L0O714O3F3ZQ.2 size=1035446 2023-10-05T11:35:14.778 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.774+0000 7f26f5634780 1 < completed multipart upload key=U6172JUYW7J6 upload=L0O714O3F3ZQ tag=EVZTR99RBSLV type=write size=4181174 2023-10-05T11:35:14.779 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.776+0000 7f26f5634780 1 > prepared operation key=0PWYKC7S6YJ4 tag=00EERRV3X6JH type=del size=1047957 2023-10-05T11:35:14.780 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.777+0000 7f26f5634780 1 < canceled operation key=7TOP5A52M9YP tag=M4BGNMPT1M75 type=del size=93851 2023-10-05T11:35:14.782 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.778+0000 7f26f5634780 1 > prepared operation key=WYN9BG66LA3K tag=JGT2V63FYPCF type=del size=1057407 2023-10-05T11:35:14.783 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.780+0000 7f26f5634780 1 < completed write operation key=761J2C7GHWU5 tag=36DM2Y2KSNON type=write size=519840 2023-10-05T11:35:14.784 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.781+0000 7f26f5634780 1 > prepared operation key=5V0Q651D4VN2 tag=HQBO3BNJ6BOG type=del size=415830 2023-10-05T11:35:14.785 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.781+0000 7f26f5634780 1 < canceled part key=_multipart_WTCWG1C1SF89.2~V3HWH4ULM2WH.0 size=1048576 2023-10-05T11:35:14.786 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.782+0000 7f26f5634780 1 < completed part key=_multipart_WTCWG1C1SF89.2~V3HWH4ULM2WH.1 size=408001 2023-10-05T11:35:14.788 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.784+0000 7f26f5634780 1 < canceled multipart upload key=WTCWG1C1SF89 upload=V3HWH4ULM2WH tag=WQYU2E4YKBEU type=write size=2505153 2023-10-05T11:35:14.789 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.786+0000 7f26f5634780 1 > prepared operation key=FOMNIIY47UUM tag=FESFJE7STIV8 type=del size=1864401 2023-10-05T11:35:14.790 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.787+0000 7f26f5634780 1 < completed part key=_multipart_0PWYKC7S6YJ4.2~7J7BTUXCZ9H6.0 size=464218 2023-10-05T11:35:14.792 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.789+0000 7f26f5634780 1 < completed multipart upload key=0PWYKC7S6YJ4 upload=7J7BTUXCZ9H6 tag=4KRDMCZOBOLU type=write size=1512794 2023-10-05T11:35:14.793 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.790+0000 7f26f5634780 1 > prepared operation key=4D3H60UTIXH3 tag=BIWQJVTGB2SX type=write size=790849 2023-10-05T11:35:14.795 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.791+0000 7f26f5634780 1 < completed part key=_multipart_W2GWVGX42QLD.2~3QZ41ESYZUCG.0 size=1048576 2023-10-05T11:35:14.796 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.792+0000 7f26f5634780 1 < completed part key=_multipart_W2GWVGX42QLD.2~3QZ41ESYZUCG.1 size=1048576 2023-10-05T11:35:14.797 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.793+0000 7f26f5634780 1 < completed part key=_multipart_W2GWVGX42QLD.2~3QZ41ESYZUCG.2 size=89385 2023-10-05T11:35:14.799 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.795+0000 7f26f5634780 1 < completed multipart upload key=W2GWVGX42QLD upload=3QZ41ESYZUCG tag=5A5QNYYFDB3Z type=write size=3235113 2023-10-05T11:35:14.800 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.797+0000 7f26f5634780 1 > prepared operation key=2D4PDQQT54ZA tag=N4TG9KUBKUI7 type=del size=2088729 2023-10-05T11:35:14.801 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.798+0000 7f26f5634780 1 < completed part key=_multipart_761J2C7GHWU5.2~PAYV65KB1U8E.0 size=1048576 2023-10-05T11:35:14.802 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.799+0000 7f26f5634780 1 < completed part key=_multipart_761J2C7GHWU5.2~PAYV65KB1U8E.1 size=1048576 2023-10-05T11:35:14.803 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.800+0000 7f26f5634780 1 < completed part key=_multipart_761J2C7GHWU5.2~PAYV65KB1U8E.2 size=572543 2023-10-05T11:35:14.805 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.802+0000 7f26f5634780 1 < completed multipart upload key=761J2C7GHWU5 upload=PAYV65KB1U8E tag=GG10OLGN8PR5 type=write size=3718271 2023-10-05T11:35:14.806 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.803+0000 7f26f5634780 1 > prepared operation key=4D3H60UTIXH3 tag=0CRUCA21TWL1 type=del size=3589013 2023-10-05T11:35:14.808 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.804+0000 7f26f5634780 1 < completed delete operation key=U6172JUYW7J6 tag=ZWDIP0RRLD1D type=del 2023-10-05T11:35:14.809 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.806+0000 7f26f5634780 1 > prepared operation key=5OPHKTHXVN5U tag=KZAFGS3VA7OT type=del size=2943288 2023-10-05T11:35:14.809 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.806+0000 7f26f5634780 1 < canceled part key=_multipart_U6172JUYW7J6.2~Z3W2N709NDEA.0 size=1048576 2023-10-05T11:35:14.810 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.807+0000 7f26f5634780 1 < completed part key=_multipart_U6172JUYW7J6.2~Z3W2N709NDEA.1 size=98070 2023-10-05T11:35:14.812 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.809+0000 7f26f5634780 1 < canceled multipart upload key=U6172JUYW7J6 upload=Z3W2N709NDEA tag=G2JGOQ3EL77W type=write size=2195222 2023-10-05T11:35:14.815 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.811+0000 7f26f5634780 1 > prepared part key=_multipart_LLR5J3X15W5R.2~7AHTPQTLI0FJ.0 size=1048576 2023-10-05T11:35:14.816 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.812+0000 7f26f5634780 1 > prepared part key=_multipart_LLR5J3X15W5R.2~7AHTPQTLI0FJ.1 size=855786 2023-10-05T11:35:14.816 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.812+0000 7f26f5634780 1 > prepared multipart upload key=LLR5J3X15W5R upload=7AHTPQTLI0FJ tag=XPMSVLBKTNL5 type=write size=2952938 2023-10-05T11:35:14.817 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.814+0000 7f26f5634780 1 < completed part key=_multipart_9S0YW7PPSJ8G.2~MOSVV9ESOXM8.0 size=728579 2023-10-05T11:35:14.819 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.816+0000 7f26f5634780 1 < completed multipart upload key=9S0YW7PPSJ8G upload=MOSVV9ESOXM8 tag=TID1TH1UQ0L5 type=write size=1777155 2023-10-05T11:35:14.820 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.817+0000 7f26f5634780 1 > prepared operation key=7TOP5A52M9YP tag=PC5RDUFILUMF type=del size=1253412 2023-10-05T11:35:14.822 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.818+0000 7f26f5634780 1 < completed delete operation key=6DP3UJ4CW1MO tag=0BAXZHZOL7R0 type=del 2023-10-05T11:35:14.825 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.822+0000 7f26f5634780 1 > prepared part key=_multipart_AV0XKXX1IR4B.2~7SRXUEGCW60R.0 size=1048576 2023-10-05T11:35:14.826 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.822+0000 7f26f5634780 1 > prepared part key=_multipart_AV0XKXX1IR4B.2~7SRXUEGCW60R.1 size=997704 2023-10-05T11:35:14.826 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.823+0000 7f26f5634780 1 > prepared multipart upload key=AV0XKXX1IR4B upload=7SRXUEGCW60R tag=1LAEANQKTBWY type=write size=3094856 2023-10-05T11:35:14.828 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.825+0000 7f26f5634780 1 < suggested update operation key=BTZUVE8R96XT tag=OQE16RD6TAQ1 type=del size=458223 2023-10-05T11:35:14.829 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.826+0000 7f26f5634780 1 > prepared operation key=IKCNZOTVWOC6 tag=U5BU37MXZJXX type=del size=3896157 2023-10-05T11:35:14.830 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.827+0000 7f26f5634780 1 < completed delete operation key=PNV0Q6ZPLYV0 tag=6LFSG6BYL6Z6 type=del 2023-10-05T11:35:14.832 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.829+0000 7f26f5634780 1 > prepared part key=_multipart_W2GWVGX42QLD.2~ZE8YFKNZAFDS.0 size=1048576 2023-10-05T11:35:14.833 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.830+0000 7f26f5634780 1 > prepared part key=_multipart_W2GWVGX42QLD.2~ZE8YFKNZAFDS.1 size=1048576 2023-10-05T11:35:14.834 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.831+0000 7f26f5634780 1 > prepared part key=_multipart_W2GWVGX42QLD.2~ZE8YFKNZAFDS.2 size=736388 2023-10-05T11:35:14.834 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.831+0000 7f26f5634780 1 > prepared multipart upload key=W2GWVGX42QLD upload=ZE8YFKNZAFDS tag=6PN37QNB92EU type=write size=3882116 2023-10-05T11:35:14.835 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.832+0000 7f26f5634780 1 < completed part key=_multipart_4D3H60UTIXH3.2~HBW04H2EEKOS.0 size=748551 2023-10-05T11:35:14.837 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.834+0000 7f26f5634780 1 < completed multipart upload key=4D3H60UTIXH3 upload=HBW04H2EEKOS tag=WNHM6EU1RA8E type=write size=1797127 2023-10-05T11:35:14.839 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.836+0000 7f26f5634780 1 > prepared operation key=6DP3UJ4CW1MO tag=PXDO63X0YK16 type=del size=513414 2023-10-05T11:35:14.840 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.837+0000 7f26f5634780 1 < completed part key=_multipart_MEY4SZRHU9NZ.2~ZLUNCZMR6RYP.0 size=1048576 2023-10-05T11:35:14.841 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.838+0000 7f26f5634780 1 < completed part key=_multipart_MEY4SZRHU9NZ.2~ZLUNCZMR6RYP.1 size=241539 2023-10-05T11:35:14.843 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.840+0000 7f26f5634780 1 < completed multipart upload key=MEY4SZRHU9NZ upload=ZLUNCZMR6RYP tag=C6GG9PP9H4HJ type=write size=2338691 2023-10-05T11:35:14.844 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.841+0000 7f26f5634780 1 > prepared operation key=5V0Q651D4VN2 tag=KMMVQI7VC5L4 type=del size=1543463 2023-10-05T11:35:14.845 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.842+0000 7f26f5634780 1 < completed part key=_multipart_4D3H60UTIXH3.2~EUJ69U2QRP1T.0 size=602958 2023-10-05T11:35:14.847 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.844+0000 7f26f5634780 1 < completed multipart upload key=4D3H60UTIXH3 upload=EUJ69U2QRP1T tag=LGOOJ1QC4TFE type=write size=1651534 2023-10-05T11:35:14.848 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.845+0000 7f26f5634780 1 > prepared operation key=U6172JUYW7J6 tag=L03BR4RC0ZES type=del size=1511779 2023-10-05T11:35:14.849 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.846+0000 7f26f5634780 1 < canceled operation key=0PWYKC7S6YJ4 tag=00EERRV3X6JH type=del size=1047957 2023-10-05T11:35:14.852 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.848+0000 7f26f5634780 1 > prepared part key=_multipart_AV0XKXX1IR4B.2~5PS171I31MU5.0 size=1048576 2023-10-05T11:35:14.853 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.849+0000 7f26f5634780 1 > prepared part key=_multipart_AV0XKXX1IR4B.2~5PS171I31MU5.1 size=1048576 2023-10-05T11:35:14.854 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.850+0000 7f26f5634780 1 > prepared part key=_multipart_AV0XKXX1IR4B.2~5PS171I31MU5.2 size=264145 2023-10-05T11:35:14.854 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.850+0000 7f26f5634780 1 > prepared multipart upload key=AV0XKXX1IR4B upload=5PS171I31MU5 tag=1E7S1F81UAMY type=write size=3409873 2023-10-05T11:35:14.855 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.851+0000 7f26f5634780 1 < canceled operation key=WYN9BG66LA3K tag=JGT2V63FYPCF type=del size=1057407 2023-10-05T11:35:14.856 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.853+0000 7f26f5634780 1 > prepared operation key=U6172JUYW7J6 tag=SMS1E5KJAYT1 type=write size=1034956 2023-10-05T11:35:14.857 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.854+0000 7f26f5634780 1 < canceled operation key=5V0Q651D4VN2 tag=HQBO3BNJ6BOG type=del size=415830 2023-10-05T11:35:14.858 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.855+0000 7f26f5634780 1 > prepared operation key=WYN9BG66LA3K tag=4QWORO1VPB7F type=write size=484911 2023-10-05T11:35:14.861 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.857+0000 7f26f5634780 1 < suggested remove operation key=FOMNIIY47UUM tag=FESFJE7STIV8 type=del 2023-10-05T11:35:14.862 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.859+0000 7f26f5634780 1 > prepared operation key=4D3H60UTIXH3 tag=UQSTHE9AAK9I type=del size=3941702 2023-10-05T11:35:14.863 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.860+0000 7f26f5634780 1 < completed write operation key=4D3H60UTIXH3 tag=BIWQJVTGB2SX type=write size=790849 2023-10-05T11:35:14.864 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.861+0000 7f26f5634780 1 > prepared operation key=PNV0Q6ZPLYV0 tag=ZDVOJEF16374 type=del size=1020949 2023-10-05T11:35:14.866 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.862+0000 7f26f5634780 1 < canceled operation key=2D4PDQQT54ZA tag=N4TG9KUBKUI7 type=del size=2088729 2023-10-05T11:35:14.868 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.865+0000 7f26f5634780 1 > prepared part key=_multipart_2D4PDQQT54ZA.2~4NKTW25FA8CK.0 size=525577 2023-10-05T11:35:14.868 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.865+0000 7f26f5634780 1 > prepared multipart upload key=2D4PDQQT54ZA upload=4NKTW25FA8CK tag=U0GVPZ8V3WOF type=write size=1574153 2023-10-05T11:35:14.869 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.866+0000 7f26f5634780 1 < completed delete operation key=4D3H60UTIXH3 tag=0CRUCA21TWL1 type=del 2023-10-05T11:35:14.871 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.868+0000 7f26f5634780 1 > prepared part key=_multipart_4IBQJLJR7LD8.2~RE359SP92NYW.0 size=1048576 2023-10-05T11:35:14.872 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.869+0000 7f26f5634780 1 > prepared part key=_multipart_4IBQJLJR7LD8.2~RE359SP92NYW.1 size=1048576 2023-10-05T11:35:14.873 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.870+0000 7f26f5634780 1 > prepared part key=_multipart_4IBQJLJR7LD8.2~RE359SP92NYW.2 size=778751 2023-10-05T11:35:14.873 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.870+0000 7f26f5634780 1 > prepared multipart upload key=4IBQJLJR7LD8 upload=RE359SP92NYW tag=X1W8ZPDWO0J2 type=write size=3924479 2023-10-05T11:35:14.874 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.871+0000 7f26f5634780 1 < canceled operation key=5OPHKTHXVN5U tag=KZAFGS3VA7OT type=del size=2943288 2023-10-05T11:35:14.876 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.872+0000 7f26f5634780 1 > prepared operation key=U6172JUYW7J6 tag=T3LX5BQLF30P type=write size=864266 2023-10-05T11:35:14.877 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.873+0000 7f26f5634780 1 < completed part key=_multipart_LLR5J3X15W5R.2~7AHTPQTLI0FJ.0 size=1048576 2023-10-05T11:35:14.878 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.874+0000 7f26f5634780 1 < completed part key=_multipart_LLR5J3X15W5R.2~7AHTPQTLI0FJ.1 size=855786 2023-10-05T11:35:14.882 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.876+0000 7f26f5634780 1 < completed multipart upload key=LLR5J3X15W5R upload=7AHTPQTLI0FJ tag=XPMSVLBKTNL5 type=write size=2952938 2023-10-05T11:35:14.882 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.878+0000 7f26f5634780 1 > prepared operation key=J5EIH25Y471T tag=084NR1RHB6YI type=write size=398170 2023-10-05T11:35:14.883 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.879+0000 7f26f5634780 1 < completed delete operation key=7TOP5A52M9YP tag=PC5RDUFILUMF type=del 2023-10-05T11:35:14.884 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.881+0000 7f26f5634780 1 > prepared operation key=7TOP5A52M9YP tag=K6TRC24X4HTS type=del size=3507836 2023-10-05T11:35:14.885 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.882+0000 7f26f5634780 1 < completed part key=_multipart_AV0XKXX1IR4B.2~7SRXUEGCW60R.0 size=1048576 2023-10-05T11:35:14.886 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.883+0000 7f26f5634780 1 < completed part key=_multipart_AV0XKXX1IR4B.2~7SRXUEGCW60R.1 size=997704 2023-10-05T11:35:14.888 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.885+0000 7f26f5634780 1 < completed multipart upload key=AV0XKXX1IR4B upload=7SRXUEGCW60R tag=1LAEANQKTBWY type=write size=3094856 2023-10-05T11:35:14.889 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.886+0000 7f26f5634780 1 > prepared operation key=PNV0Q6ZPLYV0 tag=31X3GMYEXAUW type=del size=3979549 2023-10-05T11:35:14.890 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.887+0000 7f26f5634780 1 < completed delete operation key=IKCNZOTVWOC6 tag=U5BU37MXZJXX type=del 2023-10-05T11:35:14.892 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.888+0000 7f26f5634780 1 > prepared operation key=BU3KSHTINB36 tag=KAZ70FFL35BO type=del size=2665247 2023-10-05T11:35:14.892 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.889+0000 7f26f5634780 1 < canceled part key=_multipart_W2GWVGX42QLD.2~ZE8YFKNZAFDS.0 size=1048576 2023-10-05T11:35:14.893 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.889+0000 7f26f5634780 1 < completed part key=_multipart_W2GWVGX42QLD.2~ZE8YFKNZAFDS.1 size=1048576 2023-10-05T11:35:14.894 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.890+0000 7f26f5634780 1 < completed part key=_multipart_W2GWVGX42QLD.2~ZE8YFKNZAFDS.2 size=736388 2023-10-05T11:35:14.896 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.892+0000 7f26f5634780 1 < canceled multipart upload key=W2GWVGX42QLD upload=ZE8YFKNZAFDS tag=6PN37QNB92EU type=write size=3882116 2023-10-05T11:35:14.898 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.894+0000 7f26f5634780 1 > prepared part key=_multipart_LLR5J3X15W5R.2~LM2WLP2NUDS5.0 size=1038049 2023-10-05T11:35:14.898 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.894+0000 7f26f5634780 1 > prepared multipart upload key=LLR5J3X15W5R upload=LM2WLP2NUDS5 tag=ADYVL5JADK3V type=write size=2086625 2023-10-05T11:35:14.899 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.896+0000 7f26f5634780 1 < completed delete operation key=6DP3UJ4CW1MO tag=PXDO63X0YK16 type=del 2023-10-05T11:35:14.900 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.897+0000 7f26f5634780 1 > prepared operation key=5V0Q651D4VN2 tag=IWQJKGQGACYX type=del size=149630 2023-10-05T11:35:14.901 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.898+0000 7f26f5634780 1 < completed delete operation key=5V0Q651D4VN2 tag=KMMVQI7VC5L4 type=del 2023-10-05T11:35:14.902 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.899+0000 7f26f5634780 1 > prepared operation key=J5EIH25Y471T tag=GN0GW45FSLS8 type=write size=624609 2023-10-05T11:35:14.904 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.900+0000 7f26f5634780 1 < completed delete operation key=U6172JUYW7J6 tag=L03BR4RC0ZES type=del 2023-10-05T11:35:14.905 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.901+0000 7f26f5634780 1 > prepared operation key=8IPCP77WVVZT tag=H0CN3GCQIMO0 type=del size=721958 2023-10-05T11:35:14.906 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.903+0000 7f26f5634780 1 < completed part key=_multipart_AV0XKXX1IR4B.2~5PS171I31MU5.0 size=1048576 2023-10-05T11:35:14.907 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.904+0000 7f26f5634780 1 < completed part key=_multipart_AV0XKXX1IR4B.2~5PS171I31MU5.1 size=1048576 2023-10-05T11:35:14.908 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.904+0000 7f26f5634780 1 < completed part key=_multipart_AV0XKXX1IR4B.2~5PS171I31MU5.2 size=264145 2023-10-05T11:35:14.910 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.906+0000 7f26f5634780 1 < completed multipart upload key=AV0XKXX1IR4B upload=5PS171I31MU5 tag=1E7S1F81UAMY type=write size=3409873 2023-10-05T11:35:14.911 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.907+0000 7f26f5634780 1 > prepared operation key=5V0Q651D4VN2 tag=X0PJYAD1FEDJ type=del size=1701834 2023-10-05T11:35:14.913 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.910+0000 7f26f5634780 1 < suggested update operation key=U6172JUYW7J6 tag=SMS1E5KJAYT1 type=write size=1034956 2023-10-05T11:35:14.915 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.912+0000 7f26f5634780 1 > prepared part key=_multipart_PC8WTJ8AYJ24.2~5RYY7U5NYZTG.0 size=1048576 2023-10-05T11:35:14.916 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.912+0000 7f26f5634780 1 > prepared part key=_multipart_PC8WTJ8AYJ24.2~5RYY7U5NYZTG.1 size=1048576 2023-10-05T11:35:14.917 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.913+0000 7f26f5634780 1 > prepared part key=_multipart_PC8WTJ8AYJ24.2~5RYY7U5NYZTG.2 size=398981 2023-10-05T11:35:14.917 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.913+0000 7f26f5634780 1 > prepared multipart upload key=PC8WTJ8AYJ24 upload=5RYY7U5NYZTG tag=ZX2XEASZ56KN type=write size=3544709 2023-10-05T11:35:14.919 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.916+0000 7f26f5634780 1 < suggested remove operation key=WYN9BG66LA3K tag=4QWORO1VPB7F type=write 2023-10-05T11:35:14.920 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.917+0000 7f26f5634780 1 > prepared operation key=2D4PDQQT54ZA tag=05S47O5IS0HM type=del size=542065 2023-10-05T11:35:14.921 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.918+0000 7f26f5634780 1 < completed delete operation key=4D3H60UTIXH3 tag=UQSTHE9AAK9I type=del 2023-10-05T11:35:14.922 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.919+0000 7f26f5634780 1 > prepared operation key=J5EIH25Y471T tag=3MX7BE9OY7LT type=del size=2805676 2023-10-05T11:35:14.924 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.920+0000 7f26f5634780 1 < completed delete operation key=PNV0Q6ZPLYV0 tag=ZDVOJEF16374 type=del 2023-10-05T11:35:14.926 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.923+0000 7f26f5634780 1 > prepared part key=_multipart_MEY4SZRHU9NZ.2~9KTMQIE4EFSJ.0 size=1048576 2023-10-05T11:35:14.927 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.923+0000 7f26f5634780 1 > prepared part key=_multipart_MEY4SZRHU9NZ.2~9KTMQIE4EFSJ.1 size=1048576 2023-10-05T11:35:14.928 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.924+0000 7f26f5634780 1 > prepared part key=_multipart_MEY4SZRHU9NZ.2~9KTMQIE4EFSJ.2 size=1042188 2023-10-05T11:35:14.928 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.924+0000 7f26f5634780 1 > prepared multipart upload key=MEY4SZRHU9NZ upload=9KTMQIE4EFSJ tag=VGLN00RUJPBU type=write size=4187916 2023-10-05T11:35:14.929 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.926+0000 7f26f5634780 1 < completed part key=_multipart_2D4PDQQT54ZA.2~4NKTW25FA8CK.0 size=525577 2023-10-05T11:35:14.931 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.928+0000 7f26f5634780 1 < completed multipart upload key=2D4PDQQT54ZA upload=4NKTW25FA8CK tag=U0GVPZ8V3WOF type=write size=1574153 2023-10-05T11:35:14.933 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.930+0000 7f26f5634780 1 > prepared part key=_multipart_7TOP5A52M9YP.2~64IXSJQ6QAK5.0 size=871278 2023-10-05T11:35:14.933 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.930+0000 7f26f5634780 1 > prepared multipart upload key=7TOP5A52M9YP upload=64IXSJQ6QAK5 tag=6B4FDID99CXY type=write size=1919854 2023-10-05T11:35:14.934 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.930+0000 7f26f5634780 1 < canceled part key=_multipart_4IBQJLJR7LD8.2~RE359SP92NYW.0 size=1048576 2023-10-05T11:35:14.936 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.932+0000 7f26f5634780 1 < completed part key=_multipart_4IBQJLJR7LD8.2~RE359SP92NYW.1 size=1048576 2023-10-05T11:35:14.937 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.933+0000 7f26f5634780 1 < completed part key=_multipart_4IBQJLJR7LD8.2~RE359SP92NYW.2 size=778751 2023-10-05T11:35:14.940 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.937+0000 7f26f5634780 1 < canceled multipart upload key=4IBQJLJR7LD8 upload=RE359SP92NYW tag=X1W8ZPDWO0J2 type=write size=3924479 2023-10-05T11:35:14.941 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.938+0000 7f26f5634780 1 > prepared operation key=7TOP5A52M9YP tag=B0M8Y726QNDI type=write size=373152 2023-10-05T11:35:14.943 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.939+0000 7f26f5634780 -1 < failed to complete operation key=U6172JUYW7J6 tag=T3LX5BQLF30P type=write size=864266: (22) Invalid argument 2023-10-05T11:35:14.944 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.940+0000 7f26f5634780 1 > prepared operation key=BTZUVE8R96XT tag=AM0X8W1FV96X type=write size=755793 2023-10-05T11:35:14.945 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.942+0000 7f26f5634780 1 < completed write operation key=J5EIH25Y471T tag=084NR1RHB6YI type=write size=398170 2023-10-05T11:35:14.946 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.943+0000 7f26f5634780 1 > prepared operation key=BTZUVE8R96XT tag=2V1LH7NXVHXJ type=del size=1036929 2023-10-05T11:35:14.949 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.946+0000 7f26f5634780 1 < completed delete operation key=7TOP5A52M9YP tag=K6TRC24X4HTS type=del 2023-10-05T11:35:14.950 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.947+0000 7f26f5634780 1 > prepared operation key=5OPHKTHXVN5U tag=O0OLIH56WWIX type=del size=2325697 2023-10-05T11:35:14.952 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.948+0000 7f26f5634780 1 < canceled operation key=PNV0Q6ZPLYV0 tag=31X3GMYEXAUW type=del size=3979549 2023-10-05T11:35:14.953 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.950+0000 7f26f5634780 1 > prepared operation key=2U0NRDGDNUTA tag=V526RA7619UO type=del size=3379096 2023-10-05T11:35:14.955 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.951+0000 7f26f5634780 1 < completed delete operation key=BU3KSHTINB36 tag=KAZ70FFL35BO type=del 2023-10-05T11:35:14.956 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.952+0000 7f26f5634780 1 > prepared operation key=7W9LL5HSU3BG tag=UV0WZNER20AI type=del size=936113 2023-10-05T11:35:14.957 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.954+0000 7f26f5634780 1 < completed part key=_multipart_LLR5J3X15W5R.2~LM2WLP2NUDS5.0 size=1038049 2023-10-05T11:35:14.960 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.956+0000 7f26f5634780 1 < completed multipart upload key=LLR5J3X15W5R upload=LM2WLP2NUDS5 tag=ADYVL5JADK3V type=write size=2086625 2023-10-05T11:35:14.962 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.959+0000 7f26f5634780 1 > prepared part key=_multipart_AV0XKXX1IR4B.2~IXIZT5AE3K4L.0 size=1048576 2023-10-05T11:35:14.963 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.960+0000 7f26f5634780 1 > prepared part key=_multipart_AV0XKXX1IR4B.2~IXIZT5AE3K4L.1 size=1048576 2023-10-05T11:35:14.964 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.960+0000 7f26f5634780 1 > prepared part key=_multipart_AV0XKXX1IR4B.2~IXIZT5AE3K4L.2 size=209323 2023-10-05T11:35:14.964 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.960+0000 7f26f5634780 1 > prepared multipart upload key=AV0XKXX1IR4B upload=IXIZT5AE3K4L tag=B6D0H04HZDIA type=write size=3355051 2023-10-05T11:35:14.965 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.962+0000 7f26f5634780 1 < completed delete operation key=5V0Q651D4VN2 tag=IWQJKGQGACYX type=del 2023-10-05T11:35:14.966 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.963+0000 7f26f5634780 1 > prepared operation key=FOMNIIY47UUM tag=DQB9YVSHC002 type=del size=2934190 2023-10-05T11:35:14.968 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.964+0000 7f26f5634780 1 < completed write operation key=J5EIH25Y471T tag=GN0GW45FSLS8 type=write size=624609 2023-10-05T11:35:14.969 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.966+0000 7f26f5634780 1 > prepared operation key=W2GWVGX42QLD tag=KPL2L25119SR type=del size=2415777 2023-10-05T11:35:14.971 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.967+0000 7f26f5634780 1 < completed delete operation key=8IPCP77WVVZT tag=H0CN3GCQIMO0 type=del 2023-10-05T11:35:14.973 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.970+0000 7f26f5634780 1 > prepared part key=_multipart_WYN9BG66LA3K.2~EF5E2HHOMJG3.0 size=1018859 2023-10-05T11:35:14.973 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.970+0000 7f26f5634780 1 > prepared multipart upload key=WYN9BG66LA3K upload=EF5E2HHOMJG3 tag=KUB2CZUVQ4D4 type=write size=2067435 2023-10-05T11:35:14.976 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.973+0000 7f26f5634780 1 < suggested remove operation key=5V0Q651D4VN2 tag=X0PJYAD1FEDJ type=del 2023-10-05T11:35:14.978 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.975+0000 7f26f5634780 1 > prepared part key=_multipart_S3DKYDFT4IO2.2~MJ2WBF82NCN8.0 size=626208 2023-10-05T11:35:14.978 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.975+0000 7f26f5634780 1 > prepared multipart upload key=S3DKYDFT4IO2 upload=MJ2WBF82NCN8 tag=32J85ZSLZQ14 type=write size=1674784 2023-10-05T11:35:14.980 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.976+0000 7f26f5634780 1 < completed part key=_multipart_PC8WTJ8AYJ24.2~5RYY7U5NYZTG.0 size=1048576 2023-10-05T11:35:14.980 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.976+0000 7f26f5634780 1 < canceled part key=_multipart_PC8WTJ8AYJ24.2~5RYY7U5NYZTG.1 size=1048576 2023-10-05T11:35:14.981 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.977+0000 7f26f5634780 1 < completed part key=_multipart_PC8WTJ8AYJ24.2~5RYY7U5NYZTG.2 size=398981 2023-10-05T11:35:14.983 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.979+0000 7f26f5634780 1 < canceled multipart upload key=PC8WTJ8AYJ24 upload=5RYY7U5NYZTG tag=ZX2XEASZ56KN type=write size=3544709 2023-10-05T11:35:14.984 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.980+0000 7f26f5634780 1 > prepared operation key=9S0YW7PPSJ8G tag=FABUNHPTO8DP type=write size=264437 2023-10-05T11:35:14.985 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.982+0000 7f26f5634780 1 < completed delete operation key=2D4PDQQT54ZA tag=05S47O5IS0HM type=del 2023-10-05T11:35:14.987 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.984+0000 7f26f5634780 1 > prepared part key=_multipart_9S0YW7PPSJ8G.2~C93JEI2SXWXA.0 size=725048 2023-10-05T11:35:14.987 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.984+0000 7f26f5634780 1 > prepared multipart upload key=9S0YW7PPSJ8G upload=C93JEI2SXWXA tag=0D250T3YJS4X type=write size=1773624 2023-10-05T11:35:14.990 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.987+0000 7f26f5634780 1 < suggested remove operation key=J5EIH25Y471T tag=3MX7BE9OY7LT type=del 2023-10-05T11:35:14.992 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.988+0000 7f26f5634780 1 > prepared operation key=J5EIH25Y471T tag=12RU29ISSS1L type=del size=1482582 2023-10-05T11:35:14.993 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.989+0000 7f26f5634780 1 < completed part key=_multipart_MEY4SZRHU9NZ.2~9KTMQIE4EFSJ.0 size=1048576 2023-10-05T11:35:14.994 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.991+0000 7f26f5634780 1 < completed part key=_multipart_MEY4SZRHU9NZ.2~9KTMQIE4EFSJ.1 size=1048576 2023-10-05T11:35:14.995 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.992+0000 7f26f5634780 1 < completed part key=_multipart_MEY4SZRHU9NZ.2~9KTMQIE4EFSJ.2 size=1042188 2023-10-05T11:35:14.998 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.994+0000 7f26f5634780 1 < completed multipart upload key=MEY4SZRHU9NZ upload=9KTMQIE4EFSJ tag=VGLN00RUJPBU type=write size=4187916 2023-10-05T11:35:14.999 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.995+0000 7f26f5634780 1 > prepared operation key=BTZUVE8R96XT tag=JI6UVTLI7O97 type=del size=2343440 2023-10-05T11:35:14.999 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.996+0000 7f26f5634780 1 < canceled part key=_multipart_7TOP5A52M9YP.2~64IXSJQ6QAK5.0 size=871278 2023-10-05T11:35:15.001 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:14.998+0000 7f26f5634780 1 < canceled multipart upload key=7TOP5A52M9YP upload=64IXSJQ6QAK5 tag=6B4FDID99CXY type=write size=1919854 2023-10-05T11:35:15.004 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.000+0000 7f26f5634780 1 > prepared part key=_multipart_4IBQJLJR7LD8.2~N9N0JEQ4PT67.0 size=1048576 2023-10-05T11:35:15.005 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.001+0000 7f26f5634780 1 > prepared part key=_multipart_4IBQJLJR7LD8.2~N9N0JEQ4PT67.1 size=1048576 2023-10-05T11:35:15.006 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.002+0000 7f26f5634780 1 > prepared part key=_multipart_4IBQJLJR7LD8.2~N9N0JEQ4PT67.2 size=706684 2023-10-05T11:35:15.006 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.002+0000 7f26f5634780 1 > prepared multipart upload key=4IBQJLJR7LD8 upload=N9N0JEQ4PT67 tag=4N8TJ29YG3QS type=write size=3852412 2023-10-05T11:35:15.007 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.004+0000 7f26f5634780 1 < completed write operation key=7TOP5A52M9YP tag=B0M8Y726QNDI type=write size=373152 2023-10-05T11:35:15.008 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.005+0000 7f26f5634780 1 > prepared operation key=9S0YW7PPSJ8G tag=057W653ROAYU type=write size=833810 2023-10-05T11:35:15.010 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.006+0000 7f26f5634780 1 < completed write operation key=BTZUVE8R96XT tag=AM0X8W1FV96X type=write size=755793 2023-10-05T11:35:15.012 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.009+0000 7f26f5634780 1 > prepared part key=_multipart_7TOP5A52M9YP.2~GWOPETR76FIP.0 size=1048576 2023-10-05T11:35:15.013 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.010+0000 7f26f5634780 1 > prepared part key=_multipart_7TOP5A52M9YP.2~GWOPETR76FIP.1 size=1048576 2023-10-05T11:35:15.014 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.011+0000 7f26f5634780 1 > prepared part key=_multipart_7TOP5A52M9YP.2~GWOPETR76FIP.2 size=244146 2023-10-05T11:35:15.014 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.011+0000 7f26f5634780 1 > prepared multipart upload key=7TOP5A52M9YP upload=GWOPETR76FIP tag=B57S74PC8UXB type=write size=3389874 2023-10-05T11:35:15.016 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.012+0000 7f26f5634780 1 < canceled operation key=BTZUVE8R96XT tag=2V1LH7NXVHXJ type=del size=1036929 2023-10-05T11:35:15.017 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.013+0000 7f26f5634780 1 > prepared operation key=7W9LL5HSU3BG tag=MII7JTNXZ3ZC type=del size=1794313 2023-10-05T11:35:15.018 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.015+0000 7f26f5634780 1 < completed delete operation key=5OPHKTHXVN5U tag=O0OLIH56WWIX type=del 2023-10-05T11:35:15.019 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.016+0000 7f26f5634780 1 > prepared operation key=BU3KSHTINB36 tag=J7V0VGBAAXU4 type=write size=750840 2023-10-05T11:35:15.021 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.017+0000 7f26f5634780 1 < completed delete operation key=2U0NRDGDNUTA tag=V526RA7619UO type=del 2023-10-05T11:35:15.022 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.018+0000 7f26f5634780 1 > prepared operation key=LLR5J3X15W5R tag=1KYZBYLOF5CN type=del size=2766378 2023-10-05T11:35:15.023 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.020+0000 7f26f5634780 1 < completed delete operation key=7W9LL5HSU3BG tag=UV0WZNER20AI type=del 2023-10-05T11:35:15.024 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.021+0000 7f26f5634780 1 > prepared operation key=IC7T3ZK81WQS tag=FOI7KF2AI14R type=write size=52520 2023-10-05T11:35:15.025 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.021+0000 7f26f5634780 1 < canceled part key=_multipart_AV0XKXX1IR4B.2~IXIZT5AE3K4L.0 size=1048576 2023-10-05T11:35:15.026 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.022+0000 7f26f5634780 1 < completed part key=_multipart_AV0XKXX1IR4B.2~IXIZT5AE3K4L.1 size=1048576 2023-10-05T11:35:15.027 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.023+0000 7f26f5634780 1 < completed part key=_multipart_AV0XKXX1IR4B.2~IXIZT5AE3K4L.2 size=209323 2023-10-05T11:35:15.029 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.025+0000 7f26f5634780 1 < canceled multipart upload key=AV0XKXX1IR4B upload=IXIZT5AE3K4L tag=B6D0H04HZDIA type=write size=3355051 2023-10-05T11:35:15.030 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.026+0000 7f26f5634780 1 > prepared operation key=QYQDXVIGZ7O8 tag=MDA65SM1MEE8 type=del size=2356915 2023-10-05T11:35:15.031 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.028+0000 7f26f5634780 1 < completed delete operation key=FOMNIIY47UUM tag=DQB9YVSHC002 type=del 2023-10-05T11:35:15.033 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.029+0000 7f26f5634780 1 > prepared operation key=4D3H60UTIXH3 tag=ABKZXD06WI4J type=write size=13288 2023-10-05T11:35:15.035 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.031+0000 7f26f5634780 1 < suggested update operation key=W2GWVGX42QLD tag=KPL2L25119SR type=del size=2415777 2023-10-05T11:35:15.036 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.033+0000 7f26f5634780 1 > prepared operation key=7TOP5A52M9YP tag=ZW300KMPSD65 type=del size=1880960 2023-10-05T11:35:15.037 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.034+0000 7f26f5634780 1 < completed part key=_multipart_WYN9BG66LA3K.2~EF5E2HHOMJG3.0 size=1018859 2023-10-05T11:35:15.039 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.036+0000 7f26f5634780 1 < completed multipart upload key=WYN9BG66LA3K upload=EF5E2HHOMJG3 tag=KUB2CZUVQ4D4 type=write size=2067435 2023-10-05T11:35:15.041 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.038+0000 7f26f5634780 1 > prepared part key=_multipart_4IBQJLJR7LD8.2~56D0PGO2S6W5.0 size=1048576 2023-10-05T11:35:15.042 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.039+0000 7f26f5634780 1 > prepared part key=_multipart_4IBQJLJR7LD8.2~56D0PGO2S6W5.1 size=465483 2023-10-05T11:35:15.042 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.039+0000 7f26f5634780 1 > prepared multipart upload key=4IBQJLJR7LD8 upload=56D0PGO2S6W5 tag=6BZ17J0IYDYY type=write size=2562635 2023-10-05T11:35:15.043 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.040+0000 7f26f5634780 1 < completed part key=_multipart_S3DKYDFT4IO2.2~MJ2WBF82NCN8.0 size=626208 2023-10-05T11:35:15.045 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.042+0000 7f26f5634780 1 < completed multipart upload key=S3DKYDFT4IO2 upload=MJ2WBF82NCN8 tag=32J85ZSLZQ14 type=write size=1674784 2023-10-05T11:35:15.047 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.043+0000 7f26f5634780 1 > prepared operation key=4D3H60UTIXH3 tag=VE1GMKY1TUTK type=del size=761325 2023-10-05T11:35:15.048 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.044+0000 7f26f5634780 1 < completed write operation key=9S0YW7PPSJ8G tag=FABUNHPTO8DP type=write size=264437 2023-10-05T11:35:15.050 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.047+0000 7f26f5634780 1 > prepared part key=_multipart_9S0YW7PPSJ8G.2~35B9C0032J5Z.0 size=1048576 2023-10-05T11:35:15.051 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.047+0000 7f26f5634780 1 > prepared part key=_multipart_9S0YW7PPSJ8G.2~35B9C0032J5Z.1 size=1048576 2023-10-05T11:35:15.052 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.048+0000 7f26f5634780 1 > prepared part key=_multipart_9S0YW7PPSJ8G.2~35B9C0032J5Z.2 size=855069 2023-10-05T11:35:15.052 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.048+0000 7f26f5634780 1 > prepared multipart upload key=9S0YW7PPSJ8G upload=35B9C0032J5Z tag=N42F7Y0747WK type=write size=4000797 2023-10-05T11:35:15.053 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.050+0000 7f26f5634780 1 < completed part key=_multipart_9S0YW7PPSJ8G.2~C93JEI2SXWXA.0 size=725048 2023-10-05T11:35:15.055 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.052+0000 7f26f5634780 1 < completed multipart upload key=9S0YW7PPSJ8G upload=C93JEI2SXWXA tag=0D250T3YJS4X type=write size=1773624 2023-10-05T11:35:15.056 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.053+0000 7f26f5634780 1 > prepared operation key=BTZUVE8R96XT tag=OAAY2VVRDYP6 type=del size=1480101 2023-10-05T11:35:15.059 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.056+0000 7f26f5634780 1 < completed delete operation key=J5EIH25Y471T tag=12RU29ISSS1L type=del 2023-10-05T11:35:15.062 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.058+0000 7f26f5634780 1 > prepared part key=_multipart_W2GWVGX42QLD.2~1YDPBBAS25VB.0 size=1048576 2023-10-05T11:35:15.063 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.059+0000 7f26f5634780 1 > prepared part key=_multipart_W2GWVGX42QLD.2~1YDPBBAS25VB.1 size=1048576 2023-10-05T11:35:15.063 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.060+0000 7f26f5634780 1 > prepared part key=_multipart_W2GWVGX42QLD.2~1YDPBBAS25VB.2 size=503615 2023-10-05T11:35:15.064 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.060+0000 7f26f5634780 1 > prepared multipart upload key=W2GWVGX42QLD upload=1YDPBBAS25VB tag=ID1477VXDWV5 type=write size=3649343 2023-10-05T11:35:15.065 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.061+0000 7f26f5634780 1 < completed delete operation key=BTZUVE8R96XT tag=JI6UVTLI7O97 type=del 2023-10-05T11:35:15.067 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.063+0000 7f26f5634780 1 > prepared part key=_multipart_8IPCP77WVVZT.2~JYF0M2HL2RZ3.0 size=1048576 2023-10-05T11:35:15.068 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.064+0000 7f26f5634780 1 > prepared part key=_multipart_8IPCP77WVVZT.2~JYF0M2HL2RZ3.1 size=839265 2023-10-05T11:35:15.068 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.064+0000 7f26f5634780 1 > prepared multipart upload key=8IPCP77WVVZT upload=JYF0M2HL2RZ3 tag=8NXEM7F7D9M2 type=write size=2936417 2023-10-05T11:35:15.069 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.066+0000 7f26f5634780 1 < completed part key=_multipart_4IBQJLJR7LD8.2~N9N0JEQ4PT67.0 size=1048576 2023-10-05T11:35:15.070 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.066+0000 7f26f5634780 1 < completed part key=_multipart_4IBQJLJR7LD8.2~N9N0JEQ4PT67.1 size=1048576 2023-10-05T11:35:15.071 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.067+0000 7f26f5634780 1 < completed part key=_multipart_4IBQJLJR7LD8.2~N9N0JEQ4PT67.2 size=706684 2023-10-05T11:35:15.073 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.070+0000 7f26f5634780 1 < completed multipart upload key=4IBQJLJR7LD8 upload=N9N0JEQ4PT67 tag=4N8TJ29YG3QS type=write size=3852412 2023-10-05T11:35:15.074 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.071+0000 7f26f5634780 1 > prepared operation key=AV0XKXX1IR4B tag=V59I6VGNDM0K type=write size=352055 2023-10-05T11:35:15.075 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.072+0000 7f26f5634780 1 < completed write operation key=9S0YW7PPSJ8G tag=057W653ROAYU type=write size=833810 2023-10-05T11:35:15.077 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.073+0000 7f26f5634780 1 > prepared operation key=FOMNIIY47UUM tag=PR0AR4QYNC6M type=del size=1970087 2023-10-05T11:35:15.078 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.074+0000 7f26f5634780 1 < completed part key=_multipart_7TOP5A52M9YP.2~GWOPETR76FIP.0 size=1048576 2023-10-05T11:35:15.079 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.075+0000 7f26f5634780 1 < completed part key=_multipart_7TOP5A52M9YP.2~GWOPETR76FIP.1 size=1048576 2023-10-05T11:35:15.079 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.076+0000 7f26f5634780 1 < completed part key=_multipart_7TOP5A52M9YP.2~GWOPETR76FIP.2 size=244146 2023-10-05T11:35:15.081 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.078+0000 7f26f5634780 1 < completed multipart upload key=7TOP5A52M9YP upload=GWOPETR76FIP tag=B57S74PC8UXB type=write size=3389874 2023-10-05T11:35:15.082 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.079+0000 7f26f5634780 1 > prepared operation key=761J2C7GHWU5 tag=2OD93OFFKXOR type=write size=396478 2023-10-05T11:35:15.085 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.080+0000 7f26f5634780 1 < completed delete operation key=7W9LL5HSU3BG tag=MII7JTNXZ3ZC type=del 2023-10-05T11:35:15.086 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.081+0000 7f26f5634780 1 > prepared operation key=MEY4SZRHU9NZ tag=8H0RSAA2CBZD type=del size=149947 2023-10-05T11:35:15.086 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.083+0000 7f26f5634780 1 < completed write operation key=BU3KSHTINB36 tag=J7V0VGBAAXU4 type=write size=750840 2023-10-05T11:35:15.088 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.085+0000 7f26f5634780 1 > prepared part key=_multipart_9S0YW7PPSJ8G.2~M7QFMNKCWRS0.0 size=331294 2023-10-05T11:35:15.088 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.085+0000 7f26f5634780 1 > prepared multipart upload key=9S0YW7PPSJ8G upload=M7QFMNKCWRS0 tag=G1N5VI4FVB4N type=write size=1379870 2023-10-05T11:35:15.089 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.086+0000 7f26f5634780 1 < completed delete operation key=LLR5J3X15W5R tag=1KYZBYLOF5CN type=del 2023-10-05T11:35:15.091 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.088+0000 7f26f5634780 1 > prepared part key=_multipart_5OPHKTHXVN5U.2~CYK8Z5W3XRMD.0 size=748662 2023-10-05T11:35:15.092 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.088+0000 7f26f5634780 1 > prepared multipart upload key=5OPHKTHXVN5U upload=CYK8Z5W3XRMD tag=7INOCY6QG90J type=write size=1797238 2023-10-05T11:35:15.093 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.089+0000 7f26f5634780 1 < completed write operation key=IC7T3ZK81WQS tag=FOI7KF2AI14R type=write size=52520 2023-10-05T11:35:15.094 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.090+0000 7f26f5634780 1 > prepared operation key=IKCNZOTVWOC6 tag=1BQY01VWHDRA type=del size=3335486 2023-10-05T11:35:15.095 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.092+0000 7f26f5634780 1 < completed delete operation key=QYQDXVIGZ7O8 tag=MDA65SM1MEE8 type=del 2023-10-05T11:35:15.097 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.094+0000 7f26f5634780 1 > prepared part key=_multipart_2U0NRDGDNUTA.2~QHYIERO0OZ2S.0 size=1048576 2023-10-05T11:35:15.098 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.095+0000 7f26f5634780 1 > prepared part key=_multipart_2U0NRDGDNUTA.2~QHYIERO0OZ2S.1 size=1048576 2023-10-05T11:35:15.099 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.096+0000 7f26f5634780 1 > prepared part key=_multipart_2U0NRDGDNUTA.2~QHYIERO0OZ2S.2 size=947021 2023-10-05T11:35:15.099 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.096+0000 7f26f5634780 1 > prepared multipart upload key=2U0NRDGDNUTA upload=QHYIERO0OZ2S tag=ACY00MJAHXSV type=write size=4092749 2023-10-05T11:35:15.100 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.097+0000 7f26f5634780 1 < canceled operation key=4D3H60UTIXH3 tag=ABKZXD06WI4J type=write size=13288 2023-10-05T11:35:15.101 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.098+0000 7f26f5634780 1 > prepared operation key=FOMNIIY47UUM tag=3BCK44VV1RZC type=del size=1668134 2023-10-05T11:35:15.103 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.099+0000 7f26f5634780 1 < completed delete operation key=7TOP5A52M9YP tag=ZW300KMPSD65 type=del 2023-10-05T11:35:15.104 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.100+0000 7f26f5634780 1 > prepared operation key=IC7T3ZK81WQS tag=GC22C8BDWZ3B type=del size=1883697 2023-10-05T11:35:15.105 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.101+0000 7f26f5634780 1 < completed part key=_multipart_4IBQJLJR7LD8.2~56D0PGO2S6W5.0 size=1048576 2023-10-05T11:35:15.106 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.102+0000 7f26f5634780 1 < completed part key=_multipart_4IBQJLJR7LD8.2~56D0PGO2S6W5.1 size=465483 2023-10-05T11:35:15.108 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.104+0000 7f26f5634780 1 < completed multipart upload key=4IBQJLJR7LD8 upload=56D0PGO2S6W5 tag=6BZ17J0IYDYY type=write size=2562635 2023-10-05T11:35:15.109 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.105+0000 7f26f5634780 1 > prepared operation key=WTCWG1C1SF89 tag=T58J3MNJMN1O type=del size=2185817 2023-10-05T11:35:15.110 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.107+0000 7f26f5634780 1 < completed delete operation key=4D3H60UTIXH3 tag=VE1GMKY1TUTK type=del 2023-10-05T11:35:15.111 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.108+0000 7f26f5634780 1 > prepared operation key=2U0NRDGDNUTA tag=FZW2YYNFQVB4 type=del size=1020921 2023-10-05T11:35:15.112 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.109+0000 7f26f5634780 1 < completed part key=_multipart_9S0YW7PPSJ8G.2~35B9C0032J5Z.0 size=1048576 2023-10-05T11:35:15.113 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.109+0000 7f26f5634780 1 < canceled part key=_multipart_9S0YW7PPSJ8G.2~35B9C0032J5Z.1 size=1048576 2023-10-05T11:35:15.113 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.110+0000 7f26f5634780 1 < completed part key=_multipart_9S0YW7PPSJ8G.2~35B9C0032J5Z.2 size=855069 2023-10-05T11:35:15.115 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.112+0000 7f26f5634780 1 < canceled multipart upload key=9S0YW7PPSJ8G upload=35B9C0032J5Z tag=N42F7Y0747WK type=write size=4000797 2023-10-05T11:35:15.117 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.114+0000 7f26f5634780 1 > prepared part key=_multipart_U6172JUYW7J6.2~8ZJP6TSMH3E4.0 size=566442 2023-10-05T11:35:15.118 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.114+0000 7f26f5634780 1 > prepared multipart upload key=U6172JUYW7J6 upload=8ZJP6TSMH3E4 tag=IMUE7XZKFS7H type=write size=1615018 2023-10-05T11:35:15.119 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.115+0000 7f26f5634780 1 < completed delete operation key=BTZUVE8R96XT tag=OAAY2VVRDYP6 type=del 2023-10-05T11:35:15.121 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.117+0000 7f26f5634780 1 > prepared part key=_multipart_2D4PDQQT54ZA.2~V532LDAILN4Z.0 size=449814 2023-10-05T11:35:15.121 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.117+0000 7f26f5634780 1 > prepared multipart upload key=2D4PDQQT54ZA upload=V532LDAILN4Z tag=DU1LLVTTPOHS type=write size=1498390 2023-10-05T11:35:15.122 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.118+0000 7f26f5634780 1 < completed part key=_multipart_W2GWVGX42QLD.2~1YDPBBAS25VB.0 size=1048576 2023-10-05T11:35:15.123 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.119+0000 7f26f5634780 1 < completed part key=_multipart_W2GWVGX42QLD.2~1YDPBBAS25VB.1 size=1048576 2023-10-05T11:35:15.124 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.120+0000 7f26f5634780 1 < completed part key=_multipart_W2GWVGX42QLD.2~1YDPBBAS25VB.2 size=503615 2023-10-05T11:35:15.126 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.123+0000 7f26f5634780 1 < completed multipart upload key=W2GWVGX42QLD upload=1YDPBBAS25VB tag=ID1477VXDWV5 type=write size=3649343 2023-10-05T11:35:15.127 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.124+0000 7f26f5634780 1 > prepared operation key=8IPCP77WVVZT tag=Q7J7XHISWV2C type=write size=1014398 2023-10-05T11:35:15.128 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.125+0000 7f26f5634780 1 < completed part key=_multipart_8IPCP77WVVZT.2~JYF0M2HL2RZ3.0 size=1048576 2023-10-05T11:35:15.128 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.125+0000 7f26f5634780 1 < canceled part key=_multipart_8IPCP77WVVZT.2~JYF0M2HL2RZ3.1 size=839265 2023-10-05T11:35:15.130 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.127+0000 7f26f5634780 1 < canceled multipart upload key=8IPCP77WVVZT upload=JYF0M2HL2RZ3 tag=8NXEM7F7D9M2 type=write size=2936417 2023-10-05T11:35:15.131 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.128+0000 7f26f5634780 1 > prepared operation key=761J2C7GHWU5 tag=JBX2DJ74K0JP type=del size=3543557 2023-10-05T11:35:15.133 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.129+0000 7f26f5634780 1 < completed write operation key=AV0XKXX1IR4B tag=V59I6VGNDM0K type=write size=352055 2023-10-05T11:35:15.134 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.130+0000 7f26f5634780 1 > prepared operation key=2U0NRDGDNUTA tag=425BI9FD13G6 type=write size=476220 2023-10-05T11:35:15.135 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.132+0000 7f26f5634780 1 < completed delete operation key=FOMNIIY47UUM tag=PR0AR4QYNC6M type=del 2023-10-05T11:35:15.136 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.133+0000 7f26f5634780 1 > prepared operation key=MEY4SZRHU9NZ tag=UJ9ESMU31YWJ type=del size=3611623 2023-10-05T11:35:15.137 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.134+0000 7f26f5634780 1 < completed write operation key=761J2C7GHWU5 tag=2OD93OFFKXOR type=write size=396478 2023-10-05T11:35:15.140 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.136+0000 7f26f5634780 1 > prepared part key=_multipart_PNV0Q6ZPLYV0.2~KAWJA71J650R.0 size=1048576 2023-10-05T11:35:15.141 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.137+0000 7f26f5634780 1 > prepared part key=_multipart_PNV0Q6ZPLYV0.2~KAWJA71J650R.1 size=1004748 2023-10-05T11:35:15.141 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.137+0000 7f26f5634780 1 > prepared multipart upload key=PNV0Q6ZPLYV0 upload=KAWJA71J650R tag=K27H5MYBJ4CK type=write size=3101900 2023-10-05T11:35:15.142 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.139+0000 7f26f5634780 1 < completed delete operation key=MEY4SZRHU9NZ tag=8H0RSAA2CBZD type=del 2023-10-05T11:35:15.143 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.140+0000 7f26f5634780 1 > prepared operation key=U6172JUYW7J6 tag=C8YCSBUMGKTV type=del size=2690384 2023-10-05T11:35:15.144 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.141+0000 7f26f5634780 1 < completed part key=_multipart_9S0YW7PPSJ8G.2~M7QFMNKCWRS0.0 size=331294 2023-10-05T11:35:15.146 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.143+0000 7f26f5634780 1 < completed multipart upload key=9S0YW7PPSJ8G upload=M7QFMNKCWRS0 tag=G1N5VI4FVB4N type=write size=1379870 2023-10-05T11:35:15.147 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.144+0000 7f26f5634780 1 > prepared operation key=0PWYKC7S6YJ4 tag=I09TCZH9UGS4 type=write size=392971 2023-10-05T11:35:15.149 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.145+0000 7f26f5634780 1 < completed part key=_multipart_5OPHKTHXVN5U.2~CYK8Z5W3XRMD.0 size=748662 2023-10-05T11:35:15.151 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.147+0000 7f26f5634780 1 < completed multipart upload key=5OPHKTHXVN5U upload=CYK8Z5W3XRMD tag=7INOCY6QG90J type=write size=1797238 2023-10-05T11:35:15.152 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.149+0000 7f26f5634780 1 > prepared operation key=LLR5J3X15W5R tag=Z5CUPPYS6ULN type=del size=282554 2023-10-05T11:35:15.153 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.150+0000 7f26f5634780 1 < canceled operation key=IKCNZOTVWOC6 tag=1BQY01VWHDRA type=del size=3335486 2023-10-05T11:35:15.154 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.151+0000 7f26f5634780 1 > prepared operation key=5OPHKTHXVN5U tag=RXEIXXT2VC9V type=write size=426503 2023-10-05T11:35:15.156 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.152+0000 7f26f5634780 1 < completed part key=_multipart_2U0NRDGDNUTA.2~QHYIERO0OZ2S.0 size=1048576 2023-10-05T11:35:15.157 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.153+0000 7f26f5634780 1 < completed part key=_multipart_2U0NRDGDNUTA.2~QHYIERO0OZ2S.1 size=1048576 2023-10-05T11:35:15.158 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.154+0000 7f26f5634780 1 < completed part key=_multipart_2U0NRDGDNUTA.2~QHYIERO0OZ2S.2 size=947021 2023-10-05T11:35:15.160 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.156+0000 7f26f5634780 1 < completed multipart upload key=2U0NRDGDNUTA upload=QHYIERO0OZ2S tag=ACY00MJAHXSV type=write size=4092749 2023-10-05T11:35:15.161 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.157+0000 7f26f5634780 1 > prepared operation key=PC8WTJ8AYJ24 tag=0O08BWBQ6OHO type=del size=1994155 2023-10-05T11:35:15.163 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.160+0000 7f26f5634780 1 < suggested update operation key=FOMNIIY47UUM tag=3BCK44VV1RZC type=del size=1668134 2023-10-05T11:35:15.165 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.161+0000 7f26f5634780 1 > prepared operation key=VJTFYDETLSFD tag=1YACAIETCA5S type=del size=1680092 2023-10-05T11:35:15.167 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.163+0000 7f26f5634780 1 < suggested update operation key=IC7T3ZK81WQS tag=GC22C8BDWZ3B type=del size=1883697 2023-10-05T11:35:15.168 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.165+0000 7f26f5634780 1 > prepared operation key=PNV0Q6ZPLYV0 tag=E1JQA9U2KRR5 type=del size=3715041 2023-10-05T11:35:15.170 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.167+0000 7f26f5634780 1 < completed delete operation key=WTCWG1C1SF89 tag=T58J3MNJMN1O type=del 2023-10-05T11:35:15.172 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.169+0000 7f26f5634780 1 > prepared part key=_multipart_WTCWG1C1SF89.2~VB3ZALAUWNZ3.0 size=1048576 2023-10-05T11:35:15.173 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.170+0000 7f26f5634780 1 > prepared part key=_multipart_WTCWG1C1SF89.2~VB3ZALAUWNZ3.1 size=215533 2023-10-05T11:35:15.173 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.170+0000 7f26f5634780 1 > prepared multipart upload key=WTCWG1C1SF89 upload=VB3ZALAUWNZ3 tag=X9T71G3JAHW6 type=write size=2312685 2023-10-05T11:35:15.174 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.171+0000 7f26f5634780 1 < canceled operation key=2U0NRDGDNUTA tag=FZW2YYNFQVB4 type=del size=1020921 2023-10-05T11:35:15.176 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.173+0000 7f26f5634780 1 > prepared part key=_multipart_5OPHKTHXVN5U.2~072N8C8X4L2L.0 size=1048576 2023-10-05T11:35:15.177 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.174+0000 7f26f5634780 1 > prepared part key=_multipart_5OPHKTHXVN5U.2~072N8C8X4L2L.1 size=1048576 2023-10-05T11:35:15.178 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.175+0000 7f26f5634780 1 > prepared part key=_multipart_5OPHKTHXVN5U.2~072N8C8X4L2L.2 size=1026544 2023-10-05T11:35:15.178 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.175+0000 7f26f5634780 1 > prepared multipart upload key=5OPHKTHXVN5U upload=072N8C8X4L2L tag=7UZ5IY1NHHIU type=write size=4172272 2023-10-05T11:35:15.178 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.175+0000 7f26f5634780 1 < canceled part key=_multipart_U6172JUYW7J6.2~8ZJP6TSMH3E4.0 size=566442 2023-10-05T11:35:15.180 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.177+0000 7f26f5634780 1 < canceled multipart upload key=U6172JUYW7J6 upload=8ZJP6TSMH3E4 tag=IMUE7XZKFS7H type=write size=1615018 2023-10-05T11:35:15.181 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.178+0000 7f26f5634780 1 > prepared operation key=PNV0Q6ZPLYV0 tag=LD8Y5VX14OH6 type=del size=886733 2023-10-05T11:35:15.182 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.179+0000 7f26f5634780 1 < completed part key=_multipart_2D4PDQQT54ZA.2~V532LDAILN4Z.0 size=449814 2023-10-05T11:35:15.184 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.181+0000 7f26f5634780 1 < completed multipart upload key=2D4PDQQT54ZA upload=V532LDAILN4Z tag=DU1LLVTTPOHS type=write size=1498390 2023-10-05T11:35:15.185 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.182+0000 7f26f5634780 1 > prepared operation key=U6172JUYW7J6 tag=5GE2VXLGGPIJ type=write size=555423 2023-10-05T11:35:15.189 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.186+0000 7f26f5634780 1 < suggested remove operation key=8IPCP77WVVZT tag=Q7J7XHISWV2C type=write 2023-10-05T11:35:15.191 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.188+0000 7f26f5634780 1 > prepared part key=_multipart_BTZUVE8R96XT.2~6MIB0CSB9QQR.0 size=1048576 2023-10-05T11:35:15.192 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.189+0000 7f26f5634780 1 > prepared part key=_multipart_BTZUVE8R96XT.2~6MIB0CSB9QQR.1 size=1048576 2023-10-05T11:35:15.193 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.190+0000 7f26f5634780 1 > prepared part key=_multipart_BTZUVE8R96XT.2~6MIB0CSB9QQR.2 size=307630 2023-10-05T11:35:15.194 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.190+0000 7f26f5634780 1 > prepared multipart upload key=BTZUVE8R96XT upload=6MIB0CSB9QQR tag=F9B86T5MJIHC type=write size=3453358 2023-10-05T11:35:15.195 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.191+0000 7f26f5634780 1 < completed delete operation key=761J2C7GHWU5 tag=JBX2DJ74K0JP type=del 2023-10-05T11:35:15.196 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.192+0000 7f26f5634780 1 > prepared operation key=QYQDXVIGZ7O8 tag=2FL2LO1FE80B type=del size=5093 2023-10-05T11:35:15.197 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.194+0000 7f26f5634780 1 < completed write operation key=2U0NRDGDNUTA tag=425BI9FD13G6 type=write size=476220 2023-10-05T11:35:15.198 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.195+0000 7f26f5634780 1 > prepared operation key=6DP3UJ4CW1MO tag=BI80CT7OPZG3 type=del size=3594066 2023-10-05T11:35:15.199 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.196+0000 7f26f5634780 1 < completed delete operation key=MEY4SZRHU9NZ tag=UJ9ESMU31YWJ type=del 2023-10-05T11:35:15.202 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.198+0000 7f26f5634780 1 > prepared part key=_multipart_5V0Q651D4VN2.2~B3FHE1ZQA2GL.0 size=1048576 2023-10-05T11:35:15.203 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.199+0000 7f26f5634780 1 > prepared part key=_multipart_5V0Q651D4VN2.2~B3FHE1ZQA2GL.1 size=476326 2023-10-05T11:35:15.203 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.199+0000 7f26f5634780 1 > prepared multipart upload key=5V0Q651D4VN2 upload=B3FHE1ZQA2GL tag=WEIRXKOPB3ON type=write size=2573478 2023-10-05T11:35:15.203 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.199+0000 7f26f5634780 1 < canceled part key=_multipart_PNV0Q6ZPLYV0.2~KAWJA71J650R.0 size=1048576 2023-10-05T11:35:15.204 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.200+0000 7f26f5634780 1 < completed part key=_multipart_PNV0Q6ZPLYV0.2~KAWJA71J650R.1 size=1004748 2023-10-05T11:35:15.205 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.202+0000 7f26f5634780 1 < canceled multipart upload key=PNV0Q6ZPLYV0 upload=KAWJA71J650R tag=K27H5MYBJ4CK type=write size=3101900 2023-10-05T11:35:15.207 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.203+0000 7f26f5634780 1 > prepared operation key=2D4PDQQT54ZA tag=1F6LI7BE3LME type=write size=851072 2023-10-05T11:35:15.208 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.205+0000 7f26f5634780 1 < completed delete operation key=U6172JUYW7J6 tag=C8YCSBUMGKTV type=del 2023-10-05T11:35:15.209 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.206+0000 7f26f5634780 1 > prepared operation key=BTZUVE8R96XT tag=86EDP7EPW5Z2 type=del size=773342 2023-10-05T11:35:15.210 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.207+0000 7f26f5634780 1 < completed write operation key=0PWYKC7S6YJ4 tag=I09TCZH9UGS4 type=write size=392971 2023-10-05T11:35:15.211 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.208+0000 7f26f5634780 1 > prepared operation key=7TOP5A52M9YP tag=HELC6A47VGXW type=del size=20361 2023-10-05T11:35:15.213 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.209+0000 7f26f5634780 1 < completed delete operation key=LLR5J3X15W5R tag=Z5CUPPYS6ULN type=del 2023-10-05T11:35:15.214 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.211+0000 7f26f5634780 1 > prepared operation key=MEY4SZRHU9NZ tag=HF4IQ4NO1TZS type=del size=3332008 2023-10-05T11:35:15.215 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.212+0000 7f26f5634780 1 < completed write operation key=5OPHKTHXVN5U tag=RXEIXXT2VC9V type=write size=426503 2023-10-05T11:35:15.216 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.213+0000 7f26f5634780 1 > prepared operation key=0PWYKC7S6YJ4 tag=2ZDIHQ0PUS0V type=del size=934072 2023-10-05T11:35:15.218 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.214+0000 7f26f5634780 1 < completed delete operation key=PC8WTJ8AYJ24 tag=0O08BWBQ6OHO type=del 2023-10-05T11:35:15.219 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.215+0000 7f26f5634780 1 > prepared operation key=PC8WTJ8AYJ24 tag=HQ5VDZGLH1KE type=del size=1031421 2023-10-05T11:35:15.220 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.217+0000 7f26f5634780 1 < completed delete operation key=VJTFYDETLSFD tag=1YACAIETCA5S type=del 2023-10-05T11:35:15.222 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.218+0000 7f26f5634780 1 > prepared operation key=2U0NRDGDNUTA tag=8MIUOVXG8YV0 type=del size=1701606 2023-10-05T11:35:15.224 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.221+0000 7f26f5634780 1 < suggested update operation key=PNV0Q6ZPLYV0 tag=E1JQA9U2KRR5 type=del size=3715041 2023-10-05T11:35:15.226 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.222+0000 7f26f5634780 1 > prepared operation key=9S0YW7PPSJ8G tag=EK1FL0KSH7V9 type=del size=2009305 2023-10-05T11:35:15.227 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.223+0000 7f26f5634780 1 < completed part key=_multipart_WTCWG1C1SF89.2~VB3ZALAUWNZ3.0 size=1048576 2023-10-05T11:35:15.228 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.225+0000 7f26f5634780 1 < completed part key=_multipart_WTCWG1C1SF89.2~VB3ZALAUWNZ3.1 size=215533 2023-10-05T11:35:15.230 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.227+0000 7f26f5634780 1 < completed multipart upload key=WTCWG1C1SF89 upload=VB3ZALAUWNZ3 tag=X9T71G3JAHW6 type=write size=2312685 2023-10-05T11:35:15.232 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.228+0000 7f26f5634780 1 > prepared operation key=6DP3UJ4CW1MO tag=038X2K6KTB2U type=del size=747631 2023-10-05T11:35:15.233 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.230+0000 7f26f5634780 1 < completed part key=_multipart_5OPHKTHXVN5U.2~072N8C8X4L2L.0 size=1048576 2023-10-05T11:35:15.234 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.231+0000 7f26f5634780 1 < completed part key=_multipart_5OPHKTHXVN5U.2~072N8C8X4L2L.1 size=1048576 2023-10-05T11:35:15.234 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.231+0000 7f26f5634780 1 < canceled part key=_multipart_5OPHKTHXVN5U.2~072N8C8X4L2L.2 size=1026544 2023-10-05T11:35:15.236 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.233+0000 7f26f5634780 1 < canceled multipart upload key=5OPHKTHXVN5U upload=072N8C8X4L2L tag=7UZ5IY1NHHIU type=write size=4172272 2023-10-05T11:35:15.237 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.234+0000 7f26f5634780 1 > prepared operation key=8IPCP77WVVZT tag=KV1A2J62ACC2 type=del size=48913 2023-10-05T11:35:15.239 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.235+0000 7f26f5634780 -1 < failed to complete operation key=PNV0Q6ZPLYV0 tag=LD8Y5VX14OH6 type=del size=886733: (22) Invalid argument 2023-10-05T11:35:15.241 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.237+0000 7f26f5634780 1 > prepared part key=_multipart_7TOP5A52M9YP.2~OPKMG2C92E94.0 size=369371 2023-10-05T11:35:15.241 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.237+0000 7f26f5634780 1 > prepared multipart upload key=7TOP5A52M9YP upload=OPKMG2C92E94 tag=330QLO0VPHKM type=write size=1417947 2023-10-05T11:35:15.242 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.239+0000 7f26f5634780 1 < completed write operation key=U6172JUYW7J6 tag=5GE2VXLGGPIJ type=write size=555423 2023-10-05T11:35:15.243 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.240+0000 7f26f5634780 1 > prepared operation key=2D4PDQQT54ZA tag=PNCI3ETGZ7K0 type=del size=4073898 2023-10-05T11:35:15.245 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.241+0000 7f26f5634780 1 < completed part key=_multipart_BTZUVE8R96XT.2~6MIB0CSB9QQR.0 size=1048576 2023-10-05T11:35:15.246 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.242+0000 7f26f5634780 1 < completed part key=_multipart_BTZUVE8R96XT.2~6MIB0CSB9QQR.1 size=1048576 2023-10-05T11:35:15.247 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.243+0000 7f26f5634780 1 < completed part key=_multipart_BTZUVE8R96XT.2~6MIB0CSB9QQR.2 size=307630 2023-10-05T11:35:15.249 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.245+0000 7f26f5634780 1 < completed multipart upload key=BTZUVE8R96XT upload=6MIB0CSB9QQR tag=F9B86T5MJIHC type=write size=3453358 2023-10-05T11:35:15.251 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.248+0000 7f26f5634780 1 > prepared part key=_multipart_PNV0Q6ZPLYV0.2~UWYEG11JP0X7.0 size=1048576 2023-10-05T11:35:15.252 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.249+0000 7f26f5634780 1 > prepared part key=_multipart_PNV0Q6ZPLYV0.2~UWYEG11JP0X7.1 size=1048576 2023-10-05T11:35:15.253 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.250+0000 7f26f5634780 1 > prepared part key=_multipart_PNV0Q6ZPLYV0.2~UWYEG11JP0X7.2 size=589715 2023-10-05T11:35:15.253 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.250+0000 7f26f5634780 1 > prepared multipart upload key=PNV0Q6ZPLYV0 upload=UWYEG11JP0X7 tag=2ORVL2GXUWE5 type=write size=3735443 2023-10-05T11:35:15.254 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.251+0000 7f26f5634780 1 < canceled operation key=QYQDXVIGZ7O8 tag=2FL2LO1FE80B type=del size=5093 2023-10-05T11:35:15.255 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.252+0000 7f26f5634780 1 > prepared operation key=IKCNZOTVWOC6 tag=5G5U9T29IYQ6 type=write size=150565 2023-10-05T11:35:15.258 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.254+0000 7f26f5634780 1 < suggested update operation key=6DP3UJ4CW1MO tag=BI80CT7OPZG3 type=del size=3594066 2023-10-05T11:35:15.260 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.256+0000 7f26f5634780 1 > prepared part key=_multipart_IKCNZOTVWOC6.2~MBGYD6XWOPU2.0 size=1048576 2023-10-05T11:35:15.261 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.257+0000 7f26f5634780 1 > prepared part key=_multipart_IKCNZOTVWOC6.2~MBGYD6XWOPU2.1 size=1048576 2023-10-05T11:35:15.262 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.258+0000 7f26f5634780 1 > prepared part key=_multipart_IKCNZOTVWOC6.2~MBGYD6XWOPU2.2 size=1031229 2023-10-05T11:35:15.262 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.258+0000 7f26f5634780 1 > prepared multipart upload key=IKCNZOTVWOC6 upload=MBGYD6XWOPU2 tag=VUZ0KYJUH8C5 type=write size=4176957 2023-10-05T11:35:15.263 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.259+0000 7f26f5634780 1 < completed part key=_multipart_5V0Q651D4VN2.2~B3FHE1ZQA2GL.0 size=1048576 2023-10-05T11:35:15.264 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.260+0000 7f26f5634780 1 < completed part key=_multipart_5V0Q651D4VN2.2~B3FHE1ZQA2GL.1 size=476326 2023-10-05T11:35:15.266 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.263+0000 7f26f5634780 1 < completed multipart upload key=5V0Q651D4VN2 upload=B3FHE1ZQA2GL tag=WEIRXKOPB3ON type=write size=2573478 2023-10-05T11:35:15.267 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.264+0000 7f26f5634780 1 > prepared operation key=BTZUVE8R96XT tag=EJ4T1PWXX54H type=del size=1197701 2023-10-05T11:35:15.268 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.265+0000 7f26f5634780 1 < completed write operation key=2D4PDQQT54ZA tag=1F6LI7BE3LME type=write size=851072 2023-10-05T11:35:15.270 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.266+0000 7f26f5634780 1 > prepared operation key=5V0Q651D4VN2 tag=CPEJU7BNL20K type=del size=844705 2023-10-05T11:35:15.272 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.269+0000 7f26f5634780 1 < suggested remove operation key=BTZUVE8R96XT tag=86EDP7EPW5Z2 type=del 2023-10-05T11:35:15.273 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.270+0000 7f26f5634780 1 > prepared operation key=LLR5J3X15W5R tag=G28BGLLCAUL1 type=del size=392456 2023-10-05T11:35:15.275 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.271+0000 7f26f5634780 1 < completed delete operation key=7TOP5A52M9YP tag=HELC6A47VGXW type=del 2023-10-05T11:35:15.276 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.272+0000 7f26f5634780 1 > prepared operation key=IC7T3ZK81WQS tag=3SJCNMXFAL5T type=del size=3155265 2023-10-05T11:35:15.277 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.274+0000 7f26f5634780 1 < completed delete operation key=MEY4SZRHU9NZ tag=HF4IQ4NO1TZS type=del 2023-10-05T11:35:15.278 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.275+0000 7f26f5634780 1 > prepared operation key=7TOP5A52M9YP tag=4LA0T4U4TINU type=del size=2243529 2023-10-05T11:35:15.280 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.276+0000 7f26f5634780 1 < completed delete operation key=0PWYKC7S6YJ4 tag=2ZDIHQ0PUS0V type=del 2023-10-05T11:35:15.282 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.278+0000 7f26f5634780 1 > prepared part key=_multipart_761J2C7GHWU5.2~I8Z1YSE8JSS1.0 size=1048576 2023-10-05T11:35:15.283 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.279+0000 7f26f5634780 1 > prepared part key=_multipart_761J2C7GHWU5.2~I8Z1YSE8JSS1.1 size=1048576 2023-10-05T11:35:15.284 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.280+0000 7f26f5634780 1 > prepared part key=_multipart_761J2C7GHWU5.2~I8Z1YSE8JSS1.2 size=574307 2023-10-05T11:35:15.284 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.280+0000 7f26f5634780 1 > prepared multipart upload key=761J2C7GHWU5 upload=I8Z1YSE8JSS1 tag=BF7KJ81EZF0O type=write size=3720035 2023-10-05T11:35:15.287 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.283+0000 7f26f5634780 1 < completed delete operation key=PC8WTJ8AYJ24 tag=HQ5VDZGLH1KE type=del 2023-10-05T11:35:15.289 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.285+0000 7f26f5634780 1 > prepared operation key=W2GWVGX42QLD tag=OT7I01W7LSXM type=del size=835674 2023-10-05T11:35:15.290 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.286+0000 7f26f5634780 1 < canceled operation key=2U0NRDGDNUTA tag=8MIUOVXG8YV0 type=del size=1701606 2023-10-05T11:35:15.291 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.287+0000 7f26f5634780 1 > prepared operation key=7W9LL5HSU3BG tag=HRZA7BEV90E3 type=del size=2010437 2023-10-05T11:35:15.293 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.290+0000 7f26f5634780 1 < suggested remove operation key=9S0YW7PPSJ8G tag=EK1FL0KSH7V9 type=del 2023-10-05T11:35:15.294 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.291+0000 7f26f5634780 1 > prepared operation key=761J2C7GHWU5 tag=VAK194TTUCO7 type=del size=2411759 2023-10-05T11:35:15.297 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.294+0000 7f26f5634780 1 < suggested remove operation key=6DP3UJ4CW1MO tag=038X2K6KTB2U type=del 2023-10-05T11:35:15.298 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.295+0000 7f26f5634780 1 > prepared operation key=S3DKYDFT4IO2 tag=9G8LAV72DND0 type=del size=2289901 2023-10-05T11:35:15.300 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.296+0000 7f26f5634780 1 < completed delete operation key=8IPCP77WVVZT tag=KV1A2J62ACC2 type=del 2023-10-05T11:35:15.301 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.297+0000 7f26f5634780 1 > prepared operation key=5OPHKTHXVN5U tag=XZY7L4RJ6MJM type=del size=2135810 2023-10-05T11:35:15.302 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.299+0000 7f26f5634780 1 < completed part key=_multipart_7TOP5A52M9YP.2~OPKMG2C92E94.0 size=369371 2023-10-05T11:35:15.304 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.301+0000 7f26f5634780 1 < completed multipart upload key=7TOP5A52M9YP upload=OPKMG2C92E94 tag=330QLO0VPHKM type=write size=1417947 2023-10-05T11:35:15.306 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.303+0000 7f26f5634780 1 > prepared operation key=7W9LL5HSU3BG tag=HZ8HJML6EJTH type=del size=754456 2023-10-05T11:35:15.309 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.305+0000 7f26f5634780 1 < suggested remove operation key=2D4PDQQT54ZA tag=PNCI3ETGZ7K0 type=del 2023-10-05T11:35:15.310 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.306+0000 7f26f5634780 1 > prepared operation key=VJTFYDETLSFD tag=PGWHA7S3TOSN type=del size=2350506 2023-10-05T11:35:15.311 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.308+0000 7f26f5634780 1 < completed part key=_multipart_PNV0Q6ZPLYV0.2~UWYEG11JP0X7.0 size=1048576 2023-10-05T11:35:15.312 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.309+0000 7f26f5634780 1 < completed part key=_multipart_PNV0Q6ZPLYV0.2~UWYEG11JP0X7.1 size=1048576 2023-10-05T11:35:15.313 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.310+0000 7f26f5634780 1 < completed part key=_multipart_PNV0Q6ZPLYV0.2~UWYEG11JP0X7.2 size=589715 2023-10-05T11:35:15.316 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.312+0000 7f26f5634780 1 < completed multipart upload key=PNV0Q6ZPLYV0 upload=UWYEG11JP0X7 tag=2ORVL2GXUWE5 type=write size=3735443 2023-10-05T11:35:15.319 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.316+0000 7f26f5634780 1 > prepared part key=_multipart_IKCNZOTVWOC6.2~VLARW0KEDNLH.0 size=1048576 2023-10-05T11:35:15.320 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.317+0000 7f26f5634780 1 > prepared part key=_multipart_IKCNZOTVWOC6.2~VLARW0KEDNLH.1 size=1048576 2023-10-05T11:35:15.321 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.318+0000 7f26f5634780 1 > prepared part key=_multipart_IKCNZOTVWOC6.2~VLARW0KEDNLH.2 size=472797 2023-10-05T11:35:15.321 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.318+0000 7f26f5634780 1 > prepared multipart upload key=IKCNZOTVWOC6 upload=VLARW0KEDNLH tag=KUP9PKI82TIE type=write size=3618525 2023-10-05T11:35:15.323 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.319+0000 7f26f5634780 1 < completed write operation key=IKCNZOTVWOC6 tag=5G5U9T29IYQ6 type=write size=150565 2023-10-05T11:35:15.324 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.320+0000 7f26f5634780 1 > prepared operation key=761J2C7GHWU5 tag=I5438U1DJ7GH type=del size=257991 2023-10-05T11:35:15.325 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.322+0000 7f26f5634780 1 < completed part key=_multipart_IKCNZOTVWOC6.2~MBGYD6XWOPU2.0 size=1048576 2023-10-05T11:35:15.326 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.323+0000 7f26f5634780 1 < completed part key=_multipart_IKCNZOTVWOC6.2~MBGYD6XWOPU2.1 size=1048576 2023-10-05T11:35:15.327 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.324+0000 7f26f5634780 1 < completed part key=_multipart_IKCNZOTVWOC6.2~MBGYD6XWOPU2.2 size=1031229 2023-10-05T11:35:15.329 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.326+0000 7f26f5634780 1 < completed multipart upload key=IKCNZOTVWOC6 upload=MBGYD6XWOPU2 tag=VUZ0KYJUH8C5 type=write size=4176957 2023-10-05T11:35:15.330 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.327+0000 7f26f5634780 1 > prepared operation key=IC7T3ZK81WQS tag=HIS4OX97JI5N type=del size=201666 2023-10-05T11:35:15.331 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.328+0000 7f26f5634780 -1 < failed to complete operation key=BTZUVE8R96XT tag=EJ4T1PWXX54H type=del size=1197701: (22) Invalid argument 2023-10-05T11:35:15.333 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.329+0000 7f26f5634780 1 > prepared operation key=W2GWVGX42QLD tag=201SWJE1743E type=del size=2622905 2023-10-05T11:35:15.334 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.331+0000 7f26f5634780 1 < completed delete operation key=5V0Q651D4VN2 tag=CPEJU7BNL20K type=del 2023-10-05T11:35:15.336 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.333+0000 7f26f5634780 1 > prepared part key=_multipart_BU3KSHTINB36.2~UYATG3TH0EOZ.0 size=1048576 2023-10-05T11:35:15.337 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.334+0000 7f26f5634780 1 > prepared part key=_multipart_BU3KSHTINB36.2~UYATG3TH0EOZ.1 size=1048576 2023-10-05T11:35:15.338 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.335+0000 7f26f5634780 1 > prepared part key=_multipart_BU3KSHTINB36.2~UYATG3TH0EOZ.2 size=350597 2023-10-05T11:35:15.338 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.335+0000 7f26f5634780 1 > prepared multipart upload key=BU3KSHTINB36 upload=UYATG3TH0EOZ tag=908CCY15IBX8 type=write size=3496325 2023-10-05T11:35:15.340 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.336+0000 7f26f5634780 1 < completed delete operation key=LLR5J3X15W5R tag=G28BGLLCAUL1 type=del 2023-10-05T11:35:15.342 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.338+0000 7f26f5634780 1 > prepared part key=_multipart_S3DKYDFT4IO2.2~MBWLMX66GVU1.0 size=72835 2023-10-05T11:35:15.342 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.338+0000 7f26f5634780 1 > prepared multipart upload key=S3DKYDFT4IO2 upload=MBWLMX66GVU1 tag=D029KTS0LLVY type=write size=1121411 2023-10-05T11:35:15.343 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.339+0000 7f26f5634780 1 < completed delete operation key=IC7T3ZK81WQS tag=3SJCNMXFAL5T type=del 2023-10-05T11:35:15.344 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.341+0000 7f26f5634780 1 > prepared operation key=761J2C7GHWU5 tag=LJ26ZKDGZYSW type=del size=499087 2023-10-05T11:35:15.345 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.342+0000 7f26f5634780 1 < completed delete operation key=7TOP5A52M9YP tag=4LA0T4U4TINU type=del 2023-10-05T11:35:15.346 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.343+0000 7f26f5634780 1 > prepared operation key=BTZUVE8R96XT tag=JW55KY29A1H9 type=del size=2232128 2023-10-05T11:35:15.347 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.344+0000 7f26f5634780 1 < completed part key=_multipart_761J2C7GHWU5.2~I8Z1YSE8JSS1.0 size=1048576 2023-10-05T11:35:15.349 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.345+0000 7f26f5634780 1 < completed part key=_multipart_761J2C7GHWU5.2~I8Z1YSE8JSS1.1 size=1048576 2023-10-05T11:35:15.349 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.346+0000 7f26f5634780 1 < completed part key=_multipart_761J2C7GHWU5.2~I8Z1YSE8JSS1.2 size=574307 2023-10-05T11:35:15.352 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.348+0000 7f26f5634780 1 < completed multipart upload key=761J2C7GHWU5 upload=I8Z1YSE8JSS1 tag=BF7KJ81EZF0O type=write size=3720035 2023-10-05T11:35:15.354 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.350+0000 7f26f5634780 1 > prepared part key=_multipart_WTCWG1C1SF89.2~D1PDAUM12RCU.0 size=134165 2023-10-05T11:35:15.354 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.350+0000 7f26f5634780 1 > prepared multipart upload key=WTCWG1C1SF89 upload=D1PDAUM12RCU tag=PPRN5VI848P6 type=write size=1182741 2023-10-05T11:35:15.356 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.353+0000 7f26f5634780 1 < suggested update operation key=W2GWVGX42QLD tag=OT7I01W7LSXM type=del size=835674 2023-10-05T11:35:15.357 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.354+0000 7f26f5634780 1 > prepared operation key=IKCNZOTVWOC6 tag=QNBD72K8J9XD type=del size=872530 2023-10-05T11:35:15.358 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.355+0000 7f26f5634780 1 < completed delete operation key=7W9LL5HSU3BG tag=HRZA7BEV90E3 type=del 2023-10-05T11:35:15.360 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.356+0000 7f26f5634780 1 > prepared operation key=PNV0Q6ZPLYV0 tag=LS3OFEIOX4A0 type=write size=5359 2023-10-05T11:35:15.361 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.357+0000 7f26f5634780 1 < completed delete operation key=761J2C7GHWU5 tag=VAK194TTUCO7 type=del 2023-10-05T11:35:15.363 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.360+0000 7f26f5634780 1 > prepared part key=_multipart_J5EIH25Y471T.2~EW12XXOFXG0T.0 size=1048576 2023-10-05T11:35:15.364 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.361+0000 7f26f5634780 1 > prepared part key=_multipart_J5EIH25Y471T.2~EW12XXOFXG0T.1 size=976324 2023-10-05T11:35:15.364 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.361+0000 7f26f5634780 1 > prepared multipart upload key=J5EIH25Y471T upload=EW12XXOFXG0T tag=UN5L074XD3BF type=write size=3073476 2023-10-05T11:35:15.365 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.362+0000 7f26f5634780 1 < completed delete operation key=S3DKYDFT4IO2 tag=9G8LAV72DND0 type=del 2023-10-05T11:35:15.367 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.364+0000 7f26f5634780 1 > prepared part key=_multipart_PNV0Q6ZPLYV0.2~L9NK5AKZ4BGV.0 size=1048576 2023-10-05T11:35:15.368 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.365+0000 7f26f5634780 1 > prepared part key=_multipart_PNV0Q6ZPLYV0.2~L9NK5AKZ4BGV.1 size=439980 2023-10-05T11:35:15.368 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.365+0000 7f26f5634780 1 > prepared multipart upload key=PNV0Q6ZPLYV0 upload=L9NK5AKZ4BGV tag=45IFAXFSUF6C type=write size=2537132 2023-10-05T11:35:15.370 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.366+0000 7f26f5634780 1 < completed delete operation key=5OPHKTHXVN5U tag=XZY7L4RJ6MJM type=del 2023-10-05T11:35:15.371 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.368+0000 7f26f5634780 1 > prepared operation key=BU3KSHTINB36 tag=XF0EJ9RDXUBS type=del size=1457465 2023-10-05T11:35:15.372 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.369+0000 7f26f5634780 1 < completed delete operation key=7W9LL5HSU3BG tag=HZ8HJML6EJTH type=del 2023-10-05T11:35:15.374 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.370+0000 7f26f5634780 1 > prepared operation key=2U0NRDGDNUTA tag=SFURS765V5IZ type=del size=1122931 2023-10-05T11:35:15.375 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.372+0000 7f26f5634780 1 < completed delete operation key=VJTFYDETLSFD tag=PGWHA7S3TOSN type=del 2023-10-05T11:35:15.377 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.374+0000 7f26f5634780 1 > prepared part key=_multipart_6DP3UJ4CW1MO.2~W9TR41XZ7WN6.0 size=468947 2023-10-05T11:35:15.377 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.374+0000 7f26f5634780 1 > prepared multipart upload key=6DP3UJ4CW1MO upload=W9TR41XZ7WN6 tag=ON3UQ515T6NI type=write size=1517523 2023-10-05T11:35:15.379 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.375+0000 7f26f5634780 1 < completed part key=_multipart_IKCNZOTVWOC6.2~VLARW0KEDNLH.0 size=1048576 2023-10-05T11:35:15.380 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.376+0000 7f26f5634780 1 < completed part key=_multipart_IKCNZOTVWOC6.2~VLARW0KEDNLH.1 size=1048576 2023-10-05T11:35:15.381 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.377+0000 7f26f5634780 1 < completed part key=_multipart_IKCNZOTVWOC6.2~VLARW0KEDNLH.2 size=472797 2023-10-05T11:35:15.383 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.379+0000 7f26f5634780 1 < completed multipart upload key=IKCNZOTVWOC6 upload=VLARW0KEDNLH tag=KUP9PKI82TIE type=write size=3618525 2023-10-05T11:35:15.384 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.381+0000 7f26f5634780 1 > prepared operation key=NV4Q36UOLX8A tag=9BFZK1PUE8HL type=del size=1561301 2023-10-05T11:35:15.385 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.382+0000 7f26f5634780 1 < canceled operation key=761J2C7GHWU5 tag=I5438U1DJ7GH type=del size=257991 2023-10-05T11:35:15.387 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.384+0000 7f26f5634780 1 > prepared part key=_multipart_4IBQJLJR7LD8.2~HAFOGETQ21IS.0 size=1048576 2023-10-05T11:35:15.388 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.385+0000 7f26f5634780 1 > prepared part key=_multipart_4IBQJLJR7LD8.2~HAFOGETQ21IS.1 size=1048576 2023-10-05T11:35:15.389 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.386+0000 7f26f5634780 1 > prepared part key=_multipart_4IBQJLJR7LD8.2~HAFOGETQ21IS.2 size=946730 2023-10-05T11:35:15.389 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.386+0000 7f26f5634780 1 > prepared multipart upload key=4IBQJLJR7LD8 upload=HAFOGETQ21IS tag=FJX4B848X375 type=write size=4092458 2023-10-05T11:35:15.390 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.387+0000 7f26f5634780 1 < completed delete operation key=IC7T3ZK81WQS tag=HIS4OX97JI5N type=del 2023-10-05T11:35:15.393 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.389+0000 7f26f5634780 1 > prepared part key=_multipart_W2GWVGX42QLD.2~6GKXNGI4XQEB.0 size=1048576 2023-10-05T11:35:15.394 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.390+0000 7f26f5634780 1 > prepared part key=_multipart_W2GWVGX42QLD.2~6GKXNGI4XQEB.1 size=1048576 2023-10-05T11:35:15.394 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.391+0000 7f26f5634780 1 > prepared part key=_multipart_W2GWVGX42QLD.2~6GKXNGI4XQEB.2 size=400387 2023-10-05T11:35:15.395 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.391+0000 7f26f5634780 1 > prepared multipart upload key=W2GWVGX42QLD upload=6GKXNGI4XQEB tag=34821MFGO968 type=write size=3546115 2023-10-05T11:35:15.396 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.392+0000 7f26f5634780 -1 < failed to complete operation key=W2GWVGX42QLD tag=201SWJE1743E type=del size=2622905: (22) Invalid argument 2023-10-05T11:35:15.397 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.394+0000 7f26f5634780 1 > prepared operation key=PNV0Q6ZPLYV0 tag=IJR07DPXF8EI type=del size=701854 2023-10-05T11:35:15.398 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.395+0000 7f26f5634780 1 < completed part key=_multipart_BU3KSHTINB36.2~UYATG3TH0EOZ.0 size=1048576 2023-10-05T11:35:15.399 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.396+0000 7f26f5634780 1 < completed part key=_multipart_BU3KSHTINB36.2~UYATG3TH0EOZ.1 size=1048576 2023-10-05T11:35:15.400 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.397+0000 7f26f5634780 1 < completed part key=_multipart_BU3KSHTINB36.2~UYATG3TH0EOZ.2 size=350597 2023-10-05T11:35:15.402 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.399+0000 7f26f5634780 1 < completed multipart upload key=BU3KSHTINB36 upload=UYATG3TH0EOZ tag=908CCY15IBX8 type=write size=3496325 2023-10-05T11:35:15.406 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.402+0000 7f26f5634780 1 > prepared part key=_multipart_BTZUVE8R96XT.2~GHA18Z0LHXAH.0 size=1048576 2023-10-05T11:35:15.407 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.403+0000 7f26f5634780 1 > prepared part key=_multipart_BTZUVE8R96XT.2~GHA18Z0LHXAH.1 size=826472 2023-10-05T11:35:15.407 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.403+0000 7f26f5634780 1 > prepared multipart upload key=BTZUVE8R96XT upload=GHA18Z0LHXAH tag=B5LTHISB8K5M type=write size=2923624 2023-10-05T11:35:15.410 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.406+0000 7f26f5634780 1 < completed part key=_multipart_S3DKYDFT4IO2.2~MBWLMX66GVU1.0 size=72835 2023-10-05T11:35:15.412 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.408+0000 7f26f5634780 1 < completed multipart upload key=S3DKYDFT4IO2 upload=MBWLMX66GVU1 tag=D029KTS0LLVY type=write size=1121411 2023-10-05T11:35:15.413 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.409+0000 7f26f5634780 1 > prepared operation key=4D3H60UTIXH3 tag=73T0WVPQCOJM type=del size=2218056 2023-10-05T11:35:15.414 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.411+0000 7f26f5634780 1 < completed delete operation key=761J2C7GHWU5 tag=LJ26ZKDGZYSW type=del 2023-10-05T11:35:15.415 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.412+0000 7f26f5634780 1 > prepared operation key=VJTFYDETLSFD tag=N5VPO4X6TS0V type=del size=1979747 2023-10-05T11:35:15.417 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.413+0000 7f26f5634780 1 < completed delete operation key=BTZUVE8R96XT tag=JW55KY29A1H9 type=del 2023-10-05T11:35:15.418 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.414+0000 7f26f5634780 1 > prepared operation key=BU3KSHTINB36 tag=AFRW0S9R02N0 type=del size=1419233 2023-10-05T11:35:15.419 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.416+0000 7f26f5634780 1 < completed part key=_multipart_WTCWG1C1SF89.2~D1PDAUM12RCU.0 size=134165 2023-10-05T11:35:15.421 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.418+0000 7f26f5634780 1 < completed multipart upload key=WTCWG1C1SF89 upload=D1PDAUM12RCU tag=PPRN5VI848P6 type=write size=1182741 2023-10-05T11:35:15.423 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.419+0000 7f26f5634780 1 > prepared operation key=4D3H60UTIXH3 tag=5YRGNCITIAFO type=del size=3040312 2023-10-05T11:35:15.424 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.420+0000 7f26f5634780 1 < canceled operation key=IKCNZOTVWOC6 tag=QNBD72K8J9XD type=del size=872530 2023-10-05T11:35:15.425 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.422+0000 7f26f5634780 1 > prepared operation key=2U0NRDGDNUTA tag=NG7HPACYOP5Y type=del size=2554824 2023-10-05T11:35:15.426 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.423+0000 7f26f5634780 1 < completed write operation key=PNV0Q6ZPLYV0 tag=LS3OFEIOX4A0 type=write size=5359 2023-10-05T11:35:15.427 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.424+0000 7f26f5634780 1 > prepared operation key=J5EIH25Y471T tag=DR40U6FA01YW type=del size=2214703 2023-10-05T11:35:15.429 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.425+0000 7f26f5634780 1 < completed part key=_multipart_J5EIH25Y471T.2~EW12XXOFXG0T.0 size=1048576 2023-10-05T11:35:15.430 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.426+0000 7f26f5634780 1 < completed part key=_multipart_J5EIH25Y471T.2~EW12XXOFXG0T.1 size=976324 2023-10-05T11:35:15.432 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.428+0000 7f26f5634780 1 < completed multipart upload key=J5EIH25Y471T upload=EW12XXOFXG0T tag=UN5L074XD3BF type=write size=3073476 2023-10-05T11:35:15.434 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.431+0000 7f26f5634780 1 > prepared part key=_multipart_PNV0Q6ZPLYV0.2~6J02PNZNVEH3.0 size=1048576 2023-10-05T11:35:15.435 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.431+0000 7f26f5634780 1 > prepared part key=_multipart_PNV0Q6ZPLYV0.2~6J02PNZNVEH3.1 size=1048576 2023-10-05T11:35:15.436 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.432+0000 7f26f5634780 1 > prepared part key=_multipart_PNV0Q6ZPLYV0.2~6J02PNZNVEH3.2 size=592836 2023-10-05T11:35:15.436 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.432+0000 7f26f5634780 1 > prepared multipart upload key=PNV0Q6ZPLYV0 upload=6J02PNZNVEH3 tag=KMSGSDZ200L5 type=write size=3738564 2023-10-05T11:35:15.437 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.434+0000 7f26f5634780 1 < completed part key=_multipart_PNV0Q6ZPLYV0.2~L9NK5AKZ4BGV.0 size=1048576 2023-10-05T11:35:15.438 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.435+0000 7f26f5634780 1 < completed part key=_multipart_PNV0Q6ZPLYV0.2~L9NK5AKZ4BGV.1 size=439980 2023-10-05T11:35:15.440 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.437+0000 7f26f5634780 1 < completed multipart upload key=PNV0Q6ZPLYV0 upload=L9NK5AKZ4BGV tag=45IFAXFSUF6C type=write size=2537132 2023-10-05T11:35:15.441 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.438+0000 7f26f5634780 1 > prepared operation key=2U0NRDGDNUTA tag=5RS0OP0U2X3B type=del size=2817438 2023-10-05T11:35:15.443 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.439+0000 7f26f5634780 1 < completed delete operation key=BU3KSHTINB36 tag=XF0EJ9RDXUBS type=del 2023-10-05T11:35:15.444 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.441+0000 7f26f5634780 1 > prepared operation key=W2GWVGX42QLD tag=ZO5AMH273B8P type=del size=3145599 2023-10-05T11:35:15.447 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.443+0000 7f26f5634780 1 < suggested update operation key=2U0NRDGDNUTA tag=SFURS765V5IZ type=del size=1122931 2023-10-05T11:35:15.448 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.444+0000 7f26f5634780 1 > prepared operation key=BU3KSHTINB36 tag=4MXN9MZD9YU8 type=del size=1567896 2023-10-05T11:35:15.449 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.446+0000 7f26f5634780 1 < completed part key=_multipart_6DP3UJ4CW1MO.2~W9TR41XZ7WN6.0 size=468947 2023-10-05T11:35:15.451 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.448+0000 7f26f5634780 1 < completed multipart upload key=6DP3UJ4CW1MO upload=W9TR41XZ7WN6 tag=ON3UQ515T6NI type=write size=1517523 2023-10-05T11:35:15.453 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.449+0000 7f26f5634780 1 > prepared operation key=IKCNZOTVWOC6 tag=NELABWDQ3H8F type=del size=797513 2023-10-05T11:35:15.454 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.451+0000 7f26f5634780 1 < completed delete operation key=NV4Q36UOLX8A tag=9BFZK1PUE8HL type=del 2023-10-05T11:35:15.455 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.452+0000 7f26f5634780 1 > prepared operation key=2D4PDQQT54ZA tag=8G36SFOQO8WL type=del size=141765 2023-10-05T11:35:15.457 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.453+0000 7f26f5634780 1 < completed part key=_multipart_4IBQJLJR7LD8.2~HAFOGETQ21IS.0 size=1048576 2023-10-05T11:35:15.458 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.454+0000 7f26f5634780 1 < completed part key=_multipart_4IBQJLJR7LD8.2~HAFOGETQ21IS.1 size=1048576 2023-10-05T11:35:15.458 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.454+0000 7f26f5634780 1 < canceled part key=_multipart_4IBQJLJR7LD8.2~HAFOGETQ21IS.2 size=946730 2023-10-05T11:35:15.460 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.456+0000 7f26f5634780 1 < canceled multipart upload key=4IBQJLJR7LD8 upload=HAFOGETQ21IS tag=FJX4B848X375 type=write size=4092458 2023-10-05T11:35:15.462 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.459+0000 7f26f5634780 1 > prepared part key=_multipart_5V0Q651D4VN2.2~WQ3ZEK22MCYI.0 size=109511 2023-10-05T11:35:15.462 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.459+0000 7f26f5634780 1 > prepared multipart upload key=5V0Q651D4VN2 upload=WQ3ZEK22MCYI tag=01Y7ORXGORWU type=write size=1158087 2023-10-05T11:35:15.463 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.460+0000 7f26f5634780 1 < completed part key=_multipart_W2GWVGX42QLD.2~6GKXNGI4XQEB.0 size=1048576 2023-10-05T11:35:15.464 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.461+0000 7f26f5634780 1 < completed part key=_multipart_W2GWVGX42QLD.2~6GKXNGI4XQEB.1 size=1048576 2023-10-05T11:35:15.465 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.462+0000 7f26f5634780 1 < completed part key=_multipart_W2GWVGX42QLD.2~6GKXNGI4XQEB.2 size=400387 2023-10-05T11:35:15.467 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.464+0000 7f26f5634780 1 < completed multipart upload key=W2GWVGX42QLD upload=6GKXNGI4XQEB tag=34821MFGO968 type=write size=3546115 2023-10-05T11:35:15.470 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.466+0000 7f26f5634780 1 > prepared part key=_multipart_2D4PDQQT54ZA.2~6TGUNJ00IHZD.0 size=1048576 2023-10-05T11:35:15.471 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.467+0000 7f26f5634780 1 > prepared part key=_multipart_2D4PDQQT54ZA.2~6TGUNJ00IHZD.1 size=27169 2023-10-05T11:35:15.471 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.467+0000 7f26f5634780 1 > prepared multipart upload key=2D4PDQQT54ZA upload=6TGUNJ00IHZD tag=OJ66RSNYOIU8 type=write size=2124321 2023-10-05T11:35:15.472 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.468+0000 7f26f5634780 1 < completed delete operation key=PNV0Q6ZPLYV0 tag=IJR07DPXF8EI type=del 2023-10-05T11:35:15.473 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.470+0000 7f26f5634780 1 > prepared operation key=PNV0Q6ZPLYV0 tag=31SW63K0R0UA type=write size=628247 2023-10-05T11:35:15.474 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.471+0000 7f26f5634780 1 < completed part key=_multipart_BTZUVE8R96XT.2~GHA18Z0LHXAH.0 size=1048576 2023-10-05T11:35:15.475 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.472+0000 7f26f5634780 1 < completed part key=_multipart_BTZUVE8R96XT.2~GHA18Z0LHXAH.1 size=826472 2023-10-05T11:35:15.477 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.473+0000 7f26f5634780 1 < completed multipart upload key=BTZUVE8R96XT upload=GHA18Z0LHXAH tag=B5LTHISB8K5M type=write size=2923624 2023-10-05T11:35:15.479 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.475+0000 7f26f5634780 1 > prepared part key=_multipart_LLR5J3X15W5R.2~I2EB78T4NJGH.0 size=1048576 2023-10-05T11:35:15.480 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.476+0000 7f26f5634780 1 > prepared part key=_multipart_LLR5J3X15W5R.2~I2EB78T4NJGH.1 size=291576 2023-10-05T11:35:15.480 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.476+0000 7f26f5634780 1 > prepared multipart upload key=LLR5J3X15W5R upload=I2EB78T4NJGH tag=ZS1KQRQ8HVPP type=write size=2388728 2023-10-05T11:35:15.482 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.478+0000 7f26f5634780 1 < suggested update operation key=4D3H60UTIXH3 tag=73T0WVPQCOJM type=del size=2218056 2023-10-05T11:35:15.483 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.480+0000 7f26f5634780 1 > prepared operation key=BU3KSHTINB36 tag=56V0PB9DD4JI type=del size=3034696 2023-10-05T11:35:15.484 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.481+0000 7f26f5634780 1 < completed delete operation key=VJTFYDETLSFD tag=N5VPO4X6TS0V type=del 2023-10-05T11:35:15.485 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.482+0000 7f26f5634780 1 > prepared operation key=761J2C7GHWU5 tag=LRWU0KU9ZZP4 type=del size=3064924 2023-10-05T11:35:15.486 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.483+0000 7f26f5634780 1 < completed delete operation key=BU3KSHTINB36 tag=AFRW0S9R02N0 type=del 2023-10-05T11:35:15.487 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.484+0000 7f26f5634780 1 > prepared operation key=9S0YW7PPSJ8G tag=VWEAV9D0AQZK type=del size=3318232 2023-10-05T11:35:15.489 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.485+0000 7f26f5634780 -1 < failed to complete operation key=4D3H60UTIXH3 tag=5YRGNCITIAFO type=del size=3040312: (22) Invalid argument 2023-10-05T11:35:15.491 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.487+0000 7f26f5634780 1 > prepared part key=_multipart_FOMNIIY47UUM.2~L92N1BQU3IZT.0 size=919868 2023-10-05T11:35:15.491 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.487+0000 7f26f5634780 1 > prepared multipart upload key=FOMNIIY47UUM upload=L92N1BQU3IZT tag=TPMZ3J21CQDY type=write size=1968444 2023-10-05T11:35:15.492 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.488+0000 7f26f5634780 -1 < failed to complete operation key=2U0NRDGDNUTA tag=NG7HPACYOP5Y type=del size=2554824: (22) Invalid argument 2023-10-05T11:35:15.493 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.490+0000 7f26f5634780 1 > prepared operation key=FOMNIIY47UUM tag=8YOLY7VCESL9 type=del size=1563336 2023-10-05T11:35:15.497 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.492+0000 7f26f5634780 1 < suggested remove operation key=J5EIH25Y471T tag=DR40U6FA01YW type=del 2023-10-05T11:35:15.497 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.493+0000 7f26f5634780 1 > prepared operation key=BTZUVE8R96XT tag=I4GN2W69KLRT type=del size=3628369 2023-10-05T11:35:15.498 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.494+0000 7f26f5634780 1 < completed part key=_multipart_PNV0Q6ZPLYV0.2~6J02PNZNVEH3.0 size=1048576 2023-10-05T11:35:15.498 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.494+0000 7f26f5634780 1 < canceled part key=_multipart_PNV0Q6ZPLYV0.2~6J02PNZNVEH3.1 size=1048576 2023-10-05T11:35:15.499 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.495+0000 7f26f5634780 1 < completed part key=_multipart_PNV0Q6ZPLYV0.2~6J02PNZNVEH3.2 size=592836 2023-10-05T11:35:15.501 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.497+0000 7f26f5634780 1 < canceled multipart upload key=PNV0Q6ZPLYV0 upload=6J02PNZNVEH3 tag=KMSGSDZ200L5 type=write size=3738564 2023-10-05T11:35:15.502 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.498+0000 7f26f5634780 1 > prepared operation key=J5EIH25Y471T tag=OTWFUVV8HF4U type=del size=3283898 2023-10-05T11:35:15.504 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.501+0000 7f26f5634780 1 < suggested remove operation key=2U0NRDGDNUTA tag=5RS0OP0U2X3B type=del 2023-10-05T11:35:15.505 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.502+0000 7f26f5634780 1 > prepared operation key=PC8WTJ8AYJ24 tag=O30DZ70KVG79 type=write size=772063 2023-10-05T11:35:15.506 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.503+0000 7f26f5634780 1 < completed delete operation key=W2GWVGX42QLD tag=ZO5AMH273B8P type=del 2023-10-05T11:35:15.508 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.504+0000 7f26f5634780 1 > prepared operation key=6DP3UJ4CW1MO tag=VS77UE90F3WP type=del size=3695657 2023-10-05T11:35:15.509 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.506+0000 7f26f5634780 1 < completed delete operation key=BU3KSHTINB36 tag=4MXN9MZD9YU8 type=del 2023-10-05T11:35:15.512 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.509+0000 7f26f5634780 1 > prepared part key=_multipart_W2GWVGX42QLD.2~OITLFHAHRWNC.0 size=1048576 2023-10-05T11:35:15.513 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.510+0000 7f26f5634780 1 > prepared part key=_multipart_W2GWVGX42QLD.2~OITLFHAHRWNC.1 size=466610 2023-10-05T11:35:15.513 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.510+0000 7f26f5634780 1 > prepared multipart upload key=W2GWVGX42QLD upload=OITLFHAHRWNC tag=GSOJ41JO0C5L type=write size=2563762 2023-10-05T11:35:15.516 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.512+0000 7f26f5634780 1 < suggested update operation key=IKCNZOTVWOC6 tag=NELABWDQ3H8F type=del size=797513 2023-10-05T11:35:15.517 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.513+0000 7f26f5634780 1 > prepared operation key=4IBQJLJR7LD8 tag=WK5PP3UZW8KJ type=del size=2701695 2023-10-05T11:35:15.518 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.515+0000 7f26f5634780 1 < completed delete operation key=2D4PDQQT54ZA tag=8G36SFOQO8WL type=del 2023-10-05T11:35:15.519 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.516+0000 7f26f5634780 1 > prepared operation key=4D3H60UTIXH3 tag=9RK9ZG0KXBC2 type=write size=90042 2023-10-05T11:35:15.520 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.516+0000 7f26f5634780 1 < canceled part key=_multipart_5V0Q651D4VN2.2~WQ3ZEK22MCYI.0 size=109511 2023-10-05T11:35:15.523 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.519+0000 7f26f5634780 1 < canceled multipart upload key=5V0Q651D4VN2 upload=WQ3ZEK22MCYI tag=01Y7ORXGORWU type=write size=1158087 2023-10-05T11:35:15.526 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.523+0000 7f26f5634780 1 > prepared part key=_multipart_QYQDXVIGZ7O8.2~FIY6340DEHL2.0 size=696620 2023-10-05T11:35:15.526 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.523+0000 7f26f5634780 1 > prepared multipart upload key=QYQDXVIGZ7O8 upload=FIY6340DEHL2 tag=NGESP62FOWZT type=write size=1745196 2023-10-05T11:35:15.527 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.524+0000 7f26f5634780 1 < completed part key=_multipart_2D4PDQQT54ZA.2~6TGUNJ00IHZD.0 size=1048576 2023-10-05T11:35:15.528 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.525+0000 7f26f5634780 1 < completed part key=_multipart_2D4PDQQT54ZA.2~6TGUNJ00IHZD.1 size=27169 2023-10-05T11:35:15.531 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.527+0000 7f26f5634780 1 < completed multipart upload key=2D4PDQQT54ZA upload=6TGUNJ00IHZD tag=OJ66RSNYOIU8 type=write size=2124321 2023-10-05T11:35:15.532 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.528+0000 7f26f5634780 1 > prepared operation key=2U0NRDGDNUTA tag=1D72LIAJKLJB type=del size=326938 2023-10-05T11:35:15.533 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.530+0000 7f26f5634780 1 < completed write operation key=PNV0Q6ZPLYV0 tag=31SW63K0R0UA type=write size=628247 2023-10-05T11:35:15.536 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.532+0000 7f26f5634780 1 > prepared part key=_multipart_MEY4SZRHU9NZ.2~DEPEW18WJV7L.0 size=928273 2023-10-05T11:35:15.536 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.532+0000 7f26f5634780 1 > prepared multipart upload key=MEY4SZRHU9NZ upload=DEPEW18WJV7L tag=GNAFM26AMQ9R type=write size=1976849 2023-10-05T11:35:15.537 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.534+0000 7f26f5634780 1 < completed part key=_multipart_LLR5J3X15W5R.2~I2EB78T4NJGH.0 size=1048576 2023-10-05T11:35:15.537 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.534+0000 7f26f5634780 1 < canceled part key=_multipart_LLR5J3X15W5R.2~I2EB78T4NJGH.1 size=291576 2023-10-05T11:35:15.539 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.536+0000 7f26f5634780 1 < canceled multipart upload key=LLR5J3X15W5R upload=I2EB78T4NJGH tag=ZS1KQRQ8HVPP type=write size=2388728 2023-10-05T11:35:15.540 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.537+0000 7f26f5634780 1 > prepared operation key=BTZUVE8R96XT tag=713EOQJ8Z53K type=del size=3908906 2023-10-05T11:35:15.542 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.538+0000 7f26f5634780 1 < completed delete operation key=BU3KSHTINB36 tag=56V0PB9DD4JI type=del 2023-10-05T11:35:15.543 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.540+0000 7f26f5634780 1 > prepared operation key=U6172JUYW7J6 tag=KR676XXF9YGH type=write size=465376 2023-10-05T11:35:15.546 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.542+0000 7f26f5634780 1 < suggested update operation key=761J2C7GHWU5 tag=LRWU0KU9ZZP4 type=del size=3064924 2023-10-05T11:35:15.548 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.545+0000 7f26f5634780 1 > prepared part key=_multipart_WTCWG1C1SF89.2~5F9311IEC1PW.0 size=554420 2023-10-05T11:35:15.548 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.545+0000 7f26f5634780 1 > prepared multipart upload key=WTCWG1C1SF89 upload=5F9311IEC1PW tag=8RVPVDUZUDL4 type=write size=1602996 2023-10-05T11:35:15.549 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.546+0000 7f26f5634780 1 < completed delete operation key=9S0YW7PPSJ8G tag=VWEAV9D0AQZK type=del 2023-10-05T11:35:15.551 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.548+0000 7f26f5634780 1 > prepared part key=_multipart_FOMNIIY47UUM.2~ST2FE485ADGB.0 size=1048576 2023-10-05T11:35:15.552 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.549+0000 7f26f5634780 1 > prepared part key=_multipart_FOMNIIY47UUM.2~ST2FE485ADGB.1 size=811728 2023-10-05T11:35:15.553 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.549+0000 7f26f5634780 1 > prepared multipart upload key=FOMNIIY47UUM upload=ST2FE485ADGB tag=V7NE24W7TT7E type=write size=2908880 2023-10-05T11:35:15.554 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.550+0000 7f26f5634780 1 < completed part key=_multipart_FOMNIIY47UUM.2~L92N1BQU3IZT.0 size=919868 2023-10-05T11:35:15.556 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.553+0000 7f26f5634780 1 < completed multipart upload key=FOMNIIY47UUM upload=L92N1BQU3IZT tag=TPMZ3J21CQDY type=write size=1968444 2023-10-05T11:35:15.557 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.554+0000 7f26f5634780 1 > prepared operation key=QYQDXVIGZ7O8 tag=3RM88CXVW9KF type=del size=3337459 2023-10-05T11:35:15.559 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.555+0000 7f26f5634780 1 < completed delete operation key=FOMNIIY47UUM tag=8YOLY7VCESL9 type=del 2023-10-05T11:35:15.561 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.557+0000 7f26f5634780 1 > prepared part key=_multipart_J5EIH25Y471T.2~MBLW6BHILYSE.0 size=1048576 2023-10-05T11:35:15.562 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.558+0000 7f26f5634780 1 > prepared part key=_multipart_J5EIH25Y471T.2~MBLW6BHILYSE.1 size=1048576 2023-10-05T11:35:15.563 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.559+0000 7f26f5634780 1 > prepared part key=_multipart_J5EIH25Y471T.2~MBLW6BHILYSE.2 size=452803 2023-10-05T11:35:15.563 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.559+0000 7f26f5634780 1 > prepared multipart upload key=J5EIH25Y471T upload=MBLW6BHILYSE tag=NJDFF5SQZQES type=write size=3598531 2023-10-05T11:35:15.564 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.561+0000 7f26f5634780 1 < completed delete operation key=BTZUVE8R96XT tag=I4GN2W69KLRT type=del 2023-10-05T11:35:15.566 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.563+0000 7f26f5634780 1 > prepared part key=_multipart_AV0XKXX1IR4B.2~5GL5NQNV2JYW.0 size=1048576 2023-10-05T11:35:15.567 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.564+0000 7f26f5634780 1 > prepared part key=_multipart_AV0XKXX1IR4B.2~5GL5NQNV2JYW.1 size=1048576 2023-10-05T11:35:15.568 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.565+0000 7f26f5634780 1 > prepared part key=_multipart_AV0XKXX1IR4B.2~5GL5NQNV2JYW.2 size=781252 2023-10-05T11:35:15.568 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.565+0000 7f26f5634780 1 > prepared multipart upload key=AV0XKXX1IR4B upload=5GL5NQNV2JYW tag=HKCNGN3EYZ0A type=write size=3926980 2023-10-05T11:35:15.570 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.566+0000 7f26f5634780 1 < canceled operation key=J5EIH25Y471T tag=OTWFUVV8HF4U type=del size=3283898 2023-10-05T11:35:15.571 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.567+0000 7f26f5634780 1 > prepared operation key=WTCWG1C1SF89 tag=5NSO41KKPM6V type=write size=757417 2023-10-05T11:35:15.573 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.570+0000 7f26f5634780 1 < suggested update operation key=PC8WTJ8AYJ24 tag=O30DZ70KVG79 type=write size=772063 2023-10-05T11:35:15.575 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.572+0000 7f26f5634780 1 > prepared part key=_multipart_WTCWG1C1SF89.2~FS1K19R43P0W.0 size=180847 2023-10-05T11:35:15.575 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.572+0000 7f26f5634780 1 > prepared multipart upload key=WTCWG1C1SF89 upload=FS1K19R43P0W tag=OLZ9ITW3CFUE type=write size=1229423 2023-10-05T11:35:15.576 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.573+0000 7f26f5634780 1 < completed delete operation key=6DP3UJ4CW1MO tag=VS77UE90F3WP type=del 2023-10-05T11:35:15.578 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.574+0000 7f26f5634780 1 > prepared operation key=9S0YW7PPSJ8G tag=R04H3SMS11U0 type=del size=1504582 2023-10-05T11:35:15.579 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.576+0000 7f26f5634780 1 < completed part key=_multipart_W2GWVGX42QLD.2~OITLFHAHRWNC.0 size=1048576 2023-10-05T11:35:15.580 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.577+0000 7f26f5634780 1 < completed part key=_multipart_W2GWVGX42QLD.2~OITLFHAHRWNC.1 size=466610 2023-10-05T11:35:15.583 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.580+0000 7f26f5634780 1 < completed multipart upload key=W2GWVGX42QLD upload=OITLFHAHRWNC tag=GSOJ41JO0C5L type=write size=2563762 2023-10-05T11:35:15.585 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.581+0000 7f26f5634780 1 > prepared operation key=MEY4SZRHU9NZ tag=5XWTK22RIHJX type=del size=2887972 2023-10-05T11:35:15.586 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.583+0000 7f26f5634780 1 < completed delete operation key=4IBQJLJR7LD8 tag=WK5PP3UZW8KJ type=del 2023-10-05T11:35:15.589 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.585+0000 7f26f5634780 1 > prepared part key=_multipart_S3DKYDFT4IO2.2~HR6SGCVR9TEQ.0 size=511351 2023-10-05T11:35:15.589 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.585+0000 7f26f5634780 1 > prepared multipart upload key=S3DKYDFT4IO2 upload=HR6SGCVR9TEQ tag=URQKTPLJ0Y2M type=write size=1559927 2023-10-05T11:35:15.591 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.587+0000 7f26f5634780 1 < completed write operation key=4D3H60UTIXH3 tag=9RK9ZG0KXBC2 type=write size=90042 2023-10-05T11:35:15.592 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.589+0000 7f26f5634780 1 > prepared operation key=QYQDXVIGZ7O8 tag=FJICFVPP3ZR5 type=del size=41635 2023-10-05T11:35:15.593 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.590+0000 7f26f5634780 1 < completed part key=_multipart_QYQDXVIGZ7O8.2~FIY6340DEHL2.0 size=696620 2023-10-05T11:35:15.596 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.592+0000 7f26f5634780 1 < completed multipart upload key=QYQDXVIGZ7O8 upload=FIY6340DEHL2 tag=NGESP62FOWZT type=write size=1745196 2023-10-05T11:35:15.597 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.593+0000 7f26f5634780 1 > prepared operation key=NV4Q36UOLX8A tag=03EU7637ONQB type=del size=2561121 2023-10-05T11:35:15.598 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.595+0000 7f26f5634780 1 < completed delete operation key=2U0NRDGDNUTA tag=1D72LIAJKLJB type=del 2023-10-05T11:35:15.599 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.596+0000 7f26f5634780 1 > prepared operation key=MEY4SZRHU9NZ tag=U8D1AIESC2VH type=del size=2570419 2023-10-05T11:35:15.601 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.598+0000 7f26f5634780 1 < completed part key=_multipart_MEY4SZRHU9NZ.2~DEPEW18WJV7L.0 size=928273 2023-10-05T11:35:15.603 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.600+0000 7f26f5634780 1 < completed multipart upload key=MEY4SZRHU9NZ upload=DEPEW18WJV7L tag=GNAFM26AMQ9R type=write size=1976849 2023-10-05T11:35:15.605 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.602+0000 7f26f5634780 1 > prepared part key=_multipart_W2GWVGX42QLD.2~GSZYR8HCLCHI.0 size=1033008 2023-10-05T11:35:15.606 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.602+0000 7f26f5634780 1 > prepared multipart upload key=W2GWVGX42QLD upload=GSZYR8HCLCHI tag=YVOK21AV45BB type=write size=2081584 2023-10-05T11:35:15.606 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.603+0000 7f26f5634780 1 < completed delete operation key=BTZUVE8R96XT tag=713EOQJ8Z53K type=del 2023-10-05T11:35:15.608 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.604+0000 7f26f5634780 1 > prepared operation key=4D3H60UTIXH3 tag=I8CMKEMJEZDT type=write size=641776 2023-10-05T11:35:15.609 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.606+0000 7f26f5634780 1 < completed write operation key=U6172JUYW7J6 tag=KR676XXF9YGH type=write size=465376 2023-10-05T11:35:15.612 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.608+0000 7f26f5634780 1 > prepared part key=_multipart_IC7T3ZK81WQS.2~HWJDHJ1NBSVZ.0 size=1048576 2023-10-05T11:35:15.613 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.609+0000 7f26f5634780 1 > prepared part key=_multipart_IC7T3ZK81WQS.2~HWJDHJ1NBSVZ.1 size=1048576 2023-10-05T11:35:15.614 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.610+0000 7f26f5634780 1 > prepared part key=_multipart_IC7T3ZK81WQS.2~HWJDHJ1NBSVZ.2 size=815921 2023-10-05T11:35:15.614 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.610+0000 7f26f5634780 1 > prepared multipart upload key=IC7T3ZK81WQS upload=HWJDHJ1NBSVZ tag=OJZJLEXS9Y6R type=write size=3961649 2023-10-05T11:35:15.615 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.611+0000 7f26f5634780 1 < completed part key=_multipart_WTCWG1C1SF89.2~5F9311IEC1PW.0 size=554420 2023-10-05T11:35:15.617 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.613+0000 7f26f5634780 1 < completed multipart upload key=WTCWG1C1SF89 upload=5F9311IEC1PW tag=8RVPVDUZUDL4 type=write size=1602996 2023-10-05T11:35:15.618 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.614+0000 7f26f5634780 1 > prepared operation key=761J2C7GHWU5 tag=DAJ9DJU05ZH5 type=del size=4163058 2023-10-05T11:35:15.619 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.616+0000 7f26f5634780 1 < completed part key=_multipart_FOMNIIY47UUM.2~ST2FE485ADGB.0 size=1048576 2023-10-05T11:35:15.620 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.617+0000 7f26f5634780 1 < completed part key=_multipart_FOMNIIY47UUM.2~ST2FE485ADGB.1 size=811728 2023-10-05T11:35:15.622 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.619+0000 7f26f5634780 1 < completed multipart upload key=FOMNIIY47UUM upload=ST2FE485ADGB tag=V7NE24W7TT7E type=write size=2908880 2023-10-05T11:35:15.624 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.620+0000 7f26f5634780 1 > prepared operation key=BU3KSHTINB36 tag=GG92T0AY92KZ type=del size=3685528 2023-10-05T11:35:15.625 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.622+0000 7f26f5634780 1 < completed delete operation key=QYQDXVIGZ7O8 tag=3RM88CXVW9KF type=del 2023-10-05T11:35:15.626 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.623+0000 7f26f5634780 1 > prepared operation key=J5EIH25Y471T tag=A4N6BVR6V3AF type=del size=2631025 2023-10-05T11:35:15.628 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.624+0000 7f26f5634780 1 < completed part key=_multipart_J5EIH25Y471T.2~MBLW6BHILYSE.0 size=1048576 2023-10-05T11:35:15.629 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.626+0000 7f26f5634780 1 < completed part key=_multipart_J5EIH25Y471T.2~MBLW6BHILYSE.1 size=1048576 2023-10-05T11:35:15.630 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.627+0000 7f26f5634780 1 < completed part key=_multipart_J5EIH25Y471T.2~MBLW6BHILYSE.2 size=452803 2023-10-05T11:35:15.632 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.629+0000 7f26f5634780 1 < completed multipart upload key=J5EIH25Y471T upload=MBLW6BHILYSE tag=NJDFF5SQZQES type=write size=3598531 2023-10-05T11:35:15.634 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.630+0000 7f26f5634780 1 > prepared operation key=8IPCP77WVVZT tag=5PU6YQY3PEJ5 type=del size=267051 2023-10-05T11:35:15.634 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.631+0000 7f26f5634780 1 < canceled part key=_multipart_AV0XKXX1IR4B.2~5GL5NQNV2JYW.0 size=1048576 2023-10-05T11:35:15.635 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.631+0000 7f26f5634780 1 < completed part key=_multipart_AV0XKXX1IR4B.2~5GL5NQNV2JYW.1 size=1048576 2023-10-05T11:35:15.636 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.633+0000 7f26f5634780 1 < completed part key=_multipart_AV0XKXX1IR4B.2~5GL5NQNV2JYW.2 size=781252 2023-10-05T11:35:15.638 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.634+0000 7f26f5634780 1 < canceled multipart upload key=AV0XKXX1IR4B upload=5GL5NQNV2JYW tag=HKCNGN3EYZ0A type=write size=3926980 2023-10-05T11:35:15.639 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.636+0000 7f26f5634780 1 > prepared operation key=S3DKYDFT4IO2 tag=JDP7NEEG2UNE type=del size=2021543 2023-10-05T11:35:15.640 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.637+0000 7f26f5634780 1 < completed write operation key=WTCWG1C1SF89 tag=5NSO41KKPM6V type=write size=757417 2023-10-05T11:35:15.641 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.638+0000 7f26f5634780 1 > prepared operation key=6DP3UJ4CW1MO tag=BNOICFHZCQZN type=write size=368800 2023-10-05T11:35:15.644 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.640+0000 7f26f5634780 1 < completed part key=_multipart_WTCWG1C1SF89.2~FS1K19R43P0W.0 size=180847 2023-10-05T11:35:15.649 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.645+0000 7f26f5634780 1 < completed multipart upload key=WTCWG1C1SF89 upload=FS1K19R43P0W tag=OLZ9ITW3CFUE type=write size=1229423 2023-10-05T11:35:15.651 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.648+0000 7f26f5634780 1 > prepared part key=_multipart_PNV0Q6ZPLYV0.2~PIF4Y6RDVMIZ.0 size=626641 2023-10-05T11:35:15.651 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.648+0000 7f26f5634780 1 > prepared multipart upload key=PNV0Q6ZPLYV0 upload=PIF4Y6RDVMIZ tag=ZTW01B1TXKA6 type=write size=1675217 2023-10-05T11:35:15.653 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.649+0000 7f26f5634780 1 < completed delete operation key=9S0YW7PPSJ8G tag=R04H3SMS11U0 type=del 2023-10-05T11:35:15.654 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.650+0000 7f26f5634780 1 > prepared operation key=VJTFYDETLSFD tag=3UI9JI9LKBLB type=del size=1477997 2023-10-05T11:35:15.655 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.652+0000 7f26f5634780 1 < completed delete operation key=MEY4SZRHU9NZ tag=5XWTK22RIHJX type=del 2023-10-05T11:35:15.656 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.653+0000 7f26f5634780 1 > prepared operation key=IC7T3ZK81WQS tag=WZ2HBMQ38D4B type=write size=850216 2023-10-05T11:35:15.658 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.654+0000 7f26f5634780 1 < completed part key=_multipart_S3DKYDFT4IO2.2~HR6SGCVR9TEQ.0 size=511351 2023-10-05T11:35:15.660 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.656+0000 7f26f5634780 1 < completed multipart upload key=S3DKYDFT4IO2 upload=HR6SGCVR9TEQ tag=URQKTPLJ0Y2M type=write size=1559927 2023-10-05T11:35:15.661 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.658+0000 7f26f5634780 1 > prepared operation key=AV0XKXX1IR4B tag=DK2S6YM1P11I type=del size=1956921 2023-10-05T11:35:15.663 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.660+0000 7f26f5634780 1 < suggested remove operation key=QYQDXVIGZ7O8 tag=FJICFVPP3ZR5 type=del 2023-10-05T11:35:15.665 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.661+0000 7f26f5634780 1 > prepared operation key=5V0Q651D4VN2 tag=2UTOFHL4MK6H type=del size=2477989 2023-10-05T11:35:15.667 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.664+0000 7f26f5634780 1 < suggested update operation key=NV4Q36UOLX8A tag=03EU7637ONQB type=del size=2561121 2023-10-05T11:35:15.668 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.665+0000 7f26f5634780 1 > prepared operation key=5OPHKTHXVN5U tag=EZBG1TUMX5N2 type=del size=259633 2023-10-05T11:35:15.669 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.666+0000 7f26f5634780 1 < completed delete operation key=MEY4SZRHU9NZ tag=U8D1AIESC2VH type=del 2023-10-05T11:35:15.672 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.668+0000 7f26f5634780 1 > prepared part key=_multipart_IC7T3ZK81WQS.2~SOETDSJ2I28S.0 size=1048576 2023-10-05T11:35:15.672 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.669+0000 7f26f5634780 1 > prepared part key=_multipart_IC7T3ZK81WQS.2~SOETDSJ2I28S.1 size=31130 2023-10-05T11:35:15.673 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.669+0000 7f26f5634780 1 > prepared multipart upload key=IC7T3ZK81WQS upload=SOETDSJ2I28S tag=SNY02RYIDNQ8 type=write size=2128282 2023-10-05T11:35:15.674 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.670+0000 7f26f5634780 1 < completed part key=_multipart_W2GWVGX42QLD.2~GSZYR8HCLCHI.0 size=1033008 2023-10-05T11:35:15.676 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.672+0000 7f26f5634780 1 < completed multipart upload key=W2GWVGX42QLD upload=GSZYR8HCLCHI tag=YVOK21AV45BB type=write size=2081584 2023-10-05T11:35:15.678 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.675+0000 7f26f5634780 1 > prepared part key=_multipart_5V0Q651D4VN2.2~0Z1I02501B0Z.0 size=1048576 2023-10-05T11:35:15.679 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.676+0000 7f26f5634780 1 > prepared part key=_multipart_5V0Q651D4VN2.2~0Z1I02501B0Z.1 size=1048576 2023-10-05T11:35:15.680 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.677+0000 7f26f5634780 1 > prepared part key=_multipart_5V0Q651D4VN2.2~0Z1I02501B0Z.2 size=21572 2023-10-05T11:35:15.680 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.677+0000 7f26f5634780 1 > prepared multipart upload key=5V0Q651D4VN2 upload=0Z1I02501B0Z tag=HPEANAR62R2M type=write size=3167300 2023-10-05T11:35:15.682 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.678+0000 7f26f5634780 1 < completed write operation key=4D3H60UTIXH3 tag=I8CMKEMJEZDT type=write size=641776 2023-10-05T11:35:15.684 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.680+0000 7f26f5634780 1 > prepared part key=_multipart_9S0YW7PPSJ8G.2~HGF99MDQ72P3.0 size=692 2023-10-05T11:35:15.684 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.680+0000 7f26f5634780 1 > prepared multipart upload key=9S0YW7PPSJ8G upload=HGF99MDQ72P3 tag=ZZQQ4RHK5QJR type=write size=1049268 2023-10-05T11:35:15.685 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.682+0000 7f26f5634780 1 < completed part key=_multipart_IC7T3ZK81WQS.2~HWJDHJ1NBSVZ.0 size=1048576 2023-10-05T11:35:15.686 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.683+0000 7f26f5634780 1 < completed part key=_multipart_IC7T3ZK81WQS.2~HWJDHJ1NBSVZ.1 size=1048576 2023-10-05T11:35:15.687 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.684+0000 7f26f5634780 1 < completed part key=_multipart_IC7T3ZK81WQS.2~HWJDHJ1NBSVZ.2 size=815921 2023-10-05T11:35:15.689 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.686+0000 7f26f5634780 1 < completed multipart upload key=IC7T3ZK81WQS upload=HWJDHJ1NBSVZ tag=OJZJLEXS9Y6R type=write size=3961649 2023-10-05T11:35:15.691 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.688+0000 7f26f5634780 1 > prepared part key=_multipart_5OPHKTHXVN5U.2~1YO5RT4OFY8N.0 size=1048576 2023-10-05T11:35:15.692 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.689+0000 7f26f5634780 1 > prepared part key=_multipart_5OPHKTHXVN5U.2~1YO5RT4OFY8N.1 size=751537 2023-10-05T11:35:15.692 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.689+0000 7f26f5634780 1 > prepared multipart upload key=5OPHKTHXVN5U upload=1YO5RT4OFY8N tag=2XQ2MDZZKFU9 type=write size=2848689 2023-10-05T11:35:15.694 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.690+0000 7f26f5634780 1 < completed delete operation key=761J2C7GHWU5 tag=DAJ9DJU05ZH5 type=del 2023-10-05T11:35:15.697 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.692+0000 7f26f5634780 1 > prepared part key=_multipart_0PWYKC7S6YJ4.2~DU84SVLAUF25.0 size=215108 2023-10-05T11:35:15.698 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.692+0000 7f26f5634780 1 > prepared multipart upload key=0PWYKC7S6YJ4 upload=DU84SVLAUF25 tag=LK3CS3E8RY7H type=write size=1263684 2023-10-05T11:35:15.698 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.694+0000 7f26f5634780 1 < completed delete operation key=BU3KSHTINB36 tag=GG92T0AY92KZ type=del 2023-10-05T11:35:15.699 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.696+0000 7f26f5634780 1 > prepared part key=_multipart_4IBQJLJR7LD8.2~WMQ21RJ2E3LB.0 size=1048576 2023-10-05T11:35:15.700 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.697+0000 7f26f5634780 1 > prepared part key=_multipart_4IBQJLJR7LD8.2~WMQ21RJ2E3LB.1 size=1048576 2023-10-05T11:35:15.701 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.697+0000 7f26f5634780 1 > prepared part key=_multipart_4IBQJLJR7LD8.2~WMQ21RJ2E3LB.2 size=994495 2023-10-05T11:35:15.701 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.697+0000 7f26f5634780 1 > prepared multipart upload key=4IBQJLJR7LD8 upload=WMQ21RJ2E3LB tag=RWOAG7CTQKVS type=write size=4140223 2023-10-05T11:35:15.702 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.699+0000 7f26f5634780 1 < completed delete operation key=J5EIH25Y471T tag=A4N6BVR6V3AF type=del 2023-10-05T11:35:15.703 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.700+0000 7f26f5634780 1 > prepared operation key=PC8WTJ8AYJ24 tag=2T3HZ217VLJA type=write size=599332 2023-10-05T11:35:15.704 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.701+0000 7f26f5634780 1 < completed delete operation key=8IPCP77WVVZT tag=5PU6YQY3PEJ5 type=del 2023-10-05T11:35:15.706 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.702+0000 7f26f5634780 1 > prepared operation key=2D4PDQQT54ZA tag=U0Z7QAFOC56C type=del size=3283365 2023-10-05T11:35:15.707 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.703+0000 7f26f5634780 1 < canceled operation key=S3DKYDFT4IO2 tag=JDP7NEEG2UNE type=del size=2021543 2023-10-05T11:35:15.708 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.705+0000 7f26f5634780 1 > prepared operation key=0PWYKC7S6YJ4 tag=EXIRG8S5UI5T type=del size=1421954 2023-10-05T11:35:15.709 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.706+0000 7f26f5634780 1 < completed write operation key=6DP3UJ4CW1MO tag=BNOICFHZCQZN type=write size=368800 2023-10-05T11:35:15.710 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.707+0000 7f26f5634780 1 > prepared operation key=W2GWVGX42QLD tag=YBIFBK0TXJ20 type=del size=956582 2023-10-05T11:35:15.712 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.708+0000 7f26f5634780 1 < completed part key=_multipart_PNV0Q6ZPLYV0.2~PIF4Y6RDVMIZ.0 size=626641 2023-10-05T11:35:15.713 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.710+0000 7f26f5634780 1 < completed multipart upload key=PNV0Q6ZPLYV0 upload=PIF4Y6RDVMIZ tag=ZTW01B1TXKA6 type=write size=1675217 2023-10-05T11:35:15.715 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.711+0000 7f26f5634780 1 > prepared operation key=2U0NRDGDNUTA tag=9J5J0UCCX1Q0 type=del size=2359078 2023-10-05T11:35:15.716 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.712+0000 7f26f5634780 1 < completed delete operation key=VJTFYDETLSFD tag=3UI9JI9LKBLB type=del 2023-10-05T11:35:15.717 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.714+0000 7f26f5634780 1 > prepared operation key=U6172JUYW7J6 tag=119S89JI7E2Y type=del size=2845023 2023-10-05T11:35:15.718 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.715+0000 7f26f5634780 1 < canceled operation key=IC7T3ZK81WQS tag=WZ2HBMQ38D4B type=write size=850216 2023-10-05T11:35:15.719 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.716+0000 7f26f5634780 1 > prepared operation key=8IPCP77WVVZT tag=O2UBSVXM0W7A type=del size=3229784 2023-10-05T11:35:15.721 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.717+0000 7f26f5634780 1 < completed delete operation key=AV0XKXX1IR4B tag=DK2S6YM1P11I type=del 2023-10-05T11:35:15.723 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.720+0000 7f26f5634780 1 > prepared part key=_multipart_QYQDXVIGZ7O8.2~ZYVKQ3QZ2ULH.0 size=489617 2023-10-05T11:35:15.724 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.720+0000 7f26f5634780 1 > prepared multipart upload key=QYQDXVIGZ7O8 upload=ZYVKQ3QZ2ULH tag=DN96SFFNSEY2 type=write size=1538193 2023-10-05T11:35:15.725 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.721+0000 7f26f5634780 1 < completed delete operation key=5V0Q651D4VN2 tag=2UTOFHL4MK6H type=del 2023-10-05T11:35:15.726 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.723+0000 7f26f5634780 1 > prepared operation key=LLR5J3X15W5R tag=4CS8NCIFKPHX type=write size=494579 2023-10-05T11:35:15.727 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.724+0000 7f26f5634780 1 < completed delete operation key=5OPHKTHXVN5U tag=EZBG1TUMX5N2 type=del 2023-10-05T11:35:15.729 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.725+0000 7f26f5634780 1 > prepared operation key=7W9LL5HSU3BG tag=EQSBPST0G32Q type=del size=3152905 2023-10-05T11:35:15.731 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.728+0000 7f26f5634780 1 < completed part key=_multipart_IC7T3ZK81WQS.2~SOETDSJ2I28S.0 size=1048576 2023-10-05T11:35:15.732 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.729+0000 7f26f5634780 1 < completed part key=_multipart_IC7T3ZK81WQS.2~SOETDSJ2I28S.1 size=31130 2023-10-05T11:35:15.734 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.731+0000 7f26f5634780 1 < completed multipart upload key=IC7T3ZK81WQS upload=SOETDSJ2I28S tag=SNY02RYIDNQ8 type=write size=2128282 2023-10-05T11:35:15.736 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.732+0000 7f26f5634780 1 > prepared operation key=FOMNIIY47UUM tag=FDGQJU0T8CFC type=del size=1496700 2023-10-05T11:35:15.737 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.734+0000 7f26f5634780 1 < completed part key=_multipart_5V0Q651D4VN2.2~0Z1I02501B0Z.0 size=1048576 2023-10-05T11:35:15.738 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.735+0000 7f26f5634780 1 < completed part key=_multipart_5V0Q651D4VN2.2~0Z1I02501B0Z.1 size=1048576 2023-10-05T11:35:15.739 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.736+0000 7f26f5634780 1 < completed part key=_multipart_5V0Q651D4VN2.2~0Z1I02501B0Z.2 size=21572 2023-10-05T11:35:15.741 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.738+0000 7f26f5634780 1 < completed multipart upload key=5V0Q651D4VN2 upload=0Z1I02501B0Z tag=HPEANAR62R2M type=write size=3167300 2023-10-05T11:35:15.743 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.740+0000 7f26f5634780 1 > prepared part key=_multipart_2D4PDQQT54ZA.2~NAPLTUF11GZJ.0 size=1048576 2023-10-05T11:35:15.744 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.741+0000 7f26f5634780 1 > prepared part key=_multipart_2D4PDQQT54ZA.2~NAPLTUF11GZJ.1 size=1005351 2023-10-05T11:35:15.744 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.741+0000 7f26f5634780 1 > prepared multipart upload key=2D4PDQQT54ZA upload=NAPLTUF11GZJ tag=ZXA09JEB9UNJ type=write size=3102503 2023-10-05T11:35:15.745 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.742+0000 7f26f5634780 1 < completed part key=_multipart_9S0YW7PPSJ8G.2~HGF99MDQ72P3.0 size=692 2023-10-05T11:35:15.747 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.744+0000 7f26f5634780 1 < completed multipart upload key=9S0YW7PPSJ8G upload=HGF99MDQ72P3 tag=ZZQQ4RHK5QJR type=write size=1049268 2023-10-05T11:35:15.750 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.746+0000 7f26f5634780 1 > prepared part key=_multipart_7W9LL5HSU3BG.2~7FTCI9AXWTJF.0 size=1048576 2023-10-05T11:35:15.750 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.747+0000 7f26f5634780 1 > prepared part key=_multipart_7W9LL5HSU3BG.2~7FTCI9AXWTJF.1 size=1048576 2023-10-05T11:35:15.752 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.748+0000 7f26f5634780 1 > prepared part key=_multipart_7W9LL5HSU3BG.2~7FTCI9AXWTJF.2 size=997356 2023-10-05T11:35:15.752 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.748+0000 7f26f5634780 1 > prepared multipart upload key=7W9LL5HSU3BG upload=7FTCI9AXWTJF tag=KM30E5SNY9M4 type=write size=4143084 2023-10-05T11:35:15.753 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.749+0000 7f26f5634780 1 < completed part key=_multipart_5OPHKTHXVN5U.2~1YO5RT4OFY8N.0 size=1048576 2023-10-05T11:35:15.754 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.750+0000 7f26f5634780 1 < completed part key=_multipart_5OPHKTHXVN5U.2~1YO5RT4OFY8N.1 size=751537 2023-10-05T11:35:15.756 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.752+0000 7f26f5634780 1 < completed multipart upload key=5OPHKTHXVN5U upload=1YO5RT4OFY8N tag=2XQ2MDZZKFU9 type=write size=2848689 2023-10-05T11:35:15.757 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.753+0000 7f26f5634780 1 > prepared operation key=WYN9BG66LA3K tag=GCWDVHJLO1SD type=del size=398843 2023-10-05T11:35:15.757 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.754+0000 7f26f5634780 1 < canceled part key=_multipart_0PWYKC7S6YJ4.2~DU84SVLAUF25.0 size=215108 2023-10-05T11:35:15.759 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.756+0000 7f26f5634780 1 < canceled multipart upload key=0PWYKC7S6YJ4 upload=DU84SVLAUF25 tag=LK3CS3E8RY7H type=write size=1263684 2023-10-05T11:35:15.760 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.757+0000 7f26f5634780 1 > prepared operation key=4IBQJLJR7LD8 tag=XWW3BYQFZO7D type=del size=4136745 2023-10-05T11:35:15.762 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.759+0000 7f26f5634780 1 < completed part key=_multipart_4IBQJLJR7LD8.2~WMQ21RJ2E3LB.0 size=1048576 2023-10-05T11:35:15.763 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.760+0000 7f26f5634780 1 < completed part key=_multipart_4IBQJLJR7LD8.2~WMQ21RJ2E3LB.1 size=1048576 2023-10-05T11:35:15.764 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.761+0000 7f26f5634780 1 < completed part key=_multipart_4IBQJLJR7LD8.2~WMQ21RJ2E3LB.2 size=994495 2023-10-05T11:35:15.767 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.763+0000 7f26f5634780 1 < completed multipart upload key=4IBQJLJR7LD8 upload=WMQ21RJ2E3LB tag=RWOAG7CTQKVS type=write size=4140223 2023-10-05T11:35:15.768 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.764+0000 7f26f5634780 1 > prepared operation key=WTCWG1C1SF89 tag=E4KRCJISJG2H type=write size=808297 2023-10-05T11:35:15.769 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.765+0000 7f26f5634780 1 < completed write operation key=PC8WTJ8AYJ24 tag=2T3HZ217VLJA type=write size=599332 2023-10-05T11:35:15.771 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.768+0000 7f26f5634780 1 > prepared part key=_multipart_W2GWVGX42QLD.2~L9ZP3AR2NDLV.0 size=1048576 2023-10-05T11:35:15.772 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.769+0000 7f26f5634780 1 > prepared part key=_multipart_W2GWVGX42QLD.2~L9ZP3AR2NDLV.1 size=1048576 2023-10-05T11:35:15.773 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.770+0000 7f26f5634780 1 > prepared part key=_multipart_W2GWVGX42QLD.2~L9ZP3AR2NDLV.2 size=514145 2023-10-05T11:35:15.773 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.770+0000 7f26f5634780 1 > prepared multipart upload key=W2GWVGX42QLD upload=L9ZP3AR2NDLV tag=DVGOILKOTK5X type=write size=3659873 2023-10-05T11:35:15.775 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.771+0000 7f26f5634780 1 < completed delete operation key=2D4PDQQT54ZA tag=U0Z7QAFOC56C type=del 2023-10-05T11:35:15.777 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.773+0000 7f26f5634780 1 > prepared part key=_multipart_AV0XKXX1IR4B.2~WHNKIXHEWRYV.0 size=1048576 2023-10-05T11:35:15.778 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.774+0000 7f26f5634780 1 > prepared part key=_multipart_AV0XKXX1IR4B.2~WHNKIXHEWRYV.1 size=170529 2023-10-05T11:35:15.778 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.774+0000 7f26f5634780 1 > prepared multipart upload key=AV0XKXX1IR4B upload=WHNKIXHEWRYV tag=7I8WGT5QVPFA type=write size=2267681 2023-10-05T11:35:15.779 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.776+0000 7f26f5634780 1 < canceled operation key=0PWYKC7S6YJ4 tag=EXIRG8S5UI5T type=del size=1421954 2023-10-05T11:35:15.781 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.778+0000 7f26f5634780 1 > prepared part key=_multipart_PC8WTJ8AYJ24.2~KL21NUCQ62U7.0 size=1048576 2023-10-05T11:35:15.782 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.779+0000 7f26f5634780 1 > prepared part key=_multipart_PC8WTJ8AYJ24.2~KL21NUCQ62U7.1 size=1048576 2023-10-05T11:35:15.783 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.780+0000 7f26f5634780 1 > prepared part key=_multipart_PC8WTJ8AYJ24.2~KL21NUCQ62U7.2 size=768083 2023-10-05T11:35:15.783 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.780+0000 7f26f5634780 1 > prepared multipart upload key=PC8WTJ8AYJ24 upload=KL21NUCQ62U7 tag=JD8R00XQHVTP type=write size=3913811 2023-10-05T11:35:15.786 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.783+0000 7f26f5634780 1 < completed delete operation key=W2GWVGX42QLD tag=YBIFBK0TXJ20 type=del 2023-10-05T11:35:15.789 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.785+0000 7f26f5634780 1 > prepared operation key=761J2C7GHWU5 tag=HW087PDIM8TS type=del size=3809293 2023-10-05T11:35:15.790 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.787+0000 7f26f5634780 1 < completed delete operation key=2U0NRDGDNUTA tag=9J5J0UCCX1Q0 type=del 2023-10-05T11:35:15.791 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.788+0000 7f26f5634780 1 > prepared operation key=2U0NRDGDNUTA tag=GYXP212VQA5O type=del size=585490 2023-10-05T11:35:15.792 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.789+0000 7f26f5634780 1 < completed delete operation key=U6172JUYW7J6 tag=119S89JI7E2Y type=del 2023-10-05T11:35:15.794 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.790+0000 7f26f5634780 1 > prepared operation key=5OPHKTHXVN5U tag=NOZSAUHRZB0A type=del size=688776 2023-10-05T11:35:15.795 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.792+0000 7f26f5634780 1 < completed delete operation key=8IPCP77WVVZT tag=O2UBSVXM0W7A type=del 2023-10-05T11:35:15.796 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.793+0000 7f26f5634780 1 > prepared operation key=2D4PDQQT54ZA tag=2YRAQ1DK9GG1 type=del size=4150490 2023-10-05T11:35:15.797 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.794+0000 7f26f5634780 1 < completed part key=_multipart_QYQDXVIGZ7O8.2~ZYVKQ3QZ2ULH.0 size=489617 2023-10-05T11:35:15.799 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.796+0000 7f26f5634780 1 < completed multipart upload key=QYQDXVIGZ7O8 upload=ZYVKQ3QZ2ULH tag=DN96SFFNSEY2 type=write size=1538193 2023-10-05T11:35:15.800 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.797+0000 7f26f5634780 1 > prepared operation key=QYQDXVIGZ7O8 tag=OAZ0P60NR01P type=write size=123287 2023-10-05T11:35:15.801 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.798+0000 7f26f5634780 1 < canceled operation key=LLR5J3X15W5R tag=4CS8NCIFKPHX type=write size=494579 2023-10-05T11:35:15.803 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.799+0000 7f26f5634780 1 > prepared operation key=U6172JUYW7J6 tag=U55DXZD128V4 type=del size=1459629 2023-10-05T11:35:15.804 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.800+0000 7f26f5634780 1 < completed delete operation key=7W9LL5HSU3BG tag=EQSBPST0G32Q type=del 2023-10-05T11:35:15.806 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.802+0000 7f26f5634780 1 > prepared part key=_multipart_J5EIH25Y471T.2~HYWXQXO3YOG7.0 size=928457 2023-10-05T11:35:15.806 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.802+0000 7f26f5634780 1 > prepared multipart upload key=J5EIH25Y471T upload=HYWXQXO3YOG7 tag=EWM29MKQMS06 type=write size=1977033 2023-10-05T11:35:15.807 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.804+0000 7f26f5634780 1 < completed delete operation key=FOMNIIY47UUM tag=FDGQJU0T8CFC type=del 2023-10-05T11:35:15.808 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.805+0000 7f26f5634780 1 > prepared operation key=MEY4SZRHU9NZ tag=FBU7Z5ABR0MJ type=del size=1852198 2023-10-05T11:35:15.809 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.806+0000 7f26f5634780 1 < completed part key=_multipart_2D4PDQQT54ZA.2~NAPLTUF11GZJ.0 size=1048576 2023-10-05T11:35:15.810 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.807+0000 7f26f5634780 1 < completed part key=_multipart_2D4PDQQT54ZA.2~NAPLTUF11GZJ.1 size=1005351 2023-10-05T11:35:15.812 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.809+0000 7f26f5634780 1 < completed multipart upload key=2D4PDQQT54ZA upload=NAPLTUF11GZJ tag=ZXA09JEB9UNJ type=write size=3102503 2023-10-05T11:35:15.813 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.810+0000 7f26f5634780 1 > prepared operation key=0PWYKC7S6YJ4 tag=DPLDDTZI3E9K type=del size=2871661 2023-10-05T11:35:15.815 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.811+0000 7f26f5634780 1 < completed part key=_multipart_7W9LL5HSU3BG.2~7FTCI9AXWTJF.0 size=1048576 2023-10-05T11:35:15.815 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.811+0000 7f26f5634780 1 < canceled part key=_multipart_7W9LL5HSU3BG.2~7FTCI9AXWTJF.1 size=1048576 2023-10-05T11:35:15.816 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.812+0000 7f26f5634780 1 < completed part key=_multipart_7W9LL5HSU3BG.2~7FTCI9AXWTJF.2 size=997356 2023-10-05T11:35:15.818 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.814+0000 7f26f5634780 1 < canceled multipart upload key=7W9LL5HSU3BG upload=7FTCI9AXWTJF tag=KM30E5SNY9M4 type=write size=4143084 2023-10-05T11:35:15.819 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.815+0000 7f26f5634780 1 > prepared operation key=PC8WTJ8AYJ24 tag=F7BZ0HW2VW1Y type=del size=3536849 2023-10-05T11:35:15.820 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.817+0000 7f26f5634780 1 < completed delete operation key=WYN9BG66LA3K tag=GCWDVHJLO1SD type=del 2023-10-05T11:35:15.821 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.818+0000 7f26f5634780 1 > prepared operation key=761J2C7GHWU5 tag=LMBSJI9R4280 type=del size=958977 2023-10-05T11:35:15.824 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.820+0000 7f26f5634780 1 < suggested remove operation key=4IBQJLJR7LD8 tag=XWW3BYQFZO7D type=del 2023-10-05T11:35:15.825 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.821+0000 7f26f5634780 1 > prepared operation key=W2GWVGX42QLD tag=GR3HL788K814 type=del size=1129074 2023-10-05T11:35:15.826 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.823+0000 7f26f5634780 1 < completed write operation key=WTCWG1C1SF89 tag=E4KRCJISJG2H type=write size=808297 2023-10-05T11:35:15.827 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.824+0000 7f26f5634780 1 > prepared operation key=761J2C7GHWU5 tag=WTTU4QBZH662 type=del size=1946357 2023-10-05T11:35:15.828 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.824+0000 7f26f5634780 1 < canceled part key=_multipart_W2GWVGX42QLD.2~L9ZP3AR2NDLV.0 size=1048576 2023-10-05T11:35:15.829 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.825+0000 7f26f5634780 1 < completed part key=_multipart_W2GWVGX42QLD.2~L9ZP3AR2NDLV.1 size=1048576 2023-10-05T11:35:15.830 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.826+0000 7f26f5634780 1 < completed part key=_multipart_W2GWVGX42QLD.2~L9ZP3AR2NDLV.2 size=514145 2023-10-05T11:35:15.831 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.828+0000 7f26f5634780 1 < canceled multipart upload key=W2GWVGX42QLD upload=L9ZP3AR2NDLV tag=DVGOILKOTK5X type=write size=3659873 2023-10-05T11:35:15.833 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.829+0000 7f26f5634780 1 > prepared operation key=0PWYKC7S6YJ4 tag=FK9DGVLQR32M type=del size=53815 2023-10-05T11:35:15.834 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.830+0000 7f26f5634780 1 < completed part key=_multipart_AV0XKXX1IR4B.2~WHNKIXHEWRYV.0 size=1048576 2023-10-05T11:35:15.835 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.831+0000 7f26f5634780 1 < completed part key=_multipart_AV0XKXX1IR4B.2~WHNKIXHEWRYV.1 size=170529 2023-10-05T11:35:15.837 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.833+0000 7f26f5634780 1 < completed multipart upload key=AV0XKXX1IR4B upload=WHNKIXHEWRYV tag=7I8WGT5QVPFA type=write size=2267681 2023-10-05T11:35:15.838 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.835+0000 7f26f5634780 1 > prepared operation key=PNV0Q6ZPLYV0 tag=0AMQ6DEKHE4V type=del size=2854270 2023-10-05T11:35:15.838 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.835+0000 7f26f5634780 1 < canceled part key=_multipart_PC8WTJ8AYJ24.2~KL21NUCQ62U7.0 size=1048576 2023-10-05T11:35:15.839 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.836+0000 7f26f5634780 1 < completed part key=_multipart_PC8WTJ8AYJ24.2~KL21NUCQ62U7.1 size=1048576 2023-10-05T11:35:15.840 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.837+0000 7f26f5634780 1 < completed part key=_multipart_PC8WTJ8AYJ24.2~KL21NUCQ62U7.2 size=768083 2023-10-05T11:35:15.842 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.839+0000 7f26f5634780 1 < canceled multipart upload key=PC8WTJ8AYJ24 upload=KL21NUCQ62U7 tag=JD8R00XQHVTP type=write size=3913811 2023-10-05T11:35:15.845 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.841+0000 7f26f5634780 1 > prepared part key=_multipart_QYQDXVIGZ7O8.2~GKJZICPT5QW2.0 size=505546 2023-10-05T11:35:15.845 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.841+0000 7f26f5634780 1 > prepared multipart upload key=QYQDXVIGZ7O8 upload=GKJZICPT5QW2 tag=S6AM05SXJU89 type=write size=1554122 2023-10-05T11:35:15.846 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.842+0000 7f26f5634780 1 < completed delete operation key=761J2C7GHWU5 tag=HW087PDIM8TS type=del 2023-10-05T11:35:15.847 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.844+0000 7f26f5634780 1 > prepared operation key=8IPCP77WVVZT tag=QB66HEC60Q4J type=del size=105941 2023-10-05T11:35:15.848 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.845+0000 7f26f5634780 1 < completed delete operation key=2U0NRDGDNUTA tag=GYXP212VQA5O type=del 2023-10-05T11:35:15.849 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.846+0000 7f26f5634780 1 > prepared operation key=7TOP5A52M9YP tag=R6NU43YZ9QRG type=del size=2870296 2023-10-05T11:35:15.852 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.848+0000 7f26f5634780 1 < suggested update operation key=5OPHKTHXVN5U tag=NOZSAUHRZB0A type=del size=688776 2023-10-05T11:35:15.853 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.849+0000 7f26f5634780 1 > prepared operation key=J5EIH25Y471T tag=J2220YOZQHUP type=del size=3579040 2023-10-05T11:35:15.854 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.851+0000 7f26f5634780 1 < completed delete operation key=2D4PDQQT54ZA tag=2YRAQ1DK9GG1 type=del 2023-10-05T11:35:15.856 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.853+0000 7f26f5634780 1 > prepared part key=_multipart_9S0YW7PPSJ8G.2~BF70LNBA3JHQ.0 size=1048576 2023-10-05T11:35:15.857 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.854+0000 7f26f5634780 1 > prepared part key=_multipart_9S0YW7PPSJ8G.2~BF70LNBA3JHQ.1 size=1048576 2023-10-05T11:35:15.858 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.855+0000 7f26f5634780 1 > prepared part key=_multipart_9S0YW7PPSJ8G.2~BF70LNBA3JHQ.2 size=1037848 2023-10-05T11:35:15.858 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.855+0000 7f26f5634780 1 > prepared multipart upload key=9S0YW7PPSJ8G upload=BF70LNBA3JHQ tag=BY9FO22Y54F8 type=write size=4183576 2023-10-05T11:35:15.860 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.857+0000 7f26f5634780 1 < suggested remove operation key=QYQDXVIGZ7O8 tag=OAZ0P60NR01P type=write 2023-10-05T11:35:15.862 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.858+0000 7f26f5634780 1 > prepared operation key=MEY4SZRHU9NZ tag=UCJKZBWQ9N98 type=del size=247110 2023-10-05T11:35:15.864 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.861+0000 7f26f5634780 1 < suggested remove operation key=U6172JUYW7J6 tag=U55DXZD128V4 type=del 2023-10-05T11:35:15.865 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.862+0000 7f26f5634780 1 > prepared operation key=MEY4SZRHU9NZ tag=A3769LV69AB6 type=del size=2606575 2023-10-05T11:35:15.866 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.863+0000 7f26f5634780 1 < completed part key=_multipart_J5EIH25Y471T.2~HYWXQXO3YOG7.0 size=928457 2023-10-05T11:35:15.869 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.865+0000 7f26f5634780 1 < completed multipart upload key=J5EIH25Y471T upload=HYWXQXO3YOG7 tag=EWM29MKQMS06 type=write size=1977033 2023-10-05T11:35:15.870 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.866+0000 7f26f5634780 1 > prepared operation key=S3DKYDFT4IO2 tag=U763266UVZ01 type=del size=509557 2023-10-05T11:35:15.871 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.868+0000 7f26f5634780 1 < completed delete operation key=MEY4SZRHU9NZ tag=FBU7Z5ABR0MJ type=del 2023-10-05T11:35:15.872 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.869+0000 7f26f5634780 1 > prepared operation key=VJTFYDETLSFD tag=I6MBLA86R1PE type=del size=1393149 2023-10-05T11:35:15.874 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.870+0000 7f26f5634780 1 < completed delete operation key=0PWYKC7S6YJ4 tag=DPLDDTZI3E9K type=del 2023-10-05T11:35:15.875 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.871+0000 7f26f5634780 1 > prepared operation key=5OPHKTHXVN5U tag=JE6XYP1OJUTA type=write size=135925 2023-10-05T11:35:15.876 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.873+0000 7f26f5634780 1 < completed delete operation key=PC8WTJ8AYJ24 tag=F7BZ0HW2VW1Y type=del 2023-10-05T11:35:15.877 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.874+0000 7f26f5634780 1 > prepared operation key=MEY4SZRHU9NZ tag=PZ2UF0P1Z0ES type=write size=649370 2023-10-05T11:35:15.880 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.876+0000 7f26f5634780 1 < canceled operation key=761J2C7GHWU5 tag=LMBSJI9R4280 type=del size=958977 2023-10-05T11:35:15.882 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.879+0000 7f26f5634780 1 > prepared part key=_multipart_QYQDXVIGZ7O8.2~K0FTE2ZW2NT1.0 size=1048576 2023-10-05T11:35:15.883 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.880+0000 7f26f5634780 1 > prepared part key=_multipart_QYQDXVIGZ7O8.2~K0FTE2ZW2NT1.1 size=1023356 2023-10-05T11:35:15.883 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.880+0000 7f26f5634780 1 > prepared multipart upload key=QYQDXVIGZ7O8 upload=K0FTE2ZW2NT1 tag=QFBOK0VWWCKK type=write size=3120508 2023-10-05T11:35:15.885 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.881+0000 7f26f5634780 1 < completed delete operation key=W2GWVGX42QLD tag=GR3HL788K814 type=del 2023-10-05T11:35:15.887 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.884+0000 7f26f5634780 1 > prepared part key=_multipart_FOMNIIY47UUM.2~27MF9DIHF3FU.0 size=1048576 2023-10-05T11:35:15.888 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.885+0000 7f26f5634780 1 > prepared part key=_multipart_FOMNIIY47UUM.2~27MF9DIHF3FU.1 size=586858 2023-10-05T11:35:15.888 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.885+0000 7f26f5634780 1 > prepared multipart upload key=FOMNIIY47UUM upload=27MF9DIHF3FU tag=OAUD8ICGEZM8 type=write size=2684010 2023-10-05T11:35:15.889 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.886+0000 7f26f5634780 1 < canceled operation key=761J2C7GHWU5 tag=WTTU4QBZH662 type=del size=1946357 2023-10-05T11:35:15.892 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.889+0000 7f26f5634780 1 > prepared part key=_multipart_WTCWG1C1SF89.2~LNHXPAMGDU23.0 size=1048576 2023-10-05T11:35:15.893 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.890+0000 7f26f5634780 1 > prepared part key=_multipart_WTCWG1C1SF89.2~LNHXPAMGDU23.1 size=1048576 2023-10-05T11:35:15.894 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.891+0000 7f26f5634780 1 > prepared part key=_multipart_WTCWG1C1SF89.2~LNHXPAMGDU23.2 size=538496 2023-10-05T11:35:15.895 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.891+0000 7f26f5634780 1 > prepared multipart upload key=WTCWG1C1SF89 upload=LNHXPAMGDU23 tag=LYYM779UE2OO type=write size=3684224 2023-10-05T11:35:15.897 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.894+0000 7f26f5634780 1 < suggested remove operation key=0PWYKC7S6YJ4 tag=FK9DGVLQR32M type=del 2023-10-05T11:35:15.900 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.896+0000 7f26f5634780 1 > prepared part key=_multipart_LLR5J3X15W5R.2~07C37EPO183T.0 size=1048576 2023-10-05T11:35:15.901 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.897+0000 7f26f5634780 1 > prepared part key=_multipart_LLR5J3X15W5R.2~07C37EPO183T.1 size=1048576 2023-10-05T11:35:15.902 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.899+0000 7f26f5634780 1 > prepared part key=_multipart_LLR5J3X15W5R.2~07C37EPO183T.2 size=668914 2023-10-05T11:35:15.902 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.899+0000 7f26f5634780 1 > prepared multipart upload key=LLR5J3X15W5R upload=07C37EPO183T tag=FNE6WHGC0KX4 type=write size=3814642 2023-10-05T11:35:15.903 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.900+0000 7f26f5634780 1 < completed delete operation key=PNV0Q6ZPLYV0 tag=0AMQ6DEKHE4V type=del 2023-10-05T11:35:15.906 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.903+0000 7f26f5634780 1 > prepared part key=_multipart_WYN9BG66LA3K.2~LLS810YKTPX7.0 size=1048576 2023-10-05T11:35:15.907 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.904+0000 7f26f5634780 1 > prepared part key=_multipart_WYN9BG66LA3K.2~LLS810YKTPX7.1 size=889878 2023-10-05T11:35:15.907 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.904+0000 7f26f5634780 1 > prepared multipart upload key=WYN9BG66LA3K upload=LLS810YKTPX7 tag=I1ISU0KVG7LH type=write size=2987030 2023-10-05T11:35:15.908 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.905+0000 7f26f5634780 1 < completed part key=_multipart_QYQDXVIGZ7O8.2~GKJZICPT5QW2.0 size=505546 2023-10-05T11:35:15.910 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.907+0000 7f26f5634780 1 < completed multipart upload key=QYQDXVIGZ7O8 upload=GKJZICPT5QW2 tag=S6AM05SXJU89 type=write size=1554122 2023-10-05T11:35:15.911 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.908+0000 7f26f5634780 1 > prepared operation key=S3DKYDFT4IO2 tag=7MLJLR4RMA34 type=del size=2807534 2023-10-05T11:35:15.913 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.909+0000 7f26f5634780 1 < canceled operation key=8IPCP77WVVZT tag=QB66HEC60Q4J type=del size=105941 2023-10-05T11:35:15.914 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.911+0000 7f26f5634780 1 > prepared operation key=7W9LL5HSU3BG tag=4QIPY6N3UVGQ type=del size=3202762 2023-10-05T11:35:15.915 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.912+0000 7f26f5634780 1 < completed delete operation key=7TOP5A52M9YP tag=R6NU43YZ9QRG type=del 2023-10-05T11:35:15.916 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.913+0000 7f26f5634780 1 > prepared operation key=IC7T3ZK81WQS tag=RJPLP31PNXQG type=del size=3778498 2023-10-05T11:35:15.919 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.915+0000 7f26f5634780 1 < suggested remove operation key=J5EIH25Y471T tag=J2220YOZQHUP type=del 2023-10-05T11:35:15.921 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.917+0000 7f26f5634780 1 > prepared part key=_multipart_BTZUVE8R96XT.2~5T3U5L5ASOCP.0 size=1048576 2023-10-05T11:35:15.922 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.918+0000 7f26f5634780 1 > prepared part key=_multipart_BTZUVE8R96XT.2~5T3U5L5ASOCP.1 size=1048576 2023-10-05T11:35:15.923 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.919+0000 7f26f5634780 1 > prepared part key=_multipart_BTZUVE8R96XT.2~5T3U5L5ASOCP.2 size=459108 2023-10-05T11:35:15.923 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.919+0000 7f26f5634780 1 > prepared multipart upload key=BTZUVE8R96XT upload=5T3U5L5ASOCP tag=CZEI6FENGU4Z type=write size=3604836 2023-10-05T11:35:15.924 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.920+0000 7f26f5634780 1 < completed part key=_multipart_9S0YW7PPSJ8G.2~BF70LNBA3JHQ.0 size=1048576 2023-10-05T11:35:15.925 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.922+0000 7f26f5634780 1 < completed part key=_multipart_9S0YW7PPSJ8G.2~BF70LNBA3JHQ.1 size=1048576 2023-10-05T11:35:15.926 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.923+0000 7f26f5634780 1 < completed part key=_multipart_9S0YW7PPSJ8G.2~BF70LNBA3JHQ.2 size=1037848 2023-10-05T11:35:15.928 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.925+0000 7f26f5634780 1 < completed multipart upload key=9S0YW7PPSJ8G upload=BF70LNBA3JHQ tag=BY9FO22Y54F8 type=write size=4183576 2023-10-05T11:35:15.929 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.926+0000 7f26f5634780 1 > prepared operation key=FOMNIIY47UUM tag=TQ0P6G9WWJOV type=del size=3161918 2023-10-05T11:35:15.930 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.927+0000 7f26f5634780 1 < completed delete operation key=MEY4SZRHU9NZ tag=UCJKZBWQ9N98 type=del 2023-10-05T11:35:15.933 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.930+0000 7f26f5634780 1 > prepared part key=_multipart_761J2C7GHWU5.2~5LI1UQFE0UPK.0 size=737083 2023-10-05T11:35:15.933 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.930+0000 7f26f5634780 1 > prepared multipart upload key=761J2C7GHWU5 upload=5LI1UQFE0UPK tag=QQVGPXZUE4ZI type=write size=1785659 2023-10-05T11:35:15.934 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.931+0000 7f26f5634780 1 < completed delete operation key=MEY4SZRHU9NZ tag=A3769LV69AB6 type=del 2023-10-05T11:35:15.937 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.933+0000 7f26f5634780 1 > prepared part key=_multipart_IC7T3ZK81WQS.2~M6R1O6RNIFTT.0 size=791658 2023-10-05T11:35:15.937 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.933+0000 7f26f5634780 1 > prepared multipart upload key=IC7T3ZK81WQS upload=M6R1O6RNIFTT tag=UGOVP57JTHZX type=write size=1840234 2023-10-05T11:35:15.938 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.935+0000 7f26f5634780 1 < completed delete operation key=S3DKYDFT4IO2 tag=U763266UVZ01 type=del 2023-10-05T11:35:15.939 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.936+0000 7f26f5634780 1 > prepared operation key=PC8WTJ8AYJ24 tag=QTZ5K73Z8EM8 type=del size=1204262 2023-10-05T11:35:15.942 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.938+0000 7f26f5634780 1 < suggested update operation key=VJTFYDETLSFD tag=I6MBLA86R1PE type=del size=1393149 2023-10-05T11:35:15.943 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.939+0000 7f26f5634780 1 > prepared operation key=WYN9BG66LA3K tag=O23EL7VY86M0 type=del size=1427040 2023-10-05T11:35:15.945 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.942+0000 7f26f5634780 1 < suggested update operation key=5OPHKTHXVN5U tag=JE6XYP1OJUTA type=write size=135925 2023-10-05T11:35:15.946 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.943+0000 7f26f5634780 1 > prepared operation key=BTZUVE8R96XT tag=7WNP82IV3YFJ type=del size=1091930 2023-10-05T11:35:15.947 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.944+0000 7f26f5634780 1 < completed write operation key=MEY4SZRHU9NZ tag=PZ2UF0P1Z0ES type=write size=649370 2023-10-05T11:35:15.949 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.945+0000 7f26f5634780 1 > prepared operation key=AV0XKXX1IR4B tag=IFNE77A67TWP type=del size=1682435 2023-10-05T11:35:15.950 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.946+0000 7f26f5634780 1 < completed part key=_multipart_QYQDXVIGZ7O8.2~K0FTE2ZW2NT1.0 size=1048576 2023-10-05T11:35:15.951 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.947+0000 7f26f5634780 1 < completed part key=_multipart_QYQDXVIGZ7O8.2~K0FTE2ZW2NT1.1 size=1023356 2023-10-05T11:35:15.953 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.949+0000 7f26f5634780 1 < completed multipart upload key=QYQDXVIGZ7O8 upload=K0FTE2ZW2NT1 tag=QFBOK0VWWCKK type=write size=3120508 2023-10-05T11:35:15.955 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.951+0000 7f26f5634780 1 > prepared part key=_multipart_8IPCP77WVVZT.2~ANYGGJA2S3T1.0 size=188485 2023-10-05T11:35:15.955 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.951+0000 7f26f5634780 1 > prepared multipart upload key=8IPCP77WVVZT upload=ANYGGJA2S3T1 tag=63DWYDQ60RER type=write size=1237061 2023-10-05T11:35:15.956 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.952+0000 7f26f5634780 1 < completed part key=_multipart_FOMNIIY47UUM.2~27MF9DIHF3FU.0 size=1048576 2023-10-05T11:35:15.957 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.953+0000 7f26f5634780 1 < completed part key=_multipart_FOMNIIY47UUM.2~27MF9DIHF3FU.1 size=586858 2023-10-05T11:35:15.959 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.955+0000 7f26f5634780 1 < completed multipart upload key=FOMNIIY47UUM upload=27MF9DIHF3FU tag=OAUD8ICGEZM8 type=write size=2684010 2023-10-05T11:35:15.961 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.957+0000 7f26f5634780 1 > prepared part key=_multipart_5OPHKTHXVN5U.2~M3W9ZPDM64AK.0 size=1048576 2023-10-05T11:35:15.962 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.958+0000 7f26f5634780 1 > prepared part key=_multipart_5OPHKTHXVN5U.2~M3W9ZPDM64AK.1 size=48933 2023-10-05T11:35:15.962 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.958+0000 7f26f5634780 1 > prepared multipart upload key=5OPHKTHXVN5U upload=M3W9ZPDM64AK tag=5AVGROF26MZ1 type=write size=2146085 2023-10-05T11:35:15.963 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.960+0000 7f26f5634780 1 < completed part key=_multipart_WTCWG1C1SF89.2~LNHXPAMGDU23.0 size=1048576 2023-10-05T11:35:15.964 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.961+0000 7f26f5634780 1 < completed part key=_multipart_WTCWG1C1SF89.2~LNHXPAMGDU23.1 size=1048576 2023-10-05T11:35:15.965 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.962+0000 7f26f5634780 1 < completed part key=_multipart_WTCWG1C1SF89.2~LNHXPAMGDU23.2 size=538496 2023-10-05T11:35:15.967 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.964+0000 7f26f5634780 1 < completed multipart upload key=WTCWG1C1SF89 upload=LNHXPAMGDU23 tag=LYYM779UE2OO type=write size=3684224 2023-10-05T11:35:15.968 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.965+0000 7f26f5634780 1 > prepared operation key=761J2C7GHWU5 tag=MJBF731DHPZG type=del size=3994806 2023-10-05T11:35:15.969 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.966+0000 7f26f5634780 1 < completed part key=_multipart_LLR5J3X15W5R.2~07C37EPO183T.0 size=1048576 2023-10-05T11:35:15.970 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.967+0000 7f26f5634780 1 < completed part key=_multipart_LLR5J3X15W5R.2~07C37EPO183T.1 size=1048576 2023-10-05T11:35:15.971 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.968+0000 7f26f5634780 1 < completed part key=_multipart_LLR5J3X15W5R.2~07C37EPO183T.2 size=668914 2023-10-05T11:35:15.974 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.970+0000 7f26f5634780 1 < completed multipart upload key=LLR5J3X15W5R upload=07C37EPO183T tag=FNE6WHGC0KX4 type=write size=3814642 2023-10-05T11:35:15.975 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.971+0000 7f26f5634780 1 > prepared operation key=LLR5J3X15W5R tag=KQ7ITBVJXGMN type=del size=1314267 2023-10-05T11:35:15.976 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.973+0000 7f26f5634780 1 < completed part key=_multipart_WYN9BG66LA3K.2~LLS810YKTPX7.0 size=1048576 2023-10-05T11:35:15.977 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.973+0000 7f26f5634780 1 < completed part key=_multipart_WYN9BG66LA3K.2~LLS810YKTPX7.1 size=889878 2023-10-05T11:35:15.979 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.975+0000 7f26f5634780 1 < completed multipart upload key=WYN9BG66LA3K upload=LLS810YKTPX7 tag=I1ISU0KVG7LH type=write size=2987030 2023-10-05T11:35:15.981 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.977+0000 7f26f5634780 1 > prepared part key=_multipart_5V0Q651D4VN2.2~SC2IRYGJEP78.0 size=1048576 2023-10-05T11:35:15.982 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.978+0000 7f26f5634780 1 > prepared part key=_multipart_5V0Q651D4VN2.2~SC2IRYGJEP78.1 size=1048576 2023-10-05T11:35:15.982 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.979+0000 7f26f5634780 1 > prepared part key=_multipart_5V0Q651D4VN2.2~SC2IRYGJEP78.2 size=1032910 2023-10-05T11:35:15.983 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.979+0000 7f26f5634780 1 > prepared multipart upload key=5V0Q651D4VN2 upload=SC2IRYGJEP78 tag=VVD51NSP2WB5 type=write size=4178638 2023-10-05T11:35:15.984 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.980+0000 7f26f5634780 1 < completed delete operation key=S3DKYDFT4IO2 tag=7MLJLR4RMA34 type=del 2023-10-05T11:35:15.986 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.982+0000 7f26f5634780 1 > prepared part key=_multipart_IC7T3ZK81WQS.2~3YOI0V8BAS7B.0 size=530708 2023-10-05T11:35:15.986 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.982+0000 7f26f5634780 1 > prepared multipart upload key=IC7T3ZK81WQS upload=3YOI0V8BAS7B tag=JXUIVJNXJ0T8 type=write size=1579284 2023-10-05T11:35:15.987 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.984+0000 7f26f5634780 1 < completed delete operation key=7W9LL5HSU3BG tag=4QIPY6N3UVGQ type=del 2023-10-05T11:35:15.988 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.985+0000 7f26f5634780 1 > prepared operation key=LLR5J3X15W5R tag=0I2OF9ZWO6RV type=del size=662768 2023-10-05T11:35:15.989 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.986+0000 7f26f5634780 1 < completed delete operation key=IC7T3ZK81WQS tag=RJPLP31PNXQG type=del 2023-10-05T11:35:15.991 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.988+0000 7f26f5634780 1 > prepared part key=_multipart_2D4PDQQT54ZA.2~GM1I03ZEWODA.0 size=679340 2023-10-05T11:35:15.992 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.988+0000 7f26f5634780 1 > prepared multipart upload key=2D4PDQQT54ZA upload=GM1I03ZEWODA tag=LNGDHFVHWHR2 type=write size=1727916 2023-10-05T11:35:15.994 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.990+0000 7f26f5634780 1 < completed part key=_multipart_BTZUVE8R96XT.2~5T3U5L5ASOCP.0 size=1048576 2023-10-05T11:35:15.995 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.991+0000 7f26f5634780 1 < completed part key=_multipart_BTZUVE8R96XT.2~5T3U5L5ASOCP.1 size=1048576 2023-10-05T11:35:15.996 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.992+0000 7f26f5634780 1 < completed part key=_multipart_BTZUVE8R96XT.2~5T3U5L5ASOCP.2 size=459108 2023-10-05T11:35:15.997 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.994+0000 7f26f5634780 1 < completed multipart upload key=BTZUVE8R96XT upload=5T3U5L5ASOCP tag=CZEI6FENGU4Z type=write size=3604836 2023-10-05T11:35:15.999 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.995+0000 7f26f5634780 1 > prepared operation key=8IPCP77WVVZT tag=4WFMRC3HEJEU type=del size=3288760 2023-10-05T11:35:16.000 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.996+0000 7f26f5634780 1 < completed delete operation key=FOMNIIY47UUM tag=TQ0P6G9WWJOV type=del 2023-10-05T11:35:16.001 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.998+0000 7f26f5634780 1 > prepared operation key=PC8WTJ8AYJ24 tag=40WJPC080YES type=del size=1197223 2023-10-05T11:35:16.001 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:15.998+0000 7f26f5634780 1 < canceled part key=_multipart_761J2C7GHWU5.2~5LI1UQFE0UPK.0 size=737083 2023-10-05T11:35:16.003 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.000+0000 7f26f5634780 1 < canceled multipart upload key=761J2C7GHWU5 upload=5LI1UQFE0UPK tag=QQVGPXZUE4ZI type=write size=1785659 2023-10-05T11:35:16.004 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.001+0000 7f26f5634780 1 > prepared operation key=4D3H60UTIXH3 tag=Q8F494CLMR8B type=del size=2951823 2023-10-05T11:35:16.005 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.002+0000 7f26f5634780 1 < completed part key=_multipart_IC7T3ZK81WQS.2~M6R1O6RNIFTT.0 size=791658 2023-10-05T11:35:16.007 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.004+0000 7f26f5634780 1 < completed multipart upload key=IC7T3ZK81WQS upload=M6R1O6RNIFTT tag=UGOVP57JTHZX type=write size=1840234 2023-10-05T11:35:16.009 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.006+0000 7f26f5634780 1 > prepared part key=_multipart_PNV0Q6ZPLYV0.2~VT09B8XVAWL3.0 size=418002 2023-10-05T11:35:16.009 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.006+0000 7f26f5634780 1 > prepared multipart upload key=PNV0Q6ZPLYV0 upload=VT09B8XVAWL3 tag=S89ZPH17Z1S2 type=write size=1466578 2023-10-05T11:35:16.012 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.008+0000 7f26f5634780 1 < suggested remove operation key=PC8WTJ8AYJ24 tag=QTZ5K73Z8EM8 type=del 2023-10-05T11:35:16.013 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.009+0000 7f26f5634780 1 > prepared operation key=5V0Q651D4VN2 tag=34QDO6UMJJXY type=del size=4064881 2023-10-05T11:35:16.014 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.011+0000 7f26f5634780 1 < completed delete operation key=WYN9BG66LA3K tag=O23EL7VY86M0 type=del 2023-10-05T11:35:16.016 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.013+0000 7f26f5634780 1 > prepared part key=_multipart_S3DKYDFT4IO2.2~R93TAUN8W7DB.0 size=490737 2023-10-05T11:35:16.016 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.013+0000 7f26f5634780 1 > prepared multipart upload key=S3DKYDFT4IO2 upload=R93TAUN8W7DB tag=XTJT78Q9SL2F type=write size=1539313 2023-10-05T11:35:16.019 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.015+0000 7f26f5634780 1 < suggested update operation key=BTZUVE8R96XT tag=7WNP82IV3YFJ type=del size=1091930 2023-10-05T11:35:16.020 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.017+0000 7f26f5634780 1 > prepared operation key=BU3KSHTINB36 tag=USWUUOH11PY8 type=del size=104904 2023-10-05T11:35:16.021 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.018+0000 7f26f5634780 1 < completed delete operation key=AV0XKXX1IR4B tag=IFNE77A67TWP type=del 2023-10-05T11:35:16.023 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.019+0000 7f26f5634780 1 > prepared operation key=4D3H60UTIXH3 tag=F6JLZ63ML6O1 type=del size=1707592 2023-10-05T11:35:16.024 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.021+0000 7f26f5634780 1 < completed part key=_multipart_8IPCP77WVVZT.2~ANYGGJA2S3T1.0 size=188485 2023-10-05T11:35:16.027 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.023+0000 7f26f5634780 1 < completed multipart upload key=8IPCP77WVVZT upload=ANYGGJA2S3T1 tag=63DWYDQ60RER type=write size=1237061 2023-10-05T11:35:16.028 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.024+0000 7f26f5634780 1 > prepared operation key=PNV0Q6ZPLYV0 tag=XMSU52IZ4Y36 type=del size=3975687 2023-10-05T11:35:16.029 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.026+0000 7f26f5634780 1 < completed part key=_multipart_5OPHKTHXVN5U.2~M3W9ZPDM64AK.0 size=1048576 2023-10-05T11:35:16.029 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.026+0000 7f26f5634780 1 < canceled part key=_multipart_5OPHKTHXVN5U.2~M3W9ZPDM64AK.1 size=48933 2023-10-05T11:35:16.031 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.028+0000 7f26f5634780 1 < canceled multipart upload key=5OPHKTHXVN5U upload=M3W9ZPDM64AK tag=5AVGROF26MZ1 type=write size=2146085 2023-10-05T11:35:16.032 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.029+0000 7f26f5634780 1 > prepared operation key=2D4PDQQT54ZA tag=KUNHP3BZ2QX5 type=del size=3319930 2023-10-05T11:35:16.033 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.030+0000 7f26f5634780 1 < completed delete operation key=761J2C7GHWU5 tag=MJBF731DHPZG type=del 2023-10-05T11:35:16.034 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.031+0000 7f26f5634780 1 > prepared operation key=BU3KSHTINB36 tag=R2ZY4RLJNVCD type=del size=1860176 2023-10-05T11:35:16.036 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.032+0000 7f26f5634780 1 < completed delete operation key=LLR5J3X15W5R tag=KQ7ITBVJXGMN type=del 2023-10-05T11:35:16.037 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.034+0000 7f26f5634780 1 > prepared operation key=IC7T3ZK81WQS tag=OMR39UZFCBAU type=del size=3901517 2023-10-05T11:35:16.038 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.035+0000 7f26f5634780 1 < completed part key=_multipart_5V0Q651D4VN2.2~SC2IRYGJEP78.0 size=1048576 2023-10-05T11:35:16.038 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.035+0000 7f26f5634780 1 < canceled part key=_multipart_5V0Q651D4VN2.2~SC2IRYGJEP78.1 size=1048576 2023-10-05T11:35:16.039 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.036+0000 7f26f5634780 1 < completed part key=_multipart_5V0Q651D4VN2.2~SC2IRYGJEP78.2 size=1032910 2023-10-05T11:35:16.041 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.038+0000 7f26f5634780 1 < canceled multipart upload key=5V0Q651D4VN2 upload=SC2IRYGJEP78 tag=VVD51NSP2WB5 type=write size=4178638 2023-10-05T11:35:16.043 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.040+0000 7f26f5634780 1 > prepared part key=_multipart_9S0YW7PPSJ8G.2~WWI1T71IGJ33.0 size=1048576 2023-10-05T11:35:16.044 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.041+0000 7f26f5634780 1 > prepared part key=_multipart_9S0YW7PPSJ8G.2~WWI1T71IGJ33.1 size=888528 2023-10-05T11:35:16.044 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.041+0000 7f26f5634780 1 > prepared multipart upload key=9S0YW7PPSJ8G upload=WWI1T71IGJ33 tag=T94SXVXWQSMM type=write size=2985680 2023-10-05T11:35:16.045 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.042+0000 7f26f5634780 1 < completed part key=_multipart_IC7T3ZK81WQS.2~3YOI0V8BAS7B.0 size=530708 2023-10-05T11:35:16.047 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.044+0000 7f26f5634780 1 < completed multipart upload key=IC7T3ZK81WQS upload=3YOI0V8BAS7B tag=JXUIVJNXJ0T8 type=write size=1579284 2023-10-05T11:35:16.050 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.046+0000 7f26f5634780 1 > prepared part key=_multipart_VJTFYDETLSFD.2~7EU15FMQ0M7X.0 size=1048576 2023-10-05T11:35:16.051 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.047+0000 7f26f5634780 1 > prepared part key=_multipart_VJTFYDETLSFD.2~7EU15FMQ0M7X.1 size=375767 2023-10-05T11:35:16.051 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.047+0000 7f26f5634780 1 > prepared multipart upload key=VJTFYDETLSFD upload=7EU15FMQ0M7X tag=L1DUM7XPJJY7 type=write size=2472919 2023-10-05T11:35:16.052 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.049+0000 7f26f5634780 1 < completed delete operation key=LLR5J3X15W5R tag=0I2OF9ZWO6RV type=del 2023-10-05T11:35:16.055 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.051+0000 7f26f5634780 1 > prepared part key=_multipart_IKCNZOTVWOC6.2~M6ZXHTA691V3.0 size=1048576 2023-10-05T11:35:16.056 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.052+0000 7f26f5634780 1 > prepared part key=_multipart_IKCNZOTVWOC6.2~M6ZXHTA691V3.1 size=199929 2023-10-05T11:35:16.056 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.052+0000 7f26f5634780 1 > prepared multipart upload key=IKCNZOTVWOC6 upload=M6ZXHTA691V3 tag=QXJ531V6VGPT type=write size=2297081 2023-10-05T11:35:16.057 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.054+0000 7f26f5634780 1 < completed part key=_multipart_2D4PDQQT54ZA.2~GM1I03ZEWODA.0 size=679340 2023-10-05T11:35:16.059 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.056+0000 7f26f5634780 1 < completed multipart upload key=2D4PDQQT54ZA upload=GM1I03ZEWODA tag=LNGDHFVHWHR2 type=write size=1727916 2023-10-05T11:35:16.061 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.057+0000 7f26f5634780 1 > prepared operation key=6DP3UJ4CW1MO tag=TJDJ012RGT49 type=del size=1266499 2023-10-05T11:35:16.062 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.059+0000 7f26f5634780 1 < canceled operation key=8IPCP77WVVZT tag=4WFMRC3HEJEU type=del size=3288760 2023-10-05T11:35:16.064 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.060+0000 7f26f5634780 1 > prepared operation key=PC8WTJ8AYJ24 tag=9ZDW0EP3U8PI type=del size=3335058 2023-10-05T11:35:16.065 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.061+0000 7f26f5634780 -1 < failed to complete operation key=PC8WTJ8AYJ24 tag=40WJPC080YES type=del size=1197223: (22) Invalid argument 2023-10-05T11:35:16.067 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.064+0000 7f26f5634780 1 > prepared part key=_multipart_J5EIH25Y471T.2~XW4R4YD707CS.0 size=1048576 2023-10-05T11:35:16.068 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.065+0000 7f26f5634780 1 > prepared part key=_multipart_J5EIH25Y471T.2~XW4R4YD707CS.1 size=1048576 2023-10-05T11:35:16.069 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.066+0000 7f26f5634780 1 > prepared part key=_multipart_J5EIH25Y471T.2~XW4R4YD707CS.2 size=343286 2023-10-05T11:35:16.069 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.066+0000 7f26f5634780 1 > prepared multipart upload key=J5EIH25Y471T upload=XW4R4YD707CS tag=MJY7G0HQTDOL type=write size=3489014 2023-10-05T11:35:16.070 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.067+0000 7f26f5634780 1 < completed delete operation key=4D3H60UTIXH3 tag=Q8F494CLMR8B type=del 2023-10-05T11:35:16.071 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.068+0000 7f26f5634780 1 > prepared operation key=4IBQJLJR7LD8 tag=BNNF3325LFTA type=del size=3405233 2023-10-05T11:35:16.072 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.069+0000 7f26f5634780 1 < completed part key=_multipart_PNV0Q6ZPLYV0.2~VT09B8XVAWL3.0 size=418002 2023-10-05T11:35:16.075 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.071+0000 7f26f5634780 1 < completed multipart upload key=PNV0Q6ZPLYV0 upload=VT09B8XVAWL3 tag=S89ZPH17Z1S2 type=write size=1466578 2023-10-05T11:35:16.076 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.072+0000 7f26f5634780 1 > prepared operation key=LLR5J3X15W5R tag=FDYTS81QIXBK type=del size=2631409 2023-10-05T11:35:16.077 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.074+0000 7f26f5634780 1 < completed delete operation key=5V0Q651D4VN2 tag=34QDO6UMJJXY type=del 2023-10-05T11:35:16.078 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.075+0000 7f26f5634780 1 > prepared operation key=IC7T3ZK81WQS tag=Y0DS7WZZKGVV type=del size=709849 2023-10-05T11:35:16.080 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.076+0000 7f26f5634780 1 < completed part key=_multipart_S3DKYDFT4IO2.2~R93TAUN8W7DB.0 size=490737 2023-10-05T11:35:16.082 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.078+0000 7f26f5634780 1 < completed multipart upload key=S3DKYDFT4IO2 upload=R93TAUN8W7DB tag=XTJT78Q9SL2F type=write size=1539313 2023-10-05T11:35:16.084 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.080+0000 7f26f5634780 1 > prepared part key=_multipart_761J2C7GHWU5.2~GJG6V6VA927B.0 size=404663 2023-10-05T11:35:16.084 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.080+0000 7f26f5634780 1 > prepared multipart upload key=761J2C7GHWU5 upload=GJG6V6VA927B tag=34V6GV2GZT2W type=write size=1453239 2023-10-05T11:35:16.085 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.082+0000 7f26f5634780 1 < completed delete operation key=BU3KSHTINB36 tag=USWUUOH11PY8 type=del 2023-10-05T11:35:16.087 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.084+0000 7f26f5634780 1 > prepared part key=_multipart_S3DKYDFT4IO2.2~AOA28FC1HLE1.0 size=490683 2023-10-05T11:35:16.087 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.084+0000 7f26f5634780 1 > prepared multipart upload key=S3DKYDFT4IO2 upload=AOA28FC1HLE1 tag=9SFLJPQSHZKU type=write size=1539259 2023-10-05T11:35:16.088 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.085+0000 7f26f5634780 1 < completed delete operation key=4D3H60UTIXH3 tag=F6JLZ63ML6O1 type=del 2023-10-05T11:35:16.090 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.086+0000 7f26f5634780 1 > prepared operation key=2U0NRDGDNUTA tag=4CO5THEW7XA3 type=write size=802756 2023-10-05T11:35:16.091 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.088+0000 7f26f5634780 1 < completed delete operation key=PNV0Q6ZPLYV0 tag=XMSU52IZ4Y36 type=del 2023-10-05T11:35:16.093 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.090+0000 7f26f5634780 1 > prepared part key=_multipart_QYQDXVIGZ7O8.2~85GSC9JRU27G.0 size=1048576 2023-10-05T11:35:16.094 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.091+0000 7f26f5634780 1 > prepared part key=_multipart_QYQDXVIGZ7O8.2~85GSC9JRU27G.1 size=1048576 2023-10-05T11:35:16.095 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.092+0000 7f26f5634780 1 > prepared part key=_multipart_QYQDXVIGZ7O8.2~85GSC9JRU27G.2 size=237787 2023-10-05T11:35:16.095 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.092+0000 7f26f5634780 1 > prepared multipart upload key=QYQDXVIGZ7O8 upload=85GSC9JRU27G tag=2FH58V7SC0Z7 type=write size=3383515 2023-10-05T11:35:16.096 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.093+0000 7f26f5634780 1 < completed delete operation key=2D4PDQQT54ZA tag=KUNHP3BZ2QX5 type=del 2023-10-05T11:35:16.098 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.095+0000 7f26f5634780 1 > prepared part key=_multipart_WYN9BG66LA3K.2~5837U55JUH6T.0 size=1048576 2023-10-05T11:35:16.099 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.096+0000 7f26f5634780 1 > prepared part key=_multipart_WYN9BG66LA3K.2~5837U55JUH6T.1 size=537811 2023-10-05T11:35:16.099 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.096+0000 7f26f5634780 1 > prepared multipart upload key=WYN9BG66LA3K upload=5837U55JUH6T tag=4RKNN15JG0MB type=write size=2634963 2023-10-05T11:35:16.101 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.097+0000 7f26f5634780 1 < completed delete operation key=BU3KSHTINB36 tag=R2ZY4RLJNVCD type=del 2023-10-05T11:35:16.105 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.100+0000 7f26f5634780 1 > prepared part key=_multipart_2D4PDQQT54ZA.2~G1P19I612SO6.0 size=1048576 2023-10-05T11:35:16.106 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.100+0000 7f26f5634780 1 > prepared part key=_multipart_2D4PDQQT54ZA.2~G1P19I612SO6.1 size=158083 2023-10-05T11:35:16.106 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.100+0000 7f26f5634780 1 > prepared multipart upload key=2D4PDQQT54ZA upload=G1P19I612SO6 tag=CWWB39F8CH05 type=write size=2255235 2023-10-05T11:35:16.106 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.102+0000 7f26f5634780 1 < completed delete operation key=IC7T3ZK81WQS tag=OMR39UZFCBAU type=del 2023-10-05T11:35:16.106 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.103+0000 7f26f5634780 1 > prepared operation key=8IPCP77WVVZT tag=ANZE8PPZJ2S1 type=del size=1212632 2023-10-05T11:35:16.109 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.105+0000 7f26f5634780 1 < completed part key=_multipart_9S0YW7PPSJ8G.2~WWI1T71IGJ33.0 size=1048576 2023-10-05T11:35:16.110 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.106+0000 7f26f5634780 1 < completed part key=_multipart_9S0YW7PPSJ8G.2~WWI1T71IGJ33.1 size=888528 2023-10-05T11:35:16.111 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.108+0000 7f26f5634780 1 < completed multipart upload key=9S0YW7PPSJ8G upload=WWI1T71IGJ33 tag=T94SXVXWQSMM type=write size=2985680 2023-10-05T11:35:16.113 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.109+0000 7f26f5634780 1 > prepared operation key=U6172JUYW7J6 tag=1P2S29K9JBPY type=write size=447684 2023-10-05T11:35:16.114 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.111+0000 7f26f5634780 1 < completed part key=_multipart_VJTFYDETLSFD.2~7EU15FMQ0M7X.0 size=1048576 2023-10-05T11:35:16.115 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.111+0000 7f26f5634780 1 < completed part key=_multipart_VJTFYDETLSFD.2~7EU15FMQ0M7X.1 size=375767 2023-10-05T11:35:16.117 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.113+0000 7f26f5634780 1 < completed multipart upload key=VJTFYDETLSFD upload=7EU15FMQ0M7X tag=L1DUM7XPJJY7 type=write size=2472919 2023-10-05T11:35:16.118 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.115+0000 7f26f5634780 1 > prepared operation key=BTZUVE8R96XT tag=1W4DLBIL7G7V type=del size=454540 2023-10-05T11:35:16.119 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.116+0000 7f26f5634780 1 < completed part key=_multipart_IKCNZOTVWOC6.2~M6ZXHTA691V3.0 size=1048576 2023-10-05T11:35:16.120 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.117+0000 7f26f5634780 1 < completed part key=_multipart_IKCNZOTVWOC6.2~M6ZXHTA691V3.1 size=199929 2023-10-05T11:35:16.122 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.119+0000 7f26f5634780 1 < completed multipart upload key=IKCNZOTVWOC6 upload=M6ZXHTA691V3 tag=QXJ531V6VGPT type=write size=2297081 2023-10-05T11:35:16.124 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.121+0000 7f26f5634780 1 > prepared part key=_multipart_J5EIH25Y471T.2~6GDY31J3RH8R.0 size=1048576 2023-10-05T11:35:16.125 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.122+0000 7f26f5634780 1 > prepared part key=_multipart_J5EIH25Y471T.2~6GDY31J3RH8R.1 size=149605 2023-10-05T11:35:16.125 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.122+0000 7f26f5634780 1 > prepared multipart upload key=J5EIH25Y471T upload=6GDY31J3RH8R tag=CQN7F33QUHXL type=write size=2246757 2023-10-05T11:35:16.127 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.123+0000 7f26f5634780 1 < completed delete operation key=6DP3UJ4CW1MO tag=TJDJ012RGT49 type=del 2023-10-05T11:35:16.128 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.124+0000 7f26f5634780 1 > prepared operation key=W2GWVGX42QLD tag=U0S20TIT6EBN type=del size=470404 2023-10-05T11:35:16.130 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.127+0000 7f26f5634780 1 < suggested remove operation key=PC8WTJ8AYJ24 tag=9ZDW0EP3U8PI type=del 2023-10-05T11:35:16.132 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.128+0000 7f26f5634780 1 > prepared operation key=VJTFYDETLSFD tag=8G8QWR6E8NCB type=del size=4100714 2023-10-05T11:35:16.133 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.129+0000 7f26f5634780 1 < completed part key=_multipart_J5EIH25Y471T.2~XW4R4YD707CS.0 size=1048576 2023-10-05T11:35:16.134 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.130+0000 7f26f5634780 1 < completed part key=_multipart_J5EIH25Y471T.2~XW4R4YD707CS.1 size=1048576 2023-10-05T11:35:16.135 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.131+0000 7f26f5634780 1 < completed part key=_multipart_J5EIH25Y471T.2~XW4R4YD707CS.2 size=343286 2023-10-05T11:35:16.137 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.134+0000 7f26f5634780 1 < completed multipart upload key=J5EIH25Y471T upload=XW4R4YD707CS tag=MJY7G0HQTDOL type=write size=3489014 2023-10-05T11:35:16.139 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.136+0000 7f26f5634780 1 > prepared part key=_multipart_QYQDXVIGZ7O8.2~X0CFA1G0OX4T.0 size=1048576 2023-10-05T11:35:16.140 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.137+0000 7f26f5634780 1 > prepared part key=_multipart_QYQDXVIGZ7O8.2~X0CFA1G0OX4T.1 size=885820 2023-10-05T11:35:16.140 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.137+0000 7f26f5634780 1 > prepared multipart upload key=QYQDXVIGZ7O8 upload=X0CFA1G0OX4T tag=55W25YC68I09 type=write size=2982972 2023-10-05T11:35:16.141 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.138+0000 7f26f5634780 1 < completed delete operation key=4IBQJLJR7LD8 tag=BNNF3325LFTA type=del 2023-10-05T11:35:16.143 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.139+0000 7f26f5634780 1 > prepared operation key=5V0Q651D4VN2 tag=1QOHEH7JYUTG type=del size=2098186 2023-10-05T11:35:16.145 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.142+0000 7f26f5634780 1 < suggested remove operation key=LLR5J3X15W5R tag=FDYTS81QIXBK type=del 2023-10-05T11:35:16.147 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.144+0000 7f26f5634780 1 > prepared part key=_multipart_7TOP5A52M9YP.2~R7HOEV0YDFWQ.0 size=1048576 2023-10-05T11:35:16.148 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.145+0000 7f26f5634780 1 > prepared part key=_multipart_7TOP5A52M9YP.2~R7HOEV0YDFWQ.1 size=1048576 2023-10-05T11:35:16.149 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.146+0000 7f26f5634780 1 > prepared part key=_multipart_7TOP5A52M9YP.2~R7HOEV0YDFWQ.2 size=866203 2023-10-05T11:35:16.149 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.146+0000 7f26f5634780 1 > prepared multipart upload key=7TOP5A52M9YP upload=R7HOEV0YDFWQ tag=H17QR5P525E5 type=write size=4011931 2023-10-05T11:35:16.150 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.147+0000 7f26f5634780 1 < completed delete operation key=IC7T3ZK81WQS tag=Y0DS7WZZKGVV type=del 2023-10-05T11:35:16.152 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.148+0000 7f26f5634780 1 > prepared operation key=761J2C7GHWU5 tag=J01FHJ1DLPME type=del size=3542160 2023-10-05T11:35:16.152 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.149+0000 7f26f5634780 1 < canceled part key=_multipart_761J2C7GHWU5.2~GJG6V6VA927B.0 size=404663 2023-10-05T11:35:16.154 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.151+0000 7f26f5634780 1 < canceled multipart upload key=761J2C7GHWU5 upload=GJG6V6VA927B tag=34V6GV2GZT2W type=write size=1453239 2023-10-05T11:35:16.156 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.152+0000 7f26f5634780 1 > prepared operation key=WYN9BG66LA3K tag=O31VK48PDHYL type=del size=1901232 2023-10-05T11:35:16.157 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.153+0000 7f26f5634780 1 < completed part key=_multipart_S3DKYDFT4IO2.2~AOA28FC1HLE1.0 size=490683 2023-10-05T11:35:16.159 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.155+0000 7f26f5634780 1 < completed multipart upload key=S3DKYDFT4IO2 upload=AOA28FC1HLE1 tag=9SFLJPQSHZKU type=write size=1539259 2023-10-05T11:35:16.160 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.156+0000 7f26f5634780 1 > prepared operation key=BTZUVE8R96XT tag=O4SJSAD5769F type=del size=802373 2023-10-05T11:35:16.161 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.158+0000 7f26f5634780 1 < completed write operation key=2U0NRDGDNUTA tag=4CO5THEW7XA3 type=write size=802756 2023-10-05T11:35:16.163 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.160+0000 7f26f5634780 1 > prepared part key=_multipart_IKCNZOTVWOC6.2~3TW97S40QXFM.0 size=551164 2023-10-05T11:35:16.163 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.160+0000 7f26f5634780 1 > prepared multipart upload key=IKCNZOTVWOC6 upload=3TW97S40QXFM tag=YCRJA86AXEY2 type=write size=1599740 2023-10-05T11:35:16.164 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.161+0000 7f26f5634780 1 < completed part key=_multipart_QYQDXVIGZ7O8.2~85GSC9JRU27G.0 size=1048576 2023-10-05T11:35:16.165 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.162+0000 7f26f5634780 1 < completed part key=_multipart_QYQDXVIGZ7O8.2~85GSC9JRU27G.1 size=1048576 2023-10-05T11:35:16.166 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.163+0000 7f26f5634780 1 < completed part key=_multipart_QYQDXVIGZ7O8.2~85GSC9JRU27G.2 size=237787 2023-10-05T11:35:16.168 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.165+0000 7f26f5634780 1 < completed multipart upload key=QYQDXVIGZ7O8 upload=85GSC9JRU27G tag=2FH58V7SC0Z7 type=write size=3383515 2023-10-05T11:35:16.170 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.166+0000 7f26f5634780 1 > prepared operation key=VJTFYDETLSFD tag=PLPURG69V1S2 type=del size=1084950 2023-10-05T11:35:16.170 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.166+0000 7f26f5634780 1 < canceled part key=_multipart_WYN9BG66LA3K.2~5837U55JUH6T.0 size=1048576 2023-10-05T11:35:16.171 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.167+0000 7f26f5634780 1 < completed part key=_multipart_WYN9BG66LA3K.2~5837U55JUH6T.1 size=537811 2023-10-05T11:35:16.173 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.169+0000 7f26f5634780 1 < canceled multipart upload key=WYN9BG66LA3K upload=5837U55JUH6T tag=4RKNN15JG0MB type=write size=2634963 2023-10-05T11:35:16.175 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.172+0000 7f26f5634780 1 > prepared part key=_multipart_9S0YW7PPSJ8G.2~SPC0GXGLWZKV.0 size=736849 2023-10-05T11:35:16.175 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.172+0000 7f26f5634780 1 > prepared multipart upload key=9S0YW7PPSJ8G upload=SPC0GXGLWZKV tag=8BHEOQBAZ8NQ type=write size=1785425 2023-10-05T11:35:16.176 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.173+0000 7f26f5634780 1 < completed part key=_multipart_2D4PDQQT54ZA.2~G1P19I612SO6.0 size=1048576 2023-10-05T11:35:16.177 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.174+0000 7f26f5634780 1 < completed part key=_multipart_2D4PDQQT54ZA.2~G1P19I612SO6.1 size=158083 2023-10-05T11:35:16.179 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.176+0000 7f26f5634780 1 < completed multipart upload key=2D4PDQQT54ZA upload=G1P19I612SO6 tag=CWWB39F8CH05 type=write size=2255235 2023-10-05T11:35:16.181 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.177+0000 7f26f5634780 1 > prepared operation key=LLR5J3X15W5R tag=HINS3TCWTAA0 type=del size=2703099 2023-10-05T11:35:16.182 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.179+0000 7f26f5634780 1 < completed delete operation key=8IPCP77WVVZT tag=ANZE8PPZJ2S1 type=del 2023-10-05T11:35:16.184 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.181+0000 7f26f5634780 1 > prepared part key=_multipart_0PWYKC7S6YJ4.2~FR0H1D01K5RF.0 size=1048576 2023-10-05T11:35:16.185 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.182+0000 7f26f5634780 1 > prepared part key=_multipart_0PWYKC7S6YJ4.2~FR0H1D01K5RF.1 size=310238 2023-10-05T11:35:16.185 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.182+0000 7f26f5634780 1 > prepared multipart upload key=0PWYKC7S6YJ4 upload=FR0H1D01K5RF tag=S8W4XVRXPC9Z type=write size=2407390 2023-10-05T11:35:16.187 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.183+0000 7f26f5634780 1 < completed write operation key=U6172JUYW7J6 tag=1P2S29K9JBPY type=write size=447684 2023-10-05T11:35:16.189 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.185+0000 7f26f5634780 1 > prepared part key=_multipart_4IBQJLJR7LD8.2~GWO4X6U8P0K2.0 size=1048576 2023-10-05T11:35:16.190 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.186+0000 7f26f5634780 1 > prepared part key=_multipart_4IBQJLJR7LD8.2~GWO4X6U8P0K2.1 size=1048576 2023-10-05T11:35:16.190 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.187+0000 7f26f5634780 1 > prepared part key=_multipart_4IBQJLJR7LD8.2~GWO4X6U8P0K2.2 size=694878 2023-10-05T11:35:16.190 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.187+0000 7f26f5634780 1 > prepared multipart upload key=4IBQJLJR7LD8 upload=GWO4X6U8P0K2 tag=72COP89V7M2D type=write size=3840606 2023-10-05T11:35:16.191 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.188+0000 7f26f5634780 1 < completed delete operation key=BTZUVE8R96XT tag=1W4DLBIL7G7V type=del 2023-10-05T11:35:16.193 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.189+0000 7f26f5634780 1 > prepared operation key=7W9LL5HSU3BG tag=XF7T0NA86JW8 type=del size=2932286 2023-10-05T11:35:16.193 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.189+0000 7f26f5634780 1 < canceled part key=_multipart_J5EIH25Y471T.2~6GDY31J3RH8R.0 size=1048576 2023-10-05T11:35:16.194 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.190+0000 7f26f5634780 1 < completed part key=_multipart_J5EIH25Y471T.2~6GDY31J3RH8R.1 size=149605 2023-10-05T11:35:16.196 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.192+0000 7f26f5634780 1 < canceled multipart upload key=J5EIH25Y471T upload=6GDY31J3RH8R tag=CQN7F33QUHXL type=write size=2246757 2023-10-05T11:35:16.198 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.195+0000 7f26f5634780 1 > prepared part key=_multipart_QYQDXVIGZ7O8.2~8BS73BDHEPC5.0 size=150978 2023-10-05T11:35:16.199 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.195+0000 7f26f5634780 1 > prepared multipart upload key=QYQDXVIGZ7O8 upload=8BS73BDHEPC5 tag=8TPF332TXMMW type=write size=1199554 2023-10-05T11:35:16.200 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.197+0000 7f26f5634780 1 < completed delete operation key=W2GWVGX42QLD tag=U0S20TIT6EBN type=del 2023-10-05T11:35:16.201 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.198+0000 7f26f5634780 1 > prepared operation key=W2GWVGX42QLD tag=2NCD18OROCMH type=write size=395396 2023-10-05T11:35:16.204 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.201+0000 7f26f5634780 1 < suggested remove operation key=VJTFYDETLSFD tag=8G8QWR6E8NCB type=del 2023-10-05T11:35:16.206 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.202+0000 7f26f5634780 1 > prepared operation key=8IPCP77WVVZT tag=6LH3DNCJMYM1 type=write size=105343 2023-10-05T11:35:16.207 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.204+0000 7f26f5634780 1 < completed part key=_multipart_QYQDXVIGZ7O8.2~X0CFA1G0OX4T.0 size=1048576 2023-10-05T11:35:16.209 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.205+0000 7f26f5634780 1 < completed part key=_multipart_QYQDXVIGZ7O8.2~X0CFA1G0OX4T.1 size=885820 2023-10-05T11:35:16.211 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.208+0000 7f26f5634780 1 < completed multipart upload key=QYQDXVIGZ7O8 upload=X0CFA1G0OX4T tag=55W25YC68I09 type=write size=2982972 2023-10-05T11:35:16.214 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.210+0000 7f26f5634780 1 > prepared part key=_multipart_VJTFYDETLSFD.2~V292ILUAXYXF.0 size=1048576 2023-10-05T11:35:16.214 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.211+0000 7f26f5634780 1 > prepared part key=_multipart_VJTFYDETLSFD.2~V292ILUAXYXF.1 size=902904 2023-10-05T11:35:16.215 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.211+0000 7f26f5634780 1 > prepared multipart upload key=VJTFYDETLSFD upload=V292ILUAXYXF tag=HT27IIZ6ZS84 type=write size=3000056 2023-10-05T11:35:16.216 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.212+0000 7f26f5634780 1 < canceled operation key=5V0Q651D4VN2 tag=1QOHEH7JYUTG type=del size=2098186 2023-10-05T11:35:16.218 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.215+0000 7f26f5634780 1 > prepared part key=_multipart_PC8WTJ8AYJ24.2~DKXGYDOF0ZT5.0 size=1048576 2023-10-05T11:35:16.219 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.215+0000 7f26f5634780 1 > prepared part key=_multipart_PC8WTJ8AYJ24.2~DKXGYDOF0ZT5.1 size=1048576 2023-10-05T11:35:16.220 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.217+0000 7f26f5634780 1 > prepared part key=_multipart_PC8WTJ8AYJ24.2~DKXGYDOF0ZT5.2 size=49325 2023-10-05T11:35:16.220 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.217+0000 7f26f5634780 1 > prepared multipart upload key=PC8WTJ8AYJ24 upload=DKXGYDOF0ZT5 tag=3GWKHQ4A6U37 type=write size=3195053 2023-10-05T11:35:16.221 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.218+0000 7f26f5634780 1 < completed part key=_multipart_7TOP5A52M9YP.2~R7HOEV0YDFWQ.0 size=1048576 2023-10-05T11:35:16.224 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.220+0000 7f26f5634780 1 < completed part key=_multipart_7TOP5A52M9YP.2~R7HOEV0YDFWQ.1 size=1048576 2023-10-05T11:35:16.225 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.221+0000 7f26f5634780 1 < completed part key=_multipart_7TOP5A52M9YP.2~R7HOEV0YDFWQ.2 size=866203 2023-10-05T11:35:16.227 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.223+0000 7f26f5634780 1 < completed multipart upload key=7TOP5A52M9YP upload=R7HOEV0YDFWQ tag=H17QR5P525E5 type=write size=4011931 2023-10-05T11:35:16.228 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.225+0000 7f26f5634780 1 > prepared operation key=AV0XKXX1IR4B tag=N3E03LOBYD5Q type=write size=446932 2023-10-05T11:35:16.229 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.226+0000 7f26f5634780 1 < completed delete operation key=761J2C7GHWU5 tag=J01FHJ1DLPME type=del 2023-10-05T11:35:16.230 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.227+0000 7f26f5634780 1 > prepared operation key=MEY4SZRHU9NZ tag=KYWXR3MPQ5QD type=del size=2152143 2023-10-05T11:35:16.232 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.228+0000 7f26f5634780 1 < canceled operation key=WYN9BG66LA3K tag=O31VK48PDHYL type=del size=1901232 2023-10-05T11:35:16.233 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.229+0000 7f26f5634780 1 > prepared operation key=FOMNIIY47UUM tag=H8OFG1I9K02J type=del size=2937970 2023-10-05T11:35:16.234 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.231+0000 7f26f5634780 1 < completed delete operation key=BTZUVE8R96XT tag=O4SJSAD5769F type=del 2023-10-05T11:35:16.235 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.232+0000 7f26f5634780 1 > prepared operation key=PC8WTJ8AYJ24 tag=7H4CM09TFGTD type=del size=3904842 2023-10-05T11:35:16.237 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.233+0000 7f26f5634780 1 < completed part key=_multipart_IKCNZOTVWOC6.2~3TW97S40QXFM.0 size=551164 2023-10-05T11:35:16.238 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.235+0000 7f26f5634780 1 < completed multipart upload key=IKCNZOTVWOC6 upload=3TW97S40QXFM tag=YCRJA86AXEY2 type=write size=1599740 2023-10-05T11:35:16.241 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.237+0000 7f26f5634780 1 > prepared part key=_multipart_BU3KSHTINB36.2~INUD8EA9M0A7.0 size=1048576 2023-10-05T11:35:16.242 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.238+0000 7f26f5634780 1 > prepared part key=_multipart_BU3KSHTINB36.2~INUD8EA9M0A7.1 size=1048576 2023-10-05T11:35:16.243 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.239+0000 7f26f5634780 1 > prepared part key=_multipart_BU3KSHTINB36.2~INUD8EA9M0A7.2 size=825631 2023-10-05T11:35:16.243 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.239+0000 7f26f5634780 1 > prepared multipart upload key=BU3KSHTINB36 upload=INUD8EA9M0A7 tag=NU1VAXR2IQTM type=write size=3971359 2023-10-05T11:35:16.244 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.240+0000 7f26f5634780 -1 < failed to complete operation key=VJTFYDETLSFD tag=PLPURG69V1S2 type=del size=1084950: (22) Invalid argument 2023-10-05T11:35:16.246 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.243+0000 7f26f5634780 1 > prepared part key=_multipart_IC7T3ZK81WQS.2~EUZC0NIAH495.0 size=1048576 2023-10-05T11:35:16.247 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.244+0000 7f26f5634780 1 > prepared part key=_multipart_IC7T3ZK81WQS.2~EUZC0NIAH495.1 size=614718 2023-10-05T11:35:16.247 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.244+0000 7f26f5634780 1 > prepared multipart upload key=IC7T3ZK81WQS upload=EUZC0NIAH495 tag=C3ZMN69WRUD1 type=write size=2711870 2023-10-05T11:35:16.248 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.245+0000 7f26f5634780 1 < completed part key=_multipart_9S0YW7PPSJ8G.2~SPC0GXGLWZKV.0 size=736849 2023-10-05T11:35:16.250 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.247+0000 7f26f5634780 1 < completed multipart upload key=9S0YW7PPSJ8G upload=SPC0GXGLWZKV tag=8BHEOQBAZ8NQ type=write size=1785425 2023-10-05T11:35:16.251 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.248+0000 7f26f5634780 1 > prepared operation key=LLR5J3X15W5R tag=2A9M3AJXY2MQ type=del size=1790734 2023-10-05T11:35:16.253 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.249+0000 7f26f5634780 1 < completed delete operation key=LLR5J3X15W5R tag=HINS3TCWTAA0 type=del 2023-10-05T11:35:16.253 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.250+0000 7f26f5634780 1 > prepared operation key=2D4PDQQT54ZA tag=9T1T98Z5SA1I type=del size=466988 2023-10-05T11:35:16.255 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.251+0000 7f26f5634780 1 < completed part key=_multipart_0PWYKC7S6YJ4.2~FR0H1D01K5RF.0 size=1048576 2023-10-05T11:35:16.256 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.252+0000 7f26f5634780 1 < completed part key=_multipart_0PWYKC7S6YJ4.2~FR0H1D01K5RF.1 size=310238 2023-10-05T11:35:16.257 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.254+0000 7f26f5634780 1 < completed multipart upload key=0PWYKC7S6YJ4 upload=FR0H1D01K5RF tag=S8W4XVRXPC9Z type=write size=2407390 2023-10-05T11:35:16.259 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.255+0000 7f26f5634780 1 > prepared operation key=IC7T3ZK81WQS tag=V2UZX22T1RWZ type=del size=4119944 2023-10-05T11:35:16.260 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.256+0000 7f26f5634780 1 < completed part key=_multipart_4IBQJLJR7LD8.2~GWO4X6U8P0K2.0 size=1048576 2023-10-05T11:35:16.261 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.257+0000 7f26f5634780 1 < completed part key=_multipart_4IBQJLJR7LD8.2~GWO4X6U8P0K2.1 size=1048576 2023-10-05T11:35:16.261 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.257+0000 7f26f5634780 1 < canceled part key=_multipart_4IBQJLJR7LD8.2~GWO4X6U8P0K2.2 size=694878 2023-10-05T11:35:16.263 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.260+0000 7f26f5634780 1 < canceled multipart upload key=4IBQJLJR7LD8 upload=GWO4X6U8P0K2 tag=72COP89V7M2D type=write size=3840606 2023-10-05T11:35:16.265 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.261+0000 7f26f5634780 1 > prepared operation key=4IBQJLJR7LD8 tag=GWBTWBI61RJN type=del size=37547 2023-10-05T11:35:16.267 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.264+0000 7f26f5634780 1 < suggested update operation key=7W9LL5HSU3BG tag=XF7T0NA86JW8 type=del size=2932286 2023-10-05T11:35:16.270 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.266+0000 7f26f5634780 1 > prepared part key=_multipart_WYN9BG66LA3K.2~BWYRZ5HALHN5.0 size=289666 2023-10-05T11:35:16.270 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.266+0000 7f26f5634780 1 > prepared multipart upload key=WYN9BG66LA3K upload=BWYRZ5HALHN5 tag=3AHU7RNFUIVH type=write size=1338242 2023-10-05T11:35:16.271 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.267+0000 7f26f5634780 1 < completed part key=_multipart_QYQDXVIGZ7O8.2~8BS73BDHEPC5.0 size=150978 2023-10-05T11:35:16.273 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.269+0000 7f26f5634780 1 < completed multipart upload key=QYQDXVIGZ7O8 upload=8BS73BDHEPC5 tag=8TPF332TXMMW type=write size=1199554 2023-10-05T11:35:16.274 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.271+0000 7f26f5634780 1 > prepared operation key=761J2C7GHWU5 tag=CN0UMWJMTFYL type=del size=3923296 2023-10-05T11:35:16.275 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.272+0000 7f26f5634780 1 < completed write operation key=W2GWVGX42QLD tag=2NCD18OROCMH type=write size=395396 2023-10-05T11:35:16.276 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.273+0000 7f26f5634780 1 > prepared operation key=MEY4SZRHU9NZ tag=QCE4ZJPUH2XP type=del size=3243223 2023-10-05T11:35:16.278 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.274+0000 7f26f5634780 1 < completed write operation key=8IPCP77WVVZT tag=6LH3DNCJMYM1 type=write size=105343 2023-10-05T11:35:16.280 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.277+0000 7f26f5634780 1 > prepared part key=_multipart_4D3H60UTIXH3.2~0E2QMY22K4XI.0 size=1048576 2023-10-05T11:35:16.281 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.278+0000 7f26f5634780 1 > prepared part key=_multipart_4D3H60UTIXH3.2~0E2QMY22K4XI.1 size=288345 2023-10-05T11:35:16.281 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.278+0000 7f26f5634780 1 > prepared multipart upload key=4D3H60UTIXH3 upload=0E2QMY22K4XI tag=J7WT0VSYGLW2 type=write size=2385497 2023-10-05T11:35:16.282 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.279+0000 7f26f5634780 1 < completed part key=_multipart_VJTFYDETLSFD.2~V292ILUAXYXF.0 size=1048576 2023-10-05T11:35:16.283 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.280+0000 7f26f5634780 1 < completed part key=_multipart_VJTFYDETLSFD.2~V292ILUAXYXF.1 size=902904 2023-10-05T11:35:16.285 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.282+0000 7f26f5634780 1 < completed multipart upload key=VJTFYDETLSFD upload=V292ILUAXYXF tag=HT27IIZ6ZS84 type=write size=3000056 2023-10-05T11:35:16.287 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.283+0000 7f26f5634780 1 > prepared operation key=9S0YW7PPSJ8G tag=XVA4HE4DXZCE type=del size=789655 2023-10-05T11:35:16.287 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.284+0000 7f26f5634780 1 < canceled part key=_multipart_PC8WTJ8AYJ24.2~DKXGYDOF0ZT5.0 size=1048576 2023-10-05T11:35:16.288 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.285+0000 7f26f5634780 1 < completed part key=_multipart_PC8WTJ8AYJ24.2~DKXGYDOF0ZT5.1 size=1048576 2023-10-05T11:35:16.289 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.286+0000 7f26f5634780 1 < completed part key=_multipart_PC8WTJ8AYJ24.2~DKXGYDOF0ZT5.2 size=49325 2023-10-05T11:35:16.292 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.288+0000 7f26f5634780 1 < canceled multipart upload key=PC8WTJ8AYJ24 upload=DKXGYDOF0ZT5 tag=3GWKHQ4A6U37 type=write size=3195053 2023-10-05T11:35:16.294 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.290+0000 7f26f5634780 1 > prepared part key=_multipart_5OPHKTHXVN5U.2~DAXKCK179O6P.0 size=1048576 2023-10-05T11:35:16.295 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.291+0000 7f26f5634780 1 > prepared part key=_multipart_5OPHKTHXVN5U.2~DAXKCK179O6P.1 size=1048576 2023-10-05T11:35:16.296 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.292+0000 7f26f5634780 1 > prepared part key=_multipart_5OPHKTHXVN5U.2~DAXKCK179O6P.2 size=975698 2023-10-05T11:35:16.296 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.292+0000 7f26f5634780 1 > prepared multipart upload key=5OPHKTHXVN5U upload=DAXKCK179O6P tag=EJ9R78RLY5OI type=write size=4121426 2023-10-05T11:35:16.297 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.294+0000 7f26f5634780 1 < completed write operation key=AV0XKXX1IR4B tag=N3E03LOBYD5Q type=write size=446932 2023-10-05T11:35:16.299 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.296+0000 7f26f5634780 1 > prepared part key=_multipart_BTZUVE8R96XT.2~C8Q1OGSI0A7V.0 size=1048576 2023-10-05T11:35:16.300 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.297+0000 7f26f5634780 1 > prepared part key=_multipart_BTZUVE8R96XT.2~C8Q1OGSI0A7V.1 size=1048576 2023-10-05T11:35:16.301 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.298+0000 7f26f5634780 1 > prepared part key=_multipart_BTZUVE8R96XT.2~C8Q1OGSI0A7V.2 size=873080 2023-10-05T11:35:16.301 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.298+0000 7f26f5634780 1 > prepared multipart upload key=BTZUVE8R96XT upload=C8Q1OGSI0A7V tag=Q8WGECMU1HC0 type=write size=4018808 2023-10-05T11:35:16.302 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.299+0000 7f26f5634780 1 < completed delete operation key=MEY4SZRHU9NZ tag=KYWXR3MPQ5QD type=del 2023-10-05T11:35:16.304 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.301+0000 7f26f5634780 1 > prepared part key=_multipart_MEY4SZRHU9NZ.2~0SN93D42BVWA.0 size=1048576 2023-10-05T11:35:16.305 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.302+0000 7f26f5634780 1 > prepared part key=_multipart_MEY4SZRHU9NZ.2~0SN93D42BVWA.1 size=1033082 2023-10-05T11:35:16.305 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.302+0000 7f26f5634780 1 > prepared multipart upload key=MEY4SZRHU9NZ upload=0SN93D42BVWA tag=MVWMTU0J17M8 type=write size=3130234 2023-10-05T11:35:16.309 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.303+0000 7f26f5634780 1 < completed delete operation key=FOMNIIY47UUM tag=H8OFG1I9K02J type=del 2023-10-05T11:35:16.309 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.305+0000 7f26f5634780 1 > prepared part key=_multipart_PNV0Q6ZPLYV0.2~2DX9A4T8ZGQS.0 size=1048576 2023-10-05T11:35:16.310 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.306+0000 7f26f5634780 1 > prepared part key=_multipart_PNV0Q6ZPLYV0.2~2DX9A4T8ZGQS.1 size=1048576 2023-10-05T11:35:16.311 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.307+0000 7f26f5634780 1 > prepared part key=_multipart_PNV0Q6ZPLYV0.2~2DX9A4T8ZGQS.2 size=759727 2023-10-05T11:35:16.311 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.307+0000 7f26f5634780 1 > prepared multipart upload key=PNV0Q6ZPLYV0 upload=2DX9A4T8ZGQS tag=W6S79G4H9G32 type=write size=3905455 2023-10-05T11:35:16.312 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.309+0000 7f26f5634780 1 < completed delete operation key=PC8WTJ8AYJ24 tag=7H4CM09TFGTD type=del 2023-10-05T11:35:16.314 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.311+0000 7f26f5634780 1 > prepared part key=_multipart_5V0Q651D4VN2.2~CLLU4WZZ3PT3.0 size=1048576 2023-10-05T11:35:16.316 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.312+0000 7f26f5634780 1 > prepared part key=_multipart_5V0Q651D4VN2.2~CLLU4WZZ3PT3.1 size=563189 2023-10-05T11:35:16.316 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.312+0000 7f26f5634780 1 > prepared multipart upload key=5V0Q651D4VN2 upload=CLLU4WZZ3PT3 tag=GBXT4ANIGJ20 type=write size=2660341 2023-10-05T11:35:16.317 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.313+0000 7f26f5634780 1 < completed part key=_multipart_BU3KSHTINB36.2~INUD8EA9M0A7.0 size=1048576 2023-10-05T11:35:16.318 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.314+0000 7f26f5634780 1 < completed part key=_multipart_BU3KSHTINB36.2~INUD8EA9M0A7.1 size=1048576 2023-10-05T11:35:16.319 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.315+0000 7f26f5634780 1 < completed part key=_multipart_BU3KSHTINB36.2~INUD8EA9M0A7.2 size=825631 2023-10-05T11:35:16.321 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.318+0000 7f26f5634780 1 < completed multipart upload key=BU3KSHTINB36 upload=INUD8EA9M0A7 tag=NU1VAXR2IQTM type=write size=3971359 2023-10-05T11:35:16.322 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.319+0000 7f26f5634780 1 > prepared operation key=S3DKYDFT4IO2 tag=V4TE0BOU6I89 type=write size=243857 2023-10-05T11:35:16.324 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.320+0000 7f26f5634780 1 < completed part key=_multipart_IC7T3ZK81WQS.2~EUZC0NIAH495.0 size=1048576 2023-10-05T11:35:16.325 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.321+0000 7f26f5634780 1 < completed part key=_multipart_IC7T3ZK81WQS.2~EUZC0NIAH495.1 size=614718 2023-10-05T11:35:16.327 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.323+0000 7f26f5634780 1 < completed multipart upload key=IC7T3ZK81WQS upload=EUZC0NIAH495 tag=C3ZMN69WRUD1 type=write size=2711870 2023-10-05T11:35:16.328 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.325+0000 7f26f5634780 1 > prepared operation key=BU3KSHTINB36 tag=UMF4FDV6XV2K type=del size=1510500 2023-10-05T11:35:16.329 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.326+0000 7f26f5634780 1 < completed delete operation key=LLR5J3X15W5R tag=2A9M3AJXY2MQ type=del 2023-10-05T11:35:16.331 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.328+0000 7f26f5634780 1 > prepared part key=_multipart_9S0YW7PPSJ8G.2~Y53REJY8QBMF.0 size=1048576 2023-10-05T11:35:16.332 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.329+0000 7f26f5634780 1 > prepared part key=_multipart_9S0YW7PPSJ8G.2~Y53REJY8QBMF.1 size=98271 2023-10-05T11:35:16.333 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.329+0000 7f26f5634780 1 > prepared multipart upload key=9S0YW7PPSJ8G upload=Y53REJY8QBMF tag=4LH73HCSCXH0 type=write size=2195423 2023-10-05T11:35:16.334 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.330+0000 7f26f5634780 1 < canceled operation key=2D4PDQQT54ZA tag=9T1T98Z5SA1I type=del size=466988 2023-10-05T11:35:16.335 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.332+0000 7f26f5634780 1 > prepared operation key=LLR5J3X15W5R tag=V3ELDHIHLJ9G type=del size=3929150 2023-10-05T11:35:16.338 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.334+0000 7f26f5634780 1 < completed delete operation key=IC7T3ZK81WQS tag=V2UZX22T1RWZ type=del 2023-10-05T11:35:16.340 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.336+0000 7f26f5634780 1 > prepared part key=_multipart_U6172JUYW7J6.2~L7ZW78BK5WWM.0 size=1048576 2023-10-05T11:35:16.341 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.337+0000 7f26f5634780 1 > prepared part key=_multipart_U6172JUYW7J6.2~L7ZW78BK5WWM.1 size=1048576 2023-10-05T11:35:16.342 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.338+0000 7f26f5634780 1 > prepared part key=_multipart_U6172JUYW7J6.2~L7ZW78BK5WWM.2 size=817965 2023-10-05T11:35:16.342 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.338+0000 7f26f5634780 1 > prepared multipart upload key=U6172JUYW7J6 upload=L7ZW78BK5WWM tag=2HQ2QV0R10S8 type=write size=3963693 2023-10-05T11:35:16.343 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.339+0000 7f26f5634780 1 < completed delete operation key=4IBQJLJR7LD8 tag=GWBTWBI61RJN type=del 2023-10-05T11:35:16.344 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.340+0000 7f26f5634780 1 > prepared operation key=4D3H60UTIXH3 tag=B7FGMXXHCEIC type=del size=2661195 2023-10-05T11:35:16.345 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.342+0000 7f26f5634780 1 < completed part key=_multipart_WYN9BG66LA3K.2~BWYRZ5HALHN5.0 size=289666 2023-10-05T11:35:16.347 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.344+0000 7f26f5634780 1 < completed multipart upload key=WYN9BG66LA3K upload=BWYRZ5HALHN5 tag=3AHU7RNFUIVH type=write size=1338242 2023-10-05T11:35:16.348 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.345+0000 7f26f5634780 1 > prepared operation key=PNV0Q6ZPLYV0 tag=2XDNZGR1TCJW type=write size=339351 2023-10-05T11:35:16.351 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.347+0000 7f26f5634780 1 < suggested update operation key=761J2C7GHWU5 tag=CN0UMWJMTFYL type=del size=3923296 2023-10-05T11:35:16.353 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.349+0000 7f26f5634780 1 > prepared part key=_multipart_5V0Q651D4VN2.2~DCYCALEHZLEE.0 size=64210 2023-10-05T11:35:16.353 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.349+0000 7f26f5634780 1 > prepared multipart upload key=5V0Q651D4VN2 upload=DCYCALEHZLEE tag=K4T5SFDZ3A4O type=write size=1112786 2023-10-05T11:35:16.354 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.351+0000 7f26f5634780 1 < completed delete operation key=MEY4SZRHU9NZ tag=QCE4ZJPUH2XP type=del 2023-10-05T11:35:16.356 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.353+0000 7f26f5634780 1 > prepared part key=_multipart_761J2C7GHWU5.2~C1KWXO6BAGFY.0 size=1048576 2023-10-05T11:35:16.357 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.354+0000 7f26f5634780 1 > prepared part key=_multipart_761J2C7GHWU5.2~C1KWXO6BAGFY.1 size=1048576 2023-10-05T11:35:16.358 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.355+0000 7f26f5634780 1 > prepared part key=_multipart_761J2C7GHWU5.2~C1KWXO6BAGFY.2 size=995857 2023-10-05T11:35:16.358 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.355+0000 7f26f5634780 1 > prepared multipart upload key=761J2C7GHWU5 upload=C1KWXO6BAGFY tag=DGAUQE92BMVR type=write size=4141585 2023-10-05T11:35:16.359 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.356+0000 7f26f5634780 1 < completed part key=_multipart_4D3H60UTIXH3.2~0E2QMY22K4XI.0 size=1048576 2023-10-05T11:35:16.360 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.357+0000 7f26f5634780 1 < completed part key=_multipart_4D3H60UTIXH3.2~0E2QMY22K4XI.1 size=288345 2023-10-05T11:35:16.363 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.359+0000 7f26f5634780 1 < completed multipart upload key=4D3H60UTIXH3 upload=0E2QMY22K4XI tag=J7WT0VSYGLW2 type=write size=2385497 2023-10-05T11:35:16.364 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.361+0000 7f26f5634780 1 > prepared operation key=S3DKYDFT4IO2 tag=VH8338PQKQAS type=del size=1026660 2023-10-05T11:35:16.365 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.362+0000 7f26f5634780 1 < completed delete operation key=9S0YW7PPSJ8G tag=XVA4HE4DXZCE type=del 2023-10-05T11:35:16.367 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.363+0000 7f26f5634780 1 > prepared operation key=4D3H60UTIXH3 tag=YQ36RJP786YL type=write size=135425 2023-10-05T11:35:16.368 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.365+0000 7f26f5634780 1 < completed part key=_multipart_5OPHKTHXVN5U.2~DAXKCK179O6P.0 size=1048576 2023-10-05T11:35:16.369 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.366+0000 7f26f5634780 1 < completed part key=_multipart_5OPHKTHXVN5U.2~DAXKCK179O6P.1 size=1048576 2023-10-05T11:35:16.370 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.367+0000 7f26f5634780 1 < completed part key=_multipart_5OPHKTHXVN5U.2~DAXKCK179O6P.2 size=975698 2023-10-05T11:35:16.372 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.369+0000 7f26f5634780 1 < completed multipart upload key=5OPHKTHXVN5U upload=DAXKCK179O6P tag=EJ9R78RLY5OI type=write size=4121426 2023-10-05T11:35:16.374 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.371+0000 7f26f5634780 1 > prepared part key=_multipart_PNV0Q6ZPLYV0.2~00L800EHEYJC.0 size=1048576 2023-10-05T11:35:16.375 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.372+0000 7f26f5634780 1 > prepared part key=_multipart_PNV0Q6ZPLYV0.2~00L800EHEYJC.1 size=991395 2023-10-05T11:35:16.376 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.372+0000 7f26f5634780 1 > prepared multipart upload key=PNV0Q6ZPLYV0 upload=00L800EHEYJC tag=F2RUZQ36XR8F type=write size=3088547 2023-10-05T11:35:16.377 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.373+0000 7f26f5634780 1 < completed part key=_multipart_BTZUVE8R96XT.2~C8Q1OGSI0A7V.0 size=1048576 2023-10-05T11:35:16.378 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.374+0000 7f26f5634780 1 < completed part key=_multipart_BTZUVE8R96XT.2~C8Q1OGSI0A7V.1 size=1048576 2023-10-05T11:35:16.379 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.375+0000 7f26f5634780 1 < completed part key=_multipart_BTZUVE8R96XT.2~C8Q1OGSI0A7V.2 size=873080 2023-10-05T11:35:16.381 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.377+0000 7f26f5634780 1 < completed multipart upload key=BTZUVE8R96XT upload=C8Q1OGSI0A7V tag=Q8WGECMU1HC0 type=write size=4018808 2023-10-05T11:35:16.382 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.379+0000 7f26f5634780 1 > prepared operation key=VJTFYDETLSFD tag=P6KBYD0RTFUM type=del size=3197151 2023-10-05T11:35:16.383 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.380+0000 7f26f5634780 1 < completed part key=_multipart_MEY4SZRHU9NZ.2~0SN93D42BVWA.0 size=1048576 2023-10-05T11:35:16.384 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.381+0000 7f26f5634780 1 < completed part key=_multipart_MEY4SZRHU9NZ.2~0SN93D42BVWA.1 size=1033082 2023-10-05T11:35:16.387 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.383+0000 7f26f5634780 1 < completed multipart upload key=MEY4SZRHU9NZ upload=0SN93D42BVWA tag=MVWMTU0J17M8 type=write size=3130234 2023-10-05T11:35:16.388 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.384+0000 7f26f5634780 1 > prepared operation key=761J2C7GHWU5 tag=LOBL9Q3S0ZQ1 type=del size=2608097 2023-10-05T11:35:16.389 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.386+0000 7f26f5634780 1 < completed part key=_multipart_PNV0Q6ZPLYV0.2~2DX9A4T8ZGQS.0 size=1048576 2023-10-05T11:35:16.389 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.386+0000 7f26f5634780 1 < canceled part key=_multipart_PNV0Q6ZPLYV0.2~2DX9A4T8ZGQS.1 size=1048576 2023-10-05T11:35:16.390 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.386+0000 7f26f5634780 1 < completed part key=_multipart_PNV0Q6ZPLYV0.2~2DX9A4T8ZGQS.2 size=759727 2023-10-05T11:35:16.392 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.388+0000 7f26f5634780 1 < canceled multipart upload key=PNV0Q6ZPLYV0 upload=2DX9A4T8ZGQS tag=W6S79G4H9G32 type=write size=3905455 2023-10-05T11:35:16.393 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.390+0000 7f26f5634780 1 > prepared operation key=0PWYKC7S6YJ4 tag=3S1IPC018892 type=write size=236262 2023-10-05T11:35:16.394 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.391+0000 7f26f5634780 1 < completed part key=_multipart_5V0Q651D4VN2.2~CLLU4WZZ3PT3.0 size=1048576 2023-10-05T11:35:16.395 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.392+0000 7f26f5634780 1 < completed part key=_multipart_5V0Q651D4VN2.2~CLLU4WZZ3PT3.1 size=563189 2023-10-05T11:35:16.397 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.394+0000 7f26f5634780 1 < completed multipart upload key=5V0Q651D4VN2 upload=CLLU4WZZ3PT3 tag=GBXT4ANIGJ20 type=write size=2660341 2023-10-05T11:35:16.398 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.395+0000 7f26f5634780 1 > prepared operation key=2U0NRDGDNUTA tag=BLT22FQYLG5C type=del size=1320123 2023-10-05T11:35:16.399 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.396+0000 7f26f5634780 1 < completed write operation key=S3DKYDFT4IO2 tag=V4TE0BOU6I89 type=write size=243857 2023-10-05T11:35:16.400 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.397+0000 7f26f5634780 1 > prepared operation key=WYN9BG66LA3K tag=AZPRIRL256M0 type=del size=1937029 2023-10-05T11:35:16.402 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.398+0000 7f26f5634780 1 < completed delete operation key=BU3KSHTINB36 tag=UMF4FDV6XV2K type=del 2023-10-05T11:35:16.403 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.400+0000 7f26f5634780 1 > prepared operation key=FOMNIIY47UUM tag=B38FTHKA7NQG type=write size=689390 2023-10-05T11:35:16.403 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.400+0000 7f26f5634780 1 < canceled part key=_multipart_9S0YW7PPSJ8G.2~Y53REJY8QBMF.0 size=1048576 2023-10-05T11:35:16.404 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.401+0000 7f26f5634780 1 < completed part key=_multipart_9S0YW7PPSJ8G.2~Y53REJY8QBMF.1 size=98271 2023-10-05T11:35:16.406 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.403+0000 7f26f5634780 1 < canceled multipart upload key=9S0YW7PPSJ8G upload=Y53REJY8QBMF tag=4LH73HCSCXH0 type=write size=2195423 2023-10-05T11:35:16.409 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.405+0000 7f26f5634780 1 > prepared part key=_multipart_2U0NRDGDNUTA.2~14L63RX3LB42.0 size=545293 2023-10-05T11:35:16.409 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.405+0000 7f26f5634780 1 > prepared multipart upload key=2U0NRDGDNUTA upload=14L63RX3LB42 tag=2P95S0CWK4XQ type=write size=1593869 2023-10-05T11:35:16.410 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.406+0000 7f26f5634780 1 < completed delete operation key=LLR5J3X15W5R tag=V3ELDHIHLJ9G type=del 2023-10-05T11:35:16.411 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.408+0000 7f26f5634780 1 > prepared operation key=VJTFYDETLSFD tag=VVBTHOKGG6YQ type=del size=1846320 2023-10-05T11:35:16.413 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.410+0000 7f26f5634780 1 < completed part key=_multipart_U6172JUYW7J6.2~L7ZW78BK5WWM.0 size=1048576 2023-10-05T11:35:16.414 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.411+0000 7f26f5634780 1 < completed part key=_multipart_U6172JUYW7J6.2~L7ZW78BK5WWM.1 size=1048576 2023-10-05T11:35:16.415 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.412+0000 7f26f5634780 1 < completed part key=_multipart_U6172JUYW7J6.2~L7ZW78BK5WWM.2 size=817965 2023-10-05T11:35:16.417 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.414+0000 7f26f5634780 1 < completed multipart upload key=U6172JUYW7J6 upload=L7ZW78BK5WWM tag=2HQ2QV0R10S8 type=write size=3963693 2023-10-05T11:35:16.418 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.415+0000 7f26f5634780 1 > prepared operation key=FOMNIIY47UUM tag=0CXPZ92BE6W9 type=del size=21881 2023-10-05T11:35:16.420 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.416+0000 7f26f5634780 1 < completed delete operation key=4D3H60UTIXH3 tag=B7FGMXXHCEIC type=del 2023-10-05T11:35:16.421 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.418+0000 7f26f5634780 1 > prepared operation key=9S0YW7PPSJ8G tag=P0PZDKNB7PSK type=del size=3050220 2023-10-05T11:35:16.422 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.419+0000 7f26f5634780 1 < completed write operation key=PNV0Q6ZPLYV0 tag=2XDNZGR1TCJW type=write size=339351 2023-10-05T11:35:16.423 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.420+0000 7f26f5634780 1 > prepared operation key=2D4PDQQT54ZA tag=XIRBKCLJ9OCB type=write size=821354 2023-10-05T11:35:16.425 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.421+0000 7f26f5634780 1 < completed part key=_multipart_5V0Q651D4VN2.2~DCYCALEHZLEE.0 size=64210 2023-10-05T11:35:16.427 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.423+0000 7f26f5634780 1 < completed multipart upload key=5V0Q651D4VN2 upload=DCYCALEHZLEE tag=K4T5SFDZ3A4O type=write size=1112786 2023-10-05T11:35:16.428 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.425+0000 7f26f5634780 1 > prepared operation key=4D3H60UTIXH3 tag=FLJW2X8OBFA6 type=del size=1754492 2023-10-05T11:35:16.429 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.426+0000 7f26f5634780 1 < completed part key=_multipart_761J2C7GHWU5.2~C1KWXO6BAGFY.0 size=1048576 2023-10-05T11:35:16.430 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.427+0000 7f26f5634780 1 < completed part key=_multipart_761J2C7GHWU5.2~C1KWXO6BAGFY.1 size=1048576 2023-10-05T11:35:16.431 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.428+0000 7f26f5634780 1 < completed part key=_multipart_761J2C7GHWU5.2~C1KWXO6BAGFY.2 size=995857 2023-10-05T11:35:16.433 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.430+0000 7f26f5634780 1 < completed multipart upload key=761J2C7GHWU5 upload=C1KWXO6BAGFY tag=DGAUQE92BMVR type=write size=4141585 2023-10-05T11:35:16.435 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.432+0000 7f26f5634780 1 > prepared operation key=8IPCP77WVVZT tag=011T7BMLEE67 type=del size=3441035 2023-10-05T11:35:16.436 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.433+0000 7f26f5634780 1 < completed delete operation key=S3DKYDFT4IO2 tag=VH8338PQKQAS type=del 2023-10-05T11:35:16.438 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.434+0000 7f26f5634780 1 > prepared operation key=WYN9BG66LA3K tag=LUA1INO8QGW4 type=del size=3564481 2023-10-05T11:35:16.439 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.436+0000 7f26f5634780 1 < completed write operation key=4D3H60UTIXH3 tag=YQ36RJP786YL type=write size=135425 2023-10-05T11:35:16.440 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.437+0000 7f26f5634780 1 > prepared operation key=2U0NRDGDNUTA tag=F68SSBY1X0HN type=write size=256376 2023-10-05T11:35:16.442 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.438+0000 7f26f5634780 1 < completed part key=_multipart_PNV0Q6ZPLYV0.2~00L800EHEYJC.0 size=1048576 2023-10-05T11:35:16.443 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.439+0000 7f26f5634780 1 < completed part key=_multipart_PNV0Q6ZPLYV0.2~00L800EHEYJC.1 size=991395 2023-10-05T11:35:16.445 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.441+0000 7f26f5634780 1 < completed multipart upload key=PNV0Q6ZPLYV0 upload=00L800EHEYJC tag=F2RUZQ36XR8F type=write size=3088547 2023-10-05T11:35:16.447 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.443+0000 7f26f5634780 1 > prepared part key=_multipart_BU3KSHTINB36.2~SZ5V20UO9BR1.0 size=1048576 2023-10-05T11:35:16.448 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.444+0000 7f26f5634780 1 > prepared part key=_multipart_BU3KSHTINB36.2~SZ5V20UO9BR1.1 size=1048576 2023-10-05T11:35:16.449 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.445+0000 7f26f5634780 1 > prepared part key=_multipart_BU3KSHTINB36.2~SZ5V20UO9BR1.2 size=464113 2023-10-05T11:35:16.449 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.445+0000 7f26f5634780 1 > prepared multipart upload key=BU3KSHTINB36 upload=SZ5V20UO9BR1 tag=04I4NOIM201B type=write size=3609841 2023-10-05T11:35:16.450 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.447+0000 7f26f5634780 1 < completed delete operation key=VJTFYDETLSFD tag=P6KBYD0RTFUM type=del 2023-10-05T11:35:16.528 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.524+0000 7f26f5634780 1 > prepared operation key=S3DKYDFT4IO2 tag=02RS37XTVTYY type=del size=1876493 2023-10-05T11:35:16.529 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.526+0000 7f26f5634780 1 < completed delete operation key=761J2C7GHWU5 tag=LOBL9Q3S0ZQ1 type=del 2023-10-05T11:35:16.532 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.528+0000 7f26f5634780 1 > prepared part key=_multipart_PNV0Q6ZPLYV0.2~D4JM1KOCMFRW.0 size=1048576 2023-10-05T11:35:16.533 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.529+0000 7f26f5634780 1 > prepared part key=_multipart_PNV0Q6ZPLYV0.2~D4JM1KOCMFRW.1 size=1048576 2023-10-05T11:35:16.534 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.530+0000 7f26f5634780 1 > prepared part key=_multipart_PNV0Q6ZPLYV0.2~D4JM1KOCMFRW.2 size=518359 2023-10-05T11:35:16.534 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.530+0000 7f26f5634780 1 > prepared multipart upload key=PNV0Q6ZPLYV0 upload=D4JM1KOCMFRW tag=KG8051M70YWH type=write size=3664087 2023-10-05T11:35:16.536 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.532+0000 7f26f5634780 1 < completed write operation key=0PWYKC7S6YJ4 tag=3S1IPC018892 type=write size=236262 2023-10-05T11:35:16.538 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.535+0000 7f26f5634780 1 > prepared part key=_multipart_PC8WTJ8AYJ24.2~ZMGA5382A0FK.0 size=1048576 2023-10-05T11:35:16.539 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.536+0000 7f26f5634780 1 > prepared part key=_multipart_PC8WTJ8AYJ24.2~ZMGA5382A0FK.1 size=540800 2023-10-05T11:35:16.539 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.536+0000 7f26f5634780 1 > prepared multipart upload key=PC8WTJ8AYJ24 upload=ZMGA5382A0FK tag=4JBD860WXLPN type=write size=2637952 2023-10-05T11:35:16.540 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.537+0000 7f26f5634780 1 < completed delete operation key=2U0NRDGDNUTA tag=BLT22FQYLG5C type=del 2023-10-05T11:35:16.542 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.538+0000 7f26f5634780 1 > prepared operation key=8IPCP77WVVZT tag=O0JJ9125JO01 type=del size=1693904 2023-10-05T11:35:16.543 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.539+0000 7f26f5634780 1 < completed delete operation key=WYN9BG66LA3K tag=AZPRIRL256M0 type=del 2023-10-05T11:35:16.545 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.542+0000 7f26f5634780 1 > prepared part key=_multipart_WTCWG1C1SF89.2~Q6YVA94JU4WV.0 size=1048576 2023-10-05T11:35:16.546 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.543+0000 7f26f5634780 1 > prepared part key=_multipart_WTCWG1C1SF89.2~Q6YVA94JU4WV.1 size=762741 2023-10-05T11:35:16.546 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.543+0000 7f26f5634780 1 > prepared multipart upload key=WTCWG1C1SF89 upload=Q6YVA94JU4WV tag=64M9EWCS8L05 type=write size=2859893 2023-10-05T11:35:16.547 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.544+0000 7f26f5634780 1 < completed write operation key=FOMNIIY47UUM tag=B38FTHKA7NQG type=write size=689390 2023-10-05T11:35:16.548 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.545+0000 7f26f5634780 1 > prepared operation key=761J2C7GHWU5 tag=T342EG1RJ0QB type=write size=27349 2023-10-05T11:35:16.550 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.546+0000 7f26f5634780 1 < completed part key=_multipart_2U0NRDGDNUTA.2~14L63RX3LB42.0 size=545293 2023-10-05T11:35:16.552 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.548+0000 7f26f5634780 1 < completed multipart upload key=2U0NRDGDNUTA upload=14L63RX3LB42 tag=2P95S0CWK4XQ type=write size=1593869 2023-10-05T11:35:16.554 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.551+0000 7f26f5634780 1 > prepared part key=_multipart_8IPCP77WVVZT.2~DKH92HWGJUSS.0 size=1048576 2023-10-05T11:35:16.555 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.552+0000 7f26f5634780 1 > prepared part key=_multipart_8IPCP77WVVZT.2~DKH92HWGJUSS.1 size=715146 2023-10-05T11:35:16.555 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.552+0000 7f26f5634780 1 > prepared multipart upload key=8IPCP77WVVZT upload=DKH92HWGJUSS tag=6GP6XY8C6I8W type=write size=2812298 2023-10-05T11:35:16.557 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.554+0000 7f26f5634780 1 < suggested update operation key=VJTFYDETLSFD tag=VVBTHOKGG6YQ type=del size=1846320 2023-10-05T11:35:16.558 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.555+0000 7f26f5634780 1 > prepared operation key=NV4Q36UOLX8A tag=M01Y2DCTX6R4 type=del size=238533 2023-10-05T11:35:16.560 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.556+0000 7f26f5634780 1 < completed delete operation key=FOMNIIY47UUM tag=0CXPZ92BE6W9 type=del 2023-10-05T11:35:16.561 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.558+0000 7f26f5634780 1 > prepared operation key=PNV0Q6ZPLYV0 tag=T01N540G1O5G type=del size=1585194 2023-10-05T11:35:16.562 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.559+0000 7f26f5634780 1 < completed delete operation key=9S0YW7PPSJ8G tag=P0PZDKNB7PSK type=del 2023-10-05T11:35:16.564 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.561+0000 7f26f5634780 1 > prepared part key=_multipart_5OPHKTHXVN5U.2~U52IYHMUL7W1.0 size=1048576 2023-10-05T11:35:16.565 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.562+0000 7f26f5634780 1 > prepared part key=_multipart_5OPHKTHXVN5U.2~U52IYHMUL7W1.1 size=1048576 2023-10-05T11:35:16.566 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.563+0000 7f26f5634780 1 > prepared part key=_multipart_5OPHKTHXVN5U.2~U52IYHMUL7W1.2 size=551557 2023-10-05T11:35:16.567 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.563+0000 7f26f5634780 1 > prepared multipart upload key=5OPHKTHXVN5U upload=U52IYHMUL7W1 tag=O42N6FW077YY type=write size=3697285 2023-10-05T11:35:16.568 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.564+0000 7f26f5634780 1 < completed write operation key=2D4PDQQT54ZA tag=XIRBKCLJ9OCB type=write size=821354 2023-10-05T11:35:16.569 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.566+0000 7f26f5634780 1 > prepared operation key=0PWYKC7S6YJ4 tag=T6TQUI8F8IG9 type=del size=1771113 2023-10-05T11:35:16.571 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.568+0000 7f26f5634780 1 < suggested update operation key=4D3H60UTIXH3 tag=FLJW2X8OBFA6 type=del size=1754492 2023-10-05T11:35:16.572 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.569+0000 7f26f5634780 1 > prepared operation key=WYN9BG66LA3K tag=IG82NO74A91S type=del size=2397644 2023-10-05T11:35:16.573 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.570+0000 7f26f5634780 1 < completed delete operation key=8IPCP77WVVZT tag=011T7BMLEE67 type=del 2023-10-05T11:35:16.576 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.572+0000 7f26f5634780 1 > prepared part key=_multipart_NV4Q36UOLX8A.2~4NM9YF28SPW0.0 size=915912 2023-10-05T11:35:16.576 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.572+0000 7f26f5634780 1 > prepared multipart upload key=NV4Q36UOLX8A upload=4NM9YF28SPW0 tag=QG2Y1UP4GLPL type=write size=1964488 2023-10-05T11:35:16.577 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.574+0000 7f26f5634780 1 < completed delete operation key=WYN9BG66LA3K tag=LUA1INO8QGW4 type=del 2023-10-05T11:35:16.578 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.575+0000 7f26f5634780 1 > prepared operation key=FOMNIIY47UUM tag=SYI0YOLC71U6 type=write size=671539 2023-10-05T11:35:16.580 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.576+0000 7f26f5634780 1 < completed write operation key=2U0NRDGDNUTA tag=F68SSBY1X0HN type=write size=256376 2023-10-05T11:35:16.582 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.578+0000 7f26f5634780 1 > prepared part key=_multipart_8IPCP77WVVZT.2~I9G07BT7PGBA.0 size=763673 2023-10-05T11:35:16.582 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.578+0000 7f26f5634780 1 > prepared multipart upload key=8IPCP77WVVZT upload=I9G07BT7PGBA tag=91368O319U37 type=write size=1812249 2023-10-05T11:35:16.583 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.580+0000 7f26f5634780 1 < completed part key=_multipart_BU3KSHTINB36.2~SZ5V20UO9BR1.0 size=1048576 2023-10-05T11:35:16.584 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.581+0000 7f26f5634780 1 < completed part key=_multipart_BU3KSHTINB36.2~SZ5V20UO9BR1.1 size=1048576 2023-10-05T11:35:16.585 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.582+0000 7f26f5634780 1 < completed part key=_multipart_BU3KSHTINB36.2~SZ5V20UO9BR1.2 size=464113 2023-10-05T11:35:16.587 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.584+0000 7f26f5634780 1 < completed multipart upload key=BU3KSHTINB36 upload=SZ5V20UO9BR1 tag=04I4NOIM201B type=write size=3609841 2023-10-05T11:35:16.588 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.585+0000 7f26f5634780 1 > prepared operation key=VJTFYDETLSFD tag=PCZ93KL7SUOY type=del size=1608399 2023-10-05T11:35:16.589 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.586+0000 7f26f5634780 1 < completed delete operation key=S3DKYDFT4IO2 tag=02RS37XTVTYY type=del 2023-10-05T11:35:16.590 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.587+0000 7f26f5634780 1 > prepared operation key=PC8WTJ8AYJ24 tag=FBWKCSAUMWPE type=del size=4167199 2023-10-05T11:35:16.592 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.588+0000 7f26f5634780 1 < completed part key=_multipart_PNV0Q6ZPLYV0.2~D4JM1KOCMFRW.0 size=1048576 2023-10-05T11:35:16.593 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.589+0000 7f26f5634780 1 < completed part key=_multipart_PNV0Q6ZPLYV0.2~D4JM1KOCMFRW.1 size=1048576 2023-10-05T11:35:16.594 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.590+0000 7f26f5634780 1 < completed part key=_multipart_PNV0Q6ZPLYV0.2~D4JM1KOCMFRW.2 size=518359 2023-10-05T11:35:16.596 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.592+0000 7f26f5634780 1 < completed multipart upload key=PNV0Q6ZPLYV0 upload=D4JM1KOCMFRW tag=KG8051M70YWH type=write size=3664087 2023-10-05T11:35:16.597 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.594+0000 7f26f5634780 1 > prepared operation key=W2GWVGX42QLD tag=2NSIK4RXAUKD type=del size=2240945 2023-10-05T11:35:16.598 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.595+0000 7f26f5634780 1 < completed part key=_multipart_PC8WTJ8AYJ24.2~ZMGA5382A0FK.0 size=1048576 2023-10-05T11:35:16.599 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.596+0000 7f26f5634780 1 < completed part key=_multipart_PC8WTJ8AYJ24.2~ZMGA5382A0FK.1 size=540800 2023-10-05T11:35:16.601 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.598+0000 7f26f5634780 1 < completed multipart upload key=PC8WTJ8AYJ24 upload=ZMGA5382A0FK tag=4JBD860WXLPN type=write size=2637952 2023-10-05T11:35:16.603 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.599+0000 7f26f5634780 1 > prepared operation key=J5EIH25Y471T tag=LEC1Z33B4ME0 type=del size=2038034 2023-10-05T11:35:16.604 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.601+0000 7f26f5634780 1 < completed delete operation key=8IPCP77WVVZT tag=O0JJ9125JO01 type=del 2023-10-05T11:35:16.605 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.602+0000 7f26f5634780 1 > prepared operation key=J5EIH25Y471T tag=TY7XTM3K1ROX type=del size=3207692 2023-10-05T11:35:16.606 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.603+0000 7f26f5634780 1 < completed part key=_multipart_WTCWG1C1SF89.2~Q6YVA94JU4WV.0 size=1048576 2023-10-05T11:35:16.607 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.604+0000 7f26f5634780 1 < completed part key=_multipart_WTCWG1C1SF89.2~Q6YVA94JU4WV.1 size=762741 2023-10-05T11:35:16.610 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.606+0000 7f26f5634780 1 < completed multipart upload key=WTCWG1C1SF89 upload=Q6YVA94JU4WV tag=64M9EWCS8L05 type=write size=2859893 2023-10-05T11:35:16.611 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.608+0000 7f26f5634780 1 > prepared operation key=761J2C7GHWU5 tag=GRZTSUB02562 type=write size=118263 2023-10-05T11:35:16.612 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.609+0000 7f26f5634780 1 < completed write operation key=761J2C7GHWU5 tag=T342EG1RJ0QB type=write size=27349 2023-10-05T11:35:16.613 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.610+0000 7f26f5634780 1 > prepared operation key=2U0NRDGDNUTA tag=OG8CL8MQK9UR type=del size=912972 2023-10-05T11:35:16.615 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.611+0000 7f26f5634780 1 < completed part key=_multipart_8IPCP77WVVZT.2~DKH92HWGJUSS.0 size=1048576 2023-10-05T11:35:16.616 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.612+0000 7f26f5634780 1 < completed part key=_multipart_8IPCP77WVVZT.2~DKH92HWGJUSS.1 size=715146 2023-10-05T11:35:16.618 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.615+0000 7f26f5634780 1 < completed multipart upload key=8IPCP77WVVZT upload=DKH92HWGJUSS tag=6GP6XY8C6I8W type=write size=2812298 2023-10-05T11:35:16.619 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.616+0000 7f26f5634780 1 > prepared operation key=7W9LL5HSU3BG tag=F7A33RB75OQN type=del size=2142664 2023-10-05T11:35:16.621 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.617+0000 7f26f5634780 1 < canceled operation key=NV4Q36UOLX8A tag=M01Y2DCTX6R4 type=del size=238533 2023-10-05T11:35:16.623 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.619+0000 7f26f5634780 1 > prepared part key=_multipart_LLR5J3X15W5R.2~ALZTPIPTWBS6.0 size=195638 2023-10-05T11:35:16.623 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.619+0000 7f26f5634780 1 > prepared multipart upload key=LLR5J3X15W5R upload=ALZTPIPTWBS6 tag=7KK4TGMD94V3 type=write size=1244214 2023-10-05T11:35:16.624 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.621+0000 7f26f5634780 1 < completed delete operation key=PNV0Q6ZPLYV0 tag=T01N540G1O5G type=del 2023-10-05T11:35:16.625 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.622+0000 7f26f5634780 1 > prepared operation key=MEY4SZRHU9NZ tag=MWFTOVCU5HL7 type=del size=3459252 2023-10-05T11:35:16.626 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.623+0000 7f26f5634780 1 < completed part key=_multipart_5OPHKTHXVN5U.2~U52IYHMUL7W1.0 size=1048576 2023-10-05T11:35:16.627 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.624+0000 7f26f5634780 1 < completed part key=_multipart_5OPHKTHXVN5U.2~U52IYHMUL7W1.1 size=1048576 2023-10-05T11:35:16.628 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.625+0000 7f26f5634780 1 < completed part key=_multipart_5OPHKTHXVN5U.2~U52IYHMUL7W1.2 size=551557 2023-10-05T11:35:16.631 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.627+0000 7f26f5634780 1 < completed multipart upload key=5OPHKTHXVN5U upload=U52IYHMUL7W1 tag=O42N6FW077YY type=write size=3697285 2023-10-05T11:35:16.633 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.630+0000 7f26f5634780 1 > prepared part key=_multipart_MEY4SZRHU9NZ.2~CYW52X43FJM4.0 size=1048576 2023-10-05T11:35:16.634 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.631+0000 7f26f5634780 1 > prepared part key=_multipart_MEY4SZRHU9NZ.2~CYW52X43FJM4.1 size=1048576 2023-10-05T11:35:16.635 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.632+0000 7f26f5634780 1 > prepared part key=_multipart_MEY4SZRHU9NZ.2~CYW52X43FJM4.2 size=220074 2023-10-05T11:35:16.635 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.632+0000 7f26f5634780 1 > prepared multipart upload key=MEY4SZRHU9NZ upload=CYW52X43FJM4 tag=4AJ3AE3Z155N type=write size=3365802 2023-10-05T11:35:16.636 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.633+0000 7f26f5634780 1 < completed delete operation key=0PWYKC7S6YJ4 tag=T6TQUI8F8IG9 type=del 2023-10-05T11:35:16.638 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.635+0000 7f26f5634780 1 > prepared part key=_multipart_PC8WTJ8AYJ24.2~3NROU74GQNL6.0 size=1048576 2023-10-05T11:35:16.640 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.636+0000 7f26f5634780 1 > prepared part key=_multipart_PC8WTJ8AYJ24.2~3NROU74GQNL6.1 size=634071 2023-10-05T11:35:16.640 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.636+0000 7f26f5634780 1 > prepared multipart upload key=PC8WTJ8AYJ24 upload=3NROU74GQNL6 tag=462DAGIPRFKT type=write size=2731223 2023-10-05T11:35:16.641 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.637+0000 7f26f5634780 1 < completed delete operation key=WYN9BG66LA3K tag=IG82NO74A91S type=del 2023-10-05T11:35:16.642 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.639+0000 7f26f5634780 1 > prepared operation key=FOMNIIY47UUM tag=6783GRGCXG5H type=del size=3618714 2023-10-05T11:35:16.645 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.642+0000 7f26f5634780 1 < completed part key=_multipart_NV4Q36UOLX8A.2~4NM9YF28SPW0.0 size=915912 2023-10-05T11:35:16.647 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.644+0000 7f26f5634780 1 < completed multipart upload key=NV4Q36UOLX8A upload=4NM9YF28SPW0 tag=QG2Y1UP4GLPL type=write size=1964488 2023-10-05T11:35:16.649 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.646+0000 7f26f5634780 1 > prepared part key=_multipart_5V0Q651D4VN2.2~IYODZP3JZ5ZX.0 size=1048576 2023-10-05T11:35:16.650 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.647+0000 7f26f5634780 1 > prepared part key=_multipart_5V0Q651D4VN2.2~IYODZP3JZ5ZX.1 size=214591 2023-10-05T11:35:16.651 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.647+0000 7f26f5634780 1 > prepared multipart upload key=5V0Q651D4VN2 upload=IYODZP3JZ5ZX tag=2MXIJH334DBB type=write size=2311743 2023-10-05T11:35:16.653 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.649+0000 7f26f5634780 1 < suggested remove operation key=FOMNIIY47UUM tag=SYI0YOLC71U6 type=write 2023-10-05T11:35:16.654 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.651+0000 7f26f5634780 1 > prepared operation key=AV0XKXX1IR4B tag=BRXYHAA6LHLI type=del size=536885 2023-10-05T11:35:16.655 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.652+0000 7f26f5634780 1 < completed part key=_multipart_8IPCP77WVVZT.2~I9G07BT7PGBA.0 size=763673 2023-10-05T11:35:16.657 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.654+0000 7f26f5634780 1 < completed multipart upload key=8IPCP77WVVZT upload=I9G07BT7PGBA tag=91368O319U37 type=write size=1812249 2023-10-05T11:35:16.658 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.655+0000 7f26f5634780 1 > prepared operation key=BTZUVE8R96XT tag=9AWYOC64Q26V type=del size=3009546 2023-10-05T11:35:16.659 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.656+0000 7f26f5634780 1 < canceled operation key=VJTFYDETLSFD tag=PCZ93KL7SUOY type=del size=1608399 2023-10-05T11:35:16.661 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.657+0000 7f26f5634780 1 > prepared operation key=4D3H60UTIXH3 tag=RMM75GOF4ZWW type=del size=2604375 2023-10-05T11:35:16.662 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.659+0000 7f26f5634780 1 < completed delete operation key=PC8WTJ8AYJ24 tag=FBWKCSAUMWPE type=del 2023-10-05T11:35:16.663 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.660+0000 7f26f5634780 1 > prepared operation key=5V0Q651D4VN2 tag=P2SLY2S6EUV6 type=del size=936216 2023-10-05T11:35:16.665 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.662+0000 7f26f5634780 1 < suggested update operation key=W2GWVGX42QLD tag=2NSIK4RXAUKD type=del size=2240945 2023-10-05T11:35:16.667 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.663+0000 7f26f5634780 1 > prepared operation key=BU3KSHTINB36 tag=O5WDHZ2XYWXG type=del size=2902713 2023-10-05T11:35:16.668 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.665+0000 7f26f5634780 1 < completed delete operation key=J5EIH25Y471T tag=LEC1Z33B4ME0 type=del 2023-10-05T11:35:16.669 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.666+0000 7f26f5634780 1 > prepared operation key=6DP3UJ4CW1MO tag=T3G4K21SDQFJ type=del size=167221 2023-10-05T11:35:16.670 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.667+0000 7f26f5634780 1 < completed delete operation key=J5EIH25Y471T tag=TY7XTM3K1ROX type=del 2023-10-05T11:35:16.673 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.669+0000 7f26f5634780 1 > prepared part key=_multipart_2D4PDQQT54ZA.2~FQQZWQQYW194.0 size=1048576 2023-10-05T11:35:16.673 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.670+0000 7f26f5634780 1 > prepared part key=_multipart_2D4PDQQT54ZA.2~FQQZWQQYW194.1 size=767368 2023-10-05T11:35:16.674 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.670+0000 7f26f5634780 1 > prepared multipart upload key=2D4PDQQT54ZA upload=FQQZWQQYW194 tag=6JGZJ3ATS7I0 type=write size=2864520 2023-10-05T11:35:16.675 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.671+0000 7f26f5634780 1 < completed write operation key=761J2C7GHWU5 tag=GRZTSUB02562 type=write size=118263 2023-10-05T11:35:16.676 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.673+0000 7f26f5634780 1 > prepared operation key=WTCWG1C1SF89 tag=WNA0B2714T07 type=del size=2283475 2023-10-05T11:35:16.678 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.675+0000 7f26f5634780 1 < suggested remove operation key=2U0NRDGDNUTA tag=OG8CL8MQK9UR type=del 2023-10-05T11:35:16.680 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.677+0000 7f26f5634780 1 > prepared part key=_multipart_QYQDXVIGZ7O8.2~QUP2B4PI91AC.0 size=637857 2023-10-05T11:35:16.681 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.677+0000 7f26f5634780 1 > prepared multipart upload key=QYQDXVIGZ7O8 upload=QUP2B4PI91AC tag=Y02H5CGDG843 type=write size=1686433 2023-10-05T11:35:16.682 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.678+0000 7f26f5634780 1 < completed delete operation key=7W9LL5HSU3BG tag=F7A33RB75OQN type=del 2023-10-05T11:35:16.684 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.681+0000 7f26f5634780 1 > prepared part key=_multipart_BTZUVE8R96XT.2~D6KEI4NUAKD0.0 size=1048576 2023-10-05T11:35:16.685 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.682+0000 7f26f5634780 1 > prepared part key=_multipart_BTZUVE8R96XT.2~D6KEI4NUAKD0.1 size=1048576 2023-10-05T11:35:16.686 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.682+0000 7f26f5634780 1 > prepared part key=_multipart_BTZUVE8R96XT.2~D6KEI4NUAKD0.2 size=917404 2023-10-05T11:35:16.686 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.682+0000 7f26f5634780 1 > prepared multipart upload key=BTZUVE8R96XT upload=D6KEI4NUAKD0 tag=M06KLYM2PXC5 type=write size=4063132 2023-10-05T11:35:16.687 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.684+0000 7f26f5634780 1 < completed part key=_multipart_LLR5J3X15W5R.2~ALZTPIPTWBS6.0 size=195638 2023-10-05T11:35:16.689 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.686+0000 7f26f5634780 1 < completed multipart upload key=LLR5J3X15W5R upload=ALZTPIPTWBS6 tag=7KK4TGMD94V3 type=write size=1244214 2023-10-05T11:35:16.690 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.687+0000 7f26f5634780 1 > prepared operation key=7W9LL5HSU3BG tag=SU85JSUJ8DVB type=del size=3973041 2023-10-05T11:35:16.693 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.689+0000 7f26f5634780 1 < suggested remove operation key=MEY4SZRHU9NZ tag=MWFTOVCU5HL7 type=del 2023-10-05T11:35:16.694 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.691+0000 7f26f5634780 1 > prepared operation key=761J2C7GHWU5 tag=HBI5UZ2V0E55 type=del size=2138163 2023-10-05T11:35:16.694 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.691+0000 7f26f5634780 1 < canceled part key=_multipart_MEY4SZRHU9NZ.2~CYW52X43FJM4.0 size=1048576 2023-10-05T11:35:16.695 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.692+0000 7f26f5634780 1 < completed part key=_multipart_MEY4SZRHU9NZ.2~CYW52X43FJM4.1 size=1048576 2023-10-05T11:35:16.696 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.693+0000 7f26f5634780 1 < completed part key=_multipart_MEY4SZRHU9NZ.2~CYW52X43FJM4.2 size=220074 2023-10-05T11:35:16.698 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.695+0000 7f26f5634780 1 < canceled multipart upload key=MEY4SZRHU9NZ upload=CYW52X43FJM4 tag=4AJ3AE3Z155N type=write size=3365802 2023-10-05T11:35:16.701 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.697+0000 7f26f5634780 1 > prepared part key=_multipart_0PWYKC7S6YJ4.2~RNFCKE1M7E1S.0 size=432391 2023-10-05T11:35:16.701 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.697+0000 7f26f5634780 1 > prepared multipart upload key=0PWYKC7S6YJ4 upload=RNFCKE1M7E1S tag=PPZQG5HY0NZH type=write size=1480967 2023-10-05T11:35:16.702 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.698+0000 7f26f5634780 1 < completed part key=_multipart_PC8WTJ8AYJ24.2~3NROU74GQNL6.0 size=1048576 2023-10-05T11:35:16.703 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.699+0000 7f26f5634780 1 < completed part key=_multipart_PC8WTJ8AYJ24.2~3NROU74GQNL6.1 size=634071 2023-10-05T11:35:16.705 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.702+0000 7f26f5634780 1 < completed multipart upload key=PC8WTJ8AYJ24 upload=3NROU74GQNL6 tag=462DAGIPRFKT type=write size=2731223 2023-10-05T11:35:16.706 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.703+0000 7f26f5634780 1 > prepared operation key=6DP3UJ4CW1MO tag=MBM81H57ONQM type=write size=194309 2023-10-05T11:35:16.708 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.704+0000 7f26f5634780 -1 < failed to complete operation key=FOMNIIY47UUM tag=6783GRGCXG5H type=del size=3618714: (22) Invalid argument 2023-10-05T11:35:16.709 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.705+0000 7f26f5634780 1 > prepared operation key=WTCWG1C1SF89 tag=ZGWWYENKB3IG type=write size=735933 2023-10-05T11:35:16.710 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.707+0000 7f26f5634780 1 < completed part key=_multipart_5V0Q651D4VN2.2~IYODZP3JZ5ZX.0 size=1048576 2023-10-05T11:35:16.711 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.708+0000 7f26f5634780 1 < completed part key=_multipart_5V0Q651D4VN2.2~IYODZP3JZ5ZX.1 size=214591 2023-10-05T11:35:16.713 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.710+0000 7f26f5634780 1 < completed multipart upload key=5V0Q651D4VN2 upload=IYODZP3JZ5ZX tag=2MXIJH334DBB type=write size=2311743 2023-10-05T11:35:16.714 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.711+0000 7f26f5634780 1 > prepared operation key=0PWYKC7S6YJ4 tag=HHK35NUZ9DKF type=write size=558496 2023-10-05T11:35:16.716 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.712+0000 7f26f5634780 1 < completed delete operation key=AV0XKXX1IR4B tag=BRXYHAA6LHLI type=del 2023-10-05T11:35:16.717 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.714+0000 7f26f5634780 1 > prepared operation key=QYQDXVIGZ7O8 tag=9AWYTYA52BSO type=del size=1433540 2023-10-05T11:35:16.720 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.716+0000 7f26f5634780 1 < suggested update operation key=BTZUVE8R96XT tag=9AWYOC64Q26V type=del size=3009546 2023-10-05T11:35:16.722 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.719+0000 7f26f5634780 1 > prepared part key=_multipart_2U0NRDGDNUTA.2~MWN7C3D5DYW3.0 size=1048576 2023-10-05T11:35:16.723 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.720+0000 7f26f5634780 1 > prepared part key=_multipart_2U0NRDGDNUTA.2~MWN7C3D5DYW3.1 size=982877 2023-10-05T11:35:16.723 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.720+0000 7f26f5634780 1 > prepared multipart upload key=2U0NRDGDNUTA upload=MWN7C3D5DYW3 tag=VIUB6J8PRWTE type=write size=3080029 2023-10-05T11:35:16.724 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.721+0000 7f26f5634780 1 < completed delete operation key=4D3H60UTIXH3 tag=RMM75GOF4ZWW type=del 2023-10-05T11:35:16.726 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.723+0000 7f26f5634780 1 > prepared part key=_multipart_S3DKYDFT4IO2.2~LL1D5D6GE47Q.0 size=302235 2023-10-05T11:35:16.727 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.723+0000 7f26f5634780 1 > prepared multipart upload key=S3DKYDFT4IO2 upload=LL1D5D6GE47Q tag=LCHPOFI3BM3V type=write size=1350811 2023-10-05T11:35:16.729 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.726+0000 7f26f5634780 1 < suggested remove operation key=5V0Q651D4VN2 tag=P2SLY2S6EUV6 type=del 2023-10-05T11:35:16.731 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.728+0000 7f26f5634780 1 > prepared part key=_multipart_IC7T3ZK81WQS.2~QMFB9AQ8PDJW.0 size=407238 2023-10-05T11:35:16.732 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.728+0000 7f26f5634780 1 > prepared multipart upload key=IC7T3ZK81WQS upload=QMFB9AQ8PDJW tag=079QT6LD966G type=write size=1455814 2023-10-05T11:35:16.734 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.731+0000 7f26f5634780 1 < suggested remove operation key=BU3KSHTINB36 tag=O5WDHZ2XYWXG type=del 2023-10-05T11:35:16.735 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.732+0000 7f26f5634780 1 > prepared operation key=NV4Q36UOLX8A tag=49DJ5HBUNCEV type=del size=3953797 2023-10-05T11:35:16.736 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.733+0000 7f26f5634780 1 < completed delete operation key=6DP3UJ4CW1MO tag=T3G4K21SDQFJ type=del 2023-10-05T11:35:16.739 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.735+0000 7f26f5634780 1 > prepared part key=_multipart_U6172JUYW7J6.2~53HDRBRYJM8W.0 size=1048576 2023-10-05T11:35:16.740 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.736+0000 7f26f5634780 1 > prepared part key=_multipart_U6172JUYW7J6.2~53HDRBRYJM8W.1 size=997710 2023-10-05T11:35:16.740 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.736+0000 7f26f5634780 1 > prepared multipart upload key=U6172JUYW7J6 upload=53HDRBRYJM8W tag=J2MM5D0MLTA1 type=write size=3094862 2023-10-05T11:35:16.741 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.738+0000 7f26f5634780 1 < completed part key=_multipart_2D4PDQQT54ZA.2~FQQZWQQYW194.0 size=1048576 2023-10-05T11:35:16.742 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.739+0000 7f26f5634780 1 < completed part key=_multipart_2D4PDQQT54ZA.2~FQQZWQQYW194.1 size=767368 2023-10-05T11:35:16.744 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.741+0000 7f26f5634780 1 < completed multipart upload key=2D4PDQQT54ZA upload=FQQZWQQYW194 tag=6JGZJ3ATS7I0 type=write size=2864520 2023-10-05T11:35:16.746 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.742+0000 7f26f5634780 1 > prepared operation key=NV4Q36UOLX8A tag=F5M5J0NKIE55 type=del size=147337 2023-10-05T11:35:16.748 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.745+0000 7f26f5634780 1 < suggested remove operation key=WTCWG1C1SF89 tag=WNA0B2714T07 type=del 2023-10-05T11:35:16.749 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.746+0000 7f26f5634780 1 > prepared operation key=PNV0Q6ZPLYV0 tag=00K230ZE8Q5J type=del size=220036 2023-10-05T11:35:16.751 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.747+0000 7f26f5634780 1 < completed part key=_multipart_QYQDXVIGZ7O8.2~QUP2B4PI91AC.0 size=637857 2023-10-05T11:35:16.753 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.749+0000 7f26f5634780 1 < completed multipart upload key=QYQDXVIGZ7O8 upload=QUP2B4PI91AC tag=Y02H5CGDG843 type=write size=1686433 2023-10-05T11:35:16.754 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.751+0000 7f26f5634780 1 > prepared operation key=PC8WTJ8AYJ24 tag=TJ1NMH5A8EO4 type=del size=3762743 2023-10-05T11:35:16.755 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.752+0000 7f26f5634780 1 < completed part key=_multipart_BTZUVE8R96XT.2~D6KEI4NUAKD0.0 size=1048576 2023-10-05T11:35:16.756 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.753+0000 7f26f5634780 1 < completed part key=_multipart_BTZUVE8R96XT.2~D6KEI4NUAKD0.1 size=1048576 2023-10-05T11:35:16.757 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.754+0000 7f26f5634780 1 < completed part key=_multipart_BTZUVE8R96XT.2~D6KEI4NUAKD0.2 size=917404 2023-10-05T11:35:16.759 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.756+0000 7f26f5634780 1 < completed multipart upload key=BTZUVE8R96XT upload=D6KEI4NUAKD0 tag=M06KLYM2PXC5 type=write size=4063132 2023-10-05T11:35:16.762 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.759+0000 7f26f5634780 1 > prepared operation key=MEY4SZRHU9NZ tag=2ZIWZNVSX6NB type=del size=3005133 2023-10-05T11:35:16.763 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.760+0000 7f26f5634780 1 < completed delete operation key=7W9LL5HSU3BG tag=SU85JSUJ8DVB type=del 2023-10-05T11:35:16.764 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.761+0000 7f26f5634780 1 > prepared operation key=2U0NRDGDNUTA tag=N5YF5Q8Q585E type=del size=848966 2023-10-05T11:35:16.767 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.763+0000 7f26f5634780 1 < suggested remove operation key=761J2C7GHWU5 tag=HBI5UZ2V0E55 type=del 2023-10-05T11:35:16.769 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.765+0000 7f26f5634780 1 > prepared part key=_multipart_4D3H60UTIXH3.2~ZP47GSVV1MT3.0 size=575136 2023-10-05T11:35:16.769 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.765+0000 7f26f5634780 1 > prepared multipart upload key=4D3H60UTIXH3 upload=ZP47GSVV1MT3 tag=U3RNVHGNOWXD type=write size=1623712 2023-10-05T11:35:16.770 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.767+0000 7f26f5634780 1 < completed part key=_multipart_0PWYKC7S6YJ4.2~RNFCKE1M7E1S.0 size=432391 2023-10-05T11:35:16.772 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.768+0000 7f26f5634780 1 < completed multipart upload key=0PWYKC7S6YJ4 upload=RNFCKE1M7E1S tag=PPZQG5HY0NZH type=write size=1480967 2023-10-05T11:35:16.773 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.770+0000 7f26f5634780 1 > prepared operation key=IC7T3ZK81WQS tag=N45QWUY4QT6J type=del size=1470584 2023-10-05T11:35:16.775 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.772+0000 7f26f5634780 1 < suggested remove operation key=6DP3UJ4CW1MO tag=MBM81H57ONQM type=write 2023-10-05T11:35:16.777 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.774+0000 7f26f5634780 1 > prepared part key=_multipart_5OPHKTHXVN5U.2~PJCBTPEEJY4H.0 size=745986 2023-10-05T11:35:16.778 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.774+0000 7f26f5634780 1 > prepared multipart upload key=5OPHKTHXVN5U upload=PJCBTPEEJY4H tag=7CNRS2BEYP1F type=write size=1794562 2023-10-05T11:35:16.779 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.775+0000 7f26f5634780 -1 < failed to complete operation key=WTCWG1C1SF89 tag=ZGWWYENKB3IG type=write size=735933: (22) Invalid argument 2023-10-05T11:35:16.780 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.776+0000 7f26f5634780 1 > prepared operation key=QYQDXVIGZ7O8 tag=LW3BDTSM0L31 type=del size=1175162 2023-10-05T11:35:16.781 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.778+0000 7f26f5634780 1 < completed write operation key=0PWYKC7S6YJ4 tag=HHK35NUZ9DKF type=write size=558496 2023-10-05T11:35:16.782 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.779+0000 7f26f5634780 1 > prepared operation key=VJTFYDETLSFD tag=2TUEWS45SDXP type=del size=3339734 2023-10-05T11:35:16.783 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.780+0000 7f26f5634780 1 < completed delete operation key=QYQDXVIGZ7O8 tag=9AWYTYA52BSO type=del 2023-10-05T11:35:16.785 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.782+0000 7f26f5634780 1 > prepared part key=_multipart_2D4PDQQT54ZA.2~PSJ3QQZGDJQN.0 size=1048576 2023-10-05T11:35:16.787 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.783+0000 7f26f5634780 1 > prepared part key=_multipart_2D4PDQQT54ZA.2~PSJ3QQZGDJQN.1 size=1048576 2023-10-05T11:35:16.789 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.786+0000 7f26f5634780 1 > prepared part key=_multipart_2D4PDQQT54ZA.2~PSJ3QQZGDJQN.2 size=1009371 2023-10-05T11:35:16.790 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.786+0000 7f26f5634780 1 > prepared multipart upload key=2D4PDQQT54ZA upload=PSJ3QQZGDJQN tag=KLR0X2KJ8M21 type=write size=4155099 2023-10-05T11:35:16.792 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.789+0000 7f26f5634780 1 < completed part key=_multipart_2U0NRDGDNUTA.2~MWN7C3D5DYW3.0 size=1048576 2023-10-05T11:35:16.793 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.790+0000 7f26f5634780 1 < completed part key=_multipart_2U0NRDGDNUTA.2~MWN7C3D5DYW3.1 size=982877 2023-10-05T11:35:16.795 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.792+0000 7f26f5634780 1 < completed multipart upload key=2U0NRDGDNUTA upload=MWN7C3D5DYW3 tag=VIUB6J8PRWTE type=write size=3080029 2023-10-05T11:35:16.797 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.793+0000 7f26f5634780 1 > prepared operation key=8IPCP77WVVZT tag=UQWHFCFAPFP8 type=del size=4052001 2023-10-05T11:35:16.797 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.794+0000 7f26f5634780 1 < canceled part key=_multipart_S3DKYDFT4IO2.2~LL1D5D6GE47Q.0 size=302235 2023-10-05T11:35:16.799 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.795+0000 7f26f5634780 1 < canceled multipart upload key=S3DKYDFT4IO2 upload=LL1D5D6GE47Q tag=LCHPOFI3BM3V type=write size=1350811 2023-10-05T11:35:16.800 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.797+0000 7f26f5634780 1 > prepared operation key=WYN9BG66LA3K tag=SI8WUW04SJT5 type=write size=136853 2023-10-05T11:35:16.801 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.798+0000 7f26f5634780 1 < completed part key=_multipart_IC7T3ZK81WQS.2~QMFB9AQ8PDJW.0 size=407238 2023-10-05T11:35:16.803 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.800+0000 7f26f5634780 1 < completed multipart upload key=IC7T3ZK81WQS upload=QMFB9AQ8PDJW tag=079QT6LD966G type=write size=1455814 2023-10-05T11:35:16.804 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.801+0000 7f26f5634780 1 > prepared operation key=7W9LL5HSU3BG tag=THPGR7NWAETW type=write size=731211 2023-10-05T11:35:16.806 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.802+0000 7f26f5634780 1 < completed delete operation key=NV4Q36UOLX8A tag=49DJ5HBUNCEV type=del 2023-10-05T11:35:16.807 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.804+0000 7f26f5634780 1 > prepared operation key=5OPHKTHXVN5U tag=UU8UZJ4FJ8EP type=del size=3879090 2023-10-05T11:35:16.808 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.805+0000 7f26f5634780 1 < completed part key=_multipart_U6172JUYW7J6.2~53HDRBRYJM8W.0 size=1048576 2023-10-05T11:35:16.809 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.806+0000 7f26f5634780 1 < completed part key=_multipart_U6172JUYW7J6.2~53HDRBRYJM8W.1 size=997710 2023-10-05T11:35:16.812 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.808+0000 7f26f5634780 1 < completed multipart upload key=U6172JUYW7J6 upload=53HDRBRYJM8W tag=J2MM5D0MLTA1 type=write size=3094862 2023-10-05T11:35:16.814 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.810+0000 7f26f5634780 1 > prepared part key=_multipart_S3DKYDFT4IO2.2~CZOHHD5GEPS1.0 size=214564 2023-10-05T11:35:16.814 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.810+0000 7f26f5634780 1 > prepared multipart upload key=S3DKYDFT4IO2 upload=CZOHHD5GEPS1 tag=ORI4KDJENYGC type=write size=1263140 2023-10-05T11:35:16.815 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.811+0000 7f26f5634780 1 < completed delete operation key=NV4Q36UOLX8A tag=F5M5J0NKIE55 type=del 2023-10-05T11:35:16.816 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.813+0000 7f26f5634780 1 > prepared operation key=IKCNZOTVWOC6 tag=WA9YT0YISJIJ type=del size=3261357 2023-10-05T11:35:16.817 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.814+0000 7f26f5634780 1 < canceled operation key=PNV0Q6ZPLYV0 tag=00K230ZE8Q5J type=del size=220036 2023-10-05T11:35:16.821 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.818+0000 7f26f5634780 1 > prepared part key=_multipart_MEY4SZRHU9NZ.2~7X4K76ROH9DK.0 size=439006 2023-10-05T11:35:16.821 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.818+0000 7f26f5634780 1 > prepared multipart upload key=MEY4SZRHU9NZ upload=7X4K76ROH9DK tag=KQECUHIRR2DD type=write size=1487582 2023-10-05T11:35:16.823 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.820+0000 7f26f5634780 1 < suggested remove operation key=PC8WTJ8AYJ24 tag=TJ1NMH5A8EO4 type=del 2023-10-05T11:35:16.825 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.822+0000 7f26f5634780 1 > prepared operation key=9S0YW7PPSJ8G tag=UHI6QDTN5AY0 type=del size=3469517 2023-10-05T11:35:16.826 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.823+0000 7f26f5634780 1 < completed delete operation key=MEY4SZRHU9NZ tag=2ZIWZNVSX6NB type=del 2023-10-05T11:35:16.828 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.824+0000 7f26f5634780 1 > prepared operation key=NV4Q36UOLX8A tag=XRKXMQWHZ3ZG type=del size=334850 2023-10-05T11:35:16.830 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.827+0000 7f26f5634780 1 < suggested update operation key=2U0NRDGDNUTA tag=N5YF5Q8Q585E type=del size=848966 2023-10-05T11:35:16.832 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.829+0000 7f26f5634780 1 > prepared part key=_multipart_5V0Q651D4VN2.2~9YF932WH1ABS.0 size=970204 2023-10-05T11:35:16.833 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.829+0000 7f26f5634780 1 > prepared multipart upload key=5V0Q651D4VN2 upload=9YF932WH1ABS tag=HH88CZXX7QB9 type=write size=2018780 2023-10-05T11:35:16.834 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.830+0000 7f26f5634780 1 < completed part key=_multipart_4D3H60UTIXH3.2~ZP47GSVV1MT3.0 size=575136 2023-10-05T11:35:16.836 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.832+0000 7f26f5634780 1 < completed multipart upload key=4D3H60UTIXH3 upload=ZP47GSVV1MT3 tag=U3RNVHGNOWXD type=write size=1623712 2023-10-05T11:35:16.838 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.835+0000 7f26f5634780 1 > prepared part key=_multipart_761J2C7GHWU5.2~IWYQ9GWWH77W.0 size=1048576 2023-10-05T11:35:16.839 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.836+0000 7f26f5634780 1 > prepared part key=_multipart_761J2C7GHWU5.2~IWYQ9GWWH77W.1 size=1048576 2023-10-05T11:35:16.840 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.837+0000 7f26f5634780 1 > prepared part key=_multipart_761J2C7GHWU5.2~IWYQ9GWWH77W.2 size=504524 2023-10-05T11:35:16.840 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.837+0000 7f26f5634780 1 > prepared multipart upload key=761J2C7GHWU5 upload=IWYQ9GWWH77W tag=L064DO3PEA8C type=write size=3650252 2023-10-05T11:35:16.841 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.838+0000 7f26f5634780 1 < completed delete operation key=IC7T3ZK81WQS tag=N45QWUY4QT6J type=del 2023-10-05T11:35:16.842 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.839+0000 7f26f5634780 1 > prepared operation key=8IPCP77WVVZT tag=B1OC6AZ68PFX type=del size=324011 2023-10-05T11:35:16.844 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.840+0000 7f26f5634780 1 < completed part key=_multipart_5OPHKTHXVN5U.2~PJCBTPEEJY4H.0 size=745986 2023-10-05T11:35:16.846 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.842+0000 7f26f5634780 1 < completed multipart upload key=5OPHKTHXVN5U upload=PJCBTPEEJY4H tag=7CNRS2BEYP1F type=write size=1794562 2023-10-05T11:35:16.848 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.844+0000 7f26f5634780 1 > prepared part key=_multipart_2D4PDQQT54ZA.2~DZU3IW8L5OW7.0 size=980472 2023-10-05T11:35:16.848 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.844+0000 7f26f5634780 1 > prepared multipart upload key=2D4PDQQT54ZA upload=DZU3IW8L5OW7 tag=ECIWEX0AMS7F type=write size=2029048 2023-10-05T11:35:16.849 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.846+0000 7f26f5634780 1 < completed delete operation key=QYQDXVIGZ7O8 tag=LW3BDTSM0L31 type=del 2023-10-05T11:35:16.850 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.847+0000 7f26f5634780 1 > prepared operation key=PNV0Q6ZPLYV0 tag=ZZZ4SNL787IB type=write size=559491 2023-10-05T11:35:16.852 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.848+0000 7f26f5634780 1 < completed delete operation key=VJTFYDETLSFD tag=2TUEWS45SDXP type=del 2023-10-05T11:35:16.853 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.850+0000 7f26f5634780 1 > prepared operation key=IC7T3ZK81WQS tag=0YIIL1Y037JC type=del size=3512290 2023-10-05T11:35:16.854 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.851+0000 7f26f5634780 1 < completed part key=_multipart_2D4PDQQT54ZA.2~PSJ3QQZGDJQN.0 size=1048576 2023-10-05T11:35:16.855 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.852+0000 7f26f5634780 1 < completed part key=_multipart_2D4PDQQT54ZA.2~PSJ3QQZGDJQN.1 size=1048576 2023-10-05T11:35:16.857 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.853+0000 7f26f5634780 1 < completed part key=_multipart_2D4PDQQT54ZA.2~PSJ3QQZGDJQN.2 size=1009371 2023-10-05T11:35:16.859 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.855+0000 7f26f5634780 1 < completed multipart upload key=2D4PDQQT54ZA upload=PSJ3QQZGDJQN tag=KLR0X2KJ8M21 type=write size=4155099 2023-10-05T11:35:16.861 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.858+0000 7f26f5634780 1 > prepared part key=_multipart_J5EIH25Y471T.2~48XZO2C7OXNX.0 size=1048576 2023-10-05T11:35:16.862 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.859+0000 7f26f5634780 1 > prepared part key=_multipart_J5EIH25Y471T.2~48XZO2C7OXNX.1 size=1048576 2023-10-05T11:35:16.863 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.860+0000 7f26f5634780 1 > prepared part key=_multipart_J5EIH25Y471T.2~48XZO2C7OXNX.2 size=1000570 2023-10-05T11:35:16.863 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.860+0000 7f26f5634780 1 > prepared multipart upload key=J5EIH25Y471T upload=48XZO2C7OXNX tag=YLBRZJJ0J68H type=write size=4146298 2023-10-05T11:35:16.865 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.862+0000 7f26f5634780 1 < suggested update operation key=8IPCP77WVVZT tag=UQWHFCFAPFP8 type=del size=4052001 2023-10-05T11:35:16.866 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.863+0000 7f26f5634780 1 > prepared operation key=6DP3UJ4CW1MO tag=WCDWII0B0Z8B type=write size=365398 2023-10-05T11:35:16.868 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.864+0000 7f26f5634780 1 < completed write operation key=WYN9BG66LA3K tag=SI8WUW04SJT5 type=write size=136853 2023-10-05T11:35:16.870 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.866+0000 7f26f5634780 1 > prepared part key=_multipart_0PWYKC7S6YJ4.2~CZ0CMICFG9MA.0 size=5070 2023-10-05T11:35:16.870 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.866+0000 7f26f5634780 1 > prepared multipart upload key=0PWYKC7S6YJ4 upload=CZ0CMICFG9MA tag=BMK7O6TPDU7Z type=write size=1053646 2023-10-05T11:35:16.871 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.868+0000 7f26f5634780 1 < completed write operation key=7W9LL5HSU3BG tag=THPGR7NWAETW type=write size=731211 2023-10-05T11:35:16.872 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.869+0000 7f26f5634780 1 > prepared operation key=NV4Q36UOLX8A tag=XTC51YVDMYWM type=write size=588196 2023-10-05T11:35:16.873 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.870+0000 7f26f5634780 1 < completed delete operation key=5OPHKTHXVN5U tag=UU8UZJ4FJ8EP type=del 2023-10-05T11:35:16.875 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.871+0000 7f26f5634780 1 > prepared operation key=9S0YW7PPSJ8G tag=9PY1SN55MKUX type=del size=1527076 2023-10-05T11:35:16.876 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.872+0000 7f26f5634780 1 < completed part key=_multipart_S3DKYDFT4IO2.2~CZOHHD5GEPS1.0 size=214564 2023-10-05T11:35:16.878 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.875+0000 7f26f5634780 1 < completed multipart upload key=S3DKYDFT4IO2 upload=CZOHHD5GEPS1 tag=ORI4KDJENYGC type=write size=1263140 2023-10-05T11:35:16.879 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.876+0000 7f26f5634780 1 > prepared operation key=AV0XKXX1IR4B tag=ZJFV4K23E1X4 type=del size=2768644 2023-10-05T11:35:16.881 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.877+0000 7f26f5634780 1 < completed delete operation key=IKCNZOTVWOC6 tag=WA9YT0YISJIJ type=del 2023-10-05T11:35:16.884 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.881+0000 7f26f5634780 1 > prepared part key=_multipart_0PWYKC7S6YJ4.2~8TDZIBAZ7Q1S.0 size=1048576 2023-10-05T11:35:16.885 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.882+0000 7f26f5634780 1 > prepared part key=_multipart_0PWYKC7S6YJ4.2~8TDZIBAZ7Q1S.1 size=1048576 2023-10-05T11:35:16.886 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.883+0000 7f26f5634780 1 > prepared part key=_multipart_0PWYKC7S6YJ4.2~8TDZIBAZ7Q1S.2 size=294913 2023-10-05T11:35:16.886 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.883+0000 7f26f5634780 1 > prepared multipart upload key=0PWYKC7S6YJ4 upload=8TDZIBAZ7Q1S tag=8OX1DO0WXY3V type=write size=3440641 2023-10-05T11:35:16.887 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.883+0000 7f26f5634780 1 < canceled part key=_multipart_MEY4SZRHU9NZ.2~7X4K76ROH9DK.0 size=439006 2023-10-05T11:35:16.888 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.885+0000 7f26f5634780 1 < canceled multipart upload key=MEY4SZRHU9NZ upload=7X4K76ROH9DK tag=KQECUHIRR2DD type=write size=1487582 2023-10-05T11:35:16.890 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.886+0000 7f26f5634780 1 > prepared operation key=MEY4SZRHU9NZ tag=4COAZHU3W36M type=del size=3276153 2023-10-05T11:35:16.892 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.889+0000 7f26f5634780 1 < suggested remove operation key=9S0YW7PPSJ8G tag=UHI6QDTN5AY0 type=del 2023-10-05T11:35:16.893 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.890+0000 7f26f5634780 1 > prepared operation key=5V0Q651D4VN2 tag=ZHZYKS9WY2OO type=write size=221891 2023-10-05T11:35:16.894 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.891+0000 7f26f5634780 1 < completed delete operation key=NV4Q36UOLX8A tag=XRKXMQWHZ3ZG type=del 2023-10-05T11:35:16.895 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:35:16.892+0000 7f26f5634780 1 > prepared operation key=S3DKYDFT4IO2 tag=NKPNQKRVRF1D type=del size=3542995 2023-10-05T11:35:16.896 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] cls_rgw_stats.simulate (9116 ms) 2023-10-05T11:35:16.896 INFO:tasks.workunit.client.0.smithi012.stdout:[----------] 1 test from cls_rgw_stats (9116 ms total) 2023-10-05T11:35:16.896 INFO:tasks.workunit.client.0.smithi012.stdout: 2023-10-05T11:35:16.896 INFO:tasks.workunit.client.0.smithi012.stdout:[----------] Global test environment tear-down 2023-10-05T11:35:17.800 INFO:tasks.workunit.client.0.smithi012.stdout:[==========] 1 test from 1 test suite ran. (11869 ms total) 2023-10-05T11:35:17.801 INFO:tasks.workunit.client.0.smithi012.stdout:[ PASSED ] 1 test. 2023-10-05T11:35:17.804 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-10-05T11:35:17.804 DEBUG:teuthology.orchestra.run.smithi012:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-10-05T11:35:17.878 INFO:tasks.workunit:Running workunits matching cls/test_cls_cmpomap.sh on client.0... 2023-10-05T11:35:17.879 INFO:tasks.workunit:Running workunit cls/test_cls_cmpomap.sh... 2023-10-05T11:35:17.879 DEBUG:teuthology.orchestra.run.smithi012:workunit test cls/test_cls_cmpomap.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=38321be854743c0d616618a9ea8aa0b1d4dbc0bf TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_cmpomap.sh 2023-10-05T11:35:17.950 INFO:tasks.workunit.client.0.smithi012.stdout:Running main() from gmock_main.cc 2023-10-05T11:35:17.951 INFO:tasks.workunit.client.0.smithi012.stdout:[==========] Running 31 tests from 1 test suite. 2023-10-05T11:35:17.951 INFO:tasks.workunit.client.0.smithi012.stdout:[----------] Global test environment set-up. 2023-10-05T11:35:19.814 INFO:tasks.workunit.client.0.smithi012.stdout:[----------] 31 tests from CmpOmap 2023-10-05T11:35:19.815 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_str 2023-10-05T11:35:19.831 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] CmpOmap.cmp_vals_noexist_str (17 ms) 2023-10-05T11:35:19.831 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_str_default 2023-10-05T11:35:19.835 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] CmpOmap.cmp_vals_noexist_str_default (4 ms) 2023-10-05T11:35:19.835 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_u64 2023-10-05T11:35:19.838 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] CmpOmap.cmp_vals_noexist_u64 (3 ms) 2023-10-05T11:35:19.838 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_u64_default 2023-10-05T11:35:19.841 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] CmpOmap.cmp_vals_noexist_u64_default (3 ms) 2023-10-05T11:35:19.842 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] CmpOmap.cmp_vals_str 2023-10-05T11:35:19.850 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] CmpOmap.cmp_vals_str (9 ms) 2023-10-05T11:35:19.850 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] CmpOmap.cmp_vals_u64 2023-10-05T11:35:19.856 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] CmpOmap.cmp_vals_u64 (6 ms) 2023-10-05T11:35:19.856 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_input 2023-10-05T11:35:19.859 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_input (3 ms) 2023-10-05T11:35:19.860 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_default 2023-10-05T11:35:19.863 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_default (4 ms) 2023-10-05T11:35:19.863 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] CmpOmap.cmp_vals_u64_empty_default 2023-10-05T11:35:20.068 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] CmpOmap.cmp_vals_u64_empty_default (205 ms) 2023-10-05T11:35:20.068 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_value 2023-10-05T11:35:20.074 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_value (6 ms) 2023-10-05T11:35:20.074 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] CmpOmap.cmp_vals_at_max_keys 2023-10-05T11:35:20.074 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] CmpOmap.cmp_vals_at_max_keys (0 ms) 2023-10-05T11:35:20.075 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] CmpOmap.cmp_vals_over_max_keys 2023-10-05T11:35:20.075 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] CmpOmap.cmp_vals_over_max_keys (1 ms) 2023-10-05T11:35:20.075 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_str 2023-10-05T11:35:20.084 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_str (9 ms) 2023-10-05T11:35:20.084 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_str_default 2023-10-05T11:35:20.091 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_str_default (7 ms) 2023-10-05T11:35:20.091 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_u64 2023-10-05T11:35:20.099 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_u64 (8 ms) 2023-10-05T11:35:20.099 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_u64_default 2023-10-05T11:35:20.106 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_u64_default (7 ms) 2023-10-05T11:35:20.106 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] CmpOmap.cmp_set_vals_str 2023-10-05T11:35:20.114 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] CmpOmap.cmp_set_vals_str (8 ms) 2023-10-05T11:35:20.115 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64 2023-10-05T11:35:20.124 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] CmpOmap.cmp_set_vals_u64 (10 ms) 2023-10-05T11:35:20.124 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64_einval 2023-10-05T11:35:20.127 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] CmpOmap.cmp_set_vals_u64_einval (3 ms) 2023-10-05T11:35:20.127 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64_eio 2023-10-05T11:35:20.130 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] CmpOmap.cmp_set_vals_u64_eio (3 ms) 2023-10-05T11:35:20.130 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] CmpOmap.cmp_set_vals_at_max_keys 2023-10-05T11:35:20.131 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] CmpOmap.cmp_set_vals_at_max_keys (1 ms) 2023-10-05T11:35:20.131 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] CmpOmap.cmp_set_vals_over_max_keys 2023-10-05T11:35:20.131 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] CmpOmap.cmp_set_vals_over_max_keys (0 ms) 2023-10-05T11:35:20.131 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] CmpOmap.cmp_rm_keys_noexist_str 2023-10-05T11:35:20.138 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] CmpOmap.cmp_rm_keys_noexist_str (7 ms) 2023-10-05T11:35:20.138 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] CmpOmap.cmp_rm_keys_noexist_u64 2023-10-05T11:35:20.144 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] CmpOmap.cmp_rm_keys_noexist_u64 (6 ms) 2023-10-05T11:35:20.144 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] CmpOmap.cmp_rm_keys_str 2023-10-05T11:35:20.152 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] CmpOmap.cmp_rm_keys_str (8 ms) 2023-10-05T11:35:20.152 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64 2023-10-05T11:35:20.161 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64 (9 ms) 2023-10-05T11:35:20.161 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_einval 2023-10-05T11:35:20.163 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_einval (2 ms) 2023-10-05T11:35:20.163 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_eio 2023-10-05T11:35:20.166 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_eio (3 ms) 2023-10-05T11:35:20.166 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] CmpOmap.cmp_rm_keys_at_max_keys 2023-10-05T11:35:20.167 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] CmpOmap.cmp_rm_keys_at_max_keys (1 ms) 2023-10-05T11:35:20.167 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] CmpOmap.cmp_rm_keys_over_max_keys 2023-10-05T11:35:20.168 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] CmpOmap.cmp_rm_keys_over_max_keys (1 ms) 2023-10-05T11:35:20.168 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_empty 2023-10-05T11:35:20.175 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_empty (7 ms) 2023-10-05T11:35:20.175 INFO:tasks.workunit.client.0.smithi012.stdout:[----------] 31 tests from CmpOmap (361 ms total) 2023-10-05T11:35:20.176 INFO:tasks.workunit.client.0.smithi012.stdout: 2023-10-05T11:35:20.176 INFO:tasks.workunit.client.0.smithi012.stdout:[----------] Global test environment tear-down 2023-10-05T11:35:20.828 INFO:tasks.workunit.client.0.smithi012.stdout:[==========] 31 tests from 1 test suite ran. (2878 ms total) 2023-10-05T11:35:20.828 INFO:tasks.workunit.client.0.smithi012.stdout:[ PASSED ] 31 tests. 2023-10-05T11:35:20.831 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-10-05T11:35:20.831 DEBUG:teuthology.orchestra.run.smithi012:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-10-05T11:35:20.909 INFO:tasks.workunit:Running workunits matching cls/test_cls_2pc_queue.sh on client.0... 2023-10-05T11:35:20.911 INFO:tasks.workunit:Running workunit cls/test_cls_2pc_queue.sh... 2023-10-05T11:35:20.912 DEBUG:teuthology.orchestra.run.smithi012:workunit test cls/test_cls_2pc_queue.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=38321be854743c0d616618a9ea8aa0b1d4dbc0bf TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_2pc_queue.sh 2023-10-05T11:35:20.982 INFO:tasks.workunit.client.0.smithi012.stdout:Running main() from gmock_main.cc 2023-10-05T11:35:20.982 INFO:tasks.workunit.client.0.smithi012.stdout:[==========] Running 22 tests from 1 test suite. 2023-10-05T11:35:20.982 INFO:tasks.workunit.client.0.smithi012.stdout:[----------] Global test environment set-up. 2023-10-05T11:35:20.982 INFO:tasks.workunit.client.0.smithi012.stdout:[----------] 22 tests from TestCls2PCQueue 2023-10-05T11:35:20.982 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] TestCls2PCQueue.GetCapacity 2023-10-05T11:35:23.851 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] TestCls2PCQueue.GetCapacity (2869 ms) 2023-10-05T11:35:23.852 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] TestCls2PCQueue.AsyncGetCapacity 2023-10-05T11:35:26.880 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] TestCls2PCQueue.AsyncGetCapacity (3029 ms) 2023-10-05T11:35:26.880 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] TestCls2PCQueue.Reserve 2023-10-05T11:35:29.901 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] TestCls2PCQueue.Reserve (3021 ms) 2023-10-05T11:35:29.901 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] TestCls2PCQueue.AsyncReserve 2023-10-05T11:35:32.928 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] TestCls2PCQueue.AsyncReserve (3027 ms) 2023-10-05T11:35:32.929 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] TestCls2PCQueue.Commit 2023-10-05T11:35:35.948 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] TestCls2PCQueue.Commit (3020 ms) 2023-10-05T11:35:35.948 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] TestCls2PCQueue.Abort 2023-10-05T11:35:38.966 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] TestCls2PCQueue.Abort (3017 ms) 2023-10-05T11:35:38.966 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] TestCls2PCQueue.ReserveError 2023-10-05T11:35:41.989 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] TestCls2PCQueue.ReserveError (3022 ms) 2023-10-05T11:35:41.989 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] TestCls2PCQueue.CommitError 2023-10-05T11:35:45.009 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] TestCls2PCQueue.CommitError (3021 ms) 2023-10-05T11:35:45.009 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] TestCls2PCQueue.AbortError 2023-10-05T11:35:48.038 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] TestCls2PCQueue.AbortError (3029 ms) 2023-10-05T11:35:48.038 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] TestCls2PCQueue.MultiReserve 2023-10-05T11:35:51.063 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] TestCls2PCQueue.MultiReserve (3025 ms) 2023-10-05T11:35:51.063 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] TestCls2PCQueue.MultiCommit 2023-10-05T11:35:54.095 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] TestCls2PCQueue.MultiCommit (3033 ms) 2023-10-05T11:35:54.095 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] TestCls2PCQueue.MultiAbort 2023-10-05T11:35:57.106 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] TestCls2PCQueue.MultiAbort (3010 ms) 2023-10-05T11:35:57.106 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] TestCls2PCQueue.ReserveCommit 2023-10-05T11:36:00.129 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] TestCls2PCQueue.ReserveCommit (3023 ms) 2023-10-05T11:36:00.187 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] TestCls2PCQueue.ReserveAbort 2023-10-05T11:36:03.148 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] TestCls2PCQueue.ReserveAbort (3020 ms) 2023-10-05T11:36:03.148 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] TestCls2PCQueue.ManualCleanup 2023-10-05T11:36:06.177 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] TestCls2PCQueue.ManualCleanup (3028 ms) 2023-10-05T11:36:06.177 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] TestCls2PCQueue.Cleanup 2023-10-05T11:36:09.186 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] TestCls2PCQueue.Cleanup (3007 ms) 2023-10-05T11:36:09.186 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] TestCls2PCQueue.MultiProducer 2023-10-05T11:36:19.628 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] TestCls2PCQueue.MultiProducer (10443 ms) 2023-10-05T11:36:19.628 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] TestCls2PCQueue.AsyncConsumer 2023-10-05T11:36:22.653 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] TestCls2PCQueue.AsyncConsumer (3027 ms) 2023-10-05T11:36:22.653 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] TestCls2PCQueue.MultiProducerConsumer 2023-10-05T11:36:34.741 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] TestCls2PCQueue.MultiProducerConsumer (12088 ms) 2023-10-05T11:36:34.741 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] TestCls2PCQueue.ReserveSpillover 2023-10-05T11:36:38.764 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] TestCls2PCQueue.ReserveSpillover (4023 ms) 2023-10-05T11:36:38.764 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] TestCls2PCQueue.CommitSpillover 2023-10-05T11:36:44.802 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] TestCls2PCQueue.CommitSpillover (6038 ms) 2023-10-05T11:36:44.803 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] TestCls2PCQueue.AbortSpillover 2023-10-05T11:36:50.626 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] TestCls2PCQueue.AbortSpillover (5823 ms) 2023-10-05T11:36:50.626 INFO:tasks.workunit.client.0.smithi012.stdout:[----------] 22 tests from TestCls2PCQueue (89643 ms total) 2023-10-05T11:36:50.627 INFO:tasks.workunit.client.0.smithi012.stdout: 2023-10-05T11:36:50.627 INFO:tasks.workunit.client.0.smithi012.stdout:[----------] Global test environment tear-down 2023-10-05T11:36:50.627 INFO:tasks.workunit.client.0.smithi012.stdout:[==========] 22 tests from 1 test suite ran. (89643 ms total) 2023-10-05T11:36:50.627 INFO:tasks.workunit.client.0.smithi012.stdout:[ PASSED ] 22 tests. 2023-10-05T11:36:50.629 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-10-05T11:36:50.629 DEBUG:teuthology.orchestra.run.smithi012:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-10-05T11:36:50.704 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_gc_log.sh on client.0... 2023-10-05T11:36:50.705 INFO:tasks.workunit:Running workunit rgw/test_rgw_gc_log.sh... 2023-10-05T11:36:50.705 DEBUG:teuthology.orchestra.run.smithi012:workunit test rgw/test_rgw_gc_log.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=38321be854743c0d616618a9ea8aa0b1d4dbc0bf TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_gc_log.sh 2023-10-05T11:36:50.786 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setuser ceph since I am not root 2023-10-05T11:36:50.786 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T11:36:50.787 INFO:tasks.workunit.client.0.smithi012.stdout:[==========] Running 6 tests from 1 test suite. 2023-10-05T11:36:50.787 INFO:tasks.workunit.client.0.smithi012.stdout:[----------] Global test environment set-up. 2023-10-05T11:36:52.628 INFO:tasks.workunit.client.0.smithi012.stdout:[----------] 6 tests from rgw_gc_log 2023-10-05T11:36:52.628 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] rgw_gc_log.init_existing_queue 2023-10-05T11:36:52.647 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] rgw_gc_log.init_existing_queue (20 ms) 2023-10-05T11:36:52.647 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] rgw_gc_log.init_existing_omap 2023-10-05T11:36:52.650 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] rgw_gc_log.init_existing_omap (3 ms) 2023-10-05T11:36:52.650 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] rgw_gc_log.enqueue1_after_init 2023-10-05T11:36:52.652 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] rgw_gc_log.enqueue1_after_init (2 ms) 2023-10-05T11:36:52.652 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] rgw_gc_log.enqueue2_before_init 2023-10-05T11:36:52.654 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] rgw_gc_log.enqueue2_before_init (2 ms) 2023-10-05T11:36:52.654 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] rgw_gc_log.defer1_after_init 2023-10-05T11:36:52.657 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] rgw_gc_log.defer1_after_init (3 ms) 2023-10-05T11:36:52.657 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] rgw_gc_log.defer2_before_init 2023-10-05T11:36:52.659 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] rgw_gc_log.defer2_before_init (2 ms) 2023-10-05T11:36:52.659 INFO:tasks.workunit.client.0.smithi012.stdout:[----------] 6 tests from rgw_gc_log (32 ms total) 2023-10-05T11:36:52.659 INFO:tasks.workunit.client.0.smithi012.stdout: 2023-10-05T11:36:52.659 INFO:tasks.workunit.client.0.smithi012.stdout:[----------] Global test environment tear-down 2023-10-05T11:36:53.644 INFO:tasks.workunit.client.0.smithi012.stdout:[==========] 6 tests from 1 test suite ran. (2857 ms total) 2023-10-05T11:36:53.644 INFO:tasks.workunit.client.0.smithi012.stdout:[ PASSED ] 6 tests. 2023-10-05T11:36:53.647 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-10-05T11:36:53.647 DEBUG:teuthology.orchestra.run.smithi012:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-10-05T11:36:53.722 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_obj.sh on client.0... 2023-10-05T11:36:53.723 INFO:tasks.workunit:Running workunit rgw/test_rgw_obj.sh... 2023-10-05T11:36:53.723 DEBUG:teuthology.orchestra.run.smithi012:workunit test rgw/test_rgw_obj.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=38321be854743c0d616618a9ea8aa0b1d4dbc0bf TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_obj.sh 2023-10-05T11:36:53.810 INFO:tasks.workunit.client.0.smithi012.stdout:Running main() from gmock_main.cc 2023-10-05T11:36:53.810 INFO:tasks.workunit.client.0.smithi012.stdout:[==========] Running 4 tests from 1 test suite. 2023-10-05T11:36:53.810 INFO:tasks.workunit.client.0.smithi012.stdout:[----------] Global test environment set-up. 2023-10-05T11:36:53.810 INFO:tasks.workunit.client.0.smithi012.stdout:[----------] 4 tests from TestRGWObj 2023-10-05T11:36:53.810 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] TestRGWObj.underscore 2023-10-05T11:36:53.810 INFO:tasks.workunit.client.0.smithi012.stdout:parsed: _obj 2023-10-05T11:36:53.810 INFO:tasks.workunit.client.0.smithi012.stdout:parsed: _obj 2023-10-05T11:36:53.811 INFO:tasks.workunit.client.0.smithi012.stdout:stripped: _obj ns= i= 2023-10-05T11:36:53.811 INFO:tasks.workunit.client.0.smithi012.stdout:parsed: _obj 2023-10-05T11:36:53.811 INFO:tasks.workunit.client.0.smithi012.stdout:parsed: _obj 2023-10-05T11:36:53.811 INFO:tasks.workunit.client.0.smithi012.stdout:stripped: _obj ns= i= 2023-10-05T11:36:53.811 INFO:tasks.workunit.client.0.smithi012.stdout:parsed: _obj 2023-10-05T11:36:53.811 INFO:tasks.workunit.client.0.smithi012.stdout:parsed: _obj 2023-10-05T11:36:53.811 INFO:tasks.workunit.client.0.smithi012.stdout:stripped: _obj ns= i= 2023-10-05T11:36:53.811 INFO:tasks.workunit.client.0.smithi012.stdout:{ 2023-10-05T11:36:53.811 INFO:tasks.workunit.client.0.smithi012.stdout: "obj1": { 2023-10-05T11:36:53.812 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket": { 2023-10-05T11:36:53.812 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "test", 2023-10-05T11:36:53.812 INFO:tasks.workunit.client.0.smithi012.stdout: "marker": "marker", 2023-10-05T11:36:53.812 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket_id": "bucket-id", 2023-10-05T11:36:53.812 INFO:tasks.workunit.client.0.smithi012.stdout: "tenant": "", 2023-10-05T11:36:53.812 INFO:tasks.workunit.client.0.smithi012.stdout: "explicit_placement": { 2023-10-05T11:36:53.812 INFO:tasks.workunit.client.0.smithi012.stdout: "data_pool": "", 2023-10-05T11:36:53.812 INFO:tasks.workunit.client.0.smithi012.stdout: "data_extra_pool": "", 2023-10-05T11:36:53.812 INFO:tasks.workunit.client.0.smithi012.stdout: "index_pool": "" 2023-10-05T11:36:53.812 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.813 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2023-10-05T11:36:53.813 INFO:tasks.workunit.client.0.smithi012.stdout: "key": { 2023-10-05T11:36:53.813 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "_obj", 2023-10-05T11:36:53.813 INFO:tasks.workunit.client.0.smithi012.stdout: "instance": "", 2023-10-05T11:36:53.813 INFO:tasks.workunit.client.0.smithi012.stdout: "ns": "" 2023-10-05T11:36:53.813 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.813 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2023-10-05T11:36:53.813 INFO:tasks.workunit.client.0.smithi012.stdout: "obj2": { 2023-10-05T11:36:53.813 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket": { 2023-10-05T11:36:53.814 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "test", 2023-10-05T11:36:53.814 INFO:tasks.workunit.client.0.smithi012.stdout: "marker": "marker", 2023-10-05T11:36:53.814 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket_id": "bucket-id", 2023-10-05T11:36:53.814 INFO:tasks.workunit.client.0.smithi012.stdout: "tenant": "", 2023-10-05T11:36:53.814 INFO:tasks.workunit.client.0.smithi012.stdout: "explicit_placement": { 2023-10-05T11:36:53.814 INFO:tasks.workunit.client.0.smithi012.stdout: "data_pool": "", 2023-10-05T11:36:53.814 INFO:tasks.workunit.client.0.smithi012.stdout: "data_extra_pool": "", 2023-10-05T11:36:53.814 INFO:tasks.workunit.client.0.smithi012.stdout: "index_pool": "" 2023-10-05T11:36:53.815 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.815 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2023-10-05T11:36:53.815 INFO:tasks.workunit.client.0.smithi012.stdout: "key": { 2023-10-05T11:36:53.815 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "_obj", 2023-10-05T11:36:53.815 INFO:tasks.workunit.client.0.smithi012.stdout: "instance": "", 2023-10-05T11:36:53.815 INFO:tasks.workunit.client.0.smithi012.stdout: "ns": "" 2023-10-05T11:36:53.815 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.815 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2023-10-05T11:36:53.815 INFO:tasks.workunit.client.0.smithi012.stdout: "obj3": { 2023-10-05T11:36:53.815 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket": { 2023-10-05T11:36:53.815 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "test", 2023-10-05T11:36:53.816 INFO:tasks.workunit.client.0.smithi012.stdout: "marker": "marker", 2023-10-05T11:36:53.816 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket_id": "bucket-id", 2023-10-05T11:36:53.816 INFO:tasks.workunit.client.0.smithi012.stdout: "tenant": "", 2023-10-05T11:36:53.816 INFO:tasks.workunit.client.0.smithi012.stdout: "explicit_placement": { 2023-10-05T11:36:53.816 INFO:tasks.workunit.client.0.smithi012.stdout: "data_pool": "", 2023-10-05T11:36:53.816 INFO:tasks.workunit.client.0.smithi012.stdout: "data_extra_pool": "", 2023-10-05T11:36:53.816 INFO:tasks.workunit.client.0.smithi012.stdout: "index_pool": "" 2023-10-05T11:36:53.816 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.816 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2023-10-05T11:36:53.816 INFO:tasks.workunit.client.0.smithi012.stdout: "key": { 2023-10-05T11:36:53.816 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "_obj", 2023-10-05T11:36:53.816 INFO:tasks.workunit.client.0.smithi012.stdout: "instance": "", 2023-10-05T11:36:53.817 INFO:tasks.workunit.client.0.smithi012.stdout: "ns": "" 2023-10-05T11:36:53.817 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.817 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2023-10-05T11:36:53.817 INFO:tasks.workunit.client.0.smithi012.stdout: "obj3-2": { 2023-10-05T11:36:53.817 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket": { 2023-10-05T11:36:53.817 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "test", 2023-10-05T11:36:53.817 INFO:tasks.workunit.client.0.smithi012.stdout: "marker": "marker", 2023-10-05T11:36:53.817 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket_id": "bucket-id", 2023-10-05T11:36:53.817 INFO:tasks.workunit.client.0.smithi012.stdout: "tenant": "", 2023-10-05T11:36:53.817 INFO:tasks.workunit.client.0.smithi012.stdout: "explicit_placement": { 2023-10-05T11:36:53.818 INFO:tasks.workunit.client.0.smithi012.stdout: "data_pool": "", 2023-10-05T11:36:53.818 INFO:tasks.workunit.client.0.smithi012.stdout: "data_extra_pool": "", 2023-10-05T11:36:53.818 INFO:tasks.workunit.client.0.smithi012.stdout: "index_pool": "" 2023-10-05T11:36:53.818 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.818 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2023-10-05T11:36:53.818 INFO:tasks.workunit.client.0.smithi012.stdout: "key": { 2023-10-05T11:36:53.818 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "_obj", 2023-10-05T11:36:53.818 INFO:tasks.workunit.client.0.smithi012.stdout: "instance": "", 2023-10-05T11:36:53.819 INFO:tasks.workunit.client.0.smithi012.stdout: "ns": "" 2023-10-05T11:36:53.819 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.819 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.819 INFO:tasks.workunit.client.0.smithi012.stdout:} 2023-10-05T11:36:53.819 INFO:tasks.workunit.client.0.smithi012.stdout:parsed: _obj 2023-10-05T11:36:53.819 INFO:tasks.workunit.client.0.smithi012.stdout:parsed: _obj 2023-10-05T11:36:53.819 INFO:tasks.workunit.client.0.smithi012.stdout:stripped: _obj ns=ns i= 2023-10-05T11:36:53.819 INFO:tasks.workunit.client.0.smithi012.stdout:parsed: _obj 2023-10-05T11:36:53.819 INFO:tasks.workunit.client.0.smithi012.stdout:parsed: _obj 2023-10-05T11:36:53.819 INFO:tasks.workunit.client.0.smithi012.stdout:stripped: _obj ns=ns i= 2023-10-05T11:36:53.819 INFO:tasks.workunit.client.0.smithi012.stdout:parsed: _obj 2023-10-05T11:36:53.820 INFO:tasks.workunit.client.0.smithi012.stdout:parsed: _obj 2023-10-05T11:36:53.820 INFO:tasks.workunit.client.0.smithi012.stdout:stripped: _obj ns=ns i= 2023-10-05T11:36:53.820 INFO:tasks.workunit.client.0.smithi012.stdout:{ 2023-10-05T11:36:53.820 INFO:tasks.workunit.client.0.smithi012.stdout: "obj1": { 2023-10-05T11:36:53.820 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket": { 2023-10-05T11:36:53.820 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "test", 2023-10-05T11:36:53.820 INFO:tasks.workunit.client.0.smithi012.stdout: "marker": "marker", 2023-10-05T11:36:53.820 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket_id": "bucket-id", 2023-10-05T11:36:53.820 INFO:tasks.workunit.client.0.smithi012.stdout: "tenant": "", 2023-10-05T11:36:53.820 INFO:tasks.workunit.client.0.smithi012.stdout: "explicit_placement": { 2023-10-05T11:36:53.820 INFO:tasks.workunit.client.0.smithi012.stdout: "data_pool": "", 2023-10-05T11:36:53.820 INFO:tasks.workunit.client.0.smithi012.stdout: "data_extra_pool": "", 2023-10-05T11:36:53.821 INFO:tasks.workunit.client.0.smithi012.stdout: "index_pool": "" 2023-10-05T11:36:53.821 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.821 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2023-10-05T11:36:53.821 INFO:tasks.workunit.client.0.smithi012.stdout: "key": { 2023-10-05T11:36:53.821 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "_obj", 2023-10-05T11:36:53.821 INFO:tasks.workunit.client.0.smithi012.stdout: "instance": "", 2023-10-05T11:36:53.821 INFO:tasks.workunit.client.0.smithi012.stdout: "ns": "ns" 2023-10-05T11:36:53.821 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.821 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2023-10-05T11:36:53.821 INFO:tasks.workunit.client.0.smithi012.stdout: "obj2": { 2023-10-05T11:36:53.822 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket": { 2023-10-05T11:36:53.822 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "test", 2023-10-05T11:36:53.822 INFO:tasks.workunit.client.0.smithi012.stdout: "marker": "marker", 2023-10-05T11:36:53.822 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket_id": "bucket-id", 2023-10-05T11:36:53.822 INFO:tasks.workunit.client.0.smithi012.stdout: "tenant": "", 2023-10-05T11:36:53.822 INFO:tasks.workunit.client.0.smithi012.stdout: "explicit_placement": { 2023-10-05T11:36:53.822 INFO:tasks.workunit.client.0.smithi012.stdout: "data_pool": "", 2023-10-05T11:36:53.822 INFO:tasks.workunit.client.0.smithi012.stdout: "data_extra_pool": "", 2023-10-05T11:36:53.823 INFO:tasks.workunit.client.0.smithi012.stdout: "index_pool": "" 2023-10-05T11:36:53.823 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.823 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2023-10-05T11:36:53.823 INFO:tasks.workunit.client.0.smithi012.stdout: "key": { 2023-10-05T11:36:53.823 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "_obj", 2023-10-05T11:36:53.823 INFO:tasks.workunit.client.0.smithi012.stdout: "instance": "", 2023-10-05T11:36:53.824 INFO:tasks.workunit.client.0.smithi012.stdout: "ns": "ns" 2023-10-05T11:36:53.824 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.824 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2023-10-05T11:36:53.824 INFO:tasks.workunit.client.0.smithi012.stdout: "obj3": { 2023-10-05T11:36:53.824 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket": { 2023-10-05T11:36:53.824 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "test", 2023-10-05T11:36:53.825 INFO:tasks.workunit.client.0.smithi012.stdout: "marker": "marker", 2023-10-05T11:36:53.825 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket_id": "bucket-id", 2023-10-05T11:36:53.825 INFO:tasks.workunit.client.0.smithi012.stdout: "tenant": "", 2023-10-05T11:36:53.825 INFO:tasks.workunit.client.0.smithi012.stdout: "explicit_placement": { 2023-10-05T11:36:53.825 INFO:tasks.workunit.client.0.smithi012.stdout: "data_pool": "", 2023-10-05T11:36:53.825 INFO:tasks.workunit.client.0.smithi012.stdout: "data_extra_pool": "", 2023-10-05T11:36:53.825 INFO:tasks.workunit.client.0.smithi012.stdout: "index_pool": "" 2023-10-05T11:36:53.825 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.826 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2023-10-05T11:36:53.826 INFO:tasks.workunit.client.0.smithi012.stdout: "key": { 2023-10-05T11:36:53.826 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "_obj", 2023-10-05T11:36:53.826 INFO:tasks.workunit.client.0.smithi012.stdout: "instance": "", 2023-10-05T11:36:53.826 INFO:tasks.workunit.client.0.smithi012.stdout: "ns": "" 2023-10-05T11:36:53.826 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.826 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2023-10-05T11:36:53.827 INFO:tasks.workunit.client.0.smithi012.stdout: "obj3-2": { 2023-10-05T11:36:53.827 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket": { 2023-10-05T11:36:53.827 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "test", 2023-10-05T11:36:53.827 INFO:tasks.workunit.client.0.smithi012.stdout: "marker": "marker", 2023-10-05T11:36:53.827 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket_id": "bucket-id", 2023-10-05T11:36:53.827 INFO:tasks.workunit.client.0.smithi012.stdout: "tenant": "", 2023-10-05T11:36:53.827 INFO:tasks.workunit.client.0.smithi012.stdout: "explicit_placement": { 2023-10-05T11:36:53.827 INFO:tasks.workunit.client.0.smithi012.stdout: "data_pool": "", 2023-10-05T11:36:53.828 INFO:tasks.workunit.client.0.smithi012.stdout: "data_extra_pool": "", 2023-10-05T11:36:53.828 INFO:tasks.workunit.client.0.smithi012.stdout: "index_pool": "" 2023-10-05T11:36:53.828 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.828 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2023-10-05T11:36:53.828 INFO:tasks.workunit.client.0.smithi012.stdout: "key": { 2023-10-05T11:36:53.828 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "_obj", 2023-10-05T11:36:53.828 INFO:tasks.workunit.client.0.smithi012.stdout: "instance": "", 2023-10-05T11:36:53.829 INFO:tasks.workunit.client.0.smithi012.stdout: "ns": "ns" 2023-10-05T11:36:53.829 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.829 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.829 INFO:tasks.workunit.client.0.smithi012.stdout:} 2023-10-05T11:36:53.829 INFO:tasks.workunit.client.0.smithi012.stdout:parsed: _obj[v1] 2023-10-05T11:36:53.829 INFO:tasks.workunit.client.0.smithi012.stdout:parsed: _obj[v1] 2023-10-05T11:36:53.830 INFO:tasks.workunit.client.0.smithi012.stdout:stripped: _obj ns= i=v1 2023-10-05T11:36:53.830 INFO:tasks.workunit.client.0.smithi012.stdout:parsed: _obj[v1] 2023-10-05T11:36:53.830 INFO:tasks.workunit.client.0.smithi012.stdout:parsed: _obj[v1] 2023-10-05T11:36:53.830 INFO:tasks.workunit.client.0.smithi012.stdout:stripped: _obj ns= i=v1 2023-10-05T11:36:53.830 INFO:tasks.workunit.client.0.smithi012.stdout:parsed: _obj[v1] 2023-10-05T11:36:53.830 INFO:tasks.workunit.client.0.smithi012.stdout:parsed: _obj[v1] 2023-10-05T11:36:53.830 INFO:tasks.workunit.client.0.smithi012.stdout:stripped: _obj ns= i=v1 2023-10-05T11:36:53.831 INFO:tasks.workunit.client.0.smithi012.stdout:{ 2023-10-05T11:36:53.831 INFO:tasks.workunit.client.0.smithi012.stdout: "obj1": { 2023-10-05T11:36:53.831 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket": { 2023-10-05T11:36:53.831 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "test", 2023-10-05T11:36:53.831 INFO:tasks.workunit.client.0.smithi012.stdout: "marker": "marker", 2023-10-05T11:36:53.831 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket_id": "bucket-id", 2023-10-05T11:36:53.832 INFO:tasks.workunit.client.0.smithi012.stdout: "tenant": "", 2023-10-05T11:36:53.832 INFO:tasks.workunit.client.0.smithi012.stdout: "explicit_placement": { 2023-10-05T11:36:53.832 INFO:tasks.workunit.client.0.smithi012.stdout: "data_pool": "", 2023-10-05T11:36:53.832 INFO:tasks.workunit.client.0.smithi012.stdout: "data_extra_pool": "", 2023-10-05T11:36:53.832 INFO:tasks.workunit.client.0.smithi012.stdout: "index_pool": "" 2023-10-05T11:36:53.832 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.832 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2023-10-05T11:36:53.832 INFO:tasks.workunit.client.0.smithi012.stdout: "key": { 2023-10-05T11:36:53.832 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "_obj", 2023-10-05T11:36:53.832 INFO:tasks.workunit.client.0.smithi012.stdout: "instance": "v1", 2023-10-05T11:36:53.832 INFO:tasks.workunit.client.0.smithi012.stdout: "ns": "" 2023-10-05T11:36:53.832 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.833 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2023-10-05T11:36:53.833 INFO:tasks.workunit.client.0.smithi012.stdout: "obj2": { 2023-10-05T11:36:53.833 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket": { 2023-10-05T11:36:53.833 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "test", 2023-10-05T11:36:53.833 INFO:tasks.workunit.client.0.smithi012.stdout: "marker": "marker", 2023-10-05T11:36:53.833 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket_id": "bucket-id", 2023-10-05T11:36:53.833 INFO:tasks.workunit.client.0.smithi012.stdout: "tenant": "", 2023-10-05T11:36:53.833 INFO:tasks.workunit.client.0.smithi012.stdout: "explicit_placement": { 2023-10-05T11:36:53.833 INFO:tasks.workunit.client.0.smithi012.stdout: "data_pool": "", 2023-10-05T11:36:53.833 INFO:tasks.workunit.client.0.smithi012.stdout: "data_extra_pool": "", 2023-10-05T11:36:53.833 INFO:tasks.workunit.client.0.smithi012.stdout: "index_pool": "" 2023-10-05T11:36:53.834 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.834 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2023-10-05T11:36:53.834 INFO:tasks.workunit.client.0.smithi012.stdout: "key": { 2023-10-05T11:36:53.834 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "_obj", 2023-10-05T11:36:53.834 INFO:tasks.workunit.client.0.smithi012.stdout: "instance": "v1", 2023-10-05T11:36:53.834 INFO:tasks.workunit.client.0.smithi012.stdout: "ns": "" 2023-10-05T11:36:53.834 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.834 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2023-10-05T11:36:53.835 INFO:tasks.workunit.client.0.smithi012.stdout: "obj3": { 2023-10-05T11:36:53.835 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket": { 2023-10-05T11:36:53.835 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "test", 2023-10-05T11:36:53.835 INFO:tasks.workunit.client.0.smithi012.stdout: "marker": "marker", 2023-10-05T11:36:53.835 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket_id": "bucket-id", 2023-10-05T11:36:53.835 INFO:tasks.workunit.client.0.smithi012.stdout: "tenant": "", 2023-10-05T11:36:53.835 INFO:tasks.workunit.client.0.smithi012.stdout: "explicit_placement": { 2023-10-05T11:36:53.835 INFO:tasks.workunit.client.0.smithi012.stdout: "data_pool": "", 2023-10-05T11:36:53.835 INFO:tasks.workunit.client.0.smithi012.stdout: "data_extra_pool": "", 2023-10-05T11:36:53.835 INFO:tasks.workunit.client.0.smithi012.stdout: "index_pool": "" 2023-10-05T11:36:53.835 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.836 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2023-10-05T11:36:53.836 INFO:tasks.workunit.client.0.smithi012.stdout: "key": { 2023-10-05T11:36:53.836 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "_obj", 2023-10-05T11:36:53.836 INFO:tasks.workunit.client.0.smithi012.stdout: "instance": "", 2023-10-05T11:36:53.836 INFO:tasks.workunit.client.0.smithi012.stdout: "ns": "" 2023-10-05T11:36:53.836 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.836 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2023-10-05T11:36:53.836 INFO:tasks.workunit.client.0.smithi012.stdout: "obj3-2": { 2023-10-05T11:36:53.837 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket": { 2023-10-05T11:36:53.837 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "test", 2023-10-05T11:36:53.837 INFO:tasks.workunit.client.0.smithi012.stdout: "marker": "marker", 2023-10-05T11:36:53.837 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket_id": "bucket-id", 2023-10-05T11:36:53.837 INFO:tasks.workunit.client.0.smithi012.stdout: "tenant": "", 2023-10-05T11:36:53.837 INFO:tasks.workunit.client.0.smithi012.stdout: "explicit_placement": { 2023-10-05T11:36:53.837 INFO:tasks.workunit.client.0.smithi012.stdout: "data_pool": "", 2023-10-05T11:36:53.837 INFO:tasks.workunit.client.0.smithi012.stdout: "data_extra_pool": "", 2023-10-05T11:36:53.837 INFO:tasks.workunit.client.0.smithi012.stdout: "index_pool": "" 2023-10-05T11:36:53.837 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.838 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2023-10-05T11:36:53.838 INFO:tasks.workunit.client.0.smithi012.stdout: "key": { 2023-10-05T11:36:53.838 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "_obj", 2023-10-05T11:36:53.838 INFO:tasks.workunit.client.0.smithi012.stdout: "instance": "v1", 2023-10-05T11:36:53.838 INFO:tasks.workunit.client.0.smithi012.stdout: "ns": "" 2023-10-05T11:36:53.838 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.838 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.838 INFO:tasks.workunit.client.0.smithi012.stdout:} 2023-10-05T11:36:53.838 INFO:tasks.workunit.client.0.smithi012.stdout:parsed: _obj[v1] 2023-10-05T11:36:53.838 INFO:tasks.workunit.client.0.smithi012.stdout:parsed: _obj[v1] 2023-10-05T11:36:53.838 INFO:tasks.workunit.client.0.smithi012.stdout:stripped: _obj ns=ns i=v1 2023-10-05T11:36:53.839 INFO:tasks.workunit.client.0.smithi012.stdout:parsed: _obj[v1] 2023-10-05T11:36:53.839 INFO:tasks.workunit.client.0.smithi012.stdout:parsed: _obj[v1] 2023-10-05T11:36:53.839 INFO:tasks.workunit.client.0.smithi012.stdout:stripped: _obj ns=ns i=v1 2023-10-05T11:36:53.839 INFO:tasks.workunit.client.0.smithi012.stdout:parsed: _obj[v1] 2023-10-05T11:36:53.839 INFO:tasks.workunit.client.0.smithi012.stdout:parsed: _obj[v1] 2023-10-05T11:36:53.839 INFO:tasks.workunit.client.0.smithi012.stdout:stripped: _obj ns=ns i=v1 2023-10-05T11:36:53.839 INFO:tasks.workunit.client.0.smithi012.stdout:{ 2023-10-05T11:36:53.839 INFO:tasks.workunit.client.0.smithi012.stdout: "obj1": { 2023-10-05T11:36:53.839 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket": { 2023-10-05T11:36:53.839 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "test", 2023-10-05T11:36:53.839 INFO:tasks.workunit.client.0.smithi012.stdout: "marker": "marker", 2023-10-05T11:36:53.840 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket_id": "bucket-id", 2023-10-05T11:36:53.840 INFO:tasks.workunit.client.0.smithi012.stdout: "tenant": "", 2023-10-05T11:36:53.840 INFO:tasks.workunit.client.0.smithi012.stdout: "explicit_placement": { 2023-10-05T11:36:53.840 INFO:tasks.workunit.client.0.smithi012.stdout: "data_pool": "", 2023-10-05T11:36:53.840 INFO:tasks.workunit.client.0.smithi012.stdout: "data_extra_pool": "", 2023-10-05T11:36:53.840 INFO:tasks.workunit.client.0.smithi012.stdout: "index_pool": "" 2023-10-05T11:36:53.840 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.840 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2023-10-05T11:36:53.840 INFO:tasks.workunit.client.0.smithi012.stdout: "key": { 2023-10-05T11:36:53.840 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "_obj", 2023-10-05T11:36:53.840 INFO:tasks.workunit.client.0.smithi012.stdout: "instance": "v1", 2023-10-05T11:36:53.840 INFO:tasks.workunit.client.0.smithi012.stdout: "ns": "ns" 2023-10-05T11:36:53.841 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.841 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2023-10-05T11:36:53.841 INFO:tasks.workunit.client.0.smithi012.stdout: "obj2": { 2023-10-05T11:36:53.841 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket": { 2023-10-05T11:36:53.841 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "test", 2023-10-05T11:36:53.841 INFO:tasks.workunit.client.0.smithi012.stdout: "marker": "marker", 2023-10-05T11:36:53.841 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket_id": "bucket-id", 2023-10-05T11:36:53.841 INFO:tasks.workunit.client.0.smithi012.stdout: "tenant": "", 2023-10-05T11:36:53.841 INFO:tasks.workunit.client.0.smithi012.stdout: "explicit_placement": { 2023-10-05T11:36:53.841 INFO:tasks.workunit.client.0.smithi012.stdout: "data_pool": "", 2023-10-05T11:36:53.841 INFO:tasks.workunit.client.0.smithi012.stdout: "data_extra_pool": "", 2023-10-05T11:36:53.841 INFO:tasks.workunit.client.0.smithi012.stdout: "index_pool": "" 2023-10-05T11:36:53.842 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.842 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2023-10-05T11:36:53.842 INFO:tasks.workunit.client.0.smithi012.stdout: "key": { 2023-10-05T11:36:53.842 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "_obj", 2023-10-05T11:36:53.842 INFO:tasks.workunit.client.0.smithi012.stdout: "instance": "v1", 2023-10-05T11:36:53.842 INFO:tasks.workunit.client.0.smithi012.stdout: "ns": "ns" 2023-10-05T11:36:53.842 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.842 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2023-10-05T11:36:53.842 INFO:tasks.workunit.client.0.smithi012.stdout: "obj3": { 2023-10-05T11:36:53.843 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket": { 2023-10-05T11:36:53.843 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "test", 2023-10-05T11:36:53.843 INFO:tasks.workunit.client.0.smithi012.stdout: "marker": "marker", 2023-10-05T11:36:53.843 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket_id": "bucket-id", 2023-10-05T11:36:53.843 INFO:tasks.workunit.client.0.smithi012.stdout: "tenant": "", 2023-10-05T11:36:53.843 INFO:tasks.workunit.client.0.smithi012.stdout: "explicit_placement": { 2023-10-05T11:36:53.843 INFO:tasks.workunit.client.0.smithi012.stdout: "data_pool": "", 2023-10-05T11:36:53.843 INFO:tasks.workunit.client.0.smithi012.stdout: "data_extra_pool": "", 2023-10-05T11:36:53.844 INFO:tasks.workunit.client.0.smithi012.stdout: "index_pool": "" 2023-10-05T11:36:53.844 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.844 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2023-10-05T11:36:53.844 INFO:tasks.workunit.client.0.smithi012.stdout: "key": { 2023-10-05T11:36:53.844 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "_obj", 2023-10-05T11:36:53.844 INFO:tasks.workunit.client.0.smithi012.stdout: "instance": "", 2023-10-05T11:36:53.845 INFO:tasks.workunit.client.0.smithi012.stdout: "ns": "" 2023-10-05T11:36:53.845 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.845 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2023-10-05T11:36:53.845 INFO:tasks.workunit.client.0.smithi012.stdout: "obj3-2": { 2023-10-05T11:36:53.845 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket": { 2023-10-05T11:36:53.845 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "test", 2023-10-05T11:36:53.846 INFO:tasks.workunit.client.0.smithi012.stdout: "marker": "marker", 2023-10-05T11:36:53.846 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket_id": "bucket-id", 2023-10-05T11:36:53.846 INFO:tasks.workunit.client.0.smithi012.stdout: "tenant": "", 2023-10-05T11:36:53.846 INFO:tasks.workunit.client.0.smithi012.stdout: "explicit_placement": { 2023-10-05T11:36:53.846 INFO:tasks.workunit.client.0.smithi012.stdout: "data_pool": "", 2023-10-05T11:36:53.847 INFO:tasks.workunit.client.0.smithi012.stdout: "data_extra_pool": "", 2023-10-05T11:36:53.847 INFO:tasks.workunit.client.0.smithi012.stdout: "index_pool": "" 2023-10-05T11:36:53.847 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.847 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2023-10-05T11:36:53.847 INFO:tasks.workunit.client.0.smithi012.stdout: "key": { 2023-10-05T11:36:53.847 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "_obj", 2023-10-05T11:36:53.848 INFO:tasks.workunit.client.0.smithi012.stdout: "instance": "v1", 2023-10-05T11:36:53.848 INFO:tasks.workunit.client.0.smithi012.stdout: "ns": "ns" 2023-10-05T11:36:53.848 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.848 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.848 INFO:tasks.workunit.client.0.smithi012.stdout:} 2023-10-05T11:36:53.848 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] TestRGWObj.underscore (0 ms) 2023-10-05T11:36:53.848 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] TestRGWObj.no_underscore 2023-10-05T11:36:53.849 INFO:tasks.workunit.client.0.smithi012.stdout:parsed: obj 2023-10-05T11:36:53.849 INFO:tasks.workunit.client.0.smithi012.stdout:parsed: obj 2023-10-05T11:36:53.849 INFO:tasks.workunit.client.0.smithi012.stdout:stripped: obj ns= i= 2023-10-05T11:36:53.849 INFO:tasks.workunit.client.0.smithi012.stdout:parsed: obj 2023-10-05T11:36:53.849 INFO:tasks.workunit.client.0.smithi012.stdout:parsed: obj 2023-10-05T11:36:53.849 INFO:tasks.workunit.client.0.smithi012.stdout:stripped: obj ns= i= 2023-10-05T11:36:53.849 INFO:tasks.workunit.client.0.smithi012.stdout:parsed: obj 2023-10-05T11:36:53.849 INFO:tasks.workunit.client.0.smithi012.stdout:parsed: obj 2023-10-05T11:36:53.850 INFO:tasks.workunit.client.0.smithi012.stdout:stripped: obj ns= i= 2023-10-05T11:36:53.850 INFO:tasks.workunit.client.0.smithi012.stdout:{ 2023-10-05T11:36:53.850 INFO:tasks.workunit.client.0.smithi012.stdout: "obj1": { 2023-10-05T11:36:53.850 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket": { 2023-10-05T11:36:53.850 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "test", 2023-10-05T11:36:53.850 INFO:tasks.workunit.client.0.smithi012.stdout: "marker": "marker", 2023-10-05T11:36:53.851 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket_id": "bucket-id", 2023-10-05T11:36:53.851 INFO:tasks.workunit.client.0.smithi012.stdout: "tenant": "", 2023-10-05T11:36:53.851 INFO:tasks.workunit.client.0.smithi012.stdout: "explicit_placement": { 2023-10-05T11:36:53.851 INFO:tasks.workunit.client.0.smithi012.stdout: "data_pool": "", 2023-10-05T11:36:53.851 INFO:tasks.workunit.client.0.smithi012.stdout: "data_extra_pool": "", 2023-10-05T11:36:53.851 INFO:tasks.workunit.client.0.smithi012.stdout: "index_pool": "" 2023-10-05T11:36:53.851 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.851 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2023-10-05T11:36:53.852 INFO:tasks.workunit.client.0.smithi012.stdout: "key": { 2023-10-05T11:36:53.852 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "obj", 2023-10-05T11:36:53.852 INFO:tasks.workunit.client.0.smithi012.stdout: "instance": "", 2023-10-05T11:36:53.852 INFO:tasks.workunit.client.0.smithi012.stdout: "ns": "" 2023-10-05T11:36:53.852 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.852 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2023-10-05T11:36:53.852 INFO:tasks.workunit.client.0.smithi012.stdout: "obj2": { 2023-10-05T11:36:53.852 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket": { 2023-10-05T11:36:53.852 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "test", 2023-10-05T11:36:53.852 INFO:tasks.workunit.client.0.smithi012.stdout: "marker": "marker", 2023-10-05T11:36:53.852 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket_id": "bucket-id", 2023-10-05T11:36:53.852 INFO:tasks.workunit.client.0.smithi012.stdout: "tenant": "", 2023-10-05T11:36:53.853 INFO:tasks.workunit.client.0.smithi012.stdout: "explicit_placement": { 2023-10-05T11:36:53.853 INFO:tasks.workunit.client.0.smithi012.stdout: "data_pool": "", 2023-10-05T11:36:53.853 INFO:tasks.workunit.client.0.smithi012.stdout: "data_extra_pool": "", 2023-10-05T11:36:53.853 INFO:tasks.workunit.client.0.smithi012.stdout: "index_pool": "" 2023-10-05T11:36:53.853 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.853 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2023-10-05T11:36:53.853 INFO:tasks.workunit.client.0.smithi012.stdout: "key": { 2023-10-05T11:36:53.853 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "obj", 2023-10-05T11:36:53.854 INFO:tasks.workunit.client.0.smithi012.stdout: "instance": "", 2023-10-05T11:36:53.854 INFO:tasks.workunit.client.0.smithi012.stdout: "ns": "" 2023-10-05T11:36:53.854 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.854 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2023-10-05T11:36:53.854 INFO:tasks.workunit.client.0.smithi012.stdout: "obj3": { 2023-10-05T11:36:53.854 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket": { 2023-10-05T11:36:53.854 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "test", 2023-10-05T11:36:53.854 INFO:tasks.workunit.client.0.smithi012.stdout: "marker": "marker", 2023-10-05T11:36:53.854 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket_id": "bucket-id", 2023-10-05T11:36:53.854 INFO:tasks.workunit.client.0.smithi012.stdout: "tenant": "", 2023-10-05T11:36:53.854 INFO:tasks.workunit.client.0.smithi012.stdout: "explicit_placement": { 2023-10-05T11:36:53.855 INFO:tasks.workunit.client.0.smithi012.stdout: "data_pool": "", 2023-10-05T11:36:53.855 INFO:tasks.workunit.client.0.smithi012.stdout: "data_extra_pool": "", 2023-10-05T11:36:53.855 INFO:tasks.workunit.client.0.smithi012.stdout: "index_pool": "" 2023-10-05T11:36:53.855 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.855 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2023-10-05T11:36:53.855 INFO:tasks.workunit.client.0.smithi012.stdout: "key": { 2023-10-05T11:36:53.855 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "obj", 2023-10-05T11:36:53.855 INFO:tasks.workunit.client.0.smithi012.stdout: "instance": "", 2023-10-05T11:36:53.855 INFO:tasks.workunit.client.0.smithi012.stdout: "ns": "" 2023-10-05T11:36:53.855 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.856 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2023-10-05T11:36:53.856 INFO:tasks.workunit.client.0.smithi012.stdout: "obj3-2": { 2023-10-05T11:36:53.856 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket": { 2023-10-05T11:36:53.856 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "test", 2023-10-05T11:36:53.856 INFO:tasks.workunit.client.0.smithi012.stdout: "marker": "marker", 2023-10-05T11:36:53.856 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket_id": "bucket-id", 2023-10-05T11:36:53.856 INFO:tasks.workunit.client.0.smithi012.stdout: "tenant": "", 2023-10-05T11:36:53.856 INFO:tasks.workunit.client.0.smithi012.stdout: "explicit_placement": { 2023-10-05T11:36:53.856 INFO:tasks.workunit.client.0.smithi012.stdout: "data_pool": "", 2023-10-05T11:36:53.856 INFO:tasks.workunit.client.0.smithi012.stdout: "data_extra_pool": "", 2023-10-05T11:36:53.857 INFO:tasks.workunit.client.0.smithi012.stdout: "index_pool": "" 2023-10-05T11:36:53.857 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.857 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2023-10-05T11:36:53.857 INFO:tasks.workunit.client.0.smithi012.stdout: "key": { 2023-10-05T11:36:53.857 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "obj", 2023-10-05T11:36:53.857 INFO:tasks.workunit.client.0.smithi012.stdout: "instance": "", 2023-10-05T11:36:53.857 INFO:tasks.workunit.client.0.smithi012.stdout: "ns": "" 2023-10-05T11:36:53.857 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.857 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.857 INFO:tasks.workunit.client.0.smithi012.stdout:} 2023-10-05T11:36:53.857 INFO:tasks.workunit.client.0.smithi012.stdout:parsed: obj 2023-10-05T11:36:53.858 INFO:tasks.workunit.client.0.smithi012.stdout:parsed: obj 2023-10-05T11:36:53.858 INFO:tasks.workunit.client.0.smithi012.stdout:stripped: obj ns=ns i= 2023-10-05T11:36:53.858 INFO:tasks.workunit.client.0.smithi012.stdout:parsed: obj 2023-10-05T11:36:53.858 INFO:tasks.workunit.client.0.smithi012.stdout:parsed: obj 2023-10-05T11:36:53.858 INFO:tasks.workunit.client.0.smithi012.stdout:stripped: obj ns=ns i= 2023-10-05T11:36:53.858 INFO:tasks.workunit.client.0.smithi012.stdout:parsed: obj 2023-10-05T11:36:53.858 INFO:tasks.workunit.client.0.smithi012.stdout:parsed: obj 2023-10-05T11:36:53.858 INFO:tasks.workunit.client.0.smithi012.stdout:stripped: obj ns=ns i= 2023-10-05T11:36:53.858 INFO:tasks.workunit.client.0.smithi012.stdout:{ 2023-10-05T11:36:53.858 INFO:tasks.workunit.client.0.smithi012.stdout: "obj1": { 2023-10-05T11:36:53.859 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket": { 2023-10-05T11:36:53.859 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "test", 2023-10-05T11:36:53.859 INFO:tasks.workunit.client.0.smithi012.stdout: "marker": "marker", 2023-10-05T11:36:53.859 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket_id": "bucket-id", 2023-10-05T11:36:53.859 INFO:tasks.workunit.client.0.smithi012.stdout: "tenant": "", 2023-10-05T11:36:53.859 INFO:tasks.workunit.client.0.smithi012.stdout: "explicit_placement": { 2023-10-05T11:36:53.859 INFO:tasks.workunit.client.0.smithi012.stdout: "data_pool": "", 2023-10-05T11:36:53.859 INFO:tasks.workunit.client.0.smithi012.stdout: "data_extra_pool": "", 2023-10-05T11:36:53.859 INFO:tasks.workunit.client.0.smithi012.stdout: "index_pool": "" 2023-10-05T11:36:53.859 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.859 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2023-10-05T11:36:53.859 INFO:tasks.workunit.client.0.smithi012.stdout: "key": { 2023-10-05T11:36:53.860 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "obj", 2023-10-05T11:36:53.860 INFO:tasks.workunit.client.0.smithi012.stdout: "instance": "", 2023-10-05T11:36:53.860 INFO:tasks.workunit.client.0.smithi012.stdout: "ns": "ns" 2023-10-05T11:36:53.860 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.860 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2023-10-05T11:36:53.860 INFO:tasks.workunit.client.0.smithi012.stdout: "obj2": { 2023-10-05T11:36:53.860 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket": { 2023-10-05T11:36:53.860 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "test", 2023-10-05T11:36:53.860 INFO:tasks.workunit.client.0.smithi012.stdout: "marker": "marker", 2023-10-05T11:36:53.860 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket_id": "bucket-id", 2023-10-05T11:36:53.860 INFO:tasks.workunit.client.0.smithi012.stdout: "tenant": "", 2023-10-05T11:36:53.861 INFO:tasks.workunit.client.0.smithi012.stdout: "explicit_placement": { 2023-10-05T11:36:53.861 INFO:tasks.workunit.client.0.smithi012.stdout: "data_pool": "", 2023-10-05T11:36:53.861 INFO:tasks.workunit.client.0.smithi012.stdout: "data_extra_pool": "", 2023-10-05T11:36:53.861 INFO:tasks.workunit.client.0.smithi012.stdout: "index_pool": "" 2023-10-05T11:36:53.861 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.861 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2023-10-05T11:36:53.861 INFO:tasks.workunit.client.0.smithi012.stdout: "key": { 2023-10-05T11:36:53.861 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "obj", 2023-10-05T11:36:53.861 INFO:tasks.workunit.client.0.smithi012.stdout: "instance": "", 2023-10-05T11:36:53.861 INFO:tasks.workunit.client.0.smithi012.stdout: "ns": "ns" 2023-10-05T11:36:53.861 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.862 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2023-10-05T11:36:53.862 INFO:tasks.workunit.client.0.smithi012.stdout: "obj3": { 2023-10-05T11:36:53.862 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket": { 2023-10-05T11:36:53.862 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "test", 2023-10-05T11:36:53.862 INFO:tasks.workunit.client.0.smithi012.stdout: "marker": "marker", 2023-10-05T11:36:53.862 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket_id": "bucket-id", 2023-10-05T11:36:53.862 INFO:tasks.workunit.client.0.smithi012.stdout: "tenant": "", 2023-10-05T11:36:53.862 INFO:tasks.workunit.client.0.smithi012.stdout: "explicit_placement": { 2023-10-05T11:36:53.862 INFO:tasks.workunit.client.0.smithi012.stdout: "data_pool": "", 2023-10-05T11:36:53.862 INFO:tasks.workunit.client.0.smithi012.stdout: "data_extra_pool": "", 2023-10-05T11:36:53.862 INFO:tasks.workunit.client.0.smithi012.stdout: "index_pool": "" 2023-10-05T11:36:53.863 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.863 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2023-10-05T11:36:53.863 INFO:tasks.workunit.client.0.smithi012.stdout: "key": { 2023-10-05T11:36:53.863 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "obj", 2023-10-05T11:36:53.863 INFO:tasks.workunit.client.0.smithi012.stdout: "instance": "", 2023-10-05T11:36:53.863 INFO:tasks.workunit.client.0.smithi012.stdout: "ns": "" 2023-10-05T11:36:53.863 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.863 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2023-10-05T11:36:53.863 INFO:tasks.workunit.client.0.smithi012.stdout: "obj3-2": { 2023-10-05T11:36:53.863 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket": { 2023-10-05T11:36:53.864 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "test", 2023-10-05T11:36:53.864 INFO:tasks.workunit.client.0.smithi012.stdout: "marker": "marker", 2023-10-05T11:36:53.864 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket_id": "bucket-id", 2023-10-05T11:36:53.864 INFO:tasks.workunit.client.0.smithi012.stdout: "tenant": "", 2023-10-05T11:36:53.864 INFO:tasks.workunit.client.0.smithi012.stdout: "explicit_placement": { 2023-10-05T11:36:53.864 INFO:tasks.workunit.client.0.smithi012.stdout: "data_pool": "", 2023-10-05T11:36:53.864 INFO:tasks.workunit.client.0.smithi012.stdout: "data_extra_pool": "", 2023-10-05T11:36:53.864 INFO:tasks.workunit.client.0.smithi012.stdout: "index_pool": "" 2023-10-05T11:36:53.864 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.864 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2023-10-05T11:36:53.865 INFO:tasks.workunit.client.0.smithi012.stdout: "key": { 2023-10-05T11:36:53.865 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "obj", 2023-10-05T11:36:53.865 INFO:tasks.workunit.client.0.smithi012.stdout: "instance": "", 2023-10-05T11:36:53.865 INFO:tasks.workunit.client.0.smithi012.stdout: "ns": "ns" 2023-10-05T11:36:53.865 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.865 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.865 INFO:tasks.workunit.client.0.smithi012.stdout:} 2023-10-05T11:36:53.865 INFO:tasks.workunit.client.0.smithi012.stdout:parsed: obj[v1] 2023-10-05T11:36:53.865 INFO:tasks.workunit.client.0.smithi012.stdout:parsed: obj[v1] 2023-10-05T11:36:53.866 INFO:tasks.workunit.client.0.smithi012.stdout:stripped: obj ns= i=v1 2023-10-05T11:36:53.866 INFO:tasks.workunit.client.0.smithi012.stdout:parsed: obj[v1] 2023-10-05T11:36:53.866 INFO:tasks.workunit.client.0.smithi012.stdout:parsed: obj[v1] 2023-10-05T11:36:53.866 INFO:tasks.workunit.client.0.smithi012.stdout:stripped: obj ns= i=v1 2023-10-05T11:36:53.866 INFO:tasks.workunit.client.0.smithi012.stdout:parsed: obj[v1] 2023-10-05T11:36:53.866 INFO:tasks.workunit.client.0.smithi012.stdout:parsed: obj[v1] 2023-10-05T11:36:53.866 INFO:tasks.workunit.client.0.smithi012.stdout:stripped: obj ns= i=v1 2023-10-05T11:36:53.867 INFO:tasks.workunit.client.0.smithi012.stdout:{ 2023-10-05T11:36:53.867 INFO:tasks.workunit.client.0.smithi012.stdout: "obj1": { 2023-10-05T11:36:53.867 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket": { 2023-10-05T11:36:53.867 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "test", 2023-10-05T11:36:53.867 INFO:tasks.workunit.client.0.smithi012.stdout: "marker": "marker", 2023-10-05T11:36:53.867 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket_id": "bucket-id", 2023-10-05T11:36:53.867 INFO:tasks.workunit.client.0.smithi012.stdout: "tenant": "", 2023-10-05T11:36:53.867 INFO:tasks.workunit.client.0.smithi012.stdout: "explicit_placement": { 2023-10-05T11:36:53.868 INFO:tasks.workunit.client.0.smithi012.stdout: "data_pool": "", 2023-10-05T11:36:53.868 INFO:tasks.workunit.client.0.smithi012.stdout: "data_extra_pool": "", 2023-10-05T11:36:53.868 INFO:tasks.workunit.client.0.smithi012.stdout: "index_pool": "" 2023-10-05T11:36:53.868 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.868 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2023-10-05T11:36:53.868 INFO:tasks.workunit.client.0.smithi012.stdout: "key": { 2023-10-05T11:36:53.869 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "obj", 2023-10-05T11:36:53.869 INFO:tasks.workunit.client.0.smithi012.stdout: "instance": "v1", 2023-10-05T11:36:53.869 INFO:tasks.workunit.client.0.smithi012.stdout: "ns": "" 2023-10-05T11:36:53.869 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.869 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2023-10-05T11:36:53.869 INFO:tasks.workunit.client.0.smithi012.stdout: "obj2": { 2023-10-05T11:36:53.869 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket": { 2023-10-05T11:36:53.870 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "test", 2023-10-05T11:36:53.870 INFO:tasks.workunit.client.0.smithi012.stdout: "marker": "marker", 2023-10-05T11:36:53.870 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket_id": "bucket-id", 2023-10-05T11:36:53.870 INFO:tasks.workunit.client.0.smithi012.stdout: "tenant": "", 2023-10-05T11:36:53.870 INFO:tasks.workunit.client.0.smithi012.stdout: "explicit_placement": { 2023-10-05T11:36:53.870 INFO:tasks.workunit.client.0.smithi012.stdout: "data_pool": "", 2023-10-05T11:36:53.871 INFO:tasks.workunit.client.0.smithi012.stdout: "data_extra_pool": "", 2023-10-05T11:36:53.871 INFO:tasks.workunit.client.0.smithi012.stdout: "index_pool": "" 2023-10-05T11:36:53.871 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.871 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2023-10-05T11:36:53.871 INFO:tasks.workunit.client.0.smithi012.stdout: "key": { 2023-10-05T11:36:53.871 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "obj", 2023-10-05T11:36:53.871 INFO:tasks.workunit.client.0.smithi012.stdout: "instance": "v1", 2023-10-05T11:36:53.872 INFO:tasks.workunit.client.0.smithi012.stdout: "ns": "" 2023-10-05T11:36:53.872 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.872 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2023-10-05T11:36:53.872 INFO:tasks.workunit.client.0.smithi012.stdout: "obj3": { 2023-10-05T11:36:53.872 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket": { 2023-10-05T11:36:53.872 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "test", 2023-10-05T11:36:53.873 INFO:tasks.workunit.client.0.smithi012.stdout: "marker": "marker", 2023-10-05T11:36:53.873 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket_id": "bucket-id", 2023-10-05T11:36:53.873 INFO:tasks.workunit.client.0.smithi012.stdout: "tenant": "", 2023-10-05T11:36:53.873 INFO:tasks.workunit.client.0.smithi012.stdout: "explicit_placement": { 2023-10-05T11:36:53.873 INFO:tasks.workunit.client.0.smithi012.stdout: "data_pool": "", 2023-10-05T11:36:53.873 INFO:tasks.workunit.client.0.smithi012.stdout: "data_extra_pool": "", 2023-10-05T11:36:53.873 INFO:tasks.workunit.client.0.smithi012.stdout: "index_pool": "" 2023-10-05T11:36:53.874 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.874 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2023-10-05T11:36:53.874 INFO:tasks.workunit.client.0.smithi012.stdout: "key": { 2023-10-05T11:36:53.874 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "obj", 2023-10-05T11:36:53.874 INFO:tasks.workunit.client.0.smithi012.stdout: "instance": "", 2023-10-05T11:36:53.875 INFO:tasks.workunit.client.0.smithi012.stdout: "ns": "" 2023-10-05T11:36:53.875 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.875 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2023-10-05T11:36:53.875 INFO:tasks.workunit.client.0.smithi012.stdout: "obj3-2": { 2023-10-05T11:36:53.875 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket": { 2023-10-05T11:36:53.875 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "test", 2023-10-05T11:36:53.875 INFO:tasks.workunit.client.0.smithi012.stdout: "marker": "marker", 2023-10-05T11:36:53.876 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket_id": "bucket-id", 2023-10-05T11:36:53.876 INFO:tasks.workunit.client.0.smithi012.stdout: "tenant": "", 2023-10-05T11:36:53.876 INFO:tasks.workunit.client.0.smithi012.stdout: "explicit_placement": { 2023-10-05T11:36:53.876 INFO:tasks.workunit.client.0.smithi012.stdout: "data_pool": "", 2023-10-05T11:36:53.876 INFO:tasks.workunit.client.0.smithi012.stdout: "data_extra_pool": "", 2023-10-05T11:36:53.876 INFO:tasks.workunit.client.0.smithi012.stdout: "index_pool": "" 2023-10-05T11:36:53.876 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.876 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2023-10-05T11:36:53.877 INFO:tasks.workunit.client.0.smithi012.stdout: "key": { 2023-10-05T11:36:53.877 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "obj", 2023-10-05T11:36:53.877 INFO:tasks.workunit.client.0.smithi012.stdout: "instance": "v1", 2023-10-05T11:36:53.877 INFO:tasks.workunit.client.0.smithi012.stdout: "ns": "" 2023-10-05T11:36:53.877 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.877 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.877 INFO:tasks.workunit.client.0.smithi012.stdout:} 2023-10-05T11:36:53.877 INFO:tasks.workunit.client.0.smithi012.stdout:parsed: obj[v1] 2023-10-05T11:36:53.878 INFO:tasks.workunit.client.0.smithi012.stdout:parsed: obj[v1] 2023-10-05T11:36:53.878 INFO:tasks.workunit.client.0.smithi012.stdout:stripped: obj ns=ns i=v1 2023-10-05T11:36:53.878 INFO:tasks.workunit.client.0.smithi012.stdout:parsed: obj[v1] 2023-10-05T11:36:53.878 INFO:tasks.workunit.client.0.smithi012.stdout:parsed: obj[v1] 2023-10-05T11:36:53.878 INFO:tasks.workunit.client.0.smithi012.stdout:stripped: obj ns=ns i=v1 2023-10-05T11:36:53.879 INFO:tasks.workunit.client.0.smithi012.stdout:parsed: obj[v1] 2023-10-05T11:36:53.879 INFO:tasks.workunit.client.0.smithi012.stdout:parsed: obj[v1] 2023-10-05T11:36:53.879 INFO:tasks.workunit.client.0.smithi012.stdout:stripped: obj ns=ns i=v1 2023-10-05T11:36:53.879 INFO:tasks.workunit.client.0.smithi012.stdout:{ 2023-10-05T11:36:53.879 INFO:tasks.workunit.client.0.smithi012.stdout: "obj1": { 2023-10-05T11:36:53.879 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket": { 2023-10-05T11:36:53.880 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "test", 2023-10-05T11:36:53.880 INFO:tasks.workunit.client.0.smithi012.stdout: "marker": "marker", 2023-10-05T11:36:53.880 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket_id": "bucket-id", 2023-10-05T11:36:53.880 INFO:tasks.workunit.client.0.smithi012.stdout: "tenant": "", 2023-10-05T11:36:53.880 INFO:tasks.workunit.client.0.smithi012.stdout: "explicit_placement": { 2023-10-05T11:36:53.880 INFO:tasks.workunit.client.0.smithi012.stdout: "data_pool": "", 2023-10-05T11:36:53.881 INFO:tasks.workunit.client.0.smithi012.stdout: "data_extra_pool": "", 2023-10-05T11:36:53.881 INFO:tasks.workunit.client.0.smithi012.stdout: "index_pool": "" 2023-10-05T11:36:53.881 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.881 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2023-10-05T11:36:53.881 INFO:tasks.workunit.client.0.smithi012.stdout: "key": { 2023-10-05T11:36:53.882 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "obj", 2023-10-05T11:36:53.882 INFO:tasks.workunit.client.0.smithi012.stdout: "instance": "v1", 2023-10-05T11:36:53.882 INFO:tasks.workunit.client.0.smithi012.stdout: "ns": "ns" 2023-10-05T11:36:53.882 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.882 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2023-10-05T11:36:53.882 INFO:tasks.workunit.client.0.smithi012.stdout: "obj2": { 2023-10-05T11:36:53.883 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket": { 2023-10-05T11:36:53.883 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "test", 2023-10-05T11:36:53.883 INFO:tasks.workunit.client.0.smithi012.stdout: "marker": "marker", 2023-10-05T11:36:53.883 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket_id": "bucket-id", 2023-10-05T11:36:53.883 INFO:tasks.workunit.client.0.smithi012.stdout: "tenant": "", 2023-10-05T11:36:53.883 INFO:tasks.workunit.client.0.smithi012.stdout: "explicit_placement": { 2023-10-05T11:36:53.883 INFO:tasks.workunit.client.0.smithi012.stdout: "data_pool": "", 2023-10-05T11:36:53.883 INFO:tasks.workunit.client.0.smithi012.stdout: "data_extra_pool": "", 2023-10-05T11:36:53.884 INFO:tasks.workunit.client.0.smithi012.stdout: "index_pool": "" 2023-10-05T11:36:53.884 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.884 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2023-10-05T11:36:53.884 INFO:tasks.workunit.client.0.smithi012.stdout: "key": { 2023-10-05T11:36:53.884 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "obj", 2023-10-05T11:36:53.884 INFO:tasks.workunit.client.0.smithi012.stdout: "instance": "v1", 2023-10-05T11:36:53.884 INFO:tasks.workunit.client.0.smithi012.stdout: "ns": "ns" 2023-10-05T11:36:53.884 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.885 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2023-10-05T11:36:53.885 INFO:tasks.workunit.client.0.smithi012.stdout: "obj3": { 2023-10-05T11:36:53.885 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket": { 2023-10-05T11:36:53.885 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "test", 2023-10-05T11:36:53.885 INFO:tasks.workunit.client.0.smithi012.stdout: "marker": "marker", 2023-10-05T11:36:53.885 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket_id": "bucket-id", 2023-10-05T11:36:53.885 INFO:tasks.workunit.client.0.smithi012.stdout: "tenant": "", 2023-10-05T11:36:53.885 INFO:tasks.workunit.client.0.smithi012.stdout: "explicit_placement": { 2023-10-05T11:36:53.886 INFO:tasks.workunit.client.0.smithi012.stdout: "data_pool": "", 2023-10-05T11:36:53.886 INFO:tasks.workunit.client.0.smithi012.stdout: "data_extra_pool": "", 2023-10-05T11:36:53.886 INFO:tasks.workunit.client.0.smithi012.stdout: "index_pool": "" 2023-10-05T11:36:53.886 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.886 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2023-10-05T11:36:53.886 INFO:tasks.workunit.client.0.smithi012.stdout: "key": { 2023-10-05T11:36:53.887 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "obj", 2023-10-05T11:36:53.887 INFO:tasks.workunit.client.0.smithi012.stdout: "instance": "", 2023-10-05T11:36:53.887 INFO:tasks.workunit.client.0.smithi012.stdout: "ns": "" 2023-10-05T11:36:53.887 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.887 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2023-10-05T11:36:53.887 INFO:tasks.workunit.client.0.smithi012.stdout: "obj3-2": { 2023-10-05T11:36:53.888 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket": { 2023-10-05T11:36:53.888 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "test", 2023-10-05T11:36:53.888 INFO:tasks.workunit.client.0.smithi012.stdout: "marker": "marker", 2023-10-05T11:36:53.888 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket_id": "bucket-id", 2023-10-05T11:36:53.888 INFO:tasks.workunit.client.0.smithi012.stdout: "tenant": "", 2023-10-05T11:36:53.888 INFO:tasks.workunit.client.0.smithi012.stdout: "explicit_placement": { 2023-10-05T11:36:53.889 INFO:tasks.workunit.client.0.smithi012.stdout: "data_pool": "", 2023-10-05T11:36:53.889 INFO:tasks.workunit.client.0.smithi012.stdout: "data_extra_pool": "", 2023-10-05T11:36:53.889 INFO:tasks.workunit.client.0.smithi012.stdout: "index_pool": "" 2023-10-05T11:36:53.889 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.889 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2023-10-05T11:36:53.889 INFO:tasks.workunit.client.0.smithi012.stdout: "key": { 2023-10-05T11:36:53.890 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "obj", 2023-10-05T11:36:53.890 INFO:tasks.workunit.client.0.smithi012.stdout: "instance": "v1", 2023-10-05T11:36:53.890 INFO:tasks.workunit.client.0.smithi012.stdout: "ns": "ns" 2023-10-05T11:36:53.890 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.890 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.890 INFO:tasks.workunit.client.0.smithi012.stdout:} 2023-10-05T11:36:53.890 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] TestRGWObj.no_underscore (0 ms) 2023-10-05T11:36:53.890 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] TestRGWObj.obj_to_raw 2023-10-05T11:36:53.891 INFO:tasks.workunit.client.0.smithi012.stdout:{ 2023-10-05T11:36:53.891 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket": { 2023-10-05T11:36:53.891 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "test", 2023-10-05T11:36:53.891 INFO:tasks.workunit.client.0.smithi012.stdout: "marker": "marker", 2023-10-05T11:36:53.891 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket_id": "bucket-id", 2023-10-05T11:36:53.891 INFO:tasks.workunit.client.0.smithi012.stdout: "tenant": "", 2023-10-05T11:36:53.891 INFO:tasks.workunit.client.0.smithi012.stdout: "explicit_placement": { 2023-10-05T11:36:53.891 INFO:tasks.workunit.client.0.smithi012.stdout: "data_pool": "", 2023-10-05T11:36:53.891 INFO:tasks.workunit.client.0.smithi012.stdout: "data_extra_pool": "", 2023-10-05T11:36:53.891 INFO:tasks.workunit.client.0.smithi012.stdout: "index_pool": "" 2023-10-05T11:36:53.891 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.891 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.892 INFO:tasks.workunit.client.0.smithi012.stdout:} 2023-10-05T11:36:53.892 INFO:tasks.workunit.client.0.smithi012.stdout:{ 2023-10-05T11:36:53.892 INFO:tasks.workunit.client.0.smithi012.stdout: "obj": { 2023-10-05T11:36:53.892 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket": { 2023-10-05T11:36:53.892 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "test", 2023-10-05T11:36:53.892 INFO:tasks.workunit.client.0.smithi012.stdout: "marker": "marker", 2023-10-05T11:36:53.892 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket_id": "bucket-id", 2023-10-05T11:36:53.892 INFO:tasks.workunit.client.0.smithi012.stdout: "tenant": "", 2023-10-05T11:36:53.892 INFO:tasks.workunit.client.0.smithi012.stdout: "explicit_placement": { 2023-10-05T11:36:53.892 INFO:tasks.workunit.client.0.smithi012.stdout: "data_pool": "", 2023-10-05T11:36:53.892 INFO:tasks.workunit.client.0.smithi012.stdout: "data_extra_pool": "", 2023-10-05T11:36:53.892 INFO:tasks.workunit.client.0.smithi012.stdout: "index_pool": "" 2023-10-05T11:36:53.893 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.893 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2023-10-05T11:36:53.893 INFO:tasks.workunit.client.0.smithi012.stdout: "key": { 2023-10-05T11:36:53.893 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "myobj", 2023-10-05T11:36:53.893 INFO:tasks.workunit.client.0.smithi012.stdout: "instance": "", 2023-10-05T11:36:53.893 INFO:tasks.workunit.client.0.smithi012.stdout: "ns": "" 2023-10-05T11:36:53.893 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.894 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.894 INFO:tasks.workunit.client.0.smithi012.stdout:} 2023-10-05T11:36:53.894 INFO:tasks.workunit.client.0.smithi012.stdout:{ 2023-10-05T11:36:53.894 INFO:tasks.workunit.client.0.smithi012.stdout: "raw_obj": { 2023-10-05T11:36:53.894 INFO:tasks.workunit.client.0.smithi012.stdout: "pool": "default-placement.data", 2023-10-05T11:36:53.894 INFO:tasks.workunit.client.0.smithi012.stdout: "oid": "marker_myobj", 2023-10-05T11:36:53.894 INFO:tasks.workunit.client.0.smithi012.stdout: "loc": "" 2023-10-05T11:36:53.894 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.894 INFO:tasks.workunit.client.0.smithi012.stdout:} 2023-10-05T11:36:53.894 INFO:tasks.workunit.client.0.smithi012.stdout:{ 2023-10-05T11:36:53.894 INFO:tasks.workunit.client.0.smithi012.stdout: "new_obj": { 2023-10-05T11:36:53.895 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket": { 2023-10-05T11:36:53.895 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "test", 2023-10-05T11:36:53.895 INFO:tasks.workunit.client.0.smithi012.stdout: "marker": "marker", 2023-10-05T11:36:53.895 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket_id": "bucket-id", 2023-10-05T11:36:53.895 INFO:tasks.workunit.client.0.smithi012.stdout: "tenant": "", 2023-10-05T11:36:53.895 INFO:tasks.workunit.client.0.smithi012.stdout: "explicit_placement": { 2023-10-05T11:36:53.895 INFO:tasks.workunit.client.0.smithi012.stdout: "data_pool": "", 2023-10-05T11:36:53.895 INFO:tasks.workunit.client.0.smithi012.stdout: "data_extra_pool": "", 2023-10-05T11:36:53.895 INFO:tasks.workunit.client.0.smithi012.stdout: "index_pool": "" 2023-10-05T11:36:53.896 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.896 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2023-10-05T11:36:53.896 INFO:tasks.workunit.client.0.smithi012.stdout: "key": { 2023-10-05T11:36:53.896 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "myobj", 2023-10-05T11:36:53.896 INFO:tasks.workunit.client.0.smithi012.stdout: "instance": "", 2023-10-05T11:36:53.896 INFO:tasks.workunit.client.0.smithi012.stdout: "ns": "" 2023-10-05T11:36:53.896 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.896 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.896 INFO:tasks.workunit.client.0.smithi012.stdout:} 2023-10-05T11:36:53.896 INFO:tasks.workunit.client.0.smithi012.stdout:{ 2023-10-05T11:36:53.896 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket": { 2023-10-05T11:36:53.897 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "ebtest", 2023-10-05T11:36:53.897 INFO:tasks.workunit.client.0.smithi012.stdout: "marker": "marker", 2023-10-05T11:36:53.897 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket_id": "bucket-id", 2023-10-05T11:36:53.897 INFO:tasks.workunit.client.0.smithi012.stdout: "tenant": "", 2023-10-05T11:36:53.897 INFO:tasks.workunit.client.0.smithi012.stdout: "explicit_placement": { 2023-10-05T11:36:53.897 INFO:tasks.workunit.client.0.smithi012.stdout: "data_pool": ".data-pool", 2023-10-05T11:36:53.897 INFO:tasks.workunit.client.0.smithi012.stdout: "data_extra_pool": "", 2023-10-05T11:36:53.897 INFO:tasks.workunit.client.0.smithi012.stdout: "index_pool": ".index-pool" 2023-10-05T11:36:53.898 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.898 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.898 INFO:tasks.workunit.client.0.smithi012.stdout:} 2023-10-05T11:36:53.898 INFO:tasks.workunit.client.0.smithi012.stdout:{ 2023-10-05T11:36:53.898 INFO:tasks.workunit.client.0.smithi012.stdout: "obj": { 2023-10-05T11:36:53.898 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket": { 2023-10-05T11:36:53.898 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "ebtest", 2023-10-05T11:36:53.898 INFO:tasks.workunit.client.0.smithi012.stdout: "marker": "marker", 2023-10-05T11:36:53.898 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket_id": "bucket-id", 2023-10-05T11:36:53.899 INFO:tasks.workunit.client.0.smithi012.stdout: "tenant": "", 2023-10-05T11:36:53.899 INFO:tasks.workunit.client.0.smithi012.stdout: "explicit_placement": { 2023-10-05T11:36:53.899 INFO:tasks.workunit.client.0.smithi012.stdout: "data_pool": ".data-pool", 2023-10-05T11:36:53.899 INFO:tasks.workunit.client.0.smithi012.stdout: "data_extra_pool": "", 2023-10-05T11:36:53.899 INFO:tasks.workunit.client.0.smithi012.stdout: "index_pool": ".index-pool" 2023-10-05T11:36:53.899 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.899 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2023-10-05T11:36:53.899 INFO:tasks.workunit.client.0.smithi012.stdout: "key": { 2023-10-05T11:36:53.899 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "myobj", 2023-10-05T11:36:53.899 INFO:tasks.workunit.client.0.smithi012.stdout: "instance": "", 2023-10-05T11:36:53.900 INFO:tasks.workunit.client.0.smithi012.stdout: "ns": "" 2023-10-05T11:36:53.900 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.900 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.900 INFO:tasks.workunit.client.0.smithi012.stdout:} 2023-10-05T11:36:53.900 INFO:tasks.workunit.client.0.smithi012.stdout:{ 2023-10-05T11:36:53.900 INFO:tasks.workunit.client.0.smithi012.stdout: "raw_obj": { 2023-10-05T11:36:53.901 INFO:tasks.workunit.client.0.smithi012.stdout: "pool": ".data-pool", 2023-10-05T11:36:53.901 INFO:tasks.workunit.client.0.smithi012.stdout: "oid": "marker_myobj", 2023-10-05T11:36:53.901 INFO:tasks.workunit.client.0.smithi012.stdout: "loc": "" 2023-10-05T11:36:53.901 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.901 INFO:tasks.workunit.client.0.smithi012.stdout:} 2023-10-05T11:36:53.901 INFO:tasks.workunit.client.0.smithi012.stdout:{ 2023-10-05T11:36:53.901 INFO:tasks.workunit.client.0.smithi012.stdout: "new_obj": { 2023-10-05T11:36:53.902 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket": { 2023-10-05T11:36:53.902 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "ebtest", 2023-10-05T11:36:53.902 INFO:tasks.workunit.client.0.smithi012.stdout: "marker": "marker", 2023-10-05T11:36:53.902 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket_id": "bucket-id", 2023-10-05T11:36:53.902 INFO:tasks.workunit.client.0.smithi012.stdout: "tenant": "", 2023-10-05T11:36:53.902 INFO:tasks.workunit.client.0.smithi012.stdout: "explicit_placement": { 2023-10-05T11:36:53.902 INFO:tasks.workunit.client.0.smithi012.stdout: "data_pool": ".data-pool", 2023-10-05T11:36:53.902 INFO:tasks.workunit.client.0.smithi012.stdout: "data_extra_pool": "", 2023-10-05T11:36:53.902 INFO:tasks.workunit.client.0.smithi012.stdout: "index_pool": ".index-pool" 2023-10-05T11:36:53.902 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.902 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2023-10-05T11:36:53.903 INFO:tasks.workunit.client.0.smithi012.stdout: "key": { 2023-10-05T11:36:53.903 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "myobj", 2023-10-05T11:36:53.903 INFO:tasks.workunit.client.0.smithi012.stdout: "instance": "", 2023-10-05T11:36:53.903 INFO:tasks.workunit.client.0.smithi012.stdout: "ns": "" 2023-10-05T11:36:53.903 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.903 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.903 INFO:tasks.workunit.client.0.smithi012.stdout:} 2023-10-05T11:36:53.903 INFO:tasks.workunit.client.0.smithi012.stdout:{ 2023-10-05T11:36:53.903 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket": { 2023-10-05T11:36:53.903 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "test", 2023-10-05T11:36:53.903 INFO:tasks.workunit.client.0.smithi012.stdout: "marker": "marker", 2023-10-05T11:36:53.903 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket_id": "bucket-id", 2023-10-05T11:36:53.904 INFO:tasks.workunit.client.0.smithi012.stdout: "tenant": "", 2023-10-05T11:36:53.904 INFO:tasks.workunit.client.0.smithi012.stdout: "explicit_placement": { 2023-10-05T11:36:53.904 INFO:tasks.workunit.client.0.smithi012.stdout: "data_pool": "", 2023-10-05T11:36:53.904 INFO:tasks.workunit.client.0.smithi012.stdout: "data_extra_pool": "", 2023-10-05T11:36:53.904 INFO:tasks.workunit.client.0.smithi012.stdout: "index_pool": "" 2023-10-05T11:36:53.904 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.904 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.904 INFO:tasks.workunit.client.0.smithi012.stdout:} 2023-10-05T11:36:53.905 INFO:tasks.workunit.client.0.smithi012.stdout:{ 2023-10-05T11:36:53.905 INFO:tasks.workunit.client.0.smithi012.stdout: "obj": { 2023-10-05T11:36:53.905 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket": { 2023-10-05T11:36:53.905 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "test", 2023-10-05T11:36:53.905 INFO:tasks.workunit.client.0.smithi012.stdout: "marker": "marker", 2023-10-05T11:36:53.905 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket_id": "bucket-id", 2023-10-05T11:36:53.905 INFO:tasks.workunit.client.0.smithi012.stdout: "tenant": "", 2023-10-05T11:36:53.905 INFO:tasks.workunit.client.0.smithi012.stdout: "explicit_placement": { 2023-10-05T11:36:53.905 INFO:tasks.workunit.client.0.smithi012.stdout: "data_pool": "", 2023-10-05T11:36:53.905 INFO:tasks.workunit.client.0.smithi012.stdout: "data_extra_pool": "", 2023-10-05T11:36:53.906 INFO:tasks.workunit.client.0.smithi012.stdout: "index_pool": "" 2023-10-05T11:36:53.906 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.906 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2023-10-05T11:36:53.906 INFO:tasks.workunit.client.0.smithi012.stdout: "key": { 2023-10-05T11:36:53.906 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "myobj", 2023-10-05T11:36:53.906 INFO:tasks.workunit.client.0.smithi012.stdout: "instance": "", 2023-10-05T11:36:53.906 INFO:tasks.workunit.client.0.smithi012.stdout: "ns": "ns" 2023-10-05T11:36:53.906 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.907 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.907 INFO:tasks.workunit.client.0.smithi012.stdout:} 2023-10-05T11:36:53.907 INFO:tasks.workunit.client.0.smithi012.stdout:{ 2023-10-05T11:36:53.907 INFO:tasks.workunit.client.0.smithi012.stdout: "raw_obj": { 2023-10-05T11:36:53.907 INFO:tasks.workunit.client.0.smithi012.stdout: "pool": "default-placement.data", 2023-10-05T11:36:53.907 INFO:tasks.workunit.client.0.smithi012.stdout: "oid": "marker__ns_myobj", 2023-10-05T11:36:53.907 INFO:tasks.workunit.client.0.smithi012.stdout: "loc": "" 2023-10-05T11:36:53.907 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.907 INFO:tasks.workunit.client.0.smithi012.stdout:} 2023-10-05T11:36:53.907 INFO:tasks.workunit.client.0.smithi012.stdout:{ 2023-10-05T11:36:53.907 INFO:tasks.workunit.client.0.smithi012.stdout: "new_obj": { 2023-10-05T11:36:53.908 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket": { 2023-10-05T11:36:53.908 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "test", 2023-10-05T11:36:53.908 INFO:tasks.workunit.client.0.smithi012.stdout: "marker": "marker", 2023-10-05T11:36:53.908 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket_id": "bucket-id", 2023-10-05T11:36:53.908 INFO:tasks.workunit.client.0.smithi012.stdout: "tenant": "", 2023-10-05T11:36:53.908 INFO:tasks.workunit.client.0.smithi012.stdout: "explicit_placement": { 2023-10-05T11:36:53.908 INFO:tasks.workunit.client.0.smithi012.stdout: "data_pool": "", 2023-10-05T11:36:53.908 INFO:tasks.workunit.client.0.smithi012.stdout: "data_extra_pool": "", 2023-10-05T11:36:53.908 INFO:tasks.workunit.client.0.smithi012.stdout: "index_pool": "" 2023-10-05T11:36:53.908 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.909 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2023-10-05T11:36:53.909 INFO:tasks.workunit.client.0.smithi012.stdout: "key": { 2023-10-05T11:36:53.909 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "myobj", 2023-10-05T11:36:53.909 INFO:tasks.workunit.client.0.smithi012.stdout: "instance": "", 2023-10-05T11:36:53.909 INFO:tasks.workunit.client.0.smithi012.stdout: "ns": "ns" 2023-10-05T11:36:53.909 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.909 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.909 INFO:tasks.workunit.client.0.smithi012.stdout:} 2023-10-05T11:36:53.910 INFO:tasks.workunit.client.0.smithi012.stdout:{ 2023-10-05T11:36:53.910 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket": { 2023-10-05T11:36:53.910 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "ebtest", 2023-10-05T11:36:53.910 INFO:tasks.workunit.client.0.smithi012.stdout: "marker": "marker", 2023-10-05T11:36:53.910 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket_id": "bucket-id", 2023-10-05T11:36:53.911 INFO:tasks.workunit.client.0.smithi012.stdout: "tenant": "", 2023-10-05T11:36:53.911 INFO:tasks.workunit.client.0.smithi012.stdout: "explicit_placement": { 2023-10-05T11:36:53.911 INFO:tasks.workunit.client.0.smithi012.stdout: "data_pool": ".data-pool", 2023-10-05T11:36:53.911 INFO:tasks.workunit.client.0.smithi012.stdout: "data_extra_pool": "", 2023-10-05T11:36:53.911 INFO:tasks.workunit.client.0.smithi012.stdout: "index_pool": ".index-pool" 2023-10-05T11:36:53.911 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.912 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.912 INFO:tasks.workunit.client.0.smithi012.stdout:} 2023-10-05T11:36:53.912 INFO:tasks.workunit.client.0.smithi012.stdout:{ 2023-10-05T11:36:53.912 INFO:tasks.workunit.client.0.smithi012.stdout: "obj": { 2023-10-05T11:36:53.912 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket": { 2023-10-05T11:36:53.912 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "ebtest", 2023-10-05T11:36:53.912 INFO:tasks.workunit.client.0.smithi012.stdout: "marker": "marker", 2023-10-05T11:36:53.913 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket_id": "bucket-id", 2023-10-05T11:36:53.913 INFO:tasks.workunit.client.0.smithi012.stdout: "tenant": "", 2023-10-05T11:36:53.913 INFO:tasks.workunit.client.0.smithi012.stdout: "explicit_placement": { 2023-10-05T11:36:53.913 INFO:tasks.workunit.client.0.smithi012.stdout: "data_pool": ".data-pool", 2023-10-05T11:36:53.913 INFO:tasks.workunit.client.0.smithi012.stdout: "data_extra_pool": "", 2023-10-05T11:36:53.913 INFO:tasks.workunit.client.0.smithi012.stdout: "index_pool": ".index-pool" 2023-10-05T11:36:53.913 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.913 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2023-10-05T11:36:53.914 INFO:tasks.workunit.client.0.smithi012.stdout: "key": { 2023-10-05T11:36:53.914 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "myobj", 2023-10-05T11:36:53.914 INFO:tasks.workunit.client.0.smithi012.stdout: "instance": "", 2023-10-05T11:36:53.914 INFO:tasks.workunit.client.0.smithi012.stdout: "ns": "ns" 2023-10-05T11:36:53.914 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.914 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.914 INFO:tasks.workunit.client.0.smithi012.stdout:} 2023-10-05T11:36:53.914 INFO:tasks.workunit.client.0.smithi012.stdout:{ 2023-10-05T11:36:53.915 INFO:tasks.workunit.client.0.smithi012.stdout: "raw_obj": { 2023-10-05T11:36:53.915 INFO:tasks.workunit.client.0.smithi012.stdout: "pool": ".data-pool", 2023-10-05T11:36:53.915 INFO:tasks.workunit.client.0.smithi012.stdout: "oid": "marker__ns_myobj", 2023-10-05T11:36:53.915 INFO:tasks.workunit.client.0.smithi012.stdout: "loc": "" 2023-10-05T11:36:53.915 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.915 INFO:tasks.workunit.client.0.smithi012.stdout:} 2023-10-05T11:36:53.915 INFO:tasks.workunit.client.0.smithi012.stdout:{ 2023-10-05T11:36:53.916 INFO:tasks.workunit.client.0.smithi012.stdout: "new_obj": { 2023-10-05T11:36:53.916 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket": { 2023-10-05T11:36:53.916 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "ebtest", 2023-10-05T11:36:53.916 INFO:tasks.workunit.client.0.smithi012.stdout: "marker": "marker", 2023-10-05T11:36:53.916 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket_id": "bucket-id", 2023-10-05T11:36:53.916 INFO:tasks.workunit.client.0.smithi012.stdout: "tenant": "", 2023-10-05T11:36:53.916 INFO:tasks.workunit.client.0.smithi012.stdout: "explicit_placement": { 2023-10-05T11:36:53.917 INFO:tasks.workunit.client.0.smithi012.stdout: "data_pool": ".data-pool", 2023-10-05T11:36:53.917 INFO:tasks.workunit.client.0.smithi012.stdout: "data_extra_pool": "", 2023-10-05T11:36:53.917 INFO:tasks.workunit.client.0.smithi012.stdout: "index_pool": ".index-pool" 2023-10-05T11:36:53.917 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.917 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2023-10-05T11:36:53.917 INFO:tasks.workunit.client.0.smithi012.stdout: "key": { 2023-10-05T11:36:53.917 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "myobj", 2023-10-05T11:36:53.917 INFO:tasks.workunit.client.0.smithi012.stdout: "instance": "", 2023-10-05T11:36:53.917 INFO:tasks.workunit.client.0.smithi012.stdout: "ns": "ns" 2023-10-05T11:36:53.917 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.918 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.918 INFO:tasks.workunit.client.0.smithi012.stdout:} 2023-10-05T11:36:53.918 INFO:tasks.workunit.client.0.smithi012.stdout:{ 2023-10-05T11:36:53.918 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket": { 2023-10-05T11:36:53.918 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "test", 2023-10-05T11:36:53.918 INFO:tasks.workunit.client.0.smithi012.stdout: "marker": "marker", 2023-10-05T11:36:53.918 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket_id": "bucket-id", 2023-10-05T11:36:53.918 INFO:tasks.workunit.client.0.smithi012.stdout: "tenant": "", 2023-10-05T11:36:53.918 INFO:tasks.workunit.client.0.smithi012.stdout: "explicit_placement": { 2023-10-05T11:36:53.918 INFO:tasks.workunit.client.0.smithi012.stdout: "data_pool": "", 2023-10-05T11:36:53.918 INFO:tasks.workunit.client.0.smithi012.stdout: "data_extra_pool": "", 2023-10-05T11:36:53.919 INFO:tasks.workunit.client.0.smithi012.stdout: "index_pool": "" 2023-10-05T11:36:53.919 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.919 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.919 INFO:tasks.workunit.client.0.smithi012.stdout:} 2023-10-05T11:36:53.919 INFO:tasks.workunit.client.0.smithi012.stdout:{ 2023-10-05T11:36:53.919 INFO:tasks.workunit.client.0.smithi012.stdout: "obj": { 2023-10-05T11:36:53.919 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket": { 2023-10-05T11:36:53.919 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "test", 2023-10-05T11:36:53.919 INFO:tasks.workunit.client.0.smithi012.stdout: "marker": "marker", 2023-10-05T11:36:53.919 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket_id": "bucket-id", 2023-10-05T11:36:53.919 INFO:tasks.workunit.client.0.smithi012.stdout: "tenant": "", 2023-10-05T11:36:53.920 INFO:tasks.workunit.client.0.smithi012.stdout: "explicit_placement": { 2023-10-05T11:36:53.920 INFO:tasks.workunit.client.0.smithi012.stdout: "data_pool": "", 2023-10-05T11:36:53.920 INFO:tasks.workunit.client.0.smithi012.stdout: "data_extra_pool": "", 2023-10-05T11:36:53.920 INFO:tasks.workunit.client.0.smithi012.stdout: "index_pool": "" 2023-10-05T11:36:53.920 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.920 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2023-10-05T11:36:53.920 INFO:tasks.workunit.client.0.smithi012.stdout: "key": { 2023-10-05T11:36:53.920 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "myobj", 2023-10-05T11:36:53.920 INFO:tasks.workunit.client.0.smithi012.stdout: "instance": "inst", 2023-10-05T11:36:53.920 INFO:tasks.workunit.client.0.smithi012.stdout: "ns": "" 2023-10-05T11:36:53.920 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.920 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.921 INFO:tasks.workunit.client.0.smithi012.stdout:} 2023-10-05T11:36:53.921 INFO:tasks.workunit.client.0.smithi012.stdout:{ 2023-10-05T11:36:53.921 INFO:tasks.workunit.client.0.smithi012.stdout: "raw_obj": { 2023-10-05T11:36:53.921 INFO:tasks.workunit.client.0.smithi012.stdout: "pool": "default-placement.data", 2023-10-05T11:36:53.921 INFO:tasks.workunit.client.0.smithi012.stdout: "oid": "marker__:inst_myobj", 2023-10-05T11:36:53.921 INFO:tasks.workunit.client.0.smithi012.stdout: "loc": "" 2023-10-05T11:36:53.921 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.921 INFO:tasks.workunit.client.0.smithi012.stdout:} 2023-10-05T11:36:53.921 INFO:tasks.workunit.client.0.smithi012.stdout:{ 2023-10-05T11:36:53.921 INFO:tasks.workunit.client.0.smithi012.stdout: "new_obj": { 2023-10-05T11:36:53.921 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket": { 2023-10-05T11:36:53.921 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "test", 2023-10-05T11:36:53.922 INFO:tasks.workunit.client.0.smithi012.stdout: "marker": "marker", 2023-10-05T11:36:53.922 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket_id": "bucket-id", 2023-10-05T11:36:53.922 INFO:tasks.workunit.client.0.smithi012.stdout: "tenant": "", 2023-10-05T11:36:53.922 INFO:tasks.workunit.client.0.smithi012.stdout: "explicit_placement": { 2023-10-05T11:36:53.922 INFO:tasks.workunit.client.0.smithi012.stdout: "data_pool": "", 2023-10-05T11:36:53.922 INFO:tasks.workunit.client.0.smithi012.stdout: "data_extra_pool": "", 2023-10-05T11:36:53.922 INFO:tasks.workunit.client.0.smithi012.stdout: "index_pool": "" 2023-10-05T11:36:53.922 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.922 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2023-10-05T11:36:53.922 INFO:tasks.workunit.client.0.smithi012.stdout: "key": { 2023-10-05T11:36:53.922 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "myobj", 2023-10-05T11:36:53.923 INFO:tasks.workunit.client.0.smithi012.stdout: "instance": "inst", 2023-10-05T11:36:53.923 INFO:tasks.workunit.client.0.smithi012.stdout: "ns": "" 2023-10-05T11:36:53.923 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.923 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.923 INFO:tasks.workunit.client.0.smithi012.stdout:} 2023-10-05T11:36:53.923 INFO:tasks.workunit.client.0.smithi012.stdout:{ 2023-10-05T11:36:53.923 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket": { 2023-10-05T11:36:53.923 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "ebtest", 2023-10-05T11:36:53.923 INFO:tasks.workunit.client.0.smithi012.stdout: "marker": "marker", 2023-10-05T11:36:53.924 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket_id": "bucket-id", 2023-10-05T11:36:53.924 INFO:tasks.workunit.client.0.smithi012.stdout: "tenant": "", 2023-10-05T11:36:53.924 INFO:tasks.workunit.client.0.smithi012.stdout: "explicit_placement": { 2023-10-05T11:36:53.924 INFO:tasks.workunit.client.0.smithi012.stdout: "data_pool": ".data-pool", 2023-10-05T11:36:53.924 INFO:tasks.workunit.client.0.smithi012.stdout: "data_extra_pool": "", 2023-10-05T11:36:53.924 INFO:tasks.workunit.client.0.smithi012.stdout: "index_pool": ".index-pool" 2023-10-05T11:36:53.924 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.924 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.924 INFO:tasks.workunit.client.0.smithi012.stdout:} 2023-10-05T11:36:53.925 INFO:tasks.workunit.client.0.smithi012.stdout:{ 2023-10-05T11:36:53.925 INFO:tasks.workunit.client.0.smithi012.stdout: "obj": { 2023-10-05T11:36:53.925 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket": { 2023-10-05T11:36:53.925 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "ebtest", 2023-10-05T11:36:53.925 INFO:tasks.workunit.client.0.smithi012.stdout: "marker": "marker", 2023-10-05T11:36:53.925 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket_id": "bucket-id", 2023-10-05T11:36:53.925 INFO:tasks.workunit.client.0.smithi012.stdout: "tenant": "", 2023-10-05T11:36:53.925 INFO:tasks.workunit.client.0.smithi012.stdout: "explicit_placement": { 2023-10-05T11:36:53.925 INFO:tasks.workunit.client.0.smithi012.stdout: "data_pool": ".data-pool", 2023-10-05T11:36:53.925 INFO:tasks.workunit.client.0.smithi012.stdout: "data_extra_pool": "", 2023-10-05T11:36:53.925 INFO:tasks.workunit.client.0.smithi012.stdout: "index_pool": ".index-pool" 2023-10-05T11:36:53.926 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.926 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2023-10-05T11:36:53.926 INFO:tasks.workunit.client.0.smithi012.stdout: "key": { 2023-10-05T11:36:53.926 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "myobj", 2023-10-05T11:36:53.926 INFO:tasks.workunit.client.0.smithi012.stdout: "instance": "inst", 2023-10-05T11:36:53.926 INFO:tasks.workunit.client.0.smithi012.stdout: "ns": "" 2023-10-05T11:36:53.926 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.926 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.926 INFO:tasks.workunit.client.0.smithi012.stdout:} 2023-10-05T11:36:53.927 INFO:tasks.workunit.client.0.smithi012.stdout:{ 2023-10-05T11:36:53.927 INFO:tasks.workunit.client.0.smithi012.stdout: "raw_obj": { 2023-10-05T11:36:53.927 INFO:tasks.workunit.client.0.smithi012.stdout: "pool": ".data-pool", 2023-10-05T11:36:53.927 INFO:tasks.workunit.client.0.smithi012.stdout: "oid": "marker__:inst_myobj", 2023-10-05T11:36:53.927 INFO:tasks.workunit.client.0.smithi012.stdout: "loc": "" 2023-10-05T11:36:53.927 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.927 INFO:tasks.workunit.client.0.smithi012.stdout:} 2023-10-05T11:36:53.928 INFO:tasks.workunit.client.0.smithi012.stdout:{ 2023-10-05T11:36:53.928 INFO:tasks.workunit.client.0.smithi012.stdout: "new_obj": { 2023-10-05T11:36:53.928 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket": { 2023-10-05T11:36:53.928 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "ebtest", 2023-10-05T11:36:53.928 INFO:tasks.workunit.client.0.smithi012.stdout: "marker": "marker", 2023-10-05T11:36:53.928 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket_id": "bucket-id", 2023-10-05T11:36:53.928 INFO:tasks.workunit.client.0.smithi012.stdout: "tenant": "", 2023-10-05T11:36:53.928 INFO:tasks.workunit.client.0.smithi012.stdout: "explicit_placement": { 2023-10-05T11:36:53.928 INFO:tasks.workunit.client.0.smithi012.stdout: "data_pool": ".data-pool", 2023-10-05T11:36:53.928 INFO:tasks.workunit.client.0.smithi012.stdout: "data_extra_pool": "", 2023-10-05T11:36:53.928 INFO:tasks.workunit.client.0.smithi012.stdout: "index_pool": ".index-pool" 2023-10-05T11:36:53.928 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.928 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2023-10-05T11:36:53.929 INFO:tasks.workunit.client.0.smithi012.stdout: "key": { 2023-10-05T11:36:53.929 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "myobj", 2023-10-05T11:36:53.929 INFO:tasks.workunit.client.0.smithi012.stdout: "instance": "inst", 2023-10-05T11:36:53.929 INFO:tasks.workunit.client.0.smithi012.stdout: "ns": "" 2023-10-05T11:36:53.929 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.929 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.929 INFO:tasks.workunit.client.0.smithi012.stdout:} 2023-10-05T11:36:53.929 INFO:tasks.workunit.client.0.smithi012.stdout:{ 2023-10-05T11:36:53.929 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket": { 2023-10-05T11:36:53.929 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "test", 2023-10-05T11:36:53.929 INFO:tasks.workunit.client.0.smithi012.stdout: "marker": "marker", 2023-10-05T11:36:53.929 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket_id": "bucket-id", 2023-10-05T11:36:53.930 INFO:tasks.workunit.client.0.smithi012.stdout: "tenant": "", 2023-10-05T11:36:53.930 INFO:tasks.workunit.client.0.smithi012.stdout: "explicit_placement": { 2023-10-05T11:36:53.930 INFO:tasks.workunit.client.0.smithi012.stdout: "data_pool": "", 2023-10-05T11:36:53.930 INFO:tasks.workunit.client.0.smithi012.stdout: "data_extra_pool": "", 2023-10-05T11:36:53.930 INFO:tasks.workunit.client.0.smithi012.stdout: "index_pool": "" 2023-10-05T11:36:53.930 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.930 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.930 INFO:tasks.workunit.client.0.smithi012.stdout:} 2023-10-05T11:36:53.930 INFO:tasks.workunit.client.0.smithi012.stdout:{ 2023-10-05T11:36:53.930 INFO:tasks.workunit.client.0.smithi012.stdout: "obj": { 2023-10-05T11:36:53.931 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket": { 2023-10-05T11:36:53.931 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "test", 2023-10-05T11:36:53.931 INFO:tasks.workunit.client.0.smithi012.stdout: "marker": "marker", 2023-10-05T11:36:53.931 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket_id": "bucket-id", 2023-10-05T11:36:53.931 INFO:tasks.workunit.client.0.smithi012.stdout: "tenant": "", 2023-10-05T11:36:53.931 INFO:tasks.workunit.client.0.smithi012.stdout: "explicit_placement": { 2023-10-05T11:36:53.931 INFO:tasks.workunit.client.0.smithi012.stdout: "data_pool": "", 2023-10-05T11:36:53.931 INFO:tasks.workunit.client.0.smithi012.stdout: "data_extra_pool": "", 2023-10-05T11:36:53.931 INFO:tasks.workunit.client.0.smithi012.stdout: "index_pool": "" 2023-10-05T11:36:53.931 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.931 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2023-10-05T11:36:53.932 INFO:tasks.workunit.client.0.smithi012.stdout: "key": { 2023-10-05T11:36:53.932 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "myobj", 2023-10-05T11:36:53.932 INFO:tasks.workunit.client.0.smithi012.stdout: "instance": "inst", 2023-10-05T11:36:53.932 INFO:tasks.workunit.client.0.smithi012.stdout: "ns": "ns" 2023-10-05T11:36:53.932 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.932 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.932 INFO:tasks.workunit.client.0.smithi012.stdout:} 2023-10-05T11:36:53.932 INFO:tasks.workunit.client.0.smithi012.stdout:{ 2023-10-05T11:36:53.932 INFO:tasks.workunit.client.0.smithi012.stdout: "raw_obj": { 2023-10-05T11:36:53.932 INFO:tasks.workunit.client.0.smithi012.stdout: "pool": "default-placement.data", 2023-10-05T11:36:53.932 INFO:tasks.workunit.client.0.smithi012.stdout: "oid": "marker__ns:inst_myobj", 2023-10-05T11:36:53.932 INFO:tasks.workunit.client.0.smithi012.stdout: "loc": "" 2023-10-05T11:36:53.933 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.933 INFO:tasks.workunit.client.0.smithi012.stdout:} 2023-10-05T11:36:53.933 INFO:tasks.workunit.client.0.smithi012.stdout:{ 2023-10-05T11:36:53.933 INFO:tasks.workunit.client.0.smithi012.stdout: "new_obj": { 2023-10-05T11:36:53.933 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket": { 2023-10-05T11:36:53.933 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "test", 2023-10-05T11:36:53.933 INFO:tasks.workunit.client.0.smithi012.stdout: "marker": "marker", 2023-10-05T11:36:53.933 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket_id": "bucket-id", 2023-10-05T11:36:53.933 INFO:tasks.workunit.client.0.smithi012.stdout: "tenant": "", 2023-10-05T11:36:53.933 INFO:tasks.workunit.client.0.smithi012.stdout: "explicit_placement": { 2023-10-05T11:36:53.933 INFO:tasks.workunit.client.0.smithi012.stdout: "data_pool": "", 2023-10-05T11:36:53.933 INFO:tasks.workunit.client.0.smithi012.stdout: "data_extra_pool": "", 2023-10-05T11:36:53.934 INFO:tasks.workunit.client.0.smithi012.stdout: "index_pool": "" 2023-10-05T11:36:53.934 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.934 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2023-10-05T11:36:53.934 INFO:tasks.workunit.client.0.smithi012.stdout: "key": { 2023-10-05T11:36:53.934 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "myobj", 2023-10-05T11:36:53.934 INFO:tasks.workunit.client.0.smithi012.stdout: "instance": "inst", 2023-10-05T11:36:53.934 INFO:tasks.workunit.client.0.smithi012.stdout: "ns": "ns" 2023-10-05T11:36:53.934 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.934 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.934 INFO:tasks.workunit.client.0.smithi012.stdout:} 2023-10-05T11:36:53.934 INFO:tasks.workunit.client.0.smithi012.stdout:{ 2023-10-05T11:36:53.935 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket": { 2023-10-05T11:36:53.935 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "ebtest", 2023-10-05T11:36:53.935 INFO:tasks.workunit.client.0.smithi012.stdout: "marker": "marker", 2023-10-05T11:36:53.935 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket_id": "bucket-id", 2023-10-05T11:36:53.935 INFO:tasks.workunit.client.0.smithi012.stdout: "tenant": "", 2023-10-05T11:36:53.935 INFO:tasks.workunit.client.0.smithi012.stdout: "explicit_placement": { 2023-10-05T11:36:53.935 INFO:tasks.workunit.client.0.smithi012.stdout: "data_pool": ".data-pool", 2023-10-05T11:36:53.935 INFO:tasks.workunit.client.0.smithi012.stdout: "data_extra_pool": "", 2023-10-05T11:36:53.935 INFO:tasks.workunit.client.0.smithi012.stdout: "index_pool": ".index-pool" 2023-10-05T11:36:53.935 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.935 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.936 INFO:tasks.workunit.client.0.smithi012.stdout:} 2023-10-05T11:36:53.936 INFO:tasks.workunit.client.0.smithi012.stdout:{ 2023-10-05T11:36:53.936 INFO:tasks.workunit.client.0.smithi012.stdout: "obj": { 2023-10-05T11:36:53.936 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket": { 2023-10-05T11:36:53.936 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "ebtest", 2023-10-05T11:36:53.936 INFO:tasks.workunit.client.0.smithi012.stdout: "marker": "marker", 2023-10-05T11:36:53.936 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket_id": "bucket-id", 2023-10-05T11:36:53.936 INFO:tasks.workunit.client.0.smithi012.stdout: "tenant": "", 2023-10-05T11:36:53.936 INFO:tasks.workunit.client.0.smithi012.stdout: "explicit_placement": { 2023-10-05T11:36:53.936 INFO:tasks.workunit.client.0.smithi012.stdout: "data_pool": ".data-pool", 2023-10-05T11:36:53.936 INFO:tasks.workunit.client.0.smithi012.stdout: "data_extra_pool": "", 2023-10-05T11:36:53.937 INFO:tasks.workunit.client.0.smithi012.stdout: "index_pool": ".index-pool" 2023-10-05T11:36:53.937 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.937 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2023-10-05T11:36:53.937 INFO:tasks.workunit.client.0.smithi012.stdout: "key": { 2023-10-05T11:36:53.937 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "myobj", 2023-10-05T11:36:53.937 INFO:tasks.workunit.client.0.smithi012.stdout: "instance": "inst", 2023-10-05T11:36:53.937 INFO:tasks.workunit.client.0.smithi012.stdout: "ns": "ns" 2023-10-05T11:36:53.937 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.937 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.937 INFO:tasks.workunit.client.0.smithi012.stdout:} 2023-10-05T11:36:53.937 INFO:tasks.workunit.client.0.smithi012.stdout:{ 2023-10-05T11:36:53.938 INFO:tasks.workunit.client.0.smithi012.stdout: "raw_obj": { 2023-10-05T11:36:53.938 INFO:tasks.workunit.client.0.smithi012.stdout: "pool": ".data-pool", 2023-10-05T11:36:53.938 INFO:tasks.workunit.client.0.smithi012.stdout: "oid": "marker__ns:inst_myobj", 2023-10-05T11:36:53.938 INFO:tasks.workunit.client.0.smithi012.stdout: "loc": "" 2023-10-05T11:36:53.938 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.938 INFO:tasks.workunit.client.0.smithi012.stdout:} 2023-10-05T11:36:53.938 INFO:tasks.workunit.client.0.smithi012.stdout:{ 2023-10-05T11:36:53.938 INFO:tasks.workunit.client.0.smithi012.stdout: "new_obj": { 2023-10-05T11:36:53.938 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket": { 2023-10-05T11:36:53.939 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "ebtest", 2023-10-05T11:36:53.939 INFO:tasks.workunit.client.0.smithi012.stdout: "marker": "marker", 2023-10-05T11:36:53.939 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket_id": "bucket-id", 2023-10-05T11:36:53.939 INFO:tasks.workunit.client.0.smithi012.stdout: "tenant": "", 2023-10-05T11:36:53.939 INFO:tasks.workunit.client.0.smithi012.stdout: "explicit_placement": { 2023-10-05T11:36:53.939 INFO:tasks.workunit.client.0.smithi012.stdout: "data_pool": ".data-pool", 2023-10-05T11:36:53.939 INFO:tasks.workunit.client.0.smithi012.stdout: "data_extra_pool": "", 2023-10-05T11:36:53.939 INFO:tasks.workunit.client.0.smithi012.stdout: "index_pool": ".index-pool" 2023-10-05T11:36:53.939 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.940 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2023-10-05T11:36:53.940 INFO:tasks.workunit.client.0.smithi012.stdout: "key": { 2023-10-05T11:36:53.940 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "myobj", 2023-10-05T11:36:53.940 INFO:tasks.workunit.client.0.smithi012.stdout: "instance": "inst", 2023-10-05T11:36:53.940 INFO:tasks.workunit.client.0.smithi012.stdout: "ns": "ns" 2023-10-05T11:36:53.940 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.940 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.940 INFO:tasks.workunit.client.0.smithi012.stdout:} 2023-10-05T11:36:53.940 INFO:tasks.workunit.client.0.smithi012.stdout:{ 2023-10-05T11:36:53.941 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket": { 2023-10-05T11:36:53.941 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "test", 2023-10-05T11:36:53.941 INFO:tasks.workunit.client.0.smithi012.stdout: "marker": "marker", 2023-10-05T11:36:53.941 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket_id": "bucket-id", 2023-10-05T11:36:53.941 INFO:tasks.workunit.client.0.smithi012.stdout: "tenant": "", 2023-10-05T11:36:53.941 INFO:tasks.workunit.client.0.smithi012.stdout: "explicit_placement": { 2023-10-05T11:36:53.941 INFO:tasks.workunit.client.0.smithi012.stdout: "data_pool": "", 2023-10-05T11:36:53.941 INFO:tasks.workunit.client.0.smithi012.stdout: "data_extra_pool": "", 2023-10-05T11:36:53.941 INFO:tasks.workunit.client.0.smithi012.stdout: "index_pool": "" 2023-10-05T11:36:53.941 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.941 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.941 INFO:tasks.workunit.client.0.smithi012.stdout:} 2023-10-05T11:36:53.942 INFO:tasks.workunit.client.0.smithi012.stdout:{ 2023-10-05T11:36:53.942 INFO:tasks.workunit.client.0.smithi012.stdout: "obj": { 2023-10-05T11:36:53.942 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket": { 2023-10-05T11:36:53.942 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "test", 2023-10-05T11:36:53.942 INFO:tasks.workunit.client.0.smithi012.stdout: "marker": "marker", 2023-10-05T11:36:53.942 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket_id": "bucket-id", 2023-10-05T11:36:53.942 INFO:tasks.workunit.client.0.smithi012.stdout: "tenant": "", 2023-10-05T11:36:53.942 INFO:tasks.workunit.client.0.smithi012.stdout: "explicit_placement": { 2023-10-05T11:36:53.942 INFO:tasks.workunit.client.0.smithi012.stdout: "data_pool": "", 2023-10-05T11:36:53.942 INFO:tasks.workunit.client.0.smithi012.stdout: "data_extra_pool": "", 2023-10-05T11:36:53.942 INFO:tasks.workunit.client.0.smithi012.stdout: "index_pool": "" 2023-10-05T11:36:53.943 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.943 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2023-10-05T11:36:53.943 INFO:tasks.workunit.client.0.smithi012.stdout: "key": { 2023-10-05T11:36:53.943 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "_myobj", 2023-10-05T11:36:53.943 INFO:tasks.workunit.client.0.smithi012.stdout: "instance": "", 2023-10-05T11:36:53.943 INFO:tasks.workunit.client.0.smithi012.stdout: "ns": "" 2023-10-05T11:36:53.943 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.943 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.943 INFO:tasks.workunit.client.0.smithi012.stdout:} 2023-10-05T11:36:53.943 INFO:tasks.workunit.client.0.smithi012.stdout:{ 2023-10-05T11:36:53.943 INFO:tasks.workunit.client.0.smithi012.stdout: "raw_obj": { 2023-10-05T11:36:53.944 INFO:tasks.workunit.client.0.smithi012.stdout: "pool": "default-placement.data", 2023-10-05T11:36:53.944 INFO:tasks.workunit.client.0.smithi012.stdout: "oid": "marker___myobj", 2023-10-05T11:36:53.944 INFO:tasks.workunit.client.0.smithi012.stdout: "loc": "marker__myobj" 2023-10-05T11:36:53.944 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.944 INFO:tasks.workunit.client.0.smithi012.stdout:} 2023-10-05T11:36:53.944 INFO:tasks.workunit.client.0.smithi012.stdout:{ 2023-10-05T11:36:53.944 INFO:tasks.workunit.client.0.smithi012.stdout: "new_obj": { 2023-10-05T11:36:53.944 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket": { 2023-10-05T11:36:53.944 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "test", 2023-10-05T11:36:53.944 INFO:tasks.workunit.client.0.smithi012.stdout: "marker": "marker", 2023-10-05T11:36:53.945 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket_id": "bucket-id", 2023-10-05T11:36:53.945 INFO:tasks.workunit.client.0.smithi012.stdout: "tenant": "", 2023-10-05T11:36:53.945 INFO:tasks.workunit.client.0.smithi012.stdout: "explicit_placement": { 2023-10-05T11:36:53.945 INFO:tasks.workunit.client.0.smithi012.stdout: "data_pool": "", 2023-10-05T11:36:53.945 INFO:tasks.workunit.client.0.smithi012.stdout: "data_extra_pool": "", 2023-10-05T11:36:53.945 INFO:tasks.workunit.client.0.smithi012.stdout: "index_pool": "" 2023-10-05T11:36:53.945 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.945 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2023-10-05T11:36:53.945 INFO:tasks.workunit.client.0.smithi012.stdout: "key": { 2023-10-05T11:36:53.946 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "_myobj", 2023-10-05T11:36:53.946 INFO:tasks.workunit.client.0.smithi012.stdout: "instance": "", 2023-10-05T11:36:53.946 INFO:tasks.workunit.client.0.smithi012.stdout: "ns": "" 2023-10-05T11:36:53.946 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.946 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.946 INFO:tasks.workunit.client.0.smithi012.stdout:} 2023-10-05T11:36:53.946 INFO:tasks.workunit.client.0.smithi012.stdout:{ 2023-10-05T11:36:53.946 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket": { 2023-10-05T11:36:53.946 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "ebtest", 2023-10-05T11:36:53.947 INFO:tasks.workunit.client.0.smithi012.stdout: "marker": "marker", 2023-10-05T11:36:53.947 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket_id": "bucket-id", 2023-10-05T11:36:53.947 INFO:tasks.workunit.client.0.smithi012.stdout: "tenant": "", 2023-10-05T11:36:53.947 INFO:tasks.workunit.client.0.smithi012.stdout: "explicit_placement": { 2023-10-05T11:36:53.947 INFO:tasks.workunit.client.0.smithi012.stdout: "data_pool": ".data-pool", 2023-10-05T11:36:53.947 INFO:tasks.workunit.client.0.smithi012.stdout: "data_extra_pool": "", 2023-10-05T11:36:53.947 INFO:tasks.workunit.client.0.smithi012.stdout: "index_pool": ".index-pool" 2023-10-05T11:36:53.947 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.947 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.947 INFO:tasks.workunit.client.0.smithi012.stdout:} 2023-10-05T11:36:53.947 INFO:tasks.workunit.client.0.smithi012.stdout:{ 2023-10-05T11:36:53.947 INFO:tasks.workunit.client.0.smithi012.stdout: "obj": { 2023-10-05T11:36:53.948 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket": { 2023-10-05T11:36:53.948 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "ebtest", 2023-10-05T11:36:53.948 INFO:tasks.workunit.client.0.smithi012.stdout: "marker": "marker", 2023-10-05T11:36:53.948 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket_id": "bucket-id", 2023-10-05T11:36:53.948 INFO:tasks.workunit.client.0.smithi012.stdout: "tenant": "", 2023-10-05T11:36:53.948 INFO:tasks.workunit.client.0.smithi012.stdout: "explicit_placement": { 2023-10-05T11:36:53.948 INFO:tasks.workunit.client.0.smithi012.stdout: "data_pool": ".data-pool", 2023-10-05T11:36:53.948 INFO:tasks.workunit.client.0.smithi012.stdout: "data_extra_pool": "", 2023-10-05T11:36:53.948 INFO:tasks.workunit.client.0.smithi012.stdout: "index_pool": ".index-pool" 2023-10-05T11:36:53.949 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.949 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2023-10-05T11:36:53.949 INFO:tasks.workunit.client.0.smithi012.stdout: "key": { 2023-10-05T11:36:53.949 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "_myobj", 2023-10-05T11:36:53.949 INFO:tasks.workunit.client.0.smithi012.stdout: "instance": "", 2023-10-05T11:36:53.949 INFO:tasks.workunit.client.0.smithi012.stdout: "ns": "" 2023-10-05T11:36:53.949 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.949 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.949 INFO:tasks.workunit.client.0.smithi012.stdout:} 2023-10-05T11:36:53.949 INFO:tasks.workunit.client.0.smithi012.stdout:{ 2023-10-05T11:36:53.949 INFO:tasks.workunit.client.0.smithi012.stdout: "raw_obj": { 2023-10-05T11:36:53.950 INFO:tasks.workunit.client.0.smithi012.stdout: "pool": ".data-pool", 2023-10-05T11:36:53.950 INFO:tasks.workunit.client.0.smithi012.stdout: "oid": "marker___myobj", 2023-10-05T11:36:53.950 INFO:tasks.workunit.client.0.smithi012.stdout: "loc": "marker__myobj" 2023-10-05T11:36:53.950 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.950 INFO:tasks.workunit.client.0.smithi012.stdout:} 2023-10-05T11:36:53.950 INFO:tasks.workunit.client.0.smithi012.stdout:{ 2023-10-05T11:36:53.950 INFO:tasks.workunit.client.0.smithi012.stdout: "new_obj": { 2023-10-05T11:36:53.951 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket": { 2023-10-05T11:36:53.951 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "ebtest", 2023-10-05T11:36:53.951 INFO:tasks.workunit.client.0.smithi012.stdout: "marker": "marker", 2023-10-05T11:36:53.951 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket_id": "bucket-id", 2023-10-05T11:36:53.951 INFO:tasks.workunit.client.0.smithi012.stdout: "tenant": "", 2023-10-05T11:36:53.951 INFO:tasks.workunit.client.0.smithi012.stdout: "explicit_placement": { 2023-10-05T11:36:53.951 INFO:tasks.workunit.client.0.smithi012.stdout: "data_pool": ".data-pool", 2023-10-05T11:36:53.951 INFO:tasks.workunit.client.0.smithi012.stdout: "data_extra_pool": "", 2023-10-05T11:36:53.951 INFO:tasks.workunit.client.0.smithi012.stdout: "index_pool": ".index-pool" 2023-10-05T11:36:53.951 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.951 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2023-10-05T11:36:53.951 INFO:tasks.workunit.client.0.smithi012.stdout: "key": { 2023-10-05T11:36:53.952 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "_myobj", 2023-10-05T11:36:53.952 INFO:tasks.workunit.client.0.smithi012.stdout: "instance": "", 2023-10-05T11:36:53.952 INFO:tasks.workunit.client.0.smithi012.stdout: "ns": "" 2023-10-05T11:36:53.952 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.952 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.952 INFO:tasks.workunit.client.0.smithi012.stdout:} 2023-10-05T11:36:53.952 INFO:tasks.workunit.client.0.smithi012.stdout:{ 2023-10-05T11:36:53.952 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket": { 2023-10-05T11:36:53.952 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "test", 2023-10-05T11:36:53.952 INFO:tasks.workunit.client.0.smithi012.stdout: "marker": "marker", 2023-10-05T11:36:53.952 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket_id": "bucket-id", 2023-10-05T11:36:53.952 INFO:tasks.workunit.client.0.smithi012.stdout: "tenant": "", 2023-10-05T11:36:53.953 INFO:tasks.workunit.client.0.smithi012.stdout: "explicit_placement": { 2023-10-05T11:36:53.953 INFO:tasks.workunit.client.0.smithi012.stdout: "data_pool": "", 2023-10-05T11:36:53.953 INFO:tasks.workunit.client.0.smithi012.stdout: "data_extra_pool": "", 2023-10-05T11:36:53.953 INFO:tasks.workunit.client.0.smithi012.stdout: "index_pool": "" 2023-10-05T11:36:53.953 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.953 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.953 INFO:tasks.workunit.client.0.smithi012.stdout:} 2023-10-05T11:36:53.953 INFO:tasks.workunit.client.0.smithi012.stdout:{ 2023-10-05T11:36:53.953 INFO:tasks.workunit.client.0.smithi012.stdout: "obj": { 2023-10-05T11:36:53.953 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket": { 2023-10-05T11:36:53.953 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "test", 2023-10-05T11:36:53.954 INFO:tasks.workunit.client.0.smithi012.stdout: "marker": "marker", 2023-10-05T11:36:53.954 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket_id": "bucket-id", 2023-10-05T11:36:53.954 INFO:tasks.workunit.client.0.smithi012.stdout: "tenant": "", 2023-10-05T11:36:53.954 INFO:tasks.workunit.client.0.smithi012.stdout: "explicit_placement": { 2023-10-05T11:36:53.954 INFO:tasks.workunit.client.0.smithi012.stdout: "data_pool": "", 2023-10-05T11:36:53.954 INFO:tasks.workunit.client.0.smithi012.stdout: "data_extra_pool": "", 2023-10-05T11:36:53.954 INFO:tasks.workunit.client.0.smithi012.stdout: "index_pool": "" 2023-10-05T11:36:53.954 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.954 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2023-10-05T11:36:53.954 INFO:tasks.workunit.client.0.smithi012.stdout: "key": { 2023-10-05T11:36:53.954 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "_myobj", 2023-10-05T11:36:53.954 INFO:tasks.workunit.client.0.smithi012.stdout: "instance": "", 2023-10-05T11:36:53.955 INFO:tasks.workunit.client.0.smithi012.stdout: "ns": "ns" 2023-10-05T11:36:53.955 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.955 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.955 INFO:tasks.workunit.client.0.smithi012.stdout:} 2023-10-05T11:36:53.955 INFO:tasks.workunit.client.0.smithi012.stdout:{ 2023-10-05T11:36:53.955 INFO:tasks.workunit.client.0.smithi012.stdout: "raw_obj": { 2023-10-05T11:36:53.955 INFO:tasks.workunit.client.0.smithi012.stdout: "pool": "default-placement.data", 2023-10-05T11:36:53.955 INFO:tasks.workunit.client.0.smithi012.stdout: "oid": "marker__ns__myobj", 2023-10-05T11:36:53.955 INFO:tasks.workunit.client.0.smithi012.stdout: "loc": "" 2023-10-05T11:36:53.955 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.955 INFO:tasks.workunit.client.0.smithi012.stdout:} 2023-10-05T11:36:53.955 INFO:tasks.workunit.client.0.smithi012.stdout:{ 2023-10-05T11:36:53.956 INFO:tasks.workunit.client.0.smithi012.stdout: "new_obj": { 2023-10-05T11:36:53.956 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket": { 2023-10-05T11:36:53.956 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "test", 2023-10-05T11:36:53.956 INFO:tasks.workunit.client.0.smithi012.stdout: "marker": "marker", 2023-10-05T11:36:53.956 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket_id": "bucket-id", 2023-10-05T11:36:53.956 INFO:tasks.workunit.client.0.smithi012.stdout: "tenant": "", 2023-10-05T11:36:53.956 INFO:tasks.workunit.client.0.smithi012.stdout: "explicit_placement": { 2023-10-05T11:36:53.956 INFO:tasks.workunit.client.0.smithi012.stdout: "data_pool": "", 2023-10-05T11:36:53.956 INFO:tasks.workunit.client.0.smithi012.stdout: "data_extra_pool": "", 2023-10-05T11:36:53.957 INFO:tasks.workunit.client.0.smithi012.stdout: "index_pool": "" 2023-10-05T11:36:53.957 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.957 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2023-10-05T11:36:53.957 INFO:tasks.workunit.client.0.smithi012.stdout: "key": { 2023-10-05T11:36:53.957 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "_myobj", 2023-10-05T11:36:53.957 INFO:tasks.workunit.client.0.smithi012.stdout: "instance": "", 2023-10-05T11:36:53.957 INFO:tasks.workunit.client.0.smithi012.stdout: "ns": "ns" 2023-10-05T11:36:53.957 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.957 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.957 INFO:tasks.workunit.client.0.smithi012.stdout:} 2023-10-05T11:36:53.958 INFO:tasks.workunit.client.0.smithi012.stdout:{ 2023-10-05T11:36:53.958 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket": { 2023-10-05T11:36:53.958 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "ebtest", 2023-10-05T11:36:53.958 INFO:tasks.workunit.client.0.smithi012.stdout: "marker": "marker", 2023-10-05T11:36:53.958 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket_id": "bucket-id", 2023-10-05T11:36:53.958 INFO:tasks.workunit.client.0.smithi012.stdout: "tenant": "", 2023-10-05T11:36:53.958 INFO:tasks.workunit.client.0.smithi012.stdout: "explicit_placement": { 2023-10-05T11:36:53.958 INFO:tasks.workunit.client.0.smithi012.stdout: "data_pool": ".data-pool", 2023-10-05T11:36:53.958 INFO:tasks.workunit.client.0.smithi012.stdout: "data_extra_pool": "", 2023-10-05T11:36:53.958 INFO:tasks.workunit.client.0.smithi012.stdout: "index_pool": ".index-pool" 2023-10-05T11:36:53.958 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.958 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.959 INFO:tasks.workunit.client.0.smithi012.stdout:} 2023-10-05T11:36:53.959 INFO:tasks.workunit.client.0.smithi012.stdout:{ 2023-10-05T11:36:53.959 INFO:tasks.workunit.client.0.smithi012.stdout: "obj": { 2023-10-05T11:36:53.959 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket": { 2023-10-05T11:36:53.959 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "ebtest", 2023-10-05T11:36:53.959 INFO:tasks.workunit.client.0.smithi012.stdout: "marker": "marker", 2023-10-05T11:36:53.959 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket_id": "bucket-id", 2023-10-05T11:36:53.959 INFO:tasks.workunit.client.0.smithi012.stdout: "tenant": "", 2023-10-05T11:36:53.959 INFO:tasks.workunit.client.0.smithi012.stdout: "explicit_placement": { 2023-10-05T11:36:53.960 INFO:tasks.workunit.client.0.smithi012.stdout: "data_pool": ".data-pool", 2023-10-05T11:36:53.960 INFO:tasks.workunit.client.0.smithi012.stdout: "data_extra_pool": "", 2023-10-05T11:36:53.960 INFO:tasks.workunit.client.0.smithi012.stdout: "index_pool": ".index-pool" 2023-10-05T11:36:53.960 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.960 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2023-10-05T11:36:53.960 INFO:tasks.workunit.client.0.smithi012.stdout: "key": { 2023-10-05T11:36:53.960 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "_myobj", 2023-10-05T11:36:53.960 INFO:tasks.workunit.client.0.smithi012.stdout: "instance": "", 2023-10-05T11:36:53.960 INFO:tasks.workunit.client.0.smithi012.stdout: "ns": "ns" 2023-10-05T11:36:53.960 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.960 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.960 INFO:tasks.workunit.client.0.smithi012.stdout:} 2023-10-05T11:36:53.961 INFO:tasks.workunit.client.0.smithi012.stdout:{ 2023-10-05T11:36:53.961 INFO:tasks.workunit.client.0.smithi012.stdout: "raw_obj": { 2023-10-05T11:36:53.961 INFO:tasks.workunit.client.0.smithi012.stdout: "pool": ".data-pool", 2023-10-05T11:36:53.961 INFO:tasks.workunit.client.0.smithi012.stdout: "oid": "marker__ns__myobj", 2023-10-05T11:36:53.961 INFO:tasks.workunit.client.0.smithi012.stdout: "loc": "" 2023-10-05T11:36:53.961 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.961 INFO:tasks.workunit.client.0.smithi012.stdout:} 2023-10-05T11:36:53.961 INFO:tasks.workunit.client.0.smithi012.stdout:{ 2023-10-05T11:36:53.961 INFO:tasks.workunit.client.0.smithi012.stdout: "new_obj": { 2023-10-05T11:36:53.961 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket": { 2023-10-05T11:36:53.961 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "ebtest", 2023-10-05T11:36:53.961 INFO:tasks.workunit.client.0.smithi012.stdout: "marker": "marker", 2023-10-05T11:36:53.962 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket_id": "bucket-id", 2023-10-05T11:36:53.962 INFO:tasks.workunit.client.0.smithi012.stdout: "tenant": "", 2023-10-05T11:36:53.962 INFO:tasks.workunit.client.0.smithi012.stdout: "explicit_placement": { 2023-10-05T11:36:53.962 INFO:tasks.workunit.client.0.smithi012.stdout: "data_pool": ".data-pool", 2023-10-05T11:36:53.962 INFO:tasks.workunit.client.0.smithi012.stdout: "data_extra_pool": "", 2023-10-05T11:36:53.962 INFO:tasks.workunit.client.0.smithi012.stdout: "index_pool": ".index-pool" 2023-10-05T11:36:53.962 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.962 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2023-10-05T11:36:53.962 INFO:tasks.workunit.client.0.smithi012.stdout: "key": { 2023-10-05T11:36:53.962 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "_myobj", 2023-10-05T11:36:53.962 INFO:tasks.workunit.client.0.smithi012.stdout: "instance": "", 2023-10-05T11:36:53.962 INFO:tasks.workunit.client.0.smithi012.stdout: "ns": "ns" 2023-10-05T11:36:53.963 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.963 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.963 INFO:tasks.workunit.client.0.smithi012.stdout:} 2023-10-05T11:36:53.963 INFO:tasks.workunit.client.0.smithi012.stdout:{ 2023-10-05T11:36:53.963 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket": { 2023-10-05T11:36:53.963 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "test", 2023-10-05T11:36:53.963 INFO:tasks.workunit.client.0.smithi012.stdout: "marker": "marker", 2023-10-05T11:36:53.963 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket_id": "bucket-id", 2023-10-05T11:36:53.963 INFO:tasks.workunit.client.0.smithi012.stdout: "tenant": "", 2023-10-05T11:36:53.963 INFO:tasks.workunit.client.0.smithi012.stdout: "explicit_placement": { 2023-10-05T11:36:53.963 INFO:tasks.workunit.client.0.smithi012.stdout: "data_pool": "", 2023-10-05T11:36:53.963 INFO:tasks.workunit.client.0.smithi012.stdout: "data_extra_pool": "", 2023-10-05T11:36:53.964 INFO:tasks.workunit.client.0.smithi012.stdout: "index_pool": "" 2023-10-05T11:36:53.964 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.964 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.964 INFO:tasks.workunit.client.0.smithi012.stdout:} 2023-10-05T11:36:53.964 INFO:tasks.workunit.client.0.smithi012.stdout:{ 2023-10-05T11:36:53.964 INFO:tasks.workunit.client.0.smithi012.stdout: "obj": { 2023-10-05T11:36:53.964 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket": { 2023-10-05T11:36:53.964 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "test", 2023-10-05T11:36:53.964 INFO:tasks.workunit.client.0.smithi012.stdout: "marker": "marker", 2023-10-05T11:36:53.964 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket_id": "bucket-id", 2023-10-05T11:36:53.964 INFO:tasks.workunit.client.0.smithi012.stdout: "tenant": "", 2023-10-05T11:36:53.964 INFO:tasks.workunit.client.0.smithi012.stdout: "explicit_placement": { 2023-10-05T11:36:53.965 INFO:tasks.workunit.client.0.smithi012.stdout: "data_pool": "", 2023-10-05T11:36:53.965 INFO:tasks.workunit.client.0.smithi012.stdout: "data_extra_pool": "", 2023-10-05T11:36:53.965 INFO:tasks.workunit.client.0.smithi012.stdout: "index_pool": "" 2023-10-05T11:36:53.965 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.965 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2023-10-05T11:36:53.965 INFO:tasks.workunit.client.0.smithi012.stdout: "key": { 2023-10-05T11:36:53.965 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "_myobj", 2023-10-05T11:36:53.965 INFO:tasks.workunit.client.0.smithi012.stdout: "instance": "inst", 2023-10-05T11:36:53.965 INFO:tasks.workunit.client.0.smithi012.stdout: "ns": "" 2023-10-05T11:36:53.965 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.965 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.965 INFO:tasks.workunit.client.0.smithi012.stdout:} 2023-10-05T11:36:53.965 INFO:tasks.workunit.client.0.smithi012.stdout:{ 2023-10-05T11:36:53.966 INFO:tasks.workunit.client.0.smithi012.stdout: "raw_obj": { 2023-10-05T11:36:53.966 INFO:tasks.workunit.client.0.smithi012.stdout: "pool": "default-placement.data", 2023-10-05T11:36:53.966 INFO:tasks.workunit.client.0.smithi012.stdout: "oid": "marker__:inst__myobj", 2023-10-05T11:36:53.966 INFO:tasks.workunit.client.0.smithi012.stdout: "loc": "marker__myobj" 2023-10-05T11:36:53.966 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.966 INFO:tasks.workunit.client.0.smithi012.stdout:} 2023-10-05T11:36:53.966 INFO:tasks.workunit.client.0.smithi012.stdout:{ 2023-10-05T11:36:53.966 INFO:tasks.workunit.client.0.smithi012.stdout: "new_obj": { 2023-10-05T11:36:53.966 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket": { 2023-10-05T11:36:53.966 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "test", 2023-10-05T11:36:53.966 INFO:tasks.workunit.client.0.smithi012.stdout: "marker": "marker", 2023-10-05T11:36:53.966 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket_id": "bucket-id", 2023-10-05T11:36:53.967 INFO:tasks.workunit.client.0.smithi012.stdout: "tenant": "", 2023-10-05T11:36:53.967 INFO:tasks.workunit.client.0.smithi012.stdout: "explicit_placement": { 2023-10-05T11:36:53.967 INFO:tasks.workunit.client.0.smithi012.stdout: "data_pool": "", 2023-10-05T11:36:53.967 INFO:tasks.workunit.client.0.smithi012.stdout: "data_extra_pool": "", 2023-10-05T11:36:53.967 INFO:tasks.workunit.client.0.smithi012.stdout: "index_pool": "" 2023-10-05T11:36:53.967 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.967 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2023-10-05T11:36:53.967 INFO:tasks.workunit.client.0.smithi012.stdout: "key": { 2023-10-05T11:36:53.967 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "_myobj", 2023-10-05T11:36:53.967 INFO:tasks.workunit.client.0.smithi012.stdout: "instance": "inst", 2023-10-05T11:36:53.967 INFO:tasks.workunit.client.0.smithi012.stdout: "ns": "" 2023-10-05T11:36:53.968 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.968 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.968 INFO:tasks.workunit.client.0.smithi012.stdout:} 2023-10-05T11:36:53.968 INFO:tasks.workunit.client.0.smithi012.stdout:{ 2023-10-05T11:36:53.968 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket": { 2023-10-05T11:36:53.968 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "ebtest", 2023-10-05T11:36:53.968 INFO:tasks.workunit.client.0.smithi012.stdout: "marker": "marker", 2023-10-05T11:36:53.968 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket_id": "bucket-id", 2023-10-05T11:36:53.968 INFO:tasks.workunit.client.0.smithi012.stdout: "tenant": "", 2023-10-05T11:36:53.968 INFO:tasks.workunit.client.0.smithi012.stdout: "explicit_placement": { 2023-10-05T11:36:53.968 INFO:tasks.workunit.client.0.smithi012.stdout: "data_pool": ".data-pool", 2023-10-05T11:36:53.969 INFO:tasks.workunit.client.0.smithi012.stdout: "data_extra_pool": "", 2023-10-05T11:36:53.969 INFO:tasks.workunit.client.0.smithi012.stdout: "index_pool": ".index-pool" 2023-10-05T11:36:53.969 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.969 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.969 INFO:tasks.workunit.client.0.smithi012.stdout:} 2023-10-05T11:36:53.969 INFO:tasks.workunit.client.0.smithi012.stdout:{ 2023-10-05T11:36:53.969 INFO:tasks.workunit.client.0.smithi012.stdout: "obj": { 2023-10-05T11:36:53.969 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket": { 2023-10-05T11:36:53.969 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "ebtest", 2023-10-05T11:36:53.969 INFO:tasks.workunit.client.0.smithi012.stdout: "marker": "marker", 2023-10-05T11:36:53.969 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket_id": "bucket-id", 2023-10-05T11:36:53.970 INFO:tasks.workunit.client.0.smithi012.stdout: "tenant": "", 2023-10-05T11:36:53.970 INFO:tasks.workunit.client.0.smithi012.stdout: "explicit_placement": { 2023-10-05T11:36:53.970 INFO:tasks.workunit.client.0.smithi012.stdout: "data_pool": ".data-pool", 2023-10-05T11:36:53.970 INFO:tasks.workunit.client.0.smithi012.stdout: "data_extra_pool": "", 2023-10-05T11:36:53.970 INFO:tasks.workunit.client.0.smithi012.stdout: "index_pool": ".index-pool" 2023-10-05T11:36:53.970 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.970 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2023-10-05T11:36:53.970 INFO:tasks.workunit.client.0.smithi012.stdout: "key": { 2023-10-05T11:36:53.970 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "_myobj", 2023-10-05T11:36:53.971 INFO:tasks.workunit.client.0.smithi012.stdout: "instance": "inst", 2023-10-05T11:36:53.971 INFO:tasks.workunit.client.0.smithi012.stdout: "ns": "" 2023-10-05T11:36:53.971 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.971 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.971 INFO:tasks.workunit.client.0.smithi012.stdout:} 2023-10-05T11:36:53.971 INFO:tasks.workunit.client.0.smithi012.stdout:{ 2023-10-05T11:36:53.971 INFO:tasks.workunit.client.0.smithi012.stdout: "raw_obj": { 2023-10-05T11:36:53.971 INFO:tasks.workunit.client.0.smithi012.stdout: "pool": ".data-pool", 2023-10-05T11:36:53.971 INFO:tasks.workunit.client.0.smithi012.stdout: "oid": "marker__:inst__myobj", 2023-10-05T11:36:53.971 INFO:tasks.workunit.client.0.smithi012.stdout: "loc": "marker__myobj" 2023-10-05T11:36:53.971 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.971 INFO:tasks.workunit.client.0.smithi012.stdout:} 2023-10-05T11:36:53.971 INFO:tasks.workunit.client.0.smithi012.stdout:{ 2023-10-05T11:36:53.972 INFO:tasks.workunit.client.0.smithi012.stdout: "new_obj": { 2023-10-05T11:36:53.972 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket": { 2023-10-05T11:36:53.972 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "ebtest", 2023-10-05T11:36:53.972 INFO:tasks.workunit.client.0.smithi012.stdout: "marker": "marker", 2023-10-05T11:36:53.972 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket_id": "bucket-id", 2023-10-05T11:36:53.972 INFO:tasks.workunit.client.0.smithi012.stdout: "tenant": "", 2023-10-05T11:36:53.972 INFO:tasks.workunit.client.0.smithi012.stdout: "explicit_placement": { 2023-10-05T11:36:53.972 INFO:tasks.workunit.client.0.smithi012.stdout: "data_pool": ".data-pool", 2023-10-05T11:36:53.972 INFO:tasks.workunit.client.0.smithi012.stdout: "data_extra_pool": "", 2023-10-05T11:36:53.972 INFO:tasks.workunit.client.0.smithi012.stdout: "index_pool": ".index-pool" 2023-10-05T11:36:53.972 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.972 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2023-10-05T11:36:53.973 INFO:tasks.workunit.client.0.smithi012.stdout: "key": { 2023-10-05T11:36:53.973 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "_myobj", 2023-10-05T11:36:53.973 INFO:tasks.workunit.client.0.smithi012.stdout: "instance": "inst", 2023-10-05T11:36:53.973 INFO:tasks.workunit.client.0.smithi012.stdout: "ns": "" 2023-10-05T11:36:53.973 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.973 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.973 INFO:tasks.workunit.client.0.smithi012.stdout:} 2023-10-05T11:36:53.973 INFO:tasks.workunit.client.0.smithi012.stdout:{ 2023-10-05T11:36:53.973 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket": { 2023-10-05T11:36:53.973 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "test", 2023-10-05T11:36:53.973 INFO:tasks.workunit.client.0.smithi012.stdout: "marker": "marker", 2023-10-05T11:36:53.973 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket_id": "bucket-id", 2023-10-05T11:36:53.974 INFO:tasks.workunit.client.0.smithi012.stdout: "tenant": "", 2023-10-05T11:36:53.974 INFO:tasks.workunit.client.0.smithi012.stdout: "explicit_placement": { 2023-10-05T11:36:53.974 INFO:tasks.workunit.client.0.smithi012.stdout: "data_pool": "", 2023-10-05T11:36:53.974 INFO:tasks.workunit.client.0.smithi012.stdout: "data_extra_pool": "", 2023-10-05T11:36:53.974 INFO:tasks.workunit.client.0.smithi012.stdout: "index_pool": "" 2023-10-05T11:36:53.974 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.974 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.974 INFO:tasks.workunit.client.0.smithi012.stdout:} 2023-10-05T11:36:53.974 INFO:tasks.workunit.client.0.smithi012.stdout:{ 2023-10-05T11:36:53.975 INFO:tasks.workunit.client.0.smithi012.stdout: "obj": { 2023-10-05T11:36:53.975 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket": { 2023-10-05T11:36:53.975 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "test", 2023-10-05T11:36:53.975 INFO:tasks.workunit.client.0.smithi012.stdout: "marker": "marker", 2023-10-05T11:36:53.975 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket_id": "bucket-id", 2023-10-05T11:36:53.975 INFO:tasks.workunit.client.0.smithi012.stdout: "tenant": "", 2023-10-05T11:36:53.975 INFO:tasks.workunit.client.0.smithi012.stdout: "explicit_placement": { 2023-10-05T11:36:53.975 INFO:tasks.workunit.client.0.smithi012.stdout: "data_pool": "", 2023-10-05T11:36:53.975 INFO:tasks.workunit.client.0.smithi012.stdout: "data_extra_pool": "", 2023-10-05T11:36:53.975 INFO:tasks.workunit.client.0.smithi012.stdout: "index_pool": "" 2023-10-05T11:36:53.976 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.976 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2023-10-05T11:36:53.976 INFO:tasks.workunit.client.0.smithi012.stdout: "key": { 2023-10-05T11:36:53.976 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "_myobj", 2023-10-05T11:36:53.976 INFO:tasks.workunit.client.0.smithi012.stdout: "instance": "inst", 2023-10-05T11:36:53.976 INFO:tasks.workunit.client.0.smithi012.stdout: "ns": "ns" 2023-10-05T11:36:53.976 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.976 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.976 INFO:tasks.workunit.client.0.smithi012.stdout:} 2023-10-05T11:36:53.976 INFO:tasks.workunit.client.0.smithi012.stdout:{ 2023-10-05T11:36:53.977 INFO:tasks.workunit.client.0.smithi012.stdout: "raw_obj": { 2023-10-05T11:36:53.977 INFO:tasks.workunit.client.0.smithi012.stdout: "pool": "default-placement.data", 2023-10-05T11:36:53.977 INFO:tasks.workunit.client.0.smithi012.stdout: "oid": "marker__ns:inst__myobj", 2023-10-05T11:36:53.977 INFO:tasks.workunit.client.0.smithi012.stdout: "loc": "" 2023-10-05T11:36:53.977 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.977 INFO:tasks.workunit.client.0.smithi012.stdout:} 2023-10-05T11:36:53.977 INFO:tasks.workunit.client.0.smithi012.stdout:{ 2023-10-05T11:36:53.977 INFO:tasks.workunit.client.0.smithi012.stdout: "new_obj": { 2023-10-05T11:36:53.977 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket": { 2023-10-05T11:36:53.977 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "test", 2023-10-05T11:36:53.977 INFO:tasks.workunit.client.0.smithi012.stdout: "marker": "marker", 2023-10-05T11:36:53.977 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket_id": "bucket-id", 2023-10-05T11:36:53.978 INFO:tasks.workunit.client.0.smithi012.stdout: "tenant": "", 2023-10-05T11:36:53.978 INFO:tasks.workunit.client.0.smithi012.stdout: "explicit_placement": { 2023-10-05T11:36:53.978 INFO:tasks.workunit.client.0.smithi012.stdout: "data_pool": "", 2023-10-05T11:36:53.978 INFO:tasks.workunit.client.0.smithi012.stdout: "data_extra_pool": "", 2023-10-05T11:36:53.978 INFO:tasks.workunit.client.0.smithi012.stdout: "index_pool": "" 2023-10-05T11:36:53.978 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.978 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2023-10-05T11:36:53.978 INFO:tasks.workunit.client.0.smithi012.stdout: "key": { 2023-10-05T11:36:53.978 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "_myobj", 2023-10-05T11:36:53.978 INFO:tasks.workunit.client.0.smithi012.stdout: "instance": "inst", 2023-10-05T11:36:53.978 INFO:tasks.workunit.client.0.smithi012.stdout: "ns": "ns" 2023-10-05T11:36:53.979 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.979 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.979 INFO:tasks.workunit.client.0.smithi012.stdout:} 2023-10-05T11:36:53.979 INFO:tasks.workunit.client.0.smithi012.stdout:{ 2023-10-05T11:36:53.979 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket": { 2023-10-05T11:36:53.979 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "ebtest", 2023-10-05T11:36:53.979 INFO:tasks.workunit.client.0.smithi012.stdout: "marker": "marker", 2023-10-05T11:36:53.979 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket_id": "bucket-id", 2023-10-05T11:36:53.979 INFO:tasks.workunit.client.0.smithi012.stdout: "tenant": "", 2023-10-05T11:36:53.980 INFO:tasks.workunit.client.0.smithi012.stdout: "explicit_placement": { 2023-10-05T11:36:53.980 INFO:tasks.workunit.client.0.smithi012.stdout: "data_pool": ".data-pool", 2023-10-05T11:36:53.980 INFO:tasks.workunit.client.0.smithi012.stdout: "data_extra_pool": "", 2023-10-05T11:36:53.980 INFO:tasks.workunit.client.0.smithi012.stdout: "index_pool": ".index-pool" 2023-10-05T11:36:53.980 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.980 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.980 INFO:tasks.workunit.client.0.smithi012.stdout:} 2023-10-05T11:36:53.980 INFO:tasks.workunit.client.0.smithi012.stdout:{ 2023-10-05T11:36:53.981 INFO:tasks.workunit.client.0.smithi012.stdout: "obj": { 2023-10-05T11:36:53.981 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket": { 2023-10-05T11:36:53.981 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "ebtest", 2023-10-05T11:36:53.981 INFO:tasks.workunit.client.0.smithi012.stdout: "marker": "marker", 2023-10-05T11:36:53.981 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket_id": "bucket-id", 2023-10-05T11:36:53.981 INFO:tasks.workunit.client.0.smithi012.stdout: "tenant": "", 2023-10-05T11:36:53.981 INFO:tasks.workunit.client.0.smithi012.stdout: "explicit_placement": { 2023-10-05T11:36:53.981 INFO:tasks.workunit.client.0.smithi012.stdout: "data_pool": ".data-pool", 2023-10-05T11:36:53.981 INFO:tasks.workunit.client.0.smithi012.stdout: "data_extra_pool": "", 2023-10-05T11:36:53.981 INFO:tasks.workunit.client.0.smithi012.stdout: "index_pool": ".index-pool" 2023-10-05T11:36:53.981 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.981 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2023-10-05T11:36:53.982 INFO:tasks.workunit.client.0.smithi012.stdout: "key": { 2023-10-05T11:36:53.982 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "_myobj", 2023-10-05T11:36:53.982 INFO:tasks.workunit.client.0.smithi012.stdout: "instance": "inst", 2023-10-05T11:36:53.982 INFO:tasks.workunit.client.0.smithi012.stdout: "ns": "ns" 2023-10-05T11:36:53.982 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.982 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.982 INFO:tasks.workunit.client.0.smithi012.stdout:} 2023-10-05T11:36:53.982 INFO:tasks.workunit.client.0.smithi012.stdout:{ 2023-10-05T11:36:53.982 INFO:tasks.workunit.client.0.smithi012.stdout: "raw_obj": { 2023-10-05T11:36:53.982 INFO:tasks.workunit.client.0.smithi012.stdout: "pool": ".data-pool", 2023-10-05T11:36:53.983 INFO:tasks.workunit.client.0.smithi012.stdout: "oid": "marker__ns:inst__myobj", 2023-10-05T11:36:53.983 INFO:tasks.workunit.client.0.smithi012.stdout: "loc": "" 2023-10-05T11:36:53.983 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.983 INFO:tasks.workunit.client.0.smithi012.stdout:} 2023-10-05T11:36:53.983 INFO:tasks.workunit.client.0.smithi012.stdout:{ 2023-10-05T11:36:53.983 INFO:tasks.workunit.client.0.smithi012.stdout: "new_obj": { 2023-10-05T11:36:53.983 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket": { 2023-10-05T11:36:53.983 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "ebtest", 2023-10-05T11:36:53.983 INFO:tasks.workunit.client.0.smithi012.stdout: "marker": "marker", 2023-10-05T11:36:53.983 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket_id": "bucket-id", 2023-10-05T11:36:53.983 INFO:tasks.workunit.client.0.smithi012.stdout: "tenant": "", 2023-10-05T11:36:53.983 INFO:tasks.workunit.client.0.smithi012.stdout: "explicit_placement": { 2023-10-05T11:36:53.984 INFO:tasks.workunit.client.0.smithi012.stdout: "data_pool": ".data-pool", 2023-10-05T11:36:53.984 INFO:tasks.workunit.client.0.smithi012.stdout: "data_extra_pool": "", 2023-10-05T11:36:53.984 INFO:tasks.workunit.client.0.smithi012.stdout: "index_pool": ".index-pool" 2023-10-05T11:36:53.984 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.984 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2023-10-05T11:36:53.984 INFO:tasks.workunit.client.0.smithi012.stdout: "key": { 2023-10-05T11:36:53.984 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "_myobj", 2023-10-05T11:36:53.984 INFO:tasks.workunit.client.0.smithi012.stdout: "instance": "inst", 2023-10-05T11:36:53.984 INFO:tasks.workunit.client.0.smithi012.stdout: "ns": "ns" 2023-10-05T11:36:53.984 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.984 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.985 INFO:tasks.workunit.client.0.smithi012.stdout:} 2023-10-05T11:36:53.985 INFO:tasks.workunit.client.0.smithi012.stdout:{ 2023-10-05T11:36:53.985 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket": { 2023-10-05T11:36:53.985 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "test", 2023-10-05T11:36:53.985 INFO:tasks.workunit.client.0.smithi012.stdout: "marker": "marker", 2023-10-05T11:36:53.985 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket_id": "bucket-id", 2023-10-05T11:36:53.985 INFO:tasks.workunit.client.0.smithi012.stdout: "tenant": "", 2023-10-05T11:36:53.985 INFO:tasks.workunit.client.0.smithi012.stdout: "explicit_placement": { 2023-10-05T11:36:53.985 INFO:tasks.workunit.client.0.smithi012.stdout: "data_pool": "", 2023-10-05T11:36:53.985 INFO:tasks.workunit.client.0.smithi012.stdout: "data_extra_pool": "", 2023-10-05T11:36:53.985 INFO:tasks.workunit.client.0.smithi012.stdout: "index_pool": "" 2023-10-05T11:36:53.986 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.986 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.986 INFO:tasks.workunit.client.0.smithi012.stdout:} 2023-10-05T11:36:53.986 INFO:tasks.workunit.client.0.smithi012.stdout:{ 2023-10-05T11:36:53.986 INFO:tasks.workunit.client.0.smithi012.stdout: "obj": { 2023-10-05T11:36:53.986 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket": { 2023-10-05T11:36:53.986 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "test", 2023-10-05T11:36:53.986 INFO:tasks.workunit.client.0.smithi012.stdout: "marker": "marker", 2023-10-05T11:36:53.986 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket_id": "bucket-id", 2023-10-05T11:36:53.986 INFO:tasks.workunit.client.0.smithi012.stdout: "tenant": "", 2023-10-05T11:36:53.986 INFO:tasks.workunit.client.0.smithi012.stdout: "explicit_placement": { 2023-10-05T11:36:53.987 INFO:tasks.workunit.client.0.smithi012.stdout: "data_pool": "", 2023-10-05T11:36:53.987 INFO:tasks.workunit.client.0.smithi012.stdout: "data_extra_pool": "", 2023-10-05T11:36:53.987 INFO:tasks.workunit.client.0.smithi012.stdout: "index_pool": "" 2023-10-05T11:36:53.987 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.987 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2023-10-05T11:36:53.987 INFO:tasks.workunit.client.0.smithi012.stdout: "key": { 2023-10-05T11:36:53.987 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "_myobj_", 2023-10-05T11:36:53.987 INFO:tasks.workunit.client.0.smithi012.stdout: "instance": "", 2023-10-05T11:36:53.987 INFO:tasks.workunit.client.0.smithi012.stdout: "ns": "" 2023-10-05T11:36:53.987 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.988 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.988 INFO:tasks.workunit.client.0.smithi012.stdout:} 2023-10-05T11:36:53.988 INFO:tasks.workunit.client.0.smithi012.stdout:{ 2023-10-05T11:36:53.988 INFO:tasks.workunit.client.0.smithi012.stdout: "raw_obj": { 2023-10-05T11:36:53.988 INFO:tasks.workunit.client.0.smithi012.stdout: "pool": "default-placement.data", 2023-10-05T11:36:53.988 INFO:tasks.workunit.client.0.smithi012.stdout: "oid": "marker___myobj_", 2023-10-05T11:36:53.988 INFO:tasks.workunit.client.0.smithi012.stdout: "loc": "marker__myobj_" 2023-10-05T11:36:53.988 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.988 INFO:tasks.workunit.client.0.smithi012.stdout:} 2023-10-05T11:36:53.988 INFO:tasks.workunit.client.0.smithi012.stdout:{ 2023-10-05T11:36:53.988 INFO:tasks.workunit.client.0.smithi012.stdout: "new_obj": { 2023-10-05T11:36:53.989 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket": { 2023-10-05T11:36:53.989 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "test", 2023-10-05T11:36:53.989 INFO:tasks.workunit.client.0.smithi012.stdout: "marker": "marker", 2023-10-05T11:36:53.989 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket_id": "bucket-id", 2023-10-05T11:36:53.989 INFO:tasks.workunit.client.0.smithi012.stdout: "tenant": "", 2023-10-05T11:36:53.989 INFO:tasks.workunit.client.0.smithi012.stdout: "explicit_placement": { 2023-10-05T11:36:53.989 INFO:tasks.workunit.client.0.smithi012.stdout: "data_pool": "", 2023-10-05T11:36:53.989 INFO:tasks.workunit.client.0.smithi012.stdout: "data_extra_pool": "", 2023-10-05T11:36:53.989 INFO:tasks.workunit.client.0.smithi012.stdout: "index_pool": "" 2023-10-05T11:36:53.989 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.989 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2023-10-05T11:36:53.989 INFO:tasks.workunit.client.0.smithi012.stdout: "key": { 2023-10-05T11:36:53.990 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "_myobj_", 2023-10-05T11:36:53.990 INFO:tasks.workunit.client.0.smithi012.stdout: "instance": "", 2023-10-05T11:36:53.990 INFO:tasks.workunit.client.0.smithi012.stdout: "ns": "" 2023-10-05T11:36:53.990 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.990 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.990 INFO:tasks.workunit.client.0.smithi012.stdout:} 2023-10-05T11:36:53.990 INFO:tasks.workunit.client.0.smithi012.stdout:{ 2023-10-05T11:36:53.990 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket": { 2023-10-05T11:36:53.990 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "ebtest", 2023-10-05T11:36:53.990 INFO:tasks.workunit.client.0.smithi012.stdout: "marker": "marker", 2023-10-05T11:36:53.990 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket_id": "bucket-id", 2023-10-05T11:36:53.991 INFO:tasks.workunit.client.0.smithi012.stdout: "tenant": "", 2023-10-05T11:36:53.991 INFO:tasks.workunit.client.0.smithi012.stdout: "explicit_placement": { 2023-10-05T11:36:53.991 INFO:tasks.workunit.client.0.smithi012.stdout: "data_pool": ".data-pool", 2023-10-05T11:36:53.991 INFO:tasks.workunit.client.0.smithi012.stdout: "data_extra_pool": "", 2023-10-05T11:36:53.991 INFO:tasks.workunit.client.0.smithi012.stdout: "index_pool": ".index-pool" 2023-10-05T11:36:53.991 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.991 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.991 INFO:tasks.workunit.client.0.smithi012.stdout:} 2023-10-05T11:36:53.991 INFO:tasks.workunit.client.0.smithi012.stdout:{ 2023-10-05T11:36:53.991 INFO:tasks.workunit.client.0.smithi012.stdout: "obj": { 2023-10-05T11:36:53.992 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket": { 2023-10-05T11:36:53.992 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "ebtest", 2023-10-05T11:36:53.992 INFO:tasks.workunit.client.0.smithi012.stdout: "marker": "marker", 2023-10-05T11:36:53.992 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket_id": "bucket-id", 2023-10-05T11:36:53.992 INFO:tasks.workunit.client.0.smithi012.stdout: "tenant": "", 2023-10-05T11:36:53.992 INFO:tasks.workunit.client.0.smithi012.stdout: "explicit_placement": { 2023-10-05T11:36:53.992 INFO:tasks.workunit.client.0.smithi012.stdout: "data_pool": ".data-pool", 2023-10-05T11:36:53.992 INFO:tasks.workunit.client.0.smithi012.stdout: "data_extra_pool": "", 2023-10-05T11:36:53.992 INFO:tasks.workunit.client.0.smithi012.stdout: "index_pool": ".index-pool" 2023-10-05T11:36:53.992 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.992 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2023-10-05T11:36:53.992 INFO:tasks.workunit.client.0.smithi012.stdout: "key": { 2023-10-05T11:36:53.992 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "_myobj_", 2023-10-05T11:36:53.993 INFO:tasks.workunit.client.0.smithi012.stdout: "instance": "", 2023-10-05T11:36:53.993 INFO:tasks.workunit.client.0.smithi012.stdout: "ns": "" 2023-10-05T11:36:53.993 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.993 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.993 INFO:tasks.workunit.client.0.smithi012.stdout:} 2023-10-05T11:36:53.993 INFO:tasks.workunit.client.0.smithi012.stdout:{ 2023-10-05T11:36:53.993 INFO:tasks.workunit.client.0.smithi012.stdout: "raw_obj": { 2023-10-05T11:36:53.993 INFO:tasks.workunit.client.0.smithi012.stdout: "pool": ".data-pool", 2023-10-05T11:36:53.993 INFO:tasks.workunit.client.0.smithi012.stdout: "oid": "marker___myobj_", 2023-10-05T11:36:53.993 INFO:tasks.workunit.client.0.smithi012.stdout: "loc": "marker__myobj_" 2023-10-05T11:36:53.993 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.993 INFO:tasks.workunit.client.0.smithi012.stdout:} 2023-10-05T11:36:53.994 INFO:tasks.workunit.client.0.smithi012.stdout:{ 2023-10-05T11:36:53.994 INFO:tasks.workunit.client.0.smithi012.stdout: "new_obj": { 2023-10-05T11:36:53.994 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket": { 2023-10-05T11:36:53.994 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "ebtest", 2023-10-05T11:36:53.994 INFO:tasks.workunit.client.0.smithi012.stdout: "marker": "marker", 2023-10-05T11:36:53.994 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket_id": "bucket-id", 2023-10-05T11:36:53.994 INFO:tasks.workunit.client.0.smithi012.stdout: "tenant": "", 2023-10-05T11:36:53.994 INFO:tasks.workunit.client.0.smithi012.stdout: "explicit_placement": { 2023-10-05T11:36:53.995 INFO:tasks.workunit.client.0.smithi012.stdout: "data_pool": ".data-pool", 2023-10-05T11:36:53.995 INFO:tasks.workunit.client.0.smithi012.stdout: "data_extra_pool": "", 2023-10-05T11:36:53.995 INFO:tasks.workunit.client.0.smithi012.stdout: "index_pool": ".index-pool" 2023-10-05T11:36:53.995 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.995 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2023-10-05T11:36:53.995 INFO:tasks.workunit.client.0.smithi012.stdout: "key": { 2023-10-05T11:36:53.995 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "_myobj_", 2023-10-05T11:36:53.995 INFO:tasks.workunit.client.0.smithi012.stdout: "instance": "", 2023-10-05T11:36:53.995 INFO:tasks.workunit.client.0.smithi012.stdout: "ns": "" 2023-10-05T11:36:53.995 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.995 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.996 INFO:tasks.workunit.client.0.smithi012.stdout:} 2023-10-05T11:36:53.996 INFO:tasks.workunit.client.0.smithi012.stdout:{ 2023-10-05T11:36:53.996 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket": { 2023-10-05T11:36:53.996 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "test", 2023-10-05T11:36:53.996 INFO:tasks.workunit.client.0.smithi012.stdout: "marker": "marker", 2023-10-05T11:36:53.996 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket_id": "bucket-id", 2023-10-05T11:36:53.996 INFO:tasks.workunit.client.0.smithi012.stdout: "tenant": "", 2023-10-05T11:36:53.996 INFO:tasks.workunit.client.0.smithi012.stdout: "explicit_placement": { 2023-10-05T11:36:53.996 INFO:tasks.workunit.client.0.smithi012.stdout: "data_pool": "", 2023-10-05T11:36:53.996 INFO:tasks.workunit.client.0.smithi012.stdout: "data_extra_pool": "", 2023-10-05T11:36:53.996 INFO:tasks.workunit.client.0.smithi012.stdout: "index_pool": "" 2023-10-05T11:36:53.997 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.997 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.997 INFO:tasks.workunit.client.0.smithi012.stdout:} 2023-10-05T11:36:53.997 INFO:tasks.workunit.client.0.smithi012.stdout:{ 2023-10-05T11:36:53.997 INFO:tasks.workunit.client.0.smithi012.stdout: "obj": { 2023-10-05T11:36:53.997 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket": { 2023-10-05T11:36:53.997 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "test", 2023-10-05T11:36:53.997 INFO:tasks.workunit.client.0.smithi012.stdout: "marker": "marker", 2023-10-05T11:36:53.997 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket_id": "bucket-id", 2023-10-05T11:36:53.997 INFO:tasks.workunit.client.0.smithi012.stdout: "tenant": "", 2023-10-05T11:36:53.997 INFO:tasks.workunit.client.0.smithi012.stdout: "explicit_placement": { 2023-10-05T11:36:53.998 INFO:tasks.workunit.client.0.smithi012.stdout: "data_pool": "", 2023-10-05T11:36:53.998 INFO:tasks.workunit.client.0.smithi012.stdout: "data_extra_pool": "", 2023-10-05T11:36:53.998 INFO:tasks.workunit.client.0.smithi012.stdout: "index_pool": "" 2023-10-05T11:36:53.998 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.998 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2023-10-05T11:36:53.998 INFO:tasks.workunit.client.0.smithi012.stdout: "key": { 2023-10-05T11:36:53.998 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "_myobj_", 2023-10-05T11:36:53.998 INFO:tasks.workunit.client.0.smithi012.stdout: "instance": "", 2023-10-05T11:36:53.998 INFO:tasks.workunit.client.0.smithi012.stdout: "ns": "ns" 2023-10-05T11:36:53.998 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.999 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.999 INFO:tasks.workunit.client.0.smithi012.stdout:} 2023-10-05T11:36:53.999 INFO:tasks.workunit.client.0.smithi012.stdout:{ 2023-10-05T11:36:53.999 INFO:tasks.workunit.client.0.smithi012.stdout: "raw_obj": { 2023-10-05T11:36:53.999 INFO:tasks.workunit.client.0.smithi012.stdout: "pool": "default-placement.data", 2023-10-05T11:36:53.999 INFO:tasks.workunit.client.0.smithi012.stdout: "oid": "marker__ns__myobj_", 2023-10-05T11:36:53.999 INFO:tasks.workunit.client.0.smithi012.stdout: "loc": "" 2023-10-05T11:36:53.999 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:53.999 INFO:tasks.workunit.client.0.smithi012.stdout:} 2023-10-05T11:36:53.999 INFO:tasks.workunit.client.0.smithi012.stdout:{ 2023-10-05T11:36:53.999 INFO:tasks.workunit.client.0.smithi012.stdout: "new_obj": { 2023-10-05T11:36:53.999 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket": { 2023-10-05T11:36:54.000 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "test", 2023-10-05T11:36:54.000 INFO:tasks.workunit.client.0.smithi012.stdout: "marker": "marker", 2023-10-05T11:36:54.000 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket_id": "bucket-id", 2023-10-05T11:36:54.000 INFO:tasks.workunit.client.0.smithi012.stdout: "tenant": "", 2023-10-05T11:36:54.000 INFO:tasks.workunit.client.0.smithi012.stdout: "explicit_placement": { 2023-10-05T11:36:54.000 INFO:tasks.workunit.client.0.smithi012.stdout: "data_pool": "", 2023-10-05T11:36:54.000 INFO:tasks.workunit.client.0.smithi012.stdout: "data_extra_pool": "", 2023-10-05T11:36:54.000 INFO:tasks.workunit.client.0.smithi012.stdout: "index_pool": "" 2023-10-05T11:36:54.000 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:54.000 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2023-10-05T11:36:54.001 INFO:tasks.workunit.client.0.smithi012.stdout: "key": { 2023-10-05T11:36:54.001 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "_myobj_", 2023-10-05T11:36:54.001 INFO:tasks.workunit.client.0.smithi012.stdout: "instance": "", 2023-10-05T11:36:54.001 INFO:tasks.workunit.client.0.smithi012.stdout: "ns": "ns" 2023-10-05T11:36:54.001 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:54.001 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:54.001 INFO:tasks.workunit.client.0.smithi012.stdout:} 2023-10-05T11:36:54.001 INFO:tasks.workunit.client.0.smithi012.stdout:{ 2023-10-05T11:36:54.002 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket": { 2023-10-05T11:36:54.002 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "ebtest", 2023-10-05T11:36:54.002 INFO:tasks.workunit.client.0.smithi012.stdout: "marker": "marker", 2023-10-05T11:36:54.002 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket_id": "bucket-id", 2023-10-05T11:36:54.002 INFO:tasks.workunit.client.0.smithi012.stdout: "tenant": "", 2023-10-05T11:36:54.002 INFO:tasks.workunit.client.0.smithi012.stdout: "explicit_placement": { 2023-10-05T11:36:54.002 INFO:tasks.workunit.client.0.smithi012.stdout: "data_pool": ".data-pool", 2023-10-05T11:36:54.002 INFO:tasks.workunit.client.0.smithi012.stdout: "data_extra_pool": "", 2023-10-05T11:36:54.002 INFO:tasks.workunit.client.0.smithi012.stdout: "index_pool": ".index-pool" 2023-10-05T11:36:54.002 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:54.002 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:54.002 INFO:tasks.workunit.client.0.smithi012.stdout:} 2023-10-05T11:36:54.003 INFO:tasks.workunit.client.0.smithi012.stdout:{ 2023-10-05T11:36:54.003 INFO:tasks.workunit.client.0.smithi012.stdout: "obj": { 2023-10-05T11:36:54.003 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket": { 2023-10-05T11:36:54.003 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "ebtest", 2023-10-05T11:36:54.003 INFO:tasks.workunit.client.0.smithi012.stdout: "marker": "marker", 2023-10-05T11:36:54.003 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket_id": "bucket-id", 2023-10-05T11:36:54.003 INFO:tasks.workunit.client.0.smithi012.stdout: "tenant": "", 2023-10-05T11:36:54.003 INFO:tasks.workunit.client.0.smithi012.stdout: "explicit_placement": { 2023-10-05T11:36:54.003 INFO:tasks.workunit.client.0.smithi012.stdout: "data_pool": ".data-pool", 2023-10-05T11:36:54.003 INFO:tasks.workunit.client.0.smithi012.stdout: "data_extra_pool": "", 2023-10-05T11:36:54.003 INFO:tasks.workunit.client.0.smithi012.stdout: "index_pool": ".index-pool" 2023-10-05T11:36:54.003 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:54.004 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2023-10-05T11:36:54.004 INFO:tasks.workunit.client.0.smithi012.stdout: "key": { 2023-10-05T11:36:54.004 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "_myobj_", 2023-10-05T11:36:54.004 INFO:tasks.workunit.client.0.smithi012.stdout: "instance": "", 2023-10-05T11:36:54.004 INFO:tasks.workunit.client.0.smithi012.stdout: "ns": "ns" 2023-10-05T11:36:54.004 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:54.004 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:54.004 INFO:tasks.workunit.client.0.smithi012.stdout:} 2023-10-05T11:36:54.004 INFO:tasks.workunit.client.0.smithi012.stdout:{ 2023-10-05T11:36:54.004 INFO:tasks.workunit.client.0.smithi012.stdout: "raw_obj": { 2023-10-05T11:36:54.004 INFO:tasks.workunit.client.0.smithi012.stdout: "pool": ".data-pool", 2023-10-05T11:36:54.004 INFO:tasks.workunit.client.0.smithi012.stdout: "oid": "marker__ns__myobj_", 2023-10-05T11:36:54.005 INFO:tasks.workunit.client.0.smithi012.stdout: "loc": "" 2023-10-05T11:36:54.005 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:54.005 INFO:tasks.workunit.client.0.smithi012.stdout:} 2023-10-05T11:36:54.005 INFO:tasks.workunit.client.0.smithi012.stdout:{ 2023-10-05T11:36:54.005 INFO:tasks.workunit.client.0.smithi012.stdout: "new_obj": { 2023-10-05T11:36:54.005 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket": { 2023-10-05T11:36:54.005 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "ebtest", 2023-10-05T11:36:54.005 INFO:tasks.workunit.client.0.smithi012.stdout: "marker": "marker", 2023-10-05T11:36:54.005 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket_id": "bucket-id", 2023-10-05T11:36:54.006 INFO:tasks.workunit.client.0.smithi012.stdout: "tenant": "", 2023-10-05T11:36:54.006 INFO:tasks.workunit.client.0.smithi012.stdout: "explicit_placement": { 2023-10-05T11:36:54.006 INFO:tasks.workunit.client.0.smithi012.stdout: "data_pool": ".data-pool", 2023-10-05T11:36:54.006 INFO:tasks.workunit.client.0.smithi012.stdout: "data_extra_pool": "", 2023-10-05T11:36:54.006 INFO:tasks.workunit.client.0.smithi012.stdout: "index_pool": ".index-pool" 2023-10-05T11:36:54.006 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:54.006 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2023-10-05T11:36:54.006 INFO:tasks.workunit.client.0.smithi012.stdout: "key": { 2023-10-05T11:36:54.006 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "_myobj_", 2023-10-05T11:36:54.006 INFO:tasks.workunit.client.0.smithi012.stdout: "instance": "", 2023-10-05T11:36:54.006 INFO:tasks.workunit.client.0.smithi012.stdout: "ns": "ns" 2023-10-05T11:36:54.006 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:54.007 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:54.007 INFO:tasks.workunit.client.0.smithi012.stdout:} 2023-10-05T11:36:54.007 INFO:tasks.workunit.client.0.smithi012.stdout:{ 2023-10-05T11:36:54.007 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket": { 2023-10-05T11:36:54.007 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "test", 2023-10-05T11:36:54.007 INFO:tasks.workunit.client.0.smithi012.stdout: "marker": "marker", 2023-10-05T11:36:54.007 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket_id": "bucket-id", 2023-10-05T11:36:54.007 INFO:tasks.workunit.client.0.smithi012.stdout: "tenant": "", 2023-10-05T11:36:54.007 INFO:tasks.workunit.client.0.smithi012.stdout: "explicit_placement": { 2023-10-05T11:36:54.007 INFO:tasks.workunit.client.0.smithi012.stdout: "data_pool": "", 2023-10-05T11:36:54.007 INFO:tasks.workunit.client.0.smithi012.stdout: "data_extra_pool": "", 2023-10-05T11:36:54.008 INFO:tasks.workunit.client.0.smithi012.stdout: "index_pool": "" 2023-10-05T11:36:54.008 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:54.008 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:54.008 INFO:tasks.workunit.client.0.smithi012.stdout:} 2023-10-05T11:36:54.008 INFO:tasks.workunit.client.0.smithi012.stdout:{ 2023-10-05T11:36:54.008 INFO:tasks.workunit.client.0.smithi012.stdout: "obj": { 2023-10-05T11:36:54.008 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket": { 2023-10-05T11:36:54.008 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "test", 2023-10-05T11:36:54.008 INFO:tasks.workunit.client.0.smithi012.stdout: "marker": "marker", 2023-10-05T11:36:54.009 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket_id": "bucket-id", 2023-10-05T11:36:54.009 INFO:tasks.workunit.client.0.smithi012.stdout: "tenant": "", 2023-10-05T11:36:54.009 INFO:tasks.workunit.client.0.smithi012.stdout: "explicit_placement": { 2023-10-05T11:36:54.009 INFO:tasks.workunit.client.0.smithi012.stdout: "data_pool": "", 2023-10-05T11:36:54.009 INFO:tasks.workunit.client.0.smithi012.stdout: "data_extra_pool": "", 2023-10-05T11:36:54.009 INFO:tasks.workunit.client.0.smithi012.stdout: "index_pool": "" 2023-10-05T11:36:54.010 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:54.010 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2023-10-05T11:36:54.010 INFO:tasks.workunit.client.0.smithi012.stdout: "key": { 2023-10-05T11:36:54.010 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "_myobj_", 2023-10-05T11:36:54.010 INFO:tasks.workunit.client.0.smithi012.stdout: "instance": "inst", 2023-10-05T11:36:54.010 INFO:tasks.workunit.client.0.smithi012.stdout: "ns": "" 2023-10-05T11:36:54.010 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:54.010 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:54.011 INFO:tasks.workunit.client.0.smithi012.stdout:} 2023-10-05T11:36:54.011 INFO:tasks.workunit.client.0.smithi012.stdout:{ 2023-10-05T11:36:54.011 INFO:tasks.workunit.client.0.smithi012.stdout: "raw_obj": { 2023-10-05T11:36:54.011 INFO:tasks.workunit.client.0.smithi012.stdout: "pool": "default-placement.data", 2023-10-05T11:36:54.011 INFO:tasks.workunit.client.0.smithi012.stdout: "oid": "marker__:inst__myobj_", 2023-10-05T11:36:54.011 INFO:tasks.workunit.client.0.smithi012.stdout: "loc": "marker__myobj_" 2023-10-05T11:36:54.011 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:54.011 INFO:tasks.workunit.client.0.smithi012.stdout:} 2023-10-05T11:36:54.011 INFO:tasks.workunit.client.0.smithi012.stdout:{ 2023-10-05T11:36:54.011 INFO:tasks.workunit.client.0.smithi012.stdout: "new_obj": { 2023-10-05T11:36:54.012 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket": { 2023-10-05T11:36:54.012 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "test", 2023-10-05T11:36:54.012 INFO:tasks.workunit.client.0.smithi012.stdout: "marker": "marker", 2023-10-05T11:36:54.012 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket_id": "bucket-id", 2023-10-05T11:36:54.012 INFO:tasks.workunit.client.0.smithi012.stdout: "tenant": "", 2023-10-05T11:36:54.012 INFO:tasks.workunit.client.0.smithi012.stdout: "explicit_placement": { 2023-10-05T11:36:54.012 INFO:tasks.workunit.client.0.smithi012.stdout: "data_pool": "", 2023-10-05T11:36:54.012 INFO:tasks.workunit.client.0.smithi012.stdout: "data_extra_pool": "", 2023-10-05T11:36:54.012 INFO:tasks.workunit.client.0.smithi012.stdout: "index_pool": "" 2023-10-05T11:36:54.013 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:54.013 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2023-10-05T11:36:54.013 INFO:tasks.workunit.client.0.smithi012.stdout: "key": { 2023-10-05T11:36:54.013 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "_myobj_", 2023-10-05T11:36:54.013 INFO:tasks.workunit.client.0.smithi012.stdout: "instance": "inst", 2023-10-05T11:36:54.013 INFO:tasks.workunit.client.0.smithi012.stdout: "ns": "" 2023-10-05T11:36:54.013 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:54.013 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:54.013 INFO:tasks.workunit.client.0.smithi012.stdout:} 2023-10-05T11:36:54.013 INFO:tasks.workunit.client.0.smithi012.stdout:{ 2023-10-05T11:36:54.013 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket": { 2023-10-05T11:36:54.014 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "ebtest", 2023-10-05T11:36:54.014 INFO:tasks.workunit.client.0.smithi012.stdout: "marker": "marker", 2023-10-05T11:36:54.014 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket_id": "bucket-id", 2023-10-05T11:36:54.014 INFO:tasks.workunit.client.0.smithi012.stdout: "tenant": "", 2023-10-05T11:36:54.014 INFO:tasks.workunit.client.0.smithi012.stdout: "explicit_placement": { 2023-10-05T11:36:54.014 INFO:tasks.workunit.client.0.smithi012.stdout: "data_pool": ".data-pool", 2023-10-05T11:36:54.014 INFO:tasks.workunit.client.0.smithi012.stdout: "data_extra_pool": "", 2023-10-05T11:36:54.014 INFO:tasks.workunit.client.0.smithi012.stdout: "index_pool": ".index-pool" 2023-10-05T11:36:54.014 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:54.015 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:54.015 INFO:tasks.workunit.client.0.smithi012.stdout:} 2023-10-05T11:36:54.015 INFO:tasks.workunit.client.0.smithi012.stdout:{ 2023-10-05T11:36:54.015 INFO:tasks.workunit.client.0.smithi012.stdout: "obj": { 2023-10-05T11:36:54.015 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket": { 2023-10-05T11:36:54.015 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "ebtest", 2023-10-05T11:36:54.015 INFO:tasks.workunit.client.0.smithi012.stdout: "marker": "marker", 2023-10-05T11:36:54.015 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket_id": "bucket-id", 2023-10-05T11:36:54.015 INFO:tasks.workunit.client.0.smithi012.stdout: "tenant": "", 2023-10-05T11:36:54.015 INFO:tasks.workunit.client.0.smithi012.stdout: "explicit_placement": { 2023-10-05T11:36:54.016 INFO:tasks.workunit.client.0.smithi012.stdout: "data_pool": ".data-pool", 2023-10-05T11:36:54.016 INFO:tasks.workunit.client.0.smithi012.stdout: "data_extra_pool": "", 2023-10-05T11:36:54.016 INFO:tasks.workunit.client.0.smithi012.stdout: "index_pool": ".index-pool" 2023-10-05T11:36:54.016 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:54.016 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2023-10-05T11:36:54.016 INFO:tasks.workunit.client.0.smithi012.stdout: "key": { 2023-10-05T11:36:54.016 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "_myobj_", 2023-10-05T11:36:54.016 INFO:tasks.workunit.client.0.smithi012.stdout: "instance": "inst", 2023-10-05T11:36:54.016 INFO:tasks.workunit.client.0.smithi012.stdout: "ns": "" 2023-10-05T11:36:54.016 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:54.017 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:54.017 INFO:tasks.workunit.client.0.smithi012.stdout:} 2023-10-05T11:36:54.017 INFO:tasks.workunit.client.0.smithi012.stdout:{ 2023-10-05T11:36:54.017 INFO:tasks.workunit.client.0.smithi012.stdout: "raw_obj": { 2023-10-05T11:36:54.017 INFO:tasks.workunit.client.0.smithi012.stdout: "pool": ".data-pool", 2023-10-05T11:36:54.017 INFO:tasks.workunit.client.0.smithi012.stdout: "oid": "marker__:inst__myobj_", 2023-10-05T11:36:54.017 INFO:tasks.workunit.client.0.smithi012.stdout: "loc": "marker__myobj_" 2023-10-05T11:36:54.017 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:54.017 INFO:tasks.workunit.client.0.smithi012.stdout:} 2023-10-05T11:36:54.017 INFO:tasks.workunit.client.0.smithi012.stdout:{ 2023-10-05T11:36:54.017 INFO:tasks.workunit.client.0.smithi012.stdout: "new_obj": { 2023-10-05T11:36:54.017 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket": { 2023-10-05T11:36:54.018 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "ebtest", 2023-10-05T11:36:54.018 INFO:tasks.workunit.client.0.smithi012.stdout: "marker": "marker", 2023-10-05T11:36:54.018 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket_id": "bucket-id", 2023-10-05T11:36:54.018 INFO:tasks.workunit.client.0.smithi012.stdout: "tenant": "", 2023-10-05T11:36:54.018 INFO:tasks.workunit.client.0.smithi012.stdout: "explicit_placement": { 2023-10-05T11:36:54.018 INFO:tasks.workunit.client.0.smithi012.stdout: "data_pool": ".data-pool", 2023-10-05T11:36:54.018 INFO:tasks.workunit.client.0.smithi012.stdout: "data_extra_pool": "", 2023-10-05T11:36:54.018 INFO:tasks.workunit.client.0.smithi012.stdout: "index_pool": ".index-pool" 2023-10-05T11:36:54.018 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:54.018 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2023-10-05T11:36:54.018 INFO:tasks.workunit.client.0.smithi012.stdout: "key": { 2023-10-05T11:36:54.019 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "_myobj_", 2023-10-05T11:36:54.019 INFO:tasks.workunit.client.0.smithi012.stdout: "instance": "inst", 2023-10-05T11:36:54.019 INFO:tasks.workunit.client.0.smithi012.stdout: "ns": "" 2023-10-05T11:36:54.019 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:54.019 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:54.019 INFO:tasks.workunit.client.0.smithi012.stdout:} 2023-10-05T11:36:54.019 INFO:tasks.workunit.client.0.smithi012.stdout:{ 2023-10-05T11:36:54.019 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket": { 2023-10-05T11:36:54.019 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "test", 2023-10-05T11:36:54.019 INFO:tasks.workunit.client.0.smithi012.stdout: "marker": "marker", 2023-10-05T11:36:54.019 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket_id": "bucket-id", 2023-10-05T11:36:54.019 INFO:tasks.workunit.client.0.smithi012.stdout: "tenant": "", 2023-10-05T11:36:54.020 INFO:tasks.workunit.client.0.smithi012.stdout: "explicit_placement": { 2023-10-05T11:36:54.020 INFO:tasks.workunit.client.0.smithi012.stdout: "data_pool": "", 2023-10-05T11:36:54.020 INFO:tasks.workunit.client.0.smithi012.stdout: "data_extra_pool": "", 2023-10-05T11:36:54.020 INFO:tasks.workunit.client.0.smithi012.stdout: "index_pool": "" 2023-10-05T11:36:54.020 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:54.020 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:54.020 INFO:tasks.workunit.client.0.smithi012.stdout:} 2023-10-05T11:36:54.020 INFO:tasks.workunit.client.0.smithi012.stdout:{ 2023-10-05T11:36:54.020 INFO:tasks.workunit.client.0.smithi012.stdout: "obj": { 2023-10-05T11:36:54.020 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket": { 2023-10-05T11:36:54.020 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "test", 2023-10-05T11:36:54.020 INFO:tasks.workunit.client.0.smithi012.stdout: "marker": "marker", 2023-10-05T11:36:54.021 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket_id": "bucket-id", 2023-10-05T11:36:54.021 INFO:tasks.workunit.client.0.smithi012.stdout: "tenant": "", 2023-10-05T11:36:54.021 INFO:tasks.workunit.client.0.smithi012.stdout: "explicit_placement": { 2023-10-05T11:36:54.021 INFO:tasks.workunit.client.0.smithi012.stdout: "data_pool": "", 2023-10-05T11:36:54.021 INFO:tasks.workunit.client.0.smithi012.stdout: "data_extra_pool": "", 2023-10-05T11:36:54.021 INFO:tasks.workunit.client.0.smithi012.stdout: "index_pool": "" 2023-10-05T11:36:54.021 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:54.021 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2023-10-05T11:36:54.021 INFO:tasks.workunit.client.0.smithi012.stdout: "key": { 2023-10-05T11:36:54.021 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "_myobj_", 2023-10-05T11:36:54.022 INFO:tasks.workunit.client.0.smithi012.stdout: "instance": "inst", 2023-10-05T11:36:54.022 INFO:tasks.workunit.client.0.smithi012.stdout: "ns": "ns" 2023-10-05T11:36:54.022 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:54.022 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:54.022 INFO:tasks.workunit.client.0.smithi012.stdout:} 2023-10-05T11:36:54.022 INFO:tasks.workunit.client.0.smithi012.stdout:{ 2023-10-05T11:36:54.022 INFO:tasks.workunit.client.0.smithi012.stdout: "raw_obj": { 2023-10-05T11:36:54.022 INFO:tasks.workunit.client.0.smithi012.stdout: "pool": "default-placement.data", 2023-10-05T11:36:54.023 INFO:tasks.workunit.client.0.smithi012.stdout: "oid": "marker__ns:inst__myobj_", 2023-10-05T11:36:54.023 INFO:tasks.workunit.client.0.smithi012.stdout: "loc": "" 2023-10-05T11:36:54.023 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:54.023 INFO:tasks.workunit.client.0.smithi012.stdout:} 2023-10-05T11:36:54.023 INFO:tasks.workunit.client.0.smithi012.stdout:{ 2023-10-05T11:36:54.023 INFO:tasks.workunit.client.0.smithi012.stdout: "new_obj": { 2023-10-05T11:36:54.023 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket": { 2023-10-05T11:36:54.023 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "test", 2023-10-05T11:36:54.023 INFO:tasks.workunit.client.0.smithi012.stdout: "marker": "marker", 2023-10-05T11:36:54.023 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket_id": "bucket-id", 2023-10-05T11:36:54.023 INFO:tasks.workunit.client.0.smithi012.stdout: "tenant": "", 2023-10-05T11:36:54.023 INFO:tasks.workunit.client.0.smithi012.stdout: "explicit_placement": { 2023-10-05T11:36:54.024 INFO:tasks.workunit.client.0.smithi012.stdout: "data_pool": "", 2023-10-05T11:36:54.024 INFO:tasks.workunit.client.0.smithi012.stdout: "data_extra_pool": "", 2023-10-05T11:36:54.024 INFO:tasks.workunit.client.0.smithi012.stdout: "index_pool": "" 2023-10-05T11:36:54.024 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:54.024 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2023-10-05T11:36:54.024 INFO:tasks.workunit.client.0.smithi012.stdout: "key": { 2023-10-05T11:36:54.024 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "_myobj_", 2023-10-05T11:36:54.024 INFO:tasks.workunit.client.0.smithi012.stdout: "instance": "inst", 2023-10-05T11:36:54.024 INFO:tasks.workunit.client.0.smithi012.stdout: "ns": "ns" 2023-10-05T11:36:54.024 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:54.024 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:54.025 INFO:tasks.workunit.client.0.smithi012.stdout:} 2023-10-05T11:36:54.025 INFO:tasks.workunit.client.0.smithi012.stdout:{ 2023-10-05T11:36:54.025 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket": { 2023-10-05T11:36:54.025 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "ebtest", 2023-10-05T11:36:54.025 INFO:tasks.workunit.client.0.smithi012.stdout: "marker": "marker", 2023-10-05T11:36:54.025 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket_id": "bucket-id", 2023-10-05T11:36:54.025 INFO:tasks.workunit.client.0.smithi012.stdout: "tenant": "", 2023-10-05T11:36:54.025 INFO:tasks.workunit.client.0.smithi012.stdout: "explicit_placement": { 2023-10-05T11:36:54.025 INFO:tasks.workunit.client.0.smithi012.stdout: "data_pool": ".data-pool", 2023-10-05T11:36:54.025 INFO:tasks.workunit.client.0.smithi012.stdout: "data_extra_pool": "", 2023-10-05T11:36:54.025 INFO:tasks.workunit.client.0.smithi012.stdout: "index_pool": ".index-pool" 2023-10-05T11:36:54.025 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:54.026 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:54.026 INFO:tasks.workunit.client.0.smithi012.stdout:} 2023-10-05T11:36:54.026 INFO:tasks.workunit.client.0.smithi012.stdout:{ 2023-10-05T11:36:54.026 INFO:tasks.workunit.client.0.smithi012.stdout: "obj": { 2023-10-05T11:36:54.026 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket": { 2023-10-05T11:36:54.026 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "ebtest", 2023-10-05T11:36:54.026 INFO:tasks.workunit.client.0.smithi012.stdout: "marker": "marker", 2023-10-05T11:36:54.026 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket_id": "bucket-id", 2023-10-05T11:36:54.027 INFO:tasks.workunit.client.0.smithi012.stdout: "tenant": "", 2023-10-05T11:36:54.027 INFO:tasks.workunit.client.0.smithi012.stdout: "explicit_placement": { 2023-10-05T11:36:54.027 INFO:tasks.workunit.client.0.smithi012.stdout: "data_pool": ".data-pool", 2023-10-05T11:36:54.027 INFO:tasks.workunit.client.0.smithi012.stdout: "data_extra_pool": "", 2023-10-05T11:36:54.027 INFO:tasks.workunit.client.0.smithi012.stdout: "index_pool": ".index-pool" 2023-10-05T11:36:54.027 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:54.027 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2023-10-05T11:36:54.027 INFO:tasks.workunit.client.0.smithi012.stdout: "key": { 2023-10-05T11:36:54.027 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "_myobj_", 2023-10-05T11:36:54.027 INFO:tasks.workunit.client.0.smithi012.stdout: "instance": "inst", 2023-10-05T11:36:54.028 INFO:tasks.workunit.client.0.smithi012.stdout: "ns": "ns" 2023-10-05T11:36:54.028 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:54.028 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:54.028 INFO:tasks.workunit.client.0.smithi012.stdout:} 2023-10-05T11:36:54.028 INFO:tasks.workunit.client.0.smithi012.stdout:{ 2023-10-05T11:36:54.028 INFO:tasks.workunit.client.0.smithi012.stdout: "raw_obj": { 2023-10-05T11:36:54.028 INFO:tasks.workunit.client.0.smithi012.stdout: "pool": ".data-pool", 2023-10-05T11:36:54.028 INFO:tasks.workunit.client.0.smithi012.stdout: "oid": "marker__ns:inst__myobj_", 2023-10-05T11:36:54.028 INFO:tasks.workunit.client.0.smithi012.stdout: "loc": "" 2023-10-05T11:36:54.028 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:54.028 INFO:tasks.workunit.client.0.smithi012.stdout:} 2023-10-05T11:36:54.028 INFO:tasks.workunit.client.0.smithi012.stdout:{ 2023-10-05T11:36:54.028 INFO:tasks.workunit.client.0.smithi012.stdout: "new_obj": { 2023-10-05T11:36:54.028 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket": { 2023-10-05T11:36:54.029 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "ebtest", 2023-10-05T11:36:54.029 INFO:tasks.workunit.client.0.smithi012.stdout: "marker": "marker", 2023-10-05T11:36:54.029 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket_id": "bucket-id", 2023-10-05T11:36:54.029 INFO:tasks.workunit.client.0.smithi012.stdout: "tenant": "", 2023-10-05T11:36:54.029 INFO:tasks.workunit.client.0.smithi012.stdout: "explicit_placement": { 2023-10-05T11:36:54.029 INFO:tasks.workunit.client.0.smithi012.stdout: "data_pool": ".data-pool", 2023-10-05T11:36:54.029 INFO:tasks.workunit.client.0.smithi012.stdout: "data_extra_pool": "", 2023-10-05T11:36:54.029 INFO:tasks.workunit.client.0.smithi012.stdout: "index_pool": ".index-pool" 2023-10-05T11:36:54.029 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:54.029 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2023-10-05T11:36:54.029 INFO:tasks.workunit.client.0.smithi012.stdout: "key": { 2023-10-05T11:36:54.029 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "_myobj_", 2023-10-05T11:36:54.029 INFO:tasks.workunit.client.0.smithi012.stdout: "instance": "inst", 2023-10-05T11:36:54.030 INFO:tasks.workunit.client.0.smithi012.stdout: "ns": "ns" 2023-10-05T11:36:54.030 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:54.030 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:54.030 INFO:tasks.workunit.client.0.smithi012.stdout:} 2023-10-05T11:36:54.030 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] TestRGWObj.obj_to_raw (1 ms) 2023-10-05T11:36:54.030 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] TestRGWObj.old_to_raw 2023-10-05T11:36:54.030 INFO:tasks.workunit.client.0.smithi012.stdout:{ 2023-10-05T11:36:54.030 INFO:tasks.workunit.client.0.smithi012.stdout: "raw_obj": { 2023-10-05T11:36:54.030 INFO:tasks.workunit.client.0.smithi012.stdout: "pool": ".data-pool", 2023-10-05T11:36:54.030 INFO:tasks.workunit.client.0.smithi012.stdout: "oid": "marker_myobj", 2023-10-05T11:36:54.030 INFO:tasks.workunit.client.0.smithi012.stdout: "loc": "" 2023-10-05T11:36:54.031 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:54.031 INFO:tasks.workunit.client.0.smithi012.stdout:} 2023-10-05T11:36:54.031 INFO:tasks.workunit.client.0.smithi012.stdout:{ 2023-10-05T11:36:54.031 INFO:tasks.workunit.client.0.smithi012.stdout: "new_obj": { 2023-10-05T11:36:54.031 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket": { 2023-10-05T11:36:54.031 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "ebtest", 2023-10-05T11:36:54.031 INFO:tasks.workunit.client.0.smithi012.stdout: "marker": "marker", 2023-10-05T11:36:54.031 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket_id": "bucket-id", 2023-10-05T11:36:54.031 INFO:tasks.workunit.client.0.smithi012.stdout: "tenant": "", 2023-10-05T11:36:54.032 INFO:tasks.workunit.client.0.smithi012.stdout: "explicit_placement": { 2023-10-05T11:36:54.032 INFO:tasks.workunit.client.0.smithi012.stdout: "data_pool": ".data-pool", 2023-10-05T11:36:54.032 INFO:tasks.workunit.client.0.smithi012.stdout: "data_extra_pool": "", 2023-10-05T11:36:54.032 INFO:tasks.workunit.client.0.smithi012.stdout: "index_pool": ".index-pool" 2023-10-05T11:36:54.032 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:54.032 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2023-10-05T11:36:54.032 INFO:tasks.workunit.client.0.smithi012.stdout: "key": { 2023-10-05T11:36:54.032 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "myobj", 2023-10-05T11:36:54.032 INFO:tasks.workunit.client.0.smithi012.stdout: "instance": "", 2023-10-05T11:36:54.032 INFO:tasks.workunit.client.0.smithi012.stdout: "ns": "" 2023-10-05T11:36:54.032 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:54.032 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:54.033 INFO:tasks.workunit.client.0.smithi012.stdout:} 2023-10-05T11:36:54.033 INFO:tasks.workunit.client.0.smithi012.stdout:raw=.data-pool:marker_myobj 2023-10-05T11:36:54.033 INFO:tasks.workunit.client.0.smithi012.stdout:{ 2023-10-05T11:36:54.033 INFO:tasks.workunit.client.0.smithi012.stdout: "raw_obj2": { 2023-10-05T11:36:54.033 INFO:tasks.workunit.client.0.smithi012.stdout: "pool": ".data-pool", 2023-10-05T11:36:54.033 INFO:tasks.workunit.client.0.smithi012.stdout: "oid": "marker_myobj", 2023-10-05T11:36:54.033 INFO:tasks.workunit.client.0.smithi012.stdout: "loc": "" 2023-10-05T11:36:54.033 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:54.033 INFO:tasks.workunit.client.0.smithi012.stdout:} 2023-10-05T11:36:54.033 INFO:tasks.workunit.client.0.smithi012.stdout:{ 2023-10-05T11:36:54.034 INFO:tasks.workunit.client.0.smithi012.stdout: "new_obj2": { 2023-10-05T11:36:54.034 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket": { 2023-10-05T11:36:54.034 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "ebtest", 2023-10-05T11:36:54.034 INFO:tasks.workunit.client.0.smithi012.stdout: "marker": "marker", 2023-10-05T11:36:54.034 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket_id": "bucket-id", 2023-10-05T11:36:54.034 INFO:tasks.workunit.client.0.smithi012.stdout: "tenant": "", 2023-10-05T11:36:54.034 INFO:tasks.workunit.client.0.smithi012.stdout: "explicit_placement": { 2023-10-05T11:36:54.034 INFO:tasks.workunit.client.0.smithi012.stdout: "data_pool": ".data-pool", 2023-10-05T11:36:54.034 INFO:tasks.workunit.client.0.smithi012.stdout: "data_extra_pool": "", 2023-10-05T11:36:54.034 INFO:tasks.workunit.client.0.smithi012.stdout: "index_pool": ".index-pool" 2023-10-05T11:36:54.034 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:54.034 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2023-10-05T11:36:54.035 INFO:tasks.workunit.client.0.smithi012.stdout: "key": { 2023-10-05T11:36:54.035 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "myobj", 2023-10-05T11:36:54.035 INFO:tasks.workunit.client.0.smithi012.stdout: "instance": "", 2023-10-05T11:36:54.035 INFO:tasks.workunit.client.0.smithi012.stdout: "ns": "" 2023-10-05T11:36:54.035 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:54.035 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:54.035 INFO:tasks.workunit.client.0.smithi012.stdout:} 2023-10-05T11:36:54.035 INFO:tasks.workunit.client.0.smithi012.stdout:raw2=.data-pool:marker_myobj 2023-10-05T11:36:54.035 INFO:tasks.workunit.client.0.smithi012.stdout:{ 2023-10-05T11:36:54.035 INFO:tasks.workunit.client.0.smithi012.stdout: "raw_obj": { 2023-10-05T11:36:54.035 INFO:tasks.workunit.client.0.smithi012.stdout: "pool": ".data-pool", 2023-10-05T11:36:54.035 INFO:tasks.workunit.client.0.smithi012.stdout: "oid": "marker__ns_myobj", 2023-10-05T11:36:54.036 INFO:tasks.workunit.client.0.smithi012.stdout: "loc": "" 2023-10-05T11:36:54.036 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:54.036 INFO:tasks.workunit.client.0.smithi012.stdout:} 2023-10-05T11:36:54.036 INFO:tasks.workunit.client.0.smithi012.stdout:{ 2023-10-05T11:36:54.036 INFO:tasks.workunit.client.0.smithi012.stdout: "new_obj": { 2023-10-05T11:36:54.036 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket": { 2023-10-05T11:36:54.036 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "ebtest", 2023-10-05T11:36:54.036 INFO:tasks.workunit.client.0.smithi012.stdout: "marker": "marker", 2023-10-05T11:36:54.036 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket_id": "bucket-id", 2023-10-05T11:36:54.036 INFO:tasks.workunit.client.0.smithi012.stdout: "tenant": "", 2023-10-05T11:36:54.037 INFO:tasks.workunit.client.0.smithi012.stdout: "explicit_placement": { 2023-10-05T11:36:54.037 INFO:tasks.workunit.client.0.smithi012.stdout: "data_pool": ".data-pool", 2023-10-05T11:36:54.037 INFO:tasks.workunit.client.0.smithi012.stdout: "data_extra_pool": "", 2023-10-05T11:36:54.037 INFO:tasks.workunit.client.0.smithi012.stdout: "index_pool": ".index-pool" 2023-10-05T11:36:54.037 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:54.037 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2023-10-05T11:36:54.037 INFO:tasks.workunit.client.0.smithi012.stdout: "key": { 2023-10-05T11:36:54.037 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "myobj", 2023-10-05T11:36:54.037 INFO:tasks.workunit.client.0.smithi012.stdout: "instance": "", 2023-10-05T11:36:54.037 INFO:tasks.workunit.client.0.smithi012.stdout: "ns": "ns" 2023-10-05T11:36:54.038 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:54.038 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:54.038 INFO:tasks.workunit.client.0.smithi012.stdout:} 2023-10-05T11:36:54.038 INFO:tasks.workunit.client.0.smithi012.stdout:raw=.data-pool:marker__ns_myobj 2023-10-05T11:36:54.038 INFO:tasks.workunit.client.0.smithi012.stdout:{ 2023-10-05T11:36:54.038 INFO:tasks.workunit.client.0.smithi012.stdout: "raw_obj2": { 2023-10-05T11:36:54.038 INFO:tasks.workunit.client.0.smithi012.stdout: "pool": ".data-pool", 2023-10-05T11:36:54.038 INFO:tasks.workunit.client.0.smithi012.stdout: "oid": "marker__ns_myobj", 2023-10-05T11:36:54.038 INFO:tasks.workunit.client.0.smithi012.stdout: "loc": "" 2023-10-05T11:36:54.038 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:54.039 INFO:tasks.workunit.client.0.smithi012.stdout:} 2023-10-05T11:36:54.039 INFO:tasks.workunit.client.0.smithi012.stdout:{ 2023-10-05T11:36:54.039 INFO:tasks.workunit.client.0.smithi012.stdout: "new_obj2": { 2023-10-05T11:36:54.039 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket": { 2023-10-05T11:36:54.039 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "ebtest", 2023-10-05T11:36:54.039 INFO:tasks.workunit.client.0.smithi012.stdout: "marker": "marker", 2023-10-05T11:36:54.039 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket_id": "bucket-id", 2023-10-05T11:36:54.039 INFO:tasks.workunit.client.0.smithi012.stdout: "tenant": "", 2023-10-05T11:36:54.039 INFO:tasks.workunit.client.0.smithi012.stdout: "explicit_placement": { 2023-10-05T11:36:54.039 INFO:tasks.workunit.client.0.smithi012.stdout: "data_pool": ".data-pool", 2023-10-05T11:36:54.039 INFO:tasks.workunit.client.0.smithi012.stdout: "data_extra_pool": "", 2023-10-05T11:36:54.039 INFO:tasks.workunit.client.0.smithi012.stdout: "index_pool": ".index-pool" 2023-10-05T11:36:54.040 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:54.040 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2023-10-05T11:36:54.040 INFO:tasks.workunit.client.0.smithi012.stdout: "key": { 2023-10-05T11:36:54.040 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "myobj", 2023-10-05T11:36:54.040 INFO:tasks.workunit.client.0.smithi012.stdout: "instance": "", 2023-10-05T11:36:54.040 INFO:tasks.workunit.client.0.smithi012.stdout: "ns": "ns" 2023-10-05T11:36:54.040 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:54.040 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:54.040 INFO:tasks.workunit.client.0.smithi012.stdout:} 2023-10-05T11:36:54.040 INFO:tasks.workunit.client.0.smithi012.stdout:raw2=.data-pool:marker__ns_myobj 2023-10-05T11:36:54.040 INFO:tasks.workunit.client.0.smithi012.stdout:{ 2023-10-05T11:36:54.040 INFO:tasks.workunit.client.0.smithi012.stdout: "raw_obj": { 2023-10-05T11:36:54.041 INFO:tasks.workunit.client.0.smithi012.stdout: "pool": ".data-pool", 2023-10-05T11:36:54.041 INFO:tasks.workunit.client.0.smithi012.stdout: "oid": "marker__:inst_myobj", 2023-10-05T11:36:54.041 INFO:tasks.workunit.client.0.smithi012.stdout: "loc": "" 2023-10-05T11:36:54.041 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:54.041 INFO:tasks.workunit.client.0.smithi012.stdout:} 2023-10-05T11:36:54.041 INFO:tasks.workunit.client.0.smithi012.stdout:{ 2023-10-05T11:36:54.041 INFO:tasks.workunit.client.0.smithi012.stdout: "new_obj": { 2023-10-05T11:36:54.041 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket": { 2023-10-05T11:36:54.041 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "ebtest", 2023-10-05T11:36:54.041 INFO:tasks.workunit.client.0.smithi012.stdout: "marker": "marker", 2023-10-05T11:36:54.041 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket_id": "bucket-id", 2023-10-05T11:36:54.042 INFO:tasks.workunit.client.0.smithi012.stdout: "tenant": "", 2023-10-05T11:36:54.042 INFO:tasks.workunit.client.0.smithi012.stdout: "explicit_placement": { 2023-10-05T11:36:54.042 INFO:tasks.workunit.client.0.smithi012.stdout: "data_pool": ".data-pool", 2023-10-05T11:36:54.042 INFO:tasks.workunit.client.0.smithi012.stdout: "data_extra_pool": "", 2023-10-05T11:36:54.042 INFO:tasks.workunit.client.0.smithi012.stdout: "index_pool": ".index-pool" 2023-10-05T11:36:54.042 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:54.042 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2023-10-05T11:36:54.042 INFO:tasks.workunit.client.0.smithi012.stdout: "key": { 2023-10-05T11:36:54.042 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "myobj", 2023-10-05T11:36:54.042 INFO:tasks.workunit.client.0.smithi012.stdout: "instance": "inst", 2023-10-05T11:36:54.043 INFO:tasks.workunit.client.0.smithi012.stdout: "ns": "" 2023-10-05T11:36:54.043 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:54.043 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:54.043 INFO:tasks.workunit.client.0.smithi012.stdout:} 2023-10-05T11:36:54.043 INFO:tasks.workunit.client.0.smithi012.stdout:raw=.data-pool:marker__:inst_myobj 2023-10-05T11:36:54.043 INFO:tasks.workunit.client.0.smithi012.stdout:{ 2023-10-05T11:36:54.043 INFO:tasks.workunit.client.0.smithi012.stdout: "raw_obj2": { 2023-10-05T11:36:54.043 INFO:tasks.workunit.client.0.smithi012.stdout: "pool": ".data-pool", 2023-10-05T11:36:54.043 INFO:tasks.workunit.client.0.smithi012.stdout: "oid": "marker__:inst_myobj", 2023-10-05T11:36:54.044 INFO:tasks.workunit.client.0.smithi012.stdout: "loc": "" 2023-10-05T11:36:54.044 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:54.044 INFO:tasks.workunit.client.0.smithi012.stdout:} 2023-10-05T11:36:54.044 INFO:tasks.workunit.client.0.smithi012.stdout:{ 2023-10-05T11:36:54.044 INFO:tasks.workunit.client.0.smithi012.stdout: "new_obj2": { 2023-10-05T11:36:54.044 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket": { 2023-10-05T11:36:54.044 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "ebtest", 2023-10-05T11:36:54.044 INFO:tasks.workunit.client.0.smithi012.stdout: "marker": "marker", 2023-10-05T11:36:54.044 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket_id": "bucket-id", 2023-10-05T11:36:54.044 INFO:tasks.workunit.client.0.smithi012.stdout: "tenant": "", 2023-10-05T11:36:54.044 INFO:tasks.workunit.client.0.smithi012.stdout: "explicit_placement": { 2023-10-05T11:36:54.044 INFO:tasks.workunit.client.0.smithi012.stdout: "data_pool": ".data-pool", 2023-10-05T11:36:54.045 INFO:tasks.workunit.client.0.smithi012.stdout: "data_extra_pool": "", 2023-10-05T11:36:54.045 INFO:tasks.workunit.client.0.smithi012.stdout: "index_pool": ".index-pool" 2023-10-05T11:36:54.045 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:54.045 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2023-10-05T11:36:54.045 INFO:tasks.workunit.client.0.smithi012.stdout: "key": { 2023-10-05T11:36:54.045 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "myobj", 2023-10-05T11:36:54.045 INFO:tasks.workunit.client.0.smithi012.stdout: "instance": "inst", 2023-10-05T11:36:54.045 INFO:tasks.workunit.client.0.smithi012.stdout: "ns": "" 2023-10-05T11:36:54.045 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:54.045 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:54.045 INFO:tasks.workunit.client.0.smithi012.stdout:} 2023-10-05T11:36:54.045 INFO:tasks.workunit.client.0.smithi012.stdout:raw2=.data-pool:marker__:inst_myobj 2023-10-05T11:36:54.046 INFO:tasks.workunit.client.0.smithi012.stdout:{ 2023-10-05T11:36:54.046 INFO:tasks.workunit.client.0.smithi012.stdout: "raw_obj": { 2023-10-05T11:36:54.046 INFO:tasks.workunit.client.0.smithi012.stdout: "pool": ".data-pool", 2023-10-05T11:36:54.046 INFO:tasks.workunit.client.0.smithi012.stdout: "oid": "marker__ns:inst_myobj", 2023-10-05T11:36:54.046 INFO:tasks.workunit.client.0.smithi012.stdout: "loc": "" 2023-10-05T11:36:54.046 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:54.046 INFO:tasks.workunit.client.0.smithi012.stdout:} 2023-10-05T11:36:54.046 INFO:tasks.workunit.client.0.smithi012.stdout:{ 2023-10-05T11:36:54.046 INFO:tasks.workunit.client.0.smithi012.stdout: "new_obj": { 2023-10-05T11:36:54.046 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket": { 2023-10-05T11:36:54.047 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "ebtest", 2023-10-05T11:36:54.047 INFO:tasks.workunit.client.0.smithi012.stdout: "marker": "marker", 2023-10-05T11:36:54.047 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket_id": "bucket-id", 2023-10-05T11:36:54.047 INFO:tasks.workunit.client.0.smithi012.stdout: "tenant": "", 2023-10-05T11:36:54.047 INFO:tasks.workunit.client.0.smithi012.stdout: "explicit_placement": { 2023-10-05T11:36:54.047 INFO:tasks.workunit.client.0.smithi012.stdout: "data_pool": ".data-pool", 2023-10-05T11:36:54.047 INFO:tasks.workunit.client.0.smithi012.stdout: "data_extra_pool": "", 2023-10-05T11:36:54.047 INFO:tasks.workunit.client.0.smithi012.stdout: "index_pool": ".index-pool" 2023-10-05T11:36:54.047 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:54.048 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2023-10-05T11:36:54.048 INFO:tasks.workunit.client.0.smithi012.stdout: "key": { 2023-10-05T11:36:54.048 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "myobj", 2023-10-05T11:36:54.048 INFO:tasks.workunit.client.0.smithi012.stdout: "instance": "inst", 2023-10-05T11:36:54.048 INFO:tasks.workunit.client.0.smithi012.stdout: "ns": "ns" 2023-10-05T11:36:54.048 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:54.048 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:54.048 INFO:tasks.workunit.client.0.smithi012.stdout:} 2023-10-05T11:36:54.048 INFO:tasks.workunit.client.0.smithi012.stdout:raw=.data-pool:marker__ns:inst_myobj 2023-10-05T11:36:54.048 INFO:tasks.workunit.client.0.smithi012.stdout:{ 2023-10-05T11:36:54.048 INFO:tasks.workunit.client.0.smithi012.stdout: "raw_obj2": { 2023-10-05T11:36:54.048 INFO:tasks.workunit.client.0.smithi012.stdout: "pool": ".data-pool", 2023-10-05T11:36:54.049 INFO:tasks.workunit.client.0.smithi012.stdout: "oid": "marker__ns:inst_myobj", 2023-10-05T11:36:54.049 INFO:tasks.workunit.client.0.smithi012.stdout: "loc": "" 2023-10-05T11:36:54.049 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:54.049 INFO:tasks.workunit.client.0.smithi012.stdout:} 2023-10-05T11:36:54.049 INFO:tasks.workunit.client.0.smithi012.stdout:{ 2023-10-05T11:36:54.049 INFO:tasks.workunit.client.0.smithi012.stdout: "new_obj2": { 2023-10-05T11:36:54.049 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket": { 2023-10-05T11:36:54.049 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "ebtest", 2023-10-05T11:36:54.049 INFO:tasks.workunit.client.0.smithi012.stdout: "marker": "marker", 2023-10-05T11:36:54.049 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket_id": "bucket-id", 2023-10-05T11:36:54.049 INFO:tasks.workunit.client.0.smithi012.stdout: "tenant": "", 2023-10-05T11:36:54.049 INFO:tasks.workunit.client.0.smithi012.stdout: "explicit_placement": { 2023-10-05T11:36:54.050 INFO:tasks.workunit.client.0.smithi012.stdout: "data_pool": ".data-pool", 2023-10-05T11:36:54.050 INFO:tasks.workunit.client.0.smithi012.stdout: "data_extra_pool": "", 2023-10-05T11:36:54.050 INFO:tasks.workunit.client.0.smithi012.stdout: "index_pool": ".index-pool" 2023-10-05T11:36:54.050 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:54.050 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2023-10-05T11:36:54.050 INFO:tasks.workunit.client.0.smithi012.stdout: "key": { 2023-10-05T11:36:54.050 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "myobj", 2023-10-05T11:36:54.050 INFO:tasks.workunit.client.0.smithi012.stdout: "instance": "inst", 2023-10-05T11:36:54.050 INFO:tasks.workunit.client.0.smithi012.stdout: "ns": "ns" 2023-10-05T11:36:54.050 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:54.050 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:54.051 INFO:tasks.workunit.client.0.smithi012.stdout:} 2023-10-05T11:36:54.051 INFO:tasks.workunit.client.0.smithi012.stdout:raw2=.data-pool:marker__ns:inst_myobj 2023-10-05T11:36:54.051 INFO:tasks.workunit.client.0.smithi012.stdout:{ 2023-10-05T11:36:54.051 INFO:tasks.workunit.client.0.smithi012.stdout: "raw_obj": { 2023-10-05T11:36:54.051 INFO:tasks.workunit.client.0.smithi012.stdout: "pool": ".data-pool", 2023-10-05T11:36:54.051 INFO:tasks.workunit.client.0.smithi012.stdout: "oid": "marker___myobj", 2023-10-05T11:36:54.051 INFO:tasks.workunit.client.0.smithi012.stdout: "loc": "marker__myobj" 2023-10-05T11:36:54.051 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:54.051 INFO:tasks.workunit.client.0.smithi012.stdout:} 2023-10-05T11:36:54.051 INFO:tasks.workunit.client.0.smithi012.stdout:{ 2023-10-05T11:36:54.051 INFO:tasks.workunit.client.0.smithi012.stdout: "new_obj": { 2023-10-05T11:36:54.051 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket": { 2023-10-05T11:36:54.052 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "ebtest", 2023-10-05T11:36:54.052 INFO:tasks.workunit.client.0.smithi012.stdout: "marker": "marker", 2023-10-05T11:36:54.052 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket_id": "bucket-id", 2023-10-05T11:36:54.052 INFO:tasks.workunit.client.0.smithi012.stdout: "tenant": "", 2023-10-05T11:36:54.052 INFO:tasks.workunit.client.0.smithi012.stdout: "explicit_placement": { 2023-10-05T11:36:54.052 INFO:tasks.workunit.client.0.smithi012.stdout: "data_pool": ".data-pool", 2023-10-05T11:36:54.052 INFO:tasks.workunit.client.0.smithi012.stdout: "data_extra_pool": "", 2023-10-05T11:36:54.052 INFO:tasks.workunit.client.0.smithi012.stdout: "index_pool": ".index-pool" 2023-10-05T11:36:54.052 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:54.053 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2023-10-05T11:36:54.053 INFO:tasks.workunit.client.0.smithi012.stdout: "key": { 2023-10-05T11:36:54.053 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "_myobj", 2023-10-05T11:36:54.053 INFO:tasks.workunit.client.0.smithi012.stdout: "instance": "", 2023-10-05T11:36:54.053 INFO:tasks.workunit.client.0.smithi012.stdout: "ns": "" 2023-10-05T11:36:54.053 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:54.053 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:54.053 INFO:tasks.workunit.client.0.smithi012.stdout:} 2023-10-05T11:36:54.053 INFO:tasks.workunit.client.0.smithi012.stdout:raw=.data-pool:marker___myobj 2023-10-05T11:36:54.053 INFO:tasks.workunit.client.0.smithi012.stdout:{ 2023-10-05T11:36:54.053 INFO:tasks.workunit.client.0.smithi012.stdout: "raw_obj2": { 2023-10-05T11:36:54.053 INFO:tasks.workunit.client.0.smithi012.stdout: "pool": ".data-pool", 2023-10-05T11:36:54.054 INFO:tasks.workunit.client.0.smithi012.stdout: "oid": "marker___myobj", 2023-10-05T11:36:54.054 INFO:tasks.workunit.client.0.smithi012.stdout: "loc": "marker__myobj" 2023-10-05T11:36:54.054 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:54.054 INFO:tasks.workunit.client.0.smithi012.stdout:} 2023-10-05T11:36:54.054 INFO:tasks.workunit.client.0.smithi012.stdout:{ 2023-10-05T11:36:54.054 INFO:tasks.workunit.client.0.smithi012.stdout: "new_obj2": { 2023-10-05T11:36:54.054 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket": { 2023-10-05T11:36:54.054 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "ebtest", 2023-10-05T11:36:54.054 INFO:tasks.workunit.client.0.smithi012.stdout: "marker": "marker", 2023-10-05T11:36:54.055 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket_id": "bucket-id", 2023-10-05T11:36:54.055 INFO:tasks.workunit.client.0.smithi012.stdout: "tenant": "", 2023-10-05T11:36:54.055 INFO:tasks.workunit.client.0.smithi012.stdout: "explicit_placement": { 2023-10-05T11:36:54.055 INFO:tasks.workunit.client.0.smithi012.stdout: "data_pool": ".data-pool", 2023-10-05T11:36:54.055 INFO:tasks.workunit.client.0.smithi012.stdout: "data_extra_pool": "", 2023-10-05T11:36:54.055 INFO:tasks.workunit.client.0.smithi012.stdout: "index_pool": ".index-pool" 2023-10-05T11:36:54.055 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:54.055 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2023-10-05T11:36:54.055 INFO:tasks.workunit.client.0.smithi012.stdout: "key": { 2023-10-05T11:36:54.055 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "_myobj", 2023-10-05T11:36:54.055 INFO:tasks.workunit.client.0.smithi012.stdout: "instance": "", 2023-10-05T11:36:54.056 INFO:tasks.workunit.client.0.smithi012.stdout: "ns": "" 2023-10-05T11:36:54.056 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:54.056 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:54.056 INFO:tasks.workunit.client.0.smithi012.stdout:} 2023-10-05T11:36:54.056 INFO:tasks.workunit.client.0.smithi012.stdout:raw2=.data-pool:marker___myobj 2023-10-05T11:36:54.056 INFO:tasks.workunit.client.0.smithi012.stdout:{ 2023-10-05T11:36:54.056 INFO:tasks.workunit.client.0.smithi012.stdout: "raw_obj": { 2023-10-05T11:36:54.056 INFO:tasks.workunit.client.0.smithi012.stdout: "pool": ".data-pool", 2023-10-05T11:36:54.056 INFO:tasks.workunit.client.0.smithi012.stdout: "oid": "marker__ns__myobj", 2023-10-05T11:36:54.056 INFO:tasks.workunit.client.0.smithi012.stdout: "loc": "" 2023-10-05T11:36:54.057 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:54.057 INFO:tasks.workunit.client.0.smithi012.stdout:} 2023-10-05T11:36:54.057 INFO:tasks.workunit.client.0.smithi012.stdout:{ 2023-10-05T11:36:54.057 INFO:tasks.workunit.client.0.smithi012.stdout: "new_obj": { 2023-10-05T11:36:54.057 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket": { 2023-10-05T11:36:54.057 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "ebtest", 2023-10-05T11:36:54.057 INFO:tasks.workunit.client.0.smithi012.stdout: "marker": "marker", 2023-10-05T11:36:54.057 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket_id": "bucket-id", 2023-10-05T11:36:54.057 INFO:tasks.workunit.client.0.smithi012.stdout: "tenant": "", 2023-10-05T11:36:54.058 INFO:tasks.workunit.client.0.smithi012.stdout: "explicit_placement": { 2023-10-05T11:36:54.058 INFO:tasks.workunit.client.0.smithi012.stdout: "data_pool": ".data-pool", 2023-10-05T11:36:54.058 INFO:tasks.workunit.client.0.smithi012.stdout: "data_extra_pool": "", 2023-10-05T11:36:54.058 INFO:tasks.workunit.client.0.smithi012.stdout: "index_pool": ".index-pool" 2023-10-05T11:36:54.058 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:54.058 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2023-10-05T11:36:54.058 INFO:tasks.workunit.client.0.smithi012.stdout: "key": { 2023-10-05T11:36:54.058 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "_myobj", 2023-10-05T11:36:54.058 INFO:tasks.workunit.client.0.smithi012.stdout: "instance": "", 2023-10-05T11:36:54.058 INFO:tasks.workunit.client.0.smithi012.stdout: "ns": "ns" 2023-10-05T11:36:54.058 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:54.059 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:54.059 INFO:tasks.workunit.client.0.smithi012.stdout:} 2023-10-05T11:36:54.059 INFO:tasks.workunit.client.0.smithi012.stdout:raw=.data-pool:marker__ns__myobj 2023-10-05T11:36:54.059 INFO:tasks.workunit.client.0.smithi012.stdout:{ 2023-10-05T11:36:54.059 INFO:tasks.workunit.client.0.smithi012.stdout: "raw_obj2": { 2023-10-05T11:36:54.059 INFO:tasks.workunit.client.0.smithi012.stdout: "pool": ".data-pool", 2023-10-05T11:36:54.059 INFO:tasks.workunit.client.0.smithi012.stdout: "oid": "marker__ns__myobj", 2023-10-05T11:36:54.059 INFO:tasks.workunit.client.0.smithi012.stdout: "loc": "" 2023-10-05T11:36:54.059 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:54.059 INFO:tasks.workunit.client.0.smithi012.stdout:} 2023-10-05T11:36:54.059 INFO:tasks.workunit.client.0.smithi012.stdout:{ 2023-10-05T11:36:54.060 INFO:tasks.workunit.client.0.smithi012.stdout: "new_obj2": { 2023-10-05T11:36:54.060 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket": { 2023-10-05T11:36:54.060 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "ebtest", 2023-10-05T11:36:54.060 INFO:tasks.workunit.client.0.smithi012.stdout: "marker": "marker", 2023-10-05T11:36:54.060 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket_id": "bucket-id", 2023-10-05T11:36:54.060 INFO:tasks.workunit.client.0.smithi012.stdout: "tenant": "", 2023-10-05T11:36:54.060 INFO:tasks.workunit.client.0.smithi012.stdout: "explicit_placement": { 2023-10-05T11:36:54.060 INFO:tasks.workunit.client.0.smithi012.stdout: "data_pool": ".data-pool", 2023-10-05T11:36:54.060 INFO:tasks.workunit.client.0.smithi012.stdout: "data_extra_pool": "", 2023-10-05T11:36:54.060 INFO:tasks.workunit.client.0.smithi012.stdout: "index_pool": ".index-pool" 2023-10-05T11:36:54.060 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:54.060 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2023-10-05T11:36:54.061 INFO:tasks.workunit.client.0.smithi012.stdout: "key": { 2023-10-05T11:36:54.061 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "_myobj", 2023-10-05T11:36:54.061 INFO:tasks.workunit.client.0.smithi012.stdout: "instance": "", 2023-10-05T11:36:54.061 INFO:tasks.workunit.client.0.smithi012.stdout: "ns": "ns" 2023-10-05T11:36:54.061 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:54.061 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:54.061 INFO:tasks.workunit.client.0.smithi012.stdout:} 2023-10-05T11:36:54.061 INFO:tasks.workunit.client.0.smithi012.stdout:raw2=.data-pool:marker__ns__myobj 2023-10-05T11:36:54.061 INFO:tasks.workunit.client.0.smithi012.stdout:{ 2023-10-05T11:36:54.062 INFO:tasks.workunit.client.0.smithi012.stdout: "raw_obj": { 2023-10-05T11:36:54.062 INFO:tasks.workunit.client.0.smithi012.stdout: "pool": ".data-pool", 2023-10-05T11:36:54.062 INFO:tasks.workunit.client.0.smithi012.stdout: "oid": "marker__:inst__myobj", 2023-10-05T11:36:54.062 INFO:tasks.workunit.client.0.smithi012.stdout: "loc": "marker__myobj" 2023-10-05T11:36:54.062 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:54.062 INFO:tasks.workunit.client.0.smithi012.stdout:} 2023-10-05T11:36:54.062 INFO:tasks.workunit.client.0.smithi012.stdout:{ 2023-10-05T11:36:54.063 INFO:tasks.workunit.client.0.smithi012.stdout: "new_obj": { 2023-10-05T11:36:54.063 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket": { 2023-10-05T11:36:54.063 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "ebtest", 2023-10-05T11:36:54.063 INFO:tasks.workunit.client.0.smithi012.stdout: "marker": "marker", 2023-10-05T11:36:54.063 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket_id": "bucket-id", 2023-10-05T11:36:54.063 INFO:tasks.workunit.client.0.smithi012.stdout: "tenant": "", 2023-10-05T11:36:54.063 INFO:tasks.workunit.client.0.smithi012.stdout: "explicit_placement": { 2023-10-05T11:36:54.063 INFO:tasks.workunit.client.0.smithi012.stdout: "data_pool": ".data-pool", 2023-10-05T11:36:54.063 INFO:tasks.workunit.client.0.smithi012.stdout: "data_extra_pool": "", 2023-10-05T11:36:54.063 INFO:tasks.workunit.client.0.smithi012.stdout: "index_pool": ".index-pool" 2023-10-05T11:36:54.063 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:54.063 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2023-10-05T11:36:54.064 INFO:tasks.workunit.client.0.smithi012.stdout: "key": { 2023-10-05T11:36:54.064 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "_myobj", 2023-10-05T11:36:54.064 INFO:tasks.workunit.client.0.smithi012.stdout: "instance": "inst", 2023-10-05T11:36:54.064 INFO:tasks.workunit.client.0.smithi012.stdout: "ns": "" 2023-10-05T11:36:54.064 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:54.064 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:54.064 INFO:tasks.workunit.client.0.smithi012.stdout:} 2023-10-05T11:36:54.064 INFO:tasks.workunit.client.0.smithi012.stdout:raw=.data-pool:marker__:inst__myobj 2023-10-05T11:36:54.064 INFO:tasks.workunit.client.0.smithi012.stdout:{ 2023-10-05T11:36:54.065 INFO:tasks.workunit.client.0.smithi012.stdout: "raw_obj2": { 2023-10-05T11:36:54.065 INFO:tasks.workunit.client.0.smithi012.stdout: "pool": ".data-pool", 2023-10-05T11:36:54.065 INFO:tasks.workunit.client.0.smithi012.stdout: "oid": "marker__:inst__myobj", 2023-10-05T11:36:54.065 INFO:tasks.workunit.client.0.smithi012.stdout: "loc": "marker__myobj" 2023-10-05T11:36:54.065 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:54.065 INFO:tasks.workunit.client.0.smithi012.stdout:} 2023-10-05T11:36:54.065 INFO:tasks.workunit.client.0.smithi012.stdout:{ 2023-10-05T11:36:54.065 INFO:tasks.workunit.client.0.smithi012.stdout: "new_obj2": { 2023-10-05T11:36:54.065 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket": { 2023-10-05T11:36:54.065 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "ebtest", 2023-10-05T11:36:54.065 INFO:tasks.workunit.client.0.smithi012.stdout: "marker": "marker", 2023-10-05T11:36:54.065 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket_id": "bucket-id", 2023-10-05T11:36:54.066 INFO:tasks.workunit.client.0.smithi012.stdout: "tenant": "", 2023-10-05T11:36:54.066 INFO:tasks.workunit.client.0.smithi012.stdout: "explicit_placement": { 2023-10-05T11:36:54.066 INFO:tasks.workunit.client.0.smithi012.stdout: "data_pool": ".data-pool", 2023-10-05T11:36:54.066 INFO:tasks.workunit.client.0.smithi012.stdout: "data_extra_pool": "", 2023-10-05T11:36:54.066 INFO:tasks.workunit.client.0.smithi012.stdout: "index_pool": ".index-pool" 2023-10-05T11:36:54.066 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:54.066 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2023-10-05T11:36:54.066 INFO:tasks.workunit.client.0.smithi012.stdout: "key": { 2023-10-05T11:36:54.066 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "_myobj", 2023-10-05T11:36:54.066 INFO:tasks.workunit.client.0.smithi012.stdout: "instance": "inst", 2023-10-05T11:36:54.066 INFO:tasks.workunit.client.0.smithi012.stdout: "ns": "" 2023-10-05T11:36:54.067 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:54.067 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:54.067 INFO:tasks.workunit.client.0.smithi012.stdout:} 2023-10-05T11:36:54.067 INFO:tasks.workunit.client.0.smithi012.stdout:raw2=.data-pool:marker__:inst__myobj 2023-10-05T11:36:54.067 INFO:tasks.workunit.client.0.smithi012.stdout:{ 2023-10-05T11:36:54.067 INFO:tasks.workunit.client.0.smithi012.stdout: "raw_obj": { 2023-10-05T11:36:54.067 INFO:tasks.workunit.client.0.smithi012.stdout: "pool": ".data-pool", 2023-10-05T11:36:54.067 INFO:tasks.workunit.client.0.smithi012.stdout: "oid": "marker__ns:inst__myobj", 2023-10-05T11:36:54.067 INFO:tasks.workunit.client.0.smithi012.stdout: "loc": "" 2023-10-05T11:36:54.067 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:54.069 INFO:tasks.workunit.client.0.smithi012.stdout:} 2023-10-05T11:36:54.069 INFO:tasks.workunit.client.0.smithi012.stdout:{ 2023-10-05T11:36:54.069 INFO:tasks.workunit.client.0.smithi012.stdout: "new_obj": { 2023-10-05T11:36:54.069 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket": { 2023-10-05T11:36:54.069 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "ebtest", 2023-10-05T11:36:54.069 INFO:tasks.workunit.client.0.smithi012.stdout: "marker": "marker", 2023-10-05T11:36:54.069 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket_id": "bucket-id", 2023-10-05T11:36:54.069 INFO:tasks.workunit.client.0.smithi012.stdout: "tenant": "", 2023-10-05T11:36:54.070 INFO:tasks.workunit.client.0.smithi012.stdout: "explicit_placement": { 2023-10-05T11:36:54.070 INFO:tasks.workunit.client.0.smithi012.stdout: "data_pool": ".data-pool", 2023-10-05T11:36:54.070 INFO:tasks.workunit.client.0.smithi012.stdout: "data_extra_pool": "", 2023-10-05T11:36:54.070 INFO:tasks.workunit.client.0.smithi012.stdout: "index_pool": ".index-pool" 2023-10-05T11:36:54.070 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:54.070 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2023-10-05T11:36:54.070 INFO:tasks.workunit.client.0.smithi012.stdout: "key": { 2023-10-05T11:36:54.070 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "_myobj", 2023-10-05T11:36:54.070 INFO:tasks.workunit.client.0.smithi012.stdout: "instance": "inst", 2023-10-05T11:36:54.070 INFO:tasks.workunit.client.0.smithi012.stdout: "ns": "ns" 2023-10-05T11:36:54.071 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:54.071 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:54.071 INFO:tasks.workunit.client.0.smithi012.stdout:} 2023-10-05T11:36:54.071 INFO:tasks.workunit.client.0.smithi012.stdout:raw=.data-pool:marker__ns:inst__myobj 2023-10-05T11:36:54.071 INFO:tasks.workunit.client.0.smithi012.stdout:{ 2023-10-05T11:36:54.071 INFO:tasks.workunit.client.0.smithi012.stdout: "raw_obj2": { 2023-10-05T11:36:54.071 INFO:tasks.workunit.client.0.smithi012.stdout: "pool": ".data-pool", 2023-10-05T11:36:54.071 INFO:tasks.workunit.client.0.smithi012.stdout: "oid": "marker__ns:inst__myobj", 2023-10-05T11:36:54.072 INFO:tasks.workunit.client.0.smithi012.stdout: "loc": "" 2023-10-05T11:36:54.072 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:54.072 INFO:tasks.workunit.client.0.smithi012.stdout:} 2023-10-05T11:36:54.072 INFO:tasks.workunit.client.0.smithi012.stdout:{ 2023-10-05T11:36:54.072 INFO:tasks.workunit.client.0.smithi012.stdout: "new_obj2": { 2023-10-05T11:36:54.072 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket": { 2023-10-05T11:36:54.072 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "ebtest", 2023-10-05T11:36:54.072 INFO:tasks.workunit.client.0.smithi012.stdout: "marker": "marker", 2023-10-05T11:36:54.072 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket_id": "bucket-id", 2023-10-05T11:36:54.072 INFO:tasks.workunit.client.0.smithi012.stdout: "tenant": "", 2023-10-05T11:36:54.072 INFO:tasks.workunit.client.0.smithi012.stdout: "explicit_placement": { 2023-10-05T11:36:54.072 INFO:tasks.workunit.client.0.smithi012.stdout: "data_pool": ".data-pool", 2023-10-05T11:36:54.073 INFO:tasks.workunit.client.0.smithi012.stdout: "data_extra_pool": "", 2023-10-05T11:36:54.073 INFO:tasks.workunit.client.0.smithi012.stdout: "index_pool": ".index-pool" 2023-10-05T11:36:54.073 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:54.073 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2023-10-05T11:36:54.073 INFO:tasks.workunit.client.0.smithi012.stdout: "key": { 2023-10-05T11:36:54.073 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "_myobj", 2023-10-05T11:36:54.073 INFO:tasks.workunit.client.0.smithi012.stdout: "instance": "inst", 2023-10-05T11:36:54.073 INFO:tasks.workunit.client.0.smithi012.stdout: "ns": "ns" 2023-10-05T11:36:54.073 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:54.073 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:54.074 INFO:tasks.workunit.client.0.smithi012.stdout:} 2023-10-05T11:36:54.074 INFO:tasks.workunit.client.0.smithi012.stdout:raw2=.data-pool:marker__ns:inst__myobj 2023-10-05T11:36:54.074 INFO:tasks.workunit.client.0.smithi012.stdout:{ 2023-10-05T11:36:54.074 INFO:tasks.workunit.client.0.smithi012.stdout: "raw_obj": { 2023-10-05T11:36:54.074 INFO:tasks.workunit.client.0.smithi012.stdout: "pool": ".data-pool", 2023-10-05T11:36:54.074 INFO:tasks.workunit.client.0.smithi012.stdout: "oid": "marker___myobj_", 2023-10-05T11:36:54.074 INFO:tasks.workunit.client.0.smithi012.stdout: "loc": "marker__myobj_" 2023-10-05T11:36:54.074 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:54.074 INFO:tasks.workunit.client.0.smithi012.stdout:} 2023-10-05T11:36:54.074 INFO:tasks.workunit.client.0.smithi012.stdout:{ 2023-10-05T11:36:54.074 INFO:tasks.workunit.client.0.smithi012.stdout: "new_obj": { 2023-10-05T11:36:54.075 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket": { 2023-10-05T11:36:54.075 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "ebtest", 2023-10-05T11:36:54.075 INFO:tasks.workunit.client.0.smithi012.stdout: "marker": "marker", 2023-10-05T11:36:54.075 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket_id": "bucket-id", 2023-10-05T11:36:54.075 INFO:tasks.workunit.client.0.smithi012.stdout: "tenant": "", 2023-10-05T11:36:54.075 INFO:tasks.workunit.client.0.smithi012.stdout: "explicit_placement": { 2023-10-05T11:36:54.075 INFO:tasks.workunit.client.0.smithi012.stdout: "data_pool": ".data-pool", 2023-10-05T11:36:54.075 INFO:tasks.workunit.client.0.smithi012.stdout: "data_extra_pool": "", 2023-10-05T11:36:54.075 INFO:tasks.workunit.client.0.smithi012.stdout: "index_pool": ".index-pool" 2023-10-05T11:36:54.076 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:54.076 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2023-10-05T11:36:54.076 INFO:tasks.workunit.client.0.smithi012.stdout: "key": { 2023-10-05T11:36:54.076 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "_myobj_", 2023-10-05T11:36:54.076 INFO:tasks.workunit.client.0.smithi012.stdout: "instance": "", 2023-10-05T11:36:54.076 INFO:tasks.workunit.client.0.smithi012.stdout: "ns": "" 2023-10-05T11:36:54.076 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:54.076 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:54.076 INFO:tasks.workunit.client.0.smithi012.stdout:} 2023-10-05T11:36:54.076 INFO:tasks.workunit.client.0.smithi012.stdout:raw=.data-pool:marker___myobj_ 2023-10-05T11:36:54.077 INFO:tasks.workunit.client.0.smithi012.stdout:{ 2023-10-05T11:36:54.077 INFO:tasks.workunit.client.0.smithi012.stdout: "raw_obj2": { 2023-10-05T11:36:54.077 INFO:tasks.workunit.client.0.smithi012.stdout: "pool": ".data-pool", 2023-10-05T11:36:54.077 INFO:tasks.workunit.client.0.smithi012.stdout: "oid": "marker___myobj_", 2023-10-05T11:36:54.077 INFO:tasks.workunit.client.0.smithi012.stdout: "loc": "marker__myobj_" 2023-10-05T11:36:54.077 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:54.077 INFO:tasks.workunit.client.0.smithi012.stdout:} 2023-10-05T11:36:54.077 INFO:tasks.workunit.client.0.smithi012.stdout:{ 2023-10-05T11:36:54.077 INFO:tasks.workunit.client.0.smithi012.stdout: "new_obj2": { 2023-10-05T11:36:54.077 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket": { 2023-10-05T11:36:54.077 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "ebtest", 2023-10-05T11:36:54.077 INFO:tasks.workunit.client.0.smithi012.stdout: "marker": "marker", 2023-10-05T11:36:54.078 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket_id": "bucket-id", 2023-10-05T11:36:54.078 INFO:tasks.workunit.client.0.smithi012.stdout: "tenant": "", 2023-10-05T11:36:54.078 INFO:tasks.workunit.client.0.smithi012.stdout: "explicit_placement": { 2023-10-05T11:36:54.078 INFO:tasks.workunit.client.0.smithi012.stdout: "data_pool": ".data-pool", 2023-10-05T11:36:54.078 INFO:tasks.workunit.client.0.smithi012.stdout: "data_extra_pool": "", 2023-10-05T11:36:54.078 INFO:tasks.workunit.client.0.smithi012.stdout: "index_pool": ".index-pool" 2023-10-05T11:36:54.078 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:54.078 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2023-10-05T11:36:54.078 INFO:tasks.workunit.client.0.smithi012.stdout: "key": { 2023-10-05T11:36:54.079 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "_myobj_", 2023-10-05T11:36:54.079 INFO:tasks.workunit.client.0.smithi012.stdout: "instance": "", 2023-10-05T11:36:54.079 INFO:tasks.workunit.client.0.smithi012.stdout: "ns": "" 2023-10-05T11:36:54.079 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:54.079 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:54.079 INFO:tasks.workunit.client.0.smithi012.stdout:} 2023-10-05T11:36:54.079 INFO:tasks.workunit.client.0.smithi012.stdout:raw2=.data-pool:marker___myobj_ 2023-10-05T11:36:54.079 INFO:tasks.workunit.client.0.smithi012.stdout:{ 2023-10-05T11:36:54.079 INFO:tasks.workunit.client.0.smithi012.stdout: "raw_obj": { 2023-10-05T11:36:54.080 INFO:tasks.workunit.client.0.smithi012.stdout: "pool": ".data-pool", 2023-10-05T11:36:54.080 INFO:tasks.workunit.client.0.smithi012.stdout: "oid": "marker__ns__myobj_", 2023-10-05T11:36:54.080 INFO:tasks.workunit.client.0.smithi012.stdout: "loc": "" 2023-10-05T11:36:54.080 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:54.080 INFO:tasks.workunit.client.0.smithi012.stdout:} 2023-10-05T11:36:54.080 INFO:tasks.workunit.client.0.smithi012.stdout:{ 2023-10-05T11:36:54.081 INFO:tasks.workunit.client.0.smithi012.stdout: "new_obj": { 2023-10-05T11:36:54.081 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket": { 2023-10-05T11:36:54.081 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "ebtest", 2023-10-05T11:36:54.081 INFO:tasks.workunit.client.0.smithi012.stdout: "marker": "marker", 2023-10-05T11:36:54.081 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket_id": "bucket-id", 2023-10-05T11:36:54.081 INFO:tasks.workunit.client.0.smithi012.stdout: "tenant": "", 2023-10-05T11:36:54.082 INFO:tasks.workunit.client.0.smithi012.stdout: "explicit_placement": { 2023-10-05T11:36:54.082 INFO:tasks.workunit.client.0.smithi012.stdout: "data_pool": ".data-pool", 2023-10-05T11:36:54.082 INFO:tasks.workunit.client.0.smithi012.stdout: "data_extra_pool": "", 2023-10-05T11:36:54.082 INFO:tasks.workunit.client.0.smithi012.stdout: "index_pool": ".index-pool" 2023-10-05T11:36:54.082 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:54.083 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2023-10-05T11:36:54.083 INFO:tasks.workunit.client.0.smithi012.stdout: "key": { 2023-10-05T11:36:54.083 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "_myobj_", 2023-10-05T11:36:54.083 INFO:tasks.workunit.client.0.smithi012.stdout: "instance": "", 2023-10-05T11:36:54.083 INFO:tasks.workunit.client.0.smithi012.stdout: "ns": "ns" 2023-10-05T11:36:54.083 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:54.084 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:54.084 INFO:tasks.workunit.client.0.smithi012.stdout:} 2023-10-05T11:36:54.084 INFO:tasks.workunit.client.0.smithi012.stdout:raw=.data-pool:marker__ns__myobj_ 2023-10-05T11:36:54.084 INFO:tasks.workunit.client.0.smithi012.stdout:{ 2023-10-05T11:36:54.084 INFO:tasks.workunit.client.0.smithi012.stdout: "raw_obj2": { 2023-10-05T11:36:54.084 INFO:tasks.workunit.client.0.smithi012.stdout: "pool": ".data-pool", 2023-10-05T11:36:54.085 INFO:tasks.workunit.client.0.smithi012.stdout: "oid": "marker__ns__myobj_", 2023-10-05T11:36:54.085 INFO:tasks.workunit.client.0.smithi012.stdout: "loc": "" 2023-10-05T11:36:54.085 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:54.085 INFO:tasks.workunit.client.0.smithi012.stdout:} 2023-10-05T11:36:54.085 INFO:tasks.workunit.client.0.smithi012.stdout:{ 2023-10-05T11:36:54.085 INFO:tasks.workunit.client.0.smithi012.stdout: "new_obj2": { 2023-10-05T11:36:54.086 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket": { 2023-10-05T11:36:54.086 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "ebtest", 2023-10-05T11:36:54.086 INFO:tasks.workunit.client.0.smithi012.stdout: "marker": "marker", 2023-10-05T11:36:54.086 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket_id": "bucket-id", 2023-10-05T11:36:54.086 INFO:tasks.workunit.client.0.smithi012.stdout: "tenant": "", 2023-10-05T11:36:54.086 INFO:tasks.workunit.client.0.smithi012.stdout: "explicit_placement": { 2023-10-05T11:36:54.086 INFO:tasks.workunit.client.0.smithi012.stdout: "data_pool": ".data-pool", 2023-10-05T11:36:54.087 INFO:tasks.workunit.client.0.smithi012.stdout: "data_extra_pool": "", 2023-10-05T11:36:54.087 INFO:tasks.workunit.client.0.smithi012.stdout: "index_pool": ".index-pool" 2023-10-05T11:36:54.087 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:54.087 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2023-10-05T11:36:54.087 INFO:tasks.workunit.client.0.smithi012.stdout: "key": { 2023-10-05T11:36:54.087 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "_myobj_", 2023-10-05T11:36:54.087 INFO:tasks.workunit.client.0.smithi012.stdout: "instance": "", 2023-10-05T11:36:54.087 INFO:tasks.workunit.client.0.smithi012.stdout: "ns": "ns" 2023-10-05T11:36:54.088 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:54.088 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:54.088 INFO:tasks.workunit.client.0.smithi012.stdout:} 2023-10-05T11:36:54.088 INFO:tasks.workunit.client.0.smithi012.stdout:raw2=.data-pool:marker__ns__myobj_ 2023-10-05T11:36:54.088 INFO:tasks.workunit.client.0.smithi012.stdout:{ 2023-10-05T11:36:54.088 INFO:tasks.workunit.client.0.smithi012.stdout: "raw_obj": { 2023-10-05T11:36:54.088 INFO:tasks.workunit.client.0.smithi012.stdout: "pool": ".data-pool", 2023-10-05T11:36:54.089 INFO:tasks.workunit.client.0.smithi012.stdout: "oid": "marker__:inst__myobj_", 2023-10-05T11:36:54.089 INFO:tasks.workunit.client.0.smithi012.stdout: "loc": "marker__myobj_" 2023-10-05T11:36:54.089 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:54.089 INFO:tasks.workunit.client.0.smithi012.stdout:} 2023-10-05T11:36:54.089 INFO:tasks.workunit.client.0.smithi012.stdout:{ 2023-10-05T11:36:54.089 INFO:tasks.workunit.client.0.smithi012.stdout: "new_obj": { 2023-10-05T11:36:54.089 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket": { 2023-10-05T11:36:54.090 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "ebtest", 2023-10-05T11:36:54.090 INFO:tasks.workunit.client.0.smithi012.stdout: "marker": "marker", 2023-10-05T11:36:54.090 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket_id": "bucket-id", 2023-10-05T11:36:54.090 INFO:tasks.workunit.client.0.smithi012.stdout: "tenant": "", 2023-10-05T11:36:54.090 INFO:tasks.workunit.client.0.smithi012.stdout: "explicit_placement": { 2023-10-05T11:36:54.090 INFO:tasks.workunit.client.0.smithi012.stdout: "data_pool": ".data-pool", 2023-10-05T11:36:54.091 INFO:tasks.workunit.client.0.smithi012.stdout: "data_extra_pool": "", 2023-10-05T11:36:54.091 INFO:tasks.workunit.client.0.smithi012.stdout: "index_pool": ".index-pool" 2023-10-05T11:36:54.091 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:54.091 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2023-10-05T11:36:54.091 INFO:tasks.workunit.client.0.smithi012.stdout: "key": { 2023-10-05T11:36:54.091 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "_myobj_", 2023-10-05T11:36:54.091 INFO:tasks.workunit.client.0.smithi012.stdout: "instance": "inst", 2023-10-05T11:36:54.091 INFO:tasks.workunit.client.0.smithi012.stdout: "ns": "" 2023-10-05T11:36:54.091 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:54.091 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:54.091 INFO:tasks.workunit.client.0.smithi012.stdout:} 2023-10-05T11:36:54.092 INFO:tasks.workunit.client.0.smithi012.stdout:raw=.data-pool:marker__:inst__myobj_ 2023-10-05T11:36:54.092 INFO:tasks.workunit.client.0.smithi012.stdout:{ 2023-10-05T11:36:54.092 INFO:tasks.workunit.client.0.smithi012.stdout: "raw_obj2": { 2023-10-05T11:36:54.092 INFO:tasks.workunit.client.0.smithi012.stdout: "pool": ".data-pool", 2023-10-05T11:36:54.092 INFO:tasks.workunit.client.0.smithi012.stdout: "oid": "marker__:inst__myobj_", 2023-10-05T11:36:54.092 INFO:tasks.workunit.client.0.smithi012.stdout: "loc": "marker__myobj_" 2023-10-05T11:36:54.092 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:54.092 INFO:tasks.workunit.client.0.smithi012.stdout:} 2023-10-05T11:36:54.092 INFO:tasks.workunit.client.0.smithi012.stdout:{ 2023-10-05T11:36:54.092 INFO:tasks.workunit.client.0.smithi012.stdout: "new_obj2": { 2023-10-05T11:36:54.092 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket": { 2023-10-05T11:36:54.092 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "ebtest", 2023-10-05T11:36:54.093 INFO:tasks.workunit.client.0.smithi012.stdout: "marker": "marker", 2023-10-05T11:36:54.093 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket_id": "bucket-id", 2023-10-05T11:36:54.093 INFO:tasks.workunit.client.0.smithi012.stdout: "tenant": "", 2023-10-05T11:36:54.093 INFO:tasks.workunit.client.0.smithi012.stdout: "explicit_placement": { 2023-10-05T11:36:54.093 INFO:tasks.workunit.client.0.smithi012.stdout: "data_pool": ".data-pool", 2023-10-05T11:36:54.093 INFO:tasks.workunit.client.0.smithi012.stdout: "data_extra_pool": "", 2023-10-05T11:36:54.093 INFO:tasks.workunit.client.0.smithi012.stdout: "index_pool": ".index-pool" 2023-10-05T11:36:54.093 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:54.093 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2023-10-05T11:36:54.093 INFO:tasks.workunit.client.0.smithi012.stdout: "key": { 2023-10-05T11:36:54.093 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "_myobj_", 2023-10-05T11:36:54.093 INFO:tasks.workunit.client.0.smithi012.stdout: "instance": "inst", 2023-10-05T11:36:54.093 INFO:tasks.workunit.client.0.smithi012.stdout: "ns": "" 2023-10-05T11:36:54.094 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:54.094 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:54.094 INFO:tasks.workunit.client.0.smithi012.stdout:} 2023-10-05T11:36:54.094 INFO:tasks.workunit.client.0.smithi012.stdout:raw2=.data-pool:marker__:inst__myobj_ 2023-10-05T11:36:54.094 INFO:tasks.workunit.client.0.smithi012.stdout:{ 2023-10-05T11:36:54.094 INFO:tasks.workunit.client.0.smithi012.stdout: "raw_obj": { 2023-10-05T11:36:54.094 INFO:tasks.workunit.client.0.smithi012.stdout: "pool": ".data-pool", 2023-10-05T11:36:54.094 INFO:tasks.workunit.client.0.smithi012.stdout: "oid": "marker__ns:inst__myobj_", 2023-10-05T11:36:54.094 INFO:tasks.workunit.client.0.smithi012.stdout: "loc": "" 2023-10-05T11:36:54.095 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:54.095 INFO:tasks.workunit.client.0.smithi012.stdout:} 2023-10-05T11:36:54.095 INFO:tasks.workunit.client.0.smithi012.stdout:{ 2023-10-05T11:36:54.095 INFO:tasks.workunit.client.0.smithi012.stdout: "new_obj": { 2023-10-05T11:36:54.095 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket": { 2023-10-05T11:36:54.095 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "ebtest", 2023-10-05T11:36:54.096 INFO:tasks.workunit.client.0.smithi012.stdout: "marker": "marker", 2023-10-05T11:36:54.096 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket_id": "bucket-id", 2023-10-05T11:36:54.096 INFO:tasks.workunit.client.0.smithi012.stdout: "tenant": "", 2023-10-05T11:36:54.096 INFO:tasks.workunit.client.0.smithi012.stdout: "explicit_placement": { 2023-10-05T11:36:54.096 INFO:tasks.workunit.client.0.smithi012.stdout: "data_pool": ".data-pool", 2023-10-05T11:36:54.097 INFO:tasks.workunit.client.0.smithi012.stdout: "data_extra_pool": "", 2023-10-05T11:36:54.097 INFO:tasks.workunit.client.0.smithi012.stdout: "index_pool": ".index-pool" 2023-10-05T11:36:54.097 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:54.097 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2023-10-05T11:36:54.097 INFO:tasks.workunit.client.0.smithi012.stdout: "key": { 2023-10-05T11:36:54.097 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "_myobj_", 2023-10-05T11:36:54.097 INFO:tasks.workunit.client.0.smithi012.stdout: "instance": "inst", 2023-10-05T11:36:54.097 INFO:tasks.workunit.client.0.smithi012.stdout: "ns": "ns" 2023-10-05T11:36:54.098 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:54.098 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:54.098 INFO:tasks.workunit.client.0.smithi012.stdout:} 2023-10-05T11:36:54.098 INFO:tasks.workunit.client.0.smithi012.stdout:raw=.data-pool:marker__ns:inst__myobj_ 2023-10-05T11:36:54.098 INFO:tasks.workunit.client.0.smithi012.stdout:{ 2023-10-05T11:36:54.098 INFO:tasks.workunit.client.0.smithi012.stdout: "raw_obj2": { 2023-10-05T11:36:54.098 INFO:tasks.workunit.client.0.smithi012.stdout: "pool": ".data-pool", 2023-10-05T11:36:54.098 INFO:tasks.workunit.client.0.smithi012.stdout: "oid": "marker__ns:inst__myobj_", 2023-10-05T11:36:54.099 INFO:tasks.workunit.client.0.smithi012.stdout: "loc": "" 2023-10-05T11:36:54.099 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:54.099 INFO:tasks.workunit.client.0.smithi012.stdout:} 2023-10-05T11:36:54.099 INFO:tasks.workunit.client.0.smithi012.stdout:{ 2023-10-05T11:36:54.099 INFO:tasks.workunit.client.0.smithi012.stdout: "new_obj2": { 2023-10-05T11:36:54.099 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket": { 2023-10-05T11:36:54.099 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "ebtest", 2023-10-05T11:36:54.099 INFO:tasks.workunit.client.0.smithi012.stdout: "marker": "marker", 2023-10-05T11:36:54.100 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket_id": "bucket-id", 2023-10-05T11:36:54.100 INFO:tasks.workunit.client.0.smithi012.stdout: "tenant": "", 2023-10-05T11:36:54.100 INFO:tasks.workunit.client.0.smithi012.stdout: "explicit_placement": { 2023-10-05T11:36:54.100 INFO:tasks.workunit.client.0.smithi012.stdout: "data_pool": ".data-pool", 2023-10-05T11:36:54.100 INFO:tasks.workunit.client.0.smithi012.stdout: "data_extra_pool": "", 2023-10-05T11:36:54.100 INFO:tasks.workunit.client.0.smithi012.stdout: "index_pool": ".index-pool" 2023-10-05T11:36:54.100 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:54.101 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2023-10-05T11:36:54.101 INFO:tasks.workunit.client.0.smithi012.stdout: "key": { 2023-10-05T11:36:54.101 INFO:tasks.workunit.client.0.smithi012.stdout: "name": "_myobj_", 2023-10-05T11:36:54.101 INFO:tasks.workunit.client.0.smithi012.stdout: "instance": "inst", 2023-10-05T11:36:54.101 INFO:tasks.workunit.client.0.smithi012.stdout: "ns": "ns" 2023-10-05T11:36:54.101 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:54.101 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:54.102 INFO:tasks.workunit.client.0.smithi012.stdout:} 2023-10-05T11:36:54.102 INFO:tasks.workunit.client.0.smithi012.stdout:raw2=.data-pool:marker__ns:inst__myobj_ 2023-10-05T11:36:54.102 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] TestRGWObj.old_to_raw (0 ms) 2023-10-05T11:36:54.102 INFO:tasks.workunit.client.0.smithi012.stdout:[----------] 4 tests from TestRGWObj (1 ms total) 2023-10-05T11:36:54.102 INFO:tasks.workunit.client.0.smithi012.stdout: 2023-10-05T11:36:54.102 INFO:tasks.workunit.client.0.smithi012.stdout:[----------] Global test environment tear-down 2023-10-05T11:36:54.102 INFO:tasks.workunit.client.0.smithi012.stdout:[==========] 4 tests from 1 test suite ran. (1 ms total) 2023-10-05T11:36:54.102 INFO:tasks.workunit.client.0.smithi012.stdout:[ PASSED ] 4 tests. 2023-10-05T11:36:54.102 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-10-05T11:36:54.103 DEBUG:teuthology.orchestra.run.smithi012:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-10-05T11:36:54.135 INFO:tasks.workunit:Running workunits matching rgw/test_librgw_file.sh on client.0... 2023-10-05T11:36:54.136 INFO:tasks.workunit:Running workunit rgw/test_librgw_file.sh... 2023-10-05T11:36:54.136 DEBUG:teuthology.orchestra.run.smithi012:workunit test rgw/test_librgw_file.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=38321be854743c0d616618a9ea8aa0b1d4dbc0bf TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_librgw_file.sh 2023-10-05T11:36:54.263 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setuser ceph since I am not root 2023-10-05T11:36:54.263 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T11:36:54.277 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:36:54.274+0000 7f3427f28880 20 rados->read ofs=0 len=0 2023-10-05T11:36:54.278 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:36:54.275+0000 7f3427f28880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:36:54.279 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:36:54.275+0000 7f3427f28880 20 realm 2023-10-05T11:36:54.279 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:36:54.275+0000 7f3427f28880 20 rados->read ofs=0 len=0 2023-10-05T11:36:54.279 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:36:54.276+0000 7f3427f28880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:36:54.279 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:36:54.276+0000 7f3427f28880 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T11:36:54.279 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:36:54.276+0000 7f3427f28880 20 rados->read ofs=0 len=0 2023-10-05T11:36:54.279 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:36:54.276+0000 7f3427f28880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:36:54.280 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:36:54.276+0000 7f3427f28880 20 rados->read ofs=0 len=0 2023-10-05T11:36:54.280 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:36:54.277+0000 7f3427f28880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:36:54.280 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:36:54.277+0000 7f3427f28880 20 rados->read ofs=0 len=0 2023-10-05T11:36:54.280 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:36:54.278+0000 7f3427f28880 20 rados_obj.operate() r=0 bl.length=1020 2023-10-05T11:36:54.281 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:36:54.278+0000 7f3427f28880 20 searching for the correct realm 2023-10-05T11:36:54.302 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:36:54.300+0000 7f3424852640 0 -- 172.21.15.12:0/2962203537 >> [v2:172.21.15.170:6814/3150808418,v1:172.21.15.170:6816/3150808418] conn(0x55eabc230000 msgr2=0x55eabc08f180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:36:54.304 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:36:54.301+0000 7f3427f28880 20 RGWRados::pool_iterate: got zone_info.dff27d1e-df33-400e-a68a-7ba586947c99 2023-10-05T11:36:54.304 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:36:54.301+0000 7f3427f28880 20 RGWRados::pool_iterate: got zonegroup_info.c78aa576-9d15-4e9d-b3c0-4af23a22062c 2023-10-05T11:36:54.304 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:36:54.301+0000 7f3427f28880 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T11:36:54.304 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:36:54.301+0000 7f3427f28880 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T11:36:54.305 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:36:54.301+0000 7f3427f28880 20 rados->read ofs=0 len=0 2023-10-05T11:36:54.305 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:36:54.302+0000 7f3427f28880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:36:54.305 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:36:54.302+0000 7f3427f28880 20 rados->read ofs=0 len=0 2023-10-05T11:36:54.306 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:36:54.302+0000 7f3427f28880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:36:54.306 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:36:54.302+0000 7f3427f28880 20 rados->read ofs=0 len=0 2023-10-05T11:36:54.306 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:36:54.302+0000 7f3427f28880 20 rados_obj.operate() r=0 bl.length=454 2023-10-05T11:36:54.306 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:36:54.302+0000 7f3427f28880 20 zone default found 2023-10-05T11:36:54.307 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:36:54.302+0000 7f3427f28880 4 Realm: () 2023-10-05T11:36:54.307 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:36:54.302+0000 7f3427f28880 4 ZoneGroup: default (c78aa576-9d15-4e9d-b3c0-4af23a22062c) 2023-10-05T11:36:54.307 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:36:54.302+0000 7f3427f28880 4 Zone: default (dff27d1e-df33-400e-a68a-7ba586947c99) 2023-10-05T11:36:54.307 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:36:54.302+0000 7f3427f28880 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T11:36:54.307 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:36:54.302+0000 7f3427f28880 20 zonegroup default 2023-10-05T11:36:54.307 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:36:54.302+0000 7f3427f28880 20 rados->read ofs=0 len=0 2023-10-05T11:36:54.307 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:36:54.303+0000 7f3427f28880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:36:54.308 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:36:54.303+0000 7f3427f28880 20 rados->read ofs=0 len=0 2023-10-05T11:36:54.308 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:36:54.303+0000 7f3427f28880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:36:54.308 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:36:54.303+0000 7f3427f28880 20 rados->read ofs=0 len=0 2023-10-05T11:36:54.308 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:36:54.303+0000 7f3427f28880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:36:54.308 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:36:54.303+0000 7f3427f28880 20 started sync module instance, tier type = 2023-10-05T11:36:54.308 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:36:54.303+0000 7f3427f28880 20 started zone id=dff27d1e-df33-400e-a68a-7ba586947c99 (name=default) with tier type = 2023-10-05T11:36:54.310 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:36:54.308+0000 7f3424852640 0 -- 172.21.15.12:0/2962203537 >> [v2:172.21.15.12:6800/732466381,v1:172.21.15.12:6801/732466381] conn(0x55eabc147000 msgr2=0x55eabc21ac00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:36:54.315 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:36:54.313+0000 7f3427f28880 20 add_watcher() i=0 2023-10-05T11:36:54.315 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:36:54.313+0000 7f3427f28880 20 add_watcher() i=1 2023-10-05T11:36:54.316 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:36:54.313+0000 7f3427f28880 20 add_watcher() i=2 2023-10-05T11:36:54.316 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:36:54.313+0000 7f3427f28880 20 add_watcher() i=3 2023-10-05T11:36:54.316 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:36:54.313+0000 7f3427f28880 20 add_watcher() i=4 2023-10-05T11:36:54.316 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:36:54.313+0000 7f3427f28880 20 add_watcher() i=5 2023-10-05T11:36:54.316 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:36:54.313+0000 7f3427f28880 20 add_watcher() i=6 2023-10-05T11:36:54.317 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:36:54.314+0000 7f3427f28880 20 add_watcher() i=7 2023-10-05T11:36:54.317 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:36:54.314+0000 7f3427f28880 2 all 8 watchers are set, enabling cache 2023-10-05T11:36:54.318 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:36:54.315+0000 7f340b820640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:36:54.318 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:36:54.316+0000 7f3427f28880 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T11:36:54.319 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:36:54.316+0000 7f3427f28880 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T11:36:54.324 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:36:54.321+0000 7f3427f28880 5 note: GC not initialized 2023-10-05T11:36:54.325 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:36:54.322+0000 7f3407017640 20 reqs_thread_entry: start 2023-10-05T11:36:54.325 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:36:54.322+0000 7f3427f28880 20 init_complete bucket index max shards: 11 2023-10-05T11:36:54.325 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:36:54.322+0000 7f3427f28880 20 Filter name: none 2023-10-05T11:36:54.325 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:36:54.322+0000 7f3405013640 20 reqs_thread_entry: start 2023-10-05T11:36:54.325 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:36:54.322+0000 7f3427f28880 10 cache get: name=default.rgw.meta+users.uid+ceph-test-librgw-file : miss 2023-10-05T11:36:54.326 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:36:54.322+0000 7f3427f28880 20 rados->read ofs=0 len=0 2023-10-05T11:36:54.326 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:36:54.323+0000 7f3427f28880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:36:54.326 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:36:54.323+0000 7f3427f28880 10 cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x0 2023-10-05T11:36:54.326 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:36:54.323+0000 7f3427f28880 10 adding default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2023-10-05T11:36:54.326 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:36:54.323+0000 7f3427f28880 10 cache get: name=default.rgw.meta+users.email+librgw@example.com : miss 2023-10-05T11:36:54.326 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:36:54.323+0000 7f3427f28880 20 rados->read ofs=0 len=0 2023-10-05T11:36:54.327 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:36:54.323+0000 7f3427f28880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:36:54.328 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:36:54.323+0000 7f3427f28880 10 cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x0 2023-10-05T11:36:54.328 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:36:54.323+0000 7f3427f28880 10 adding default.rgw.meta+users.email+librgw@example.com to cache LRU end 2023-10-05T11:36:54.328 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:36:54.323+0000 7f3427f28880 10 cache get: name=default.rgw.meta+users.keys+6xggPhwdTRxiPqiIDUXFtSPF8RA= : miss 2023-10-05T11:36:54.328 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:36:54.323+0000 7f3427f28880 20 rados->read ofs=0 len=0 2023-10-05T11:36:54.328 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:36:54.323+0000 7f3427f28880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:36:54.328 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:36:54.323+0000 7f3427f28880 10 cache put: name=default.rgw.meta+users.keys+6xggPhwdTRxiPqiIDUXFtSPF8RA= info.flags=0x0 2023-10-05T11:36:54.329 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:36:54.323+0000 7f3427f28880 10 adding default.rgw.meta+users.keys+6xggPhwdTRxiPqiIDUXFtSPF8RA= to cache LRU end 2023-10-05T11:36:54.329 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:36:54.323+0000 7f3427f28880 10 cache get: name=default.rgw.meta+users.keys+6xggPhwdTRxiPqiIDUXFtSPF8RA= : hit (negative entry) 2023-10-05T11:36:54.329 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:36:54.323+0000 7f3427f28880 10 cache get: name=default.rgw.meta+users.keys+6xggPhwdTRxiPqiIDUXFtSPF8RA= : hit (negative entry) 2023-10-05T11:36:54.329 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:36:54.324+0000 7f3427f28880 10 cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x17 2023-10-05T11:36:54.329 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:36:54.324+0000 7f3427f28880 10 moving default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2023-10-05T11:36:54.329 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:36:54.324+0000 7f3427f28880 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:ceph-test-librgw-file, ofs0, ns] 2023-10-05T11:36:54.329 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:36:54.325+0000 7f341f047640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1005022347267 cookie 94466667123712 notifier 5682 bl.length()=663 2023-10-05T11:36:54.330 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:36:54.325+0000 7f341f047640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x17 2023-10-05T11:36:54.330 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:36:54.325+0000 7f341f047640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2023-10-05T11:36:54.330 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:36:54.328+0000 7f3427f28880 10 cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x7 2023-10-05T11:36:54.331 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:36:54.328+0000 7f3427f28880 10 moving default.rgw.meta+users.email+librgw@example.com to cache LRU end 2023-10-05T11:36:54.331 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:36:54.328+0000 7f3427f28880 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.email:librgw@example.com, ofs0, ns] 2023-10-05T11:36:54.331 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:36:54.328+0000 7f341f047640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1005022347264 cookie 94466667122688 notifier 5682 bl.length()=194 2023-10-05T11:36:54.331 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:36:54.328+0000 7f341f047640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x7 2023-10-05T11:36:54.331 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:36:54.328+0000 7f341f047640 10 rgw watcher librados: moving default.rgw.meta+users.email+librgw@example.com to cache LRU end 2023-10-05T11:36:54.333 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:36:54.331+0000 7f3427f28880 10 cache put: name=default.rgw.meta+users.keys+6xggPhwdTRxiPqiIDUXFtSPF8RA= info.flags=0x7 2023-10-05T11:36:54.333 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:36:54.331+0000 7f3427f28880 10 moving default.rgw.meta+users.keys+6xggPhwdTRxiPqiIDUXFtSPF8RA= to cache LRU end 2023-10-05T11:36:54.333 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:36:54.331+0000 7f3427f28880 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.keys:6xggPhwdTRxiPqiIDUXFtSPF8RA=, ofs0, ns] 2023-10-05T11:36:54.334 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:36:54.331+0000 7f341e846640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1005022347266 cookie 94466667121664 notifier 5682 bl.length()=203 2023-10-05T11:36:54.334 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:36:54.331+0000 7f341e846640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+6xggPhwdTRxiPqiIDUXFtSPF8RA= info.flags=0x7 2023-10-05T11:36:54.334 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:36:54.331+0000 7f341e846640 10 rgw watcher librados: moving default.rgw.meta+users.keys+6xggPhwdTRxiPqiIDUXFtSPF8RA= to cache LRU end 2023-10-05T11:36:54.334 INFO:tasks.workunit.client.0.smithi012.stdout:{ 2023-10-05T11:36:54.335 INFO:tasks.workunit.client.0.smithi012.stdout: "user_id": "ceph-test-librgw-file", 2023-10-05T11:36:54.335 INFO:tasks.workunit.client.0.smithi012.stdout: "display_name": "librgw test user", 2023-10-05T11:36:54.335 INFO:tasks.workunit.client.0.smithi012.stdout: "email": "librgw@example.com", 2023-10-05T11:36:54.335 INFO:tasks.workunit.client.0.smithi012.stdout: "suspended": 0, 2023-10-05T11:36:54.335 INFO:tasks.workunit.client.0.smithi012.stdout: "max_buckets": 1000, 2023-10-05T11:36:54.335 INFO:tasks.workunit.client.0.smithi012.stdout: "subusers": [], 2023-10-05T11:36:54.335 INFO:tasks.workunit.client.0.smithi012.stdout: "keys": [ 2023-10-05T11:36:54.335 INFO:tasks.workunit.client.0.smithi012.stdout: { 2023-10-05T11:36:54.335 INFO:tasks.workunit.client.0.smithi012.stdout: "user": "ceph-test-librgw-file", 2023-10-05T11:36:54.335 INFO:tasks.workunit.client.0.smithi012.stdout: "access_key": "6xggPhwdTRxiPqiIDUXFtSPF8RA=", 2023-10-05T11:36:54.335 INFO:tasks.workunit.client.0.smithi012.stdout: "secret_key": "10ojgIl+DJRenn2nKO4FLd/C5JlXoh8Vof0TqjDMVkebvHYsc3QxjQ==" 2023-10-05T11:36:54.336 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:36:54.336 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2023-10-05T11:36:54.336 INFO:tasks.workunit.client.0.smithi012.stdout: "swift_keys": [], 2023-10-05T11:36:54.336 INFO:tasks.workunit.client.0.smithi012.stdout: "caps": [], 2023-10-05T11:36:54.336 INFO:tasks.workunit.client.0.smithi012.stdout: "op_mask": "read, write, delete", 2023-10-05T11:36:54.336 INFO:tasks.workunit.client.0.smithi012.stdout: "default_placement": "", 2023-10-05T11:36:54.336 INFO:tasks.workunit.client.0.smithi012.stdout: "default_storage_class": "", 2023-10-05T11:36:54.336 INFO:tasks.workunit.client.0.smithi012.stdout: "placement_tags": [], 2023-10-05T11:36:54.337 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket_quota": { 2023-10-05T11:36:54.337 INFO:tasks.workunit.client.0.smithi012.stdout: "enabled": false, 2023-10-05T11:36:54.337 INFO:tasks.workunit.client.0.smithi012.stdout: "check_on_raw": false, 2023-10-05T11:36:54.337 INFO:tasks.workunit.client.0.smithi012.stdout: "max_size": -1, 2023-10-05T11:36:54.337 INFO:tasks.workunit.client.0.smithi012.stdout: "max_size_kb": 0, 2023-10-05T11:36:54.337 INFO:tasks.workunit.client.0.smithi012.stdout: "max_objects": -1 2023-10-05T11:36:54.337 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2023-10-05T11:36:54.337 INFO:tasks.workunit.client.0.smithi012.stdout: "user_quota": { 2023-10-05T11:36:54.337 INFO:tasks.workunit.client.0.smithi012.stdout: "enabled": false, 2023-10-05T11:36:54.337 INFO:tasks.workunit.client.0.smithi012.stdout: "check_on_raw": false, 2023-10-05T11:36:54.338 INFO:tasks.workunit.client.0.smithi012.stdout: "max_size": -1, 2023-10-05T11:36:54.338 INFO:tasks.workunit.client.0.smithi012.stdout: "max_size_kb": 0, 2023-10-05T11:36:54.338 INFO:tasks.workunit.client.0.smithi012.stdout: "max_objects": -1 2023-10-05T11:36:54.338 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2023-10-05T11:36:54.338 INFO:tasks.workunit.client.0.smithi012.stdout: "temp_url_keys": [], 2023-10-05T11:36:54.338 INFO:tasks.workunit.client.0.smithi012.stdout: "type": "rgw", 2023-10-05T11:36:54.338 INFO:tasks.workunit.client.0.smithi012.stdout: "mfa_ids": [] 2023-10-05T11:36:54.338 INFO:tasks.workunit.client.0.smithi012.stdout:} 2023-10-05T11:36:54.338 INFO:tasks.workunit.client.0.smithi012.stdout: 2023-10-05T11:36:54.339 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:36:54.333+0000 7f340b820640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:36:54.339 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:36:54.335+0000 7f3427f28880 20 remove_watcher() i=0 2023-10-05T11:36:54.339 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:36:54.335+0000 7f3427f28880 2 removed watcher, disabling cache 2023-10-05T11:36:54.340 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:36:54.336+0000 7f3427f28880 20 remove_watcher() i=1 2023-10-05T11:36:54.340 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:36:54.337+0000 7f3427f28880 20 remove_watcher() i=2 2023-10-05T11:36:54.341 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:36:54.338+0000 7f3427f28880 20 remove_watcher() i=3 2023-10-05T11:36:54.342 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:36:54.339+0000 7f3427f28880 20 remove_watcher() i=4 2023-10-05T11:36:54.343 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:36:54.340+0000 7f3427f28880 20 remove_watcher() i=5 2023-10-05T11:36:54.344 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:36:54.341+0000 7f3427f28880 20 remove_watcher() i=6 2023-10-05T11:36:54.344 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:36:54.342+0000 7f3427f28880 20 remove_watcher() i=7 2023-10-05T11:36:54.349 INFO:tasks.workunit.client.0.smithi012.stdout:phase 1.1 2023-10-05T11:36:54.369 INFO:tasks.workunit.client.0.smithi012.stdout:[==========] Running 24 tests from 1 test suite. 2023-10-05T11:36:54.369 INFO:tasks.workunit.client.0.smithi012.stdout:[----------] Global test environment set-up. 2023-10-05T11:36:54.369 INFO:tasks.workunit.client.0.smithi012.stdout:[----------] 24 tests from LibRGW 2023-10-05T11:36:54.370 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.INIT 2023-10-05T11:36:54.381 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setuser ceph since I am not root 2023-10-05T11:36:54.381 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T11:36:54.503 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.INIT (133 ms) 2023-10-05T11:36:54.503 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2023-10-05T11:36:54.504 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.MOUNT_NOROOT (1 ms) 2023-10-05T11:36:54.504 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.MOUNT 2023-10-05T11:36:54.504 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2023-10-05T11:36:54.504 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.SETUP_HIER1 2023-10-05T11:36:54.515 INFO:tasks.workunit.client.0.smithi012.stdout:creating: nfsroot:foo/bar/baz/quux 2023-10-05T11:36:54.518 INFO:tasks.workunit.client.0.smithi012.stdout:creating: nfsroot:foo/f1 2023-10-05T11:36:54.522 INFO:tasks.workunit.client.0.smithi012.stdout:creating: nfsroot:foo/f2 2023-10-05T11:36:54.525 INFO:tasks.workunit.client.0.smithi012.stdout:creating: nfsroot:foo/bar/f1 2023-10-05T11:36:54.528 INFO:tasks.workunit.client.0.smithi012.stdout:creating: nfsroot:foo/bar/d1/ 2023-10-05T11:36:54.531 INFO:tasks.workunit.client.0.smithi012.stdout:creating: nfsroot:foo/bar/baz/hungry 2023-10-05T11:36:54.534 INFO:tasks.workunit.client.0.smithi012.stdout:creating: nfsroot:foo/bar/baz/hungry/ 2023-10-05T11:36:54.537 INFO:tasks.workunit.client.0.smithi012.stdout:creating: nfsroot:foo/bar/baz/momma 2023-10-05T11:36:54.540 INFO:tasks.workunit.client.0.smithi012.stdout:creating: nfsroot:foo/bar/baz/bear/ 2023-10-05T11:36:54.542 INFO:tasks.workunit.client.0.smithi012.stdout:creating: nfsroot:foo/bar/baz/sasquatch 2023-10-05T11:36:54.545 INFO:tasks.workunit.client.0.smithi012.stdout:creating: nfsroot:foo/bar/baz/sasquatch/ 2023-10-05T11:36:54.548 INFO:tasks.workunit.client.0.smithi012.stdout:creating: nfsroot:foo/bar/baz/frobozz 2023-10-05T11:36:54.551 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.SETUP_HIER1 (48 ms) 2023-10-05T11:36:54.551 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2023-10-05T11:36:54.670 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.SETUP_DIRS1 (119 ms) 2023-10-05T11:36:54.671 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.SETATTR 2023-10-05T11:36:54.671 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2023-10-05T11:36:54.671 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2023-10-05T11:36:54.690 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (20 ms) 2023-10-05T11:36:54.690 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2023-10-05T11:36:54.737 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (47 ms) 2023-10-05T11:36:54.738 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2023-10-05T11:36:54.738 INFO:tasks.workunit.client.0.smithi012.stdout:rename file rfile_0 to rfile_r0 (bucket brename0) 2023-10-05T11:36:54.744 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (7 ms) 2023-10-05T11:36:54.744 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2023-10-05T11:36:54.744 INFO:tasks.workunit.client.0.smithi012.stdout:rename file rfile_1 (bucket brename0) to rfile_rhilldog (bucket brename1) 2023-10-05T11:36:54.753 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (8 ms) 2023-10-05T11:36:54.753 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2023-10-05T11:36:54.753 INFO:tasks.workunit.client.0.smithi012.stdout:scanning objects in /bdirs1/dir_0 2023-10-05T11:36:54.753 INFO:tasks.workunit.client.0.smithi012.stdout: /bdirs1/dir_0/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2023-10-05T11:36:54.753 INFO:tasks.workunit.client.0.smithi012.stdout: /bdirs1/dir_0/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2023-10-05T11:36:54.753 INFO:tasks.workunit.client.0.smithi012.stdout: /bdirs1/dir_0/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2023-10-05T11:36:54.753 INFO:tasks.workunit.client.0.smithi012.stdout: /bdirs1/dir_0/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2023-10-05T11:36:54.754 INFO:tasks.workunit.client.0.smithi012.stdout:scanning objects in /bdirs1/dir_1 2023-10-05T11:36:54.754 INFO:tasks.workunit.client.0.smithi012.stdout: /bdirs1/dir_1/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2023-10-05T11:36:54.754 INFO:tasks.workunit.client.0.smithi012.stdout: /bdirs1/dir_1/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2023-10-05T11:36:54.754 INFO:tasks.workunit.client.0.smithi012.stdout: /bdirs1/dir_1/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2023-10-05T11:36:54.754 INFO:tasks.workunit.client.0.smithi012.stdout: /bdirs1/dir_1/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2023-10-05T11:36:54.754 INFO:tasks.workunit.client.0.smithi012.stdout:scanning objects in /bdirs1/dir_2 2023-10-05T11:36:54.754 INFO:tasks.workunit.client.0.smithi012.stdout: /bdirs1/dir_2/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2023-10-05T11:36:54.755 INFO:tasks.workunit.client.0.smithi012.stdout: /bdirs1/dir_2/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2023-10-05T11:36:54.755 INFO:tasks.workunit.client.0.smithi012.stdout: /bdirs1/dir_2/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2023-10-05T11:36:54.755 INFO:tasks.workunit.client.0.smithi012.stdout: /bdirs1/dir_2/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2023-10-05T11:36:54.755 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2023-10-05T11:36:54.755 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.READ_DIRS1 2023-10-05T11:36:54.755 INFO:tasks.workunit.client.0.smithi012.stdout:read back objects in /bdirs1/dir_0 2023-10-05T11:36:54.755 INFO:tasks.workunit.client.0.smithi012.stdout:reading 0,256 dir_0/sfile_0 2023-10-05T11:36:54.756 INFO:tasks.workunit.client.0.smithi012.stdout: read back from sfile_0 : "data for sfile_0" 2023-10-05T11:36:54.756 INFO:tasks.workunit.client.0.smithi012.stdout:reading 0,256 dir_0/sfile_1 2023-10-05T11:36:54.756 INFO:tasks.workunit.client.0.smithi012.stdout: read back from sfile_1 : "data for sfile_1" 2023-10-05T11:36:54.757 INFO:tasks.workunit.client.0.smithi012.stdout:read back objects in /bdirs1/dir_1 2023-10-05T11:36:54.757 INFO:tasks.workunit.client.0.smithi012.stdout:reading 0,256 dir_1/sfile_0 2023-10-05T11:36:54.757 INFO:tasks.workunit.client.0.smithi012.stdout: read back from sfile_0 : "data for sfile_0" 2023-10-05T11:36:54.757 INFO:tasks.workunit.client.0.smithi012.stdout:reading 0,256 dir_1/sfile_1 2023-10-05T11:36:54.759 INFO:tasks.workunit.client.0.smithi012.stdout: read back from sfile_1 : "data for sfile_1" 2023-10-05T11:36:54.759 INFO:tasks.workunit.client.0.smithi012.stdout:read back objects in /bdirs1/dir_2 2023-10-05T11:36:54.759 INFO:tasks.workunit.client.0.smithi012.stdout:reading 0,256 dir_2/sfile_0 2023-10-05T11:36:54.760 INFO:tasks.workunit.client.0.smithi012.stdout: read back from sfile_0 : "data for sfile_0" 2023-10-05T11:36:54.760 INFO:tasks.workunit.client.0.smithi012.stdout:reading 0,256 dir_2/sfile_1 2023-10-05T11:36:54.762 INFO:tasks.workunit.client.0.smithi012.stdout: read back from sfile_1 : "data for sfile_1" 2023-10-05T11:36:54.762 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.READ_DIRS1 (10 ms) 2023-10-05T11:36:54.762 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.READF_SETUP1 2023-10-05T11:36:54.943 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.READF_SETUP1 (181 ms) 2023-10-05T11:36:54.944 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.READF_DIRS1 2023-10-05T11:36:54.944 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2023-10-05T11:36:54.944 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2023-10-05T11:36:54.944 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2023-10-05T11:36:54.944 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2023-10-05T11:36:54.945 INFO:tasks.workunit.client.0.smithi012.stdout:release sdir_0 type: DIR refs: 2 2023-10-05T11:36:54.945 INFO:tasks.workunit.client.0.smithi012.stdout:release sfile_0 type: FILE refs: 2 2023-10-05T11:36:54.945 INFO:tasks.workunit.client.0.smithi012.stdout:release sdir_1 type: DIR refs: 2 2023-10-05T11:36:54.945 INFO:tasks.workunit.client.0.smithi012.stdout:release sfile_1 type: FILE refs: 2 2023-10-05T11:36:54.945 INFO:tasks.workunit.client.0.smithi012.stdout:release sdir_0 type: DIR refs: 2 2023-10-05T11:36:54.945 INFO:tasks.workunit.client.0.smithi012.stdout:release sfile_0 type: FILE refs: 2 2023-10-05T11:36:54.946 INFO:tasks.workunit.client.0.smithi012.stdout:release sdir_1 type: DIR refs: 2 2023-10-05T11:36:54.946 INFO:tasks.workunit.client.0.smithi012.stdout:release sfile_1 type: FILE refs: 2 2023-10-05T11:36:54.946 INFO:tasks.workunit.client.0.smithi012.stdout:release sdir_0 type: DIR refs: 2 2023-10-05T11:36:54.946 INFO:tasks.workunit.client.0.smithi012.stdout:release sfile_0 type: FILE refs: 2 2023-10-05T11:36:54.946 INFO:tasks.workunit.client.0.smithi012.stdout:release sdir_1 type: DIR refs: 2 2023-10-05T11:36:54.947 INFO:tasks.workunit.client.0.smithi012.stdout:release sfile_1 type: FILE refs: 2 2023-10-05T11:36:54.947 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2023-10-05T11:36:54.947 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.HIER1 2023-10-05T11:36:54.952 INFO:tasks.workunit.client.0.smithi012.stdout:/nfsroot/foo/f2 (f2): FILE 2023-10-05T11:36:54.953 INFO:tasks.workunit.client.0.smithi012.stdout:/nfsroot/foo/f1 (f1): FILE 2023-10-05T11:36:54.956 INFO:tasks.workunit.client.0.smithi012.stdout:/nfsroot/foo/bar/f1 (f1): FILE 2023-10-05T11:36:54.958 INFO:tasks.workunit.client.0.smithi012.stdout:/nfsroot/foo/bar/d1 (d1): DIR 2023-10-05T11:36:54.961 INFO:tasks.workunit.client.0.smithi012.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2023-10-05T11:36:54.963 INFO:tasks.workunit.client.0.smithi012.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2023-10-05T11:36:54.963 INFO:tasks.workunit.client.0.smithi012.stdout:/nfsroot/foo/bar/baz/quux (quux): FILE 2023-10-05T11:36:54.963 INFO:tasks.workunit.client.0.smithi012.stdout:/nfsroot/foo/bar/baz/momma (momma): FILE 2023-10-05T11:36:54.963 INFO:tasks.workunit.client.0.smithi012.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2023-10-05T11:36:54.963 INFO:tasks.workunit.client.0.smithi012.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2023-10-05T11:36:54.964 INFO:tasks.workunit.client.0.smithi012.stdout:/nfsroot/foo/bar/baz/frobozz (frobozz): FILE 2023-10-05T11:36:54.967 INFO:tasks.workunit.client.0.smithi012.stdout:/nfsroot/foo/bar/baz/bear (bear): DIR 2023-10-05T11:36:54.968 INFO:tasks.workunit.client.0.smithi012.stdout:/nfsroot/foo/bar/baz (baz): DIR 2023-10-05T11:36:54.968 INFO:tasks.workunit.client.0.smithi012.stdout:/nfsroot/foo/bar (bar): DIR 2023-10-05T11:36:54.968 INFO:tasks.workunit.client.0.smithi012.stdout:/nfsroot/foo (foo): DIR 2023-10-05T11:36:54.968 INFO:tasks.workunit.client.0.smithi012.stdout:/nfsroot (nfsroot): DIR 2023-10-05T11:36:54.968 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.HIER1 (23 ms) 2023-10-05T11:36:54.970 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2023-10-05T11:36:54.971 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2023-10-05T11:36:54.972 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2023-10-05T11:36:54.972 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2023-10-05T11:36:54.972 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2023-10-05T11:36:54.972 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2023-10-05T11:36:54.973 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2023-10-05T11:36:54.973 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2023-10-05T11:36:54.973 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.CLEANUP 2023-10-05T11:36:54.973 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2023-10-05T11:36:54.973 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.UMOUNT 2023-10-05T11:36:54.973 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2023-10-05T11:36:54.973 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.SHUTDOWN 2023-10-05T11:36:54.974 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:36:54.964+0000 7fdf5e6448c0 -1 shutting down 2023-10-05T11:36:54.974 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:36:54.964+0000 7fde75ffb640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 97211, si_uid : 1000, si_addr0x3e800017bbb, si_status0 2023-10-05T11:36:55.006 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.SHUTDOWN (40 ms) 2023-10-05T11:36:55.007 INFO:tasks.workunit.client.0.smithi012.stdout:[----------] 24 tests from LibRGW (637 ms total) 2023-10-05T11:36:55.007 INFO:tasks.workunit.client.0.smithi012.stdout: 2023-10-05T11:36:55.008 INFO:tasks.workunit.client.0.smithi012.stdout:[----------] Global test environment tear-down 2023-10-05T11:36:55.008 INFO:tasks.workunit.client.0.smithi012.stdout:[==========] 24 tests from 1 test suite ran. (637 ms total) 2023-10-05T11:36:55.008 INFO:tasks.workunit.client.0.smithi012.stdout:[ PASSED ] 24 tests. 2023-10-05T11:36:55.010 INFO:tasks.workunit.client.0.smithi012.stdout:phase 1.2 2023-10-05T11:36:55.030 INFO:tasks.workunit.client.0.smithi012.stdout:[==========] Running 24 tests from 1 test suite. 2023-10-05T11:36:55.031 INFO:tasks.workunit.client.0.smithi012.stdout:[----------] Global test environment set-up. 2023-10-05T11:36:55.031 INFO:tasks.workunit.client.0.smithi012.stdout:[----------] 24 tests from LibRGW 2023-10-05T11:36:55.031 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.INIT 2023-10-05T11:36:55.038 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setuser ceph since I am not root 2023-10-05T11:36:55.039 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T11:36:55.157 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.INIT (127 ms) 2023-10-05T11:36:55.158 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2023-10-05T11:36:55.160 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.MOUNT_NOROOT (1 ms) 2023-10-05T11:36:55.160 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.MOUNT 2023-10-05T11:36:55.160 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2023-10-05T11:36:55.161 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.SETUP_HIER1 2023-10-05T11:36:55.161 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.SETUP_HIER1 (0 ms) 2023-10-05T11:36:55.161 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2023-10-05T11:36:55.161 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.SETUP_DIRS1 (0 ms) 2023-10-05T11:36:55.161 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.SETATTR 2023-10-05T11:36:55.161 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2023-10-05T11:36:55.161 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2023-10-05T11:36:55.161 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (0 ms) 2023-10-05T11:36:55.161 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2023-10-05T11:36:55.161 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (0 ms) 2023-10-05T11:36:55.161 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2023-10-05T11:36:55.162 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (0 ms) 2023-10-05T11:36:55.162 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2023-10-05T11:36:55.162 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (0 ms) 2023-10-05T11:36:55.162 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2023-10-05T11:36:55.162 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2023-10-05T11:36:55.162 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.READ_DIRS1 2023-10-05T11:36:55.162 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.READ_DIRS1 (0 ms) 2023-10-05T11:36:55.162 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.READF_SETUP1 2023-10-05T11:36:55.162 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.READF_SETUP1 (0 ms) 2023-10-05T11:36:55.162 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.READF_DIRS1 2023-10-05T11:36:55.163 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2023-10-05T11:36:55.163 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2023-10-05T11:36:55.163 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2023-10-05T11:36:55.163 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2023-10-05T11:36:55.163 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2023-10-05T11:36:55.163 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.HIER1 2023-10-05T11:36:55.163 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.HIER1 (0 ms) 2023-10-05T11:36:55.163 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2023-10-05T11:36:55.163 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2023-10-05T11:36:55.163 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2023-10-05T11:36:55.163 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2023-10-05T11:36:55.163 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2023-10-05T11:36:55.164 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2023-10-05T11:36:55.164 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2023-10-05T11:36:55.164 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2023-10-05T11:36:55.164 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.CLEANUP 2023-10-05T11:36:55.164 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2023-10-05T11:36:55.164 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.UMOUNT 2023-10-05T11:36:55.164 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2023-10-05T11:36:55.164 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.SHUTDOWN 2023-10-05T11:36:55.165 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:36:55.156+0000 7fabe69368c0 -1 shutting down 2023-10-05T11:36:55.165 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:36:55.156+0000 7faaf6ffd640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 97314, si_uid : 1000, si_addr0x3e800017c22, si_status0 2023-10-05T11:36:55.261 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.SHUTDOWN (102 ms) 2023-10-05T11:36:55.261 INFO:tasks.workunit.client.0.smithi012.stdout:[----------] 24 tests from LibRGW (230 ms total) 2023-10-05T11:36:55.261 INFO:tasks.workunit.client.0.smithi012.stdout: 2023-10-05T11:36:55.261 INFO:tasks.workunit.client.0.smithi012.stdout:[----------] Global test environment tear-down 2023-10-05T11:36:55.261 INFO:tasks.workunit.client.0.smithi012.stdout:[==========] 24 tests from 1 test suite ran. (230 ms total) 2023-10-05T11:36:55.261 INFO:tasks.workunit.client.0.smithi012.stdout:[ PASSED ] 24 tests. 2023-10-05T11:36:55.264 INFO:tasks.workunit.client.0.smithi012.stdout:phase 1.3 2023-10-05T11:36:55.284 INFO:tasks.workunit.client.0.smithi012.stdout:[==========] Running 24 tests from 1 test suite. 2023-10-05T11:36:55.284 INFO:tasks.workunit.client.0.smithi012.stdout:[----------] Global test environment set-up. 2023-10-05T11:36:55.285 INFO:tasks.workunit.client.0.smithi012.stdout:[----------] 24 tests from LibRGW 2023-10-05T11:36:55.285 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.INIT 2023-10-05T11:36:55.295 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setuser ceph since I am not root 2023-10-05T11:36:55.295 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T11:36:55.401 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.INIT (117 ms) 2023-10-05T11:36:55.401 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2023-10-05T11:36:55.402 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.MOUNT_NOROOT (1 ms) 2023-10-05T11:36:55.402 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.MOUNT 2023-10-05T11:36:55.402 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2023-10-05T11:36:55.402 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.SETUP_HIER1 2023-10-05T11:36:55.408 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.SETUP_HIER1 (6 ms) 2023-10-05T11:36:55.409 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2023-10-05T11:36:55.473 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.SETUP_DIRS1 (64 ms) 2023-10-05T11:36:55.473 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.SETATTR 2023-10-05T11:36:55.473 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2023-10-05T11:36:55.473 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2023-10-05T11:36:55.473 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (0 ms) 2023-10-05T11:36:55.473 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2023-10-05T11:36:55.473 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (0 ms) 2023-10-05T11:36:55.474 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2023-10-05T11:36:55.474 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (0 ms) 2023-10-05T11:36:55.474 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2023-10-05T11:36:55.474 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (0 ms) 2023-10-05T11:36:55.474 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2023-10-05T11:36:55.474 INFO:tasks.workunit.client.0.smithi012.stdout:scanning objects in /bdirs1/dir_0 2023-10-05T11:36:55.474 INFO:tasks.workunit.client.0.smithi012.stdout: /bdirs1/dir_0/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2023-10-05T11:36:55.474 INFO:tasks.workunit.client.0.smithi012.stdout: /bdirs1/dir_0/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2023-10-05T11:36:55.474 INFO:tasks.workunit.client.0.smithi012.stdout: /bdirs1/dir_0/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2023-10-05T11:36:55.474 INFO:tasks.workunit.client.0.smithi012.stdout: /bdirs1/dir_0/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2023-10-05T11:36:55.474 INFO:tasks.workunit.client.0.smithi012.stdout:scanning objects in /bdirs1/dir_1 2023-10-05T11:36:55.474 INFO:tasks.workunit.client.0.smithi012.stdout: /bdirs1/dir_1/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2023-10-05T11:36:55.475 INFO:tasks.workunit.client.0.smithi012.stdout: /bdirs1/dir_1/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2023-10-05T11:36:55.475 INFO:tasks.workunit.client.0.smithi012.stdout: /bdirs1/dir_1/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2023-10-05T11:36:55.475 INFO:tasks.workunit.client.0.smithi012.stdout: /bdirs1/dir_1/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2023-10-05T11:36:55.475 INFO:tasks.workunit.client.0.smithi012.stdout:scanning objects in /bdirs1/dir_2 2023-10-05T11:36:55.475 INFO:tasks.workunit.client.0.smithi012.stdout: /bdirs1/dir_2/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2023-10-05T11:36:55.475 INFO:tasks.workunit.client.0.smithi012.stdout: /bdirs1/dir_2/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2023-10-05T11:36:55.475 INFO:tasks.workunit.client.0.smithi012.stdout: /bdirs1/dir_2/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2023-10-05T11:36:55.475 INFO:tasks.workunit.client.0.smithi012.stdout: /bdirs1/dir_2/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2023-10-05T11:36:55.475 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2023-10-05T11:36:55.475 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.READ_DIRS1 2023-10-05T11:36:55.475 INFO:tasks.workunit.client.0.smithi012.stdout:read back objects in /bdirs1/dir_0 2023-10-05T11:36:55.475 INFO:tasks.workunit.client.0.smithi012.stdout:reading 0,256 dir_0/sfile_0 2023-10-05T11:36:55.476 INFO:tasks.workunit.client.0.smithi012.stdout: read back from sfile_0 : "data for sfile_0" 2023-10-05T11:36:55.476 INFO:tasks.workunit.client.0.smithi012.stdout:reading 0,256 dir_0/sfile_1 2023-10-05T11:36:55.476 INFO:tasks.workunit.client.0.smithi012.stdout: read back from sfile_1 : "data for sfile_1" 2023-10-05T11:36:55.476 INFO:tasks.workunit.client.0.smithi012.stdout:read back objects in /bdirs1/dir_1 2023-10-05T11:36:55.476 INFO:tasks.workunit.client.0.smithi012.stdout:reading 0,256 dir_1/sfile_0 2023-10-05T11:36:55.477 INFO:tasks.workunit.client.0.smithi012.stdout: read back from sfile_0 : "data for sfile_0" 2023-10-05T11:36:55.477 INFO:tasks.workunit.client.0.smithi012.stdout:reading 0,256 dir_1/sfile_1 2023-10-05T11:36:55.480 INFO:tasks.workunit.client.0.smithi012.stdout: read back from sfile_1 : "data for sfile_1" 2023-10-05T11:36:55.480 INFO:tasks.workunit.client.0.smithi012.stdout:read back objects in /bdirs1/dir_2 2023-10-05T11:36:55.480 INFO:tasks.workunit.client.0.smithi012.stdout:reading 0,256 dir_2/sfile_0 2023-10-05T11:36:55.480 INFO:tasks.workunit.client.0.smithi012.stdout: read back from sfile_0 : "data for sfile_0" 2023-10-05T11:36:55.480 INFO:tasks.workunit.client.0.smithi012.stdout:reading 0,256 dir_2/sfile_1 2023-10-05T11:36:55.482 INFO:tasks.workunit.client.0.smithi012.stdout: read back from sfile_1 : "data for sfile_1" 2023-10-05T11:36:55.482 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.READ_DIRS1 (10 ms) 2023-10-05T11:36:55.482 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.READF_SETUP1 2023-10-05T11:36:55.482 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.READF_SETUP1 (0 ms) 2023-10-05T11:36:55.482 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.READF_DIRS1 2023-10-05T11:36:55.482 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2023-10-05T11:36:55.482 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2023-10-05T11:36:55.483 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2023-10-05T11:36:55.483 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2023-10-05T11:36:55.483 INFO:tasks.workunit.client.0.smithi012.stdout:release sdir_0 type: DIR refs: 2 2023-10-05T11:36:55.483 INFO:tasks.workunit.client.0.smithi012.stdout:release sfile_0 type: FILE refs: 2 2023-10-05T11:36:55.483 INFO:tasks.workunit.client.0.smithi012.stdout:release sdir_1 type: DIR refs: 2 2023-10-05T11:36:55.483 INFO:tasks.workunit.client.0.smithi012.stdout:release sfile_1 type: FILE refs: 2 2023-10-05T11:36:55.483 INFO:tasks.workunit.client.0.smithi012.stdout:release sdir_0 type: DIR refs: 2 2023-10-05T11:36:55.483 INFO:tasks.workunit.client.0.smithi012.stdout:release sfile_0 type: FILE refs: 2 2023-10-05T11:36:55.483 INFO:tasks.workunit.client.0.smithi012.stdout:release sdir_1 type: DIR refs: 2 2023-10-05T11:36:55.483 INFO:tasks.workunit.client.0.smithi012.stdout:release sfile_1 type: FILE refs: 2 2023-10-05T11:36:55.483 INFO:tasks.workunit.client.0.smithi012.stdout:release sdir_0 type: DIR refs: 2 2023-10-05T11:36:55.483 INFO:tasks.workunit.client.0.smithi012.stdout:release sfile_0 type: FILE refs: 2 2023-10-05T11:36:55.483 INFO:tasks.workunit.client.0.smithi012.stdout:release sdir_1 type: DIR refs: 2 2023-10-05T11:36:55.484 INFO:tasks.workunit.client.0.smithi012.stdout:release sfile_1 type: FILE refs: 2 2023-10-05T11:36:55.484 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2023-10-05T11:36:55.484 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.HIER1 2023-10-05T11:36:55.490 INFO:tasks.workunit.client.0.smithi012.stdout:/nfsroot/foo/f2 (f2): FILE 2023-10-05T11:36:55.491 INFO:tasks.workunit.client.0.smithi012.stdout:/nfsroot/foo/f1 (f1): FILE 2023-10-05T11:36:55.494 INFO:tasks.workunit.client.0.smithi012.stdout:/nfsroot/foo/bar/f1 (f1): FILE 2023-10-05T11:36:55.496 INFO:tasks.workunit.client.0.smithi012.stdout:/nfsroot/foo/bar/d1 (d1): DIR 2023-10-05T11:36:55.499 INFO:tasks.workunit.client.0.smithi012.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2023-10-05T11:36:55.499 INFO:tasks.workunit.client.0.smithi012.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2023-10-05T11:36:55.499 INFO:tasks.workunit.client.0.smithi012.stdout:/nfsroot/foo/bar/baz/quux (quux): FILE 2023-10-05T11:36:55.500 INFO:tasks.workunit.client.0.smithi012.stdout:/nfsroot/foo/bar/baz/momma (momma): FILE 2023-10-05T11:36:55.500 INFO:tasks.workunit.client.0.smithi012.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2023-10-05T11:36:55.501 INFO:tasks.workunit.client.0.smithi012.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2023-10-05T11:36:55.501 INFO:tasks.workunit.client.0.smithi012.stdout:/nfsroot/foo/bar/baz/frobozz (frobozz): FILE 2023-10-05T11:36:55.505 INFO:tasks.workunit.client.0.smithi012.stdout:/nfsroot/foo/bar/baz/bear (bear): DIR 2023-10-05T11:36:55.505 INFO:tasks.workunit.client.0.smithi012.stdout:/nfsroot/foo/bar/baz (baz): DIR 2023-10-05T11:36:55.505 INFO:tasks.workunit.client.0.smithi012.stdout:/nfsroot/foo/bar (bar): DIR 2023-10-05T11:36:55.506 INFO:tasks.workunit.client.0.smithi012.stdout:/nfsroot/foo (foo): DIR 2023-10-05T11:36:55.506 INFO:tasks.workunit.client.0.smithi012.stdout:/nfsroot (nfsroot): DIR 2023-10-05T11:36:55.506 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.HIER1 (21 ms) 2023-10-05T11:36:55.506 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2023-10-05T11:36:55.506 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2023-10-05T11:36:55.506 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2023-10-05T11:36:55.506 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2023-10-05T11:36:55.506 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2023-10-05T11:36:55.506 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2023-10-05T11:36:55.506 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2023-10-05T11:36:55.506 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2023-10-05T11:36:55.507 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.CLEANUP 2023-10-05T11:36:55.507 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2023-10-05T11:36:55.507 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.UMOUNT 2023-10-05T11:36:55.507 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2023-10-05T11:36:55.507 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.SHUTDOWN 2023-10-05T11:36:55.507 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:36:55.501+0000 7f6d10b228c0 -1 shutting down 2023-10-05T11:36:55.507 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:36:55.501+0000 7f6c25ffb640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 97410, si_uid : 1000, si_addr0x3e800017c82, si_status0 2023-10-05T11:36:55.605 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.SHUTDOWN (102 ms) 2023-10-05T11:36:55.605 INFO:tasks.workunit.client.0.smithi012.stdout:[----------] 24 tests from LibRGW (321 ms total) 2023-10-05T11:36:55.605 INFO:tasks.workunit.client.0.smithi012.stdout: 2023-10-05T11:36:55.605 INFO:tasks.workunit.client.0.smithi012.stdout:[----------] Global test environment tear-down 2023-10-05T11:36:55.605 INFO:tasks.workunit.client.0.smithi012.stdout:[==========] 24 tests from 1 test suite ran. (321 ms total) 2023-10-05T11:36:55.605 INFO:tasks.workunit.client.0.smithi012.stdout:[ PASSED ] 24 tests. 2023-10-05T11:36:55.608 INFO:tasks.workunit.client.0.smithi012.stdout:phase 2.1 2023-10-05T11:36:55.629 INFO:tasks.workunit.client.0.smithi012.stdout:[==========] Running 9 tests from 1 test suite. 2023-10-05T11:36:55.629 INFO:tasks.workunit.client.0.smithi012.stdout:[----------] Global test environment set-up. 2023-10-05T11:36:55.629 INFO:tasks.workunit.client.0.smithi012.stdout:[----------] 9 tests from LibRGW 2023-10-05T11:36:55.630 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.INIT 2023-10-05T11:36:55.639 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setuser ceph since I am not root 2023-10-05T11:36:55.639 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T11:36:55.758 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.INIT (129 ms) 2023-10-05T11:36:55.758 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.MOUNT 2023-10-05T11:36:55.759 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2023-10-05T11:36:55.759 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2023-10-05T11:36:55.770 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.CREATE_BUCKET (11 ms) 2023-10-05T11:36:55.770 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2023-10-05T11:36:55.770 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2023-10-05T11:36:55.770 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.CREATE_BUCKET_MULTI 2023-10-05T11:36:55.781 INFO:tasks.workunit.client.0.smithi012.stdout:created: sorrydave0 2023-10-05T11:36:55.791 INFO:tasks.workunit.client.0.smithi012.stdout:created: sorrydave1 2023-10-05T11:36:55.802 INFO:tasks.workunit.client.0.smithi012.stdout:created: sorrydave2 2023-10-05T11:36:55.813 INFO:tasks.workunit.client.0.smithi012.stdout:created: sorrydave3 2023-10-05T11:36:55.824 INFO:tasks.workunit.client.0.smithi012.stdout:created: sorrydave4 2023-10-05T11:36:55.835 INFO:tasks.workunit.client.0.smithi012.stdout:created: sorrydave5 2023-10-05T11:36:55.846 INFO:tasks.workunit.client.0.smithi012.stdout:created: sorrydave6 2023-10-05T11:36:55.856 INFO:tasks.workunit.client.0.smithi012.stdout:created: sorrydave7 2023-10-05T11:36:55.867 INFO:tasks.workunit.client.0.smithi012.stdout:created: sorrydave8 2023-10-05T11:36:55.877 INFO:tasks.workunit.client.0.smithi012.stdout:created: sorrydave9 2023-10-05T11:36:55.877 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.CREATE_BUCKET_MULTI (107 ms) 2023-10-05T11:36:55.878 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.DELETE_BUCKET_MULTI 2023-10-05T11:36:56.196 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.DELETE_BUCKET_MULTI (319 ms) 2023-10-05T11:36:56.196 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.CLEANUP 2023-10-05T11:36:56.196 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2023-10-05T11:36:56.196 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.UMOUNT 2023-10-05T11:36:56.196 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2023-10-05T11:36:56.197 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.SHUTDOWN 2023-10-05T11:36:56.197 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:36:56.193+0000 7f092ce0e8c0 -1 shutting down 2023-10-05T11:36:56.197 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:36:56.193+0000 7f0841ffb640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 97513, si_uid : 1000, si_addr0x3e800017ce9, si_status0 2023-10-05T11:36:56.262 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.SHUTDOWN (66 ms) 2023-10-05T11:36:56.262 INFO:tasks.workunit.client.0.smithi012.stdout:[----------] 9 tests from LibRGW (633 ms total) 2023-10-05T11:36:56.262 INFO:tasks.workunit.client.0.smithi012.stdout: 2023-10-05T11:36:56.263 INFO:tasks.workunit.client.0.smithi012.stdout:[----------] Global test environment tear-down 2023-10-05T11:36:56.263 INFO:tasks.workunit.client.0.smithi012.stdout:[==========] 9 tests from 1 test suite ran. (633 ms total) 2023-10-05T11:36:56.263 INFO:tasks.workunit.client.0.smithi012.stdout:[ PASSED ] 9 tests. 2023-10-05T11:36:56.265 INFO:tasks.workunit.client.0.smithi012.stdout:phase 2.2 2023-10-05T11:36:56.286 INFO:tasks.workunit.client.0.smithi012.stdout:[==========] Running 9 tests from 1 test suite. 2023-10-05T11:36:56.286 INFO:tasks.workunit.client.0.smithi012.stdout:[----------] Global test environment set-up. 2023-10-05T11:36:56.286 INFO:tasks.workunit.client.0.smithi012.stdout:[----------] 9 tests from LibRGW 2023-10-05T11:36:56.286 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.INIT 2023-10-05T11:36:56.295 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setuser ceph since I am not root 2023-10-05T11:36:56.295 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T11:36:56.468 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.INIT (182 ms) 2023-10-05T11:36:56.469 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.MOUNT 2023-10-05T11:36:56.469 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2023-10-05T11:36:56.469 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2023-10-05T11:36:56.469 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2023-10-05T11:36:56.469 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2023-10-05T11:36:56.504 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.DELETE_BUCKET (35 ms) 2023-10-05T11:36:56.504 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.CREATE_BUCKET_MULTI 2023-10-05T11:36:56.515 INFO:tasks.workunit.client.0.smithi012.stdout:created: sorrydave0 2023-10-05T11:36:56.526 INFO:tasks.workunit.client.0.smithi012.stdout:created: sorrydave1 2023-10-05T11:36:56.537 INFO:tasks.workunit.client.0.smithi012.stdout:created: sorrydave2 2023-10-05T11:36:56.548 INFO:tasks.workunit.client.0.smithi012.stdout:created: sorrydave3 2023-10-05T11:36:56.559 INFO:tasks.workunit.client.0.smithi012.stdout:created: sorrydave4 2023-10-05T11:36:56.570 INFO:tasks.workunit.client.0.smithi012.stdout:created: sorrydave5 2023-10-05T11:36:56.580 INFO:tasks.workunit.client.0.smithi012.stdout:created: sorrydave6 2023-10-05T11:36:56.591 INFO:tasks.workunit.client.0.smithi012.stdout:created: sorrydave7 2023-10-05T11:36:56.602 INFO:tasks.workunit.client.0.smithi012.stdout:created: sorrydave8 2023-10-05T11:36:56.612 INFO:tasks.workunit.client.0.smithi012.stdout:created: sorrydave9 2023-10-05T11:36:56.612 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.CREATE_BUCKET_MULTI (108 ms) 2023-10-05T11:36:56.612 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.DELETE_BUCKET_MULTI 2023-10-05T11:36:56.930 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.DELETE_BUCKET_MULTI (318 ms) 2023-10-05T11:36:56.931 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.CLEANUP 2023-10-05T11:36:56.931 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2023-10-05T11:36:56.931 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.UMOUNT 2023-10-05T11:36:56.931 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2023-10-05T11:36:56.931 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.SHUTDOWN 2023-10-05T11:36:56.931 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:36:56.928+0000 7fcb9400d8c0 -1 shutting down 2023-10-05T11:36:56.931 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:36:56.928+0000 7fcab4ff9640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 97609, si_uid : 1000, si_addr0x3e800017d49, si_status0 2023-10-05T11:36:56.972 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.SHUTDOWN (42 ms) 2023-10-05T11:36:56.972 INFO:tasks.workunit.client.0.smithi012.stdout:[----------] 9 tests from LibRGW (686 ms total) 2023-10-05T11:36:56.972 INFO:tasks.workunit.client.0.smithi012.stdout: 2023-10-05T11:36:56.972 INFO:tasks.workunit.client.0.smithi012.stdout:[----------] Global test environment tear-down 2023-10-05T11:36:56.972 INFO:tasks.workunit.client.0.smithi012.stdout:[==========] 9 tests from 1 test suite ran. (686 ms total) 2023-10-05T11:36:56.972 INFO:tasks.workunit.client.0.smithi012.stdout:[ PASSED ] 9 tests. 2023-10-05T11:36:56.975 INFO:tasks.workunit.client.0.smithi012.stdout:phase 3.1 2023-10-05T11:36:57.300 INFO:tasks.workunit.client.0.smithi012.stdout:[==========] Running 13 tests from 1 test suite. 2023-10-05T11:36:57.300 INFO:tasks.workunit.client.0.smithi012.stdout:[----------] Global test environment set-up. 2023-10-05T11:36:57.300 INFO:tasks.workunit.client.0.smithi012.stdout:[----------] 13 tests from LibRGW 2023-10-05T11:36:57.300 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.INIT 2023-10-05T11:36:57.309 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setuser ceph since I am not root 2023-10-05T11:36:57.310 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T11:36:57.639 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.INIT (339 ms) 2023-10-05T11:36:57.640 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.MOUNT 2023-10-05T11:36:57.640 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2023-10-05T11:36:57.640 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2023-10-05T11:36:57.651 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.CREATE_BUCKET (11 ms) 2023-10-05T11:36:57.651 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2023-10-05T11:36:57.656 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (5 ms) 2023-10-05T11:36:57.656 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2023-10-05T11:36:57.658 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (2 ms) 2023-10-05T11:36:57.658 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.LARGE1 2023-10-05T11:36:57.715 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.LARGE1 (57 ms) 2023-10-05T11:36:57.716 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.LARGE2 2023-10-05T11:36:57.803 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.LARGE2 (87 ms) 2023-10-05T11:36:57.803 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.STAT_OBJECT 2023-10-05T11:36:57.803 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2023-10-05T11:36:57.803 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2023-10-05T11:36:57.803 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.DELETE_OBJECT (0 ms) 2023-10-05T11:36:57.803 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2023-10-05T11:36:57.803 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2023-10-05T11:36:57.803 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.CLEANUP 2023-10-05T11:36:57.803 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2023-10-05T11:36:57.803 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.UMOUNT 2023-10-05T11:36:57.804 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2023-10-05T11:36:57.804 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.SHUTDOWN 2023-10-05T11:36:57.804 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:36:57.800+0000 7f1f531428c0 -1 shutting down 2023-10-05T11:36:57.804 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:36:57.800+0000 7f1e667fc640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 97705, si_uid : 1000, si_addr0x3e800017da9, si_status0 2023-10-05T11:36:57.843 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.SHUTDOWN (40 ms) 2023-10-05T11:36:57.843 INFO:tasks.workunit.client.0.smithi012.stdout:[----------] 13 tests from LibRGW (542 ms total) 2023-10-05T11:36:57.843 INFO:tasks.workunit.client.0.smithi012.stdout: 2023-10-05T11:36:57.843 INFO:tasks.workunit.client.0.smithi012.stdout:[----------] Global test environment tear-down 2023-10-05T11:36:57.843 INFO:tasks.workunit.client.0.smithi012.stdout:[==========] 13 tests from 1 test suite ran. (544 ms total) 2023-10-05T11:36:57.843 INFO:tasks.workunit.client.0.smithi012.stdout:[ PASSED ] 13 tests. 2023-10-05T11:36:57.847 INFO:tasks.workunit.client.0.smithi012.stdout:phase 3.2 2023-10-05T11:36:58.172 INFO:tasks.workunit.client.0.smithi012.stdout:[==========] Running 13 tests from 1 test suite. 2023-10-05T11:36:58.172 INFO:tasks.workunit.client.0.smithi012.stdout:[----------] Global test environment set-up. 2023-10-05T11:36:58.172 INFO:tasks.workunit.client.0.smithi012.stdout:[----------] 13 tests from LibRGW 2023-10-05T11:36:58.172 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.INIT 2023-10-05T11:36:58.180 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setuser ceph since I am not root 2023-10-05T11:36:58.180 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T11:36:58.299 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.INIT (127 ms) 2023-10-05T11:36:58.300 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.MOUNT 2023-10-05T11:36:58.300 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2023-10-05T11:36:58.300 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2023-10-05T11:36:58.300 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2023-10-05T11:36:58.300 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2023-10-05T11:36:58.306 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (6 ms) 2023-10-05T11:36:58.307 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2023-10-05T11:36:58.310 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (3 ms) 2023-10-05T11:36:58.310 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.LARGE1 2023-10-05T11:36:58.370 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.LARGE1 (60 ms) 2023-10-05T11:36:58.370 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.LARGE2 2023-10-05T11:36:58.370 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.LARGE2 (0 ms) 2023-10-05T11:36:58.370 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.STAT_OBJECT 2023-10-05T11:36:58.370 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2023-10-05T11:36:58.370 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2023-10-05T11:36:58.374 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.DELETE_OBJECT (4 ms) 2023-10-05T11:36:58.375 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2023-10-05T11:36:58.406 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.DELETE_BUCKET (32 ms) 2023-10-05T11:36:58.407 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.CLEANUP 2023-10-05T11:36:58.407 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2023-10-05T11:36:58.407 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.UMOUNT 2023-10-05T11:36:58.407 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2023-10-05T11:36:58.407 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.SHUTDOWN 2023-10-05T11:36:58.407 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:36:58.404+0000 7fb25971f8c0 -1 shutting down 2023-10-05T11:36:58.407 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:36:58.404+0000 7fb178ff9640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 97814, si_uid : 1000, si_addr0x3e800017e16, si_status0 2023-10-05T11:36:58.503 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.SHUTDOWN (97 ms) 2023-10-05T11:36:58.503 INFO:tasks.workunit.client.0.smithi012.stdout:[----------] 13 tests from LibRGW (331 ms total) 2023-10-05T11:36:58.503 INFO:tasks.workunit.client.0.smithi012.stdout: 2023-10-05T11:36:58.503 INFO:tasks.workunit.client.0.smithi012.stdout:[----------] Global test environment tear-down 2023-10-05T11:36:58.504 INFO:tasks.workunit.client.0.smithi012.stdout:[==========] 13 tests from 1 test suite ran. (331 ms total) 2023-10-05T11:36:58.504 INFO:tasks.workunit.client.0.smithi012.stdout:[ PASSED ] 13 tests. 2023-10-05T11:36:58.507 INFO:tasks.workunit.client.0.smithi012.stdout:phase 4.1 2023-10-05T11:36:58.527 INFO:tasks.workunit.client.0.smithi012.stdout:[==========] Running 11 tests from 1 test suite. 2023-10-05T11:36:58.528 INFO:tasks.workunit.client.0.smithi012.stdout:[----------] Global test environment set-up. 2023-10-05T11:36:58.528 INFO:tasks.workunit.client.0.smithi012.stdout:[----------] 11 tests from LibRGW 2023-10-05T11:36:58.528 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.TVAR 2023-10-05T11:36:58.528 INFO:tasks.workunit.client.0.smithi012.stdout:read i1: 64001 2023-10-05T11:36:58.528 INFO:tasks.workunit.client.0.smithi012.stdout:read s1: blunderbuss 2023-10-05T11:36:58.528 INFO:tasks.workunit.client.0.smithi012.stdout:read s3: [ OK ] LibRGW.TVAR (0 ms) 2023-10-05T11:36:58.528 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.INIT 2023-10-05T11:36:58.539 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setuser ceph since I am not root 2023-10-05T11:36:58.539 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T11:36:58.859 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.INIT (332 ms) 2023-10-05T11:36:58.860 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.MOUNT 2023-10-05T11:36:58.860 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2023-10-05T11:36:58.860 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2023-10-05T11:36:58.879 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (19 ms) 2023-10-05T11:36:58.879 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2023-10-05T11:36:59.493 INFO:tasks.workunit.client.0.smithi012.stdout:created: dmarker:f_0 2023-10-05T11:36:59.493 INFO:tasks.workunit.client.0.smithi012.stdout:created: dmarker:f_1 2023-10-05T11:36:59.493 INFO:tasks.workunit.client.0.smithi012.stdout:created: dmarker:f_2 2023-10-05T11:36:59.493 INFO:tasks.workunit.client.0.smithi012.stdout:created: dmarker:f_3 2023-10-05T11:36:59.493 INFO:tasks.workunit.client.0.smithi012.stdout:created: dmarker:f_4 2023-10-05T11:36:59.493 INFO:tasks.workunit.client.0.smithi012.stdout:created: dmarker:f_5 2023-10-05T11:36:59.493 INFO:tasks.workunit.client.0.smithi012.stdout:created: dmarker:f_6 2023-10-05T11:36:59.493 INFO:tasks.workunit.client.0.smithi012.stdout:created: dmarker:f_7 2023-10-05T11:36:59.493 INFO:tasks.workunit.client.0.smithi012.stdout:created: dmarker:f_8 2023-10-05T11:36:59.494 INFO:tasks.workunit.client.0.smithi012.stdout:created: dmarker:f_9 2023-10-05T11:36:59.494 INFO:tasks.workunit.client.0.smithi012.stdout:created: dmarker:f_10 2023-10-05T11:36:59.494 INFO:tasks.workunit.client.0.smithi012.stdout:created: dmarker:f_11 2023-10-05T11:36:59.494 INFO:tasks.workunit.client.0.smithi012.stdout:created: dmarker:f_12 2023-10-05T11:36:59.494 INFO:tasks.workunit.client.0.smithi012.stdout:created: dmarker:f_13 2023-10-05T11:36:59.494 INFO:tasks.workunit.client.0.smithi012.stdout:created: dmarker:f_14 2023-10-05T11:36:59.494 INFO:tasks.workunit.client.0.smithi012.stdout:created: dmarker:f_15 2023-10-05T11:36:59.494 INFO:tasks.workunit.client.0.smithi012.stdout:created: dmarker:f_16 2023-10-05T11:36:59.495 INFO:tasks.workunit.client.0.smithi012.stdout:created: dmarker:f_17 2023-10-05T11:36:59.495 INFO:tasks.workunit.client.0.smithi012.stdout:created: dmarker:f_18 2023-10-05T11:36:59.495 INFO:tasks.workunit.client.0.smithi012.stdout:created: dmarker:f_19 2023-10-05T11:36:59.495 INFO:tasks.workunit.client.0.smithi012.stdout:created: dmarker:f_20 2023-10-05T11:36:59.495 INFO:tasks.workunit.client.0.smithi012.stdout:created: dmarker:f_21 2023-10-05T11:36:59.495 INFO:tasks.workunit.client.0.smithi012.stdout:created: dmarker:f_22 2023-10-05T11:36:59.495 INFO:tasks.workunit.client.0.smithi012.stdout:created: dmarker:f_23 2023-10-05T11:36:59.495 INFO:tasks.workunit.client.0.smithi012.stdout:created: dmarker:f_24 2023-10-05T11:36:59.495 INFO:tasks.workunit.client.0.smithi012.stdout:created: dmarker:f_25 2023-10-05T11:36:59.495 INFO:tasks.workunit.client.0.smithi012.stdout:created: dmarker:f_26 2023-10-05T11:36:59.496 INFO:tasks.workunit.client.0.smithi012.stdout:created: dmarker:f_27 2023-10-05T11:36:59.496 INFO:tasks.workunit.client.0.smithi012.stdout:created: dmarker:f_28 2023-10-05T11:36:59.496 INFO:tasks.workunit.client.0.smithi012.stdout:created: dmarker:f_29 2023-10-05T11:36:59.496 INFO:tasks.workunit.client.0.smithi012.stdout:created: dmarker:f_30 2023-10-05T11:36:59.496 INFO:tasks.workunit.client.0.smithi012.stdout:created: dmarker:f_31 2023-10-05T11:36:59.496 INFO:tasks.workunit.client.0.smithi012.stdout:created: dmarker:f_32 2023-10-05T11:36:59.496 INFO:tasks.workunit.client.0.smithi012.stdout:created: dmarker:f_33 2023-10-05T11:36:59.496 INFO:tasks.workunit.client.0.smithi012.stdout:created: dmarker:f_34 2023-10-05T11:36:59.496 INFO:tasks.workunit.client.0.smithi012.stdout:created: dmarker:f_35 2023-10-05T11:36:59.496 INFO:tasks.workunit.client.0.smithi012.stdout:created: dmarker:f_36 2023-10-05T11:36:59.496 INFO:tasks.workunit.client.0.smithi012.stdout:created: dmarker:f_37 2023-10-05T11:36:59.496 INFO:tasks.workunit.client.0.smithi012.stdout:created: dmarker:f_38 2023-10-05T11:36:59.497 INFO:tasks.workunit.client.0.smithi012.stdout:created: dmarker:f_39 2023-10-05T11:36:59.497 INFO:tasks.workunit.client.0.smithi012.stdout:created: dmarker:f_40 2023-10-05T11:36:59.497 INFO:tasks.workunit.client.0.smithi012.stdout:created: dmarker:f_41 2023-10-05T11:36:59.497 INFO:tasks.workunit.client.0.smithi012.stdout:created: dmarker:f_42 2023-10-05T11:36:59.497 INFO:tasks.workunit.client.0.smithi012.stdout:created: dmarker:f_43 2023-10-05T11:36:59.497 INFO:tasks.workunit.client.0.smithi012.stdout:created: dmarker:f_44 2023-10-05T11:36:59.497 INFO:tasks.workunit.client.0.smithi012.stdout:created: dmarker:f_45 2023-10-05T11:36:59.497 INFO:tasks.workunit.client.0.smithi012.stdout:created: dmarker:f_46 2023-10-05T11:36:59.497 INFO:tasks.workunit.client.0.smithi012.stdout:created: dmarker:f_47 2023-10-05T11:36:59.497 INFO:tasks.workunit.client.0.smithi012.stdout:created: dmarker:f_48 2023-10-05T11:36:59.497 INFO:tasks.workunit.client.0.smithi012.stdout:created: dmarker:f_49 2023-10-05T11:36:59.497 INFO:tasks.workunit.client.0.smithi012.stdout:created: dmarker:f_50 2023-10-05T11:36:59.498 INFO:tasks.workunit.client.0.smithi012.stdout:created: dmarker:f_51 2023-10-05T11:36:59.498 INFO:tasks.workunit.client.0.smithi012.stdout:created: dmarker:f_52 2023-10-05T11:36:59.498 INFO:tasks.workunit.client.0.smithi012.stdout:created: dmarker:f_53 2023-10-05T11:36:59.498 INFO:tasks.workunit.client.0.smithi012.stdout:created: dmarker:f_54 2023-10-05T11:36:59.498 INFO:tasks.workunit.client.0.smithi012.stdout:created: dmarker:f_55 2023-10-05T11:36:59.498 INFO:tasks.workunit.client.0.smithi012.stdout:created: dmarker:f_56 2023-10-05T11:36:59.498 INFO:tasks.workunit.client.0.smithi012.stdout:created: dmarker:f_57 2023-10-05T11:36:59.498 INFO:tasks.workunit.client.0.smithi012.stdout:created: dmarker:f_58 2023-10-05T11:36:59.498 INFO:tasks.workunit.client.0.smithi012.stdout:created: dmarker:f_59 2023-10-05T11:36:59.498 INFO:tasks.workunit.client.0.smithi012.stdout:created: dmarker:f_60 2023-10-05T11:36:59.498 INFO:tasks.workunit.client.0.smithi012.stdout:created: dmarker:f_61 2023-10-05T11:36:59.498 INFO:tasks.workunit.client.0.smithi012.stdout:created: dmarker:f_62 2023-10-05T11:36:59.499 INFO:tasks.workunit.client.0.smithi012.stdout:created: dmarker:f_63 2023-10-05T11:36:59.499 INFO:tasks.workunit.client.0.smithi012.stdout:created: dmarker:f_64 2023-10-05T11:36:59.499 INFO:tasks.workunit.client.0.smithi012.stdout:created: dmarker:f_65 2023-10-05T11:36:59.499 INFO:tasks.workunit.client.0.smithi012.stdout:created: dmarker:f_66 2023-10-05T11:36:59.499 INFO:tasks.workunit.client.0.smithi012.stdout:created: dmarker:f_67 2023-10-05T11:36:59.499 INFO:tasks.workunit.client.0.smithi012.stdout:created: dmarker:f_68 2023-10-05T11:36:59.499 INFO:tasks.workunit.client.0.smithi012.stdout:created: dmarker:f_69 2023-10-05T11:36:59.499 INFO:tasks.workunit.client.0.smithi012.stdout:created: dmarker:f_70 2023-10-05T11:36:59.499 INFO:tasks.workunit.client.0.smithi012.stdout:created: dmarker:f_71 2023-10-05T11:36:59.499 INFO:tasks.workunit.client.0.smithi012.stdout:created: dmarker:f_72 2023-10-05T11:36:59.499 INFO:tasks.workunit.client.0.smithi012.stdout:created: dmarker:f_73 2023-10-05T11:36:59.499 INFO:tasks.workunit.client.0.smithi012.stdout:created: dmarker:f_74 2023-10-05T11:36:59.500 INFO:tasks.workunit.client.0.smithi012.stdout:created: dmarker:f_75 2023-10-05T11:36:59.500 INFO:tasks.workunit.client.0.smithi012.stdout:created: dmarker:f_76 2023-10-05T11:36:59.500 INFO:tasks.workunit.client.0.smithi012.stdout:created: dmarker:f_77 2023-10-05T11:36:59.500 INFO:tasks.workunit.client.0.smithi012.stdout:created: dmarker:f_78 2023-10-05T11:36:59.500 INFO:tasks.workunit.client.0.smithi012.stdout:created: dmarker:f_79 2023-10-05T11:36:59.500 INFO:tasks.workunit.client.0.smithi012.stdout:created: dmarker:f_80 2023-10-05T11:36:59.500 INFO:tasks.workunit.client.0.smithi012.stdout:created: dmarker:f_81 2023-10-05T11:36:59.500 INFO:tasks.workunit.client.0.smithi012.stdout:created: dmarker:f_82 2023-10-05T11:36:59.500 INFO:tasks.workunit.client.0.smithi012.stdout:created: dmarker:f_83 2023-10-05T11:36:59.500 INFO:tasks.workunit.client.0.smithi012.stdout:created: dmarker:f_84 2023-10-05T11:36:59.500 INFO:tasks.workunit.client.0.smithi012.stdout:created: dmarker:f_85 2023-10-05T11:36:59.500 INFO:tasks.workunit.client.0.smithi012.stdout:created: dmarker:f_86 2023-10-05T11:36:59.500 INFO:tasks.workunit.client.0.smithi012.stdout:created: dmarker:f_87 2023-10-05T11:36:59.501 INFO:tasks.workunit.client.0.smithi012.stdout:created: dmarker:f_88 2023-10-05T11:36:59.501 INFO:tasks.workunit.client.0.smithi012.stdout:created: dmarker:f_89 2023-10-05T11:36:59.501 INFO:tasks.workunit.client.0.smithi012.stdout:created: dmarker:f_90 2023-10-05T11:36:59.501 INFO:tasks.workunit.client.0.smithi012.stdout:created: dmarker:f_91 2023-10-05T11:36:59.501 INFO:tasks.workunit.client.0.smithi012.stdout:created: dmarker:f_92 2023-10-05T11:36:59.501 INFO:tasks.workunit.client.0.smithi012.stdout:created: dmarker:f_93 2023-10-05T11:36:59.501 INFO:tasks.workunit.client.0.smithi012.stdout:created: dmarker:f_94 2023-10-05T11:36:59.501 INFO:tasks.workunit.client.0.smithi012.stdout:created: dmarker:f_95 2023-10-05T11:36:59.501 INFO:tasks.workunit.client.0.smithi012.stdout:created: dmarker:f_96 2023-10-05T11:36:59.501 INFO:tasks.workunit.client.0.smithi012.stdout:created: dmarker:f_97 2023-10-05T11:36:59.501 INFO:tasks.workunit.client.0.smithi012.stdout:created: dmarker:f_98 2023-10-05T11:36:59.501 INFO:tasks.workunit.client.0.smithi012.stdout:created: dmarker:f_99 2023-10-05T11:36:59.502 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (614 ms) 2023-10-05T11:36:59.502 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2023-10-05T11:36:59.503 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=. flags=4 2023-10-05T11:36:59.504 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=.. flags=4 2023-10-05T11:36:59.504 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2023-10-05T11:36:59.504 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2023-10-05T11:36:59.504 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2023-10-05T11:36:59.504 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2023-10-05T11:36:59.504 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2023-10-05T11:36:59.504 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2023-10-05T11:36:59.504 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2023-10-05T11:36:59.504 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2023-10-05T11:36:59.504 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2023-10-05T11:36:59.504 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2023-10-05T11:36:59.504 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2023-10-05T11:36:59.505 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2023-10-05T11:36:59.505 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2023-10-05T11:36:59.505 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2023-10-05T11:36:59.505 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2023-10-05T11:36:59.505 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2023-10-05T11:36:59.505 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2023-10-05T11:36:59.505 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2023-10-05T11:36:59.505 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2023-10-05T11:36:59.505 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2023-10-05T11:36:59.505 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2023-10-05T11:36:59.505 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2023-10-05T11:36:59.505 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2023-10-05T11:36:59.506 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2023-10-05T11:36:59.506 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2023-10-05T11:36:59.506 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2023-10-05T11:36:59.506 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2023-10-05T11:36:59.506 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2023-10-05T11:36:59.506 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2023-10-05T11:36:59.506 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2023-10-05T11:36:59.506 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2023-10-05T11:36:59.506 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2023-10-05T11:36:59.506 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2023-10-05T11:36:59.506 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2023-10-05T11:36:59.506 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2023-10-05T11:36:59.509 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2023-10-05T11:36:59.509 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2023-10-05T11:36:59.509 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2023-10-05T11:36:59.509 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2023-10-05T11:36:59.509 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2023-10-05T11:36:59.509 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2023-10-05T11:36:59.510 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2023-10-05T11:36:59.510 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2023-10-05T11:36:59.510 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2023-10-05T11:36:59.510 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2023-10-05T11:36:59.510 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2023-10-05T11:36:59.510 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2023-10-05T11:36:59.511 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2023-10-05T11:36:59.511 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2023-10-05T11:36:59.511 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2023-10-05T11:36:59.511 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2023-10-05T11:36:59.511 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2023-10-05T11:36:59.511 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2023-10-05T11:36:59.511 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2023-10-05T11:36:59.512 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2023-10-05T11:36:59.512 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2023-10-05T11:36:59.512 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2023-10-05T11:36:59.512 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2023-10-05T11:36:59.512 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2023-10-05T11:36:59.512 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2023-10-05T11:36:59.512 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2023-10-05T11:36:59.513 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2023-10-05T11:36:59.513 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2023-10-05T11:36:59.513 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2023-10-05T11:36:59.513 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2023-10-05T11:36:59.513 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2023-10-05T11:36:59.513 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2023-10-05T11:36:59.513 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2023-10-05T11:36:59.514 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2023-10-05T11:36:59.514 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2023-10-05T11:36:59.514 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2023-10-05T11:36:59.514 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2023-10-05T11:36:59.514 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2023-10-05T11:36:59.514 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2023-10-05T11:36:59.514 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2023-10-05T11:36:59.515 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2023-10-05T11:36:59.515 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2023-10-05T11:36:59.515 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2023-10-05T11:36:59.515 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2023-10-05T11:36:59.515 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2023-10-05T11:36:59.515 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2023-10-05T11:36:59.515 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2023-10-05T11:36:59.516 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2023-10-05T11:36:59.516 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2023-10-05T11:36:59.516 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2023-10-05T11:36:59.516 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2023-10-05T11:36:59.516 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2023-10-05T11:36:59.516 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2023-10-05T11:36:59.516 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2023-10-05T11:36:59.517 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2023-10-05T11:36:59.517 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2023-10-05T11:36:59.517 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2023-10-05T11:36:59.517 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2023-10-05T11:36:59.517 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2023-10-05T11:36:59.517 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2023-10-05T11:36:59.517 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2023-10-05T11:36:59.518 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2023-10-05T11:36:59.518 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2023-10-05T11:36:59.518 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2023-10-05T11:36:59.518 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2023-10-05T11:36:59.518 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.MARKER1_READDIR (2 ms) 2023-10-05T11:36:59.518 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.MARKER2_READDIR 2023-10-05T11:36:59.519 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2023-10-05T11:36:59.519 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2023-10-05T11:36:59.519 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2023-10-05T11:36:59.519 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2023-10-05T11:36:59.519 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2023-10-05T11:36:59.519 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2023-10-05T11:36:59.519 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2023-10-05T11:36:59.520 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2023-10-05T11:36:59.520 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2023-10-05T11:36:59.520 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2023-10-05T11:36:59.520 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2023-10-05T11:36:59.520 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2023-10-05T11:36:59.520 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2023-10-05T11:36:59.520 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2023-10-05T11:36:59.520 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2023-10-05T11:36:59.520 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2023-10-05T11:36:59.520 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2023-10-05T11:36:59.521 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2023-10-05T11:36:59.521 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2023-10-05T11:36:59.521 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2023-10-05T11:36:59.521 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2023-10-05T11:36:59.521 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2023-10-05T11:36:59.521 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2023-10-05T11:36:59.521 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2023-10-05T11:36:59.521 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2023-10-05T11:36:59.522 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2023-10-05T11:36:59.522 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2023-10-05T11:36:59.522 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2023-10-05T11:36:59.522 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2023-10-05T11:36:59.522 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2023-10-05T11:36:59.522 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2023-10-05T11:36:59.522 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2023-10-05T11:36:59.522 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2023-10-05T11:36:59.522 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2023-10-05T11:36:59.522 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2023-10-05T11:36:59.522 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2023-10-05T11:36:59.523 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2023-10-05T11:36:59.523 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2023-10-05T11:36:59.523 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2023-10-05T11:36:59.523 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2023-10-05T11:36:59.523 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2023-10-05T11:36:59.523 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2023-10-05T11:36:59.523 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2023-10-05T11:36:59.523 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2023-10-05T11:36:59.523 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2023-10-05T11:36:59.523 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2023-10-05T11:36:59.523 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2023-10-05T11:36:59.523 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2023-10-05T11:36:59.523 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2023-10-05T11:36:59.524 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2023-10-05T11:36:59.524 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2023-10-05T11:36:59.524 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2023-10-05T11:36:59.524 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2023-10-05T11:36:59.524 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2023-10-05T11:36:59.524 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2023-10-05T11:36:59.524 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2023-10-05T11:36:59.524 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2023-10-05T11:36:59.524 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2023-10-05T11:36:59.524 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2023-10-05T11:36:59.524 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2023-10-05T11:36:59.524 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2023-10-05T11:36:59.525 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2023-10-05T11:36:59.525 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2023-10-05T11:36:59.525 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2023-10-05T11:36:59.525 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2023-10-05T11:36:59.525 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2023-10-05T11:36:59.525 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2023-10-05T11:36:59.525 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2023-10-05T11:36:59.525 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2023-10-05T11:36:59.525 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2023-10-05T11:36:59.525 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2023-10-05T11:36:59.525 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2023-10-05T11:36:59.525 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2023-10-05T11:36:59.526 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2023-10-05T11:36:59.526 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2023-10-05T11:36:59.526 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2023-10-05T11:36:59.526 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2023-10-05T11:36:59.526 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2023-10-05T11:36:59.526 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2023-10-05T11:36:59.526 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2023-10-05T11:36:59.526 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2023-10-05T11:36:59.526 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2023-10-05T11:36:59.526 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2023-10-05T11:36:59.526 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2023-10-05T11:36:59.526 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2023-10-05T11:36:59.527 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2023-10-05T11:36:59.527 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2023-10-05T11:36:59.527 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2023-10-05T11:36:59.527 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2023-10-05T11:36:59.527 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2023-10-05T11:36:59.527 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2023-10-05T11:36:59.527 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2023-10-05T11:36:59.527 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2023-10-05T11:36:59.527 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2023-10-05T11:36:59.527 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2023-10-05T11:36:59.527 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2023-10-05T11:36:59.527 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2023-10-05T11:36:59.527 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2023-10-05T11:36:59.528 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2023-10-05T11:36:59.528 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2023-10-05T11:36:59.528 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.MARKER2_READDIR (1 ms) 2023-10-05T11:36:59.528 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2023-10-05T11:36:59.528 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (1 ms) 2023-10-05T11:36:59.528 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.CLEANUP 2023-10-05T11:36:59.528 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2023-10-05T11:36:59.528 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.UMOUNT 2023-10-05T11:36:59.528 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2023-10-05T11:36:59.528 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.SHUTDOWN 2023-10-05T11:36:59.529 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:36:59.494+0000 7fb2a57428c0 -1 shutting down 2023-10-05T11:36:59.529 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:36:59.494+0000 7fb1ba7fc640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 97910, si_uid : 1000, si_addr0x3e800017e76, si_status0 2023-10-05T11:36:59.563 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.SHUTDOWN (66 ms) 2023-10-05T11:36:59.564 INFO:tasks.workunit.client.0.smithi012.stdout:[----------] 11 tests from LibRGW (1036 ms total) 2023-10-05T11:36:59.564 INFO:tasks.workunit.client.0.smithi012.stdout: 2023-10-05T11:36:59.564 INFO:tasks.workunit.client.0.smithi012.stdout:[----------] Global test environment tear-down 2023-10-05T11:36:59.564 INFO:tasks.workunit.client.0.smithi012.stdout:[==========] 11 tests from 1 test suite ran. (1036 ms total) 2023-10-05T11:36:59.564 INFO:tasks.workunit.client.0.smithi012.stdout:[ PASSED ] 11 tests. 2023-10-05T11:36:59.567 INFO:tasks.workunit.client.0.smithi012.stdout:phase 4.2 2023-10-05T11:36:59.587 INFO:tasks.workunit.client.0.smithi012.stdout:[==========] Running 11 tests from 1 test suite. 2023-10-05T11:36:59.588 INFO:tasks.workunit.client.0.smithi012.stdout:[----------] Global test environment set-up. 2023-10-05T11:36:59.588 INFO:tasks.workunit.client.0.smithi012.stdout:[----------] 11 tests from LibRGW 2023-10-05T11:36:59.588 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.TVAR 2023-10-05T11:36:59.588 INFO:tasks.workunit.client.0.smithi012.stdout:read i1: 64001 2023-10-05T11:36:59.588 INFO:tasks.workunit.client.0.smithi012.stdout:read s1: blunderbuss 2023-10-05T11:36:59.588 INFO:tasks.workunit.client.0.smithi012.stdout:read s3: [ OK ] LibRGW.TVAR (0 ms) 2023-10-05T11:36:59.589 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.INIT 2023-10-05T11:36:59.596 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setuser ceph since I am not root 2023-10-05T11:36:59.597 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T11:36:59.703 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.INIT (116 ms) 2023-10-05T11:36:59.703 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.MOUNT 2023-10-05T11:36:59.704 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2023-10-05T11:36:59.704 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2023-10-05T11:36:59.715 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (11 ms) 2023-10-05T11:36:59.715 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2023-10-05T11:36:59.715 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2023-10-05T11:36:59.715 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2023-10-05T11:36:59.715 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2023-10-05T11:36:59.715 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.MARKER2_READDIR 2023-10-05T11:36:59.717 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2023-10-05T11:36:59.717 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2023-10-05T11:36:59.718 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2023-10-05T11:36:59.718 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2023-10-05T11:36:59.718 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2023-10-05T11:36:59.718 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2023-10-05T11:36:59.718 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2023-10-05T11:36:59.718 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2023-10-05T11:36:59.718 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2023-10-05T11:36:59.718 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2023-10-05T11:36:59.718 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2023-10-05T11:36:59.719 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2023-10-05T11:36:59.719 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2023-10-05T11:36:59.719 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2023-10-05T11:36:59.719 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2023-10-05T11:36:59.719 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2023-10-05T11:36:59.719 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2023-10-05T11:36:59.719 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2023-10-05T11:36:59.720 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2023-10-05T11:36:59.720 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2023-10-05T11:36:59.720 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2023-10-05T11:36:59.720 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2023-10-05T11:36:59.720 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2023-10-05T11:36:59.720 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2023-10-05T11:36:59.720 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2023-10-05T11:36:59.720 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2023-10-05T11:36:59.720 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2023-10-05T11:36:59.720 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2023-10-05T11:36:59.720 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2023-10-05T11:36:59.721 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2023-10-05T11:36:59.721 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2023-10-05T11:36:59.721 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2023-10-05T11:36:59.721 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2023-10-05T11:36:59.721 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2023-10-05T11:36:59.721 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2023-10-05T11:36:59.721 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2023-10-05T11:36:59.721 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2023-10-05T11:36:59.721 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2023-10-05T11:36:59.721 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2023-10-05T11:36:59.721 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2023-10-05T11:36:59.721 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2023-10-05T11:36:59.721 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2023-10-05T11:36:59.722 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2023-10-05T11:36:59.722 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2023-10-05T11:36:59.722 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2023-10-05T11:36:59.722 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2023-10-05T11:36:59.722 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2023-10-05T11:36:59.722 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2023-10-05T11:36:59.722 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2023-10-05T11:36:59.722 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2023-10-05T11:36:59.722 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2023-10-05T11:36:59.722 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2023-10-05T11:36:59.722 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2023-10-05T11:36:59.723 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2023-10-05T11:36:59.723 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2023-10-05T11:36:59.723 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2023-10-05T11:36:59.723 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2023-10-05T11:36:59.723 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2023-10-05T11:36:59.724 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2023-10-05T11:36:59.724 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2023-10-05T11:36:59.724 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2023-10-05T11:36:59.724 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2023-10-05T11:36:59.724 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2023-10-05T11:36:59.724 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2023-10-05T11:36:59.724 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2023-10-05T11:36:59.724 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2023-10-05T11:36:59.724 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2023-10-05T11:36:59.724 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2023-10-05T11:36:59.724 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2023-10-05T11:36:59.725 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2023-10-05T11:36:59.725 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2023-10-05T11:36:59.725 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2023-10-05T11:36:59.725 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2023-10-05T11:36:59.725 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2023-10-05T11:36:59.725 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2023-10-05T11:36:59.725 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2023-10-05T11:36:59.725 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2023-10-05T11:36:59.725 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2023-10-05T11:36:59.725 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2023-10-05T11:36:59.725 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2023-10-05T11:36:59.725 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2023-10-05T11:36:59.725 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2023-10-05T11:36:59.726 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2023-10-05T11:36:59.726 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2023-10-05T11:36:59.726 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2023-10-05T11:36:59.726 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2023-10-05T11:36:59.726 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2023-10-05T11:36:59.726 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2023-10-05T11:36:59.726 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2023-10-05T11:36:59.726 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2023-10-05T11:36:59.726 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2023-10-05T11:36:59.726 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2023-10-05T11:36:59.726 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2023-10-05T11:36:59.726 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2023-10-05T11:36:59.727 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2023-10-05T11:36:59.727 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2023-10-05T11:36:59.727 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2023-10-05T11:36:59.727 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2023-10-05T11:36:59.727 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2023-10-05T11:36:59.727 INFO:tasks.workunit.client.0.smithi012.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2023-10-05T11:36:59.727 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.MARKER2_READDIR (2 ms) 2023-10-05T11:36:59.727 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2023-10-05T11:36:59.727 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2023-10-05T11:36:59.727 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.CLEANUP 2023-10-05T11:36:59.728 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2023-10-05T11:36:59.728 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.UMOUNT 2023-10-05T11:36:59.728 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2023-10-05T11:36:59.728 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.SHUTDOWN 2023-10-05T11:36:59.728 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:36:59.715+0000 7f95484e48c0 -1 shutting down 2023-10-05T11:36:59.728 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:36:59.715+0000 7f945effd640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 98006, si_uid : 1000, si_addr0x3e800017ed6, si_status0 2023-10-05T11:36:59.807 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.SHUTDOWN (90 ms) 2023-10-05T11:36:59.807 INFO:tasks.workunit.client.0.smithi012.stdout:[----------] 11 tests from LibRGW (220 ms total) 2023-10-05T11:36:59.807 INFO:tasks.workunit.client.0.smithi012.stdout: 2023-10-05T11:36:59.808 INFO:tasks.workunit.client.0.smithi012.stdout:[----------] Global test environment tear-down 2023-10-05T11:36:59.808 INFO:tasks.workunit.client.0.smithi012.stdout:[==========] 11 tests from 1 test suite ran. (220 ms total) 2023-10-05T11:36:59.808 INFO:tasks.workunit.client.0.smithi012.stdout:[ PASSED ] 11 tests. 2023-10-05T11:36:59.810 INFO:tasks.workunit.client.0.smithi012.stdout:phase 5.1 2023-10-05T11:36:59.840 INFO:tasks.workunit.client.0.smithi012.stdout:[==========] Running 19 tests from 1 test suite. 2023-10-05T11:36:59.841 INFO:tasks.workunit.client.0.smithi012.stdout:[----------] Global test environment set-up. 2023-10-05T11:36:59.841 INFO:tasks.workunit.client.0.smithi012.stdout:[----------] 19 tests from LibRGW 2023-10-05T11:36:59.841 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.INIT 2023-10-05T11:36:59.851 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setuser ceph since I am not root 2023-10-05T11:36:59.851 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T11:37:00.169 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.INIT (329 ms) 2023-10-05T11:37:00.170 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.MOUNT 2023-10-05T11:37:00.170 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2023-10-05T11:37:00.170 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2023-10-05T11:37:00.181 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.CREATE_BUCKET (11 ms) 2023-10-05T11:37:00.181 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2023-10-05T11:37:00.185 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (5 ms) 2023-10-05T11:37:00.186 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.LIST_OBJECTS 2023-10-05T11:37:00.186 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.LIST_OBJECTS (0 ms) 2023-10-05T11:37:00.186 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2023-10-05T11:37:00.189 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (2 ms) 2023-10-05T11:37:00.189 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.OBJ_OPEN 2023-10-05T11:37:00.189 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.OBJ_OPEN (0 ms) 2023-10-05T11:37:00.190 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.PUT_OBJECT 2023-10-05T11:37:00.192 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.PUT_OBJECT (4 ms) 2023-10-05T11:37:00.192 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.GET_OBJECT 2023-10-05T11:37:00.194 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.GET_OBJECT (2 ms) 2023-10-05T11:37:00.195 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.STAT_OBJECT 2023-10-05T11:37:00.195 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2023-10-05T11:37:00.195 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.WRITE_READ_VERIFY 2023-10-05T11:37:00.195 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.WRITE_READ_VERIFY (0 ms) 2023-10-05T11:37:00.195 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.WRITEV 2023-10-05T11:37:00.195 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.WRITEV (0 ms) 2023-10-05T11:37:00.195 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.READV 2023-10-05T11:37:00.196 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.READV (0 ms) 2023-10-05T11:37:00.196 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.READV_AFTER_WRITEV 2023-10-05T11:37:00.196 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.READV_AFTER_WRITEV (0 ms) 2023-10-05T11:37:00.196 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2023-10-05T11:37:00.196 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.DELETE_OBJECT (0 ms) 2023-10-05T11:37:00.196 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2023-10-05T11:37:00.196 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2023-10-05T11:37:00.197 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.CLEANUP 2023-10-05T11:37:00.197 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2023-10-05T11:37:00.197 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.UMOUNT 2023-10-05T11:37:00.197 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2023-10-05T11:37:00.197 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.SHUTDOWN 2023-10-05T11:37:00.197 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:37:00.192+0000 7f1279b358c0 -1 shutting down 2023-10-05T11:37:00.198 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:37:00.192+0000 7f118e7fc640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 98102, si_uid : 1000, si_addr0x3e800017f36, si_status0 2023-10-05T11:37:00.273 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.SHUTDOWN (79 ms) 2023-10-05T11:37:00.273 INFO:tasks.workunit.client.0.smithi012.stdout:[----------] 19 tests from LibRGW (433 ms total) 2023-10-05T11:37:00.273 INFO:tasks.workunit.client.0.smithi012.stdout: 2023-10-05T11:37:00.274 INFO:tasks.workunit.client.0.smithi012.stdout:[----------] Global test environment tear-down 2023-10-05T11:37:00.274 INFO:tasks.workunit.client.0.smithi012.stdout:[==========] 19 tests from 1 test suite ran. (433 ms total) 2023-10-05T11:37:00.274 INFO:tasks.workunit.client.0.smithi012.stdout:[ PASSED ] 19 tests. 2023-10-05T11:37:00.276 INFO:tasks.workunit.client.0.smithi012.stdout:phase 5.2 2023-10-05T11:37:00.307 INFO:tasks.workunit.client.0.smithi012.stdout:[==========] Running 19 tests from 1 test suite. 2023-10-05T11:37:00.307 INFO:tasks.workunit.client.0.smithi012.stdout:[----------] Global test environment set-up. 2023-10-05T11:37:00.307 INFO:tasks.workunit.client.0.smithi012.stdout:[----------] 19 tests from LibRGW 2023-10-05T11:37:00.307 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.INIT 2023-10-05T11:37:00.314 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setuser ceph since I am not root 2023-10-05T11:37:00.314 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T11:37:00.626 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.INIT (319 ms) 2023-10-05T11:37:00.626 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.MOUNT 2023-10-05T11:37:00.627 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2023-10-05T11:37:00.627 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2023-10-05T11:37:00.627 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2023-10-05T11:37:00.627 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2023-10-05T11:37:00.633 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (6 ms) 2023-10-05T11:37:00.633 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.LIST_OBJECTS 2023-10-05T11:37:00.634 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.LIST_OBJECTS (0 ms) 2023-10-05T11:37:00.634 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2023-10-05T11:37:00.634 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (0 ms) 2023-10-05T11:37:00.634 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.OBJ_OPEN 2023-10-05T11:37:00.634 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.OBJ_OPEN (0 ms) 2023-10-05T11:37:00.634 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.PUT_OBJECT 2023-10-05T11:37:00.634 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.PUT_OBJECT (0 ms) 2023-10-05T11:37:00.634 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.GET_OBJECT 2023-10-05T11:37:00.634 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.GET_OBJECT (0 ms) 2023-10-05T11:37:00.634 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.STAT_OBJECT 2023-10-05T11:37:00.634 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2023-10-05T11:37:00.635 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.WRITE_READ_VERIFY 2023-10-05T11:37:00.635 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.WRITE_READ_VERIFY (0 ms) 2023-10-05T11:37:00.635 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.WRITEV 2023-10-05T11:37:00.635 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.WRITEV (0 ms) 2023-10-05T11:37:00.635 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.READV 2023-10-05T11:37:00.635 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.READV (0 ms) 2023-10-05T11:37:00.635 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.READV_AFTER_WRITEV 2023-10-05T11:37:00.635 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.READV_AFTER_WRITEV (0 ms) 2023-10-05T11:37:00.635 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2023-10-05T11:37:00.638 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.DELETE_OBJECT (5 ms) 2023-10-05T11:37:00.638 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2023-10-05T11:37:00.673 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.DELETE_BUCKET (35 ms) 2023-10-05T11:37:00.673 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.CLEANUP 2023-10-05T11:37:00.673 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2023-10-05T11:37:00.673 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.UMOUNT 2023-10-05T11:37:00.673 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2023-10-05T11:37:00.673 INFO:tasks.workunit.client.0.smithi012.stdout:[ RUN ] LibRGW.SHUTDOWN 2023-10-05T11:37:00.674 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:37:00.670+0000 7f374e9308c0 -1 shutting down 2023-10-05T11:37:00.674 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:37:00.670+0000 7f365effd640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 98200, si_uid : 1000, si_addr0x3e800017f98, si_status0 2023-10-05T11:37:00.730 INFO:tasks.workunit.client.0.smithi012.stdout:[ OK ] LibRGW.SHUTDOWN (56 ms) 2023-10-05T11:37:00.730 INFO:tasks.workunit.client.0.smithi012.stdout:[----------] 19 tests from LibRGW (422 ms total) 2023-10-05T11:37:00.730 INFO:tasks.workunit.client.0.smithi012.stdout: 2023-10-05T11:37:00.730 INFO:tasks.workunit.client.0.smithi012.stdout:[----------] Global test environment tear-down 2023-10-05T11:37:00.730 INFO:tasks.workunit.client.0.smithi012.stdout:[==========] 19 tests from 1 test suite ran. (422 ms total) 2023-10-05T11:37:00.730 INFO:tasks.workunit.client.0.smithi012.stdout:[ PASSED ] 19 tests. 2023-10-05T11:37:00.734 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-10-05T11:37:00.734 DEBUG:teuthology.orchestra.run.smithi012:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-10-05T11:37:00.765 INFO:tasks.workunit:Stopping ['cls/test_cls_lock.sh', 'cls/test_cls_log.sh', 'cls/test_cls_refcount.sh', 'cls/test_cls_rgw.sh', 'cls/test_cls_rgw_gc.sh', 'cls/test_cls_rgw_stats.sh', 'cls/test_cls_cmpomap.sh', 'cls/test_cls_2pc_queue.sh', 'rgw/test_rgw_gc_log.sh', 'rgw/test_rgw_obj.sh', 'rgw/test_librgw_file.sh'] on client.0... 2023-10-05T11:37:00.765 DEBUG:teuthology.orchestra.run.smithi012:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2023-10-05T11:37:01.099 DEBUG:teuthology.parallel:result is None 2023-10-05T11:37:01.100 DEBUG:teuthology.orchestra.run.smithi012:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2023-10-05T11:37:01.130 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2023-10-05T11:37:01.131 DEBUG:teuthology.orchestra.run.smithi012:> rmdir -- /home/ubuntu/cephtest/mnt.0 2023-10-05T11:37:01.185 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2023-10-05T11:37:01.185 INFO:teuthology.run_tasks:Running task workunit... 2023-10-05T11:37:01.195 INFO:tasks.workunit:Pulling workunits from ref 38321be854743c0d616618a9ea8aa0b1d4dbc0bf 2023-10-05T11:37:01.195 INFO:tasks.workunit:Making a separate scratch dir for every client... 2023-10-05T11:37:01.195 DEBUG:teuthology.orchestra.run.smithi012:> stat -- /home/ubuntu/cephtest/mnt.0 2023-10-05T11:37:01.240 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-05T11:37:01.241 INFO:teuthology.orchestra.run.smithi012.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2023-10-05T11:37:01.241 DEBUG:teuthology.orchestra.run.smithi012:> mkdir -- /home/ubuntu/cephtest/mnt.0 2023-10-05T11:37:01.296 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2023-10-05T11:37:01.296 DEBUG:teuthology.orchestra.run.smithi012:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2023-10-05T11:37:01.351 INFO:tasks.workunit:timeout=3h 2023-10-05T11:37:01.351 INFO:tasks.workunit:cleanup=True 2023-10-05T11:37:01.352 DEBUG:teuthology.orchestra.run.smithi012:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/pritha-srivastava/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 38321be854743c0d616618a9ea8aa0b1d4dbc0bf 2023-10-05T11:37:01.407 INFO:tasks.workunit.client.0.smithi012.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2023-10-05T11:37:41.142 INFO:tasks.workunit.client.0.smithi012.stderr:Note: switching to '38321be854743c0d616618a9ea8aa0b1d4dbc0bf'. 2023-10-05T11:37:41.142 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:37:41.142 INFO:tasks.workunit.client.0.smithi012.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2023-10-05T11:37:41.142 INFO:tasks.workunit.client.0.smithi012.stderr:changes and commit them, and you can discard any commits you make in this 2023-10-05T11:37:41.143 INFO:tasks.workunit.client.0.smithi012.stderr:state without impacting any branches by switching back to a branch. 2023-10-05T11:37:41.143 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:37:41.143 INFO:tasks.workunit.client.0.smithi012.stderr:If you want to create a new branch to retain commits you create, you may 2023-10-05T11:37:41.143 INFO:tasks.workunit.client.0.smithi012.stderr:do so (now or later) by using -c with the switch command. Example: 2023-10-05T11:37:41.143 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:37:41.143 INFO:tasks.workunit.client.0.smithi012.stderr: git switch -c 2023-10-05T11:37:41.143 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:37:41.143 INFO:tasks.workunit.client.0.smithi012.stderr:Or undo this operation with: 2023-10-05T11:37:41.143 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:37:41.143 INFO:tasks.workunit.client.0.smithi012.stderr: git switch - 2023-10-05T11:37:41.143 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:37:41.143 INFO:tasks.workunit.client.0.smithi012.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2023-10-05T11:37:41.144 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:37:41.144 INFO:tasks.workunit.client.0.smithi012.stderr:HEAD is now at 38321be8547 rgw/d3n: fixes for failures seen in test_multipart_upload. 2023-10-05T11:37:41.147 DEBUG:teuthology.orchestra.run.smithi012:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2023-10-05T11:37:41.201 INFO:tasks.workunit.client.0.smithi012.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2023-10-05T11:37:41.203 INFO:tasks.workunit.client.0.smithi012.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-10-05T11:37:41.204 INFO:tasks.workunit.client.0.smithi012.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2023-10-05T11:37:41.254 INFO:tasks.workunit.client.0.smithi012.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2023-10-05T11:37:41.304 INFO:tasks.workunit.client.0.smithi012.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2023-10-05T11:37:41.346 INFO:tasks.workunit.client.0.smithi012.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-10-05T11:37:41.347 INFO:tasks.workunit.client.0.smithi012.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-10-05T11:37:41.348 INFO:tasks.workunit.client.0.smithi012.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2023-10-05T11:37:41.387 INFO:tasks.workunit.client.0.smithi012.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-10-05T11:37:41.390 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-10-05T11:37:41.390 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2023-10-05T11:37:41.447 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_s3_mp_reupload.sh on client.0... 2023-10-05T11:37:41.448 INFO:tasks.workunit:Running workunit rgw/test_rgw_s3_mp_reupload.sh... 2023-10-05T11:37:41.448 DEBUG:teuthology.orchestra.run.smithi012:workunit test rgw/test_rgw_s3_mp_reupload.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=38321be854743c0d616618a9ea8aa0b1d4dbc0bf TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_s3_mp_reupload.sh 2023-10-05T11:37:41.507 INFO:tasks.workunit.client.0.smithi012.stdout:INFO: fully qualified domain name: smithi012.front.sepia.ceph.com 2023-10-05T11:37:41.507 INFO:tasks.workunit.client.0.smithi012.stdout:== TESTING *COMPLETING* MULTIPART UPLOAD WITH RE-UPLOADS == 2023-10-05T11:37:41.507 INFO:tasks.workunit.client.0.smithi012.stdout:== TESTING VERSIONED BUCKET == 2023-10-05T11:37:44.210 INFO:tasks.workunit.client.0.smithi012.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.9/site-packages (21.2.3) 2023-10-05T11:37:44.428 INFO:tasks.workunit.client.0.smithi012.stdout:Collecting pip 2023-10-05T11:37:44.435 INFO:tasks.workunit.client.0.smithi012.stdout: Using cached pip-23.2.1-py3-none-any.whl (2.1 MB) 2023-10-05T11:37:44.484 INFO:tasks.workunit.client.0.smithi012.stdout:Installing collected packages: pip 2023-10-05T11:37:44.484 INFO:tasks.workunit.client.0.smithi012.stdout: Attempting uninstall: pip 2023-10-05T11:37:44.484 INFO:tasks.workunit.client.0.smithi012.stdout: Found existing installation: pip 21.2.3 2023-10-05T11:37:44.651 INFO:tasks.workunit.client.0.smithi012.stdout: Uninstalling pip-21.2.3: 2023-10-05T11:37:44.657 INFO:tasks.workunit.client.0.smithi012.stdout: Successfully uninstalled pip-21.2.3 2023-10-05T11:37:45.672 INFO:tasks.workunit.client.0.smithi012.stdout:Successfully installed pip-23.2.1 2023-10-05T11:37:46.649 INFO:tasks.workunit.client.0.smithi012.stdout:Collecting boto3 2023-10-05T11:37:46.649 INFO:tasks.workunit.client.0.smithi012.stdout: Obtaining dependency information for boto3 from https://files.pythonhosted.org/packages/da/7e/ea3b898a2f7f8b698eb93d808cca4202e2e5ee1887715b28b42fb9b5c71c/boto3-1.28.60-py3-none-any.whl.metadata 2023-10-05T11:37:46.650 INFO:tasks.workunit.client.0.smithi012.stdout: Using cached boto3-1.28.60-py3-none-any.whl.metadata (6.7 kB) 2023-10-05T11:37:47.299 INFO:tasks.workunit.client.0.smithi012.stdout:Collecting botocore<1.32.0,>=1.31.60 (from boto3) 2023-10-05T11:37:47.299 INFO:tasks.workunit.client.0.smithi012.stdout: Obtaining dependency information for botocore<1.32.0,>=1.31.60 from https://files.pythonhosted.org/packages/5d/fa/fb73dceac7f2fd4ad82020696e241315e1ed9525810900ca8e35b7cf9b74/botocore-1.31.60-py3-none-any.whl.metadata 2023-10-05T11:37:47.300 INFO:tasks.workunit.client.0.smithi012.stdout: Using cached botocore-1.31.60-py3-none-any.whl.metadata (6.0 kB) 2023-10-05T11:37:47.355 INFO:tasks.workunit.client.0.smithi012.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2023-10-05T11:37:47.356 INFO:tasks.workunit.client.0.smithi012.stdout: Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2023-10-05T11:37:47.411 INFO:tasks.workunit.client.0.smithi012.stdout:Collecting s3transfer<0.8.0,>=0.7.0 (from boto3) 2023-10-05T11:37:47.411 INFO:tasks.workunit.client.0.smithi012.stdout: Obtaining dependency information for s3transfer<0.8.0,>=0.7.0 from https://files.pythonhosted.org/packages/5a/4b/fec9ce18f8874a96c5061422625ba86c3ee1e6587ccd92ff9f5bf7bd91b2/s3transfer-0.7.0-py3-none-any.whl.metadata 2023-10-05T11:37:47.412 INFO:tasks.workunit.client.0.smithi012.stdout: Using cached s3transfer-0.7.0-py3-none-any.whl.metadata (1.8 kB) 2023-10-05T11:37:47.470 INFO:tasks.workunit.client.0.smithi012.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.32.0,>=1.31.60->boto3) 2023-10-05T11:37:47.471 INFO:tasks.workunit.client.0.smithi012.stdout: Using cached python_dateutil-2.8.2-py2.py3-none-any.whl (247 kB) 2023-10-05T11:37:47.557 INFO:tasks.workunit.client.0.smithi012.stdout:Collecting urllib3<1.27,>=1.25.4 (from botocore<1.32.0,>=1.31.60->boto3) 2023-10-05T11:37:47.557 INFO:tasks.workunit.client.0.smithi012.stdout: Obtaining dependency information for urllib3<1.27,>=1.25.4 from https://files.pythonhosted.org/packages/48/fe/a5c6cc46e9fe9171d7ecf0f33ee7aae14642f8d74baa7af4d7840f9358be/urllib3-1.26.17-py2.py3-none-any.whl.metadata 2023-10-05T11:37:47.558 INFO:tasks.workunit.client.0.smithi012.stdout: Using cached urllib3-1.26.17-py2.py3-none-any.whl.metadata (48 kB) 2023-10-05T11:37:47.768 INFO:tasks.workunit.client.0.smithi012.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.32.0,>=1.31.60->boto3) 2023-10-05T11:37:47.769 INFO:tasks.workunit.client.0.smithi012.stdout: Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2023-10-05T11:37:47.793 INFO:tasks.workunit.client.0.smithi012.stdout:Using cached boto3-1.28.60-py3-none-any.whl (135 kB) 2023-10-05T11:37:47.808 INFO:tasks.workunit.client.0.smithi012.stdout:Using cached botocore-1.31.60-py3-none-any.whl (11.2 MB) 2023-10-05T11:37:47.826 INFO:tasks.workunit.client.0.smithi012.stdout:Using cached s3transfer-0.7.0-py3-none-any.whl (79 kB) 2023-10-05T11:37:47.827 INFO:tasks.workunit.client.0.smithi012.stdout:Using cached urllib3-1.26.17-py2.py3-none-any.whl (143 kB) 2023-10-05T11:37:47.928 INFO:tasks.workunit.client.0.smithi012.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2023-10-05T11:37:49.224 INFO:tasks.workunit.client.0.smithi012.stdout:Successfully installed boto3-1.28.60 botocore-1.31.60 jmespath-1.0.1 python-dateutil-2.8.2 s3transfer-0.7.0 six-1.16.0 urllib3-1.26.17 2023-10-05T11:37:49.442 INFO:tasks.workunit.client.0.smithi012.stdout:INFO: creating user 2023-10-05T11:37:49.534 INFO:tasks.workunit.client.0.smithi012.stdout:{ 2023-10-05T11:37:49.534 INFO:tasks.workunit.client.0.smithi012.stdout: "user_id": "testid", 2023-10-05T11:37:49.534 INFO:tasks.workunit.client.0.smithi012.stdout: "display_name": "M. Tester", 2023-10-05T11:37:49.534 INFO:tasks.workunit.client.0.smithi012.stdout: "email": "tester@ceph.com", 2023-10-05T11:37:49.534 INFO:tasks.workunit.client.0.smithi012.stdout: "suspended": 0, 2023-10-05T11:37:49.534 INFO:tasks.workunit.client.0.smithi012.stdout: "max_buckets": 1000, 2023-10-05T11:37:49.534 INFO:tasks.workunit.client.0.smithi012.stdout: "subusers": [], 2023-10-05T11:37:49.534 INFO:tasks.workunit.client.0.smithi012.stdout: "keys": [ 2023-10-05T11:37:49.534 INFO:tasks.workunit.client.0.smithi012.stdout: { 2023-10-05T11:37:49.535 INFO:tasks.workunit.client.0.smithi012.stdout: "user": "testid", 2023-10-05T11:37:49.535 INFO:tasks.workunit.client.0.smithi012.stdout: "access_key": "0555b35654ad1656d804", 2023-10-05T11:37:49.535 INFO:tasks.workunit.client.0.smithi012.stdout: "secret_key": "h7GhxuBLTrlhVUyxSPUKUV8r/2EI4ngqJxD7iBdBYLhwluN30JaT3Q==" 2023-10-05T11:37:49.535 INFO:tasks.workunit.client.0.smithi012.stdout: } 2023-10-05T11:37:49.535 INFO:tasks.workunit.client.0.smithi012.stdout: ], 2023-10-05T11:37:49.535 INFO:tasks.workunit.client.0.smithi012.stdout: "swift_keys": [], 2023-10-05T11:37:49.535 INFO:tasks.workunit.client.0.smithi012.stdout: "caps": [], 2023-10-05T11:37:49.535 INFO:tasks.workunit.client.0.smithi012.stdout: "op_mask": "read, write, delete", 2023-10-05T11:37:49.535 INFO:tasks.workunit.client.0.smithi012.stdout: "default_placement": "", 2023-10-05T11:37:49.535 INFO:tasks.workunit.client.0.smithi012.stdout: "default_storage_class": "", 2023-10-05T11:37:49.535 INFO:tasks.workunit.client.0.smithi012.stdout: "placement_tags": [], 2023-10-05T11:37:49.535 INFO:tasks.workunit.client.0.smithi012.stdout: "bucket_quota": { 2023-10-05T11:37:49.536 INFO:tasks.workunit.client.0.smithi012.stdout: "enabled": false, 2023-10-05T11:37:49.536 INFO:tasks.workunit.client.0.smithi012.stdout: "check_on_raw": false, 2023-10-05T11:37:49.536 INFO:tasks.workunit.client.0.smithi012.stdout: "max_size": -1, 2023-10-05T11:37:49.536 INFO:tasks.workunit.client.0.smithi012.stdout: "max_size_kb": 0, 2023-10-05T11:37:49.536 INFO:tasks.workunit.client.0.smithi012.stdout: "max_objects": -1 2023-10-05T11:37:49.536 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2023-10-05T11:37:49.536 INFO:tasks.workunit.client.0.smithi012.stdout: "user_quota": { 2023-10-05T11:37:49.536 INFO:tasks.workunit.client.0.smithi012.stdout: "enabled": false, 2023-10-05T11:37:49.536 INFO:tasks.workunit.client.0.smithi012.stdout: "check_on_raw": false, 2023-10-05T11:37:49.536 INFO:tasks.workunit.client.0.smithi012.stdout: "max_size": -1, 2023-10-05T11:37:49.536 INFO:tasks.workunit.client.0.smithi012.stdout: "max_size_kb": 0, 2023-10-05T11:37:49.536 INFO:tasks.workunit.client.0.smithi012.stdout: "max_objects": -1 2023-10-05T11:37:49.536 INFO:tasks.workunit.client.0.smithi012.stdout: }, 2023-10-05T11:37:49.537 INFO:tasks.workunit.client.0.smithi012.stdout: "temp_url_keys": [], 2023-10-05T11:37:49.537 INFO:tasks.workunit.client.0.smithi012.stdout: "type": "rgw", 2023-10-05T11:37:49.537 INFO:tasks.workunit.client.0.smithi012.stdout: "mfa_ids": [] 2023-10-05T11:37:49.537 INFO:tasks.workunit.client.0.smithi012.stdout:} 2023-10-05T11:37:49.537 INFO:tasks.workunit.client.0.smithi012.stdout: 2023-10-05T11:37:49.836 INFO:tasks.workunit.client.0.smithi012.stderr:5+0 records in 2023-10-05T11:37:49.836 INFO:tasks.workunit.client.0.smithi012.stderr:5+0 records out 2023-10-05T11:37:49.836 INFO:tasks.workunit.client.0.smithi012.stderr:5242880 bytes (5.2 MB, 5.0 MiB) copied, 0.0142771 s, 367 MB/s 2023-10-05T11:38:01.707 INFO:tasks.workunit.client.0.smithi012.stdout:bucket nams is reupload-bkt-117928 2023-10-05T11:38:01.707 INFO:tasks.workunit.client.0.smithi012.stdout:endpoint is http://smithi012.front.sepia.ceph.com:80 2023-10-05T11:38:01.707 INFO:tasks.workunit.client.0.smithi012.stdout:start UploadId=2~gNNW-H1v-4VguYOZbQjHOlA4ioMtEMY 2023-10-05T11:38:01.707 INFO:tasks.workunit.client.0.smithi012.stdout:phase 1 uploaded part {'ETag': '"ffeb2faae3f5c01070452df5e0c2ceda"', 'PartNumber': 1} 2023-10-05T11:38:01.708 INFO:tasks.workunit.client.0.smithi012.stdout:phase 1 uploaded part {'ETag': '"ffeb2faae3f5c01070452df5e0c2ceda"', 'PartNumber': 2} 2023-10-05T11:38:01.708 INFO:tasks.workunit.client.0.smithi012.stdout:phase 2 uploaded part {'ETag': '"ffeb2faae3f5c01070452df5e0c2ceda"', 'PartNumber': 1} 2023-10-05T11:38:01.708 INFO:tasks.workunit.client.0.smithi012.stdout:phase 2 uploaded part {'ETag': '"ffeb2faae3f5c01070452df5e0c2ceda"', 'PartNumber': 1} 2023-10-05T11:38:01.708 INFO:tasks.workunit.client.0.smithi012.stdout:phase 2 uploaded part {'ETag': '"ffeb2faae3f5c01070452df5e0c2ceda"', 'PartNumber': 1} 2023-10-05T11:38:01.708 INFO:tasks.workunit.client.0.smithi012.stdout:phase 2 uploaded part {'ETag': '"ffeb2faae3f5c01070452df5e0c2ceda"', 'PartNumber': 1} 2023-10-05T11:38:01.708 INFO:tasks.workunit.client.0.smithi012.stdout:phase 2 uploaded part {'ETag': '"ffeb2faae3f5c01070452df5e0c2ceda"', 'PartNumber': 1} 2023-10-05T11:38:01.708 INFO:tasks.workunit.client.0.smithi012.stdout:phase 2 uploaded part {'ETag': '"ffeb2faae3f5c01070452df5e0c2ceda"', 'PartNumber': 1} 2023-10-05T11:38:01.708 INFO:tasks.workunit.client.0.smithi012.stdout:phase 2 uploaded part {'ETag': '"ffeb2faae3f5c01070452df5e0c2ceda"', 'PartNumber': 1} 2023-10-05T11:38:01.708 INFO:tasks.workunit.client.0.smithi012.stdout:phase 2 uploaded part {'ETag': '"ffeb2faae3f5c01070452df5e0c2ceda"', 'PartNumber': 1} 2023-10-05T11:38:01.708 INFO:tasks.workunit.client.0.smithi012.stdout:phase 2 uploaded part {'ETag': '"ffeb2faae3f5c01070452df5e0c2ceda"', 'PartNumber': 1} 2023-10-05T11:38:01.708 INFO:tasks.workunit.client.0.smithi012.stdout:phase 2 uploaded part {'ETag': '"ffeb2faae3f5c01070452df5e0c2ceda"', 'PartNumber': 1} 2023-10-05T11:38:01.708 INFO:tasks.workunit.client.0.smithi012.stdout:phase 2 uploaded part {'ETag': '"ffeb2faae3f5c01070452df5e0c2ceda"', 'PartNumber': 1} 2023-10-05T11:38:01.709 INFO:tasks.workunit.client.0.smithi012.stdout:completing multipart upload, parts=[{'ETag': '"ffeb2faae3f5c01070452df5e0c2ceda"', 'PartNumber': 1}, {'ETag': '"ffeb2faae3f5c01070452df5e0c2ceda"', 'PartNumber': 2}] 2023-10-05T11:38:02.222 INFO:tasks.workunit.client.0.smithi012.stdout:radosgw-admin bucket radoslist: 2023-10-05T11:38:02.223 INFO:tasks.workunit.client.0.smithi012.stdout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.3_mpu_test4 2023-10-05T11:38:02.223 INFO:tasks.workunit.client.0.smithi012.stdout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.3__multipart_mpu_test4.2~gNNW-H1v-4VguYOZbQjHOlA4ioMtEMY.2 2023-10-05T11:38:02.223 INFO:tasks.workunit.client.0.smithi012.stdout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.3__multipart_mpu_test4._of3h5lxCeTeJekmrdRhTC6-P0DsxCHt.1 2023-10-05T11:38:02.223 INFO:tasks.workunit.client.0.smithi012.stdout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.3__shadow_mpu_test4.2~gNNW-H1v-4VguYOZbQjHOlA4ioMtEMY.2_1 2023-10-05T11:38:02.223 INFO:tasks.workunit.client.0.smithi012.stdout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.3__shadow_mpu_test4._of3h5lxCeTeJekmrdRhTC6-P0DsxCHt.1_1 2023-10-05T11:38:02.223 INFO:tasks.workunit.client.0.smithi012.stdout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.3__:uMGldHrIEkwi.9UFk-AtsSOxHx8gZHy_mpu_test4 2023-10-05T11:38:02.283 INFO:tasks.workunit.client.0.smithi012.stdout:rados ls: 2023-10-05T11:38:02.284 INFO:tasks.workunit.client.0.smithi012.stdout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.3_mpu_test4 2023-10-05T11:38:02.284 INFO:tasks.workunit.client.0.smithi012.stdout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.3__multipart_mpu_test4.2~gNNW-H1v-4VguYOZbQjHOlA4ioMtEMY.2 2023-10-05T11:38:02.284 INFO:tasks.workunit.client.0.smithi012.stdout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.3__multipart_mpu_test4._of3h5lxCeTeJekmrdRhTC6-P0DsxCHt.1 2023-10-05T11:38:02.284 INFO:tasks.workunit.client.0.smithi012.stdout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.3__shadow_mpu_test4.2~gNNW-H1v-4VguYOZbQjHOlA4ioMtEMY.2_1 2023-10-05T11:38:02.284 INFO:tasks.workunit.client.0.smithi012.stdout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.3__shadow_mpu_test4._of3h5lxCeTeJekmrdRhTC6-P0DsxCHt.1_1 2023-10-05T11:38:02.284 INFO:tasks.workunit.client.0.smithi012.stdout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.3__:uMGldHrIEkwi.9UFk-AtsSOxHx8gZHy_mpu_test4 2023-10-05T11:38:02.287 INFO:tasks.workunit.client.0.smithi012.stdout:== PASSED == 2023-10-05T11:38:02.288 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-10-05T11:38:02.288 DEBUG:teuthology.orchestra.run.smithi012:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-10-05T11:38:02.359 INFO:tasks.workunit:Stopping ['rgw/test_rgw_s3_mp_reupload.sh'] on client.0... 2023-10-05T11:38:02.359 DEBUG:teuthology.orchestra.run.smithi012:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2023-10-05T11:38:02.732 DEBUG:teuthology.parallel:result is None 2023-10-05T11:38:02.732 DEBUG:teuthology.orchestra.run.smithi012:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2023-10-05T11:38:02.763 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2023-10-05T11:38:02.775 DEBUG:teuthology.orchestra.run.smithi012:> rmdir -- /home/ubuntu/cephtest/mnt.0 2023-10-05T11:38:02.818 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2023-10-05T11:38:02.818 INFO:teuthology.run_tasks:Running task ragweed... 2023-10-05T11:38:02.831 DEBUG:tasks.ragweed:ragweed config is {'client.0': {'default-branch': 'ceph-master', 'rgw_server': 'client.0', 'stages': 'prepare,check'}} 2023-10-05T11:38:02.831 INFO:tasks.ragweed:Downloading ragweed... 2023-10-05T11:38:02.831 INFO:tasks.ragweed:Using branch 'wip-rgw-d3n-filter' for ragweed 2023-10-05T11:38:02.832 DEBUG:teuthology.orchestra.run.smithi012:> git clone -b wip-rgw-d3n-filter https://git.ceph.com/ragweed.git /home/ubuntu/cephtest/ragweed.client.0 2023-10-05T11:38:02.873 INFO:teuthology.orchestra.run.smithi012.stderr:Cloning into '/home/ubuntu/cephtest/ragweed.client.0'... 2023-10-05T11:38:02.919 INFO:teuthology.orchestra.run.smithi012.stderr:fatal: Remote branch wip-rgw-d3n-filter not found in upstream origin 2023-10-05T11:38:02.919 DEBUG:teuthology.orchestra.run:got remote process result: 128 2023-10-05T11:38:02.920 INFO:tasks.ragweed:Using branch 'ceph-master' for ragweed 2023-10-05T11:38:02.921 DEBUG:teuthology.orchestra.run.smithi012:> git clone -b ceph-master https://git.ceph.com/ragweed.git /home/ubuntu/cephtest/ragweed.client.0 2023-10-05T11:38:02.975 INFO:teuthology.orchestra.run.smithi012.stderr:Cloning into '/home/ubuntu/cephtest/ragweed.client.0'... 2023-10-05T11:38:03.142 INFO:tasks.ragweed:Creating rgw users... 2023-10-05T11:38:03.142 DEBUG:tasks.ragweed:Creating user ragweed.client.0 on client.0 2023-10-05T11:38:03.143 DEBUG:teuthology.orchestra.run.smithi012:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid ragweed.client.0 --display-name 'Mr. ragweed.client.0' --access-key WDFHAESUVLDKQVRYPAXX --secret BTH3/4UBTu5UCf45CpgVQmHwASgtcVO+Y2BIByg/isme8uDF7eZuJw== --email ragweed.client.0+test@test.test --system false 2023-10-05T11:38:03.236 INFO:teuthology.orchestra.run.smithi012.stderr:ignoring --setuser ceph since I am not root 2023-10-05T11:38:03.236 INFO:teuthology.orchestra.run.smithi012.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T11:38:03.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.243+0000 7fc217e14880 20 rados->read ofs=0 len=0 2023-10-05T11:38:03.248 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.245+0000 7fc217e14880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:38:03.249 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.245+0000 7fc217e14880 20 realm 2023-10-05T11:38:03.249 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.245+0000 7fc217e14880 20 rados->read ofs=0 len=0 2023-10-05T11:38:03.249 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.245+0000 7fc217e14880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:38:03.249 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.245+0000 7fc217e14880 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T11:38:03.249 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.245+0000 7fc217e14880 20 rados->read ofs=0 len=0 2023-10-05T11:38:03.249 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.245+0000 7fc217e14880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:38:03.249 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.245+0000 7fc217e14880 20 rados->read ofs=0 len=0 2023-10-05T11:38:03.249 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.246+0000 7fc217e14880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:38:03.250 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.246+0000 7fc217e14880 20 rados->read ofs=0 len=0 2023-10-05T11:38:03.251 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.247+0000 7fc217e14880 20 rados_obj.operate() r=0 bl.length=1020 2023-10-05T11:38:03.251 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.247+0000 7fc217e14880 20 searching for the correct realm 2023-10-05T11:38:03.260 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.257+0000 7fc214323640 0 -- 172.21.15.12:0/1913252819 >> [v2:172.21.15.170:6814/3150808418,v1:172.21.15.170:6816/3150808418] conn(0x5571232e5c00 msgr2=0x5571226eec00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:38:03.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.258+0000 7fc217e14880 20 RGWRados::pool_iterate: got zone_info.dff27d1e-df33-400e-a68a-7ba586947c99 2023-10-05T11:38:03.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.258+0000 7fc217e14880 20 RGWRados::pool_iterate: got zonegroup_info.c78aa576-9d15-4e9d-b3c0-4af23a22062c 2023-10-05T11:38:03.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.258+0000 7fc217e14880 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T11:38:03.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.258+0000 7fc217e14880 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T11:38:03.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.258+0000 7fc217e14880 20 rados->read ofs=0 len=0 2023-10-05T11:38:03.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.258+0000 7fc217e14880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:38:03.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.258+0000 7fc217e14880 20 rados->read ofs=0 len=0 2023-10-05T11:38:03.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.258+0000 7fc217e14880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:38:03.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.258+0000 7fc217e14880 20 rados->read ofs=0 len=0 2023-10-05T11:38:03.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.259+0000 7fc217e14880 20 rados_obj.operate() r=0 bl.length=454 2023-10-05T11:38:03.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.259+0000 7fc217e14880 20 zone default found 2023-10-05T11:38:03.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.259+0000 7fc217e14880 4 Realm: () 2023-10-05T11:38:03.265 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.259+0000 7fc217e14880 4 ZoneGroup: default (c78aa576-9d15-4e9d-b3c0-4af23a22062c) 2023-10-05T11:38:03.266 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.259+0000 7fc217e14880 4 Zone: default (dff27d1e-df33-400e-a68a-7ba586947c99) 2023-10-05T11:38:03.266 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.259+0000 7fc217e14880 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T11:38:03.266 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.259+0000 7fc217e14880 20 zonegroup default 2023-10-05T11:38:03.266 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.259+0000 7fc217e14880 20 rados->read ofs=0 len=0 2023-10-05T11:38:03.266 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.259+0000 7fc217e14880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:38:03.266 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.259+0000 7fc217e14880 20 rados->read ofs=0 len=0 2023-10-05T11:38:03.266 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.259+0000 7fc217e14880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:38:03.267 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.259+0000 7fc217e14880 20 rados->read ofs=0 len=0 2023-10-05T11:38:03.267 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.260+0000 7fc217e14880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:38:03.267 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.260+0000 7fc217e14880 20 started sync module instance, tier type = 2023-10-05T11:38:03.267 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.260+0000 7fc217e14880 20 started zone id=dff27d1e-df33-400e-a68a-7ba586947c99 (name=default) with tier type = 2023-10-05T11:38:03.271 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.267+0000 7fc214b24640 0 -- 172.21.15.12:0/1913252819 >> [v2:172.21.15.170:6800/4137726411,v1:172.21.15.170:6801/4137726411] conn(0x55712285f800 msgr2=0x55712277b600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:38:03.273 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.270+0000 7fc217e14880 20 add_watcher() i=0 2023-10-05T11:38:03.273 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.270+0000 7fc217e14880 20 add_watcher() i=1 2023-10-05T11:38:03.274 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.270+0000 7fc217e14880 20 add_watcher() i=2 2023-10-05T11:38:03.274 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.270+0000 7fc217e14880 20 add_watcher() i=3 2023-10-05T11:38:03.274 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.270+0000 7fc217e14880 20 add_watcher() i=4 2023-10-05T11:38:03.274 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.270+0000 7fc217e14880 20 add_watcher() i=5 2023-10-05T11:38:03.274 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.270+0000 7fc217e14880 20 add_watcher() i=6 2023-10-05T11:38:03.275 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.270+0000 7fc217e14880 20 add_watcher() i=7 2023-10-05T11:38:03.275 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.270+0000 7fc217e14880 2 all 8 watchers are set, enabling cache 2023-10-05T11:38:03.276 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.272+0000 7fc1fb2f1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:38:03.276 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.272+0000 7fc217e14880 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T11:38:03.277 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.272+0000 7fc217e14880 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T11:38:03.282 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.277+0000 7fc217e14880 5 note: GC not initialized 2023-10-05T11:38:03.283 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.277+0000 7fc1f6ae8640 20 reqs_thread_entry: start 2023-10-05T11:38:03.283 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.277+0000 7fc217e14880 20 init_complete bucket index max shards: 11 2023-10-05T11:38:03.283 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.277+0000 7fc217e14880 20 Filter name: none 2023-10-05T11:38:03.283 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.277+0000 7fc1f4ae4640 20 reqs_thread_entry: start 2023-10-05T11:38:03.283 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.277+0000 7fc217e14880 10 cache get: name=default.rgw.meta+users.uid+ragweed.client.0 : miss 2023-10-05T11:38:03.284 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.277+0000 7fc217e14880 20 rados->read ofs=0 len=0 2023-10-05T11:38:03.284 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.278+0000 7fc217e14880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:38:03.284 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.278+0000 7fc217e14880 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x0 2023-10-05T11:38:03.284 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.278+0000 7fc217e14880 10 adding default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2023-10-05T11:38:03.284 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.278+0000 7fc217e14880 10 cache get: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test : miss 2023-10-05T11:38:03.285 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.278+0000 7fc217e14880 20 rados->read ofs=0 len=0 2023-10-05T11:38:03.285 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.278+0000 7fc217e14880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:38:03.285 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.278+0000 7fc217e14880 10 cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x0 2023-10-05T11:38:03.285 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.278+0000 7fc217e14880 10 adding default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2023-10-05T11:38:03.285 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.278+0000 7fc217e14880 10 cache get: name=default.rgw.meta+users.keys+WDFHAESUVLDKQVRYPAXX : miss 2023-10-05T11:38:03.285 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.278+0000 7fc217e14880 20 rados->read ofs=0 len=0 2023-10-05T11:38:03.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.278+0000 7fc217e14880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:38:03.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.278+0000 7fc217e14880 10 cache put: name=default.rgw.meta+users.keys+WDFHAESUVLDKQVRYPAXX info.flags=0x0 2023-10-05T11:38:03.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.278+0000 7fc217e14880 10 adding default.rgw.meta+users.keys+WDFHAESUVLDKQVRYPAXX to cache LRU end 2023-10-05T11:38:03.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.278+0000 7fc217e14880 10 cache get: name=default.rgw.meta+users.keys+WDFHAESUVLDKQVRYPAXX : hit (negative entry) 2023-10-05T11:38:03.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.278+0000 7fc217e14880 10 cache get: name=default.rgw.meta+users.keys+WDFHAESUVLDKQVRYPAXX : hit (negative entry) 2023-10-05T11:38:03.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.280+0000 7fc217e14880 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x17 2023-10-05T11:38:03.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.280+0000 7fc217e14880 10 moving default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2023-10-05T11:38:03.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.280+0000 7fc217e14880 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ragweed.client.0, ofs0, ns] 2023-10-05T11:38:03.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.280+0000 7fc20e317640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1017907249174 cookie 93944398981120 notifier 5819 bl.length()=641 2023-10-05T11:38:03.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.280+0000 7fc20e317640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x17 2023-10-05T11:38:03.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.280+0000 7fc20e317640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2023-10-05T11:38:03.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.283+0000 7fc217e14880 10 cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x7 2023-10-05T11:38:03.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.283+0000 7fc217e14880 10 moving default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2023-10-05T11:38:03.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.283+0000 7fc217e14880 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.email:ragweed.client.0+test@test.test, ofs0, ns] 2023-10-05T11:38:03.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.283+0000 7fc20e317640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1017907249183 cookie 93944398868480 notifier 5819 bl.length()=202 2023-10-05T11:38:03.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.283+0000 7fc20e317640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x7 2023-10-05T11:38:03.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.283+0000 7fc20e317640 10 rgw watcher librados: moving default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2023-10-05T11:38:03.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.286+0000 7fc217e14880 10 cache put: name=default.rgw.meta+users.keys+WDFHAESUVLDKQVRYPAXX info.flags=0x7 2023-10-05T11:38:03.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.286+0000 7fc217e14880 10 moving default.rgw.meta+users.keys+WDFHAESUVLDKQVRYPAXX to cache LRU end 2023-10-05T11:38:03.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.286+0000 7fc217e14880 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.keys:WDFHAESUVLDKQVRYPAXX, ofs0, ns] 2023-10-05T11:38:03.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.287+0000 7fc20e317640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1017907249175 cookie 93944398866432 notifier 5819 bl.length()=190 2023-10-05T11:38:03.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.287+0000 7fc20e317640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+WDFHAESUVLDKQVRYPAXX info.flags=0x7 2023-10-05T11:38:03.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.287+0000 7fc20e317640 10 rgw watcher librados: moving default.rgw.meta+users.keys+WDFHAESUVLDKQVRYPAXX to cache LRU end 2023-10-05T11:38:03.292 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-10-05T11:38:03.293 INFO:teuthology.orchestra.run.smithi012.stdout: "user_id": "ragweed.client.0", 2023-10-05T11:38:03.293 INFO:teuthology.orchestra.run.smithi012.stdout: "display_name": "Mr. ragweed.client.0", 2023-10-05T11:38:03.293 INFO:teuthology.orchestra.run.smithi012.stdout: "email": "ragweed.client.0+test@test.test", 2023-10-05T11:38:03.293 INFO:teuthology.orchestra.run.smithi012.stdout: "suspended": 0, 2023-10-05T11:38:03.293 INFO:teuthology.orchestra.run.smithi012.stdout: "max_buckets": 1000, 2023-10-05T11:38:03.294 INFO:teuthology.orchestra.run.smithi012.stdout: "subusers": [], 2023-10-05T11:38:03.294 INFO:teuthology.orchestra.run.smithi012.stdout: "keys": [ 2023-10-05T11:38:03.294 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-05T11:38:03.294 INFO:teuthology.orchestra.run.smithi012.stdout: "user": "ragweed.client.0", 2023-10-05T11:38:03.294 INFO:teuthology.orchestra.run.smithi012.stdout: "access_key": "WDFHAESUVLDKQVRYPAXX", 2023-10-05T11:38:03.295 INFO:teuthology.orchestra.run.smithi012.stdout: "secret_key": "BTH3/4UBTu5UCf45CpgVQmHwASgtcVO+Y2BIByg/isme8uDF7eZuJw==" 2023-10-05T11:38:03.295 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-05T11:38:03.295 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-10-05T11:38:03.295 INFO:teuthology.orchestra.run.smithi012.stdout: "swift_keys": [], 2023-10-05T11:38:03.295 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": [], 2023-10-05T11:38:03.295 INFO:teuthology.orchestra.run.smithi012.stdout: "op_mask": "read, write, delete", 2023-10-05T11:38:03.296 INFO:teuthology.orchestra.run.smithi012.stdout: "default_placement": "", 2023-10-05T11:38:03.296 INFO:teuthology.orchestra.run.smithi012.stdout: "default_storage_class": "", 2023-10-05T11:38:03.296 INFO:teuthology.orchestra.run.smithi012.stdout: "placement_tags": [], 2023-10-05T11:38:03.296 INFO:teuthology.orchestra.run.smithi012.stdout: "bucket_quota": { 2023-10-05T11:38:03.296 INFO:teuthology.orchestra.run.smithi012.stdout: "enabled": false, 2023-10-05T11:38:03.296 INFO:teuthology.orchestra.run.smithi012.stdout: "check_on_raw": false, 2023-10-05T11:38:03.297 INFO:teuthology.orchestra.run.smithi012.stdout: "max_size": -1, 2023-10-05T11:38:03.297 INFO:teuthology.orchestra.run.smithi012.stdout: "max_size_kb": 0, 2023-10-05T11:38:03.297 INFO:teuthology.orchestra.run.smithi012.stdout: "max_objects": -1 2023-10-05T11:38:03.297 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-05T11:38:03.297 INFO:teuthology.orchestra.run.smithi012.stdout: "user_quota": { 2023-10-05T11:38:03.298 INFO:teuthology.orchestra.run.smithi012.stdout: "enabled": false, 2023-10-05T11:38:03.298 INFO:teuthology.orchestra.run.smithi012.stdout: "check_on_raw": false, 2023-10-05T11:38:03.298 INFO:teuthology.orchestra.run.smithi012.stdout: "max_size": -1, 2023-10-05T11:38:03.298 INFO:teuthology.orchestra.run.smithi012.stdout: "max_size_kb": 0, 2023-10-05T11:38:03.298 INFO:teuthology.orchestra.run.smithi012.stdout: "max_objects": -1 2023-10-05T11:38:03.298 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-05T11:38:03.299 INFO:teuthology.orchestra.run.smithi012.stdout: "temp_url_keys": [], 2023-10-05T11:38:03.299 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "rgw", 2023-10-05T11:38:03.299 INFO:teuthology.orchestra.run.smithi012.stdout: "mfa_ids": [] 2023-10-05T11:38:03.299 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-10-05T11:38:03.299 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:38:03.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.289+0000 7fc1fb2f1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:38:03.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.291+0000 7fc217e14880 20 remove_watcher() i=0 2023-10-05T11:38:03.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.291+0000 7fc217e14880 2 removed watcher, disabling cache 2023-10-05T11:38:03.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.293+0000 7fc217e14880 20 remove_watcher() i=1 2023-10-05T11:38:03.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.294+0000 7fc217e14880 20 remove_watcher() i=2 2023-10-05T11:38:03.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.295+0000 7fc217e14880 20 remove_watcher() i=3 2023-10-05T11:38:03.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.296+0000 7fc217e14880 20 remove_watcher() i=4 2023-10-05T11:38:03.302 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.297+0000 7fc217e14880 20 remove_watcher() i=5 2023-10-05T11:38:03.302 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.298+0000 7fc217e14880 20 remove_watcher() i=6 2023-10-05T11:38:03.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.299+0000 7fc217e14880 20 remove_watcher() i=7 2023-10-05T11:38:03.308 DEBUG:tasks.ragweed:Creating user sysuser.client.0 on client.0 2023-10-05T11:38:03.308 DEBUG:teuthology.orchestra.run.smithi012:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid sysuser.client.0 --display-name 'Mr. sysuser.client.0' --access-key TUHUZRMEGNHRRNUFSDHH --secret wgIIJp8LuLze1IK66eJ/RgXWrmmvAlbeg6+FblB5aECtyV/YiKTVEg== --email sysuser.client.0+test@test.test --system true 2023-10-05T11:38:03.360 INFO:teuthology.orchestra.run.smithi012.stderr:ignoring --setuser ceph since I am not root 2023-10-05T11:38:03.360 INFO:teuthology.orchestra.run.smithi012.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T11:38:03.371 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.368+0000 7fcb6ab33880 20 rados->read ofs=0 len=0 2023-10-05T11:38:03.373 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.369+0000 7fcb6ab33880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:38:03.373 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.369+0000 7fcb6ab33880 20 realm 2023-10-05T11:38:03.373 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.369+0000 7fcb6ab33880 20 rados->read ofs=0 len=0 2023-10-05T11:38:03.373 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.369+0000 7fcb6ab33880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:38:03.373 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.369+0000 7fcb6ab33880 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T11:38:03.373 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.369+0000 7fcb6ab33880 20 rados->read ofs=0 len=0 2023-10-05T11:38:03.373 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.370+0000 7fcb6ab33880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:38:03.374 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.370+0000 7fcb6ab33880 20 rados->read ofs=0 len=0 2023-10-05T11:38:03.374 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.370+0000 7fcb6ab33880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:38:03.374 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.370+0000 7fcb6ab33880 20 rados->read ofs=0 len=0 2023-10-05T11:38:03.374 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.371+0000 7fcb6ab33880 20 rados_obj.operate() r=0 bl.length=1020 2023-10-05T11:38:03.375 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.371+0000 7fcb6ab33880 20 searching for the correct realm 2023-10-05T11:38:03.382 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.379+0000 7fcb6742a640 0 -- 172.21.15.12:0/1015678405 >> [v2:172.21.15.12:6808/396693578,v1:172.21.15.12:6809/396693578] conn(0x5623731fa000 msgr2=0x5623731f6580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:38:03.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.382+0000 7fcb6ab33880 20 RGWRados::pool_iterate: got zone_info.dff27d1e-df33-400e-a68a-7ba586947c99 2023-10-05T11:38:03.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.382+0000 7fcb6ab33880 20 RGWRados::pool_iterate: got zonegroup_info.c78aa576-9d15-4e9d-b3c0-4af23a22062c 2023-10-05T11:38:03.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.382+0000 7fcb6ab33880 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T11:38:03.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.382+0000 7fcb6ab33880 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T11:38:03.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.382+0000 7fcb6ab33880 20 rados->read ofs=0 len=0 2023-10-05T11:38:03.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.382+0000 7fcb6ab33880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:38:03.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.382+0000 7fcb6ab33880 20 rados->read ofs=0 len=0 2023-10-05T11:38:03.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.382+0000 7fcb6ab33880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:38:03.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.382+0000 7fcb6ab33880 20 rados->read ofs=0 len=0 2023-10-05T11:38:03.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.383+0000 7fcb6ab33880 20 rados_obj.operate() r=0 bl.length=454 2023-10-05T11:38:03.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.383+0000 7fcb6ab33880 20 zone default found 2023-10-05T11:38:03.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.383+0000 7fcb6ab33880 4 Realm: () 2023-10-05T11:38:03.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.383+0000 7fcb6ab33880 4 ZoneGroup: default (c78aa576-9d15-4e9d-b3c0-4af23a22062c) 2023-10-05T11:38:03.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.383+0000 7fcb6ab33880 4 Zone: default (dff27d1e-df33-400e-a68a-7ba586947c99) 2023-10-05T11:38:03.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.383+0000 7fcb6ab33880 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T11:38:03.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.383+0000 7fcb6ab33880 20 zonegroup default 2023-10-05T11:38:03.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.383+0000 7fcb6ab33880 20 rados->read ofs=0 len=0 2023-10-05T11:38:03.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.383+0000 7fcb6ab33880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:38:03.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.383+0000 7fcb6ab33880 20 rados->read ofs=0 len=0 2023-10-05T11:38:03.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.383+0000 7fcb6ab33880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:38:03.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.383+0000 7fcb6ab33880 20 rados->read ofs=0 len=0 2023-10-05T11:38:03.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.383+0000 7fcb6ab33880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:38:03.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.383+0000 7fcb6ab33880 20 started sync module instance, tier type = 2023-10-05T11:38:03.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.383+0000 7fcb6ab33880 20 started zone id=dff27d1e-df33-400e-a68a-7ba586947c99 (name=default) with tier type = 2023-10-05T11:38:03.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.385+0000 7fcb67c2b640 0 -- 172.21.15.12:0/1015678405 >> [v2:172.21.15.170:6800/4137726411,v1:172.21.15.170:6801/4137726411] conn(0x562373c4d400 msgr2=0x5623731f6000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:38:03.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.393+0000 7fcb6ab33880 20 add_watcher() i=0 2023-10-05T11:38:03.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.393+0000 7fcb6ab33880 20 add_watcher() i=1 2023-10-05T11:38:03.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.393+0000 7fcb6ab33880 20 add_watcher() i=2 2023-10-05T11:38:03.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.393+0000 7fcb6ab33880 20 add_watcher() i=3 2023-10-05T11:38:03.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.393+0000 7fcb6ab33880 20 add_watcher() i=4 2023-10-05T11:38:03.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.393+0000 7fcb6ab33880 20 add_watcher() i=5 2023-10-05T11:38:03.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.393+0000 7fcb6ab33880 20 add_watcher() i=6 2023-10-05T11:38:03.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.394+0000 7fcb6ab33880 20 add_watcher() i=7 2023-10-05T11:38:03.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.394+0000 7fcb6ab33880 2 all 8 watchers are set, enabling cache 2023-10-05T11:38:03.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.395+0000 7fcb4e3f8640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:38:03.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.395+0000 7fcb6ab33880 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T11:38:03.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.395+0000 7fcb6ab33880 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T11:38:03.404 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.400+0000 7fcb6ab33880 5 note: GC not initialized 2023-10-05T11:38:03.404 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.400+0000 7fcb49bef640 20 reqs_thread_entry: start 2023-10-05T11:38:03.404 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.400+0000 7fcb6ab33880 20 init_complete bucket index max shards: 11 2023-10-05T11:38:03.404 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.400+0000 7fcb6ab33880 20 Filter name: none 2023-10-05T11:38:03.404 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.400+0000 7fcb47beb640 20 reqs_thread_entry: start 2023-10-05T11:38:03.404 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.400+0000 7fcb6ab33880 10 cache get: name=default.rgw.meta+users.uid+sysuser.client.0 : miss 2023-10-05T11:38:03.404 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.400+0000 7fcb6ab33880 20 rados->read ofs=0 len=0 2023-10-05T11:38:03.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.401+0000 7fcb6ab33880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:38:03.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.401+0000 7fcb6ab33880 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x0 2023-10-05T11:38:03.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.401+0000 7fcb6ab33880 10 adding default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2023-10-05T11:38:03.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.401+0000 7fcb6ab33880 10 cache get: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test : miss 2023-10-05T11:38:03.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.401+0000 7fcb6ab33880 20 rados->read ofs=0 len=0 2023-10-05T11:38:03.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.401+0000 7fcb6ab33880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:38:03.406 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.401+0000 7fcb6ab33880 10 cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x0 2023-10-05T11:38:03.406 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.401+0000 7fcb6ab33880 10 adding default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2023-10-05T11:38:03.406 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.401+0000 7fcb6ab33880 10 cache get: name=default.rgw.meta+users.keys+TUHUZRMEGNHRRNUFSDHH : miss 2023-10-05T11:38:03.406 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.401+0000 7fcb6ab33880 20 rados->read ofs=0 len=0 2023-10-05T11:38:03.406 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.401+0000 7fcb6ab33880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:38:03.406 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.401+0000 7fcb6ab33880 10 cache put: name=default.rgw.meta+users.keys+TUHUZRMEGNHRRNUFSDHH info.flags=0x0 2023-10-05T11:38:03.406 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.401+0000 7fcb6ab33880 10 adding default.rgw.meta+users.keys+TUHUZRMEGNHRRNUFSDHH to cache LRU end 2023-10-05T11:38:03.406 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.401+0000 7fcb6ab33880 10 cache get: name=default.rgw.meta+users.keys+TUHUZRMEGNHRRNUFSDHH : hit (negative entry) 2023-10-05T11:38:03.406 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.401+0000 7fcb6ab33880 10 cache get: name=default.rgw.meta+users.keys+TUHUZRMEGNHRRNUFSDHH : hit (negative entry) 2023-10-05T11:38:03.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.402+0000 7fcb6ab33880 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x17 2023-10-05T11:38:03.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.402+0000 7fcb6ab33880 10 moving default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2023-10-05T11:38:03.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.402+0000 7fcb6ab33880 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:sysuser.client.0, ofs0, ns] 2023-10-05T11:38:03.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.403+0000 7fcb61c1f640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1017907249184 cookie 94710255301632 notifier 5837 bl.length()=641 2023-10-05T11:38:03.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.403+0000 7fcb61c1f640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x17 2023-10-05T11:38:03.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.403+0000 7fcb61c1f640 10 rgw watcher librados: moving default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2023-10-05T11:38:03.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.406+0000 7fcb6ab33880 10 cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x7 2023-10-05T11:38:03.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.406+0000 7fcb6ab33880 10 moving default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2023-10-05T11:38:03.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.406+0000 7fcb6ab33880 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.email:sysuser.client.0+test@test.test, ofs0, ns] 2023-10-05T11:38:03.410 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.406+0000 7fcb61c1f640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1017907249176 cookie 94710255303680 notifier 5837 bl.length()=202 2023-10-05T11:38:03.410 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.406+0000 7fcb61c1f640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x7 2023-10-05T11:38:03.410 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.406+0000 7fcb61c1f640 10 rgw watcher librados: moving default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2023-10-05T11:38:03.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.408+0000 7fcb6ab33880 10 cache put: name=default.rgw.meta+users.keys+TUHUZRMEGNHRRNUFSDHH info.flags=0x7 2023-10-05T11:38:03.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.408+0000 7fcb6ab33880 10 moving default.rgw.meta+users.keys+TUHUZRMEGNHRRNUFSDHH to cache LRU end 2023-10-05T11:38:03.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.408+0000 7fcb6ab33880 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.keys:TUHUZRMEGNHRRNUFSDHH, ofs0, ns] 2023-10-05T11:38:03.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.409+0000 7fcb61c1f640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1017907249168 cookie 94710255379456 notifier 5837 bl.length()=190 2023-10-05T11:38:03.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.409+0000 7fcb61c1f640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+TUHUZRMEGNHRRNUFSDHH info.flags=0x7 2023-10-05T11:38:03.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.409+0000 7fcb61c1f640 10 rgw watcher librados: moving default.rgw.meta+users.keys+TUHUZRMEGNHRRNUFSDHH to cache LRU end 2023-10-05T11:38:03.413 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-10-05T11:38:03.413 INFO:teuthology.orchestra.run.smithi012.stdout: "user_id": "sysuser.client.0", 2023-10-05T11:38:03.414 INFO:teuthology.orchestra.run.smithi012.stdout: "display_name": "Mr. sysuser.client.0", 2023-10-05T11:38:03.414 INFO:teuthology.orchestra.run.smithi012.stdout: "email": "sysuser.client.0+test@test.test", 2023-10-05T11:38:03.414 INFO:teuthology.orchestra.run.smithi012.stdout: "suspended": 0, 2023-10-05T11:38:03.414 INFO:teuthology.orchestra.run.smithi012.stdout: "max_buckets": 1000, 2023-10-05T11:38:03.414 INFO:teuthology.orchestra.run.smithi012.stdout: "subusers": [], 2023-10-05T11:38:03.414 INFO:teuthology.orchestra.run.smithi012.stdout: "keys": [ 2023-10-05T11:38:03.414 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-05T11:38:03.414 INFO:teuthology.orchestra.run.smithi012.stdout: "user": "sysuser.client.0", 2023-10-05T11:38:03.414 INFO:teuthology.orchestra.run.smithi012.stdout: "access_key": "TUHUZRMEGNHRRNUFSDHH", 2023-10-05T11:38:03.414 INFO:teuthology.orchestra.run.smithi012.stdout: "secret_key": "wgIIJp8LuLze1IK66eJ/RgXWrmmvAlbeg6+FblB5aECtyV/YiKTVEg==" 2023-10-05T11:38:03.414 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-05T11:38:03.415 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-10-05T11:38:03.415 INFO:teuthology.orchestra.run.smithi012.stdout: "swift_keys": [], 2023-10-05T11:38:03.415 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": [], 2023-10-05T11:38:03.415 INFO:teuthology.orchestra.run.smithi012.stdout: "op_mask": "read, write, delete", 2023-10-05T11:38:03.415 INFO:teuthology.orchestra.run.smithi012.stdout: "system": true, 2023-10-05T11:38:03.415 INFO:teuthology.orchestra.run.smithi012.stdout: "default_placement": "", 2023-10-05T11:38:03.415 INFO:teuthology.orchestra.run.smithi012.stdout: "default_storage_class": "", 2023-10-05T11:38:03.415 INFO:teuthology.orchestra.run.smithi012.stdout: "placement_tags": [], 2023-10-05T11:38:03.415 INFO:teuthology.orchestra.run.smithi012.stdout: "bucket_quota": { 2023-10-05T11:38:03.415 INFO:teuthology.orchestra.run.smithi012.stdout: "enabled": false, 2023-10-05T11:38:03.415 INFO:teuthology.orchestra.run.smithi012.stdout: "check_on_raw": false, 2023-10-05T11:38:03.415 INFO:teuthology.orchestra.run.smithi012.stdout: "max_size": -1, 2023-10-05T11:38:03.415 INFO:teuthology.orchestra.run.smithi012.stdout: "max_size_kb": 0, 2023-10-05T11:38:03.416 INFO:teuthology.orchestra.run.smithi012.stdout: "max_objects": -1 2023-10-05T11:38:03.416 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-05T11:38:03.416 INFO:teuthology.orchestra.run.smithi012.stdout: "user_quota": { 2023-10-05T11:38:03.416 INFO:teuthology.orchestra.run.smithi012.stdout: "enabled": false, 2023-10-05T11:38:03.416 INFO:teuthology.orchestra.run.smithi012.stdout: "check_on_raw": false, 2023-10-05T11:38:03.416 INFO:teuthology.orchestra.run.smithi012.stdout: "max_size": -1, 2023-10-05T11:38:03.416 INFO:teuthology.orchestra.run.smithi012.stdout: "max_size_kb": 0, 2023-10-05T11:38:03.416 INFO:teuthology.orchestra.run.smithi012.stdout: "max_objects": -1 2023-10-05T11:38:03.416 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-05T11:38:03.416 INFO:teuthology.orchestra.run.smithi012.stdout: "temp_url_keys": [], 2023-10-05T11:38:03.416 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "rgw", 2023-10-05T11:38:03.416 INFO:teuthology.orchestra.run.smithi012.stdout: "mfa_ids": [] 2023-10-05T11:38:03.417 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-10-05T11:38:03.417 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:38:03.417 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.411+0000 7fcb4e3f8640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:38:03.417 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.413+0000 7fcb6ab33880 20 remove_watcher() i=0 2023-10-05T11:38:03.417 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.413+0000 7fcb6ab33880 2 removed watcher, disabling cache 2023-10-05T11:38:03.418 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.415+0000 7fcb6ab33880 20 remove_watcher() i=1 2023-10-05T11:38:03.419 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.416+0000 7fcb6ab33880 20 remove_watcher() i=2 2023-10-05T11:38:03.420 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.417+0000 7fcb6ab33880 20 remove_watcher() i=3 2023-10-05T11:38:03.421 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.418+0000 7fcb6ab33880 20 remove_watcher() i=4 2023-10-05T11:38:03.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.419+0000 7fcb6ab33880 20 remove_watcher() i=5 2023-10-05T11:38:03.423 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.420+0000 7fcb6ab33880 20 remove_watcher() i=6 2023-10-05T11:38:03.424 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:03.421+0000 7fcb6ab33880 20 remove_watcher() i=7 2023-10-05T11:38:03.429 INFO:tasks.ragweed:Configuring ragweed... 2023-10-05T11:38:03.429 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-10-05T11:38:03.430 DEBUG:teuthology.orchestra.run.smithi012:> dd of=/home/ubuntu/cephtest/archive/ragweed.client.0.conf 2023-10-05T11:38:03.444 INFO:tasks.ragweed:Configuring boto... 2023-10-05T11:38:03.444 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-10-05T11:38:03.445 DEBUG:teuthology.orchestra.run.smithi012:> dd of=/home/ubuntu/cephtest/boto.cfg 2023-10-05T11:38:03.499 DEBUG:teuthology.orchestra.run.smithi012:ragweed tests against rgw> source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/ragweed.client.0 && RAGWEED_CONF=/home/ubuntu/cephtest/archive/ragweed.client.0.conf RAGWEED_STAGES=prepare,check BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg tox --sitepackages -- -v -m 'not fails_on_rgw' 2023-10-05T11:38:03.666 INFO:teuthology.orchestra.run.smithi012.stdout:GLOB sdist-make: /home/ubuntu/cephtest/ragweed.client.0/setup.py 2023-10-05T11:38:03.846 INFO:teuthology.orchestra.run.smithi012.stdout:py create: /home/ubuntu/cephtest/ragweed.client.0/.tox/py 2023-10-05T11:38:04.356 INFO:teuthology.orchestra.run.smithi012.stdout:py installdeps: -rrequirements.txt 2023-10-05T11:38:11.158 INFO:teuthology.orchestra.run.smithi012.stdout:py inst: /home/ubuntu/cephtest/ragweed.client.0/.tox/.tmp/package/1/ragweed-0.0.1.zip 2023-10-05T11:38:13.208 INFO:teuthology.orchestra.run.smithi012.stdout:py installed: asyncssh==2.13.2,Babel==2.9.1,bcrypt==3.2.2,boto==2.49.0,cachetools==4.2.4,ceph==1.0.0,ceph-volume==1.0.0,cephfs==2.0.0,certifi==2021.10.8,cffi==1.14.5,chardet==4.0.0,cheroot==8.6.0,CherryPy==18.6.1,cockpit @ file:///builddir/build/BUILD/cockpit-299/tmp/wheel/cockpit-299-py3-none-any.whl,cryptography==36.0.1,dasbus==1.4,dbus-python==1.2.18,distro==1.5.0,docopt==0.6.2,exceptiongroup==1.1.3,execnet==2.0.2,file-magic==0.4.0,gevent==23.9.1,google-auth==2.23.0,gpg==1.15.1,greenlet==3.0.0,httplib2==0.22.0,idna==2.10,iniconfig==2.0.0,isodate==0.6.1,jaraco.classes==3.2.1,jaraco.collections==3.0.0,jaraco.functools==3.5.0,jaraco.text==3.2.0,Jinja2==2.11.3,jsonpatch==1.21,jsonpointer==2.0,kubernetes==26.1.0,libcomps==0.1.18,logutils==0.3.5,lxml==4.6.5,Mako==1.1.4.dev0,MarkupSafe==1.1.1,more-itertools==8.12.0,munch==4.0.0,natsort==7.1.1,nftables==0.1,numpy==1.20.1,oauthlib==3.1.1,packaging==23.2,pecan==1.4.2,perf==0.1,pexpect==4.8.0,pluggy==1.3.0,ply==3.11,portend==3.1.0,prettytable==0.7.2,psutil==5.8.0,ptyprocess==0.6.0,pyasn1==0.4.8,pyasn1-modules==0.2.8,pycparser==2.20,PyGObject==3.40.1,PyJWT==2.4.0,pyOpenSSL==21.0.0,pyparsing==2.4.7,PySocks==1.7.1,pytest==7.4.2,python-dateutil==2.8.1,python-linux-procfs==0.7.0,pytz==2021.1,pyudev==0.22.0,PyYAML==5.4.1,rados==2.0.0,ragweed @ file:///home/ubuntu/cephtest/ragweed.client.0/.tox/.tmp/package/1/ragweed-0.0.1.zip#sha256=ec3e1cbb5110235937bebddf09320fa67198119a35d830862486121b47de01dc,rbd==2.0.0,registries-conf-ctl==1.0,remoto==1.2.1,repoze.lru==0.7,requests==2.25.1,requests-oauthlib==1.3.0,rgw==2.0.0,Routes==2.5.1,rpm==4.16.1.3,rsa==4.9,s3cmd==2.3.0,scipy==1.6.2,selinux==3.5,sepolicy==3.5,setools==4.4.3,setroubleshoot @ file:///builddir/build/BUILD/setroubleshoot-3.3.32/src,six==1.15.0,sos==4.3,systemd-python==234,tempora==5.0.0,toml==0.10.2,tomli==2.0.1,typing_extensions==4.4.0,urllib3==1.26.5,WebOb==1.8.7,websocket-client==1.2.3,Werkzeug==2.0.3,zc.lockfile==2.0,zope.event==5.0,zope.interface==6.1 2023-10-05T11:38:13.208 INFO:teuthology.orchestra.run.smithi012.stdout:py run-test-pre: PYTHONHASHSEED='3657800934' 2023-10-05T11:38:13.208 INFO:teuthology.orchestra.run.smithi012.stdout:py run-test: commands[0] | python -m pytest -v -m 'not fails_on_rgw' 2023-10-05T11:38:13.438 INFO:teuthology.orchestra.run.smithi012.stdout:============================= test session starts ============================== 2023-10-05T11:38:13.438 INFO:teuthology.orchestra.run.smithi012.stdout:platform linux -- Python 3.9.17, pytest-7.4.2, pluggy-1.3.0 -- /home/ubuntu/cephtest/ragweed.client.0/.tox/py/bin/python 2023-10-05T11:38:13.438 INFO:teuthology.orchestra.run.smithi012.stdout:cachedir: .tox/py/.pytest_cache 2023-10-05T11:38:13.438 INFO:teuthology.orchestra.run.smithi012.stdout:rootdir: /home/ubuntu/cephtest/ragweed.client.0 2023-10-05T11:38:13.438 INFO:teuthology.orchestra.run.smithi012.stdout:configfile: pytest.ini 2023-10-05T11:38:13.541 INFO:teuthology.orchestra.run.smithi012.stdout:collecting ... collected 9 items 2023-10-05T11:38:13.542 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:38:15.755 INFO:teuthology.orchestra.run.smithi012.stdout:ragweed/tests/tests.py::r_test_small_obj_data::test PASSED [ 11%] 2023-10-05T11:38:18.229 INFO:teuthology.orchestra.run.smithi012.stdout:ragweed/tests/tests.py::r_test_multipart_simple::test PASSED [ 22%] 2023-10-05T11:38:20.411 INFO:teuthology.orchestra.run.smithi012.stdout:ragweed/tests/tests.py::r_test_multipart_index_versioning::test PASSED [ 33%] 2023-10-05T11:38:22.850 INFO:teuthology.orchestra.run.smithi012.stdout:ragweed/tests/tests.py::r_test_multipart_defer_complete::test PASSED [ 44%] 2023-10-05T11:38:25.344 INFO:teuthology.orchestra.run.smithi012.stdout:ragweed/tests/tests.py::r_test_multipart_defer_update_complete::test PASSED [ 55%] 2023-10-05T11:38:34.070 INFO:teuthology.orchestra.run.smithi012.stdout:ragweed/tests/tests.py::r_test_obj_storage_class::test PASSED [ 66%] 2023-10-05T11:38:38.794 INFO:teuthology.orchestra.run.smithi012.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_multipart::test PASSED [ 77%] 2023-10-05T11:38:43.434 INFO:teuthology.orchestra.run.smithi012.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_copy::test PASSED [ 88%] 2023-10-05T11:38:52.440 INFO:teuthology.orchestra.run.smithi012.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_multipart_copy::test PASSED [100%] 2023-10-05T11:38:52.440 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:38:52.440 INFO:teuthology.orchestra.run.smithi012.stdout:=============================== warnings summary =============================== 2023-10-05T11:38:52.440 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/boto/plugin.py:40 2023-10-05T11:38:52.441 INFO:teuthology.orchestra.run.smithi012.stdout: /home/ubuntu/cephtest/ragweed.client.0/.tox/py/lib/python3.9/site-packages/boto/plugin.py:40: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses 2023-10-05T11:38:52.441 INFO:teuthology.orchestra.run.smithi012.stdout: import imp 2023-10-05T11:38:52.441 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:38:52.441 INFO:teuthology.orchestra.run.smithi012.stdout:-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html 2023-10-05T11:38:52.441 INFO:teuthology.orchestra.run.smithi012.stdout:======================== 9 passed, 1 warning in 39.00s ========================= 2023-10-05T11:38:52.472 INFO:teuthology.orchestra.run.smithi012.stdout:___________________________________ summary ____________________________________ 2023-10-05T11:38:52.473 INFO:teuthology.orchestra.run.smithi012.stdout: py: commands succeeded 2023-10-05T11:38:52.473 INFO:teuthology.orchestra.run.smithi012.stdout: congratulations :) 2023-10-05T11:38:52.487 INFO:tasks.ragweed:Cleaning up boto... 2023-10-05T11:38:52.487 DEBUG:teuthology.orchestra.run.smithi012:> rm -f /home/ubuntu/cephtest/boto.cfg 2023-10-05T11:38:52.502 DEBUG:teuthology.orchestra.run.smithi012:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid ragweed.client.0 --purge-data 2023-10-05T11:38:52.585 INFO:teuthology.orchestra.run.smithi012.stderr:ignoring --setuser ceph since I am not root 2023-10-05T11:38:52.585 INFO:teuthology.orchestra.run.smithi012.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T11:38:52.595 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.593+0000 7f8b43611880 20 rados->read ofs=0 len=0 2023-10-05T11:38:52.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.594+0000 7f8b43611880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:38:52.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.594+0000 7f8b43611880 20 realm 2023-10-05T11:38:52.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.594+0000 7f8b43611880 20 rados->read ofs=0 len=0 2023-10-05T11:38:52.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.594+0000 7f8b43611880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:38:52.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.594+0000 7f8b43611880 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T11:38:52.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.594+0000 7f8b43611880 20 rados->read ofs=0 len=0 2023-10-05T11:38:52.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.595+0000 7f8b43611880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:38:52.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.595+0000 7f8b43611880 20 rados->read ofs=0 len=0 2023-10-05T11:38:52.598 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.596+0000 7f8b43611880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:38:52.598 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.596+0000 7f8b43611880 20 rados->read ofs=0 len=0 2023-10-05T11:38:52.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.597+0000 7f8b43611880 20 rados_obj.operate() r=0 bl.length=1020 2023-10-05T11:38:52.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.597+0000 7f8b43611880 20 searching for the correct realm 2023-10-05T11:38:52.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.607+0000 7f8b4028f640 0 -- 172.21.15.12:0/672442911 >> [v2:172.21.15.12:6824/2171933159,v1:172.21.15.12:6825/2171933159] conn(0x55766d24a400 msgr2=0x55766d0b9700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:38:52.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.608+0000 7f8b43611880 20 RGWRados::pool_iterate: got zone_info.dff27d1e-df33-400e-a68a-7ba586947c99 2023-10-05T11:38:52.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.608+0000 7f8b43611880 20 RGWRados::pool_iterate: got zonegroup_info.c78aa576-9d15-4e9d-b3c0-4af23a22062c 2023-10-05T11:38:52.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.608+0000 7f8b43611880 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T11:38:52.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.608+0000 7f8b43611880 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T11:38:52.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.608+0000 7f8b43611880 20 rados->read ofs=0 len=0 2023-10-05T11:38:52.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.608+0000 7f8b43611880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:38:52.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.608+0000 7f8b43611880 20 rados->read ofs=0 len=0 2023-10-05T11:38:52.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.609+0000 7f8b43611880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:38:52.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.609+0000 7f8b43611880 20 rados->read ofs=0 len=0 2023-10-05T11:38:52.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.609+0000 7f8b43611880 20 rados_obj.operate() r=0 bl.length=454 2023-10-05T11:38:52.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.609+0000 7f8b43611880 20 zone default found 2023-10-05T11:38:52.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.609+0000 7f8b43611880 4 Realm: () 2023-10-05T11:38:52.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.609+0000 7f8b43611880 4 ZoneGroup: default (c78aa576-9d15-4e9d-b3c0-4af23a22062c) 2023-10-05T11:38:52.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.609+0000 7f8b43611880 4 Zone: default (dff27d1e-df33-400e-a68a-7ba586947c99) 2023-10-05T11:38:52.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.609+0000 7f8b43611880 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T11:38:52.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.609+0000 7f8b43611880 20 zonegroup default 2023-10-05T11:38:52.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.609+0000 7f8b43611880 20 rados->read ofs=0 len=0 2023-10-05T11:38:52.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.609+0000 7f8b43611880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:38:52.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.609+0000 7f8b43611880 20 rados->read ofs=0 len=0 2023-10-05T11:38:52.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.610+0000 7f8b43611880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:38:52.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.610+0000 7f8b43611880 20 rados->read ofs=0 len=0 2023-10-05T11:38:52.614 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.610+0000 7f8b43611880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:38:52.614 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.610+0000 7f8b43611880 20 started sync module instance, tier type = 2023-10-05T11:38:52.614 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.610+0000 7f8b43611880 20 started zone id=dff27d1e-df33-400e-a68a-7ba586947c99 (name=default) with tier type = 2023-10-05T11:38:52.620 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.618+0000 7f8b4028f640 0 -- 172.21.15.12:0/672442911 >> [v2:172.21.15.170:6800/4137726411,v1:172.21.15.170:6801/4137726411] conn(0x55766d14ac00 msgr2=0x55766d151600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:38:52.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.620+0000 7f8b43611880 20 add_watcher() i=0 2023-10-05T11:38:52.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.620+0000 7f8b43611880 20 add_watcher() i=1 2023-10-05T11:38:52.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.620+0000 7f8b43611880 20 add_watcher() i=2 2023-10-05T11:38:52.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.620+0000 7f8b43611880 20 add_watcher() i=3 2023-10-05T11:38:52.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.620+0000 7f8b43611880 20 add_watcher() i=4 2023-10-05T11:38:52.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.620+0000 7f8b43611880 20 add_watcher() i=5 2023-10-05T11:38:52.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.620+0000 7f8b43611880 20 add_watcher() i=6 2023-10-05T11:38:52.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.621+0000 7f8b43611880 20 add_watcher() i=7 2023-10-05T11:38:52.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.621+0000 7f8b43611880 2 all 8 watchers are set, enabling cache 2023-10-05T11:38:52.625 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.622+0000 7f8b26a5c640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:38:52.625 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.623+0000 7f8b43611880 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T11:38:52.625 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.623+0000 7f8b43611880 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T11:38:52.668 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.666+0000 7f8b22253640 20 reqs_thread_entry: start 2023-10-05T11:38:52.668 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.666+0000 7f8b43611880 20 init_complete bucket index max shards: 11 2023-10-05T11:38:52.668 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.666+0000 7f8b43611880 20 Filter name: none 2023-10-05T11:38:52.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.666+0000 7f8b2024f640 20 reqs_thread_entry: start 2023-10-05T11:38:52.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.666+0000 7f8b43611880 10 cache get: name=default.rgw.meta+users.uid+ragweed.client.0 : miss 2023-10-05T11:38:52.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.666+0000 7f8b43611880 20 rados->read ofs=0 len=0 2023-10-05T11:38:52.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.666+0000 7f8b43611880 20 rados_obj.operate() r=0 bl.length=452 2023-10-05T11:38:52.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.666+0000 7f8b43611880 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x13 2023-10-05T11:38:52.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.666+0000 7f8b43611880 10 adding default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2023-10-05T11:38:52.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.666+0000 7f8b43611880 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T11:38:52.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.667+0000 7f8b43611880 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:dff27d1e-df33-400e-a68a-7ba586947c99.4604.4 : miss 2023-10-05T11:38:52.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.667+0000 7f8b43611880 20 rados->read ofs=0 len=0 2023-10-05T11:38:52.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.667+0000 7f8b43611880 20 rados_obj.operate() r=0 bl.length=378 2023-10-05T11:38:52.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.667+0000 7f8b43611880 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:dff27d1e-df33-400e-a68a-7ba586947c99.4604.4 info.flags=0x17 2023-10-05T11:38:52.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.667+0000 7f8b43611880 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-conf:dff27d1e-df33-400e-a68a-7ba586947c99.4604.4 to cache LRU end 2023-10-05T11:38:52.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.667+0000 7f8b43611880 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T11:38:52.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.667+0000 7f8b43611880 10 updating xattr: name=user.rgw.acl bl.length()=209 2023-10-05T11:38:52.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.668+0000 7f8b43611880 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-conf:dff27d1e-df33-400e-a68a-7ba586947c99.4604.4 2023-10-05T11:38:52.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.668+0000 7f8b43611880 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_multipart_copy 2023-10-05T11:38:52.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.669+0000 7f8b43611880 10 cls_bucket_list_unordered: got tests/r_test_multipart_index_versioning 2023-10-05T11:38:52.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.669+0000 7f8b43611880 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_copy 2023-10-05T11:38:52.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.669+0000 7f8b43611880 10 cls_bucket_list_unordered: got tests/r_test_multipart_defer_update_complete 2023-10-05T11:38:52.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.669+0000 7f8b43611880 10 cls_bucket_list_unordered: got tests/r_test_multipart_defer_complete 2023-10-05T11:38:52.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.669+0000 7f8b43611880 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class 2023-10-05T11:38:52.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.670+0000 7f8b43611880 10 cls_bucket_list_unordered: got tests/r_test_multipart_simple 2023-10-05T11:38:52.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.670+0000 7f8b43611880 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_multipart 2023-10-05T11:38:52.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.671+0000 7f8b43611880 10 cls_bucket_list_unordered: got tests/r_test_small_obj_data 2023-10-05T11:38:52.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.671+0000 7f8b43611880 20 get_obj_state: rctx=0x55766dc9a9a0 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart_copy state=0x55766d3d61e8 s->prefetch_data=0 2023-10-05T11:38:52.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.672+0000 7f8b43611880 10 manifest: total_size = 7708 2023-10-05T11:38:52.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.672+0000 7f8b43611880 20 get_obj_state: setting s->obj_tag to dff27d1e-df33-400e-a68a-7ba586947c99.4543.12847283017947720595 2023-10-05T11:38:52.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.672+0000 7f8b43611880 20 get_obj_state: rctx=0x55766dc9a9a0 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart_copy state=0x55766d3d61e8 s->prefetch_data=0 2023-10-05T11:38:52.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.672+0000 7f8b43611880 20 prepare_atomic_modification: state is not atomic. state=0x55766d3d61e8 2023-10-05T11:38:52.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.672+0000 7f8b43611880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.4.1 2023-10-05T11:38:52.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.675+0000 7f8b43611880 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-10-05T11:38:52.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.675+0000 7f8b43611880 20 RGWObjManifest::operator++(): result: ofs=7708 stripe_ofs=7708 part_ofs=0 rule->part_size=0 2023-10-05T11:38:52.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.675+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - tag is: dff27d1e-df33-400e-a68a-7ba586947c99.4543.12847283017947720595 2023-10-05T11:38:52.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.675+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2023-10-05T11:38:52.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.675+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dff27d1e-df33-400e-a68a-7ba586947c99.4604.4__shadow_.koOM-cdaEP_onJg81A8iG5uYCZ5UHVd_0 2023-10-05T11:38:52.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.675+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2023-10-05T11:38:52.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.675+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2023-10-05T11:38:52.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.675+0000 7f8b43611880 20 garbage collection: RGWGC::send_chain - on object name: gc.16tag is: dff27d1e-df33-400e-a68a-7ba586947c99.4543.12847283017947720595 2023-10-05T11:38:52.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.676+0000 7f8b3a283640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_multipart_copy 2023-10-05T11:38:52.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.676+0000 7f8b43611880 20 get_obj_state: rctx=0x55766dc9a9a0 obj=test-client.0-conf:tests/r_test_multipart_index_versioning state=0x55766d3d61e8 s->prefetch_data=0 2023-10-05T11:38:52.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.676+0000 7f8b43611880 10 manifest: total_size = 4790 2023-10-05T11:38:52.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.676+0000 7f8b43611880 20 get_obj_state: setting s->obj_tag to dff27d1e-df33-400e-a68a-7ba586947c99.4543.9076493676790453196 2023-10-05T11:38:52.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.676+0000 7f8b43611880 20 get_obj_state: rctx=0x55766dc9a9a0 obj=test-client.0-conf:tests/r_test_multipart_index_versioning state=0x55766d3d61e8 s->prefetch_data=0 2023-10-05T11:38:52.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.676+0000 7f8b43611880 20 prepare_atomic_modification: state is not atomic. state=0x55766d3d61e8 2023-10-05T11:38:52.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.676+0000 7f8b43611880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.4.2 2023-10-05T11:38:52.681 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.679+0000 7f8b43611880 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-10-05T11:38:52.681 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.679+0000 7f8b43611880 20 RGWObjManifest::operator++(): result: ofs=4790 stripe_ofs=4790 part_ofs=0 rule->part_size=0 2023-10-05T11:38:52.682 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.679+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - tag is: dff27d1e-df33-400e-a68a-7ba586947c99.4543.9076493676790453196 2023-10-05T11:38:52.682 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.679+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2023-10-05T11:38:52.682 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.679+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dff27d1e-df33-400e-a68a-7ba586947c99.4604.4__shadow_.DK40kz-nN2pWp_fNPLsrvxkJUGeQMbf_0 2023-10-05T11:38:52.682 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.679+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2023-10-05T11:38:52.682 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.679+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2023-10-05T11:38:52.682 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.679+0000 7f8b43611880 20 garbage collection: RGWGC::send_chain - on object name: gc.13tag is: dff27d1e-df33-400e-a68a-7ba586947c99.4543.9076493676790453196 2023-10-05T11:38:52.683 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.680+0000 7f8b39a82640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_index_versioning 2023-10-05T11:38:52.683 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.680+0000 7f8b43611880 20 get_obj_state: rctx=0x55766dc9a9a0 obj=test-client.0-conf:tests/r_test_obj_storage_class_copy state=0x55766d3d61e8 s->prefetch_data=0 2023-10-05T11:38:52.683 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.681+0000 7f8b43611880 10 manifest: total_size = 4945 2023-10-05T11:38:52.683 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.681+0000 7f8b43611880 20 get_obj_state: setting s->obj_tag to dff27d1e-df33-400e-a68a-7ba586947c99.4543.6874965642748883390 2023-10-05T11:38:52.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.681+0000 7f8b43611880 20 get_obj_state: rctx=0x55766dc9a9a0 obj=test-client.0-conf:tests/r_test_obj_storage_class_copy state=0x55766d3d61e8 s->prefetch_data=0 2023-10-05T11:38:52.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.681+0000 7f8b43611880 20 prepare_atomic_modification: state is not atomic. state=0x55766d3d61e8 2023-10-05T11:38:52.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.681+0000 7f8b43611880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.4.2 2023-10-05T11:38:52.686 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.683+0000 7f8b43611880 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-10-05T11:38:52.686 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.683+0000 7f8b43611880 20 RGWObjManifest::operator++(): result: ofs=4945 stripe_ofs=4945 part_ofs=0 rule->part_size=0 2023-10-05T11:38:52.686 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.683+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - tag is: dff27d1e-df33-400e-a68a-7ba586947c99.4543.6874965642748883390 2023-10-05T11:38:52.686 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.683+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2023-10-05T11:38:52.686 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.683+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dff27d1e-df33-400e-a68a-7ba586947c99.4604.4__shadow_.6BWJ8qcFRoqe2xtxHuwKsU7E3TERQxO_0 2023-10-05T11:38:52.686 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.683+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2023-10-05T11:38:52.686 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.683+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2023-10-05T11:38:52.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.683+0000 7f8b43611880 20 garbage collection: RGWGC::send_chain - on object name: gc.3tag is: dff27d1e-df33-400e-a68a-7ba586947c99.4543.6874965642748883390 2023-10-05T11:38:52.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.684+0000 7f8b3a283640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_copy 2023-10-05T11:38:52.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.685+0000 7f8b43611880 20 get_obj_state: rctx=0x55766dc9a9a0 obj=test-client.0-conf:tests/r_test_multipart_defer_update_complete state=0x55766d3d61e8 s->prefetch_data=0 2023-10-05T11:38:52.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.685+0000 7f8b43611880 10 manifest: total_size = 12886 2023-10-05T11:38:52.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.685+0000 7f8b43611880 20 get_obj_state: setting s->obj_tag to dff27d1e-df33-400e-a68a-7ba586947c99.4543.11083568931409205542 2023-10-05T11:38:52.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.685+0000 7f8b43611880 20 get_obj_state: rctx=0x55766dc9a9a0 obj=test-client.0-conf:tests/r_test_multipart_defer_update_complete state=0x55766d3d61e8 s->prefetch_data=0 2023-10-05T11:38:52.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.685+0000 7f8b43611880 20 prepare_atomic_modification: state is not atomic. state=0x55766d3d61e8 2023-10-05T11:38:52.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.685+0000 7f8b43611880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.4.3 2023-10-05T11:38:52.690 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.688+0000 7f8b43611880 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-10-05T11:38:52.690 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.688+0000 7f8b43611880 20 RGWObjManifest::operator++(): result: ofs=12886 stripe_ofs=12886 part_ofs=0 rule->part_size=0 2023-10-05T11:38:52.691 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.688+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - tag is: dff27d1e-df33-400e-a68a-7ba586947c99.4543.11083568931409205542 2023-10-05T11:38:52.691 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.688+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2023-10-05T11:38:52.691 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.688+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dff27d1e-df33-400e-a68a-7ba586947c99.4604.4__shadow_.J1-I1ujmNKW79WpQ4tOrw1zx7vVmUiF_0 2023-10-05T11:38:52.691 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.688+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2023-10-05T11:38:52.691 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.688+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2023-10-05T11:38:52.691 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.688+0000 7f8b43611880 20 garbage collection: RGWGC::send_chain - on object name: gc.4tag is: dff27d1e-df33-400e-a68a-7ba586947c99.4543.11083568931409205542 2023-10-05T11:38:52.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.689+0000 7f8b39a82640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_defer_update_complete 2023-10-05T11:38:52.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.689+0000 7f8b43611880 20 get_obj_state: rctx=0x55766dc9a9a0 obj=test-client.0-conf:tests/r_test_multipart_defer_complete state=0x55766d3d61e8 s->prefetch_data=0 2023-10-05T11:38:52.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.690+0000 7f8b43611880 10 manifest: total_size = 7564 2023-10-05T11:38:52.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.690+0000 7f8b43611880 20 get_obj_state: setting s->obj_tag to dff27d1e-df33-400e-a68a-7ba586947c99.4543.11967606977212414543 2023-10-05T11:38:52.693 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.690+0000 7f8b43611880 20 get_obj_state: rctx=0x55766dc9a9a0 obj=test-client.0-conf:tests/r_test_multipart_defer_complete state=0x55766d3d61e8 s->prefetch_data=0 2023-10-05T11:38:52.693 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.690+0000 7f8b43611880 20 prepare_atomic_modification: state is not atomic. state=0x55766d3d61e8 2023-10-05T11:38:52.693 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.690+0000 7f8b43611880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.4.4 2023-10-05T11:38:52.695 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.692+0000 7f8b43611880 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-10-05T11:38:52.695 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.692+0000 7f8b43611880 20 RGWObjManifest::operator++(): result: ofs=7564 stripe_ofs=7564 part_ofs=0 rule->part_size=0 2023-10-05T11:38:52.695 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.692+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - tag is: dff27d1e-df33-400e-a68a-7ba586947c99.4543.11967606977212414543 2023-10-05T11:38:52.695 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.692+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2023-10-05T11:38:52.695 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.692+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dff27d1e-df33-400e-a68a-7ba586947c99.4604.4__shadow_.ZtO_o3mCzaIJMk5hcTUHrpvlSHr3G-n_0 2023-10-05T11:38:52.695 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.692+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2023-10-05T11:38:52.695 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.692+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2023-10-05T11:38:52.695 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.692+0000 7f8b43611880 20 garbage collection: RGWGC::send_chain - on object name: gc.0tag is: dff27d1e-df33-400e-a68a-7ba586947c99.4543.11967606977212414543 2023-10-05T11:38:52.696 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.694+0000 7f8b3a283640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_defer_complete 2023-10-05T11:38:52.696 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.694+0000 7f8b43611880 20 get_obj_state: rctx=0x55766dc9a9a0 obj=test-client.0-conf:tests/r_test_obj_storage_class state=0x55766d3d61e8 s->prefetch_data=0 2023-10-05T11:38:52.697 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.694+0000 7f8b43611880 10 manifest: total_size = 4881 2023-10-05T11:38:52.697 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.694+0000 7f8b43611880 20 get_obj_state: setting s->obj_tag to dff27d1e-df33-400e-a68a-7ba586947c99.4543.3550742902591535562 2023-10-05T11:38:52.697 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.694+0000 7f8b43611880 20 get_obj_state: rctx=0x55766dc9a9a0 obj=test-client.0-conf:tests/r_test_obj_storage_class state=0x55766d3d61e8 s->prefetch_data=0 2023-10-05T11:38:52.697 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.694+0000 7f8b43611880 20 prepare_atomic_modification: state is not atomic. state=0x55766d3d61e8 2023-10-05T11:38:52.697 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.694+0000 7f8b43611880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.4.4 2023-10-05T11:38:52.699 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.696+0000 7f8b43611880 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-10-05T11:38:52.699 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.696+0000 7f8b43611880 20 RGWObjManifest::operator++(): result: ofs=4881 stripe_ofs=4881 part_ofs=0 rule->part_size=0 2023-10-05T11:38:52.699 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.696+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - tag is: dff27d1e-df33-400e-a68a-7ba586947c99.4543.3550742902591535562 2023-10-05T11:38:52.699 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.696+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2023-10-05T11:38:52.699 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.696+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dff27d1e-df33-400e-a68a-7ba586947c99.4604.4__shadow_.tUwLMTUk6oeWdNE-FaDJR58xwGYih1D_0 2023-10-05T11:38:52.699 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.696+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2023-10-05T11:38:52.699 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.696+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2023-10-05T11:38:52.699 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.696+0000 7f8b43611880 20 garbage collection: RGWGC::send_chain - on object name: gc.29tag is: dff27d1e-df33-400e-a68a-7ba586947c99.4543.3550742902591535562 2023-10-05T11:38:52.700 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.697+0000 7f8b39a82640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class 2023-10-05T11:38:52.700 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.698+0000 7f8b43611880 20 get_obj_state: rctx=0x55766dc9a9a0 obj=test-client.0-conf:tests/r_test_multipart_simple state=0x55766d3d61e8 s->prefetch_data=0 2023-10-05T11:38:52.700 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.698+0000 7f8b43611880 10 manifest: total_size = 7345 2023-10-05T11:38:52.701 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.698+0000 7f8b43611880 20 get_obj_state: setting s->obj_tag to dff27d1e-df33-400e-a68a-7ba586947c99.4543.3585161418491478297 2023-10-05T11:38:52.701 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.698+0000 7f8b43611880 20 get_obj_state: rctx=0x55766dc9a9a0 obj=test-client.0-conf:tests/r_test_multipart_simple state=0x55766d3d61e8 s->prefetch_data=0 2023-10-05T11:38:52.701 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.698+0000 7f8b43611880 20 prepare_atomic_modification: state is not atomic. state=0x55766d3d61e8 2023-10-05T11:38:52.701 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.698+0000 7f8b43611880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.4.5 2023-10-05T11:38:52.703 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.701+0000 7f8b43611880 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-10-05T11:38:52.703 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.701+0000 7f8b43611880 20 RGWObjManifest::operator++(): result: ofs=7345 stripe_ofs=7345 part_ofs=0 rule->part_size=0 2023-10-05T11:38:52.703 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.701+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - tag is: dff27d1e-df33-400e-a68a-7ba586947c99.4543.3585161418491478297 2023-10-05T11:38:52.704 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.701+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2023-10-05T11:38:52.704 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.701+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dff27d1e-df33-400e-a68a-7ba586947c99.4604.4__shadow_.Xzwm3crQQ_Hk9h9xNDbVk-KgBzjkpzv_0 2023-10-05T11:38:52.704 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.701+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2023-10-05T11:38:52.704 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.701+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2023-10-05T11:38:52.704 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.701+0000 7f8b43611880 20 garbage collection: RGWGC::send_chain - on object name: gc.19tag is: dff27d1e-df33-400e-a68a-7ba586947c99.4543.3585161418491478297 2023-10-05T11:38:52.705 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.702+0000 7f8b3a283640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_simple 2023-10-05T11:38:52.705 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.702+0000 7f8b43611880 20 get_obj_state: rctx=0x55766dc9a9a0 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart state=0x55766d3d61e8 s->prefetch_data=0 2023-10-05T11:38:52.705 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.703+0000 7f8b43611880 10 manifest: total_size = 5341 2023-10-05T11:38:52.705 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.703+0000 7f8b43611880 20 get_obj_state: setting s->obj_tag to dff27d1e-df33-400e-a68a-7ba586947c99.4543.3780724165736036439 2023-10-05T11:38:52.705 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.703+0000 7f8b43611880 20 get_obj_state: rctx=0x55766dc9a9a0 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart state=0x55766d3d61e8 s->prefetch_data=0 2023-10-05T11:38:52.706 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.703+0000 7f8b43611880 20 prepare_atomic_modification: state is not atomic. state=0x55766d3d61e8 2023-10-05T11:38:52.706 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.703+0000 7f8b43611880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.4.7 2023-10-05T11:38:52.707 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.705+0000 7f8b43611880 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-10-05T11:38:52.707 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.705+0000 7f8b43611880 20 RGWObjManifest::operator++(): result: ofs=5341 stripe_ofs=5341 part_ofs=0 rule->part_size=0 2023-10-05T11:38:52.708 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.705+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - tag is: dff27d1e-df33-400e-a68a-7ba586947c99.4543.3780724165736036439 2023-10-05T11:38:52.708 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.705+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2023-10-05T11:38:52.708 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.705+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dff27d1e-df33-400e-a68a-7ba586947c99.4604.4__shadow_.H5yBsVyOqyIBlesXqQD-FuTbtJ9DNMf_0 2023-10-05T11:38:52.708 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.705+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2023-10-05T11:38:52.708 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.705+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2023-10-05T11:38:52.708 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.705+0000 7f8b43611880 20 garbage collection: RGWGC::send_chain - on object name: gc.5tag is: dff27d1e-df33-400e-a68a-7ba586947c99.4543.3780724165736036439 2023-10-05T11:38:52.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.706+0000 7f8b39a82640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_multipart 2023-10-05T11:38:52.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.706+0000 7f8b43611880 20 get_obj_state: rctx=0x55766dc9a9a0 obj=test-client.0-conf:tests/r_test_small_obj_data state=0x55766d3d61e8 s->prefetch_data=0 2023-10-05T11:38:52.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.707+0000 7f8b43611880 10 manifest: total_size = 5283 2023-10-05T11:38:52.710 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.707+0000 7f8b43611880 20 get_obj_state: setting s->obj_tag to dff27d1e-df33-400e-a68a-7ba586947c99.4543.15847424263535009406 2023-10-05T11:38:52.710 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.707+0000 7f8b43611880 20 get_obj_state: rctx=0x55766dc9a9a0 obj=test-client.0-conf:tests/r_test_small_obj_data state=0x55766d3d61e8 s->prefetch_data=0 2023-10-05T11:38:52.710 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.707+0000 7f8b43611880 20 prepare_atomic_modification: state is not atomic. state=0x55766d3d61e8 2023-10-05T11:38:52.710 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.707+0000 7f8b43611880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.4.8 2023-10-05T11:38:52.712 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.710+0000 7f8b43611880 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-10-05T11:38:52.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.710+0000 7f8b43611880 20 RGWObjManifest::operator++(): result: ofs=5283 stripe_ofs=5283 part_ofs=0 rule->part_size=0 2023-10-05T11:38:52.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.710+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - tag is: dff27d1e-df33-400e-a68a-7ba586947c99.4543.15847424263535009406 2023-10-05T11:38:52.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.710+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2023-10-05T11:38:52.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.710+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dff27d1e-df33-400e-a68a-7ba586947c99.4604.4__shadow_.OiYGTOdInsNsv2GIS08Yq0WBHsEIt9d_0 2023-10-05T11:38:52.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.710+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2023-10-05T11:38:52.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.710+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2023-10-05T11:38:52.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.710+0000 7f8b43611880 20 garbage collection: RGWGC::send_chain - on object name: gc.29tag is: dff27d1e-df33-400e-a68a-7ba586947c99.4543.15847424263535009406 2023-10-05T11:38:52.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.711+0000 7f8b3a283640 20 handle_completion(): completion ok for obj=tests/r_test_small_obj_data 2023-10-05T11:38:52.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.712+0000 7f8b43611880 20 list_objects_ordered: starting attempt 1 2023-10-05T11:38:52.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.712+0000 7f8b43611880 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2023-10-05T11:38:52.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.712+0000 7f8b43611880 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2023-10-05T11:38:52.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.712+0000 7f8b43611880 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2023-10-05T11:38:52.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.712+0000 7f8b43611880 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2023-10-05T11:38:52.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.712+0000 7f8b43611880 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2023-10-05T11:38:52.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.712+0000 7f8b43611880 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-conf[dff27d1e-df33-400e-a68a-7ba586947c99.4604.4])"; uploads.size()=0; is_truncated=0 2023-10-05T11:38:52.717 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.714+0000 7f8b43611880 10 cache get: name=default.rgw.meta+root+test-client.0-conf : miss 2023-10-05T11:38:52.717 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.714+0000 7f8b43611880 20 rados->read ofs=0 len=0 2023-10-05T11:38:52.717 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.715+0000 7f8b43611880 20 rados_obj.operate() r=0 bl.length=204 2023-10-05T11:38:52.717 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.715+0000 7f8b43611880 10 cache put: name=default.rgw.meta+root+test-client.0-conf info.flags=0x11 2023-10-05T11:38:52.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.715+0000 7f8b43611880 10 adding default.rgw.meta+root+test-client.0-conf to cache LRU end 2023-10-05T11:38:52.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.715+0000 7f8b43611880 10 removing default.rgw.meta+root+test-client.0-conf from cache 2023-10-05T11:38:52.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.715+0000 7f8b43611880 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-conf, ofs0, ns] 2023-10-05T11:38:52.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.715+0000 7f8b39a82640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1052266987549 cookie 93967125620736 notifier 5864 bl.length()=162 2023-10-05T11:38:52.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.718+0000 7f8b43611880 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-conf:dff27d1e-df33-400e-a68a-7ba586947c99.4604.4 from cache 2023-10-05T11:38:52.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.718+0000 7f8b43611880 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-conf:dff27d1e-df33-400e-a68a-7ba586947c99.4604.4, ofs0, ns] 2023-10-05T11:38:52.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.718+0000 7f8b39a82640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1052266987558 cookie 93967125622784 notifier 5864 bl.length()=219 2023-10-05T11:38:52.726 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.724+0000 7f8b43611880 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-conf/dff27d1e-df33-400e-a68a-7ba586947c99.4604.4 : miss 2023-10-05T11:38:52.726 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.724+0000 7f8b43611880 20 rados->read ofs=0 len=0 2023-10-05T11:38:52.727 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.724+0000 7f8b43611880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:38:52.727 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.724+0000 7f8b43611880 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-conf/dff27d1e-df33-400e-a68a-7ba586947c99.4604.4 info.flags=0x0 2023-10-05T11:38:52.727 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.724+0000 7f8b43611880 10 adding default.rgw.log++pubsub..bucket.test-client.0-conf/dff27d1e-df33-400e-a68a-7ba586947c99.4604.4 to cache LRU end 2023-10-05T11:38:52.727 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.724+0000 7f8b43611880 10 removing default.rgw.log++pubsub..bucket.test-client.0-conf/dff27d1e-df33-400e-a68a-7ba586947c99.4604.4 from cache 2023-10-05T11:38:52.727 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.724+0000 7f8b43611880 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.log:pubsub..bucket.test-client.0-conf/dff27d1e-df33-400e-a68a-7ba586947c99.4604.4, ofs0, ns] 2023-10-05T11:38:52.727 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.724+0000 7f8b39a82640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1052266987568 cookie 93967125621760 notifier 5864 bl.length()=216 2023-10-05T11:38:52.730 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.728+0000 7f8b43611880 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:dff27d1e-df33-400e-a68a-7ba586947c99.4604.10 : miss 2023-10-05T11:38:52.731 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.728+0000 7f8b43611880 20 rados->read ofs=0 len=0 2023-10-05T11:38:52.731 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.728+0000 7f8b43611880 20 rados_obj.operate() r=0 bl.length=409 2023-10-05T11:38:52.731 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.728+0000 7f8b43611880 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:dff27d1e-df33-400e-a68a-7ba586947c99.4604.10 info.flags=0x17 2023-10-05T11:38:52.731 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.728+0000 7f8b43611880 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:dff27d1e-df33-400e-a68a-7ba586947c99.4604.10 to cache LRU end 2023-10-05T11:38:52.731 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.728+0000 7f8b43611880 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T11:38:52.732 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.728+0000 7f8b43611880 10 updating xattr: name=user.rgw.acl bl.length()=209 2023-10-05T11:38:52.732 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.729+0000 7f8b43611880 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:dff27d1e-df33-400e-a68a-7ba586947c99.4604.10 2023-10-05T11:38:52.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.733+0000 7f8b43611880 10 cls_bucket_list_unordered: got foo 2023-10-05T11:38:52.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.733+0000 7f8b43611880 20 get_obj_state: rctx=0x55766dc9a9a0 obj=test-client.0-r-test-multipart-defer-complete.1:foo state=0x55766d3d61e8 s->prefetch_data=0 2023-10-05T11:38:52.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.733+0000 7f8b43611880 10 manifest: total_size = 18874368 2023-10-05T11:38:52.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.733+0000 7f8b43611880 20 get_obj_state: setting s->obj_tag to dff27d1e-df33-400e-a68a-7ba586947c99.4543.13800752616018758557 2023-10-05T11:38:52.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.733+0000 7f8b43611880 20 get_obj_state: rctx=0x55766dc9a9a0 obj=test-client.0-r-test-multipart-defer-complete.1:foo state=0x55766d3d61e8 s->prefetch_data=0 2023-10-05T11:38:52.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.733+0000 7f8b43611880 20 prepare_atomic_modification: state is not atomic. state=0x55766d3d61e8 2023-10-05T11:38:52.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.733+0000 7f8b43611880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.10.10 2023-10-05T11:38:52.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.736+0000 7f8b43611880 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2023-10-05T11:38:52.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.736+0000 7f8b43611880 20 RGWObjManifest::operator++(): stripe_ofs=4190208 part_ofs=0 rule->part_size=5242880 2023-10-05T11:38:52.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.736+0000 7f8b43611880 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=5242880 2023-10-05T11:38:52.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.736+0000 7f8b43611880 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2023-10-05T11:38:52.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.736+0000 7f8b43611880 20 RGWObjManifest::operator++(): stripe_ofs=8380416 part_ofs=0 rule->part_size=5242880 2023-10-05T11:38:52.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.736+0000 7f8b43611880 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2023-10-05T11:38:52.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.736+0000 7f8b43611880 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2023-10-05T11:38:52.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.736+0000 7f8b43611880 20 RGWObjManifest::operator++(): stripe_ofs=9433088 part_ofs=5242880 rule->part_size=5242880 2023-10-05T11:38:52.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.736+0000 7f8b43611880 20 RGWObjManifest::operator++(): result: ofs=9433088 stripe_ofs=9433088 part_ofs=5242880 rule->part_size=5242880 2023-10-05T11:38:52.740 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.736+0000 7f8b43611880 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2023-10-05T11:38:52.740 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.736+0000 7f8b43611880 20 RGWObjManifest::operator++(): stripe_ofs=13623296 part_ofs=5242880 rule->part_size=5242880 2023-10-05T11:38:52.740 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.736+0000 7f8b43611880 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=5242880 2023-10-05T11:38:52.740 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.736+0000 7f8b43611880 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2023-10-05T11:38:52.740 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.736+0000 7f8b43611880 20 RGWObjManifest::operator++(): stripe_ofs=14675968 part_ofs=10485760 rule->part_size=5242880 2023-10-05T11:38:52.740 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.736+0000 7f8b43611880 20 RGWObjManifest::operator++(): result: ofs=14675968 stripe_ofs=14675968 part_ofs=10485760 rule->part_size=5242880 2023-10-05T11:38:52.740 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.736+0000 7f8b43611880 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2023-10-05T11:38:52.740 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.736+0000 7f8b43611880 20 RGWObjManifest::operator++(): stripe_ofs=18866176 part_ofs=10485760 rule->part_size=5242880 2023-10-05T11:38:52.740 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.736+0000 7f8b43611880 20 RGWObjManifest::operator++(): result: ofs=15728640 stripe_ofs=15728640 part_ofs=15728640 rule->part_size=3145728 2023-10-05T11:38:52.740 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.736+0000 7f8b43611880 20 RGWObjManifest::operator++(): rule->part_size=3145728 rules.size()=2 2023-10-05T11:38:52.740 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.736+0000 7f8b43611880 20 RGWObjManifest::operator++(): stripe_ofs=19918848 part_ofs=15728640 rule->part_size=3145728 2023-10-05T11:38:52.740 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.736+0000 7f8b43611880 20 RGWObjManifest::operator++(): result: ofs=18874368 stripe_ofs=18874368 part_ofs=18874368 rule->part_size=3145728 2023-10-05T11:38:52.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.736+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - tag is: dff27d1e-df33-400e-a68a-7ba586947c99.4543.13800752616018758557 2023-10-05T11:38:52.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.736+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2023-10-05T11:38:52.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.736+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dff27d1e-df33-400e-a68a-7ba586947c99.4604.10__multipart_foo.2~uvmX3YFr7Dxk58f4C_akXxjzyfwDhJA.1 2023-10-05T11:38:52.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.736+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 347 2023-10-05T11:38:52.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.736+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dff27d1e-df33-400e-a68a-7ba586947c99.4604.10__shadow_foo.2~uvmX3YFr7Dxk58f4C_akXxjzyfwDhJA.1_1 2023-10-05T11:38:52.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.736+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 591 2023-10-05T11:38:52.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.736+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dff27d1e-df33-400e-a68a-7ba586947c99.4604.10__multipart_foo.2~uvmX3YFr7Dxk58f4C_akXxjzyfwDhJA.2 2023-10-05T11:38:52.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.736+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 837 2023-10-05T11:38:52.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.736+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dff27d1e-df33-400e-a68a-7ba586947c99.4604.10__shadow_foo.2~uvmX3YFr7Dxk58f4C_akXxjzyfwDhJA.2_1 2023-10-05T11:38:52.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.736+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1081 2023-10-05T11:38:52.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.736+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dff27d1e-df33-400e-a68a-7ba586947c99.4604.10__multipart_foo.2~uvmX3YFr7Dxk58f4C_akXxjzyfwDhJA.3 2023-10-05T11:38:52.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.736+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1327 2023-10-05T11:38:52.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.736+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dff27d1e-df33-400e-a68a-7ba586947c99.4604.10__shadow_foo.2~uvmX3YFr7Dxk58f4C_akXxjzyfwDhJA.3_1 2023-10-05T11:38:52.742 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.736+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1571 2023-10-05T11:38:52.742 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.736+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dff27d1e-df33-400e-a68a-7ba586947c99.4604.10__multipart_foo.2~uvmX3YFr7Dxk58f4C_akXxjzyfwDhJA.4 2023-10-05T11:38:52.742 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.736+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1817 2023-10-05T11:38:52.742 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.736+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2023-10-05T11:38:52.742 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.736+0000 7f8b43611880 20 garbage collection: RGWGC::send_chain - on object name: gc.1tag is: dff27d1e-df33-400e-a68a-7ba586947c99.4543.13800752616018758557 2023-10-05T11:38:52.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.737+0000 7f8b3a283640 20 handle_completion(): completion ok for obj=foo 2023-10-05T11:38:52.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.737+0000 7f8b43611880 20 list_objects_ordered: starting attempt 1 2023-10-05T11:38:52.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.737+0000 7f8b43611880 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2023-10-05T11:38:52.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.738+0000 7f8b43611880 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2023-10-05T11:38:52.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.738+0000 7f8b43611880 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2023-10-05T11:38:52.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.738+0000 7f8b43611880 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2023-10-05T11:38:52.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.738+0000 7f8b43611880 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2023-10-05T11:38:52.744 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.738+0000 7f8b43611880 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-defer-complete.1[dff27d1e-df33-400e-a68a-7ba586947c99.4604.10])"; uploads.size()=0; is_truncated=0 2023-10-05T11:38:52.744 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.740+0000 7f8b43611880 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 : miss 2023-10-05T11:38:52.744 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.740+0000 7f8b43611880 20 rados->read ofs=0 len=0 2023-10-05T11:38:52.744 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.740+0000 7f8b43611880 20 rados_obj.operate() r=0 bl.length=235 2023-10-05T11:38:52.744 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.740+0000 7f8b43611880 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 info.flags=0x11 2023-10-05T11:38:52.744 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.740+0000 7f8b43611880 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 to cache LRU end 2023-10-05T11:38:52.744 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.740+0000 7f8b43611880 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 from cache 2023-10-05T11:38:52.744 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.740+0000 7f8b43611880 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-defer-complete.1, ofs0, ns] 2023-10-05T11:38:52.744 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.740+0000 7f8b3a283640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1052266987569 cookie 93967125621760 notifier 5864 bl.length()=191 2023-10-05T11:38:52.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.743+0000 7f8b43611880 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:dff27d1e-df33-400e-a68a-7ba586947c99.4604.10 from cache 2023-10-05T11:38:52.746 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.743+0000 7f8b43611880 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:dff27d1e-df33-400e-a68a-7ba586947c99.4604.10, ofs0, ns] 2023-10-05T11:38:52.746 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.744+0000 7f8b3a283640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1052266987550 cookie 93967125620736 notifier 5864 bl.length()=249 2023-10-05T11:38:52.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.749+0000 7f8b43611880 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/dff27d1e-df33-400e-a68a-7ba586947c99.4604.10 : miss 2023-10-05T11:38:52.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.749+0000 7f8b43611880 20 rados->read ofs=0 len=0 2023-10-05T11:38:52.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.749+0000 7f8b43611880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:38:52.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.749+0000 7f8b43611880 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/dff27d1e-df33-400e-a68a-7ba586947c99.4604.10 info.flags=0x0 2023-10-05T11:38:52.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.749+0000 7f8b43611880 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/dff27d1e-df33-400e-a68a-7ba586947c99.4604.10 to cache LRU end 2023-10-05T11:38:52.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.749+0000 7f8b43611880 10 removing default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/dff27d1e-df33-400e-a68a-7ba586947c99.4604.10 from cache 2023-10-05T11:38:52.752 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.749+0000 7f8b43611880 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.log:pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/dff27d1e-df33-400e-a68a-7ba586947c99.4604.10, ofs0, ns] 2023-10-05T11:38:52.752 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.749+0000 7f8b3a283640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1052266987547 cookie 93967125752832 notifier 5864 bl.length()=246 2023-10-05T11:38:52.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.752+0000 7f8b43611880 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:dff27d1e-df33-400e-a68a-7ba586947c99.4604.11 : miss 2023-10-05T11:38:52.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.752+0000 7f8b43611880 20 rados->read ofs=0 len=0 2023-10-05T11:38:52.756 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.753+0000 7f8b43611880 20 rados_obj.operate() r=0 bl.length=416 2023-10-05T11:38:52.756 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.753+0000 7f8b43611880 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:dff27d1e-df33-400e-a68a-7ba586947c99.4604.11 info.flags=0x17 2023-10-05T11:38:52.756 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.753+0000 7f8b43611880 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:dff27d1e-df33-400e-a68a-7ba586947c99.4604.11 to cache LRU end 2023-10-05T11:38:52.756 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.753+0000 7f8b43611880 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T11:38:52.756 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.753+0000 7f8b43611880 10 updating xattr: name=user.rgw.acl bl.length()=209 2023-10-05T11:38:52.756 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.753+0000 7f8b43611880 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:dff27d1e-df33-400e-a68a-7ba586947c99.4604.11 2023-10-05T11:38:52.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.757+0000 7f8b43611880 10 cls_bucket_list_unordered: got foo 2023-10-05T11:38:52.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.757+0000 7f8b43611880 20 get_obj_state: rctx=0x55766dc9a8c0 obj=test-client.0-r-test-multipart-defer-update-complete.1:foo state=0x55766d3d61e8 s->prefetch_data=0 2023-10-05T11:38:52.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.757+0000 7f8b43611880 10 manifest: total_size = 886297 2023-10-05T11:38:52.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.757+0000 7f8b43611880 20 get_obj_state: setting s->obj_tag to dff27d1e-df33-400e-a68a-7ba586947c99.4543.551383658556754855 2023-10-05T11:38:52.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.757+0000 7f8b43611880 20 get_obj_state: rctx=0x55766dc9a8c0 obj=test-client.0-r-test-multipart-defer-update-complete.1:foo state=0x55766d3d61e8 s->prefetch_data=0 2023-10-05T11:38:52.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.757+0000 7f8b43611880 20 prepare_atomic_modification: state is not atomic. state=0x55766d3d61e8 2023-10-05T11:38:52.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.757+0000 7f8b43611880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.11.10 2023-10-05T11:38:52.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.760+0000 7f8b43611880 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2023-10-05T11:38:52.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.760+0000 7f8b43611880 20 RGWObjManifest::operator++(): stripe_ofs=4190208 part_ofs=0 rule->part_size=246247 2023-10-05T11:38:52.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.760+0000 7f8b43611880 20 RGWObjManifest::operator++(): result: ofs=246247 stripe_ofs=246247 part_ofs=246247 rule->part_size=246247 2023-10-05T11:38:52.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.760+0000 7f8b43611880 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2023-10-05T11:38:52.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.760+0000 7f8b43611880 20 RGWObjManifest::operator++(): stripe_ofs=4436455 part_ofs=246247 rule->part_size=246247 2023-10-05T11:38:52.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.760+0000 7f8b43611880 20 RGWObjManifest::operator++(): result: ofs=492494 stripe_ofs=492494 part_ofs=492494 rule->part_size=246247 2023-10-05T11:38:52.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.760+0000 7f8b43611880 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2023-10-05T11:38:52.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.760+0000 7f8b43611880 20 RGWObjManifest::operator++(): stripe_ofs=4682702 part_ofs=492494 rule->part_size=246247 2023-10-05T11:38:52.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.760+0000 7f8b43611880 20 RGWObjManifest::operator++(): result: ofs=738741 stripe_ofs=738741 part_ofs=738741 rule->part_size=147556 2023-10-05T11:38:52.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.760+0000 7f8b43611880 20 RGWObjManifest::operator++(): rule->part_size=147556 rules.size()=2 2023-10-05T11:38:52.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.760+0000 7f8b43611880 20 RGWObjManifest::operator++(): stripe_ofs=4928949 part_ofs=738741 rule->part_size=147556 2023-10-05T11:38:52.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.760+0000 7f8b43611880 20 RGWObjManifest::operator++(): result: ofs=886297 stripe_ofs=886297 part_ofs=886297 rule->part_size=147556 2023-10-05T11:38:52.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.760+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - tag is: dff27d1e-df33-400e-a68a-7ba586947c99.4543.551383658556754855 2023-10-05T11:38:52.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.760+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2023-10-05T11:38:52.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.760+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dff27d1e-df33-400e-a68a-7ba586947c99.4604.11__multipart_foo.2~G-Y1jaO2JdTJPeh4KEfiZMdVr-wiOQ3.1 2023-10-05T11:38:52.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.760+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 345 2023-10-05T11:38:52.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.760+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dff27d1e-df33-400e-a68a-7ba586947c99.4604.11__multipart_foo.2~G-Y1jaO2JdTJPeh4KEfiZMdVr-wiOQ3.2 2023-10-05T11:38:52.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.760+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 591 2023-10-05T11:38:52.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.760+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dff27d1e-df33-400e-a68a-7ba586947c99.4604.11__multipart_foo.2~G-Y1jaO2JdTJPeh4KEfiZMdVr-wiOQ3.3 2023-10-05T11:38:52.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.760+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 837 2023-10-05T11:38:52.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.760+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dff27d1e-df33-400e-a68a-7ba586947c99.4604.11__multipart_foo.2~G-Y1jaO2JdTJPeh4KEfiZMdVr-wiOQ3.4 2023-10-05T11:38:52.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.760+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1083 2023-10-05T11:38:52.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.760+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2023-10-05T11:38:52.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.760+0000 7f8b43611880 20 garbage collection: RGWGC::send_chain - on object name: gc.5tag is: dff27d1e-df33-400e-a68a-7ba586947c99.4543.551383658556754855 2023-10-05T11:38:52.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.761+0000 7f8b39a82640 20 handle_completion(): completion ok for obj=foo 2023-10-05T11:38:52.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.761+0000 7f8b43611880 20 list_objects_ordered: starting attempt 1 2023-10-05T11:38:52.766 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.761+0000 7f8b43611880 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2023-10-05T11:38:52.766 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.762+0000 7f8b43611880 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2023-10-05T11:38:52.766 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.762+0000 7f8b43611880 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2023-10-05T11:38:52.766 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.762+0000 7f8b43611880 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2023-10-05T11:38:52.766 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.762+0000 7f8b43611880 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2023-10-05T11:38:52.766 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.762+0000 7f8b43611880 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-defer-update-complete.1[dff27d1e-df33-400e-a68a-7ba586947c99.4604.11])"; uploads.size()=0; is_truncated=0 2023-10-05T11:38:52.766 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.764+0000 7f8b43611880 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 : miss 2023-10-05T11:38:52.766 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.764+0000 7f8b43611880 20 rados->read ofs=0 len=0 2023-10-05T11:38:52.767 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.764+0000 7f8b43611880 20 rados_obj.operate() r=0 bl.length=242 2023-10-05T11:38:52.767 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.764+0000 7f8b43611880 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 info.flags=0x11 2023-10-05T11:38:52.767 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.764+0000 7f8b43611880 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 to cache LRU end 2023-10-05T11:38:52.767 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.764+0000 7f8b43611880 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 from cache 2023-10-05T11:38:52.767 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.764+0000 7f8b43611880 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-defer-update-complete.1, ofs0, ns] 2023-10-05T11:38:52.768 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.765+0000 7f8b3a283640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1052266987559 cookie 93967125622784 notifier 5864 bl.length()=198 2023-10-05T11:38:52.769 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.767+0000 7f8b43611880 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:dff27d1e-df33-400e-a68a-7ba586947c99.4604.11 from cache 2023-10-05T11:38:52.770 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.767+0000 7f8b43611880 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:dff27d1e-df33-400e-a68a-7ba586947c99.4604.11, ofs0, ns] 2023-10-05T11:38:52.770 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.768+0000 7f8b39a82640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1052266987548 cookie 93967125752832 notifier 5864 bl.length()=256 2023-10-05T11:38:52.774 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.772+0000 7f8b43611880 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/dff27d1e-df33-400e-a68a-7ba586947c99.4604.11 : miss 2023-10-05T11:38:52.775 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.772+0000 7f8b43611880 20 rados->read ofs=0 len=0 2023-10-05T11:38:52.775 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.772+0000 7f8b43611880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:38:52.775 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.772+0000 7f8b43611880 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/dff27d1e-df33-400e-a68a-7ba586947c99.4604.11 info.flags=0x0 2023-10-05T11:38:52.775 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.772+0000 7f8b43611880 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/dff27d1e-df33-400e-a68a-7ba586947c99.4604.11 to cache LRU end 2023-10-05T11:38:52.775 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.772+0000 7f8b43611880 10 removing default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/dff27d1e-df33-400e-a68a-7ba586947c99.4604.11 from cache 2023-10-05T11:38:52.775 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.772+0000 7f8b43611880 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.log:pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/dff27d1e-df33-400e-a68a-7ba586947c99.4604.11, ofs0, ns] 2023-10-05T11:38:52.775 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.773+0000 7f8b3a283640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1052266987560 cookie 93967125622784 notifier 5864 bl.length()=253 2023-10-05T11:38:52.778 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.776+0000 7f8b43611880 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:dff27d1e-df33-400e-a68a-7ba586947c99.4604.9 : miss 2023-10-05T11:38:52.779 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.776+0000 7f8b43611880 20 rados->read ofs=0 len=0 2023-10-05T11:38:52.779 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.777+0000 7f8b43611880 20 rados_obj.operate() r=0 bl.length=409 2023-10-05T11:38:52.779 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.777+0000 7f8b43611880 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:dff27d1e-df33-400e-a68a-7ba586947c99.4604.9 info.flags=0x17 2023-10-05T11:38:52.779 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.777+0000 7f8b43611880 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:dff27d1e-df33-400e-a68a-7ba586947c99.4604.9 to cache LRU end 2023-10-05T11:38:52.779 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.777+0000 7f8b43611880 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T11:38:52.780 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.777+0000 7f8b43611880 10 updating xattr: name=user.rgw.acl bl.length()=209 2023-10-05T11:38:52.780 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.777+0000 7f8b43611880 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:dff27d1e-df33-400e-a68a-7ba586947c99.4604.9 2023-10-05T11:38:52.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.781+0000 7f8b43611880 10 cls_bucket_list_unordered: got foo[SzmhQckGfJYCMhORkvRLG07pyiRL4nr] 2023-10-05T11:38:52.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.781+0000 7f8b43611880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.9.10 2023-10-05T11:38:52.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.781+0000 7f8b43611880 20 get_obj_state: rctx=0x55766dc9a8c0 obj=test-client.0-r-test-multipart-index-versioning.1:foo state=0x55766d3d61e8 s->prefetch_data=0 2023-10-05T11:38:52.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.782+0000 7f8b43611880 20 get_obj_state: setting s->obj_tag to mnqqxvkcga2g40qfh59yt6p6wm7l4ci9 2023-10-05T11:38:52.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.782+0000 7f8b43611880 20 get_obj_state_impl: setting s->olh_tag to ql7tn0ej4rlskyi6h5bo33qguhof4rok 2023-10-05T11:38:52.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.782+0000 7f8b43611880 20 bucket_index_guard_olh_op(): olh_state.olh_tag=ql7tn0ej4rlskyi6h5bo33qguhof4rok 2023-10-05T11:38:52.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.783+0000 7f8b43611880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.9.10 2023-10-05T11:38:52.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.784+0000 7f8b43611880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.9.10 2023-10-05T11:38:52.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.785+0000 7f8b43611880 20 olh_log_entry: epoch=3 op=2 key=foo[] 2023-10-05T11:38:52.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.785+0000 7f8b43611880 20 olh_log_entry: epoch=3 op=3 key=foo[SzmhQckGfJYCMhORkvRLG07pyiRL4nr] 2023-10-05T11:38:52.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.785+0000 7f8b43611880 20 get_obj_state: rctx=0x55766dc9a8c0 obj=test-client.0-r-test-multipart-index-versioning.1:_:SzmhQckGfJYCMhORkvRLG07pyiRL4nr_foo state=0x55766d3d6de8 s->prefetch_data=0 2023-10-05T11:38:52.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.785+0000 7f8b43611880 10 manifest: total_size = 886297 2023-10-05T11:38:52.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.785+0000 7f8b43611880 20 get_obj_state: setting s->obj_tag to dff27d1e-df33-400e-a68a-7ba586947c99.4543.9172761051855772569 2023-10-05T11:38:52.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.785+0000 7f8b43611880 20 get_obj_state: rctx=0x55766dc9a8c0 obj=test-client.0-r-test-multipart-index-versioning.1:_:SzmhQckGfJYCMhORkvRLG07pyiRL4nr_foo state=0x55766d3d6de8 s->prefetch_data=0 2023-10-05T11:38:52.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.785+0000 7f8b43611880 20 prepare_atomic_modification: state is not atomic. state=0x55766d3d6de8 2023-10-05T11:38:52.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.785+0000 7f8b43611880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.9.10 2023-10-05T11:38:52.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.787+0000 7f8b43611880 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2023-10-05T11:38:52.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.787+0000 7f8b43611880 20 RGWObjManifest::operator++(): stripe_ofs=4190208 part_ofs=0 rule->part_size=246247 2023-10-05T11:38:52.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.787+0000 7f8b43611880 20 RGWObjManifest::operator++(): result: ofs=246247 stripe_ofs=246247 part_ofs=246247 rule->part_size=246247 2023-10-05T11:38:52.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.787+0000 7f8b43611880 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2023-10-05T11:38:52.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.787+0000 7f8b43611880 20 RGWObjManifest::operator++(): stripe_ofs=4436455 part_ofs=246247 rule->part_size=246247 2023-10-05T11:38:52.791 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.787+0000 7f8b43611880 20 RGWObjManifest::operator++(): result: ofs=492494 stripe_ofs=492494 part_ofs=492494 rule->part_size=246247 2023-10-05T11:38:52.791 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.787+0000 7f8b43611880 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2023-10-05T11:38:52.791 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.787+0000 7f8b43611880 20 RGWObjManifest::operator++(): stripe_ofs=4682702 part_ofs=492494 rule->part_size=246247 2023-10-05T11:38:52.791 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.787+0000 7f8b43611880 20 RGWObjManifest::operator++(): result: ofs=738741 stripe_ofs=738741 part_ofs=738741 rule->part_size=147556 2023-10-05T11:38:52.791 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.787+0000 7f8b43611880 20 RGWObjManifest::operator++(): rule->part_size=147556 rules.size()=2 2023-10-05T11:38:52.791 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.787+0000 7f8b43611880 20 RGWObjManifest::operator++(): stripe_ofs=4928949 part_ofs=738741 rule->part_size=147556 2023-10-05T11:38:52.791 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.787+0000 7f8b43611880 20 RGWObjManifest::operator++(): result: ofs=886297 stripe_ofs=886297 part_ofs=886297 rule->part_size=147556 2023-10-05T11:38:52.791 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.787+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - tag is: dff27d1e-df33-400e-a68a-7ba586947c99.4543.9172761051855772569 2023-10-05T11:38:52.791 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.787+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2023-10-05T11:38:52.791 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.787+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dff27d1e-df33-400e-a68a-7ba586947c99.4604.9__multipart_foo.2~Lkl9yRqzDBNexhelDrW8L6l2EAL2Iud.1 2023-10-05T11:38:52.791 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.787+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 344 2023-10-05T11:38:52.791 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.787+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dff27d1e-df33-400e-a68a-7ba586947c99.4604.9__multipart_foo.2~Lkl9yRqzDBNexhelDrW8L6l2EAL2Iud.2 2023-10-05T11:38:52.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.787+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 588 2023-10-05T11:38:52.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.787+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dff27d1e-df33-400e-a68a-7ba586947c99.4604.9__multipart_foo.2~Lkl9yRqzDBNexhelDrW8L6l2EAL2Iud.3 2023-10-05T11:38:52.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.787+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 832 2023-10-05T11:38:52.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.787+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dff27d1e-df33-400e-a68a-7ba586947c99.4604.9__multipart_foo.2~Lkl9yRqzDBNexhelDrW8L6l2EAL2Iud.4 2023-10-05T11:38:52.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.787+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1076 2023-10-05T11:38:52.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.787+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2023-10-05T11:38:52.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.787+0000 7f8b43611880 20 garbage collection: RGWGC::send_chain - on object name: gc.14tag is: dff27d1e-df33-400e-a68a-7ba586947c99.4543.9172761051855772569 2023-10-05T11:38:52.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.789+0000 7f8b3a283640 20 handle_completion(): completion ok for obj=foo[SzmhQckGfJYCMhORkvRLG07pyiRL4nr] 2023-10-05T11:38:52.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.790+0000 7f8b43611880 20 get_obj_state: rctx=0x55766dc9a8c0 obj=test-client.0-r-test-multipart-index-versioning.1:foo state=0x55766d3d61e8 s->prefetch_data=0 2023-10-05T11:38:52.794 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.791+0000 7f8b43611880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.9.10 2023-10-05T11:38:52.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.793+0000 7f8b43611880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.9.10 2023-10-05T11:38:52.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.793+0000 7f8b43611880 20 list_objects_ordered: starting attempt 1 2023-10-05T11:38:52.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.793+0000 7f8b43611880 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2023-10-05T11:38:52.796 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.793+0000 7f8b43611880 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2023-10-05T11:38:52.796 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.793+0000 7f8b43611880 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2023-10-05T11:38:52.796 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.793+0000 7f8b43611880 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2023-10-05T11:38:52.796 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.793+0000 7f8b43611880 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2023-10-05T11:38:52.796 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.793+0000 7f8b43611880 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-index-versioning.1[dff27d1e-df33-400e-a68a-7ba586947c99.4604.9])"; uploads.size()=0; is_truncated=0 2023-10-05T11:38:52.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.795+0000 7f8b43611880 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 : miss 2023-10-05T11:38:52.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.795+0000 7f8b43611880 20 rados->read ofs=0 len=0 2023-10-05T11:38:52.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.796+0000 7f8b43611880 20 rados_obj.operate() r=0 bl.length=235 2023-10-05T11:38:52.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.796+0000 7f8b43611880 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 info.flags=0x11 2023-10-05T11:38:52.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.796+0000 7f8b43611880 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 to cache LRU end 2023-10-05T11:38:52.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.796+0000 7f8b43611880 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 from cache 2023-10-05T11:38:52.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.796+0000 7f8b43611880 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-index-versioning.1, ofs0, ns] 2023-10-05T11:38:52.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.796+0000 7f8b3a283640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1052266987561 cookie 93967125622784 notifier 5864 bl.length()=193 2023-10-05T11:38:52.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.798+0000 7f8b43611880 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:dff27d1e-df33-400e-a68a-7ba586947c99.4604.9 from cache 2023-10-05T11:38:52.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.798+0000 7f8b43611880 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:dff27d1e-df33-400e-a68a-7ba586947c99.4604.9, ofs0, ns] 2023-10-05T11:38:52.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.799+0000 7f8b3a283640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1052266987549 cookie 93967125753856 notifier 5864 bl.length()=250 2023-10-05T11:38:52.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.803+0000 7f8b43611880 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/dff27d1e-df33-400e-a68a-7ba586947c99.4604.9 : miss 2023-10-05T11:38:52.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.803+0000 7f8b43611880 20 rados->read ofs=0 len=0 2023-10-05T11:38:52.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.803+0000 7f8b43611880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:38:52.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.803+0000 7f8b43611880 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/dff27d1e-df33-400e-a68a-7ba586947c99.4604.9 info.flags=0x0 2023-10-05T11:38:52.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.803+0000 7f8b43611880 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/dff27d1e-df33-400e-a68a-7ba586947c99.4604.9 to cache LRU end 2023-10-05T11:38:52.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.803+0000 7f8b43611880 10 removing default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/dff27d1e-df33-400e-a68a-7ba586947c99.4604.9 from cache 2023-10-05T11:38:52.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.803+0000 7f8b43611880 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.log:pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/dff27d1e-df33-400e-a68a-7ba586947c99.4604.9, ofs0, ns] 2023-10-05T11:38:52.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.804+0000 7f8b39a82640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1052266987550 cookie 93967125752832 notifier 5864 bl.length()=247 2023-10-05T11:38:52.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.807+0000 7f8b43611880 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:dff27d1e-df33-400e-a68a-7ba586947c99.4604.8 : miss 2023-10-05T11:38:52.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.807+0000 7f8b43611880 20 rados->read ofs=0 len=0 2023-10-05T11:38:52.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.807+0000 7f8b43611880 20 rados_obj.operate() r=0 bl.length=399 2023-10-05T11:38:52.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.807+0000 7f8b43611880 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:dff27d1e-df33-400e-a68a-7ba586947c99.4604.8 info.flags=0x17 2023-10-05T11:38:52.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.807+0000 7f8b43611880 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:dff27d1e-df33-400e-a68a-7ba586947c99.4604.8 to cache LRU end 2023-10-05T11:38:52.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.807+0000 7f8b43611880 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T11:38:52.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.807+0000 7f8b43611880 10 updating xattr: name=user.rgw.acl bl.length()=209 2023-10-05T11:38:52.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.807+0000 7f8b43611880 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:dff27d1e-df33-400e-a68a-7ba586947c99.4604.8 2023-10-05T11:38:52.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.811+0000 7f8b43611880 10 cls_bucket_list_unordered: got foo 2023-10-05T11:38:52.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.811+0000 7f8b43611880 20 get_obj_state: rctx=0x55766dc9a9a0 obj=test-client.0-r-test-multipart-simple.1:foo state=0x55766d3d61e8 s->prefetch_data=0 2023-10-05T11:38:52.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.811+0000 7f8b43611880 10 manifest: total_size = 18874368 2023-10-05T11:38:52.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.811+0000 7f8b43611880 20 get_obj_state: setting s->obj_tag to dff27d1e-df33-400e-a68a-7ba586947c99.4543.8729090374544412441 2023-10-05T11:38:52.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.811+0000 7f8b43611880 20 get_obj_state: rctx=0x55766dc9a9a0 obj=test-client.0-r-test-multipart-simple.1:foo state=0x55766d3d61e8 s->prefetch_data=0 2023-10-05T11:38:52.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.811+0000 7f8b43611880 20 prepare_atomic_modification: state is not atomic. state=0x55766d3d61e8 2023-10-05T11:38:52.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.811+0000 7f8b43611880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.8.10 2023-10-05T11:38:52.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.814+0000 7f8b43611880 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2023-10-05T11:38:52.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.814+0000 7f8b43611880 20 RGWObjManifest::operator++(): stripe_ofs=4190208 part_ofs=0 rule->part_size=5242880 2023-10-05T11:38:52.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.814+0000 7f8b43611880 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=5242880 2023-10-05T11:38:52.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.814+0000 7f8b43611880 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2023-10-05T11:38:52.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.814+0000 7f8b43611880 20 RGWObjManifest::operator++(): stripe_ofs=8380416 part_ofs=0 rule->part_size=5242880 2023-10-05T11:38:52.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.814+0000 7f8b43611880 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2023-10-05T11:38:52.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.814+0000 7f8b43611880 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2023-10-05T11:38:52.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.814+0000 7f8b43611880 20 RGWObjManifest::operator++(): stripe_ofs=9433088 part_ofs=5242880 rule->part_size=5242880 2023-10-05T11:38:52.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.814+0000 7f8b43611880 20 RGWObjManifest::operator++(): result: ofs=9433088 stripe_ofs=9433088 part_ofs=5242880 rule->part_size=5242880 2023-10-05T11:38:52.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.814+0000 7f8b43611880 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2023-10-05T11:38:52.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.814+0000 7f8b43611880 20 RGWObjManifest::operator++(): stripe_ofs=13623296 part_ofs=5242880 rule->part_size=5242880 2023-10-05T11:38:52.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.814+0000 7f8b43611880 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=5242880 2023-10-05T11:38:52.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.814+0000 7f8b43611880 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2023-10-05T11:38:52.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.814+0000 7f8b43611880 20 RGWObjManifest::operator++(): stripe_ofs=14675968 part_ofs=10485760 rule->part_size=5242880 2023-10-05T11:38:52.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.814+0000 7f8b43611880 20 RGWObjManifest::operator++(): result: ofs=14675968 stripe_ofs=14675968 part_ofs=10485760 rule->part_size=5242880 2023-10-05T11:38:52.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.814+0000 7f8b43611880 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2023-10-05T11:38:52.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.814+0000 7f8b43611880 20 RGWObjManifest::operator++(): stripe_ofs=18866176 part_ofs=10485760 rule->part_size=5242880 2023-10-05T11:38:52.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.814+0000 7f8b43611880 20 RGWObjManifest::operator++(): result: ofs=15728640 stripe_ofs=15728640 part_ofs=15728640 rule->part_size=3145728 2023-10-05T11:38:52.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.814+0000 7f8b43611880 20 RGWObjManifest::operator++(): rule->part_size=3145728 rules.size()=2 2023-10-05T11:38:52.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.814+0000 7f8b43611880 20 RGWObjManifest::operator++(): stripe_ofs=19918848 part_ofs=15728640 rule->part_size=3145728 2023-10-05T11:38:52.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.814+0000 7f8b43611880 20 RGWObjManifest::operator++(): result: ofs=18874368 stripe_ofs=18874368 part_ofs=18874368 rule->part_size=3145728 2023-10-05T11:38:52.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.814+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - tag is: dff27d1e-df33-400e-a68a-7ba586947c99.4543.8729090374544412441 2023-10-05T11:38:52.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.814+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2023-10-05T11:38:52.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.814+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dff27d1e-df33-400e-a68a-7ba586947c99.4604.8__multipart_foo.2~2WTdJ1yYcOXbi5kFG_iIZ8SepiY-z1j.1 2023-10-05T11:38:52.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.814+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 344 2023-10-05T11:38:52.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.814+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dff27d1e-df33-400e-a68a-7ba586947c99.4604.8__shadow_foo.2~2WTdJ1yYcOXbi5kFG_iIZ8SepiY-z1j.1_1 2023-10-05T11:38:52.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.814+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 586 2023-10-05T11:38:52.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.814+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dff27d1e-df33-400e-a68a-7ba586947c99.4604.8__multipart_foo.2~2WTdJ1yYcOXbi5kFG_iIZ8SepiY-z1j.2 2023-10-05T11:38:52.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.814+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 830 2023-10-05T11:38:52.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.814+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dff27d1e-df33-400e-a68a-7ba586947c99.4604.8__shadow_foo.2~2WTdJ1yYcOXbi5kFG_iIZ8SepiY-z1j.2_1 2023-10-05T11:38:52.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.814+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1072 2023-10-05T11:38:52.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.814+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dff27d1e-df33-400e-a68a-7ba586947c99.4604.8__multipart_foo.2~2WTdJ1yYcOXbi5kFG_iIZ8SepiY-z1j.3 2023-10-05T11:38:52.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.814+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1316 2023-10-05T11:38:52.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.814+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dff27d1e-df33-400e-a68a-7ba586947c99.4604.8__shadow_foo.2~2WTdJ1yYcOXbi5kFG_iIZ8SepiY-z1j.3_1 2023-10-05T11:38:52.820 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.814+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1558 2023-10-05T11:38:52.820 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.814+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dff27d1e-df33-400e-a68a-7ba586947c99.4604.8__multipart_foo.2~2WTdJ1yYcOXbi5kFG_iIZ8SepiY-z1j.4 2023-10-05T11:38:52.820 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.814+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1802 2023-10-05T11:38:52.820 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.814+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2023-10-05T11:38:52.820 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.814+0000 7f8b43611880 20 garbage collection: RGWGC::send_chain - on object name: gc.17tag is: dff27d1e-df33-400e-a68a-7ba586947c99.4543.8729090374544412441 2023-10-05T11:38:52.821 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.815+0000 7f8b3a283640 20 handle_completion(): completion ok for obj=foo 2023-10-05T11:38:52.821 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.815+0000 7f8b43611880 20 list_objects_ordered: starting attempt 1 2023-10-05T11:38:52.821 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.815+0000 7f8b43611880 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2023-10-05T11:38:52.821 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.816+0000 7f8b43611880 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2023-10-05T11:38:52.822 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.816+0000 7f8b43611880 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2023-10-05T11:38:52.822 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.816+0000 7f8b43611880 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2023-10-05T11:38:52.822 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.816+0000 7f8b43611880 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2023-10-05T11:38:52.822 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.816+0000 7f8b43611880 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-simple.1[dff27d1e-df33-400e-a68a-7ba586947c99.4604.8])"; uploads.size()=0; is_truncated=0 2023-10-05T11:38:52.822 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.818+0000 7f8b43611880 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 : miss 2023-10-05T11:38:52.822 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.818+0000 7f8b43611880 20 rados->read ofs=0 len=0 2023-10-05T11:38:52.822 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.818+0000 7f8b43611880 20 rados_obj.operate() r=0 bl.length=225 2023-10-05T11:38:52.822 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.818+0000 7f8b43611880 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 info.flags=0x11 2023-10-05T11:38:52.822 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.818+0000 7f8b43611880 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 to cache LRU end 2023-10-05T11:38:52.822 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.818+0000 7f8b43611880 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 from cache 2023-10-05T11:38:52.823 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.818+0000 7f8b43611880 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-simple.1, ofs0, ns] 2023-10-05T11:38:52.823 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.818+0000 7f8b39a82640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1052266987551 cookie 93967125751808 notifier 5864 bl.length()=183 2023-10-05T11:38:52.823 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.821+0000 7f8b43611880 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:dff27d1e-df33-400e-a68a-7ba586947c99.4604.8 from cache 2023-10-05T11:38:52.823 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.821+0000 7f8b43611880 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-simple.1:dff27d1e-df33-400e-a68a-7ba586947c99.4604.8, ofs0, ns] 2023-10-05T11:38:52.824 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.821+0000 7f8b3a283640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1052266987552 cookie 93967125620736 notifier 5864 bl.length()=240 2023-10-05T11:38:52.828 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.825+0000 7f8b43611880 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/dff27d1e-df33-400e-a68a-7ba586947c99.4604.8 : miss 2023-10-05T11:38:52.828 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.825+0000 7f8b43611880 20 rados->read ofs=0 len=0 2023-10-05T11:38:52.828 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.826+0000 7f8b43611880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:38:52.829 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.826+0000 7f8b43611880 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/dff27d1e-df33-400e-a68a-7ba586947c99.4604.8 info.flags=0x0 2023-10-05T11:38:52.829 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.826+0000 7f8b43611880 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/dff27d1e-df33-400e-a68a-7ba586947c99.4604.8 to cache LRU end 2023-10-05T11:38:52.829 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.826+0000 7f8b43611880 10 removing default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/dff27d1e-df33-400e-a68a-7ba586947c99.4604.8 from cache 2023-10-05T11:38:52.829 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.826+0000 7f8b43611880 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.log:pubsub..bucket.test-client.0-r-test-multipart-simple.1/dff27d1e-df33-400e-a68a-7ba586947c99.4604.8, ofs0, ns] 2023-10-05T11:38:52.829 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.826+0000 7f8b3a283640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1052266987530 cookie 93967125754880 notifier 5864 bl.length()=237 2023-10-05T11:38:52.832 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.830+0000 7f8b43611880 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:dff27d1e-df33-400e-a68a-7ba586947c99.4604.14 : miss 2023-10-05T11:38:52.832 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.830+0000 7f8b43611880 20 rados->read ofs=0 len=0 2023-10-05T11:38:52.833 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.830+0000 7f8b43611880 20 rados_obj.operate() r=0 bl.length=407 2023-10-05T11:38:52.833 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.830+0000 7f8b43611880 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:dff27d1e-df33-400e-a68a-7ba586947c99.4604.14 info.flags=0x17 2023-10-05T11:38:52.833 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.830+0000 7f8b43611880 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:dff27d1e-df33-400e-a68a-7ba586947c99.4604.14 to cache LRU end 2023-10-05T11:38:52.833 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.830+0000 7f8b43611880 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T11:38:52.833 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.830+0000 7f8b43611880 10 updating xattr: name=user.rgw.acl bl.length()=209 2023-10-05T11:38:52.833 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.830+0000 7f8b43611880 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:dff27d1e-df33-400e-a68a-7ba586947c99.4604.14 2023-10-05T11:38:52.834 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.830+0000 7f8b43611880 10 cls_bucket_list_unordered: got foo-STANDARD-LUKEWARM 2023-10-05T11:38:52.834 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.831+0000 7f8b43611880 10 cls_bucket_list_unordered: got foo-LUKEWARM-STANDARD 2023-10-05T11:38:52.834 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.832+0000 7f8b43611880 10 cls_bucket_list_unordered: got foo-FROZEN 2023-10-05T11:38:52.835 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.833+0000 7f8b43611880 10 cls_bucket_list_unordered: got foo-FROZEN-LUKEWARM 2023-10-05T11:38:52.835 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.833+0000 7f8b43611880 10 cls_bucket_list_unordered: got foo-LUKEWARM-FROZEN 2023-10-05T11:38:52.835 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.833+0000 7f8b43611880 10 cls_bucket_list_unordered: got foo-STANDARD 2023-10-05T11:38:52.836 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.833+0000 7f8b43611880 10 cls_bucket_list_unordered: got foo-FROZEN-STANDARD 2023-10-05T11:38:52.836 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.833+0000 7f8b43611880 10 cls_bucket_list_unordered: got foo-LUKEWARM 2023-10-05T11:38:52.836 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.833+0000 7f8b43611880 10 cls_bucket_list_unordered: got foo-STANDARD-STANDARD 2023-10-05T11:38:52.836 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.834+0000 7f8b43611880 10 cls_bucket_list_unordered: got foo-LUKEWARM-LUKEWARM 2023-10-05T11:38:52.836 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.834+0000 7f8b43611880 10 cls_bucket_list_unordered: got foo-STANDARD-FROZEN 2023-10-05T11:38:52.836 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.834+0000 7f8b43611880 10 cls_bucket_list_unordered: got foo-FROZEN-FROZEN 2023-10-05T11:38:52.837 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.834+0000 7f8b43611880 20 get_obj_state: rctx=0x55766dc9a9a0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-LUKEWARM state=0x55766d3d61e8 s->prefetch_data=0 2023-10-05T11:38:52.837 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.835+0000 7f8b43611880 10 manifest: total_size = 2044 2023-10-05T11:38:52.837 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.835+0000 7f8b43611880 20 get_obj_state: setting s->obj_tag to _DiWw2L8RwfKYlUyIKD1ENDtorXgxaJ5 2023-10-05T11:38:52.837 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.835+0000 7f8b43611880 20 get_obj_state: rctx=0x55766dc9a9a0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-LUKEWARM state=0x55766d3d61e8 s->prefetch_data=0 2023-10-05T11:38:52.837 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.835+0000 7f8b43611880 20 prepare_atomic_modification: state is not atomic. state=0x55766d3d61e8 2023-10-05T11:38:52.838 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.835+0000 7f8b43611880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.14.0 2023-10-05T11:38:52.840 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.837+0000 7f8b43611880 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-10-05T11:38:52.840 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.837+0000 7f8b43611880 20 RGWObjManifest::operator++(): result: ofs=2044 stripe_ofs=2044 part_ofs=0 rule->part_size=0 2023-10-05T11:38:52.840 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.837+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - tag is: _DiWw2L8RwfKYlUyIKD1ENDtorXgxaJ5 2023-10-05T11:38:52.840 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.837+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2023-10-05T11:38:52.840 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.837+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dff27d1e-df33-400e-a68a-7ba586947c99.4604.14__shadow_.9XEY8ur8KKyfH6FShXE5bXwoo3r962d_0 2023-10-05T11:38:52.840 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.837+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2023-10-05T11:38:52.840 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.837+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2023-10-05T11:38:52.840 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.837+0000 7f8b43611880 20 garbage collection: RGWGC::send_chain - on object name: gc.6tag is: _DiWw2L8RwfKYlUyIKD1ENDtorXgxaJ5 2023-10-05T11:38:52.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.839+0000 7f8b39a82640 20 handle_completion(): completion ok for obj=foo-STANDARD-LUKEWARM 2023-10-05T11:38:52.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.839+0000 7f8b43611880 20 get_obj_state: rctx=0x55766dc9a9a0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-STANDARD state=0x55766d3d61e8 s->prefetch_data=0 2023-10-05T11:38:52.842 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.839+0000 7f8b43611880 10 manifest: total_size = 5242880 2023-10-05T11:38:52.842 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.839+0000 7f8b43611880 20 get_obj_state: setting s->obj_tag to _HQSma6SM2uypwga__GOdLEn7BDq_Rn2 2023-10-05T11:38:52.842 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.839+0000 7f8b43611880 20 get_obj_state: rctx=0x55766dc9a9a0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-STANDARD state=0x55766d3d61e8 s->prefetch_data=0 2023-10-05T11:38:52.842 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.839+0000 7f8b43611880 20 prepare_atomic_modification: state is not atomic. state=0x55766d3d61e8 2023-10-05T11:38:52.842 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.839+0000 7f8b43611880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.14.2 2023-10-05T11:38:52.844 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.842+0000 7f8b43611880 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-10-05T11:38:52.844 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.842+0000 7f8b43611880 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=0 2023-10-05T11:38:52.844 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.842+0000 7f8b43611880 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-10-05T11:38:52.844 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.842+0000 7f8b43611880 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2023-10-05T11:38:52.844 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.842+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - tag is: _HQSma6SM2uypwga__GOdLEn7BDq_Rn2 2023-10-05T11:38:52.844 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.842+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2023-10-05T11:38:52.845 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.842+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dff27d1e-df33-400e-a68a-7ba586947c99.4604.14__shadow_.zeE-ECM8IyFGpwrhLUFbbvzd3f0dUSR_0 2023-10-05T11:38:52.845 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.842+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2023-10-05T11:38:52.845 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.842+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dff27d1e-df33-400e-a68a-7ba586947c99.4604.14__shadow_.zeE-ECM8IyFGpwrhLUFbbvzd3f0dUSR_1 2023-10-05T11:38:52.845 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.842+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 531 2023-10-05T11:38:52.845 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.842+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2023-10-05T11:38:52.845 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.842+0000 7f8b43611880 20 garbage collection: RGWGC::send_chain - on object name: gc.11tag is: _HQSma6SM2uypwga__GOdLEn7BDq_Rn2 2023-10-05T11:38:52.846 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.843+0000 7f8b3a283640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-STANDARD 2023-10-05T11:38:52.846 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.843+0000 7f8b43611880 20 get_obj_state: rctx=0x55766dc9a9a0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN state=0x55766d3d61e8 s->prefetch_data=0 2023-10-05T11:38:52.846 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.843+0000 7f8b43611880 10 manifest: total_size = 5242880 2023-10-05T11:38:52.846 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.843+0000 7f8b43611880 20 get_obj_state: setting s->obj_tag to dff27d1e-df33-400e-a68a-7ba586947c99.4543.5847751018704817253 2023-10-05T11:38:52.846 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.843+0000 7f8b43611880 20 get_obj_state: rctx=0x55766dc9a9a0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN state=0x55766d3d61e8 s->prefetch_data=0 2023-10-05T11:38:52.846 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.843+0000 7f8b43611880 20 prepare_atomic_modification: state is not atomic. state=0x55766d3d61e8 2023-10-05T11:38:52.846 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.843+0000 7f8b43611880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.14.3 2023-10-05T11:38:52.848 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.846+0000 7f8b43611880 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-10-05T11:38:52.848 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.846+0000 7f8b43611880 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=0 2023-10-05T11:38:52.848 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.846+0000 7f8b43611880 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-10-05T11:38:52.848 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.846+0000 7f8b43611880 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2023-10-05T11:38:52.848 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.846+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - tag is: dff27d1e-df33-400e-a68a-7ba586947c99.4543.5847751018704817253 2023-10-05T11:38:52.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.846+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2023-10-05T11:38:52.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.846+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dff27d1e-df33-400e-a68a-7ba586947c99.4604.14__shadow_.A01jg9hrnSBp5OelmISDJjqxFt9CZMV_0 2023-10-05T11:38:52.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.846+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 337 2023-10-05T11:38:52.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.846+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dff27d1e-df33-400e-a68a-7ba586947c99.4604.14__shadow_.A01jg9hrnSBp5OelmISDJjqxFt9CZMV_1 2023-10-05T11:38:52.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.846+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 574 2023-10-05T11:38:52.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.846+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2023-10-05T11:38:52.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.846+0000 7f8b43611880 20 garbage collection: RGWGC::send_chain - on object name: gc.0tag is: dff27d1e-df33-400e-a68a-7ba586947c99.4543.5847751018704817253 2023-10-05T11:38:52.850 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.847+0000 7f8b39a82640 20 handle_completion(): completion ok for obj=foo-FROZEN 2023-10-05T11:38:52.850 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.847+0000 7f8b43611880 20 get_obj_state: rctx=0x55766dc9a9a0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-LUKEWARM state=0x55766d3d61e8 s->prefetch_data=0 2023-10-05T11:38:52.850 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.847+0000 7f8b43611880 10 manifest: total_size = 5242880 2023-10-05T11:38:52.850 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.847+0000 7f8b43611880 20 get_obj_state: setting s->obj_tag to _-j4Aoxt6p3zCfpEDUK6-wsKVzoI9xLW 2023-10-05T11:38:52.850 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.847+0000 7f8b43611880 20 get_obj_state: rctx=0x55766dc9a9a0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-LUKEWARM state=0x55766d3d61e8 s->prefetch_data=0 2023-10-05T11:38:52.850 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.847+0000 7f8b43611880 20 prepare_atomic_modification: state is not atomic. state=0x55766d3d61e8 2023-10-05T11:38:52.850 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.847+0000 7f8b43611880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.14.5 2023-10-05T11:38:52.852 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.850+0000 7f8b43611880 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-10-05T11:38:52.852 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.850+0000 7f8b43611880 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=0 2023-10-05T11:38:52.853 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.850+0000 7f8b43611880 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-10-05T11:38:52.853 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.850+0000 7f8b43611880 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2023-10-05T11:38:52.853 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.850+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - tag is: _-j4Aoxt6p3zCfpEDUK6-wsKVzoI9xLW 2023-10-05T11:38:52.853 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.850+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2023-10-05T11:38:52.853 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.850+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dff27d1e-df33-400e-a68a-7ba586947c99.4604.14__shadow_.w-0vcCicg4YWoMDAiJCyGv404RW_vxg_0 2023-10-05T11:38:52.853 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.850+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2023-10-05T11:38:52.853 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.850+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dff27d1e-df33-400e-a68a-7ba586947c99.4604.14__shadow_.w-0vcCicg4YWoMDAiJCyGv404RW_vxg_1 2023-10-05T11:38:52.853 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.850+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 549 2023-10-05T11:38:52.853 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.850+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2023-10-05T11:38:52.853 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.850+0000 7f8b43611880 20 garbage collection: RGWGC::send_chain - on object name: gc.8tag is: _-j4Aoxt6p3zCfpEDUK6-wsKVzoI9xLW 2023-10-05T11:38:52.854 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.851+0000 7f8b3a283640 20 handle_completion(): completion ok for obj=foo-FROZEN-LUKEWARM 2023-10-05T11:38:52.854 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.851+0000 7f8b43611880 20 get_obj_state: rctx=0x55766dc9a9a0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-FROZEN state=0x55766d3d61e8 s->prefetch_data=0 2023-10-05T11:38:52.854 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.852+0000 7f8b43611880 10 manifest: total_size = 5242880 2023-10-05T11:38:52.854 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.852+0000 7f8b43611880 20 get_obj_state: setting s->obj_tag to _k8x9CeOeN49Akmu-Sxt9nge5HUNWveh 2023-10-05T11:38:52.854 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.852+0000 7f8b43611880 20 get_obj_state: rctx=0x55766dc9a9a0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-FROZEN state=0x55766d3d61e8 s->prefetch_data=0 2023-10-05T11:38:52.854 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.852+0000 7f8b43611880 20 prepare_atomic_modification: state is not atomic. state=0x55766d3d61e8 2023-10-05T11:38:52.855 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.852+0000 7f8b43611880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.14.5 2023-10-05T11:38:52.857 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.854+0000 7f8b43611880 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-10-05T11:38:52.857 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.854+0000 7f8b43611880 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=0 2023-10-05T11:38:52.857 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.854+0000 7f8b43611880 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-10-05T11:38:52.857 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.854+0000 7f8b43611880 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2023-10-05T11:38:52.857 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.854+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - tag is: _k8x9CeOeN49Akmu-Sxt9nge5HUNWveh 2023-10-05T11:38:52.857 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.854+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2023-10-05T11:38:52.857 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.854+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dff27d1e-df33-400e-a68a-7ba586947c99.4604.14__shadow_.GU4sVdNGzLYSCcY_JuxWSV6D5zpltGY_0 2023-10-05T11:38:52.857 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.854+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2023-10-05T11:38:52.857 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.854+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dff27d1e-df33-400e-a68a-7ba586947c99.4604.14__shadow_.GU4sVdNGzLYSCcY_JuxWSV6D5zpltGY_1 2023-10-05T11:38:52.857 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.854+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 545 2023-10-05T11:38:52.858 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.854+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2023-10-05T11:38:52.858 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.854+0000 7f8b43611880 20 garbage collection: RGWGC::send_chain - on object name: gc.22tag is: _k8x9CeOeN49Akmu-Sxt9nge5HUNWveh 2023-10-05T11:38:52.858 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.855+0000 7f8b39a82640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-FROZEN 2023-10-05T11:38:52.858 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.855+0000 7f8b43611880 20 get_obj_state: rctx=0x55766dc9a9a0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD state=0x55766d3d61e8 s->prefetch_data=0 2023-10-05T11:38:52.859 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.856+0000 7f8b43611880 10 manifest: total_size = 2044 2023-10-05T11:38:52.859 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.856+0000 7f8b43611880 20 get_obj_state: setting s->obj_tag to dff27d1e-df33-400e-a68a-7ba586947c99.4543.7629049515416214585 2023-10-05T11:38:52.859 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.856+0000 7f8b43611880 20 get_obj_state: rctx=0x55766dc9a9a0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD state=0x55766d3d61e8 s->prefetch_data=0 2023-10-05T11:38:52.859 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.856+0000 7f8b43611880 20 prepare_atomic_modification: state is not atomic. state=0x55766d3d61e8 2023-10-05T11:38:52.859 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.856+0000 7f8b43611880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.14.5 2023-10-05T11:38:52.861 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.858+0000 7f8b43611880 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-10-05T11:38:52.861 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.858+0000 7f8b43611880 20 RGWObjManifest::operator++(): result: ofs=2044 stripe_ofs=2044 part_ofs=0 rule->part_size=0 2023-10-05T11:38:52.861 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.858+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - tag is: dff27d1e-df33-400e-a68a-7ba586947c99.4543.7629049515416214585 2023-10-05T11:38:52.861 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.858+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2023-10-05T11:38:52.862 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.858+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dff27d1e-df33-400e-a68a-7ba586947c99.4604.14__shadow_.GI4GSSKuf5EYhZ2Rl_eVZ8rQ9pvybAv_0 2023-10-05T11:38:52.862 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.858+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 330 2023-10-05T11:38:52.862 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.858+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2023-10-05T11:38:52.862 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.858+0000 7f8b43611880 20 garbage collection: RGWGC::send_chain - on object name: gc.26tag is: dff27d1e-df33-400e-a68a-7ba586947c99.4543.7629049515416214585 2023-10-05T11:38:52.862 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.860+0000 7f8b3a283640 20 handle_completion(): completion ok for obj=foo-STANDARD 2023-10-05T11:38:52.863 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.860+0000 7f8b43611880 20 get_obj_state: rctx=0x55766dc9a9a0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-STANDARD state=0x55766d3d61e8 s->prefetch_data=0 2023-10-05T11:38:52.863 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.860+0000 7f8b43611880 10 manifest: total_size = 5242880 2023-10-05T11:38:52.863 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.860+0000 7f8b43611880 20 get_obj_state: setting s->obj_tag to _ZaloqTWiiNZfhWKTOROzncyDjjochVp 2023-10-05T11:38:52.863 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.860+0000 7f8b43611880 20 get_obj_state: rctx=0x55766dc9a9a0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-STANDARD state=0x55766d3d61e8 s->prefetch_data=0 2023-10-05T11:38:52.863 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.860+0000 7f8b43611880 20 prepare_atomic_modification: state is not atomic. state=0x55766d3d61e8 2023-10-05T11:38:52.863 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.860+0000 7f8b43611880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.14.7 2023-10-05T11:38:52.865 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.862+0000 7f8b43611880 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-10-05T11:38:52.865 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.862+0000 7f8b43611880 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=0 2023-10-05T11:38:52.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.862+0000 7f8b43611880 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-10-05T11:38:52.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.862+0000 7f8b43611880 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2023-10-05T11:38:52.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.862+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - tag is: _ZaloqTWiiNZfhWKTOROzncyDjjochVp 2023-10-05T11:38:52.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.862+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2023-10-05T11:38:52.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.862+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dff27d1e-df33-400e-a68a-7ba586947c99.4604.14__shadow_.BCKTSxlLhFi9Uofx1pUj-Bwwu4lLHI6_0 2023-10-05T11:38:52.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.862+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2023-10-05T11:38:52.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.862+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dff27d1e-df33-400e-a68a-7ba586947c99.4604.14__shadow_.BCKTSxlLhFi9Uofx1pUj-Bwwu4lLHI6_1 2023-10-05T11:38:52.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.862+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 531 2023-10-05T11:38:52.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.862+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2023-10-05T11:38:52.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.863+0000 7f8b43611880 20 garbage collection: RGWGC::send_chain - on object name: gc.4tag is: _ZaloqTWiiNZfhWKTOROzncyDjjochVp 2023-10-05T11:38:52.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.864+0000 7f8b43611880 20 get_obj_state: rctx=0x55766dc9a9a0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM state=0x55766d3d61e8 s->prefetch_data=0 2023-10-05T11:38:52.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.864+0000 7f8b39a82640 20 handle_completion(): completion ok for obj=foo-FROZEN-STANDARD 2023-10-05T11:38:52.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.864+0000 7f8b43611880 10 manifest: total_size = 5242880 2023-10-05T11:38:52.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.864+0000 7f8b43611880 20 get_obj_state: setting s->obj_tag to dff27d1e-df33-400e-a68a-7ba586947c99.4543.4615129885446632945 2023-10-05T11:38:52.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.864+0000 7f8b43611880 20 get_obj_state: rctx=0x55766dc9a9a0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM state=0x55766d3d61e8 s->prefetch_data=0 2023-10-05T11:38:52.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.864+0000 7f8b43611880 20 prepare_atomic_modification: state is not atomic. state=0x55766d3d61e8 2023-10-05T11:38:52.868 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.864+0000 7f8b43611880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.14.7 2023-10-05T11:38:52.869 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.867+0000 7f8b43611880 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-10-05T11:38:52.869 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.867+0000 7f8b43611880 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=0 2023-10-05T11:38:52.869 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.867+0000 7f8b43611880 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-10-05T11:38:52.869 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.867+0000 7f8b43611880 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2023-10-05T11:38:52.869 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.867+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - tag is: dff27d1e-df33-400e-a68a-7ba586947c99.4543.4615129885446632945 2023-10-05T11:38:52.870 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.867+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2023-10-05T11:38:52.870 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.867+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dff27d1e-df33-400e-a68a-7ba586947c99.4604.14__shadow_.HyTHayXxfVUkBdzTN6BAiFUTiwqOuzV_0 2023-10-05T11:38:52.870 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.867+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 339 2023-10-05T11:38:52.870 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.867+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dff27d1e-df33-400e-a68a-7ba586947c99.4604.14__shadow_.HyTHayXxfVUkBdzTN6BAiFUTiwqOuzV_1 2023-10-05T11:38:52.870 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.867+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 578 2023-10-05T11:38:52.870 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.867+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2023-10-05T11:38:52.870 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.867+0000 7f8b43611880 20 garbage collection: RGWGC::send_chain - on object name: gc.9tag is: dff27d1e-df33-400e-a68a-7ba586947c99.4543.4615129885446632945 2023-10-05T11:38:52.871 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.868+0000 7f8b3a283640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2023-10-05T11:38:52.871 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.868+0000 7f8b43611880 20 get_obj_state: rctx=0x55766dc9a9a0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-STANDARD state=0x55766d3d61e8 s->prefetch_data=0 2023-10-05T11:38:52.871 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.868+0000 7f8b43611880 10 manifest: total_size = 2044 2023-10-05T11:38:52.871 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.868+0000 7f8b43611880 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-10-05T11:38:52.871 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.868+0000 7f8b43611880 20 RGWObjManifest::operator++(): result: ofs=2044 stripe_ofs=2044 part_ofs=0 rule->part_size=0 2023-10-05T11:38:52.871 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.868+0000 7f8b43611880 10 generate_fake_tag new tag=dff27d1e-df33-400e-a68a-7ba586947c99.4604.14__shadow_.GI4GSSKuf5EYhZ2Rl_eVZ8rQ9pvybAv_1_d085f501e0d8b997692cb3c2b8961949 2023-10-05T11:38:52.872 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.868+0000 7f8b43611880 20 get_obj_state: setting s->obj_tag to dff27d1e-df33-400e-a68a-7ba586947c99.4604.14__shadow_.GI4GSSKuf5EYhZ2Rl_eVZ8rQ9pvybAv_1_d085f501e0d8b997692cb3c2b8961949 2023-10-05T11:38:52.872 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.868+0000 7f8b43611880 20 get_obj_state: rctx=0x55766dc9a9a0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-STANDARD state=0x55766d3d61e8 s->prefetch_data=0 2023-10-05T11:38:52.872 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.868+0000 7f8b43611880 20 prepare_atomic_modification: state is not atomic. state=0x55766d3d61e8 2023-10-05T11:38:52.872 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.868+0000 7f8b43611880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.14.7 2023-10-05T11:38:52.873 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.871+0000 7f8b43611880 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-10-05T11:38:52.873 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.871+0000 7f8b43611880 20 RGWObjManifest::operator++(): result: ofs=2044 stripe_ofs=2044 part_ofs=0 rule->part_size=0 2023-10-05T11:38:52.873 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.871+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - tag is: dff27d1e-df33-400e-a68a-7ba586947c99.4604.14__shadow_.GI4GSSKuf5EYhZ2Rl_eVZ8rQ9pvybAv_1_d085f501e0d8b997692cb3c2b8961949 2023-10-05T11:38:52.873 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.871+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2023-10-05T11:38:52.873 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.871+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dff27d1e-df33-400e-a68a-7ba586947c99.4604.14__shadow_.GI4GSSKuf5EYhZ2Rl_eVZ8rQ9pvybAv_0 2023-10-05T11:38:52.873 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.871+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 389 2023-10-05T11:38:52.874 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.871+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2023-10-05T11:38:52.874 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.871+0000 7f8b43611880 20 garbage collection: RGWGC::send_chain - on object name: gc.18tag is: dff27d1e-df33-400e-a68a-7ba586947c99.4604.14__shadow_.GI4GSSKuf5EYhZ2Rl_eVZ8rQ9pvybAv_1_d085f501e0d8b997692cb3c2b8961949 2023-10-05T11:38:52.874 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.872+0000 7f8b39a82640 20 handle_completion(): completion ok for obj=foo-STANDARD-STANDARD 2023-10-05T11:38:52.874 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.872+0000 7f8b43611880 20 get_obj_state: rctx=0x55766dc9a9a0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-LUKEWARM state=0x55766d3d61e8 s->prefetch_data=0 2023-10-05T11:38:52.875 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.872+0000 7f8b43611880 10 manifest: total_size = 5242880 2023-10-05T11:38:52.875 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.872+0000 7f8b43611880 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-10-05T11:38:52.875 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.872+0000 7f8b43611880 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=0 2023-10-05T11:38:52.875 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.872+0000 7f8b43611880 10 generate_fake_tag new tag=dff27d1e-df33-400e-a68a-7ba586947c99.4604.14__shadow_.HyTHayXxfVUkBdzTN6BAiFUTiwqOuzV_1_6423ab5c67962c460ecfbf63d8917aea 2023-10-05T11:38:52.875 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.872+0000 7f8b43611880 20 get_obj_state: setting s->obj_tag to dff27d1e-df33-400e-a68a-7ba586947c99.4604.14__shadow_.HyTHayXxfVUkBdzTN6BAiFUTiwqOuzV_1_6423ab5c67962c460ecfbf63d8917aea 2023-10-05T11:38:52.875 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.872+0000 7f8b43611880 20 get_obj_state: rctx=0x55766dc9a9a0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-LUKEWARM state=0x55766d3d61e8 s->prefetch_data=0 2023-10-05T11:38:52.876 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.872+0000 7f8b43611880 20 prepare_atomic_modification: state is not atomic. state=0x55766d3d61e8 2023-10-05T11:38:52.876 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.872+0000 7f8b43611880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.14.8 2023-10-05T11:38:52.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.875+0000 7f8b43611880 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-10-05T11:38:52.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.875+0000 7f8b43611880 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=0 2023-10-05T11:38:52.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.875+0000 7f8b43611880 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-10-05T11:38:52.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.875+0000 7f8b43611880 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2023-10-05T11:38:52.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.875+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - tag is: dff27d1e-df33-400e-a68a-7ba586947c99.4604.14__shadow_.HyTHayXxfVUkBdzTN6BAiFUTiwqOuzV_1_6423ab5c67962c460ecfbf63d8917aea 2023-10-05T11:38:52.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.875+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2023-10-05T11:38:52.878 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.875+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dff27d1e-df33-400e-a68a-7ba586947c99.4604.14__shadow_.HyTHayXxfVUkBdzTN6BAiFUTiwqOuzV_0 2023-10-05T11:38:52.878 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.875+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 398 2023-10-05T11:38:52.878 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.875+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dff27d1e-df33-400e-a68a-7ba586947c99.4604.14__shadow_.HyTHayXxfVUkBdzTN6BAiFUTiwqOuzV_1 2023-10-05T11:38:52.878 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.875+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 637 2023-10-05T11:38:52.878 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.875+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2023-10-05T11:38:52.878 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.875+0000 7f8b43611880 20 garbage collection: RGWGC::send_chain - on object name: gc.14tag is: dff27d1e-df33-400e-a68a-7ba586947c99.4604.14__shadow_.HyTHayXxfVUkBdzTN6BAiFUTiwqOuzV_1_6423ab5c67962c460ecfbf63d8917aea 2023-10-05T11:38:52.879 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.876+0000 7f8b3a283640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-LUKEWARM 2023-10-05T11:38:52.879 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.876+0000 7f8b43611880 20 get_obj_state: rctx=0x55766dc9a9a0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-FROZEN state=0x55766d3d61e8 s->prefetch_data=0 2023-10-05T11:38:52.879 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.876+0000 7f8b43611880 10 manifest: total_size = 2044 2023-10-05T11:38:52.879 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.876+0000 7f8b43611880 20 get_obj_state: setting s->obj_tag to _NuyELYtsflu2FhWFXnU3geAk6v97wm7 2023-10-05T11:38:52.879 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.876+0000 7f8b43611880 20 get_obj_state: rctx=0x55766dc9a9a0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-FROZEN state=0x55766d3d61e8 s->prefetch_data=0 2023-10-05T11:38:52.879 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.876+0000 7f8b43611880 20 prepare_atomic_modification: state is not atomic. state=0x55766d3d61e8 2023-10-05T11:38:52.880 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.876+0000 7f8b43611880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.14.8 2023-10-05T11:38:52.881 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.879+0000 7f8b43611880 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-10-05T11:38:52.881 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.879+0000 7f8b43611880 20 RGWObjManifest::operator++(): result: ofs=2044 stripe_ofs=2044 part_ofs=0 rule->part_size=0 2023-10-05T11:38:52.881 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.879+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - tag is: _NuyELYtsflu2FhWFXnU3geAk6v97wm7 2023-10-05T11:38:52.881 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.879+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2023-10-05T11:38:52.881 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.879+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dff27d1e-df33-400e-a68a-7ba586947c99.4604.14__shadow_.jlY4YeqRkB8slVYN8tQ4WN9-0lMH8bh_0 2023-10-05T11:38:52.881 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.879+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2023-10-05T11:38:52.882 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.879+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2023-10-05T11:38:52.882 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.879+0000 7f8b43611880 20 garbage collection: RGWGC::send_chain - on object name: gc.22tag is: _NuyELYtsflu2FhWFXnU3geAk6v97wm7 2023-10-05T11:38:52.882 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.880+0000 7f8b39a82640 20 handle_completion(): completion ok for obj=foo-STANDARD-FROZEN 2023-10-05T11:38:52.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.880+0000 7f8b43611880 20 get_obj_state: rctx=0x55766dc9a9a0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-FROZEN state=0x55766d3d61e8 s->prefetch_data=0 2023-10-05T11:38:52.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.880+0000 7f8b43611880 10 manifest: total_size = 5242880 2023-10-05T11:38:52.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.880+0000 7f8b43611880 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-10-05T11:38:52.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.880+0000 7f8b43611880 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=0 2023-10-05T11:38:52.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.880+0000 7f8b43611880 10 generate_fake_tag new tag=dff27d1e-df33-400e-a68a-7ba586947c99.4604.14__shadow_.A01jg9hrnSBp5OelmISDJjqxFt9CZMV_1_caf3f594d83f21f6d6c11df66e14cc59 2023-10-05T11:38:52.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.880+0000 7f8b43611880 20 get_obj_state: setting s->obj_tag to dff27d1e-df33-400e-a68a-7ba586947c99.4604.14__shadow_.A01jg9hrnSBp5OelmISDJjqxFt9CZMV_1_caf3f594d83f21f6d6c11df66e14cc59 2023-10-05T11:38:52.884 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.880+0000 7f8b43611880 20 get_obj_state: rctx=0x55766dc9a9a0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-FROZEN state=0x55766d3d61e8 s->prefetch_data=0 2023-10-05T11:38:52.884 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.880+0000 7f8b43611880 20 prepare_atomic_modification: state is not atomic. state=0x55766d3d61e8 2023-10-05T11:38:52.884 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.880+0000 7f8b43611880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.14.9 2023-10-05T11:38:52.885 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.883+0000 7f8b43611880 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-10-05T11:38:52.885 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.883+0000 7f8b43611880 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=0 2023-10-05T11:38:52.885 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.883+0000 7f8b43611880 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-10-05T11:38:52.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.883+0000 7f8b43611880 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2023-10-05T11:38:52.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.883+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - tag is: dff27d1e-df33-400e-a68a-7ba586947c99.4604.14__shadow_.A01jg9hrnSBp5OelmISDJjqxFt9CZMV_1_caf3f594d83f21f6d6c11df66e14cc59 2023-10-05T11:38:52.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.883+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2023-10-05T11:38:52.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.883+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dff27d1e-df33-400e-a68a-7ba586947c99.4604.14__shadow_.A01jg9hrnSBp5OelmISDJjqxFt9CZMV_0 2023-10-05T11:38:52.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.883+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 396 2023-10-05T11:38:52.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.883+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dff27d1e-df33-400e-a68a-7ba586947c99.4604.14__shadow_.A01jg9hrnSBp5OelmISDJjqxFt9CZMV_1 2023-10-05T11:38:52.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.883+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 633 2023-10-05T11:38:52.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.883+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2023-10-05T11:38:52.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.883+0000 7f8b43611880 20 garbage collection: RGWGC::send_chain - on object name: gc.4tag is: dff27d1e-df33-400e-a68a-7ba586947c99.4604.14__shadow_.A01jg9hrnSBp5OelmISDJjqxFt9CZMV_1_caf3f594d83f21f6d6c11df66e14cc59 2023-10-05T11:38:52.887 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.884+0000 7f8b3a283640 20 handle_completion(): completion ok for obj=foo-FROZEN-FROZEN 2023-10-05T11:38:52.887 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.884+0000 7f8b43611880 20 list_objects_ordered: starting attempt 1 2023-10-05T11:38:52.887 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.884+0000 7f8b43611880 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2023-10-05T11:38:52.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.885+0000 7f8b43611880 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2023-10-05T11:38:52.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.885+0000 7f8b43611880 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2023-10-05T11:38:52.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.885+0000 7f8b43611880 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2023-10-05T11:38:52.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.885+0000 7f8b43611880 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2023-10-05T11:38:52.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.885+0000 7f8b43611880 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-copy.1[dff27d1e-df33-400e-a68a-7ba586947c99.4604.14])"; uploads.size()=0; is_truncated=0 2023-10-05T11:38:52.889 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.887+0000 7f8b43611880 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 : miss 2023-10-05T11:38:52.889 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.887+0000 7f8b43611880 20 rados->read ofs=0 len=0 2023-10-05T11:38:52.890 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.888+0000 7f8b43611880 20 rados_obj.operate() r=0 bl.length=233 2023-10-05T11:38:52.890 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.888+0000 7f8b43611880 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x11 2023-10-05T11:38:52.890 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.888+0000 7f8b43611880 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2023-10-05T11:38:52.890 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.888+0000 7f8b43611880 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 from cache 2023-10-05T11:38:52.891 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.888+0000 7f8b43611880 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-copy.1, ofs0, ns] 2023-10-05T11:38:52.891 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.888+0000 7f8b3a283640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1052266987562 cookie 93967125622784 notifier 5864 bl.length()=189 2023-10-05T11:38:52.893 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.890+0000 7f8b43611880 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:dff27d1e-df33-400e-a68a-7ba586947c99.4604.14 from cache 2023-10-05T11:38:52.893 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.890+0000 7f8b43611880 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:dff27d1e-df33-400e-a68a-7ba586947c99.4604.14, ofs0, ns] 2023-10-05T11:38:52.893 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.891+0000 7f8b3a283640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1052266987580 cookie 93967125623808 notifier 5864 bl.length()=247 2023-10-05T11:38:52.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.895+0000 7f8b43611880 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/dff27d1e-df33-400e-a68a-7ba586947c99.4604.14 : miss 2023-10-05T11:38:52.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.895+0000 7f8b43611880 20 rados->read ofs=0 len=0 2023-10-05T11:38:52.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.896+0000 7f8b43611880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:38:52.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.896+0000 7f8b43611880 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/dff27d1e-df33-400e-a68a-7ba586947c99.4604.14 info.flags=0x0 2023-10-05T11:38:52.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.896+0000 7f8b43611880 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/dff27d1e-df33-400e-a68a-7ba586947c99.4604.14 to cache LRU end 2023-10-05T11:38:52.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.896+0000 7f8b43611880 10 removing default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/dff27d1e-df33-400e-a68a-7ba586947c99.4604.14 from cache 2023-10-05T11:38:52.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.896+0000 7f8b43611880 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.log:pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/dff27d1e-df33-400e-a68a-7ba586947c99.4604.14, ofs0, ns] 2023-10-05T11:38:52.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.896+0000 7f8b3a283640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1052266987553 cookie 93967125620736 notifier 5864 bl.length()=244 2023-10-05T11:38:52.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.900+0000 7f8b43611880 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:dff27d1e-df33-400e-a68a-7ba586947c99.4604.15 : miss 2023-10-05T11:38:52.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.900+0000 7f8b43611880 20 rados->read ofs=0 len=0 2023-10-05T11:38:52.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.900+0000 7f8b43611880 20 rados_obj.operate() r=0 bl.length=417 2023-10-05T11:38:52.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.900+0000 7f8b43611880 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:dff27d1e-df33-400e-a68a-7ba586947c99.4604.15 info.flags=0x17 2023-10-05T11:38:52.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.900+0000 7f8b43611880 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:dff27d1e-df33-400e-a68a-7ba586947c99.4604.15 to cache LRU end 2023-10-05T11:38:52.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.900+0000 7f8b43611880 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T11:38:52.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.900+0000 7f8b43611880 10 updating xattr: name=user.rgw.acl bl.length()=209 2023-10-05T11:38:52.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.900+0000 7f8b43611880 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:dff27d1e-df33-400e-a68a-7ba586947c99.4604.15 2023-10-05T11:38:52.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.901+0000 7f8b43611880 10 cls_bucket_list_unordered: got foo-STANDARD-LUKEWARM 2023-10-05T11:38:52.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.901+0000 7f8b43611880 10 cls_bucket_list_unordered: got foo-LUKEWARM-STANDARD 2023-10-05T11:38:52.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.902+0000 7f8b43611880 10 cls_bucket_list_unordered: got foo-FROZEN 2023-10-05T11:38:52.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.902+0000 7f8b43611880 10 cls_bucket_list_unordered: got foo-FROZEN-LUKEWARM 2023-10-05T11:38:52.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.902+0000 7f8b43611880 10 cls_bucket_list_unordered: got foo-LUKEWARM-FROZEN 2023-10-05T11:38:52.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.902+0000 7f8b43611880 10 cls_bucket_list_unordered: got foo-STANDARD 2023-10-05T11:38:52.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.903+0000 7f8b43611880 10 cls_bucket_list_unordered: got foo-FROZEN-STANDARD 2023-10-05T11:38:52.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.903+0000 7f8b43611880 10 cls_bucket_list_unordered: got foo-LUKEWARM 2023-10-05T11:38:52.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.903+0000 7f8b43611880 10 cls_bucket_list_unordered: got foo-STANDARD-STANDARD 2023-10-05T11:38:52.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.903+0000 7f8b43611880 10 cls_bucket_list_unordered: got foo-LUKEWARM-LUKEWARM 2023-10-05T11:38:52.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.903+0000 7f8b43611880 10 cls_bucket_list_unordered: got foo-STANDARD-FROZEN 2023-10-05T11:38:52.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.904+0000 7f8b43611880 10 cls_bucket_list_unordered: got foo-FROZEN-FROZEN 2023-10-05T11:38:52.907 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.904+0000 7f8b43611880 20 get_obj_state: rctx=0x55766d1c9d50 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-LUKEWARM state=0x55766d3d61e8 s->prefetch_data=0 2023-10-05T11:38:52.907 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.905+0000 7f8b43611880 10 manifest: total_size = 45360 2023-10-05T11:38:52.907 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.905+0000 7f8b43611880 20 get_obj_state: setting s->obj_tag to _omDcfAmZ35MUqfvCZaF7uHioT5uqU7h 2023-10-05T11:38:52.907 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.905+0000 7f8b43611880 20 get_obj_state: rctx=0x55766d1c9d50 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-LUKEWARM state=0x55766d3d61e8 s->prefetch_data=0 2023-10-05T11:38:52.907 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.905+0000 7f8b43611880 20 prepare_atomic_modification: state is not atomic. state=0x55766d3d61e8 2023-10-05T11:38:52.907 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.905+0000 7f8b43611880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.15.0 2023-10-05T11:38:52.909 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.907+0000 7f8b43611880 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-10-05T11:38:52.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.907+0000 7f8b43611880 20 RGWObjManifest::operator++(): result: ofs=45360 stripe_ofs=45360 part_ofs=0 rule->part_size=0 2023-10-05T11:38:52.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.907+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - tag is: _omDcfAmZ35MUqfvCZaF7uHioT5uqU7h 2023-10-05T11:38:52.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.907+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2023-10-05T11:38:52.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.907+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dff27d1e-df33-400e-a68a-7ba586947c99.4604.15__shadow_.iZc5u3NKf4sSRVxP0DtdLz5jEIjKfCd_0 2023-10-05T11:38:52.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.907+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2023-10-05T11:38:52.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.907+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2023-10-05T11:38:52.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.907+0000 7f8b43611880 20 garbage collection: RGWGC::send_chain - on object name: gc.23tag is: _omDcfAmZ35MUqfvCZaF7uHioT5uqU7h 2023-10-05T11:38:52.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.908+0000 7f8b3a283640 20 handle_completion(): completion ok for obj=foo-STANDARD-LUKEWARM 2023-10-05T11:38:52.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.909+0000 7f8b43611880 20 get_obj_state: rctx=0x55766d1c9d50 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-STANDARD state=0x55766d3d61e8 s->prefetch_data=0 2023-10-05T11:38:52.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.909+0000 7f8b43611880 10 manifest: total_size = 11534336 2023-10-05T11:38:52.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.909+0000 7f8b43611880 20 get_obj_state: setting s->obj_tag to _zWVjy7Rak0ddjwUsdfq3FDXdRddGvCM 2023-10-05T11:38:52.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.909+0000 7f8b43611880 20 get_obj_state: rctx=0x55766d1c9d50 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-STANDARD state=0x55766d3d61e8 s->prefetch_data=0 2023-10-05T11:38:52.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.909+0000 7f8b43611880 20 prepare_atomic_modification: state is not atomic. state=0x55766d3d61e8 2023-10-05T11:38:52.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.909+0000 7f8b43611880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.15.2 2023-10-05T11:38:52.914 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.911+0000 7f8b43611880 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-10-05T11:38:52.914 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.911+0000 7f8b43611880 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=0 2023-10-05T11:38:52.914 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.911+0000 7f8b43611880 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-10-05T11:38:52.914 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.911+0000 7f8b43611880 20 RGWObjManifest::operator++(): result: ofs=8380416 stripe_ofs=8380416 part_ofs=0 rule->part_size=0 2023-10-05T11:38:52.914 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.911+0000 7f8b43611880 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-10-05T11:38:52.914 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.911+0000 7f8b43611880 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2023-10-05T11:38:52.914 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.911+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - tag is: _zWVjy7Rak0ddjwUsdfq3FDXdRddGvCM 2023-10-05T11:38:52.914 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.911+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2023-10-05T11:38:52.915 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.911+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dff27d1e-df33-400e-a68a-7ba586947c99.4604.15__shadow_.aacmbLLysPQ497cbvWkpYQEqtSWSywH_0 2023-10-05T11:38:52.915 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.911+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2023-10-05T11:38:52.915 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.911+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dff27d1e-df33-400e-a68a-7ba586947c99.4604.15__shadow_.aacmbLLysPQ497cbvWkpYQEqtSWSywH_1 2023-10-05T11:38:52.915 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.911+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 531 2023-10-05T11:38:52.915 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.911+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dff27d1e-df33-400e-a68a-7ba586947c99.4604.15__shadow_.aacmbLLysPQ497cbvWkpYQEqtSWSywH_2 2023-10-05T11:38:52.915 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.911+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 761 2023-10-05T11:38:52.915 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.911+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2023-10-05T11:38:52.915 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.911+0000 7f8b43611880 20 garbage collection: RGWGC::send_chain - on object name: gc.21tag is: _zWVjy7Rak0ddjwUsdfq3FDXdRddGvCM 2023-10-05T11:38:52.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.913+0000 7f8b39a82640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-STANDARD 2023-10-05T11:38:52.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.913+0000 7f8b43611880 20 get_obj_state: rctx=0x55766d1c9d50 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN state=0x55766d3d61e8 s->prefetch_data=0 2023-10-05T11:38:52.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.913+0000 7f8b43611880 10 manifest: total_size = 11534336 2023-10-05T11:38:52.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.913+0000 7f8b43611880 20 get_obj_state: setting s->obj_tag to dff27d1e-df33-400e-a68a-7ba586947c99.4543.4000609754370304510 2023-10-05T11:38:52.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.913+0000 7f8b43611880 20 get_obj_state: rctx=0x55766d1c9d50 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN state=0x55766d3d61e8 s->prefetch_data=0 2023-10-05T11:38:52.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.913+0000 7f8b43611880 20 prepare_atomic_modification: state is not atomic. state=0x55766d3d61e8 2023-10-05T11:38:52.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.913+0000 7f8b43611880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.15.3 2023-10-05T11:38:52.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.915+0000 7f8b43611880 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2023-10-05T11:38:52.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.915+0000 7f8b43611880 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2023-10-05T11:38:52.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.915+0000 7f8b43611880 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2023-10-05T11:38:52.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.915+0000 7f8b43611880 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2023-10-05T11:38:52.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.915+0000 7f8b43611880 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2023-10-05T11:38:52.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.915+0000 7f8b43611880 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2023-10-05T11:38:52.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.915+0000 7f8b43611880 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2023-10-05T11:38:52.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.915+0000 7f8b43611880 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2023-10-05T11:38:52.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.915+0000 7f8b43611880 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2023-10-05T11:38:52.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.915+0000 7f8b43611880 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2023-10-05T11:38:52.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.915+0000 7f8b43611880 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2023-10-05T11:38:52.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.915+0000 7f8b43611880 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2023-10-05T11:38:52.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.915+0000 7f8b43611880 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2023-10-05T11:38:52.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.915+0000 7f8b43611880 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2023-10-05T11:38:52.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.915+0000 7f8b43611880 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2023-10-05T11:38:52.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.915+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - tag is: dff27d1e-df33-400e-a68a-7ba586947c99.4543.4000609754370304510 2023-10-05T11:38:52.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.915+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2023-10-05T11:38:52.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.915+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dff27d1e-df33-400e-a68a-7ba586947c99.4604.15__multipart_foo-FROZEN.2~eTH9zomvpT2_DCVGbxdz_khqGa_LaG5.1 2023-10-05T11:38:52.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.915+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 367 2023-10-05T11:38:52.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.915+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dff27d1e-df33-400e-a68a-7ba586947c99.4604.15__shadow_foo-FROZEN.2~eTH9zomvpT2_DCVGbxdz_khqGa_LaG5.1_1 2023-10-05T11:38:52.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.915+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 632 2023-10-05T11:38:52.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.915+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dff27d1e-df33-400e-a68a-7ba586947c99.4604.15__multipart_foo-FROZEN.2~eTH9zomvpT2_DCVGbxdz_khqGa_LaG5.2 2023-10-05T11:38:52.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.915+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 899 2023-10-05T11:38:52.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.915+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dff27d1e-df33-400e-a68a-7ba586947c99.4604.15__shadow_foo-FROZEN.2~eTH9zomvpT2_DCVGbxdz_khqGa_LaG5.2_1 2023-10-05T11:38:52.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.915+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1164 2023-10-05T11:38:52.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.915+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dff27d1e-df33-400e-a68a-7ba586947c99.4604.15__multipart_foo-FROZEN.2~eTH9zomvpT2_DCVGbxdz_khqGa_LaG5.3 2023-10-05T11:38:52.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.915+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1431 2023-10-05T11:38:52.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.915+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2023-10-05T11:38:52.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.915+0000 7f8b43611880 20 garbage collection: RGWGC::send_chain - on object name: gc.10tag is: dff27d1e-df33-400e-a68a-7ba586947c99.4543.4000609754370304510 2023-10-05T11:38:52.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.917+0000 7f8b3a283640 20 handle_completion(): completion ok for obj=foo-FROZEN 2023-10-05T11:38:52.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.917+0000 7f8b43611880 20 get_obj_state: rctx=0x55766d1c9d50 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-LUKEWARM state=0x55766d3d61e8 s->prefetch_data=0 2023-10-05T11:38:52.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.917+0000 7f8b43611880 10 manifest: total_size = 11534336 2023-10-05T11:38:52.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.917+0000 7f8b43611880 20 get_obj_state: setting s->obj_tag to _0n104TY1yh4AP_xxmeJ84OsYD1IxNxn 2023-10-05T11:38:52.923 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.917+0000 7f8b43611880 20 get_obj_state: rctx=0x55766d1c9d50 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-LUKEWARM state=0x55766d3d61e8 s->prefetch_data=0 2023-10-05T11:38:52.923 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.917+0000 7f8b43611880 20 prepare_atomic_modification: state is not atomic. state=0x55766d3d61e8 2023-10-05T11:38:52.923 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.917+0000 7f8b43611880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.15.5 2023-10-05T11:38:52.923 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.920+0000 7f8b43611880 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-10-05T11:38:52.923 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.920+0000 7f8b43611880 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=0 2023-10-05T11:38:52.923 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.920+0000 7f8b43611880 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-10-05T11:38:52.923 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.920+0000 7f8b43611880 20 RGWObjManifest::operator++(): result: ofs=8380416 stripe_ofs=8380416 part_ofs=0 rule->part_size=0 2023-10-05T11:38:52.923 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.920+0000 7f8b43611880 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-10-05T11:38:52.923 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.920+0000 7f8b43611880 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2023-10-05T11:38:52.923 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.920+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - tag is: _0n104TY1yh4AP_xxmeJ84OsYD1IxNxn 2023-10-05T11:38:52.923 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.920+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2023-10-05T11:38:52.923 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.920+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dff27d1e-df33-400e-a68a-7ba586947c99.4604.15__shadow_.quqUyXe0lkpnBG5m5gY0_3v32wahitN_0 2023-10-05T11:38:52.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.920+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2023-10-05T11:38:52.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.920+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dff27d1e-df33-400e-a68a-7ba586947c99.4604.15__shadow_.quqUyXe0lkpnBG5m5gY0_3v32wahitN_1 2023-10-05T11:38:52.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.920+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 549 2023-10-05T11:38:52.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.920+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dff27d1e-df33-400e-a68a-7ba586947c99.4604.15__shadow_.quqUyXe0lkpnBG5m5gY0_3v32wahitN_2 2023-10-05T11:38:52.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.920+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 788 2023-10-05T11:38:52.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.920+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2023-10-05T11:38:52.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.920+0000 7f8b43611880 20 garbage collection: RGWGC::send_chain - on object name: gc.3tag is: _0n104TY1yh4AP_xxmeJ84OsYD1IxNxn 2023-10-05T11:38:52.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.921+0000 7f8b39a82640 20 handle_completion(): completion ok for obj=foo-FROZEN-LUKEWARM 2023-10-05T11:38:52.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.921+0000 7f8b43611880 20 get_obj_state: rctx=0x55766d1c9d50 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-FROZEN state=0x55766d3d61e8 s->prefetch_data=0 2023-10-05T11:38:52.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.921+0000 7f8b43611880 10 manifest: total_size = 11534336 2023-10-05T11:38:52.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.921+0000 7f8b43611880 20 get_obj_state: setting s->obj_tag to _bUPuo0nOspwRkS7uhU6Sh13wG1oyv5E 2023-10-05T11:38:52.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.921+0000 7f8b43611880 20 get_obj_state: rctx=0x55766d1c9d50 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-FROZEN state=0x55766d3d61e8 s->prefetch_data=0 2023-10-05T11:38:52.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.921+0000 7f8b43611880 20 prepare_atomic_modification: state is not atomic. state=0x55766d3d61e8 2023-10-05T11:38:52.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.921+0000 7f8b43611880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.15.5 2023-10-05T11:38:52.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.923+0000 7f8b43611880 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-10-05T11:38:52.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.923+0000 7f8b43611880 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=0 2023-10-05T11:38:52.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.923+0000 7f8b43611880 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-10-05T11:38:52.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.923+0000 7f8b43611880 20 RGWObjManifest::operator++(): result: ofs=8380416 stripe_ofs=8380416 part_ofs=0 rule->part_size=0 2023-10-05T11:38:52.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.923+0000 7f8b43611880 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-10-05T11:38:52.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.923+0000 7f8b43611880 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2023-10-05T11:38:52.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.923+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - tag is: _bUPuo0nOspwRkS7uhU6Sh13wG1oyv5E 2023-10-05T11:38:52.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.923+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2023-10-05T11:38:52.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.923+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dff27d1e-df33-400e-a68a-7ba586947c99.4604.15__shadow_.x84OyxPid3E8XTidfAxZhxyH4oqTYSR_0 2023-10-05T11:38:52.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.923+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2023-10-05T11:38:52.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.923+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dff27d1e-df33-400e-a68a-7ba586947c99.4604.15__shadow_.x84OyxPid3E8XTidfAxZhxyH4oqTYSR_1 2023-10-05T11:38:52.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.923+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 545 2023-10-05T11:38:52.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.923+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dff27d1e-df33-400e-a68a-7ba586947c99.4604.15__shadow_.x84OyxPid3E8XTidfAxZhxyH4oqTYSR_2 2023-10-05T11:38:52.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.923+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 782 2023-10-05T11:38:52.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.923+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2023-10-05T11:38:52.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.923+0000 7f8b43611880 20 garbage collection: RGWGC::send_chain - on object name: gc.21tag is: _bUPuo0nOspwRkS7uhU6Sh13wG1oyv5E 2023-10-05T11:38:52.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.925+0000 7f8b43611880 20 get_obj_state: rctx=0x55766d1c9d50 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD state=0x55766d3d61e8 s->prefetch_data=0 2023-10-05T11:38:52.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.925+0000 7f8b3a283640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-FROZEN 2023-10-05T11:38:52.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.925+0000 7f8b43611880 10 manifest: total_size = 45360 2023-10-05T11:38:52.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.925+0000 7f8b43611880 20 get_obj_state: setting s->obj_tag to dff27d1e-df33-400e-a68a-7ba586947c99.4543.17557920844989408581 2023-10-05T11:38:52.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.925+0000 7f8b43611880 20 get_obj_state: rctx=0x55766d1c9d50 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD state=0x55766d3d61e8 s->prefetch_data=0 2023-10-05T11:38:52.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.925+0000 7f8b43611880 20 prepare_atomic_modification: state is not atomic. state=0x55766d3d61e8 2023-10-05T11:38:52.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.925+0000 7f8b43611880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.15.5 2023-10-05T11:38:52.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.927+0000 7f8b43611880 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2023-10-05T11:38:52.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.927+0000 7f8b43611880 20 RGWObjManifest::operator++(): stripe_ofs=4190208 part_ofs=0 rule->part_size=20613 2023-10-05T11:38:52.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.927+0000 7f8b43611880 20 RGWObjManifest::operator++(): result: ofs=20613 stripe_ofs=20613 part_ofs=20613 rule->part_size=20613 2023-10-05T11:38:52.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.927+0000 7f8b43611880 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2023-10-05T11:38:52.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.927+0000 7f8b43611880 20 RGWObjManifest::operator++(): stripe_ofs=4210821 part_ofs=20613 rule->part_size=20613 2023-10-05T11:38:52.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.927+0000 7f8b43611880 20 RGWObjManifest::operator++(): result: ofs=41226 stripe_ofs=41226 part_ofs=41226 rule->part_size=4134 2023-10-05T11:38:52.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.927+0000 7f8b43611880 20 RGWObjManifest::operator++(): rule->part_size=4134 rules.size()=2 2023-10-05T11:38:52.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.927+0000 7f8b43611880 20 RGWObjManifest::operator++(): stripe_ofs=4231434 part_ofs=41226 rule->part_size=4134 2023-10-05T11:38:52.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.927+0000 7f8b43611880 20 RGWObjManifest::operator++(): result: ofs=45360 stripe_ofs=45360 part_ofs=45360 rule->part_size=4134 2023-10-05T11:38:52.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.927+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - tag is: dff27d1e-df33-400e-a68a-7ba586947c99.4543.17557920844989408581 2023-10-05T11:38:52.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.927+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2023-10-05T11:38:52.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.927+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dff27d1e-df33-400e-a68a-7ba586947c99.4604.15__multipart_foo-STANDARD.2~Z6dKpa83YGSvhC9lPlIewGuxHObiI7F.1 2023-10-05T11:38:52.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.927+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 365 2023-10-05T11:38:52.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.927+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dff27d1e-df33-400e-a68a-7ba586947c99.4604.15__multipart_foo-STANDARD.2~Z6dKpa83YGSvhC9lPlIewGuxHObiI7F.2 2023-10-05T11:38:52.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.927+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 629 2023-10-05T11:38:52.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.927+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dff27d1e-df33-400e-a68a-7ba586947c99.4604.15__multipart_foo-STANDARD.2~Z6dKpa83YGSvhC9lPlIewGuxHObiI7F.3 2023-10-05T11:38:52.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.927+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 893 2023-10-05T11:38:52.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.927+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2023-10-05T11:38:52.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.927+0000 7f8b43611880 20 garbage collection: RGWGC::send_chain - on object name: gc.14tag is: dff27d1e-df33-400e-a68a-7ba586947c99.4543.17557920844989408581 2023-10-05T11:38:52.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.929+0000 7f8b43611880 20 get_obj_state: rctx=0x55766d1c9d50 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-STANDARD state=0x55766d3d61e8 s->prefetch_data=0 2023-10-05T11:38:52.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.929+0000 7f8b39a82640 20 handle_completion(): completion ok for obj=foo-STANDARD 2023-10-05T11:38:52.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.929+0000 7f8b43611880 10 manifest: total_size = 11534336 2023-10-05T11:38:52.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.929+0000 7f8b43611880 20 get_obj_state: setting s->obj_tag to _6daq5jau7eCGJWPsHlUp_8_QRNUK0Xv 2023-10-05T11:38:52.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.929+0000 7f8b43611880 20 get_obj_state: rctx=0x55766d1c9d50 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-STANDARD state=0x55766d3d61e8 s->prefetch_data=0 2023-10-05T11:38:52.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.929+0000 7f8b43611880 20 prepare_atomic_modification: state is not atomic. state=0x55766d3d61e8 2023-10-05T11:38:52.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.929+0000 7f8b43611880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.15.7 2023-10-05T11:38:52.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.931+0000 7f8b43611880 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-10-05T11:38:52.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.931+0000 7f8b43611880 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=0 2023-10-05T11:38:52.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.931+0000 7f8b43611880 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-10-05T11:38:52.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.931+0000 7f8b43611880 20 RGWObjManifest::operator++(): result: ofs=8380416 stripe_ofs=8380416 part_ofs=0 rule->part_size=0 2023-10-05T11:38:52.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.931+0000 7f8b43611880 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-10-05T11:38:52.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.931+0000 7f8b43611880 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2023-10-05T11:38:52.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.931+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - tag is: _6daq5jau7eCGJWPsHlUp_8_QRNUK0Xv 2023-10-05T11:38:52.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.931+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2023-10-05T11:38:52.935 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.931+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dff27d1e-df33-400e-a68a-7ba586947c99.4604.15__shadow_.rE-HILhYOpAGk_gQTztX2cNkdgNjUf7_0 2023-10-05T11:38:52.935 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.931+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2023-10-05T11:38:52.935 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.931+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dff27d1e-df33-400e-a68a-7ba586947c99.4604.15__shadow_.rE-HILhYOpAGk_gQTztX2cNkdgNjUf7_1 2023-10-05T11:38:52.935 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.931+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 531 2023-10-05T11:38:52.935 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.931+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dff27d1e-df33-400e-a68a-7ba586947c99.4604.15__shadow_.rE-HILhYOpAGk_gQTztX2cNkdgNjUf7_2 2023-10-05T11:38:52.935 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.931+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 761 2023-10-05T11:38:52.935 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.931+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2023-10-05T11:38:52.935 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.931+0000 7f8b43611880 20 garbage collection: RGWGC::send_chain - on object name: gc.11tag is: _6daq5jau7eCGJWPsHlUp_8_QRNUK0Xv 2023-10-05T11:38:52.936 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.933+0000 7f8b3a283640 20 handle_completion(): completion ok for obj=foo-FROZEN-STANDARD 2023-10-05T11:38:52.936 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.933+0000 7f8b43611880 20 get_obj_state: rctx=0x55766d1c9d50 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM state=0x55766d3d61e8 s->prefetch_data=0 2023-10-05T11:38:52.936 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.933+0000 7f8b43611880 10 manifest: total_size = 11534336 2023-10-05T11:38:52.936 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.933+0000 7f8b43611880 20 get_obj_state: setting s->obj_tag to dff27d1e-df33-400e-a68a-7ba586947c99.4543.12024535468307055096 2023-10-05T11:38:52.936 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.933+0000 7f8b43611880 20 get_obj_state: rctx=0x55766d1c9d50 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM state=0x55766d3d61e8 s->prefetch_data=0 2023-10-05T11:38:52.936 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.933+0000 7f8b43611880 20 prepare_atomic_modification: state is not atomic. state=0x55766d3d61e8 2023-10-05T11:38:52.936 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.933+0000 7f8b43611880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.15.7 2023-10-05T11:38:52.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.936+0000 7f8b43611880 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2023-10-05T11:38:52.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.936+0000 7f8b43611880 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2023-10-05T11:38:52.939 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.936+0000 7f8b43611880 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2023-10-05T11:38:52.939 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.936+0000 7f8b43611880 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2023-10-05T11:38:52.939 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.936+0000 7f8b43611880 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2023-10-05T11:38:52.939 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.936+0000 7f8b43611880 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2023-10-05T11:38:52.939 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.936+0000 7f8b43611880 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2023-10-05T11:38:52.939 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.936+0000 7f8b43611880 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2023-10-05T11:38:52.939 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.936+0000 7f8b43611880 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2023-10-05T11:38:52.939 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.936+0000 7f8b43611880 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2023-10-05T11:38:52.939 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.936+0000 7f8b43611880 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2023-10-05T11:38:52.939 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.936+0000 7f8b43611880 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2023-10-05T11:38:52.939 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.936+0000 7f8b43611880 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2023-10-05T11:38:52.939 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.936+0000 7f8b43611880 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2023-10-05T11:38:52.940 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.936+0000 7f8b43611880 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2023-10-05T11:38:52.940 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.936+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - tag is: dff27d1e-df33-400e-a68a-7ba586947c99.4543.12024535468307055096 2023-10-05T11:38:52.940 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.936+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2023-10-05T11:38:52.940 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.936+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dff27d1e-df33-400e-a68a-7ba586947c99.4604.15__multipart_foo-LUKEWARM.2~YLmts8n3fu7wg5fqcOFoiJoJ0cwqF0e.1 2023-10-05T11:38:52.940 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.936+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 374 2023-10-05T11:38:52.940 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.936+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dff27d1e-df33-400e-a68a-7ba586947c99.4604.15__shadow_foo-LUKEWARM.2~YLmts8n3fu7wg5fqcOFoiJoJ0cwqF0e.1_1 2023-10-05T11:38:52.940 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.936+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 645 2023-10-05T11:38:52.940 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.936+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dff27d1e-df33-400e-a68a-7ba586947c99.4604.15__multipart_foo-LUKEWARM.2~YLmts8n3fu7wg5fqcOFoiJoJ0cwqF0e.2 2023-10-05T11:38:52.940 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.936+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 918 2023-10-05T11:38:52.940 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.936+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dff27d1e-df33-400e-a68a-7ba586947c99.4604.15__shadow_foo-LUKEWARM.2~YLmts8n3fu7wg5fqcOFoiJoJ0cwqF0e.2_1 2023-10-05T11:38:52.940 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.936+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1189 2023-10-05T11:38:52.940 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.936+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dff27d1e-df33-400e-a68a-7ba586947c99.4604.15__multipart_foo-LUKEWARM.2~YLmts8n3fu7wg5fqcOFoiJoJ0cwqF0e.3 2023-10-05T11:38:52.941 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.936+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1462 2023-10-05T11:38:52.941 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.936+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2023-10-05T11:38:52.941 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.936+0000 7f8b43611880 20 garbage collection: RGWGC::send_chain - on object name: gc.17tag is: dff27d1e-df33-400e-a68a-7ba586947c99.4543.12024535468307055096 2023-10-05T11:38:52.941 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.937+0000 7f8b43611880 20 get_obj_state: rctx=0x55766d1c9d50 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-STANDARD state=0x55766d3d61e8 s->prefetch_data=0 2023-10-05T11:38:52.942 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.937+0000 7f8b39a82640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2023-10-05T11:38:52.942 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.937+0000 7f8b43611880 10 manifest: total_size = 45360 2023-10-05T11:38:52.942 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.937+0000 7f8b43611880 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2023-10-05T11:38:52.942 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.937+0000 7f8b43611880 20 RGWObjManifest::operator++(): stripe_ofs=4190208 part_ofs=0 rule->part_size=20613 2023-10-05T11:38:52.942 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.937+0000 7f8b43611880 20 RGWObjManifest::operator++(): result: ofs=20613 stripe_ofs=20613 part_ofs=20613 rule->part_size=20613 2023-10-05T11:38:52.942 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.937+0000 7f8b43611880 10 generate_fake_tag new tag=dff27d1e-df33-400e-a68a-7ba586947c99.4604.15__multipart_foo-STANDARD.2~Z6dKpa83YGSvhC9lPlIewGuxHObiI7F.2_b40bfc20e170960e0e6ba6f0e697be91 2023-10-05T11:38:52.942 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.937+0000 7f8b43611880 20 get_obj_state: setting s->obj_tag to dff27d1e-df33-400e-a68a-7ba586947c99.4604.15__multipart_foo-STANDARD.2~Z6dKpa83YGSvhC9lPlIewGuxHObiI7F.2_b40bfc20e170960e0e6ba6f0e697be91 2023-10-05T11:38:52.942 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.937+0000 7f8b43611880 20 get_obj_state: rctx=0x55766d1c9d50 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-STANDARD state=0x55766d3d61e8 s->prefetch_data=0 2023-10-05T11:38:52.942 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.937+0000 7f8b43611880 20 prepare_atomic_modification: state is not atomic. state=0x55766d3d61e8 2023-10-05T11:38:52.942 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.937+0000 7f8b43611880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.15.7 2023-10-05T11:38:52.943 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.940+0000 7f8b43611880 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2023-10-05T11:38:52.943 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.940+0000 7f8b43611880 20 RGWObjManifest::operator++(): stripe_ofs=4190208 part_ofs=0 rule->part_size=20613 2023-10-05T11:38:52.943 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.940+0000 7f8b43611880 20 RGWObjManifest::operator++(): result: ofs=20613 stripe_ofs=20613 part_ofs=20613 rule->part_size=20613 2023-10-05T11:38:52.943 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.940+0000 7f8b43611880 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2023-10-05T11:38:52.944 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.940+0000 7f8b43611880 20 RGWObjManifest::operator++(): stripe_ofs=4210821 part_ofs=20613 rule->part_size=20613 2023-10-05T11:38:52.944 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.940+0000 7f8b43611880 20 RGWObjManifest::operator++(): result: ofs=41226 stripe_ofs=41226 part_ofs=41226 rule->part_size=4134 2023-10-05T11:38:52.944 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.940+0000 7f8b43611880 20 RGWObjManifest::operator++(): rule->part_size=4134 rules.size()=2 2023-10-05T11:38:52.944 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.940+0000 7f8b43611880 20 RGWObjManifest::operator++(): stripe_ofs=4231434 part_ofs=41226 rule->part_size=4134 2023-10-05T11:38:52.944 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.940+0000 7f8b43611880 20 RGWObjManifest::operator++(): result: ofs=45360 stripe_ofs=45360 part_ofs=45360 rule->part_size=4134 2023-10-05T11:38:52.944 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.940+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - tag is: dff27d1e-df33-400e-a68a-7ba586947c99.4604.15__multipart_foo-STANDARD.2~Z6dKpa83YGSvhC9lPlIewGuxHObiI7F.2_b40bfc20e170960e0e6ba6f0e697be91 2023-10-05T11:38:52.944 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.940+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2023-10-05T11:38:52.944 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.940+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dff27d1e-df33-400e-a68a-7ba586947c99.4604.15__multipart_foo-STANDARD.2~Z6dKpa83YGSvhC9lPlIewGuxHObiI7F.1 2023-10-05T11:38:52.944 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.940+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 440 2023-10-05T11:38:52.944 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.940+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dff27d1e-df33-400e-a68a-7ba586947c99.4604.15__multipart_foo-STANDARD.2~Z6dKpa83YGSvhC9lPlIewGuxHObiI7F.2 2023-10-05T11:38:52.944 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.940+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 704 2023-10-05T11:38:52.945 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.940+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dff27d1e-df33-400e-a68a-7ba586947c99.4604.15__multipart_foo-STANDARD.2~Z6dKpa83YGSvhC9lPlIewGuxHObiI7F.3 2023-10-05T11:38:52.945 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.940+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 968 2023-10-05T11:38:52.945 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.940+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2023-10-05T11:38:52.945 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.940+0000 7f8b43611880 20 garbage collection: RGWGC::send_chain - on object name: gc.10tag is: dff27d1e-df33-400e-a68a-7ba586947c99.4604.15__multipart_foo-STANDARD.2~Z6dKpa83YGSvhC9lPlIewGuxHObiI7F.2_b40bfc20e170960e0e6ba6f0e697be91 2023-10-05T11:38:52.945 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.941+0000 7f8b3a283640 20 handle_completion(): completion ok for obj=foo-STANDARD-STANDARD 2023-10-05T11:38:52.945 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.941+0000 7f8b43611880 20 get_obj_state: rctx=0x55766d1c9d50 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-LUKEWARM state=0x55766d3d61e8 s->prefetch_data=0 2023-10-05T11:38:52.945 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.941+0000 7f8b43611880 10 manifest: total_size = 11534336 2023-10-05T11:38:52.946 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.941+0000 7f8b43611880 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2023-10-05T11:38:52.946 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.941+0000 7f8b43611880 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2023-10-05T11:38:52.946 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.941+0000 7f8b43611880 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2023-10-05T11:38:52.946 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.941+0000 7f8b43611880 10 generate_fake_tag new tag=dff27d1e-df33-400e-a68a-7ba586947c99.4604.15__shadow_foo-LUKEWARM.2~YLmts8n3fu7wg5fqcOFoiJoJ0cwqF0e.1_1_9649c73d0337f7a97a31faa8f7cdead5 2023-10-05T11:38:52.946 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.941+0000 7f8b43611880 20 get_obj_state: setting s->obj_tag to dff27d1e-df33-400e-a68a-7ba586947c99.4604.15__shadow_foo-LUKEWARM.2~YLmts8n3fu7wg5fqcOFoiJoJ0cwqF0e.1_1_9649c73d0337f7a97a31faa8f7cdead5 2023-10-05T11:38:52.946 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.941+0000 7f8b43611880 20 get_obj_state: rctx=0x55766d1c9d50 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-LUKEWARM state=0x55766d3d61e8 s->prefetch_data=0 2023-10-05T11:38:52.946 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.941+0000 7f8b43611880 20 prepare_atomic_modification: state is not atomic. state=0x55766d3d61e8 2023-10-05T11:38:52.946 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.941+0000 7f8b43611880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.15.8 2023-10-05T11:38:52.947 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.944+0000 7f8b43611880 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2023-10-05T11:38:52.947 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.944+0000 7f8b43611880 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2023-10-05T11:38:52.947 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.944+0000 7f8b43611880 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2023-10-05T11:38:52.947 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.944+0000 7f8b43611880 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2023-10-05T11:38:52.948 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.944+0000 7f8b43611880 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2023-10-05T11:38:52.948 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.944+0000 7f8b43611880 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2023-10-05T11:38:52.948 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.944+0000 7f8b43611880 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2023-10-05T11:38:52.948 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.944+0000 7f8b43611880 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2023-10-05T11:38:52.948 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.944+0000 7f8b43611880 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2023-10-05T11:38:52.948 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.944+0000 7f8b43611880 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2023-10-05T11:38:52.948 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.944+0000 7f8b43611880 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2023-10-05T11:38:52.948 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.944+0000 7f8b43611880 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2023-10-05T11:38:52.948 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.944+0000 7f8b43611880 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2023-10-05T11:38:52.948 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.944+0000 7f8b43611880 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2023-10-05T11:38:52.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.944+0000 7f8b43611880 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2023-10-05T11:38:52.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.944+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - tag is: dff27d1e-df33-400e-a68a-7ba586947c99.4604.15__shadow_foo-LUKEWARM.2~YLmts8n3fu7wg5fqcOFoiJoJ0cwqF0e.1_1_9649c73d0337f7a97a31faa8f7cdead5 2023-10-05T11:38:52.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.944+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2023-10-05T11:38:52.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.944+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dff27d1e-df33-400e-a68a-7ba586947c99.4604.15__multipart_foo-LUKEWARM.2~YLmts8n3fu7wg5fqcOFoiJoJ0cwqF0e.1 2023-10-05T11:38:52.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.944+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 448 2023-10-05T11:38:52.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.944+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dff27d1e-df33-400e-a68a-7ba586947c99.4604.15__shadow_foo-LUKEWARM.2~YLmts8n3fu7wg5fqcOFoiJoJ0cwqF0e.1_1 2023-10-05T11:38:52.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.944+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 719 2023-10-05T11:38:52.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.944+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dff27d1e-df33-400e-a68a-7ba586947c99.4604.15__multipart_foo-LUKEWARM.2~YLmts8n3fu7wg5fqcOFoiJoJ0cwqF0e.2 2023-10-05T11:38:52.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.944+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 992 2023-10-05T11:38:52.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.944+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dff27d1e-df33-400e-a68a-7ba586947c99.4604.15__shadow_foo-LUKEWARM.2~YLmts8n3fu7wg5fqcOFoiJoJ0cwqF0e.2_1 2023-10-05T11:38:52.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.944+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1263 2023-10-05T11:38:52.950 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.944+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dff27d1e-df33-400e-a68a-7ba586947c99.4604.15__multipart_foo-LUKEWARM.2~YLmts8n3fu7wg5fqcOFoiJoJ0cwqF0e.3 2023-10-05T11:38:52.950 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.944+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1536 2023-10-05T11:38:52.950 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.944+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2023-10-05T11:38:52.950 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.944+0000 7f8b43611880 20 garbage collection: RGWGC::send_chain - on object name: gc.17tag is: dff27d1e-df33-400e-a68a-7ba586947c99.4604.15__shadow_foo-LUKEWARM.2~YLmts8n3fu7wg5fqcOFoiJoJ0cwqF0e.1_1_9649c73d0337f7a97a31faa8f7cdead5 2023-10-05T11:38:52.950 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.945+0000 7f8b39a82640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-LUKEWARM 2023-10-05T11:38:52.950 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.945+0000 7f8b43611880 20 get_obj_state: rctx=0x55766d1c9d50 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-FROZEN state=0x55766d3d61e8 s->prefetch_data=0 2023-10-05T11:38:52.951 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.945+0000 7f8b43611880 10 manifest: total_size = 45360 2023-10-05T11:38:52.951 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.945+0000 7f8b43611880 20 get_obj_state: setting s->obj_tag to _BXuNAKRqTCTFys94Onm8AcoRn9MEInJ 2023-10-05T11:38:52.951 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.945+0000 7f8b43611880 20 get_obj_state: rctx=0x55766d1c9d50 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-FROZEN state=0x55766d3d61e8 s->prefetch_data=0 2023-10-05T11:38:52.951 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.945+0000 7f8b43611880 20 prepare_atomic_modification: state is not atomic. state=0x55766d3d61e8 2023-10-05T11:38:52.951 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.945+0000 7f8b43611880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.15.8 2023-10-05T11:38:52.951 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.948+0000 7f8b43611880 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-10-05T11:38:52.951 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.948+0000 7f8b43611880 20 RGWObjManifest::operator++(): result: ofs=45360 stripe_ofs=45360 part_ofs=0 rule->part_size=0 2023-10-05T11:38:52.951 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.948+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - tag is: _BXuNAKRqTCTFys94Onm8AcoRn9MEInJ 2023-10-05T11:38:52.951 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.948+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2023-10-05T11:38:52.951 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.948+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dff27d1e-df33-400e-a68a-7ba586947c99.4604.15__shadow_.8xpthpdRKbjqvzR6lGIhdL6EoF818xP_0 2023-10-05T11:38:52.952 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.948+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2023-10-05T11:38:52.952 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.948+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2023-10-05T11:38:52.952 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.948+0000 7f8b43611880 20 garbage collection: RGWGC::send_chain - on object name: gc.23tag is: _BXuNAKRqTCTFys94Onm8AcoRn9MEInJ 2023-10-05T11:38:52.952 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.949+0000 7f8b3a283640 20 handle_completion(): completion ok for obj=foo-STANDARD-FROZEN 2023-10-05T11:38:52.953 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.949+0000 7f8b43611880 20 get_obj_state: rctx=0x55766d1c9d50 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-FROZEN state=0x55766d3d61e8 s->prefetch_data=0 2023-10-05T11:38:52.953 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.950+0000 7f8b43611880 10 manifest: total_size = 11534336 2023-10-05T11:38:52.953 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.950+0000 7f8b43611880 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2023-10-05T11:38:52.953 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.950+0000 7f8b43611880 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2023-10-05T11:38:52.953 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.950+0000 7f8b43611880 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2023-10-05T11:38:52.953 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.950+0000 7f8b43611880 10 generate_fake_tag new tag=dff27d1e-df33-400e-a68a-7ba586947c99.4604.15__shadow_foo-FROZEN.2~eTH9zomvpT2_DCVGbxdz_khqGa_LaG5.1_1_d1f2fa2bf2d3cc802cf82541e54ea059 2023-10-05T11:38:52.953 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.950+0000 7f8b43611880 20 get_obj_state: setting s->obj_tag to dff27d1e-df33-400e-a68a-7ba586947c99.4604.15__shadow_foo-FROZEN.2~eTH9zomvpT2_DCVGbxdz_khqGa_LaG5.1_1_d1f2fa2bf2d3cc802cf82541e54ea059 2023-10-05T11:38:52.953 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.950+0000 7f8b43611880 20 get_obj_state: rctx=0x55766d1c9d50 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-FROZEN state=0x55766d3d61e8 s->prefetch_data=0 2023-10-05T11:38:52.953 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.950+0000 7f8b43611880 20 prepare_atomic_modification: state is not atomic. state=0x55766d3d61e8 2023-10-05T11:38:52.953 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.950+0000 7f8b43611880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.15.9 2023-10-05T11:38:52.957 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.952+0000 7f8b43611880 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2023-10-05T11:38:52.957 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.952+0000 7f8b43611880 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2023-10-05T11:38:52.957 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.952+0000 7f8b43611880 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2023-10-05T11:38:52.958 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.952+0000 7f8b43611880 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2023-10-05T11:38:52.958 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.952+0000 7f8b43611880 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2023-10-05T11:38:52.958 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.952+0000 7f8b43611880 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2023-10-05T11:38:52.958 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.952+0000 7f8b43611880 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2023-10-05T11:38:52.958 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.952+0000 7f8b43611880 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2023-10-05T11:38:52.958 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.952+0000 7f8b43611880 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2023-10-05T11:38:52.958 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.952+0000 7f8b43611880 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2023-10-05T11:38:52.958 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.952+0000 7f8b43611880 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2023-10-05T11:38:52.959 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.952+0000 7f8b43611880 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2023-10-05T11:38:52.959 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.952+0000 7f8b43611880 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2023-10-05T11:38:52.959 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.952+0000 7f8b43611880 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2023-10-05T11:38:52.959 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.952+0000 7f8b43611880 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2023-10-05T11:38:52.959 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.952+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - tag is: dff27d1e-df33-400e-a68a-7ba586947c99.4604.15__shadow_foo-FROZEN.2~eTH9zomvpT2_DCVGbxdz_khqGa_LaG5.1_1_d1f2fa2bf2d3cc802cf82541e54ea059 2023-10-05T11:38:52.959 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.952+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2023-10-05T11:38:52.959 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.952+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dff27d1e-df33-400e-a68a-7ba586947c99.4604.15__multipart_foo-FROZEN.2~eTH9zomvpT2_DCVGbxdz_khqGa_LaG5.1 2023-10-05T11:38:52.959 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.952+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 440 2023-10-05T11:38:52.959 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.952+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dff27d1e-df33-400e-a68a-7ba586947c99.4604.15__shadow_foo-FROZEN.2~eTH9zomvpT2_DCVGbxdz_khqGa_LaG5.1_1 2023-10-05T11:38:52.959 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.952+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 705 2023-10-05T11:38:52.959 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.952+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dff27d1e-df33-400e-a68a-7ba586947c99.4604.15__multipart_foo-FROZEN.2~eTH9zomvpT2_DCVGbxdz_khqGa_LaG5.2 2023-10-05T11:38:52.959 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.952+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 972 2023-10-05T11:38:52.960 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.952+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dff27d1e-df33-400e-a68a-7ba586947c99.4604.15__shadow_foo-FROZEN.2~eTH9zomvpT2_DCVGbxdz_khqGa_LaG5.2_1 2023-10-05T11:38:52.960 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.952+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1237 2023-10-05T11:38:52.960 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.952+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dff27d1e-df33-400e-a68a-7ba586947c99.4604.15__multipart_foo-FROZEN.2~eTH9zomvpT2_DCVGbxdz_khqGa_LaG5.3 2023-10-05T11:38:52.960 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.952+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1504 2023-10-05T11:38:52.960 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.952+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2023-10-05T11:38:52.960 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.952+0000 7f8b43611880 20 garbage collection: RGWGC::send_chain - on object name: gc.6tag is: dff27d1e-df33-400e-a68a-7ba586947c99.4604.15__shadow_foo-FROZEN.2~eTH9zomvpT2_DCVGbxdz_khqGa_LaG5.1_1_d1f2fa2bf2d3cc802cf82541e54ea059 2023-10-05T11:38:52.961 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.953+0000 7f8b39a82640 20 handle_completion(): completion ok for obj=foo-FROZEN-FROZEN 2023-10-05T11:38:52.961 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.953+0000 7f8b43611880 20 list_objects_ordered: starting attempt 1 2023-10-05T11:38:52.962 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.953+0000 7f8b43611880 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2023-10-05T11:38:52.962 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.954+0000 7f8b43611880 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2023-10-05T11:38:52.962 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.954+0000 7f8b43611880 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2023-10-05T11:38:52.962 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.954+0000 7f8b43611880 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2023-10-05T11:38:52.962 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.954+0000 7f8b43611880 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2023-10-05T11:38:52.962 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.954+0000 7f8b43611880 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-multipart-copy.1[dff27d1e-df33-400e-a68a-7ba586947c99.4604.15])"; uploads.size()=0; is_truncated=0 2023-10-05T11:38:52.962 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.956+0000 7f8b43611880 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 : miss 2023-10-05T11:38:52.962 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.956+0000 7f8b43611880 20 rados->read ofs=0 len=0 2023-10-05T11:38:52.962 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.957+0000 7f8b43611880 20 rados_obj.operate() r=0 bl.length=243 2023-10-05T11:38:52.962 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.957+0000 7f8b43611880 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x11 2023-10-05T11:38:52.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.957+0000 7f8b43611880 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2023-10-05T11:38:52.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.957+0000 7f8b43611880 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 from cache 2023-10-05T11:38:52.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.957+0000 7f8b43611880 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart-copy.1, ofs0, ns] 2023-10-05T11:38:52.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.957+0000 7f8b39a82640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1052266987581 cookie 93967125623808 notifier 5864 bl.length()=199 2023-10-05T11:38:52.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.959+0000 7f8b43611880 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:dff27d1e-df33-400e-a68a-7ba586947c99.4604.15 from cache 2023-10-05T11:38:52.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.959+0000 7f8b43611880 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:dff27d1e-df33-400e-a68a-7ba586947c99.4604.15, ofs0, ns] 2023-10-05T11:38:52.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.960+0000 7f8b39a82640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1052266987551 cookie 93967125753856 notifier 5864 bl.length()=257 2023-10-05T11:38:52.967 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.965+0000 7f8b43611880 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/dff27d1e-df33-400e-a68a-7ba586947c99.4604.15 : miss 2023-10-05T11:38:52.967 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.965+0000 7f8b43611880 20 rados->read ofs=0 len=0 2023-10-05T11:38:52.967 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.965+0000 7f8b43611880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:38:52.968 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.965+0000 7f8b43611880 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/dff27d1e-df33-400e-a68a-7ba586947c99.4604.15 info.flags=0x0 2023-10-05T11:38:52.968 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.965+0000 7f8b43611880 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/dff27d1e-df33-400e-a68a-7ba586947c99.4604.15 to cache LRU end 2023-10-05T11:38:52.968 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.965+0000 7f8b43611880 10 removing default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/dff27d1e-df33-400e-a68a-7ba586947c99.4604.15 from cache 2023-10-05T11:38:52.968 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.965+0000 7f8b43611880 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.log:pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/dff27d1e-df33-400e-a68a-7ba586947c99.4604.15, ofs0, ns] 2023-10-05T11:38:52.968 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.965+0000 7f8b3a283640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1052266987582 cookie 93967125623808 notifier 5864 bl.length()=254 2023-10-05T11:38:52.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.968+0000 7f8b43611880 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:dff27d1e-df33-400e-a68a-7ba586947c99.4604.13 : miss 2023-10-05T11:38:52.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.968+0000 7f8b43611880 20 rados->read ofs=0 len=0 2023-10-05T11:38:52.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.969+0000 7f8b43611880 20 rados_obj.operate() r=0 bl.length=412 2023-10-05T11:38:52.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.969+0000 7f8b43611880 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:dff27d1e-df33-400e-a68a-7ba586947c99.4604.13 info.flags=0x17 2023-10-05T11:38:52.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.969+0000 7f8b43611880 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:dff27d1e-df33-400e-a68a-7ba586947c99.4604.13 to cache LRU end 2023-10-05T11:38:52.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.969+0000 7f8b43611880 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T11:38:52.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.969+0000 7f8b43611880 10 updating xattr: name=user.rgw.acl bl.length()=209 2023-10-05T11:38:52.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.969+0000 7f8b43611880 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:dff27d1e-df33-400e-a68a-7ba586947c99.4604.13 2023-10-05T11:38:52.973 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.971+0000 7f8b43611880 10 cls_bucket_list_unordered: got foo-FROZEN 2023-10-05T11:38:52.974 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.972+0000 7f8b43611880 10 cls_bucket_list_unordered: got foo-STANDARD 2023-10-05T11:38:52.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.972+0000 7f8b43611880 10 cls_bucket_list_unordered: got foo-LUKEWARM 2023-10-05T11:38:52.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.973+0000 7f8b43611880 20 get_obj_state: rctx=0x55766d1c9d50 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-FROZEN state=0x55766d3d61e8 s->prefetch_data=0 2023-10-05T11:38:52.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.974+0000 7f8b43611880 10 manifest: total_size = 11534336 2023-10-05T11:38:52.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.974+0000 7f8b43611880 20 get_obj_state: setting s->obj_tag to dff27d1e-df33-400e-a68a-7ba586947c99.4543.5153479672258178246 2023-10-05T11:38:52.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.974+0000 7f8b43611880 20 get_obj_state: rctx=0x55766d1c9d50 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-FROZEN state=0x55766d3d61e8 s->prefetch_data=0 2023-10-05T11:38:52.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.974+0000 7f8b43611880 20 prepare_atomic_modification: state is not atomic. state=0x55766d3d61e8 2023-10-05T11:38:52.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.974+0000 7f8b43611880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.13.3 2023-10-05T11:38:52.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.976+0000 7f8b43611880 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2023-10-05T11:38:52.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.976+0000 7f8b43611880 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2023-10-05T11:38:52.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.976+0000 7f8b43611880 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2023-10-05T11:38:52.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.976+0000 7f8b43611880 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2023-10-05T11:38:52.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.976+0000 7f8b43611880 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2023-10-05T11:38:52.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.976+0000 7f8b43611880 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2023-10-05T11:38:52.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.976+0000 7f8b43611880 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2023-10-05T11:38:52.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.976+0000 7f8b43611880 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2023-10-05T11:38:52.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.976+0000 7f8b43611880 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2023-10-05T11:38:52.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.976+0000 7f8b43611880 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2023-10-05T11:38:52.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.976+0000 7f8b43611880 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2023-10-05T11:38:52.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.976+0000 7f8b43611880 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2023-10-05T11:38:52.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.976+0000 7f8b43611880 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2023-10-05T11:38:52.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.976+0000 7f8b43611880 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2023-10-05T11:38:52.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.976+0000 7f8b43611880 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2023-10-05T11:38:52.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.976+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - tag is: dff27d1e-df33-400e-a68a-7ba586947c99.4543.5153479672258178246 2023-10-05T11:38:52.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.976+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2023-10-05T11:38:52.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.976+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dff27d1e-df33-400e-a68a-7ba586947c99.4604.13__multipart_foo-FROZEN.2~V6p4WepcN13yZmsFrTnpg2USDScYzGl.1 2023-10-05T11:38:52.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.976+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 367 2023-10-05T11:38:52.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.976+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dff27d1e-df33-400e-a68a-7ba586947c99.4604.13__shadow_foo-FROZEN.2~V6p4WepcN13yZmsFrTnpg2USDScYzGl.1_1 2023-10-05T11:38:52.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.976+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 632 2023-10-05T11:38:52.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.976+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dff27d1e-df33-400e-a68a-7ba586947c99.4604.13__multipart_foo-FROZEN.2~V6p4WepcN13yZmsFrTnpg2USDScYzGl.2 2023-10-05T11:38:52.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.976+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 899 2023-10-05T11:38:52.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.976+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dff27d1e-df33-400e-a68a-7ba586947c99.4604.13__shadow_foo-FROZEN.2~V6p4WepcN13yZmsFrTnpg2USDScYzGl.2_1 2023-10-05T11:38:52.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.976+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1164 2023-10-05T11:38:52.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.976+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dff27d1e-df33-400e-a68a-7ba586947c99.4604.13__multipart_foo-FROZEN.2~V6p4WepcN13yZmsFrTnpg2USDScYzGl.3 2023-10-05T11:38:52.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.976+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1431 2023-10-05T11:38:52.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.976+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2023-10-05T11:38:52.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.976+0000 7f8b43611880 20 garbage collection: RGWGC::send_chain - on object name: gc.23tag is: dff27d1e-df33-400e-a68a-7ba586947c99.4543.5153479672258178246 2023-10-05T11:38:52.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.977+0000 7f8b3a283640 20 handle_completion(): completion ok for obj=foo-FROZEN 2023-10-05T11:38:52.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.977+0000 7f8b43611880 20 get_obj_state: rctx=0x55766d1c9d50 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-STANDARD state=0x55766d3d61e8 s->prefetch_data=0 2023-10-05T11:38:52.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.978+0000 7f8b43611880 10 manifest: total_size = 45360 2023-10-05T11:38:52.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.978+0000 7f8b43611880 20 get_obj_state: setting s->obj_tag to dff27d1e-df33-400e-a68a-7ba586947c99.4543.1958357894716679094 2023-10-05T11:38:52.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.978+0000 7f8b43611880 20 get_obj_state: rctx=0x55766d1c9d50 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-STANDARD state=0x55766d3d61e8 s->prefetch_data=0 2023-10-05T11:38:52.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.978+0000 7f8b43611880 20 prepare_atomic_modification: state is not atomic. state=0x55766d3d61e8 2023-10-05T11:38:52.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.978+0000 7f8b43611880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.13.5 2023-10-05T11:38:52.984 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.980+0000 7f8b43611880 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2023-10-05T11:38:52.984 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.980+0000 7f8b43611880 20 RGWObjManifest::operator++(): stripe_ofs=4190208 part_ofs=0 rule->part_size=20613 2023-10-05T11:38:52.984 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.980+0000 7f8b43611880 20 RGWObjManifest::operator++(): result: ofs=20613 stripe_ofs=20613 part_ofs=20613 rule->part_size=20613 2023-10-05T11:38:52.984 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.980+0000 7f8b43611880 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2023-10-05T11:38:52.984 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.980+0000 7f8b43611880 20 RGWObjManifest::operator++(): stripe_ofs=4210821 part_ofs=20613 rule->part_size=20613 2023-10-05T11:38:52.984 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.980+0000 7f8b43611880 20 RGWObjManifest::operator++(): result: ofs=41226 stripe_ofs=41226 part_ofs=41226 rule->part_size=4134 2023-10-05T11:38:52.984 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.980+0000 7f8b43611880 20 RGWObjManifest::operator++(): rule->part_size=4134 rules.size()=2 2023-10-05T11:38:52.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.980+0000 7f8b43611880 20 RGWObjManifest::operator++(): stripe_ofs=4231434 part_ofs=41226 rule->part_size=4134 2023-10-05T11:38:52.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.980+0000 7f8b43611880 20 RGWObjManifest::operator++(): result: ofs=45360 stripe_ofs=45360 part_ofs=45360 rule->part_size=4134 2023-10-05T11:38:52.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.980+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - tag is: dff27d1e-df33-400e-a68a-7ba586947c99.4543.1958357894716679094 2023-10-05T11:38:52.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.980+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2023-10-05T11:38:52.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.980+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dff27d1e-df33-400e-a68a-7ba586947c99.4604.13__multipart_foo-STANDARD.2~laFwYJkJ7VQDQWgNvvI__y8FvtejLg2.1 2023-10-05T11:38:52.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.980+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 364 2023-10-05T11:38:52.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.980+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dff27d1e-df33-400e-a68a-7ba586947c99.4604.13__multipart_foo-STANDARD.2~laFwYJkJ7VQDQWgNvvI__y8FvtejLg2.2 2023-10-05T11:38:52.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.980+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 628 2023-10-05T11:38:52.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.980+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dff27d1e-df33-400e-a68a-7ba586947c99.4604.13__multipart_foo-STANDARD.2~laFwYJkJ7VQDQWgNvvI__y8FvtejLg2.3 2023-10-05T11:38:52.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.980+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 892 2023-10-05T11:38:52.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.980+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2023-10-05T11:38:52.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.980+0000 7f8b43611880 20 garbage collection: RGWGC::send_chain - on object name: gc.15tag is: dff27d1e-df33-400e-a68a-7ba586947c99.4543.1958357894716679094 2023-10-05T11:38:52.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.981+0000 7f8b39a82640 20 handle_completion(): completion ok for obj=foo-STANDARD 2023-10-05T11:38:52.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.982+0000 7f8b43611880 20 get_obj_state: rctx=0x55766d1c9d50 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-LUKEWARM state=0x55766d3d61e8 s->prefetch_data=0 2023-10-05T11:38:52.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.982+0000 7f8b43611880 10 manifest: total_size = 11534336 2023-10-05T11:38:52.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.982+0000 7f8b43611880 20 get_obj_state: setting s->obj_tag to dff27d1e-df33-400e-a68a-7ba586947c99.4543.13117393144579574484 2023-10-05T11:38:52.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.982+0000 7f8b43611880 20 get_obj_state: rctx=0x55766d1c9d50 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-LUKEWARM state=0x55766d3d61e8 s->prefetch_data=0 2023-10-05T11:38:52.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.982+0000 7f8b43611880 20 prepare_atomic_modification: state is not atomic. state=0x55766d3d61e8 2023-10-05T11:38:52.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.982+0000 7f8b43611880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.13.7 2023-10-05T11:38:52.993 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.985+0000 7f8b43611880 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2023-10-05T11:38:52.993 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.985+0000 7f8b43611880 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2023-10-05T11:38:52.993 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.985+0000 7f8b43611880 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2023-10-05T11:38:52.993 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.985+0000 7f8b43611880 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2023-10-05T11:38:52.993 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.985+0000 7f8b43611880 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2023-10-05T11:38:52.993 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.985+0000 7f8b43611880 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2023-10-05T11:38:52.993 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.985+0000 7f8b43611880 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2023-10-05T11:38:52.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.985+0000 7f8b43611880 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2023-10-05T11:38:52.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.985+0000 7f8b43611880 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2023-10-05T11:38:52.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.985+0000 7f8b43611880 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2023-10-05T11:38:52.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.985+0000 7f8b43611880 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2023-10-05T11:38:52.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.985+0000 7f8b43611880 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2023-10-05T11:38:52.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.985+0000 7f8b43611880 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2023-10-05T11:38:52.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.985+0000 7f8b43611880 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2023-10-05T11:38:52.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.985+0000 7f8b43611880 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2023-10-05T11:38:52.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.985+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - tag is: dff27d1e-df33-400e-a68a-7ba586947c99.4543.13117393144579574484 2023-10-05T11:38:52.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.985+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2023-10-05T11:38:52.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.985+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dff27d1e-df33-400e-a68a-7ba586947c99.4604.13__multipart_foo-LUKEWARM.2~kY3j8j6FspLSxuoYGP4duNql-7hikOx.1 2023-10-05T11:38:52.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.985+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 374 2023-10-05T11:38:52.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.985+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dff27d1e-df33-400e-a68a-7ba586947c99.4604.13__shadow_foo-LUKEWARM.2~kY3j8j6FspLSxuoYGP4duNql-7hikOx.1_1 2023-10-05T11:38:52.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.985+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 645 2023-10-05T11:38:52.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.985+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dff27d1e-df33-400e-a68a-7ba586947c99.4604.13__multipart_foo-LUKEWARM.2~kY3j8j6FspLSxuoYGP4duNql-7hikOx.2 2023-10-05T11:38:52.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.985+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 918 2023-10-05T11:38:52.996 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.985+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dff27d1e-df33-400e-a68a-7ba586947c99.4604.13__shadow_foo-LUKEWARM.2~kY3j8j6FspLSxuoYGP4duNql-7hikOx.2_1 2023-10-05T11:38:52.996 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.985+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1189 2023-10-05T11:38:52.996 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.985+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dff27d1e-df33-400e-a68a-7ba586947c99.4604.13__multipart_foo-LUKEWARM.2~kY3j8j6FspLSxuoYGP4duNql-7hikOx.3 2023-10-05T11:38:52.996 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.985+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1462 2023-10-05T11:38:52.996 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.985+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2023-10-05T11:38:52.996 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.985+0000 7f8b43611880 20 garbage collection: RGWGC::send_chain - on object name: gc.1tag is: dff27d1e-df33-400e-a68a-7ba586947c99.4543.13117393144579574484 2023-10-05T11:38:52.996 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.986+0000 7f8b43611880 20 list_objects_ordered: starting attempt 1 2023-10-05T11:38:52.996 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.986+0000 7f8b43611880 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2023-10-05T11:38:52.997 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.986+0000 7f8b3a283640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2023-10-05T11:38:52.997 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.987+0000 7f8b43611880 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2023-10-05T11:38:52.997 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.987+0000 7f8b43611880 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2023-10-05T11:38:52.997 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.987+0000 7f8b43611880 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2023-10-05T11:38:52.997 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.987+0000 7f8b43611880 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2023-10-05T11:38:52.997 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.987+0000 7f8b43611880 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-multipart.1[dff27d1e-df33-400e-a68a-7ba586947c99.4604.13])"; uploads.size()=0; is_truncated=0 2023-10-05T11:38:52.997 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.989+0000 7f8b43611880 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 : miss 2023-10-05T11:38:52.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.989+0000 7f8b43611880 20 rados->read ofs=0 len=0 2023-10-05T11:38:52.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.989+0000 7f8b43611880 20 rados_obj.operate() r=0 bl.length=238 2023-10-05T11:38:52.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.989+0000 7f8b43611880 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 info.flags=0x11 2023-10-05T11:38:52.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.989+0000 7f8b43611880 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 to cache LRU end 2023-10-05T11:38:52.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.989+0000 7f8b43611880 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 from cache 2023-10-05T11:38:52.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.989+0000 7f8b43611880 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart.1, ofs0, ns] 2023-10-05T11:38:52.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.989+0000 7f8b3a283640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1052266987552 cookie 93967125752832 notifier 5864 bl.length()=194 2023-10-05T11:38:52.999 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.992+0000 7f8b43611880 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:dff27d1e-df33-400e-a68a-7ba586947c99.4604.13 from cache 2023-10-05T11:38:52.999 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.992+0000 7f8b43611880 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:dff27d1e-df33-400e-a68a-7ba586947c99.4604.13, ofs0, ns] 2023-10-05T11:38:52.999 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.993+0000 7f8b3a283640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1052266987553 cookie 93967125753856 notifier 5864 bl.length()=252 2023-10-05T11:38:53.000 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.997+0000 7f8b43611880 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/dff27d1e-df33-400e-a68a-7ba586947c99.4604.13 : miss 2023-10-05T11:38:53.000 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.997+0000 7f8b43611880 20 rados->read ofs=0 len=0 2023-10-05T11:38:53.001 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.998+0000 7f8b43611880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:38:53.001 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.998+0000 7f8b43611880 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/dff27d1e-df33-400e-a68a-7ba586947c99.4604.13 info.flags=0x0 2023-10-05T11:38:53.001 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.998+0000 7f8b43611880 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/dff27d1e-df33-400e-a68a-7ba586947c99.4604.13 to cache LRU end 2023-10-05T11:38:53.001 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.998+0000 7f8b43611880 10 removing default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/dff27d1e-df33-400e-a68a-7ba586947c99.4604.13 from cache 2023-10-05T11:38:53.001 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.998+0000 7f8b43611880 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.log:pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/dff27d1e-df33-400e-a68a-7ba586947c99.4604.13, ofs0, ns] 2023-10-05T11:38:53.001 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:52.998+0000 7f8b3a283640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1052266987583 cookie 93967125623808 notifier 5864 bl.length()=249 2023-10-05T11:38:53.004 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.001+0000 7f8b43611880 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:dff27d1e-df33-400e-a68a-7ba586947c99.4604.12 : miss 2023-10-05T11:38:53.004 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.001+0000 7f8b43611880 20 rados->read ofs=0 len=0 2023-10-05T11:38:53.004 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.001+0000 7f8b43611880 20 rados_obj.operate() r=0 bl.length=402 2023-10-05T11:38:53.004 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.001+0000 7f8b43611880 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:dff27d1e-df33-400e-a68a-7ba586947c99.4604.12 info.flags=0x17 2023-10-05T11:38:53.004 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.001+0000 7f8b43611880 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:dff27d1e-df33-400e-a68a-7ba586947c99.4604.12 to cache LRU end 2023-10-05T11:38:53.004 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.001+0000 7f8b43611880 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T11:38:53.004 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.001+0000 7f8b43611880 10 updating xattr: name=user.rgw.acl bl.length()=209 2023-10-05T11:38:53.005 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.001+0000 7f8b43611880 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:dff27d1e-df33-400e-a68a-7ba586947c99.4604.12 2023-10-05T11:38:53.005 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.003+0000 7f8b43611880 10 cls_bucket_list_unordered: got foo-FROZEN 2023-10-05T11:38:53.006 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.004+0000 7f8b43611880 10 cls_bucket_list_unordered: got foo-STANDARD 2023-10-05T11:38:53.007 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.004+0000 7f8b43611880 10 cls_bucket_list_unordered: got foo-LUKEWARM 2023-10-05T11:38:53.008 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.005+0000 7f8b43611880 20 get_obj_state: rctx=0x55766d4405b0 obj=test-client.0-r-test-obj-storage-class.1:foo-FROZEN state=0x55766d3d61e8 s->prefetch_data=0 2023-10-05T11:38:53.008 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.006+0000 7f8b43611880 10 manifest: total_size = 10485760 2023-10-05T11:38:53.008 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.006+0000 7f8b43611880 20 get_obj_state: setting s->obj_tag to dff27d1e-df33-400e-a68a-7ba586947c99.4543.11361452713326344291 2023-10-05T11:38:53.008 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.006+0000 7f8b43611880 20 get_obj_state: rctx=0x55766d4405b0 obj=test-client.0-r-test-obj-storage-class.1:foo-FROZEN state=0x55766d3d61e8 s->prefetch_data=0 2023-10-05T11:38:53.009 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.006+0000 7f8b43611880 20 prepare_atomic_modification: state is not atomic. state=0x55766d3d61e8 2023-10-05T11:38:53.009 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.006+0000 7f8b43611880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.12.3 2023-10-05T11:38:53.011 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.008+0000 7f8b43611880 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-10-05T11:38:53.011 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.008+0000 7f8b43611880 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=0 2023-10-05T11:38:53.011 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.008+0000 7f8b43611880 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-10-05T11:38:53.011 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.008+0000 7f8b43611880 20 RGWObjManifest::operator++(): result: ofs=8380416 stripe_ofs=8380416 part_ofs=0 rule->part_size=0 2023-10-05T11:38:53.012 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.008+0000 7f8b43611880 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-10-05T11:38:53.012 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.008+0000 7f8b43611880 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2023-10-05T11:38:53.012 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.008+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - tag is: dff27d1e-df33-400e-a68a-7ba586947c99.4543.11361452713326344291 2023-10-05T11:38:53.012 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.008+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2023-10-05T11:38:53.012 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.008+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dff27d1e-df33-400e-a68a-7ba586947c99.4604.12__shadow_.QgdZ_zisY-cyd21PAF8bXKk2f7y3FMX_0 2023-10-05T11:38:53.012 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.008+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 338 2023-10-05T11:38:53.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.008+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dff27d1e-df33-400e-a68a-7ba586947c99.4604.12__shadow_.QgdZ_zisY-cyd21PAF8bXKk2f7y3FMX_1 2023-10-05T11:38:53.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.008+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 575 2023-10-05T11:38:53.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.008+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dff27d1e-df33-400e-a68a-7ba586947c99.4604.12__shadow_.QgdZ_zisY-cyd21PAF8bXKk2f7y3FMX_2 2023-10-05T11:38:53.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.008+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 812 2023-10-05T11:38:53.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.008+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2023-10-05T11:38:53.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.008+0000 7f8b43611880 20 garbage collection: RGWGC::send_chain - on object name: gc.2tag is: dff27d1e-df33-400e-a68a-7ba586947c99.4543.11361452713326344291 2023-10-05T11:38:53.014 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.010+0000 7f8b3a283640 20 handle_completion(): completion ok for obj=foo-FROZEN 2023-10-05T11:38:53.014 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.010+0000 7f8b43611880 20 get_obj_state: rctx=0x55766d4405b0 obj=test-client.0-r-test-obj-storage-class.1:foo-STANDARD state=0x55766d3d61e8 s->prefetch_data=0 2023-10-05T11:38:53.014 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.010+0000 7f8b43611880 10 manifest: total_size = 53499 2023-10-05T11:38:53.014 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.010+0000 7f8b43611880 20 get_obj_state: setting s->obj_tag to dff27d1e-df33-400e-a68a-7ba586947c99.4543.13165101542196247068 2023-10-05T11:38:53.015 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.010+0000 7f8b43611880 20 get_obj_state: rctx=0x55766d4405b0 obj=test-client.0-r-test-obj-storage-class.1:foo-STANDARD state=0x55766d3d61e8 s->prefetch_data=0 2023-10-05T11:38:53.015 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.010+0000 7f8b43611880 20 prepare_atomic_modification: state is not atomic. state=0x55766d3d61e8 2023-10-05T11:38:53.015 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.010+0000 7f8b43611880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.12.5 2023-10-05T11:38:53.015 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.012+0000 7f8b43611880 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-10-05T11:38:53.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.012+0000 7f8b43611880 20 RGWObjManifest::operator++(): result: ofs=53499 stripe_ofs=53499 part_ofs=0 rule->part_size=0 2023-10-05T11:38:53.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.012+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - tag is: dff27d1e-df33-400e-a68a-7ba586947c99.4543.13165101542196247068 2023-10-05T11:38:53.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.012+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2023-10-05T11:38:53.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.012+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dff27d1e-df33-400e-a68a-7ba586947c99.4604.12__shadow_.OC4Luwmy2-uNv_aelh0xYvg_pdJciZg_0 2023-10-05T11:38:53.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.012+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 331 2023-10-05T11:38:53.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.012+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2023-10-05T11:38:53.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.012+0000 7f8b43611880 20 garbage collection: RGWGC::send_chain - on object name: gc.21tag is: dff27d1e-df33-400e-a68a-7ba586947c99.4543.13165101542196247068 2023-10-05T11:38:53.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.013+0000 7f8b39a82640 20 handle_completion(): completion ok for obj=foo-STANDARD 2023-10-05T11:38:53.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.014+0000 7f8b43611880 20 get_obj_state: rctx=0x55766d4405b0 obj=test-client.0-r-test-obj-storage-class.1:foo-LUKEWARM state=0x55766d3d61e8 s->prefetch_data=0 2023-10-05T11:38:53.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.014+0000 7f8b43611880 10 manifest: total_size = 10485760 2023-10-05T11:38:53.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.014+0000 7f8b43611880 20 get_obj_state: setting s->obj_tag to dff27d1e-df33-400e-a68a-7ba586947c99.4543.14673467699392796647 2023-10-05T11:38:53.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.014+0000 7f8b43611880 20 get_obj_state: rctx=0x55766d4405b0 obj=test-client.0-r-test-obj-storage-class.1:foo-LUKEWARM state=0x55766d3d61e8 s->prefetch_data=0 2023-10-05T11:38:53.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.014+0000 7f8b43611880 20 prepare_atomic_modification: state is not atomic. state=0x55766d3d61e8 2023-10-05T11:38:53.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.014+0000 7f8b43611880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.12.7 2023-10-05T11:38:53.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.017+0000 7f8b43611880 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-10-05T11:38:53.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.017+0000 7f8b43611880 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=0 2023-10-05T11:38:53.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.017+0000 7f8b43611880 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-10-05T11:38:53.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.017+0000 7f8b43611880 20 RGWObjManifest::operator++(): result: ofs=8380416 stripe_ofs=8380416 part_ofs=0 rule->part_size=0 2023-10-05T11:38:53.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.017+0000 7f8b43611880 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-10-05T11:38:53.020 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.017+0000 7f8b43611880 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2023-10-05T11:38:53.020 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.017+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - tag is: dff27d1e-df33-400e-a68a-7ba586947c99.4543.14673467699392796647 2023-10-05T11:38:53.020 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.017+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2023-10-05T11:38:53.020 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.017+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dff27d1e-df33-400e-a68a-7ba586947c99.4604.12__shadow_.sU0G5r4P8GbEFrjVlJ7FH8TVse7zBwf_0 2023-10-05T11:38:53.020 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.017+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 340 2023-10-05T11:38:53.020 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.017+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dff27d1e-df33-400e-a68a-7ba586947c99.4604.12__shadow_.sU0G5r4P8GbEFrjVlJ7FH8TVse7zBwf_1 2023-10-05T11:38:53.020 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.017+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 579 2023-10-05T11:38:53.020 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.017+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dff27d1e-df33-400e-a68a-7ba586947c99.4604.12__shadow_.sU0G5r4P8GbEFrjVlJ7FH8TVse7zBwf_2 2023-10-05T11:38:53.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.017+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 818 2023-10-05T11:38:53.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.017+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2023-10-05T11:38:53.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.017+0000 7f8b43611880 20 garbage collection: RGWGC::send_chain - on object name: gc.6tag is: dff27d1e-df33-400e-a68a-7ba586947c99.4543.14673467699392796647 2023-10-05T11:38:53.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.018+0000 7f8b3a283640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2023-10-05T11:38:53.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.018+0000 7f8b43611880 20 list_objects_ordered: starting attempt 1 2023-10-05T11:38:53.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.018+0000 7f8b43611880 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2023-10-05T11:38:53.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.019+0000 7f8b43611880 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2023-10-05T11:38:53.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.019+0000 7f8b43611880 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2023-10-05T11:38:53.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.019+0000 7f8b43611880 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2023-10-05T11:38:53.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.019+0000 7f8b43611880 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2023-10-05T11:38:53.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.019+0000 7f8b43611880 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class.1[dff27d1e-df33-400e-a68a-7ba586947c99.4604.12])"; uploads.size()=0; is_truncated=0 2023-10-05T11:38:53.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.021+0000 7f8b43611880 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 : miss 2023-10-05T11:38:53.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.021+0000 7f8b43611880 20 rados->read ofs=0 len=0 2023-10-05T11:38:53.024 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.021+0000 7f8b43611880 20 rados_obj.operate() r=0 bl.length=228 2023-10-05T11:38:53.024 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.021+0000 7f8b43611880 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 info.flags=0x11 2023-10-05T11:38:53.024 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.021+0000 7f8b43611880 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 to cache LRU end 2023-10-05T11:38:53.024 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.021+0000 7f8b43611880 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 from cache 2023-10-05T11:38:53.024 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.021+0000 7f8b43611880 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class.1, ofs0, ns] 2023-10-05T11:38:53.025 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.022+0000 7f8b3a283640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1052266987563 cookie 93967125622784 notifier 5864 bl.length()=184 2023-10-05T11:38:53.027 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.025+0000 7f8b43611880 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:dff27d1e-df33-400e-a68a-7ba586947c99.4604.12 from cache 2023-10-05T11:38:53.027 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.025+0000 7f8b43611880 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class.1:dff27d1e-df33-400e-a68a-7ba586947c99.4604.12, ofs0, ns] 2023-10-05T11:38:53.027 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.025+0000 7f8b3a283640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1052266987554 cookie 93967125752832 notifier 5864 bl.length()=242 2023-10-05T11:38:53.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.030+0000 7f8b43611880 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/dff27d1e-df33-400e-a68a-7ba586947c99.4604.12 : miss 2023-10-05T11:38:53.033 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.030+0000 7f8b43611880 20 rados->read ofs=0 len=0 2023-10-05T11:38:53.033 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.030+0000 7f8b43611880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:38:53.033 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.030+0000 7f8b43611880 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/dff27d1e-df33-400e-a68a-7ba586947c99.4604.12 info.flags=0x0 2023-10-05T11:38:53.033 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.030+0000 7f8b43611880 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/dff27d1e-df33-400e-a68a-7ba586947c99.4604.12 to cache LRU end 2023-10-05T11:38:53.033 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.030+0000 7f8b43611880 10 removing default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/dff27d1e-df33-400e-a68a-7ba586947c99.4604.12 from cache 2023-10-05T11:38:53.033 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.030+0000 7f8b43611880 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.log:pubsub..bucket.test-client.0-r-test-obj-storage-class.1/dff27d1e-df33-400e-a68a-7ba586947c99.4604.12, ofs0, ns] 2023-10-05T11:38:53.034 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.030+0000 7f8b39a82640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1052266987564 cookie 93967125622784 notifier 5864 bl.length()=239 2023-10-05T11:38:53.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.034+0000 7f8b43611880 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:dff27d1e-df33-400e-a68a-7ba586947c99.4604.5 : miss 2023-10-05T11:38:53.037 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.034+0000 7f8b43611880 20 rados->read ofs=0 len=0 2023-10-05T11:38:53.037 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.035+0000 7f8b43611880 20 rados_obj.operate() r=0 bl.length=397 2023-10-05T11:38:53.037 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.035+0000 7f8b43611880 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:dff27d1e-df33-400e-a68a-7ba586947c99.4604.5 info.flags=0x17 2023-10-05T11:38:53.038 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.035+0000 7f8b43611880 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:dff27d1e-df33-400e-a68a-7ba586947c99.4604.5 to cache LRU end 2023-10-05T11:38:53.038 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.035+0000 7f8b43611880 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T11:38:53.038 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.035+0000 7f8b43611880 10 updating xattr: name=user.rgw.acl bl.length()=209 2023-10-05T11:38:53.038 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.035+0000 7f8b43611880 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:dff27d1e-df33-400e-a68a-7ba586947c99.4604.5 2023-10-05T11:38:53.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.036+0000 7f8b43611880 10 cls_bucket_list_unordered: got ___ 2023-10-05T11:38:53.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.036+0000 7f8b43611880 10 cls_bucket_list_unordered: got __ _ 2023-10-05T11:38:53.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.037+0000 7f8b43611880 10 cls_bucket_list_unordered: got __ 2023-10-05T11:38:53.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.038+0000 7f8b43611880 10 cls_bucket_list_unordered: got obj 2023-10-05T11:38:53.041 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.038+0000 7f8b43611880 20 get_obj_state: rctx=0x55766d4405b0 obj=test-client.0-r-test-small-obj-data.1:___ state=0x55766d3d61e8 s->prefetch_data=0 2023-10-05T11:38:53.041 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.039+0000 7f8b43611880 10 manifest: total_size = 0 2023-10-05T11:38:53.041 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.039+0000 7f8b43611880 20 get_obj_state: setting s->obj_tag to dff27d1e-df33-400e-a68a-7ba586947c99.4543.8852060637834147008 2023-10-05T11:38:53.041 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.039+0000 7f8b43611880 20 get_obj_state: rctx=0x55766d4405b0 obj=test-client.0-r-test-small-obj-data.1:___ state=0x55766d3d61e8 s->prefetch_data=0 2023-10-05T11:38:53.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.039+0000 7f8b43611880 20 prepare_atomic_modification: state is not atomic. state=0x55766d3d61e8 2023-10-05T11:38:53.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.039+0000 7f8b43611880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.5.2 2023-10-05T11:38:53.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.041+0000 7f8b43611880 20 get_obj_state: rctx=0x55766d4405b0 obj=test-client.0-r-test-small-obj-data.1:__ _ state=0x55766d3d61e8 s->prefetch_data=0 2023-10-05T11:38:53.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.042+0000 7f8b43611880 10 manifest: total_size = 0 2023-10-05T11:38:53.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.042+0000 7f8b43611880 20 get_obj_state: setting s->obj_tag to dff27d1e-df33-400e-a68a-7ba586947c99.4543.870368576201407778 2023-10-05T11:38:53.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.042+0000 7f8b43611880 20 get_obj_state: rctx=0x55766d4405b0 obj=test-client.0-r-test-small-obj-data.1:__ _ state=0x55766d3d61e8 s->prefetch_data=0 2023-10-05T11:38:53.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.042+0000 7f8b43611880 20 prepare_atomic_modification: state is not atomic. state=0x55766d3d61e8 2023-10-05T11:38:53.045 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.042+0000 7f8b43611880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.5.3 2023-10-05T11:38:53.045 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.042+0000 7f8b39a82640 20 handle_completion(): completion ok for obj=___ 2023-10-05T11:38:53.047 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.044+0000 7f8b43611880 20 get_obj_state: rctx=0x55766d4405b0 obj=test-client.0-r-test-small-obj-data.1:__ state=0x55766d3d61e8 s->prefetch_data=0 2023-10-05T11:38:53.047 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.045+0000 7f8b43611880 10 manifest: total_size = 0 2023-10-05T11:38:53.047 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.045+0000 7f8b43611880 20 get_obj_state: setting s->obj_tag to dff27d1e-df33-400e-a68a-7ba586947c99.4543.13300312137158749117 2023-10-05T11:38:53.048 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.045+0000 7f8b43611880 20 get_obj_state: rctx=0x55766d4405b0 obj=test-client.0-r-test-small-obj-data.1:__ state=0x55766d3d61e8 s->prefetch_data=0 2023-10-05T11:38:53.048 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.045+0000 7f8b43611880 20 prepare_atomic_modification: state is not atomic. state=0x55766d3d61e8 2023-10-05T11:38:53.048 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.045+0000 7f8b43611880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.5.6 2023-10-05T11:38:53.048 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.046+0000 7f8b3a283640 20 handle_completion(): completion ok for obj=__ _ 2023-10-05T11:38:53.050 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.047+0000 7f8b43611880 20 get_obj_state: rctx=0x55766d4405b0 obj=test-client.0-r-test-small-obj-data.1:obj state=0x55766d3d61e8 s->prefetch_data=0 2023-10-05T11:38:53.050 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.048+0000 7f8b43611880 10 manifest: total_size = 0 2023-10-05T11:38:53.050 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.048+0000 7f8b43611880 20 get_obj_state: setting s->obj_tag to dff27d1e-df33-400e-a68a-7ba586947c99.4543.8356114742130006925 2023-10-05T11:38:53.051 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.048+0000 7f8b43611880 20 get_obj_state: rctx=0x55766d4405b0 obj=test-client.0-r-test-small-obj-data.1:obj state=0x55766d3d61e8 s->prefetch_data=0 2023-10-05T11:38:53.051 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.048+0000 7f8b43611880 20 prepare_atomic_modification: state is not atomic. state=0x55766d3d61e8 2023-10-05T11:38:53.051 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.048+0000 7f8b43611880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.5.8 2023-10-05T11:38:53.051 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.049+0000 7f8b39a82640 20 handle_completion(): completion ok for obj=__ 2023-10-05T11:38:53.053 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.050+0000 7f8b43611880 20 list_objects_ordered: starting attempt 1 2023-10-05T11:38:53.053 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.050+0000 7f8b43611880 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2023-10-05T11:38:53.054 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.052+0000 7f8b39a82640 20 handle_completion(): completion ok for obj=obj 2023-10-05T11:38:53.054 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.052+0000 7f8b43611880 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2023-10-05T11:38:53.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.052+0000 7f8b43611880 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2023-10-05T11:38:53.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.052+0000 7f8b43611880 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2023-10-05T11:38:53.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.052+0000 7f8b43611880 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2023-10-05T11:38:53.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.052+0000 7f8b43611880 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.1[dff27d1e-df33-400e-a68a-7ba586947c99.4604.5])"; uploads.size()=0; is_truncated=0 2023-10-05T11:38:53.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.054+0000 7f8b43611880 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 : miss 2023-10-05T11:38:53.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.054+0000 7f8b43611880 20 rados->read ofs=0 len=0 2023-10-05T11:38:53.057 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.054+0000 7f8b43611880 20 rados_obj.operate() r=0 bl.length=223 2023-10-05T11:38:53.057 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.054+0000 7f8b43611880 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 info.flags=0x11 2023-10-05T11:38:53.057 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.054+0000 7f8b43611880 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 to cache LRU end 2023-10-05T11:38:53.057 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.054+0000 7f8b43611880 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 from cache 2023-10-05T11:38:53.057 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.054+0000 7f8b43611880 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.1, ofs0, ns] 2023-10-05T11:38:53.058 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.055+0000 7f8b39a82640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1052266987570 cookie 93967125621760 notifier 5864 bl.length()=181 2023-10-05T11:38:53.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.057+0000 7f8b43611880 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:dff27d1e-df33-400e-a68a-7ba586947c99.4604.5 from cache 2023-10-05T11:38:53.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.057+0000 7f8b43611880 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.1:dff27d1e-df33-400e-a68a-7ba586947c99.4604.5, ofs0, ns] 2023-10-05T11:38:53.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.058+0000 7f8b39a82640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1052266987555 cookie 93967125752832 notifier 5864 bl.length()=238 2023-10-05T11:38:53.065 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.062+0000 7f8b43611880 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/dff27d1e-df33-400e-a68a-7ba586947c99.4604.5 : miss 2023-10-05T11:38:53.065 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.062+0000 7f8b43611880 20 rados->read ofs=0 len=0 2023-10-05T11:38:53.065 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.063+0000 7f8b43611880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:38:53.066 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.063+0000 7f8b43611880 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/dff27d1e-df33-400e-a68a-7ba586947c99.4604.5 info.flags=0x0 2023-10-05T11:38:53.066 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.063+0000 7f8b43611880 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/dff27d1e-df33-400e-a68a-7ba586947c99.4604.5 to cache LRU end 2023-10-05T11:38:53.066 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.063+0000 7f8b43611880 10 removing default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/dff27d1e-df33-400e-a68a-7ba586947c99.4604.5 from cache 2023-10-05T11:38:53.066 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.063+0000 7f8b43611880 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.log:pubsub..bucket.test-client.0-r-test-small-obj-data.1/dff27d1e-df33-400e-a68a-7ba586947c99.4604.5, ofs0, ns] 2023-10-05T11:38:53.066 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.063+0000 7f8b39a82640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1052266987554 cookie 93967125751808 notifier 5864 bl.length()=235 2023-10-05T11:38:53.069 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.066+0000 7f8b43611880 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:dff27d1e-df33-400e-a68a-7ba586947c99.4604.6 : miss 2023-10-05T11:38:53.069 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.066+0000 7f8b43611880 20 rados->read ofs=0 len=0 2023-10-05T11:38:53.069 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.067+0000 7f8b43611880 20 rados_obj.operate() r=0 bl.length=397 2023-10-05T11:38:53.070 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.067+0000 7f8b43611880 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:dff27d1e-df33-400e-a68a-7ba586947c99.4604.6 info.flags=0x17 2023-10-05T11:38:53.070 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.067+0000 7f8b43611880 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:dff27d1e-df33-400e-a68a-7ba586947c99.4604.6 to cache LRU end 2023-10-05T11:38:53.070 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.067+0000 7f8b43611880 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T11:38:53.070 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.067+0000 7f8b43611880 10 updating xattr: name=user.rgw.acl bl.length()=209 2023-10-05T11:38:53.070 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.067+0000 7f8b43611880 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:dff27d1e-df33-400e-a68a-7ba586947c99.4604.6 2023-10-05T11:38:53.071 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.068+0000 7f8b43611880 10 cls_bucket_list_unordered: got ___ 2023-10-05T11:38:53.071 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.068+0000 7f8b43611880 10 cls_bucket_list_unordered: got __ _ 2023-10-05T11:38:53.072 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.069+0000 7f8b43611880 10 cls_bucket_list_unordered: got __ 2023-10-05T11:38:53.072 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.070+0000 7f8b43611880 10 cls_bucket_list_unordered: got obj 2023-10-05T11:38:53.073 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.071+0000 7f8b43611880 20 get_obj_state: rctx=0x55766d1c9c70 obj=test-client.0-r-test-small-obj-data.2:___ state=0x55766d3d61e8 s->prefetch_data=0 2023-10-05T11:38:53.074 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.071+0000 7f8b43611880 10 manifest: total_size = 24595 2023-10-05T11:38:53.074 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.071+0000 7f8b43611880 20 get_obj_state: setting s->obj_tag to dff27d1e-df33-400e-a68a-7ba586947c99.4543.5227784691186849772 2023-10-05T11:38:53.074 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.071+0000 7f8b43611880 20 get_obj_state: rctx=0x55766d1c9c70 obj=test-client.0-r-test-small-obj-data.2:___ state=0x55766d3d61e8 s->prefetch_data=0 2023-10-05T11:38:53.074 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.071+0000 7f8b43611880 20 prepare_atomic_modification: state is not atomic. state=0x55766d3d61e8 2023-10-05T11:38:53.074 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.071+0000 7f8b43611880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.6.2 2023-10-05T11:38:53.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.074+0000 7f8b43611880 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-10-05T11:38:53.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.074+0000 7f8b43611880 20 RGWObjManifest::operator++(): result: ofs=24595 stripe_ofs=24595 part_ofs=0 rule->part_size=0 2023-10-05T11:38:53.077 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.074+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - tag is: dff27d1e-df33-400e-a68a-7ba586947c99.4543.5227784691186849772 2023-10-05T11:38:53.077 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.074+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2023-10-05T11:38:53.077 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.074+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dff27d1e-df33-400e-a68a-7ba586947c99.4604.6__shadow_.zOdJDCiRyiqJe7M7cBTRa2bqKCzA1gZ_0 2023-10-05T11:38:53.077 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.074+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2023-10-05T11:38:53.077 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.074+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2023-10-05T11:38:53.077 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.074+0000 7f8b43611880 20 garbage collection: RGWGC::send_chain - on object name: gc.17tag is: dff27d1e-df33-400e-a68a-7ba586947c99.4543.5227784691186849772 2023-10-05T11:38:53.078 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.075+0000 7f8b3a283640 20 handle_completion(): completion ok for obj=___ 2023-10-05T11:38:53.078 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.075+0000 7f8b43611880 20 get_obj_state: rctx=0x55766d1c9c70 obj=test-client.0-r-test-small-obj-data.2:__ _ state=0x55766d3d61e8 s->prefetch_data=0 2023-10-05T11:38:53.079 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.076+0000 7f8b43611880 10 manifest: total_size = 527 2023-10-05T11:38:53.079 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.076+0000 7f8b43611880 20 get_obj_state: setting s->obj_tag to dff27d1e-df33-400e-a68a-7ba586947c99.4543.5894538664764713404 2023-10-05T11:38:53.079 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.076+0000 7f8b43611880 20 get_obj_state: rctx=0x55766d1c9c70 obj=test-client.0-r-test-small-obj-data.2:__ _ state=0x55766d3d61e8 s->prefetch_data=0 2023-10-05T11:38:53.079 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.076+0000 7f8b43611880 20 prepare_atomic_modification: state is not atomic. state=0x55766d3d61e8 2023-10-05T11:38:53.079 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.076+0000 7f8b43611880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.6.3 2023-10-05T11:38:53.080 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.078+0000 7f8b43611880 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-10-05T11:38:53.080 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.078+0000 7f8b43611880 20 RGWObjManifest::operator++(): result: ofs=527 stripe_ofs=527 part_ofs=0 rule->part_size=0 2023-10-05T11:38:53.081 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.078+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - tag is: dff27d1e-df33-400e-a68a-7ba586947c99.4543.5894538664764713404 2023-10-05T11:38:53.081 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.078+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2023-10-05T11:38:53.081 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.078+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dff27d1e-df33-400e-a68a-7ba586947c99.4604.6__shadow_.4Er4u8AHde644sIewOYPU1SRhV54344_0 2023-10-05T11:38:53.081 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.078+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2023-10-05T11:38:53.081 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.078+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2023-10-05T11:38:53.081 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.078+0000 7f8b43611880 20 garbage collection: RGWGC::send_chain - on object name: gc.18tag is: dff27d1e-df33-400e-a68a-7ba586947c99.4543.5894538664764713404 2023-10-05T11:38:53.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.079+0000 7f8b43611880 20 get_obj_state: rctx=0x55766d1c9c70 obj=test-client.0-r-test-small-obj-data.2:__ state=0x55766d3d61e8 s->prefetch_data=0 2023-10-05T11:38:53.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.079+0000 7f8b39a82640 20 handle_completion(): completion ok for obj=__ _ 2023-10-05T11:38:53.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.080+0000 7f8b43611880 10 manifest: total_size = 527 2023-10-05T11:38:53.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.080+0000 7f8b43611880 20 get_obj_state: setting s->obj_tag to dff27d1e-df33-400e-a68a-7ba586947c99.4543.17331514491489228034 2023-10-05T11:38:53.085 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.080+0000 7f8b43611880 20 get_obj_state: rctx=0x55766d1c9c70 obj=test-client.0-r-test-small-obj-data.2:__ state=0x55766d3d61e8 s->prefetch_data=0 2023-10-05T11:38:53.085 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.080+0000 7f8b43611880 20 prepare_atomic_modification: state is not atomic. state=0x55766d3d61e8 2023-10-05T11:38:53.085 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.080+0000 7f8b43611880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.6.6 2023-10-05T11:38:53.086 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.082+0000 7f8b43611880 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-10-05T11:38:53.086 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.082+0000 7f8b43611880 20 RGWObjManifest::operator++(): result: ofs=527 stripe_ofs=527 part_ofs=0 rule->part_size=0 2023-10-05T11:38:53.087 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.082+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - tag is: dff27d1e-df33-400e-a68a-7ba586947c99.4543.17331514491489228034 2023-10-05T11:38:53.087 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.082+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2023-10-05T11:38:53.087 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.082+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dff27d1e-df33-400e-a68a-7ba586947c99.4604.6__shadow_.cSyBCkpsHu2zw15yZdDB7QjC7HhmIx1_0 2023-10-05T11:38:53.087 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.082+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2023-10-05T11:38:53.087 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.082+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2023-10-05T11:38:53.087 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.082+0000 7f8b43611880 20 garbage collection: RGWGC::send_chain - on object name: gc.11tag is: dff27d1e-df33-400e-a68a-7ba586947c99.4543.17331514491489228034 2023-10-05T11:38:53.087 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.083+0000 7f8b3a283640 20 handle_completion(): completion ok for obj=__ 2023-10-05T11:38:53.088 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.083+0000 7f8b43611880 20 get_obj_state: rctx=0x55766d1c9c70 obj=test-client.0-r-test-small-obj-data.2:obj state=0x55766d3d61e8 s->prefetch_data=0 2023-10-05T11:38:53.088 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.084+0000 7f8b43611880 10 manifest: total_size = 2078 2023-10-05T11:38:53.088 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.084+0000 7f8b43611880 20 get_obj_state: setting s->obj_tag to dff27d1e-df33-400e-a68a-7ba586947c99.4543.11942677610827212047 2023-10-05T11:38:53.088 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.084+0000 7f8b43611880 20 get_obj_state: rctx=0x55766d1c9c70 obj=test-client.0-r-test-small-obj-data.2:obj state=0x55766d3d61e8 s->prefetch_data=0 2023-10-05T11:38:53.088 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.084+0000 7f8b43611880 20 prepare_atomic_modification: state is not atomic. state=0x55766d3d61e8 2023-10-05T11:38:53.088 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.084+0000 7f8b43611880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.6.8 2023-10-05T11:38:53.089 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.086+0000 7f8b43611880 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-10-05T11:38:53.089 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.086+0000 7f8b43611880 20 RGWObjManifest::operator++(): result: ofs=2078 stripe_ofs=2078 part_ofs=0 rule->part_size=0 2023-10-05T11:38:53.089 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.086+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - tag is: dff27d1e-df33-400e-a68a-7ba586947c99.4543.11942677610827212047 2023-10-05T11:38:53.089 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.086+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2023-10-05T11:38:53.090 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.086+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dff27d1e-df33-400e-a68a-7ba586947c99.4604.6__shadow_.1M_Xl721KoAkZttZTlfo17FEkkb82Zs_0 2023-10-05T11:38:53.090 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.086+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2023-10-05T11:38:53.090 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.086+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2023-10-05T11:38:53.090 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.086+0000 7f8b43611880 20 garbage collection: RGWGC::send_chain - on object name: gc.23tag is: dff27d1e-df33-400e-a68a-7ba586947c99.4543.11942677610827212047 2023-10-05T11:38:53.091 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.087+0000 7f8b39a82640 20 handle_completion(): completion ok for obj=obj 2023-10-05T11:38:53.091 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.088+0000 7f8b43611880 20 list_objects_ordered: starting attempt 1 2023-10-05T11:38:53.091 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.088+0000 7f8b43611880 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2023-10-05T11:38:53.091 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.088+0000 7f8b43611880 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2023-10-05T11:38:53.091 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.088+0000 7f8b43611880 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2023-10-05T11:38:53.092 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.088+0000 7f8b43611880 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2023-10-05T11:38:53.092 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.088+0000 7f8b43611880 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2023-10-05T11:38:53.092 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.088+0000 7f8b43611880 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.2[dff27d1e-df33-400e-a68a-7ba586947c99.4604.6])"; uploads.size()=0; is_truncated=0 2023-10-05T11:38:53.092 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.090+0000 7f8b43611880 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 : miss 2023-10-05T11:38:53.092 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.090+0000 7f8b43611880 20 rados->read ofs=0 len=0 2023-10-05T11:38:53.093 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.091+0000 7f8b43611880 20 rados_obj.operate() r=0 bl.length=223 2023-10-05T11:38:53.093 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.091+0000 7f8b43611880 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 info.flags=0x11 2023-10-05T11:38:53.093 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.091+0000 7f8b43611880 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 to cache LRU end 2023-10-05T11:38:53.093 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.091+0000 7f8b43611880 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 from cache 2023-10-05T11:38:53.094 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.091+0000 7f8b43611880 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.2, ofs0, ns] 2023-10-05T11:38:53.094 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.091+0000 7f8b3a283640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1052266987571 cookie 93967125621760 notifier 5864 bl.length()=181 2023-10-05T11:38:53.096 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.093+0000 7f8b43611880 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:dff27d1e-df33-400e-a68a-7ba586947c99.4604.6 from cache 2023-10-05T11:38:53.096 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.093+0000 7f8b43611880 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.2:dff27d1e-df33-400e-a68a-7ba586947c99.4604.6, ofs0, ns] 2023-10-05T11:38:53.096 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.094+0000 7f8b3a283640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1052266987556 cookie 93967125752832 notifier 5864 bl.length()=238 2023-10-05T11:38:53.101 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.098+0000 7f8b43611880 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/dff27d1e-df33-400e-a68a-7ba586947c99.4604.6 : miss 2023-10-05T11:38:53.101 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.098+0000 7f8b43611880 20 rados->read ofs=0 len=0 2023-10-05T11:38:53.101 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.099+0000 7f8b43611880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:38:53.101 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.099+0000 7f8b43611880 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/dff27d1e-df33-400e-a68a-7ba586947c99.4604.6 info.flags=0x0 2023-10-05T11:38:53.101 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.099+0000 7f8b43611880 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/dff27d1e-df33-400e-a68a-7ba586947c99.4604.6 to cache LRU end 2023-10-05T11:38:53.101 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.099+0000 7f8b43611880 10 removing default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/dff27d1e-df33-400e-a68a-7ba586947c99.4604.6 from cache 2023-10-05T11:38:53.101 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.099+0000 7f8b43611880 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.log:pubsub..bucket.test-client.0-r-test-small-obj-data.2/dff27d1e-df33-400e-a68a-7ba586947c99.4604.6, ofs0, ns] 2023-10-05T11:38:53.102 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.099+0000 7f8b3a283640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1052266987555 cookie 93967125751808 notifier 5864 bl.length()=235 2023-10-05T11:38:53.105 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.102+0000 7f8b43611880 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:dff27d1e-df33-400e-a68a-7ba586947c99.4604.7 : miss 2023-10-05T11:38:53.105 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.102+0000 7f8b43611880 20 rados->read ofs=0 len=0 2023-10-05T11:38:53.105 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.103+0000 7f8b43611880 20 rados_obj.operate() r=0 bl.length=397 2023-10-05T11:38:53.105 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.103+0000 7f8b43611880 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:dff27d1e-df33-400e-a68a-7ba586947c99.4604.7 info.flags=0x17 2023-10-05T11:38:53.106 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.103+0000 7f8b43611880 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:dff27d1e-df33-400e-a68a-7ba586947c99.4604.7 to cache LRU end 2023-10-05T11:38:53.106 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.103+0000 7f8b43611880 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T11:38:53.106 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.103+0000 7f8b43611880 10 updating xattr: name=user.rgw.acl bl.length()=209 2023-10-05T11:38:53.106 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.103+0000 7f8b43611880 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:dff27d1e-df33-400e-a68a-7ba586947c99.4604.7 2023-10-05T11:38:53.106 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.104+0000 7f8b43611880 10 cls_bucket_list_unordered: got ___ 2023-10-05T11:38:53.106 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.104+0000 7f8b43611880 10 cls_bucket_list_unordered: got __ _ 2023-10-05T11:38:53.107 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.105+0000 7f8b43611880 10 cls_bucket_list_unordered: got __ 2023-10-05T11:38:53.108 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.106+0000 7f8b43611880 10 cls_bucket_list_unordered: got obj 2023-10-05T11:38:53.109 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.106+0000 7f8b43611880 20 get_obj_state: rctx=0x55766d1c9d50 obj=test-client.0-r-test-small-obj-data.3:___ state=0x55766d3d61e8 s->prefetch_data=0 2023-10-05T11:38:53.109 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.107+0000 7f8b43611880 10 manifest: total_size = 1035 2023-10-05T11:38:53.109 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.107+0000 7f8b43611880 20 get_obj_state: setting s->obj_tag to dff27d1e-df33-400e-a68a-7ba586947c99.4543.12667656014713169454 2023-10-05T11:38:53.110 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.107+0000 7f8b43611880 20 get_obj_state: rctx=0x55766d1c9d50 obj=test-client.0-r-test-small-obj-data.3:___ state=0x55766d3d61e8 s->prefetch_data=0 2023-10-05T11:38:53.110 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.107+0000 7f8b43611880 20 prepare_atomic_modification: state is not atomic. state=0x55766d3d61e8 2023-10-05T11:38:53.110 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.107+0000 7f8b43611880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.7.2 2023-10-05T11:38:53.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.109+0000 7f8b43611880 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-10-05T11:38:53.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.109+0000 7f8b43611880 20 RGWObjManifest::operator++(): result: ofs=1035 stripe_ofs=1035 part_ofs=0 rule->part_size=0 2023-10-05T11:38:53.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.109+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - tag is: dff27d1e-df33-400e-a68a-7ba586947c99.4543.12667656014713169454 2023-10-05T11:38:53.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.109+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2023-10-05T11:38:53.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.109+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dff27d1e-df33-400e-a68a-7ba586947c99.4604.7__shadow_.9AWNjm5UDcrey9UY-iyLfMbpyg36Q6t_0 2023-10-05T11:38:53.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.109+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2023-10-05T11:38:53.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.109+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2023-10-05T11:38:53.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.109+0000 7f8b43611880 20 garbage collection: RGWGC::send_chain - on object name: gc.3tag is: dff27d1e-df33-400e-a68a-7ba586947c99.4543.12667656014713169454 2023-10-05T11:38:53.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.111+0000 7f8b39a82640 20 handle_completion(): completion ok for obj=___ 2023-10-05T11:38:53.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.111+0000 7f8b43611880 20 get_obj_state: rctx=0x55766d1c9d50 obj=test-client.0-r-test-small-obj-data.3:__ _ state=0x55766d3d61e8 s->prefetch_data=0 2023-10-05T11:38:53.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.111+0000 7f8b43611880 10 manifest: total_size = 4134 2023-10-05T11:38:53.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.111+0000 7f8b43611880 20 get_obj_state: setting s->obj_tag to dff27d1e-df33-400e-a68a-7ba586947c99.4543.13797328828128833096 2023-10-05T11:38:53.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.111+0000 7f8b43611880 20 get_obj_state: rctx=0x55766d1c9d50 obj=test-client.0-r-test-small-obj-data.3:__ _ state=0x55766d3d61e8 s->prefetch_data=0 2023-10-05T11:38:53.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.111+0000 7f8b43611880 20 prepare_atomic_modification: state is not atomic. state=0x55766d3d61e8 2023-10-05T11:38:53.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.111+0000 7f8b43611880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.7.3 2023-10-05T11:38:53.116 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.113+0000 7f8b43611880 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-10-05T11:38:53.116 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.113+0000 7f8b43611880 20 RGWObjManifest::operator++(): result: ofs=4134 stripe_ofs=4134 part_ofs=0 rule->part_size=0 2023-10-05T11:38:53.116 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.113+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - tag is: dff27d1e-df33-400e-a68a-7ba586947c99.4543.13797328828128833096 2023-10-05T11:38:53.116 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.113+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2023-10-05T11:38:53.116 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.113+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dff27d1e-df33-400e-a68a-7ba586947c99.4604.7__shadow_.TqGU928AjW-b0ctsiisCN-11dxrOkWG_0 2023-10-05T11:38:53.116 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.113+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2023-10-05T11:38:53.116 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.113+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2023-10-05T11:38:53.116 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.113+0000 7f8b43611880 20 garbage collection: RGWGC::send_chain - on object name: gc.25tag is: dff27d1e-df33-400e-a68a-7ba586947c99.4543.13797328828128833096 2023-10-05T11:38:53.117 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.115+0000 7f8b3a283640 20 handle_completion(): completion ok for obj=__ _ 2023-10-05T11:38:53.117 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.115+0000 7f8b43611880 20 get_obj_state: rctx=0x55766d1c9d50 obj=test-client.0-r-test-small-obj-data.3:__ state=0x55766d3d61e8 s->prefetch_data=0 2023-10-05T11:38:53.118 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.115+0000 7f8b43611880 10 manifest: total_size = 4134 2023-10-05T11:38:53.118 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.115+0000 7f8b43611880 20 get_obj_state: setting s->obj_tag to dff27d1e-df33-400e-a68a-7ba586947c99.4543.955027549519794420 2023-10-05T11:38:53.118 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.115+0000 7f8b43611880 20 get_obj_state: rctx=0x55766d1c9d50 obj=test-client.0-r-test-small-obj-data.3:__ state=0x55766d3d61e8 s->prefetch_data=0 2023-10-05T11:38:53.118 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.115+0000 7f8b43611880 20 prepare_atomic_modification: state is not atomic. state=0x55766d3d61e8 2023-10-05T11:38:53.118 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.115+0000 7f8b43611880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.7.6 2023-10-05T11:38:53.120 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.117+0000 7f8b43611880 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-10-05T11:38:53.120 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.117+0000 7f8b43611880 20 RGWObjManifest::operator++(): result: ofs=4134 stripe_ofs=4134 part_ofs=0 rule->part_size=0 2023-10-05T11:38:53.120 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.117+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - tag is: dff27d1e-df33-400e-a68a-7ba586947c99.4543.955027549519794420 2023-10-05T11:38:53.120 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.117+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2023-10-05T11:38:53.120 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.117+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dff27d1e-df33-400e-a68a-7ba586947c99.4604.7__shadow_.AZNPVUPGfCm1dVraYqltEoXRWf-Zmn6_0 2023-10-05T11:38:53.120 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.117+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 327 2023-10-05T11:38:53.121 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.117+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2023-10-05T11:38:53.121 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.118+0000 7f8b43611880 20 garbage collection: RGWGC::send_chain - on object name: gc.28tag is: dff27d1e-df33-400e-a68a-7ba586947c99.4543.955027549519794420 2023-10-05T11:38:53.121 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.119+0000 7f8b39a82640 20 handle_completion(): completion ok for obj=__ 2023-10-05T11:38:53.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.119+0000 7f8b43611880 20 get_obj_state: rctx=0x55766d1c9d50 obj=test-client.0-r-test-small-obj-data.3:obj state=0x55766d3d61e8 s->prefetch_data=0 2023-10-05T11:38:53.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.119+0000 7f8b43611880 10 manifest: total_size = 55 2023-10-05T11:38:53.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.119+0000 7f8b43611880 20 get_obj_state: setting s->obj_tag to dff27d1e-df33-400e-a68a-7ba586947c99.4543.18184949987962663880 2023-10-05T11:38:53.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.119+0000 7f8b43611880 20 get_obj_state: rctx=0x55766d1c9d50 obj=test-client.0-r-test-small-obj-data.3:obj state=0x55766d3d61e8 s->prefetch_data=0 2023-10-05T11:38:53.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.119+0000 7f8b43611880 20 prepare_atomic_modification: state is not atomic. state=0x55766d3d61e8 2023-10-05T11:38:53.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.119+0000 7f8b43611880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.7.8 2023-10-05T11:38:53.124 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.122+0000 7f8b43611880 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-10-05T11:38:53.124 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.122+0000 7f8b43611880 20 RGWObjManifest::operator++(): result: ofs=55 stripe_ofs=55 part_ofs=0 rule->part_size=0 2023-10-05T11:38:53.124 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.122+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - tag is: dff27d1e-df33-400e-a68a-7ba586947c99.4543.18184949987962663880 2023-10-05T11:38:53.124 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.122+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2023-10-05T11:38:53.124 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.122+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dff27d1e-df33-400e-a68a-7ba586947c99.4604.7__shadow_.MhLhwrg7ERryCuPu7U58GjSOAYxxuwG_0 2023-10-05T11:38:53.124 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.122+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2023-10-05T11:38:53.124 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.122+0000 7f8b43611880 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2023-10-05T11:38:53.125 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.122+0000 7f8b43611880 20 garbage collection: RGWGC::send_chain - on object name: gc.26tag is: dff27d1e-df33-400e-a68a-7ba586947c99.4543.18184949987962663880 2023-10-05T11:38:53.125 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.123+0000 7f8b3a283640 20 handle_completion(): completion ok for obj=obj 2023-10-05T11:38:53.125 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.123+0000 7f8b43611880 20 list_objects_ordered: starting attempt 1 2023-10-05T11:38:53.125 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.123+0000 7f8b43611880 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2023-10-05T11:38:53.126 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.124+0000 7f8b43611880 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2023-10-05T11:38:53.126 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.124+0000 7f8b43611880 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2023-10-05T11:38:53.126 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.124+0000 7f8b43611880 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2023-10-05T11:38:53.126 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.124+0000 7f8b43611880 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2023-10-05T11:38:53.127 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.124+0000 7f8b43611880 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.3[dff27d1e-df33-400e-a68a-7ba586947c99.4604.7])"; uploads.size()=0; is_truncated=0 2023-10-05T11:38:53.128 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.126+0000 7f8b43611880 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 : miss 2023-10-05T11:38:53.128 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.126+0000 7f8b43611880 20 rados->read ofs=0 len=0 2023-10-05T11:38:53.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.128+0000 7f8b43611880 20 rados_obj.operate() r=0 bl.length=223 2023-10-05T11:38:53.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.128+0000 7f8b43611880 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 info.flags=0x11 2023-10-05T11:38:53.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.128+0000 7f8b43611880 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 to cache LRU end 2023-10-05T11:38:53.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.128+0000 7f8b43611880 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 from cache 2023-10-05T11:38:53.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.128+0000 7f8b43611880 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.3, ofs0, ns] 2023-10-05T11:38:53.132 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.128+0000 7f8b39a82640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1052266987572 cookie 93967125621760 notifier 5864 bl.length()=181 2023-10-05T11:38:53.134 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.131+0000 7f8b43611880 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:dff27d1e-df33-400e-a68a-7ba586947c99.4604.7 from cache 2023-10-05T11:38:53.134 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.131+0000 7f8b43611880 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.3:dff27d1e-df33-400e-a68a-7ba586947c99.4604.7, ofs0, ns] 2023-10-05T11:38:53.134 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.131+0000 7f8b39a82640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1052266987557 cookie 93967125752832 notifier 5864 bl.length()=238 2023-10-05T11:38:53.139 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.136+0000 7f8b43611880 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/dff27d1e-df33-400e-a68a-7ba586947c99.4604.7 : miss 2023-10-05T11:38:53.139 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.136+0000 7f8b43611880 20 rados->read ofs=0 len=0 2023-10-05T11:38:53.139 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.136+0000 7f8b43611880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:38:53.139 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.136+0000 7f8b43611880 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/dff27d1e-df33-400e-a68a-7ba586947c99.4604.7 info.flags=0x0 2023-10-05T11:38:53.139 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.136+0000 7f8b43611880 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/dff27d1e-df33-400e-a68a-7ba586947c99.4604.7 to cache LRU end 2023-10-05T11:38:53.139 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.136+0000 7f8b43611880 10 removing default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/dff27d1e-df33-400e-a68a-7ba586947c99.4604.7 from cache 2023-10-05T11:38:53.139 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.136+0000 7f8b43611880 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.log:pubsub..bucket.test-client.0-r-test-small-obj-data.3/dff27d1e-df33-400e-a68a-7ba586947c99.4604.7, ofs0, ns] 2023-10-05T11:38:53.140 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.137+0000 7f8b39a82640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1052266987556 cookie 93967125751808 notifier 5864 bl.length()=235 2023-10-05T11:38:53.142 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.140+0000 7f8b43611880 10 removing key index: WDFHAESUVLDKQVRYPAXX 2023-10-05T11:38:53.142 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.140+0000 7f8b43611880 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.keys:WDFHAESUVLDKQVRYPAXX, ofs0, ns] 2023-10-05T11:38:53.143 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.140+0000 7f8b39a82640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1052266987557 cookie 93967125620736 notifier 5864 bl.length()=170 2023-10-05T11:38:53.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.143+0000 7f8b43611880 10 removing email index: ragweed.client.0+test@test.test 2023-10-05T11:38:53.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.143+0000 7f8b43611880 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.email:ragweed.client.0+test@test.test, ofs0, ns] 2023-10-05T11:38:53.146 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.143+0000 7f8b39a82640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1052266987565 cookie 93967125622784 notifier 5864 bl.length()=182 2023-10-05T11:38:53.148 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.145+0000 7f8b43611880 10 removing user buckets index 2023-10-05T11:38:53.148 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.145+0000 7f8b43611880 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:ragweed.client.0.buckets, ofs0, ns] 2023-10-05T11:38:53.148 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.146+0000 7f8b3a283640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1052266987558 cookie 93967125752832 notifier 5864 bl.length()=173 2023-10-05T11:38:53.150 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.148+0000 7f8b43611880 10 removing user index: ragweed.client.0 2023-10-05T11:38:53.150 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.148+0000 7f8b43611880 10 removing default.rgw.meta+users.uid+ragweed.client.0 from cache 2023-10-05T11:38:53.151 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.148+0000 7f8b43611880 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:ragweed.client.0, ofs0, ns] 2023-10-05T11:38:53.151 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.148+0000 7f8b39a82640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1052266987558 cookie 93967125751808 notifier 5864 bl.length()=165 2023-10-05T11:38:53.156 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.154+0000 7f8b26a5c640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:38:53.158 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.156+0000 7f8b43611880 20 remove_watcher() i=0 2023-10-05T11:38:53.158 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.156+0000 7f8b43611880 2 removed watcher, disabling cache 2023-10-05T11:38:53.159 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.157+0000 7f8b43611880 20 remove_watcher() i=1 2023-10-05T11:38:53.160 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.158+0000 7f8b43611880 20 remove_watcher() i=2 2023-10-05T11:38:53.161 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.159+0000 7f8b43611880 20 remove_watcher() i=3 2023-10-05T11:38:53.162 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.160+0000 7f8b43611880 20 remove_watcher() i=4 2023-10-05T11:38:53.163 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.161+0000 7f8b43611880 20 remove_watcher() i=5 2023-10-05T11:38:53.164 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.162+0000 7f8b43611880 20 remove_watcher() i=6 2023-10-05T11:38:53.165 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.163+0000 7f8b43611880 20 remove_watcher() i=7 2023-10-05T11:38:53.171 DEBUG:teuthology.orchestra.run.smithi012:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid sysuser.client.0 --purge-data 2023-10-05T11:38:53.254 INFO:teuthology.orchestra.run.smithi012.stderr:ignoring --setuser ceph since I am not root 2023-10-05T11:38:53.254 INFO:teuthology.orchestra.run.smithi012.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T11:38:53.265 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.262+0000 7f8b0a528880 20 rados->read ofs=0 len=0 2023-10-05T11:38:53.266 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.263+0000 7f8b0a528880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:38:53.266 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.263+0000 7f8b0a528880 20 realm 2023-10-05T11:38:53.266 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.263+0000 7f8b0a528880 20 rados->read ofs=0 len=0 2023-10-05T11:38:53.267 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.264+0000 7f8b0a528880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:38:53.267 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.264+0000 7f8b0a528880 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T11:38:53.267 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.264+0000 7f8b0a528880 20 rados->read ofs=0 len=0 2023-10-05T11:38:53.267 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.264+0000 7f8b0a528880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:38:53.267 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.264+0000 7f8b0a528880 20 rados->read ofs=0 len=0 2023-10-05T11:38:53.267 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.265+0000 7f8b0a528880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:38:53.267 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.265+0000 7f8b0a528880 20 rados->read ofs=0 len=0 2023-10-05T11:38:53.268 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.265+0000 7f8b0a528880 20 rados_obj.operate() r=0 bl.length=1020 2023-10-05T11:38:53.268 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.265+0000 7f8b0a528880 20 searching for the correct realm 2023-10-05T11:38:53.276 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.274+0000 7f8b06e1c640 0 -- 172.21.15.12:0/175291866 >> [v2:172.21.15.12:6800/732466381,v1:172.21.15.12:6801/732466381] conn(0x55a67cb53800 msgr2=0x55a67cb58b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-10-05T11:38:53.279 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.276+0000 7f8b0a528880 20 RGWRados::pool_iterate: got zone_info.dff27d1e-df33-400e-a68a-7ba586947c99 2023-10-05T11:38:53.279 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.276+0000 7f8b0a528880 20 RGWRados::pool_iterate: got zonegroup_info.c78aa576-9d15-4e9d-b3c0-4af23a22062c 2023-10-05T11:38:53.279 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.276+0000 7f8b0a528880 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T11:38:53.279 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.276+0000 7f8b0a528880 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T11:38:53.279 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.276+0000 7f8b0a528880 20 rados->read ofs=0 len=0 2023-10-05T11:38:53.279 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.276+0000 7f8b0a528880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:38:53.279 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.276+0000 7f8b0a528880 20 rados->read ofs=0 len=0 2023-10-05T11:38:53.279 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.277+0000 7f8b0a528880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:38:53.280 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.277+0000 7f8b0a528880 20 rados->read ofs=0 len=0 2023-10-05T11:38:53.280 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.277+0000 7f8b0a528880 20 rados_obj.operate() r=0 bl.length=454 2023-10-05T11:38:53.281 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.277+0000 7f8b0a528880 20 zone default found 2023-10-05T11:38:53.281 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.277+0000 7f8b0a528880 4 Realm: () 2023-10-05T11:38:53.281 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.277+0000 7f8b0a528880 4 ZoneGroup: default (c78aa576-9d15-4e9d-b3c0-4af23a22062c) 2023-10-05T11:38:53.281 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.277+0000 7f8b0a528880 4 Zone: default (dff27d1e-df33-400e-a68a-7ba586947c99) 2023-10-05T11:38:53.281 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.277+0000 7f8b0a528880 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T11:38:53.281 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.277+0000 7f8b0a528880 20 zonegroup default 2023-10-05T11:38:53.281 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.277+0000 7f8b0a528880 20 rados->read ofs=0 len=0 2023-10-05T11:38:53.281 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.277+0000 7f8b0a528880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:38:53.281 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.277+0000 7f8b0a528880 20 rados->read ofs=0 len=0 2023-10-05T11:38:53.281 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.278+0000 7f8b0a528880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:38:53.281 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.278+0000 7f8b0a528880 20 rados->read ofs=0 len=0 2023-10-05T11:38:53.282 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.278+0000 7f8b0a528880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:38:53.282 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.278+0000 7f8b0a528880 20 started sync module instance, tier type = 2023-10-05T11:38:53.282 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.278+0000 7f8b0a528880 20 started zone id=dff27d1e-df33-400e-a68a-7ba586947c99 (name=default) with tier type = 2023-10-05T11:38:53.284 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.282+0000 7f8b0661b640 0 -- 172.21.15.12:0/175291866 >> [v2:172.21.15.170:6824/75773779,v1:172.21.15.170:6825/75773779] conn(0x55a67cc36000 msgr2=0x55a67cab1180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:38:53.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.286+0000 7f8b0a528880 20 add_watcher() i=0 2023-10-05T11:38:53.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.286+0000 7f8b0a528880 20 add_watcher() i=1 2023-10-05T11:38:53.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.286+0000 7f8b0a528880 20 add_watcher() i=2 2023-10-05T11:38:53.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.286+0000 7f8b0a528880 20 add_watcher() i=3 2023-10-05T11:38:53.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.286+0000 7f8b0a528880 20 add_watcher() i=4 2023-10-05T11:38:53.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.286+0000 7f8b0a528880 20 add_watcher() i=5 2023-10-05T11:38:53.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.286+0000 7f8b0a528880 20 add_watcher() i=6 2023-10-05T11:38:53.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.287+0000 7f8b0a528880 20 add_watcher() i=7 2023-10-05T11:38:53.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.287+0000 7f8b0a528880 2 all 8 watchers are set, enabling cache 2023-10-05T11:38:53.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.289+0000 7f8aeddea640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:38:53.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.289+0000 7f8b0a528880 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T11:38:53.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.289+0000 7f8b0a528880 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T11:38:53.333 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.329+0000 7f8ae95e1640 20 reqs_thread_entry: start 2023-10-05T11:38:53.334 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.329+0000 7f8b0a528880 20 init_complete bucket index max shards: 11 2023-10-05T11:38:53.334 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.329+0000 7f8b0a528880 20 Filter name: none 2023-10-05T11:38:53.334 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.329+0000 7f8ae75dd640 20 reqs_thread_entry: start 2023-10-05T11:38:53.334 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.329+0000 7f8b0a528880 10 cache get: name=default.rgw.meta+users.uid+sysuser.client.0 : miss 2023-10-05T11:38:53.334 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.329+0000 7f8b0a528880 20 rados->read ofs=0 len=0 2023-10-05T11:38:53.334 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.329+0000 7f8b0a528880 20 rados_obj.operate() r=0 bl.length=452 2023-10-05T11:38:53.334 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.329+0000 7f8b0a528880 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x13 2023-10-05T11:38:53.334 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.329+0000 7f8b0a528880 10 adding default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2023-10-05T11:38:53.334 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.329+0000 7f8b0a528880 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T11:38:53.334 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.330+0000 7f8b0a528880 10 removing key index: TUHUZRMEGNHRRNUFSDHH 2023-10-05T11:38:53.335 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.330+0000 7f8b0a528880 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.keys:TUHUZRMEGNHRRNUFSDHH, ofs0, ns] 2023-10-05T11:38:53.335 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.330+0000 7f8b01611640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1052266987559 cookie 94173546213376 notifier 5882 bl.length()=170 2023-10-05T11:38:53.335 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.333+0000 7f8b0a528880 10 removing email index: sysuser.client.0+test@test.test 2023-10-05T11:38:53.335 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.333+0000 7f8b0a528880 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.email:sysuser.client.0+test@test.test, ofs0, ns] 2023-10-05T11:38:53.335 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.333+0000 7f8b01611640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1052266987559 cookie 94173546211328 notifier 5882 bl.length()=182 2023-10-05T11:38:53.337 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.335+0000 7f8b0a528880 10 removing user buckets index 2023-10-05T11:38:53.337 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.335+0000 7f8b0a528880 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.uid:sysuser.client.0.buckets, ofs0, ns] 2023-10-05T11:38:53.338 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.335+0000 7f8b00e10640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1052266987584 cookie 94173546116096 notifier 5882 bl.length()=173 2023-10-05T11:38:53.340 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.337+0000 7f8b0a528880 10 removing user index: sysuser.client.0 2023-10-05T11:38:53.340 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.337+0000 7f8b0a528880 10 removing default.rgw.meta+users.uid+sysuser.client.0 from cache 2023-10-05T11:38:53.340 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.337+0000 7f8b0a528880 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.uid:sysuser.client.0, ofs0, ns] 2023-10-05T11:38:53.340 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.338+0000 7f8b00e10640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1052266987566 cookie 94173546115072 notifier 5882 bl.length()=165 2023-10-05T11:38:53.343 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.341+0000 7f8aeddea640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:38:53.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.343+0000 7f8b0a528880 20 remove_watcher() i=0 2023-10-05T11:38:53.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.343+0000 7f8b0a528880 2 removed watcher, disabling cache 2023-10-05T11:38:53.346 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.344+0000 7f8b0a528880 20 remove_watcher() i=1 2023-10-05T11:38:53.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.345+0000 7f8b0a528880 20 remove_watcher() i=2 2023-10-05T11:38:53.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.346+0000 7f8b0a528880 20 remove_watcher() i=3 2023-10-05T11:38:53.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.347+0000 7f8b0a528880 20 remove_watcher() i=4 2023-10-05T11:38:53.350 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.348+0000 7f8b0a528880 20 remove_watcher() i=5 2023-10-05T11:38:53.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.349+0000 7f8b0a528880 20 remove_watcher() i=6 2023-10-05T11:38:53.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:38:53.350+0000 7f8b0a528880 20 remove_watcher() i=7 2023-10-05T11:38:53.357 INFO:tasks.ragweed:Removing ragweed... 2023-10-05T11:38:53.358 DEBUG:teuthology.orchestra.run.smithi012:> rm -rf /home/ubuntu/cephtest/ragweed.client.0 2023-10-05T11:38:53.467 INFO:teuthology.run_tasks:Running task workunit... 2023-10-05T11:38:53.478 INFO:tasks.workunit:Pulling workunits from ref 38321be854743c0d616618a9ea8aa0b1d4dbc0bf 2023-10-05T11:38:53.478 INFO:tasks.workunit:Making a separate scratch dir for every client... 2023-10-05T11:38:53.479 DEBUG:teuthology.orchestra.run.smithi012:> stat -- /home/ubuntu/cephtest/mnt.0 2023-10-05T11:38:53.495 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-05T11:38:53.495 INFO:teuthology.orchestra.run.smithi012.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2023-10-05T11:38:53.496 DEBUG:teuthology.orchestra.run.smithi012:> mkdir -- /home/ubuntu/cephtest/mnt.0 2023-10-05T11:38:53.550 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2023-10-05T11:38:53.550 DEBUG:teuthology.orchestra.run.smithi012:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2023-10-05T11:38:53.606 INFO:tasks.workunit:timeout=3h 2023-10-05T11:38:53.606 INFO:tasks.workunit:cleanup=True 2023-10-05T11:38:53.607 DEBUG:teuthology.orchestra.run.smithi012:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/pritha-srivastava/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 38321be854743c0d616618a9ea8aa0b1d4dbc0bf 2023-10-05T11:38:53.662 INFO:tasks.workunit.client.0.smithi012.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2023-10-05T11:39:36.059 INFO:tasks.workunit.client.0.smithi012.stderr:Note: switching to '38321be854743c0d616618a9ea8aa0b1d4dbc0bf'. 2023-10-05T11:39:36.059 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:39:36.059 INFO:tasks.workunit.client.0.smithi012.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2023-10-05T11:39:36.059 INFO:tasks.workunit.client.0.smithi012.stderr:changes and commit them, and you can discard any commits you make in this 2023-10-05T11:39:36.060 INFO:tasks.workunit.client.0.smithi012.stderr:state without impacting any branches by switching back to a branch. 2023-10-05T11:39:36.060 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:39:36.060 INFO:tasks.workunit.client.0.smithi012.stderr:If you want to create a new branch to retain commits you create, you may 2023-10-05T11:39:36.060 INFO:tasks.workunit.client.0.smithi012.stderr:do so (now or later) by using -c with the switch command. Example: 2023-10-05T11:39:36.060 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:39:36.060 INFO:tasks.workunit.client.0.smithi012.stderr: git switch -c 2023-10-05T11:39:36.060 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:39:36.060 INFO:tasks.workunit.client.0.smithi012.stderr:Or undo this operation with: 2023-10-05T11:39:36.060 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:39:36.060 INFO:tasks.workunit.client.0.smithi012.stderr: git switch - 2023-10-05T11:39:36.060 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:39:36.060 INFO:tasks.workunit.client.0.smithi012.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2023-10-05T11:39:36.061 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:39:36.061 INFO:tasks.workunit.client.0.smithi012.stderr:HEAD is now at 38321be8547 rgw/d3n: fixes for failures seen in test_multipart_upload. 2023-10-05T11:39:36.064 DEBUG:teuthology.orchestra.run.smithi012:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2023-10-05T11:39:36.119 INFO:tasks.workunit.client.0.smithi012.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2023-10-05T11:39:36.121 INFO:tasks.workunit.client.0.smithi012.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-10-05T11:39:36.122 INFO:tasks.workunit.client.0.smithi012.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2023-10-05T11:39:36.171 INFO:tasks.workunit.client.0.smithi012.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2023-10-05T11:39:36.221 INFO:tasks.workunit.client.0.smithi012.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2023-10-05T11:39:36.261 INFO:tasks.workunit.client.0.smithi012.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-10-05T11:39:36.263 INFO:tasks.workunit.client.0.smithi012.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-10-05T11:39:36.263 INFO:tasks.workunit.client.0.smithi012.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2023-10-05T11:39:36.302 INFO:tasks.workunit.client.0.smithi012.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-10-05T11:39:36.305 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-10-05T11:39:36.305 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2023-10-05T11:39:36.361 INFO:tasks.workunit:Running workunits matching rgw/run-reshard.sh on client.0... 2023-10-05T11:39:36.362 INFO:tasks.workunit:Running workunit rgw/run-reshard.sh... 2023-10-05T11:39:36.363 DEBUG:teuthology.orchestra.run.smithi012:workunit test rgw/run-reshard.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=38321be854743c0d616618a9ea8aa0b1d4dbc0bf TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh 2023-10-05T11:39:36.421 INFO:tasks.workunit.client.0.smithi012.stderr:+ ulimit -c 0 2023-10-05T11:39:36.421 INFO:tasks.workunit.client.0.smithi012.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh 2023-10-05T11:39:36.422 INFO:tasks.workunit.client.0.smithi012.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2023-10-05T11:39:36.422 INFO:tasks.workunit.client.0.smithi012.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2023-10-05T11:39:38.795 INFO:tasks.workunit.client.0.smithi012.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2023-10-05T11:39:38.796 INFO:tasks.workunit.client.0.smithi012.stderr:++ deactivate nondestructive 2023-10-05T11:39:38.796 INFO:tasks.workunit.client.0.smithi012.stderr:++ '[' -n '' ']' 2023-10-05T11:39:38.796 INFO:tasks.workunit.client.0.smithi012.stderr:++ '[' -n '' ']' 2023-10-05T11:39:38.796 INFO:tasks.workunit.client.0.smithi012.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2023-10-05T11:39:38.796 INFO:tasks.workunit.client.0.smithi012.stderr:++ hash -r 2023-10-05T11:39:38.796 INFO:tasks.workunit.client.0.smithi012.stderr:++ '[' -n '' ']' 2023-10-05T11:39:38.796 INFO:tasks.workunit.client.0.smithi012.stderr:++ unset VIRTUAL_ENV 2023-10-05T11:39:38.796 INFO:tasks.workunit.client.0.smithi012.stderr:++ '[' '!' nondestructive = nondestructive ']' 2023-10-05T11:39:38.797 INFO:tasks.workunit.client.0.smithi012.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2023-10-05T11:39:38.797 INFO:tasks.workunit.client.0.smithi012.stderr:++ export VIRTUAL_ENV 2023-10-05T11:39:38.797 INFO:tasks.workunit.client.0.smithi012.stderr:++ _OLD_VIRTUAL_PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2023-10-05T11:39:38.797 INFO:tasks.workunit.client.0.smithi012.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2023-10-05T11:39:38.798 INFO:tasks.workunit.client.0.smithi012.stderr:++ export PATH 2023-10-05T11:39:38.798 INFO:tasks.workunit.client.0.smithi012.stderr:++ '[' -n '' ']' 2023-10-05T11:39:38.798 INFO:tasks.workunit.client.0.smithi012.stderr:++ '[' -z '' ']' 2023-10-05T11:39:38.798 INFO:tasks.workunit.client.0.smithi012.stderr:++ _OLD_VIRTUAL_PS1= 2023-10-05T11:39:38.798 INFO:tasks.workunit.client.0.smithi012.stderr:++ PS1='(rgw) ' 2023-10-05T11:39:38.798 INFO:tasks.workunit.client.0.smithi012.stderr:++ export PS1 2023-10-05T11:39:38.798 INFO:tasks.workunit.client.0.smithi012.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2023-10-05T11:39:38.798 INFO:tasks.workunit.client.0.smithi012.stderr:++ hash -r 2023-10-05T11:39:38.798 INFO:tasks.workunit.client.0.smithi012.stderr:+ pip install pip --upgrade 2023-10-05T11:39:39.037 INFO:tasks.workunit.client.0.smithi012.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.9/site-packages (21.2.3) 2023-10-05T11:39:39.286 INFO:tasks.workunit.client.0.smithi012.stdout:Collecting pip 2023-10-05T11:39:39.292 INFO:tasks.workunit.client.0.smithi012.stdout: Using cached pip-23.2.1-py3-none-any.whl (2.1 MB) 2023-10-05T11:39:39.340 INFO:tasks.workunit.client.0.smithi012.stdout:Installing collected packages: pip 2023-10-05T11:39:39.340 INFO:tasks.workunit.client.0.smithi012.stdout: Attempting uninstall: pip 2023-10-05T11:39:39.340 INFO:tasks.workunit.client.0.smithi012.stdout: Found existing installation: pip 21.2.3 2023-10-05T11:39:39.508 INFO:tasks.workunit.client.0.smithi012.stdout: Uninstalling pip-21.2.3: 2023-10-05T11:39:39.514 INFO:tasks.workunit.client.0.smithi012.stdout: Successfully uninstalled pip-21.2.3 2023-10-05T11:39:40.532 INFO:tasks.workunit.client.0.smithi012.stdout:Successfully installed pip-23.2.1 2023-10-05T11:39:40.579 INFO:tasks.workunit.client.0.smithi012.stderr:+ pip install boto3 2023-10-05T11:39:41.539 INFO:tasks.workunit.client.0.smithi012.stdout:Collecting boto3 2023-10-05T11:39:41.539 INFO:tasks.workunit.client.0.smithi012.stdout: Obtaining dependency information for boto3 from https://files.pythonhosted.org/packages/da/7e/ea3b898a2f7f8b698eb93d808cca4202e2e5ee1887715b28b42fb9b5c71c/boto3-1.28.60-py3-none-any.whl.metadata 2023-10-05T11:39:41.540 INFO:tasks.workunit.client.0.smithi012.stdout: Using cached boto3-1.28.60-py3-none-any.whl.metadata (6.7 kB) 2023-10-05T11:39:42.198 INFO:tasks.workunit.client.0.smithi012.stdout:Collecting botocore<1.32.0,>=1.31.60 (from boto3) 2023-10-05T11:39:42.198 INFO:tasks.workunit.client.0.smithi012.stdout: Obtaining dependency information for botocore<1.32.0,>=1.31.60 from https://files.pythonhosted.org/packages/5d/fa/fb73dceac7f2fd4ad82020696e241315e1ed9525810900ca8e35b7cf9b74/botocore-1.31.60-py3-none-any.whl.metadata 2023-10-05T11:39:42.199 INFO:tasks.workunit.client.0.smithi012.stdout: Using cached botocore-1.31.60-py3-none-any.whl.metadata (6.0 kB) 2023-10-05T11:39:42.264 INFO:tasks.workunit.client.0.smithi012.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2023-10-05T11:39:42.265 INFO:tasks.workunit.client.0.smithi012.stdout: Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2023-10-05T11:39:42.328 INFO:tasks.workunit.client.0.smithi012.stdout:Collecting s3transfer<0.8.0,>=0.7.0 (from boto3) 2023-10-05T11:39:42.328 INFO:tasks.workunit.client.0.smithi012.stdout: Obtaining dependency information for s3transfer<0.8.0,>=0.7.0 from https://files.pythonhosted.org/packages/5a/4b/fec9ce18f8874a96c5061422625ba86c3ee1e6587ccd92ff9f5bf7bd91b2/s3transfer-0.7.0-py3-none-any.whl.metadata 2023-10-05T11:39:42.329 INFO:tasks.workunit.client.0.smithi012.stdout: Using cached s3transfer-0.7.0-py3-none-any.whl.metadata (1.8 kB) 2023-10-05T11:39:42.394 INFO:tasks.workunit.client.0.smithi012.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.32.0,>=1.31.60->boto3) 2023-10-05T11:39:42.396 INFO:tasks.workunit.client.0.smithi012.stdout: Using cached python_dateutil-2.8.2-py2.py3-none-any.whl (247 kB) 2023-10-05T11:39:42.490 INFO:tasks.workunit.client.0.smithi012.stdout:Collecting urllib3<1.27,>=1.25.4 (from botocore<1.32.0,>=1.31.60->boto3) 2023-10-05T11:39:42.491 INFO:tasks.workunit.client.0.smithi012.stdout: Obtaining dependency information for urllib3<1.27,>=1.25.4 from https://files.pythonhosted.org/packages/48/fe/a5c6cc46e9fe9171d7ecf0f33ee7aae14642f8d74baa7af4d7840f9358be/urllib3-1.26.17-py2.py3-none-any.whl.metadata 2023-10-05T11:39:42.492 INFO:tasks.workunit.client.0.smithi012.stdout: Using cached urllib3-1.26.17-py2.py3-none-any.whl.metadata (48 kB) 2023-10-05T11:39:42.651 INFO:tasks.workunit.client.0.smithi012.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.32.0,>=1.31.60->boto3) 2023-10-05T11:39:42.652 INFO:tasks.workunit.client.0.smithi012.stdout: Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2023-10-05T11:39:42.676 INFO:tasks.workunit.client.0.smithi012.stdout:Using cached boto3-1.28.60-py3-none-any.whl (135 kB) 2023-10-05T11:39:42.692 INFO:tasks.workunit.client.0.smithi012.stdout:Using cached botocore-1.31.60-py3-none-any.whl (11.2 MB) 2023-10-05T11:39:42.710 INFO:tasks.workunit.client.0.smithi012.stdout:Using cached s3transfer-0.7.0-py3-none-any.whl (79 kB) 2023-10-05T11:39:42.712 INFO:tasks.workunit.client.0.smithi012.stdout:Using cached urllib3-1.26.17-py2.py3-none-any.whl (143 kB) 2023-10-05T11:39:42.816 INFO:tasks.workunit.client.0.smithi012.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2023-10-05T11:39:44.082 INFO:tasks.workunit.client.0.smithi012.stdout:Successfully installed boto3-1.28.60 botocore-1.31.60 jmespath-1.0.1 python-dateutil-2.8.2 s3transfer-0.7.0 six-1.16.0 urllib3-1.26.17 2023-10-05T11:39:44.205 INFO:tasks.workunit.client.0.smithi012.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_reshard.py 2023-10-05T11:39:44.336 INFO:tasks.workunit.client.0.smithi012.stderr:radosgw-admin user create --uid tester --display-name "Testing" --access-key NX5QOQKC6BH2IDN8HC7A --secret LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn 2023-10-05T11:39:44.372 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setuser ceph since I am not root 2023-10-05T11:39:44.372 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T11:39:44.385 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.381+0000 7ff19df4b880 20 rados->read ofs=0 len=0 2023-10-05T11:39:44.386 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.383+0000 7ff19df4b880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:44.386 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.383+0000 7ff19df4b880 20 realm 2023-10-05T11:39:44.386 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.383+0000 7ff19df4b880 20 rados->read ofs=0 len=0 2023-10-05T11:39:44.387 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.383+0000 7ff19df4b880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:44.387 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.383+0000 7ff19df4b880 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T11:39:44.387 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.383+0000 7ff19df4b880 20 rados->read ofs=0 len=0 2023-10-05T11:39:44.387 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.383+0000 7ff19df4b880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:44.387 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.383+0000 7ff19df4b880 20 rados->read ofs=0 len=0 2023-10-05T11:39:44.387 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.384+0000 7ff19df4b880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:39:44.387 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.384+0000 7ff19df4b880 20 rados->read ofs=0 len=0 2023-10-05T11:39:44.388 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.385+0000 7ff19df4b880 20 rados_obj.operate() r=0 bl.length=1020 2023-10-05T11:39:44.388 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.385+0000 7ff19df4b880 20 searching for the correct realm 2023-10-05T11:39:44.400 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.396+0000 7ff19cef1640 0 -- 172.21.15.12:0/1314680894 >> [v2:172.21.15.170:6800/4137726411,v1:172.21.15.170:6801/4137726411] conn(0x56297c533000 msgr2=0x56297c45d600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:39:44.400 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.396+0000 7ff19df4b880 20 RGWRados::pool_iterate: got zone_info.dff27d1e-df33-400e-a68a-7ba586947c99 2023-10-05T11:39:44.400 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.396+0000 7ff19df4b880 20 RGWRados::pool_iterate: got zonegroup_info.c78aa576-9d15-4e9d-b3c0-4af23a22062c 2023-10-05T11:39:44.400 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.396+0000 7ff19df4b880 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T11:39:44.400 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.396+0000 7ff19df4b880 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T11:39:44.400 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.396+0000 7ff19df4b880 20 rados->read ofs=0 len=0 2023-10-05T11:39:44.400 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.397+0000 7ff19df4b880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:44.400 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.397+0000 7ff19df4b880 20 rados->read ofs=0 len=0 2023-10-05T11:39:44.402 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.397+0000 7ff19df4b880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:39:44.402 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.397+0000 7ff19df4b880 20 rados->read ofs=0 len=0 2023-10-05T11:39:44.402 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.397+0000 7ff19df4b880 20 rados_obj.operate() r=0 bl.length=454 2023-10-05T11:39:44.402 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.397+0000 7ff19df4b880 20 zone default found 2023-10-05T11:39:44.402 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.397+0000 7ff19df4b880 4 Realm: () 2023-10-05T11:39:44.402 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.397+0000 7ff19df4b880 4 ZoneGroup: default (c78aa576-9d15-4e9d-b3c0-4af23a22062c) 2023-10-05T11:39:44.402 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.397+0000 7ff19df4b880 4 Zone: default (dff27d1e-df33-400e-a68a-7ba586947c99) 2023-10-05T11:39:44.402 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.397+0000 7ff19df4b880 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T11:39:44.402 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.397+0000 7ff19df4b880 20 zonegroup default 2023-10-05T11:39:44.402 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.397+0000 7ff19df4b880 20 rados->read ofs=0 len=0 2023-10-05T11:39:44.403 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.397+0000 7ff19df4b880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:44.403 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.397+0000 7ff19df4b880 20 rados->read ofs=0 len=0 2023-10-05T11:39:44.403 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.398+0000 7ff19df4b880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:44.403 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.398+0000 7ff19df4b880 20 rados->read ofs=0 len=0 2023-10-05T11:39:44.403 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.398+0000 7ff19df4b880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:44.403 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.398+0000 7ff19df4b880 20 started sync module instance, tier type = 2023-10-05T11:39:44.403 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.398+0000 7ff19df4b880 20 started zone id=dff27d1e-df33-400e-a68a-7ba586947c99 (name=default) with tier type = 2023-10-05T11:39:44.411 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.407+0000 7ff19cef1640 0 -- 172.21.15.12:0/1314680894 >> [v2:172.21.15.12:6824/2171933159,v1:172.21.15.12:6825/2171933159] conn(0x56297d030000 msgr2=0x56297c399700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:39:44.411 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.408+0000 7ff19df4b880 20 add_watcher() i=0 2023-10-05T11:39:44.411 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.408+0000 7ff19df4b880 20 add_watcher() i=1 2023-10-05T11:39:44.411 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.408+0000 7ff19df4b880 20 add_watcher() i=2 2023-10-05T11:39:44.411 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.408+0000 7ff19df4b880 20 add_watcher() i=3 2023-10-05T11:39:44.411 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.408+0000 7ff19df4b880 20 add_watcher() i=4 2023-10-05T11:39:44.412 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.408+0000 7ff19df4b880 20 add_watcher() i=5 2023-10-05T11:39:44.412 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.408+0000 7ff19df4b880 20 add_watcher() i=6 2023-10-05T11:39:44.412 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.409+0000 7ff19df4b880 20 add_watcher() i=7 2023-10-05T11:39:44.412 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.409+0000 7ff19df4b880 2 all 8 watchers are set, enabling cache 2023-10-05T11:39:44.414 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.411+0000 7ff1836be640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:39:44.414 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.411+0000 7ff19df4b880 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T11:39:44.414 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.411+0000 7ff19df4b880 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T11:39:44.420 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.416+0000 7ff19df4b880 5 note: GC not initialized 2023-10-05T11:39:44.420 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.416+0000 7ff17eeb5640 20 reqs_thread_entry: start 2023-10-05T11:39:44.420 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.417+0000 7ff19df4b880 20 init_complete bucket index max shards: 11 2023-10-05T11:39:44.421 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.417+0000 7ff19df4b880 20 Filter name: none 2023-10-05T11:39:44.421 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.417+0000 7ff17ceb1640 20 reqs_thread_entry: start 2023-10-05T11:39:44.421 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.417+0000 7ff19df4b880 10 cache get: name=default.rgw.meta+users.uid+tester : miss 2023-10-05T11:39:44.421 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.417+0000 7ff19df4b880 20 rados->read ofs=0 len=0 2023-10-05T11:39:44.422 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.417+0000 7ff19df4b880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:44.422 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.417+0000 7ff19df4b880 10 cache put: name=default.rgw.meta+users.uid+tester info.flags=0x0 2023-10-05T11:39:44.422 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.417+0000 7ff19df4b880 10 adding default.rgw.meta+users.uid+tester to cache LRU end 2023-10-05T11:39:44.423 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.417+0000 7ff19df4b880 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : miss 2023-10-05T11:39:44.423 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.417+0000 7ff19df4b880 20 rados->read ofs=0 len=0 2023-10-05T11:39:44.423 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.418+0000 7ff19df4b880 20 rados_obj.operate() r=0 bl.length=22 2023-10-05T11:39:44.423 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.418+0000 7ff19df4b880 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x5 2023-10-05T11:39:44.423 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.418+0000 7ff19df4b880 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2023-10-05T11:39:44.423 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.418+0000 7ff19df4b880 10 cache get: name=default.rgw.meta+users.uid+rgw_datacache_user : miss 2023-10-05T11:39:44.424 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.418+0000 7ff19df4b880 20 rados->read ofs=0 len=0 2023-10-05T11:39:44.424 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.418+0000 7ff19df4b880 20 rados_obj.operate() r=0 bl.length=386 2023-10-05T11:39:44.424 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.418+0000 7ff19df4b880 10 cache put: name=default.rgw.meta+users.uid+rgw_datacache_user info.flags=0x11 2023-10-05T11:39:44.424 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.418+0000 7ff19df4b880 10 adding default.rgw.meta+users.uid+rgw_datacache_user to cache LRU end 2023-10-05T11:39:44.424 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.418+0000 7ff19df4b880 10 chain_cache_entry: cache_locator=default.rgw.meta+users.uid+rgw_datacache_user 2023-10-05T11:39:44.424 INFO:tasks.workunit.client.0.smithi012.stderr:could not create user: unable to parse parameters, duplicate key provided 2023-10-05T11:39:44.424 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.419+0000 7ff1836be640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:39:44.425 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.421+0000 7ff19df4b880 20 remove_watcher() i=0 2023-10-05T11:39:44.425 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.421+0000 7ff19df4b880 2 removed watcher, disabling cache 2023-10-05T11:39:44.426 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.422+0000 7ff19df4b880 20 remove_watcher() i=1 2023-10-05T11:39:44.427 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.424+0000 7ff19df4b880 20 remove_watcher() i=2 2023-10-05T11:39:44.428 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.425+0000 7ff19df4b880 20 remove_watcher() i=3 2023-10-05T11:39:44.429 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.426+0000 7ff19df4b880 20 remove_watcher() i=4 2023-10-05T11:39:44.430 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.427+0000 7ff19df4b880 20 remove_watcher() i=5 2023-10-05T11:39:44.431 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.428+0000 7ff19df4b880 20 remove_watcher() i=6 2023-10-05T11:39:44.432 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.429+0000 7ff19df4b880 20 remove_watcher() i=7 2023-10-05T11:39:44.774 INFO:tasks.workunit.client.0.smithi012.stderr:TEST: reshard add 2023-10-05T11:39:44.774 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:39:44.775 INFO:tasks.workunit.client.0.smithi012.stderr:radosgw-admin bucket stats --bucket a-bucket 2023-10-05T11:39:44.806 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setuser ceph since I am not root 2023-10-05T11:39:44.807 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T11:39:44.819 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.816+0000 7f8e44f36880 20 rados->read ofs=0 len=0 2023-10-05T11:39:44.821 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.817+0000 7f8e44f36880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:44.821 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.817+0000 7f8e44f36880 20 realm 2023-10-05T11:39:44.821 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.817+0000 7f8e44f36880 20 rados->read ofs=0 len=0 2023-10-05T11:39:44.821 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.817+0000 7f8e44f36880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:44.821 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.817+0000 7f8e44f36880 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T11:39:44.821 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.817+0000 7f8e44f36880 20 rados->read ofs=0 len=0 2023-10-05T11:39:44.821 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.817+0000 7f8e44f36880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:44.821 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.817+0000 7f8e44f36880 20 rados->read ofs=0 len=0 2023-10-05T11:39:44.822 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.818+0000 7f8e44f36880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:39:44.822 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.818+0000 7f8e44f36880 20 rados->read ofs=0 len=0 2023-10-05T11:39:44.823 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.819+0000 7f8e44f36880 20 rados_obj.operate() r=0 bl.length=1020 2023-10-05T11:39:44.823 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.819+0000 7f8e44f36880 20 searching for the correct realm 2023-10-05T11:39:44.832 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.829+0000 7f8e42140640 0 -- 172.21.15.12:0/3742539000 >> [v2:172.21.15.12:6824/2171933159,v1:172.21.15.12:6825/2171933159] conn(0x564b8007f400 msgr2=0x564b8006f600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-10-05T11:39:44.835 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.832+0000 7f8e44f36880 20 RGWRados::pool_iterate: got zone_info.dff27d1e-df33-400e-a68a-7ba586947c99 2023-10-05T11:39:44.835 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.832+0000 7f8e44f36880 20 RGWRados::pool_iterate: got zonegroup_info.c78aa576-9d15-4e9d-b3c0-4af23a22062c 2023-10-05T11:39:44.835 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.832+0000 7f8e44f36880 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T11:39:44.835 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.832+0000 7f8e44f36880 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T11:39:44.835 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.832+0000 7f8e44f36880 20 rados->read ofs=0 len=0 2023-10-05T11:39:44.836 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.832+0000 7f8e44f36880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:44.836 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.832+0000 7f8e44f36880 20 rados->read ofs=0 len=0 2023-10-05T11:39:44.837 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.832+0000 7f8e44f36880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:39:44.837 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.832+0000 7f8e44f36880 20 rados->read ofs=0 len=0 2023-10-05T11:39:44.837 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.832+0000 7f8e44f36880 20 rados_obj.operate() r=0 bl.length=454 2023-10-05T11:39:44.837 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.832+0000 7f8e44f36880 20 zone default found 2023-10-05T11:39:44.837 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.832+0000 7f8e44f36880 4 Realm: () 2023-10-05T11:39:44.837 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.832+0000 7f8e44f36880 4 ZoneGroup: default (c78aa576-9d15-4e9d-b3c0-4af23a22062c) 2023-10-05T11:39:44.837 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.832+0000 7f8e44f36880 4 Zone: default (dff27d1e-df33-400e-a68a-7ba586947c99) 2023-10-05T11:39:44.837 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.832+0000 7f8e44f36880 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T11:39:44.837 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.832+0000 7f8e44f36880 20 zonegroup default 2023-10-05T11:39:44.837 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.832+0000 7f8e44f36880 20 rados->read ofs=0 len=0 2023-10-05T11:39:44.838 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.833+0000 7f8e44f36880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:44.838 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.833+0000 7f8e44f36880 20 rados->read ofs=0 len=0 2023-10-05T11:39:44.838 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.833+0000 7f8e44f36880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:44.838 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.833+0000 7f8e44f36880 20 rados->read ofs=0 len=0 2023-10-05T11:39:44.838 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.833+0000 7f8e44f36880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:44.838 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.833+0000 7f8e44f36880 20 started sync module instance, tier type = 2023-10-05T11:39:44.838 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.833+0000 7f8e44f36880 20 started zone id=dff27d1e-df33-400e-a68a-7ba586947c99 (name=default) with tier type = 2023-10-05T11:39:44.842 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.838+0000 7f8e4193f640 0 -- 172.21.15.12:0/3742539000 >> [v2:172.21.15.12:6800/732466381,v1:172.21.15.12:6801/732466381] conn(0x564b8006d800 msgr2=0x564b8006eb00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:39:44.846 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.843+0000 7f8e44f36880 20 add_watcher() i=0 2023-10-05T11:39:44.847 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.843+0000 7f8e44f36880 20 add_watcher() i=1 2023-10-05T11:39:44.847 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.843+0000 7f8e44f36880 20 add_watcher() i=2 2023-10-05T11:39:44.847 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.843+0000 7f8e44f36880 20 add_watcher() i=3 2023-10-05T11:39:44.847 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.843+0000 7f8e44f36880 20 add_watcher() i=4 2023-10-05T11:39:44.847 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.843+0000 7f8e44f36880 20 add_watcher() i=5 2023-10-05T11:39:44.847 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.843+0000 7f8e44f36880 20 add_watcher() i=6 2023-10-05T11:39:44.847 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.844+0000 7f8e44f36880 20 add_watcher() i=7 2023-10-05T11:39:44.848 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.844+0000 7f8e44f36880 2 all 8 watchers are set, enabling cache 2023-10-05T11:39:44.849 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.846+0000 7f8e2890d640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:39:44.849 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.846+0000 7f8e44f36880 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T11:39:44.849 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.846+0000 7f8e44f36880 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T11:39:44.855 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.852+0000 7f8e44f36880 5 note: GC not initialized 2023-10-05T11:39:44.855 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.852+0000 7f8e24104640 20 reqs_thread_entry: start 2023-10-05T11:39:44.856 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.852+0000 7f8e44f36880 20 init_complete bucket index max shards: 11 2023-10-05T11:39:44.856 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.852+0000 7f8e44f36880 20 Filter name: none 2023-10-05T11:39:44.856 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.852+0000 7f8e22100640 20 reqs_thread_entry: start 2023-10-05T11:39:44.856 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.852+0000 7f8e44f36880 20 rados->read ofs=0 len=0 2023-10-05T11:39:44.857 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.853+0000 7f8e44f36880 20 rados_obj.operate() r=0 bl.length=200 2023-10-05T11:39:44.857 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.853+0000 7f8e44f36880 20 rados->read ofs=0 len=0 2023-10-05T11:39:44.857 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.853+0000 7f8e44f36880 20 rados_obj.operate() r=0 bl.length=372 2023-10-05T11:39:44.857 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.853+0000 7f8e44f36880 20 couldn't put binfo cache entry, might have raced with data changes 2023-10-05T11:39:44.857 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.853+0000 7f8e44f36880 20 rados->read ofs=0 len=0 2023-10-05T11:39:44.858 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.854+0000 7f8e44f36880 20 rados_obj.operate() r=0 bl.length=200 2023-10-05T11:39:44.858 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.854+0000 7f8e44f36880 20 rados->read ofs=0 len=0 2023-10-05T11:39:44.858 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.854+0000 7f8e44f36880 20 rados_obj.operate() r=0 bl.length=372 2023-10-05T11:39:44.858 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.854+0000 7f8e44f36880 20 couldn't put binfo cache entry, might have raced with data changes 2023-10-05T11:39:44.858 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.855+0000 7f8e44f36880 20 rados->read ofs=0 len=0 2023-10-05T11:39:44.859 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.855+0000 7f8e44f36880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:44.859 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.856+0000 7f8e2890d640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:39:44.861 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.858+0000 7f8e44f36880 20 remove_watcher() i=0 2023-10-05T11:39:44.861 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.858+0000 7f8e44f36880 2 removed watcher, disabling cache 2023-10-05T11:39:44.862 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.859+0000 7f8e44f36880 20 remove_watcher() i=1 2023-10-05T11:39:44.864 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.860+0000 7f8e44f36880 20 remove_watcher() i=2 2023-10-05T11:39:44.865 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.861+0000 7f8e44f36880 20 remove_watcher() i=3 2023-10-05T11:39:44.866 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.862+0000 7f8e44f36880 20 remove_watcher() i=4 2023-10-05T11:39:44.867 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.863+0000 7f8e44f36880 20 remove_watcher() i=5 2023-10-05T11:39:44.868 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.864+0000 7f8e44f36880 20 remove_watcher() i=6 2023-10-05T11:39:44.868 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.865+0000 7f8e44f36880 20 remove_watcher() i=7 2023-10-05T11:39:44.873 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:39:44.873 INFO:tasks.workunit.client.0.smithi012.stderr:BUCKET_STATS: 2023-10-05T11:39:44.873 INFO:tasks.workunit.client.0.smithi012.stderr:bucket: a-bucket id: dff27d1e-df33-400e-a68a-7ba586947c99.4604.16 num_objects: 0 size_kb: 0 num_shards: 11 2023-10-05T11:39:44.874 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:39:44.875 INFO:tasks.workunit.client.0.smithi012.stderr:radosgw-admin reshard add --bucket a-bucket --num-shards 12 2023-10-05T11:39:44.905 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setuser ceph since I am not root 2023-10-05T11:39:44.905 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T11:39:44.918 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.915+0000 7f3574536880 20 rados->read ofs=0 len=0 2023-10-05T11:39:44.920 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.916+0000 7f3574536880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:44.920 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.916+0000 7f3574536880 20 realm 2023-10-05T11:39:44.920 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.916+0000 7f3574536880 20 rados->read ofs=0 len=0 2023-10-05T11:39:44.920 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.916+0000 7f3574536880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:44.920 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.916+0000 7f3574536880 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T11:39:44.920 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.916+0000 7f3574536880 20 rados->read ofs=0 len=0 2023-10-05T11:39:44.921 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.917+0000 7f3574536880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:44.921 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.917+0000 7f3574536880 20 rados->read ofs=0 len=0 2023-10-05T11:39:44.921 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.917+0000 7f3574536880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:39:44.921 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.918+0000 7f3574536880 20 rados->read ofs=0 len=0 2023-10-05T11:39:44.922 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.918+0000 7f3574536880 20 rados_obj.operate() r=0 bl.length=1020 2023-10-05T11:39:44.922 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.918+0000 7f3574536880 20 searching for the correct realm 2023-10-05T11:39:44.930 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.927+0000 7f35716e9640 0 -- 172.21.15.12:0/2414399374 >> [v2:172.21.15.12:6824/2171933159,v1:172.21.15.12:6825/2171933159] conn(0x55b2281f9c00 msgr2=0x55b228059700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:39:44.932 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.929+0000 7f3574536880 20 RGWRados::pool_iterate: got zone_info.dff27d1e-df33-400e-a68a-7ba586947c99 2023-10-05T11:39:44.932 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.929+0000 7f3574536880 20 RGWRados::pool_iterate: got zonegroup_info.c78aa576-9d15-4e9d-b3c0-4af23a22062c 2023-10-05T11:39:44.932 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.929+0000 7f3574536880 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T11:39:44.932 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.929+0000 7f3574536880 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T11:39:44.933 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.929+0000 7f3574536880 20 rados->read ofs=0 len=0 2023-10-05T11:39:44.933 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.929+0000 7f3574536880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:44.933 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.929+0000 7f3574536880 20 rados->read ofs=0 len=0 2023-10-05T11:39:44.934 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.929+0000 7f3574536880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:39:44.934 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.929+0000 7f3574536880 20 rados->read ofs=0 len=0 2023-10-05T11:39:44.934 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.929+0000 7f3574536880 20 rados_obj.operate() r=0 bl.length=454 2023-10-05T11:39:44.934 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.929+0000 7f3574536880 20 zone default found 2023-10-05T11:39:44.934 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.929+0000 7f3574536880 4 Realm: () 2023-10-05T11:39:44.934 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.929+0000 7f3574536880 4 ZoneGroup: default (c78aa576-9d15-4e9d-b3c0-4af23a22062c) 2023-10-05T11:39:44.934 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.929+0000 7f3574536880 4 Zone: default (dff27d1e-df33-400e-a68a-7ba586947c99) 2023-10-05T11:39:44.935 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.929+0000 7f3574536880 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T11:39:44.935 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.929+0000 7f3574536880 20 zonegroup default 2023-10-05T11:39:44.935 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.929+0000 7f3574536880 20 rados->read ofs=0 len=0 2023-10-05T11:39:44.935 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.930+0000 7f3574536880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:44.935 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.930+0000 7f3574536880 20 rados->read ofs=0 len=0 2023-10-05T11:39:44.935 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.930+0000 7f3574536880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:44.935 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.930+0000 7f3574536880 20 rados->read ofs=0 len=0 2023-10-05T11:39:44.935 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.930+0000 7f3574536880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:44.935 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.930+0000 7f3574536880 20 started sync module instance, tier type = 2023-10-05T11:39:44.935 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.930+0000 7f3574536880 20 started zone id=dff27d1e-df33-400e-a68a-7ba586947c99 (name=default) with tier type = 2023-10-05T11:39:44.938 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.935+0000 7f3570ee8640 0 -- 172.21.15.12:0/2414399374 >> [v2:172.21.15.12:6800/732466381,v1:172.21.15.12:6801/732466381] conn(0x55b2281f8800 msgr2=0x55b22811eb00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-10-05T11:39:44.943 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.939+0000 7f3574536880 20 add_watcher() i=0 2023-10-05T11:39:44.943 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.939+0000 7f3574536880 20 add_watcher() i=1 2023-10-05T11:39:44.943 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.939+0000 7f3574536880 20 add_watcher() i=2 2023-10-05T11:39:44.943 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.939+0000 7f3574536880 20 add_watcher() i=3 2023-10-05T11:39:44.943 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.939+0000 7f3574536880 20 add_watcher() i=4 2023-10-05T11:39:44.943 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.939+0000 7f3574536880 20 add_watcher() i=5 2023-10-05T11:39:44.943 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.939+0000 7f3574536880 20 add_watcher() i=6 2023-10-05T11:39:44.944 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.940+0000 7f3574536880 20 add_watcher() i=7 2023-10-05T11:39:44.944 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.940+0000 7f3574536880 2 all 8 watchers are set, enabling cache 2023-10-05T11:39:44.945 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.942+0000 7f3557eb6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:39:44.946 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.942+0000 7f3574536880 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T11:39:44.946 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.942+0000 7f3574536880 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T11:39:44.952 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.948+0000 7f3574536880 5 note: GC not initialized 2023-10-05T11:39:44.952 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.948+0000 7f35536ad640 20 reqs_thread_entry: start 2023-10-05T11:39:44.952 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.948+0000 7f3574536880 20 init_complete bucket index max shards: 11 2023-10-05T11:39:44.952 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.948+0000 7f3574536880 20 Filter name: none 2023-10-05T11:39:44.952 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.948+0000 7f35516a9640 20 reqs_thread_entry: start 2023-10-05T11:39:44.952 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.948+0000 7f3574536880 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2023-10-05T11:39:44.952 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.948+0000 7f3574536880 20 rados->read ofs=0 len=0 2023-10-05T11:39:44.953 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.949+0000 7f3574536880 20 rados_obj.operate() r=0 bl.length=200 2023-10-05T11:39:44.953 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.949+0000 7f3574536880 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2023-10-05T11:39:44.953 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.949+0000 7f3574536880 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2023-10-05T11:39:44.953 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.949+0000 7f3574536880 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:dff27d1e-df33-400e-a68a-7ba586947c99.4604.16 : miss 2023-10-05T11:39:44.953 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.949+0000 7f3574536880 20 rados->read ofs=0 len=0 2023-10-05T11:39:44.953 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.949+0000 7f3574536880 20 rados_obj.operate() r=0 bl.length=372 2023-10-05T11:39:44.954 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.949+0000 7f3574536880 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:dff27d1e-df33-400e-a68a-7ba586947c99.4604.16 info.flags=0x17 2023-10-05T11:39:44.954 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.949+0000 7f3574536880 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:dff27d1e-df33-400e-a68a-7ba586947c99.4604.16 to cache LRU end 2023-10-05T11:39:44.954 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.949+0000 7f3574536880 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T11:39:44.954 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.949+0000 7f3574536880 10 updating xattr: name=user.rgw.acl bl.length()=203 2023-10-05T11:39:44.954 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.949+0000 7f3574536880 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:dff27d1e-df33-400e-a68a-7ba586947c99.4604.16 2023-10-05T11:39:44.954 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.951+0000 7f3557eb6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:39:44.957 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.953+0000 7f3574536880 20 remove_watcher() i=0 2023-10-05T11:39:44.957 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.953+0000 7f3574536880 2 removed watcher, disabling cache 2023-10-05T11:39:44.958 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.955+0000 7f3574536880 20 remove_watcher() i=1 2023-10-05T11:39:44.959 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.956+0000 7f3574536880 20 remove_watcher() i=2 2023-10-05T11:39:44.960 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.957+0000 7f3574536880 20 remove_watcher() i=3 2023-10-05T11:39:44.961 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.958+0000 7f3574536880 20 remove_watcher() i=4 2023-10-05T11:39:44.962 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.959+0000 7f3574536880 20 remove_watcher() i=5 2023-10-05T11:39:44.963 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.960+0000 7f3574536880 20 remove_watcher() i=6 2023-10-05T11:39:44.964 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:44.961+0000 7f3574536880 20 remove_watcher() i=7 2023-10-05T11:39:44.970 INFO:tasks.workunit.client.0.smithi012.stderr:radosgw-admin reshard list 2023-10-05T11:39:44.997 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setuser ceph since I am not root 2023-10-05T11:39:44.997 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T11:39:45.009 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.006+0000 7fef2bf26880 20 rados->read ofs=0 len=0 2023-10-05T11:39:45.011 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.008+0000 7fef2bf26880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:45.011 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.008+0000 7fef2bf26880 20 realm 2023-10-05T11:39:45.011 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.008+0000 7fef2bf26880 20 rados->read ofs=0 len=0 2023-10-05T11:39:45.012 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.008+0000 7fef2bf26880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:45.012 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.008+0000 7fef2bf26880 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T11:39:45.012 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.008+0000 7fef2bf26880 20 rados->read ofs=0 len=0 2023-10-05T11:39:45.012 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.008+0000 7fef2bf26880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:45.012 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.008+0000 7fef2bf26880 20 rados->read ofs=0 len=0 2023-10-05T11:39:45.012 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.009+0000 7fef2bf26880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:39:45.012 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.009+0000 7fef2bf26880 20 rados->read ofs=0 len=0 2023-10-05T11:39:45.013 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.010+0000 7fef2bf26880 20 rados_obj.operate() r=0 bl.length=1020 2023-10-05T11:39:45.013 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.010+0000 7fef2bf26880 20 searching for the correct realm 2023-10-05T11:39:45.023 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.019+0000 7fef287d9640 0 -- 172.21.15.12:0/3354464635 >> [v2:172.21.15.170:6814/3150808418,v1:172.21.15.170:6816/3150808418] conn(0x55c9f1b6dc00 msgr2=0x55c9f0f84c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:39:45.024 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.021+0000 7fef2bf26880 20 RGWRados::pool_iterate: got zone_info.dff27d1e-df33-400e-a68a-7ba586947c99 2023-10-05T11:39:45.024 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.021+0000 7fef2bf26880 20 RGWRados::pool_iterate: got zonegroup_info.c78aa576-9d15-4e9d-b3c0-4af23a22062c 2023-10-05T11:39:45.024 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.021+0000 7fef2bf26880 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T11:39:45.024 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.021+0000 7fef2bf26880 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T11:39:45.025 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.021+0000 7fef2bf26880 20 rados->read ofs=0 len=0 2023-10-05T11:39:45.025 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.021+0000 7fef2bf26880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:45.025 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.021+0000 7fef2bf26880 20 rados->read ofs=0 len=0 2023-10-05T11:39:45.025 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.021+0000 7fef2bf26880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:39:45.025 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.021+0000 7fef2bf26880 20 rados->read ofs=0 len=0 2023-10-05T11:39:45.026 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.021+0000 7fef2bf26880 20 rados_obj.operate() r=0 bl.length=454 2023-10-05T11:39:45.026 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.021+0000 7fef2bf26880 20 zone default found 2023-10-05T11:39:45.026 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.021+0000 7fef2bf26880 4 Realm: () 2023-10-05T11:39:45.026 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.021+0000 7fef2bf26880 4 ZoneGroup: default (c78aa576-9d15-4e9d-b3c0-4af23a22062c) 2023-10-05T11:39:45.026 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.021+0000 7fef2bf26880 4 Zone: default (dff27d1e-df33-400e-a68a-7ba586947c99) 2023-10-05T11:39:45.026 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.021+0000 7fef2bf26880 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T11:39:45.026 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.021+0000 7fef2bf26880 20 zonegroup default 2023-10-05T11:39:45.027 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.021+0000 7fef2bf26880 20 rados->read ofs=0 len=0 2023-10-05T11:39:45.027 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.021+0000 7fef2bf26880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:45.027 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.021+0000 7fef2bf26880 20 rados->read ofs=0 len=0 2023-10-05T11:39:45.027 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.022+0000 7fef2bf26880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:45.027 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.022+0000 7fef2bf26880 20 rados->read ofs=0 len=0 2023-10-05T11:39:45.027 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.022+0000 7fef2bf26880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:45.027 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.022+0000 7fef2bf26880 20 started sync module instance, tier type = 2023-10-05T11:39:45.027 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.022+0000 7fef2bf26880 20 started zone id=dff27d1e-df33-400e-a68a-7ba586947c99 (name=default) with tier type = 2023-10-05T11:39:45.032 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.029+0000 7fef28fda640 0 -- 172.21.15.12:0/3354464635 >> [v2:172.21.15.170:6800/4137726411,v1:172.21.15.170:6801/4137726411] conn(0x55c9f1039800 msgr2=0x55c9f103f600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:39:45.035 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.031+0000 7fef2bf26880 20 add_watcher() i=0 2023-10-05T11:39:45.035 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.031+0000 7fef2bf26880 20 add_watcher() i=1 2023-10-05T11:39:45.035 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.031+0000 7fef2bf26880 20 add_watcher() i=2 2023-10-05T11:39:45.035 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.031+0000 7fef2bf26880 20 add_watcher() i=3 2023-10-05T11:39:45.035 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.031+0000 7fef2bf26880 20 add_watcher() i=4 2023-10-05T11:39:45.035 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.031+0000 7fef2bf26880 20 add_watcher() i=5 2023-10-05T11:39:45.035 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.031+0000 7fef2bf26880 20 add_watcher() i=6 2023-10-05T11:39:45.036 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.032+0000 7fef2bf26880 20 add_watcher() i=7 2023-10-05T11:39:45.036 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.032+0000 7fef2bf26880 2 all 8 watchers are set, enabling cache 2023-10-05T11:39:45.037 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.034+0000 7fef0f7a7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:39:45.037 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.034+0000 7fef2bf26880 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T11:39:45.037 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.034+0000 7fef2bf26880 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T11:39:45.043 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.039+0000 7fef2bf26880 5 note: GC not initialized 2023-10-05T11:39:45.043 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.039+0000 7fef0af9e640 20 reqs_thread_entry: start 2023-10-05T11:39:45.043 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.040+0000 7fef2bf26880 20 init_complete bucket index max shards: 11 2023-10-05T11:39:45.043 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.040+0000 7fef2bf26880 20 Filter name: none 2023-10-05T11:39:45.043 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.040+0000 7fef08f9a640 20 reqs_thread_entry: start 2023-10-05T11:39:45.052 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.049+0000 7fef0f7a7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:39:45.054 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.051+0000 7fef2bf26880 20 remove_watcher() i=0 2023-10-05T11:39:45.054 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.051+0000 7fef2bf26880 2 removed watcher, disabling cache 2023-10-05T11:39:45.055 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.052+0000 7fef2bf26880 20 remove_watcher() i=1 2023-10-05T11:39:45.056 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.053+0000 7fef2bf26880 20 remove_watcher() i=2 2023-10-05T11:39:45.057 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.054+0000 7fef2bf26880 20 remove_watcher() i=3 2023-10-05T11:39:45.058 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.055+0000 7fef2bf26880 20 remove_watcher() i=4 2023-10-05T11:39:45.059 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.056+0000 7fef2bf26880 20 remove_watcher() i=5 2023-10-05T11:39:45.060 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.057+0000 7fef2bf26880 20 remove_watcher() i=6 2023-10-05T11:39:45.061 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.058+0000 7fef2bf26880 20 remove_watcher() i=7 2023-10-05T11:39:45.066 INFO:tasks.workunit.client.0.smithi012.stderr:bucket name a-bucket 2023-10-05T11:39:45.066 INFO:tasks.workunit.client.0.smithi012.stderr:TEST: reshard process 2023-10-05T11:39:45.066 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:39:45.067 INFO:tasks.workunit.client.0.smithi012.stderr:radosgw-admin reshard process 2023-10-05T11:39:45.094 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setuser ceph since I am not root 2023-10-05T11:39:45.094 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T11:39:45.309 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.305+0000 7fa95b121880 20 rados->read ofs=0 len=0 2023-10-05T11:39:45.310 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.306+0000 7fa95b121880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:45.310 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.306+0000 7fa95b121880 20 realm 2023-10-05T11:39:45.310 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.306+0000 7fa95b121880 20 rados->read ofs=0 len=0 2023-10-05T11:39:45.310 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.307+0000 7fa95b121880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:45.310 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.307+0000 7fa95b121880 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T11:39:45.310 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.307+0000 7fa95b121880 20 rados->read ofs=0 len=0 2023-10-05T11:39:45.310 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.307+0000 7fa95b121880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:45.311 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.307+0000 7fa95b121880 20 rados->read ofs=0 len=0 2023-10-05T11:39:45.311 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.308+0000 7fa95b121880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:39:45.311 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.308+0000 7fa95b121880 20 rados->read ofs=0 len=0 2023-10-05T11:39:45.312 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.308+0000 7fa95b121880 20 rados_obj.operate() r=0 bl.length=1020 2023-10-05T11:39:45.312 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.308+0000 7fa95b121880 20 searching for the correct realm 2023-10-05T11:39:45.319 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.316+0000 7fa957acc640 0 -- 172.21.15.12:0/835868019 >> [v2:172.21.15.12:6808/396693578,v1:172.21.15.12:6809/396693578] conn(0x562f0dfc2000 msgr2=0x562f0df8cc00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:39:45.323 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.319+0000 7fa95b121880 20 RGWRados::pool_iterate: got zone_info.dff27d1e-df33-400e-a68a-7ba586947c99 2023-10-05T11:39:45.323 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.319+0000 7fa95b121880 20 RGWRados::pool_iterate: got zonegroup_info.c78aa576-9d15-4e9d-b3c0-4af23a22062c 2023-10-05T11:39:45.323 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.319+0000 7fa95b121880 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T11:39:45.323 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.319+0000 7fa95b121880 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T11:39:45.323 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.319+0000 7fa95b121880 20 rados->read ofs=0 len=0 2023-10-05T11:39:45.323 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.320+0000 7fa95b121880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:45.323 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.320+0000 7fa95b121880 20 rados->read ofs=0 len=0 2023-10-05T11:39:45.324 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.320+0000 7fa95b121880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:39:45.325 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.320+0000 7fa95b121880 20 rados->read ofs=0 len=0 2023-10-05T11:39:45.325 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.320+0000 7fa95b121880 20 rados_obj.operate() r=0 bl.length=454 2023-10-05T11:39:45.325 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.320+0000 7fa95b121880 20 zone default found 2023-10-05T11:39:45.325 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.320+0000 7fa95b121880 4 Realm: () 2023-10-05T11:39:45.325 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.320+0000 7fa95b121880 4 ZoneGroup: default (c78aa576-9d15-4e9d-b3c0-4af23a22062c) 2023-10-05T11:39:45.325 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.320+0000 7fa95b121880 4 Zone: default (dff27d1e-df33-400e-a68a-7ba586947c99) 2023-10-05T11:39:45.325 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.320+0000 7fa95b121880 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T11:39:45.325 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.320+0000 7fa95b121880 20 zonegroup default 2023-10-05T11:39:45.325 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.320+0000 7fa95b121880 20 rados->read ofs=0 len=0 2023-10-05T11:39:45.325 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.320+0000 7fa95b121880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:45.325 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.320+0000 7fa95b121880 20 rados->read ofs=0 len=0 2023-10-05T11:39:45.326 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.321+0000 7fa95b121880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:45.326 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.321+0000 7fa95b121880 20 rados->read ofs=0 len=0 2023-10-05T11:39:45.326 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.321+0000 7fa95b121880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:45.326 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.321+0000 7fa95b121880 20 started sync module instance, tier type = 2023-10-05T11:39:45.326 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.321+0000 7fa95b121880 20 started zone id=dff27d1e-df33-400e-a68a-7ba586947c99 (name=default) with tier type = 2023-10-05T11:39:45.326 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.322+0000 7fa9582cd640 0 -- 172.21.15.12:0/835868019 >> [v2:172.21.15.170:6800/4137726411,v1:172.21.15.170:6801/4137726411] conn(0x562f0dfa3c00 msgr2=0x562f0df8c680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:39:45.334 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.330+0000 7fa95b121880 20 add_watcher() i=0 2023-10-05T11:39:45.334 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.330+0000 7fa95b121880 20 add_watcher() i=1 2023-10-05T11:39:45.334 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.330+0000 7fa95b121880 20 add_watcher() i=2 2023-10-05T11:39:45.334 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.330+0000 7fa95b121880 20 add_watcher() i=3 2023-10-05T11:39:45.334 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.330+0000 7fa95b121880 20 add_watcher() i=4 2023-10-05T11:39:45.334 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.330+0000 7fa95b121880 20 add_watcher() i=5 2023-10-05T11:39:45.334 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.330+0000 7fa95b121880 20 add_watcher() i=6 2023-10-05T11:39:45.335 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.331+0000 7fa95b121880 20 add_watcher() i=7 2023-10-05T11:39:45.335 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.331+0000 7fa95b121880 2 all 8 watchers are set, enabling cache 2023-10-05T11:39:45.336 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.333+0000 7fa93ea9a640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:39:45.336 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.333+0000 7fa95b121880 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T11:39:45.337 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.333+0000 7fa95b121880 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T11:39:45.342 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.338+0000 7fa95b121880 5 note: GC not initialized 2023-10-05T11:39:45.342 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.339+0000 7fa93a291640 20 reqs_thread_entry: start 2023-10-05T11:39:45.342 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.339+0000 7fa95b121880 20 init_complete bucket index max shards: 11 2023-10-05T11:39:45.342 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.339+0000 7fa95b121880 20 Filter name: none 2023-10-05T11:39:45.343 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.339+0000 7fa93828d640 20 reqs_thread_entry: start 2023-10-05T11:39:45.343 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.339+0000 7fa95b121880 20 processing logshard = reshard.0000000000 2023-10-05T11:39:45.345 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.342+0000 7fa95b121880 20 finish processing logshard = reshard.0000000000 , ret = 0 2023-10-05T11:39:45.345 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.342+0000 7fa95b121880 20 processing logshard = reshard.0000000001 2023-10-05T11:39:45.348 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.345+0000 7fa95b121880 20 finish processing logshard = reshard.0000000001 , ret = 0 2023-10-05T11:39:45.348 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.345+0000 7fa95b121880 20 processing logshard = reshard.0000000002 2023-10-05T11:39:45.351 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.347+0000 7fa95b121880 20 finish processing logshard = reshard.0000000002 , ret = 0 2023-10-05T11:39:45.351 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.347+0000 7fa95b121880 20 processing logshard = reshard.0000000003 2023-10-05T11:39:45.353 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.350+0000 7fa95b121880 20 finish processing logshard = reshard.0000000003 , ret = 0 2023-10-05T11:39:45.353 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.350+0000 7fa95b121880 20 processing logshard = reshard.0000000004 2023-10-05T11:39:45.357 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.353+0000 7fa95b121880 20 finish processing logshard = reshard.0000000004 , ret = 0 2023-10-05T11:39:45.357 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.353+0000 7fa95b121880 20 processing logshard = reshard.0000000005 2023-10-05T11:39:45.359 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.356+0000 7fa95b121880 20 finish processing logshard = reshard.0000000005 , ret = 0 2023-10-05T11:39:45.359 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.356+0000 7fa95b121880 20 processing logshard = reshard.0000000006 2023-10-05T11:39:45.361 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.357+0000 7fa95b121880 20 process_entry resharding a-bucket 2023-10-05T11:39:45.361 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.357+0000 7fa95b121880 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2023-10-05T11:39:45.361 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.357+0000 7fa95b121880 20 rados->read ofs=0 len=0 2023-10-05T11:39:45.361 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.358+0000 7fa95b121880 20 rados_obj.operate() r=0 bl.length=200 2023-10-05T11:39:45.362 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.358+0000 7fa95b121880 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x1 2023-10-05T11:39:45.362 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.358+0000 7fa95b121880 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2023-10-05T11:39:45.362 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.358+0000 7fa95b121880 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:dff27d1e-df33-400e-a68a-7ba586947c99.4604.16 : miss 2023-10-05T11:39:45.362 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.358+0000 7fa95b121880 20 rados->read ofs=0 len=0 2023-10-05T11:39:45.362 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.358+0000 7fa95b121880 20 rados_obj.operate() r=0 bl.length=372 2023-10-05T11:39:45.362 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.358+0000 7fa95b121880 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:dff27d1e-df33-400e-a68a-7ba586947c99.4604.16 info.flags=0x17 2023-10-05T11:39:45.362 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.358+0000 7fa95b121880 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:dff27d1e-df33-400e-a68a-7ba586947c99.4604.16 to cache LRU end 2023-10-05T11:39:45.362 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.358+0000 7fa95b121880 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T11:39:45.362 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.358+0000 7fa95b121880 10 updating xattr: name=user.rgw.acl bl.length()=203 2023-10-05T11:39:45.362 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.358+0000 7fa95b121880 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:dff27d1e-df33-400e-a68a-7ba586947c99.4604.16 2023-10-05T11:39:45.369 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.365+0000 7fa95b121880 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:dff27d1e-df33-400e-a68a-7ba586947c99.4604.16 info.flags=0x17 2023-10-05T11:39:45.369 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.365+0000 7fa95b121880 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:dff27d1e-df33-400e-a68a-7ba586947c99.4604.16 to cache LRU end 2023-10-05T11:39:45.369 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.365+0000 7fa95b121880 10 updating xattr: name=user.rgw.acl bl.length()=203 2023-10-05T11:39:45.370 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.365+0000 7fa95b121880 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:dff27d1e-df33-400e-a68a-7ba586947c99.4604.16, ofs0, ns] 2023-10-05T11:39:45.370 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.365+0000 7fa9522c1640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1060856922154 cookie 94760097950720 notifier 6240 bl.length()=861 2023-10-05T11:39:45.370 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.365+0000 7fa9522c1640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:dff27d1e-df33-400e-a68a-7ba586947c99.4604.16 info.flags=0x17 2023-10-05T11:39:45.370 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.365+0000 7fa9522c1640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:dff27d1e-df33-400e-a68a-7ba586947c99.4604.16 to cache LRU end 2023-10-05T11:39:45.370 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.365+0000 7fa9522c1640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2023-10-05T11:39:45.370 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.367+0000 7fa95b121880 20 handle_bi_update(): bucket=:a-bucket[dff27d1e-df33-400e-a68a-7ba586947c99.4604.16]): orig_sources= new_sources= 2023-10-05T11:39:45.370 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.367+0000 7fa95b121880 20 handle_bi_update(): bucket=:a-bucket[dff27d1e-df33-400e-a68a-7ba586947c99.4604.16]): potential sources added=[] removed=[] 2023-10-05T11:39:45.370 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.367+0000 7fa95b121880 20 handle_bi_update(): bucket=:a-bucket[dff27d1e-df33-400e-a68a-7ba586947c99.4604.16]): orig_dests= new_dests= 2023-10-05T11:39:45.371 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.367+0000 7fa95b121880 20 handle_bi_update(): bucket=:a-bucket[dff27d1e-df33-400e-a68a-7ba586947c99.4604.16]): potential dests added=[] removed=[] 2023-10-05T11:39:45.373 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.369+0000 7fa95b121880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.16.1.0 2023-10-05T11:39:45.373 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.369+0000 7fa95b121880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.16.1.0 2023-10-05T11:39:45.373 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.369+0000 7fa95b121880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.16.1.1 2023-10-05T11:39:45.373 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.369+0000 7fa95b121880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.16.1.1 2023-10-05T11:39:45.373 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.369+0000 7fa95b121880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.16.1.2 2023-10-05T11:39:45.373 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.369+0000 7fa95b121880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.16.1.2 2023-10-05T11:39:45.373 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.369+0000 7fa95b121880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.16.1.3 2023-10-05T11:39:45.373 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.369+0000 7fa95b121880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.16.1.3 2023-10-05T11:39:45.373 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.369+0000 7fa95b121880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.16.1.4 2023-10-05T11:39:45.373 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.369+0000 7fa95b121880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.16.1.4 2023-10-05T11:39:45.374 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.369+0000 7fa95b121880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.16.1.5 2023-10-05T11:39:45.374 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.369+0000 7fa95b121880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.16.1.5 2023-10-05T11:39:45.374 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.369+0000 7fa95b121880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.16.1.6 2023-10-05T11:39:45.374 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.369+0000 7fa95b121880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.16.1.6 2023-10-05T11:39:45.374 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.369+0000 7fa95b121880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.16.1.7 2023-10-05T11:39:45.374 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.369+0000 7fa95b121880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.16.1.7 2023-10-05T11:39:45.374 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.369+0000 7fa95b121880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.16.1.8 2023-10-05T11:39:45.374 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.369+0000 7fa95b121880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.16.1.8 2023-10-05T11:39:45.374 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.369+0000 7fa95b121880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.16.1.9 2023-10-05T11:39:45.374 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.369+0000 7fa95b121880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.16.1.9 2023-10-05T11:39:45.374 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.369+0000 7fa95b121880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.16.1.10 2023-10-05T11:39:45.375 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.369+0000 7fa95b121880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.16.1.10 2023-10-05T11:39:45.375 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.369+0000 7fa95b121880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.16.1.11 2023-10-05T11:39:45.375 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.369+0000 7fa95b121880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.16.1.11 2023-10-05T11:39:45.375 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.369+0000 7fa95b121880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.16.0 2023-10-05T11:39:45.375 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.370+0000 7fa95b121880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.16.1 2023-10-05T11:39:45.376 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.370+0000 7fa95b121880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.16.2 2023-10-05T11:39:45.376 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.370+0000 7fa95b121880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.16.3 2023-10-05T11:39:45.376 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.371+0000 7fa95b121880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.16.4 2023-10-05T11:39:45.376 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.371+0000 7fa95b121880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.16.5 2023-10-05T11:39:45.376 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.372+0000 7fa95b121880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.16.6 2023-10-05T11:39:45.376 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.372+0000 7fa95b121880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.16.7 2023-10-05T11:39:45.377 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.373+0000 7fa95b121880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.16.8 2023-10-05T11:39:45.377 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.373+0000 7fa95b121880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.16.9 2023-10-05T11:39:45.377 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.374+0000 7fa95b121880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.16.10 2023-10-05T11:39:45.377 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.374+0000 7fa95b121880 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:dff27d1e-df33-400e-a68a-7ba586947c99.4604.16 : hit (requested=0x17, cached=0x17) 2023-10-05T11:39:45.377 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.374+0000 7fa95b121880 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:dff27d1e-df33-400e-a68a-7ba586947c99.4604.16 2023-10-05T11:39:45.379 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.375+0000 7fa95b121880 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:dff27d1e-df33-400e-a68a-7ba586947c99.4604.16 info.flags=0x17 2023-10-05T11:39:45.379 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.375+0000 7fa95b121880 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:dff27d1e-df33-400e-a68a-7ba586947c99.4604.16 to cache LRU end 2023-10-05T11:39:45.379 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.375+0000 7fa95b121880 10 updating xattr: name=user.rgw.acl bl.length()=203 2023-10-05T11:39:45.379 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.375+0000 7fa95b121880 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:dff27d1e-df33-400e-a68a-7ba586947c99.4604.16, ofs0, ns] 2023-10-05T11:39:45.379 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.376+0000 7fa951ac0640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1060856922155 cookie 94760097950720 notifier 6240 bl.length()=829 2023-10-05T11:39:45.380 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.376+0000 7fa951ac0640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:dff27d1e-df33-400e-a68a-7ba586947c99.4604.16 info.flags=0x17 2023-10-05T11:39:45.380 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.376+0000 7fa951ac0640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:dff27d1e-df33-400e-a68a-7ba586947c99.4604.16 to cache LRU end 2023-10-05T11:39:45.380 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.376+0000 7fa951ac0640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2023-10-05T11:39:45.381 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.377+0000 7fa95b121880 20 handle_bi_update(): bucket=:a-bucket[dff27d1e-df33-400e-a68a-7ba586947c99.4604.16]): orig_sources= new_sources= 2023-10-05T11:39:45.381 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.377+0000 7fa95b121880 20 handle_bi_update(): bucket=:a-bucket[dff27d1e-df33-400e-a68a-7ba586947c99.4604.16]): potential sources added=[] removed=[] 2023-10-05T11:39:45.381 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.377+0000 7fa95b121880 20 handle_bi_update(): bucket=:a-bucket[dff27d1e-df33-400e-a68a-7ba586947c99.4604.16]): orig_dests= new_dests= 2023-10-05T11:39:45.381 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.377+0000 7fa95b121880 20 handle_bi_update(): bucket=:a-bucket[dff27d1e-df33-400e-a68a-7ba586947c99.4604.16]): potential dests added=[] removed=[] 2023-10-05T11:39:45.383 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.379+0000 7fa95b121880 1 execute INFO: reshard of bucket "a-bucket" completed successfully 2023-10-05T11:39:45.385 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.380+0000 7fa95b121880 20 process_entry removing reshard queue entry for bucket a-bucket 2023-10-05T11:39:45.385 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.382+0000 7fa95b121880 20 finish processing logshard = reshard.0000000006 , ret = 0 2023-10-05T11:39:45.386 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.382+0000 7fa95b121880 20 processing logshard = reshard.0000000007 2023-10-05T11:39:45.387 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.384+0000 7fa95b121880 20 finish processing logshard = reshard.0000000007 , ret = 0 2023-10-05T11:39:45.388 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.384+0000 7fa95b121880 20 processing logshard = reshard.0000000008 2023-10-05T11:39:45.391 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.388+0000 7fa95b121880 20 finish processing logshard = reshard.0000000008 , ret = 0 2023-10-05T11:39:45.391 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.388+0000 7fa95b121880 20 processing logshard = reshard.0000000009 2023-10-05T11:39:45.393 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.390+0000 7fa95b121880 20 finish processing logshard = reshard.0000000009 , ret = 0 2023-10-05T11:39:45.393 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.390+0000 7fa95b121880 20 processing logshard = reshard.0000000010 2023-10-05T11:39:45.395 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.392+0000 7fa95b121880 20 finish processing logshard = reshard.0000000010 , ret = 0 2023-10-05T11:39:45.395 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.392+0000 7fa95b121880 20 processing logshard = reshard.0000000011 2023-10-05T11:39:45.398 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.394+0000 7fa95b121880 20 finish processing logshard = reshard.0000000011 , ret = 0 2023-10-05T11:39:45.398 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.394+0000 7fa95b121880 20 processing logshard = reshard.0000000012 2023-10-05T11:39:45.400 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.397+0000 7fa95b121880 20 finish processing logshard = reshard.0000000012 , ret = 0 2023-10-05T11:39:45.400 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.397+0000 7fa95b121880 20 processing logshard = reshard.0000000013 2023-10-05T11:39:45.402 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.399+0000 7fa95b121880 20 finish processing logshard = reshard.0000000013 , ret = 0 2023-10-05T11:39:45.402 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.399+0000 7fa95b121880 20 processing logshard = reshard.0000000014 2023-10-05T11:39:45.405 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.401+0000 7fa95b121880 20 finish processing logshard = reshard.0000000014 , ret = 0 2023-10-05T11:39:45.405 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.401+0000 7fa95b121880 20 processing logshard = reshard.0000000015 2023-10-05T11:39:45.407 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.404+0000 7fa95b121880 20 finish processing logshard = reshard.0000000015 , ret = 0 2023-10-05T11:39:45.408 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.405+0000 7fa93ea9a640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:39:45.410 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.407+0000 7fa95b121880 20 remove_watcher() i=0 2023-10-05T11:39:45.410 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.407+0000 7fa95b121880 2 removed watcher, disabling cache 2023-10-05T11:39:45.411 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.408+0000 7fa95b121880 20 remove_watcher() i=1 2023-10-05T11:39:45.412 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.408+0000 7fa95b121880 20 remove_watcher() i=2 2023-10-05T11:39:45.413 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.409+0000 7fa95b121880 20 remove_watcher() i=3 2023-10-05T11:39:45.414 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.411+0000 7fa95b121880 20 remove_watcher() i=4 2023-10-05T11:39:45.415 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.412+0000 7fa95b121880 20 remove_watcher() i=5 2023-10-05T11:39:45.416 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.413+0000 7fa95b121880 20 remove_watcher() i=6 2023-10-05T11:39:45.417 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:45.413+0000 7fa95b121880 20 remove_watcher() i=7 2023-10-05T11:39:50.428 INFO:tasks.workunit.client.0.smithi012.stderr:radosgw-admin bucket stats --bucket a-bucket 2023-10-05T11:39:50.462 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setuser ceph since I am not root 2023-10-05T11:39:50.462 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T11:39:50.478 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:50.474+0000 7f3a74c0f880 20 rados->read ofs=0 len=0 2023-10-05T11:39:50.479 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:50.476+0000 7f3a74c0f880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:50.479 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:50.476+0000 7f3a74c0f880 20 realm 2023-10-05T11:39:50.480 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:50.476+0000 7f3a74c0f880 20 rados->read ofs=0 len=0 2023-10-05T11:39:50.480 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:50.476+0000 7f3a74c0f880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:50.480 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:50.476+0000 7f3a74c0f880 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T11:39:50.480 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:50.476+0000 7f3a74c0f880 20 rados->read ofs=0 len=0 2023-10-05T11:39:50.480 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:50.476+0000 7f3a74c0f880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:50.480 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:50.476+0000 7f3a74c0f880 20 rados->read ofs=0 len=0 2023-10-05T11:39:50.481 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:50.477+0000 7f3a74c0f880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:39:50.481 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:50.477+0000 7f3a74c0f880 20 rados->read ofs=0 len=0 2023-10-05T11:39:50.482 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:50.478+0000 7f3a74c0f880 20 rados_obj.operate() r=0 bl.length=1020 2023-10-05T11:39:50.482 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:50.478+0000 7f3a74c0f880 20 searching for the correct realm 2023-10-05T11:39:50.694 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:50.691+0000 7f3a717e2640 0 -- 172.21.15.12:0/3298379805 >> [v2:172.21.15.12:6813/3341239609,v1:172.21.15.12:6815/3341239609] conn(0x55cc54253800 msgr2=0x55cc5365a680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:39:50.697 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:50.694+0000 7f3a74c0f880 20 RGWRados::pool_iterate: got zone_info.dff27d1e-df33-400e-a68a-7ba586947c99 2023-10-05T11:39:50.697 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:50.694+0000 7f3a74c0f880 20 RGWRados::pool_iterate: got zonegroup_info.c78aa576-9d15-4e9d-b3c0-4af23a22062c 2023-10-05T11:39:50.697 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:50.694+0000 7f3a74c0f880 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T11:39:50.698 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:50.694+0000 7f3a74c0f880 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T11:39:50.698 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:50.694+0000 7f3a74c0f880 20 rados->read ofs=0 len=0 2023-10-05T11:39:50.698 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:50.694+0000 7f3a74c0f880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:50.698 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:50.694+0000 7f3a74c0f880 20 rados->read ofs=0 len=0 2023-10-05T11:39:50.699 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:50.694+0000 7f3a74c0f880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:39:50.699 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:50.694+0000 7f3a74c0f880 20 rados->read ofs=0 len=0 2023-10-05T11:39:50.699 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:50.695+0000 7f3a74c0f880 20 rados_obj.operate() r=0 bl.length=454 2023-10-05T11:39:50.699 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:50.695+0000 7f3a74c0f880 20 zone default found 2023-10-05T11:39:50.699 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:50.695+0000 7f3a74c0f880 4 Realm: () 2023-10-05T11:39:50.699 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:50.695+0000 7f3a74c0f880 4 ZoneGroup: default (c78aa576-9d15-4e9d-b3c0-4af23a22062c) 2023-10-05T11:39:50.699 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:50.695+0000 7f3a74c0f880 4 Zone: default (dff27d1e-df33-400e-a68a-7ba586947c99) 2023-10-05T11:39:50.699 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:50.695+0000 7f3a74c0f880 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T11:39:50.699 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:50.695+0000 7f3a74c0f880 20 zonegroup default 2023-10-05T11:39:50.700 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:50.695+0000 7f3a74c0f880 20 rados->read ofs=0 len=0 2023-10-05T11:39:50.700 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:50.695+0000 7f3a74c0f880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:50.700 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:50.695+0000 7f3a74c0f880 20 rados->read ofs=0 len=0 2023-10-05T11:39:50.700 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:50.695+0000 7f3a74c0f880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:50.700 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:50.695+0000 7f3a74c0f880 20 rados->read ofs=0 len=0 2023-10-05T11:39:50.700 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:50.696+0000 7f3a74c0f880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:50.700 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:50.696+0000 7f3a74c0f880 20 started sync module instance, tier type = 2023-10-05T11:39:50.700 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:50.696+0000 7f3a74c0f880 20 started zone id=dff27d1e-df33-400e-a68a-7ba586947c99 (name=default) with tier type = 2023-10-05T11:39:50.703 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:50.700+0000 7f3a707e0640 0 -- 172.21.15.12:0/3298379805 >> [v2:172.21.15.170:6824/75773779,v1:172.21.15.170:6825/75773779] conn(0x55cc53725c00 msgr2=0x55cc5365b180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:39:50.710 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:50.707+0000 7f3a74c0f880 20 add_watcher() i=0 2023-10-05T11:39:50.711 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:50.707+0000 7f3a74c0f880 20 add_watcher() i=1 2023-10-05T11:39:50.711 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:50.707+0000 7f3a74c0f880 20 add_watcher() i=2 2023-10-05T11:39:50.711 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:50.707+0000 7f3a74c0f880 20 add_watcher() i=3 2023-10-05T11:39:50.711 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:50.707+0000 7f3a74c0f880 20 add_watcher() i=4 2023-10-05T11:39:50.711 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:50.707+0000 7f3a74c0f880 20 add_watcher() i=5 2023-10-05T11:39:50.711 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:50.707+0000 7f3a74c0f880 20 add_watcher() i=6 2023-10-05T11:39:50.712 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:50.708+0000 7f3a74c0f880 20 add_watcher() i=7 2023-10-05T11:39:50.712 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:50.708+0000 7f3a74c0f880 2 all 8 watchers are set, enabling cache 2023-10-05T11:39:50.714 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:50.710+0000 7f3a57faf640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:39:50.714 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:50.711+0000 7f3a74c0f880 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T11:39:50.714 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:50.711+0000 7f3a74c0f880 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T11:39:50.721 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:50.717+0000 7f3a74c0f880 5 note: GC not initialized 2023-10-05T11:39:50.721 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:50.717+0000 7f3a537a6640 20 reqs_thread_entry: start 2023-10-05T11:39:50.721 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:50.717+0000 7f3a74c0f880 20 init_complete bucket index max shards: 11 2023-10-05T11:39:50.721 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:50.718+0000 7f3a74c0f880 20 Filter name: none 2023-10-05T11:39:50.721 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:50.718+0000 7f3a517a2640 20 reqs_thread_entry: start 2023-10-05T11:39:50.721 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:50.718+0000 7f3a74c0f880 20 rados->read ofs=0 len=0 2023-10-05T11:39:50.722 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:50.718+0000 7f3a74c0f880 20 rados_obj.operate() r=0 bl.length=200 2023-10-05T11:39:50.722 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:50.718+0000 7f3a74c0f880 20 rados->read ofs=0 len=0 2023-10-05T11:39:50.723 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:50.719+0000 7f3a74c0f880 20 rados_obj.operate() r=0 bl.length=372 2023-10-05T11:39:50.723 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:50.719+0000 7f3a74c0f880 20 couldn't put binfo cache entry, might have raced with data changes 2023-10-05T11:39:50.723 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:50.719+0000 7f3a74c0f880 20 rados->read ofs=0 len=0 2023-10-05T11:39:50.723 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:50.719+0000 7f3a74c0f880 20 rados_obj.operate() r=0 bl.length=200 2023-10-05T11:39:50.723 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:50.719+0000 7f3a74c0f880 20 rados->read ofs=0 len=0 2023-10-05T11:39:50.723 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:50.720+0000 7f3a74c0f880 20 rados_obj.operate() r=0 bl.length=372 2023-10-05T11:39:50.723 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:50.720+0000 7f3a74c0f880 20 couldn't put binfo cache entry, might have raced with data changes 2023-10-05T11:39:50.724 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:50.721+0000 7f3a74c0f880 20 rados->read ofs=0 len=0 2023-10-05T11:39:50.724 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:50.721+0000 7f3a74c0f880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:50.725 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:50.722+0000 7f3a57faf640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:39:50.728 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:50.724+0000 7f3a74c0f880 20 remove_watcher() i=0 2023-10-05T11:39:50.728 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:50.724+0000 7f3a74c0f880 2 removed watcher, disabling cache 2023-10-05T11:39:50.729 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:50.726+0000 7f3a74c0f880 20 remove_watcher() i=1 2023-10-05T11:39:50.730 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:50.727+0000 7f3a74c0f880 20 remove_watcher() i=2 2023-10-05T11:39:50.731 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:50.728+0000 7f3a74c0f880 20 remove_watcher() i=3 2023-10-05T11:39:50.732 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:50.729+0000 7f3a74c0f880 20 remove_watcher() i=4 2023-10-05T11:39:50.733 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:50.730+0000 7f3a74c0f880 20 remove_watcher() i=5 2023-10-05T11:39:50.735 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:50.731+0000 7f3a74c0f880 20 remove_watcher() i=6 2023-10-05T11:39:50.736 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:50.733+0000 7f3a74c0f880 20 remove_watcher() i=7 2023-10-05T11:39:50.741 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:39:50.741 INFO:tasks.workunit.client.0.smithi012.stderr:BUCKET_STATS: 2023-10-05T11:39:50.741 INFO:tasks.workunit.client.0.smithi012.stderr:bucket: a-bucket id: dff27d1e-df33-400e-a68a-7ba586947c99.4604.16 num_objects: 0 size_kb: 0 num_shards: 12 2023-10-05T11:39:50.741 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:39:50.742 INFO:tasks.workunit.client.0.smithi012.stderr:TEST: reshard add non empty bucket 2023-10-05T11:39:50.742 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:39:50.998 INFO:tasks.workunit.client.0.smithi012.stderr:radosgw-admin bucket stats --bucket a-bucket 2023-10-05T11:39:51.026 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setuser ceph since I am not root 2023-10-05T11:39:51.027 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T11:39:51.039 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.036+0000 7f7106019880 20 rados->read ofs=0 len=0 2023-10-05T11:39:51.041 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.037+0000 7f7106019880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:51.041 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.037+0000 7f7106019880 20 realm 2023-10-05T11:39:51.041 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.037+0000 7f7106019880 20 rados->read ofs=0 len=0 2023-10-05T11:39:51.041 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.037+0000 7f7106019880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:51.041 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.037+0000 7f7106019880 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T11:39:51.041 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.037+0000 7f7106019880 20 rados->read ofs=0 len=0 2023-10-05T11:39:51.041 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.037+0000 7f7106019880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:51.041 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.037+0000 7f7106019880 20 rados->read ofs=0 len=0 2023-10-05T11:39:51.042 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.038+0000 7f7106019880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:39:51.042 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.038+0000 7f7106019880 20 rados->read ofs=0 len=0 2023-10-05T11:39:51.042 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.039+0000 7f7106019880 20 rados_obj.operate() r=0 bl.length=1020 2023-10-05T11:39:51.043 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.039+0000 7f7106019880 20 searching for the correct realm 2023-10-05T11:39:51.054 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.050+0000 7f7102500640 0 -- 172.21.15.12:0/1540857998 >> [v2:172.21.15.170:6814/3150808418,v1:172.21.15.170:6816/3150808418] conn(0x557fbc947c00 msgr2=0x557fbbd4ec00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:39:51.054 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.050+0000 7f7106019880 20 RGWRados::pool_iterate: got zone_info.dff27d1e-df33-400e-a68a-7ba586947c99 2023-10-05T11:39:51.054 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.050+0000 7f7106019880 20 RGWRados::pool_iterate: got zonegroup_info.c78aa576-9d15-4e9d-b3c0-4af23a22062c 2023-10-05T11:39:51.054 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.050+0000 7f7106019880 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T11:39:51.055 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.050+0000 7f7106019880 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T11:39:51.055 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.050+0000 7f7106019880 20 rados->read ofs=0 len=0 2023-10-05T11:39:51.055 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.051+0000 7f7106019880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:51.055 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.051+0000 7f7106019880 20 rados->read ofs=0 len=0 2023-10-05T11:39:51.055 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.051+0000 7f7106019880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:39:51.055 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.051+0000 7f7106019880 20 rados->read ofs=0 len=0 2023-10-05T11:39:51.056 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.051+0000 7f7106019880 20 rados_obj.operate() r=0 bl.length=454 2023-10-05T11:39:51.056 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.051+0000 7f7106019880 20 zone default found 2023-10-05T11:39:51.056 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.051+0000 7f7106019880 4 Realm: () 2023-10-05T11:39:51.056 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.051+0000 7f7106019880 4 ZoneGroup: default (c78aa576-9d15-4e9d-b3c0-4af23a22062c) 2023-10-05T11:39:51.056 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.051+0000 7f7106019880 4 Zone: default (dff27d1e-df33-400e-a68a-7ba586947c99) 2023-10-05T11:39:51.056 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.051+0000 7f7106019880 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T11:39:51.057 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.051+0000 7f7106019880 20 zonegroup default 2023-10-05T11:39:51.057 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.051+0000 7f7106019880 20 rados->read ofs=0 len=0 2023-10-05T11:39:51.057 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.051+0000 7f7106019880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:51.057 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.051+0000 7f7106019880 20 rados->read ofs=0 len=0 2023-10-05T11:39:51.057 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.052+0000 7f7106019880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:51.057 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.052+0000 7f7106019880 20 rados->read ofs=0 len=0 2023-10-05T11:39:51.057 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.052+0000 7f7106019880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:51.057 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.052+0000 7f7106019880 20 started sync module instance, tier type = 2023-10-05T11:39:51.057 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.052+0000 7f7106019880 20 started zone id=dff27d1e-df33-400e-a68a-7ba586947c99 (name=default) with tier type = 2023-10-05T11:39:51.063 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.060+0000 7f7102d01640 0 -- 172.21.15.12:0/1540857998 >> [v2:172.21.15.12:6824/2171933159,v1:172.21.15.12:6825/2171933159] conn(0x557fbbf02400 msgr2=0x557fbbd4f700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:39:51.065 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.061+0000 7f7106019880 20 add_watcher() i=0 2023-10-05T11:39:51.065 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.061+0000 7f7106019880 20 add_watcher() i=1 2023-10-05T11:39:51.065 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.061+0000 7f7106019880 20 add_watcher() i=2 2023-10-05T11:39:51.065 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.061+0000 7f7106019880 20 add_watcher() i=3 2023-10-05T11:39:51.065 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.061+0000 7f7106019880 20 add_watcher() i=4 2023-10-05T11:39:51.065 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.061+0000 7f7106019880 20 add_watcher() i=5 2023-10-05T11:39:51.065 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.061+0000 7f7106019880 20 add_watcher() i=6 2023-10-05T11:39:51.065 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.062+0000 7f7106019880 20 add_watcher() i=7 2023-10-05T11:39:51.066 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.062+0000 7f7106019880 2 all 8 watchers are set, enabling cache 2023-10-05T11:39:51.068 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.065+0000 7f70e94ce640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:39:51.068 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.065+0000 7f7106019880 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T11:39:51.069 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.065+0000 7f7106019880 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T11:39:51.074 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.070+0000 7f7106019880 5 note: GC not initialized 2023-10-05T11:39:51.074 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.071+0000 7f70e4cc5640 20 reqs_thread_entry: start 2023-10-05T11:39:51.074 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.071+0000 7f7106019880 20 init_complete bucket index max shards: 11 2023-10-05T11:39:51.075 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.071+0000 7f7106019880 20 Filter name: none 2023-10-05T11:39:51.075 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.071+0000 7f70e2cc1640 20 reqs_thread_entry: start 2023-10-05T11:39:51.075 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.071+0000 7f7106019880 20 rados->read ofs=0 len=0 2023-10-05T11:39:51.076 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.071+0000 7f7106019880 20 rados_obj.operate() r=0 bl.length=200 2023-10-05T11:39:51.076 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.071+0000 7f7106019880 20 rados->read ofs=0 len=0 2023-10-05T11:39:51.076 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.072+0000 7f7106019880 20 rados_obj.operate() r=0 bl.length=372 2023-10-05T11:39:51.076 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.072+0000 7f7106019880 20 couldn't put binfo cache entry, might have raced with data changes 2023-10-05T11:39:51.076 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.072+0000 7f7106019880 20 rados->read ofs=0 len=0 2023-10-05T11:39:51.076 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.072+0000 7f7106019880 20 rados_obj.operate() r=0 bl.length=200 2023-10-05T11:39:51.076 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.072+0000 7f7106019880 20 rados->read ofs=0 len=0 2023-10-05T11:39:51.076 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.072+0000 7f7106019880 20 rados_obj.operate() r=0 bl.length=372 2023-10-05T11:39:51.076 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.072+0000 7f7106019880 20 couldn't put binfo cache entry, might have raced with data changes 2023-10-05T11:39:51.077 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.073+0000 7f7106019880 20 rados->read ofs=0 len=0 2023-10-05T11:39:51.077 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.074+0000 7f7106019880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:51.078 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.074+0000 7f70e94ce640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:39:51.080 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.077+0000 7f7106019880 20 remove_watcher() i=0 2023-10-05T11:39:51.080 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.077+0000 7f7106019880 2 removed watcher, disabling cache 2023-10-05T11:39:51.081 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.078+0000 7f7106019880 20 remove_watcher() i=1 2023-10-05T11:39:51.082 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.079+0000 7f7106019880 20 remove_watcher() i=2 2023-10-05T11:39:51.083 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.080+0000 7f7106019880 20 remove_watcher() i=3 2023-10-05T11:39:51.286 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.283+0000 7f7106019880 20 remove_watcher() i=4 2023-10-05T11:39:51.287 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.284+0000 7f7106019880 20 remove_watcher() i=5 2023-10-05T11:39:51.288 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.285+0000 7f7106019880 20 remove_watcher() i=6 2023-10-05T11:39:51.289 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.286+0000 7f7106019880 20 remove_watcher() i=7 2023-10-05T11:39:51.294 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:39:51.294 INFO:tasks.workunit.client.0.smithi012.stderr:BUCKET_STATS: 2023-10-05T11:39:51.294 INFO:tasks.workunit.client.0.smithi012.stderr:bucket: a-bucket id: dff27d1e-df33-400e-a68a-7ba586947c99.4604.16 num_objects: 8 size_kb: 1 num_shards: 12 2023-10-05T11:39:51.294 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:39:51.295 INFO:tasks.workunit.client.0.smithi012.stderr:radosgw-admin reshard add --bucket a-bucket --num-shards 13 2023-10-05T11:39:51.326 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setuser ceph since I am not root 2023-10-05T11:39:51.326 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T11:39:51.340 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.336+0000 7f4d60f21880 20 rados->read ofs=0 len=0 2023-10-05T11:39:51.341 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.338+0000 7f4d60f21880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:51.342 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.338+0000 7f4d60f21880 20 realm 2023-10-05T11:39:51.342 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.338+0000 7f4d60f21880 20 rados->read ofs=0 len=0 2023-10-05T11:39:51.342 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.338+0000 7f4d60f21880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:51.342 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.338+0000 7f4d60f21880 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T11:39:51.342 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.338+0000 7f4d60f21880 20 rados->read ofs=0 len=0 2023-10-05T11:39:51.342 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.338+0000 7f4d60f21880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:51.342 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.338+0000 7f4d60f21880 20 rados->read ofs=0 len=0 2023-10-05T11:39:51.342 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.339+0000 7f4d60f21880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:39:51.343 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.339+0000 7f4d60f21880 20 rados->read ofs=0 len=0 2023-10-05T11:39:51.343 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.340+0000 7f4d60f21880 20 rados_obj.operate() r=0 bl.length=1020 2023-10-05T11:39:51.343 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.340+0000 7f4d60f21880 20 searching for the correct realm 2023-10-05T11:39:51.352 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.349+0000 7f4d5d8cc640 0 -- 172.21.15.12:0/3307831228 >> [v2:172.21.15.12:6800/732466381,v1:172.21.15.12:6801/732466381] conn(0x564f8783ac00 msgr2=0x564f87840b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:39:51.354 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.350+0000 7f4d60f21880 20 RGWRados::pool_iterate: got zone_info.dff27d1e-df33-400e-a68a-7ba586947c99 2023-10-05T11:39:51.354 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.350+0000 7f4d60f21880 20 RGWRados::pool_iterate: got zonegroup_info.c78aa576-9d15-4e9d-b3c0-4af23a22062c 2023-10-05T11:39:51.354 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.350+0000 7f4d60f21880 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T11:39:51.354 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.350+0000 7f4d60f21880 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T11:39:51.354 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.350+0000 7f4d60f21880 20 rados->read ofs=0 len=0 2023-10-05T11:39:51.354 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.351+0000 7f4d60f21880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:51.354 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.351+0000 7f4d60f21880 20 rados->read ofs=0 len=0 2023-10-05T11:39:51.355 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.351+0000 7f4d60f21880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:39:51.355 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.351+0000 7f4d60f21880 20 rados->read ofs=0 len=0 2023-10-05T11:39:51.355 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.351+0000 7f4d60f21880 20 rados_obj.operate() r=0 bl.length=454 2023-10-05T11:39:51.356 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.351+0000 7f4d60f21880 20 zone default found 2023-10-05T11:39:51.356 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.351+0000 7f4d60f21880 4 Realm: () 2023-10-05T11:39:51.356 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.351+0000 7f4d60f21880 4 ZoneGroup: default (c78aa576-9d15-4e9d-b3c0-4af23a22062c) 2023-10-05T11:39:51.356 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.351+0000 7f4d60f21880 4 Zone: default (dff27d1e-df33-400e-a68a-7ba586947c99) 2023-10-05T11:39:51.356 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.351+0000 7f4d60f21880 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T11:39:51.356 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.351+0000 7f4d60f21880 20 zonegroup default 2023-10-05T11:39:51.356 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.351+0000 7f4d60f21880 20 rados->read ofs=0 len=0 2023-10-05T11:39:51.356 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.352+0000 7f4d60f21880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:51.356 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.352+0000 7f4d60f21880 20 rados->read ofs=0 len=0 2023-10-05T11:39:51.356 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.352+0000 7f4d60f21880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:51.356 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.352+0000 7f4d60f21880 20 rados->read ofs=0 len=0 2023-10-05T11:39:51.357 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.352+0000 7f4d60f21880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:51.357 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.352+0000 7f4d60f21880 20 started sync module instance, tier type = 2023-10-05T11:39:51.357 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.352+0000 7f4d60f21880 20 started zone id=dff27d1e-df33-400e-a68a-7ba586947c99 (name=default) with tier type = 2023-10-05T11:39:51.361 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.358+0000 7f4d5d8cc640 0 -- 172.21.15.12:0/3307831228 >> [v2:172.21.15.12:6800/732466381,v1:172.21.15.12:6801/732466381] conn(0x564f87944c00 msgr2=0x564f87842100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:39:51.365 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.362+0000 7f4d60f21880 20 add_watcher() i=0 2023-10-05T11:39:51.365 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.362+0000 7f4d60f21880 20 add_watcher() i=1 2023-10-05T11:39:51.365 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.362+0000 7f4d60f21880 20 add_watcher() i=2 2023-10-05T11:39:51.365 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.362+0000 7f4d60f21880 20 add_watcher() i=3 2023-10-05T11:39:51.365 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.362+0000 7f4d60f21880 20 add_watcher() i=4 2023-10-05T11:39:51.366 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.362+0000 7f4d60f21880 20 add_watcher() i=5 2023-10-05T11:39:51.366 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.362+0000 7f4d60f21880 20 add_watcher() i=6 2023-10-05T11:39:51.366 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.363+0000 7f4d60f21880 20 add_watcher() i=7 2023-10-05T11:39:51.366 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.363+0000 7f4d60f21880 2 all 8 watchers are set, enabling cache 2023-10-05T11:39:51.368 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.365+0000 7f4d4489a640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:39:51.368 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.365+0000 7f4d60f21880 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T11:39:51.368 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.365+0000 7f4d60f21880 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T11:39:51.374 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.370+0000 7f4d60f21880 5 note: GC not initialized 2023-10-05T11:39:51.375 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.371+0000 7f4d40091640 20 reqs_thread_entry: start 2023-10-05T11:39:51.375 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.371+0000 7f4d60f21880 20 init_complete bucket index max shards: 11 2023-10-05T11:39:51.375 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.371+0000 7f4d60f21880 20 Filter name: none 2023-10-05T11:39:51.375 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.371+0000 7f4d3e08d640 20 reqs_thread_entry: start 2023-10-05T11:39:51.375 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.371+0000 7f4d60f21880 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2023-10-05T11:39:51.375 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.371+0000 7f4d60f21880 20 rados->read ofs=0 len=0 2023-10-05T11:39:51.375 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.371+0000 7f4d60f21880 20 rados_obj.operate() r=0 bl.length=200 2023-10-05T11:39:51.375 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.371+0000 7f4d60f21880 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2023-10-05T11:39:51.375 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.371+0000 7f4d60f21880 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2023-10-05T11:39:51.375 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.371+0000 7f4d60f21880 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:dff27d1e-df33-400e-a68a-7ba586947c99.4604.16 : miss 2023-10-05T11:39:51.375 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.371+0000 7f4d60f21880 20 rados->read ofs=0 len=0 2023-10-05T11:39:51.376 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.372+0000 7f4d60f21880 20 rados_obj.operate() r=0 bl.length=372 2023-10-05T11:39:51.376 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.372+0000 7f4d60f21880 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:dff27d1e-df33-400e-a68a-7ba586947c99.4604.16 info.flags=0x17 2023-10-05T11:39:51.376 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.372+0000 7f4d60f21880 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:dff27d1e-df33-400e-a68a-7ba586947c99.4604.16 to cache LRU end 2023-10-05T11:39:51.376 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.372+0000 7f4d60f21880 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T11:39:51.376 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.372+0000 7f4d60f21880 10 updating xattr: name=user.rgw.acl bl.length()=203 2023-10-05T11:39:51.376 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.372+0000 7f4d60f21880 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:dff27d1e-df33-400e-a68a-7ba586947c99.4604.16 2023-10-05T11:39:51.377 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.374+0000 7f4d4489a640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:39:51.379 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.376+0000 7f4d60f21880 20 remove_watcher() i=0 2023-10-05T11:39:51.379 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.376+0000 7f4d60f21880 2 removed watcher, disabling cache 2023-10-05T11:39:51.380 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.377+0000 7f4d60f21880 20 remove_watcher() i=1 2023-10-05T11:39:51.381 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.378+0000 7f4d60f21880 20 remove_watcher() i=2 2023-10-05T11:39:51.382 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.379+0000 7f4d60f21880 20 remove_watcher() i=3 2023-10-05T11:39:51.383 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.380+0000 7f4d60f21880 20 remove_watcher() i=4 2023-10-05T11:39:51.384 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.381+0000 7f4d60f21880 20 remove_watcher() i=5 2023-10-05T11:39:51.386 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.382+0000 7f4d60f21880 20 remove_watcher() i=6 2023-10-05T11:39:51.387 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.383+0000 7f4d60f21880 20 remove_watcher() i=7 2023-10-05T11:39:51.392 INFO:tasks.workunit.client.0.smithi012.stderr:radosgw-admin reshard list 2023-10-05T11:39:51.419 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setuser ceph since I am not root 2023-10-05T11:39:51.419 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T11:39:51.629 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.626+0000 7f6ed755b640 0 --2- 172.21.15.12:0/2983576595 >> [v2:172.21.15.12:3301/0,v1:172.21.15.12:6790/0] conn(0x55c19956f000 0x55c198978580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2023-10-05T11:39:51.633 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.630+0000 7f6ed8daf880 20 rados->read ofs=0 len=0 2023-10-05T11:39:51.635 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.631+0000 7f6ed8daf880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:51.635 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.631+0000 7f6ed8daf880 20 realm 2023-10-05T11:39:51.635 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.631+0000 7f6ed8daf880 20 rados->read ofs=0 len=0 2023-10-05T11:39:51.635 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.632+0000 7f6ed8daf880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:51.636 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.632+0000 7f6ed8daf880 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T11:39:51.636 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.632+0000 7f6ed8daf880 20 rados->read ofs=0 len=0 2023-10-05T11:39:51.636 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.632+0000 7f6ed8daf880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:51.636 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.632+0000 7f6ed8daf880 20 rados->read ofs=0 len=0 2023-10-05T11:39:51.636 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.633+0000 7f6ed8daf880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:39:51.636 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.633+0000 7f6ed8daf880 20 rados->read ofs=0 len=0 2023-10-05T11:39:51.637 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.634+0000 7f6ed8daf880 20 rados_obj.operate() r=0 bl.length=1020 2023-10-05T11:39:51.637 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.634+0000 7f6ed8daf880 20 searching for the correct realm 2023-10-05T11:39:51.644 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.641+0000 7f6ed7d5c640 0 -- 172.21.15.12:0/1995340953 >> [v2:172.21.15.12:6813/3341239609,v1:172.21.15.12:6815/3341239609] conn(0x55c19956f800 msgr2=0x55c19897a680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-10-05T11:39:51.648 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.645+0000 7f6ed8daf880 20 RGWRados::pool_iterate: got zone_info.dff27d1e-df33-400e-a68a-7ba586947c99 2023-10-05T11:39:51.648 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.645+0000 7f6ed8daf880 20 RGWRados::pool_iterate: got zonegroup_info.c78aa576-9d15-4e9d-b3c0-4af23a22062c 2023-10-05T11:39:51.649 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.645+0000 7f6ed8daf880 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T11:39:51.649 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.645+0000 7f6ed8daf880 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T11:39:51.649 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.645+0000 7f6ed8daf880 20 rados->read ofs=0 len=0 2023-10-05T11:39:51.649 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.645+0000 7f6ed8daf880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:51.649 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.645+0000 7f6ed8daf880 20 rados->read ofs=0 len=0 2023-10-05T11:39:51.650 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.645+0000 7f6ed8daf880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:39:51.650 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.645+0000 7f6ed8daf880 20 rados->read ofs=0 len=0 2023-10-05T11:39:51.651 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.646+0000 7f6ed8daf880 20 rados_obj.operate() r=0 bl.length=454 2023-10-05T11:39:51.651 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.646+0000 7f6ed8daf880 20 zone default found 2023-10-05T11:39:51.651 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.646+0000 7f6ed8daf880 4 Realm: () 2023-10-05T11:39:51.651 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.646+0000 7f6ed8daf880 4 ZoneGroup: default (c78aa576-9d15-4e9d-b3c0-4af23a22062c) 2023-10-05T11:39:51.651 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.646+0000 7f6ed8daf880 4 Zone: default (dff27d1e-df33-400e-a68a-7ba586947c99) 2023-10-05T11:39:51.651 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.646+0000 7f6ed8daf880 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T11:39:51.651 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.646+0000 7f6ed8daf880 20 zonegroup default 2023-10-05T11:39:51.651 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.646+0000 7f6ed8daf880 20 rados->read ofs=0 len=0 2023-10-05T11:39:51.651 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.646+0000 7f6ed8daf880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:51.651 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.646+0000 7f6ed8daf880 20 rados->read ofs=0 len=0 2023-10-05T11:39:51.651 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.646+0000 7f6ed8daf880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:51.652 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.646+0000 7f6ed8daf880 20 rados->read ofs=0 len=0 2023-10-05T11:39:51.652 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.646+0000 7f6ed7d5c640 0 -- 172.21.15.12:0/1995340953 >> [v2:172.21.15.12:6824/2171933159,v1:172.21.15.12:6825/2171933159] conn(0x55c198a2fc00 msgr2=0x55c19897b700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-10-05T11:39:51.652 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.647+0000 7f6ed8daf880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:51.652 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.647+0000 7f6ed8daf880 20 started sync module instance, tier type = 2023-10-05T11:39:51.652 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.647+0000 7f6ed8daf880 20 started zone id=dff27d1e-df33-400e-a68a-7ba586947c99 (name=default) with tier type = 2023-10-05T11:39:51.660 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.657+0000 7f6ed8daf880 20 add_watcher() i=0 2023-10-05T11:39:51.660 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.657+0000 7f6ed8daf880 20 add_watcher() i=1 2023-10-05T11:39:51.660 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.657+0000 7f6ed8daf880 20 add_watcher() i=2 2023-10-05T11:39:51.661 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.657+0000 7f6ed8daf880 20 add_watcher() i=3 2023-10-05T11:39:51.661 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.657+0000 7f6ed8daf880 20 add_watcher() i=4 2023-10-05T11:39:51.661 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.657+0000 7f6ed8daf880 20 add_watcher() i=5 2023-10-05T11:39:51.661 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.657+0000 7f6ed8daf880 20 add_watcher() i=6 2023-10-05T11:39:51.661 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.658+0000 7f6ed8daf880 20 add_watcher() i=7 2023-10-05T11:39:51.661 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.658+0000 7f6ed8daf880 2 all 8 watchers are set, enabling cache 2023-10-05T11:39:51.663 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.659+0000 7f6ebe529640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:39:51.663 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.659+0000 7f6ed8daf880 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T11:39:51.663 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.659+0000 7f6ed8daf880 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T11:39:51.669 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.665+0000 7f6ed8daf880 5 note: GC not initialized 2023-10-05T11:39:51.669 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.665+0000 7f6eb9d20640 20 reqs_thread_entry: start 2023-10-05T11:39:51.669 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.665+0000 7f6ed8daf880 20 init_complete bucket index max shards: 11 2023-10-05T11:39:51.669 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.665+0000 7f6ed8daf880 20 Filter name: none 2023-10-05T11:39:51.669 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.666+0000 7f6eb7d1c640 20 reqs_thread_entry: start 2023-10-05T11:39:51.677 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.674+0000 7f6ebe529640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:39:51.680 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.676+0000 7f6ed8daf880 20 remove_watcher() i=0 2023-10-05T11:39:51.680 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.676+0000 7f6ed8daf880 2 removed watcher, disabling cache 2023-10-05T11:39:51.681 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.678+0000 7f6ed8daf880 20 remove_watcher() i=1 2023-10-05T11:39:51.682 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.679+0000 7f6ed8daf880 20 remove_watcher() i=2 2023-10-05T11:39:51.683 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.680+0000 7f6ed8daf880 20 remove_watcher() i=3 2023-10-05T11:39:51.684 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.681+0000 7f6ed8daf880 20 remove_watcher() i=4 2023-10-05T11:39:51.685 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.682+0000 7f6ed8daf880 20 remove_watcher() i=5 2023-10-05T11:39:51.686 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.683+0000 7f6ed8daf880 20 remove_watcher() i=6 2023-10-05T11:39:51.687 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.684+0000 7f6ed8daf880 20 remove_watcher() i=7 2023-10-05T11:39:51.692 INFO:tasks.workunit.client.0.smithi012.stderr:TEST: reshard process non empty bucket 2023-10-05T11:39:51.692 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:39:51.693 INFO:tasks.workunit.client.0.smithi012.stderr:radosgw-admin reshard process 2023-10-05T11:39:51.719 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setuser ceph since I am not root 2023-10-05T11:39:51.719 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T11:39:51.733 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.729+0000 7f793860f880 20 rados->read ofs=0 len=0 2023-10-05T11:39:51.735 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.731+0000 7f793860f880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:51.735 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.731+0000 7f793860f880 20 realm 2023-10-05T11:39:51.735 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.731+0000 7f793860f880 20 rados->read ofs=0 len=0 2023-10-05T11:39:51.735 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.731+0000 7f793860f880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:51.735 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.731+0000 7f793860f880 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T11:39:51.735 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.731+0000 7f793860f880 20 rados->read ofs=0 len=0 2023-10-05T11:39:51.736 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.731+0000 7f793860f880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:51.736 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.731+0000 7f793860f880 20 rados->read ofs=0 len=0 2023-10-05T11:39:51.736 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.732+0000 7f793860f880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:39:51.736 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.732+0000 7f793860f880 20 rados->read ofs=0 len=0 2023-10-05T11:39:51.737 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.733+0000 7f793860f880 20 rados_obj.operate() r=0 bl.length=1020 2023-10-05T11:39:51.737 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.733+0000 7f793860f880 20 searching for the correct realm 2023-10-05T11:39:51.746 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.742+0000 7f7934a8e640 0 -- 172.21.15.12:0/13348954 >> [v2:172.21.15.170:6814/3150808418,v1:172.21.15.170:6816/3150808418] conn(0x56351d044800 msgr2=0x56351cf99180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:39:51.748 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.743+0000 7f793860f880 20 RGWRados::pool_iterate: got zone_info.dff27d1e-df33-400e-a68a-7ba586947c99 2023-10-05T11:39:51.748 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.743+0000 7f793860f880 20 RGWRados::pool_iterate: got zonegroup_info.c78aa576-9d15-4e9d-b3c0-4af23a22062c 2023-10-05T11:39:51.748 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.743+0000 7f793860f880 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T11:39:51.748 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.743+0000 7f793860f880 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T11:39:51.748 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.743+0000 7f793860f880 20 rados->read ofs=0 len=0 2023-10-05T11:39:51.749 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.744+0000 7f793860f880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:51.749 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.744+0000 7f793860f880 20 rados->read ofs=0 len=0 2023-10-05T11:39:51.749 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.744+0000 7f793860f880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:39:51.749 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.744+0000 7f793860f880 20 rados->read ofs=0 len=0 2023-10-05T11:39:51.749 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.744+0000 7f793860f880 20 rados_obj.operate() r=0 bl.length=454 2023-10-05T11:39:51.749 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.744+0000 7f793860f880 20 zone default found 2023-10-05T11:39:51.749 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.744+0000 7f793860f880 4 Realm: () 2023-10-05T11:39:51.749 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.744+0000 7f793860f880 4 ZoneGroup: default (c78aa576-9d15-4e9d-b3c0-4af23a22062c) 2023-10-05T11:39:51.750 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.744+0000 7f793860f880 4 Zone: default (dff27d1e-df33-400e-a68a-7ba586947c99) 2023-10-05T11:39:51.750 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.744+0000 7f793860f880 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T11:39:51.750 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.744+0000 7f793860f880 20 zonegroup default 2023-10-05T11:39:51.750 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.744+0000 7f793860f880 20 rados->read ofs=0 len=0 2023-10-05T11:39:51.750 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.744+0000 7f793860f880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:51.750 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.744+0000 7f793860f880 20 rados->read ofs=0 len=0 2023-10-05T11:39:51.750 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.745+0000 7f793860f880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:51.751 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.745+0000 7f793860f880 20 rados->read ofs=0 len=0 2023-10-05T11:39:51.751 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.745+0000 7f793860f880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:51.751 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.745+0000 7f793860f880 20 started sync module instance, tier type = 2023-10-05T11:39:51.752 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.745+0000 7f793860f880 20 started zone id=dff27d1e-df33-400e-a68a-7ba586947c99 (name=default) with tier type = 2023-10-05T11:39:51.755 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.752+0000 7f793528f640 0 -- 172.21.15.12:0/13348954 >> [v2:172.21.15.12:6824/2171933159,v1:172.21.15.12:6825/2171933159] conn(0x56351d044000 msgr2=0x56351d132580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:39:51.758 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.755+0000 7f793860f880 20 add_watcher() i=0 2023-10-05T11:39:51.758 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.755+0000 7f793860f880 20 add_watcher() i=1 2023-10-05T11:39:51.758 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.755+0000 7f793860f880 20 add_watcher() i=2 2023-10-05T11:39:51.759 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.755+0000 7f793860f880 20 add_watcher() i=3 2023-10-05T11:39:51.759 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.755+0000 7f793860f880 20 add_watcher() i=4 2023-10-05T11:39:51.759 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.755+0000 7f793860f880 20 add_watcher() i=5 2023-10-05T11:39:51.759 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.755+0000 7f793860f880 20 add_watcher() i=6 2023-10-05T11:39:51.759 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.756+0000 7f793860f880 20 add_watcher() i=7 2023-10-05T11:39:51.760 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.756+0000 7f793860f880 2 all 8 watchers are set, enabling cache 2023-10-05T11:39:51.761 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.757+0000 7f791ba5c640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:39:51.761 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.757+0000 7f793860f880 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T11:39:51.761 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.757+0000 7f793860f880 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T11:39:51.767 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.763+0000 7f793860f880 5 note: GC not initialized 2023-10-05T11:39:51.767 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.763+0000 7f7917253640 20 reqs_thread_entry: start 2023-10-05T11:39:51.767 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.763+0000 7f793860f880 20 init_complete bucket index max shards: 11 2023-10-05T11:39:51.767 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.763+0000 7f793860f880 20 Filter name: none 2023-10-05T11:39:51.767 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.763+0000 7f791524f640 20 reqs_thread_entry: start 2023-10-05T11:39:51.767 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.763+0000 7f793860f880 20 processing logshard = reshard.0000000000 2023-10-05T11:39:51.769 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.766+0000 7f793860f880 20 finish processing logshard = reshard.0000000000 , ret = 0 2023-10-05T11:39:51.770 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.766+0000 7f793860f880 20 processing logshard = reshard.0000000001 2023-10-05T11:39:51.772 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.769+0000 7f793860f880 20 finish processing logshard = reshard.0000000001 , ret = 0 2023-10-05T11:39:51.773 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.769+0000 7f793860f880 20 processing logshard = reshard.0000000002 2023-10-05T11:39:51.775 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.772+0000 7f793860f880 20 finish processing logshard = reshard.0000000002 , ret = 0 2023-10-05T11:39:51.775 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.772+0000 7f793860f880 20 processing logshard = reshard.0000000003 2023-10-05T11:39:51.777 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.774+0000 7f793860f880 20 finish processing logshard = reshard.0000000003 , ret = 0 2023-10-05T11:39:51.777 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.774+0000 7f793860f880 20 processing logshard = reshard.0000000004 2023-10-05T11:39:51.780 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.777+0000 7f793860f880 20 finish processing logshard = reshard.0000000004 , ret = 0 2023-10-05T11:39:51.780 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.777+0000 7f793860f880 20 processing logshard = reshard.0000000005 2023-10-05T11:39:51.783 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.780+0000 7f793860f880 20 finish processing logshard = reshard.0000000005 , ret = 0 2023-10-05T11:39:51.783 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.780+0000 7f793860f880 20 processing logshard = reshard.0000000006 2023-10-05T11:39:51.785 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.782+0000 7f793860f880 20 process_entry resharding a-bucket 2023-10-05T11:39:51.786 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.782+0000 7f793860f880 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2023-10-05T11:39:51.786 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.782+0000 7f793860f880 20 rados->read ofs=0 len=0 2023-10-05T11:39:51.786 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.782+0000 7f793860f880 20 rados_obj.operate() r=0 bl.length=200 2023-10-05T11:39:51.787 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.782+0000 7f793860f880 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x1 2023-10-05T11:39:51.787 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.782+0000 7f793860f880 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2023-10-05T11:39:51.787 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.782+0000 7f793860f880 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:dff27d1e-df33-400e-a68a-7ba586947c99.4604.16 : miss 2023-10-05T11:39:51.787 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.783+0000 7f793860f880 20 rados->read ofs=0 len=0 2023-10-05T11:39:51.787 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.783+0000 7f793860f880 20 rados_obj.operate() r=0 bl.length=372 2023-10-05T11:39:51.787 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.783+0000 7f793860f880 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:dff27d1e-df33-400e-a68a-7ba586947c99.4604.16 info.flags=0x17 2023-10-05T11:39:51.787 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.783+0000 7f793860f880 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:dff27d1e-df33-400e-a68a-7ba586947c99.4604.16 to cache LRU end 2023-10-05T11:39:51.787 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.783+0000 7f793860f880 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T11:39:51.788 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.783+0000 7f793860f880 10 updating xattr: name=user.rgw.acl bl.length()=203 2023-10-05T11:39:51.788 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.783+0000 7f793860f880 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:dff27d1e-df33-400e-a68a-7ba586947c99.4604.16 2023-10-05T11:39:51.793 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.789+0000 7f793860f880 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:dff27d1e-df33-400e-a68a-7ba586947c99.4604.16 info.flags=0x17 2023-10-05T11:39:51.793 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.789+0000 7f793860f880 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:dff27d1e-df33-400e-a68a-7ba586947c99.4604.16 to cache LRU end 2023-10-05T11:39:51.793 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.789+0000 7f793860f880 10 updating xattr: name=user.rgw.acl bl.length()=203 2023-10-05T11:39:51.793 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.789+0000 7f793860f880 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:dff27d1e-df33-400e-a68a-7ba586947c99.4604.16, ofs0, ns] 2023-10-05T11:39:51.794 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.790+0000 7f792ea82640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1060856922156 cookie 94786121233408 notifier 6086 bl.length()=861 2023-10-05T11:39:51.794 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.790+0000 7f792ea82640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:dff27d1e-df33-400e-a68a-7ba586947c99.4604.16 info.flags=0x17 2023-10-05T11:39:51.794 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.790+0000 7f792ea82640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:dff27d1e-df33-400e-a68a-7ba586947c99.4604.16 to cache LRU end 2023-10-05T11:39:51.794 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.790+0000 7f792ea82640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2023-10-05T11:39:51.795 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.791+0000 7f793860f880 20 handle_bi_update(): bucket=:a-bucket[dff27d1e-df33-400e-a68a-7ba586947c99.4604.16]): orig_sources= new_sources= 2023-10-05T11:39:51.795 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.792+0000 7f793860f880 20 handle_bi_update(): bucket=:a-bucket[dff27d1e-df33-400e-a68a-7ba586947c99.4604.16]): potential sources added=[] removed=[] 2023-10-05T11:39:51.795 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.792+0000 7f793860f880 20 handle_bi_update(): bucket=:a-bucket[dff27d1e-df33-400e-a68a-7ba586947c99.4604.16]): orig_dests= new_dests= 2023-10-05T11:39:51.795 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.792+0000 7f793860f880 20 handle_bi_update(): bucket=:a-bucket[dff27d1e-df33-400e-a68a-7ba586947c99.4604.16]): potential dests added=[] removed=[] 2023-10-05T11:39:51.798 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.794+0000 7f793860f880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.16.2.0 2023-10-05T11:39:51.798 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.794+0000 7f793860f880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.16.2.0 2023-10-05T11:39:51.798 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.794+0000 7f793860f880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.16.2.1 2023-10-05T11:39:51.798 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.794+0000 7f793860f880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.16.2.1 2023-10-05T11:39:51.798 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.794+0000 7f793860f880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.16.2.2 2023-10-05T11:39:51.799 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.794+0000 7f793860f880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.16.2.2 2023-10-05T11:39:51.799 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.794+0000 7f793860f880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.16.2.3 2023-10-05T11:39:51.799 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.794+0000 7f793860f880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.16.2.3 2023-10-05T11:39:51.799 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.794+0000 7f793860f880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.16.2.4 2023-10-05T11:39:51.799 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.794+0000 7f793860f880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.16.2.4 2023-10-05T11:39:51.799 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.794+0000 7f793860f880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.16.2.5 2023-10-05T11:39:51.799 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.794+0000 7f793860f880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.16.2.5 2023-10-05T11:39:51.799 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.794+0000 7f793860f880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.16.2.6 2023-10-05T11:39:51.800 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.794+0000 7f793860f880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.16.2.6 2023-10-05T11:39:51.800 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.794+0000 7f793860f880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.16.2.7 2023-10-05T11:39:51.800 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.794+0000 7f793860f880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.16.2.7 2023-10-05T11:39:51.800 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.794+0000 7f793860f880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.16.2.8 2023-10-05T11:39:51.800 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.794+0000 7f793860f880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.16.2.8 2023-10-05T11:39:51.800 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.794+0000 7f793860f880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.16.2.9 2023-10-05T11:39:51.800 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.794+0000 7f793860f880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.16.2.9 2023-10-05T11:39:51.800 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.794+0000 7f793860f880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.16.2.10 2023-10-05T11:39:51.801 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.794+0000 7f793860f880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.16.2.10 2023-10-05T11:39:51.801 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.794+0000 7f793860f880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.16.2.11 2023-10-05T11:39:51.801 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.794+0000 7f793860f880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.16.2.11 2023-10-05T11:39:51.801 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.794+0000 7f793860f880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.16.2.12 2023-10-05T11:39:51.801 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.794+0000 7f793860f880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.16.2.12 2023-10-05T11:39:51.801 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.794+0000 7f793860f880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.16.1.0 2023-10-05T11:39:51.802 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.794+0000 7f793860f880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.16.1.0 2023-10-05T11:39:51.803 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.795+0000 7f793860f880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.16.1.1 2023-10-05T11:39:51.803 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.795+0000 7f793860f880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.16.1.1 2023-10-05T11:39:51.803 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.795+0000 7f793860f880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.16.1.2 2023-10-05T11:39:51.804 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.795+0000 7f793860f880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.16.1.2 2023-10-05T11:39:51.804 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.796+0000 7f793860f880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.16.1.3 2023-10-05T11:39:51.804 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.796+0000 7f793860f880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.16.1.3 2023-10-05T11:39:51.804 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.796+0000 7f793860f880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.16.1.4 2023-10-05T11:39:51.804 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.796+0000 7f793860f880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.16.1.4 2023-10-05T11:39:51.804 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.797+0000 7f793860f880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.16.1.5 2023-10-05T11:39:51.804 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.797+0000 7f793860f880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.16.1.5 2023-10-05T11:39:51.805 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.797+0000 7f793860f880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.16.1.6 2023-10-05T11:39:51.805 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.797+0000 7f793860f880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.16.1.6 2023-10-05T11:39:51.805 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.798+0000 7f793860f880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.16.1.7 2023-10-05T11:39:51.805 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.798+0000 7f793860f880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.16.1.7 2023-10-05T11:39:51.805 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.798+0000 7f793860f880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.16.1.8 2023-10-05T11:39:51.805 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.798+0000 7f793860f880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.16.1.8 2023-10-05T11:39:51.805 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.798+0000 7f793860f880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.16.1.9 2023-10-05T11:39:51.805 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.798+0000 7f793860f880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.16.1.9 2023-10-05T11:39:51.805 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.799+0000 7f793860f880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.16.1.10 2023-10-05T11:39:51.806 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.799+0000 7f793860f880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.16.1.10 2023-10-05T11:39:51.806 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.799+0000 7f793860f880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.16.1.11 2023-10-05T11:39:51.806 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.799+0000 7f793860f880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.16.1.11 2023-10-05T11:39:51.806 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.802+0000 7f793860f880 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:dff27d1e-df33-400e-a68a-7ba586947c99.4604.16 : hit (requested=0x17, cached=0x17) 2023-10-05T11:39:51.806 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.802+0000 7f793860f880 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:dff27d1e-df33-400e-a68a-7ba586947c99.4604.16 2023-10-05T11:39:51.807 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.803+0000 7f793860f880 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:dff27d1e-df33-400e-a68a-7ba586947c99.4604.16 info.flags=0x17 2023-10-05T11:39:51.807 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.803+0000 7f793860f880 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:dff27d1e-df33-400e-a68a-7ba586947c99.4604.16 to cache LRU end 2023-10-05T11:39:51.807 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.803+0000 7f793860f880 10 updating xattr: name=user.rgw.acl bl.length()=203 2023-10-05T11:39:51.807 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.803+0000 7f793860f880 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:dff27d1e-df33-400e-a68a-7ba586947c99.4604.16, ofs0, ns] 2023-10-05T11:39:51.807 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.804+0000 7f792ea82640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1060856922157 cookie 94786121233408 notifier 6086 bl.length()=829 2023-10-05T11:39:51.808 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.804+0000 7f792ea82640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:dff27d1e-df33-400e-a68a-7ba586947c99.4604.16 info.flags=0x17 2023-10-05T11:39:51.808 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.804+0000 7f792ea82640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:dff27d1e-df33-400e-a68a-7ba586947c99.4604.16 to cache LRU end 2023-10-05T11:39:51.808 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.804+0000 7f792ea82640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2023-10-05T11:39:51.809 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.806+0000 7f793860f880 20 handle_bi_update(): bucket=:a-bucket[dff27d1e-df33-400e-a68a-7ba586947c99.4604.16]): orig_sources= new_sources= 2023-10-05T11:39:51.809 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.806+0000 7f793860f880 20 handle_bi_update(): bucket=:a-bucket[dff27d1e-df33-400e-a68a-7ba586947c99.4604.16]): potential sources added=[] removed=[] 2023-10-05T11:39:51.810 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.806+0000 7f793860f880 20 handle_bi_update(): bucket=:a-bucket[dff27d1e-df33-400e-a68a-7ba586947c99.4604.16]): orig_dests= new_dests= 2023-10-05T11:39:51.810 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.806+0000 7f793860f880 20 handle_bi_update(): bucket=:a-bucket[dff27d1e-df33-400e-a68a-7ba586947c99.4604.16]): potential dests added=[] removed=[] 2023-10-05T11:39:51.812 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.809+0000 7f793860f880 1 execute INFO: reshard of bucket "a-bucket" completed successfully 2023-10-05T11:39:51.813 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.810+0000 7f793860f880 20 process_entry removing reshard queue entry for bucket a-bucket 2023-10-05T11:39:51.815 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.812+0000 7f793860f880 20 finish processing logshard = reshard.0000000006 , ret = 0 2023-10-05T11:39:51.815 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.812+0000 7f793860f880 20 processing logshard = reshard.0000000007 2023-10-05T11:39:51.817 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.814+0000 7f793860f880 20 finish processing logshard = reshard.0000000007 , ret = 0 2023-10-05T11:39:51.817 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.814+0000 7f793860f880 20 processing logshard = reshard.0000000008 2023-10-05T11:39:51.820 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.817+0000 7f793860f880 20 finish processing logshard = reshard.0000000008 , ret = 0 2023-10-05T11:39:51.820 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.817+0000 7f793860f880 20 processing logshard = reshard.0000000009 2023-10-05T11:39:51.822 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.819+0000 7f793860f880 20 finish processing logshard = reshard.0000000009 , ret = 0 2023-10-05T11:39:51.822 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.819+0000 7f793860f880 20 processing logshard = reshard.0000000010 2023-10-05T11:39:51.824 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.821+0000 7f793860f880 20 finish processing logshard = reshard.0000000010 , ret = 0 2023-10-05T11:39:51.824 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.821+0000 7f793860f880 20 processing logshard = reshard.0000000011 2023-10-05T11:39:51.826 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.823+0000 7f793860f880 20 finish processing logshard = reshard.0000000011 , ret = 0 2023-10-05T11:39:51.827 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.823+0000 7f793860f880 20 processing logshard = reshard.0000000012 2023-10-05T11:39:51.829 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.826+0000 7f793860f880 20 finish processing logshard = reshard.0000000012 , ret = 0 2023-10-05T11:39:51.829 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.826+0000 7f793860f880 20 processing logshard = reshard.0000000013 2023-10-05T11:39:51.831 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.828+0000 7f793860f880 20 finish processing logshard = reshard.0000000013 , ret = 0 2023-10-05T11:39:51.831 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.828+0000 7f793860f880 20 processing logshard = reshard.0000000014 2023-10-05T11:39:51.833 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.830+0000 7f793860f880 20 finish processing logshard = reshard.0000000014 , ret = 0 2023-10-05T11:39:51.833 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.830+0000 7f793860f880 20 processing logshard = reshard.0000000015 2023-10-05T11:39:51.835 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.832+0000 7f793860f880 20 finish processing logshard = reshard.0000000015 , ret = 0 2023-10-05T11:39:51.836 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.833+0000 7f791ba5c640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:39:51.838 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.835+0000 7f793860f880 20 remove_watcher() i=0 2023-10-05T11:39:51.839 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.835+0000 7f793860f880 2 removed watcher, disabling cache 2023-10-05T11:39:51.840 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.836+0000 7f793860f880 20 remove_watcher() i=1 2023-10-05T11:39:51.841 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.837+0000 7f793860f880 20 remove_watcher() i=2 2023-10-05T11:39:51.842 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.839+0000 7f793860f880 20 remove_watcher() i=3 2023-10-05T11:39:51.843 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.840+0000 7f793860f880 20 remove_watcher() i=4 2023-10-05T11:39:51.844 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.841+0000 7f793860f880 20 remove_watcher() i=5 2023-10-05T11:39:51.845 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.842+0000 7f793860f880 20 remove_watcher() i=6 2023-10-05T11:39:51.846 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.843+0000 7f793860f880 20 remove_watcher() i=7 2023-10-05T11:39:51.852 INFO:tasks.workunit.client.0.smithi012.stderr:radosgw-admin bucket stats --bucket a-bucket 2023-10-05T11:39:51.881 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setuser ceph since I am not root 2023-10-05T11:39:51.881 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T11:39:51.894 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.890+0000 7f0590d37880 20 rados->read ofs=0 len=0 2023-10-05T11:39:51.895 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.892+0000 7f0590d37880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:51.896 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.892+0000 7f0590d37880 20 realm 2023-10-05T11:39:51.896 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.892+0000 7f0590d37880 20 rados->read ofs=0 len=0 2023-10-05T11:39:51.896 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.892+0000 7f0590d37880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:51.896 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.892+0000 7f0590d37880 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T11:39:51.896 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.892+0000 7f0590d37880 20 rados->read ofs=0 len=0 2023-10-05T11:39:51.896 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.892+0000 7f0590d37880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:51.896 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.892+0000 7f0590d37880 20 rados->read ofs=0 len=0 2023-10-05T11:39:51.897 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.893+0000 7f0590d37880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:39:51.897 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.893+0000 7f0590d37880 20 rados->read ofs=0 len=0 2023-10-05T11:39:51.897 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.894+0000 7f0590d37880 20 rados_obj.operate() r=0 bl.length=1020 2023-10-05T11:39:51.897 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.894+0000 7f0590d37880 20 searching for the correct realm 2023-10-05T11:39:51.906 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.903+0000 7f058d71b640 0 -- 172.21.15.12:0/3442201221 >> [v2:172.21.15.12:6800/732466381,v1:172.21.15.12:6801/732466381] conn(0x55e1f7d96c00 msgr2=0x55e1f7da8b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:39:51.907 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.904+0000 7f0590d37880 20 RGWRados::pool_iterate: got zone_info.dff27d1e-df33-400e-a68a-7ba586947c99 2023-10-05T11:39:51.908 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.904+0000 7f0590d37880 20 RGWRados::pool_iterate: got zonegroup_info.c78aa576-9d15-4e9d-b3c0-4af23a22062c 2023-10-05T11:39:51.908 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.904+0000 7f0590d37880 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T11:39:51.908 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.904+0000 7f0590d37880 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T11:39:51.908 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.904+0000 7f0590d37880 20 rados->read ofs=0 len=0 2023-10-05T11:39:51.908 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.904+0000 7f0590d37880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:51.908 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.904+0000 7f0590d37880 20 rados->read ofs=0 len=0 2023-10-05T11:39:51.909 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.905+0000 7f0590d37880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:39:51.909 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.905+0000 7f0590d37880 20 rados->read ofs=0 len=0 2023-10-05T11:39:51.909 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.905+0000 7f0590d37880 20 rados_obj.operate() r=0 bl.length=454 2023-10-05T11:39:51.910 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.905+0000 7f0590d37880 20 zone default found 2023-10-05T11:39:51.910 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.905+0000 7f0590d37880 4 Realm: () 2023-10-05T11:39:51.910 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.905+0000 7f0590d37880 4 ZoneGroup: default (c78aa576-9d15-4e9d-b3c0-4af23a22062c) 2023-10-05T11:39:51.910 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.905+0000 7f0590d37880 4 Zone: default (dff27d1e-df33-400e-a68a-7ba586947c99) 2023-10-05T11:39:51.910 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.905+0000 7f0590d37880 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T11:39:51.910 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.905+0000 7f0590d37880 20 zonegroup default 2023-10-05T11:39:51.910 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.905+0000 7f0590d37880 20 rados->read ofs=0 len=0 2023-10-05T11:39:51.910 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.905+0000 7f0590d37880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:51.910 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.905+0000 7f0590d37880 20 rados->read ofs=0 len=0 2023-10-05T11:39:51.910 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.905+0000 7f0590d37880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:51.910 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.905+0000 7f0590d37880 20 rados->read ofs=0 len=0 2023-10-05T11:39:51.910 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.906+0000 7f0590d37880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:51.911 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.906+0000 7f0590d37880 20 started sync module instance, tier type = 2023-10-05T11:39:51.911 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.906+0000 7f0590d37880 20 started zone id=dff27d1e-df33-400e-a68a-7ba586947c99 (name=default) with tier type = 2023-10-05T11:39:51.915 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.911+0000 7f058df1c640 0 -- 172.21.15.12:0/3442201221 >> [v2:172.21.15.170:6800/4137726411,v1:172.21.15.170:6801/4137726411] conn(0x55e1f7eb6000 msgr2=0x55e1f7da9600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:39:51.918 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.915+0000 7f0590d37880 20 add_watcher() i=0 2023-10-05T11:39:51.918 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.915+0000 7f0590d37880 20 add_watcher() i=1 2023-10-05T11:39:51.918 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.915+0000 7f0590d37880 20 add_watcher() i=2 2023-10-05T11:39:51.918 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.915+0000 7f0590d37880 20 add_watcher() i=3 2023-10-05T11:39:51.919 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.915+0000 7f0590d37880 20 add_watcher() i=4 2023-10-05T11:39:51.919 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.915+0000 7f0590d37880 20 add_watcher() i=5 2023-10-05T11:39:51.919 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.915+0000 7f0590d37880 20 add_watcher() i=6 2023-10-05T11:39:51.919 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.916+0000 7f0590d37880 20 add_watcher() i=7 2023-10-05T11:39:51.919 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.916+0000 7f0590d37880 2 all 8 watchers are set, enabling cache 2023-10-05T11:39:51.920 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.917+0000 7f05746e9640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:39:51.921 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.918+0000 7f0590d37880 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T11:39:51.921 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.918+0000 7f0590d37880 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T11:39:51.927 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.923+0000 7f0590d37880 5 note: GC not initialized 2023-10-05T11:39:51.927 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.923+0000 7f056fee0640 20 reqs_thread_entry: start 2023-10-05T11:39:51.927 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.923+0000 7f0590d37880 20 init_complete bucket index max shards: 11 2023-10-05T11:39:51.927 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.923+0000 7f0590d37880 20 Filter name: none 2023-10-05T11:39:51.927 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.923+0000 7f056dedc640 20 reqs_thread_entry: start 2023-10-05T11:39:51.927 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.923+0000 7f0590d37880 20 rados->read ofs=0 len=0 2023-10-05T11:39:51.928 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.924+0000 7f0590d37880 20 rados_obj.operate() r=0 bl.length=200 2023-10-05T11:39:51.928 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.924+0000 7f0590d37880 20 rados->read ofs=0 len=0 2023-10-05T11:39:51.928 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.924+0000 7f0590d37880 20 rados_obj.operate() r=0 bl.length=372 2023-10-05T11:39:51.928 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.924+0000 7f0590d37880 20 couldn't put binfo cache entry, might have raced with data changes 2023-10-05T11:39:51.928 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.924+0000 7f0590d37880 20 rados->read ofs=0 len=0 2023-10-05T11:39:51.928 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.925+0000 7f0590d37880 20 rados_obj.operate() r=0 bl.length=200 2023-10-05T11:39:51.928 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.925+0000 7f0590d37880 20 rados->read ofs=0 len=0 2023-10-05T11:39:51.929 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.925+0000 7f0590d37880 20 rados_obj.operate() r=0 bl.length=372 2023-10-05T11:39:51.929 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.925+0000 7f0590d37880 20 couldn't put binfo cache entry, might have raced with data changes 2023-10-05T11:39:51.929 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.926+0000 7f0590d37880 20 rados->read ofs=0 len=0 2023-10-05T11:39:51.929 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.926+0000 7f0590d37880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:51.930 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.927+0000 7f05746e9640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:39:51.932 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.929+0000 7f0590d37880 20 remove_watcher() i=0 2023-10-05T11:39:51.932 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.929+0000 7f0590d37880 2 removed watcher, disabling cache 2023-10-05T11:39:51.933 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.930+0000 7f0590d37880 20 remove_watcher() i=1 2023-10-05T11:39:51.934 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.931+0000 7f0590d37880 20 remove_watcher() i=2 2023-10-05T11:39:51.935 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.932+0000 7f0590d37880 20 remove_watcher() i=3 2023-10-05T11:39:51.936 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.933+0000 7f0590d37880 20 remove_watcher() i=4 2023-10-05T11:39:51.937 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.934+0000 7f0590d37880 20 remove_watcher() i=5 2023-10-05T11:39:51.938 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.935+0000 7f0590d37880 20 remove_watcher() i=6 2023-10-05T11:39:51.939 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:51.936+0000 7f0590d37880 20 remove_watcher() i=7 2023-10-05T11:39:51.944 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:39:51.944 INFO:tasks.workunit.client.0.smithi012.stderr:BUCKET_STATS: 2023-10-05T11:39:51.944 INFO:tasks.workunit.client.0.smithi012.stderr:bucket: a-bucket id: dff27d1e-df33-400e-a68a-7ba586947c99.4604.16 num_objects: 8 size_kb: 1 num_shards: 13 2023-10-05T11:39:51.944 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:39:51.944 INFO:tasks.workunit.client.0.smithi012.stderr:TEST: reshard bucket with EIO injected at set_target_layout 2023-10-05T11:39:51.945 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:39:52.667 INFO:tasks.workunit.client.0.smithi012.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2023-10-05T11:39:52.696 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setuser ceph since I am not root 2023-10-05T11:39:52.696 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T11:39:52.709 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.706+0000 7f8f0e224880 20 rados->read ofs=0 len=0 2023-10-05T11:39:52.710 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.707+0000 7f8f0e224880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:52.710 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.707+0000 7f8f0e224880 20 realm 2023-10-05T11:39:52.711 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.707+0000 7f8f0e224880 20 rados->read ofs=0 len=0 2023-10-05T11:39:52.711 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.707+0000 7f8f0e224880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:52.711 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.707+0000 7f8f0e224880 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T11:39:52.711 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.707+0000 7f8f0e224880 20 rados->read ofs=0 len=0 2023-10-05T11:39:52.711 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.707+0000 7f8f0e224880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:52.711 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.707+0000 7f8f0e224880 20 rados->read ofs=0 len=0 2023-10-05T11:39:52.712 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.708+0000 7f8f0e224880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:39:52.712 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.708+0000 7f8f0e224880 20 rados->read ofs=0 len=0 2023-10-05T11:39:52.712 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.709+0000 7f8f0e224880 20 rados_obj.operate() r=0 bl.length=1020 2023-10-05T11:39:52.712 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.709+0000 7f8f0e224880 20 searching for the correct realm 2023-10-05T11:39:52.721 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.718+0000 7f8f0c9d0640 0 -- 172.21.15.12:0/2205427843 >> [v2:172.21.15.170:6814/3150808418,v1:172.21.15.170:6816/3150808418] conn(0x5623005a1400 msgr2=0x5623004ff180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:39:52.722 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.719+0000 7f8f0e224880 20 RGWRados::pool_iterate: got zone_info.dff27d1e-df33-400e-a68a-7ba586947c99 2023-10-05T11:39:52.723 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.719+0000 7f8f0e224880 20 RGWRados::pool_iterate: got zonegroup_info.c78aa576-9d15-4e9d-b3c0-4af23a22062c 2023-10-05T11:39:52.723 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.719+0000 7f8f0e224880 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T11:39:52.723 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.719+0000 7f8f0e224880 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T11:39:52.723 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.719+0000 7f8f0e224880 20 rados->read ofs=0 len=0 2023-10-05T11:39:52.723 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.719+0000 7f8f0e224880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:52.723 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.719+0000 7f8f0e224880 20 rados->read ofs=0 len=0 2023-10-05T11:39:52.724 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.720+0000 7f8f0e224880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:39:52.724 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.720+0000 7f8f0e224880 20 rados->read ofs=0 len=0 2023-10-05T11:39:52.724 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.720+0000 7f8f0e224880 20 rados_obj.operate() r=0 bl.length=454 2023-10-05T11:39:52.724 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.720+0000 7f8f0e224880 20 zone default found 2023-10-05T11:39:52.724 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.720+0000 7f8f0e224880 4 Realm: () 2023-10-05T11:39:52.724 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.720+0000 7f8f0e224880 4 ZoneGroup: default (c78aa576-9d15-4e9d-b3c0-4af23a22062c) 2023-10-05T11:39:52.725 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.720+0000 7f8f0e224880 4 Zone: default (dff27d1e-df33-400e-a68a-7ba586947c99) 2023-10-05T11:39:52.725 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.720+0000 7f8f0e224880 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T11:39:52.725 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.720+0000 7f8f0e224880 20 zonegroup default 2023-10-05T11:39:52.725 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.720+0000 7f8f0e224880 20 rados->read ofs=0 len=0 2023-10-05T11:39:52.725 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.720+0000 7f8f0e224880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:52.725 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.720+0000 7f8f0e224880 20 rados->read ofs=0 len=0 2023-10-05T11:39:52.725 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.720+0000 7f8f0e224880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:52.725 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.720+0000 7f8f0e224880 20 rados->read ofs=0 len=0 2023-10-05T11:39:52.726 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.721+0000 7f8f0e224880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:52.726 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.721+0000 7f8f0e224880 20 started sync module instance, tier type = 2023-10-05T11:39:52.726 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.721+0000 7f8f0e224880 20 started zone id=dff27d1e-df33-400e-a68a-7ba586947c99 (name=default) with tier type = 2023-10-05T11:39:52.731 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.727+0000 7f8f0d1d1640 0 -- 172.21.15.12:0/2205427843 >> [v2:172.21.15.170:6800/4137726411,v1:172.21.15.170:6801/4137726411] conn(0x562300695c00 msgr2=0x562300679700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:39:52.733 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.730+0000 7f8f0e224880 20 add_watcher() i=0 2023-10-05T11:39:52.733 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.730+0000 7f8f0e224880 20 add_watcher() i=1 2023-10-05T11:39:52.733 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.730+0000 7f8f0e224880 20 add_watcher() i=2 2023-10-05T11:39:52.734 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.730+0000 7f8f0e224880 20 add_watcher() i=3 2023-10-05T11:39:52.734 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.730+0000 7f8f0e224880 20 add_watcher() i=4 2023-10-05T11:39:52.734 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.730+0000 7f8f0e224880 20 add_watcher() i=5 2023-10-05T11:39:52.734 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.730+0000 7f8f0e224880 20 add_watcher() i=6 2023-10-05T11:39:52.734 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.731+0000 7f8f0e224880 20 add_watcher() i=7 2023-10-05T11:39:52.734 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.731+0000 7f8f0e224880 2 all 8 watchers are set, enabling cache 2023-10-05T11:39:52.736 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.732+0000 7f8ef399e640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:39:52.736 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.733+0000 7f8f0e224880 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T11:39:52.736 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.733+0000 7f8f0e224880 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T11:39:52.742 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.738+0000 7f8f0e224880 5 note: GC not initialized 2023-10-05T11:39:52.742 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.738+0000 7f8eef195640 20 reqs_thread_entry: start 2023-10-05T11:39:52.742 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.738+0000 7f8f0e224880 20 init_complete bucket index max shards: 11 2023-10-05T11:39:52.742 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.738+0000 7f8f0e224880 20 Filter name: none 2023-10-05T11:39:52.742 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.739+0000 7f8eed191640 20 reqs_thread_entry: start 2023-10-05T11:39:52.742 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.739+0000 7f8f0e224880 20 rados->read ofs=0 len=0 2023-10-05T11:39:52.744 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.739+0000 7f8f0e224880 20 rados_obj.operate() r=0 bl.length=218 2023-10-05T11:39:52.744 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.739+0000 7f8f0e224880 20 rados->read ofs=0 len=0 2023-10-05T11:39:52.744 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.740+0000 7f8f0e224880 20 rados_obj.operate() r=0 bl.length=390 2023-10-05T11:39:52.744 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.740+0000 7f8f0e224880 20 couldn't put binfo cache entry, might have raced with data changes 2023-10-05T11:39:52.744 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.740+0000 7f8f0e224880 20 rados->read ofs=0 len=0 2023-10-05T11:39:52.744 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.740+0000 7f8f0e224880 20 rados_obj.operate() r=0 bl.length=218 2023-10-05T11:39:52.744 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.740+0000 7f8f0e224880 20 rados->read ofs=0 len=0 2023-10-05T11:39:52.744 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.740+0000 7f8f0e224880 20 rados_obj.operate() r=0 bl.length=390 2023-10-05T11:39:52.744 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.740+0000 7f8f0e224880 20 couldn't put binfo cache entry, might have raced with data changes 2023-10-05T11:39:52.745 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.741+0000 7f8f0e224880 20 rados->read ofs=0 len=0 2023-10-05T11:39:52.745 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.741+0000 7f8f0e224880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:52.745 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.742+0000 7f8ef399e640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:39:52.747 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.744+0000 7f8f0e224880 20 remove_watcher() i=0 2023-10-05T11:39:52.747 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.744+0000 7f8f0e224880 2 removed watcher, disabling cache 2023-10-05T11:39:52.749 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.745+0000 7f8f0e224880 20 remove_watcher() i=1 2023-10-05T11:39:52.749 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.746+0000 7f8f0e224880 20 remove_watcher() i=2 2023-10-05T11:39:52.750 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.747+0000 7f8f0e224880 20 remove_watcher() i=3 2023-10-05T11:39:52.751 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.748+0000 7f8f0e224880 20 remove_watcher() i=4 2023-10-05T11:39:52.752 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.749+0000 7f8f0e224880 20 remove_watcher() i=5 2023-10-05T11:39:52.753 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.750+0000 7f8f0e224880 20 remove_watcher() i=6 2023-10-05T11:39:52.754 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.751+0000 7f8f0e224880 20 remove_watcher() i=7 2023-10-05T11:39:52.759 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:39:52.759 INFO:tasks.workunit.client.0.smithi012.stderr:BUCKET_STATS: 2023-10-05T11:39:52.759 INFO:tasks.workunit.client.0.smithi012.stderr:bucket: error-at-set-target-layout id: dff27d1e-df33-400e-a68a-7ba586947c99.4604.18 num_objects: 20 size_kb: 1 num_shards: 11 2023-10-05T11:39:52.759 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:39:52.760 INFO:tasks.workunit.client.0.smithi012.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at set_target_layout 2023-10-05T11:39:52.793 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setuser ceph since I am not root 2023-10-05T11:39:52.794 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T11:39:52.808 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.805+0000 7fcb6f619880 20 rados->read ofs=0 len=0 2023-10-05T11:39:52.810 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.806+0000 7fcb6f619880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:52.810 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.806+0000 7fcb6f619880 20 realm 2023-10-05T11:39:52.810 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.806+0000 7fcb6f619880 20 rados->read ofs=0 len=0 2023-10-05T11:39:52.810 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.806+0000 7fcb6f619880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:52.810 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.806+0000 7fcb6f619880 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T11:39:52.810 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.806+0000 7fcb6f619880 20 rados->read ofs=0 len=0 2023-10-05T11:39:52.810 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.806+0000 7fcb6f619880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:52.810 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.806+0000 7fcb6f619880 20 rados->read ofs=0 len=0 2023-10-05T11:39:52.811 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.807+0000 7fcb6f619880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:39:52.811 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.807+0000 7fcb6f619880 20 rados->read ofs=0 len=0 2023-10-05T11:39:52.811 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.808+0000 7fcb6f619880 20 rados_obj.operate() r=0 bl.length=1020 2023-10-05T11:39:52.811 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.808+0000 7fcb6f619880 20 searching for the correct realm 2023-10-05T11:39:52.820 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.816+0000 7fcb6c301640 0 -- 172.21.15.12:0/2389451831 >> [v2:172.21.15.12:6824/2171933159,v1:172.21.15.12:6825/2171933159] conn(0x55de3e738400 msgr2=0x55de3e583700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:39:52.822 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.818+0000 7fcb6f619880 20 RGWRados::pool_iterate: got zone_info.dff27d1e-df33-400e-a68a-7ba586947c99 2023-10-05T11:39:52.822 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.818+0000 7fcb6f619880 20 RGWRados::pool_iterate: got zonegroup_info.c78aa576-9d15-4e9d-b3c0-4af23a22062c 2023-10-05T11:39:52.822 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.818+0000 7fcb6f619880 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T11:39:52.822 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.818+0000 7fcb6f619880 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T11:39:52.822 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.818+0000 7fcb6f619880 20 rados->read ofs=0 len=0 2023-10-05T11:39:52.822 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.818+0000 7fcb6f619880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:52.822 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.818+0000 7fcb6f619880 20 rados->read ofs=0 len=0 2023-10-05T11:39:52.822 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.819+0000 7fcb6f619880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:39:52.822 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.819+0000 7fcb6f619880 20 rados->read ofs=0 len=0 2023-10-05T11:39:52.823 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.819+0000 7fcb6f619880 20 rados_obj.operate() r=0 bl.length=454 2023-10-05T11:39:52.824 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.819+0000 7fcb6f619880 20 zone default found 2023-10-05T11:39:52.824 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.819+0000 7fcb6f619880 4 Realm: () 2023-10-05T11:39:52.824 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.819+0000 7fcb6f619880 4 ZoneGroup: default (c78aa576-9d15-4e9d-b3c0-4af23a22062c) 2023-10-05T11:39:52.824 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.819+0000 7fcb6f619880 4 Zone: default (dff27d1e-df33-400e-a68a-7ba586947c99) 2023-10-05T11:39:52.824 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.819+0000 7fcb6f619880 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T11:39:52.824 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.819+0000 7fcb6f619880 20 zonegroup default 2023-10-05T11:39:52.824 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.819+0000 7fcb6f619880 20 rados->read ofs=0 len=0 2023-10-05T11:39:52.824 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.819+0000 7fcb6f619880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:52.824 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.819+0000 7fcb6f619880 20 rados->read ofs=0 len=0 2023-10-05T11:39:52.824 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.819+0000 7fcb6f619880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:52.824 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.819+0000 7fcb6f619880 20 rados->read ofs=0 len=0 2023-10-05T11:39:52.824 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.820+0000 7fcb6f619880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:52.825 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.820+0000 7fcb6f619880 20 started sync module instance, tier type = 2023-10-05T11:39:52.825 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.820+0000 7fcb6f619880 20 started zone id=dff27d1e-df33-400e-a68a-7ba586947c99 (name=default) with tier type = 2023-10-05T11:39:52.828 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.824+0000 7fcb6c301640 0 -- 172.21.15.12:0/2389451831 >> [v2:172.21.15.170:6800/4137726411,v1:172.21.15.170:6801/4137726411] conn(0x55de3e3c9400 msgr2=0x55de3e633600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-10-05T11:39:52.833 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.830+0000 7fcb6f619880 20 add_watcher() i=0 2023-10-05T11:39:52.833 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.830+0000 7fcb6f619880 20 add_watcher() i=1 2023-10-05T11:39:52.833 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.830+0000 7fcb6f619880 20 add_watcher() i=2 2023-10-05T11:39:52.833 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.830+0000 7fcb6f619880 20 add_watcher() i=3 2023-10-05T11:39:52.833 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.830+0000 7fcb6f619880 20 add_watcher() i=4 2023-10-05T11:39:52.833 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.830+0000 7fcb6f619880 20 add_watcher() i=5 2023-10-05T11:39:52.834 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.830+0000 7fcb6f619880 20 add_watcher() i=6 2023-10-05T11:39:52.834 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.830+0000 7fcb6f619880 20 add_watcher() i=7 2023-10-05T11:39:52.834 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.830+0000 7fcb6f619880 2 all 8 watchers are set, enabling cache 2023-10-05T11:39:52.835 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.832+0000 7fcb52ace640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:39:52.836 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.833+0000 7fcb6f619880 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T11:39:52.836 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.833+0000 7fcb6f619880 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T11:39:52.842 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.838+0000 7fcb6f619880 5 note: GC not initialized 2023-10-05T11:39:52.842 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.838+0000 7fcb4e2c5640 20 reqs_thread_entry: start 2023-10-05T11:39:52.842 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.838+0000 7fcb6f619880 20 init_complete bucket index max shards: 11 2023-10-05T11:39:52.842 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.838+0000 7fcb6f619880 20 Filter name: none 2023-10-05T11:39:52.842 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.838+0000 7fcb4c2c1640 20 reqs_thread_entry: start 2023-10-05T11:39:52.842 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.839+0000 7fcb6f619880 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2023-10-05T11:39:52.842 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.839+0000 7fcb6f619880 20 rados->read ofs=0 len=0 2023-10-05T11:39:52.843 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.839+0000 7fcb6f619880 20 rados_obj.operate() r=0 bl.length=218 2023-10-05T11:39:52.843 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.839+0000 7fcb6f619880 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2023-10-05T11:39:52.843 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.839+0000 7fcb6f619880 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2023-10-05T11:39:52.844 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.839+0000 7fcb6f619880 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.18 : miss 2023-10-05T11:39:52.844 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.839+0000 7fcb6f619880 20 rados->read ofs=0 len=0 2023-10-05T11:39:52.844 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.839+0000 7fcb6f619880 20 rados_obj.operate() r=0 bl.length=390 2023-10-05T11:39:52.844 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.839+0000 7fcb6f619880 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.18 info.flags=0x17 2023-10-05T11:39:52.844 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.839+0000 7fcb6f619880 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.18 to cache LRU end 2023-10-05T11:39:52.844 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.839+0000 7fcb6f619880 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T11:39:52.844 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.839+0000 7fcb6f619880 10 updating xattr: name=user.rgw.acl bl.length()=265 2023-10-05T11:39:52.844 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.839+0000 7fcb6f619880 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.18 2023-10-05T11:39:52.847 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.843+0000 7fcb6f619880 -1 Injecting error=-5 at location=set_target_layout 2023-10-05T11:39:52.847 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.843+0000 7fcb6f619880 0 ERROR: init_target_layout failed to write target index layout to bucket info: (5) Input/output error 2023-10-05T11:39:52.851 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.847+0000 7fcb52ace640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:39:52.853 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.849+0000 7fcb6f619880 20 remove_watcher() i=0 2023-10-05T11:39:52.853 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.849+0000 7fcb6f619880 2 removed watcher, disabling cache 2023-10-05T11:39:52.854 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.850+0000 7fcb6f619880 20 remove_watcher() i=1 2023-10-05T11:39:52.855 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.851+0000 7fcb6f619880 20 remove_watcher() i=2 2023-10-05T11:39:52.856 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.852+0000 7fcb6f619880 20 remove_watcher() i=3 2023-10-05T11:39:52.857 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.853+0000 7fcb6f619880 20 remove_watcher() i=4 2023-10-05T11:39:52.858 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.854+0000 7fcb6f619880 20 remove_watcher() i=5 2023-10-05T11:39:52.859 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.855+0000 7fcb6f619880 20 remove_watcher() i=6 2023-10-05T11:39:52.860 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.856+0000 7fcb6f619880 20 remove_watcher() i=7 2023-10-05T11:39:52.865 INFO:tasks.workunit.client.0.smithi012.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2023-10-05T11:39:52.893 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setuser ceph since I am not root 2023-10-05T11:39:52.894 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T11:39:52.906 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.903+0000 7f0958b1e880 20 rados->read ofs=0 len=0 2023-10-05T11:39:52.908 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.904+0000 7f0958b1e880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:52.908 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.904+0000 7f0958b1e880 20 realm 2023-10-05T11:39:52.908 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.904+0000 7f0958b1e880 20 rados->read ofs=0 len=0 2023-10-05T11:39:52.909 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.905+0000 7f0958b1e880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:52.909 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.905+0000 7f0958b1e880 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T11:39:52.909 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.905+0000 7f0958b1e880 20 rados->read ofs=0 len=0 2023-10-05T11:39:52.909 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.905+0000 7f0958b1e880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:52.909 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.905+0000 7f0958b1e880 20 rados->read ofs=0 len=0 2023-10-05T11:39:52.909 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.906+0000 7f0958b1e880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:39:52.909 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.906+0000 7f0958b1e880 20 rados->read ofs=0 len=0 2023-10-05T11:39:52.910 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.907+0000 7f0958b1e880 20 rados_obj.operate() r=0 bl.length=1020 2023-10-05T11:39:52.910 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.907+0000 7f0958b1e880 20 searching for the correct realm 2023-10-05T11:39:52.919 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.916+0000 7f09572c3640 0 -- 172.21.15.12:0/137475539 >> [v2:172.21.15.170:6814/3150808418,v1:172.21.15.170:6816/3150808418] conn(0x55fa7b89d000 msgr2=0x55fa7ac02c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:39:52.920 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.917+0000 7f0958b1e880 20 RGWRados::pool_iterate: got zone_info.dff27d1e-df33-400e-a68a-7ba586947c99 2023-10-05T11:39:52.920 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.917+0000 7f0958b1e880 20 RGWRados::pool_iterate: got zonegroup_info.c78aa576-9d15-4e9d-b3c0-4af23a22062c 2023-10-05T11:39:52.921 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.917+0000 7f0958b1e880 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T11:39:52.921 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.917+0000 7f0958b1e880 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T11:39:52.921 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.917+0000 7f0958b1e880 20 rados->read ofs=0 len=0 2023-10-05T11:39:52.921 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.917+0000 7f0958b1e880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:52.921 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.917+0000 7f0958b1e880 20 rados->read ofs=0 len=0 2023-10-05T11:39:52.922 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.917+0000 7f0958b1e880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:39:52.922 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.917+0000 7f0958b1e880 20 rados->read ofs=0 len=0 2023-10-05T11:39:52.922 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.918+0000 7f0958b1e880 20 rados_obj.operate() r=0 bl.length=454 2023-10-05T11:39:52.923 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.918+0000 7f0958b1e880 20 zone default found 2023-10-05T11:39:52.923 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.918+0000 7f0958b1e880 4 Realm: () 2023-10-05T11:39:52.923 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.918+0000 7f0958b1e880 4 ZoneGroup: default (c78aa576-9d15-4e9d-b3c0-4af23a22062c) 2023-10-05T11:39:52.923 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.918+0000 7f0958b1e880 4 Zone: default (dff27d1e-df33-400e-a68a-7ba586947c99) 2023-10-05T11:39:52.923 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.918+0000 7f0958b1e880 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T11:39:52.923 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.918+0000 7f0958b1e880 20 zonegroup default 2023-10-05T11:39:52.923 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.918+0000 7f0958b1e880 20 rados->read ofs=0 len=0 2023-10-05T11:39:52.923 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.918+0000 7f0958b1e880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:52.923 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.918+0000 7f0958b1e880 20 rados->read ofs=0 len=0 2023-10-05T11:39:52.923 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.919+0000 7f0958b1e880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:52.923 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.919+0000 7f0958b1e880 20 rados->read ofs=0 len=0 2023-10-05T11:39:52.924 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.919+0000 7f0958b1e880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:52.924 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.919+0000 7f0958b1e880 20 started sync module instance, tier type = 2023-10-05T11:39:52.924 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.919+0000 7f0958b1e880 20 started zone id=dff27d1e-df33-400e-a68a-7ba586947c99 (name=default) with tier type = 2023-10-05T11:39:52.929 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.926+0000 7f0957ac4640 0 -- 172.21.15.12:0/137475539 >> [v2:172.21.15.12:6824/2171933159,v1:172.21.15.12:6825/2171933159] conn(0x55fa7adba400 msgr2=0x55fa7ac03700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:39:52.932 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.928+0000 7f0958b1e880 20 add_watcher() i=0 2023-10-05T11:39:52.932 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.928+0000 7f0958b1e880 20 add_watcher() i=1 2023-10-05T11:39:52.932 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.928+0000 7f0958b1e880 20 add_watcher() i=2 2023-10-05T11:39:52.932 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.928+0000 7f0958b1e880 20 add_watcher() i=3 2023-10-05T11:39:52.932 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.928+0000 7f0958b1e880 20 add_watcher() i=4 2023-10-05T11:39:52.932 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.928+0000 7f0958b1e880 20 add_watcher() i=5 2023-10-05T11:39:52.933 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.928+0000 7f0958b1e880 20 add_watcher() i=6 2023-10-05T11:39:52.933 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.929+0000 7f0958b1e880 20 add_watcher() i=7 2023-10-05T11:39:52.933 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.929+0000 7f0958b1e880 2 all 8 watchers are set, enabling cache 2023-10-05T11:39:52.934 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.931+0000 7f093e291640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:39:52.934 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.931+0000 7f0958b1e880 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T11:39:52.934 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.931+0000 7f0958b1e880 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T11:39:52.940 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.936+0000 7f0958b1e880 5 note: GC not initialized 2023-10-05T11:39:52.940 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.937+0000 7f0939a88640 20 reqs_thread_entry: start 2023-10-05T11:39:52.940 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.937+0000 7f0958b1e880 20 init_complete bucket index max shards: 11 2023-10-05T11:39:52.940 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.937+0000 7f0958b1e880 20 Filter name: none 2023-10-05T11:39:52.940 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.937+0000 7f0937a84640 20 reqs_thread_entry: start 2023-10-05T11:39:52.941 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.937+0000 7f0958b1e880 20 rados->read ofs=0 len=0 2023-10-05T11:39:52.941 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.937+0000 7f0958b1e880 20 rados_obj.operate() r=0 bl.length=218 2023-10-05T11:39:52.942 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.937+0000 7f0958b1e880 20 rados->read ofs=0 len=0 2023-10-05T11:39:52.942 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.938+0000 7f0958b1e880 20 rados_obj.operate() r=0 bl.length=390 2023-10-05T11:39:52.942 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.938+0000 7f0958b1e880 20 couldn't put binfo cache entry, might have raced with data changes 2023-10-05T11:39:52.942 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.938+0000 7f0958b1e880 20 rados->read ofs=0 len=0 2023-10-05T11:39:52.942 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.938+0000 7f0958b1e880 20 rados_obj.operate() r=0 bl.length=218 2023-10-05T11:39:52.942 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.938+0000 7f0958b1e880 20 rados->read ofs=0 len=0 2023-10-05T11:39:52.942 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.938+0000 7f0958b1e880 20 rados_obj.operate() r=0 bl.length=390 2023-10-05T11:39:52.942 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.938+0000 7f0958b1e880 20 couldn't put binfo cache entry, might have raced with data changes 2023-10-05T11:39:52.943 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.939+0000 7f0958b1e880 20 rados->read ofs=0 len=0 2023-10-05T11:39:52.943 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.939+0000 7f0958b1e880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:52.943 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.940+0000 7f093e291640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:39:52.945 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.942+0000 7f0958b1e880 20 remove_watcher() i=0 2023-10-05T11:39:52.945 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.942+0000 7f0958b1e880 2 removed watcher, disabling cache 2023-10-05T11:39:52.946 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.943+0000 7f0958b1e880 20 remove_watcher() i=1 2023-10-05T11:39:52.947 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.944+0000 7f0958b1e880 20 remove_watcher() i=2 2023-10-05T11:39:52.948 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.945+0000 7f0958b1e880 20 remove_watcher() i=3 2023-10-05T11:39:52.949 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.946+0000 7f0958b1e880 20 remove_watcher() i=4 2023-10-05T11:39:52.950 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.947+0000 7f0958b1e880 20 remove_watcher() i=5 2023-10-05T11:39:52.951 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.948+0000 7f0958b1e880 20 remove_watcher() i=6 2023-10-05T11:39:52.952 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:52.949+0000 7f0958b1e880 20 remove_watcher() i=7 2023-10-05T11:39:52.957 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:39:52.957 INFO:tasks.workunit.client.0.smithi012.stderr:BUCKET_STATS: 2023-10-05T11:39:52.957 INFO:tasks.workunit.client.0.smithi012.stderr:bucket: error-at-set-target-layout id: dff27d1e-df33-400e-a68a-7ba586947c99.4604.18 num_objects: 20 size_kb: 1 num_shards: 11 2023-10-05T11:39:52.957 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:39:53.039 INFO:tasks.workunit.client.0.smithi012.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2023-10-05T11:39:53.070 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setuser ceph since I am not root 2023-10-05T11:39:53.070 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T11:39:53.082 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.079+0000 7f0fc3335880 20 rados->read ofs=0 len=0 2023-10-05T11:39:53.084 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.081+0000 7f0fc3335880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:53.084 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.081+0000 7f0fc3335880 20 realm 2023-10-05T11:39:53.084 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.081+0000 7f0fc3335880 20 rados->read ofs=0 len=0 2023-10-05T11:39:53.085 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.081+0000 7f0fc3335880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:53.085 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.081+0000 7f0fc3335880 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T11:39:53.085 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.081+0000 7f0fc3335880 20 rados->read ofs=0 len=0 2023-10-05T11:39:53.085 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.081+0000 7f0fc3335880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:53.085 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.081+0000 7f0fc3335880 20 rados->read ofs=0 len=0 2023-10-05T11:39:53.085 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.082+0000 7f0fc3335880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:39:53.085 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.082+0000 7f0fc3335880 20 rados->read ofs=0 len=0 2023-10-05T11:39:53.086 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.083+0000 7f0fc3335880 20 rados_obj.operate() r=0 bl.length=1020 2023-10-05T11:39:53.086 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.083+0000 7f0fc3335880 20 searching for the correct realm 2023-10-05T11:39:53.096 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.092+0000 7f0fc0515640 0 -- 172.21.15.12:0/3825605906 >> [v2:172.21.15.12:6824/2171933159,v1:172.21.15.12:6825/2171933159] conn(0x55dff860bc00 msgr2=0x55dff854b700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-10-05T11:39:53.097 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.093+0000 7f0fc3335880 20 RGWRados::pool_iterate: got zone_info.dff27d1e-df33-400e-a68a-7ba586947c99 2023-10-05T11:39:53.097 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.093+0000 7f0fc3335880 20 RGWRados::pool_iterate: got zonegroup_info.c78aa576-9d15-4e9d-b3c0-4af23a22062c 2023-10-05T11:39:53.097 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.093+0000 7f0fc3335880 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T11:39:53.097 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.093+0000 7f0fc3335880 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T11:39:53.097 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.093+0000 7f0fc3335880 20 rados->read ofs=0 len=0 2023-10-05T11:39:53.097 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.094+0000 7f0fc3335880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:53.098 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.094+0000 7f0fc3335880 20 rados->read ofs=0 len=0 2023-10-05T11:39:53.099 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.094+0000 7f0fc3335880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:39:53.099 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.094+0000 7f0fc3335880 20 rados->read ofs=0 len=0 2023-10-05T11:39:53.099 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.094+0000 7f0fc3335880 20 rados_obj.operate() r=0 bl.length=454 2023-10-05T11:39:53.099 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.094+0000 7f0fc3335880 20 zone default found 2023-10-05T11:39:53.099 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.094+0000 7f0fc3335880 4 Realm: () 2023-10-05T11:39:53.099 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.094+0000 7f0fc3335880 4 ZoneGroup: default (c78aa576-9d15-4e9d-b3c0-4af23a22062c) 2023-10-05T11:39:53.099 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.094+0000 7f0fc3335880 4 Zone: default (dff27d1e-df33-400e-a68a-7ba586947c99) 2023-10-05T11:39:53.099 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.094+0000 7f0fc3335880 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T11:39:53.099 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.094+0000 7f0fc3335880 20 zonegroup default 2023-10-05T11:39:53.099 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.094+0000 7f0fc3335880 20 rados->read ofs=0 len=0 2023-10-05T11:39:53.100 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.094+0000 7f0fc3335880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:53.100 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.094+0000 7f0fc3335880 20 rados->read ofs=0 len=0 2023-10-05T11:39:53.100 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.095+0000 7f0fc3335880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:53.100 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.095+0000 7f0fc3335880 20 rados->read ofs=0 len=0 2023-10-05T11:39:53.100 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.095+0000 7f0fc3335880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:53.100 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.095+0000 7f0fc3335880 20 started sync module instance, tier type = 2023-10-05T11:39:53.100 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.095+0000 7f0fc3335880 20 started zone id=dff27d1e-df33-400e-a68a-7ba586947c99 (name=default) with tier type = 2023-10-05T11:39:53.106 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.103+0000 7f0fc0515640 0 -- 172.21.15.12:0/3825605906 >> [v2:172.21.15.12:6824/2171933159,v1:172.21.15.12:6825/2171933159] conn(0x55dff86fd000 msgr2=0x55dff8612100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:39:53.108 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.104+0000 7f0fc3335880 20 add_watcher() i=0 2023-10-05T11:39:53.108 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.104+0000 7f0fc3335880 20 add_watcher() i=1 2023-10-05T11:39:53.108 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.104+0000 7f0fc3335880 20 add_watcher() i=2 2023-10-05T11:39:53.108 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.104+0000 7f0fc3335880 20 add_watcher() i=3 2023-10-05T11:39:53.108 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.104+0000 7f0fc3335880 20 add_watcher() i=4 2023-10-05T11:39:53.108 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.104+0000 7f0fc3335880 20 add_watcher() i=5 2023-10-05T11:39:53.108 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.104+0000 7f0fc3335880 20 add_watcher() i=6 2023-10-05T11:39:53.109 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.105+0000 7f0fc3335880 20 add_watcher() i=7 2023-10-05T11:39:53.109 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.105+0000 7f0fc3335880 2 all 8 watchers are set, enabling cache 2023-10-05T11:39:53.110 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.107+0000 7f0fa6ce2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:39:53.110 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.107+0000 7f0fc3335880 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T11:39:53.111 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.107+0000 7f0fc3335880 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T11:39:53.117 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.113+0000 7f0fc3335880 5 note: GC not initialized 2023-10-05T11:39:53.117 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.113+0000 7f0fa24d9640 20 reqs_thread_entry: start 2023-10-05T11:39:53.117 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.113+0000 7f0fc3335880 20 init_complete bucket index max shards: 11 2023-10-05T11:39:53.117 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.113+0000 7f0fc3335880 20 Filter name: none 2023-10-05T11:39:53.117 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.113+0000 7f0fa04d5640 20 reqs_thread_entry: start 2023-10-05T11:39:53.117 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.113+0000 7f0fc3335880 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2023-10-05T11:39:53.117 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.113+0000 7f0fc3335880 20 rados->read ofs=0 len=0 2023-10-05T11:39:53.117 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.114+0000 7f0fc3335880 20 rados_obj.operate() r=0 bl.length=218 2023-10-05T11:39:53.118 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.114+0000 7f0fc3335880 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2023-10-05T11:39:53.118 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.114+0000 7f0fc3335880 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2023-10-05T11:39:53.118 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.114+0000 7f0fc3335880 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.18 : miss 2023-10-05T11:39:53.118 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.114+0000 7f0fc3335880 20 rados->read ofs=0 len=0 2023-10-05T11:39:53.118 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.114+0000 7f0fc3335880 20 rados_obj.operate() r=0 bl.length=390 2023-10-05T11:39:53.118 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.114+0000 7f0fc3335880 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.18 info.flags=0x17 2023-10-05T11:39:53.118 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.114+0000 7f0fc3335880 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.18 to cache LRU end 2023-10-05T11:39:53.119 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.114+0000 7f0fc3335880 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T11:39:53.119 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.114+0000 7f0fc3335880 10 updating xattr: name=user.rgw.acl bl.length()=265 2023-10-05T11:39:53.119 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.114+0000 7f0fc3335880 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.18 2023-10-05T11:39:53.122 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.119+0000 7f0fc3335880 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.18 info.flags=0x17 2023-10-05T11:39:53.123 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.119+0000 7f0fc3335880 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.18 to cache LRU end 2023-10-05T11:39:53.123 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.119+0000 7f0fc3335880 10 updating xattr: name=user.rgw.acl bl.length()=265 2023-10-05T11:39:53.123 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.119+0000 7f0fc3335880 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.18, ofs0, ns] 2023-10-05T11:39:53.123 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.120+0000 7f0fba509640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1060856922159 cookie 94420434147328 notifier 6456 bl.length()=959 2023-10-05T11:39:53.123 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.120+0000 7f0fba509640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.18 info.flags=0x17 2023-10-05T11:39:53.123 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.120+0000 7f0fba509640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.18 to cache LRU end 2023-10-05T11:39:53.123 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.120+0000 7f0fba509640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2023-10-05T11:39:53.125 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.122+0000 7f0fc3335880 20 handle_bi_update(): bucket=:error-at-set-target-layout[dff27d1e-df33-400e-a68a-7ba586947c99.4604.18]): orig_sources= new_sources= 2023-10-05T11:39:53.125 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.122+0000 7f0fc3335880 20 handle_bi_update(): bucket=:error-at-set-target-layout[dff27d1e-df33-400e-a68a-7ba586947c99.4604.18]): potential sources added=[] removed=[] 2023-10-05T11:39:53.125 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.122+0000 7f0fc3335880 20 handle_bi_update(): bucket=:error-at-set-target-layout[dff27d1e-df33-400e-a68a-7ba586947c99.4604.18]): orig_dests= new_dests= 2023-10-05T11:39:53.125 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.122+0000 7f0fc3335880 20 handle_bi_update(): bucket=:error-at-set-target-layout[dff27d1e-df33-400e-a68a-7ba586947c99.4604.18]): potential dests added=[] removed=[] 2023-10-05T11:39:53.128 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.124+0000 7f0fc3335880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.18.1.0 2023-10-05T11:39:53.128 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.124+0000 7f0fc3335880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.18.1.0 2023-10-05T11:39:53.128 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.124+0000 7f0fc3335880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.18.1.1 2023-10-05T11:39:53.128 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.124+0000 7f0fc3335880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.18.1.1 2023-10-05T11:39:53.128 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.124+0000 7f0fc3335880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.18.1.2 2023-10-05T11:39:53.128 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.124+0000 7f0fc3335880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.18.1.2 2023-10-05T11:39:53.128 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.124+0000 7f0fc3335880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.18.1.3 2023-10-05T11:39:53.128 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.124+0000 7f0fc3335880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.18.1.3 2023-10-05T11:39:53.128 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.124+0000 7f0fc3335880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.18.1.4 2023-10-05T11:39:53.128 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.124+0000 7f0fc3335880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.18.1.4 2023-10-05T11:39:53.128 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.124+0000 7f0fc3335880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.18.1.5 2023-10-05T11:39:53.129 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.124+0000 7f0fc3335880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.18.1.5 2023-10-05T11:39:53.129 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.124+0000 7f0fc3335880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.18.1.6 2023-10-05T11:39:53.129 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.124+0000 7f0fc3335880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.18.1.6 2023-10-05T11:39:53.129 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.124+0000 7f0fc3335880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.18.1.7 2023-10-05T11:39:53.129 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.124+0000 7f0fc3335880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.18.1.7 2023-10-05T11:39:53.129 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.124+0000 7f0fc3335880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.18.1.8 2023-10-05T11:39:53.129 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.124+0000 7f0fc3335880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.18.1.8 2023-10-05T11:39:53.129 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.124+0000 7f0fc3335880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.18.1.9 2023-10-05T11:39:53.129 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.124+0000 7f0fc3335880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.18.1.9 2023-10-05T11:39:53.129 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.124+0000 7f0fc3335880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.18.1.10 2023-10-05T11:39:53.129 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.124+0000 7f0fc3335880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.18.1.10 2023-10-05T11:39:53.129 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.124+0000 7f0fc3335880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.18.1.11 2023-10-05T11:39:53.130 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.124+0000 7f0fc3335880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.18.1.11 2023-10-05T11:39:53.130 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.124+0000 7f0fc3335880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.18.0 2023-10-05T11:39:53.130 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.125+0000 7f0fc3335880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.18.1 2023-10-05T11:39:53.131 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.125+0000 7f0fc3335880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.18.2 2023-10-05T11:39:53.131 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.126+0000 7f0fc3335880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.18.3 2023-10-05T11:39:53.131 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.126+0000 7f0fc3335880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.18.4 2023-10-05T11:39:53.131 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.127+0000 7f0fc3335880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.18.5 2023-10-05T11:39:53.131 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.127+0000 7f0fc3335880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.18.6 2023-10-05T11:39:53.131 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.128+0000 7f0fc3335880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.18.7 2023-10-05T11:39:53.131 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.128+0000 7f0fc3335880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.18.8 2023-10-05T11:39:53.132 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.129+0000 7f0fc3335880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.18.9 2023-10-05T11:39:53.132 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.129+0000 7f0fc3335880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.18.10 2023-10-05T11:39:53.135 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.132+0000 7f0fc3335880 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.18 : hit (requested=0x17, cached=0x17) 2023-10-05T11:39:53.136 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.132+0000 7f0fc3335880 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.18 2023-10-05T11:39:53.137 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.133+0000 7f0fc3335880 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.18 info.flags=0x17 2023-10-05T11:39:53.137 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.133+0000 7f0fc3335880 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.18 to cache LRU end 2023-10-05T11:39:53.137 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.133+0000 7f0fc3335880 10 updating xattr: name=user.rgw.acl bl.length()=265 2023-10-05T11:39:53.137 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.133+0000 7f0fc3335880 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.18, ofs0, ns] 2023-10-05T11:39:53.137 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.134+0000 7f0fba509640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1060856922160 cookie 94420434147328 notifier 6456 bl.length()=927 2023-10-05T11:39:53.137 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.134+0000 7f0fba509640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.18 info.flags=0x17 2023-10-05T11:39:53.137 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.134+0000 7f0fba509640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.18 to cache LRU end 2023-10-05T11:39:53.138 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.134+0000 7f0fba509640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2023-10-05T11:39:53.139 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.135+0000 7f0fc3335880 20 handle_bi_update(): bucket=:error-at-set-target-layout[dff27d1e-df33-400e-a68a-7ba586947c99.4604.18]): orig_sources= new_sources= 2023-10-05T11:39:53.139 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.135+0000 7f0fc3335880 20 handle_bi_update(): bucket=:error-at-set-target-layout[dff27d1e-df33-400e-a68a-7ba586947c99.4604.18]): potential sources added=[] removed=[] 2023-10-05T11:39:53.139 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.135+0000 7f0fc3335880 20 handle_bi_update(): bucket=:error-at-set-target-layout[dff27d1e-df33-400e-a68a-7ba586947c99.4604.18]): orig_dests= new_dests= 2023-10-05T11:39:53.139 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.135+0000 7f0fc3335880 20 handle_bi_update(): bucket=:error-at-set-target-layout[dff27d1e-df33-400e-a68a-7ba586947c99.4604.18]): potential dests added=[] removed=[] 2023-10-05T11:39:53.141 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.137+0000 7f0fc3335880 1 execute INFO: reshard of bucket "error-at-set-target-layout" completed successfully 2023-10-05T11:39:53.142 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.139+0000 7f0fa6ce2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:39:53.144 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.141+0000 7f0fc3335880 20 remove_watcher() i=0 2023-10-05T11:39:53.144 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.141+0000 7f0fc3335880 2 removed watcher, disabling cache 2023-10-05T11:39:53.145 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.142+0000 7f0fc3335880 20 remove_watcher() i=1 2023-10-05T11:39:53.147 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.144+0000 7f0fc3335880 20 remove_watcher() i=2 2023-10-05T11:39:53.148 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.145+0000 7f0fc3335880 20 remove_watcher() i=3 2023-10-05T11:39:53.149 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.146+0000 7f0fc3335880 20 remove_watcher() i=4 2023-10-05T11:39:53.151 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.148+0000 7f0fc3335880 20 remove_watcher() i=5 2023-10-05T11:39:53.152 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.149+0000 7f0fc3335880 20 remove_watcher() i=6 2023-10-05T11:39:53.153 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.150+0000 7f0fc3335880 20 remove_watcher() i=7 2023-10-05T11:39:53.159 INFO:tasks.workunit.client.0.smithi012.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2023-10-05T11:39:53.187 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setuser ceph since I am not root 2023-10-05T11:39:53.187 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T11:39:53.201 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.197+0000 7f442b336880 20 rados->read ofs=0 len=0 2023-10-05T11:39:53.202 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.199+0000 7f442b336880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:53.202 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.199+0000 7f442b336880 20 realm 2023-10-05T11:39:53.203 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.199+0000 7f442b336880 20 rados->read ofs=0 len=0 2023-10-05T11:39:53.203 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.199+0000 7f442b336880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:53.203 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.199+0000 7f442b336880 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T11:39:53.203 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.199+0000 7f442b336880 20 rados->read ofs=0 len=0 2023-10-05T11:39:53.203 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.199+0000 7f442b336880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:53.203 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.199+0000 7f442b336880 20 rados->read ofs=0 len=0 2023-10-05T11:39:53.204 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.200+0000 7f442b336880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:39:53.204 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.200+0000 7f442b336880 20 rados->read ofs=0 len=0 2023-10-05T11:39:53.204 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.200+0000 7f442b336880 20 rados_obj.operate() r=0 bl.length=1020 2023-10-05T11:39:53.204 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.200+0000 7f442b336880 20 searching for the correct realm 2023-10-05T11:39:53.213 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.210+0000 7f44284e9640 0 -- 172.21.15.12:0/1445316316 >> [v2:172.21.15.12:6824/2171933159,v1:172.21.15.12:6825/2171933159] conn(0x55d7ab467c00 msgr2=0x55d7ab3bb700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:39:53.214 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.211+0000 7f442b336880 20 RGWRados::pool_iterate: got zone_info.dff27d1e-df33-400e-a68a-7ba586947c99 2023-10-05T11:39:53.214 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.211+0000 7f442b336880 20 RGWRados::pool_iterate: got zonegroup_info.c78aa576-9d15-4e9d-b3c0-4af23a22062c 2023-10-05T11:39:53.215 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.211+0000 7f442b336880 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T11:39:53.215 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.211+0000 7f442b336880 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T11:39:53.215 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.211+0000 7f442b336880 20 rados->read ofs=0 len=0 2023-10-05T11:39:53.215 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.211+0000 7f442b336880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:53.215 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.211+0000 7f442b336880 20 rados->read ofs=0 len=0 2023-10-05T11:39:53.215 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.211+0000 7f442b336880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:39:53.215 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.211+0000 7f442b336880 20 rados->read ofs=0 len=0 2023-10-05T11:39:53.216 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.211+0000 7f442b336880 20 rados_obj.operate() r=0 bl.length=454 2023-10-05T11:39:53.216 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.211+0000 7f442b336880 20 zone default found 2023-10-05T11:39:53.216 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.211+0000 7f442b336880 4 Realm: () 2023-10-05T11:39:53.216 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.211+0000 7f442b336880 4 ZoneGroup: default (c78aa576-9d15-4e9d-b3c0-4af23a22062c) 2023-10-05T11:39:53.216 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.211+0000 7f442b336880 4 Zone: default (dff27d1e-df33-400e-a68a-7ba586947c99) 2023-10-05T11:39:53.217 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.211+0000 7f442b336880 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T11:39:53.217 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.211+0000 7f442b336880 20 zonegroup default 2023-10-05T11:39:53.217 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.211+0000 7f442b336880 20 rados->read ofs=0 len=0 2023-10-05T11:39:53.217 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.212+0000 7f442b336880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:53.217 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.212+0000 7f442b336880 20 rados->read ofs=0 len=0 2023-10-05T11:39:53.217 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.212+0000 7f442b336880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:53.217 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.212+0000 7f442b336880 20 rados->read ofs=0 len=0 2023-10-05T11:39:53.217 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.212+0000 7f442b336880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:53.217 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.212+0000 7f442b336880 20 started sync module instance, tier type = 2023-10-05T11:39:53.217 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.212+0000 7f442b336880 20 started zone id=dff27d1e-df33-400e-a68a-7ba586947c99 (name=default) with tier type = 2023-10-05T11:39:53.223 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.219+0000 7f44284e9640 0 -- 172.21.15.12:0/1445316316 >> [v2:172.21.15.12:6824/2171933159,v1:172.21.15.12:6825/2171933159] conn(0x55d7ab594000 msgr2=0x55d7ab480100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:39:53.225 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.221+0000 7f442b336880 20 add_watcher() i=0 2023-10-05T11:39:53.225 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.221+0000 7f442b336880 20 add_watcher() i=1 2023-10-05T11:39:53.225 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.221+0000 7f442b336880 20 add_watcher() i=2 2023-10-05T11:39:53.225 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.221+0000 7f442b336880 20 add_watcher() i=3 2023-10-05T11:39:53.225 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.221+0000 7f442b336880 20 add_watcher() i=4 2023-10-05T11:39:53.225 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.221+0000 7f442b336880 20 add_watcher() i=5 2023-10-05T11:39:53.225 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.221+0000 7f442b336880 20 add_watcher() i=6 2023-10-05T11:39:53.226 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.222+0000 7f442b336880 20 add_watcher() i=7 2023-10-05T11:39:53.226 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.222+0000 7f442b336880 2 all 8 watchers are set, enabling cache 2023-10-05T11:39:53.227 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.224+0000 7f440ecb6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:39:53.227 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.224+0000 7f442b336880 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T11:39:53.228 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.224+0000 7f442b336880 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T11:39:53.233 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.230+0000 7f442b336880 5 note: GC not initialized 2023-10-05T11:39:53.233 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.230+0000 7f440a4ad640 20 reqs_thread_entry: start 2023-10-05T11:39:53.234 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.230+0000 7f442b336880 20 init_complete bucket index max shards: 11 2023-10-05T11:39:53.234 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.230+0000 7f442b336880 20 Filter name: none 2023-10-05T11:39:53.234 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.230+0000 7f44084a9640 20 reqs_thread_entry: start 2023-10-05T11:39:53.234 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.230+0000 7f442b336880 20 rados->read ofs=0 len=0 2023-10-05T11:39:53.235 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.230+0000 7f442b336880 20 rados_obj.operate() r=0 bl.length=218 2023-10-05T11:39:53.235 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.231+0000 7f442b336880 20 rados->read ofs=0 len=0 2023-10-05T11:39:53.235 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.231+0000 7f442b336880 20 rados_obj.operate() r=0 bl.length=390 2023-10-05T11:39:53.235 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.231+0000 7f442b336880 20 couldn't put binfo cache entry, might have raced with data changes 2023-10-05T11:39:53.235 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.231+0000 7f442b336880 20 rados->read ofs=0 len=0 2023-10-05T11:39:53.235 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.231+0000 7f442b336880 20 rados_obj.operate() r=0 bl.length=218 2023-10-05T11:39:53.236 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.231+0000 7f442b336880 20 rados->read ofs=0 len=0 2023-10-05T11:39:53.236 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.232+0000 7f442b336880 20 rados_obj.operate() r=0 bl.length=390 2023-10-05T11:39:53.236 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.232+0000 7f442b336880 20 couldn't put binfo cache entry, might have raced with data changes 2023-10-05T11:39:53.236 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.233+0000 7f442b336880 20 rados->read ofs=0 len=0 2023-10-05T11:39:53.236 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.233+0000 7f442b336880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:53.237 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.234+0000 7f440ecb6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:39:53.239 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.236+0000 7f442b336880 20 remove_watcher() i=0 2023-10-05T11:39:53.239 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.236+0000 7f442b336880 2 removed watcher, disabling cache 2023-10-05T11:39:53.240 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.237+0000 7f442b336880 20 remove_watcher() i=1 2023-10-05T11:39:53.241 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.238+0000 7f442b336880 20 remove_watcher() i=2 2023-10-05T11:39:53.242 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.239+0000 7f442b336880 20 remove_watcher() i=3 2023-10-05T11:39:53.244 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.241+0000 7f442b336880 20 remove_watcher() i=4 2023-10-05T11:39:53.245 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.242+0000 7f442b336880 20 remove_watcher() i=5 2023-10-05T11:39:53.246 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.243+0000 7f442b336880 20 remove_watcher() i=6 2023-10-05T11:39:53.247 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:53.244+0000 7f442b336880 20 remove_watcher() i=7 2023-10-05T11:39:53.251 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:39:53.251 INFO:tasks.workunit.client.0.smithi012.stderr:BUCKET_STATS: 2023-10-05T11:39:53.252 INFO:tasks.workunit.client.0.smithi012.stderr:bucket: error-at-set-target-layout id: dff27d1e-df33-400e-a68a-7ba586947c99.4604.18 num_objects: 19 size_kb: 1 num_shards: 12 2023-10-05T11:39:53.252 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:39:53.602 INFO:tasks.workunit.client.0.smithi012.stderr:TEST: reshard bucket with ECANCELED injected at set_target_layout 2023-10-05T11:39:53.602 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:39:54.304 INFO:tasks.workunit.client.0.smithi012.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2023-10-05T11:39:54.332 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setuser ceph since I am not root 2023-10-05T11:39:54.333 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T11:39:54.345 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.342+0000 7f56e6a13880 20 rados->read ofs=0 len=0 2023-10-05T11:39:54.347 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.343+0000 7f56e6a13880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:54.347 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.343+0000 7f56e6a13880 20 realm 2023-10-05T11:39:54.347 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.343+0000 7f56e6a13880 20 rados->read ofs=0 len=0 2023-10-05T11:39:54.347 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.343+0000 7f56e6a13880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:54.347 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.343+0000 7f56e6a13880 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T11:39:54.347 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.343+0000 7f56e6a13880 20 rados->read ofs=0 len=0 2023-10-05T11:39:54.347 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.344+0000 7f56e6a13880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:54.347 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.344+0000 7f56e6a13880 20 rados->read ofs=0 len=0 2023-10-05T11:39:54.348 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.344+0000 7f56e6a13880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:39:54.348 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.344+0000 7f56e6a13880 20 rados->read ofs=0 len=0 2023-10-05T11:39:54.348 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.345+0000 7f56e6a13880 20 rados_obj.operate() r=0 bl.length=1020 2023-10-05T11:39:54.349 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.345+0000 7f56e6a13880 20 searching for the correct realm 2023-10-05T11:39:54.358 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.354+0000 7f56e51bf640 0 -- 172.21.15.12:0/3264195491 >> [v2:172.21.15.170:6814/3150808418,v1:172.21.15.170:6816/3150808418] conn(0x55e5926a5c00 msgr2=0x55e591ac4c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:39:54.359 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.356+0000 7f56e6a13880 20 RGWRados::pool_iterate: got zone_info.dff27d1e-df33-400e-a68a-7ba586947c99 2023-10-05T11:39:54.359 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.356+0000 7f56e6a13880 20 RGWRados::pool_iterate: got zonegroup_info.c78aa576-9d15-4e9d-b3c0-4af23a22062c 2023-10-05T11:39:54.359 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.356+0000 7f56e6a13880 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T11:39:54.359 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.356+0000 7f56e6a13880 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T11:39:54.359 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.356+0000 7f56e6a13880 20 rados->read ofs=0 len=0 2023-10-05T11:39:54.360 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.356+0000 7f56e6a13880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:54.360 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.356+0000 7f56e6a13880 20 rados->read ofs=0 len=0 2023-10-05T11:39:54.361 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.356+0000 7f56e6a13880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:39:54.361 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.356+0000 7f56e6a13880 20 rados->read ofs=0 len=0 2023-10-05T11:39:54.361 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.357+0000 7f56e6a13880 20 rados_obj.operate() r=0 bl.length=454 2023-10-05T11:39:54.361 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.357+0000 7f56e6a13880 20 zone default found 2023-10-05T11:39:54.361 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.357+0000 7f56e6a13880 4 Realm: () 2023-10-05T11:39:54.361 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.357+0000 7f56e6a13880 4 ZoneGroup: default (c78aa576-9d15-4e9d-b3c0-4af23a22062c) 2023-10-05T11:39:54.361 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.357+0000 7f56e6a13880 4 Zone: default (dff27d1e-df33-400e-a68a-7ba586947c99) 2023-10-05T11:39:54.361 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.357+0000 7f56e6a13880 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T11:39:54.361 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.357+0000 7f56e6a13880 20 zonegroup default 2023-10-05T11:39:54.361 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.357+0000 7f56e6a13880 20 rados->read ofs=0 len=0 2023-10-05T11:39:54.361 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.357+0000 7f56e6a13880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:54.361 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.357+0000 7f56e6a13880 20 rados->read ofs=0 len=0 2023-10-05T11:39:54.362 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.357+0000 7f56e6a13880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:54.362 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.357+0000 7f56e6a13880 20 rados->read ofs=0 len=0 2023-10-05T11:39:54.362 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.357+0000 7f56e6a13880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:54.362 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.357+0000 7f56e6a13880 20 started sync module instance, tier type = 2023-10-05T11:39:54.362 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.357+0000 7f56e6a13880 20 started zone id=dff27d1e-df33-400e-a68a-7ba586947c99 (name=default) with tier type = 2023-10-05T11:39:54.367 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.364+0000 7f56e59c0640 0 -- 172.21.15.12:0/3264195491 >> [v2:172.21.15.170:6800/4137726411,v1:172.21.15.170:6801/4137726411] conn(0x55e591c89000 msgr2=0x55e591b85600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:39:54.370 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.366+0000 7f56e6a13880 20 add_watcher() i=0 2023-10-05T11:39:54.370 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.366+0000 7f56e6a13880 20 add_watcher() i=1 2023-10-05T11:39:54.370 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.366+0000 7f56e6a13880 20 add_watcher() i=2 2023-10-05T11:39:54.370 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.366+0000 7f56e6a13880 20 add_watcher() i=3 2023-10-05T11:39:54.370 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.366+0000 7f56e6a13880 20 add_watcher() i=4 2023-10-05T11:39:54.370 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.366+0000 7f56e6a13880 20 add_watcher() i=5 2023-10-05T11:39:54.370 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.366+0000 7f56e6a13880 20 add_watcher() i=6 2023-10-05T11:39:54.371 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.367+0000 7f56e6a13880 20 add_watcher() i=7 2023-10-05T11:39:54.371 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.367+0000 7f56e6a13880 2 all 8 watchers are set, enabling cache 2023-10-05T11:39:54.372 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.369+0000 7f56cc18d640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:39:54.372 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.369+0000 7f56e6a13880 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T11:39:54.372 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.369+0000 7f56e6a13880 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T11:39:54.378 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.374+0000 7f56e6a13880 5 note: GC not initialized 2023-10-05T11:39:54.378 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.375+0000 7f56c7984640 20 reqs_thread_entry: start 2023-10-05T11:39:54.378 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.375+0000 7f56e6a13880 20 init_complete bucket index max shards: 11 2023-10-05T11:39:54.378 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.375+0000 7f56e6a13880 20 Filter name: none 2023-10-05T11:39:54.379 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.375+0000 7f56c5980640 20 reqs_thread_entry: start 2023-10-05T11:39:54.379 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.375+0000 7f56e6a13880 20 rados->read ofs=0 len=0 2023-10-05T11:39:54.379 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.375+0000 7f56e6a13880 20 rados_obj.operate() r=0 bl.length=218 2023-10-05T11:39:54.379 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.375+0000 7f56e6a13880 20 rados->read ofs=0 len=0 2023-10-05T11:39:54.380 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.376+0000 7f56e6a13880 20 rados_obj.operate() r=0 bl.length=390 2023-10-05T11:39:54.380 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.376+0000 7f56e6a13880 20 couldn't put binfo cache entry, might have raced with data changes 2023-10-05T11:39:54.380 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.376+0000 7f56e6a13880 20 rados->read ofs=0 len=0 2023-10-05T11:39:54.380 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.376+0000 7f56e6a13880 20 rados_obj.operate() r=0 bl.length=218 2023-10-05T11:39:54.380 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.376+0000 7f56e6a13880 20 rados->read ofs=0 len=0 2023-10-05T11:39:54.381 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.376+0000 7f56e6a13880 20 rados_obj.operate() r=0 bl.length=390 2023-10-05T11:39:54.381 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.377+0000 7f56e6a13880 20 couldn't put binfo cache entry, might have raced with data changes 2023-10-05T11:39:54.381 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.377+0000 7f56e6a13880 20 rados->read ofs=0 len=0 2023-10-05T11:39:54.381 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.377+0000 7f56e6a13880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:54.381 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.378+0000 7f56cc18d640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:39:54.383 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.380+0000 7f56e6a13880 20 remove_watcher() i=0 2023-10-05T11:39:54.383 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.380+0000 7f56e6a13880 2 removed watcher, disabling cache 2023-10-05T11:39:54.385 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.382+0000 7f56e6a13880 20 remove_watcher() i=1 2023-10-05T11:39:54.386 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.383+0000 7f56e6a13880 20 remove_watcher() i=2 2023-10-05T11:39:54.387 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.384+0000 7f56e6a13880 20 remove_watcher() i=3 2023-10-05T11:39:54.388 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.385+0000 7f56e6a13880 20 remove_watcher() i=4 2023-10-05T11:39:54.389 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.386+0000 7f56e6a13880 20 remove_watcher() i=5 2023-10-05T11:39:54.391 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.387+0000 7f56e6a13880 20 remove_watcher() i=6 2023-10-05T11:39:54.392 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.388+0000 7f56e6a13880 20 remove_watcher() i=7 2023-10-05T11:39:54.397 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:39:54.397 INFO:tasks.workunit.client.0.smithi012.stderr:BUCKET_STATS: 2023-10-05T11:39:54.397 INFO:tasks.workunit.client.0.smithi012.stderr:bucket: error-at-set-target-layout id: dff27d1e-df33-400e-a68a-7ba586947c99.4604.19 num_objects: 20 size_kb: 1 num_shards: 11 2023-10-05T11:39:54.397 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:39:54.398 INFO:tasks.workunit.client.0.smithi012.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at set_target_layout --inject-error-code 125 2023-10-05T11:39:54.432 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setuser ceph since I am not root 2023-10-05T11:39:54.432 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T11:39:54.445 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.442+0000 7f30d4726880 20 rados->read ofs=0 len=0 2023-10-05T11:39:54.447 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.444+0000 7f30d4726880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:54.447 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.444+0000 7f30d4726880 20 realm 2023-10-05T11:39:54.448 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.444+0000 7f30d4726880 20 rados->read ofs=0 len=0 2023-10-05T11:39:54.448 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.444+0000 7f30d4726880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:54.448 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.444+0000 7f30d4726880 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T11:39:54.448 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.444+0000 7f30d4726880 20 rados->read ofs=0 len=0 2023-10-05T11:39:54.448 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.444+0000 7f30d4726880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:54.448 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.444+0000 7f30d4726880 20 rados->read ofs=0 len=0 2023-10-05T11:39:54.448 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.445+0000 7f30d4726880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:39:54.448 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.445+0000 7f30d4726880 20 rados->read ofs=0 len=0 2023-10-05T11:39:54.449 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.446+0000 7f30d4726880 20 rados_obj.operate() r=0 bl.length=1020 2023-10-05T11:39:54.449 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.446+0000 7f30d4726880 20 searching for the correct realm 2023-10-05T11:39:54.458 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.455+0000 7f30d0fc8640 0 -- 172.21.15.12:0/855929798 >> [v2:172.21.15.170:6814/3150808418,v1:172.21.15.170:6816/3150808418] conn(0x560cc8d77400 msgr2=0x560cc8ccb180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:39:54.460 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.456+0000 7f30d4726880 20 RGWRados::pool_iterate: got zone_info.dff27d1e-df33-400e-a68a-7ba586947c99 2023-10-05T11:39:54.460 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.456+0000 7f30d4726880 20 RGWRados::pool_iterate: got zonegroup_info.c78aa576-9d15-4e9d-b3c0-4af23a22062c 2023-10-05T11:39:54.460 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.456+0000 7f30d4726880 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T11:39:54.460 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.456+0000 7f30d4726880 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T11:39:54.460 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.456+0000 7f30d4726880 20 rados->read ofs=0 len=0 2023-10-05T11:39:54.460 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.456+0000 7f30d4726880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:54.460 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.456+0000 7f30d4726880 20 rados->read ofs=0 len=0 2023-10-05T11:39:54.461 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.457+0000 7f30d4726880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:39:54.461 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.457+0000 7f30d4726880 20 rados->read ofs=0 len=0 2023-10-05T11:39:54.461 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.457+0000 7f30d4726880 20 rados_obj.operate() r=0 bl.length=454 2023-10-05T11:39:54.462 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.457+0000 7f30d4726880 20 zone default found 2023-10-05T11:39:54.462 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.457+0000 7f30d4726880 4 Realm: () 2023-10-05T11:39:54.462 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.457+0000 7f30d4726880 4 ZoneGroup: default (c78aa576-9d15-4e9d-b3c0-4af23a22062c) 2023-10-05T11:39:54.462 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.457+0000 7f30d4726880 4 Zone: default (dff27d1e-df33-400e-a68a-7ba586947c99) 2023-10-05T11:39:54.462 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.457+0000 7f30d4726880 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T11:39:54.462 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.457+0000 7f30d4726880 20 zonegroup default 2023-10-05T11:39:54.462 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.457+0000 7f30d4726880 20 rados->read ofs=0 len=0 2023-10-05T11:39:54.462 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.457+0000 7f30d4726880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:54.462 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.457+0000 7f30d4726880 20 rados->read ofs=0 len=0 2023-10-05T11:39:54.462 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.457+0000 7f30d4726880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:54.462 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.457+0000 7f30d4726880 20 rados->read ofs=0 len=0 2023-10-05T11:39:54.463 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.458+0000 7f30d4726880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:54.463 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.458+0000 7f30d4726880 20 started sync module instance, tier type = 2023-10-05T11:39:54.463 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.458+0000 7f30d4726880 20 started zone id=dff27d1e-df33-400e-a68a-7ba586947c99 (name=default) with tier type = 2023-10-05T11:39:54.467 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.464+0000 7f30d17c9640 0 -- 172.21.15.12:0/855929798 >> [v2:172.21.15.170:6800/4137726411,v1:172.21.15.170:6801/4137726411] conn(0x560cc8e8a400 msgr2=0x560cc8e6b700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-10-05T11:39:54.472 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.469+0000 7f30d4726880 20 add_watcher() i=0 2023-10-05T11:39:54.472 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.469+0000 7f30d4726880 20 add_watcher() i=1 2023-10-05T11:39:54.472 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.469+0000 7f30d4726880 20 add_watcher() i=2 2023-10-05T11:39:54.472 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.469+0000 7f30d4726880 20 add_watcher() i=3 2023-10-05T11:39:54.472 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.469+0000 7f30d4726880 20 add_watcher() i=4 2023-10-05T11:39:54.472 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.469+0000 7f30d4726880 20 add_watcher() i=5 2023-10-05T11:39:54.472 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.469+0000 7f30d4726880 20 add_watcher() i=6 2023-10-05T11:39:54.473 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.469+0000 7f30d4726880 20 add_watcher() i=7 2023-10-05T11:39:54.473 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.469+0000 7f30d4726880 2 all 8 watchers are set, enabling cache 2023-10-05T11:39:54.474 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.471+0000 7f30b7f96640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:39:54.475 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.471+0000 7f30d4726880 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T11:39:54.475 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.471+0000 7f30d4726880 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T11:39:54.481 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.477+0000 7f30d4726880 5 note: GC not initialized 2023-10-05T11:39:54.481 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.477+0000 7f30b378d640 20 reqs_thread_entry: start 2023-10-05T11:39:54.481 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.477+0000 7f30d4726880 20 init_complete bucket index max shards: 11 2023-10-05T11:39:54.481 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.477+0000 7f30d4726880 20 Filter name: none 2023-10-05T11:39:54.481 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.477+0000 7f30b1789640 20 reqs_thread_entry: start 2023-10-05T11:39:54.481 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.477+0000 7f30d4726880 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2023-10-05T11:39:54.481 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.477+0000 7f30d4726880 20 rados->read ofs=0 len=0 2023-10-05T11:39:54.482 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.478+0000 7f30d4726880 20 rados_obj.operate() r=0 bl.length=218 2023-10-05T11:39:54.482 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.478+0000 7f30d4726880 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2023-10-05T11:39:54.482 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.478+0000 7f30d4726880 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2023-10-05T11:39:54.482 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.478+0000 7f30d4726880 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.19 : miss 2023-10-05T11:39:54.482 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.478+0000 7f30d4726880 20 rados->read ofs=0 len=0 2023-10-05T11:39:54.482 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.478+0000 7f30d4726880 20 rados_obj.operate() r=0 bl.length=390 2023-10-05T11:39:54.482 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.478+0000 7f30d4726880 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.19 info.flags=0x17 2023-10-05T11:39:54.483 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.478+0000 7f30d4726880 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.19 to cache LRU end 2023-10-05T11:39:54.483 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.478+0000 7f30d4726880 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T11:39:54.483 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.478+0000 7f30d4726880 10 updating xattr: name=user.rgw.acl bl.length()=265 2023-10-05T11:39:54.483 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.478+0000 7f30d4726880 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.19 2023-10-05T11:39:54.485 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.482+0000 7f30d4726880 -1 Injecting error=-125 at location=set_target_layout 2023-10-05T11:39:54.486 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.483+0000 7f30d4726880 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.19 info.flags=0x17 2023-10-05T11:39:54.486 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.483+0000 7f30d4726880 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.19 to cache LRU end 2023-10-05T11:39:54.487 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.483+0000 7f30d4726880 10 updating xattr: name=user.rgw.acl bl.length()=265 2023-10-05T11:39:54.487 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.483+0000 7f30d4726880 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.19, ofs0, ns] 2023-10-05T11:39:54.487 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.483+0000 7f30cb7bd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1060856922163 cookie 94612909284352 notifier 6522 bl.length()=959 2023-10-05T11:39:54.487 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.483+0000 7f30cb7bd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.19 info.flags=0x17 2023-10-05T11:39:54.487 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.483+0000 7f30cb7bd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.19 to cache LRU end 2023-10-05T11:39:54.487 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.483+0000 7f30cb7bd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2023-10-05T11:39:54.488 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.485+0000 7f30d4726880 20 handle_bi_update(): bucket=:error-at-set-target-layout[dff27d1e-df33-400e-a68a-7ba586947c99.4604.19]): orig_sources= new_sources= 2023-10-05T11:39:54.489 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.485+0000 7f30d4726880 20 handle_bi_update(): bucket=:error-at-set-target-layout[dff27d1e-df33-400e-a68a-7ba586947c99.4604.19]): potential sources added=[] removed=[] 2023-10-05T11:39:54.489 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.485+0000 7f30d4726880 20 handle_bi_update(): bucket=:error-at-set-target-layout[dff27d1e-df33-400e-a68a-7ba586947c99.4604.19]): orig_dests= new_dests= 2023-10-05T11:39:54.489 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.485+0000 7f30d4726880 20 handle_bi_update(): bucket=:error-at-set-target-layout[dff27d1e-df33-400e-a68a-7ba586947c99.4604.19]): potential dests added=[] removed=[] 2023-10-05T11:39:54.491 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.487+0000 7f30d4726880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.19.1.0 2023-10-05T11:39:54.491 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.487+0000 7f30d4726880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.19.1.0 2023-10-05T11:39:54.491 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.487+0000 7f30d4726880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.19.1.1 2023-10-05T11:39:54.491 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.487+0000 7f30d4726880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.19.1.1 2023-10-05T11:39:54.491 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.487+0000 7f30d4726880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.19.1.2 2023-10-05T11:39:54.491 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.487+0000 7f30d4726880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.19.1.2 2023-10-05T11:39:54.491 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.487+0000 7f30d4726880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.19.1.3 2023-10-05T11:39:54.491 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.487+0000 7f30d4726880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.19.1.3 2023-10-05T11:39:54.491 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.487+0000 7f30d4726880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.19.1.4 2023-10-05T11:39:54.491 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.487+0000 7f30d4726880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.19.1.4 2023-10-05T11:39:54.492 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.487+0000 7f30d4726880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.19.1.5 2023-10-05T11:39:54.492 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.487+0000 7f30d4726880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.19.1.5 2023-10-05T11:39:54.492 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.487+0000 7f30d4726880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.19.1.6 2023-10-05T11:39:54.492 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.487+0000 7f30d4726880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.19.1.6 2023-10-05T11:39:54.492 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.487+0000 7f30d4726880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.19.1.7 2023-10-05T11:39:54.492 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.487+0000 7f30d4726880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.19.1.7 2023-10-05T11:39:54.492 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.487+0000 7f30d4726880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.19.1.8 2023-10-05T11:39:54.492 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.487+0000 7f30d4726880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.19.1.8 2023-10-05T11:39:54.492 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.487+0000 7f30d4726880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.19.1.9 2023-10-05T11:39:54.492 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.487+0000 7f30d4726880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.19.1.9 2023-10-05T11:39:54.492 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.487+0000 7f30d4726880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.19.1.10 2023-10-05T11:39:54.492 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.487+0000 7f30d4726880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.19.1.10 2023-10-05T11:39:54.493 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.487+0000 7f30d4726880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.19.1.11 2023-10-05T11:39:54.493 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.487+0000 7f30d4726880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.19.1.11 2023-10-05T11:39:54.493 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.487+0000 7f30d4726880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.19.0 2023-10-05T11:39:54.493 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.488+0000 7f30d4726880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.19.1 2023-10-05T11:39:54.494 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.488+0000 7f30d4726880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.19.2 2023-10-05T11:39:54.494 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.489+0000 7f30d4726880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.19.3 2023-10-05T11:39:54.494 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.489+0000 7f30d4726880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.19.4 2023-10-05T11:39:54.494 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.490+0000 7f30d4726880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.19.5 2023-10-05T11:39:54.494 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.490+0000 7f30d4726880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.19.6 2023-10-05T11:39:54.494 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.490+0000 7f30d4726880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.19.7 2023-10-05T11:39:54.495 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.491+0000 7f30d4726880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.19.8 2023-10-05T11:39:54.495 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.491+0000 7f30d4726880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.19.9 2023-10-05T11:39:54.495 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.492+0000 7f30d4726880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.19.10 2023-10-05T11:39:54.499 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.495+0000 7f30d4726880 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.19 : hit (requested=0x17, cached=0x17) 2023-10-05T11:39:54.499 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.495+0000 7f30d4726880 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.19 2023-10-05T11:39:54.500 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.496+0000 7f30d4726880 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.19 info.flags=0x17 2023-10-05T11:39:54.500 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.496+0000 7f30d4726880 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.19 to cache LRU end 2023-10-05T11:39:54.500 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.496+0000 7f30d4726880 10 updating xattr: name=user.rgw.acl bl.length()=265 2023-10-05T11:39:54.500 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.496+0000 7f30d4726880 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.19, ofs0, ns] 2023-10-05T11:39:54.500 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.497+0000 7f30cb7bd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1060856922164 cookie 94612909284352 notifier 6522 bl.length()=927 2023-10-05T11:39:54.500 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.497+0000 7f30cb7bd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.19 info.flags=0x17 2023-10-05T11:39:54.501 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.497+0000 7f30cb7bd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.19 to cache LRU end 2023-10-05T11:39:54.501 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.497+0000 7f30cb7bd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2023-10-05T11:39:54.502 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.498+0000 7f30d4726880 20 handle_bi_update(): bucket=:error-at-set-target-layout[dff27d1e-df33-400e-a68a-7ba586947c99.4604.19]): orig_sources= new_sources= 2023-10-05T11:39:54.502 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.498+0000 7f30d4726880 20 handle_bi_update(): bucket=:error-at-set-target-layout[dff27d1e-df33-400e-a68a-7ba586947c99.4604.19]): potential sources added=[] removed=[] 2023-10-05T11:39:54.502 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.498+0000 7f30d4726880 20 handle_bi_update(): bucket=:error-at-set-target-layout[dff27d1e-df33-400e-a68a-7ba586947c99.4604.19]): orig_dests= new_dests= 2023-10-05T11:39:54.502 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.498+0000 7f30d4726880 20 handle_bi_update(): bucket=:error-at-set-target-layout[dff27d1e-df33-400e-a68a-7ba586947c99.4604.19]): potential dests added=[] removed=[] 2023-10-05T11:39:54.504 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.501+0000 7f30d4726880 1 execute INFO: reshard of bucket "error-at-set-target-layout" completed successfully 2023-10-05T11:39:54.505 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.502+0000 7f30b7f96640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:39:54.508 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.504+0000 7f30d4726880 20 remove_watcher() i=0 2023-10-05T11:39:54.508 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.504+0000 7f30d4726880 2 removed watcher, disabling cache 2023-10-05T11:39:54.509 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.506+0000 7f30d4726880 20 remove_watcher() i=1 2023-10-05T11:39:54.510 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.507+0000 7f30d4726880 20 remove_watcher() i=2 2023-10-05T11:39:54.511 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.508+0000 7f30d4726880 20 remove_watcher() i=3 2023-10-05T11:39:54.512 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.509+0000 7f30d4726880 20 remove_watcher() i=4 2023-10-05T11:39:54.513 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.510+0000 7f30d4726880 20 remove_watcher() i=5 2023-10-05T11:39:54.514 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.511+0000 7f30d4726880 20 remove_watcher() i=6 2023-10-05T11:39:54.516 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.513+0000 7f30d4726880 20 remove_watcher() i=7 2023-10-05T11:39:54.522 INFO:tasks.workunit.client.0.smithi012.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2023-10-05T11:39:54.551 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setuser ceph since I am not root 2023-10-05T11:39:54.551 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T11:39:54.563 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.560+0000 7f3fbfb29880 20 rados->read ofs=0 len=0 2023-10-05T11:39:54.565 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.562+0000 7f3fbfb29880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:54.565 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.562+0000 7f3fbfb29880 20 realm 2023-10-05T11:39:54.566 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.562+0000 7f3fbfb29880 20 rados->read ofs=0 len=0 2023-10-05T11:39:54.566 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.562+0000 7f3fbfb29880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:54.566 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.562+0000 7f3fbfb29880 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T11:39:54.566 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.562+0000 7f3fbfb29880 20 rados->read ofs=0 len=0 2023-10-05T11:39:54.566 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.562+0000 7f3fbfb29880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:54.566 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.562+0000 7f3fbfb29880 20 rados->read ofs=0 len=0 2023-10-05T11:39:54.566 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.563+0000 7f3fbfb29880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:39:54.567 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.563+0000 7f3fbfb29880 20 rados->read ofs=0 len=0 2023-10-05T11:39:54.567 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.564+0000 7f3fbfb29880 20 rados_obj.operate() r=0 bl.length=1020 2023-10-05T11:39:54.567 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.564+0000 7f3fbfb29880 20 searching for the correct realm 2023-10-05T11:39:54.576 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.573+0000 7f3fbc400640 0 -- 172.21.15.12:0/708692584 >> [v2:172.21.15.170:6814/3150808418,v1:172.21.15.170:6816/3150808418] conn(0x55712d443c00 msgr2=0x55712c854c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:39:54.578 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.575+0000 7f3fbfb29880 20 RGWRados::pool_iterate: got zone_info.dff27d1e-df33-400e-a68a-7ba586947c99 2023-10-05T11:39:54.578 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.575+0000 7f3fbfb29880 20 RGWRados::pool_iterate: got zonegroup_info.c78aa576-9d15-4e9d-b3c0-4af23a22062c 2023-10-05T11:39:54.578 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.575+0000 7f3fbfb29880 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T11:39:54.578 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.575+0000 7f3fbfb29880 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T11:39:54.578 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.575+0000 7f3fbfb29880 20 rados->read ofs=0 len=0 2023-10-05T11:39:54.578 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.575+0000 7f3fbfb29880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:54.579 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.575+0000 7f3fbfb29880 20 rados->read ofs=0 len=0 2023-10-05T11:39:54.580 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.575+0000 7f3fbfb29880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:39:54.580 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.575+0000 7f3fbfb29880 20 rados->read ofs=0 len=0 2023-10-05T11:39:54.580 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.575+0000 7f3fbfb29880 20 rados_obj.operate() r=0 bl.length=454 2023-10-05T11:39:54.580 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.575+0000 7f3fbfb29880 20 zone default found 2023-10-05T11:39:54.580 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.575+0000 7f3fbfb29880 4 Realm: () 2023-10-05T11:39:54.580 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.575+0000 7f3fbfb29880 4 ZoneGroup: default (c78aa576-9d15-4e9d-b3c0-4af23a22062c) 2023-10-05T11:39:54.580 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.575+0000 7f3fbfb29880 4 Zone: default (dff27d1e-df33-400e-a68a-7ba586947c99) 2023-10-05T11:39:54.580 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.575+0000 7f3fbfb29880 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T11:39:54.581 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.575+0000 7f3fbfb29880 20 zonegroup default 2023-10-05T11:39:54.581 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.575+0000 7f3fbfb29880 20 rados->read ofs=0 len=0 2023-10-05T11:39:54.581 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.576+0000 7f3fbfb29880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:54.581 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.576+0000 7f3fbfb29880 20 rados->read ofs=0 len=0 2023-10-05T11:39:54.581 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.576+0000 7f3fbfb29880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:54.581 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.576+0000 7f3fbfb29880 20 rados->read ofs=0 len=0 2023-10-05T11:39:54.581 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.576+0000 7f3fbfb29880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:54.581 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.576+0000 7f3fbfb29880 20 started sync module instance, tier type = 2023-10-05T11:39:54.581 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.576+0000 7f3fbfb29880 20 started zone id=dff27d1e-df33-400e-a68a-7ba586947c99 (name=default) with tier type = 2023-10-05T11:39:54.586 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.583+0000 7f3fbcc01640 0 -- 172.21.15.12:0/708692584 >> [v2:172.21.15.170:6800/4137726411,v1:172.21.15.170:6801/4137726411] conn(0x55712d442800 msgr2=0x55712c917600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:39:54.589 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.585+0000 7f3fbfb29880 20 add_watcher() i=0 2023-10-05T11:39:54.589 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.585+0000 7f3fbfb29880 20 add_watcher() i=1 2023-10-05T11:39:54.589 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.585+0000 7f3fbfb29880 20 add_watcher() i=2 2023-10-05T11:39:54.589 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.585+0000 7f3fbfb29880 20 add_watcher() i=3 2023-10-05T11:39:54.589 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.585+0000 7f3fbfb29880 20 add_watcher() i=4 2023-10-05T11:39:54.589 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.585+0000 7f3fbfb29880 20 add_watcher() i=5 2023-10-05T11:39:54.589 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.585+0000 7f3fbfb29880 20 add_watcher() i=6 2023-10-05T11:39:54.590 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.586+0000 7f3fbfb29880 20 add_watcher() i=7 2023-10-05T11:39:54.590 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.586+0000 7f3fbfb29880 2 all 8 watchers are set, enabling cache 2023-10-05T11:39:54.591 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.588+0000 7f3fa33ce640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:39:54.591 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.588+0000 7f3fbfb29880 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T11:39:54.591 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.588+0000 7f3fbfb29880 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T11:39:54.597 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.593+0000 7f3fbfb29880 5 note: GC not initialized 2023-10-05T11:39:54.597 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.593+0000 7f3f9ebc5640 20 reqs_thread_entry: start 2023-10-05T11:39:54.597 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.594+0000 7f3fbfb29880 20 init_complete bucket index max shards: 11 2023-10-05T11:39:54.597 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.594+0000 7f3fbfb29880 20 Filter name: none 2023-10-05T11:39:54.597 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.594+0000 7f3f9cbc1640 20 reqs_thread_entry: start 2023-10-05T11:39:54.598 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.594+0000 7f3fbfb29880 20 rados->read ofs=0 len=0 2023-10-05T11:39:54.598 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.594+0000 7f3fbfb29880 20 rados_obj.operate() r=0 bl.length=218 2023-10-05T11:39:54.599 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.594+0000 7f3fbfb29880 20 rados->read ofs=0 len=0 2023-10-05T11:39:54.599 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.595+0000 7f3fbfb29880 20 rados_obj.operate() r=0 bl.length=390 2023-10-05T11:39:54.599 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.595+0000 7f3fbfb29880 20 couldn't put binfo cache entry, might have raced with data changes 2023-10-05T11:39:54.599 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.595+0000 7f3fbfb29880 20 rados->read ofs=0 len=0 2023-10-05T11:39:54.599 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.595+0000 7f3fbfb29880 20 rados_obj.operate() r=0 bl.length=218 2023-10-05T11:39:54.599 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.595+0000 7f3fbfb29880 20 rados->read ofs=0 len=0 2023-10-05T11:39:54.599 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.595+0000 7f3fbfb29880 20 rados_obj.operate() r=0 bl.length=390 2023-10-05T11:39:54.599 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.595+0000 7f3fbfb29880 20 couldn't put binfo cache entry, might have raced with data changes 2023-10-05T11:39:54.600 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.596+0000 7f3fbfb29880 20 rados->read ofs=0 len=0 2023-10-05T11:39:54.600 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.596+0000 7f3fbfb29880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:54.600 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.597+0000 7f3fa33ce640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:39:54.602 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.599+0000 7f3fbfb29880 20 remove_watcher() i=0 2023-10-05T11:39:54.603 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.599+0000 7f3fbfb29880 2 removed watcher, disabling cache 2023-10-05T11:39:54.603 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.600+0000 7f3fbfb29880 20 remove_watcher() i=1 2023-10-05T11:39:54.604 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.601+0000 7f3fbfb29880 20 remove_watcher() i=2 2023-10-05T11:39:54.605 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.602+0000 7f3fbfb29880 20 remove_watcher() i=3 2023-10-05T11:39:54.607 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.603+0000 7f3fbfb29880 20 remove_watcher() i=4 2023-10-05T11:39:54.608 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.604+0000 7f3fbfb29880 20 remove_watcher() i=5 2023-10-05T11:39:54.609 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.605+0000 7f3fbfb29880 20 remove_watcher() i=6 2023-10-05T11:39:54.609 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:54.606+0000 7f3fbfb29880 20 remove_watcher() i=7 2023-10-05T11:39:54.614 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:39:54.614 INFO:tasks.workunit.client.0.smithi012.stderr:BUCKET_STATS: 2023-10-05T11:39:54.614 INFO:tasks.workunit.client.0.smithi012.stderr:bucket: error-at-set-target-layout id: dff27d1e-df33-400e-a68a-7ba586947c99.4604.19 num_objects: 20 size_kb: 1 num_shards: 12 2023-10-05T11:39:54.614 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:39:54.960 INFO:tasks.workunit.client.0.smithi012.stderr:TEST: reshard bucket with abort at set_target_layout 2023-10-05T11:39:54.960 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:39:55.665 INFO:tasks.workunit.client.0.smithi012.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2023-10-05T11:39:55.693 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setuser ceph since I am not root 2023-10-05T11:39:55.693 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T11:39:55.706 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.703+0000 7f906e733880 20 rados->read ofs=0 len=0 2023-10-05T11:39:55.708 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.704+0000 7f906e733880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:55.708 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.704+0000 7f906e733880 20 realm 2023-10-05T11:39:55.708 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.704+0000 7f906e733880 20 rados->read ofs=0 len=0 2023-10-05T11:39:55.708 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.704+0000 7f906e733880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:55.708 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.704+0000 7f906e733880 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T11:39:55.708 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.704+0000 7f906e733880 20 rados->read ofs=0 len=0 2023-10-05T11:39:55.708 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.705+0000 7f906e733880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:55.708 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.705+0000 7f906e733880 20 rados->read ofs=0 len=0 2023-10-05T11:39:55.709 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.706+0000 7f906e733880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:39:55.709 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.706+0000 7f906e733880 20 rados->read ofs=0 len=0 2023-10-05T11:39:55.710 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.706+0000 7f906e733880 20 rados_obj.operate() r=0 bl.length=1020 2023-10-05T11:39:55.710 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.706+0000 7f906e733880 20 searching for the correct realm 2023-10-05T11:39:55.719 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.716+0000 7f906b027640 0 -- 172.21.15.12:0/2644514274 >> [v2:172.21.15.12:6800/732466381,v1:172.21.15.12:6801/732466381] conn(0x5559f72b1800 msgr2=0x5559f7386c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:39:55.721 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.717+0000 7f906e733880 20 RGWRados::pool_iterate: got zone_info.dff27d1e-df33-400e-a68a-7ba586947c99 2023-10-05T11:39:55.721 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.717+0000 7f906e733880 20 RGWRados::pool_iterate: got zonegroup_info.c78aa576-9d15-4e9d-b3c0-4af23a22062c 2023-10-05T11:39:55.721 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.717+0000 7f906e733880 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T11:39:55.721 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.717+0000 7f906e733880 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T11:39:55.721 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.717+0000 7f906e733880 20 rados->read ofs=0 len=0 2023-10-05T11:39:55.721 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.718+0000 7f906e733880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:55.721 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.718+0000 7f906e733880 20 rados->read ofs=0 len=0 2023-10-05T11:39:55.722 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.718+0000 7f906e733880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:39:55.722 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.718+0000 7f906e733880 20 rados->read ofs=0 len=0 2023-10-05T11:39:55.723 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.718+0000 7f906e733880 20 rados_obj.operate() r=0 bl.length=454 2023-10-05T11:39:55.723 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.718+0000 7f906e733880 20 zone default found 2023-10-05T11:39:55.723 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.718+0000 7f906e733880 4 Realm: () 2023-10-05T11:39:55.723 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.718+0000 7f906e733880 4 ZoneGroup: default (c78aa576-9d15-4e9d-b3c0-4af23a22062c) 2023-10-05T11:39:55.723 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.718+0000 7f906e733880 4 Zone: default (dff27d1e-df33-400e-a68a-7ba586947c99) 2023-10-05T11:39:55.723 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.718+0000 7f906e733880 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T11:39:55.723 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.718+0000 7f906e733880 20 zonegroup default 2023-10-05T11:39:55.723 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.718+0000 7f906e733880 20 rados->read ofs=0 len=0 2023-10-05T11:39:55.723 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.718+0000 7f906e733880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:55.723 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.718+0000 7f906e733880 20 rados->read ofs=0 len=0 2023-10-05T11:39:55.723 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.719+0000 7f906e733880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:55.724 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.719+0000 7f906e733880 20 rados->read ofs=0 len=0 2023-10-05T11:39:55.724 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.719+0000 7f906e733880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:55.724 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.719+0000 7f906e733880 20 started sync module instance, tier type = 2023-10-05T11:39:55.724 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.719+0000 7f906e733880 20 started zone id=dff27d1e-df33-400e-a68a-7ba586947c99 (name=default) with tier type = 2023-10-05T11:39:55.727 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.724+0000 7f906b027640 0 -- 172.21.15.12:0/2644514274 >> [v2:172.21.15.12:6800/732466381,v1:172.21.15.12:6801/732466381] conn(0x5559f73bb000 msgr2=0x5559f73bd080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:39:55.731 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.728+0000 7f906e733880 20 add_watcher() i=0 2023-10-05T11:39:55.731 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.728+0000 7f906e733880 20 add_watcher() i=1 2023-10-05T11:39:55.731 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.728+0000 7f906e733880 20 add_watcher() i=2 2023-10-05T11:39:55.732 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.728+0000 7f906e733880 20 add_watcher() i=3 2023-10-05T11:39:55.732 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.728+0000 7f906e733880 20 add_watcher() i=4 2023-10-05T11:39:55.732 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.728+0000 7f906e733880 20 add_watcher() i=5 2023-10-05T11:39:55.732 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.728+0000 7f906e733880 20 add_watcher() i=6 2023-10-05T11:39:55.732 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.729+0000 7f906e733880 20 add_watcher() i=7 2023-10-05T11:39:55.732 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.729+0000 7f906e733880 2 all 8 watchers are set, enabling cache 2023-10-05T11:39:55.734 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.730+0000 7f9051ff5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:39:55.734 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.731+0000 7f906e733880 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T11:39:55.734 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.731+0000 7f906e733880 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T11:39:55.740 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.736+0000 7f906e733880 5 note: GC not initialized 2023-10-05T11:39:55.740 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.736+0000 7f904d7ec640 20 reqs_thread_entry: start 2023-10-05T11:39:55.740 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.736+0000 7f906e733880 20 init_complete bucket index max shards: 11 2023-10-05T11:39:55.740 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.737+0000 7f906e733880 20 Filter name: none 2023-10-05T11:39:55.740 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.737+0000 7f904b7e8640 20 reqs_thread_entry: start 2023-10-05T11:39:55.740 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.737+0000 7f906e733880 20 rados->read ofs=0 len=0 2023-10-05T11:39:55.741 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.737+0000 7f906e733880 20 rados_obj.operate() r=0 bl.length=218 2023-10-05T11:39:55.741 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.737+0000 7f906e733880 20 rados->read ofs=0 len=0 2023-10-05T11:39:55.741 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.738+0000 7f906e733880 20 rados_obj.operate() r=0 bl.length=390 2023-10-05T11:39:55.741 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.738+0000 7f906e733880 20 couldn't put binfo cache entry, might have raced with data changes 2023-10-05T11:39:55.741 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.738+0000 7f906e733880 20 rados->read ofs=0 len=0 2023-10-05T11:39:55.742 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.738+0000 7f906e733880 20 rados_obj.operate() r=0 bl.length=218 2023-10-05T11:39:55.742 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.738+0000 7f906e733880 20 rados->read ofs=0 len=0 2023-10-05T11:39:55.742 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.738+0000 7f906e733880 20 rados_obj.operate() r=0 bl.length=390 2023-10-05T11:39:55.742 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.738+0000 7f906e733880 20 couldn't put binfo cache entry, might have raced with data changes 2023-10-05T11:39:55.743 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.739+0000 7f906e733880 20 rados->read ofs=0 len=0 2023-10-05T11:39:55.743 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.740+0000 7f906e733880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:55.743 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.740+0000 7f9051ff5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:39:55.745 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.742+0000 7f906e733880 20 remove_watcher() i=0 2023-10-05T11:39:55.745 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.742+0000 7f906e733880 2 removed watcher, disabling cache 2023-10-05T11:39:55.746 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.743+0000 7f906e733880 20 remove_watcher() i=1 2023-10-05T11:39:55.747 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.744+0000 7f906e733880 20 remove_watcher() i=2 2023-10-05T11:39:55.748 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.745+0000 7f906e733880 20 remove_watcher() i=3 2023-10-05T11:39:55.749 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.746+0000 7f906e733880 20 remove_watcher() i=4 2023-10-05T11:39:55.750 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.747+0000 7f906e733880 20 remove_watcher() i=5 2023-10-05T11:39:55.751 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.748+0000 7f906e733880 20 remove_watcher() i=6 2023-10-05T11:39:55.752 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.749+0000 7f906e733880 20 remove_watcher() i=7 2023-10-05T11:39:55.757 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:39:55.757 INFO:tasks.workunit.client.0.smithi012.stderr:BUCKET_STATS: 2023-10-05T11:39:55.757 INFO:tasks.workunit.client.0.smithi012.stderr:bucket: abort-at-set-target-layout id: dff27d1e-df33-400e-a68a-7ba586947c99.4604.20 num_objects: 20 size_kb: 1 num_shards: 11 2023-10-05T11:39:55.757 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:39:55.758 INFO:tasks.workunit.client.0.smithi012.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at set_target_layout 2023-10-05T11:39:55.791 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setuser ceph since I am not root 2023-10-05T11:39:55.791 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T11:39:55.804 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.801+0000 7fe62028b880 20 rados->read ofs=0 len=0 2023-10-05T11:39:55.806 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.802+0000 7fe62028b880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:55.806 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.802+0000 7fe62028b880 20 realm 2023-10-05T11:39:55.806 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.802+0000 7fe62028b880 20 rados->read ofs=0 len=0 2023-10-05T11:39:55.806 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.803+0000 7fe62028b880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:55.806 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.803+0000 7fe62028b880 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T11:39:55.807 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.803+0000 7fe62028b880 20 rados->read ofs=0 len=0 2023-10-05T11:39:55.807 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.803+0000 7fe62028b880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:55.807 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.803+0000 7fe62028b880 20 rados->read ofs=0 len=0 2023-10-05T11:39:55.807 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.804+0000 7fe62028b880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:39:55.807 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.804+0000 7fe62028b880 20 rados->read ofs=0 len=0 2023-10-05T11:39:55.808 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.805+0000 7fe62028b880 20 rados_obj.operate() r=0 bl.length=1020 2023-10-05T11:39:55.808 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.805+0000 7fe62028b880 20 searching for the correct realm 2023-10-05T11:39:55.817 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.814+0000 7fe61ea30640 0 -- 172.21.15.12:0/3931236051 >> [v2:172.21.15.170:6814/3150808418,v1:172.21.15.170:6816/3150808418] conn(0x55dfb76fd400 msgr2=0x55dfb6b06c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:39:55.819 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.815+0000 7fe62028b880 20 RGWRados::pool_iterate: got zone_info.dff27d1e-df33-400e-a68a-7ba586947c99 2023-10-05T11:39:55.819 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.815+0000 7fe62028b880 20 RGWRados::pool_iterate: got zonegroup_info.c78aa576-9d15-4e9d-b3c0-4af23a22062c 2023-10-05T11:39:55.819 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.815+0000 7fe62028b880 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T11:39:55.819 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.815+0000 7fe62028b880 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T11:39:55.819 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.815+0000 7fe62028b880 20 rados->read ofs=0 len=0 2023-10-05T11:39:55.819 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.816+0000 7fe62028b880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:55.819 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.816+0000 7fe62028b880 20 rados->read ofs=0 len=0 2023-10-05T11:39:55.820 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.816+0000 7fe62028b880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:39:55.820 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.816+0000 7fe62028b880 20 rados->read ofs=0 len=0 2023-10-05T11:39:55.820 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.816+0000 7fe62028b880 20 rados_obj.operate() r=0 bl.length=454 2023-10-05T11:39:55.821 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.816+0000 7fe62028b880 20 zone default found 2023-10-05T11:39:55.821 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.816+0000 7fe62028b880 4 Realm: () 2023-10-05T11:39:55.821 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.816+0000 7fe62028b880 4 ZoneGroup: default (c78aa576-9d15-4e9d-b3c0-4af23a22062c) 2023-10-05T11:39:55.821 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.816+0000 7fe62028b880 4 Zone: default (dff27d1e-df33-400e-a68a-7ba586947c99) 2023-10-05T11:39:55.821 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.816+0000 7fe62028b880 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T11:39:55.821 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.816+0000 7fe62028b880 20 zonegroup default 2023-10-05T11:39:55.821 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.816+0000 7fe62028b880 20 rados->read ofs=0 len=0 2023-10-05T11:39:55.821 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.816+0000 7fe62028b880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:55.821 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.816+0000 7fe62028b880 20 rados->read ofs=0 len=0 2023-10-05T11:39:55.821 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.817+0000 7fe62028b880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:55.821 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.817+0000 7fe62028b880 20 rados->read ofs=0 len=0 2023-10-05T11:39:55.822 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.817+0000 7fe62028b880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:55.822 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.817+0000 7fe62028b880 20 started sync module instance, tier type = 2023-10-05T11:39:55.822 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.817+0000 7fe62028b880 20 started zone id=dff27d1e-df33-400e-a68a-7ba586947c99 (name=default) with tier type = 2023-10-05T11:39:55.826 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.822+0000 7fe61f231640 0 -- 172.21.15.12:0/3931236051 >> [v2:172.21.15.12:6824/2171933159,v1:172.21.15.12:6825/2171933159] conn(0x55dfb6cb5400 msgr2=0x55dfb6b07700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-10-05T11:39:55.829 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.826+0000 7fe62028b880 20 add_watcher() i=0 2023-10-05T11:39:55.830 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.826+0000 7fe62028b880 20 add_watcher() i=1 2023-10-05T11:39:55.830 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.826+0000 7fe62028b880 20 add_watcher() i=2 2023-10-05T11:39:55.830 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.826+0000 7fe62028b880 20 add_watcher() i=3 2023-10-05T11:39:55.830 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.826+0000 7fe62028b880 20 add_watcher() i=4 2023-10-05T11:39:55.830 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.826+0000 7fe62028b880 20 add_watcher() i=5 2023-10-05T11:39:55.830 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.826+0000 7fe62028b880 20 add_watcher() i=6 2023-10-05T11:39:55.830 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.827+0000 7fe62028b880 20 add_watcher() i=7 2023-10-05T11:39:55.831 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.827+0000 7fe62028b880 2 all 8 watchers are set, enabling cache 2023-10-05T11:39:55.832 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.829+0000 7fe6059fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:39:55.833 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.829+0000 7fe62028b880 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T11:39:55.833 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.829+0000 7fe62028b880 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T11:39:55.839 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.835+0000 7fe62028b880 5 note: GC not initialized 2023-10-05T11:39:55.839 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.835+0000 7fe6011f5640 20 reqs_thread_entry: start 2023-10-05T11:39:55.839 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.835+0000 7fe62028b880 20 init_complete bucket index max shards: 11 2023-10-05T11:39:55.839 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.835+0000 7fe62028b880 20 Filter name: none 2023-10-05T11:39:55.839 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.835+0000 7fe5ff1f1640 20 reqs_thread_entry: start 2023-10-05T11:39:55.839 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.835+0000 7fe62028b880 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2023-10-05T11:39:55.839 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.835+0000 7fe62028b880 20 rados->read ofs=0 len=0 2023-10-05T11:39:55.840 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.836+0000 7fe62028b880 20 rados_obj.operate() r=0 bl.length=218 2023-10-05T11:39:55.840 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.836+0000 7fe62028b880 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2023-10-05T11:39:55.840 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.836+0000 7fe62028b880 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2023-10-05T11:39:55.840 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.836+0000 7fe62028b880 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.20 : miss 2023-10-05T11:39:55.840 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.836+0000 7fe62028b880 20 rados->read ofs=0 len=0 2023-10-05T11:39:55.841 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.836+0000 7fe62028b880 20 rados_obj.operate() r=0 bl.length=390 2023-10-05T11:39:55.841 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.836+0000 7fe62028b880 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.20 info.flags=0x17 2023-10-05T11:39:55.841 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.836+0000 7fe62028b880 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.20 to cache LRU end 2023-10-05T11:39:55.841 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.836+0000 7fe62028b880 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T11:39:55.841 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.836+0000 7fe62028b880 10 updating xattr: name=user.rgw.acl bl.length()=265 2023-10-05T11:39:55.841 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.836+0000 7fe62028b880 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.20 2023-10-05T11:39:55.844 INFO:tasks.workunit.client.0.smithi012.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6543-g38321be8/rpm/el9/BUILD/ceph-18.0.0-6543-g38321be8/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fe62028b880 time 2023-10-05T11:39:55.842864+0000 2023-10-05T11:39:55.844 INFO:tasks.workunit.client.0.smithi012.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6543-g38321be8/rpm/el9/BUILD/ceph-18.0.0-6543-g38321be8/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2023-10-05T11:39:55.845 INFO:tasks.workunit.client.0.smithi012.stderr: ceph version 18.0.0-6543-g38321be8 (38321be854743c0d616618a9ea8aa0b1d4dbc0bf) reef (dev) 2023-10-05T11:39:55.845 INFO:tasks.workunit.client.0.smithi012.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fe624f6d15f] 2023-10-05T11:39:55.845 INFO:tasks.workunit.client.0.smithi012.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16d31d) [0x7fe624f6d31d] 2023-10-05T11:39:55.845 INFO:tasks.workunit.client.0.smithi012.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55dfb540dc31] 2023-10-05T11:39:55.845 INFO:tasks.workunit.client.0.smithi012.stderr: 4: radosgw-admin(+0x79c6d2) [0x55dfb541b6d2] 2023-10-05T11:39:55.846 INFO:tasks.workunit.client.0.smithi012.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x24b) [0x55dfb54246db] 2023-10-05T11:39:55.846 INFO:tasks.workunit.client.0.smithi012.stderr: 6: main() 2023-10-05T11:39:55.846 INFO:tasks.workunit.client.0.smithi012.stderr: 7: /lib64/libc.so.6(+0x3feb0) [0x7fe62243feb0] 2023-10-05T11:39:55.846 INFO:tasks.workunit.client.0.smithi012.stderr: 8: __libc_start_main() 2023-10-05T11:39:55.846 INFO:tasks.workunit.client.0.smithi012.stderr: 9: _start() 2023-10-05T11:39:55.846 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.842+0000 7fe62028b880 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6543-g38321be8/rpm/el9/BUILD/ceph-18.0.0-6543-g38321be8/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fe62028b880 time 2023-10-05T11:39:55.842864+0000 2023-10-05T11:39:55.846 INFO:tasks.workunit.client.0.smithi012.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6543-g38321be8/rpm/el9/BUILD/ceph-18.0.0-6543-g38321be8/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2023-10-05T11:39:55.846 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:39:55.846 INFO:tasks.workunit.client.0.smithi012.stderr: ceph version 18.0.0-6543-g38321be8 (38321be854743c0d616618a9ea8aa0b1d4dbc0bf) reef (dev) 2023-10-05T11:39:55.846 INFO:tasks.workunit.client.0.smithi012.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fe624f6d15f] 2023-10-05T11:39:55.846 INFO:tasks.workunit.client.0.smithi012.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16d31d) [0x7fe624f6d31d] 2023-10-05T11:39:55.847 INFO:tasks.workunit.client.0.smithi012.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55dfb540dc31] 2023-10-05T11:39:55.847 INFO:tasks.workunit.client.0.smithi012.stderr: 4: radosgw-admin(+0x79c6d2) [0x55dfb541b6d2] 2023-10-05T11:39:55.847 INFO:tasks.workunit.client.0.smithi012.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x24b) [0x55dfb54246db] 2023-10-05T11:39:55.847 INFO:tasks.workunit.client.0.smithi012.stderr: 6: main() 2023-10-05T11:39:55.847 INFO:tasks.workunit.client.0.smithi012.stderr: 7: /lib64/libc.so.6(+0x3feb0) [0x7fe62243feb0] 2023-10-05T11:39:55.847 INFO:tasks.workunit.client.0.smithi012.stderr: 8: __libc_start_main() 2023-10-05T11:39:55.847 INFO:tasks.workunit.client.0.smithi012.stderr: 9: _start() 2023-10-05T11:39:55.847 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:39:55.847 INFO:tasks.workunit.client.0.smithi012.stderr:*** Caught signal (Aborted) ** 2023-10-05T11:39:55.847 INFO:tasks.workunit.client.0.smithi012.stderr: in thread 7fe62028b880 thread_name:radosgw-admin 2023-10-05T11:39:55.865 INFO:tasks.workunit.client.0.smithi012.stderr: ceph version 18.0.0-6543-g38321be8 (38321be854743c0d616618a9ea8aa0b1d4dbc0bf) reef (dev) 2023-10-05T11:39:55.866 INFO:tasks.workunit.client.0.smithi012.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7fe622454db0] 2023-10-05T11:39:55.866 INFO:tasks.workunit.client.0.smithi012.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7fe6224a154c] 2023-10-05T11:39:55.866 INFO:tasks.workunit.client.0.smithi012.stderr: 3: raise() 2023-10-05T11:39:55.866 INFO:tasks.workunit.client.0.smithi012.stderr: 4: abort() 2023-10-05T11:39:55.866 INFO:tasks.workunit.client.0.smithi012.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fe624f6d1b9] 2023-10-05T11:39:55.866 INFO:tasks.workunit.client.0.smithi012.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16d31d) [0x7fe624f6d31d] 2023-10-05T11:39:55.866 INFO:tasks.workunit.client.0.smithi012.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55dfb540dc31] 2023-10-05T11:39:55.866 INFO:tasks.workunit.client.0.smithi012.stderr: 8: radosgw-admin(+0x79c6d2) [0x55dfb541b6d2] 2023-10-05T11:39:55.866 INFO:tasks.workunit.client.0.smithi012.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x24b) [0x55dfb54246db] 2023-10-05T11:39:55.866 INFO:tasks.workunit.client.0.smithi012.stderr: 10: main() 2023-10-05T11:39:55.866 INFO:tasks.workunit.client.0.smithi012.stderr: 11: /lib64/libc.so.6(+0x3feb0) [0x7fe62243feb0] 2023-10-05T11:39:55.867 INFO:tasks.workunit.client.0.smithi012.stderr: 12: __libc_start_main() 2023-10-05T11:39:55.867 INFO:tasks.workunit.client.0.smithi012.stderr: 13: _start() 2023-10-05T11:39:55.867 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.843+0000 7fe62028b880 -1 *** Caught signal (Aborted) ** 2023-10-05T11:39:55.867 INFO:tasks.workunit.client.0.smithi012.stderr: in thread 7fe62028b880 thread_name:radosgw-admin 2023-10-05T11:39:55.867 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:39:55.867 INFO:tasks.workunit.client.0.smithi012.stderr: ceph version 18.0.0-6543-g38321be8 (38321be854743c0d616618a9ea8aa0b1d4dbc0bf) reef (dev) 2023-10-05T11:39:55.867 INFO:tasks.workunit.client.0.smithi012.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7fe622454db0] 2023-10-05T11:39:55.867 INFO:tasks.workunit.client.0.smithi012.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7fe6224a154c] 2023-10-05T11:39:55.867 INFO:tasks.workunit.client.0.smithi012.stderr: 3: raise() 2023-10-05T11:39:55.867 INFO:tasks.workunit.client.0.smithi012.stderr: 4: abort() 2023-10-05T11:39:55.867 INFO:tasks.workunit.client.0.smithi012.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fe624f6d1b9] 2023-10-05T11:39:55.867 INFO:tasks.workunit.client.0.smithi012.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16d31d) [0x7fe624f6d31d] 2023-10-05T11:39:55.868 INFO:tasks.workunit.client.0.smithi012.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55dfb540dc31] 2023-10-05T11:39:55.868 INFO:tasks.workunit.client.0.smithi012.stderr: 8: radosgw-admin(+0x79c6d2) [0x55dfb541b6d2] 2023-10-05T11:39:55.868 INFO:tasks.workunit.client.0.smithi012.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x24b) [0x55dfb54246db] 2023-10-05T11:39:55.868 INFO:tasks.workunit.client.0.smithi012.stderr: 10: main() 2023-10-05T11:39:55.868 INFO:tasks.workunit.client.0.smithi012.stderr: 11: /lib64/libc.so.6(+0x3feb0) [0x7fe62243feb0] 2023-10-05T11:39:55.868 INFO:tasks.workunit.client.0.smithi012.stderr: 12: __libc_start_main() 2023-10-05T11:39:55.868 INFO:tasks.workunit.client.0.smithi012.stderr: 13: _start() 2023-10-05T11:39:55.868 INFO:tasks.workunit.client.0.smithi012.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-10-05T11:39:55.868 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:39:55.868 INFO:tasks.workunit.client.0.smithi012.stderr:--- begin dump of recent events --- 2023-10-05T11:39:55.868 INFO:tasks.workunit.client.0.smithi012.stderr: -499> 2023-10-05T11:39:55.795+0000 7fe61f231640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-10-05T11:39:55.868 INFO:tasks.workunit.client.0.smithi012.stderr: -498> 2023-10-05T11:39:55.796+0000 7fe61e22f640 10 monclient(hunting): get_auth_request con 0x55dfb6827400 auth_method 0 2023-10-05T11:39:55.869 INFO:tasks.workunit.client.0.smithi012.stderr: -497> 2023-10-05T11:39:55.796+0000 7fe61e22f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-10-05T11:39:55.869 INFO:tasks.workunit.client.0.smithi012.stderr: -496> 2023-10-05T11:39:55.796+0000 7fe61e22f640 10 monclient(hunting): _init_auth method 2 2023-10-05T11:39:55.869 INFO:tasks.workunit.client.0.smithi012.stderr: -495> 2023-10-05T11:39:55.796+0000 7fe61e22f640 10 monclient(hunting): _init_auth creating new auth 2023-10-05T11:39:55.869 INFO:tasks.workunit.client.0.smithi012.stderr: -494> 2023-10-05T11:39:55.796+0000 7fe61ea30640 10 monclient(hunting): handle_auth_done global_id 6582 payload 824 2023-10-05T11:39:55.869 INFO:tasks.workunit.client.0.smithi012.stderr: -493> 2023-10-05T11:39:55.796+0000 7fe61ea30640 10 monclient: _finish_hunting 0 2023-10-05T11:39:55.869 INFO:tasks.workunit.client.0.smithi012.stderr: -492> 2023-10-05T11:39:55.796+0000 7fe61ea30640 1 monclient: found mon.noname-a 2023-10-05T11:39:55.869 INFO:tasks.workunit.client.0.smithi012.stderr: -491> 2023-10-05T11:39:55.796+0000 7fe61ea30640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.12:3300/0 2023-10-05T11:39:55.869 INFO:tasks.workunit.client.0.smithi012.stderr: -490> 2023-10-05T11:39:55.796+0000 7fe61ba2a640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-10-05T11:39:55.869 INFO:tasks.workunit.client.0.smithi012.stderr: -489> 2023-10-05T11:39:55.796+0000 7fe61ba2a640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2023-10-05T11:39:55.869 INFO:tasks.workunit.client.0.smithi012.stderr: -488> 2023-10-05T11:39:55.796+0000 7fe61ba2a640 10 monclient: dump: 2023-10-05T11:39:55.869 INFO:tasks.workunit.client.0.smithi012.stderr:epoch 1 2023-10-05T11:39:55.869 INFO:tasks.workunit.client.0.smithi012.stderr:fsid 7e015f46-293b-4b09-bd32-7d32b52f6e2f 2023-10-05T11:39:55.869 INFO:tasks.workunit.client.0.smithi012.stderr:last_changed 2023-10-05T11:27:38.366888+0000 2023-10-05T11:39:55.870 INFO:tasks.workunit.client.0.smithi012.stderr:created 2023-10-05T11:27:38.366888+0000 2023-10-05T11:39:55.870 INFO:tasks.workunit.client.0.smithi012.stderr:min_mon_release 18 (reef) 2023-10-05T11:39:55.870 INFO:tasks.workunit.client.0.smithi012.stderr:election_strategy: 1 2023-10-05T11:39:55.870 INFO:tasks.workunit.client.0.smithi012.stderr:0: [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon.a 2023-10-05T11:39:55.870 INFO:tasks.workunit.client.0.smithi012.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2023-10-05T11:39:55.870 INFO:tasks.workunit.client.0.smithi012.stderr:2: [v2:172.21.15.12:3301/0,v1:172.21.15.12:6790/0] mon.c 2023-10-05T11:39:55.870 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:39:55.870 INFO:tasks.workunit.client.0.smithi012.stderr: -487> 2023-10-05T11:39:55.796+0000 7fe61ba2a640 10 monclient: _finish_auth 0 2023-10-05T11:39:55.870 INFO:tasks.workunit.client.0.smithi012.stderr: -486> 2023-10-05T11:39:55.796+0000 7fe61ba2a640 10 monclient: _check_auth_tickets 2023-10-05T11:39:55.870 INFO:tasks.workunit.client.0.smithi012.stderr: -485> 2023-10-05T11:39:55.796+0000 7fe61ba2a640 10 monclient: handle_config config(0 keys) v1 2023-10-05T11:39:55.870 INFO:tasks.workunit.client.0.smithi012.stderr: -484> 2023-10-05T11:39:55.796+0000 7fe61ba2a640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-10-05T11:39:55.870 INFO:tasks.workunit.client.0.smithi012.stderr: -483> 2023-10-05T11:39:55.796+0000 7fe61ba2a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2023-10-05T11:39:55.871 INFO:tasks.workunit.client.0.smithi012.stderr: -482> 2023-10-05T11:39:55.796+0000 7fe61ba2a640 10 monclient: dump: 2023-10-05T11:39:55.871 INFO:tasks.workunit.client.0.smithi012.stderr:epoch 1 2023-10-05T11:39:55.871 INFO:tasks.workunit.client.0.smithi012.stderr:fsid 7e015f46-293b-4b09-bd32-7d32b52f6e2f 2023-10-05T11:39:55.871 INFO:tasks.workunit.client.0.smithi012.stderr:last_changed 2023-10-05T11:27:38.366888+0000 2023-10-05T11:39:55.871 INFO:tasks.workunit.client.0.smithi012.stderr:created 2023-10-05T11:27:38.366888+0000 2023-10-05T11:39:55.871 INFO:tasks.workunit.client.0.smithi012.stderr:min_mon_release 18 (reef) 2023-10-05T11:39:55.871 INFO:tasks.workunit.client.0.smithi012.stderr:election_strategy: 1 2023-10-05T11:39:55.871 INFO:tasks.workunit.client.0.smithi012.stderr:0: [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon.a 2023-10-05T11:39:55.871 INFO:tasks.workunit.client.0.smithi012.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2023-10-05T11:39:55.871 INFO:tasks.workunit.client.0.smithi012.stderr:2: [v2:172.21.15.12:3301/0,v1:172.21.15.12:6790/0] mon.c 2023-10-05T11:39:55.871 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:39:55.871 INFO:tasks.workunit.client.0.smithi012.stderr: -481> 2023-10-05T11:39:55.796+0000 7fe61d22d640 4 set_mon_vals no callback set 2023-10-05T11:39:55.872 INFO:tasks.workunit.client.0.smithi012.stderr: -480> 2023-10-05T11:39:55.796+0000 7fe62028b880 5 monclient: authenticate success, global_id 6582 2023-10-05T11:39:55.872 INFO:tasks.workunit.client.0.smithi012.stderr: -479> 2023-10-05T11:39:55.796+0000 7fe62028b880 10 monclient: _renew_subs 2023-10-05T11:39:55.872 INFO:tasks.workunit.client.0.smithi012.stderr: -478> 2023-10-05T11:39:55.796+0000 7fe62028b880 10 monclient: _send_mon_message to mon.a at v2:172.21.15.12:3300/0 2023-10-05T11:39:55.872 INFO:tasks.workunit.client.0.smithi012.stderr: -477> 2023-10-05T11:39:55.796+0000 7fe62028b880 10 monclient: _renew_subs 2023-10-05T11:39:55.872 INFO:tasks.workunit.client.0.smithi012.stderr: -476> 2023-10-05T11:39:55.796+0000 7fe62028b880 10 monclient: _send_mon_message to mon.a at v2:172.21.15.12:3300/0 2023-10-05T11:39:55.872 INFO:tasks.workunit.client.0.smithi012.stderr: -475> 2023-10-05T11:39:55.796+0000 7fe62028b880 1 librados: init done 2023-10-05T11:39:55.872 INFO:tasks.workunit.client.0.smithi012.stderr: -474> 2023-10-05T11:39:55.796+0000 7fe62028b880 10 monclient: get_monmap_and_config 2023-10-05T11:39:55.872 INFO:tasks.workunit.client.0.smithi012.stderr: -473> 2023-10-05T11:39:55.796+0000 7fe62028b880 10 monclient: build_initial_monmap 2023-10-05T11:39:55.872 INFO:tasks.workunit.client.0.smithi012.stderr: -472> 2023-10-05T11:39:55.796+0000 7fe62028b880 1 build_initial for_mkfs: 0 2023-10-05T11:39:55.872 INFO:tasks.workunit.client.0.smithi012.stderr: -471> 2023-10-05T11:39:55.796+0000 7fe62028b880 10 monclient: monmap: 2023-10-05T11:39:55.872 INFO:tasks.workunit.client.0.smithi012.stderr:epoch 0 2023-10-05T11:39:55.872 INFO:tasks.workunit.client.0.smithi012.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-10-05T11:39:55.872 INFO:tasks.workunit.client.0.smithi012.stderr:last_changed 0.000000 2023-10-05T11:39:55.873 INFO:tasks.workunit.client.0.smithi012.stderr:created 0.000000 2023-10-05T11:39:55.873 INFO:tasks.workunit.client.0.smithi012.stderr:min_mon_release 0 (unknown) 2023-10-05T11:39:55.873 INFO:tasks.workunit.client.0.smithi012.stderr:election_strategy: 1 2023-10-05T11:39:55.873 INFO:tasks.workunit.client.0.smithi012.stderr:0: [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon.noname-a 2023-10-05T11:39:55.873 INFO:tasks.workunit.client.0.smithi012.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.noname-b 2023-10-05T11:39:55.873 INFO:tasks.workunit.client.0.smithi012.stderr:2: [v2:172.21.15.12:3301/0,v1:172.21.15.12:6790/0] mon.noname-c 2023-10-05T11:39:55.873 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:39:55.873 INFO:tasks.workunit.client.0.smithi012.stderr: -470> 2023-10-05T11:39:55.796+0000 7fe62028b880 5 AuthRegistry(0x55dfb75b1340) adding auth protocol: cephx 2023-10-05T11:39:55.873 INFO:tasks.workunit.client.0.smithi012.stderr: -469> 2023-10-05T11:39:55.796+0000 7fe62028b880 5 AuthRegistry(0x55dfb75b1340) adding auth protocol: cephx 2023-10-05T11:39:55.873 INFO:tasks.workunit.client.0.smithi012.stderr: -468> 2023-10-05T11:39:55.796+0000 7fe62028b880 5 AuthRegistry(0x55dfb75b1340) adding auth protocol: cephx 2023-10-05T11:39:55.873 INFO:tasks.workunit.client.0.smithi012.stderr: -467> 2023-10-05T11:39:55.796+0000 7fe62028b880 5 AuthRegistry(0x55dfb75b1340) adding con mode: secure 2023-10-05T11:39:55.873 INFO:tasks.workunit.client.0.smithi012.stderr: -466> 2023-10-05T11:39:55.796+0000 7fe62028b880 5 AuthRegistry(0x55dfb75b1340) adding con mode: crc 2023-10-05T11:39:55.874 INFO:tasks.workunit.client.0.smithi012.stderr: -465> 2023-10-05T11:39:55.796+0000 7fe62028b880 5 AuthRegistry(0x55dfb75b1340) adding con mode: secure 2023-10-05T11:39:55.874 INFO:tasks.workunit.client.0.smithi012.stderr: -464> 2023-10-05T11:39:55.796+0000 7fe62028b880 5 AuthRegistry(0x55dfb75b1340) adding con mode: crc 2023-10-05T11:39:55.874 INFO:tasks.workunit.client.0.smithi012.stderr: -463> 2023-10-05T11:39:55.796+0000 7fe62028b880 5 AuthRegistry(0x55dfb75b1340) adding con mode: secure 2023-10-05T11:39:55.874 INFO:tasks.workunit.client.0.smithi012.stderr: -462> 2023-10-05T11:39:55.796+0000 7fe62028b880 5 AuthRegistry(0x55dfb75b1340) adding con mode: crc 2023-10-05T11:39:55.874 INFO:tasks.workunit.client.0.smithi012.stderr: -461> 2023-10-05T11:39:55.796+0000 7fe62028b880 5 AuthRegistry(0x55dfb75b1340) adding con mode: crc 2023-10-05T11:39:55.874 INFO:tasks.workunit.client.0.smithi012.stderr: -460> 2023-10-05T11:39:55.796+0000 7fe62028b880 5 AuthRegistry(0x55dfb75b1340) adding con mode: secure 2023-10-05T11:39:55.874 INFO:tasks.workunit.client.0.smithi012.stderr: -459> 2023-10-05T11:39:55.796+0000 7fe62028b880 5 AuthRegistry(0x55dfb75b1340) adding con mode: crc 2023-10-05T11:39:55.874 INFO:tasks.workunit.client.0.smithi012.stderr: -458> 2023-10-05T11:39:55.796+0000 7fe62028b880 5 AuthRegistry(0x55dfb75b1340) adding con mode: secure 2023-10-05T11:39:55.874 INFO:tasks.workunit.client.0.smithi012.stderr: -457> 2023-10-05T11:39:55.796+0000 7fe62028b880 5 AuthRegistry(0x55dfb75b1340) adding con mode: crc 2023-10-05T11:39:55.874 INFO:tasks.workunit.client.0.smithi012.stderr: -456> 2023-10-05T11:39:55.796+0000 7fe62028b880 5 AuthRegistry(0x55dfb75b1340) adding con mode: secure 2023-10-05T11:39:55.875 INFO:tasks.workunit.client.0.smithi012.stderr: -455> 2023-10-05T11:39:55.797+0000 7fe62028b880 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-10-05T11:39:55.875 INFO:tasks.workunit.client.0.smithi012.stderr: -454> 2023-10-05T11:39:55.797+0000 7fe62028b880 10 monclient: init 2023-10-05T11:39:55.875 INFO:tasks.workunit.client.0.smithi012.stderr: -453> 2023-10-05T11:39:55.797+0000 7fe62028b880 5 AuthRegistry(0x7fffd737f870) adding auth protocol: cephx 2023-10-05T11:39:55.875 INFO:tasks.workunit.client.0.smithi012.stderr: -452> 2023-10-05T11:39:55.797+0000 7fe62028b880 5 AuthRegistry(0x7fffd737f870) adding auth protocol: cephx 2023-10-05T11:39:55.875 INFO:tasks.workunit.client.0.smithi012.stderr: -451> 2023-10-05T11:39:55.797+0000 7fe62028b880 5 AuthRegistry(0x7fffd737f870) adding auth protocol: cephx 2023-10-05T11:39:55.875 INFO:tasks.workunit.client.0.smithi012.stderr: -450> 2023-10-05T11:39:55.797+0000 7fe62028b880 5 AuthRegistry(0x7fffd737f870) adding con mode: secure 2023-10-05T11:39:55.875 INFO:tasks.workunit.client.0.smithi012.stderr: -449> 2023-10-05T11:39:55.797+0000 7fe62028b880 5 AuthRegistry(0x7fffd737f870) adding con mode: crc 2023-10-05T11:39:55.875 INFO:tasks.workunit.client.0.smithi012.stderr: -448> 2023-10-05T11:39:55.797+0000 7fe62028b880 5 AuthRegistry(0x7fffd737f870) adding con mode: secure 2023-10-05T11:39:55.875 INFO:tasks.workunit.client.0.smithi012.stderr: -447> 2023-10-05T11:39:55.797+0000 7fe62028b880 5 AuthRegistry(0x7fffd737f870) adding con mode: crc 2023-10-05T11:39:55.875 INFO:tasks.workunit.client.0.smithi012.stderr: -446> 2023-10-05T11:39:55.797+0000 7fe62028b880 5 AuthRegistry(0x7fffd737f870) adding con mode: secure 2023-10-05T11:39:55.875 INFO:tasks.workunit.client.0.smithi012.stderr: -445> 2023-10-05T11:39:55.797+0000 7fe62028b880 5 AuthRegistry(0x7fffd737f870) adding con mode: crc 2023-10-05T11:39:55.875 INFO:tasks.workunit.client.0.smithi012.stderr: -444> 2023-10-05T11:39:55.797+0000 7fe62028b880 5 AuthRegistry(0x7fffd737f870) adding con mode: crc 2023-10-05T11:39:55.876 INFO:tasks.workunit.client.0.smithi012.stderr: -443> 2023-10-05T11:39:55.797+0000 7fe62028b880 5 AuthRegistry(0x7fffd737f870) adding con mode: secure 2023-10-05T11:39:55.876 INFO:tasks.workunit.client.0.smithi012.stderr: -442> 2023-10-05T11:39:55.797+0000 7fe62028b880 5 AuthRegistry(0x7fffd737f870) adding con mode: crc 2023-10-05T11:39:55.876 INFO:tasks.workunit.client.0.smithi012.stderr: -441> 2023-10-05T11:39:55.797+0000 7fe62028b880 5 AuthRegistry(0x7fffd737f870) adding con mode: secure 2023-10-05T11:39:55.876 INFO:tasks.workunit.client.0.smithi012.stderr: -440> 2023-10-05T11:39:55.797+0000 7fe62028b880 5 AuthRegistry(0x7fffd737f870) adding con mode: crc 2023-10-05T11:39:55.876 INFO:tasks.workunit.client.0.smithi012.stderr: -439> 2023-10-05T11:39:55.797+0000 7fe62028b880 5 AuthRegistry(0x7fffd737f870) adding con mode: secure 2023-10-05T11:39:55.876 INFO:tasks.workunit.client.0.smithi012.stderr: -438> 2023-10-05T11:39:55.797+0000 7fe62028b880 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-10-05T11:39:55.876 INFO:tasks.workunit.client.0.smithi012.stderr: -437> 2023-10-05T11:39:55.797+0000 7fe62028b880 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-10-05T11:39:55.876 INFO:tasks.workunit.client.0.smithi012.stderr: -436> 2023-10-05T11:39:55.797+0000 7fe62028b880 5 asok(0x55dfb6b00000) register_command rotate-key cmddesc rotate-key hook 0x7fffd737f9b8 EEXIST 2023-10-05T11:39:55.876 INFO:tasks.workunit.client.0.smithi012.stderr: -435> 2023-10-05T11:39:55.797+0000 7fe62028b880 10 monclient: _reopen_session rank -1 2023-10-05T11:39:55.876 INFO:tasks.workunit.client.0.smithi012.stderr: -434> 2023-10-05T11:39:55.797+0000 7fe62028b880 10 monclient: _add_conns ranks=[1,2,0] 2023-10-05T11:39:55.876 INFO:tasks.workunit.client.0.smithi012.stderr: -433> 2023-10-05T11:39:55.797+0000 7fe62028b880 10 monclient(hunting): picked mon.noname-b con 0x55dfb76fc400 addr [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] 2023-10-05T11:39:55.876 INFO:tasks.workunit.client.0.smithi012.stderr: -432> 2023-10-05T11:39:55.797+0000 7fe62028b880 10 monclient(hunting): picked mon.noname-c con 0x55dfb76fc800 addr [v2:172.21.15.12:3301/0,v1:172.21.15.12:6790/0] 2023-10-05T11:39:55.877 INFO:tasks.workunit.client.0.smithi012.stderr: -431> 2023-10-05T11:39:55.797+0000 7fe62028b880 10 monclient(hunting): picked mon.noname-a con 0x55dfb76fcc00 addr [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] 2023-10-05T11:39:55.877 INFO:tasks.workunit.client.0.smithi012.stderr: -430> 2023-10-05T11:39:55.797+0000 7fe62028b880 10 monclient(hunting): start opening mon connection 2023-10-05T11:39:55.877 INFO:tasks.workunit.client.0.smithi012.stderr: -429> 2023-10-05T11:39:55.797+0000 7fe62028b880 10 monclient(hunting): start opening mon connection 2023-10-05T11:39:55.877 INFO:tasks.workunit.client.0.smithi012.stderr: -428> 2023-10-05T11:39:55.797+0000 7fe62028b880 10 monclient(hunting): start opening mon connection 2023-10-05T11:39:55.877 INFO:tasks.workunit.client.0.smithi012.stderr: -427> 2023-10-05T11:39:55.797+0000 7fe62028b880 10 monclient(hunting): _renew_subs 2023-10-05T11:39:55.877 INFO:tasks.workunit.client.0.smithi012.stderr: -426> 2023-10-05T11:39:55.797+0000 7fe62028b880 10 monclient(hunting): authenticate will time out at 1503.966081s 2023-10-05T11:39:55.877 INFO:tasks.workunit.client.0.smithi012.stderr: -425> 2023-10-05T11:39:55.797+0000 7fe61e22f640 10 monclient(hunting): get_auth_request con 0x55dfb76fcc00 auth_method 0 2023-10-05T11:39:55.877 INFO:tasks.workunit.client.0.smithi012.stderr: -424> 2023-10-05T11:39:55.797+0000 7fe61e22f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-10-05T11:39:55.877 INFO:tasks.workunit.client.0.smithi012.stderr: -423> 2023-10-05T11:39:55.797+0000 7fe61e22f640 10 monclient(hunting): _init_auth method 2 2023-10-05T11:39:55.877 INFO:tasks.workunit.client.0.smithi012.stderr: -422> 2023-10-05T11:39:55.797+0000 7fe61e22f640 10 monclient(hunting): _init_auth creating new auth 2023-10-05T11:39:55.877 INFO:tasks.workunit.client.0.smithi012.stderr: -421> 2023-10-05T11:39:55.797+0000 7fe61f231640 10 monclient(hunting): get_auth_request con 0x55dfb76fc400 auth_method 0 2023-10-05T11:39:55.877 INFO:tasks.workunit.client.0.smithi012.stderr: -420> 2023-10-05T11:39:55.797+0000 7fe61f231640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-10-05T11:39:55.878 INFO:tasks.workunit.client.0.smithi012.stderr: -419> 2023-10-05T11:39:55.797+0000 7fe61f231640 10 monclient(hunting): _init_auth method 2 2023-10-05T11:39:55.878 INFO:tasks.workunit.client.0.smithi012.stderr: -418> 2023-10-05T11:39:55.797+0000 7fe61f231640 10 monclient(hunting): _init_auth creating new auth 2023-10-05T11:39:55.878 INFO:tasks.workunit.client.0.smithi012.stderr: -417> 2023-10-05T11:39:55.797+0000 7fe61ea30640 10 monclient(hunting): get_auth_request con 0x55dfb76fc800 auth_method 0 2023-10-05T11:39:55.878 INFO:tasks.workunit.client.0.smithi012.stderr: -416> 2023-10-05T11:39:55.797+0000 7fe61ea30640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-10-05T11:39:55.878 INFO:tasks.workunit.client.0.smithi012.stderr: -415> 2023-10-05T11:39:55.797+0000 7fe61ea30640 10 monclient(hunting): _init_auth method 2 2023-10-05T11:39:55.878 INFO:tasks.workunit.client.0.smithi012.stderr: -414> 2023-10-05T11:39:55.797+0000 7fe61ea30640 10 monclient(hunting): _init_auth creating new auth 2023-10-05T11:39:55.878 INFO:tasks.workunit.client.0.smithi012.stderr: -413> 2023-10-05T11:39:55.797+0000 7fe61e22f640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-10-05T11:39:55.878 INFO:tasks.workunit.client.0.smithi012.stderr: -412> 2023-10-05T11:39:55.797+0000 7fe61e22f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-10-05T11:39:55.878 INFO:tasks.workunit.client.0.smithi012.stderr: -411> 2023-10-05T11:39:55.797+0000 7fe61e22f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-10-05T11:39:55.878 INFO:tasks.workunit.client.0.smithi012.stderr: -410> 2023-10-05T11:39:55.797+0000 7fe61f231640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-10-05T11:39:55.878 INFO:tasks.workunit.client.0.smithi012.stderr: -409> 2023-10-05T11:39:55.797+0000 7fe61f231640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-10-05T11:39:55.878 INFO:tasks.workunit.client.0.smithi012.stderr: -408> 2023-10-05T11:39:55.797+0000 7fe61f231640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-10-05T11:39:55.879 INFO:tasks.workunit.client.0.smithi012.stderr: -407> 2023-10-05T11:39:55.797+0000 7fe61ea30640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-10-05T11:39:55.879 INFO:tasks.workunit.client.0.smithi012.stderr: -406> 2023-10-05T11:39:55.797+0000 7fe61ea30640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-10-05T11:39:55.879 INFO:tasks.workunit.client.0.smithi012.stderr: -405> 2023-10-05T11:39:55.797+0000 7fe61ea30640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-10-05T11:39:55.879 INFO:tasks.workunit.client.0.smithi012.stderr: -404> 2023-10-05T11:39:55.798+0000 7fe61ba2a640 4 mgrc handle_mgr_map Got map version 5 2023-10-05T11:39:55.879 INFO:tasks.workunit.client.0.smithi012.stderr: -403> 2023-10-05T11:39:55.798+0000 7fe61ba2a640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.170:6832/180516904,v1:172.21.15.170:6833/180516904] 2023-10-05T11:39:55.879 INFO:tasks.workunit.client.0.smithi012.stderr: -402> 2023-10-05T11:39:55.798+0000 7fe61ba2a640 4 mgrc reconnect Starting new session with [v2:172.21.15.170:6832/180516904,v1:172.21.15.170:6833/180516904] 2023-10-05T11:39:55.879 INFO:tasks.workunit.client.0.smithi012.stderr: -401> 2023-10-05T11:39:55.798+0000 7fe61e22f640 10 monclient(hunting): handle_auth_done global_id 6585 payload 274 2023-10-05T11:39:55.879 INFO:tasks.workunit.client.0.smithi012.stderr: -400> 2023-10-05T11:39:55.798+0000 7fe61e22f640 10 monclient: _finish_hunting 0 2023-10-05T11:39:55.879 INFO:tasks.workunit.client.0.smithi012.stderr: -399> 2023-10-05T11:39:55.798+0000 7fe61e22f640 1 monclient: found mon.noname-a 2023-10-05T11:39:55.879 INFO:tasks.workunit.client.0.smithi012.stderr: -398> 2023-10-05T11:39:55.798+0000 7fe61e22f640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.12:3300/0 2023-10-05T11:39:55.879 INFO:tasks.workunit.client.0.smithi012.stderr: -397> 2023-10-05T11:39:55.798+0000 7fe61f231640 10 monclient: get_auth_request con 0x55dfb76fd800 auth_method 0 2023-10-05T11:39:55.879 INFO:tasks.workunit.client.0.smithi012.stderr: -396> 2023-10-05T11:39:55.798+0000 7fe619225640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-10-05T11:39:55.879 INFO:tasks.workunit.client.0.smithi012.stderr: -395> 2023-10-05T11:39:55.798+0000 7fe619225640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2023-10-05T11:39:55.880 INFO:tasks.workunit.client.0.smithi012.stderr: -394> 2023-10-05T11:39:55.798+0000 7fe619225640 10 monclient: dump: 2023-10-05T11:39:55.880 INFO:tasks.workunit.client.0.smithi012.stderr:epoch 1 2023-10-05T11:39:55.880 INFO:tasks.workunit.client.0.smithi012.stderr:fsid 7e015f46-293b-4b09-bd32-7d32b52f6e2f 2023-10-05T11:39:55.880 INFO:tasks.workunit.client.0.smithi012.stderr:last_changed 2023-10-05T11:27:38.366888+0000 2023-10-05T11:39:55.880 INFO:tasks.workunit.client.0.smithi012.stderr:created 2023-10-05T11:27:38.366888+0000 2023-10-05T11:39:55.880 INFO:tasks.workunit.client.0.smithi012.stderr:min_mon_release 18 (reef) 2023-10-05T11:39:55.880 INFO:tasks.workunit.client.0.smithi012.stderr:election_strategy: 1 2023-10-05T11:39:55.880 INFO:tasks.workunit.client.0.smithi012.stderr:0: [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon.a 2023-10-05T11:39:55.880 INFO:tasks.workunit.client.0.smithi012.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2023-10-05T11:39:55.880 INFO:tasks.workunit.client.0.smithi012.stderr:2: [v2:172.21.15.12:3301/0,v1:172.21.15.12:6790/0] mon.c 2023-10-05T11:39:55.880 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:39:55.880 INFO:tasks.workunit.client.0.smithi012.stderr: -393> 2023-10-05T11:39:55.798+0000 7fe619225640 10 monclient: _finish_auth 0 2023-10-05T11:39:55.881 INFO:tasks.workunit.client.0.smithi012.stderr: -392> 2023-10-05T11:39:55.798+0000 7fe619225640 10 monclient: _check_auth_tickets 2023-10-05T11:39:55.881 INFO:tasks.workunit.client.0.smithi012.stderr: -391> 2023-10-05T11:39:55.798+0000 7fe619225640 10 monclient: handle_config config(0 keys) v1 2023-10-05T11:39:55.881 INFO:tasks.workunit.client.0.smithi012.stderr: -390> 2023-10-05T11:39:55.798+0000 7fe619225640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-10-05T11:39:55.881 INFO:tasks.workunit.client.0.smithi012.stderr: -389> 2023-10-05T11:39:55.798+0000 7fe619225640 10 monclient: got monmap 1 from mon.a (according to old e1) 2023-10-05T11:39:55.881 INFO:tasks.workunit.client.0.smithi012.stderr: -388> 2023-10-05T11:39:55.798+0000 7fe619225640 10 monclient: dump: 2023-10-05T11:39:55.881 INFO:tasks.workunit.client.0.smithi012.stderr:epoch 1 2023-10-05T11:39:55.881 INFO:tasks.workunit.client.0.smithi012.stderr:fsid 7e015f46-293b-4b09-bd32-7d32b52f6e2f 2023-10-05T11:39:55.881 INFO:tasks.workunit.client.0.smithi012.stderr:last_changed 2023-10-05T11:27:38.366888+0000 2023-10-05T11:39:55.881 INFO:tasks.workunit.client.0.smithi012.stderr:created 2023-10-05T11:27:38.366888+0000 2023-10-05T11:39:55.881 INFO:tasks.workunit.client.0.smithi012.stderr:min_mon_release 18 (reef) 2023-10-05T11:39:55.881 INFO:tasks.workunit.client.0.smithi012.stderr:election_strategy: 1 2023-10-05T11:39:55.881 INFO:tasks.workunit.client.0.smithi012.stderr:0: [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon.a 2023-10-05T11:39:55.882 INFO:tasks.workunit.client.0.smithi012.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2023-10-05T11:39:55.882 INFO:tasks.workunit.client.0.smithi012.stderr:2: [v2:172.21.15.12:3301/0,v1:172.21.15.12:6790/0] mon.c 2023-10-05T11:39:55.882 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:39:55.882 INFO:tasks.workunit.client.0.smithi012.stderr: -387> 2023-10-05T11:39:55.798+0000 7fe62028b880 5 monclient: authenticate success, global_id 6585 2023-10-05T11:39:55.882 INFO:tasks.workunit.client.0.smithi012.stderr: -386> 2023-10-05T11:39:55.798+0000 7fe62028b880 10 monclient: get_monmap_and_config success 2023-10-05T11:39:55.882 INFO:tasks.workunit.client.0.smithi012.stderr: -385> 2023-10-05T11:39:55.798+0000 7fe62028b880 4 set_mon_vals no callback set 2023-10-05T11:39:55.882 INFO:tasks.workunit.client.0.smithi012.stderr: -384> 2023-10-05T11:39:55.798+0000 7fe62028b880 10 monclient: shutdown 2023-10-05T11:39:55.882 INFO:tasks.workunit.client.0.smithi012.stderr: -383> 2023-10-05T11:39:55.798+0000 7fe62028b880 10 monclient: build_initial_monmap 2023-10-05T11:39:55.882 INFO:tasks.workunit.client.0.smithi012.stderr: -382> 2023-10-05T11:39:55.798+0000 7fe62028b880 1 build_initial for_mkfs: 0 2023-10-05T11:39:55.882 INFO:tasks.workunit.client.0.smithi012.stderr: -381> 2023-10-05T11:39:55.798+0000 7fe62028b880 10 monclient: monmap: 2023-10-05T11:39:55.882 INFO:tasks.workunit.client.0.smithi012.stderr:epoch 0 2023-10-05T11:39:55.882 INFO:tasks.workunit.client.0.smithi012.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-10-05T11:39:55.883 INFO:tasks.workunit.client.0.smithi012.stderr:last_changed 0.000000 2023-10-05T11:39:55.883 INFO:tasks.workunit.client.0.smithi012.stderr:created 0.000000 2023-10-05T11:39:55.883 INFO:tasks.workunit.client.0.smithi012.stderr:min_mon_release 0 (unknown) 2023-10-05T11:39:55.883 INFO:tasks.workunit.client.0.smithi012.stderr:election_strategy: 1 2023-10-05T11:39:55.883 INFO:tasks.workunit.client.0.smithi012.stderr:0: [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon.noname-a 2023-10-05T11:39:55.883 INFO:tasks.workunit.client.0.smithi012.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.noname-b 2023-10-05T11:39:55.883 INFO:tasks.workunit.client.0.smithi012.stderr:2: [v2:172.21.15.12:3301/0,v1:172.21.15.12:6790/0] mon.noname-c 2023-10-05T11:39:55.883 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:39:55.883 INFO:tasks.workunit.client.0.smithi012.stderr: -380> 2023-10-05T11:39:55.798+0000 7fe62028b880 5 AuthRegistry(0x55dfb75b1340) adding auth protocol: cephx 2023-10-05T11:39:55.883 INFO:tasks.workunit.client.0.smithi012.stderr: -379> 2023-10-05T11:39:55.798+0000 7fe62028b880 5 AuthRegistry(0x55dfb75b1340) adding auth protocol: cephx 2023-10-05T11:39:55.883 INFO:tasks.workunit.client.0.smithi012.stderr: -378> 2023-10-05T11:39:55.798+0000 7fe62028b880 5 AuthRegistry(0x55dfb75b1340) adding auth protocol: cephx 2023-10-05T11:39:55.883 INFO:tasks.workunit.client.0.smithi012.stderr: -377> 2023-10-05T11:39:55.798+0000 7fe62028b880 5 AuthRegistry(0x55dfb75b1340) adding con mode: secure 2023-10-05T11:39:55.884 INFO:tasks.workunit.client.0.smithi012.stderr: -376> 2023-10-05T11:39:55.798+0000 7fe62028b880 5 AuthRegistry(0x55dfb75b1340) adding con mode: crc 2023-10-05T11:39:55.884 INFO:tasks.workunit.client.0.smithi012.stderr: -375> 2023-10-05T11:39:55.798+0000 7fe62028b880 5 AuthRegistry(0x55dfb75b1340) adding con mode: secure 2023-10-05T11:39:55.884 INFO:tasks.workunit.client.0.smithi012.stderr: -374> 2023-10-05T11:39:55.798+0000 7fe62028b880 5 AuthRegistry(0x55dfb75b1340) adding con mode: crc 2023-10-05T11:39:55.884 INFO:tasks.workunit.client.0.smithi012.stderr: -373> 2023-10-05T11:39:55.798+0000 7fe62028b880 5 AuthRegistry(0x55dfb75b1340) adding con mode: secure 2023-10-05T11:39:55.884 INFO:tasks.workunit.client.0.smithi012.stderr: -372> 2023-10-05T11:39:55.798+0000 7fe62028b880 5 AuthRegistry(0x55dfb75b1340) adding con mode: crc 2023-10-05T11:39:55.884 INFO:tasks.workunit.client.0.smithi012.stderr: -371> 2023-10-05T11:39:55.798+0000 7fe62028b880 5 AuthRegistry(0x55dfb75b1340) adding con mode: crc 2023-10-05T11:39:55.884 INFO:tasks.workunit.client.0.smithi012.stderr: -370> 2023-10-05T11:39:55.798+0000 7fe62028b880 5 AuthRegistry(0x55dfb75b1340) adding con mode: secure 2023-10-05T11:39:55.884 INFO:tasks.workunit.client.0.smithi012.stderr: -369> 2023-10-05T11:39:55.798+0000 7fe62028b880 5 AuthRegistry(0x55dfb75b1340) adding con mode: crc 2023-10-05T11:39:55.884 INFO:tasks.workunit.client.0.smithi012.stderr: -368> 2023-10-05T11:39:55.798+0000 7fe62028b880 5 AuthRegistry(0x55dfb75b1340) adding con mode: secure 2023-10-05T11:39:55.884 INFO:tasks.workunit.client.0.smithi012.stderr: -367> 2023-10-05T11:39:55.798+0000 7fe62028b880 5 AuthRegistry(0x55dfb75b1340) adding con mode: crc 2023-10-05T11:39:55.884 INFO:tasks.workunit.client.0.smithi012.stderr: -366> 2023-10-05T11:39:55.798+0000 7fe62028b880 5 AuthRegistry(0x55dfb75b1340) adding con mode: secure 2023-10-05T11:39:55.884 INFO:tasks.workunit.client.0.smithi012.stderr: -365> 2023-10-05T11:39:55.799+0000 7fe62028b880 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-10-05T11:39:55.884 INFO:tasks.workunit.client.0.smithi012.stderr: -364> 2023-10-05T11:39:55.799+0000 7fe62028b880 1 librados: starting msgr at 2023-10-05T11:39:55.885 INFO:tasks.workunit.client.0.smithi012.stderr: -363> 2023-10-05T11:39:55.799+0000 7fe62028b880 1 librados: starting objecter 2023-10-05T11:39:55.885 INFO:tasks.workunit.client.0.smithi012.stderr: -362> 2023-10-05T11:39:55.799+0000 7fe62028b880 5 asok(0x55dfb6b00000) register_command objecter_requests cmddesc objecter_requests hook 0x55dfb68c1530 EEXIST 2023-10-05T11:39:55.885 INFO:tasks.workunit.client.0.smithi012.stderr: -361> 2023-10-05T11:39:55.799+0000 7fe62028b880 1 librados: setting wanted keys 2023-10-05T11:39:55.885 INFO:tasks.workunit.client.0.smithi012.stderr: -360> 2023-10-05T11:39:55.799+0000 7fe62028b880 1 librados: calling monclient init 2023-10-05T11:39:55.885 INFO:tasks.workunit.client.0.smithi012.stderr: -359> 2023-10-05T11:39:55.799+0000 7fe62028b880 10 monclient: init 2023-10-05T11:39:55.885 INFO:tasks.workunit.client.0.smithi012.stderr: -358> 2023-10-05T11:39:55.799+0000 7fe62028b880 5 AuthRegistry(0x55dfb695f0d8) adding auth protocol: cephx 2023-10-05T11:39:55.885 INFO:tasks.workunit.client.0.smithi012.stderr: -357> 2023-10-05T11:39:55.799+0000 7fe62028b880 5 AuthRegistry(0x55dfb695f0d8) adding auth protocol: cephx 2023-10-05T11:39:55.885 INFO:tasks.workunit.client.0.smithi012.stderr: -356> 2023-10-05T11:39:55.799+0000 7fe62028b880 5 AuthRegistry(0x55dfb695f0d8) adding auth protocol: cephx 2023-10-05T11:39:55.885 INFO:tasks.workunit.client.0.smithi012.stderr: -355> 2023-10-05T11:39:55.799+0000 7fe62028b880 5 AuthRegistry(0x55dfb695f0d8) adding con mode: secure 2023-10-05T11:39:55.885 INFO:tasks.workunit.client.0.smithi012.stderr: -354> 2023-10-05T11:39:55.799+0000 7fe62028b880 5 AuthRegistry(0x55dfb695f0d8) adding con mode: crc 2023-10-05T11:39:55.885 INFO:tasks.workunit.client.0.smithi012.stderr: -353> 2023-10-05T11:39:55.799+0000 7fe62028b880 5 AuthRegistry(0x55dfb695f0d8) adding con mode: secure 2023-10-05T11:39:55.885 INFO:tasks.workunit.client.0.smithi012.stderr: -352> 2023-10-05T11:39:55.799+0000 7fe62028b880 5 AuthRegistry(0x55dfb695f0d8) adding con mode: crc 2023-10-05T11:39:55.886 INFO:tasks.workunit.client.0.smithi012.stderr: -351> 2023-10-05T11:39:55.799+0000 7fe62028b880 5 AuthRegistry(0x55dfb695f0d8) adding con mode: secure 2023-10-05T11:39:55.886 INFO:tasks.workunit.client.0.smithi012.stderr: -350> 2023-10-05T11:39:55.799+0000 7fe62028b880 5 AuthRegistry(0x55dfb695f0d8) adding con mode: crc 2023-10-05T11:39:55.886 INFO:tasks.workunit.client.0.smithi012.stderr: -349> 2023-10-05T11:39:55.799+0000 7fe62028b880 5 AuthRegistry(0x55dfb695f0d8) adding con mode: crc 2023-10-05T11:39:55.886 INFO:tasks.workunit.client.0.smithi012.stderr: -348> 2023-10-05T11:39:55.799+0000 7fe62028b880 5 AuthRegistry(0x55dfb695f0d8) adding con mode: secure 2023-10-05T11:39:55.886 INFO:tasks.workunit.client.0.smithi012.stderr: -347> 2023-10-05T11:39:55.799+0000 7fe62028b880 5 AuthRegistry(0x55dfb695f0d8) adding con mode: crc 2023-10-05T11:39:55.886 INFO:tasks.workunit.client.0.smithi012.stderr: -346> 2023-10-05T11:39:55.799+0000 7fe62028b880 5 AuthRegistry(0x55dfb695f0d8) adding con mode: secure 2023-10-05T11:39:55.886 INFO:tasks.workunit.client.0.smithi012.stderr: -345> 2023-10-05T11:39:55.799+0000 7fe62028b880 5 AuthRegistry(0x55dfb695f0d8) adding con mode: crc 2023-10-05T11:39:55.886 INFO:tasks.workunit.client.0.smithi012.stderr: -344> 2023-10-05T11:39:55.799+0000 7fe62028b880 5 AuthRegistry(0x55dfb695f0d8) adding con mode: secure 2023-10-05T11:39:55.886 INFO:tasks.workunit.client.0.smithi012.stderr: -343> 2023-10-05T11:39:55.799+0000 7fe62028b880 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-10-05T11:39:55.886 INFO:tasks.workunit.client.0.smithi012.stderr: -342> 2023-10-05T11:39:55.799+0000 7fe62028b880 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-10-05T11:39:55.886 INFO:tasks.workunit.client.0.smithi012.stderr: -341> 2023-10-05T11:39:55.799+0000 7fe62028b880 5 asok(0x55dfb6b00000) register_command rotate-key cmddesc rotate-key hook 0x55dfb695f220 EEXIST 2023-10-05T11:39:55.886 INFO:tasks.workunit.client.0.smithi012.stderr: -340> 2023-10-05T11:39:55.799+0000 7fe62028b880 10 monclient: _reopen_session rank -1 2023-10-05T11:39:55.887 INFO:tasks.workunit.client.0.smithi012.stderr: -339> 2023-10-05T11:39:55.799+0000 7fe62028b880 10 monclient: _add_conns ranks=[1,0,2] 2023-10-05T11:39:55.887 INFO:tasks.workunit.client.0.smithi012.stderr: -338> 2023-10-05T11:39:55.799+0000 7fe62028b880 10 monclient(hunting): picked mon.noname-b con 0x55dfb76fc400 addr [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] 2023-10-05T11:39:55.887 INFO:tasks.workunit.client.0.smithi012.stderr: -337> 2023-10-05T11:39:55.799+0000 7fe62028b880 10 monclient(hunting): picked mon.noname-a con 0x55dfb76fc800 addr [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] 2023-10-05T11:39:55.887 INFO:tasks.workunit.client.0.smithi012.stderr: -336> 2023-10-05T11:39:55.799+0000 7fe62028b880 10 monclient(hunting): picked mon.noname-c con 0x55dfb76fcc00 addr [v2:172.21.15.12:3301/0,v1:172.21.15.12:6790/0] 2023-10-05T11:39:55.887 INFO:tasks.workunit.client.0.smithi012.stderr: -335> 2023-10-05T11:39:55.799+0000 7fe62028b880 10 monclient(hunting): start opening mon connection 2023-10-05T11:39:55.887 INFO:tasks.workunit.client.0.smithi012.stderr: -334> 2023-10-05T11:39:55.799+0000 7fe62028b880 10 monclient(hunting): start opening mon connection 2023-10-05T11:39:55.887 INFO:tasks.workunit.client.0.smithi012.stderr: -333> 2023-10-05T11:39:55.799+0000 7fe62028b880 10 monclient(hunting): start opening mon connection 2023-10-05T11:39:55.887 INFO:tasks.workunit.client.0.smithi012.stderr: -332> 2023-10-05T11:39:55.799+0000 7fe62028b880 10 monclient(hunting): _renew_subs 2023-10-05T11:39:55.887 INFO:tasks.workunit.client.0.smithi012.stderr: -331> 2023-10-05T11:39:55.799+0000 7fe62028b880 10 monclient(hunting): authenticate will time out at 1503.968207s 2023-10-05T11:39:55.887 INFO:tasks.workunit.client.0.smithi012.stderr: -330> 2023-10-05T11:39:55.799+0000 7fe61e22f640 10 monclient(hunting): get_auth_request con 0x55dfb76fc800 auth_method 0 2023-10-05T11:39:55.887 INFO:tasks.workunit.client.0.smithi012.stderr: -329> 2023-10-05T11:39:55.799+0000 7fe61e22f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-10-05T11:39:55.887 INFO:tasks.workunit.client.0.smithi012.stderr: -328> 2023-10-05T11:39:55.799+0000 7fe61e22f640 10 monclient(hunting): _init_auth method 2 2023-10-05T11:39:55.887 INFO:tasks.workunit.client.0.smithi012.stderr: -327> 2023-10-05T11:39:55.799+0000 7fe61e22f640 10 monclient(hunting): _init_auth creating new auth 2023-10-05T11:39:55.888 INFO:tasks.workunit.client.0.smithi012.stderr: -326> 2023-10-05T11:39:55.799+0000 7fe61f231640 10 monclient(hunting): get_auth_request con 0x55dfb76fcc00 auth_method 0 2023-10-05T11:39:55.888 INFO:tasks.workunit.client.0.smithi012.stderr: -325> 2023-10-05T11:39:55.799+0000 7fe61f231640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-10-05T11:39:55.888 INFO:tasks.workunit.client.0.smithi012.stderr: -324> 2023-10-05T11:39:55.799+0000 7fe61f231640 10 monclient(hunting): _init_auth method 2 2023-10-05T11:39:55.888 INFO:tasks.workunit.client.0.smithi012.stderr: -323> 2023-10-05T11:39:55.799+0000 7fe61f231640 10 monclient(hunting): _init_auth creating new auth 2023-10-05T11:39:55.888 INFO:tasks.workunit.client.0.smithi012.stderr: -322> 2023-10-05T11:39:55.799+0000 7fe61e22f640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-10-05T11:39:55.888 INFO:tasks.workunit.client.0.smithi012.stderr: -321> 2023-10-05T11:39:55.799+0000 7fe61e22f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-10-05T11:39:55.888 INFO:tasks.workunit.client.0.smithi012.stderr: -320> 2023-10-05T11:39:55.799+0000 7fe61e22f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-10-05T11:39:55.888 INFO:tasks.workunit.client.0.smithi012.stderr: -319> 2023-10-05T11:39:55.799+0000 7fe61f231640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-10-05T11:39:55.888 INFO:tasks.workunit.client.0.smithi012.stderr: -318> 2023-10-05T11:39:55.799+0000 7fe61f231640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-10-05T11:39:55.888 INFO:tasks.workunit.client.0.smithi012.stderr: -317> 2023-10-05T11:39:55.799+0000 7fe61f231640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-10-05T11:39:55.888 INFO:tasks.workunit.client.0.smithi012.stderr: -316> 2023-10-05T11:39:55.800+0000 7fe61ea30640 10 monclient(hunting): get_auth_request con 0x55dfb76fc400 auth_method 0 2023-10-05T11:39:55.888 INFO:tasks.workunit.client.0.smithi012.stderr: -315> 2023-10-05T11:39:55.800+0000 7fe61ea30640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-10-05T11:39:55.889 INFO:tasks.workunit.client.0.smithi012.stderr: -314> 2023-10-05T11:39:55.800+0000 7fe61ea30640 10 monclient(hunting): _init_auth method 2 2023-10-05T11:39:55.889 INFO:tasks.workunit.client.0.smithi012.stderr: -313> 2023-10-05T11:39:55.800+0000 7fe61ea30640 10 monclient(hunting): _init_auth creating new auth 2023-10-05T11:39:55.889 INFO:tasks.workunit.client.0.smithi012.stderr: -312> 2023-10-05T11:39:55.800+0000 7fe61e22f640 10 monclient(hunting): handle_auth_done global_id 6588 payload 824 2023-10-05T11:39:55.889 INFO:tasks.workunit.client.0.smithi012.stderr: -311> 2023-10-05T11:39:55.800+0000 7fe61e22f640 10 monclient: _finish_hunting 0 2023-10-05T11:39:55.889 INFO:tasks.workunit.client.0.smithi012.stderr: -310> 2023-10-05T11:39:55.800+0000 7fe61e22f640 1 monclient: found mon.noname-a 2023-10-05T11:39:55.889 INFO:tasks.workunit.client.0.smithi012.stderr: -309> 2023-10-05T11:39:55.800+0000 7fe61e22f640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.12:3300/0 2023-10-05T11:39:55.889 INFO:tasks.workunit.client.0.smithi012.stderr: -308> 2023-10-05T11:39:55.800+0000 7fe617a22640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-10-05T11:39:55.889 INFO:tasks.workunit.client.0.smithi012.stderr: -307> 2023-10-05T11:39:55.800+0000 7fe617a22640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2023-10-05T11:39:55.889 INFO:tasks.workunit.client.0.smithi012.stderr: -306> 2023-10-05T11:39:55.800+0000 7fe617a22640 10 monclient: dump: 2023-10-05T11:39:55.889 INFO:tasks.workunit.client.0.smithi012.stderr:epoch 1 2023-10-05T11:39:55.889 INFO:tasks.workunit.client.0.smithi012.stderr:fsid 7e015f46-293b-4b09-bd32-7d32b52f6e2f 2023-10-05T11:39:55.889 INFO:tasks.workunit.client.0.smithi012.stderr:last_changed 2023-10-05T11:27:38.366888+0000 2023-10-05T11:39:55.890 INFO:tasks.workunit.client.0.smithi012.stderr:created 2023-10-05T11:27:38.366888+0000 2023-10-05T11:39:55.890 INFO:tasks.workunit.client.0.smithi012.stderr:min_mon_release 18 (reef) 2023-10-05T11:39:55.890 INFO:tasks.workunit.client.0.smithi012.stderr:election_strategy: 1 2023-10-05T11:39:55.890 INFO:tasks.workunit.client.0.smithi012.stderr:0: [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon.a 2023-10-05T11:39:55.890 INFO:tasks.workunit.client.0.smithi012.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2023-10-05T11:39:55.890 INFO:tasks.workunit.client.0.smithi012.stderr:2: [v2:172.21.15.12:3301/0,v1:172.21.15.12:6790/0] mon.c 2023-10-05T11:39:55.890 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:39:55.890 INFO:tasks.workunit.client.0.smithi012.stderr: -305> 2023-10-05T11:39:55.800+0000 7fe617a22640 10 monclient: _finish_auth 0 2023-10-05T11:39:55.890 INFO:tasks.workunit.client.0.smithi012.stderr: -304> 2023-10-05T11:39:55.800+0000 7fe617a22640 10 monclient: _check_auth_tickets 2023-10-05T11:39:55.890 INFO:tasks.workunit.client.0.smithi012.stderr: -303> 2023-10-05T11:39:55.800+0000 7fe617a22640 10 monclient: handle_config config(0 keys) v1 2023-10-05T11:39:55.890 INFO:tasks.workunit.client.0.smithi012.stderr: -302> 2023-10-05T11:39:55.800+0000 7fe617a22640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-10-05T11:39:55.890 INFO:tasks.workunit.client.0.smithi012.stderr: -301> 2023-10-05T11:39:55.800+0000 7fe617a22640 10 monclient: got monmap 1 from mon.a (according to old e1) 2023-10-05T11:39:55.891 INFO:tasks.workunit.client.0.smithi012.stderr: -300> 2023-10-05T11:39:55.800+0000 7fe617a22640 10 monclient: dump: 2023-10-05T11:39:55.891 INFO:tasks.workunit.client.0.smithi012.stderr:epoch 1 2023-10-05T11:39:55.891 INFO:tasks.workunit.client.0.smithi012.stderr:fsid 7e015f46-293b-4b09-bd32-7d32b52f6e2f 2023-10-05T11:39:55.891 INFO:tasks.workunit.client.0.smithi012.stderr:last_changed 2023-10-05T11:27:38.366888+0000 2023-10-05T11:39:55.891 INFO:tasks.workunit.client.0.smithi012.stderr:created 2023-10-05T11:27:38.366888+0000 2023-10-05T11:39:55.891 INFO:tasks.workunit.client.0.smithi012.stderr:min_mon_release 18 (reef) 2023-10-05T11:39:55.891 INFO:tasks.workunit.client.0.smithi012.stderr:election_strategy: 1 2023-10-05T11:39:55.891 INFO:tasks.workunit.client.0.smithi012.stderr:0: [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon.a 2023-10-05T11:39:55.891 INFO:tasks.workunit.client.0.smithi012.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2023-10-05T11:39:55.891 INFO:tasks.workunit.client.0.smithi012.stderr:2: [v2:172.21.15.12:3301/0,v1:172.21.15.12:6790/0] mon.c 2023-10-05T11:39:55.891 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:39:55.891 INFO:tasks.workunit.client.0.smithi012.stderr: -299> 2023-10-05T11:39:55.800+0000 7fe619225640 4 set_mon_vals no callback set 2023-10-05T11:39:55.892 INFO:tasks.workunit.client.0.smithi012.stderr: -298> 2023-10-05T11:39:55.800+0000 7fe62028b880 5 monclient: authenticate success, global_id 6588 2023-10-05T11:39:55.892 INFO:tasks.workunit.client.0.smithi012.stderr: -297> 2023-10-05T11:39:55.800+0000 7fe62028b880 10 monclient: _renew_subs 2023-10-05T11:39:55.892 INFO:tasks.workunit.client.0.smithi012.stderr: -296> 2023-10-05T11:39:55.800+0000 7fe62028b880 10 monclient: _send_mon_message to mon.a at v2:172.21.15.12:3300/0 2023-10-05T11:39:55.892 INFO:tasks.workunit.client.0.smithi012.stderr: -295> 2023-10-05T11:39:55.800+0000 7fe62028b880 10 monclient: _renew_subs 2023-10-05T11:39:55.892 INFO:tasks.workunit.client.0.smithi012.stderr: -294> 2023-10-05T11:39:55.800+0000 7fe62028b880 10 monclient: _send_mon_message to mon.a at v2:172.21.15.12:3300/0 2023-10-05T11:39:55.892 INFO:tasks.workunit.client.0.smithi012.stderr: -293> 2023-10-05T11:39:55.800+0000 7fe62028b880 1 librados: init done 2023-10-05T11:39:55.892 INFO:tasks.workunit.client.0.smithi012.stderr: -292> 2023-10-05T11:39:55.801+0000 7fe62028b880 20 rados->read ofs=0 len=0 2023-10-05T11:39:55.892 INFO:tasks.workunit.client.0.smithi012.stderr: -291> 2023-10-05T11:39:55.801+0000 7fe617a22640 4 mgrc handle_mgr_map Got map version 5 2023-10-05T11:39:55.892 INFO:tasks.workunit.client.0.smithi012.stderr: -290> 2023-10-05T11:39:55.801+0000 7fe617a22640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.170:6832/180516904,v1:172.21.15.170:6833/180516904] 2023-10-05T11:39:55.892 INFO:tasks.workunit.client.0.smithi012.stderr: -289> 2023-10-05T11:39:55.801+0000 7fe617a22640 4 mgrc reconnect Starting new session with [v2:172.21.15.170:6832/180516904,v1:172.21.15.170:6833/180516904] 2023-10-05T11:39:55.892 INFO:tasks.workunit.client.0.smithi012.stderr: -288> 2023-10-05T11:39:55.802+0000 7fe61ea30640 10 monclient: get_auth_request con 0x55dfb6bd5c00 auth_method 0 2023-10-05T11:39:55.892 INFO:tasks.workunit.client.0.smithi012.stderr: -287> 2023-10-05T11:39:55.802+0000 7fe61f231640 10 monclient: get_auth_request con 0x55dfb76fd000 auth_method 0 2023-10-05T11:39:55.892 INFO:tasks.workunit.client.0.smithi012.stderr: -286> 2023-10-05T11:39:55.802+0000 7fe62028b880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:55.893 INFO:tasks.workunit.client.0.smithi012.stderr: -285> 2023-10-05T11:39:55.802+0000 7fe62028b880 20 realm 2023-10-05T11:39:55.893 INFO:tasks.workunit.client.0.smithi012.stderr: -284> 2023-10-05T11:39:55.802+0000 7fe62028b880 20 rados->read ofs=0 len=0 2023-10-05T11:39:55.893 INFO:tasks.workunit.client.0.smithi012.stderr: -283> 2023-10-05T11:39:55.803+0000 7fe62028b880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:55.893 INFO:tasks.workunit.client.0.smithi012.stderr: -282> 2023-10-05T11:39:55.803+0000 7fe62028b880 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T11:39:55.893 INFO:tasks.workunit.client.0.smithi012.stderr: -281> 2023-10-05T11:39:55.803+0000 7fe62028b880 20 rados->read ofs=0 len=0 2023-10-05T11:39:55.893 INFO:tasks.workunit.client.0.smithi012.stderr: -280> 2023-10-05T11:39:55.803+0000 7fe62028b880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:55.893 INFO:tasks.workunit.client.0.smithi012.stderr: -279> 2023-10-05T11:39:55.803+0000 7fe62028b880 20 rados->read ofs=0 len=0 2023-10-05T11:39:55.893 INFO:tasks.workunit.client.0.smithi012.stderr: -278> 2023-10-05T11:39:55.803+0000 7fe61ea30640 10 monclient: get_auth_request con 0x55dfb76fd400 auth_method 0 2023-10-05T11:39:55.893 INFO:tasks.workunit.client.0.smithi012.stderr: -277> 2023-10-05T11:39:55.804+0000 7fe62028b880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:39:55.893 INFO:tasks.workunit.client.0.smithi012.stderr: -276> 2023-10-05T11:39:55.804+0000 7fe62028b880 20 rados->read ofs=0 len=0 2023-10-05T11:39:55.893 INFO:tasks.workunit.client.0.smithi012.stderr: -275> 2023-10-05T11:39:55.804+0000 7fe61e22f640 10 monclient: get_auth_request con 0x55dfb6cb5000 auth_method 0 2023-10-05T11:39:55.893 INFO:tasks.workunit.client.0.smithi012.stderr: -274> 2023-10-05T11:39:55.805+0000 7fe62028b880 20 rados_obj.operate() r=0 bl.length=1020 2023-10-05T11:39:55.894 INFO:tasks.workunit.client.0.smithi012.stderr: -273> 2023-10-05T11:39:55.805+0000 7fe62028b880 20 searching for the correct realm 2023-10-05T11:39:55.894 INFO:tasks.workunit.client.0.smithi012.stderr: -272> 2023-10-05T11:39:55.805+0000 7fe61f231640 10 monclient: get_auth_request con 0x55dfb6cb5400 auth_method 0 2023-10-05T11:39:55.894 INFO:tasks.workunit.client.0.smithi012.stderr: -271> 2023-10-05T11:39:55.806+0000 7fe61ea30640 10 monclient: get_auth_request con 0x55dfb6bd5000 auth_method 0 2023-10-05T11:39:55.894 INFO:tasks.workunit.client.0.smithi012.stderr: -270> 2023-10-05T11:39:55.807+0000 7fe61e22f640 10 monclient: get_auth_request con 0x55dfb6cb4400 auth_method 0 2023-10-05T11:39:55.894 INFO:tasks.workunit.client.0.smithi012.stderr: -269> 2023-10-05T11:39:55.808+0000 7fe61f231640 10 monclient: get_auth_request con 0x55dfb6bd5400 auth_method 0 2023-10-05T11:39:55.894 INFO:tasks.workunit.client.0.smithi012.stderr: -268> 2023-10-05T11:39:55.810+0000 7fe61ea30640 10 monclient: get_auth_request con 0x55dfb6cd6000 auth_method 0 2023-10-05T11:39:55.894 INFO:tasks.workunit.client.0.smithi012.stderr: -267> 2023-10-05T11:39:55.814+0000 7fe61ea30640 0 -- 172.21.15.12:0/3931236051 >> [v2:172.21.15.170:6814/3150808418,v1:172.21.15.170:6816/3150808418] conn(0x55dfb76fd400 msgr2=0x55dfb6b06c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:39:55.894 INFO:tasks.workunit.client.0.smithi012.stderr: -266> 2023-10-05T11:39:55.814+0000 7fe617a22640 1 client.6588.objecter ms_handle_reset 0x55dfb76fd400 session 0x55dfb6afb980 osd.5 2023-10-05T11:39:55.894 INFO:tasks.workunit.client.0.smithi012.stderr: -265> 2023-10-05T11:39:55.814+0000 7fe617a22640 10 monclient: _renew_subs 2023-10-05T11:39:55.894 INFO:tasks.workunit.client.0.smithi012.stderr: -264> 2023-10-05T11:39:55.814+0000 7fe617a22640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.12:3300/0 2023-10-05T11:39:55.894 INFO:tasks.workunit.client.0.smithi012.stderr: -263> 2023-10-05T11:39:55.814+0000 7fe61ea30640 10 monclient: get_auth_request con 0x55dfb6cd7000 auth_method 0 2023-10-05T11:39:55.894 INFO:tasks.workunit.client.0.smithi012.stderr: -262> 2023-10-05T11:39:55.815+0000 7fe62028b880 20 RGWRados::pool_iterate: got zone_info.dff27d1e-df33-400e-a68a-7ba586947c99 2023-10-05T11:39:55.895 INFO:tasks.workunit.client.0.smithi012.stderr: -261> 2023-10-05T11:39:55.815+0000 7fe62028b880 20 RGWRados::pool_iterate: got zonegroup_info.c78aa576-9d15-4e9d-b3c0-4af23a22062c 2023-10-05T11:39:55.895 INFO:tasks.workunit.client.0.smithi012.stderr: -260> 2023-10-05T11:39:55.815+0000 7fe62028b880 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T11:39:55.895 INFO:tasks.workunit.client.0.smithi012.stderr: -259> 2023-10-05T11:39:55.815+0000 7fe62028b880 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T11:39:55.895 INFO:tasks.workunit.client.0.smithi012.stderr: -258> 2023-10-05T11:39:55.815+0000 7fe62028b880 20 rados->read ofs=0 len=0 2023-10-05T11:39:55.895 INFO:tasks.workunit.client.0.smithi012.stderr: -257> 2023-10-05T11:39:55.816+0000 7fe62028b880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:55.895 INFO:tasks.workunit.client.0.smithi012.stderr: -256> 2023-10-05T11:39:55.816+0000 7fe62028b880 20 rados->read ofs=0 len=0 2023-10-05T11:39:55.895 INFO:tasks.workunit.client.0.smithi012.stderr: -255> 2023-10-05T11:39:55.816+0000 7fe62028b880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:39:55.895 INFO:tasks.workunit.client.0.smithi012.stderr: -254> 2023-10-05T11:39:55.816+0000 7fe62028b880 20 rados->read ofs=0 len=0 2023-10-05T11:39:55.895 INFO:tasks.workunit.client.0.smithi012.stderr: -253> 2023-10-05T11:39:55.816+0000 7fe62028b880 20 rados_obj.operate() r=0 bl.length=454 2023-10-05T11:39:55.895 INFO:tasks.workunit.client.0.smithi012.stderr: -252> 2023-10-05T11:39:55.816+0000 7fe62028b880 20 zone default found 2023-10-05T11:39:55.895 INFO:tasks.workunit.client.0.smithi012.stderr: -251> 2023-10-05T11:39:55.816+0000 7fe62028b880 4 Realm: () 2023-10-05T11:39:55.895 INFO:tasks.workunit.client.0.smithi012.stderr: -250> 2023-10-05T11:39:55.816+0000 7fe62028b880 4 ZoneGroup: default (c78aa576-9d15-4e9d-b3c0-4af23a22062c) 2023-10-05T11:39:55.895 INFO:tasks.workunit.client.0.smithi012.stderr: -249> 2023-10-05T11:39:55.816+0000 7fe62028b880 4 Zone: default (dff27d1e-df33-400e-a68a-7ba586947c99) 2023-10-05T11:39:55.896 INFO:tasks.workunit.client.0.smithi012.stderr: -248> 2023-10-05T11:39:55.816+0000 7fe62028b880 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T11:39:55.896 INFO:tasks.workunit.client.0.smithi012.stderr: -247> 2023-10-05T11:39:55.816+0000 7fe62028b880 20 zonegroup default 2023-10-05T11:39:55.896 INFO:tasks.workunit.client.0.smithi012.stderr: -246> 2023-10-05T11:39:55.816+0000 7fe62028b880 20 rados->read ofs=0 len=0 2023-10-05T11:39:55.896 INFO:tasks.workunit.client.0.smithi012.stderr: -245> 2023-10-05T11:39:55.816+0000 7fe62028b880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:55.896 INFO:tasks.workunit.client.0.smithi012.stderr: -244> 2023-10-05T11:39:55.816+0000 7fe62028b880 20 rados->read ofs=0 len=0 2023-10-05T11:39:55.896 INFO:tasks.workunit.client.0.smithi012.stderr: -243> 2023-10-05T11:39:55.817+0000 7fe62028b880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:55.896 INFO:tasks.workunit.client.0.smithi012.stderr: -242> 2023-10-05T11:39:55.817+0000 7fe62028b880 20 rados->read ofs=0 len=0 2023-10-05T11:39:55.896 INFO:tasks.workunit.client.0.smithi012.stderr: -241> 2023-10-05T11:39:55.817+0000 7fe62028b880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:55.896 INFO:tasks.workunit.client.0.smithi012.stderr: -240> 2023-10-05T11:39:55.817+0000 7fe62028b880 20 started sync module instance, tier type = 2023-10-05T11:39:55.896 INFO:tasks.workunit.client.0.smithi012.stderr: -239> 2023-10-05T11:39:55.817+0000 7fe62028b880 20 started zone id=dff27d1e-df33-400e-a68a-7ba586947c99 (name=default) with tier type = 2023-10-05T11:39:55.896 INFO:tasks.workunit.client.0.smithi012.stderr: -238> 2023-10-05T11:39:55.822+0000 7fe61f231640 0 -- 172.21.15.12:0/3931236051 >> [v2:172.21.15.12:6824/2171933159,v1:172.21.15.12:6825/2171933159] conn(0x55dfb6cb5400 msgr2=0x55dfb6b07700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-10-05T11:39:55.896 INFO:tasks.workunit.client.0.smithi012.stderr: -237> 2023-10-05T11:39:55.822+0000 7fe617a22640 1 client.6588.objecter ms_handle_reset 0x55dfb6cb5400 session 0x55dfb6afad80 osd.3 2023-10-05T11:39:55.897 INFO:tasks.workunit.client.0.smithi012.stderr: -236> 2023-10-05T11:39:55.823+0000 7fe61f231640 10 monclient: get_auth_request con 0x55dfb76fd400 auth_method 0 2023-10-05T11:39:55.897 INFO:tasks.workunit.client.0.smithi012.stderr: -235> 2023-10-05T11:39:55.826+0000 7fe62028b880 20 add_watcher() i=0 2023-10-05T11:39:55.897 INFO:tasks.workunit.client.0.smithi012.stderr: -234> 2023-10-05T11:39:55.826+0000 7fe62028b880 20 add_watcher() i=1 2023-10-05T11:39:55.897 INFO:tasks.workunit.client.0.smithi012.stderr: -233> 2023-10-05T11:39:55.826+0000 7fe62028b880 20 add_watcher() i=2 2023-10-05T11:39:55.897 INFO:tasks.workunit.client.0.smithi012.stderr: -232> 2023-10-05T11:39:55.826+0000 7fe62028b880 20 add_watcher() i=3 2023-10-05T11:39:55.897 INFO:tasks.workunit.client.0.smithi012.stderr: -231> 2023-10-05T11:39:55.826+0000 7fe62028b880 20 add_watcher() i=4 2023-10-05T11:39:55.897 INFO:tasks.workunit.client.0.smithi012.stderr: -230> 2023-10-05T11:39:55.826+0000 7fe62028b880 20 add_watcher() i=5 2023-10-05T11:39:55.897 INFO:tasks.workunit.client.0.smithi012.stderr: -229> 2023-10-05T11:39:55.826+0000 7fe62028b880 20 add_watcher() i=6 2023-10-05T11:39:55.897 INFO:tasks.workunit.client.0.smithi012.stderr: -228> 2023-10-05T11:39:55.827+0000 7fe62028b880 20 add_watcher() i=7 2023-10-05T11:39:55.897 INFO:tasks.workunit.client.0.smithi012.stderr: -227> 2023-10-05T11:39:55.827+0000 7fe62028b880 2 all 8 watchers are set, enabling cache 2023-10-05T11:39:55.897 INFO:tasks.workunit.client.0.smithi012.stderr: -226> 2023-10-05T11:39:55.829+0000 7fe62028b880 5 AuthRegistry(0x7fffd73802a0) adding auth protocol: cephx 2023-10-05T11:39:55.897 INFO:tasks.workunit.client.0.smithi012.stderr: -225> 2023-10-05T11:39:55.829+0000 7fe62028b880 5 AuthRegistry(0x7fffd73802a0) adding auth protocol: cephx 2023-10-05T11:39:55.898 INFO:tasks.workunit.client.0.smithi012.stderr: -224> 2023-10-05T11:39:55.829+0000 7fe62028b880 5 AuthRegistry(0x7fffd73802a0) adding auth protocol: cephx 2023-10-05T11:39:55.898 INFO:tasks.workunit.client.0.smithi012.stderr: -223> 2023-10-05T11:39:55.829+0000 7fe62028b880 5 AuthRegistry(0x7fffd73802a0) adding con mode: secure 2023-10-05T11:39:55.898 INFO:tasks.workunit.client.0.smithi012.stderr: -222> 2023-10-05T11:39:55.829+0000 7fe62028b880 5 AuthRegistry(0x7fffd73802a0) adding con mode: crc 2023-10-05T11:39:55.898 INFO:tasks.workunit.client.0.smithi012.stderr: -221> 2023-10-05T11:39:55.829+0000 7fe6059fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:39:55.898 INFO:tasks.workunit.client.0.smithi012.stderr: -220> 2023-10-05T11:39:55.829+0000 7fe62028b880 5 AuthRegistry(0x7fffd73802a0) adding con mode: secure 2023-10-05T11:39:55.898 INFO:tasks.workunit.client.0.smithi012.stderr: -219> 2023-10-05T11:39:55.829+0000 7fe62028b880 5 AuthRegistry(0x7fffd73802a0) adding con mode: crc 2023-10-05T11:39:55.898 INFO:tasks.workunit.client.0.smithi012.stderr: -218> 2023-10-05T11:39:55.829+0000 7fe62028b880 5 AuthRegistry(0x7fffd73802a0) adding con mode: secure 2023-10-05T11:39:55.898 INFO:tasks.workunit.client.0.smithi012.stderr: -217> 2023-10-05T11:39:55.829+0000 7fe62028b880 5 AuthRegistry(0x7fffd73802a0) adding con mode: crc 2023-10-05T11:39:55.898 INFO:tasks.workunit.client.0.smithi012.stderr: -216> 2023-10-05T11:39:55.829+0000 7fe62028b880 5 AuthRegistry(0x7fffd73802a0) adding con mode: crc 2023-10-05T11:39:55.898 INFO:tasks.workunit.client.0.smithi012.stderr: -215> 2023-10-05T11:39:55.829+0000 7fe62028b880 5 AuthRegistry(0x7fffd73802a0) adding con mode: secure 2023-10-05T11:39:55.898 INFO:tasks.workunit.client.0.smithi012.stderr: -214> 2023-10-05T11:39:55.829+0000 7fe62028b880 5 AuthRegistry(0x7fffd73802a0) adding con mode: crc 2023-10-05T11:39:55.898 INFO:tasks.workunit.client.0.smithi012.stderr: -213> 2023-10-05T11:39:55.829+0000 7fe62028b880 5 AuthRegistry(0x7fffd73802a0) adding con mode: secure 2023-10-05T11:39:55.899 INFO:tasks.workunit.client.0.smithi012.stderr: -212> 2023-10-05T11:39:55.829+0000 7fe62028b880 5 AuthRegistry(0x7fffd73802a0) adding con mode: crc 2023-10-05T11:39:55.899 INFO:tasks.workunit.client.0.smithi012.stderr: -211> 2023-10-05T11:39:55.829+0000 7fe62028b880 5 AuthRegistry(0x7fffd73802a0) adding con mode: secure 2023-10-05T11:39:55.899 INFO:tasks.workunit.client.0.smithi012.stderr: -210> 2023-10-05T11:39:55.829+0000 7fe62028b880 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-10-05T11:39:55.899 INFO:tasks.workunit.client.0.smithi012.stderr: -209> 2023-10-05T11:39:55.829+0000 7fe62028b880 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T11:39:55.899 INFO:tasks.workunit.client.0.smithi012.stderr: -208> 2023-10-05T11:39:55.829+0000 7fe62028b880 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T11:39:55.899 INFO:tasks.workunit.client.0.smithi012.stderr: -207> 2023-10-05T11:39:55.829+0000 7fe62028b880 5 asok(0x55dfb6b00000) register_command cache list hook 0x55dfb68c1470 2023-10-05T11:39:55.899 INFO:tasks.workunit.client.0.smithi012.stderr: -206> 2023-10-05T11:39:55.829+0000 7fe62028b880 5 asok(0x55dfb6b00000) register_command cache inspect hook 0x55dfb68c1470 2023-10-05T11:39:55.899 INFO:tasks.workunit.client.0.smithi012.stderr: -205> 2023-10-05T11:39:55.829+0000 7fe62028b880 5 asok(0x55dfb6b00000) register_command cache erase hook 0x55dfb68c1470 2023-10-05T11:39:55.899 INFO:tasks.workunit.client.0.smithi012.stderr: -204> 2023-10-05T11:39:55.829+0000 7fe62028b880 5 asok(0x55dfb6b00000) register_command cache zap hook 0x55dfb68c1470 2023-10-05T11:39:55.899 INFO:tasks.workunit.client.0.smithi012.stderr: -203> 2023-10-05T11:39:55.829+0000 7fe62028b880 10 monclient: get_monmap_and_config 2023-10-05T11:39:55.899 INFO:tasks.workunit.client.0.smithi012.stderr: -202> 2023-10-05T11:39:55.829+0000 7fe62028b880 10 monclient: build_initial_monmap 2023-10-05T11:39:55.899 INFO:tasks.workunit.client.0.smithi012.stderr: -201> 2023-10-05T11:39:55.829+0000 7fe62028b880 1 build_initial for_mkfs: 0 2023-10-05T11:39:55.900 INFO:tasks.workunit.client.0.smithi012.stderr: -200> 2023-10-05T11:39:55.829+0000 7fe62028b880 10 monclient: monmap: 2023-10-05T11:39:55.900 INFO:tasks.workunit.client.0.smithi012.stderr:epoch 0 2023-10-05T11:39:55.900 INFO:tasks.workunit.client.0.smithi012.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-10-05T11:39:55.900 INFO:tasks.workunit.client.0.smithi012.stderr:last_changed 0.000000 2023-10-05T11:39:55.900 INFO:tasks.workunit.client.0.smithi012.stderr:created 0.000000 2023-10-05T11:39:55.900 INFO:tasks.workunit.client.0.smithi012.stderr:min_mon_release 0 (unknown) 2023-10-05T11:39:55.900 INFO:tasks.workunit.client.0.smithi012.stderr:election_strategy: 1 2023-10-05T11:39:55.900 INFO:tasks.workunit.client.0.smithi012.stderr:0: [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon.noname-a 2023-10-05T11:39:55.900 INFO:tasks.workunit.client.0.smithi012.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.noname-b 2023-10-05T11:39:55.900 INFO:tasks.workunit.client.0.smithi012.stderr:2: [v2:172.21.15.12:3301/0,v1:172.21.15.12:6790/0] mon.noname-c 2023-10-05T11:39:55.900 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:39:55.900 INFO:tasks.workunit.client.0.smithi012.stderr: -199> 2023-10-05T11:39:55.829+0000 7fe62028b880 5 AuthRegistry(0x55dfb6d1e140) adding auth protocol: cephx 2023-10-05T11:39:55.900 INFO:tasks.workunit.client.0.smithi012.stderr: -198> 2023-10-05T11:39:55.829+0000 7fe62028b880 5 AuthRegistry(0x55dfb6d1e140) adding auth protocol: cephx 2023-10-05T11:39:55.901 INFO:tasks.workunit.client.0.smithi012.stderr: -197> 2023-10-05T11:39:55.829+0000 7fe62028b880 5 AuthRegistry(0x55dfb6d1e140) adding auth protocol: cephx 2023-10-05T11:39:55.901 INFO:tasks.workunit.client.0.smithi012.stderr: -196> 2023-10-05T11:39:55.829+0000 7fe62028b880 5 AuthRegistry(0x55dfb6d1e140) adding con mode: secure 2023-10-05T11:39:55.901 INFO:tasks.workunit.client.0.smithi012.stderr: -195> 2023-10-05T11:39:55.829+0000 7fe62028b880 5 AuthRegistry(0x55dfb6d1e140) adding con mode: crc 2023-10-05T11:39:55.901 INFO:tasks.workunit.client.0.smithi012.stderr: -194> 2023-10-05T11:39:55.829+0000 7fe62028b880 5 AuthRegistry(0x55dfb6d1e140) adding con mode: secure 2023-10-05T11:39:55.901 INFO:tasks.workunit.client.0.smithi012.stderr: -193> 2023-10-05T11:39:55.829+0000 7fe62028b880 5 AuthRegistry(0x55dfb6d1e140) adding con mode: crc 2023-10-05T11:39:55.901 INFO:tasks.workunit.client.0.smithi012.stderr: -192> 2023-10-05T11:39:55.829+0000 7fe62028b880 5 AuthRegistry(0x55dfb6d1e140) adding con mode: secure 2023-10-05T11:39:55.901 INFO:tasks.workunit.client.0.smithi012.stderr: -191> 2023-10-05T11:39:55.829+0000 7fe62028b880 5 AuthRegistry(0x55dfb6d1e140) adding con mode: crc 2023-10-05T11:39:55.901 INFO:tasks.workunit.client.0.smithi012.stderr: -190> 2023-10-05T11:39:55.829+0000 7fe62028b880 5 AuthRegistry(0x55dfb6d1e140) adding con mode: crc 2023-10-05T11:39:55.901 INFO:tasks.workunit.client.0.smithi012.stderr: -189> 2023-10-05T11:39:55.829+0000 7fe62028b880 5 AuthRegistry(0x55dfb6d1e140) adding con mode: secure 2023-10-05T11:39:55.901 INFO:tasks.workunit.client.0.smithi012.stderr: -188> 2023-10-05T11:39:55.829+0000 7fe62028b880 5 AuthRegistry(0x55dfb6d1e140) adding con mode: crc 2023-10-05T11:39:55.901 INFO:tasks.workunit.client.0.smithi012.stderr: -187> 2023-10-05T11:39:55.829+0000 7fe62028b880 5 AuthRegistry(0x55dfb6d1e140) adding con mode: secure 2023-10-05T11:39:55.901 INFO:tasks.workunit.client.0.smithi012.stderr: -186> 2023-10-05T11:39:55.829+0000 7fe62028b880 5 AuthRegistry(0x55dfb6d1e140) adding con mode: crc 2023-10-05T11:39:55.902 INFO:tasks.workunit.client.0.smithi012.stderr: -185> 2023-10-05T11:39:55.829+0000 7fe62028b880 5 AuthRegistry(0x55dfb6d1e140) adding con mode: secure 2023-10-05T11:39:55.902 INFO:tasks.workunit.client.0.smithi012.stderr: -184> 2023-10-05T11:39:55.830+0000 7fe62028b880 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-10-05T11:39:55.902 INFO:tasks.workunit.client.0.smithi012.stderr: -183> 2023-10-05T11:39:55.830+0000 7fe62028b880 10 monclient: init 2023-10-05T11:39:55.902 INFO:tasks.workunit.client.0.smithi012.stderr: -182> 2023-10-05T11:39:55.830+0000 7fe62028b880 5 AuthRegistry(0x7fffd737fdf0) adding auth protocol: cephx 2023-10-05T11:39:55.902 INFO:tasks.workunit.client.0.smithi012.stderr: -181> 2023-10-05T11:39:55.830+0000 7fe62028b880 5 AuthRegistry(0x7fffd737fdf0) adding auth protocol: cephx 2023-10-05T11:39:55.902 INFO:tasks.workunit.client.0.smithi012.stderr: -180> 2023-10-05T11:39:55.830+0000 7fe62028b880 5 AuthRegistry(0x7fffd737fdf0) adding auth protocol: cephx 2023-10-05T11:39:55.902 INFO:tasks.workunit.client.0.smithi012.stderr: -179> 2023-10-05T11:39:55.830+0000 7fe62028b880 5 AuthRegistry(0x7fffd737fdf0) adding con mode: secure 2023-10-05T11:39:55.902 INFO:tasks.workunit.client.0.smithi012.stderr: -178> 2023-10-05T11:39:55.830+0000 7fe62028b880 5 AuthRegistry(0x7fffd737fdf0) adding con mode: crc 2023-10-05T11:39:55.902 INFO:tasks.workunit.client.0.smithi012.stderr: -177> 2023-10-05T11:39:55.830+0000 7fe62028b880 5 AuthRegistry(0x7fffd737fdf0) adding con mode: secure 2023-10-05T11:39:55.902 INFO:tasks.workunit.client.0.smithi012.stderr: -176> 2023-10-05T11:39:55.830+0000 7fe62028b880 5 AuthRegistry(0x7fffd737fdf0) adding con mode: crc 2023-10-05T11:39:55.902 INFO:tasks.workunit.client.0.smithi012.stderr: -175> 2023-10-05T11:39:55.830+0000 7fe62028b880 5 AuthRegistry(0x7fffd737fdf0) adding con mode: secure 2023-10-05T11:39:55.902 INFO:tasks.workunit.client.0.smithi012.stderr: -174> 2023-10-05T11:39:55.830+0000 7fe62028b880 5 AuthRegistry(0x7fffd737fdf0) adding con mode: crc 2023-10-05T11:39:55.903 INFO:tasks.workunit.client.0.smithi012.stderr: -173> 2023-10-05T11:39:55.830+0000 7fe62028b880 5 AuthRegistry(0x7fffd737fdf0) adding con mode: crc 2023-10-05T11:39:55.903 INFO:tasks.workunit.client.0.smithi012.stderr: -172> 2023-10-05T11:39:55.830+0000 7fe62028b880 5 AuthRegistry(0x7fffd737fdf0) adding con mode: secure 2023-10-05T11:39:55.903 INFO:tasks.workunit.client.0.smithi012.stderr: -171> 2023-10-05T11:39:55.830+0000 7fe62028b880 5 AuthRegistry(0x7fffd737fdf0) adding con mode: crc 2023-10-05T11:39:55.903 INFO:tasks.workunit.client.0.smithi012.stderr: -170> 2023-10-05T11:39:55.830+0000 7fe62028b880 5 AuthRegistry(0x7fffd737fdf0) adding con mode: secure 2023-10-05T11:39:55.903 INFO:tasks.workunit.client.0.smithi012.stderr: -169> 2023-10-05T11:39:55.830+0000 7fe62028b880 5 AuthRegistry(0x7fffd737fdf0) adding con mode: crc 2023-10-05T11:39:55.903 INFO:tasks.workunit.client.0.smithi012.stderr: -168> 2023-10-05T11:39:55.830+0000 7fe62028b880 5 AuthRegistry(0x7fffd737fdf0) adding con mode: secure 2023-10-05T11:39:55.903 INFO:tasks.workunit.client.0.smithi012.stderr: -167> 2023-10-05T11:39:55.830+0000 7fe62028b880 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-10-05T11:39:55.903 INFO:tasks.workunit.client.0.smithi012.stderr: -166> 2023-10-05T11:39:55.830+0000 7fe62028b880 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-10-05T11:39:55.903 INFO:tasks.workunit.client.0.smithi012.stderr: -165> 2023-10-05T11:39:55.830+0000 7fe62028b880 5 asok(0x55dfb6b00000) register_command rotate-key cmddesc rotate-key hook 0x7fffd737ff38 EEXIST 2023-10-05T11:39:55.903 INFO:tasks.workunit.client.0.smithi012.stderr: -164> 2023-10-05T11:39:55.830+0000 7fe62028b880 10 monclient: _reopen_session rank -1 2023-10-05T11:39:55.903 INFO:tasks.workunit.client.0.smithi012.stderr: -163> 2023-10-05T11:39:55.830+0000 7fe62028b880 10 monclient: _add_conns ranks=[1,0,2] 2023-10-05T11:39:55.903 INFO:tasks.workunit.client.0.smithi012.stderr: -162> 2023-10-05T11:39:55.830+0000 7fe62028b880 10 monclient(hunting): picked mon.noname-b con 0x55dfb6ce1800 addr [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] 2023-10-05T11:39:55.904 INFO:tasks.workunit.client.0.smithi012.stderr: -161> 2023-10-05T11:39:55.830+0000 7fe62028b880 10 monclient(hunting): picked mon.noname-a con 0x55dfb6ce1c00 addr [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] 2023-10-05T11:39:55.904 INFO:tasks.workunit.client.0.smithi012.stderr: -160> 2023-10-05T11:39:55.830+0000 7fe62028b880 10 monclient(hunting): picked mon.noname-c con 0x55dfb6d30000 addr [v2:172.21.15.12:3301/0,v1:172.21.15.12:6790/0] 2023-10-05T11:39:55.904 INFO:tasks.workunit.client.0.smithi012.stderr: -159> 2023-10-05T11:39:55.830+0000 7fe62028b880 10 monclient(hunting): start opening mon connection 2023-10-05T11:39:55.904 INFO:tasks.workunit.client.0.smithi012.stderr: -158> 2023-10-05T11:39:55.830+0000 7fe62028b880 10 monclient(hunting): start opening mon connection 2023-10-05T11:39:55.904 INFO:tasks.workunit.client.0.smithi012.stderr: -157> 2023-10-05T11:39:55.830+0000 7fe62028b880 10 monclient(hunting): start opening mon connection 2023-10-05T11:39:55.904 INFO:tasks.workunit.client.0.smithi012.stderr: -156> 2023-10-05T11:39:55.830+0000 7fe62028b880 10 monclient(hunting): _renew_subs 2023-10-05T11:39:55.904 INFO:tasks.workunit.client.0.smithi012.stderr: -155> 2023-10-05T11:39:55.830+0000 7fe62028b880 10 monclient(hunting): authenticate will time out at 1503.999097s 2023-10-05T11:39:55.904 INFO:tasks.workunit.client.0.smithi012.stderr: -154> 2023-10-05T11:39:55.830+0000 7fe61e22f640 10 monclient(hunting): get_auth_request con 0x55dfb6d30000 auth_method 0 2023-10-05T11:39:55.904 INFO:tasks.workunit.client.0.smithi012.stderr: -153> 2023-10-05T11:39:55.830+0000 7fe61e22f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-10-05T11:39:55.904 INFO:tasks.workunit.client.0.smithi012.stderr: -152> 2023-10-05T11:39:55.830+0000 7fe61e22f640 10 monclient(hunting): _init_auth method 2 2023-10-05T11:39:55.904 INFO:tasks.workunit.client.0.smithi012.stderr: -151> 2023-10-05T11:39:55.830+0000 7fe61e22f640 10 monclient(hunting): _init_auth creating new auth 2023-10-05T11:39:55.904 INFO:tasks.workunit.client.0.smithi012.stderr: -150> 2023-10-05T11:39:55.830+0000 7fe61ea30640 10 monclient(hunting): get_auth_request con 0x55dfb6ce1c00 auth_method 0 2023-10-05T11:39:55.904 INFO:tasks.workunit.client.0.smithi012.stderr: -149> 2023-10-05T11:39:55.830+0000 7fe61ea30640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-10-05T11:39:55.905 INFO:tasks.workunit.client.0.smithi012.stderr: -148> 2023-10-05T11:39:55.830+0000 7fe61ea30640 10 monclient(hunting): _init_auth method 2 2023-10-05T11:39:55.905 INFO:tasks.workunit.client.0.smithi012.stderr: -147> 2023-10-05T11:39:55.830+0000 7fe61ea30640 10 monclient(hunting): _init_auth creating new auth 2023-10-05T11:39:55.905 INFO:tasks.workunit.client.0.smithi012.stderr: -146> 2023-10-05T11:39:55.830+0000 7fe61f231640 10 monclient(hunting): get_auth_request con 0x55dfb6ce1800 auth_method 0 2023-10-05T11:39:55.905 INFO:tasks.workunit.client.0.smithi012.stderr: -145> 2023-10-05T11:39:55.830+0000 7fe61f231640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-10-05T11:39:55.905 INFO:tasks.workunit.client.0.smithi012.stderr: -144> 2023-10-05T11:39:55.830+0000 7fe61f231640 10 monclient(hunting): _init_auth method 2 2023-10-05T11:39:55.905 INFO:tasks.workunit.client.0.smithi012.stderr: -143> 2023-10-05T11:39:55.830+0000 7fe61f231640 10 monclient(hunting): _init_auth creating new auth 2023-10-05T11:39:55.905 INFO:tasks.workunit.client.0.smithi012.stderr: -142> 2023-10-05T11:39:55.830+0000 7fe61e22f640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-10-05T11:39:55.905 INFO:tasks.workunit.client.0.smithi012.stderr: -141> 2023-10-05T11:39:55.830+0000 7fe61e22f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-10-05T11:39:55.905 INFO:tasks.workunit.client.0.smithi012.stderr: -140> 2023-10-05T11:39:55.830+0000 7fe61e22f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-10-05T11:39:55.905 INFO:tasks.workunit.client.0.smithi012.stderr: -139> 2023-10-05T11:39:55.830+0000 7fe61ea30640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-10-05T11:39:55.905 INFO:tasks.workunit.client.0.smithi012.stderr: -138> 2023-10-05T11:39:55.830+0000 7fe61ea30640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-10-05T11:39:55.905 INFO:tasks.workunit.client.0.smithi012.stderr: -137> 2023-10-05T11:39:55.830+0000 7fe61ea30640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-10-05T11:39:55.906 INFO:tasks.workunit.client.0.smithi012.stderr: -136> 2023-10-05T11:39:55.830+0000 7fe61f231640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-10-05T11:39:55.906 INFO:tasks.workunit.client.0.smithi012.stderr: -135> 2023-10-05T11:39:55.830+0000 7fe61f231640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-10-05T11:39:55.906 INFO:tasks.workunit.client.0.smithi012.stderr: -134> 2023-10-05T11:39:55.830+0000 7fe61f231640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-10-05T11:39:55.906 INFO:tasks.workunit.client.0.smithi012.stderr: -133> 2023-10-05T11:39:55.831+0000 7fe61ea30640 10 monclient(hunting): handle_auth_done global_id 6591 payload 274 2023-10-05T11:39:55.906 INFO:tasks.workunit.client.0.smithi012.stderr: -132> 2023-10-05T11:39:55.831+0000 7fe61ea30640 10 monclient: _finish_hunting 0 2023-10-05T11:39:55.906 INFO:tasks.workunit.client.0.smithi012.stderr: -131> 2023-10-05T11:39:55.831+0000 7fe61ea30640 1 monclient: found mon.noname-a 2023-10-05T11:39:55.906 INFO:tasks.workunit.client.0.smithi012.stderr: -130> 2023-10-05T11:39:55.831+0000 7fe61ea30640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.12:3300/0 2023-10-05T11:39:55.906 INFO:tasks.workunit.client.0.smithi012.stderr: -129> 2023-10-05T11:39:55.831+0000 7fe6051fd640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-10-05T11:39:55.906 INFO:tasks.workunit.client.0.smithi012.stderr: -128> 2023-10-05T11:39:55.831+0000 7fe6051fd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2023-10-05T11:39:55.906 INFO:tasks.workunit.client.0.smithi012.stderr: -127> 2023-10-05T11:39:55.831+0000 7fe6051fd640 10 monclient: dump: 2023-10-05T11:39:55.906 INFO:tasks.workunit.client.0.smithi012.stderr:epoch 1 2023-10-05T11:39:55.906 INFO:tasks.workunit.client.0.smithi012.stderr:fsid 7e015f46-293b-4b09-bd32-7d32b52f6e2f 2023-10-05T11:39:55.907 INFO:tasks.workunit.client.0.smithi012.stderr:last_changed 2023-10-05T11:27:38.366888+0000 2023-10-05T11:39:55.907 INFO:tasks.workunit.client.0.smithi012.stderr:created 2023-10-05T11:27:38.366888+0000 2023-10-05T11:39:55.907 INFO:tasks.workunit.client.0.smithi012.stderr:min_mon_release 18 (reef) 2023-10-05T11:39:55.907 INFO:tasks.workunit.client.0.smithi012.stderr:election_strategy: 1 2023-10-05T11:39:55.907 INFO:tasks.workunit.client.0.smithi012.stderr:0: [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon.a 2023-10-05T11:39:55.907 INFO:tasks.workunit.client.0.smithi012.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2023-10-05T11:39:55.907 INFO:tasks.workunit.client.0.smithi012.stderr:2: [v2:172.21.15.12:3301/0,v1:172.21.15.12:6790/0] mon.c 2023-10-05T11:39:55.907 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:39:55.907 INFO:tasks.workunit.client.0.smithi012.stderr: -126> 2023-10-05T11:39:55.831+0000 7fe6051fd640 10 monclient: _finish_auth 0 2023-10-05T11:39:55.907 INFO:tasks.workunit.client.0.smithi012.stderr: -125> 2023-10-05T11:39:55.831+0000 7fe6051fd640 10 monclient: _check_auth_tickets 2023-10-05T11:39:55.907 INFO:tasks.workunit.client.0.smithi012.stderr: -124> 2023-10-05T11:39:55.831+0000 7fe6051fd640 10 monclient: handle_config config(0 keys) v1 2023-10-05T11:39:55.907 INFO:tasks.workunit.client.0.smithi012.stderr: -123> 2023-10-05T11:39:55.831+0000 7fe6051fd640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-10-05T11:39:55.907 INFO:tasks.workunit.client.0.smithi012.stderr: -122> 2023-10-05T11:39:55.831+0000 7fe6051fd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2023-10-05T11:39:55.908 INFO:tasks.workunit.client.0.smithi012.stderr: -121> 2023-10-05T11:39:55.831+0000 7fe6051fd640 10 monclient: dump: 2023-10-05T11:39:55.908 INFO:tasks.workunit.client.0.smithi012.stderr:epoch 1 2023-10-05T11:39:55.908 INFO:tasks.workunit.client.0.smithi012.stderr:fsid 7e015f46-293b-4b09-bd32-7d32b52f6e2f 2023-10-05T11:39:55.908 INFO:tasks.workunit.client.0.smithi012.stderr:last_changed 2023-10-05T11:27:38.366888+0000 2023-10-05T11:39:55.908 INFO:tasks.workunit.client.0.smithi012.stderr:created 2023-10-05T11:27:38.366888+0000 2023-10-05T11:39:55.908 INFO:tasks.workunit.client.0.smithi012.stderr:min_mon_release 18 (reef) 2023-10-05T11:39:55.908 INFO:tasks.workunit.client.0.smithi012.stderr:election_strategy: 1 2023-10-05T11:39:55.908 INFO:tasks.workunit.client.0.smithi012.stderr:0: [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon.a 2023-10-05T11:39:55.908 INFO:tasks.workunit.client.0.smithi012.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2023-10-05T11:39:55.908 INFO:tasks.workunit.client.0.smithi012.stderr:2: [v2:172.21.15.12:3301/0,v1:172.21.15.12:6790/0] mon.c 2023-10-05T11:39:55.908 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:39:55.908 INFO:tasks.workunit.client.0.smithi012.stderr: -120> 2023-10-05T11:39:55.831+0000 7fe62028b880 5 monclient: authenticate success, global_id 6591 2023-10-05T11:39:55.909 INFO:tasks.workunit.client.0.smithi012.stderr: -119> 2023-10-05T11:39:55.831+0000 7fe62028b880 10 monclient: get_monmap_and_config success 2023-10-05T11:39:55.909 INFO:tasks.workunit.client.0.smithi012.stderr: -118> 2023-10-05T11:39:55.831+0000 7fe62028b880 4 set_mon_vals no callback set 2023-10-05T11:39:55.909 INFO:tasks.workunit.client.0.smithi012.stderr: -117> 2023-10-05T11:39:55.831+0000 7fe62028b880 10 monclient: shutdown 2023-10-05T11:39:55.909 INFO:tasks.workunit.client.0.smithi012.stderr: -116> 2023-10-05T11:39:55.832+0000 7fe62028b880 10 monclient: build_initial_monmap 2023-10-05T11:39:55.909 INFO:tasks.workunit.client.0.smithi012.stderr: -115> 2023-10-05T11:39:55.832+0000 7fe62028b880 1 build_initial for_mkfs: 0 2023-10-05T11:39:55.909 INFO:tasks.workunit.client.0.smithi012.stderr: -114> 2023-10-05T11:39:55.832+0000 7fe62028b880 10 monclient: monmap: 2023-10-05T11:39:55.909 INFO:tasks.workunit.client.0.smithi012.stderr:epoch 0 2023-10-05T11:39:55.909 INFO:tasks.workunit.client.0.smithi012.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-10-05T11:39:55.909 INFO:tasks.workunit.client.0.smithi012.stderr:last_changed 0.000000 2023-10-05T11:39:55.909 INFO:tasks.workunit.client.0.smithi012.stderr:created 0.000000 2023-10-05T11:39:55.909 INFO:tasks.workunit.client.0.smithi012.stderr:min_mon_release 0 (unknown) 2023-10-05T11:39:55.909 INFO:tasks.workunit.client.0.smithi012.stderr:election_strategy: 1 2023-10-05T11:39:55.909 INFO:tasks.workunit.client.0.smithi012.stderr:0: [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon.noname-a 2023-10-05T11:39:55.910 INFO:tasks.workunit.client.0.smithi012.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.noname-b 2023-10-05T11:39:55.910 INFO:tasks.workunit.client.0.smithi012.stderr:2: [v2:172.21.15.12:3301/0,v1:172.21.15.12:6790/0] mon.noname-c 2023-10-05T11:39:55.910 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:39:55.910 INFO:tasks.workunit.client.0.smithi012.stderr: -113> 2023-10-05T11:39:55.832+0000 7fe62028b880 5 AuthRegistry(0x55dfb6d1e140) adding auth protocol: cephx 2023-10-05T11:39:55.910 INFO:tasks.workunit.client.0.smithi012.stderr: -112> 2023-10-05T11:39:55.832+0000 7fe62028b880 5 AuthRegistry(0x55dfb6d1e140) adding auth protocol: cephx 2023-10-05T11:39:55.910 INFO:tasks.workunit.client.0.smithi012.stderr: -111> 2023-10-05T11:39:55.832+0000 7fe62028b880 5 AuthRegistry(0x55dfb6d1e140) adding auth protocol: cephx 2023-10-05T11:39:55.910 INFO:tasks.workunit.client.0.smithi012.stderr: -110> 2023-10-05T11:39:55.832+0000 7fe62028b880 5 AuthRegistry(0x55dfb6d1e140) adding con mode: secure 2023-10-05T11:39:55.910 INFO:tasks.workunit.client.0.smithi012.stderr: -109> 2023-10-05T11:39:55.832+0000 7fe62028b880 5 AuthRegistry(0x55dfb6d1e140) adding con mode: crc 2023-10-05T11:39:55.910 INFO:tasks.workunit.client.0.smithi012.stderr: -108> 2023-10-05T11:39:55.832+0000 7fe62028b880 5 AuthRegistry(0x55dfb6d1e140) adding con mode: secure 2023-10-05T11:39:55.910 INFO:tasks.workunit.client.0.smithi012.stderr: -107> 2023-10-05T11:39:55.832+0000 7fe62028b880 5 AuthRegistry(0x55dfb6d1e140) adding con mode: crc 2023-10-05T11:39:55.910 INFO:tasks.workunit.client.0.smithi012.stderr: -106> 2023-10-05T11:39:55.832+0000 7fe62028b880 5 AuthRegistry(0x55dfb6d1e140) adding con mode: secure 2023-10-05T11:39:55.910 INFO:tasks.workunit.client.0.smithi012.stderr: -105> 2023-10-05T11:39:55.832+0000 7fe62028b880 5 AuthRegistry(0x55dfb6d1e140) adding con mode: crc 2023-10-05T11:39:55.911 INFO:tasks.workunit.client.0.smithi012.stderr: -104> 2023-10-05T11:39:55.832+0000 7fe62028b880 5 AuthRegistry(0x55dfb6d1e140) adding con mode: crc 2023-10-05T11:39:55.911 INFO:tasks.workunit.client.0.smithi012.stderr: -103> 2023-10-05T11:39:55.832+0000 7fe62028b880 5 AuthRegistry(0x55dfb6d1e140) adding con mode: secure 2023-10-05T11:39:55.911 INFO:tasks.workunit.client.0.smithi012.stderr: -102> 2023-10-05T11:39:55.832+0000 7fe62028b880 5 AuthRegistry(0x55dfb6d1e140) adding con mode: crc 2023-10-05T11:39:55.911 INFO:tasks.workunit.client.0.smithi012.stderr: -101> 2023-10-05T11:39:55.832+0000 7fe62028b880 5 AuthRegistry(0x55dfb6d1e140) adding con mode: secure 2023-10-05T11:39:55.911 INFO:tasks.workunit.client.0.smithi012.stderr: -100> 2023-10-05T11:39:55.832+0000 7fe62028b880 5 AuthRegistry(0x55dfb6d1e140) adding con mode: crc 2023-10-05T11:39:55.911 INFO:tasks.workunit.client.0.smithi012.stderr: -99> 2023-10-05T11:39:55.832+0000 7fe62028b880 5 AuthRegistry(0x55dfb6d1e140) adding con mode: secure 2023-10-05T11:39:55.911 INFO:tasks.workunit.client.0.smithi012.stderr: -98> 2023-10-05T11:39:55.832+0000 7fe62028b880 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-10-05T11:39:55.911 INFO:tasks.workunit.client.0.smithi012.stderr: -97> 2023-10-05T11:39:55.832+0000 7fe62028b880 1 librados: starting msgr at 2023-10-05T11:39:55.911 INFO:tasks.workunit.client.0.smithi012.stderr: -96> 2023-10-05T11:39:55.832+0000 7fe62028b880 1 librados: starting objecter 2023-10-05T11:39:55.911 INFO:tasks.workunit.client.0.smithi012.stderr: -95> 2023-10-05T11:39:55.832+0000 7fe62028b880 5 asok(0x55dfb6b00000) register_command objecter_requests cmddesc objecter_requests hook 0x55dfb68c1bc0 EEXIST 2023-10-05T11:39:55.911 INFO:tasks.workunit.client.0.smithi012.stderr: -94> 2023-10-05T11:39:55.832+0000 7fe62028b880 1 librados: setting wanted keys 2023-10-05T11:39:55.911 INFO:tasks.workunit.client.0.smithi012.stderr: -93> 2023-10-05T11:39:55.832+0000 7fe62028b880 1 librados: calling monclient init 2023-10-05T11:39:55.912 INFO:tasks.workunit.client.0.smithi012.stderr: -92> 2023-10-05T11:39:55.832+0000 7fe62028b880 10 monclient: init 2023-10-05T11:39:55.912 INFO:tasks.workunit.client.0.smithi012.stderr: -91> 2023-10-05T11:39:55.832+0000 7fe62028b880 5 AuthRegistry(0x55dfb6d020d8) adding auth protocol: cephx 2023-10-05T11:39:55.912 INFO:tasks.workunit.client.0.smithi012.stderr: -90> 2023-10-05T11:39:55.832+0000 7fe62028b880 5 AuthRegistry(0x55dfb6d020d8) adding auth protocol: cephx 2023-10-05T11:39:55.912 INFO:tasks.workunit.client.0.smithi012.stderr: -89> 2023-10-05T11:39:55.832+0000 7fe62028b880 5 AuthRegistry(0x55dfb6d020d8) adding auth protocol: cephx 2023-10-05T11:39:55.912 INFO:tasks.workunit.client.0.smithi012.stderr: -88> 2023-10-05T11:39:55.832+0000 7fe62028b880 5 AuthRegistry(0x55dfb6d020d8) adding con mode: secure 2023-10-05T11:39:55.912 INFO:tasks.workunit.client.0.smithi012.stderr: -87> 2023-10-05T11:39:55.832+0000 7fe62028b880 5 AuthRegistry(0x55dfb6d020d8) adding con mode: crc 2023-10-05T11:39:55.912 INFO:tasks.workunit.client.0.smithi012.stderr: -86> 2023-10-05T11:39:55.832+0000 7fe62028b880 5 AuthRegistry(0x55dfb6d020d8) adding con mode: secure 2023-10-05T11:39:55.912 INFO:tasks.workunit.client.0.smithi012.stderr: -85> 2023-10-05T11:39:55.832+0000 7fe62028b880 5 AuthRegistry(0x55dfb6d020d8) adding con mode: crc 2023-10-05T11:39:55.912 INFO:tasks.workunit.client.0.smithi012.stderr: -84> 2023-10-05T11:39:55.832+0000 7fe62028b880 5 AuthRegistry(0x55dfb6d020d8) adding con mode: secure 2023-10-05T11:39:55.912 INFO:tasks.workunit.client.0.smithi012.stderr: -83> 2023-10-05T11:39:55.832+0000 7fe62028b880 5 AuthRegistry(0x55dfb6d020d8) adding con mode: crc 2023-10-05T11:39:55.912 INFO:tasks.workunit.client.0.smithi012.stderr: -82> 2023-10-05T11:39:55.832+0000 7fe62028b880 5 AuthRegistry(0x55dfb6d020d8) adding con mode: crc 2023-10-05T11:39:55.912 INFO:tasks.workunit.client.0.smithi012.stderr: -81> 2023-10-05T11:39:55.832+0000 7fe62028b880 5 AuthRegistry(0x55dfb6d020d8) adding con mode: secure 2023-10-05T11:39:55.913 INFO:tasks.workunit.client.0.smithi012.stderr: -80> 2023-10-05T11:39:55.832+0000 7fe62028b880 5 AuthRegistry(0x55dfb6d020d8) adding con mode: crc 2023-10-05T11:39:55.913 INFO:tasks.workunit.client.0.smithi012.stderr: -79> 2023-10-05T11:39:55.832+0000 7fe62028b880 5 AuthRegistry(0x55dfb6d020d8) adding con mode: secure 2023-10-05T11:39:55.913 INFO:tasks.workunit.client.0.smithi012.stderr: -78> 2023-10-05T11:39:55.832+0000 7fe62028b880 5 AuthRegistry(0x55dfb6d020d8) adding con mode: crc 2023-10-05T11:39:55.913 INFO:tasks.workunit.client.0.smithi012.stderr: -77> 2023-10-05T11:39:55.832+0000 7fe62028b880 5 AuthRegistry(0x55dfb6d020d8) adding con mode: secure 2023-10-05T11:39:55.913 INFO:tasks.workunit.client.0.smithi012.stderr: -76> 2023-10-05T11:39:55.832+0000 7fe62028b880 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-10-05T11:39:55.913 INFO:tasks.workunit.client.0.smithi012.stderr: -75> 2023-10-05T11:39:55.832+0000 7fe62028b880 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-10-05T11:39:55.913 INFO:tasks.workunit.client.0.smithi012.stderr: -74> 2023-10-05T11:39:55.832+0000 7fe62028b880 5 asok(0x55dfb6b00000) register_command rotate-key cmddesc rotate-key hook 0x55dfb6d02220 EEXIST 2023-10-05T11:39:55.913 INFO:tasks.workunit.client.0.smithi012.stderr: -73> 2023-10-05T11:39:55.832+0000 7fe62028b880 10 monclient: _reopen_session rank -1 2023-10-05T11:39:55.913 INFO:tasks.workunit.client.0.smithi012.stderr: -72> 2023-10-05T11:39:55.832+0000 7fe62028b880 10 monclient: _add_conns ranks=[2,1,0] 2023-10-05T11:39:55.913 INFO:tasks.workunit.client.0.smithi012.stderr: -71> 2023-10-05T11:39:55.832+0000 7fe62028b880 10 monclient(hunting): picked mon.noname-c con 0x55dfb6ce1800 addr [v2:172.21.15.12:3301/0,v1:172.21.15.12:6790/0] 2023-10-05T11:39:55.913 INFO:tasks.workunit.client.0.smithi012.stderr: -70> 2023-10-05T11:39:55.832+0000 7fe62028b880 10 monclient(hunting): picked mon.noname-b con 0x55dfb6ce1400 addr [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] 2023-10-05T11:39:55.913 INFO:tasks.workunit.client.0.smithi012.stderr: -69> 2023-10-05T11:39:55.832+0000 7fe62028b880 10 monclient(hunting): picked mon.noname-a con 0x55dfb6d22000 addr [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] 2023-10-05T11:39:55.914 INFO:tasks.workunit.client.0.smithi012.stderr: -68> 2023-10-05T11:39:55.832+0000 7fe62028b880 10 monclient(hunting): start opening mon connection 2023-10-05T11:39:55.914 INFO:tasks.workunit.client.0.smithi012.stderr: -67> 2023-10-05T11:39:55.832+0000 7fe62028b880 10 monclient(hunting): start opening mon connection 2023-10-05T11:39:55.914 INFO:tasks.workunit.client.0.smithi012.stderr: -66> 2023-10-05T11:39:55.832+0000 7fe62028b880 10 monclient(hunting): start opening mon connection 2023-10-05T11:39:55.914 INFO:tasks.workunit.client.0.smithi012.stderr: -65> 2023-10-05T11:39:55.832+0000 7fe62028b880 10 monclient(hunting): _renew_subs 2023-10-05T11:39:55.914 INFO:tasks.workunit.client.0.smithi012.stderr: -64> 2023-10-05T11:39:55.832+0000 7fe62028b880 10 monclient(hunting): authenticate will time out at 1504.001409s 2023-10-05T11:39:55.914 INFO:tasks.workunit.client.0.smithi012.stderr: -63> 2023-10-05T11:39:55.833+0000 7fe61e22f640 10 monclient(hunting): get_auth_request con 0x55dfb6d22000 auth_method 0 2023-10-05T11:39:55.914 INFO:tasks.workunit.client.0.smithi012.stderr: -62> 2023-10-05T11:39:55.833+0000 7fe61e22f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-10-05T11:39:55.914 INFO:tasks.workunit.client.0.smithi012.stderr: -61> 2023-10-05T11:39:55.833+0000 7fe61e22f640 10 monclient(hunting): _init_auth method 2 2023-10-05T11:39:55.914 INFO:tasks.workunit.client.0.smithi012.stderr: -60> 2023-10-05T11:39:55.833+0000 7fe61e22f640 10 monclient(hunting): _init_auth creating new auth 2023-10-05T11:39:55.914 INFO:tasks.workunit.client.0.smithi012.stderr: -59> 2023-10-05T11:39:55.833+0000 7fe61f231640 10 monclient(hunting): get_auth_request con 0x55dfb6ce1800 auth_method 0 2023-10-05T11:39:55.914 INFO:tasks.workunit.client.0.smithi012.stderr: -58> 2023-10-05T11:39:55.833+0000 7fe61f231640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-10-05T11:39:55.914 INFO:tasks.workunit.client.0.smithi012.stderr: -57> 2023-10-05T11:39:55.833+0000 7fe61f231640 10 monclient(hunting): _init_auth method 2 2023-10-05T11:39:55.915 INFO:tasks.workunit.client.0.smithi012.stderr: -56> 2023-10-05T11:39:55.833+0000 7fe61f231640 10 monclient(hunting): _init_auth creating new auth 2023-10-05T11:39:55.915 INFO:tasks.workunit.client.0.smithi012.stderr: -55> 2023-10-05T11:39:55.833+0000 7fe61e22f640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-10-05T11:39:55.915 INFO:tasks.workunit.client.0.smithi012.stderr: -54> 2023-10-05T11:39:55.833+0000 7fe61e22f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-10-05T11:39:55.915 INFO:tasks.workunit.client.0.smithi012.stderr: -53> 2023-10-05T11:39:55.833+0000 7fe61e22f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-10-05T11:39:55.915 INFO:tasks.workunit.client.0.smithi012.stderr: -52> 2023-10-05T11:39:55.833+0000 7fe61f231640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-10-05T11:39:55.915 INFO:tasks.workunit.client.0.smithi012.stderr: -51> 2023-10-05T11:39:55.833+0000 7fe61f231640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-10-05T11:39:55.915 INFO:tasks.workunit.client.0.smithi012.stderr: -50> 2023-10-05T11:39:55.833+0000 7fe61f231640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-10-05T11:39:55.915 INFO:tasks.workunit.client.0.smithi012.stderr: -49> 2023-10-05T11:39:55.833+0000 7fe61e22f640 10 monclient(hunting): handle_auth_done global_id 6594 payload 824 2023-10-05T11:39:55.915 INFO:tasks.workunit.client.0.smithi012.stderr: -48> 2023-10-05T11:39:55.833+0000 7fe61e22f640 10 monclient: _finish_hunting 0 2023-10-05T11:39:55.915 INFO:tasks.workunit.client.0.smithi012.stderr: -47> 2023-10-05T11:39:55.833+0000 7fe61e22f640 1 monclient: found mon.noname-a 2023-10-05T11:39:55.915 INFO:tasks.workunit.client.0.smithi012.stderr: -46> 2023-10-05T11:39:55.833+0000 7fe61e22f640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.12:3300/0 2023-10-05T11:39:55.915 INFO:tasks.workunit.client.0.smithi012.stderr: -45> 2023-10-05T11:39:55.833+0000 7fe6039fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-10-05T11:39:55.915 INFO:tasks.workunit.client.0.smithi012.stderr: -44> 2023-10-05T11:39:55.833+0000 7fe6039fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2023-10-05T11:39:55.916 INFO:tasks.workunit.client.0.smithi012.stderr: -43> 2023-10-05T11:39:55.833+0000 7fe6039fa640 10 monclient: dump: 2023-10-05T11:39:55.916 INFO:tasks.workunit.client.0.smithi012.stderr:epoch 1 2023-10-05T11:39:55.916 INFO:tasks.workunit.client.0.smithi012.stderr:fsid 7e015f46-293b-4b09-bd32-7d32b52f6e2f 2023-10-05T11:39:55.916 INFO:tasks.workunit.client.0.smithi012.stderr:last_changed 2023-10-05T11:27:38.366888+0000 2023-10-05T11:39:55.916 INFO:tasks.workunit.client.0.smithi012.stderr:created 2023-10-05T11:27:38.366888+0000 2023-10-05T11:39:55.916 INFO:tasks.workunit.client.0.smithi012.stderr:min_mon_release 18 (reef) 2023-10-05T11:39:55.916 INFO:tasks.workunit.client.0.smithi012.stderr:election_strategy: 1 2023-10-05T11:39:55.916 INFO:tasks.workunit.client.0.smithi012.stderr:0: [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon.a 2023-10-05T11:39:55.916 INFO:tasks.workunit.client.0.smithi012.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2023-10-05T11:39:55.916 INFO:tasks.workunit.client.0.smithi012.stderr:2: [v2:172.21.15.12:3301/0,v1:172.21.15.12:6790/0] mon.c 2023-10-05T11:39:55.916 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:39:55.916 INFO:tasks.workunit.client.0.smithi012.stderr: -42> 2023-10-05T11:39:55.833+0000 7fe6039fa640 10 monclient: _finish_auth 0 2023-10-05T11:39:55.917 INFO:tasks.workunit.client.0.smithi012.stderr: -41> 2023-10-05T11:39:55.833+0000 7fe6039fa640 10 monclient: _check_auth_tickets 2023-10-05T11:39:55.917 INFO:tasks.workunit.client.0.smithi012.stderr: -40> 2023-10-05T11:39:55.833+0000 7fe6039fa640 10 monclient: handle_config config(0 keys) v1 2023-10-05T11:39:55.917 INFO:tasks.workunit.client.0.smithi012.stderr: -39> 2023-10-05T11:39:55.833+0000 7fe6039fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-10-05T11:39:55.917 INFO:tasks.workunit.client.0.smithi012.stderr: -38> 2023-10-05T11:39:55.833+0000 7fe6039fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2023-10-05T11:39:55.917 INFO:tasks.workunit.client.0.smithi012.stderr: -37> 2023-10-05T11:39:55.833+0000 7fe6051fd640 4 set_mon_vals no callback set 2023-10-05T11:39:55.917 INFO:tasks.workunit.client.0.smithi012.stderr: -36> 2023-10-05T11:39:55.833+0000 7fe6039fa640 10 monclient: dump: 2023-10-05T11:39:55.917 INFO:tasks.workunit.client.0.smithi012.stderr:epoch 1 2023-10-05T11:39:55.917 INFO:tasks.workunit.client.0.smithi012.stderr:fsid 7e015f46-293b-4b09-bd32-7d32b52f6e2f 2023-10-05T11:39:55.917 INFO:tasks.workunit.client.0.smithi012.stderr:last_changed 2023-10-05T11:27:38.366888+0000 2023-10-05T11:39:55.917 INFO:tasks.workunit.client.0.smithi012.stderr:created 2023-10-05T11:27:38.366888+0000 2023-10-05T11:39:55.917 INFO:tasks.workunit.client.0.smithi012.stderr:min_mon_release 18 (reef) 2023-10-05T11:39:55.917 INFO:tasks.workunit.client.0.smithi012.stderr:election_strategy: 1 2023-10-05T11:39:55.918 INFO:tasks.workunit.client.0.smithi012.stderr:0: [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon.a 2023-10-05T11:39:55.918 INFO:tasks.workunit.client.0.smithi012.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2023-10-05T11:39:55.918 INFO:tasks.workunit.client.0.smithi012.stderr:2: [v2:172.21.15.12:3301/0,v1:172.21.15.12:6790/0] mon.c 2023-10-05T11:39:55.918 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:39:55.918 INFO:tasks.workunit.client.0.smithi012.stderr: -35> 2023-10-05T11:39:55.833+0000 7fe62028b880 5 monclient: authenticate success, global_id 6594 2023-10-05T11:39:55.918 INFO:tasks.workunit.client.0.smithi012.stderr: -34> 2023-10-05T11:39:55.833+0000 7fe62028b880 10 monclient: _renew_subs 2023-10-05T11:39:55.918 INFO:tasks.workunit.client.0.smithi012.stderr: -33> 2023-10-05T11:39:55.833+0000 7fe62028b880 10 monclient: _send_mon_message to mon.a at v2:172.21.15.12:3300/0 2023-10-05T11:39:55.918 INFO:tasks.workunit.client.0.smithi012.stderr: -32> 2023-10-05T11:39:55.833+0000 7fe62028b880 10 monclient: _renew_subs 2023-10-05T11:39:55.918 INFO:tasks.workunit.client.0.smithi012.stderr: -31> 2023-10-05T11:39:55.833+0000 7fe62028b880 10 monclient: _send_mon_message to mon.a at v2:172.21.15.12:3300/0 2023-10-05T11:39:55.918 INFO:tasks.workunit.client.0.smithi012.stderr: -30> 2023-10-05T11:39:55.833+0000 7fe62028b880 1 librados: init done 2023-10-05T11:39:55.918 INFO:tasks.workunit.client.0.smithi012.stderr: -29> 2023-10-05T11:39:55.833+0000 7fe62028b880 5 asok(0x55dfb6b00000) register_command cr dump hook 0x55dfb76d7408 2023-10-05T11:39:55.918 INFO:tasks.workunit.client.0.smithi012.stderr: -28> 2023-10-05T11:39:55.835+0000 7fe6039fa640 4 mgrc handle_mgr_map Got map version 5 2023-10-05T11:39:55.919 INFO:tasks.workunit.client.0.smithi012.stderr: -27> 2023-10-05T11:39:55.835+0000 7fe6039fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.170:6832/180516904,v1:172.21.15.170:6833/180516904] 2023-10-05T11:39:55.919 INFO:tasks.workunit.client.0.smithi012.stderr: -26> 2023-10-05T11:39:55.835+0000 7fe6039fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.170:6832/180516904,v1:172.21.15.170:6833/180516904] 2023-10-05T11:39:55.919 INFO:tasks.workunit.client.0.smithi012.stderr: -25> 2023-10-05T11:39:55.835+0000 7fe62028b880 5 note: GC not initialized 2023-10-05T11:39:55.919 INFO:tasks.workunit.client.0.smithi012.stderr: -24> 2023-10-05T11:39:55.835+0000 7fe61f231640 10 monclient: get_auth_request con 0x55dfb6dee000 auth_method 0 2023-10-05T11:39:55.919 INFO:tasks.workunit.client.0.smithi012.stderr: -23> 2023-10-05T11:39:55.835+0000 7fe6011f5640 20 reqs_thread_entry: start 2023-10-05T11:39:55.919 INFO:tasks.workunit.client.0.smithi012.stderr: -22> 2023-10-05T11:39:55.835+0000 7fe62028b880 5 asok(0x55dfb6b00000) register_command sync trace show hook 0x55dfb684aa80 2023-10-05T11:39:55.919 INFO:tasks.workunit.client.0.smithi012.stderr: -21> 2023-10-05T11:39:55.835+0000 7fe62028b880 5 asok(0x55dfb6b00000) register_command sync trace history hook 0x55dfb684aa80 2023-10-05T11:39:55.919 INFO:tasks.workunit.client.0.smithi012.stderr: -20> 2023-10-05T11:39:55.835+0000 7fe62028b880 5 asok(0x55dfb6b00000) register_command sync trace active hook 0x55dfb684aa80 2023-10-05T11:39:55.919 INFO:tasks.workunit.client.0.smithi012.stderr: -19> 2023-10-05T11:39:55.835+0000 7fe62028b880 5 asok(0x55dfb6b00000) register_command sync trace active_short hook 0x55dfb684aa80 2023-10-05T11:39:55.919 INFO:tasks.workunit.client.0.smithi012.stderr: -18> 2023-10-05T11:39:55.835+0000 7fe62028b880 20 init_complete bucket index max shards: 11 2023-10-05T11:39:55.919 INFO:tasks.workunit.client.0.smithi012.stderr: -17> 2023-10-05T11:39:55.835+0000 7fe62028b880 20 Filter name: none 2023-10-05T11:39:55.919 INFO:tasks.workunit.client.0.smithi012.stderr: -16> 2023-10-05T11:39:55.835+0000 7fe5ff1f1640 20 reqs_thread_entry: start 2023-10-05T11:39:55.920 INFO:tasks.workunit.client.0.smithi012.stderr: -15> 2023-10-05T11:39:55.835+0000 7fe62028b880 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2023-10-05T11:39:55.920 INFO:tasks.workunit.client.0.smithi012.stderr: -14> 2023-10-05T11:39:55.835+0000 7fe62028b880 20 rados->read ofs=0 len=0 2023-10-05T11:39:55.920 INFO:tasks.workunit.client.0.smithi012.stderr: -13> 2023-10-05T11:39:55.836+0000 7fe62028b880 20 rados_obj.operate() r=0 bl.length=218 2023-10-05T11:39:55.920 INFO:tasks.workunit.client.0.smithi012.stderr: -12> 2023-10-05T11:39:55.836+0000 7fe62028b880 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2023-10-05T11:39:55.920 INFO:tasks.workunit.client.0.smithi012.stderr: -11> 2023-10-05T11:39:55.836+0000 7fe62028b880 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2023-10-05T11:39:55.920 INFO:tasks.workunit.client.0.smithi012.stderr: -10> 2023-10-05T11:39:55.836+0000 7fe62028b880 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.20 : miss 2023-10-05T11:39:55.920 INFO:tasks.workunit.client.0.smithi012.stderr: -9> 2023-10-05T11:39:55.836+0000 7fe62028b880 20 rados->read ofs=0 len=0 2023-10-05T11:39:55.920 INFO:tasks.workunit.client.0.smithi012.stderr: -8> 2023-10-05T11:39:55.836+0000 7fe62028b880 20 rados_obj.operate() r=0 bl.length=390 2023-10-05T11:39:55.920 INFO:tasks.workunit.client.0.smithi012.stderr: -7> 2023-10-05T11:39:55.836+0000 7fe62028b880 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.20 info.flags=0x17 2023-10-05T11:39:55.920 INFO:tasks.workunit.client.0.smithi012.stderr: -6> 2023-10-05T11:39:55.836+0000 7fe62028b880 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.20 to cache LRU end 2023-10-05T11:39:55.920 INFO:tasks.workunit.client.0.smithi012.stderr: -5> 2023-10-05T11:39:55.836+0000 7fe62028b880 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T11:39:55.920 INFO:tasks.workunit.client.0.smithi012.stderr: -4> 2023-10-05T11:39:55.836+0000 7fe62028b880 10 updating xattr: name=user.rgw.acl bl.length()=265 2023-10-05T11:39:55.921 INFO:tasks.workunit.client.0.smithi012.stderr: -3> 2023-10-05T11:39:55.836+0000 7fe62028b880 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.20 2023-10-05T11:39:55.921 INFO:tasks.workunit.client.0.smithi012.stderr: -2> 2023-10-05T11:39:55.837+0000 7fe61ea30640 10 monclient: get_auth_request con 0x55dfb6d22800 auth_method 0 2023-10-05T11:39:55.921 INFO:tasks.workunit.client.0.smithi012.stderr: -1> 2023-10-05T11:39:55.842+0000 7fe62028b880 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6543-g38321be8/rpm/el9/BUILD/ceph-18.0.0-6543-g38321be8/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fe62028b880 time 2023-10-05T11:39:55.842864+0000 2023-10-05T11:39:55.921 INFO:tasks.workunit.client.0.smithi012.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6543-g38321be8/rpm/el9/BUILD/ceph-18.0.0-6543-g38321be8/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2023-10-05T11:39:55.921 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:39:55.921 INFO:tasks.workunit.client.0.smithi012.stderr: ceph version 18.0.0-6543-g38321be8 (38321be854743c0d616618a9ea8aa0b1d4dbc0bf) reef (dev) 2023-10-05T11:39:55.921 INFO:tasks.workunit.client.0.smithi012.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fe624f6d15f] 2023-10-05T11:39:55.921 INFO:tasks.workunit.client.0.smithi012.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16d31d) [0x7fe624f6d31d] 2023-10-05T11:39:55.921 INFO:tasks.workunit.client.0.smithi012.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55dfb540dc31] 2023-10-05T11:39:55.921 INFO:tasks.workunit.client.0.smithi012.stderr: 4: radosgw-admin(+0x79c6d2) [0x55dfb541b6d2] 2023-10-05T11:39:55.921 INFO:tasks.workunit.client.0.smithi012.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x24b) [0x55dfb54246db] 2023-10-05T11:39:55.921 INFO:tasks.workunit.client.0.smithi012.stderr: 6: main() 2023-10-05T11:39:55.922 INFO:tasks.workunit.client.0.smithi012.stderr: 7: /lib64/libc.so.6(+0x3feb0) [0x7fe62243feb0] 2023-10-05T11:39:55.922 INFO:tasks.workunit.client.0.smithi012.stderr: 8: __libc_start_main() 2023-10-05T11:39:55.922 INFO:tasks.workunit.client.0.smithi012.stderr: 9: _start() 2023-10-05T11:39:55.922 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:39:55.922 INFO:tasks.workunit.client.0.smithi012.stderr: 0> 2023-10-05T11:39:55.843+0000 7fe62028b880 -1 *** Caught signal (Aborted) ** 2023-10-05T11:39:55.922 INFO:tasks.workunit.client.0.smithi012.stderr: in thread 7fe62028b880 thread_name:radosgw-admin 2023-10-05T11:39:55.922 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:39:55.922 INFO:tasks.workunit.client.0.smithi012.stderr: ceph version 18.0.0-6543-g38321be8 (38321be854743c0d616618a9ea8aa0b1d4dbc0bf) reef (dev) 2023-10-05T11:39:55.922 INFO:tasks.workunit.client.0.smithi012.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7fe622454db0] 2023-10-05T11:39:55.922 INFO:tasks.workunit.client.0.smithi012.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7fe6224a154c] 2023-10-05T11:39:55.922 INFO:tasks.workunit.client.0.smithi012.stderr: 3: raise() 2023-10-05T11:39:55.922 INFO:tasks.workunit.client.0.smithi012.stderr: 4: abort() 2023-10-05T11:39:55.923 INFO:tasks.workunit.client.0.smithi012.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fe624f6d1b9] 2023-10-05T11:39:55.923 INFO:tasks.workunit.client.0.smithi012.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16d31d) [0x7fe624f6d31d] 2023-10-05T11:39:55.923 INFO:tasks.workunit.client.0.smithi012.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55dfb540dc31] 2023-10-05T11:39:55.923 INFO:tasks.workunit.client.0.smithi012.stderr: 8: radosgw-admin(+0x79c6d2) [0x55dfb541b6d2] 2023-10-05T11:39:55.923 INFO:tasks.workunit.client.0.smithi012.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x24b) [0x55dfb54246db] 2023-10-05T11:39:55.923 INFO:tasks.workunit.client.0.smithi012.stderr: 10: main() 2023-10-05T11:39:55.923 INFO:tasks.workunit.client.0.smithi012.stderr: 11: /lib64/libc.so.6(+0x3feb0) [0x7fe62243feb0] 2023-10-05T11:39:55.923 INFO:tasks.workunit.client.0.smithi012.stderr: 12: __libc_start_main() 2023-10-05T11:39:55.923 INFO:tasks.workunit.client.0.smithi012.stderr: 13: _start() 2023-10-05T11:39:55.923 INFO:tasks.workunit.client.0.smithi012.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-10-05T11:39:55.923 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:39:55.923 INFO:tasks.workunit.client.0.smithi012.stderr:--- logging levels --- 2023-10-05T11:39:55.923 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 none 2023-10-05T11:39:55.924 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 1 lockdep 2023-10-05T11:39:55.924 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 1 context 2023-10-05T11:39:55.924 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 1 crush 2023-10-05T11:39:55.924 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 mds 2023-10-05T11:39:55.924 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 mds_balancer 2023-10-05T11:39:55.924 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 mds_locker 2023-10-05T11:39:55.924 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 mds_log 2023-10-05T11:39:55.924 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 mds_log_expire 2023-10-05T11:39:55.924 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 mds_migrator 2023-10-05T11:39:55.924 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 1 buffer 2023-10-05T11:39:55.924 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 1 timer 2023-10-05T11:39:55.924 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 1 filer 2023-10-05T11:39:55.925 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 1 striper 2023-10-05T11:39:55.925 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 1 objecter 2023-10-05T11:39:55.925 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 rados 2023-10-05T11:39:55.925 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 rbd 2023-10-05T11:39:55.925 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 rbd_mirror 2023-10-05T11:39:55.925 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 rbd_replay 2023-10-05T11:39:55.925 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 rbd_pwl 2023-10-05T11:39:55.925 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 journaler 2023-10-05T11:39:55.925 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 objectcacher 2023-10-05T11:39:55.925 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 immutable_obj_cache 2023-10-05T11:39:55.925 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 client 2023-10-05T11:39:55.925 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 osd 2023-10-05T11:39:55.925 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 optracker 2023-10-05T11:39:55.926 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 objclass 2023-10-05T11:39:55.926 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 3 filestore 2023-10-05T11:39:55.926 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 3 journal 2023-10-05T11:39:55.926 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 0 ms 2023-10-05T11:39:55.926 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 mon 2023-10-05T11:39:55.926 INFO:tasks.workunit.client.0.smithi012.stderr: 0/10 monc 2023-10-05T11:39:55.926 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 paxos 2023-10-05T11:39:55.926 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 tp 2023-10-05T11:39:55.926 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 auth 2023-10-05T11:39:55.926 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 crypto 2023-10-05T11:39:55.926 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 1 finisher 2023-10-05T11:39:55.926 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 1 reserver 2023-10-05T11:39:55.927 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 heartbeatmap 2023-10-05T11:39:55.927 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 perfcounter 2023-10-05T11:39:55.927 INFO:tasks.workunit.client.0.smithi012.stderr: 20/20 rgw 2023-10-05T11:39:55.927 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 rgw_sync 2023-10-05T11:39:55.927 INFO:tasks.workunit.client.0.smithi012.stderr: 30/30 rgw_datacache 2023-10-05T11:39:55.927 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 rgw_access 2023-10-05T11:39:55.927 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 rgw_dbstore 2023-10-05T11:39:55.927 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 rgw_flight 2023-10-05T11:39:55.927 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 javaclient 2023-10-05T11:39:55.927 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 asok 2023-10-05T11:39:55.927 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 1 throttle 2023-10-05T11:39:55.927 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 0 refs 2023-10-05T11:39:55.927 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 compressor 2023-10-05T11:39:55.928 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 bluestore 2023-10-05T11:39:55.928 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 bluefs 2023-10-05T11:39:55.928 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 3 bdev 2023-10-05T11:39:55.928 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 kstore 2023-10-05T11:39:55.928 INFO:tasks.workunit.client.0.smithi012.stderr: 4/ 5 rocksdb 2023-10-05T11:39:55.928 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 fuse 2023-10-05T11:39:55.928 INFO:tasks.workunit.client.0.smithi012.stderr: 2/ 5 mgr 2023-10-05T11:39:55.928 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 mgrc 2023-10-05T11:39:55.928 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 dpdk 2023-10-05T11:39:55.928 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 eventtrace 2023-10-05T11:39:55.928 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 prioritycache 2023-10-05T11:39:55.928 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 test 2023-10-05T11:39:55.928 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 cephfs_mirror 2023-10-05T11:39:55.929 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 cephsqlite 2023-10-05T11:39:55.929 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 seastore 2023-10-05T11:39:55.929 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 seastore_onode 2023-10-05T11:39:55.929 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 seastore_odata 2023-10-05T11:39:55.929 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 seastore_omap 2023-10-05T11:39:55.929 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 seastore_tm 2023-10-05T11:39:55.929 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 seastore_t 2023-10-05T11:39:55.929 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 seastore_cleaner 2023-10-05T11:39:55.929 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 seastore_epm 2023-10-05T11:39:55.929 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 seastore_lba 2023-10-05T11:39:55.929 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 seastore_fixedkv_tree 2023-10-05T11:39:55.929 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 seastore_cache 2023-10-05T11:39:55.930 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 seastore_journal 2023-10-05T11:39:55.930 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 seastore_device 2023-10-05T11:39:55.930 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 seastore_backref 2023-10-05T11:39:55.930 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 alienstore 2023-10-05T11:39:55.930 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 mclock 2023-10-05T11:39:55.930 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 cyanstore 2023-10-05T11:39:55.930 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 ceph_exporter 2023-10-05T11:39:55.930 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 memstore 2023-10-05T11:39:55.930 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 trace 2023-10-05T11:39:55.930 INFO:tasks.workunit.client.0.smithi012.stderr: -2/-2 (syslog threshold) 2023-10-05T11:39:55.930 INFO:tasks.workunit.client.0.smithi012.stderr: 99/99 (stderr threshold) 2023-10-05T11:39:55.930 INFO:tasks.workunit.client.0.smithi012.stderr:--- pthread ID / name mapping for recent threads --- 2023-10-05T11:39:55.931 INFO:tasks.workunit.client.0.smithi012.stderr: 7fe5ff1f1640 / http_manager 2023-10-05T11:39:55.931 INFO:tasks.workunit.client.0.smithi012.stderr: 7fe6011f5640 / http_manager 2023-10-05T11:39:55.931 INFO:tasks.workunit.client.0.smithi012.stderr: 7fe6039fa640 / ms_dispatch 2023-10-05T11:39:55.931 INFO:tasks.workunit.client.0.smithi012.stderr: 7fe6051fd640 / io_context_pool 2023-10-05T11:39:55.931 INFO:tasks.workunit.client.0.smithi012.stderr: 7fe6059fe640 / rgw_dt_lg_renew 2023-10-05T11:39:55.931 INFO:tasks.workunit.client.0.smithi012.stderr: 7fe617a22640 / ms_dispatch 2023-10-05T11:39:55.931 INFO:tasks.workunit.client.0.smithi012.stderr: 7fe619225640 / io_context_pool 2023-10-05T11:39:55.931 INFO:tasks.workunit.client.0.smithi012.stderr: 7fe61ba2a640 / ms_dispatch 2023-10-05T11:39:55.931 INFO:tasks.workunit.client.0.smithi012.stderr: 7fe61d22d640 / io_context_pool 2023-10-05T11:39:55.931 INFO:tasks.workunit.client.0.smithi012.stderr: 7fe61e22f640 / msgr-worker-2 2023-10-05T11:39:55.931 INFO:tasks.workunit.client.0.smithi012.stderr: 7fe61ea30640 / msgr-worker-1 2023-10-05T11:39:55.931 INFO:tasks.workunit.client.0.smithi012.stderr: 7fe61f231640 / msgr-worker-0 2023-10-05T11:39:55.931 INFO:tasks.workunit.client.0.smithi012.stderr: 7fe62028b880 / radosgw-admin 2023-10-05T11:39:55.932 INFO:tasks.workunit.client.0.smithi012.stderr: max_recent 500 2023-10-05T11:39:55.932 INFO:tasks.workunit.client.0.smithi012.stderr: max_new 1000 2023-10-05T11:39:55.932 INFO:tasks.workunit.client.0.smithi012.stderr: log_file /var/log/ceph/ceph-client.admin.101591.log 2023-10-05T11:39:55.932 INFO:tasks.workunit.client.0.smithi012.stderr:--- end dump of recent events --- 2023-10-05T11:39:55.932 INFO:tasks.workunit.client.0.smithi012.stderr:--- begin dump of recent events --- 2023-10-05T11:39:55.932 INFO:tasks.workunit.client.0.smithi012.stderr: -499> 2023-10-05T11:39:55.795+0000 7fe61f231640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-10-05T11:39:55.932 INFO:tasks.workunit.client.0.smithi012.stderr: -498> 2023-10-05T11:39:55.796+0000 7fe61e22f640 10 monclient(hunting): get_auth_request con 0x55dfb6827400 auth_method 0 2023-10-05T11:39:55.932 INFO:tasks.workunit.client.0.smithi012.stderr: -497> 2023-10-05T11:39:55.796+0000 7fe61e22f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-10-05T11:39:55.932 INFO:tasks.workunit.client.0.smithi012.stderr: -496> 2023-10-05T11:39:55.796+0000 7fe61e22f640 10 monclient(hunting): _init_auth method 2 2023-10-05T11:39:55.932 INFO:tasks.workunit.client.0.smithi012.stderr: -495> 2023-10-05T11:39:55.796+0000 7fe61e22f640 10 monclient(hunting): _init_auth creating new auth 2023-10-05T11:39:55.932 INFO:tasks.workunit.client.0.smithi012.stderr: -494> 2023-10-05T11:39:55.796+0000 7fe61ea30640 10 monclient(hunting): handle_auth_done global_id 6582 payload 824 2023-10-05T11:39:55.932 INFO:tasks.workunit.client.0.smithi012.stderr: -493> 2023-10-05T11:39:55.796+0000 7fe61ea30640 10 monclient: _finish_hunting 0 2023-10-05T11:39:55.933 INFO:tasks.workunit.client.0.smithi012.stderr: -492> 2023-10-05T11:39:55.796+0000 7fe61ea30640 1 monclient: found mon.noname-a 2023-10-05T11:39:55.933 INFO:tasks.workunit.client.0.smithi012.stderr: -491> 2023-10-05T11:39:55.796+0000 7fe61ea30640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.12:3300/0 2023-10-05T11:39:55.933 INFO:tasks.workunit.client.0.smithi012.stderr: -490> 2023-10-05T11:39:55.796+0000 7fe61ba2a640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-10-05T11:39:55.933 INFO:tasks.workunit.client.0.smithi012.stderr: -489> 2023-10-05T11:39:55.796+0000 7fe61ba2a640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2023-10-05T11:39:55.933 INFO:tasks.workunit.client.0.smithi012.stderr: -488> 2023-10-05T11:39:55.796+0000 7fe61ba2a640 10 monclient: dump: 2023-10-05T11:39:55.933 INFO:tasks.workunit.client.0.smithi012.stderr:epoch 1 2023-10-05T11:39:55.933 INFO:tasks.workunit.client.0.smithi012.stderr:fsid 7e015f46-293b-4b09-bd32-7d32b52f6e2f 2023-10-05T11:39:55.933 INFO:tasks.workunit.client.0.smithi012.stderr:last_changed 2023-10-05T11:27:38.366888+0000 2023-10-05T11:39:55.933 INFO:tasks.workunit.client.0.smithi012.stderr:created 2023-10-05T11:27:38.366888+0000 2023-10-05T11:39:55.933 INFO:tasks.workunit.client.0.smithi012.stderr:min_mon_release 18 (reef) 2023-10-05T11:39:55.933 INFO:tasks.workunit.client.0.smithi012.stderr:election_strategy: 1 2023-10-05T11:39:55.933 INFO:tasks.workunit.client.0.smithi012.stderr:0: [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon.a 2023-10-05T11:39:55.934 INFO:tasks.workunit.client.0.smithi012.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2023-10-05T11:39:55.934 INFO:tasks.workunit.client.0.smithi012.stderr:2: [v2:172.21.15.12:3301/0,v1:172.21.15.12:6790/0] mon.c 2023-10-05T11:39:55.934 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:39:55.934 INFO:tasks.workunit.client.0.smithi012.stderr: -487> 2023-10-05T11:39:55.796+0000 7fe61ba2a640 10 monclient: _finish_auth 0 2023-10-05T11:39:55.934 INFO:tasks.workunit.client.0.smithi012.stderr: -486> 2023-10-05T11:39:55.796+0000 7fe61ba2a640 10 monclient: _check_auth_tickets 2023-10-05T11:39:55.934 INFO:tasks.workunit.client.0.smithi012.stderr: -485> 2023-10-05T11:39:55.796+0000 7fe61ba2a640 10 monclient: handle_config config(0 keys) v1 2023-10-05T11:39:55.934 INFO:tasks.workunit.client.0.smithi012.stderr: -484> 2023-10-05T11:39:55.796+0000 7fe61ba2a640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-10-05T11:39:55.934 INFO:tasks.workunit.client.0.smithi012.stderr: -483> 2023-10-05T11:39:55.796+0000 7fe61ba2a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2023-10-05T11:39:55.934 INFO:tasks.workunit.client.0.smithi012.stderr: -482> 2023-10-05T11:39:55.796+0000 7fe61ba2a640 10 monclient: dump: 2023-10-05T11:39:55.934 INFO:tasks.workunit.client.0.smithi012.stderr:epoch 1 2023-10-05T11:39:55.934 INFO:tasks.workunit.client.0.smithi012.stderr:fsid 7e015f46-293b-4b09-bd32-7d32b52f6e2f 2023-10-05T11:39:55.934 INFO:tasks.workunit.client.0.smithi012.stderr:last_changed 2023-10-05T11:27:38.366888+0000 2023-10-05T11:39:55.935 INFO:tasks.workunit.client.0.smithi012.stderr:created 2023-10-05T11:27:38.366888+0000 2023-10-05T11:39:55.935 INFO:tasks.workunit.client.0.smithi012.stderr:min_mon_release 18 (reef) 2023-10-05T11:39:55.935 INFO:tasks.workunit.client.0.smithi012.stderr:election_strategy: 1 2023-10-05T11:39:55.935 INFO:tasks.workunit.client.0.smithi012.stderr:0: [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon.a 2023-10-05T11:39:55.935 INFO:tasks.workunit.client.0.smithi012.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2023-10-05T11:39:55.935 INFO:tasks.workunit.client.0.smithi012.stderr:2: [v2:172.21.15.12:3301/0,v1:172.21.15.12:6790/0] mon.c 2023-10-05T11:39:55.935 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:39:55.935 INFO:tasks.workunit.client.0.smithi012.stderr: -481> 2023-10-05T11:39:55.796+0000 7fe61d22d640 4 set_mon_vals no callback set 2023-10-05T11:39:55.935 INFO:tasks.workunit.client.0.smithi012.stderr: -480> 2023-10-05T11:39:55.796+0000 7fe62028b880 5 monclient: authenticate success, global_id 6582 2023-10-05T11:39:55.935 INFO:tasks.workunit.client.0.smithi012.stderr: -479> 2023-10-05T11:39:55.796+0000 7fe62028b880 10 monclient: _renew_subs 2023-10-05T11:39:55.935 INFO:tasks.workunit.client.0.smithi012.stderr: -478> 2023-10-05T11:39:55.796+0000 7fe62028b880 10 monclient: _send_mon_message to mon.a at v2:172.21.15.12:3300/0 2023-10-05T11:39:55.935 INFO:tasks.workunit.client.0.smithi012.stderr: -477> 2023-10-05T11:39:55.796+0000 7fe62028b880 10 monclient: _renew_subs 2023-10-05T11:39:55.936 INFO:tasks.workunit.client.0.smithi012.stderr: -476> 2023-10-05T11:39:55.796+0000 7fe62028b880 10 monclient: _send_mon_message to mon.a at v2:172.21.15.12:3300/0 2023-10-05T11:39:55.936 INFO:tasks.workunit.client.0.smithi012.stderr: -475> 2023-10-05T11:39:55.796+0000 7fe62028b880 1 librados: init done 2023-10-05T11:39:55.936 INFO:tasks.workunit.client.0.smithi012.stderr: -474> 2023-10-05T11:39:55.796+0000 7fe62028b880 10 monclient: get_monmap_and_config 2023-10-05T11:39:55.936 INFO:tasks.workunit.client.0.smithi012.stderr: -473> 2023-10-05T11:39:55.796+0000 7fe62028b880 10 monclient: build_initial_monmap 2023-10-05T11:39:55.936 INFO:tasks.workunit.client.0.smithi012.stderr: -472> 2023-10-05T11:39:55.796+0000 7fe62028b880 1 build_initial for_mkfs: 0 2023-10-05T11:39:55.936 INFO:tasks.workunit.client.0.smithi012.stderr: -471> 2023-10-05T11:39:55.796+0000 7fe62028b880 10 monclient: monmap: 2023-10-05T11:39:55.936 INFO:tasks.workunit.client.0.smithi012.stderr:epoch 0 2023-10-05T11:39:55.936 INFO:tasks.workunit.client.0.smithi012.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-10-05T11:39:55.936 INFO:tasks.workunit.client.0.smithi012.stderr:last_changed 0.000000 2023-10-05T11:39:55.936 INFO:tasks.workunit.client.0.smithi012.stderr:created 0.000000 2023-10-05T11:39:55.936 INFO:tasks.workunit.client.0.smithi012.stderr:min_mon_release 0 (unknown) 2023-10-05T11:39:55.936 INFO:tasks.workunit.client.0.smithi012.stderr:election_strategy: 1 2023-10-05T11:39:55.936 INFO:tasks.workunit.client.0.smithi012.stderr:0: [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon.noname-a 2023-10-05T11:39:55.937 INFO:tasks.workunit.client.0.smithi012.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.noname-b 2023-10-05T11:39:55.937 INFO:tasks.workunit.client.0.smithi012.stderr:2: [v2:172.21.15.12:3301/0,v1:172.21.15.12:6790/0] mon.noname-c 2023-10-05T11:39:55.937 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:39:55.937 INFO:tasks.workunit.client.0.smithi012.stderr: -470> 2023-10-05T11:39:55.796+0000 7fe62028b880 5 AuthRegistry(0x55dfb75b1340) adding auth protocol: cephx 2023-10-05T11:39:55.937 INFO:tasks.workunit.client.0.smithi012.stderr: -469> 2023-10-05T11:39:55.796+0000 7fe62028b880 5 AuthRegistry(0x55dfb75b1340) adding auth protocol: cephx 2023-10-05T11:39:55.937 INFO:tasks.workunit.client.0.smithi012.stderr: -468> 2023-10-05T11:39:55.796+0000 7fe62028b880 5 AuthRegistry(0x55dfb75b1340) adding auth protocol: cephx 2023-10-05T11:39:55.937 INFO:tasks.workunit.client.0.smithi012.stderr: -467> 2023-10-05T11:39:55.796+0000 7fe62028b880 5 AuthRegistry(0x55dfb75b1340) adding con mode: secure 2023-10-05T11:39:55.937 INFO:tasks.workunit.client.0.smithi012.stderr: -466> 2023-10-05T11:39:55.796+0000 7fe62028b880 5 AuthRegistry(0x55dfb75b1340) adding con mode: crc 2023-10-05T11:39:55.937 INFO:tasks.workunit.client.0.smithi012.stderr: -465> 2023-10-05T11:39:55.796+0000 7fe62028b880 5 AuthRegistry(0x55dfb75b1340) adding con mode: secure 2023-10-05T11:39:55.937 INFO:tasks.workunit.client.0.smithi012.stderr: -464> 2023-10-05T11:39:55.796+0000 7fe62028b880 5 AuthRegistry(0x55dfb75b1340) adding con mode: crc 2023-10-05T11:39:55.937 INFO:tasks.workunit.client.0.smithi012.stderr: -463> 2023-10-05T11:39:55.796+0000 7fe62028b880 5 AuthRegistry(0x55dfb75b1340) adding con mode: secure 2023-10-05T11:39:55.937 INFO:tasks.workunit.client.0.smithi012.stderr: -462> 2023-10-05T11:39:55.796+0000 7fe62028b880 5 AuthRegistry(0x55dfb75b1340) adding con mode: crc 2023-10-05T11:39:55.938 INFO:tasks.workunit.client.0.smithi012.stderr: -461> 2023-10-05T11:39:55.796+0000 7fe62028b880 5 AuthRegistry(0x55dfb75b1340) adding con mode: crc 2023-10-05T11:39:55.938 INFO:tasks.workunit.client.0.smithi012.stderr: -460> 2023-10-05T11:39:55.796+0000 7fe62028b880 5 AuthRegistry(0x55dfb75b1340) adding con mode: secure 2023-10-05T11:39:55.938 INFO:tasks.workunit.client.0.smithi012.stderr: -459> 2023-10-05T11:39:55.796+0000 7fe62028b880 5 AuthRegistry(0x55dfb75b1340) adding con mode: crc 2023-10-05T11:39:55.938 INFO:tasks.workunit.client.0.smithi012.stderr: -458> 2023-10-05T11:39:55.796+0000 7fe62028b880 5 AuthRegistry(0x55dfb75b1340) adding con mode: secure 2023-10-05T11:39:55.938 INFO:tasks.workunit.client.0.smithi012.stderr: -457> 2023-10-05T11:39:55.796+0000 7fe62028b880 5 AuthRegistry(0x55dfb75b1340) adding con mode: crc 2023-10-05T11:39:55.938 INFO:tasks.workunit.client.0.smithi012.stderr: -456> 2023-10-05T11:39:55.796+0000 7fe62028b880 5 AuthRegistry(0x55dfb75b1340) adding con mode: secure 2023-10-05T11:39:55.938 INFO:tasks.workunit.client.0.smithi012.stderr: -455> 2023-10-05T11:39:55.797+0000 7fe62028b880 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-10-05T11:39:55.938 INFO:tasks.workunit.client.0.smithi012.stderr: -454> 2023-10-05T11:39:55.797+0000 7fe62028b880 10 monclient: init 2023-10-05T11:39:55.938 INFO:tasks.workunit.client.0.smithi012.stderr: -453> 2023-10-05T11:39:55.797+0000 7fe62028b880 5 AuthRegistry(0x7fffd737f870) adding auth protocol: cephx 2023-10-05T11:39:55.938 INFO:tasks.workunit.client.0.smithi012.stderr: -452> 2023-10-05T11:39:55.797+0000 7fe62028b880 5 AuthRegistry(0x7fffd737f870) adding auth protocol: cephx 2023-10-05T11:39:55.938 INFO:tasks.workunit.client.0.smithi012.stderr: -451> 2023-10-05T11:39:55.797+0000 7fe62028b880 5 AuthRegistry(0x7fffd737f870) adding auth protocol: cephx 2023-10-05T11:39:55.938 INFO:tasks.workunit.client.0.smithi012.stderr: -450> 2023-10-05T11:39:55.797+0000 7fe62028b880 5 AuthRegistry(0x7fffd737f870) adding con mode: secure 2023-10-05T11:39:55.939 INFO:tasks.workunit.client.0.smithi012.stderr: -449> 2023-10-05T11:39:55.797+0000 7fe62028b880 5 AuthRegistry(0x7fffd737f870) adding con mode: crc 2023-10-05T11:39:55.939 INFO:tasks.workunit.client.0.smithi012.stderr: -448> 2023-10-05T11:39:55.797+0000 7fe62028b880 5 AuthRegistry(0x7fffd737f870) adding con mode: secure 2023-10-05T11:39:55.939 INFO:tasks.workunit.client.0.smithi012.stderr: -447> 2023-10-05T11:39:55.797+0000 7fe62028b880 5 AuthRegistry(0x7fffd737f870) adding con mode: crc 2023-10-05T11:39:55.939 INFO:tasks.workunit.client.0.smithi012.stderr: -446> 2023-10-05T11:39:55.797+0000 7fe62028b880 5 AuthRegistry(0x7fffd737f870) adding con mode: secure 2023-10-05T11:39:55.939 INFO:tasks.workunit.client.0.smithi012.stderr: -445> 2023-10-05T11:39:55.797+0000 7fe62028b880 5 AuthRegistry(0x7fffd737f870) adding con mode: crc 2023-10-05T11:39:55.939 INFO:tasks.workunit.client.0.smithi012.stderr: -444> 2023-10-05T11:39:55.797+0000 7fe62028b880 5 AuthRegistry(0x7fffd737f870) adding con mode: crc 2023-10-05T11:39:55.939 INFO:tasks.workunit.client.0.smithi012.stderr: -443> 2023-10-05T11:39:55.797+0000 7fe62028b880 5 AuthRegistry(0x7fffd737f870) adding con mode: secure 2023-10-05T11:39:55.939 INFO:tasks.workunit.client.0.smithi012.stderr: -442> 2023-10-05T11:39:55.797+0000 7fe62028b880 5 AuthRegistry(0x7fffd737f870) adding con mode: crc 2023-10-05T11:39:55.939 INFO:tasks.workunit.client.0.smithi012.stderr: -441> 2023-10-05T11:39:55.797+0000 7fe62028b880 5 AuthRegistry(0x7fffd737f870) adding con mode: secure 2023-10-05T11:39:55.939 INFO:tasks.workunit.client.0.smithi012.stderr: -440> 2023-10-05T11:39:55.797+0000 7fe62028b880 5 AuthRegistry(0x7fffd737f870) adding con mode: crc 2023-10-05T11:39:55.939 INFO:tasks.workunit.client.0.smithi012.stderr: -439> 2023-10-05T11:39:55.797+0000 7fe62028b880 5 AuthRegistry(0x7fffd737f870) adding con mode: secure 2023-10-05T11:39:55.939 INFO:tasks.workunit.client.0.smithi012.stderr: -438> 2023-10-05T11:39:55.797+0000 7fe62028b880 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-10-05T11:39:55.940 INFO:tasks.workunit.client.0.smithi012.stderr: -437> 2023-10-05T11:39:55.797+0000 7fe62028b880 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-10-05T11:39:55.940 INFO:tasks.workunit.client.0.smithi012.stderr: -436> 2023-10-05T11:39:55.797+0000 7fe62028b880 5 asok(0x55dfb6b00000) register_command rotate-key cmddesc rotate-key hook 0x7fffd737f9b8 EEXIST 2023-10-05T11:39:55.940 INFO:tasks.workunit.client.0.smithi012.stderr: -435> 2023-10-05T11:39:55.797+0000 7fe62028b880 10 monclient: _reopen_session rank -1 2023-10-05T11:39:55.940 INFO:tasks.workunit.client.0.smithi012.stderr: -434> 2023-10-05T11:39:55.797+0000 7fe62028b880 10 monclient: _add_conns ranks=[1,2,0] 2023-10-05T11:39:55.940 INFO:tasks.workunit.client.0.smithi012.stderr: -433> 2023-10-05T11:39:55.797+0000 7fe62028b880 10 monclient(hunting): picked mon.noname-b con 0x55dfb76fc400 addr [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] 2023-10-05T11:39:55.940 INFO:tasks.workunit.client.0.smithi012.stderr: -432> 2023-10-05T11:39:55.797+0000 7fe62028b880 10 monclient(hunting): picked mon.noname-c con 0x55dfb76fc800 addr [v2:172.21.15.12:3301/0,v1:172.21.15.12:6790/0] 2023-10-05T11:39:55.940 INFO:tasks.workunit.client.0.smithi012.stderr: -431> 2023-10-05T11:39:55.797+0000 7fe62028b880 10 monclient(hunting): picked mon.noname-a con 0x55dfb76fcc00 addr [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] 2023-10-05T11:39:55.940 INFO:tasks.workunit.client.0.smithi012.stderr: -430> 2023-10-05T11:39:55.797+0000 7fe62028b880 10 monclient(hunting): start opening mon connection 2023-10-05T11:39:55.940 INFO:tasks.workunit.client.0.smithi012.stderr: -429> 2023-10-05T11:39:55.797+0000 7fe62028b880 10 monclient(hunting): start opening mon connection 2023-10-05T11:39:55.940 INFO:tasks.workunit.client.0.smithi012.stderr: -428> 2023-10-05T11:39:55.797+0000 7fe62028b880 10 monclient(hunting): start opening mon connection 2023-10-05T11:39:55.940 INFO:tasks.workunit.client.0.smithi012.stderr: -427> 2023-10-05T11:39:55.797+0000 7fe62028b880 10 monclient(hunting): _renew_subs 2023-10-05T11:39:55.940 INFO:tasks.workunit.client.0.smithi012.stderr: -426> 2023-10-05T11:39:55.797+0000 7fe62028b880 10 monclient(hunting): authenticate will time out at 1503.966081s 2023-10-05T11:39:55.941 INFO:tasks.workunit.client.0.smithi012.stderr: -425> 2023-10-05T11:39:55.797+0000 7fe61e22f640 10 monclient(hunting): get_auth_request con 0x55dfb76fcc00 auth_method 0 2023-10-05T11:39:55.941 INFO:tasks.workunit.client.0.smithi012.stderr: -424> 2023-10-05T11:39:55.797+0000 7fe61e22f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-10-05T11:39:55.941 INFO:tasks.workunit.client.0.smithi012.stderr: -423> 2023-10-05T11:39:55.797+0000 7fe61e22f640 10 monclient(hunting): _init_auth method 2 2023-10-05T11:39:55.941 INFO:tasks.workunit.client.0.smithi012.stderr: -422> 2023-10-05T11:39:55.797+0000 7fe61e22f640 10 monclient(hunting): _init_auth creating new auth 2023-10-05T11:39:55.941 INFO:tasks.workunit.client.0.smithi012.stderr: -421> 2023-10-05T11:39:55.797+0000 7fe61f231640 10 monclient(hunting): get_auth_request con 0x55dfb76fc400 auth_method 0 2023-10-05T11:39:55.941 INFO:tasks.workunit.client.0.smithi012.stderr: -420> 2023-10-05T11:39:55.797+0000 7fe61f231640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-10-05T11:39:55.941 INFO:tasks.workunit.client.0.smithi012.stderr: -419> 2023-10-05T11:39:55.797+0000 7fe61f231640 10 monclient(hunting): _init_auth method 2 2023-10-05T11:39:55.941 INFO:tasks.workunit.client.0.smithi012.stderr: -418> 2023-10-05T11:39:55.797+0000 7fe61f231640 10 monclient(hunting): _init_auth creating new auth 2023-10-05T11:39:55.941 INFO:tasks.workunit.client.0.smithi012.stderr: -417> 2023-10-05T11:39:55.797+0000 7fe61ea30640 10 monclient(hunting): get_auth_request con 0x55dfb76fc800 auth_method 0 2023-10-05T11:39:55.941 INFO:tasks.workunit.client.0.smithi012.stderr: -416> 2023-10-05T11:39:55.797+0000 7fe61ea30640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-10-05T11:39:55.941 INFO:tasks.workunit.client.0.smithi012.stderr: -415> 2023-10-05T11:39:55.797+0000 7fe61ea30640 10 monclient(hunting): _init_auth method 2 2023-10-05T11:39:55.941 INFO:tasks.workunit.client.0.smithi012.stderr: -414> 2023-10-05T11:39:55.797+0000 7fe61ea30640 10 monclient(hunting): _init_auth creating new auth 2023-10-05T11:39:55.941 INFO:tasks.workunit.client.0.smithi012.stderr: -413> 2023-10-05T11:39:55.797+0000 7fe61e22f640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-10-05T11:39:55.942 INFO:tasks.workunit.client.0.smithi012.stderr: -412> 2023-10-05T11:39:55.797+0000 7fe61e22f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-10-05T11:39:55.942 INFO:tasks.workunit.client.0.smithi012.stderr: -411> 2023-10-05T11:39:55.797+0000 7fe61e22f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-10-05T11:39:55.942 INFO:tasks.workunit.client.0.smithi012.stderr: -410> 2023-10-05T11:39:55.797+0000 7fe61f231640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-10-05T11:39:55.942 INFO:tasks.workunit.client.0.smithi012.stderr: -409> 2023-10-05T11:39:55.797+0000 7fe61f231640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-10-05T11:39:55.942 INFO:tasks.workunit.client.0.smithi012.stderr: -408> 2023-10-05T11:39:55.797+0000 7fe61f231640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-10-05T11:39:55.942 INFO:tasks.workunit.client.0.smithi012.stderr: -407> 2023-10-05T11:39:55.797+0000 7fe61ea30640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-10-05T11:39:55.942 INFO:tasks.workunit.client.0.smithi012.stderr: -406> 2023-10-05T11:39:55.797+0000 7fe61ea30640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-10-05T11:39:55.942 INFO:tasks.workunit.client.0.smithi012.stderr: -405> 2023-10-05T11:39:55.797+0000 7fe61ea30640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-10-05T11:39:55.942 INFO:tasks.workunit.client.0.smithi012.stderr: -404> 2023-10-05T11:39:55.798+0000 7fe61ba2a640 4 mgrc handle_mgr_map Got map version 5 2023-10-05T11:39:55.942 INFO:tasks.workunit.client.0.smithi012.stderr: -403> 2023-10-05T11:39:55.798+0000 7fe61ba2a640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.170:6832/180516904,v1:172.21.15.170:6833/180516904] 2023-10-05T11:39:55.942 INFO:tasks.workunit.client.0.smithi012.stderr: -402> 2023-10-05T11:39:55.798+0000 7fe61ba2a640 4 mgrc reconnect Starting new session with [v2:172.21.15.170:6832/180516904,v1:172.21.15.170:6833/180516904] 2023-10-05T11:39:55.943 INFO:tasks.workunit.client.0.smithi012.stderr: -401> 2023-10-05T11:39:55.798+0000 7fe61e22f640 10 monclient(hunting): handle_auth_done global_id 6585 payload 274 2023-10-05T11:39:55.943 INFO:tasks.workunit.client.0.smithi012.stderr: -400> 2023-10-05T11:39:55.798+0000 7fe61e22f640 10 monclient: _finish_hunting 0 2023-10-05T11:39:55.943 INFO:tasks.workunit.client.0.smithi012.stderr: -399> 2023-10-05T11:39:55.798+0000 7fe61e22f640 1 monclient: found mon.noname-a 2023-10-05T11:39:55.943 INFO:tasks.workunit.client.0.smithi012.stderr: -398> 2023-10-05T11:39:55.798+0000 7fe61e22f640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.12:3300/0 2023-10-05T11:39:55.943 INFO:tasks.workunit.client.0.smithi012.stderr: -397> 2023-10-05T11:39:55.798+0000 7fe61f231640 10 monclient: get_auth_request con 0x55dfb76fd800 auth_method 0 2023-10-05T11:39:55.943 INFO:tasks.workunit.client.0.smithi012.stderr: -396> 2023-10-05T11:39:55.798+0000 7fe619225640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-10-05T11:39:55.943 INFO:tasks.workunit.client.0.smithi012.stderr: -395> 2023-10-05T11:39:55.798+0000 7fe619225640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2023-10-05T11:39:55.943 INFO:tasks.workunit.client.0.smithi012.stderr: -394> 2023-10-05T11:39:55.798+0000 7fe619225640 10 monclient: dump: 2023-10-05T11:39:55.943 INFO:tasks.workunit.client.0.smithi012.stderr:epoch 1 2023-10-05T11:39:55.943 INFO:tasks.workunit.client.0.smithi012.stderr:fsid 7e015f46-293b-4b09-bd32-7d32b52f6e2f 2023-10-05T11:39:55.943 INFO:tasks.workunit.client.0.smithi012.stderr:last_changed 2023-10-05T11:27:38.366888+0000 2023-10-05T11:39:55.943 INFO:tasks.workunit.client.0.smithi012.stderr:created 2023-10-05T11:27:38.366888+0000 2023-10-05T11:39:55.943 INFO:tasks.workunit.client.0.smithi012.stderr:min_mon_release 18 (reef) 2023-10-05T11:39:55.944 INFO:tasks.workunit.client.0.smithi012.stderr:election_strategy: 1 2023-10-05T11:39:55.944 INFO:tasks.workunit.client.0.smithi012.stderr:0: [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon.a 2023-10-05T11:39:55.944 INFO:tasks.workunit.client.0.smithi012.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2023-10-05T11:39:55.944 INFO:tasks.workunit.client.0.smithi012.stderr:2: [v2:172.21.15.12:3301/0,v1:172.21.15.12:6790/0] mon.c 2023-10-05T11:39:55.944 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:39:55.944 INFO:tasks.workunit.client.0.smithi012.stderr: -393> 2023-10-05T11:39:55.798+0000 7fe619225640 10 monclient: _finish_auth 0 2023-10-05T11:39:55.944 INFO:tasks.workunit.client.0.smithi012.stderr: -392> 2023-10-05T11:39:55.798+0000 7fe619225640 10 monclient: _check_auth_tickets 2023-10-05T11:39:55.944 INFO:tasks.workunit.client.0.smithi012.stderr: -391> 2023-10-05T11:39:55.798+0000 7fe619225640 10 monclient: handle_config config(0 keys) v1 2023-10-05T11:39:55.944 INFO:tasks.workunit.client.0.smithi012.stderr: -390> 2023-10-05T11:39:55.798+0000 7fe619225640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-10-05T11:39:55.944 INFO:tasks.workunit.client.0.smithi012.stderr: -389> 2023-10-05T11:39:55.798+0000 7fe619225640 10 monclient: got monmap 1 from mon.a (according to old e1) 2023-10-05T11:39:55.944 INFO:tasks.workunit.client.0.smithi012.stderr: -388> 2023-10-05T11:39:55.798+0000 7fe619225640 10 monclient: dump: 2023-10-05T11:39:55.944 INFO:tasks.workunit.client.0.smithi012.stderr:epoch 1 2023-10-05T11:39:55.945 INFO:tasks.workunit.client.0.smithi012.stderr:fsid 7e015f46-293b-4b09-bd32-7d32b52f6e2f 2023-10-05T11:39:55.945 INFO:tasks.workunit.client.0.smithi012.stderr:last_changed 2023-10-05T11:27:38.366888+0000 2023-10-05T11:39:55.945 INFO:tasks.workunit.client.0.smithi012.stderr:created 2023-10-05T11:27:38.366888+0000 2023-10-05T11:39:55.945 INFO:tasks.workunit.client.0.smithi012.stderr:min_mon_release 18 (reef) 2023-10-05T11:39:55.945 INFO:tasks.workunit.client.0.smithi012.stderr:election_strategy: 1 2023-10-05T11:39:55.945 INFO:tasks.workunit.client.0.smithi012.stderr:0: [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon.a 2023-10-05T11:39:55.945 INFO:tasks.workunit.client.0.smithi012.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2023-10-05T11:39:55.945 INFO:tasks.workunit.client.0.smithi012.stderr:2: [v2:172.21.15.12:3301/0,v1:172.21.15.12:6790/0] mon.c 2023-10-05T11:39:55.945 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:39:55.945 INFO:tasks.workunit.client.0.smithi012.stderr: -387> 2023-10-05T11:39:55.798+0000 7fe62028b880 5 monclient: authenticate success, global_id 6585 2023-10-05T11:39:55.945 INFO:tasks.workunit.client.0.smithi012.stderr: -386> 2023-10-05T11:39:55.798+0000 7fe62028b880 10 monclient: get_monmap_and_config success 2023-10-05T11:39:55.945 INFO:tasks.workunit.client.0.smithi012.stderr: -385> 2023-10-05T11:39:55.798+0000 7fe62028b880 4 set_mon_vals no callback set 2023-10-05T11:39:55.946 INFO:tasks.workunit.client.0.smithi012.stderr: -384> 2023-10-05T11:39:55.798+0000 7fe62028b880 10 monclient: shutdown 2023-10-05T11:39:55.946 INFO:tasks.workunit.client.0.smithi012.stderr: -383> 2023-10-05T11:39:55.798+0000 7fe62028b880 10 monclient: build_initial_monmap 2023-10-05T11:39:55.946 INFO:tasks.workunit.client.0.smithi012.stderr: -382> 2023-10-05T11:39:55.798+0000 7fe62028b880 1 build_initial for_mkfs: 0 2023-10-05T11:39:55.946 INFO:tasks.workunit.client.0.smithi012.stderr: -381> 2023-10-05T11:39:55.798+0000 7fe62028b880 10 monclient: monmap: 2023-10-05T11:39:55.946 INFO:tasks.workunit.client.0.smithi012.stderr:epoch 0 2023-10-05T11:39:55.946 INFO:tasks.workunit.client.0.smithi012.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-10-05T11:39:55.946 INFO:tasks.workunit.client.0.smithi012.stderr:last_changed 0.000000 2023-10-05T11:39:55.946 INFO:tasks.workunit.client.0.smithi012.stderr:created 0.000000 2023-10-05T11:39:55.946 INFO:tasks.workunit.client.0.smithi012.stderr:min_mon_release 0 (unknown) 2023-10-05T11:39:55.946 INFO:tasks.workunit.client.0.smithi012.stderr:election_strategy: 1 2023-10-05T11:39:55.946 INFO:tasks.workunit.client.0.smithi012.stderr:0: [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon.noname-a 2023-10-05T11:39:55.947 INFO:tasks.workunit.client.0.smithi012.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.noname-b 2023-10-05T11:39:55.947 INFO:tasks.workunit.client.0.smithi012.stderr:2: [v2:172.21.15.12:3301/0,v1:172.21.15.12:6790/0] mon.noname-c 2023-10-05T11:39:55.947 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:39:55.947 INFO:tasks.workunit.client.0.smithi012.stderr: -380> 2023-10-05T11:39:55.798+0000 7fe62028b880 5 AuthRegistry(0x55dfb75b1340) adding auth protocol: cephx 2023-10-05T11:39:55.947 INFO:tasks.workunit.client.0.smithi012.stderr: -379> 2023-10-05T11:39:55.798+0000 7fe62028b880 5 AuthRegistry(0x55dfb75b1340) adding auth protocol: cephx 2023-10-05T11:39:55.947 INFO:tasks.workunit.client.0.smithi012.stderr: -378> 2023-10-05T11:39:55.798+0000 7fe62028b880 5 AuthRegistry(0x55dfb75b1340) adding auth protocol: cephx 2023-10-05T11:39:55.947 INFO:tasks.workunit.client.0.smithi012.stderr: -377> 2023-10-05T11:39:55.798+0000 7fe62028b880 5 AuthRegistry(0x55dfb75b1340) adding con mode: secure 2023-10-05T11:39:55.947 INFO:tasks.workunit.client.0.smithi012.stderr: -376> 2023-10-05T11:39:55.798+0000 7fe62028b880 5 AuthRegistry(0x55dfb75b1340) adding con mode: crc 2023-10-05T11:39:55.947 INFO:tasks.workunit.client.0.smithi012.stderr: -375> 2023-10-05T11:39:55.798+0000 7fe62028b880 5 AuthRegistry(0x55dfb75b1340) adding con mode: secure 2023-10-05T11:39:55.947 INFO:tasks.workunit.client.0.smithi012.stderr: -374> 2023-10-05T11:39:55.798+0000 7fe62028b880 5 AuthRegistry(0x55dfb75b1340) adding con mode: crc 2023-10-05T11:39:55.947 INFO:tasks.workunit.client.0.smithi012.stderr: -373> 2023-10-05T11:39:55.798+0000 7fe62028b880 5 AuthRegistry(0x55dfb75b1340) adding con mode: secure 2023-10-05T11:39:55.947 INFO:tasks.workunit.client.0.smithi012.stderr: -372> 2023-10-05T11:39:55.798+0000 7fe62028b880 5 AuthRegistry(0x55dfb75b1340) adding con mode: crc 2023-10-05T11:39:55.948 INFO:tasks.workunit.client.0.smithi012.stderr: -371> 2023-10-05T11:39:55.798+0000 7fe62028b880 5 AuthRegistry(0x55dfb75b1340) adding con mode: crc 2023-10-05T11:39:55.948 INFO:tasks.workunit.client.0.smithi012.stderr: -370> 2023-10-05T11:39:55.798+0000 7fe62028b880 5 AuthRegistry(0x55dfb75b1340) adding con mode: secure 2023-10-05T11:39:55.948 INFO:tasks.workunit.client.0.smithi012.stderr: -369> 2023-10-05T11:39:55.798+0000 7fe62028b880 5 AuthRegistry(0x55dfb75b1340) adding con mode: crc 2023-10-05T11:39:55.948 INFO:tasks.workunit.client.0.smithi012.stderr: -368> 2023-10-05T11:39:55.798+0000 7fe62028b880 5 AuthRegistry(0x55dfb75b1340) adding con mode: secure 2023-10-05T11:39:55.948 INFO:tasks.workunit.client.0.smithi012.stderr: -367> 2023-10-05T11:39:55.798+0000 7fe62028b880 5 AuthRegistry(0x55dfb75b1340) adding con mode: crc 2023-10-05T11:39:55.948 INFO:tasks.workunit.client.0.smithi012.stderr: -366> 2023-10-05T11:39:55.798+0000 7fe62028b880 5 AuthRegistry(0x55dfb75b1340) adding con mode: secure 2023-10-05T11:39:55.948 INFO:tasks.workunit.client.0.smithi012.stderr: -365> 2023-10-05T11:39:55.799+0000 7fe62028b880 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-10-05T11:39:55.948 INFO:tasks.workunit.client.0.smithi012.stderr: -364> 2023-10-05T11:39:55.799+0000 7fe62028b880 1 librados: starting msgr at 2023-10-05T11:39:55.948 INFO:tasks.workunit.client.0.smithi012.stderr: -363> 2023-10-05T11:39:55.799+0000 7fe62028b880 1 librados: starting objecter 2023-10-05T11:39:55.948 INFO:tasks.workunit.client.0.smithi012.stderr: -362> 2023-10-05T11:39:55.799+0000 7fe62028b880 5 asok(0x55dfb6b00000) register_command objecter_requests cmddesc objecter_requests hook 0x55dfb68c1530 EEXIST 2023-10-05T11:39:55.948 INFO:tasks.workunit.client.0.smithi012.stderr: -361> 2023-10-05T11:39:55.799+0000 7fe62028b880 1 librados: setting wanted keys 2023-10-05T11:39:55.948 INFO:tasks.workunit.client.0.smithi012.stderr: -360> 2023-10-05T11:39:55.799+0000 7fe62028b880 1 librados: calling monclient init 2023-10-05T11:39:55.948 INFO:tasks.workunit.client.0.smithi012.stderr: -359> 2023-10-05T11:39:55.799+0000 7fe62028b880 10 monclient: init 2023-10-05T11:39:55.949 INFO:tasks.workunit.client.0.smithi012.stderr: -358> 2023-10-05T11:39:55.799+0000 7fe62028b880 5 AuthRegistry(0x55dfb695f0d8) adding auth protocol: cephx 2023-10-05T11:39:55.949 INFO:tasks.workunit.client.0.smithi012.stderr: -357> 2023-10-05T11:39:55.799+0000 7fe62028b880 5 AuthRegistry(0x55dfb695f0d8) adding auth protocol: cephx 2023-10-05T11:39:55.949 INFO:tasks.workunit.client.0.smithi012.stderr: -356> 2023-10-05T11:39:55.799+0000 7fe62028b880 5 AuthRegistry(0x55dfb695f0d8) adding auth protocol: cephx 2023-10-05T11:39:55.949 INFO:tasks.workunit.client.0.smithi012.stderr: -355> 2023-10-05T11:39:55.799+0000 7fe62028b880 5 AuthRegistry(0x55dfb695f0d8) adding con mode: secure 2023-10-05T11:39:55.949 INFO:tasks.workunit.client.0.smithi012.stderr: -354> 2023-10-05T11:39:55.799+0000 7fe62028b880 5 AuthRegistry(0x55dfb695f0d8) adding con mode: crc 2023-10-05T11:39:55.949 INFO:tasks.workunit.client.0.smithi012.stderr: -353> 2023-10-05T11:39:55.799+0000 7fe62028b880 5 AuthRegistry(0x55dfb695f0d8) adding con mode: secure 2023-10-05T11:39:55.949 INFO:tasks.workunit.client.0.smithi012.stderr: -352> 2023-10-05T11:39:55.799+0000 7fe62028b880 5 AuthRegistry(0x55dfb695f0d8) adding con mode: crc 2023-10-05T11:39:55.949 INFO:tasks.workunit.client.0.smithi012.stderr: -351> 2023-10-05T11:39:55.799+0000 7fe62028b880 5 AuthRegistry(0x55dfb695f0d8) adding con mode: secure 2023-10-05T11:39:55.949 INFO:tasks.workunit.client.0.smithi012.stderr: -350> 2023-10-05T11:39:55.799+0000 7fe62028b880 5 AuthRegistry(0x55dfb695f0d8) adding con mode: crc 2023-10-05T11:39:55.949 INFO:tasks.workunit.client.0.smithi012.stderr: -349> 2023-10-05T11:39:55.799+0000 7fe62028b880 5 AuthRegistry(0x55dfb695f0d8) adding con mode: crc 2023-10-05T11:39:55.949 INFO:tasks.workunit.client.0.smithi012.stderr: -348> 2023-10-05T11:39:55.799+0000 7fe62028b880 5 AuthRegistry(0x55dfb695f0d8) adding con mode: secure 2023-10-05T11:39:55.949 INFO:tasks.workunit.client.0.smithi012.stderr: -347> 2023-10-05T11:39:55.799+0000 7fe62028b880 5 AuthRegistry(0x55dfb695f0d8) adding con mode: crc 2023-10-05T11:39:55.950 INFO:tasks.workunit.client.0.smithi012.stderr: -346> 2023-10-05T11:39:55.799+0000 7fe62028b880 5 AuthRegistry(0x55dfb695f0d8) adding con mode: secure 2023-10-05T11:39:55.950 INFO:tasks.workunit.client.0.smithi012.stderr: -345> 2023-10-05T11:39:55.799+0000 7fe62028b880 5 AuthRegistry(0x55dfb695f0d8) adding con mode: crc 2023-10-05T11:39:55.950 INFO:tasks.workunit.client.0.smithi012.stderr: -344> 2023-10-05T11:39:55.799+0000 7fe62028b880 5 AuthRegistry(0x55dfb695f0d8) adding con mode: secure 2023-10-05T11:39:55.950 INFO:tasks.workunit.client.0.smithi012.stderr: -343> 2023-10-05T11:39:55.799+0000 7fe62028b880 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-10-05T11:39:55.950 INFO:tasks.workunit.client.0.smithi012.stderr: -342> 2023-10-05T11:39:55.799+0000 7fe62028b880 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-10-05T11:39:55.950 INFO:tasks.workunit.client.0.smithi012.stderr: -341> 2023-10-05T11:39:55.799+0000 7fe62028b880 5 asok(0x55dfb6b00000) register_command rotate-key cmddesc rotate-key hook 0x55dfb695f220 EEXIST 2023-10-05T11:39:55.950 INFO:tasks.workunit.client.0.smithi012.stderr: -340> 2023-10-05T11:39:55.799+0000 7fe62028b880 10 monclient: _reopen_session rank -1 2023-10-05T11:39:55.950 INFO:tasks.workunit.client.0.smithi012.stderr: -339> 2023-10-05T11:39:55.799+0000 7fe62028b880 10 monclient: _add_conns ranks=[1,0,2] 2023-10-05T11:39:55.950 INFO:tasks.workunit.client.0.smithi012.stderr: -338> 2023-10-05T11:39:55.799+0000 7fe62028b880 10 monclient(hunting): picked mon.noname-b con 0x55dfb76fc400 addr [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] 2023-10-05T11:39:55.950 INFO:tasks.workunit.client.0.smithi012.stderr: -337> 2023-10-05T11:39:55.799+0000 7fe62028b880 10 monclient(hunting): picked mon.noname-a con 0x55dfb76fc800 addr [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] 2023-10-05T11:39:55.950 INFO:tasks.workunit.client.0.smithi012.stderr: -336> 2023-10-05T11:39:55.799+0000 7fe62028b880 10 monclient(hunting): picked mon.noname-c con 0x55dfb76fcc00 addr [v2:172.21.15.12:3301/0,v1:172.21.15.12:6790/0] 2023-10-05T11:39:55.951 INFO:tasks.workunit.client.0.smithi012.stderr: -335> 2023-10-05T11:39:55.799+0000 7fe62028b880 10 monclient(hunting): start opening mon connection 2023-10-05T11:39:55.951 INFO:tasks.workunit.client.0.smithi012.stderr: -334> 2023-10-05T11:39:55.799+0000 7fe62028b880 10 monclient(hunting): start opening mon connection 2023-10-05T11:39:55.951 INFO:tasks.workunit.client.0.smithi012.stderr: -333> 2023-10-05T11:39:55.799+0000 7fe62028b880 10 monclient(hunting): start opening mon connection 2023-10-05T11:39:55.951 INFO:tasks.workunit.client.0.smithi012.stderr: -332> 2023-10-05T11:39:55.799+0000 7fe62028b880 10 monclient(hunting): _renew_subs 2023-10-05T11:39:55.951 INFO:tasks.workunit.client.0.smithi012.stderr: -331> 2023-10-05T11:39:55.799+0000 7fe62028b880 10 monclient(hunting): authenticate will time out at 1503.968207s 2023-10-05T11:39:55.951 INFO:tasks.workunit.client.0.smithi012.stderr: -330> 2023-10-05T11:39:55.799+0000 7fe61e22f640 10 monclient(hunting): get_auth_request con 0x55dfb76fc800 auth_method 0 2023-10-05T11:39:55.951 INFO:tasks.workunit.client.0.smithi012.stderr: -329> 2023-10-05T11:39:55.799+0000 7fe61e22f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-10-05T11:39:55.951 INFO:tasks.workunit.client.0.smithi012.stderr: -328> 2023-10-05T11:39:55.799+0000 7fe61e22f640 10 monclient(hunting): _init_auth method 2 2023-10-05T11:39:55.951 INFO:tasks.workunit.client.0.smithi012.stderr: -327> 2023-10-05T11:39:55.799+0000 7fe61e22f640 10 monclient(hunting): _init_auth creating new auth 2023-10-05T11:39:55.951 INFO:tasks.workunit.client.0.smithi012.stderr: -326> 2023-10-05T11:39:55.799+0000 7fe61f231640 10 monclient(hunting): get_auth_request con 0x55dfb76fcc00 auth_method 0 2023-10-05T11:39:55.951 INFO:tasks.workunit.client.0.smithi012.stderr: -325> 2023-10-05T11:39:55.799+0000 7fe61f231640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-10-05T11:39:55.951 INFO:tasks.workunit.client.0.smithi012.stderr: -324> 2023-10-05T11:39:55.799+0000 7fe61f231640 10 monclient(hunting): _init_auth method 2 2023-10-05T11:39:55.951 INFO:tasks.workunit.client.0.smithi012.stderr: -323> 2023-10-05T11:39:55.799+0000 7fe61f231640 10 monclient(hunting): _init_auth creating new auth 2023-10-05T11:39:55.952 INFO:tasks.workunit.client.0.smithi012.stderr: -322> 2023-10-05T11:39:55.799+0000 7fe61e22f640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-10-05T11:39:55.952 INFO:tasks.workunit.client.0.smithi012.stderr: -321> 2023-10-05T11:39:55.799+0000 7fe61e22f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-10-05T11:39:55.952 INFO:tasks.workunit.client.0.smithi012.stderr: -320> 2023-10-05T11:39:55.799+0000 7fe61e22f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-10-05T11:39:55.952 INFO:tasks.workunit.client.0.smithi012.stderr: -319> 2023-10-05T11:39:55.799+0000 7fe61f231640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-10-05T11:39:55.952 INFO:tasks.workunit.client.0.smithi012.stderr: -318> 2023-10-05T11:39:55.799+0000 7fe61f231640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-10-05T11:39:55.952 INFO:tasks.workunit.client.0.smithi012.stderr: -317> 2023-10-05T11:39:55.799+0000 7fe61f231640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-10-05T11:39:55.952 INFO:tasks.workunit.client.0.smithi012.stderr: -316> 2023-10-05T11:39:55.800+0000 7fe61ea30640 10 monclient(hunting): get_auth_request con 0x55dfb76fc400 auth_method 0 2023-10-05T11:39:55.952 INFO:tasks.workunit.client.0.smithi012.stderr: -315> 2023-10-05T11:39:55.800+0000 7fe61ea30640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-10-05T11:39:55.952 INFO:tasks.workunit.client.0.smithi012.stderr: -314> 2023-10-05T11:39:55.800+0000 7fe61ea30640 10 monclient(hunting): _init_auth method 2 2023-10-05T11:39:55.952 INFO:tasks.workunit.client.0.smithi012.stderr: -313> 2023-10-05T11:39:55.800+0000 7fe61ea30640 10 monclient(hunting): _init_auth creating new auth 2023-10-05T11:39:55.952 INFO:tasks.workunit.client.0.smithi012.stderr: -312> 2023-10-05T11:39:55.800+0000 7fe61e22f640 10 monclient(hunting): handle_auth_done global_id 6588 payload 824 2023-10-05T11:39:55.952 INFO:tasks.workunit.client.0.smithi012.stderr: -311> 2023-10-05T11:39:55.800+0000 7fe61e22f640 10 monclient: _finish_hunting 0 2023-10-05T11:39:55.953 INFO:tasks.workunit.client.0.smithi012.stderr: -310> 2023-10-05T11:39:55.800+0000 7fe61e22f640 1 monclient: found mon.noname-a 2023-10-05T11:39:55.953 INFO:tasks.workunit.client.0.smithi012.stderr: -309> 2023-10-05T11:39:55.800+0000 7fe61e22f640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.12:3300/0 2023-10-05T11:39:55.953 INFO:tasks.workunit.client.0.smithi012.stderr: -308> 2023-10-05T11:39:55.800+0000 7fe617a22640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-10-05T11:39:55.953 INFO:tasks.workunit.client.0.smithi012.stderr: -307> 2023-10-05T11:39:55.800+0000 7fe617a22640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2023-10-05T11:39:55.953 INFO:tasks.workunit.client.0.smithi012.stderr: -306> 2023-10-05T11:39:55.800+0000 7fe617a22640 10 monclient: dump: 2023-10-05T11:39:55.953 INFO:tasks.workunit.client.0.smithi012.stderr:epoch 1 2023-10-05T11:39:55.953 INFO:tasks.workunit.client.0.smithi012.stderr:fsid 7e015f46-293b-4b09-bd32-7d32b52f6e2f 2023-10-05T11:39:55.953 INFO:tasks.workunit.client.0.smithi012.stderr:last_changed 2023-10-05T11:27:38.366888+0000 2023-10-05T11:39:55.953 INFO:tasks.workunit.client.0.smithi012.stderr:created 2023-10-05T11:27:38.366888+0000 2023-10-05T11:39:55.953 INFO:tasks.workunit.client.0.smithi012.stderr:min_mon_release 18 (reef) 2023-10-05T11:39:55.953 INFO:tasks.workunit.client.0.smithi012.stderr:election_strategy: 1 2023-10-05T11:39:55.953 INFO:tasks.workunit.client.0.smithi012.stderr:0: [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon.a 2023-10-05T11:39:55.954 INFO:tasks.workunit.client.0.smithi012.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2023-10-05T11:39:55.954 INFO:tasks.workunit.client.0.smithi012.stderr:2: [v2:172.21.15.12:3301/0,v1:172.21.15.12:6790/0] mon.c 2023-10-05T11:39:55.954 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:39:55.954 INFO:tasks.workunit.client.0.smithi012.stderr: -305> 2023-10-05T11:39:55.800+0000 7fe617a22640 10 monclient: _finish_auth 0 2023-10-05T11:39:55.954 INFO:tasks.workunit.client.0.smithi012.stderr: -304> 2023-10-05T11:39:55.800+0000 7fe617a22640 10 monclient: _check_auth_tickets 2023-10-05T11:39:55.954 INFO:tasks.workunit.client.0.smithi012.stderr: -303> 2023-10-05T11:39:55.800+0000 7fe617a22640 10 monclient: handle_config config(0 keys) v1 2023-10-05T11:39:55.954 INFO:tasks.workunit.client.0.smithi012.stderr: -302> 2023-10-05T11:39:55.800+0000 7fe617a22640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-10-05T11:39:55.954 INFO:tasks.workunit.client.0.smithi012.stderr: -301> 2023-10-05T11:39:55.800+0000 7fe617a22640 10 monclient: got monmap 1 from mon.a (according to old e1) 2023-10-05T11:39:55.954 INFO:tasks.workunit.client.0.smithi012.stderr: -300> 2023-10-05T11:39:55.800+0000 7fe617a22640 10 monclient: dump: 2023-10-05T11:39:55.954 INFO:tasks.workunit.client.0.smithi012.stderr:epoch 1 2023-10-05T11:39:55.954 INFO:tasks.workunit.client.0.smithi012.stderr:fsid 7e015f46-293b-4b09-bd32-7d32b52f6e2f 2023-10-05T11:39:55.954 INFO:tasks.workunit.client.0.smithi012.stderr:last_changed 2023-10-05T11:27:38.366888+0000 2023-10-05T11:39:55.955 INFO:tasks.workunit.client.0.smithi012.stderr:created 2023-10-05T11:27:38.366888+0000 2023-10-05T11:39:55.955 INFO:tasks.workunit.client.0.smithi012.stderr:min_mon_release 18 (reef) 2023-10-05T11:39:55.955 INFO:tasks.workunit.client.0.smithi012.stderr:election_strategy: 1 2023-10-05T11:39:55.955 INFO:tasks.workunit.client.0.smithi012.stderr:0: [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon.a 2023-10-05T11:39:55.955 INFO:tasks.workunit.client.0.smithi012.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2023-10-05T11:39:55.955 INFO:tasks.workunit.client.0.smithi012.stderr:2: [v2:172.21.15.12:3301/0,v1:172.21.15.12:6790/0] mon.c 2023-10-05T11:39:55.955 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:39:55.955 INFO:tasks.workunit.client.0.smithi012.stderr: -299> 2023-10-05T11:39:55.800+0000 7fe619225640 4 set_mon_vals no callback set 2023-10-05T11:39:55.955 INFO:tasks.workunit.client.0.smithi012.stderr: -298> 2023-10-05T11:39:55.800+0000 7fe62028b880 5 monclient: authenticate success, global_id 6588 2023-10-05T11:39:55.955 INFO:tasks.workunit.client.0.smithi012.stderr: -297> 2023-10-05T11:39:55.800+0000 7fe62028b880 10 monclient: _renew_subs 2023-10-05T11:39:55.955 INFO:tasks.workunit.client.0.smithi012.stderr: -296> 2023-10-05T11:39:55.800+0000 7fe62028b880 10 monclient: _send_mon_message to mon.a at v2:172.21.15.12:3300/0 2023-10-05T11:39:55.955 INFO:tasks.workunit.client.0.smithi012.stderr: -295> 2023-10-05T11:39:55.800+0000 7fe62028b880 10 monclient: _renew_subs 2023-10-05T11:39:55.956 INFO:tasks.workunit.client.0.smithi012.stderr: -294> 2023-10-05T11:39:55.800+0000 7fe62028b880 10 monclient: _send_mon_message to mon.a at v2:172.21.15.12:3300/0 2023-10-05T11:39:55.956 INFO:tasks.workunit.client.0.smithi012.stderr: -293> 2023-10-05T11:39:55.800+0000 7fe62028b880 1 librados: init done 2023-10-05T11:39:55.956 INFO:tasks.workunit.client.0.smithi012.stderr: -292> 2023-10-05T11:39:55.801+0000 7fe62028b880 20 rados->read ofs=0 len=0 2023-10-05T11:39:55.956 INFO:tasks.workunit.client.0.smithi012.stderr: -291> 2023-10-05T11:39:55.801+0000 7fe617a22640 4 mgrc handle_mgr_map Got map version 5 2023-10-05T11:39:55.956 INFO:tasks.workunit.client.0.smithi012.stderr: -290> 2023-10-05T11:39:55.801+0000 7fe617a22640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.170:6832/180516904,v1:172.21.15.170:6833/180516904] 2023-10-05T11:39:55.956 INFO:tasks.workunit.client.0.smithi012.stderr: -289> 2023-10-05T11:39:55.801+0000 7fe617a22640 4 mgrc reconnect Starting new session with [v2:172.21.15.170:6832/180516904,v1:172.21.15.170:6833/180516904] 2023-10-05T11:39:55.956 INFO:tasks.workunit.client.0.smithi012.stderr: -288> 2023-10-05T11:39:55.802+0000 7fe61ea30640 10 monclient: get_auth_request con 0x55dfb6bd5c00 auth_method 0 2023-10-05T11:39:55.956 INFO:tasks.workunit.client.0.smithi012.stderr: -287> 2023-10-05T11:39:55.802+0000 7fe61f231640 10 monclient: get_auth_request con 0x55dfb76fd000 auth_method 0 2023-10-05T11:39:55.956 INFO:tasks.workunit.client.0.smithi012.stderr: -286> 2023-10-05T11:39:55.802+0000 7fe62028b880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:55.956 INFO:tasks.workunit.client.0.smithi012.stderr: -285> 2023-10-05T11:39:55.802+0000 7fe62028b880 20 realm 2023-10-05T11:39:55.956 INFO:tasks.workunit.client.0.smithi012.stderr: -284> 2023-10-05T11:39:55.802+0000 7fe62028b880 20 rados->read ofs=0 len=0 2023-10-05T11:39:55.956 INFO:tasks.workunit.client.0.smithi012.stderr: -283> 2023-10-05T11:39:55.803+0000 7fe62028b880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:55.957 INFO:tasks.workunit.client.0.smithi012.stderr: -282> 2023-10-05T11:39:55.803+0000 7fe62028b880 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T11:39:55.957 INFO:tasks.workunit.client.0.smithi012.stderr: -281> 2023-10-05T11:39:55.803+0000 7fe62028b880 20 rados->read ofs=0 len=0 2023-10-05T11:39:55.957 INFO:tasks.workunit.client.0.smithi012.stderr: -280> 2023-10-05T11:39:55.803+0000 7fe62028b880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:55.957 INFO:tasks.workunit.client.0.smithi012.stderr: -279> 2023-10-05T11:39:55.803+0000 7fe62028b880 20 rados->read ofs=0 len=0 2023-10-05T11:39:55.957 INFO:tasks.workunit.client.0.smithi012.stderr: -278> 2023-10-05T11:39:55.803+0000 7fe61ea30640 10 monclient: get_auth_request con 0x55dfb76fd400 auth_method 0 2023-10-05T11:39:55.957 INFO:tasks.workunit.client.0.smithi012.stderr: -277> 2023-10-05T11:39:55.804+0000 7fe62028b880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:39:55.957 INFO:tasks.workunit.client.0.smithi012.stderr: -276> 2023-10-05T11:39:55.804+0000 7fe62028b880 20 rados->read ofs=0 len=0 2023-10-05T11:39:55.957 INFO:tasks.workunit.client.0.smithi012.stderr: -275> 2023-10-05T11:39:55.804+0000 7fe61e22f640 10 monclient: get_auth_request con 0x55dfb6cb5000 auth_method 0 2023-10-05T11:39:55.957 INFO:tasks.workunit.client.0.smithi012.stderr: -274> 2023-10-05T11:39:55.805+0000 7fe62028b880 20 rados_obj.operate() r=0 bl.length=1020 2023-10-05T11:39:55.957 INFO:tasks.workunit.client.0.smithi012.stderr: -273> 2023-10-05T11:39:55.805+0000 7fe62028b880 20 searching for the correct realm 2023-10-05T11:39:55.957 INFO:tasks.workunit.client.0.smithi012.stderr: -272> 2023-10-05T11:39:55.805+0000 7fe61f231640 10 monclient: get_auth_request con 0x55dfb6cb5400 auth_method 0 2023-10-05T11:39:55.957 INFO:tasks.workunit.client.0.smithi012.stderr: -271> 2023-10-05T11:39:55.806+0000 7fe61ea30640 10 monclient: get_auth_request con 0x55dfb6bd5000 auth_method 0 2023-10-05T11:39:55.958 INFO:tasks.workunit.client.0.smithi012.stderr: -270> 2023-10-05T11:39:55.807+0000 7fe61e22f640 10 monclient: get_auth_request con 0x55dfb6cb4400 auth_method 0 2023-10-05T11:39:55.958 INFO:tasks.workunit.client.0.smithi012.stderr: -269> 2023-10-05T11:39:55.808+0000 7fe61f231640 10 monclient: get_auth_request con 0x55dfb6bd5400 auth_method 0 2023-10-05T11:39:55.958 INFO:tasks.workunit.client.0.smithi012.stderr: -268> 2023-10-05T11:39:55.810+0000 7fe61ea30640 10 monclient: get_auth_request con 0x55dfb6cd6000 auth_method 0 2023-10-05T11:39:55.958 INFO:tasks.workunit.client.0.smithi012.stderr: -267> 2023-10-05T11:39:55.814+0000 7fe61ea30640 0 -- 172.21.15.12:0/3931236051 >> [v2:172.21.15.170:6814/3150808418,v1:172.21.15.170:6816/3150808418] conn(0x55dfb76fd400 msgr2=0x55dfb6b06c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:39:55.958 INFO:tasks.workunit.client.0.smithi012.stderr: -266> 2023-10-05T11:39:55.814+0000 7fe617a22640 1 client.6588.objecter ms_handle_reset 0x55dfb76fd400 session 0x55dfb6afb980 osd.5 2023-10-05T11:39:55.958 INFO:tasks.workunit.client.0.smithi012.stderr: -265> 2023-10-05T11:39:55.814+0000 7fe617a22640 10 monclient: _renew_subs 2023-10-05T11:39:55.958 INFO:tasks.workunit.client.0.smithi012.stderr: -264> 2023-10-05T11:39:55.814+0000 7fe617a22640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.12:3300/0 2023-10-05T11:39:55.958 INFO:tasks.workunit.client.0.smithi012.stderr: -263> 2023-10-05T11:39:55.814+0000 7fe61ea30640 10 monclient: get_auth_request con 0x55dfb6cd7000 auth_method 0 2023-10-05T11:39:55.958 INFO:tasks.workunit.client.0.smithi012.stderr: -262> 2023-10-05T11:39:55.815+0000 7fe62028b880 20 RGWRados::pool_iterate: got zone_info.dff27d1e-df33-400e-a68a-7ba586947c99 2023-10-05T11:39:55.958 INFO:tasks.workunit.client.0.smithi012.stderr: -261> 2023-10-05T11:39:55.815+0000 7fe62028b880 20 RGWRados::pool_iterate: got zonegroup_info.c78aa576-9d15-4e9d-b3c0-4af23a22062c 2023-10-05T11:39:55.958 INFO:tasks.workunit.client.0.smithi012.stderr: -260> 2023-10-05T11:39:55.815+0000 7fe62028b880 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T11:39:55.958 INFO:tasks.workunit.client.0.smithi012.stderr: -259> 2023-10-05T11:39:55.815+0000 7fe62028b880 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T11:39:55.959 INFO:tasks.workunit.client.0.smithi012.stderr: -258> 2023-10-05T11:39:55.815+0000 7fe62028b880 20 rados->read ofs=0 len=0 2023-10-05T11:39:55.959 INFO:tasks.workunit.client.0.smithi012.stderr: -257> 2023-10-05T11:39:55.816+0000 7fe62028b880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:55.959 INFO:tasks.workunit.client.0.smithi012.stderr: -256> 2023-10-05T11:39:55.816+0000 7fe62028b880 20 rados->read ofs=0 len=0 2023-10-05T11:39:55.959 INFO:tasks.workunit.client.0.smithi012.stderr: -255> 2023-10-05T11:39:55.816+0000 7fe62028b880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:39:55.959 INFO:tasks.workunit.client.0.smithi012.stderr: -254> 2023-10-05T11:39:55.816+0000 7fe62028b880 20 rados->read ofs=0 len=0 2023-10-05T11:39:55.959 INFO:tasks.workunit.client.0.smithi012.stderr: -253> 2023-10-05T11:39:55.816+0000 7fe62028b880 20 rados_obj.operate() r=0 bl.length=454 2023-10-05T11:39:55.959 INFO:tasks.workunit.client.0.smithi012.stderr: -252> 2023-10-05T11:39:55.816+0000 7fe62028b880 20 zone default found 2023-10-05T11:39:55.959 INFO:tasks.workunit.client.0.smithi012.stderr: -251> 2023-10-05T11:39:55.816+0000 7fe62028b880 4 Realm: () 2023-10-05T11:39:55.959 INFO:tasks.workunit.client.0.smithi012.stderr: -250> 2023-10-05T11:39:55.816+0000 7fe62028b880 4 ZoneGroup: default (c78aa576-9d15-4e9d-b3c0-4af23a22062c) 2023-10-05T11:39:55.959 INFO:tasks.workunit.client.0.smithi012.stderr: -249> 2023-10-05T11:39:55.816+0000 7fe62028b880 4 Zone: default (dff27d1e-df33-400e-a68a-7ba586947c99) 2023-10-05T11:39:55.959 INFO:tasks.workunit.client.0.smithi012.stderr: -248> 2023-10-05T11:39:55.816+0000 7fe62028b880 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T11:39:55.959 INFO:tasks.workunit.client.0.smithi012.stderr: -247> 2023-10-05T11:39:55.816+0000 7fe62028b880 20 zonegroup default 2023-10-05T11:39:55.960 INFO:tasks.workunit.client.0.smithi012.stderr: -246> 2023-10-05T11:39:55.816+0000 7fe62028b880 20 rados->read ofs=0 len=0 2023-10-05T11:39:55.960 INFO:tasks.workunit.client.0.smithi012.stderr: -245> 2023-10-05T11:39:55.816+0000 7fe62028b880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:55.960 INFO:tasks.workunit.client.0.smithi012.stderr: -244> 2023-10-05T11:39:55.816+0000 7fe62028b880 20 rados->read ofs=0 len=0 2023-10-05T11:39:55.960 INFO:tasks.workunit.client.0.smithi012.stderr: -243> 2023-10-05T11:39:55.817+0000 7fe62028b880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:55.960 INFO:tasks.workunit.client.0.smithi012.stderr: -242> 2023-10-05T11:39:55.817+0000 7fe62028b880 20 rados->read ofs=0 len=0 2023-10-05T11:39:55.960 INFO:tasks.workunit.client.0.smithi012.stderr: -241> 2023-10-05T11:39:55.817+0000 7fe62028b880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:55.960 INFO:tasks.workunit.client.0.smithi012.stderr: -240> 2023-10-05T11:39:55.817+0000 7fe62028b880 20 started sync module instance, tier type = 2023-10-05T11:39:55.960 INFO:tasks.workunit.client.0.smithi012.stderr: -239> 2023-10-05T11:39:55.817+0000 7fe62028b880 20 started zone id=dff27d1e-df33-400e-a68a-7ba586947c99 (name=default) with tier type = 2023-10-05T11:39:55.960 INFO:tasks.workunit.client.0.smithi012.stderr: -238> 2023-10-05T11:39:55.822+0000 7fe61f231640 0 -- 172.21.15.12:0/3931236051 >> [v2:172.21.15.12:6824/2171933159,v1:172.21.15.12:6825/2171933159] conn(0x55dfb6cb5400 msgr2=0x55dfb6b07700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-10-05T11:39:55.960 INFO:tasks.workunit.client.0.smithi012.stderr: -237> 2023-10-05T11:39:55.822+0000 7fe617a22640 1 client.6588.objecter ms_handle_reset 0x55dfb6cb5400 session 0x55dfb6afad80 osd.3 2023-10-05T11:39:55.960 INFO:tasks.workunit.client.0.smithi012.stderr: -236> 2023-10-05T11:39:55.823+0000 7fe61f231640 10 monclient: get_auth_request con 0x55dfb76fd400 auth_method 0 2023-10-05T11:39:55.960 INFO:tasks.workunit.client.0.smithi012.stderr: -235> 2023-10-05T11:39:55.826+0000 7fe62028b880 20 add_watcher() i=0 2023-10-05T11:39:55.961 INFO:tasks.workunit.client.0.smithi012.stderr: -234> 2023-10-05T11:39:55.826+0000 7fe62028b880 20 add_watcher() i=1 2023-10-05T11:39:55.961 INFO:tasks.workunit.client.0.smithi012.stderr: -233> 2023-10-05T11:39:55.826+0000 7fe62028b880 20 add_watcher() i=2 2023-10-05T11:39:55.961 INFO:tasks.workunit.client.0.smithi012.stderr: -232> 2023-10-05T11:39:55.826+0000 7fe62028b880 20 add_watcher() i=3 2023-10-05T11:39:55.961 INFO:tasks.workunit.client.0.smithi012.stderr: -231> 2023-10-05T11:39:55.826+0000 7fe62028b880 20 add_watcher() i=4 2023-10-05T11:39:55.961 INFO:tasks.workunit.client.0.smithi012.stderr: -230> 2023-10-05T11:39:55.826+0000 7fe62028b880 20 add_watcher() i=5 2023-10-05T11:39:55.961 INFO:tasks.workunit.client.0.smithi012.stderr: -229> 2023-10-05T11:39:55.826+0000 7fe62028b880 20 add_watcher() i=6 2023-10-05T11:39:55.961 INFO:tasks.workunit.client.0.smithi012.stderr: -228> 2023-10-05T11:39:55.827+0000 7fe62028b880 20 add_watcher() i=7 2023-10-05T11:39:55.961 INFO:tasks.workunit.client.0.smithi012.stderr: -227> 2023-10-05T11:39:55.827+0000 7fe62028b880 2 all 8 watchers are set, enabling cache 2023-10-05T11:39:55.961 INFO:tasks.workunit.client.0.smithi012.stderr: -226> 2023-10-05T11:39:55.829+0000 7fe62028b880 5 AuthRegistry(0x7fffd73802a0) adding auth protocol: cephx 2023-10-05T11:39:55.961 INFO:tasks.workunit.client.0.smithi012.stderr: -225> 2023-10-05T11:39:55.829+0000 7fe62028b880 5 AuthRegistry(0x7fffd73802a0) adding auth protocol: cephx 2023-10-05T11:39:55.961 INFO:tasks.workunit.client.0.smithi012.stderr: -224> 2023-10-05T11:39:55.829+0000 7fe62028b880 5 AuthRegistry(0x7fffd73802a0) adding auth protocol: cephx 2023-10-05T11:39:55.961 INFO:tasks.workunit.client.0.smithi012.stderr: -223> 2023-10-05T11:39:55.829+0000 7fe62028b880 5 AuthRegistry(0x7fffd73802a0) adding con mode: secure 2023-10-05T11:39:55.961 INFO:tasks.workunit.client.0.smithi012.stderr: -222> 2023-10-05T11:39:55.829+0000 7fe62028b880 5 AuthRegistry(0x7fffd73802a0) adding con mode: crc 2023-10-05T11:39:55.962 INFO:tasks.workunit.client.0.smithi012.stderr: -221> 2023-10-05T11:39:55.829+0000 7fe6059fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:39:55.962 INFO:tasks.workunit.client.0.smithi012.stderr: -220> 2023-10-05T11:39:55.829+0000 7fe62028b880 5 AuthRegistry(0x7fffd73802a0) adding con mode: secure 2023-10-05T11:39:55.962 INFO:tasks.workunit.client.0.smithi012.stderr: -219> 2023-10-05T11:39:55.829+0000 7fe62028b880 5 AuthRegistry(0x7fffd73802a0) adding con mode: crc 2023-10-05T11:39:55.962 INFO:tasks.workunit.client.0.smithi012.stderr: -218> 2023-10-05T11:39:55.829+0000 7fe62028b880 5 AuthRegistry(0x7fffd73802a0) adding con mode: secure 2023-10-05T11:39:55.962 INFO:tasks.workunit.client.0.smithi012.stderr: -217> 2023-10-05T11:39:55.829+0000 7fe62028b880 5 AuthRegistry(0x7fffd73802a0) adding con mode: crc 2023-10-05T11:39:55.962 INFO:tasks.workunit.client.0.smithi012.stderr: -216> 2023-10-05T11:39:55.829+0000 7fe62028b880 5 AuthRegistry(0x7fffd73802a0) adding con mode: crc 2023-10-05T11:39:55.962 INFO:tasks.workunit.client.0.smithi012.stderr: -215> 2023-10-05T11:39:55.829+0000 7fe62028b880 5 AuthRegistry(0x7fffd73802a0) adding con mode: secure 2023-10-05T11:39:55.962 INFO:tasks.workunit.client.0.smithi012.stderr: -214> 2023-10-05T11:39:55.829+0000 7fe62028b880 5 AuthRegistry(0x7fffd73802a0) adding con mode: crc 2023-10-05T11:39:55.962 INFO:tasks.workunit.client.0.smithi012.stderr: -213> 2023-10-05T11:39:55.829+0000 7fe62028b880 5 AuthRegistry(0x7fffd73802a0) adding con mode: secure 2023-10-05T11:39:55.962 INFO:tasks.workunit.client.0.smithi012.stderr: -212> 2023-10-05T11:39:55.829+0000 7fe62028b880 5 AuthRegistry(0x7fffd73802a0) adding con mode: crc 2023-10-05T11:39:55.962 INFO:tasks.workunit.client.0.smithi012.stderr: -211> 2023-10-05T11:39:55.829+0000 7fe62028b880 5 AuthRegistry(0x7fffd73802a0) adding con mode: secure 2023-10-05T11:39:55.963 INFO:tasks.workunit.client.0.smithi012.stderr: -210> 2023-10-05T11:39:55.829+0000 7fe62028b880 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-10-05T11:39:55.963 INFO:tasks.workunit.client.0.smithi012.stderr: -209> 2023-10-05T11:39:55.829+0000 7fe62028b880 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T11:39:55.963 INFO:tasks.workunit.client.0.smithi012.stderr: -208> 2023-10-05T11:39:55.829+0000 7fe62028b880 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T11:39:55.963 INFO:tasks.workunit.client.0.smithi012.stderr: -207> 2023-10-05T11:39:55.829+0000 7fe62028b880 5 asok(0x55dfb6b00000) register_command cache list hook 0x55dfb68c1470 2023-10-05T11:39:55.963 INFO:tasks.workunit.client.0.smithi012.stderr: -206> 2023-10-05T11:39:55.829+0000 7fe62028b880 5 asok(0x55dfb6b00000) register_command cache inspect hook 0x55dfb68c1470 2023-10-05T11:39:55.963 INFO:tasks.workunit.client.0.smithi012.stderr: -205> 2023-10-05T11:39:55.829+0000 7fe62028b880 5 asok(0x55dfb6b00000) register_command cache erase hook 0x55dfb68c1470 2023-10-05T11:39:55.963 INFO:tasks.workunit.client.0.smithi012.stderr: -204> 2023-10-05T11:39:55.829+0000 7fe62028b880 5 asok(0x55dfb6b00000) register_command cache zap hook 0x55dfb68c1470 2023-10-05T11:39:55.963 INFO:tasks.workunit.client.0.smithi012.stderr: -203> 2023-10-05T11:39:55.829+0000 7fe62028b880 10 monclient: get_monmap_and_config 2023-10-05T11:39:55.963 INFO:tasks.workunit.client.0.smithi012.stderr: -202> 2023-10-05T11:39:55.829+0000 7fe62028b880 10 monclient: build_initial_monmap 2023-10-05T11:39:55.963 INFO:tasks.workunit.client.0.smithi012.stderr: -201> 2023-10-05T11:39:55.829+0000 7fe62028b880 1 build_initial for_mkfs: 0 2023-10-05T11:39:55.963 INFO:tasks.workunit.client.0.smithi012.stderr: -200> 2023-10-05T11:39:55.829+0000 7fe62028b880 10 monclient: monmap: 2023-10-05T11:39:55.963 INFO:tasks.workunit.client.0.smithi012.stderr:epoch 0 2023-10-05T11:39:55.964 INFO:tasks.workunit.client.0.smithi012.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-10-05T11:39:55.964 INFO:tasks.workunit.client.0.smithi012.stderr:last_changed 0.000000 2023-10-05T11:39:55.964 INFO:tasks.workunit.client.0.smithi012.stderr:created 0.000000 2023-10-05T11:39:55.964 INFO:tasks.workunit.client.0.smithi012.stderr:min_mon_release 0 (unknown) 2023-10-05T11:39:55.964 INFO:tasks.workunit.client.0.smithi012.stderr:election_strategy: 1 2023-10-05T11:39:55.964 INFO:tasks.workunit.client.0.smithi012.stderr:0: [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon.noname-a 2023-10-05T11:39:55.964 INFO:tasks.workunit.client.0.smithi012.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.noname-b 2023-10-05T11:39:55.964 INFO:tasks.workunit.client.0.smithi012.stderr:2: [v2:172.21.15.12:3301/0,v1:172.21.15.12:6790/0] mon.noname-c 2023-10-05T11:39:55.964 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:39:55.964 INFO:tasks.workunit.client.0.smithi012.stderr: -199> 2023-10-05T11:39:55.829+0000 7fe62028b880 5 AuthRegistry(0x55dfb6d1e140) adding auth protocol: cephx 2023-10-05T11:39:55.964 INFO:tasks.workunit.client.0.smithi012.stderr: -198> 2023-10-05T11:39:55.829+0000 7fe62028b880 5 AuthRegistry(0x55dfb6d1e140) adding auth protocol: cephx 2023-10-05T11:39:55.964 INFO:tasks.workunit.client.0.smithi012.stderr: -197> 2023-10-05T11:39:55.829+0000 7fe62028b880 5 AuthRegistry(0x55dfb6d1e140) adding auth protocol: cephx 2023-10-05T11:39:55.965 INFO:tasks.workunit.client.0.smithi012.stderr: -196> 2023-10-05T11:39:55.829+0000 7fe62028b880 5 AuthRegistry(0x55dfb6d1e140) adding con mode: secure 2023-10-05T11:39:55.965 INFO:tasks.workunit.client.0.smithi012.stderr: -195> 2023-10-05T11:39:55.829+0000 7fe62028b880 5 AuthRegistry(0x55dfb6d1e140) adding con mode: crc 2023-10-05T11:39:55.965 INFO:tasks.workunit.client.0.smithi012.stderr: -194> 2023-10-05T11:39:55.829+0000 7fe62028b880 5 AuthRegistry(0x55dfb6d1e140) adding con mode: secure 2023-10-05T11:39:55.965 INFO:tasks.workunit.client.0.smithi012.stderr: -193> 2023-10-05T11:39:55.829+0000 7fe62028b880 5 AuthRegistry(0x55dfb6d1e140) adding con mode: crc 2023-10-05T11:39:55.965 INFO:tasks.workunit.client.0.smithi012.stderr: -192> 2023-10-05T11:39:55.829+0000 7fe62028b880 5 AuthRegistry(0x55dfb6d1e140) adding con mode: secure 2023-10-05T11:39:55.965 INFO:tasks.workunit.client.0.smithi012.stderr: -191> 2023-10-05T11:39:55.829+0000 7fe62028b880 5 AuthRegistry(0x55dfb6d1e140) adding con mode: crc 2023-10-05T11:39:55.965 INFO:tasks.workunit.client.0.smithi012.stderr: -190> 2023-10-05T11:39:55.829+0000 7fe62028b880 5 AuthRegistry(0x55dfb6d1e140) adding con mode: crc 2023-10-05T11:39:55.965 INFO:tasks.workunit.client.0.smithi012.stderr: -189> 2023-10-05T11:39:55.829+0000 7fe62028b880 5 AuthRegistry(0x55dfb6d1e140) adding con mode: secure 2023-10-05T11:39:55.965 INFO:tasks.workunit.client.0.smithi012.stderr: -188> 2023-10-05T11:39:55.829+0000 7fe62028b880 5 AuthRegistry(0x55dfb6d1e140) adding con mode: crc 2023-10-05T11:39:55.965 INFO:tasks.workunit.client.0.smithi012.stderr: -187> 2023-10-05T11:39:55.829+0000 7fe62028b880 5 AuthRegistry(0x55dfb6d1e140) adding con mode: secure 2023-10-05T11:39:55.965 INFO:tasks.workunit.client.0.smithi012.stderr: -186> 2023-10-05T11:39:55.829+0000 7fe62028b880 5 AuthRegistry(0x55dfb6d1e140) adding con mode: crc 2023-10-05T11:39:55.965 INFO:tasks.workunit.client.0.smithi012.stderr: -185> 2023-10-05T11:39:55.829+0000 7fe62028b880 5 AuthRegistry(0x55dfb6d1e140) adding con mode: secure 2023-10-05T11:39:55.966 INFO:tasks.workunit.client.0.smithi012.stderr: -184> 2023-10-05T11:39:55.830+0000 7fe62028b880 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-10-05T11:39:55.966 INFO:tasks.workunit.client.0.smithi012.stderr: -183> 2023-10-05T11:39:55.830+0000 7fe62028b880 10 monclient: init 2023-10-05T11:39:55.966 INFO:tasks.workunit.client.0.smithi012.stderr: -182> 2023-10-05T11:39:55.830+0000 7fe62028b880 5 AuthRegistry(0x7fffd737fdf0) adding auth protocol: cephx 2023-10-05T11:39:55.966 INFO:tasks.workunit.client.0.smithi012.stderr: -181> 2023-10-05T11:39:55.830+0000 7fe62028b880 5 AuthRegistry(0x7fffd737fdf0) adding auth protocol: cephx 2023-10-05T11:39:55.966 INFO:tasks.workunit.client.0.smithi012.stderr: -180> 2023-10-05T11:39:55.830+0000 7fe62028b880 5 AuthRegistry(0x7fffd737fdf0) adding auth protocol: cephx 2023-10-05T11:39:55.966 INFO:tasks.workunit.client.0.smithi012.stderr: -179> 2023-10-05T11:39:55.830+0000 7fe62028b880 5 AuthRegistry(0x7fffd737fdf0) adding con mode: secure 2023-10-05T11:39:55.966 INFO:tasks.workunit.client.0.smithi012.stderr: -178> 2023-10-05T11:39:55.830+0000 7fe62028b880 5 AuthRegistry(0x7fffd737fdf0) adding con mode: crc 2023-10-05T11:39:55.966 INFO:tasks.workunit.client.0.smithi012.stderr: -177> 2023-10-05T11:39:55.830+0000 7fe62028b880 5 AuthRegistry(0x7fffd737fdf0) adding con mode: secure 2023-10-05T11:39:55.966 INFO:tasks.workunit.client.0.smithi012.stderr: -176> 2023-10-05T11:39:55.830+0000 7fe62028b880 5 AuthRegistry(0x7fffd737fdf0) adding con mode: crc 2023-10-05T11:39:55.966 INFO:tasks.workunit.client.0.smithi012.stderr: -175> 2023-10-05T11:39:55.830+0000 7fe62028b880 5 AuthRegistry(0x7fffd737fdf0) adding con mode: secure 2023-10-05T11:39:55.966 INFO:tasks.workunit.client.0.smithi012.stderr: -174> 2023-10-05T11:39:55.830+0000 7fe62028b880 5 AuthRegistry(0x7fffd737fdf0) adding con mode: crc 2023-10-05T11:39:55.966 INFO:tasks.workunit.client.0.smithi012.stderr: -173> 2023-10-05T11:39:55.830+0000 7fe62028b880 5 AuthRegistry(0x7fffd737fdf0) adding con mode: crc 2023-10-05T11:39:55.967 INFO:tasks.workunit.client.0.smithi012.stderr: -172> 2023-10-05T11:39:55.830+0000 7fe62028b880 5 AuthRegistry(0x7fffd737fdf0) adding con mode: secure 2023-10-05T11:39:55.967 INFO:tasks.workunit.client.0.smithi012.stderr: -171> 2023-10-05T11:39:55.830+0000 7fe62028b880 5 AuthRegistry(0x7fffd737fdf0) adding con mode: crc 2023-10-05T11:39:55.967 INFO:tasks.workunit.client.0.smithi012.stderr: -170> 2023-10-05T11:39:55.830+0000 7fe62028b880 5 AuthRegistry(0x7fffd737fdf0) adding con mode: secure 2023-10-05T11:39:55.967 INFO:tasks.workunit.client.0.smithi012.stderr: -169> 2023-10-05T11:39:55.830+0000 7fe62028b880 5 AuthRegistry(0x7fffd737fdf0) adding con mode: crc 2023-10-05T11:39:55.967 INFO:tasks.workunit.client.0.smithi012.stderr: -168> 2023-10-05T11:39:55.830+0000 7fe62028b880 5 AuthRegistry(0x7fffd737fdf0) adding con mode: secure 2023-10-05T11:39:55.967 INFO:tasks.workunit.client.0.smithi012.stderr: -167> 2023-10-05T11:39:55.830+0000 7fe62028b880 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-10-05T11:39:55.967 INFO:tasks.workunit.client.0.smithi012.stderr: -166> 2023-10-05T11:39:55.830+0000 7fe62028b880 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-10-05T11:39:55.967 INFO:tasks.workunit.client.0.smithi012.stderr: -165> 2023-10-05T11:39:55.830+0000 7fe62028b880 5 asok(0x55dfb6b00000) register_command rotate-key cmddesc rotate-key hook 0x7fffd737ff38 EEXIST 2023-10-05T11:39:55.967 INFO:tasks.workunit.client.0.smithi012.stderr: -164> 2023-10-05T11:39:55.830+0000 7fe62028b880 10 monclient: _reopen_session rank -1 2023-10-05T11:39:55.967 INFO:tasks.workunit.client.0.smithi012.stderr: -163> 2023-10-05T11:39:55.830+0000 7fe62028b880 10 monclient: _add_conns ranks=[1,0,2] 2023-10-05T11:39:55.967 INFO:tasks.workunit.client.0.smithi012.stderr: -162> 2023-10-05T11:39:55.830+0000 7fe62028b880 10 monclient(hunting): picked mon.noname-b con 0x55dfb6ce1800 addr [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] 2023-10-05T11:39:55.967 INFO:tasks.workunit.client.0.smithi012.stderr: -161> 2023-10-05T11:39:55.830+0000 7fe62028b880 10 monclient(hunting): picked mon.noname-a con 0x55dfb6ce1c00 addr [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] 2023-10-05T11:39:55.967 INFO:tasks.workunit.client.0.smithi012.stderr: -160> 2023-10-05T11:39:55.830+0000 7fe62028b880 10 monclient(hunting): picked mon.noname-c con 0x55dfb6d30000 addr [v2:172.21.15.12:3301/0,v1:172.21.15.12:6790/0] 2023-10-05T11:39:55.968 INFO:tasks.workunit.client.0.smithi012.stderr: -159> 2023-10-05T11:39:55.830+0000 7fe62028b880 10 monclient(hunting): start opening mon connection 2023-10-05T11:39:55.968 INFO:tasks.workunit.client.0.smithi012.stderr: -158> 2023-10-05T11:39:55.830+0000 7fe62028b880 10 monclient(hunting): start opening mon connection 2023-10-05T11:39:55.968 INFO:tasks.workunit.client.0.smithi012.stderr: -157> 2023-10-05T11:39:55.830+0000 7fe62028b880 10 monclient(hunting): start opening mon connection 2023-10-05T11:39:55.968 INFO:tasks.workunit.client.0.smithi012.stderr: -156> 2023-10-05T11:39:55.830+0000 7fe62028b880 10 monclient(hunting): _renew_subs 2023-10-05T11:39:55.968 INFO:tasks.workunit.client.0.smithi012.stderr: -155> 2023-10-05T11:39:55.830+0000 7fe62028b880 10 monclient(hunting): authenticate will time out at 1503.999097s 2023-10-05T11:39:55.968 INFO:tasks.workunit.client.0.smithi012.stderr: -154> 2023-10-05T11:39:55.830+0000 7fe61e22f640 10 monclient(hunting): get_auth_request con 0x55dfb6d30000 auth_method 0 2023-10-05T11:39:55.968 INFO:tasks.workunit.client.0.smithi012.stderr: -153> 2023-10-05T11:39:55.830+0000 7fe61e22f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-10-05T11:39:55.968 INFO:tasks.workunit.client.0.smithi012.stderr: -152> 2023-10-05T11:39:55.830+0000 7fe61e22f640 10 monclient(hunting): _init_auth method 2 2023-10-05T11:39:55.968 INFO:tasks.workunit.client.0.smithi012.stderr: -151> 2023-10-05T11:39:55.830+0000 7fe61e22f640 10 monclient(hunting): _init_auth creating new auth 2023-10-05T11:39:55.968 INFO:tasks.workunit.client.0.smithi012.stderr: -150> 2023-10-05T11:39:55.830+0000 7fe61ea30640 10 monclient(hunting): get_auth_request con 0x55dfb6ce1c00 auth_method 0 2023-10-05T11:39:55.968 INFO:tasks.workunit.client.0.smithi012.stderr: -149> 2023-10-05T11:39:55.830+0000 7fe61ea30640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-10-05T11:39:55.968 INFO:tasks.workunit.client.0.smithi012.stderr: -148> 2023-10-05T11:39:55.830+0000 7fe61ea30640 10 monclient(hunting): _init_auth method 2 2023-10-05T11:39:55.969 INFO:tasks.workunit.client.0.smithi012.stderr: -147> 2023-10-05T11:39:55.830+0000 7fe61ea30640 10 monclient(hunting): _init_auth creating new auth 2023-10-05T11:39:55.969 INFO:tasks.workunit.client.0.smithi012.stderr: -146> 2023-10-05T11:39:55.830+0000 7fe61f231640 10 monclient(hunting): get_auth_request con 0x55dfb6ce1800 auth_method 0 2023-10-05T11:39:55.969 INFO:tasks.workunit.client.0.smithi012.stderr: -145> 2023-10-05T11:39:55.830+0000 7fe61f231640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-10-05T11:39:55.969 INFO:tasks.workunit.client.0.smithi012.stderr: -144> 2023-10-05T11:39:55.830+0000 7fe61f231640 10 monclient(hunting): _init_auth method 2 2023-10-05T11:39:55.969 INFO:tasks.workunit.client.0.smithi012.stderr: -143> 2023-10-05T11:39:55.830+0000 7fe61f231640 10 monclient(hunting): _init_auth creating new auth 2023-10-05T11:39:55.969 INFO:tasks.workunit.client.0.smithi012.stderr: -142> 2023-10-05T11:39:55.830+0000 7fe61e22f640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-10-05T11:39:55.969 INFO:tasks.workunit.client.0.smithi012.stderr: -141> 2023-10-05T11:39:55.830+0000 7fe61e22f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-10-05T11:39:55.969 INFO:tasks.workunit.client.0.smithi012.stderr: -140> 2023-10-05T11:39:55.830+0000 7fe61e22f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-10-05T11:39:55.969 INFO:tasks.workunit.client.0.smithi012.stderr: -139> 2023-10-05T11:39:55.830+0000 7fe61ea30640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-10-05T11:39:55.969 INFO:tasks.workunit.client.0.smithi012.stderr: -138> 2023-10-05T11:39:55.830+0000 7fe61ea30640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-10-05T11:39:55.969 INFO:tasks.workunit.client.0.smithi012.stderr: -137> 2023-10-05T11:39:55.830+0000 7fe61ea30640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-10-05T11:39:55.969 INFO:tasks.workunit.client.0.smithi012.stderr: -136> 2023-10-05T11:39:55.830+0000 7fe61f231640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-10-05T11:39:55.970 INFO:tasks.workunit.client.0.smithi012.stderr: -135> 2023-10-05T11:39:55.830+0000 7fe61f231640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-10-05T11:39:55.970 INFO:tasks.workunit.client.0.smithi012.stderr: -134> 2023-10-05T11:39:55.830+0000 7fe61f231640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-10-05T11:39:55.970 INFO:tasks.workunit.client.0.smithi012.stderr: -133> 2023-10-05T11:39:55.831+0000 7fe61ea30640 10 monclient(hunting): handle_auth_done global_id 6591 payload 274 2023-10-05T11:39:55.970 INFO:tasks.workunit.client.0.smithi012.stderr: -132> 2023-10-05T11:39:55.831+0000 7fe61ea30640 10 monclient: _finish_hunting 0 2023-10-05T11:39:55.970 INFO:tasks.workunit.client.0.smithi012.stderr: -131> 2023-10-05T11:39:55.831+0000 7fe61ea30640 1 monclient: found mon.noname-a 2023-10-05T11:39:55.970 INFO:tasks.workunit.client.0.smithi012.stderr: -130> 2023-10-05T11:39:55.831+0000 7fe61ea30640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.12:3300/0 2023-10-05T11:39:55.970 INFO:tasks.workunit.client.0.smithi012.stderr: -129> 2023-10-05T11:39:55.831+0000 7fe6051fd640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-10-05T11:39:55.970 INFO:tasks.workunit.client.0.smithi012.stderr: -128> 2023-10-05T11:39:55.831+0000 7fe6051fd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2023-10-05T11:39:55.970 INFO:tasks.workunit.client.0.smithi012.stderr: -127> 2023-10-05T11:39:55.831+0000 7fe6051fd640 10 monclient: dump: 2023-10-05T11:39:55.970 INFO:tasks.workunit.client.0.smithi012.stderr:epoch 1 2023-10-05T11:39:55.970 INFO:tasks.workunit.client.0.smithi012.stderr:fsid 7e015f46-293b-4b09-bd32-7d32b52f6e2f 2023-10-05T11:39:55.970 INFO:tasks.workunit.client.0.smithi012.stderr:last_changed 2023-10-05T11:27:38.366888+0000 2023-10-05T11:39:55.971 INFO:tasks.workunit.client.0.smithi012.stderr:created 2023-10-05T11:27:38.366888+0000 2023-10-05T11:39:55.971 INFO:tasks.workunit.client.0.smithi012.stderr:min_mon_release 18 (reef) 2023-10-05T11:39:55.971 INFO:tasks.workunit.client.0.smithi012.stderr:election_strategy: 1 2023-10-05T11:39:55.971 INFO:tasks.workunit.client.0.smithi012.stderr:0: [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon.a 2023-10-05T11:39:55.971 INFO:tasks.workunit.client.0.smithi012.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2023-10-05T11:39:55.971 INFO:tasks.workunit.client.0.smithi012.stderr:2: [v2:172.21.15.12:3301/0,v1:172.21.15.12:6790/0] mon.c 2023-10-05T11:39:55.971 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:39:55.971 INFO:tasks.workunit.client.0.smithi012.stderr: -126> 2023-10-05T11:39:55.831+0000 7fe6051fd640 10 monclient: _finish_auth 0 2023-10-05T11:39:55.971 INFO:tasks.workunit.client.0.smithi012.stderr: -125> 2023-10-05T11:39:55.831+0000 7fe6051fd640 10 monclient: _check_auth_tickets 2023-10-05T11:39:55.971 INFO:tasks.workunit.client.0.smithi012.stderr: -124> 2023-10-05T11:39:55.831+0000 7fe6051fd640 10 monclient: handle_config config(0 keys) v1 2023-10-05T11:39:55.971 INFO:tasks.workunit.client.0.smithi012.stderr: -123> 2023-10-05T11:39:55.831+0000 7fe6051fd640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-10-05T11:39:55.971 INFO:tasks.workunit.client.0.smithi012.stderr: -122> 2023-10-05T11:39:55.831+0000 7fe6051fd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2023-10-05T11:39:55.972 INFO:tasks.workunit.client.0.smithi012.stderr: -121> 2023-10-05T11:39:55.831+0000 7fe6051fd640 10 monclient: dump: 2023-10-05T11:39:55.972 INFO:tasks.workunit.client.0.smithi012.stderr:epoch 1 2023-10-05T11:39:55.972 INFO:tasks.workunit.client.0.smithi012.stderr:fsid 7e015f46-293b-4b09-bd32-7d32b52f6e2f 2023-10-05T11:39:55.972 INFO:tasks.workunit.client.0.smithi012.stderr:last_changed 2023-10-05T11:27:38.366888+0000 2023-10-05T11:39:55.972 INFO:tasks.workunit.client.0.smithi012.stderr:created 2023-10-05T11:27:38.366888+0000 2023-10-05T11:39:55.972 INFO:tasks.workunit.client.0.smithi012.stderr:min_mon_release 18 (reef) 2023-10-05T11:39:55.972 INFO:tasks.workunit.client.0.smithi012.stderr:election_strategy: 1 2023-10-05T11:39:55.972 INFO:tasks.workunit.client.0.smithi012.stderr:0: [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon.a 2023-10-05T11:39:55.972 INFO:tasks.workunit.client.0.smithi012.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2023-10-05T11:39:55.972 INFO:tasks.workunit.client.0.smithi012.stderr:2: [v2:172.21.15.12:3301/0,v1:172.21.15.12:6790/0] mon.c 2023-10-05T11:39:55.972 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:39:55.972 INFO:tasks.workunit.client.0.smithi012.stderr: -120> 2023-10-05T11:39:55.831+0000 7fe62028b880 5 monclient: authenticate success, global_id 6591 2023-10-05T11:39:55.973 INFO:tasks.workunit.client.0.smithi012.stderr: -119> 2023-10-05T11:39:55.831+0000 7fe62028b880 10 monclient: get_monmap_and_config success 2023-10-05T11:39:55.973 INFO:tasks.workunit.client.0.smithi012.stderr: -118> 2023-10-05T11:39:55.831+0000 7fe62028b880 4 set_mon_vals no callback set 2023-10-05T11:39:55.973 INFO:tasks.workunit.client.0.smithi012.stderr: -117> 2023-10-05T11:39:55.831+0000 7fe62028b880 10 monclient: shutdown 2023-10-05T11:39:55.973 INFO:tasks.workunit.client.0.smithi012.stderr: -116> 2023-10-05T11:39:55.832+0000 7fe62028b880 10 monclient: build_initial_monmap 2023-10-05T11:39:55.973 INFO:tasks.workunit.client.0.smithi012.stderr: -115> 2023-10-05T11:39:55.832+0000 7fe62028b880 1 build_initial for_mkfs: 0 2023-10-05T11:39:55.973 INFO:tasks.workunit.client.0.smithi012.stderr: -114> 2023-10-05T11:39:55.832+0000 7fe62028b880 10 monclient: monmap: 2023-10-05T11:39:55.973 INFO:tasks.workunit.client.0.smithi012.stderr:epoch 0 2023-10-05T11:39:55.973 INFO:tasks.workunit.client.0.smithi012.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-10-05T11:39:55.973 INFO:tasks.workunit.client.0.smithi012.stderr:last_changed 0.000000 2023-10-05T11:39:55.973 INFO:tasks.workunit.client.0.smithi012.stderr:created 0.000000 2023-10-05T11:39:55.973 INFO:tasks.workunit.client.0.smithi012.stderr:min_mon_release 0 (unknown) 2023-10-05T11:39:55.973 INFO:tasks.workunit.client.0.smithi012.stderr:election_strategy: 1 2023-10-05T11:39:55.973 INFO:tasks.workunit.client.0.smithi012.stderr:0: [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon.noname-a 2023-10-05T11:39:55.974 INFO:tasks.workunit.client.0.smithi012.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.noname-b 2023-10-05T11:39:55.974 INFO:tasks.workunit.client.0.smithi012.stderr:2: [v2:172.21.15.12:3301/0,v1:172.21.15.12:6790/0] mon.noname-c 2023-10-05T11:39:55.974 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:39:55.974 INFO:tasks.workunit.client.0.smithi012.stderr: -113> 2023-10-05T11:39:55.832+0000 7fe62028b880 5 AuthRegistry(0x55dfb6d1e140) adding auth protocol: cephx 2023-10-05T11:39:55.974 INFO:tasks.workunit.client.0.smithi012.stderr: -112> 2023-10-05T11:39:55.832+0000 7fe62028b880 5 AuthRegistry(0x55dfb6d1e140) adding auth protocol: cephx 2023-10-05T11:39:55.974 INFO:tasks.workunit.client.0.smithi012.stderr: -111> 2023-10-05T11:39:55.832+0000 7fe62028b880 5 AuthRegistry(0x55dfb6d1e140) adding auth protocol: cephx 2023-10-05T11:39:55.974 INFO:tasks.workunit.client.0.smithi012.stderr: -110> 2023-10-05T11:39:55.832+0000 7fe62028b880 5 AuthRegistry(0x55dfb6d1e140) adding con mode: secure 2023-10-05T11:39:55.974 INFO:tasks.workunit.client.0.smithi012.stderr: -109> 2023-10-05T11:39:55.832+0000 7fe62028b880 5 AuthRegistry(0x55dfb6d1e140) adding con mode: crc 2023-10-05T11:39:55.974 INFO:tasks.workunit.client.0.smithi012.stderr: -108> 2023-10-05T11:39:55.832+0000 7fe62028b880 5 AuthRegistry(0x55dfb6d1e140) adding con mode: secure 2023-10-05T11:39:55.974 INFO:tasks.workunit.client.0.smithi012.stderr: -107> 2023-10-05T11:39:55.832+0000 7fe62028b880 5 AuthRegistry(0x55dfb6d1e140) adding con mode: crc 2023-10-05T11:39:55.974 INFO:tasks.workunit.client.0.smithi012.stderr: -106> 2023-10-05T11:39:55.832+0000 7fe62028b880 5 AuthRegistry(0x55dfb6d1e140) adding con mode: secure 2023-10-05T11:39:55.974 INFO:tasks.workunit.client.0.smithi012.stderr: -105> 2023-10-05T11:39:55.832+0000 7fe62028b880 5 AuthRegistry(0x55dfb6d1e140) adding con mode: crc 2023-10-05T11:39:55.975 INFO:tasks.workunit.client.0.smithi012.stderr: -104> 2023-10-05T11:39:55.832+0000 7fe62028b880 5 AuthRegistry(0x55dfb6d1e140) adding con mode: crc 2023-10-05T11:39:55.975 INFO:tasks.workunit.client.0.smithi012.stderr: -103> 2023-10-05T11:39:55.832+0000 7fe62028b880 5 AuthRegistry(0x55dfb6d1e140) adding con mode: secure 2023-10-05T11:39:55.975 INFO:tasks.workunit.client.0.smithi012.stderr: -102> 2023-10-05T11:39:55.832+0000 7fe62028b880 5 AuthRegistry(0x55dfb6d1e140) adding con mode: crc 2023-10-05T11:39:55.975 INFO:tasks.workunit.client.0.smithi012.stderr: -101> 2023-10-05T11:39:55.832+0000 7fe62028b880 5 AuthRegistry(0x55dfb6d1e140) adding con mode: secure 2023-10-05T11:39:55.975 INFO:tasks.workunit.client.0.smithi012.stderr: -100> 2023-10-05T11:39:55.832+0000 7fe62028b880 5 AuthRegistry(0x55dfb6d1e140) adding con mode: crc 2023-10-05T11:39:55.975 INFO:tasks.workunit.client.0.smithi012.stderr: -99> 2023-10-05T11:39:55.832+0000 7fe62028b880 5 AuthRegistry(0x55dfb6d1e140) adding con mode: secure 2023-10-05T11:39:55.975 INFO:tasks.workunit.client.0.smithi012.stderr: -98> 2023-10-05T11:39:55.832+0000 7fe62028b880 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-10-05T11:39:55.975 INFO:tasks.workunit.client.0.smithi012.stderr: -97> 2023-10-05T11:39:55.832+0000 7fe62028b880 1 librados: starting msgr at 2023-10-05T11:39:55.975 INFO:tasks.workunit.client.0.smithi012.stderr: -96> 2023-10-05T11:39:55.832+0000 7fe62028b880 1 librados: starting objecter 2023-10-05T11:39:55.975 INFO:tasks.workunit.client.0.smithi012.stderr: -95> 2023-10-05T11:39:55.832+0000 7fe62028b880 5 asok(0x55dfb6b00000) register_command objecter_requests cmddesc objecter_requests hook 0x55dfb68c1bc0 EEXIST 2023-10-05T11:39:55.975 INFO:tasks.workunit.client.0.smithi012.stderr: -94> 2023-10-05T11:39:55.832+0000 7fe62028b880 1 librados: setting wanted keys 2023-10-05T11:39:55.975 INFO:tasks.workunit.client.0.smithi012.stderr: -93> 2023-10-05T11:39:55.832+0000 7fe62028b880 1 librados: calling monclient init 2023-10-05T11:39:55.976 INFO:tasks.workunit.client.0.smithi012.stderr: -92> 2023-10-05T11:39:55.832+0000 7fe62028b880 10 monclient: init 2023-10-05T11:39:55.976 INFO:tasks.workunit.client.0.smithi012.stderr: -91> 2023-10-05T11:39:55.832+0000 7fe62028b880 5 AuthRegistry(0x55dfb6d020d8) adding auth protocol: cephx 2023-10-05T11:39:55.976 INFO:tasks.workunit.client.0.smithi012.stderr: -90> 2023-10-05T11:39:55.832+0000 7fe62028b880 5 AuthRegistry(0x55dfb6d020d8) adding auth protocol: cephx 2023-10-05T11:39:55.976 INFO:tasks.workunit.client.0.smithi012.stderr: -89> 2023-10-05T11:39:55.832+0000 7fe62028b880 5 AuthRegistry(0x55dfb6d020d8) adding auth protocol: cephx 2023-10-05T11:39:55.976 INFO:tasks.workunit.client.0.smithi012.stderr: -88> 2023-10-05T11:39:55.832+0000 7fe62028b880 5 AuthRegistry(0x55dfb6d020d8) adding con mode: secure 2023-10-05T11:39:55.976 INFO:tasks.workunit.client.0.smithi012.stderr: -87> 2023-10-05T11:39:55.832+0000 7fe62028b880 5 AuthRegistry(0x55dfb6d020d8) adding con mode: crc 2023-10-05T11:39:55.976 INFO:tasks.workunit.client.0.smithi012.stderr: -86> 2023-10-05T11:39:55.832+0000 7fe62028b880 5 AuthRegistry(0x55dfb6d020d8) adding con mode: secure 2023-10-05T11:39:55.976 INFO:tasks.workunit.client.0.smithi012.stderr: -85> 2023-10-05T11:39:55.832+0000 7fe62028b880 5 AuthRegistry(0x55dfb6d020d8) adding con mode: crc 2023-10-05T11:39:55.976 INFO:tasks.workunit.client.0.smithi012.stderr: -84> 2023-10-05T11:39:55.832+0000 7fe62028b880 5 AuthRegistry(0x55dfb6d020d8) adding con mode: secure 2023-10-05T11:39:55.976 INFO:tasks.workunit.client.0.smithi012.stderr: -83> 2023-10-05T11:39:55.832+0000 7fe62028b880 5 AuthRegistry(0x55dfb6d020d8) adding con mode: crc 2023-10-05T11:39:55.976 INFO:tasks.workunit.client.0.smithi012.stderr: -82> 2023-10-05T11:39:55.832+0000 7fe62028b880 5 AuthRegistry(0x55dfb6d020d8) adding con mode: crc 2023-10-05T11:39:55.977 INFO:tasks.workunit.client.0.smithi012.stderr: -81> 2023-10-05T11:39:55.832+0000 7fe62028b880 5 AuthRegistry(0x55dfb6d020d8) adding con mode: secure 2023-10-05T11:39:55.977 INFO:tasks.workunit.client.0.smithi012.stderr: -80> 2023-10-05T11:39:55.832+0000 7fe62028b880 5 AuthRegistry(0x55dfb6d020d8) adding con mode: crc 2023-10-05T11:39:55.977 INFO:tasks.workunit.client.0.smithi012.stderr: -79> 2023-10-05T11:39:55.832+0000 7fe62028b880 5 AuthRegistry(0x55dfb6d020d8) adding con mode: secure 2023-10-05T11:39:55.977 INFO:tasks.workunit.client.0.smithi012.stderr: -78> 2023-10-05T11:39:55.832+0000 7fe62028b880 5 AuthRegistry(0x55dfb6d020d8) adding con mode: crc 2023-10-05T11:39:55.977 INFO:tasks.workunit.client.0.smithi012.stderr: -77> 2023-10-05T11:39:55.832+0000 7fe62028b880 5 AuthRegistry(0x55dfb6d020d8) adding con mode: secure 2023-10-05T11:39:55.977 INFO:tasks.workunit.client.0.smithi012.stderr: -76> 2023-10-05T11:39:55.832+0000 7fe62028b880 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-10-05T11:39:55.977 INFO:tasks.workunit.client.0.smithi012.stderr: -75> 2023-10-05T11:39:55.832+0000 7fe62028b880 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-10-05T11:39:55.977 INFO:tasks.workunit.client.0.smithi012.stderr: -74> 2023-10-05T11:39:55.832+0000 7fe62028b880 5 asok(0x55dfb6b00000) register_command rotate-key cmddesc rotate-key hook 0x55dfb6d02220 EEXIST 2023-10-05T11:39:55.977 INFO:tasks.workunit.client.0.smithi012.stderr: -73> 2023-10-05T11:39:55.832+0000 7fe62028b880 10 monclient: _reopen_session rank -1 2023-10-05T11:39:55.977 INFO:tasks.workunit.client.0.smithi012.stderr: -72> 2023-10-05T11:39:55.832+0000 7fe62028b880 10 monclient: _add_conns ranks=[2,1,0] 2023-10-05T11:39:55.977 INFO:tasks.workunit.client.0.smithi012.stderr: -71> 2023-10-05T11:39:55.832+0000 7fe62028b880 10 monclient(hunting): picked mon.noname-c con 0x55dfb6ce1800 addr [v2:172.21.15.12:3301/0,v1:172.21.15.12:6790/0] 2023-10-05T11:39:55.977 INFO:tasks.workunit.client.0.smithi012.stderr: -70> 2023-10-05T11:39:55.832+0000 7fe62028b880 10 monclient(hunting): picked mon.noname-b con 0x55dfb6ce1400 addr [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] 2023-10-05T11:39:55.978 INFO:tasks.workunit.client.0.smithi012.stderr: -69> 2023-10-05T11:39:55.832+0000 7fe62028b880 10 monclient(hunting): picked mon.noname-a con 0x55dfb6d22000 addr [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] 2023-10-05T11:39:55.978 INFO:tasks.workunit.client.0.smithi012.stderr: -68> 2023-10-05T11:39:55.832+0000 7fe62028b880 10 monclient(hunting): start opening mon connection 2023-10-05T11:39:55.978 INFO:tasks.workunit.client.0.smithi012.stderr: -67> 2023-10-05T11:39:55.832+0000 7fe62028b880 10 monclient(hunting): start opening mon connection 2023-10-05T11:39:55.978 INFO:tasks.workunit.client.0.smithi012.stderr: -66> 2023-10-05T11:39:55.832+0000 7fe62028b880 10 monclient(hunting): start opening mon connection 2023-10-05T11:39:55.978 INFO:tasks.workunit.client.0.smithi012.stderr: -65> 2023-10-05T11:39:55.832+0000 7fe62028b880 10 monclient(hunting): _renew_subs 2023-10-05T11:39:55.978 INFO:tasks.workunit.client.0.smithi012.stderr: -64> 2023-10-05T11:39:55.832+0000 7fe62028b880 10 monclient(hunting): authenticate will time out at 1504.001409s 2023-10-05T11:39:55.978 INFO:tasks.workunit.client.0.smithi012.stderr: -63> 2023-10-05T11:39:55.833+0000 7fe61e22f640 10 monclient(hunting): get_auth_request con 0x55dfb6d22000 auth_method 0 2023-10-05T11:39:55.978 INFO:tasks.workunit.client.0.smithi012.stderr: -62> 2023-10-05T11:39:55.833+0000 7fe61e22f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-10-05T11:39:55.978 INFO:tasks.workunit.client.0.smithi012.stderr: -61> 2023-10-05T11:39:55.833+0000 7fe61e22f640 10 monclient(hunting): _init_auth method 2 2023-10-05T11:39:55.978 INFO:tasks.workunit.client.0.smithi012.stderr: -60> 2023-10-05T11:39:55.833+0000 7fe61e22f640 10 monclient(hunting): _init_auth creating new auth 2023-10-05T11:39:55.978 INFO:tasks.workunit.client.0.smithi012.stderr: -59> 2023-10-05T11:39:55.833+0000 7fe61f231640 10 monclient(hunting): get_auth_request con 0x55dfb6ce1800 auth_method 0 2023-10-05T11:39:55.979 INFO:tasks.workunit.client.0.smithi012.stderr: -58> 2023-10-05T11:39:55.833+0000 7fe61f231640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-10-05T11:39:55.979 INFO:tasks.workunit.client.0.smithi012.stderr: -57> 2023-10-05T11:39:55.833+0000 7fe61f231640 10 monclient(hunting): _init_auth method 2 2023-10-05T11:39:55.979 INFO:tasks.workunit.client.0.smithi012.stderr: -56> 2023-10-05T11:39:55.833+0000 7fe61f231640 10 monclient(hunting): _init_auth creating new auth 2023-10-05T11:39:55.979 INFO:tasks.workunit.client.0.smithi012.stderr: -55> 2023-10-05T11:39:55.833+0000 7fe61e22f640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-10-05T11:39:55.979 INFO:tasks.workunit.client.0.smithi012.stderr: -54> 2023-10-05T11:39:55.833+0000 7fe61e22f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-10-05T11:39:55.979 INFO:tasks.workunit.client.0.smithi012.stderr: -53> 2023-10-05T11:39:55.833+0000 7fe61e22f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-10-05T11:39:55.979 INFO:tasks.workunit.client.0.smithi012.stderr: -52> 2023-10-05T11:39:55.833+0000 7fe61f231640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-10-05T11:39:55.979 INFO:tasks.workunit.client.0.smithi012.stderr: -51> 2023-10-05T11:39:55.833+0000 7fe61f231640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-10-05T11:39:55.979 INFO:tasks.workunit.client.0.smithi012.stderr: -50> 2023-10-05T11:39:55.833+0000 7fe61f231640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-10-05T11:39:55.979 INFO:tasks.workunit.client.0.smithi012.stderr: -49> 2023-10-05T11:39:55.833+0000 7fe61e22f640 10 monclient(hunting): handle_auth_done global_id 6594 payload 824 2023-10-05T11:39:55.979 INFO:tasks.workunit.client.0.smithi012.stderr: -48> 2023-10-05T11:39:55.833+0000 7fe61e22f640 10 monclient: _finish_hunting 0 2023-10-05T11:39:55.979 INFO:tasks.workunit.client.0.smithi012.stderr: -47> 2023-10-05T11:39:55.833+0000 7fe61e22f640 1 monclient: found mon.noname-a 2023-10-05T11:39:55.979 INFO:tasks.workunit.client.0.smithi012.stderr: -46> 2023-10-05T11:39:55.833+0000 7fe61e22f640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.12:3300/0 2023-10-05T11:39:55.980 INFO:tasks.workunit.client.0.smithi012.stderr: -45> 2023-10-05T11:39:55.833+0000 7fe6039fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-10-05T11:39:55.980 INFO:tasks.workunit.client.0.smithi012.stderr: -44> 2023-10-05T11:39:55.833+0000 7fe6039fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2023-10-05T11:39:55.980 INFO:tasks.workunit.client.0.smithi012.stderr: -43> 2023-10-05T11:39:55.833+0000 7fe6039fa640 10 monclient: dump: 2023-10-05T11:39:55.980 INFO:tasks.workunit.client.0.smithi012.stderr:epoch 1 2023-10-05T11:39:55.980 INFO:tasks.workunit.client.0.smithi012.stderr:fsid 7e015f46-293b-4b09-bd32-7d32b52f6e2f 2023-10-05T11:39:55.980 INFO:tasks.workunit.client.0.smithi012.stderr:last_changed 2023-10-05T11:27:38.366888+0000 2023-10-05T11:39:55.980 INFO:tasks.workunit.client.0.smithi012.stderr:created 2023-10-05T11:27:38.366888+0000 2023-10-05T11:39:55.980 INFO:tasks.workunit.client.0.smithi012.stderr:min_mon_release 18 (reef) 2023-10-05T11:39:55.980 INFO:tasks.workunit.client.0.smithi012.stderr:election_strategy: 1 2023-10-05T11:39:55.980 INFO:tasks.workunit.client.0.smithi012.stderr:0: [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon.a 2023-10-05T11:39:55.980 INFO:tasks.workunit.client.0.smithi012.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2023-10-05T11:39:55.980 INFO:tasks.workunit.client.0.smithi012.stderr:2: [v2:172.21.15.12:3301/0,v1:172.21.15.12:6790/0] mon.c 2023-10-05T11:39:55.981 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:39:55.981 INFO:tasks.workunit.client.0.smithi012.stderr: -42> 2023-10-05T11:39:55.833+0000 7fe6039fa640 10 monclient: _finish_auth 0 2023-10-05T11:39:55.981 INFO:tasks.workunit.client.0.smithi012.stderr: -41> 2023-10-05T11:39:55.833+0000 7fe6039fa640 10 monclient: _check_auth_tickets 2023-10-05T11:39:55.981 INFO:tasks.workunit.client.0.smithi012.stderr: -40> 2023-10-05T11:39:55.833+0000 7fe6039fa640 10 monclient: handle_config config(0 keys) v1 2023-10-05T11:39:55.981 INFO:tasks.workunit.client.0.smithi012.stderr: -39> 2023-10-05T11:39:55.833+0000 7fe6039fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-10-05T11:39:55.981 INFO:tasks.workunit.client.0.smithi012.stderr: -38> 2023-10-05T11:39:55.833+0000 7fe6039fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2023-10-05T11:39:55.981 INFO:tasks.workunit.client.0.smithi012.stderr: -37> 2023-10-05T11:39:55.833+0000 7fe6051fd640 4 set_mon_vals no callback set 2023-10-05T11:39:55.981 INFO:tasks.workunit.client.0.smithi012.stderr: -36> 2023-10-05T11:39:55.833+0000 7fe6039fa640 10 monclient: dump: 2023-10-05T11:39:55.981 INFO:tasks.workunit.client.0.smithi012.stderr:epoch 1 2023-10-05T11:39:55.981 INFO:tasks.workunit.client.0.smithi012.stderr:fsid 7e015f46-293b-4b09-bd32-7d32b52f6e2f 2023-10-05T11:39:55.981 INFO:tasks.workunit.client.0.smithi012.stderr:last_changed 2023-10-05T11:27:38.366888+0000 2023-10-05T11:39:55.981 INFO:tasks.workunit.client.0.smithi012.stderr:created 2023-10-05T11:27:38.366888+0000 2023-10-05T11:39:55.982 INFO:tasks.workunit.client.0.smithi012.stderr:min_mon_release 18 (reef) 2023-10-05T11:39:55.982 INFO:tasks.workunit.client.0.smithi012.stderr:election_strategy: 1 2023-10-05T11:39:55.982 INFO:tasks.workunit.client.0.smithi012.stderr:0: [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon.a 2023-10-05T11:39:55.982 INFO:tasks.workunit.client.0.smithi012.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2023-10-05T11:39:55.982 INFO:tasks.workunit.client.0.smithi012.stderr:2: [v2:172.21.15.12:3301/0,v1:172.21.15.12:6790/0] mon.c 2023-10-05T11:39:55.982 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:39:55.982 INFO:tasks.workunit.client.0.smithi012.stderr: -35> 2023-10-05T11:39:55.833+0000 7fe62028b880 5 monclient: authenticate success, global_id 6594 2023-10-05T11:39:55.982 INFO:tasks.workunit.client.0.smithi012.stderr: -34> 2023-10-05T11:39:55.833+0000 7fe62028b880 10 monclient: _renew_subs 2023-10-05T11:39:55.982 INFO:tasks.workunit.client.0.smithi012.stderr: -33> 2023-10-05T11:39:55.833+0000 7fe62028b880 10 monclient: _send_mon_message to mon.a at v2:172.21.15.12:3300/0 2023-10-05T11:39:55.982 INFO:tasks.workunit.client.0.smithi012.stderr: -32> 2023-10-05T11:39:55.833+0000 7fe62028b880 10 monclient: _renew_subs 2023-10-05T11:39:55.982 INFO:tasks.workunit.client.0.smithi012.stderr: -31> 2023-10-05T11:39:55.833+0000 7fe62028b880 10 monclient: _send_mon_message to mon.a at v2:172.21.15.12:3300/0 2023-10-05T11:39:55.982 INFO:tasks.workunit.client.0.smithi012.stderr: -30> 2023-10-05T11:39:55.833+0000 7fe62028b880 1 librados: init done 2023-10-05T11:39:55.983 INFO:tasks.workunit.client.0.smithi012.stderr: -29> 2023-10-05T11:39:55.833+0000 7fe62028b880 5 asok(0x55dfb6b00000) register_command cr dump hook 0x55dfb76d7408 2023-10-05T11:39:55.983 INFO:tasks.workunit.client.0.smithi012.stderr: -28> 2023-10-05T11:39:55.835+0000 7fe6039fa640 4 mgrc handle_mgr_map Got map version 5 2023-10-05T11:39:55.983 INFO:tasks.workunit.client.0.smithi012.stderr: -27> 2023-10-05T11:39:55.835+0000 7fe6039fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.170:6832/180516904,v1:172.21.15.170:6833/180516904] 2023-10-05T11:39:55.983 INFO:tasks.workunit.client.0.smithi012.stderr: -26> 2023-10-05T11:39:55.835+0000 7fe6039fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.170:6832/180516904,v1:172.21.15.170:6833/180516904] 2023-10-05T11:39:55.983 INFO:tasks.workunit.client.0.smithi012.stderr: -25> 2023-10-05T11:39:55.835+0000 7fe62028b880 5 note: GC not initialized 2023-10-05T11:39:55.983 INFO:tasks.workunit.client.0.smithi012.stderr: -24> 2023-10-05T11:39:55.835+0000 7fe61f231640 10 monclient: get_auth_request con 0x55dfb6dee000 auth_method 0 2023-10-05T11:39:55.983 INFO:tasks.workunit.client.0.smithi012.stderr: -23> 2023-10-05T11:39:55.835+0000 7fe6011f5640 20 reqs_thread_entry: start 2023-10-05T11:39:55.983 INFO:tasks.workunit.client.0.smithi012.stderr: -22> 2023-10-05T11:39:55.835+0000 7fe62028b880 5 asok(0x55dfb6b00000) register_command sync trace show hook 0x55dfb684aa80 2023-10-05T11:39:55.983 INFO:tasks.workunit.client.0.smithi012.stderr: -21> 2023-10-05T11:39:55.835+0000 7fe62028b880 5 asok(0x55dfb6b00000) register_command sync trace history hook 0x55dfb684aa80 2023-10-05T11:39:55.983 INFO:tasks.workunit.client.0.smithi012.stderr: -20> 2023-10-05T11:39:55.835+0000 7fe62028b880 5 asok(0x55dfb6b00000) register_command sync trace active hook 0x55dfb684aa80 2023-10-05T11:39:55.983 INFO:tasks.workunit.client.0.smithi012.stderr: -19> 2023-10-05T11:39:55.835+0000 7fe62028b880 5 asok(0x55dfb6b00000) register_command sync trace active_short hook 0x55dfb684aa80 2023-10-05T11:39:55.983 INFO:tasks.workunit.client.0.smithi012.stderr: -18> 2023-10-05T11:39:55.835+0000 7fe62028b880 20 init_complete bucket index max shards: 11 2023-10-05T11:39:55.984 INFO:tasks.workunit.client.0.smithi012.stderr: -17> 2023-10-05T11:39:55.835+0000 7fe62028b880 20 Filter name: none 2023-10-05T11:39:55.984 INFO:tasks.workunit.client.0.smithi012.stderr: -16> 2023-10-05T11:39:55.835+0000 7fe5ff1f1640 20 reqs_thread_entry: start 2023-10-05T11:39:55.984 INFO:tasks.workunit.client.0.smithi012.stderr: -15> 2023-10-05T11:39:55.835+0000 7fe62028b880 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2023-10-05T11:39:55.984 INFO:tasks.workunit.client.0.smithi012.stderr: -14> 2023-10-05T11:39:55.835+0000 7fe62028b880 20 rados->read ofs=0 len=0 2023-10-05T11:39:55.984 INFO:tasks.workunit.client.0.smithi012.stderr: -13> 2023-10-05T11:39:55.836+0000 7fe62028b880 20 rados_obj.operate() r=0 bl.length=218 2023-10-05T11:39:55.984 INFO:tasks.workunit.client.0.smithi012.stderr: -12> 2023-10-05T11:39:55.836+0000 7fe62028b880 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2023-10-05T11:39:55.984 INFO:tasks.workunit.client.0.smithi012.stderr: -11> 2023-10-05T11:39:55.836+0000 7fe62028b880 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2023-10-05T11:39:55.984 INFO:tasks.workunit.client.0.smithi012.stderr: -10> 2023-10-05T11:39:55.836+0000 7fe62028b880 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.20 : miss 2023-10-05T11:39:55.984 INFO:tasks.workunit.client.0.smithi012.stderr: -9> 2023-10-05T11:39:55.836+0000 7fe62028b880 20 rados->read ofs=0 len=0 2023-10-05T11:39:55.984 INFO:tasks.workunit.client.0.smithi012.stderr: -8> 2023-10-05T11:39:55.836+0000 7fe62028b880 20 rados_obj.operate() r=0 bl.length=390 2023-10-05T11:39:55.984 INFO:tasks.workunit.client.0.smithi012.stderr: -7> 2023-10-05T11:39:55.836+0000 7fe62028b880 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.20 info.flags=0x17 2023-10-05T11:39:55.984 INFO:tasks.workunit.client.0.smithi012.stderr: -6> 2023-10-05T11:39:55.836+0000 7fe62028b880 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.20 to cache LRU end 2023-10-05T11:39:55.985 INFO:tasks.workunit.client.0.smithi012.stderr: -5> 2023-10-05T11:39:55.836+0000 7fe62028b880 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T11:39:55.985 INFO:tasks.workunit.client.0.smithi012.stderr: -4> 2023-10-05T11:39:55.836+0000 7fe62028b880 10 updating xattr: name=user.rgw.acl bl.length()=265 2023-10-05T11:39:55.985 INFO:tasks.workunit.client.0.smithi012.stderr: -3> 2023-10-05T11:39:55.836+0000 7fe62028b880 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.20 2023-10-05T11:39:55.985 INFO:tasks.workunit.client.0.smithi012.stderr: -2> 2023-10-05T11:39:55.837+0000 7fe61ea30640 10 monclient: get_auth_request con 0x55dfb6d22800 auth_method 0 2023-10-05T11:39:55.985 INFO:tasks.workunit.client.0.smithi012.stderr: -1> 2023-10-05T11:39:55.842+0000 7fe62028b880 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6543-g38321be8/rpm/el9/BUILD/ceph-18.0.0-6543-g38321be8/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fe62028b880 time 2023-10-05T11:39:55.842864+0000 2023-10-05T11:39:55.985 INFO:tasks.workunit.client.0.smithi012.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6543-g38321be8/rpm/el9/BUILD/ceph-18.0.0-6543-g38321be8/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2023-10-05T11:39:55.985 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:39:55.985 INFO:tasks.workunit.client.0.smithi012.stderr: ceph version 18.0.0-6543-g38321be8 (38321be854743c0d616618a9ea8aa0b1d4dbc0bf) reef (dev) 2023-10-05T11:39:55.985 INFO:tasks.workunit.client.0.smithi012.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fe624f6d15f] 2023-10-05T11:39:55.985 INFO:tasks.workunit.client.0.smithi012.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16d31d) [0x7fe624f6d31d] 2023-10-05T11:39:55.985 INFO:tasks.workunit.client.0.smithi012.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55dfb540dc31] 2023-10-05T11:39:55.986 INFO:tasks.workunit.client.0.smithi012.stderr: 4: radosgw-admin(+0x79c6d2) [0x55dfb541b6d2] 2023-10-05T11:39:55.986 INFO:tasks.workunit.client.0.smithi012.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x24b) [0x55dfb54246db] 2023-10-05T11:39:55.986 INFO:tasks.workunit.client.0.smithi012.stderr: 6: main() 2023-10-05T11:39:55.986 INFO:tasks.workunit.client.0.smithi012.stderr: 7: /lib64/libc.so.6(+0x3feb0) [0x7fe62243feb0] 2023-10-05T11:39:55.986 INFO:tasks.workunit.client.0.smithi012.stderr: 8: __libc_start_main() 2023-10-05T11:39:55.986 INFO:tasks.workunit.client.0.smithi012.stderr: 9: _start() 2023-10-05T11:39:55.986 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:39:55.986 INFO:tasks.workunit.client.0.smithi012.stderr: 0> 2023-10-05T11:39:55.843+0000 7fe62028b880 -1 *** Caught signal (Aborted) ** 2023-10-05T11:39:55.986 INFO:tasks.workunit.client.0.smithi012.stderr: in thread 7fe62028b880 thread_name:radosgw-admin 2023-10-05T11:39:55.986 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:39:55.986 INFO:tasks.workunit.client.0.smithi012.stderr: ceph version 18.0.0-6543-g38321be8 (38321be854743c0d616618a9ea8aa0b1d4dbc0bf) reef (dev) 2023-10-05T11:39:55.986 INFO:tasks.workunit.client.0.smithi012.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7fe622454db0] 2023-10-05T11:39:55.987 INFO:tasks.workunit.client.0.smithi012.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7fe6224a154c] 2023-10-05T11:39:55.987 INFO:tasks.workunit.client.0.smithi012.stderr: 3: raise() 2023-10-05T11:39:55.987 INFO:tasks.workunit.client.0.smithi012.stderr: 4: abort() 2023-10-05T11:39:55.987 INFO:tasks.workunit.client.0.smithi012.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fe624f6d1b9] 2023-10-05T11:39:55.987 INFO:tasks.workunit.client.0.smithi012.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16d31d) [0x7fe624f6d31d] 2023-10-05T11:39:55.987 INFO:tasks.workunit.client.0.smithi012.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55dfb540dc31] 2023-10-05T11:39:55.987 INFO:tasks.workunit.client.0.smithi012.stderr: 8: radosgw-admin(+0x79c6d2) [0x55dfb541b6d2] 2023-10-05T11:39:55.987 INFO:tasks.workunit.client.0.smithi012.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x24b) [0x55dfb54246db] 2023-10-05T11:39:55.987 INFO:tasks.workunit.client.0.smithi012.stderr: 10: main() 2023-10-05T11:39:55.987 INFO:tasks.workunit.client.0.smithi012.stderr: 11: /lib64/libc.so.6(+0x3feb0) [0x7fe62243feb0] 2023-10-05T11:39:55.987 INFO:tasks.workunit.client.0.smithi012.stderr: 12: __libc_start_main() 2023-10-05T11:39:55.987 INFO:tasks.workunit.client.0.smithi012.stderr: 13: _start() 2023-10-05T11:39:55.988 INFO:tasks.workunit.client.0.smithi012.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-10-05T11:39:55.988 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:39:55.988 INFO:tasks.workunit.client.0.smithi012.stderr:--- logging levels --- 2023-10-05T11:39:55.988 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 none 2023-10-05T11:39:55.988 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 1 lockdep 2023-10-05T11:39:55.988 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 1 context 2023-10-05T11:39:55.988 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 1 crush 2023-10-05T11:39:55.988 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 mds 2023-10-05T11:39:55.988 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 mds_balancer 2023-10-05T11:39:55.988 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 mds_locker 2023-10-05T11:39:55.988 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 mds_log 2023-10-05T11:39:55.988 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 mds_log_expire 2023-10-05T11:39:55.988 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 mds_migrator 2023-10-05T11:39:55.989 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 1 buffer 2023-10-05T11:39:55.989 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 1 timer 2023-10-05T11:39:55.989 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 1 filer 2023-10-05T11:39:55.989 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 1 striper 2023-10-05T11:39:55.989 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 1 objecter 2023-10-05T11:39:55.989 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 rados 2023-10-05T11:39:55.989 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 rbd 2023-10-05T11:39:55.989 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 rbd_mirror 2023-10-05T11:39:55.989 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 rbd_replay 2023-10-05T11:39:55.989 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 rbd_pwl 2023-10-05T11:39:55.989 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 journaler 2023-10-05T11:39:55.989 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 objectcacher 2023-10-05T11:39:55.990 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 immutable_obj_cache 2023-10-05T11:39:55.990 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 client 2023-10-05T11:39:55.990 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 osd 2023-10-05T11:39:55.990 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 optracker 2023-10-05T11:39:55.990 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 objclass 2023-10-05T11:39:55.990 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 3 filestore 2023-10-05T11:39:55.990 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 3 journal 2023-10-05T11:39:55.990 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 0 ms 2023-10-05T11:39:55.990 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 mon 2023-10-05T11:39:55.990 INFO:tasks.workunit.client.0.smithi012.stderr: 0/10 monc 2023-10-05T11:39:55.990 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 paxos 2023-10-05T11:39:55.990 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 tp 2023-10-05T11:39:55.991 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 auth 2023-10-05T11:39:55.991 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 crypto 2023-10-05T11:39:55.991 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 1 finisher 2023-10-05T11:39:55.991 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 1 reserver 2023-10-05T11:39:55.991 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 heartbeatmap 2023-10-05T11:39:55.991 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 perfcounter 2023-10-05T11:39:55.991 INFO:tasks.workunit.client.0.smithi012.stderr: 20/20 rgw 2023-10-05T11:39:55.991 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 rgw_sync 2023-10-05T11:39:55.991 INFO:tasks.workunit.client.0.smithi012.stderr: 30/30 rgw_datacache 2023-10-05T11:39:55.991 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 rgw_access 2023-10-05T11:39:55.991 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 rgw_dbstore 2023-10-05T11:39:55.991 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 rgw_flight 2023-10-05T11:39:55.991 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 javaclient 2023-10-05T11:39:55.992 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 asok 2023-10-05T11:39:55.992 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 1 throttle 2023-10-05T11:39:55.992 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 0 refs 2023-10-05T11:39:55.992 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 compressor 2023-10-05T11:39:55.992 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 bluestore 2023-10-05T11:39:55.992 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 bluefs 2023-10-05T11:39:55.992 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 3 bdev 2023-10-05T11:39:55.992 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 kstore 2023-10-05T11:39:55.992 INFO:tasks.workunit.client.0.smithi012.stderr: 4/ 5 rocksdb 2023-10-05T11:39:55.992 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 fuse 2023-10-05T11:39:55.992 INFO:tasks.workunit.client.0.smithi012.stderr: 2/ 5 mgr 2023-10-05T11:39:55.992 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 mgrc 2023-10-05T11:39:55.993 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 dpdk 2023-10-05T11:39:55.993 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 eventtrace 2023-10-05T11:39:55.993 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 prioritycache 2023-10-05T11:39:55.993 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 test 2023-10-05T11:39:55.993 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 cephfs_mirror 2023-10-05T11:39:55.993 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 cephsqlite 2023-10-05T11:39:55.993 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 seastore 2023-10-05T11:39:55.993 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 seastore_onode 2023-10-05T11:39:55.993 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 seastore_odata 2023-10-05T11:39:55.993 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 seastore_omap 2023-10-05T11:39:55.993 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 seastore_tm 2023-10-05T11:39:55.993 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 seastore_t 2023-10-05T11:39:55.993 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 seastore_cleaner 2023-10-05T11:39:55.994 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 seastore_epm 2023-10-05T11:39:55.994 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 seastore_lba 2023-10-05T11:39:55.994 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 seastore_fixedkv_tree 2023-10-05T11:39:55.994 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 seastore_cache 2023-10-05T11:39:55.994 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 seastore_journal 2023-10-05T11:39:55.994 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 seastore_device 2023-10-05T11:39:55.994 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 seastore_backref 2023-10-05T11:39:55.994 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 alienstore 2023-10-05T11:39:55.994 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 mclock 2023-10-05T11:39:55.994 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 cyanstore 2023-10-05T11:39:55.994 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 ceph_exporter 2023-10-05T11:39:55.994 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 memstore 2023-10-05T11:39:55.995 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 trace 2023-10-05T11:39:55.995 INFO:tasks.workunit.client.0.smithi012.stderr: -2/-2 (syslog threshold) 2023-10-05T11:39:55.995 INFO:tasks.workunit.client.0.smithi012.stderr: 99/99 (stderr threshold) 2023-10-05T11:39:55.995 INFO:tasks.workunit.client.0.smithi012.stderr:--- pthread ID / name mapping for recent threads --- 2023-10-05T11:39:55.995 INFO:tasks.workunit.client.0.smithi012.stderr: 7fe5ff1f1640 / http_manager 2023-10-05T11:39:55.995 INFO:tasks.workunit.client.0.smithi012.stderr: 7fe6011f5640 / http_manager 2023-10-05T11:39:55.995 INFO:tasks.workunit.client.0.smithi012.stderr: 7fe6039fa640 / ms_dispatch 2023-10-05T11:39:55.995 INFO:tasks.workunit.client.0.smithi012.stderr: 7fe6051fd640 / io_context_pool 2023-10-05T11:39:55.995 INFO:tasks.workunit.client.0.smithi012.stderr: 7fe6059fe640 / rgw_dt_lg_renew 2023-10-05T11:39:55.995 INFO:tasks.workunit.client.0.smithi012.stderr: 7fe617a22640 / ms_dispatch 2023-10-05T11:39:55.995 INFO:tasks.workunit.client.0.smithi012.stderr: 7fe619225640 / io_context_pool 2023-10-05T11:39:55.995 INFO:tasks.workunit.client.0.smithi012.stderr: 7fe61ba2a640 / ms_dispatch 2023-10-05T11:39:55.996 INFO:tasks.workunit.client.0.smithi012.stderr: 7fe61d22d640 / io_context_pool 2023-10-05T11:39:55.996 INFO:tasks.workunit.client.0.smithi012.stderr: 7fe61e22f640 / msgr-worker-2 2023-10-05T11:39:55.996 INFO:tasks.workunit.client.0.smithi012.stderr: 7fe61ea30640 / msgr-worker-1 2023-10-05T11:39:55.996 INFO:tasks.workunit.client.0.smithi012.stderr: 7fe61f231640 / msgr-worker-0 2023-10-05T11:39:55.996 INFO:tasks.workunit.client.0.smithi012.stderr: 7fe62028b880 / radosgw-admin 2023-10-05T11:39:55.996 INFO:tasks.workunit.client.0.smithi012.stderr: max_recent 500 2023-10-05T11:39:55.996 INFO:tasks.workunit.client.0.smithi012.stderr: max_new 1000 2023-10-05T11:39:55.996 INFO:tasks.workunit.client.0.smithi012.stderr: log_file /var/lib/ceph/crash/2023-10-05T11:39:55.844453Z_7aa01862-ca4a-4560-b529-befc89b0537a/log 2023-10-05T11:39:55.996 INFO:tasks.workunit.client.0.smithi012.stderr:--- end dump of recent events --- 2023-10-05T11:39:55.996 INFO:tasks.workunit.client.0.smithi012.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2023-10-05T11:39:56.001 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setuser ceph since I am not root 2023-10-05T11:39:56.001 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T11:39:56.001 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.891+0000 7fca1ab4b880 20 rados->read ofs=0 len=0 2023-10-05T11:39:56.001 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.892+0000 7fca1ab4b880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:56.002 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.892+0000 7fca1ab4b880 20 realm 2023-10-05T11:39:56.002 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.892+0000 7fca1ab4b880 20 rados->read ofs=0 len=0 2023-10-05T11:39:56.002 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.892+0000 7fca1ab4b880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:56.002 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.892+0000 7fca1ab4b880 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T11:39:56.002 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.892+0000 7fca1ab4b880 20 rados->read ofs=0 len=0 2023-10-05T11:39:56.002 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.892+0000 7fca1ab4b880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:56.002 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.892+0000 7fca1ab4b880 20 rados->read ofs=0 len=0 2023-10-05T11:39:56.002 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.893+0000 7fca1ab4b880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:39:56.002 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.893+0000 7fca1ab4b880 20 rados->read ofs=0 len=0 2023-10-05T11:39:56.002 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.894+0000 7fca1ab4b880 20 rados_obj.operate() r=0 bl.length=1020 2023-10-05T11:39:56.002 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.894+0000 7fca1ab4b880 20 searching for the correct realm 2023-10-05T11:39:56.003 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.904+0000 7fca1ab4b880 20 RGWRados::pool_iterate: got zone_info.dff27d1e-df33-400e-a68a-7ba586947c99 2023-10-05T11:39:56.003 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.904+0000 7fca1ab4b880 20 RGWRados::pool_iterate: got zonegroup_info.c78aa576-9d15-4e9d-b3c0-4af23a22062c 2023-10-05T11:39:56.003 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.904+0000 7fca1ab4b880 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T11:39:56.003 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.904+0000 7fca1ab4b880 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T11:39:56.003 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.904+0000 7fca1ab4b880 20 rados->read ofs=0 len=0 2023-10-05T11:39:56.003 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.905+0000 7fca1ab4b880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:56.003 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.905+0000 7fca1ab4b880 20 rados->read ofs=0 len=0 2023-10-05T11:39:56.003 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.905+0000 7fca192f0640 0 -- 172.21.15.12:0/3358029833 >> [v2:172.21.15.170:6814/3150808418,v1:172.21.15.170:6816/3150808418] conn(0x55cd0622b400 msgr2=0x55cd0563ec00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:39:56.003 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.905+0000 7fca1ab4b880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:39:56.003 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.905+0000 7fca1ab4b880 20 rados->read ofs=0 len=0 2023-10-05T11:39:56.003 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.906+0000 7fca1ab4b880 20 rados_obj.operate() r=0 bl.length=454 2023-10-05T11:39:56.003 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.906+0000 7fca1ab4b880 20 zone default found 2023-10-05T11:39:56.004 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.906+0000 7fca1ab4b880 4 Realm: () 2023-10-05T11:39:56.004 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.906+0000 7fca1ab4b880 4 ZoneGroup: default (c78aa576-9d15-4e9d-b3c0-4af23a22062c) 2023-10-05T11:39:56.004 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.906+0000 7fca1ab4b880 4 Zone: default (dff27d1e-df33-400e-a68a-7ba586947c99) 2023-10-05T11:39:56.004 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.906+0000 7fca1ab4b880 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T11:39:56.004 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.906+0000 7fca1ab4b880 20 zonegroup default 2023-10-05T11:39:56.004 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.906+0000 7fca1ab4b880 20 rados->read ofs=0 len=0 2023-10-05T11:39:56.004 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.906+0000 7fca1ab4b880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:56.004 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.906+0000 7fca1ab4b880 20 rados->read ofs=0 len=0 2023-10-05T11:39:56.004 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.906+0000 7fca1ab4b880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:56.004 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.906+0000 7fca1ab4b880 20 rados->read ofs=0 len=0 2023-10-05T11:39:56.004 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.907+0000 7fca1ab4b880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:56.004 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.907+0000 7fca1ab4b880 20 started sync module instance, tier type = 2023-10-05T11:39:56.005 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.907+0000 7fca1ab4b880 20 started zone id=dff27d1e-df33-400e-a68a-7ba586947c99 (name=default) with tier type = 2023-10-05T11:39:56.005 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.915+0000 7fca1ab4b880 20 add_watcher() i=0 2023-10-05T11:39:56.005 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.915+0000 7fca1ab4b880 20 add_watcher() i=1 2023-10-05T11:39:56.005 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.915+0000 7fca1ab4b880 20 add_watcher() i=2 2023-10-05T11:39:56.005 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.915+0000 7fca1ab4b880 20 add_watcher() i=3 2023-10-05T11:39:56.005 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.915+0000 7fca1ab4b880 20 add_watcher() i=4 2023-10-05T11:39:56.005 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.915+0000 7fca1ab4b880 20 add_watcher() i=5 2023-10-05T11:39:56.005 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.915+0000 7fca1ab4b880 20 add_watcher() i=6 2023-10-05T11:39:56.005 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.916+0000 7fca192f0640 0 -- 172.21.15.12:0/3358029833 >> [v2:172.21.15.12:6808/396693578,v1:172.21.15.12:6809/396693578] conn(0x55cd05715400 msgr2=0x55cd05703b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:39:56.005 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.916+0000 7fca1ab4b880 20 add_watcher() i=7 2023-10-05T11:39:56.005 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.916+0000 7fca1ab4b880 2 all 8 watchers are set, enabling cache 2023-10-05T11:39:56.005 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.918+0000 7fca002be640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:39:56.005 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.919+0000 7fca1ab4b880 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T11:39:56.006 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.919+0000 7fca1ab4b880 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T11:39:56.006 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.924+0000 7fca1ab4b880 5 note: GC not initialized 2023-10-05T11:39:56.006 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.924+0000 7fc9fbab5640 20 reqs_thread_entry: start 2023-10-05T11:39:56.006 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.924+0000 7fca1ab4b880 20 init_complete bucket index max shards: 11 2023-10-05T11:39:56.006 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.924+0000 7fca1ab4b880 20 Filter name: none 2023-10-05T11:39:56.006 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.924+0000 7fc9f9ab1640 20 reqs_thread_entry: start 2023-10-05T11:39:56.006 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.924+0000 7fca1ab4b880 20 rados->read ofs=0 len=0 2023-10-05T11:39:56.006 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.925+0000 7fca1ab4b880 20 rados_obj.operate() r=0 bl.length=218 2023-10-05T11:39:56.006 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.925+0000 7fca1ab4b880 20 rados->read ofs=0 len=0 2023-10-05T11:39:56.006 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.925+0000 7fca1ab4b880 20 rados_obj.operate() r=0 bl.length=390 2023-10-05T11:39:56.006 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.925+0000 7fca1ab4b880 20 couldn't put binfo cache entry, might have raced with data changes 2023-10-05T11:39:56.006 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.925+0000 7fca1ab4b880 20 rados->read ofs=0 len=0 2023-10-05T11:39:56.007 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.926+0000 7fca1ab4b880 20 rados_obj.operate() r=0 bl.length=218 2023-10-05T11:39:56.007 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.926+0000 7fca1ab4b880 20 rados->read ofs=0 len=0 2023-10-05T11:39:56.007 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.926+0000 7fca1ab4b880 20 rados_obj.operate() r=0 bl.length=390 2023-10-05T11:39:56.007 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.926+0000 7fca1ab4b880 20 couldn't put binfo cache entry, might have raced with data changes 2023-10-05T11:39:56.007 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.927+0000 7fca1ab4b880 20 rados->read ofs=0 len=0 2023-10-05T11:39:56.007 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.927+0000 7fca1ab4b880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:56.007 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.928+0000 7fca002be640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:39:56.007 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.930+0000 7fca1ab4b880 20 remove_watcher() i=0 2023-10-05T11:39:56.007 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.930+0000 7fca1ab4b880 2 removed watcher, disabling cache 2023-10-05T11:39:56.007 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.931+0000 7fca1ab4b880 20 remove_watcher() i=1 2023-10-05T11:39:56.007 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.932+0000 7fca1ab4b880 20 remove_watcher() i=2 2023-10-05T11:39:56.007 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.933+0000 7fca1ab4b880 20 remove_watcher() i=3 2023-10-05T11:39:56.008 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.934+0000 7fca1ab4b880 20 remove_watcher() i=4 2023-10-05T11:39:56.008 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.935+0000 7fca1ab4b880 20 remove_watcher() i=5 2023-10-05T11:39:56.008 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.936+0000 7fca1ab4b880 20 remove_watcher() i=6 2023-10-05T11:39:56.008 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:55.937+0000 7fca1ab4b880 20 remove_watcher() i=7 2023-10-05T11:39:56.008 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:39:56.008 INFO:tasks.workunit.client.0.smithi012.stderr:BUCKET_STATS: 2023-10-05T11:39:56.008 INFO:tasks.workunit.client.0.smithi012.stderr:bucket: abort-at-set-target-layout id: dff27d1e-df33-400e-a68a-7ba586947c99.4604.20 num_objects: 20 size_kb: 1 num_shards: 11 2023-10-05T11:39:56.008 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:39:56.026 INFO:tasks.workunit.client.0.smithi012.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2023-10-05T11:39:56.058 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setuser ceph since I am not root 2023-10-05T11:39:56.058 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T11:39:56.071 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:56.068+0000 7f0f2651e880 20 rados->read ofs=0 len=0 2023-10-05T11:39:56.073 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:56.069+0000 7f0f2651e880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:56.073 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:56.069+0000 7f0f2651e880 20 realm 2023-10-05T11:39:56.073 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:56.069+0000 7f0f2651e880 20 rados->read ofs=0 len=0 2023-10-05T11:39:56.073 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:56.070+0000 7f0f2651e880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:56.074 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:56.070+0000 7f0f2651e880 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T11:39:56.074 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:56.070+0000 7f0f2651e880 20 rados->read ofs=0 len=0 2023-10-05T11:39:56.074 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:56.070+0000 7f0f2651e880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:56.074 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:56.070+0000 7f0f2651e880 20 rados->read ofs=0 len=0 2023-10-05T11:39:56.074 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:56.071+0000 7f0f2651e880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:39:56.074 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:56.071+0000 7f0f2651e880 20 rados->read ofs=0 len=0 2023-10-05T11:39:56.075 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:56.071+0000 7f0f2651e880 20 rados_obj.operate() r=0 bl.length=1020 2023-10-05T11:39:56.075 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:56.071+0000 7f0f2651e880 20 searching for the correct realm 2023-10-05T11:39:56.081 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:56.078+0000 7f0f254cb640 0 -- 172.21.15.12:0/163170856 >> [v2:172.21.15.12:6813/3341239609,v1:172.21.15.12:6815/3341239609] conn(0x56277fefb400 msgr2=0x56277f30b180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:39:56.085 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:56.081+0000 7f0f2651e880 20 RGWRados::pool_iterate: got zone_info.dff27d1e-df33-400e-a68a-7ba586947c99 2023-10-05T11:39:56.085 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:56.081+0000 7f0f2651e880 20 RGWRados::pool_iterate: got zonegroup_info.c78aa576-9d15-4e9d-b3c0-4af23a22062c 2023-10-05T11:39:56.085 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:56.081+0000 7f0f2651e880 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T11:39:56.085 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:56.081+0000 7f0f2651e880 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T11:39:56.085 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:56.081+0000 7f0f2651e880 20 rados->read ofs=0 len=0 2023-10-05T11:39:56.086 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:56.082+0000 7f0f2651e880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:56.087 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:56.082+0000 7f0f2651e880 20 rados->read ofs=0 len=0 2023-10-05T11:39:56.087 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:56.082+0000 7f0f2651e880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:39:56.087 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:56.082+0000 7f0f2651e880 20 rados->read ofs=0 len=0 2023-10-05T11:39:56.087 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:56.082+0000 7f0f2651e880 20 rados_obj.operate() r=0 bl.length=454 2023-10-05T11:39:56.087 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:56.082+0000 7f0f2651e880 20 zone default found 2023-10-05T11:39:56.087 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:56.082+0000 7f0f2651e880 4 Realm: () 2023-10-05T11:39:56.087 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:56.082+0000 7f0f2651e880 4 ZoneGroup: default (c78aa576-9d15-4e9d-b3c0-4af23a22062c) 2023-10-05T11:39:56.087 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:56.082+0000 7f0f2651e880 4 Zone: default (dff27d1e-df33-400e-a68a-7ba586947c99) 2023-10-05T11:39:56.087 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:56.082+0000 7f0f2651e880 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T11:39:56.087 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:56.082+0000 7f0f2651e880 20 zonegroup default 2023-10-05T11:39:56.087 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:56.082+0000 7f0f2651e880 20 rados->read ofs=0 len=0 2023-10-05T11:39:56.088 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:56.082+0000 7f0f2651e880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:56.088 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:56.082+0000 7f0f2651e880 20 rados->read ofs=0 len=0 2023-10-05T11:39:56.088 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:56.083+0000 7f0f2651e880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:56.088 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:56.083+0000 7f0f2651e880 20 rados->read ofs=0 len=0 2023-10-05T11:39:56.088 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:56.083+0000 7f0f2651e880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:39:56.088 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:56.083+0000 7f0f2651e880 20 started sync module instance, tier type = 2023-10-05T11:39:56.088 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:56.083+0000 7f0f2651e880 20 started zone id=dff27d1e-df33-400e-a68a-7ba586947c99 (name=default) with tier type = 2023-10-05T11:39:56.088 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:56.083+0000 7f0f254cb640 0 -- 172.21.15.12:0/163170856 >> [v2:172.21.15.170:6800/4137726411,v1:172.21.15.170:6801/4137726411] conn(0x56277f3d3c00 msgr2=0x56277f4af700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-10-05T11:39:56.095 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:56.092+0000 7f0f2651e880 20 add_watcher() i=0 2023-10-05T11:39:56.096 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:56.092+0000 7f0f2651e880 20 add_watcher() i=1 2023-10-05T11:39:56.096 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:56.092+0000 7f0f2651e880 20 add_watcher() i=2 2023-10-05T11:39:56.096 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:56.092+0000 7f0f2651e880 20 add_watcher() i=3 2023-10-05T11:39:56.096 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:56.092+0000 7f0f2651e880 20 add_watcher() i=4 2023-10-05T11:39:56.096 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:56.092+0000 7f0f2651e880 20 add_watcher() i=5 2023-10-05T11:39:56.096 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:56.092+0000 7f0f2651e880 20 add_watcher() i=6 2023-10-05T11:39:56.096 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:56.093+0000 7f0f2651e880 20 add_watcher() i=7 2023-10-05T11:39:56.096 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:56.093+0000 7f0f2651e880 2 all 8 watchers are set, enabling cache 2023-10-05T11:39:56.098 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:56.095+0000 7f0f0bc98640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:39:56.098 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:56.095+0000 7f0f2651e880 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T11:39:56.098 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:56.095+0000 7f0f2651e880 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T11:39:56.104 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:56.100+0000 7f0f2651e880 5 note: GC not initialized 2023-10-05T11:39:56.104 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:56.100+0000 7f0f0748f640 20 reqs_thread_entry: start 2023-10-05T11:39:56.104 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:56.101+0000 7f0f2651e880 20 init_complete bucket index max shards: 11 2023-10-05T11:39:56.104 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:56.101+0000 7f0f2651e880 20 Filter name: none 2023-10-05T11:39:56.104 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:56.101+0000 7f0f0548b640 20 reqs_thread_entry: start 2023-10-05T11:39:56.105 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:56.101+0000 7f0f2651e880 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2023-10-05T11:39:56.105 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:56.101+0000 7f0f2651e880 20 rados->read ofs=0 len=0 2023-10-05T11:39:56.105 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:56.101+0000 7f0f2651e880 20 rados_obj.operate() r=0 bl.length=218 2023-10-05T11:39:56.105 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:56.101+0000 7f0f2651e880 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2023-10-05T11:39:56.106 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:56.101+0000 7f0f2651e880 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2023-10-05T11:39:56.106 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:56.101+0000 7f0f2651e880 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.20 : miss 2023-10-05T11:39:56.106 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:56.101+0000 7f0f2651e880 20 rados->read ofs=0 len=0 2023-10-05T11:39:56.106 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:56.102+0000 7f0f2651e880 20 rados_obj.operate() r=0 bl.length=390 2023-10-05T11:39:56.106 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:56.102+0000 7f0f2651e880 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.20 info.flags=0x17 2023-10-05T11:39:56.106 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:56.102+0000 7f0f2651e880 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.20 to cache LRU end 2023-10-05T11:39:56.106 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:56.102+0000 7f0f2651e880 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T11:39:56.106 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:56.102+0000 7f0f2651e880 10 updating xattr: name=user.rgw.acl bl.length()=265 2023-10-05T11:39:56.106 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:56.102+0000 7f0f2651e880 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.20 2023-10-05T11:39:56.107 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:56.103+0000 7f0f2651e880 0 INFO: RGWReshardLock::lock found lock on abort-at-set-target-layout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.20 to be held by another RGW process; skipping for now 2023-10-05T11:39:56.107 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:56.104+0000 7f0f0bc98640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:39:56.109 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:56.106+0000 7f0f2651e880 20 remove_watcher() i=0 2023-10-05T11:39:56.109 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:56.106+0000 7f0f2651e880 2 removed watcher, disabling cache 2023-10-05T11:39:56.110 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:56.107+0000 7f0f2651e880 20 remove_watcher() i=1 2023-10-05T11:39:56.111 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:56.108+0000 7f0f2651e880 20 remove_watcher() i=2 2023-10-05T11:39:56.112 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:56.109+0000 7f0f2651e880 20 remove_watcher() i=3 2023-10-05T11:39:56.113 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:56.110+0000 7f0f2651e880 20 remove_watcher() i=4 2023-10-05T11:39:56.114 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:56.111+0000 7f0f2651e880 20 remove_watcher() i=5 2023-10-05T11:39:56.115 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:56.112+0000 7f0f2651e880 20 remove_watcher() i=6 2023-10-05T11:39:56.116 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:39:56.113+0000 7f0f2651e880 20 remove_watcher() i=7 2023-10-05T11:39:56.120 INFO:tasks.workunit.client.0.smithi012.stderr:waiting 30 seconds for reshard lock to expire... 2023-10-05T11:40:26.153 INFO:tasks.workunit.client.0.smithi012.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2023-10-05T11:40:26.190 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setuser ceph since I am not root 2023-10-05T11:40:26.190 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T11:40:26.206 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.202+0000 7f1205c11880 20 rados->read ofs=0 len=0 2023-10-05T11:40:26.207 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.204+0000 7f1205c11880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:40:26.208 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.204+0000 7f1205c11880 20 realm 2023-10-05T11:40:26.208 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.204+0000 7f1205c11880 20 rados->read ofs=0 len=0 2023-10-05T11:40:26.208 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.204+0000 7f1205c11880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:40:26.208 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.204+0000 7f1205c11880 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T11:40:26.208 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.204+0000 7f1205c11880 20 rados->read ofs=0 len=0 2023-10-05T11:40:26.208 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.204+0000 7f1205c11880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:40:26.208 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.204+0000 7f1205c11880 20 rados->read ofs=0 len=0 2023-10-05T11:40:26.209 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.205+0000 7f1205c11880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:40:26.209 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.205+0000 7f1205c11880 20 rados->read ofs=0 len=0 2023-10-05T11:40:26.210 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.206+0000 7f1205c11880 20 rados_obj.operate() r=0 bl.length=1020 2023-10-05T11:40:26.210 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.206+0000 7f1205c11880 20 searching for the correct realm 2023-10-05T11:40:26.221 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.218+0000 7f120217d640 0 -- 172.21.15.12:0/4168193781 >> [v2:172.21.15.170:6814/3150808418,v1:172.21.15.170:6816/3150808418] conn(0x55716a86e400 msgr2=0x55716a6cb180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:40:26.223 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.220+0000 7f1205c11880 20 RGWRados::pool_iterate: got zone_info.dff27d1e-df33-400e-a68a-7ba586947c99 2023-10-05T11:40:26.223 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.220+0000 7f1205c11880 20 RGWRados::pool_iterate: got zonegroup_info.c78aa576-9d15-4e9d-b3c0-4af23a22062c 2023-10-05T11:40:26.223 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.220+0000 7f1205c11880 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T11:40:26.223 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.220+0000 7f1205c11880 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T11:40:26.224 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.220+0000 7f1205c11880 20 rados->read ofs=0 len=0 2023-10-05T11:40:26.224 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.220+0000 7f1205c11880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:40:26.224 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.220+0000 7f1205c11880 20 rados->read ofs=0 len=0 2023-10-05T11:40:26.225 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.220+0000 7f1205c11880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:40:26.225 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.220+0000 7f1205c11880 20 rados->read ofs=0 len=0 2023-10-05T11:40:26.225 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.221+0000 7f1205c11880 20 rados_obj.operate() r=0 bl.length=454 2023-10-05T11:40:26.225 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.221+0000 7f1205c11880 20 zone default found 2023-10-05T11:40:26.225 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.221+0000 7f1205c11880 4 Realm: () 2023-10-05T11:40:26.225 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.221+0000 7f1205c11880 4 ZoneGroup: default (c78aa576-9d15-4e9d-b3c0-4af23a22062c) 2023-10-05T11:40:26.225 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.221+0000 7f1205c11880 4 Zone: default (dff27d1e-df33-400e-a68a-7ba586947c99) 2023-10-05T11:40:26.225 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.221+0000 7f1205c11880 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T11:40:26.225 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.221+0000 7f1205c11880 20 zonegroup default 2023-10-05T11:40:26.225 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.221+0000 7f1205c11880 20 rados->read ofs=0 len=0 2023-10-05T11:40:26.225 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.221+0000 7f1205c11880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:40:26.226 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.221+0000 7f1205c11880 20 rados->read ofs=0 len=0 2023-10-05T11:40:26.226 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.221+0000 7f1205c11880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:40:26.226 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.221+0000 7f1205c11880 20 rados->read ofs=0 len=0 2023-10-05T11:40:26.226 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.222+0000 7f1205c11880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:40:26.226 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.222+0000 7f1205c11880 20 started sync module instance, tier type = 2023-10-05T11:40:26.226 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.222+0000 7f1205c11880 20 started zone id=dff27d1e-df33-400e-a68a-7ba586947c99 (name=default) with tier type = 2023-10-05T11:40:26.231 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.228+0000 7f120297e640 0 -- 172.21.15.12:0/4168193781 >> [v2:172.21.15.12:6824/2171933159,v1:172.21.15.12:6825/2171933159] conn(0x55716a86ec00 msgr2=0x55716a870580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-10-05T11:40:26.236 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.232+0000 7f1205c11880 20 add_watcher() i=0 2023-10-05T11:40:26.236 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.232+0000 7f1205c11880 20 add_watcher() i=1 2023-10-05T11:40:26.236 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.232+0000 7f1205c11880 20 add_watcher() i=2 2023-10-05T11:40:26.236 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.232+0000 7f1205c11880 20 add_watcher() i=3 2023-10-05T11:40:26.236 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.232+0000 7f1205c11880 20 add_watcher() i=4 2023-10-05T11:40:26.236 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.232+0000 7f1205c11880 20 add_watcher() i=5 2023-10-05T11:40:26.236 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.232+0000 7f1205c11880 20 add_watcher() i=6 2023-10-05T11:40:26.236 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.233+0000 7f1205c11880 20 add_watcher() i=7 2023-10-05T11:40:26.236 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.233+0000 7f1205c11880 2 all 8 watchers are set, enabling cache 2023-10-05T11:40:26.238 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.235+0000 7f11e914b640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:40:26.238 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.235+0000 7f1205c11880 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T11:40:26.238 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.235+0000 7f1205c11880 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T11:40:26.245 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.241+0000 7f1205c11880 5 note: GC not initialized 2023-10-05T11:40:26.245 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.241+0000 7f11e4942640 20 reqs_thread_entry: start 2023-10-05T11:40:26.245 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.241+0000 7f1205c11880 20 init_complete bucket index max shards: 11 2023-10-05T11:40:26.245 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.242+0000 7f1205c11880 20 Filter name: none 2023-10-05T11:40:26.245 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.242+0000 7f11e293e640 20 reqs_thread_entry: start 2023-10-05T11:40:26.245 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.242+0000 7f1205c11880 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2023-10-05T11:40:26.245 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.242+0000 7f1205c11880 20 rados->read ofs=0 len=0 2023-10-05T11:40:26.246 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.242+0000 7f1205c11880 20 rados_obj.operate() r=0 bl.length=218 2023-10-05T11:40:26.246 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.242+0000 7f1205c11880 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2023-10-05T11:40:26.246 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.242+0000 7f1205c11880 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2023-10-05T11:40:26.246 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.242+0000 7f1205c11880 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.20 : miss 2023-10-05T11:40:26.246 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.242+0000 7f1205c11880 20 rados->read ofs=0 len=0 2023-10-05T11:40:26.247 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.243+0000 7f1205c11880 20 rados_obj.operate() r=0 bl.length=390 2023-10-05T11:40:26.247 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.243+0000 7f1205c11880 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.20 info.flags=0x17 2023-10-05T11:40:26.247 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.243+0000 7f1205c11880 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.20 to cache LRU end 2023-10-05T11:40:26.247 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.243+0000 7f1205c11880 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T11:40:26.247 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.243+0000 7f1205c11880 10 updating xattr: name=user.rgw.acl bl.length()=265 2023-10-05T11:40:26.247 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.243+0000 7f1205c11880 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.20 2023-10-05T11:40:26.252 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.248+0000 7f1205c11880 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.20 info.flags=0x17 2023-10-05T11:40:26.252 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.248+0000 7f1205c11880 10 moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.20 to cache LRU end 2023-10-05T11:40:26.252 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.248+0000 7f1205c11880 10 updating xattr: name=user.rgw.acl bl.length()=265 2023-10-05T11:40:26.252 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.249+0000 7f1205c11880 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-set-target-layout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.20, ofs0, ns] 2023-10-05T11:40:26.253 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.249+0000 7f11fc171640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1060856922155 cookie 93945607152640 notifier 6362 bl.length()=959 2023-10-05T11:40:26.253 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.249+0000 7f11fc171640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.20 info.flags=0x17 2023-10-05T11:40:26.253 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.249+0000 7f11fc171640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.20 to cache LRU end 2023-10-05T11:40:26.253 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.249+0000 7f11fc171640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2023-10-05T11:40:26.254 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.251+0000 7f1205c11880 20 handle_bi_update(): bucket=:abort-at-set-target-layout[dff27d1e-df33-400e-a68a-7ba586947c99.4604.20]): orig_sources= new_sources= 2023-10-05T11:40:26.254 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.251+0000 7f1205c11880 20 handle_bi_update(): bucket=:abort-at-set-target-layout[dff27d1e-df33-400e-a68a-7ba586947c99.4604.20]): potential sources added=[] removed=[] 2023-10-05T11:40:26.254 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.251+0000 7f1205c11880 20 handle_bi_update(): bucket=:abort-at-set-target-layout[dff27d1e-df33-400e-a68a-7ba586947c99.4604.20]): orig_dests= new_dests= 2023-10-05T11:40:26.254 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.251+0000 7f1205c11880 20 handle_bi_update(): bucket=:abort-at-set-target-layout[dff27d1e-df33-400e-a68a-7ba586947c99.4604.20]): potential dests added=[] removed=[] 2023-10-05T11:40:26.257 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.253+0000 7f1205c11880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.20.1.0 2023-10-05T11:40:26.257 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.254+0000 7f1205c11880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.20.1.0 2023-10-05T11:40:26.257 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.254+0000 7f1205c11880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.20.1.1 2023-10-05T11:40:26.257 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.254+0000 7f1205c11880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.20.1.1 2023-10-05T11:40:26.257 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.254+0000 7f1205c11880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.20.1.2 2023-10-05T11:40:26.257 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.254+0000 7f1205c11880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.20.1.2 2023-10-05T11:40:26.258 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.254+0000 7f1205c11880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.20.1.3 2023-10-05T11:40:26.258 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.254+0000 7f1205c11880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.20.1.3 2023-10-05T11:40:26.258 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.254+0000 7f1205c11880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.20.1.4 2023-10-05T11:40:26.258 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.254+0000 7f1205c11880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.20.1.4 2023-10-05T11:40:26.258 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.254+0000 7f1205c11880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.20.1.5 2023-10-05T11:40:26.258 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.254+0000 7f1205c11880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.20.1.5 2023-10-05T11:40:26.258 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.254+0000 7f1205c11880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.20.1.6 2023-10-05T11:40:26.258 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.254+0000 7f1205c11880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.20.1.6 2023-10-05T11:40:26.258 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.254+0000 7f1205c11880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.20.1.7 2023-10-05T11:40:26.258 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.254+0000 7f1205c11880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.20.1.7 2023-10-05T11:40:26.258 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.254+0000 7f1205c11880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.20.1.8 2023-10-05T11:40:26.258 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.254+0000 7f1205c11880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.20.1.8 2023-10-05T11:40:26.259 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.254+0000 7f1205c11880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.20.1.9 2023-10-05T11:40:26.259 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.254+0000 7f1205c11880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.20.1.9 2023-10-05T11:40:26.259 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.254+0000 7f1205c11880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.20.1.10 2023-10-05T11:40:26.259 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.254+0000 7f1205c11880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.20.1.10 2023-10-05T11:40:26.259 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.254+0000 7f1205c11880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.20.1.11 2023-10-05T11:40:26.259 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.254+0000 7f1205c11880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.20.1.11 2023-10-05T11:40:26.259 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.254+0000 7f1205c11880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.20.0 2023-10-05T11:40:26.260 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.254+0000 7f1205c11880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.20.1 2023-10-05T11:40:26.260 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.254+0000 7f1205c11880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.20.2 2023-10-05T11:40:26.260 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.255+0000 7f1205c11880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.20.3 2023-10-05T11:40:26.260 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.256+0000 7f1205c11880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.20.4 2023-10-05T11:40:26.260 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.256+0000 7f1205c11880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.20.5 2023-10-05T11:40:26.261 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.257+0000 7f1205c11880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.20.6 2023-10-05T11:40:26.261 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.257+0000 7f1205c11880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.20.7 2023-10-05T11:40:26.261 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.258+0000 7f1205c11880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.20.8 2023-10-05T11:40:26.262 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.258+0000 7f1205c11880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.20.9 2023-10-05T11:40:26.262 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.259+0000 7f1205c11880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.20.10 2023-10-05T11:40:26.265 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.262+0000 7f1205c11880 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.20 : hit (requested=0x17, cached=0x17) 2023-10-05T11:40:26.266 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.262+0000 7f1205c11880 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.20 2023-10-05T11:40:26.267 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.263+0000 7f1205c11880 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.20 info.flags=0x17 2023-10-05T11:40:26.267 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.263+0000 7f1205c11880 10 moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.20 to cache LRU end 2023-10-05T11:40:26.267 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.263+0000 7f1205c11880 10 updating xattr: name=user.rgw.acl bl.length()=265 2023-10-05T11:40:26.267 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.263+0000 7f1205c11880 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-set-target-layout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.20, ofs0, ns] 2023-10-05T11:40:26.267 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.264+0000 7f11fc972640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1060856922156 cookie 93945607152640 notifier 6362 bl.length()=927 2023-10-05T11:40:26.268 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.264+0000 7f11fc972640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.20 info.flags=0x17 2023-10-05T11:40:26.268 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.264+0000 7f11fc972640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.20 to cache LRU end 2023-10-05T11:40:26.268 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.264+0000 7f11fc972640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2023-10-05T11:40:26.269 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.265+0000 7f1205c11880 20 handle_bi_update(): bucket=:abort-at-set-target-layout[dff27d1e-df33-400e-a68a-7ba586947c99.4604.20]): orig_sources= new_sources= 2023-10-05T11:40:26.269 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.265+0000 7f1205c11880 20 handle_bi_update(): bucket=:abort-at-set-target-layout[dff27d1e-df33-400e-a68a-7ba586947c99.4604.20]): potential sources added=[] removed=[] 2023-10-05T11:40:26.269 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.265+0000 7f1205c11880 20 handle_bi_update(): bucket=:abort-at-set-target-layout[dff27d1e-df33-400e-a68a-7ba586947c99.4604.20]): orig_dests= new_dests= 2023-10-05T11:40:26.269 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.265+0000 7f1205c11880 20 handle_bi_update(): bucket=:abort-at-set-target-layout[dff27d1e-df33-400e-a68a-7ba586947c99.4604.20]): potential dests added=[] removed=[] 2023-10-05T11:40:26.271 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.268+0000 7f1205c11880 1 execute INFO: reshard of bucket "abort-at-set-target-layout" completed successfully 2023-10-05T11:40:26.273 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.270+0000 7f11e914b640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:40:26.275 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.272+0000 7f1205c11880 20 remove_watcher() i=0 2023-10-05T11:40:26.275 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.272+0000 7f1205c11880 2 removed watcher, disabling cache 2023-10-05T11:40:26.276 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.273+0000 7f1205c11880 20 remove_watcher() i=1 2023-10-05T11:40:26.278 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.274+0000 7f1205c11880 20 remove_watcher() i=2 2023-10-05T11:40:26.279 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.275+0000 7f1205c11880 20 remove_watcher() i=3 2023-10-05T11:40:26.280 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.277+0000 7f1205c11880 20 remove_watcher() i=4 2023-10-05T11:40:26.281 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.278+0000 7f1205c11880 20 remove_watcher() i=5 2023-10-05T11:40:26.282 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.279+0000 7f1205c11880 20 remove_watcher() i=6 2023-10-05T11:40:26.283 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.280+0000 7f1205c11880 20 remove_watcher() i=7 2023-10-05T11:40:26.289 INFO:tasks.workunit.client.0.smithi012.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2023-10-05T11:40:26.318 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setuser ceph since I am not root 2023-10-05T11:40:26.318 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T11:40:26.331 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.327+0000 7fb55cb36880 20 rados->read ofs=0 len=0 2023-10-05T11:40:26.333 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.329+0000 7fb55cb36880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:40:26.333 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.329+0000 7fb55cb36880 20 realm 2023-10-05T11:40:26.333 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.329+0000 7fb55cb36880 20 rados->read ofs=0 len=0 2023-10-05T11:40:26.333 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.329+0000 7fb55cb36880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:40:26.333 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.329+0000 7fb55cb36880 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T11:40:26.333 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.329+0000 7fb55cb36880 20 rados->read ofs=0 len=0 2023-10-05T11:40:26.333 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.329+0000 7fb55cb36880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:40:26.333 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.329+0000 7fb55cb36880 20 rados->read ofs=0 len=0 2023-10-05T11:40:26.334 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.330+0000 7fb55cb36880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:40:26.334 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.330+0000 7fb55cb36880 20 rados->read ofs=0 len=0 2023-10-05T11:40:26.334 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.331+0000 7fb55cb36880 20 rados_obj.operate() r=0 bl.length=1020 2023-10-05T11:40:26.334 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.331+0000 7fb55cb36880 20 searching for the correct realm 2023-10-05T11:40:26.344 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.341+0000 7fb559538640 0 -- 172.21.15.12:0/1377141067 >> [v2:172.21.15.170:6814/3150808418,v1:172.21.15.170:6816/3150808418] conn(0x55ad9a6fbc00 msgr2=0x55ad99afac00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:40:26.346 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.342+0000 7fb55cb36880 20 RGWRados::pool_iterate: got zone_info.dff27d1e-df33-400e-a68a-7ba586947c99 2023-10-05T11:40:26.346 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.342+0000 7fb55cb36880 20 RGWRados::pool_iterate: got zonegroup_info.c78aa576-9d15-4e9d-b3c0-4af23a22062c 2023-10-05T11:40:26.346 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.342+0000 7fb55cb36880 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T11:40:26.346 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.342+0000 7fb55cb36880 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T11:40:26.347 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.342+0000 7fb55cb36880 20 rados->read ofs=0 len=0 2023-10-05T11:40:26.347 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.343+0000 7fb55cb36880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:40:26.347 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.343+0000 7fb55cb36880 20 rados->read ofs=0 len=0 2023-10-05T11:40:26.347 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.343+0000 7fb55cb36880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:40:26.347 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.343+0000 7fb55cb36880 20 rados->read ofs=0 len=0 2023-10-05T11:40:26.348 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.343+0000 7fb55cb36880 20 rados_obj.operate() r=0 bl.length=454 2023-10-05T11:40:26.348 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.343+0000 7fb55cb36880 20 zone default found 2023-10-05T11:40:26.348 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.343+0000 7fb55cb36880 4 Realm: () 2023-10-05T11:40:26.348 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.343+0000 7fb55cb36880 4 ZoneGroup: default (c78aa576-9d15-4e9d-b3c0-4af23a22062c) 2023-10-05T11:40:26.348 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.343+0000 7fb55cb36880 4 Zone: default (dff27d1e-df33-400e-a68a-7ba586947c99) 2023-10-05T11:40:26.348 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.343+0000 7fb55cb36880 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T11:40:26.349 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.343+0000 7fb55cb36880 20 zonegroup default 2023-10-05T11:40:26.349 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.343+0000 7fb55cb36880 20 rados->read ofs=0 len=0 2023-10-05T11:40:26.349 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.343+0000 7fb55cb36880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:40:26.349 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.343+0000 7fb55cb36880 20 rados->read ofs=0 len=0 2023-10-05T11:40:26.349 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.344+0000 7fb55cb36880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:40:26.349 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.344+0000 7fb55cb36880 20 rados->read ofs=0 len=0 2023-10-05T11:40:26.349 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.344+0000 7fb55cb36880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:40:26.349 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.344+0000 7fb55cb36880 20 started sync module instance, tier type = 2023-10-05T11:40:26.349 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.344+0000 7fb55cb36880 20 started zone id=dff27d1e-df33-400e-a68a-7ba586947c99 (name=default) with tier type = 2023-10-05T11:40:26.353 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.350+0000 7fb559d39640 0 -- 172.21.15.12:0/1377141067 >> [v2:172.21.15.170:6800/4137726411,v1:172.21.15.170:6801/4137726411] conn(0x55ad99baf800 msgr2=0x55ad99bb5600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:40:26.357 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.353+0000 7fb55cb36880 20 add_watcher() i=0 2023-10-05T11:40:26.357 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.353+0000 7fb55cb36880 20 add_watcher() i=1 2023-10-05T11:40:26.357 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.353+0000 7fb55cb36880 20 add_watcher() i=2 2023-10-05T11:40:26.357 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.353+0000 7fb55cb36880 20 add_watcher() i=3 2023-10-05T11:40:26.357 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.353+0000 7fb55cb36880 20 add_watcher() i=4 2023-10-05T11:40:26.357 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.353+0000 7fb55cb36880 20 add_watcher() i=5 2023-10-05T11:40:26.357 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.353+0000 7fb55cb36880 20 add_watcher() i=6 2023-10-05T11:40:26.358 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.354+0000 7fb55cb36880 20 add_watcher() i=7 2023-10-05T11:40:26.358 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.354+0000 7fb55cb36880 2 all 8 watchers are set, enabling cache 2023-10-05T11:40:26.359 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.356+0000 7fb540506640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:40:26.360 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.356+0000 7fb55cb36880 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T11:40:26.360 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.356+0000 7fb55cb36880 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T11:40:26.365 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.362+0000 7fb55cb36880 5 note: GC not initialized 2023-10-05T11:40:26.365 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.362+0000 7fb53bcfd640 20 reqs_thread_entry: start 2023-10-05T11:40:26.366 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.362+0000 7fb55cb36880 20 init_complete bucket index max shards: 11 2023-10-05T11:40:26.366 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.362+0000 7fb55cb36880 20 Filter name: none 2023-10-05T11:40:26.366 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.362+0000 7fb539cf9640 20 reqs_thread_entry: start 2023-10-05T11:40:26.366 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.362+0000 7fb55cb36880 20 rados->read ofs=0 len=0 2023-10-05T11:40:26.370 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.363+0000 7fb55cb36880 20 rados_obj.operate() r=0 bl.length=218 2023-10-05T11:40:26.370 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.363+0000 7fb55cb36880 20 rados->read ofs=0 len=0 2023-10-05T11:40:26.370 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.363+0000 7fb55cb36880 20 rados_obj.operate() r=0 bl.length=390 2023-10-05T11:40:26.370 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.363+0000 7fb55cb36880 20 couldn't put binfo cache entry, might have raced with data changes 2023-10-05T11:40:26.370 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.363+0000 7fb55cb36880 20 rados->read ofs=0 len=0 2023-10-05T11:40:26.370 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.364+0000 7fb55cb36880 20 rados_obj.operate() r=0 bl.length=218 2023-10-05T11:40:26.370 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.364+0000 7fb55cb36880 20 rados->read ofs=0 len=0 2023-10-05T11:40:26.370 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.364+0000 7fb55cb36880 20 rados_obj.operate() r=0 bl.length=390 2023-10-05T11:40:26.371 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.364+0000 7fb55cb36880 20 couldn't put binfo cache entry, might have raced with data changes 2023-10-05T11:40:26.371 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.365+0000 7fb55cb36880 20 rados->read ofs=0 len=0 2023-10-05T11:40:26.371 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.365+0000 7fb55cb36880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:40:26.371 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.366+0000 7fb540506640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:40:26.371 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.368+0000 7fb55cb36880 20 remove_watcher() i=0 2023-10-05T11:40:26.372 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.368+0000 7fb55cb36880 2 removed watcher, disabling cache 2023-10-05T11:40:26.373 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.369+0000 7fb55cb36880 20 remove_watcher() i=1 2023-10-05T11:40:26.374 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.370+0000 7fb55cb36880 20 remove_watcher() i=2 2023-10-05T11:40:26.375 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.371+0000 7fb55cb36880 20 remove_watcher() i=3 2023-10-05T11:40:26.376 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.372+0000 7fb55cb36880 20 remove_watcher() i=4 2023-10-05T11:40:26.377 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.373+0000 7fb55cb36880 20 remove_watcher() i=5 2023-10-05T11:40:26.377 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.374+0000 7fb55cb36880 20 remove_watcher() i=6 2023-10-05T11:40:26.378 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:26.375+0000 7fb55cb36880 20 remove_watcher() i=7 2023-10-05T11:40:26.383 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:40:26.383 INFO:tasks.workunit.client.0.smithi012.stderr:BUCKET_STATS: 2023-10-05T11:40:26.383 INFO:tasks.workunit.client.0.smithi012.stderr:bucket: abort-at-set-target-layout id: dff27d1e-df33-400e-a68a-7ba586947c99.4604.20 num_objects: 19 size_kb: 1 num_shards: 12 2023-10-05T11:40:26.383 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:40:26.726 INFO:tasks.workunit.client.0.smithi012.stderr:TEST: reshard bucket with EIO injected at block_writes 2023-10-05T11:40:26.726 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:40:27.431 INFO:tasks.workunit.client.0.smithi012.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2023-10-05T11:40:27.458 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setuser ceph since I am not root 2023-10-05T11:40:27.459 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T11:40:27.471 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.468+0000 7f7cc8611880 20 rados->read ofs=0 len=0 2023-10-05T11:40:27.473 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.469+0000 7f7cc8611880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:40:27.473 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.469+0000 7f7cc8611880 20 realm 2023-10-05T11:40:27.473 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.469+0000 7f7cc8611880 20 rados->read ofs=0 len=0 2023-10-05T11:40:27.473 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.469+0000 7f7cc8611880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:40:27.473 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.469+0000 7f7cc8611880 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T11:40:27.473 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.469+0000 7f7cc8611880 20 rados->read ofs=0 len=0 2023-10-05T11:40:27.474 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.469+0000 7f7cc8611880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:40:27.474 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.469+0000 7f7cc8611880 20 rados->read ofs=0 len=0 2023-10-05T11:40:27.474 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.470+0000 7f7cc8611880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:40:27.474 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.470+0000 7f7cc8611880 20 rados->read ofs=0 len=0 2023-10-05T11:40:27.475 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.471+0000 7f7cc8611880 20 rados_obj.operate() r=0 bl.length=1020 2023-10-05T11:40:27.475 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.471+0000 7f7cc8611880 20 searching for the correct realm 2023-10-05T11:40:27.483 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.480+0000 7f7cc4b91640 0 -- 172.21.15.12:0/3800062424 >> [v2:172.21.15.170:6814/3150808418,v1:172.21.15.170:6816/3150808418] conn(0x563923aa5400 msgr2=0x563922eaac00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:40:27.485 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.481+0000 7f7cc8611880 20 RGWRados::pool_iterate: got zone_info.dff27d1e-df33-400e-a68a-7ba586947c99 2023-10-05T11:40:27.485 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.481+0000 7f7cc8611880 20 RGWRados::pool_iterate: got zonegroup_info.c78aa576-9d15-4e9d-b3c0-4af23a22062c 2023-10-05T11:40:27.485 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.481+0000 7f7cc8611880 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T11:40:27.485 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.481+0000 7f7cc8611880 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T11:40:27.485 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.482+0000 7f7cc8611880 20 rados->read ofs=0 len=0 2023-10-05T11:40:27.485 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.482+0000 7f7cc8611880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:40:27.486 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.482+0000 7f7cc8611880 20 rados->read ofs=0 len=0 2023-10-05T11:40:27.487 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.482+0000 7f7cc8611880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:40:27.487 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.482+0000 7f7cc8611880 20 rados->read ofs=0 len=0 2023-10-05T11:40:27.487 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.482+0000 7f7cc8611880 20 rados_obj.operate() r=0 bl.length=454 2023-10-05T11:40:27.487 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.482+0000 7f7cc8611880 20 zone default found 2023-10-05T11:40:27.487 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.482+0000 7f7cc8611880 4 Realm: () 2023-10-05T11:40:27.487 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.482+0000 7f7cc8611880 4 ZoneGroup: default (c78aa576-9d15-4e9d-b3c0-4af23a22062c) 2023-10-05T11:40:27.487 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.482+0000 7f7cc8611880 4 Zone: default (dff27d1e-df33-400e-a68a-7ba586947c99) 2023-10-05T11:40:27.487 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.482+0000 7f7cc8611880 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T11:40:27.487 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.482+0000 7f7cc8611880 20 zonegroup default 2023-10-05T11:40:27.488 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.482+0000 7f7cc8611880 20 rados->read ofs=0 len=0 2023-10-05T11:40:27.488 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.482+0000 7f7cc8611880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:40:27.488 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.482+0000 7f7cc8611880 20 rados->read ofs=0 len=0 2023-10-05T11:40:27.488 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.483+0000 7f7cc8611880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:40:27.488 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.483+0000 7f7cc8611880 20 rados->read ofs=0 len=0 2023-10-05T11:40:27.488 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.483+0000 7f7cc8611880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:40:27.488 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.483+0000 7f7cc8611880 20 started sync module instance, tier type = 2023-10-05T11:40:27.488 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.483+0000 7f7cc8611880 20 started zone id=dff27d1e-df33-400e-a68a-7ba586947c99 (name=default) with tier type = 2023-10-05T11:40:27.492 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.489+0000 7f7cc5392640 0 -- 172.21.15.12:0/3800062424 >> [v2:172.21.15.170:6800/4137726411,v1:172.21.15.170:6801/4137726411] conn(0x563922f6f800 msgr2=0x563922f6b600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-10-05T11:40:27.495 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.492+0000 7f7cc8611880 20 add_watcher() i=0 2023-10-05T11:40:27.495 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.492+0000 7f7cc8611880 20 add_watcher() i=1 2023-10-05T11:40:27.495 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.492+0000 7f7cc8611880 20 add_watcher() i=2 2023-10-05T11:40:27.495 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.492+0000 7f7cc8611880 20 add_watcher() i=3 2023-10-05T11:40:27.496 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.492+0000 7f7cc8611880 20 add_watcher() i=4 2023-10-05T11:40:27.496 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.492+0000 7f7cc8611880 20 add_watcher() i=5 2023-10-05T11:40:27.496 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.492+0000 7f7cc8611880 20 add_watcher() i=6 2023-10-05T11:40:27.496 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.493+0000 7f7cc8611880 20 add_watcher() i=7 2023-10-05T11:40:27.496 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.493+0000 7f7cc8611880 2 all 8 watchers are set, enabling cache 2023-10-05T11:40:27.498 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.495+0000 7f7cabb5f640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:40:27.498 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.495+0000 7f7cc8611880 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T11:40:27.498 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.495+0000 7f7cc8611880 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T11:40:27.504 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.500+0000 7f7cc8611880 5 note: GC not initialized 2023-10-05T11:40:27.504 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.500+0000 7f7ca7356640 20 reqs_thread_entry: start 2023-10-05T11:40:27.504 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.501+0000 7f7cc8611880 20 init_complete bucket index max shards: 11 2023-10-05T11:40:27.504 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.501+0000 7f7cc8611880 20 Filter name: none 2023-10-05T11:40:27.504 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.501+0000 7f7ca5352640 20 reqs_thread_entry: start 2023-10-05T11:40:27.504 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.501+0000 7f7cc8611880 20 rados->read ofs=0 len=0 2023-10-05T11:40:27.505 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.501+0000 7f7cc8611880 20 rados_obj.operate() r=0 bl.length=213 2023-10-05T11:40:27.505 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.501+0000 7f7cc8611880 20 rados->read ofs=0 len=0 2023-10-05T11:40:27.506 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.502+0000 7f7cc8611880 20 rados_obj.operate() r=0 bl.length=385 2023-10-05T11:40:27.506 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.502+0000 7f7cc8611880 20 couldn't put binfo cache entry, might have raced with data changes 2023-10-05T11:40:27.506 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.502+0000 7f7cc8611880 20 rados->read ofs=0 len=0 2023-10-05T11:40:27.506 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.502+0000 7f7cc8611880 20 rados_obj.operate() r=0 bl.length=213 2023-10-05T11:40:27.506 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.502+0000 7f7cc8611880 20 rados->read ofs=0 len=0 2023-10-05T11:40:27.506 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.503+0000 7f7cc8611880 20 rados_obj.operate() r=0 bl.length=385 2023-10-05T11:40:27.506 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.503+0000 7f7cc8611880 20 couldn't put binfo cache entry, might have raced with data changes 2023-10-05T11:40:27.507 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.503+0000 7f7cc8611880 20 rados->read ofs=0 len=0 2023-10-05T11:40:27.507 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.504+0000 7f7cc8611880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:40:27.508 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.504+0000 7f7cabb5f640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:40:27.510 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.506+0000 7f7cc8611880 20 remove_watcher() i=0 2023-10-05T11:40:27.510 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.506+0000 7f7cc8611880 2 removed watcher, disabling cache 2023-10-05T11:40:27.511 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.508+0000 7f7cc8611880 20 remove_watcher() i=1 2023-10-05T11:40:27.512 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.509+0000 7f7cc8611880 20 remove_watcher() i=2 2023-10-05T11:40:27.513 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.510+0000 7f7cc8611880 20 remove_watcher() i=3 2023-10-05T11:40:27.514 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.511+0000 7f7cc8611880 20 remove_watcher() i=4 2023-10-05T11:40:27.515 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.512+0000 7f7cc8611880 20 remove_watcher() i=5 2023-10-05T11:40:27.516 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.513+0000 7f7cc8611880 20 remove_watcher() i=6 2023-10-05T11:40:27.517 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.514+0000 7f7cc8611880 20 remove_watcher() i=7 2023-10-05T11:40:27.521 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:40:27.521 INFO:tasks.workunit.client.0.smithi012.stderr:BUCKET_STATS: 2023-10-05T11:40:27.521 INFO:tasks.workunit.client.0.smithi012.stderr:bucket: error-at-block-writes id: dff27d1e-df33-400e-a68a-7ba586947c99.4604.21 num_objects: 20 size_kb: 1 num_shards: 11 2023-10-05T11:40:27.521 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:40:27.523 INFO:tasks.workunit.client.0.smithi012.stderr:radosgw-admin bucket reshard --bucket error-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at block_writes 2023-10-05T11:40:27.556 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setuser ceph since I am not root 2023-10-05T11:40:27.556 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T11:40:27.568 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.565+0000 7f88f9c19880 20 rados->read ofs=0 len=0 2023-10-05T11:40:27.570 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.566+0000 7f88f9c19880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:40:27.570 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.566+0000 7f88f9c19880 20 realm 2023-10-05T11:40:27.570 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.566+0000 7f88f9c19880 20 rados->read ofs=0 len=0 2023-10-05T11:40:27.570 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.566+0000 7f88f9c19880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:40:27.570 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.566+0000 7f88f9c19880 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T11:40:27.570 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.566+0000 7f88f9c19880 20 rados->read ofs=0 len=0 2023-10-05T11:40:27.571 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.567+0000 7f88f9c19880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:40:27.571 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.567+0000 7f88f9c19880 20 rados->read ofs=0 len=0 2023-10-05T11:40:27.571 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.567+0000 7f88f9c19880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:40:27.571 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.567+0000 7f88f9c19880 20 rados->read ofs=0 len=0 2023-10-05T11:40:27.572 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.568+0000 7f88f9c19880 20 rados_obj.operate() r=0 bl.length=1020 2023-10-05T11:40:27.572 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.568+0000 7f88f9c19880 20 searching for the correct realm 2023-10-05T11:40:27.580 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.577+0000 7f88f6100640 0 -- 172.21.15.12:0/606578723 >> [v2:172.21.15.170:6814/3150808418,v1:172.21.15.170:6816/3150808418] conn(0x55ff1f3d6c00 msgr2=0x55ff1f230c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:40:27.582 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.579+0000 7f88f9c19880 20 RGWRados::pool_iterate: got zone_info.dff27d1e-df33-400e-a68a-7ba586947c99 2023-10-05T11:40:27.582 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.579+0000 7f88f9c19880 20 RGWRados::pool_iterate: got zonegroup_info.c78aa576-9d15-4e9d-b3c0-4af23a22062c 2023-10-05T11:40:27.582 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.579+0000 7f88f9c19880 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T11:40:27.582 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.579+0000 7f88f9c19880 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T11:40:27.582 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.579+0000 7f88f9c19880 20 rados->read ofs=0 len=0 2023-10-05T11:40:27.583 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.579+0000 7f88f9c19880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:40:27.583 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.579+0000 7f88f9c19880 20 rados->read ofs=0 len=0 2023-10-05T11:40:27.584 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.579+0000 7f88f9c19880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:40:27.584 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.579+0000 7f88f9c19880 20 rados->read ofs=0 len=0 2023-10-05T11:40:27.584 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.579+0000 7f88f9c19880 20 rados_obj.operate() r=0 bl.length=454 2023-10-05T11:40:27.584 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.579+0000 7f88f9c19880 20 zone default found 2023-10-05T11:40:27.584 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.579+0000 7f88f9c19880 4 Realm: () 2023-10-05T11:40:27.584 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.579+0000 7f88f9c19880 4 ZoneGroup: default (c78aa576-9d15-4e9d-b3c0-4af23a22062c) 2023-10-05T11:40:27.584 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.579+0000 7f88f9c19880 4 Zone: default (dff27d1e-df33-400e-a68a-7ba586947c99) 2023-10-05T11:40:27.584 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.579+0000 7f88f9c19880 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T11:40:27.584 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.579+0000 7f88f9c19880 20 zonegroup default 2023-10-05T11:40:27.585 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.579+0000 7f88f9c19880 20 rados->read ofs=0 len=0 2023-10-05T11:40:27.585 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.580+0000 7f88f9c19880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:40:27.585 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.580+0000 7f88f9c19880 20 rados->read ofs=0 len=0 2023-10-05T11:40:27.585 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.580+0000 7f88f9c19880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:40:27.585 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.580+0000 7f88f9c19880 20 rados->read ofs=0 len=0 2023-10-05T11:40:27.585 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.580+0000 7f88f9c19880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:40:27.585 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.580+0000 7f88f9c19880 20 started sync module instance, tier type = 2023-10-05T11:40:27.585 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.580+0000 7f88f9c19880 20 started zone id=dff27d1e-df33-400e-a68a-7ba586947c99 (name=default) with tier type = 2023-10-05T11:40:27.590 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.587+0000 7f88f6901640 0 -- 172.21.15.12:0/606578723 >> [v2:172.21.15.12:6824/2171933159,v1:172.21.15.12:6825/2171933159] conn(0x55ff1f3d7400 msgr2=0x55ff1f231700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:40:27.592 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.589+0000 7f88f9c19880 20 add_watcher() i=0 2023-10-05T11:40:27.593 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.589+0000 7f88f9c19880 20 add_watcher() i=1 2023-10-05T11:40:27.593 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.589+0000 7f88f9c19880 20 add_watcher() i=2 2023-10-05T11:40:27.593 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.589+0000 7f88f9c19880 20 add_watcher() i=3 2023-10-05T11:40:27.593 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.589+0000 7f88f9c19880 20 add_watcher() i=4 2023-10-05T11:40:27.593 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.589+0000 7f88f9c19880 20 add_watcher() i=5 2023-10-05T11:40:27.593 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.589+0000 7f88f9c19880 20 add_watcher() i=6 2023-10-05T11:40:27.594 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.590+0000 7f88f9c19880 20 add_watcher() i=7 2023-10-05T11:40:27.594 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.590+0000 7f88f9c19880 2 all 8 watchers are set, enabling cache 2023-10-05T11:40:27.595 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.592+0000 7f88dd0ce640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:40:27.595 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.592+0000 7f88f9c19880 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T11:40:27.596 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.592+0000 7f88f9c19880 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T11:40:27.601 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.598+0000 7f88f9c19880 5 note: GC not initialized 2023-10-05T11:40:27.601 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.598+0000 7f88d88c5640 20 reqs_thread_entry: start 2023-10-05T11:40:27.602 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.598+0000 7f88f9c19880 20 init_complete bucket index max shards: 11 2023-10-05T11:40:27.602 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.598+0000 7f88f9c19880 20 Filter name: none 2023-10-05T11:40:27.602 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.598+0000 7f88d68c1640 20 reqs_thread_entry: start 2023-10-05T11:40:27.602 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.598+0000 7f88f9c19880 10 cache get: name=default.rgw.meta+root+error-at-block-writes : miss 2023-10-05T11:40:27.602 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.598+0000 7f88f9c19880 20 rados->read ofs=0 len=0 2023-10-05T11:40:27.605 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.599+0000 7f88f9c19880 20 rados_obj.operate() r=0 bl.length=213 2023-10-05T11:40:27.606 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.599+0000 7f88f9c19880 10 cache put: name=default.rgw.meta+root+error-at-block-writes info.flags=0x11 2023-10-05T11:40:27.606 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.599+0000 7f88f9c19880 10 adding default.rgw.meta+root+error-at-block-writes to cache LRU end 2023-10-05T11:40:27.606 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.599+0000 7f88f9c19880 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:dff27d1e-df33-400e-a68a-7ba586947c99.4604.21 : miss 2023-10-05T11:40:27.606 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.599+0000 7f88f9c19880 20 rados->read ofs=0 len=0 2023-10-05T11:40:27.606 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.599+0000 7f88f9c19880 20 rados_obj.operate() r=0 bl.length=385 2023-10-05T11:40:27.606 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.599+0000 7f88f9c19880 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:dff27d1e-df33-400e-a68a-7ba586947c99.4604.21 info.flags=0x17 2023-10-05T11:40:27.606 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.599+0000 7f88f9c19880 10 adding default.rgw.meta+root+.bucket.meta.error-at-block-writes:dff27d1e-df33-400e-a68a-7ba586947c99.4604.21 to cache LRU end 2023-10-05T11:40:27.606 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.599+0000 7f88f9c19880 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T11:40:27.606 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.599+0000 7f88f9c19880 10 updating xattr: name=user.rgw.acl bl.length()=265 2023-10-05T11:40:27.606 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.599+0000 7f88f9c19880 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:dff27d1e-df33-400e-a68a-7ba586947c99.4604.21 2023-10-05T11:40:27.608 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.604+0000 7f88f9c19880 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:dff27d1e-df33-400e-a68a-7ba586947c99.4604.21 info.flags=0x17 2023-10-05T11:40:27.608 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.604+0000 7f88f9c19880 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:dff27d1e-df33-400e-a68a-7ba586947c99.4604.21 to cache LRU end 2023-10-05T11:40:27.608 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.604+0000 7f88f9c19880 10 updating xattr: name=user.rgw.acl bl.length()=265 2023-10-05T11:40:27.608 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.604+0000 7f88f9c19880 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:dff27d1e-df33-400e-a68a-7ba586947c99.4604.21, ofs0, ns] 2023-10-05T11:40:27.608 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.605+0000 7f88f08f5640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1060856922159 cookie 94554229340160 notifier 6714 bl.length()=949 2023-10-05T11:40:27.609 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.605+0000 7f88f08f5640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:dff27d1e-df33-400e-a68a-7ba586947c99.4604.21 info.flags=0x17 2023-10-05T11:40:27.609 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.605+0000 7f88f08f5640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:dff27d1e-df33-400e-a68a-7ba586947c99.4604.21 to cache LRU end 2023-10-05T11:40:27.609 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.605+0000 7f88f08f5640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2023-10-05T11:40:27.610 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.606+0000 7f88f9c19880 20 handle_bi_update(): bucket=:error-at-block-writes[dff27d1e-df33-400e-a68a-7ba586947c99.4604.21]): orig_sources= new_sources= 2023-10-05T11:40:27.610 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.606+0000 7f88f9c19880 20 handle_bi_update(): bucket=:error-at-block-writes[dff27d1e-df33-400e-a68a-7ba586947c99.4604.21]): potential sources added=[] removed=[] 2023-10-05T11:40:27.610 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.606+0000 7f88f9c19880 20 handle_bi_update(): bucket=:error-at-block-writes[dff27d1e-df33-400e-a68a-7ba586947c99.4604.21]): orig_dests= new_dests= 2023-10-05T11:40:27.610 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.606+0000 7f88f9c19880 20 handle_bi_update(): bucket=:error-at-block-writes[dff27d1e-df33-400e-a68a-7ba586947c99.4604.21]): potential dests added=[] removed=[] 2023-10-05T11:40:27.610 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.606+0000 7f88f9c19880 -1 Injecting error=-5 at location=block_writes 2023-10-05T11:40:27.610 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.606+0000 7f88f9c19880 0 ERROR: init_reshard failed to pause writes to the current index: (5) Input/output error 2023-10-05T11:40:27.612 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.609+0000 7f88f9c19880 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:dff27d1e-df33-400e-a68a-7ba586947c99.4604.21 : hit (requested=0x17, cached=0x17) 2023-10-05T11:40:27.612 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.609+0000 7f88f9c19880 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:dff27d1e-df33-400e-a68a-7ba586947c99.4604.21 2023-10-05T11:40:27.613 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.610+0000 7f88f9c19880 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:dff27d1e-df33-400e-a68a-7ba586947c99.4604.21 info.flags=0x17 2023-10-05T11:40:27.613 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.610+0000 7f88f9c19880 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:dff27d1e-df33-400e-a68a-7ba586947c99.4604.21 to cache LRU end 2023-10-05T11:40:27.614 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.610+0000 7f88f9c19880 10 updating xattr: name=user.rgw.acl bl.length()=265 2023-10-05T11:40:27.614 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.610+0000 7f88f9c19880 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:dff27d1e-df33-400e-a68a-7ba586947c99.4604.21, ofs0, ns] 2023-10-05T11:40:27.614 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.610+0000 7f88f00f4640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1060856922160 cookie 94554229340160 notifier 6714 bl.length()=917 2023-10-05T11:40:27.614 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.611+0000 7f88f00f4640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:dff27d1e-df33-400e-a68a-7ba586947c99.4604.21 info.flags=0x17 2023-10-05T11:40:27.614 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.611+0000 7f88f00f4640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:dff27d1e-df33-400e-a68a-7ba586947c99.4604.21 to cache LRU end 2023-10-05T11:40:27.614 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.611+0000 7f88f00f4640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2023-10-05T11:40:27.615 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.612+0000 7f88f9c19880 20 handle_bi_update(): bucket=:error-at-block-writes[dff27d1e-df33-400e-a68a-7ba586947c99.4604.21]): orig_sources= new_sources= 2023-10-05T11:40:27.615 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.612+0000 7f88f9c19880 20 handle_bi_update(): bucket=:error-at-block-writes[dff27d1e-df33-400e-a68a-7ba586947c99.4604.21]): potential sources added=[] removed=[] 2023-10-05T11:40:27.615 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.612+0000 7f88f9c19880 20 handle_bi_update(): bucket=:error-at-block-writes[dff27d1e-df33-400e-a68a-7ba586947c99.4604.21]): orig_dests= new_dests= 2023-10-05T11:40:27.615 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.612+0000 7f88f9c19880 20 handle_bi_update(): bucket=:error-at-block-writes[dff27d1e-df33-400e-a68a-7ba586947c99.4604.21]): potential dests added=[] removed=[] 2023-10-05T11:40:27.617 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.614+0000 7f88dd0ce640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:40:27.619 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.616+0000 7f88f9c19880 20 remove_watcher() i=0 2023-10-05T11:40:27.619 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.616+0000 7f88f9c19880 2 removed watcher, disabling cache 2023-10-05T11:40:27.621 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.617+0000 7f88f9c19880 20 remove_watcher() i=1 2023-10-05T11:40:27.621 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.618+0000 7f88f9c19880 20 remove_watcher() i=2 2023-10-05T11:40:27.622 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.619+0000 7f88f9c19880 20 remove_watcher() i=3 2023-10-05T11:40:27.623 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.620+0000 7f88f9c19880 20 remove_watcher() i=4 2023-10-05T11:40:27.624 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.621+0000 7f88f9c19880 20 remove_watcher() i=5 2023-10-05T11:40:27.625 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.622+0000 7f88f9c19880 20 remove_watcher() i=6 2023-10-05T11:40:27.626 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.623+0000 7f88f9c19880 20 remove_watcher() i=7 2023-10-05T11:40:27.632 INFO:tasks.workunit.client.0.smithi012.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2023-10-05T11:40:27.662 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setuser ceph since I am not root 2023-10-05T11:40:27.946 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T11:40:27.957 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.673+0000 7f6244b36880 20 rados->read ofs=0 len=0 2023-10-05T11:40:27.958 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.674+0000 7f6244b36880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:40:27.958 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.674+0000 7f6244b36880 20 realm 2023-10-05T11:40:27.958 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.674+0000 7f6244b36880 20 rados->read ofs=0 len=0 2023-10-05T11:40:27.958 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.674+0000 7f6244b36880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:40:27.958 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.674+0000 7f6244b36880 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T11:40:27.958 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.674+0000 7f6244b36880 20 rados->read ofs=0 len=0 2023-10-05T11:40:27.958 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.674+0000 7f6244b36880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:40:27.958 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.674+0000 7f6244b36880 20 rados->read ofs=0 len=0 2023-10-05T11:40:27.958 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.675+0000 7f6244b36880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:40:27.958 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.675+0000 7f6244b36880 20 rados->read ofs=0 len=0 2023-10-05T11:40:27.959 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.676+0000 7f6244b36880 20 rados_obj.operate() r=0 bl.length=1020 2023-10-05T11:40:27.959 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.676+0000 7f6244b36880 20 searching for the correct realm 2023-10-05T11:40:27.959 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.685+0000 7f6241ce2640 0 -- 172.21.15.12:0/536380681 >> [v2:172.21.15.12:6813/3341239609,v1:172.21.15.12:6815/3341239609] conn(0x558e1f1bfc00 msgr2=0x558e1e5c4c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:40:27.959 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.688+0000 7f6244b36880 20 RGWRados::pool_iterate: got zone_info.dff27d1e-df33-400e-a68a-7ba586947c99 2023-10-05T11:40:27.959 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.688+0000 7f6244b36880 20 RGWRados::pool_iterate: got zonegroup_info.c78aa576-9d15-4e9d-b3c0-4af23a22062c 2023-10-05T11:40:27.959 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.688+0000 7f6244b36880 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T11:40:27.959 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.688+0000 7f6244b36880 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T11:40:27.959 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.688+0000 7f6244b36880 20 rados->read ofs=0 len=0 2023-10-05T11:40:27.959 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.688+0000 7f6244b36880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:40:27.959 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.688+0000 7f6244b36880 20 rados->read ofs=0 len=0 2023-10-05T11:40:27.959 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.689+0000 7f6244b36880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:40:27.960 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.689+0000 7f6244b36880 20 rados->read ofs=0 len=0 2023-10-05T11:40:27.960 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.689+0000 7f6244b36880 20 rados_obj.operate() r=0 bl.length=454 2023-10-05T11:40:27.960 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.689+0000 7f6244b36880 20 zone default found 2023-10-05T11:40:27.960 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.689+0000 7f6244b36880 4 Realm: () 2023-10-05T11:40:27.960 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.689+0000 7f6244b36880 4 ZoneGroup: default (c78aa576-9d15-4e9d-b3c0-4af23a22062c) 2023-10-05T11:40:27.960 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.689+0000 7f6244b36880 4 Zone: default (dff27d1e-df33-400e-a68a-7ba586947c99) 2023-10-05T11:40:27.960 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.689+0000 7f6244b36880 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T11:40:27.960 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.689+0000 7f6244b36880 20 zonegroup default 2023-10-05T11:40:27.960 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.689+0000 7f6244b36880 20 rados->read ofs=0 len=0 2023-10-05T11:40:27.960 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.689+0000 7f6244b36880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:40:27.960 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.690+0000 7f6244b36880 20 rados->read ofs=0 len=0 2023-10-05T11:40:27.961 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.690+0000 7f6244b36880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:40:27.961 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.690+0000 7f6244b36880 20 rados->read ofs=0 len=0 2023-10-05T11:40:27.961 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.690+0000 7f6244b36880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:40:27.961 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.690+0000 7f6244b36880 20 started sync module instance, tier type = 2023-10-05T11:40:27.961 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.690+0000 7f6244b36880 20 started zone id=dff27d1e-df33-400e-a68a-7ba586947c99 (name=default) with tier type = 2023-10-05T11:40:27.961 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.694+0000 7f6240ce0640 0 -- 172.21.15.12:0/536380681 >> [v2:172.21.15.170:6824/75773779,v1:172.21.15.170:6825/75773779] conn(0x558e1e762400 msgr2=0x558e1e5c5700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:40:27.961 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.700+0000 7f6244b36880 20 add_watcher() i=0 2023-10-05T11:40:27.961 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.700+0000 7f6244b36880 20 add_watcher() i=1 2023-10-05T11:40:27.961 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.700+0000 7f6244b36880 20 add_watcher() i=2 2023-10-05T11:40:27.961 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.700+0000 7f6244b36880 20 add_watcher() i=3 2023-10-05T11:40:27.961 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.700+0000 7f6244b36880 20 add_watcher() i=4 2023-10-05T11:40:27.961 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.700+0000 7f6244b36880 20 add_watcher() i=5 2023-10-05T11:40:27.962 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.700+0000 7f6244b36880 20 add_watcher() i=6 2023-10-05T11:40:27.962 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.701+0000 7f6244b36880 20 add_watcher() i=7 2023-10-05T11:40:27.962 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.701+0000 7f6244b36880 2 all 8 watchers are set, enabling cache 2023-10-05T11:40:27.962 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.703+0000 7f62284af640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:40:27.962 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.703+0000 7f6244b36880 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T11:40:27.962 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.703+0000 7f6244b36880 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T11:40:27.962 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.708+0000 7f6244b36880 5 note: GC not initialized 2023-10-05T11:40:27.962 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.709+0000 7f6223ca6640 20 reqs_thread_entry: start 2023-10-05T11:40:27.962 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.709+0000 7f6244b36880 20 init_complete bucket index max shards: 11 2023-10-05T11:40:27.962 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.709+0000 7f6244b36880 20 Filter name: none 2023-10-05T11:40:27.963 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.709+0000 7f6221ca2640 20 reqs_thread_entry: start 2023-10-05T11:40:27.963 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.709+0000 7f6244b36880 20 rados->read ofs=0 len=0 2023-10-05T11:40:27.963 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.710+0000 7f6244b36880 20 rados_obj.operate() r=0 bl.length=213 2023-10-05T11:40:27.963 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.710+0000 7f6244b36880 20 rados->read ofs=0 len=0 2023-10-05T11:40:27.963 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.710+0000 7f6244b36880 20 rados_obj.operate() r=0 bl.length=385 2023-10-05T11:40:27.963 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.710+0000 7f6244b36880 20 couldn't put binfo cache entry, might have raced with data changes 2023-10-05T11:40:27.963 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.710+0000 7f6244b36880 20 rados->read ofs=0 len=0 2023-10-05T11:40:27.963 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.711+0000 7f6244b36880 20 rados_obj.operate() r=0 bl.length=213 2023-10-05T11:40:27.963 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.711+0000 7f6244b36880 20 rados->read ofs=0 len=0 2023-10-05T11:40:27.963 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.711+0000 7f6244b36880 20 rados_obj.operate() r=0 bl.length=385 2023-10-05T11:40:27.963 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.711+0000 7f6244b36880 20 couldn't put binfo cache entry, might have raced with data changes 2023-10-05T11:40:27.963 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.712+0000 7f6244b36880 20 rados->read ofs=0 len=0 2023-10-05T11:40:27.964 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.712+0000 7f6244b36880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:40:27.964 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.713+0000 7f62284af640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:40:27.964 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.715+0000 7f6244b36880 20 remove_watcher() i=0 2023-10-05T11:40:27.964 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.715+0000 7f6244b36880 2 removed watcher, disabling cache 2023-10-05T11:40:27.964 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.716+0000 7f6244b36880 20 remove_watcher() i=1 2023-10-05T11:40:27.964 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.717+0000 7f6244b36880 20 remove_watcher() i=2 2023-10-05T11:40:27.964 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.718+0000 7f6244b36880 20 remove_watcher() i=3 2023-10-05T11:40:27.964 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.719+0000 7f6244b36880 20 remove_watcher() i=4 2023-10-05T11:40:27.964 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.720+0000 7f6244b36880 20 remove_watcher() i=5 2023-10-05T11:40:27.964 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.721+0000 7f6244b36880 20 remove_watcher() i=6 2023-10-05T11:40:27.964 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.722+0000 7f6244b36880 20 remove_watcher() i=7 2023-10-05T11:40:27.964 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:40:27.965 INFO:tasks.workunit.client.0.smithi012.stderr:BUCKET_STATS: 2023-10-05T11:40:27.965 INFO:tasks.workunit.client.0.smithi012.stderr:bucket: error-at-block-writes id: dff27d1e-df33-400e-a68a-7ba586947c99.4604.21 num_objects: 20 size_kb: 1 num_shards: 11 2023-10-05T11:40:27.965 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:40:27.965 INFO:tasks.workunit.client.0.smithi012.stderr:radosgw-admin bucket reshard --bucket error-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2023-10-05T11:40:27.965 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setuser ceph since I am not root 2023-10-05T11:40:27.965 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T11:40:27.965 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.855+0000 7ff38ec44880 20 rados->read ofs=0 len=0 2023-10-05T11:40:27.965 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.857+0000 7ff38ec44880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:40:27.965 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.857+0000 7ff38ec44880 20 realm 2023-10-05T11:40:27.965 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.857+0000 7ff38ec44880 20 rados->read ofs=0 len=0 2023-10-05T11:40:27.965 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.857+0000 7ff38ec44880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:40:27.966 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.857+0000 7ff38ec44880 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T11:40:27.966 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.857+0000 7ff38ec44880 20 rados->read ofs=0 len=0 2023-10-05T11:40:27.966 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.857+0000 7ff38ec44880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:40:27.966 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.857+0000 7ff38ec44880 20 rados->read ofs=0 len=0 2023-10-05T11:40:27.966 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.858+0000 7ff38ec44880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:40:27.966 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.858+0000 7ff38ec44880 20 rados->read ofs=0 len=0 2023-10-05T11:40:27.966 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.859+0000 7ff38ec44880 20 rados_obj.operate() r=0 bl.length=1020 2023-10-05T11:40:27.966 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.859+0000 7ff38ec44880 20 searching for the correct realm 2023-10-05T11:40:27.966 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.868+0000 7ff38d3e9640 0 -- 172.21.15.12:0/3230317232 >> [v2:172.21.15.170:6814/3150808418,v1:172.21.15.170:6816/3150808418] conn(0x55d343ce9400 msgr2=0x55d343c17180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-10-05T11:40:27.966 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.869+0000 7ff38ec44880 20 RGWRados::pool_iterate: got zone_info.dff27d1e-df33-400e-a68a-7ba586947c99 2023-10-05T11:40:27.966 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.869+0000 7ff38ec44880 20 RGWRados::pool_iterate: got zonegroup_info.c78aa576-9d15-4e9d-b3c0-4af23a22062c 2023-10-05T11:40:27.967 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.869+0000 7ff38ec44880 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T11:40:27.967 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.869+0000 7ff38ec44880 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T11:40:27.967 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.869+0000 7ff38ec44880 20 rados->read ofs=0 len=0 2023-10-05T11:40:27.967 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.869+0000 7ff38ec44880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:40:27.967 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.869+0000 7ff38ec44880 20 rados->read ofs=0 len=0 2023-10-05T11:40:27.967 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.869+0000 7ff38ec44880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:40:27.967 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.870+0000 7ff38ec44880 20 rados->read ofs=0 len=0 2023-10-05T11:40:27.967 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.870+0000 7ff38ec44880 20 rados_obj.operate() r=0 bl.length=454 2023-10-05T11:40:27.967 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.870+0000 7ff38ec44880 20 zone default found 2023-10-05T11:40:27.967 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.870+0000 7ff38ec44880 4 Realm: () 2023-10-05T11:40:27.967 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.870+0000 7ff38ec44880 4 ZoneGroup: default (c78aa576-9d15-4e9d-b3c0-4af23a22062c) 2023-10-05T11:40:27.967 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.870+0000 7ff38ec44880 4 Zone: default (dff27d1e-df33-400e-a68a-7ba586947c99) 2023-10-05T11:40:27.968 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.870+0000 7ff38ec44880 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T11:40:27.968 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.870+0000 7ff38ec44880 20 zonegroup default 2023-10-05T11:40:27.968 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.870+0000 7ff38ec44880 20 rados->read ofs=0 len=0 2023-10-05T11:40:27.968 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.870+0000 7ff38ec44880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:40:27.968 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.870+0000 7ff38ec44880 20 rados->read ofs=0 len=0 2023-10-05T11:40:27.968 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.870+0000 7ff38ec44880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:40:27.968 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.870+0000 7ff38ec44880 20 rados->read ofs=0 len=0 2023-10-05T11:40:27.968 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.871+0000 7ff38ec44880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:40:27.968 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.871+0000 7ff38ec44880 20 started sync module instance, tier type = 2023-10-05T11:40:27.968 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.871+0000 7ff38ec44880 20 started zone id=dff27d1e-df33-400e-a68a-7ba586947c99 (name=default) with tier type = 2023-10-05T11:40:27.968 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.877+0000 7ff38dbea640 0 -- 172.21.15.12:0/3230317232 >> [v2:172.21.15.12:6824/2171933159,v1:172.21.15.12:6825/2171933159] conn(0x55d343ce9c00 msgr2=0x55d343dc0580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:40:27.968 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.880+0000 7ff38ec44880 20 add_watcher() i=0 2023-10-05T11:40:27.968 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.880+0000 7ff38ec44880 20 add_watcher() i=1 2023-10-05T11:40:27.969 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.880+0000 7ff38ec44880 20 add_watcher() i=2 2023-10-05T11:40:27.969 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.880+0000 7ff38ec44880 20 add_watcher() i=3 2023-10-05T11:40:27.969 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.880+0000 7ff38ec44880 20 add_watcher() i=4 2023-10-05T11:40:27.969 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.880+0000 7ff38ec44880 20 add_watcher() i=5 2023-10-05T11:40:27.969 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.880+0000 7ff38ec44880 20 add_watcher() i=6 2023-10-05T11:40:27.969 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.881+0000 7ff38ec44880 20 add_watcher() i=7 2023-10-05T11:40:27.969 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.881+0000 7ff38ec44880 2 all 8 watchers are set, enabling cache 2023-10-05T11:40:27.969 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.882+0000 7ff3743b7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:40:27.969 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.883+0000 7ff38ec44880 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T11:40:27.969 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.883+0000 7ff38ec44880 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T11:40:27.969 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.888+0000 7ff38ec44880 5 note: GC not initialized 2023-10-05T11:40:27.969 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.888+0000 7ff36fbae640 20 reqs_thread_entry: start 2023-10-05T11:40:27.970 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.888+0000 7ff38ec44880 20 init_complete bucket index max shards: 11 2023-10-05T11:40:27.970 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.888+0000 7ff38ec44880 20 Filter name: none 2023-10-05T11:40:27.970 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.889+0000 7ff36dbaa640 20 reqs_thread_entry: start 2023-10-05T11:40:27.970 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.889+0000 7ff38ec44880 10 cache get: name=default.rgw.meta+root+error-at-block-writes : miss 2023-10-05T11:40:27.970 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.889+0000 7ff38ec44880 20 rados->read ofs=0 len=0 2023-10-05T11:40:27.970 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.889+0000 7ff38ec44880 20 rados_obj.operate() r=0 bl.length=213 2023-10-05T11:40:27.970 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.889+0000 7ff38ec44880 10 cache put: name=default.rgw.meta+root+error-at-block-writes info.flags=0x11 2023-10-05T11:40:27.970 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.889+0000 7ff38ec44880 10 adding default.rgw.meta+root+error-at-block-writes to cache LRU end 2023-10-05T11:40:27.970 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.889+0000 7ff38ec44880 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:dff27d1e-df33-400e-a68a-7ba586947c99.4604.21 : miss 2023-10-05T11:40:27.970 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.889+0000 7ff38ec44880 20 rados->read ofs=0 len=0 2023-10-05T11:40:27.970 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.889+0000 7ff38ec44880 20 rados_obj.operate() r=0 bl.length=385 2023-10-05T11:40:27.970 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.889+0000 7ff38ec44880 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:dff27d1e-df33-400e-a68a-7ba586947c99.4604.21 info.flags=0x17 2023-10-05T11:40:27.971 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.889+0000 7ff38ec44880 10 adding default.rgw.meta+root+.bucket.meta.error-at-block-writes:dff27d1e-df33-400e-a68a-7ba586947c99.4604.21 to cache LRU end 2023-10-05T11:40:27.971 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.889+0000 7ff38ec44880 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T11:40:27.971 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.889+0000 7ff38ec44880 10 updating xattr: name=user.rgw.acl bl.length()=265 2023-10-05T11:40:27.971 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.890+0000 7ff38ec44880 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:dff27d1e-df33-400e-a68a-7ba586947c99.4604.21 2023-10-05T11:40:27.971 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.895+0000 7ff38ec44880 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:dff27d1e-df33-400e-a68a-7ba586947c99.4604.21 info.flags=0x17 2023-10-05T11:40:27.971 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.895+0000 7ff38ec44880 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:dff27d1e-df33-400e-a68a-7ba586947c99.4604.21 to cache LRU end 2023-10-05T11:40:27.971 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.895+0000 7ff38ec44880 10 updating xattr: name=user.rgw.acl bl.length()=265 2023-10-05T11:40:27.971 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.895+0000 7ff38ec44880 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:dff27d1e-df33-400e-a68a-7ba586947c99.4604.21, ofs0, ns] 2023-10-05T11:40:27.971 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.896+0000 7ff3873dd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1060856922161 cookie 94365865209856 notifier 6756 bl.length()=949 2023-10-05T11:40:27.971 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.896+0000 7ff3873dd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:dff27d1e-df33-400e-a68a-7ba586947c99.4604.21 info.flags=0x17 2023-10-05T11:40:27.971 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.896+0000 7ff3873dd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:dff27d1e-df33-400e-a68a-7ba586947c99.4604.21 to cache LRU end 2023-10-05T11:40:27.971 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.896+0000 7ff3873dd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2023-10-05T11:40:27.972 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.897+0000 7ff38ec44880 20 handle_bi_update(): bucket=:error-at-block-writes[dff27d1e-df33-400e-a68a-7ba586947c99.4604.21]): orig_sources= new_sources= 2023-10-05T11:40:27.972 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.897+0000 7ff38ec44880 20 handle_bi_update(): bucket=:error-at-block-writes[dff27d1e-df33-400e-a68a-7ba586947c99.4604.21]): potential sources added=[] removed=[] 2023-10-05T11:40:27.972 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.897+0000 7ff38ec44880 20 handle_bi_update(): bucket=:error-at-block-writes[dff27d1e-df33-400e-a68a-7ba586947c99.4604.21]): orig_dests= new_dests= 2023-10-05T11:40:28.046 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.897+0000 7ff38ec44880 20 handle_bi_update(): bucket=:error-at-block-writes[dff27d1e-df33-400e-a68a-7ba586947c99.4604.21]): potential dests added=[] removed=[] 2023-10-05T11:40:28.046 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.900+0000 7ff38ec44880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.21.1.0 2023-10-05T11:40:28.046 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.900+0000 7ff38ec44880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.21.1.0 2023-10-05T11:40:28.046 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.900+0000 7ff38ec44880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.21.1.1 2023-10-05T11:40:28.046 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.900+0000 7ff38ec44880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.21.1.1 2023-10-05T11:40:28.046 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.900+0000 7ff38ec44880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.21.1.2 2023-10-05T11:40:28.046 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.900+0000 7ff38ec44880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.21.1.2 2023-10-05T11:40:28.046 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.900+0000 7ff38ec44880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.21.1.3 2023-10-05T11:40:28.047 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.900+0000 7ff38ec44880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.21.1.3 2023-10-05T11:40:28.047 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.900+0000 7ff38ec44880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.21.1.4 2023-10-05T11:40:28.047 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.900+0000 7ff38ec44880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.21.1.4 2023-10-05T11:40:28.047 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.900+0000 7ff38ec44880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.21.1.5 2023-10-05T11:40:28.047 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.900+0000 7ff38ec44880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.21.1.5 2023-10-05T11:40:28.047 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.900+0000 7ff38ec44880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.21.1.6 2023-10-05T11:40:28.047 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.900+0000 7ff38ec44880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.21.1.6 2023-10-05T11:40:28.047 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.900+0000 7ff38ec44880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.21.1.7 2023-10-05T11:40:28.047 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.900+0000 7ff38ec44880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.21.1.7 2023-10-05T11:40:28.047 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.900+0000 7ff38ec44880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.21.1.8 2023-10-05T11:40:28.048 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.900+0000 7ff38ec44880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.21.1.8 2023-10-05T11:40:28.048 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.900+0000 7ff38ec44880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.21.1.9 2023-10-05T11:40:28.048 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.900+0000 7ff38ec44880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.21.1.9 2023-10-05T11:40:28.048 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.900+0000 7ff38ec44880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.21.1.10 2023-10-05T11:40:28.048 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.900+0000 7ff38ec44880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.21.1.10 2023-10-05T11:40:28.048 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.900+0000 7ff38ec44880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.21.1.11 2023-10-05T11:40:28.048 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.900+0000 7ff38ec44880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.21.1.11 2023-10-05T11:40:28.048 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.900+0000 7ff38ec44880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.21.0 2023-10-05T11:40:28.048 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.901+0000 7ff38ec44880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.21.1 2023-10-05T11:40:28.048 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.901+0000 7ff38ec44880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.21.2 2023-10-05T11:40:28.048 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.902+0000 7ff38ec44880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.21.3 2023-10-05T11:40:28.048 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.902+0000 7ff38ec44880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.21.4 2023-10-05T11:40:28.049 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.903+0000 7ff38ec44880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.21.5 2023-10-05T11:40:28.049 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.903+0000 7ff38ec44880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.21.6 2023-10-05T11:40:28.049 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.904+0000 7ff38ec44880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.21.7 2023-10-05T11:40:28.049 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.904+0000 7ff38ec44880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.21.8 2023-10-05T11:40:28.049 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.905+0000 7ff38ec44880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.21.9 2023-10-05T11:40:28.049 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.905+0000 7ff38ec44880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.21.10 2023-10-05T11:40:28.049 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.908+0000 7ff38ec44880 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:dff27d1e-df33-400e-a68a-7ba586947c99.4604.21 : hit (requested=0x17, cached=0x17) 2023-10-05T11:40:28.049 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.908+0000 7ff38ec44880 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:dff27d1e-df33-400e-a68a-7ba586947c99.4604.21 2023-10-05T11:40:28.049 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.910+0000 7ff38ec44880 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:dff27d1e-df33-400e-a68a-7ba586947c99.4604.21 info.flags=0x17 2023-10-05T11:40:28.049 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.910+0000 7ff38ec44880 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:dff27d1e-df33-400e-a68a-7ba586947c99.4604.21 to cache LRU end 2023-10-05T11:40:28.050 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.910+0000 7ff38ec44880 10 updating xattr: name=user.rgw.acl bl.length()=265 2023-10-05T11:40:28.050 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.910+0000 7ff38ec44880 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:dff27d1e-df33-400e-a68a-7ba586947c99.4604.21, ofs0, ns] 2023-10-05T11:40:28.050 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.910+0000 7ff387bde640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1060856922162 cookie 94365865209856 notifier 6756 bl.length()=917 2023-10-05T11:40:28.050 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.910+0000 7ff387bde640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:dff27d1e-df33-400e-a68a-7ba586947c99.4604.21 info.flags=0x17 2023-10-05T11:40:28.050 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.910+0000 7ff387bde640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:dff27d1e-df33-400e-a68a-7ba586947c99.4604.21 to cache LRU end 2023-10-05T11:40:28.050 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.910+0000 7ff387bde640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2023-10-05T11:40:28.050 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.911+0000 7ff38ec44880 20 handle_bi_update(): bucket=:error-at-block-writes[dff27d1e-df33-400e-a68a-7ba586947c99.4604.21]): orig_sources= new_sources= 2023-10-05T11:40:28.050 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.911+0000 7ff38ec44880 20 handle_bi_update(): bucket=:error-at-block-writes[dff27d1e-df33-400e-a68a-7ba586947c99.4604.21]): potential sources added=[] removed=[] 2023-10-05T11:40:28.050 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.911+0000 7ff38ec44880 20 handle_bi_update(): bucket=:error-at-block-writes[dff27d1e-df33-400e-a68a-7ba586947c99.4604.21]): orig_dests= new_dests= 2023-10-05T11:40:28.050 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.911+0000 7ff38ec44880 20 handle_bi_update(): bucket=:error-at-block-writes[dff27d1e-df33-400e-a68a-7ba586947c99.4604.21]): potential dests added=[] removed=[] 2023-10-05T11:40:28.050 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.914+0000 7ff38ec44880 1 execute INFO: reshard of bucket "error-at-block-writes" completed successfully 2023-10-05T11:40:28.051 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.916+0000 7ff3743b7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:40:28.051 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.918+0000 7ff38ec44880 20 remove_watcher() i=0 2023-10-05T11:40:28.051 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.918+0000 7ff38ec44880 2 removed watcher, disabling cache 2023-10-05T11:40:28.051 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.919+0000 7ff38ec44880 20 remove_watcher() i=1 2023-10-05T11:40:28.051 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.920+0000 7ff38ec44880 20 remove_watcher() i=2 2023-10-05T11:40:28.051 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.921+0000 7ff38ec44880 20 remove_watcher() i=3 2023-10-05T11:40:28.051 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.922+0000 7ff38ec44880 20 remove_watcher() i=4 2023-10-05T11:40:28.051 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.923+0000 7ff38ec44880 20 remove_watcher() i=5 2023-10-05T11:40:28.051 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.924+0000 7ff38ec44880 20 remove_watcher() i=6 2023-10-05T11:40:28.051 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.925+0000 7ff38ec44880 20 remove_watcher() i=7 2023-10-05T11:40:28.051 INFO:tasks.workunit.client.0.smithi012.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2023-10-05T11:40:28.056 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setuser ceph since I am not root 2023-10-05T11:40:28.057 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T11:40:28.057 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.972+0000 7f24d4e33880 20 rados->read ofs=0 len=0 2023-10-05T11:40:28.057 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.974+0000 7f24d4e33880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:40:28.057 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.974+0000 7f24d4e33880 20 realm 2023-10-05T11:40:28.057 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.974+0000 7f24d4e33880 20 rados->read ofs=0 len=0 2023-10-05T11:40:28.057 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.974+0000 7f24d4e33880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:40:28.057 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.974+0000 7f24d4e33880 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T11:40:28.057 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.974+0000 7f24d4e33880 20 rados->read ofs=0 len=0 2023-10-05T11:40:28.057 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.974+0000 7f24d4e33880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:40:28.057 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.974+0000 7f24d4e33880 20 rados->read ofs=0 len=0 2023-10-05T11:40:28.058 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.975+0000 7f24d4e33880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:40:28.058 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.975+0000 7f24d4e33880 20 rados->read ofs=0 len=0 2023-10-05T11:40:28.058 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.975+0000 7f24d4e33880 20 rados_obj.operate() r=0 bl.length=1020 2023-10-05T11:40:28.058 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.975+0000 7f24d4e33880 20 searching for the correct realm 2023-10-05T11:40:28.058 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.983+0000 7f24d3de0640 0 -- 172.21.15.12:0/3447171818 >> [v2:172.21.15.12:6813/3341239609,v1:172.21.15.12:6815/3341239609] conn(0x55da2b29bc00 msgr2=0x55da2a6a4c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-10-05T11:40:28.058 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.987+0000 7f24d4e33880 20 RGWRados::pool_iterate: got zone_info.dff27d1e-df33-400e-a68a-7ba586947c99 2023-10-05T11:40:28.058 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.987+0000 7f24d4e33880 20 RGWRados::pool_iterate: got zonegroup_info.c78aa576-9d15-4e9d-b3c0-4af23a22062c 2023-10-05T11:40:28.058 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.987+0000 7f24d4e33880 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T11:40:28.058 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.987+0000 7f24d4e33880 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T11:40:28.058 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.987+0000 7f24d4e33880 20 rados->read ofs=0 len=0 2023-10-05T11:40:28.058 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.987+0000 7f24d4e33880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:40:28.059 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.987+0000 7f24d4e33880 20 rados->read ofs=0 len=0 2023-10-05T11:40:28.059 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.987+0000 7f24d4e33880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:40:28.059 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.987+0000 7f24d4e33880 20 rados->read ofs=0 len=0 2023-10-05T11:40:28.059 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.987+0000 7f24d4e33880 20 rados_obj.operate() r=0 bl.length=454 2023-10-05T11:40:28.059 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.987+0000 7f24d4e33880 20 zone default found 2023-10-05T11:40:28.059 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.987+0000 7f24d4e33880 4 Realm: () 2023-10-05T11:40:28.059 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.987+0000 7f24d4e33880 4 ZoneGroup: default (c78aa576-9d15-4e9d-b3c0-4af23a22062c) 2023-10-05T11:40:28.059 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.987+0000 7f24d4e33880 4 Zone: default (dff27d1e-df33-400e-a68a-7ba586947c99) 2023-10-05T11:40:28.059 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.987+0000 7f24d4e33880 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T11:40:28.059 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.987+0000 7f24d4e33880 20 zonegroup default 2023-10-05T11:40:28.059 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.987+0000 7f24d4e33880 20 rados->read ofs=0 len=0 2023-10-05T11:40:28.059 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.988+0000 7f24d4e33880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:40:28.060 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.988+0000 7f24d4e33880 20 rados->read ofs=0 len=0 2023-10-05T11:40:28.060 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.988+0000 7f24d4e33880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:40:28.060 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.988+0000 7f24d2dde640 0 -- 172.21.15.12:0/3447171818 >> [v2:172.21.15.170:6808/2113414864,v1:172.21.15.170:6809/2113414864] conn(0x55da2a858000 msgr2=0x55da2a771700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:40:28.060 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.988+0000 7f24d4e33880 20 rados->read ofs=0 len=0 2023-10-05T11:40:28.060 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.988+0000 7f24d4e33880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:40:28.060 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.988+0000 7f24d4e33880 20 started sync module instance, tier type = 2023-10-05T11:40:28.060 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.988+0000 7f24d4e33880 20 started zone id=dff27d1e-df33-400e-a68a-7ba586947c99 (name=default) with tier type = 2023-10-05T11:40:28.060 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.997+0000 7f24d4e33880 20 add_watcher() i=0 2023-10-05T11:40:28.060 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.997+0000 7f24d4e33880 20 add_watcher() i=1 2023-10-05T11:40:28.060 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.997+0000 7f24d4e33880 20 add_watcher() i=2 2023-10-05T11:40:28.060 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.997+0000 7f24d4e33880 20 add_watcher() i=3 2023-10-05T11:40:28.061 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.997+0000 7f24d4e33880 20 add_watcher() i=4 2023-10-05T11:40:28.061 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.997+0000 7f24d4e33880 20 add_watcher() i=5 2023-10-05T11:40:28.061 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.997+0000 7f24d4e33880 20 add_watcher() i=6 2023-10-05T11:40:28.061 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.998+0000 7f24d4e33880 20 add_watcher() i=7 2023-10-05T11:40:28.061 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.998+0000 7f24d4e33880 2 all 8 watchers are set, enabling cache 2023-10-05T11:40:28.061 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.999+0000 7f24ba5ad640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:40:28.061 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.999+0000 7f24d4e33880 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T11:40:28.061 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:27.999+0000 7f24d4e33880 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T11:40:28.061 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:28.005+0000 7f24d4e33880 5 note: GC not initialized 2023-10-05T11:40:28.061 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:28.005+0000 7f24b5da4640 20 reqs_thread_entry: start 2023-10-05T11:40:28.061 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:28.005+0000 7f24d4e33880 20 init_complete bucket index max shards: 11 2023-10-05T11:40:28.061 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:28.005+0000 7f24d4e33880 20 Filter name: none 2023-10-05T11:40:28.061 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:28.005+0000 7f24b3da0640 20 reqs_thread_entry: start 2023-10-05T11:40:28.062 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:28.005+0000 7f24d4e33880 20 rados->read ofs=0 len=0 2023-10-05T11:40:28.062 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:28.006+0000 7f24d4e33880 20 rados_obj.operate() r=0 bl.length=213 2023-10-05T11:40:28.062 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:28.006+0000 7f24d4e33880 20 rados->read ofs=0 len=0 2023-10-05T11:40:28.062 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:28.007+0000 7f24d4e33880 20 rados_obj.operate() r=0 bl.length=385 2023-10-05T11:40:28.062 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:28.007+0000 7f24d4e33880 20 couldn't put binfo cache entry, might have raced with data changes 2023-10-05T11:40:28.062 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:28.007+0000 7f24d4e33880 20 rados->read ofs=0 len=0 2023-10-05T11:40:28.062 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:28.007+0000 7f24d4e33880 20 rados_obj.operate() r=0 bl.length=213 2023-10-05T11:40:28.062 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:28.007+0000 7f24d4e33880 20 rados->read ofs=0 len=0 2023-10-05T11:40:28.062 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:28.007+0000 7f24d4e33880 20 rados_obj.operate() r=0 bl.length=385 2023-10-05T11:40:28.062 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:28.007+0000 7f24d4e33880 20 couldn't put binfo cache entry, might have raced with data changes 2023-10-05T11:40:28.062 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:28.008+0000 7f24d4e33880 20 rados->read ofs=0 len=0 2023-10-05T11:40:28.063 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:28.008+0000 7f24d4e33880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:40:28.063 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:28.009+0000 7f24ba5ad640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:40:28.063 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:28.011+0000 7f24d4e33880 20 remove_watcher() i=0 2023-10-05T11:40:28.063 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:28.011+0000 7f24d4e33880 2 removed watcher, disabling cache 2023-10-05T11:40:28.063 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:28.012+0000 7f24d4e33880 20 remove_watcher() i=1 2023-10-05T11:40:28.063 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:28.013+0000 7f24d4e33880 20 remove_watcher() i=2 2023-10-05T11:40:28.063 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:28.014+0000 7f24d4e33880 20 remove_watcher() i=3 2023-10-05T11:40:28.063 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:28.015+0000 7f24d4e33880 20 remove_watcher() i=4 2023-10-05T11:40:28.063 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:28.016+0000 7f24d4e33880 20 remove_watcher() i=5 2023-10-05T11:40:28.063 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:28.017+0000 7f24d4e33880 20 remove_watcher() i=6 2023-10-05T11:40:28.063 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:28.018+0000 7f24d4e33880 20 remove_watcher() i=7 2023-10-05T11:40:28.063 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:40:28.064 INFO:tasks.workunit.client.0.smithi012.stderr:BUCKET_STATS: 2023-10-05T11:40:28.064 INFO:tasks.workunit.client.0.smithi012.stderr:bucket: error-at-block-writes id: dff27d1e-df33-400e-a68a-7ba586947c99.4604.21 num_objects: 19 size_kb: 1 num_shards: 12 2023-10-05T11:40:28.064 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:40:28.359 INFO:tasks.workunit.client.0.smithi012.stderr:TEST: reshard bucket with abort at block_writes 2023-10-05T11:40:28.359 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:40:29.054 INFO:tasks.workunit.client.0.smithi012.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2023-10-05T11:40:29.081 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setuser ceph since I am not root 2023-10-05T11:40:29.082 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T11:40:29.095 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.092+0000 7f34e1d1f880 20 rados->read ofs=0 len=0 2023-10-05T11:40:29.097 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.093+0000 7f34e1d1f880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:40:29.097 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.093+0000 7f34e1d1f880 20 realm 2023-10-05T11:40:29.097 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.094+0000 7f34e1d1f880 20 rados->read ofs=0 len=0 2023-10-05T11:40:29.097 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.094+0000 7f34e1d1f880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:40:29.098 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.094+0000 7f34e1d1f880 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T11:40:29.098 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.094+0000 7f34e1d1f880 20 rados->read ofs=0 len=0 2023-10-05T11:40:29.098 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.094+0000 7f34e1d1f880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:40:29.098 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.094+0000 7f34e1d1f880 20 rados->read ofs=0 len=0 2023-10-05T11:40:29.098 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.095+0000 7f34e1d1f880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:40:29.098 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.095+0000 7f34e1d1f880 20 rados->read ofs=0 len=0 2023-10-05T11:40:29.099 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.096+0000 7f34e1d1f880 20 rados_obj.operate() r=0 bl.length=1020 2023-10-05T11:40:29.099 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.096+0000 7f34e1d1f880 20 searching for the correct realm 2023-10-05T11:40:29.108 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.104+0000 7f34de5b8640 0 -- 172.21.15.12:0/2539977037 >> [v2:172.21.15.12:6800/732466381,v1:172.21.15.12:6801/732466381] conn(0x56493067e400 msgr2=0x56493066ec00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:40:29.109 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.106+0000 7f34e1d1f880 20 RGWRados::pool_iterate: got zone_info.dff27d1e-df33-400e-a68a-7ba586947c99 2023-10-05T11:40:29.109 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.106+0000 7f34e1d1f880 20 RGWRados::pool_iterate: got zonegroup_info.c78aa576-9d15-4e9d-b3c0-4af23a22062c 2023-10-05T11:40:29.109 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.106+0000 7f34e1d1f880 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T11:40:29.109 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.106+0000 7f34e1d1f880 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T11:40:29.110 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.106+0000 7f34e1d1f880 20 rados->read ofs=0 len=0 2023-10-05T11:40:29.110 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.106+0000 7f34e1d1f880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:40:29.110 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.106+0000 7f34e1d1f880 20 rados->read ofs=0 len=0 2023-10-05T11:40:29.110 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.106+0000 7f34e1d1f880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:40:29.110 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.106+0000 7f34e1d1f880 20 rados->read ofs=0 len=0 2023-10-05T11:40:29.111 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.106+0000 7f34e1d1f880 20 rados_obj.operate() r=0 bl.length=454 2023-10-05T11:40:29.111 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.106+0000 7f34e1d1f880 20 zone default found 2023-10-05T11:40:29.111 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.106+0000 7f34e1d1f880 4 Realm: () 2023-10-05T11:40:29.111 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.106+0000 7f34e1d1f880 4 ZoneGroup: default (c78aa576-9d15-4e9d-b3c0-4af23a22062c) 2023-10-05T11:40:29.111 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.106+0000 7f34e1d1f880 4 Zone: default (dff27d1e-df33-400e-a68a-7ba586947c99) 2023-10-05T11:40:29.111 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.106+0000 7f34e1d1f880 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T11:40:29.112 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.106+0000 7f34e1d1f880 20 zonegroup default 2023-10-05T11:40:29.112 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.106+0000 7f34e1d1f880 20 rados->read ofs=0 len=0 2023-10-05T11:40:29.112 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.107+0000 7f34e1d1f880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:40:29.112 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.107+0000 7f34e1d1f880 20 rados->read ofs=0 len=0 2023-10-05T11:40:29.112 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.107+0000 7f34e1d1f880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:40:29.112 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.107+0000 7f34e1d1f880 20 rados->read ofs=0 len=0 2023-10-05T11:40:29.112 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.107+0000 7f34e1d1f880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:40:29.112 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.107+0000 7f34e1d1f880 20 started sync module instance, tier type = 2023-10-05T11:40:29.112 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.107+0000 7f34e1d1f880 20 started zone id=dff27d1e-df33-400e-a68a-7ba586947c99 (name=default) with tier type = 2023-10-05T11:40:29.116 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.113+0000 7f34de5b8640 0 -- 172.21.15.12:0/2539977037 >> [v2:172.21.15.12:6800/732466381,v1:172.21.15.12:6801/732466381] conn(0x5649306a6000 msgr2=0x56493069b080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:40:29.119 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.116+0000 7f34e1d1f880 20 add_watcher() i=0 2023-10-05T11:40:29.120 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.116+0000 7f34e1d1f880 20 add_watcher() i=1 2023-10-05T11:40:29.120 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.116+0000 7f34e1d1f880 20 add_watcher() i=2 2023-10-05T11:40:29.120 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.116+0000 7f34e1d1f880 20 add_watcher() i=3 2023-10-05T11:40:29.120 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.116+0000 7f34e1d1f880 20 add_watcher() i=4 2023-10-05T11:40:29.120 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.116+0000 7f34e1d1f880 20 add_watcher() i=5 2023-10-05T11:40:29.120 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.116+0000 7f34e1d1f880 20 add_watcher() i=6 2023-10-05T11:40:29.120 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.117+0000 7f34e1d1f880 20 add_watcher() i=7 2023-10-05T11:40:29.120 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.117+0000 7f34e1d1f880 2 all 8 watchers are set, enabling cache 2023-10-05T11:40:29.122 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.119+0000 7f34c5586640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:40:29.122 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.119+0000 7f34e1d1f880 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T11:40:29.123 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.119+0000 7f34e1d1f880 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T11:40:29.128 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.125+0000 7f34e1d1f880 5 note: GC not initialized 2023-10-05T11:40:29.128 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.125+0000 7f34c0d7d640 20 reqs_thread_entry: start 2023-10-05T11:40:29.128 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.125+0000 7f34e1d1f880 20 init_complete bucket index max shards: 11 2023-10-05T11:40:29.129 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.125+0000 7f34e1d1f880 20 Filter name: none 2023-10-05T11:40:29.129 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.125+0000 7f34bed79640 20 reqs_thread_entry: start 2023-10-05T11:40:29.129 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.125+0000 7f34e1d1f880 20 rados->read ofs=0 len=0 2023-10-05T11:40:29.129 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.126+0000 7f34e1d1f880 20 rados_obj.operate() r=0 bl.length=213 2023-10-05T11:40:29.129 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.126+0000 7f34e1d1f880 20 rados->read ofs=0 len=0 2023-10-05T11:40:29.130 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.126+0000 7f34e1d1f880 20 rados_obj.operate() r=0 bl.length=385 2023-10-05T11:40:29.130 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.126+0000 7f34e1d1f880 20 couldn't put binfo cache entry, might have raced with data changes 2023-10-05T11:40:29.130 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.126+0000 7f34e1d1f880 20 rados->read ofs=0 len=0 2023-10-05T11:40:29.130 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.127+0000 7f34e1d1f880 20 rados_obj.operate() r=0 bl.length=213 2023-10-05T11:40:29.130 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.127+0000 7f34e1d1f880 20 rados->read ofs=0 len=0 2023-10-05T11:40:29.131 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.127+0000 7f34e1d1f880 20 rados_obj.operate() r=0 bl.length=385 2023-10-05T11:40:29.131 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.127+0000 7f34e1d1f880 20 couldn't put binfo cache entry, might have raced with data changes 2023-10-05T11:40:29.131 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.128+0000 7f34e1d1f880 20 rados->read ofs=0 len=0 2023-10-05T11:40:29.131 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.128+0000 7f34e1d1f880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:40:29.132 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.129+0000 7f34c5586640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:40:29.134 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.131+0000 7f34e1d1f880 20 remove_watcher() i=0 2023-10-05T11:40:29.134 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.131+0000 7f34e1d1f880 2 removed watcher, disabling cache 2023-10-05T11:40:29.135 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.132+0000 7f34e1d1f880 20 remove_watcher() i=1 2023-10-05T11:40:29.136 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.133+0000 7f34e1d1f880 20 remove_watcher() i=2 2023-10-05T11:40:29.137 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.133+0000 7f34e1d1f880 20 remove_watcher() i=3 2023-10-05T11:40:29.138 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.134+0000 7f34e1d1f880 20 remove_watcher() i=4 2023-10-05T11:40:29.139 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.135+0000 7f34e1d1f880 20 remove_watcher() i=5 2023-10-05T11:40:29.140 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.136+0000 7f34e1d1f880 20 remove_watcher() i=6 2023-10-05T11:40:29.141 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.137+0000 7f34e1d1f880 20 remove_watcher() i=7 2023-10-05T11:40:29.145 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:40:29.145 INFO:tasks.workunit.client.0.smithi012.stderr:BUCKET_STATS: 2023-10-05T11:40:29.145 INFO:tasks.workunit.client.0.smithi012.stderr:bucket: abort-at-block-writes id: dff27d1e-df33-400e-a68a-7ba586947c99.4604.22 num_objects: 20 size_kb: 1 num_shards: 11 2023-10-05T11:40:29.145 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:40:29.147 INFO:tasks.workunit.client.0.smithi012.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at block_writes 2023-10-05T11:40:29.181 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setuser ceph since I am not root 2023-10-05T11:40:29.181 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T11:40:29.194 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.191+0000 7fc5fab4b880 20 rados->read ofs=0 len=0 2023-10-05T11:40:29.196 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.192+0000 7fc5fab4b880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:40:29.196 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.192+0000 7fc5fab4b880 20 realm 2023-10-05T11:40:29.196 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.192+0000 7fc5fab4b880 20 rados->read ofs=0 len=0 2023-10-05T11:40:29.196 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.192+0000 7fc5fab4b880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:40:29.196 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.192+0000 7fc5fab4b880 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T11:40:29.196 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.192+0000 7fc5fab4b880 20 rados->read ofs=0 len=0 2023-10-05T11:40:29.196 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.193+0000 7fc5fab4b880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:40:29.197 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.193+0000 7fc5fab4b880 20 rados->read ofs=0 len=0 2023-10-05T11:40:29.197 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.193+0000 7fc5fab4b880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:40:29.197 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.193+0000 7fc5fab4b880 20 rados->read ofs=0 len=0 2023-10-05T11:40:29.197 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.194+0000 7fc5fab4b880 20 rados_obj.operate() r=0 bl.length=1020 2023-10-05T11:40:29.198 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.194+0000 7fc5fab4b880 20 searching for the correct realm 2023-10-05T11:40:29.206 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.202+0000 7fc5f92f0640 0 -- 172.21.15.12:0/2263745182 >> [v2:172.21.15.12:6808/396693578,v1:172.21.15.12:6809/396693578] conn(0x5632594be800 msgr2=0x5632593c5b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:40:29.208 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.204+0000 7fc5fab4b880 20 RGWRados::pool_iterate: got zone_info.dff27d1e-df33-400e-a68a-7ba586947c99 2023-10-05T11:40:29.208 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.204+0000 7fc5fab4b880 20 RGWRados::pool_iterate: got zonegroup_info.c78aa576-9d15-4e9d-b3c0-4af23a22062c 2023-10-05T11:40:29.208 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.204+0000 7fc5fab4b880 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T11:40:29.208 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.204+0000 7fc5fab4b880 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T11:40:29.208 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.204+0000 7fc5fab4b880 20 rados->read ofs=0 len=0 2023-10-05T11:40:29.208 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.205+0000 7fc5fab4b880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:40:29.208 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.205+0000 7fc5fab4b880 20 rados->read ofs=0 len=0 2023-10-05T11:40:29.210 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.205+0000 7fc5fab4b880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:40:29.210 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.205+0000 7fc5fab4b880 20 rados->read ofs=0 len=0 2023-10-05T11:40:29.210 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.205+0000 7fc5fab4b880 20 rados_obj.operate() r=0 bl.length=454 2023-10-05T11:40:29.210 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.205+0000 7fc5fab4b880 20 zone default found 2023-10-05T11:40:29.210 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.205+0000 7fc5fab4b880 4 Realm: () 2023-10-05T11:40:29.210 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.205+0000 7fc5fab4b880 4 ZoneGroup: default (c78aa576-9d15-4e9d-b3c0-4af23a22062c) 2023-10-05T11:40:29.211 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.205+0000 7fc5fab4b880 4 Zone: default (dff27d1e-df33-400e-a68a-7ba586947c99) 2023-10-05T11:40:29.211 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.205+0000 7fc5fab4b880 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T11:40:29.211 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.205+0000 7fc5fab4b880 20 zonegroup default 2023-10-05T11:40:29.211 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.205+0000 7fc5fab4b880 20 rados->read ofs=0 len=0 2023-10-05T11:40:29.211 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.205+0000 7fc5fab4b880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:40:29.211 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.205+0000 7fc5fab4b880 20 rados->read ofs=0 len=0 2023-10-05T11:40:29.211 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.206+0000 7fc5fab4b880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:40:29.211 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.206+0000 7fc5fab4b880 20 rados->read ofs=0 len=0 2023-10-05T11:40:29.211 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.206+0000 7fc5fab4b880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:40:29.211 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.206+0000 7fc5fab4b880 20 started sync module instance, tier type = 2023-10-05T11:40:29.212 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.206+0000 7fc5fab4b880 20 started zone id=dff27d1e-df33-400e-a68a-7ba586947c99 (name=default) with tier type = 2023-10-05T11:40:29.214 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.211+0000 7fc5f8aef640 0 -- 172.21.15.12:0/2263745182 >> [v2:172.21.15.170:6824/75773779,v1:172.21.15.170:6825/75773779] conn(0x5632593ce800 msgr2=0x5632592fd180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:40:29.218 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.215+0000 7fc5fab4b880 20 add_watcher() i=0 2023-10-05T11:40:29.218 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.215+0000 7fc5fab4b880 20 add_watcher() i=1 2023-10-05T11:40:29.219 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.215+0000 7fc5fab4b880 20 add_watcher() i=2 2023-10-05T11:40:29.219 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.215+0000 7fc5fab4b880 20 add_watcher() i=3 2023-10-05T11:40:29.219 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.215+0000 7fc5fab4b880 20 add_watcher() i=4 2023-10-05T11:40:29.219 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.215+0000 7fc5fab4b880 20 add_watcher() i=5 2023-10-05T11:40:29.219 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.215+0000 7fc5fab4b880 20 add_watcher() i=6 2023-10-05T11:40:29.219 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.216+0000 7fc5fab4b880 20 add_watcher() i=7 2023-10-05T11:40:29.219 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.216+0000 7fc5fab4b880 2 all 8 watchers are set, enabling cache 2023-10-05T11:40:29.221 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.217+0000 7fc5e02be640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:40:29.221 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.218+0000 7fc5fab4b880 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T11:40:29.221 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.218+0000 7fc5fab4b880 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T11:40:29.227 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.223+0000 7fc5fab4b880 5 note: GC not initialized 2023-10-05T11:40:29.227 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.223+0000 7fc5dbab5640 20 reqs_thread_entry: start 2023-10-05T11:40:29.227 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.223+0000 7fc5fab4b880 20 init_complete bucket index max shards: 11 2023-10-05T11:40:29.227 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.223+0000 7fc5fab4b880 20 Filter name: none 2023-10-05T11:40:29.227 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.224+0000 7fc5d9ab1640 20 reqs_thread_entry: start 2023-10-05T11:40:29.227 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.224+0000 7fc5fab4b880 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2023-10-05T11:40:29.227 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.224+0000 7fc5fab4b880 20 rados->read ofs=0 len=0 2023-10-05T11:40:29.228 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.224+0000 7fc5fab4b880 20 rados_obj.operate() r=0 bl.length=213 2023-10-05T11:40:29.228 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.224+0000 7fc5fab4b880 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2023-10-05T11:40:29.228 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.224+0000 7fc5fab4b880 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2023-10-05T11:40:29.228 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.224+0000 7fc5fab4b880 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dff27d1e-df33-400e-a68a-7ba586947c99.4604.22 : miss 2023-10-05T11:40:29.229 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.224+0000 7fc5fab4b880 20 rados->read ofs=0 len=0 2023-10-05T11:40:29.229 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.225+0000 7fc5fab4b880 20 rados_obj.operate() r=0 bl.length=385 2023-10-05T11:40:29.229 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.225+0000 7fc5fab4b880 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dff27d1e-df33-400e-a68a-7ba586947c99.4604.22 info.flags=0x17 2023-10-05T11:40:29.229 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.225+0000 7fc5fab4b880 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dff27d1e-df33-400e-a68a-7ba586947c99.4604.22 to cache LRU end 2023-10-05T11:40:29.229 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.225+0000 7fc5fab4b880 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T11:40:29.229 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.225+0000 7fc5fab4b880 10 updating xattr: name=user.rgw.acl bl.length()=265 2023-10-05T11:40:29.229 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.225+0000 7fc5fab4b880 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dff27d1e-df33-400e-a68a-7ba586947c99.4604.22 2023-10-05T11:40:29.234 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.230+0000 7fc5fab4b880 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dff27d1e-df33-400e-a68a-7ba586947c99.4604.22 info.flags=0x17 2023-10-05T11:40:29.234 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.230+0000 7fc5fab4b880 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dff27d1e-df33-400e-a68a-7ba586947c99.4604.22 to cache LRU end 2023-10-05T11:40:29.234 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.230+0000 7fc5fab4b880 10 updating xattr: name=user.rgw.acl bl.length()=265 2023-10-05T11:40:29.234 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.230+0000 7fc5fab4b880 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:dff27d1e-df33-400e-a68a-7ba586947c99.4604.22, ofs0, ns] 2023-10-05T11:40:29.234 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.231+0000 7fc5f3ae5640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1060856922165 cookie 94774246504448 notifier 6822 bl.length()=949 2023-10-05T11:40:29.235 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.231+0000 7fc5f3ae5640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dff27d1e-df33-400e-a68a-7ba586947c99.4604.22 info.flags=0x17 2023-10-05T11:40:29.235 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.231+0000 7fc5f3ae5640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dff27d1e-df33-400e-a68a-7ba586947c99.4604.22 to cache LRU end 2023-10-05T11:40:29.235 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.231+0000 7fc5f3ae5640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2023-10-05T11:40:29.236 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.233+0000 7fc5fab4b880 20 handle_bi_update(): bucket=:abort-at-block-writes[dff27d1e-df33-400e-a68a-7ba586947c99.4604.22]): orig_sources= new_sources= 2023-10-05T11:40:29.236 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.233+0000 7fc5fab4b880 20 handle_bi_update(): bucket=:abort-at-block-writes[dff27d1e-df33-400e-a68a-7ba586947c99.4604.22]): potential sources added=[] removed=[] 2023-10-05T11:40:29.236 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.233+0000 7fc5fab4b880 20 handle_bi_update(): bucket=:abort-at-block-writes[dff27d1e-df33-400e-a68a-7ba586947c99.4604.22]): orig_dests= new_dests= 2023-10-05T11:40:29.236 INFO:tasks.workunit.client.0.smithi012.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6543-g38321be8/rpm/el9/BUILD/ceph-18.0.0-6543-g38321be8/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fc5fab4b880 time 2023-10-05T11:40:29.234434+0000 2023-10-05T11:40:29.236 INFO:tasks.workunit.client.0.smithi012.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6543-g38321be8/rpm/el9/BUILD/ceph-18.0.0-6543-g38321be8/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2023-10-05T11:40:29.237 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.233+0000 7fc5fab4b880 20 handle_bi_update(): bucket=:abort-at-block-writes[dff27d1e-df33-400e-a68a-7ba586947c99.4604.22]): potential dests added=[] removed=[] 2023-10-05T11:40:29.258 INFO:tasks.workunit.client.0.smithi012.stderr: ceph version 18.0.0-6543-g38321be8 (38321be854743c0d616618a9ea8aa0b1d4dbc0bf) reef (dev) 2023-10-05T11:40:29.258 INFO:tasks.workunit.client.0.smithi012.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fc5ff76d15f] 2023-10-05T11:40:29.258 INFO:tasks.workunit.client.0.smithi012.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16d31d) [0x7fc5ff76d31d] 2023-10-05T11:40:29.258 INFO:tasks.workunit.client.0.smithi012.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56325759ac31] 2023-10-05T11:40:29.258 INFO:tasks.workunit.client.0.smithi012.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x2a4) [0x5632575b1734] 2023-10-05T11:40:29.258 INFO:tasks.workunit.client.0.smithi012.stderr: 5: main() 2023-10-05T11:40:29.259 INFO:tasks.workunit.client.0.smithi012.stderr: 6: /lib64/libc.so.6(+0x3feb0) [0x7fc5fcc3feb0] 2023-10-05T11:40:29.259 INFO:tasks.workunit.client.0.smithi012.stderr: 7: __libc_start_main() 2023-10-05T11:40:29.259 INFO:tasks.workunit.client.0.smithi012.stderr: 8: _start() 2023-10-05T11:40:29.259 INFO:tasks.workunit.client.0.smithi012.stderr:*** Caught signal (Aborted) ** 2023-10-05T11:40:29.259 INFO:tasks.workunit.client.0.smithi012.stderr: in thread 7fc5fab4b880 thread_name:radosgw-admin 2023-10-05T11:40:29.259 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.233+0000 7fc5fab4b880 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6543-g38321be8/rpm/el9/BUILD/ceph-18.0.0-6543-g38321be8/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fc5fab4b880 time 2023-10-05T11:40:29.234434+0000 2023-10-05T11:40:29.259 INFO:tasks.workunit.client.0.smithi012.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6543-g38321be8/rpm/el9/BUILD/ceph-18.0.0-6543-g38321be8/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2023-10-05T11:40:29.259 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:40:29.259 INFO:tasks.workunit.client.0.smithi012.stderr: ceph version 18.0.0-6543-g38321be8 (38321be854743c0d616618a9ea8aa0b1d4dbc0bf) reef (dev) 2023-10-05T11:40:29.259 INFO:tasks.workunit.client.0.smithi012.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fc5ff76d15f] 2023-10-05T11:40:29.259 INFO:tasks.workunit.client.0.smithi012.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16d31d) [0x7fc5ff76d31d] 2023-10-05T11:40:29.259 INFO:tasks.workunit.client.0.smithi012.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56325759ac31] 2023-10-05T11:40:29.260 INFO:tasks.workunit.client.0.smithi012.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x2a4) [0x5632575b1734] 2023-10-05T11:40:29.260 INFO:tasks.workunit.client.0.smithi012.stderr: 5: main() 2023-10-05T11:40:29.260 INFO:tasks.workunit.client.0.smithi012.stderr: 6: /lib64/libc.so.6(+0x3feb0) [0x7fc5fcc3feb0] 2023-10-05T11:40:29.260 INFO:tasks.workunit.client.0.smithi012.stderr: 7: __libc_start_main() 2023-10-05T11:40:29.260 INFO:tasks.workunit.client.0.smithi012.stderr: 8: _start() 2023-10-05T11:40:29.260 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:40:29.260 INFO:tasks.workunit.client.0.smithi012.stderr: ceph version 18.0.0-6543-g38321be8 (38321be854743c0d616618a9ea8aa0b1d4dbc0bf) reef (dev) 2023-10-05T11:40:29.260 INFO:tasks.workunit.client.0.smithi012.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7fc5fcc54db0] 2023-10-05T11:40:29.260 INFO:tasks.workunit.client.0.smithi012.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7fc5fcca154c] 2023-10-05T11:40:29.260 INFO:tasks.workunit.client.0.smithi012.stderr: 3: raise() 2023-10-05T11:40:29.260 INFO:tasks.workunit.client.0.smithi012.stderr: 4: abort() 2023-10-05T11:40:29.260 INFO:tasks.workunit.client.0.smithi012.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fc5ff76d1b9] 2023-10-05T11:40:29.261 INFO:tasks.workunit.client.0.smithi012.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16d31d) [0x7fc5ff76d31d] 2023-10-05T11:40:29.261 INFO:tasks.workunit.client.0.smithi012.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56325759ac31] 2023-10-05T11:40:29.261 INFO:tasks.workunit.client.0.smithi012.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x2a4) [0x5632575b1734] 2023-10-05T11:40:29.261 INFO:tasks.workunit.client.0.smithi012.stderr: 9: main() 2023-10-05T11:40:29.261 INFO:tasks.workunit.client.0.smithi012.stderr: 10: /lib64/libc.so.6(+0x3feb0) [0x7fc5fcc3feb0] 2023-10-05T11:40:29.261 INFO:tasks.workunit.client.0.smithi012.stderr: 11: __libc_start_main() 2023-10-05T11:40:29.261 INFO:tasks.workunit.client.0.smithi012.stderr: 12: _start() 2023-10-05T11:40:29.261 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.234+0000 7fc5fab4b880 -1 *** Caught signal (Aborted) ** 2023-10-05T11:40:29.261 INFO:tasks.workunit.client.0.smithi012.stderr: in thread 7fc5fab4b880 thread_name:radosgw-admin 2023-10-05T11:40:29.261 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:40:29.261 INFO:tasks.workunit.client.0.smithi012.stderr: ceph version 18.0.0-6543-g38321be8 (38321be854743c0d616618a9ea8aa0b1d4dbc0bf) reef (dev) 2023-10-05T11:40:29.261 INFO:tasks.workunit.client.0.smithi012.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7fc5fcc54db0] 2023-10-05T11:40:29.262 INFO:tasks.workunit.client.0.smithi012.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7fc5fcca154c] 2023-10-05T11:40:29.262 INFO:tasks.workunit.client.0.smithi012.stderr: 3: raise() 2023-10-05T11:40:29.262 INFO:tasks.workunit.client.0.smithi012.stderr: 4: abort() 2023-10-05T11:40:29.262 INFO:tasks.workunit.client.0.smithi012.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fc5ff76d1b9] 2023-10-05T11:40:29.262 INFO:tasks.workunit.client.0.smithi012.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16d31d) [0x7fc5ff76d31d] 2023-10-05T11:40:29.262 INFO:tasks.workunit.client.0.smithi012.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56325759ac31] 2023-10-05T11:40:29.262 INFO:tasks.workunit.client.0.smithi012.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x2a4) [0x5632575b1734] 2023-10-05T11:40:29.262 INFO:tasks.workunit.client.0.smithi012.stderr: 9: main() 2023-10-05T11:40:29.262 INFO:tasks.workunit.client.0.smithi012.stderr: 10: /lib64/libc.so.6(+0x3feb0) [0x7fc5fcc3feb0] 2023-10-05T11:40:29.262 INFO:tasks.workunit.client.0.smithi012.stderr: 11: __libc_start_main() 2023-10-05T11:40:29.262 INFO:tasks.workunit.client.0.smithi012.stderr: 12: _start() 2023-10-05T11:40:29.263 INFO:tasks.workunit.client.0.smithi012.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-10-05T11:40:29.263 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:40:29.263 INFO:tasks.workunit.client.0.smithi012.stderr:--- begin dump of recent events --- 2023-10-05T11:40:29.263 INFO:tasks.workunit.client.0.smithi012.stderr: -499> 2023-10-05T11:40:29.186+0000 7fc5f62ea640 10 monclient: _finish_auth 0 2023-10-05T11:40:29.263 INFO:tasks.workunit.client.0.smithi012.stderr: -498> 2023-10-05T11:40:29.186+0000 7fc5f62ea640 10 monclient: _check_auth_tickets 2023-10-05T11:40:29.263 INFO:tasks.workunit.client.0.smithi012.stderr: -497> 2023-10-05T11:40:29.186+0000 7fc5fab4b880 5 monclient: authenticate success, global_id 6503 2023-10-05T11:40:29.263 INFO:tasks.workunit.client.0.smithi012.stderr: -496> 2023-10-05T11:40:29.186+0000 7fc5f62ea640 10 monclient: handle_config config(0 keys) v1 2023-10-05T11:40:29.263 INFO:tasks.workunit.client.0.smithi012.stderr: -495> 2023-10-05T11:40:29.186+0000 7fc5f62ea640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-10-05T11:40:29.263 INFO:tasks.workunit.client.0.smithi012.stderr: -494> 2023-10-05T11:40:29.186+0000 7fc5f62ea640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-10-05T11:40:29.263 INFO:tasks.workunit.client.0.smithi012.stderr: -493> 2023-10-05T11:40:29.186+0000 7fc5f62ea640 10 monclient: dump: 2023-10-05T11:40:29.263 INFO:tasks.workunit.client.0.smithi012.stderr:epoch 1 2023-10-05T11:40:29.264 INFO:tasks.workunit.client.0.smithi012.stderr:fsid 7e015f46-293b-4b09-bd32-7d32b52f6e2f 2023-10-05T11:40:29.264 INFO:tasks.workunit.client.0.smithi012.stderr:last_changed 2023-10-05T11:27:38.366888+0000 2023-10-05T11:40:29.264 INFO:tasks.workunit.client.0.smithi012.stderr:created 2023-10-05T11:27:38.366888+0000 2023-10-05T11:40:29.264 INFO:tasks.workunit.client.0.smithi012.stderr:min_mon_release 18 (reef) 2023-10-05T11:40:29.264 INFO:tasks.workunit.client.0.smithi012.stderr:election_strategy: 1 2023-10-05T11:40:29.264 INFO:tasks.workunit.client.0.smithi012.stderr:0: [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon.a 2023-10-05T11:40:29.264 INFO:tasks.workunit.client.0.smithi012.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2023-10-05T11:40:29.264 INFO:tasks.workunit.client.0.smithi012.stderr:2: [v2:172.21.15.12:3301/0,v1:172.21.15.12:6790/0] mon.c 2023-10-05T11:40:29.264 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:40:29.264 INFO:tasks.workunit.client.0.smithi012.stderr: -492> 2023-10-05T11:40:29.186+0000 7fc5f7aed640 4 set_mon_vals no callback set 2023-10-05T11:40:29.265 INFO:tasks.workunit.client.0.smithi012.stderr: -491> 2023-10-05T11:40:29.186+0000 7fc5fab4b880 10 monclient: _renew_subs 2023-10-05T11:40:29.265 INFO:tasks.workunit.client.0.smithi012.stderr: -490> 2023-10-05T11:40:29.186+0000 7fc5fab4b880 10 monclient: _send_mon_message to mon.c at v2:172.21.15.12:3301/0 2023-10-05T11:40:29.265 INFO:tasks.workunit.client.0.smithi012.stderr: -489> 2023-10-05T11:40:29.186+0000 7fc5fab4b880 10 monclient: _renew_subs 2023-10-05T11:40:29.265 INFO:tasks.workunit.client.0.smithi012.stderr: -488> 2023-10-05T11:40:29.186+0000 7fc5fab4b880 10 monclient: _send_mon_message to mon.c at v2:172.21.15.12:3301/0 2023-10-05T11:40:29.265 INFO:tasks.workunit.client.0.smithi012.stderr: -487> 2023-10-05T11:40:29.186+0000 7fc5fab4b880 1 librados: init done 2023-10-05T11:40:29.265 INFO:tasks.workunit.client.0.smithi012.stderr: -486> 2023-10-05T11:40:29.186+0000 7fc5fab4b880 10 monclient: get_monmap_and_config 2023-10-05T11:40:29.265 INFO:tasks.workunit.client.0.smithi012.stderr: -485> 2023-10-05T11:40:29.186+0000 7fc5fab4b880 10 monclient: build_initial_monmap 2023-10-05T11:40:29.265 INFO:tasks.workunit.client.0.smithi012.stderr: -484> 2023-10-05T11:40:29.186+0000 7fc5fab4b880 1 build_initial for_mkfs: 0 2023-10-05T11:40:29.265 INFO:tasks.workunit.client.0.smithi012.stderr: -483> 2023-10-05T11:40:29.186+0000 7fc5fab4b880 10 monclient: monmap: 2023-10-05T11:40:29.265 INFO:tasks.workunit.client.0.smithi012.stderr:epoch 0 2023-10-05T11:40:29.265 INFO:tasks.workunit.client.0.smithi012.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-10-05T11:40:29.265 INFO:tasks.workunit.client.0.smithi012.stderr:last_changed 0.000000 2023-10-05T11:40:29.266 INFO:tasks.workunit.client.0.smithi012.stderr:created 0.000000 2023-10-05T11:40:29.266 INFO:tasks.workunit.client.0.smithi012.stderr:min_mon_release 0 (unknown) 2023-10-05T11:40:29.266 INFO:tasks.workunit.client.0.smithi012.stderr:election_strategy: 1 2023-10-05T11:40:29.266 INFO:tasks.workunit.client.0.smithi012.stderr:0: [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon.noname-a 2023-10-05T11:40:29.266 INFO:tasks.workunit.client.0.smithi012.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.noname-b 2023-10-05T11:40:29.266 INFO:tasks.workunit.client.0.smithi012.stderr:2: [v2:172.21.15.12:3301/0,v1:172.21.15.12:6790/0] mon.noname-c 2023-10-05T11:40:29.266 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:40:29.266 INFO:tasks.workunit.client.0.smithi012.stderr: -482> 2023-10-05T11:40:29.186+0000 7fc5fab4b880 5 AuthRegistry(0x563259da7340) adding auth protocol: cephx 2023-10-05T11:40:29.266 INFO:tasks.workunit.client.0.smithi012.stderr: -481> 2023-10-05T11:40:29.186+0000 7fc5fab4b880 5 AuthRegistry(0x563259da7340) adding auth protocol: cephx 2023-10-05T11:40:29.266 INFO:tasks.workunit.client.0.smithi012.stderr: -480> 2023-10-05T11:40:29.186+0000 7fc5fab4b880 5 AuthRegistry(0x563259da7340) adding auth protocol: cephx 2023-10-05T11:40:29.266 INFO:tasks.workunit.client.0.smithi012.stderr: -479> 2023-10-05T11:40:29.186+0000 7fc5fab4b880 5 AuthRegistry(0x563259da7340) adding con mode: secure 2023-10-05T11:40:29.267 INFO:tasks.workunit.client.0.smithi012.stderr: -478> 2023-10-05T11:40:29.186+0000 7fc5fab4b880 5 AuthRegistry(0x563259da7340) adding con mode: crc 2023-10-05T11:40:29.267 INFO:tasks.workunit.client.0.smithi012.stderr: -477> 2023-10-05T11:40:29.186+0000 7fc5fab4b880 5 AuthRegistry(0x563259da7340) adding con mode: secure 2023-10-05T11:40:29.267 INFO:tasks.workunit.client.0.smithi012.stderr: -476> 2023-10-05T11:40:29.186+0000 7fc5fab4b880 5 AuthRegistry(0x563259da7340) adding con mode: crc 2023-10-05T11:40:29.267 INFO:tasks.workunit.client.0.smithi012.stderr: -475> 2023-10-05T11:40:29.186+0000 7fc5fab4b880 5 AuthRegistry(0x563259da7340) adding con mode: secure 2023-10-05T11:40:29.267 INFO:tasks.workunit.client.0.smithi012.stderr: -474> 2023-10-05T11:40:29.186+0000 7fc5fab4b880 5 AuthRegistry(0x563259da7340) adding con mode: crc 2023-10-05T11:40:29.267 INFO:tasks.workunit.client.0.smithi012.stderr: -473> 2023-10-05T11:40:29.186+0000 7fc5fab4b880 5 AuthRegistry(0x563259da7340) adding con mode: crc 2023-10-05T11:40:29.267 INFO:tasks.workunit.client.0.smithi012.stderr: -472> 2023-10-05T11:40:29.186+0000 7fc5fab4b880 5 AuthRegistry(0x563259da7340) adding con mode: secure 2023-10-05T11:40:29.267 INFO:tasks.workunit.client.0.smithi012.stderr: -471> 2023-10-05T11:40:29.186+0000 7fc5fab4b880 5 AuthRegistry(0x563259da7340) adding con mode: crc 2023-10-05T11:40:29.267 INFO:tasks.workunit.client.0.smithi012.stderr: -470> 2023-10-05T11:40:29.186+0000 7fc5fab4b880 5 AuthRegistry(0x563259da7340) adding con mode: secure 2023-10-05T11:40:29.267 INFO:tasks.workunit.client.0.smithi012.stderr: -469> 2023-10-05T11:40:29.186+0000 7fc5fab4b880 5 AuthRegistry(0x563259da7340) adding con mode: crc 2023-10-05T11:40:29.267 INFO:tasks.workunit.client.0.smithi012.stderr: -468> 2023-10-05T11:40:29.186+0000 7fc5fab4b880 5 AuthRegistry(0x563259da7340) adding con mode: secure 2023-10-05T11:40:29.267 INFO:tasks.workunit.client.0.smithi012.stderr: -467> 2023-10-05T11:40:29.186+0000 7fc5fab4b880 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-10-05T11:40:29.268 INFO:tasks.workunit.client.0.smithi012.stderr: -466> 2023-10-05T11:40:29.187+0000 7fc5fab4b880 10 monclient: init 2023-10-05T11:40:29.268 INFO:tasks.workunit.client.0.smithi012.stderr: -465> 2023-10-05T11:40:29.187+0000 7fc5fab4b880 5 AuthRegistry(0x7fff2cd5ddc0) adding auth protocol: cephx 2023-10-05T11:40:29.268 INFO:tasks.workunit.client.0.smithi012.stderr: -464> 2023-10-05T11:40:29.187+0000 7fc5fab4b880 5 AuthRegistry(0x7fff2cd5ddc0) adding auth protocol: cephx 2023-10-05T11:40:29.268 INFO:tasks.workunit.client.0.smithi012.stderr: -463> 2023-10-05T11:40:29.187+0000 7fc5fab4b880 5 AuthRegistry(0x7fff2cd5ddc0) adding auth protocol: cephx 2023-10-05T11:40:29.268 INFO:tasks.workunit.client.0.smithi012.stderr: -462> 2023-10-05T11:40:29.187+0000 7fc5fab4b880 5 AuthRegistry(0x7fff2cd5ddc0) adding con mode: secure 2023-10-05T11:40:29.268 INFO:tasks.workunit.client.0.smithi012.stderr: -461> 2023-10-05T11:40:29.187+0000 7fc5fab4b880 5 AuthRegistry(0x7fff2cd5ddc0) adding con mode: crc 2023-10-05T11:40:29.268 INFO:tasks.workunit.client.0.smithi012.stderr: -460> 2023-10-05T11:40:29.187+0000 7fc5fab4b880 5 AuthRegistry(0x7fff2cd5ddc0) adding con mode: secure 2023-10-05T11:40:29.268 INFO:tasks.workunit.client.0.smithi012.stderr: -459> 2023-10-05T11:40:29.187+0000 7fc5fab4b880 5 AuthRegistry(0x7fff2cd5ddc0) adding con mode: crc 2023-10-05T11:40:29.268 INFO:tasks.workunit.client.0.smithi012.stderr: -458> 2023-10-05T11:40:29.187+0000 7fc5fab4b880 5 AuthRegistry(0x7fff2cd5ddc0) adding con mode: secure 2023-10-05T11:40:29.268 INFO:tasks.workunit.client.0.smithi012.stderr: -457> 2023-10-05T11:40:29.187+0000 7fc5fab4b880 5 AuthRegistry(0x7fff2cd5ddc0) adding con mode: crc 2023-10-05T11:40:29.268 INFO:tasks.workunit.client.0.smithi012.stderr: -456> 2023-10-05T11:40:29.187+0000 7fc5fab4b880 5 AuthRegistry(0x7fff2cd5ddc0) adding con mode: crc 2023-10-05T11:40:29.268 INFO:tasks.workunit.client.0.smithi012.stderr: -455> 2023-10-05T11:40:29.187+0000 7fc5fab4b880 5 AuthRegistry(0x7fff2cd5ddc0) adding con mode: secure 2023-10-05T11:40:29.269 INFO:tasks.workunit.client.0.smithi012.stderr: -454> 2023-10-05T11:40:29.187+0000 7fc5fab4b880 5 AuthRegistry(0x7fff2cd5ddc0) adding con mode: crc 2023-10-05T11:40:29.269 INFO:tasks.workunit.client.0.smithi012.stderr: -453> 2023-10-05T11:40:29.187+0000 7fc5fab4b880 5 AuthRegistry(0x7fff2cd5ddc0) adding con mode: secure 2023-10-05T11:40:29.269 INFO:tasks.workunit.client.0.smithi012.stderr: -452> 2023-10-05T11:40:29.187+0000 7fc5fab4b880 5 AuthRegistry(0x7fff2cd5ddc0) adding con mode: crc 2023-10-05T11:40:29.269 INFO:tasks.workunit.client.0.smithi012.stderr: -451> 2023-10-05T11:40:29.187+0000 7fc5fab4b880 5 AuthRegistry(0x7fff2cd5ddc0) adding con mode: secure 2023-10-05T11:40:29.269 INFO:tasks.workunit.client.0.smithi012.stderr: -450> 2023-10-05T11:40:29.187+0000 7fc5fab4b880 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-10-05T11:40:29.269 INFO:tasks.workunit.client.0.smithi012.stderr: -449> 2023-10-05T11:40:29.187+0000 7fc5fab4b880 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-10-05T11:40:29.269 INFO:tasks.workunit.client.0.smithi012.stderr: -448> 2023-10-05T11:40:29.187+0000 7fc5fab4b880 5 asok(0x5632592f6000) register_command rotate-key cmddesc rotate-key hook 0x7fff2cd5df08 EEXIST 2023-10-05T11:40:29.269 INFO:tasks.workunit.client.0.smithi012.stderr: -447> 2023-10-05T11:40:29.187+0000 7fc5fab4b880 10 monclient: _reopen_session rank -1 2023-10-05T11:40:29.269 INFO:tasks.workunit.client.0.smithi012.stderr: -446> 2023-10-05T11:40:29.187+0000 7fc5fab4b880 10 monclient: _add_conns ranks=[0,1,2] 2023-10-05T11:40:29.269 INFO:tasks.workunit.client.0.smithi012.stderr: -445> 2023-10-05T11:40:29.187+0000 7fc5fab4b880 10 monclient(hunting): picked mon.noname-a con 0x563259eeec00 addr [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] 2023-10-05T11:40:29.269 INFO:tasks.workunit.client.0.smithi012.stderr: -444> 2023-10-05T11:40:29.187+0000 7fc5fab4b880 10 monclient(hunting): picked mon.noname-b con 0x563259eef000 addr [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] 2023-10-05T11:40:29.270 INFO:tasks.workunit.client.0.smithi012.stderr: -443> 2023-10-05T11:40:29.187+0000 7fc5fab4b880 10 monclient(hunting): picked mon.noname-c con 0x563259eef400 addr [v2:172.21.15.12:3301/0,v1:172.21.15.12:6790/0] 2023-10-05T11:40:29.270 INFO:tasks.workunit.client.0.smithi012.stderr: -442> 2023-10-05T11:40:29.187+0000 7fc5fab4b880 10 monclient(hunting): start opening mon connection 2023-10-05T11:40:29.270 INFO:tasks.workunit.client.0.smithi012.stderr: -441> 2023-10-05T11:40:29.187+0000 7fc5fab4b880 10 monclient(hunting): start opening mon connection 2023-10-05T11:40:29.270 INFO:tasks.workunit.client.0.smithi012.stderr: -440> 2023-10-05T11:40:29.187+0000 7fc5fab4b880 10 monclient(hunting): start opening mon connection 2023-10-05T11:40:29.270 INFO:tasks.workunit.client.0.smithi012.stderr: -439> 2023-10-05T11:40:29.187+0000 7fc5fab4b880 10 monclient(hunting): _renew_subs 2023-10-05T11:40:29.270 INFO:tasks.workunit.client.0.smithi012.stderr: -438> 2023-10-05T11:40:29.187+0000 7fc5fab4b880 10 monclient(hunting): authenticate will time out at 1537.355928s 2023-10-05T11:40:29.270 INFO:tasks.workunit.client.0.smithi012.stderr: -437> 2023-10-05T11:40:29.187+0000 7fc5f9af1640 10 monclient(hunting): get_auth_request con 0x563259eeec00 auth_method 0 2023-10-05T11:40:29.270 INFO:tasks.workunit.client.0.smithi012.stderr: -436> 2023-10-05T11:40:29.187+0000 7fc5f9af1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-10-05T11:40:29.270 INFO:tasks.workunit.client.0.smithi012.stderr: -435> 2023-10-05T11:40:29.187+0000 7fc5f9af1640 10 monclient(hunting): _init_auth method 2 2023-10-05T11:40:29.270 INFO:tasks.workunit.client.0.smithi012.stderr: -434> 2023-10-05T11:40:29.187+0000 7fc5f9af1640 10 monclient(hunting): _init_auth creating new auth 2023-10-05T11:40:29.271 INFO:tasks.workunit.client.0.smithi012.stderr: -433> 2023-10-05T11:40:29.187+0000 7fc5f8aef640 10 monclient(hunting): get_auth_request con 0x563259eef400 auth_method 0 2023-10-05T11:40:29.271 INFO:tasks.workunit.client.0.smithi012.stderr: -432> 2023-10-05T11:40:29.187+0000 7fc5f8aef640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-10-05T11:40:29.271 INFO:tasks.workunit.client.0.smithi012.stderr: -431> 2023-10-05T11:40:29.187+0000 7fc5f8aef640 10 monclient(hunting): _init_auth method 2 2023-10-05T11:40:29.271 INFO:tasks.workunit.client.0.smithi012.stderr: -430> 2023-10-05T11:40:29.187+0000 7fc5f8aef640 10 monclient(hunting): _init_auth creating new auth 2023-10-05T11:40:29.271 INFO:tasks.workunit.client.0.smithi012.stderr: -429> 2023-10-05T11:40:29.187+0000 7fc5f92f0640 10 monclient(hunting): get_auth_request con 0x563259eef000 auth_method 0 2023-10-05T11:40:29.271 INFO:tasks.workunit.client.0.smithi012.stderr: -428> 2023-10-05T11:40:29.187+0000 7fc5f92f0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-10-05T11:40:29.271 INFO:tasks.workunit.client.0.smithi012.stderr: -427> 2023-10-05T11:40:29.187+0000 7fc5f92f0640 10 monclient(hunting): _init_auth method 2 2023-10-05T11:40:29.271 INFO:tasks.workunit.client.0.smithi012.stderr: -426> 2023-10-05T11:40:29.187+0000 7fc5f92f0640 10 monclient(hunting): _init_auth creating new auth 2023-10-05T11:40:29.271 INFO:tasks.workunit.client.0.smithi012.stderr: -425> 2023-10-05T11:40:29.187+0000 7fc5f8aef640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-10-05T11:40:29.271 INFO:tasks.workunit.client.0.smithi012.stderr: -424> 2023-10-05T11:40:29.187+0000 7fc5f8aef640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-10-05T11:40:29.271 INFO:tasks.workunit.client.0.smithi012.stderr: -423> 2023-10-05T11:40:29.187+0000 7fc5f8aef640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-10-05T11:40:29.271 INFO:tasks.workunit.client.0.smithi012.stderr: -422> 2023-10-05T11:40:29.187+0000 7fc5f9af1640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-10-05T11:40:29.272 INFO:tasks.workunit.client.0.smithi012.stderr: -421> 2023-10-05T11:40:29.187+0000 7fc5f9af1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-10-05T11:40:29.272 INFO:tasks.workunit.client.0.smithi012.stderr: -420> 2023-10-05T11:40:29.187+0000 7fc5f9af1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-10-05T11:40:29.272 INFO:tasks.workunit.client.0.smithi012.stderr: -419> 2023-10-05T11:40:29.187+0000 7fc5f92f0640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-10-05T11:40:29.272 INFO:tasks.workunit.client.0.smithi012.stderr: -418> 2023-10-05T11:40:29.187+0000 7fc5f92f0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-10-05T11:40:29.272 INFO:tasks.workunit.client.0.smithi012.stderr: -417> 2023-10-05T11:40:29.187+0000 7fc5f92f0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-10-05T11:40:29.272 INFO:tasks.workunit.client.0.smithi012.stderr: -416> 2023-10-05T11:40:29.187+0000 7fc5f62ea640 4 mgrc handle_mgr_map Got map version 5 2023-10-05T11:40:29.272 INFO:tasks.workunit.client.0.smithi012.stderr: -415> 2023-10-05T11:40:29.187+0000 7fc5f62ea640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.170:6832/180516904,v1:172.21.15.170:6833/180516904] 2023-10-05T11:40:29.272 INFO:tasks.workunit.client.0.smithi012.stderr: -414> 2023-10-05T11:40:29.187+0000 7fc5f62ea640 4 mgrc reconnect Starting new session with [v2:172.21.15.170:6832/180516904,v1:172.21.15.170:6833/180516904] 2023-10-05T11:40:29.272 INFO:tasks.workunit.client.0.smithi012.stderr: -413> 2023-10-05T11:40:29.187+0000 7fc5f8aef640 10 monclient(hunting): handle_auth_done global_id 6506 payload 274 2023-10-05T11:40:29.272 INFO:tasks.workunit.client.0.smithi012.stderr: -412> 2023-10-05T11:40:29.187+0000 7fc5f8aef640 10 monclient: _finish_hunting 0 2023-10-05T11:40:29.272 INFO:tasks.workunit.client.0.smithi012.stderr: -411> 2023-10-05T11:40:29.187+0000 7fc5f8aef640 1 monclient: found mon.noname-c 2023-10-05T11:40:29.273 INFO:tasks.workunit.client.0.smithi012.stderr: -410> 2023-10-05T11:40:29.187+0000 7fc5f8aef640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.12:3301/0 2023-10-05T11:40:29.273 INFO:tasks.workunit.client.0.smithi012.stderr: -409> 2023-10-05T11:40:29.188+0000 7fc5f9af1640 10 monclient: get_auth_request con 0x5632593be000 auth_method 0 2023-10-05T11:40:29.273 INFO:tasks.workunit.client.0.smithi012.stderr: -408> 2023-10-05T11:40:29.188+0000 7fc5f3ae5640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-10-05T11:40:29.273 INFO:tasks.workunit.client.0.smithi012.stderr: -407> 2023-10-05T11:40:29.188+0000 7fc5f3ae5640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2023-10-05T11:40:29.273 INFO:tasks.workunit.client.0.smithi012.stderr: -406> 2023-10-05T11:40:29.188+0000 7fc5f3ae5640 10 monclient: dump: 2023-10-05T11:40:29.273 INFO:tasks.workunit.client.0.smithi012.stderr:epoch 1 2023-10-05T11:40:29.273 INFO:tasks.workunit.client.0.smithi012.stderr:fsid 7e015f46-293b-4b09-bd32-7d32b52f6e2f 2023-10-05T11:40:29.273 INFO:tasks.workunit.client.0.smithi012.stderr:last_changed 2023-10-05T11:27:38.366888+0000 2023-10-05T11:40:29.273 INFO:tasks.workunit.client.0.smithi012.stderr:created 2023-10-05T11:27:38.366888+0000 2023-10-05T11:40:29.273 INFO:tasks.workunit.client.0.smithi012.stderr:min_mon_release 18 (reef) 2023-10-05T11:40:29.273 INFO:tasks.workunit.client.0.smithi012.stderr:election_strategy: 1 2023-10-05T11:40:29.273 INFO:tasks.workunit.client.0.smithi012.stderr:0: [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon.a 2023-10-05T11:40:29.274 INFO:tasks.workunit.client.0.smithi012.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2023-10-05T11:40:29.274 INFO:tasks.workunit.client.0.smithi012.stderr:2: [v2:172.21.15.12:3301/0,v1:172.21.15.12:6790/0] mon.c 2023-10-05T11:40:29.274 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:40:29.274 INFO:tasks.workunit.client.0.smithi012.stderr: -405> 2023-10-05T11:40:29.188+0000 7fc5f3ae5640 10 monclient: _finish_auth 0 2023-10-05T11:40:29.274 INFO:tasks.workunit.client.0.smithi012.stderr: -404> 2023-10-05T11:40:29.188+0000 7fc5f3ae5640 10 monclient: _check_auth_tickets 2023-10-05T11:40:29.274 INFO:tasks.workunit.client.0.smithi012.stderr: -403> 2023-10-05T11:40:29.188+0000 7fc5f3ae5640 10 monclient: handle_config config(0 keys) v1 2023-10-05T11:40:29.274 INFO:tasks.workunit.client.0.smithi012.stderr: -402> 2023-10-05T11:40:29.188+0000 7fc5f3ae5640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-10-05T11:40:29.274 INFO:tasks.workunit.client.0.smithi012.stderr: -401> 2023-10-05T11:40:29.188+0000 7fc5f3ae5640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-10-05T11:40:29.274 INFO:tasks.workunit.client.0.smithi012.stderr: -400> 2023-10-05T11:40:29.188+0000 7fc5f3ae5640 10 monclient: dump: 2023-10-05T11:40:29.274 INFO:tasks.workunit.client.0.smithi012.stderr:epoch 1 2023-10-05T11:40:29.275 INFO:tasks.workunit.client.0.smithi012.stderr:fsid 7e015f46-293b-4b09-bd32-7d32b52f6e2f 2023-10-05T11:40:29.275 INFO:tasks.workunit.client.0.smithi012.stderr:last_changed 2023-10-05T11:27:38.366888+0000 2023-10-05T11:40:29.275 INFO:tasks.workunit.client.0.smithi012.stderr:created 2023-10-05T11:27:38.366888+0000 2023-10-05T11:40:29.275 INFO:tasks.workunit.client.0.smithi012.stderr:min_mon_release 18 (reef) 2023-10-05T11:40:29.275 INFO:tasks.workunit.client.0.smithi012.stderr:election_strategy: 1 2023-10-05T11:40:29.275 INFO:tasks.workunit.client.0.smithi012.stderr:0: [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon.a 2023-10-05T11:40:29.275 INFO:tasks.workunit.client.0.smithi012.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2023-10-05T11:40:29.275 INFO:tasks.workunit.client.0.smithi012.stderr:2: [v2:172.21.15.12:3301/0,v1:172.21.15.12:6790/0] mon.c 2023-10-05T11:40:29.275 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:40:29.275 INFO:tasks.workunit.client.0.smithi012.stderr: -399> 2023-10-05T11:40:29.188+0000 7fc5fab4b880 5 monclient: authenticate success, global_id 6506 2023-10-05T11:40:29.276 INFO:tasks.workunit.client.0.smithi012.stderr: -398> 2023-10-05T11:40:29.188+0000 7fc5fab4b880 10 monclient: get_monmap_and_config success 2023-10-05T11:40:29.276 INFO:tasks.workunit.client.0.smithi012.stderr: -397> 2023-10-05T11:40:29.188+0000 7fc5fab4b880 4 set_mon_vals no callback set 2023-10-05T11:40:29.276 INFO:tasks.workunit.client.0.smithi012.stderr: -396> 2023-10-05T11:40:29.188+0000 7fc5fab4b880 10 monclient: shutdown 2023-10-05T11:40:29.276 INFO:tasks.workunit.client.0.smithi012.stderr: -395> 2023-10-05T11:40:29.188+0000 7fc5fab4b880 10 monclient: build_initial_monmap 2023-10-05T11:40:29.276 INFO:tasks.workunit.client.0.smithi012.stderr: -394> 2023-10-05T11:40:29.188+0000 7fc5fab4b880 1 build_initial for_mkfs: 0 2023-10-05T11:40:29.276 INFO:tasks.workunit.client.0.smithi012.stderr: -393> 2023-10-05T11:40:29.188+0000 7fc5fab4b880 10 monclient: monmap: 2023-10-05T11:40:29.276 INFO:tasks.workunit.client.0.smithi012.stderr:epoch 0 2023-10-05T11:40:29.276 INFO:tasks.workunit.client.0.smithi012.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-10-05T11:40:29.276 INFO:tasks.workunit.client.0.smithi012.stderr:last_changed 0.000000 2023-10-05T11:40:29.277 INFO:tasks.workunit.client.0.smithi012.stderr:created 0.000000 2023-10-05T11:40:29.277 INFO:tasks.workunit.client.0.smithi012.stderr:min_mon_release 0 (unknown) 2023-10-05T11:40:29.277 INFO:tasks.workunit.client.0.smithi012.stderr:election_strategy: 1 2023-10-05T11:40:29.277 INFO:tasks.workunit.client.0.smithi012.stderr:0: [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon.noname-a 2023-10-05T11:40:29.277 INFO:tasks.workunit.client.0.smithi012.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.noname-b 2023-10-05T11:40:29.277 INFO:tasks.workunit.client.0.smithi012.stderr:2: [v2:172.21.15.12:3301/0,v1:172.21.15.12:6790/0] mon.noname-c 2023-10-05T11:40:29.277 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:40:29.277 INFO:tasks.workunit.client.0.smithi012.stderr: -392> 2023-10-05T11:40:29.188+0000 7fc5fab4b880 5 AuthRegistry(0x563259da7340) adding auth protocol: cephx 2023-10-05T11:40:29.277 INFO:tasks.workunit.client.0.smithi012.stderr: -391> 2023-10-05T11:40:29.188+0000 7fc5fab4b880 5 AuthRegistry(0x563259da7340) adding auth protocol: cephx 2023-10-05T11:40:29.277 INFO:tasks.workunit.client.0.smithi012.stderr: -390> 2023-10-05T11:40:29.188+0000 7fc5fab4b880 5 AuthRegistry(0x563259da7340) adding auth protocol: cephx 2023-10-05T11:40:29.278 INFO:tasks.workunit.client.0.smithi012.stderr: -389> 2023-10-05T11:40:29.188+0000 7fc5fab4b880 5 AuthRegistry(0x563259da7340) adding con mode: secure 2023-10-05T11:40:29.278 INFO:tasks.workunit.client.0.smithi012.stderr: -388> 2023-10-05T11:40:29.188+0000 7fc5fab4b880 5 AuthRegistry(0x563259da7340) adding con mode: crc 2023-10-05T11:40:29.278 INFO:tasks.workunit.client.0.smithi012.stderr: -387> 2023-10-05T11:40:29.188+0000 7fc5fab4b880 5 AuthRegistry(0x563259da7340) adding con mode: secure 2023-10-05T11:40:29.278 INFO:tasks.workunit.client.0.smithi012.stderr: -386> 2023-10-05T11:40:29.188+0000 7fc5fab4b880 5 AuthRegistry(0x563259da7340) adding con mode: crc 2023-10-05T11:40:29.278 INFO:tasks.workunit.client.0.smithi012.stderr: -385> 2023-10-05T11:40:29.188+0000 7fc5fab4b880 5 AuthRegistry(0x563259da7340) adding con mode: secure 2023-10-05T11:40:29.278 INFO:tasks.workunit.client.0.smithi012.stderr: -384> 2023-10-05T11:40:29.188+0000 7fc5fab4b880 5 AuthRegistry(0x563259da7340) adding con mode: crc 2023-10-05T11:40:29.278 INFO:tasks.workunit.client.0.smithi012.stderr: -383> 2023-10-05T11:40:29.188+0000 7fc5fab4b880 5 AuthRegistry(0x563259da7340) adding con mode: crc 2023-10-05T11:40:29.278 INFO:tasks.workunit.client.0.smithi012.stderr: -382> 2023-10-05T11:40:29.188+0000 7fc5fab4b880 5 AuthRegistry(0x563259da7340) adding con mode: secure 2023-10-05T11:40:29.278 INFO:tasks.workunit.client.0.smithi012.stderr: -381> 2023-10-05T11:40:29.188+0000 7fc5fab4b880 5 AuthRegistry(0x563259da7340) adding con mode: crc 2023-10-05T11:40:29.278 INFO:tasks.workunit.client.0.smithi012.stderr: -380> 2023-10-05T11:40:29.188+0000 7fc5fab4b880 5 AuthRegistry(0x563259da7340) adding con mode: secure 2023-10-05T11:40:29.279 INFO:tasks.workunit.client.0.smithi012.stderr: -379> 2023-10-05T11:40:29.188+0000 7fc5fab4b880 5 AuthRegistry(0x563259da7340) adding con mode: crc 2023-10-05T11:40:29.279 INFO:tasks.workunit.client.0.smithi012.stderr: -378> 2023-10-05T11:40:29.188+0000 7fc5fab4b880 5 AuthRegistry(0x563259da7340) adding con mode: secure 2023-10-05T11:40:29.279 INFO:tasks.workunit.client.0.smithi012.stderr: -377> 2023-10-05T11:40:29.188+0000 7fc5fab4b880 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-10-05T11:40:29.279 INFO:tasks.workunit.client.0.smithi012.stderr: -376> 2023-10-05T11:40:29.188+0000 7fc5fab4b880 1 librados: starting msgr at 2023-10-05T11:40:29.279 INFO:tasks.workunit.client.0.smithi012.stderr: -375> 2023-10-05T11:40:29.188+0000 7fc5fab4b880 1 librados: starting objecter 2023-10-05T11:40:29.279 INFO:tasks.workunit.client.0.smithi012.stderr: -374> 2023-10-05T11:40:29.189+0000 7fc5fab4b880 5 asok(0x5632592f6000) register_command objecter_requests cmddesc objecter_requests hook 0x5632590ad610 EEXIST 2023-10-05T11:40:29.279 INFO:tasks.workunit.client.0.smithi012.stderr: -373> 2023-10-05T11:40:29.189+0000 7fc5fab4b880 1 librados: setting wanted keys 2023-10-05T11:40:29.279 INFO:tasks.workunit.client.0.smithi012.stderr: -372> 2023-10-05T11:40:29.189+0000 7fc5fab4b880 1 librados: calling monclient init 2023-10-05T11:40:29.279 INFO:tasks.workunit.client.0.smithi012.stderr: -371> 2023-10-05T11:40:29.189+0000 7fc5fab4b880 10 monclient: init 2023-10-05T11:40:29.279 INFO:tasks.workunit.client.0.smithi012.stderr: -370> 2023-10-05T11:40:29.189+0000 7fc5fab4b880 5 AuthRegistry(0x5632591550d8) adding auth protocol: cephx 2023-10-05T11:40:29.280 INFO:tasks.workunit.client.0.smithi012.stderr: -369> 2023-10-05T11:40:29.189+0000 7fc5fab4b880 5 AuthRegistry(0x5632591550d8) adding auth protocol: cephx 2023-10-05T11:40:29.280 INFO:tasks.workunit.client.0.smithi012.stderr: -368> 2023-10-05T11:40:29.189+0000 7fc5fab4b880 5 AuthRegistry(0x5632591550d8) adding auth protocol: cephx 2023-10-05T11:40:29.280 INFO:tasks.workunit.client.0.smithi012.stderr: -367> 2023-10-05T11:40:29.189+0000 7fc5fab4b880 5 AuthRegistry(0x5632591550d8) adding con mode: secure 2023-10-05T11:40:29.280 INFO:tasks.workunit.client.0.smithi012.stderr: -366> 2023-10-05T11:40:29.189+0000 7fc5fab4b880 5 AuthRegistry(0x5632591550d8) adding con mode: crc 2023-10-05T11:40:29.280 INFO:tasks.workunit.client.0.smithi012.stderr: -365> 2023-10-05T11:40:29.189+0000 7fc5fab4b880 5 AuthRegistry(0x5632591550d8) adding con mode: secure 2023-10-05T11:40:29.280 INFO:tasks.workunit.client.0.smithi012.stderr: -364> 2023-10-05T11:40:29.189+0000 7fc5fab4b880 5 AuthRegistry(0x5632591550d8) adding con mode: crc 2023-10-05T11:40:29.280 INFO:tasks.workunit.client.0.smithi012.stderr: -363> 2023-10-05T11:40:29.189+0000 7fc5fab4b880 5 AuthRegistry(0x5632591550d8) adding con mode: secure 2023-10-05T11:40:29.280 INFO:tasks.workunit.client.0.smithi012.stderr: -362> 2023-10-05T11:40:29.189+0000 7fc5fab4b880 5 AuthRegistry(0x5632591550d8) adding con mode: crc 2023-10-05T11:40:29.280 INFO:tasks.workunit.client.0.smithi012.stderr: -361> 2023-10-05T11:40:29.189+0000 7fc5fab4b880 5 AuthRegistry(0x5632591550d8) adding con mode: crc 2023-10-05T11:40:29.280 INFO:tasks.workunit.client.0.smithi012.stderr: -360> 2023-10-05T11:40:29.189+0000 7fc5fab4b880 5 AuthRegistry(0x5632591550d8) adding con mode: secure 2023-10-05T11:40:29.280 INFO:tasks.workunit.client.0.smithi012.stderr: -359> 2023-10-05T11:40:29.189+0000 7fc5fab4b880 5 AuthRegistry(0x5632591550d8) adding con mode: crc 2023-10-05T11:40:29.281 INFO:tasks.workunit.client.0.smithi012.stderr: -358> 2023-10-05T11:40:29.189+0000 7fc5fab4b880 5 AuthRegistry(0x5632591550d8) adding con mode: secure 2023-10-05T11:40:29.281 INFO:tasks.workunit.client.0.smithi012.stderr: -357> 2023-10-05T11:40:29.189+0000 7fc5fab4b880 5 AuthRegistry(0x5632591550d8) adding con mode: crc 2023-10-05T11:40:29.281 INFO:tasks.workunit.client.0.smithi012.stderr: -356> 2023-10-05T11:40:29.189+0000 7fc5fab4b880 5 AuthRegistry(0x5632591550d8) adding con mode: secure 2023-10-05T11:40:29.281 INFO:tasks.workunit.client.0.smithi012.stderr: -355> 2023-10-05T11:40:29.189+0000 7fc5fab4b880 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-10-05T11:40:29.281 INFO:tasks.workunit.client.0.smithi012.stderr: -354> 2023-10-05T11:40:29.189+0000 7fc5fab4b880 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-10-05T11:40:29.281 INFO:tasks.workunit.client.0.smithi012.stderr: -353> 2023-10-05T11:40:29.189+0000 7fc5fab4b880 5 asok(0x5632592f6000) register_command rotate-key cmddesc rotate-key hook 0x563259155220 EEXIST 2023-10-05T11:40:29.281 INFO:tasks.workunit.client.0.smithi012.stderr: -352> 2023-10-05T11:40:29.189+0000 7fc5fab4b880 10 monclient: _reopen_session rank -1 2023-10-05T11:40:29.281 INFO:tasks.workunit.client.0.smithi012.stderr: -351> 2023-10-05T11:40:29.189+0000 7fc5fab4b880 10 monclient: _add_conns ranks=[0,2,1] 2023-10-05T11:40:29.281 INFO:tasks.workunit.client.0.smithi012.stderr: -350> 2023-10-05T11:40:29.189+0000 7fc5fab4b880 10 monclient(hunting): picked mon.noname-a con 0x563259eeec00 addr [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] 2023-10-05T11:40:29.281 INFO:tasks.workunit.client.0.smithi012.stderr: -349> 2023-10-05T11:40:29.189+0000 7fc5fab4b880 10 monclient(hunting): picked mon.noname-c con 0x563259eef000 addr [v2:172.21.15.12:3301/0,v1:172.21.15.12:6790/0] 2023-10-05T11:40:29.281 INFO:tasks.workunit.client.0.smithi012.stderr: -348> 2023-10-05T11:40:29.189+0000 7fc5fab4b880 10 monclient(hunting): picked mon.noname-b con 0x563259eef400 addr [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] 2023-10-05T11:40:29.281 INFO:tasks.workunit.client.0.smithi012.stderr: -347> 2023-10-05T11:40:29.189+0000 7fc5fab4b880 10 monclient(hunting): start opening mon connection 2023-10-05T11:40:29.282 INFO:tasks.workunit.client.0.smithi012.stderr: -346> 2023-10-05T11:40:29.189+0000 7fc5fab4b880 10 monclient(hunting): start opening mon connection 2023-10-05T11:40:29.282 INFO:tasks.workunit.client.0.smithi012.stderr: -345> 2023-10-05T11:40:29.189+0000 7fc5fab4b880 10 monclient(hunting): start opening mon connection 2023-10-05T11:40:29.282 INFO:tasks.workunit.client.0.smithi012.stderr: -344> 2023-10-05T11:40:29.189+0000 7fc5fab4b880 10 monclient(hunting): _renew_subs 2023-10-05T11:40:29.282 INFO:tasks.workunit.client.0.smithi012.stderr: -343> 2023-10-05T11:40:29.189+0000 7fc5fab4b880 10 monclient(hunting): authenticate will time out at 1537.357969s 2023-10-05T11:40:29.282 INFO:tasks.workunit.client.0.smithi012.stderr: -342> 2023-10-05T11:40:29.189+0000 7fc5f92f0640 10 monclient(hunting): get_auth_request con 0x563259eeec00 auth_method 0 2023-10-05T11:40:29.282 INFO:tasks.workunit.client.0.smithi012.stderr: -341> 2023-10-05T11:40:29.189+0000 7fc5f92f0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-10-05T11:40:29.282 INFO:tasks.workunit.client.0.smithi012.stderr: -340> 2023-10-05T11:40:29.189+0000 7fc5f92f0640 10 monclient(hunting): _init_auth method 2 2023-10-05T11:40:29.282 INFO:tasks.workunit.client.0.smithi012.stderr: -339> 2023-10-05T11:40:29.189+0000 7fc5f92f0640 10 monclient(hunting): _init_auth creating new auth 2023-10-05T11:40:29.282 INFO:tasks.workunit.client.0.smithi012.stderr: -338> 2023-10-05T11:40:29.189+0000 7fc5f8aef640 10 monclient(hunting): get_auth_request con 0x563259eef000 auth_method 0 2023-10-05T11:40:29.282 INFO:tasks.workunit.client.0.smithi012.stderr: -337> 2023-10-05T11:40:29.189+0000 7fc5f8aef640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-10-05T11:40:29.283 INFO:tasks.workunit.client.0.smithi012.stderr: -336> 2023-10-05T11:40:29.189+0000 7fc5f8aef640 10 monclient(hunting): _init_auth method 2 2023-10-05T11:40:29.283 INFO:tasks.workunit.client.0.smithi012.stderr: -335> 2023-10-05T11:40:29.189+0000 7fc5f8aef640 10 monclient(hunting): _init_auth creating new auth 2023-10-05T11:40:29.283 INFO:tasks.workunit.client.0.smithi012.stderr: -334> 2023-10-05T11:40:29.189+0000 7fc5f9af1640 10 monclient(hunting): get_auth_request con 0x563259eef400 auth_method 0 2023-10-05T11:40:29.283 INFO:tasks.workunit.client.0.smithi012.stderr: -333> 2023-10-05T11:40:29.189+0000 7fc5f9af1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-10-05T11:40:29.283 INFO:tasks.workunit.client.0.smithi012.stderr: -332> 2023-10-05T11:40:29.189+0000 7fc5f9af1640 10 monclient(hunting): _init_auth method 2 2023-10-05T11:40:29.283 INFO:tasks.workunit.client.0.smithi012.stderr: -331> 2023-10-05T11:40:29.189+0000 7fc5f9af1640 10 monclient(hunting): _init_auth creating new auth 2023-10-05T11:40:29.283 INFO:tasks.workunit.client.0.smithi012.stderr: -330> 2023-10-05T11:40:29.189+0000 7fc5f92f0640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-10-05T11:40:29.283 INFO:tasks.workunit.client.0.smithi012.stderr: -329> 2023-10-05T11:40:29.189+0000 7fc5f92f0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-10-05T11:40:29.283 INFO:tasks.workunit.client.0.smithi012.stderr: -328> 2023-10-05T11:40:29.189+0000 7fc5f92f0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-10-05T11:40:29.283 INFO:tasks.workunit.client.0.smithi012.stderr: -327> 2023-10-05T11:40:29.189+0000 7fc5f8aef640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-10-05T11:40:29.283 INFO:tasks.workunit.client.0.smithi012.stderr: -326> 2023-10-05T11:40:29.189+0000 7fc5f8aef640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-10-05T11:40:29.283 INFO:tasks.workunit.client.0.smithi012.stderr: -325> 2023-10-05T11:40:29.189+0000 7fc5f8aef640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-10-05T11:40:29.284 INFO:tasks.workunit.client.0.smithi012.stderr: -324> 2023-10-05T11:40:29.189+0000 7fc5f9af1640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-10-05T11:40:29.284 INFO:tasks.workunit.client.0.smithi012.stderr: -323> 2023-10-05T11:40:29.189+0000 7fc5f9af1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-10-05T11:40:29.284 INFO:tasks.workunit.client.0.smithi012.stderr: -322> 2023-10-05T11:40:29.189+0000 7fc5f9af1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-10-05T11:40:29.284 INFO:tasks.workunit.client.0.smithi012.stderr: -321> 2023-10-05T11:40:29.189+0000 7fc5f92f0640 10 monclient(hunting): handle_auth_done global_id 6822 payload 824 2023-10-05T11:40:29.284 INFO:tasks.workunit.client.0.smithi012.stderr: -320> 2023-10-05T11:40:29.189+0000 7fc5f92f0640 10 monclient: _finish_hunting 0 2023-10-05T11:40:29.284 INFO:tasks.workunit.client.0.smithi012.stderr: -319> 2023-10-05T11:40:29.189+0000 7fc5f92f0640 1 monclient: found mon.noname-a 2023-10-05T11:40:29.284 INFO:tasks.workunit.client.0.smithi012.stderr: -318> 2023-10-05T11:40:29.189+0000 7fc5f92f0640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.12:3300/0 2023-10-05T11:40:29.284 INFO:tasks.workunit.client.0.smithi012.stderr: -317> 2023-10-05T11:40:29.190+0000 7fc5f22e2640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-10-05T11:40:29.284 INFO:tasks.workunit.client.0.smithi012.stderr: -316> 2023-10-05T11:40:29.190+0000 7fc5f22e2640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2023-10-05T11:40:29.284 INFO:tasks.workunit.client.0.smithi012.stderr: -315> 2023-10-05T11:40:29.190+0000 7fc5f22e2640 10 monclient: dump: 2023-10-05T11:40:29.284 INFO:tasks.workunit.client.0.smithi012.stderr:epoch 1 2023-10-05T11:40:29.285 INFO:tasks.workunit.client.0.smithi012.stderr:fsid 7e015f46-293b-4b09-bd32-7d32b52f6e2f 2023-10-05T11:40:29.285 INFO:tasks.workunit.client.0.smithi012.stderr:last_changed 2023-10-05T11:27:38.366888+0000 2023-10-05T11:40:29.285 INFO:tasks.workunit.client.0.smithi012.stderr:created 2023-10-05T11:27:38.366888+0000 2023-10-05T11:40:29.285 INFO:tasks.workunit.client.0.smithi012.stderr:min_mon_release 18 (reef) 2023-10-05T11:40:29.285 INFO:tasks.workunit.client.0.smithi012.stderr:election_strategy: 1 2023-10-05T11:40:29.285 INFO:tasks.workunit.client.0.smithi012.stderr:0: [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon.a 2023-10-05T11:40:29.285 INFO:tasks.workunit.client.0.smithi012.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2023-10-05T11:40:29.285 INFO:tasks.workunit.client.0.smithi012.stderr:2: [v2:172.21.15.12:3301/0,v1:172.21.15.12:6790/0] mon.c 2023-10-05T11:40:29.285 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:40:29.285 INFO:tasks.workunit.client.0.smithi012.stderr: -314> 2023-10-05T11:40:29.190+0000 7fc5f22e2640 10 monclient: _finish_auth 0 2023-10-05T11:40:29.285 INFO:tasks.workunit.client.0.smithi012.stderr: -313> 2023-10-05T11:40:29.190+0000 7fc5f22e2640 10 monclient: _check_auth_tickets 2023-10-05T11:40:29.285 INFO:tasks.workunit.client.0.smithi012.stderr: -312> 2023-10-05T11:40:29.190+0000 7fc5f22e2640 10 monclient: handle_config config(0 keys) v1 2023-10-05T11:40:29.286 INFO:tasks.workunit.client.0.smithi012.stderr: -311> 2023-10-05T11:40:29.190+0000 7fc5f22e2640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-10-05T11:40:29.286 INFO:tasks.workunit.client.0.smithi012.stderr: -310> 2023-10-05T11:40:29.190+0000 7fc5f22e2640 10 monclient: got monmap 1 from mon.a (according to old e1) 2023-10-05T11:40:29.286 INFO:tasks.workunit.client.0.smithi012.stderr: -309> 2023-10-05T11:40:29.190+0000 7fc5f3ae5640 4 set_mon_vals no callback set 2023-10-05T11:40:29.286 INFO:tasks.workunit.client.0.smithi012.stderr: -308> 2023-10-05T11:40:29.190+0000 7fc5f22e2640 10 monclient: dump: 2023-10-05T11:40:29.286 INFO:tasks.workunit.client.0.smithi012.stderr:epoch 1 2023-10-05T11:40:29.286 INFO:tasks.workunit.client.0.smithi012.stderr:fsid 7e015f46-293b-4b09-bd32-7d32b52f6e2f 2023-10-05T11:40:29.286 INFO:tasks.workunit.client.0.smithi012.stderr:last_changed 2023-10-05T11:27:38.366888+0000 2023-10-05T11:40:29.286 INFO:tasks.workunit.client.0.smithi012.stderr:created 2023-10-05T11:27:38.366888+0000 2023-10-05T11:40:29.286 INFO:tasks.workunit.client.0.smithi012.stderr:min_mon_release 18 (reef) 2023-10-05T11:40:29.286 INFO:tasks.workunit.client.0.smithi012.stderr:election_strategy: 1 2023-10-05T11:40:29.286 INFO:tasks.workunit.client.0.smithi012.stderr:0: [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon.a 2023-10-05T11:40:29.287 INFO:tasks.workunit.client.0.smithi012.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2023-10-05T11:40:29.287 INFO:tasks.workunit.client.0.smithi012.stderr:2: [v2:172.21.15.12:3301/0,v1:172.21.15.12:6790/0] mon.c 2023-10-05T11:40:29.287 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:40:29.287 INFO:tasks.workunit.client.0.smithi012.stderr: -307> 2023-10-05T11:40:29.190+0000 7fc5fab4b880 5 monclient: authenticate success, global_id 6822 2023-10-05T11:40:29.287 INFO:tasks.workunit.client.0.smithi012.stderr: -306> 2023-10-05T11:40:29.190+0000 7fc5fab4b880 10 monclient: _renew_subs 2023-10-05T11:40:29.287 INFO:tasks.workunit.client.0.smithi012.stderr: -305> 2023-10-05T11:40:29.190+0000 7fc5fab4b880 10 monclient: _send_mon_message to mon.a at v2:172.21.15.12:3300/0 2023-10-05T11:40:29.287 INFO:tasks.workunit.client.0.smithi012.stderr: -304> 2023-10-05T11:40:29.190+0000 7fc5fab4b880 10 monclient: _renew_subs 2023-10-05T11:40:29.287 INFO:tasks.workunit.client.0.smithi012.stderr: -303> 2023-10-05T11:40:29.190+0000 7fc5fab4b880 10 monclient: _send_mon_message to mon.a at v2:172.21.15.12:3300/0 2023-10-05T11:40:29.287 INFO:tasks.workunit.client.0.smithi012.stderr: -302> 2023-10-05T11:40:29.190+0000 7fc5fab4b880 1 librados: init done 2023-10-05T11:40:29.287 INFO:tasks.workunit.client.0.smithi012.stderr: -301> 2023-10-05T11:40:29.191+0000 7fc5fab4b880 20 rados->read ofs=0 len=0 2023-10-05T11:40:29.287 INFO:tasks.workunit.client.0.smithi012.stderr: -300> 2023-10-05T11:40:29.191+0000 7fc5f22e2640 4 mgrc handle_mgr_map Got map version 5 2023-10-05T11:40:29.288 INFO:tasks.workunit.client.0.smithi012.stderr: -299> 2023-10-05T11:40:29.191+0000 7fc5f22e2640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.170:6832/180516904,v1:172.21.15.170:6833/180516904] 2023-10-05T11:40:29.288 INFO:tasks.workunit.client.0.smithi012.stderr: -298> 2023-10-05T11:40:29.191+0000 7fc5f22e2640 4 mgrc reconnect Starting new session with [v2:172.21.15.170:6832/180516904,v1:172.21.15.170:6833/180516904] 2023-10-05T11:40:29.288 INFO:tasks.workunit.client.0.smithi012.stderr: -297> 2023-10-05T11:40:29.191+0000 7fc5f8aef640 10 monclient: get_auth_request con 0x5632593ce400 auth_method 0 2023-10-05T11:40:29.288 INFO:tasks.workunit.client.0.smithi012.stderr: -296> 2023-10-05T11:40:29.192+0000 7fc5f9af1640 10 monclient: get_auth_request con 0x563259eef800 auth_method 0 2023-10-05T11:40:29.288 INFO:tasks.workunit.client.0.smithi012.stderr: -295> 2023-10-05T11:40:29.192+0000 7fc5fab4b880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:40:29.288 INFO:tasks.workunit.client.0.smithi012.stderr: -294> 2023-10-05T11:40:29.192+0000 7fc5fab4b880 20 realm 2023-10-05T11:40:29.288 INFO:tasks.workunit.client.0.smithi012.stderr: -293> 2023-10-05T11:40:29.192+0000 7fc5fab4b880 20 rados->read ofs=0 len=0 2023-10-05T11:40:29.288 INFO:tasks.workunit.client.0.smithi012.stderr: -292> 2023-10-05T11:40:29.192+0000 7fc5fab4b880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:40:29.288 INFO:tasks.workunit.client.0.smithi012.stderr: -291> 2023-10-05T11:40:29.192+0000 7fc5fab4b880 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T11:40:29.288 INFO:tasks.workunit.client.0.smithi012.stderr: -290> 2023-10-05T11:40:29.192+0000 7fc5fab4b880 20 rados->read ofs=0 len=0 2023-10-05T11:40:29.288 INFO:tasks.workunit.client.0.smithi012.stderr: -289> 2023-10-05T11:40:29.193+0000 7fc5fab4b880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:40:29.289 INFO:tasks.workunit.client.0.smithi012.stderr: -288> 2023-10-05T11:40:29.193+0000 7fc5fab4b880 20 rados->read ofs=0 len=0 2023-10-05T11:40:29.289 INFO:tasks.workunit.client.0.smithi012.stderr: -287> 2023-10-05T11:40:29.193+0000 7fc5f92f0640 10 monclient: get_auth_request con 0x563259eefc00 auth_method 0 2023-10-05T11:40:29.289 INFO:tasks.workunit.client.0.smithi012.stderr: -286> 2023-10-05T11:40:29.193+0000 7fc5fab4b880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:40:29.289 INFO:tasks.workunit.client.0.smithi012.stderr: -285> 2023-10-05T11:40:29.193+0000 7fc5fab4b880 20 rados->read ofs=0 len=0 2023-10-05T11:40:29.289 INFO:tasks.workunit.client.0.smithi012.stderr: -284> 2023-10-05T11:40:29.194+0000 7fc5f8aef640 10 monclient: get_auth_request con 0x5632593ce800 auth_method 0 2023-10-05T11:40:29.289 INFO:tasks.workunit.client.0.smithi012.stderr: -283> 2023-10-05T11:40:29.194+0000 7fc5fab4b880 20 rados_obj.operate() r=0 bl.length=1020 2023-10-05T11:40:29.289 INFO:tasks.workunit.client.0.smithi012.stderr: -282> 2023-10-05T11:40:29.194+0000 7fc5fab4b880 20 searching for the correct realm 2023-10-05T11:40:29.289 INFO:tasks.workunit.client.0.smithi012.stderr: -281> 2023-10-05T11:40:29.194+0000 7fc5f9af1640 10 monclient: get_auth_request con 0x5632593cec00 auth_method 0 2023-10-05T11:40:29.289 INFO:tasks.workunit.client.0.smithi012.stderr: -280> 2023-10-05T11:40:29.195+0000 7fc5f92f0640 10 monclient: get_auth_request con 0x5632594be000 auth_method 0 2023-10-05T11:40:29.289 INFO:tasks.workunit.client.0.smithi012.stderr: -279> 2023-10-05T11:40:29.196+0000 7fc5f8aef640 10 monclient: get_auth_request con 0x5632593bf400 auth_method 0 2023-10-05T11:40:29.289 INFO:tasks.workunit.client.0.smithi012.stderr: -278> 2023-10-05T11:40:29.198+0000 7fc5f9af1640 10 monclient: get_auth_request con 0x5632594be400 auth_method 0 2023-10-05T11:40:29.290 INFO:tasks.workunit.client.0.smithi012.stderr: -277> 2023-10-05T11:40:29.200+0000 7fc5f92f0640 10 monclient: get_auth_request con 0x5632594be800 auth_method 0 2023-10-05T11:40:29.290 INFO:tasks.workunit.client.0.smithi012.stderr: -276> 2023-10-05T11:40:29.202+0000 7fc5f92f0640 0 -- 172.21.15.12:0/2263745182 >> [v2:172.21.15.12:6808/396693578,v1:172.21.15.12:6809/396693578] conn(0x5632594be800 msgr2=0x5632593c5b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:40:29.290 INFO:tasks.workunit.client.0.smithi012.stderr: -275> 2023-10-05T11:40:29.202+0000 7fc5f22e2640 1 client.6822.objecter ms_handle_reset 0x5632594be800 session 0x5632592f0900 osd.0 2023-10-05T11:40:29.290 INFO:tasks.workunit.client.0.smithi012.stderr: -274> 2023-10-05T11:40:29.202+0000 7fc5f22e2640 10 monclient: _renew_subs 2023-10-05T11:40:29.290 INFO:tasks.workunit.client.0.smithi012.stderr: -273> 2023-10-05T11:40:29.202+0000 7fc5f22e2640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.12:3300/0 2023-10-05T11:40:29.290 INFO:tasks.workunit.client.0.smithi012.stderr: -272> 2023-10-05T11:40:29.203+0000 7fc5f92f0640 10 monclient: get_auth_request con 0x5632594bec00 auth_method 0 2023-10-05T11:40:29.290 INFO:tasks.workunit.client.0.smithi012.stderr: -271> 2023-10-05T11:40:29.204+0000 7fc5fab4b880 20 RGWRados::pool_iterate: got zone_info.dff27d1e-df33-400e-a68a-7ba586947c99 2023-10-05T11:40:29.290 INFO:tasks.workunit.client.0.smithi012.stderr: -270> 2023-10-05T11:40:29.204+0000 7fc5fab4b880 20 RGWRados::pool_iterate: got zonegroup_info.c78aa576-9d15-4e9d-b3c0-4af23a22062c 2023-10-05T11:40:29.290 INFO:tasks.workunit.client.0.smithi012.stderr: -269> 2023-10-05T11:40:29.204+0000 7fc5fab4b880 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T11:40:29.290 INFO:tasks.workunit.client.0.smithi012.stderr: -268> 2023-10-05T11:40:29.204+0000 7fc5fab4b880 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T11:40:29.290 INFO:tasks.workunit.client.0.smithi012.stderr: -267> 2023-10-05T11:40:29.204+0000 7fc5fab4b880 20 rados->read ofs=0 len=0 2023-10-05T11:40:29.290 INFO:tasks.workunit.client.0.smithi012.stderr: -266> 2023-10-05T11:40:29.205+0000 7fc5fab4b880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:40:29.291 INFO:tasks.workunit.client.0.smithi012.stderr: -265> 2023-10-05T11:40:29.205+0000 7fc5fab4b880 20 rados->read ofs=0 len=0 2023-10-05T11:40:29.291 INFO:tasks.workunit.client.0.smithi012.stderr: -264> 2023-10-05T11:40:29.205+0000 7fc5fab4b880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:40:29.291 INFO:tasks.workunit.client.0.smithi012.stderr: -263> 2023-10-05T11:40:29.205+0000 7fc5fab4b880 20 rados->read ofs=0 len=0 2023-10-05T11:40:29.291 INFO:tasks.workunit.client.0.smithi012.stderr: -262> 2023-10-05T11:40:29.205+0000 7fc5fab4b880 20 rados_obj.operate() r=0 bl.length=454 2023-10-05T11:40:29.291 INFO:tasks.workunit.client.0.smithi012.stderr: -261> 2023-10-05T11:40:29.205+0000 7fc5fab4b880 20 zone default found 2023-10-05T11:40:29.291 INFO:tasks.workunit.client.0.smithi012.stderr: -260> 2023-10-05T11:40:29.205+0000 7fc5fab4b880 4 Realm: () 2023-10-05T11:40:29.291 INFO:tasks.workunit.client.0.smithi012.stderr: -259> 2023-10-05T11:40:29.205+0000 7fc5fab4b880 4 ZoneGroup: default (c78aa576-9d15-4e9d-b3c0-4af23a22062c) 2023-10-05T11:40:29.291 INFO:tasks.workunit.client.0.smithi012.stderr: -258> 2023-10-05T11:40:29.205+0000 7fc5fab4b880 4 Zone: default (dff27d1e-df33-400e-a68a-7ba586947c99) 2023-10-05T11:40:29.291 INFO:tasks.workunit.client.0.smithi012.stderr: -257> 2023-10-05T11:40:29.205+0000 7fc5fab4b880 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T11:40:29.291 INFO:tasks.workunit.client.0.smithi012.stderr: -256> 2023-10-05T11:40:29.205+0000 7fc5fab4b880 20 zonegroup default 2023-10-05T11:40:29.291 INFO:tasks.workunit.client.0.smithi012.stderr: -255> 2023-10-05T11:40:29.205+0000 7fc5fab4b880 20 rados->read ofs=0 len=0 2023-10-05T11:40:29.291 INFO:tasks.workunit.client.0.smithi012.stderr: -254> 2023-10-05T11:40:29.205+0000 7fc5fab4b880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:40:29.292 INFO:tasks.workunit.client.0.smithi012.stderr: -253> 2023-10-05T11:40:29.205+0000 7fc5fab4b880 20 rados->read ofs=0 len=0 2023-10-05T11:40:29.292 INFO:tasks.workunit.client.0.smithi012.stderr: -252> 2023-10-05T11:40:29.206+0000 7fc5fab4b880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:40:29.292 INFO:tasks.workunit.client.0.smithi012.stderr: -251> 2023-10-05T11:40:29.206+0000 7fc5fab4b880 20 rados->read ofs=0 len=0 2023-10-05T11:40:29.292 INFO:tasks.workunit.client.0.smithi012.stderr: -250> 2023-10-05T11:40:29.206+0000 7fc5fab4b880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:40:29.292 INFO:tasks.workunit.client.0.smithi012.stderr: -249> 2023-10-05T11:40:29.206+0000 7fc5fab4b880 20 started sync module instance, tier type = 2023-10-05T11:40:29.292 INFO:tasks.workunit.client.0.smithi012.stderr: -248> 2023-10-05T11:40:29.206+0000 7fc5fab4b880 20 started zone id=dff27d1e-df33-400e-a68a-7ba586947c99 (name=default) with tier type = 2023-10-05T11:40:29.292 INFO:tasks.workunit.client.0.smithi012.stderr: -247> 2023-10-05T11:40:29.211+0000 7fc5f8aef640 0 -- 172.21.15.12:0/2263745182 >> [v2:172.21.15.170:6824/75773779,v1:172.21.15.170:6825/75773779] conn(0x5632593ce800 msgr2=0x5632592fd180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:40:29.292 INFO:tasks.workunit.client.0.smithi012.stderr: -246> 2023-10-05T11:40:29.211+0000 7fc5f22e2640 1 client.6822.objecter ms_handle_reset 0x5632593ce800 session 0x5632592f1200 osd.7 2023-10-05T11:40:29.292 INFO:tasks.workunit.client.0.smithi012.stderr: -245> 2023-10-05T11:40:29.211+0000 7fc5f8aef640 10 monclient: get_auth_request con 0x5632594be800 auth_method 0 2023-10-05T11:40:29.292 INFO:tasks.workunit.client.0.smithi012.stderr: -244> 2023-10-05T11:40:29.215+0000 7fc5fab4b880 20 add_watcher() i=0 2023-10-05T11:40:29.293 INFO:tasks.workunit.client.0.smithi012.stderr: -243> 2023-10-05T11:40:29.215+0000 7fc5fab4b880 20 add_watcher() i=1 2023-10-05T11:40:29.293 INFO:tasks.workunit.client.0.smithi012.stderr: -242> 2023-10-05T11:40:29.215+0000 7fc5fab4b880 20 add_watcher() i=2 2023-10-05T11:40:29.293 INFO:tasks.workunit.client.0.smithi012.stderr: -241> 2023-10-05T11:40:29.215+0000 7fc5fab4b880 20 add_watcher() i=3 2023-10-05T11:40:29.293 INFO:tasks.workunit.client.0.smithi012.stderr: -240> 2023-10-05T11:40:29.215+0000 7fc5fab4b880 20 add_watcher() i=4 2023-10-05T11:40:29.293 INFO:tasks.workunit.client.0.smithi012.stderr: -239> 2023-10-05T11:40:29.215+0000 7fc5fab4b880 20 add_watcher() i=5 2023-10-05T11:40:29.293 INFO:tasks.workunit.client.0.smithi012.stderr: -238> 2023-10-05T11:40:29.215+0000 7fc5fab4b880 20 add_watcher() i=6 2023-10-05T11:40:29.293 INFO:tasks.workunit.client.0.smithi012.stderr: -237> 2023-10-05T11:40:29.216+0000 7fc5fab4b880 20 add_watcher() i=7 2023-10-05T11:40:29.293 INFO:tasks.workunit.client.0.smithi012.stderr: -236> 2023-10-05T11:40:29.216+0000 7fc5fab4b880 2 all 8 watchers are set, enabling cache 2023-10-05T11:40:29.293 INFO:tasks.workunit.client.0.smithi012.stderr: -235> 2023-10-05T11:40:29.217+0000 7fc5fab4b880 5 AuthRegistry(0x7fff2cd5e7f0) adding auth protocol: cephx 2023-10-05T11:40:29.293 INFO:tasks.workunit.client.0.smithi012.stderr: -234> 2023-10-05T11:40:29.217+0000 7fc5fab4b880 5 AuthRegistry(0x7fff2cd5e7f0) adding auth protocol: cephx 2023-10-05T11:40:29.293 INFO:tasks.workunit.client.0.smithi012.stderr: -233> 2023-10-05T11:40:29.217+0000 7fc5fab4b880 5 AuthRegistry(0x7fff2cd5e7f0) adding auth protocol: cephx 2023-10-05T11:40:29.293 INFO:tasks.workunit.client.0.smithi012.stderr: -232> 2023-10-05T11:40:29.217+0000 7fc5fab4b880 5 AuthRegistry(0x7fff2cd5e7f0) adding con mode: secure 2023-10-05T11:40:29.294 INFO:tasks.workunit.client.0.smithi012.stderr: -231> 2023-10-05T11:40:29.217+0000 7fc5fab4b880 5 AuthRegistry(0x7fff2cd5e7f0) adding con mode: crc 2023-10-05T11:40:29.294 INFO:tasks.workunit.client.0.smithi012.stderr: -230> 2023-10-05T11:40:29.217+0000 7fc5fab4b880 5 AuthRegistry(0x7fff2cd5e7f0) adding con mode: secure 2023-10-05T11:40:29.294 INFO:tasks.workunit.client.0.smithi012.stderr: -229> 2023-10-05T11:40:29.217+0000 7fc5fab4b880 5 AuthRegistry(0x7fff2cd5e7f0) adding con mode: crc 2023-10-05T11:40:29.294 INFO:tasks.workunit.client.0.smithi012.stderr: -228> 2023-10-05T11:40:29.217+0000 7fc5e02be640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:40:29.294 INFO:tasks.workunit.client.0.smithi012.stderr: -227> 2023-10-05T11:40:29.217+0000 7fc5fab4b880 5 AuthRegistry(0x7fff2cd5e7f0) adding con mode: secure 2023-10-05T11:40:29.294 INFO:tasks.workunit.client.0.smithi012.stderr: -226> 2023-10-05T11:40:29.217+0000 7fc5fab4b880 5 AuthRegistry(0x7fff2cd5e7f0) adding con mode: crc 2023-10-05T11:40:29.294 INFO:tasks.workunit.client.0.smithi012.stderr: -225> 2023-10-05T11:40:29.217+0000 7fc5fab4b880 5 AuthRegistry(0x7fff2cd5e7f0) adding con mode: crc 2023-10-05T11:40:29.294 INFO:tasks.workunit.client.0.smithi012.stderr: -224> 2023-10-05T11:40:29.217+0000 7fc5fab4b880 5 AuthRegistry(0x7fff2cd5e7f0) adding con mode: secure 2023-10-05T11:40:29.294 INFO:tasks.workunit.client.0.smithi012.stderr: -223> 2023-10-05T11:40:29.217+0000 7fc5fab4b880 5 AuthRegistry(0x7fff2cd5e7f0) adding con mode: crc 2023-10-05T11:40:29.294 INFO:tasks.workunit.client.0.smithi012.stderr: -222> 2023-10-05T11:40:29.217+0000 7fc5fab4b880 5 AuthRegistry(0x7fff2cd5e7f0) adding con mode: secure 2023-10-05T11:40:29.294 INFO:tasks.workunit.client.0.smithi012.stderr: -221> 2023-10-05T11:40:29.217+0000 7fc5fab4b880 5 AuthRegistry(0x7fff2cd5e7f0) adding con mode: crc 2023-10-05T11:40:29.294 INFO:tasks.workunit.client.0.smithi012.stderr: -220> 2023-10-05T11:40:29.217+0000 7fc5fab4b880 5 AuthRegistry(0x7fff2cd5e7f0) adding con mode: secure 2023-10-05T11:40:29.295 INFO:tasks.workunit.client.0.smithi012.stderr: -219> 2023-10-05T11:40:29.218+0000 7fc5fab4b880 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-10-05T11:40:29.295 INFO:tasks.workunit.client.0.smithi012.stderr: -218> 2023-10-05T11:40:29.218+0000 7fc5fab4b880 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T11:40:29.295 INFO:tasks.workunit.client.0.smithi012.stderr: -217> 2023-10-05T11:40:29.218+0000 7fc5fab4b880 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T11:40:29.295 INFO:tasks.workunit.client.0.smithi012.stderr: -216> 2023-10-05T11:40:29.218+0000 7fc5fab4b880 5 asok(0x5632592f6000) register_command cache list hook 0x5632590ad480 2023-10-05T11:40:29.295 INFO:tasks.workunit.client.0.smithi012.stderr: -215> 2023-10-05T11:40:29.218+0000 7fc5fab4b880 5 asok(0x5632592f6000) register_command cache inspect hook 0x5632590ad480 2023-10-05T11:40:29.295 INFO:tasks.workunit.client.0.smithi012.stderr: -214> 2023-10-05T11:40:29.218+0000 7fc5fab4b880 5 asok(0x5632592f6000) register_command cache erase hook 0x5632590ad480 2023-10-05T11:40:29.295 INFO:tasks.workunit.client.0.smithi012.stderr: -213> 2023-10-05T11:40:29.218+0000 7fc5fab4b880 5 asok(0x5632592f6000) register_command cache zap hook 0x5632590ad480 2023-10-05T11:40:29.295 INFO:tasks.workunit.client.0.smithi012.stderr: -212> 2023-10-05T11:40:29.218+0000 7fc5fab4b880 10 monclient: get_monmap_and_config 2023-10-05T11:40:29.295 INFO:tasks.workunit.client.0.smithi012.stderr: -211> 2023-10-05T11:40:29.218+0000 7fc5fab4b880 10 monclient: build_initial_monmap 2023-10-05T11:40:29.295 INFO:tasks.workunit.client.0.smithi012.stderr: -210> 2023-10-05T11:40:29.218+0000 7fc5fab4b880 1 build_initial for_mkfs: 0 2023-10-05T11:40:29.295 INFO:tasks.workunit.client.0.smithi012.stderr: -209> 2023-10-05T11:40:29.218+0000 7fc5fab4b880 10 monclient: monmap: 2023-10-05T11:40:29.296 INFO:tasks.workunit.client.0.smithi012.stderr:epoch 0 2023-10-05T11:40:29.296 INFO:tasks.workunit.client.0.smithi012.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-10-05T11:40:29.296 INFO:tasks.workunit.client.0.smithi012.stderr:last_changed 0.000000 2023-10-05T11:40:29.296 INFO:tasks.workunit.client.0.smithi012.stderr:created 0.000000 2023-10-05T11:40:29.296 INFO:tasks.workunit.client.0.smithi012.stderr:min_mon_release 0 (unknown) 2023-10-05T11:40:29.296 INFO:tasks.workunit.client.0.smithi012.stderr:election_strategy: 1 2023-10-05T11:40:29.296 INFO:tasks.workunit.client.0.smithi012.stderr:0: [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon.noname-a 2023-10-05T11:40:29.296 INFO:tasks.workunit.client.0.smithi012.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.noname-b 2023-10-05T11:40:29.296 INFO:tasks.workunit.client.0.smithi012.stderr:2: [v2:172.21.15.12:3301/0,v1:172.21.15.12:6790/0] mon.noname-c 2023-10-05T11:40:29.296 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:40:29.296 INFO:tasks.workunit.client.0.smithi012.stderr: -208> 2023-10-05T11:40:29.218+0000 7fc5fab4b880 5 AuthRegistry(0x563259da7c40) adding auth protocol: cephx 2023-10-05T11:40:29.296 INFO:tasks.workunit.client.0.smithi012.stderr: -207> 2023-10-05T11:40:29.218+0000 7fc5fab4b880 5 AuthRegistry(0x563259da7c40) adding auth protocol: cephx 2023-10-05T11:40:29.297 INFO:tasks.workunit.client.0.smithi012.stderr: -206> 2023-10-05T11:40:29.218+0000 7fc5fab4b880 5 AuthRegistry(0x563259da7c40) adding auth protocol: cephx 2023-10-05T11:40:29.297 INFO:tasks.workunit.client.0.smithi012.stderr: -205> 2023-10-05T11:40:29.218+0000 7fc5fab4b880 5 AuthRegistry(0x563259da7c40) adding con mode: secure 2023-10-05T11:40:29.297 INFO:tasks.workunit.client.0.smithi012.stderr: -204> 2023-10-05T11:40:29.218+0000 7fc5fab4b880 5 AuthRegistry(0x563259da7c40) adding con mode: crc 2023-10-05T11:40:29.297 INFO:tasks.workunit.client.0.smithi012.stderr: -203> 2023-10-05T11:40:29.218+0000 7fc5fab4b880 5 AuthRegistry(0x563259da7c40) adding con mode: secure 2023-10-05T11:40:29.297 INFO:tasks.workunit.client.0.smithi012.stderr: -202> 2023-10-05T11:40:29.218+0000 7fc5fab4b880 5 AuthRegistry(0x563259da7c40) adding con mode: crc 2023-10-05T11:40:29.297 INFO:tasks.workunit.client.0.smithi012.stderr: -201> 2023-10-05T11:40:29.218+0000 7fc5fab4b880 5 AuthRegistry(0x563259da7c40) adding con mode: secure 2023-10-05T11:40:29.297 INFO:tasks.workunit.client.0.smithi012.stderr: -200> 2023-10-05T11:40:29.218+0000 7fc5fab4b880 5 AuthRegistry(0x563259da7c40) adding con mode: crc 2023-10-05T11:40:29.297 INFO:tasks.workunit.client.0.smithi012.stderr: -199> 2023-10-05T11:40:29.218+0000 7fc5fab4b880 5 AuthRegistry(0x563259da7c40) adding con mode: crc 2023-10-05T11:40:29.297 INFO:tasks.workunit.client.0.smithi012.stderr: -198> 2023-10-05T11:40:29.218+0000 7fc5fab4b880 5 AuthRegistry(0x563259da7c40) adding con mode: secure 2023-10-05T11:40:29.297 INFO:tasks.workunit.client.0.smithi012.stderr: -197> 2023-10-05T11:40:29.218+0000 7fc5fab4b880 5 AuthRegistry(0x563259da7c40) adding con mode: crc 2023-10-05T11:40:29.297 INFO:tasks.workunit.client.0.smithi012.stderr: -196> 2023-10-05T11:40:29.218+0000 7fc5fab4b880 5 AuthRegistry(0x563259da7c40) adding con mode: secure 2023-10-05T11:40:29.298 INFO:tasks.workunit.client.0.smithi012.stderr: -195> 2023-10-05T11:40:29.218+0000 7fc5fab4b880 5 AuthRegistry(0x563259da7c40) adding con mode: crc 2023-10-05T11:40:29.298 INFO:tasks.workunit.client.0.smithi012.stderr: -194> 2023-10-05T11:40:29.218+0000 7fc5fab4b880 5 AuthRegistry(0x563259da7c40) adding con mode: secure 2023-10-05T11:40:29.298 INFO:tasks.workunit.client.0.smithi012.stderr: -193> 2023-10-05T11:40:29.218+0000 7fc5fab4b880 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-10-05T11:40:29.298 INFO:tasks.workunit.client.0.smithi012.stderr: -192> 2023-10-05T11:40:29.218+0000 7fc5fab4b880 10 monclient: init 2023-10-05T11:40:29.298 INFO:tasks.workunit.client.0.smithi012.stderr: -191> 2023-10-05T11:40:29.218+0000 7fc5fab4b880 5 AuthRegistry(0x7fff2cd5e340) adding auth protocol: cephx 2023-10-05T11:40:29.298 INFO:tasks.workunit.client.0.smithi012.stderr: -190> 2023-10-05T11:40:29.218+0000 7fc5fab4b880 5 AuthRegistry(0x7fff2cd5e340) adding auth protocol: cephx 2023-10-05T11:40:29.298 INFO:tasks.workunit.client.0.smithi012.stderr: -189> 2023-10-05T11:40:29.218+0000 7fc5fab4b880 5 AuthRegistry(0x7fff2cd5e340) adding auth protocol: cephx 2023-10-05T11:40:29.298 INFO:tasks.workunit.client.0.smithi012.stderr: -188> 2023-10-05T11:40:29.218+0000 7fc5fab4b880 5 AuthRegistry(0x7fff2cd5e340) adding con mode: secure 2023-10-05T11:40:29.298 INFO:tasks.workunit.client.0.smithi012.stderr: -187> 2023-10-05T11:40:29.218+0000 7fc5fab4b880 5 AuthRegistry(0x7fff2cd5e340) adding con mode: crc 2023-10-05T11:40:29.298 INFO:tasks.workunit.client.0.smithi012.stderr: -186> 2023-10-05T11:40:29.218+0000 7fc5fab4b880 5 AuthRegistry(0x7fff2cd5e340) adding con mode: secure 2023-10-05T11:40:29.299 INFO:tasks.workunit.client.0.smithi012.stderr: -185> 2023-10-05T11:40:29.218+0000 7fc5fab4b880 5 AuthRegistry(0x7fff2cd5e340) adding con mode: crc 2023-10-05T11:40:29.299 INFO:tasks.workunit.client.0.smithi012.stderr: -184> 2023-10-05T11:40:29.218+0000 7fc5fab4b880 5 AuthRegistry(0x7fff2cd5e340) adding con mode: secure 2023-10-05T11:40:29.299 INFO:tasks.workunit.client.0.smithi012.stderr: -183> 2023-10-05T11:40:29.218+0000 7fc5fab4b880 5 AuthRegistry(0x7fff2cd5e340) adding con mode: crc 2023-10-05T11:40:29.299 INFO:tasks.workunit.client.0.smithi012.stderr: -182> 2023-10-05T11:40:29.218+0000 7fc5fab4b880 5 AuthRegistry(0x7fff2cd5e340) adding con mode: crc 2023-10-05T11:40:29.299 INFO:tasks.workunit.client.0.smithi012.stderr: -181> 2023-10-05T11:40:29.218+0000 7fc5fab4b880 5 AuthRegistry(0x7fff2cd5e340) adding con mode: secure 2023-10-05T11:40:29.299 INFO:tasks.workunit.client.0.smithi012.stderr: -180> 2023-10-05T11:40:29.218+0000 7fc5fab4b880 5 AuthRegistry(0x7fff2cd5e340) adding con mode: crc 2023-10-05T11:40:29.299 INFO:tasks.workunit.client.0.smithi012.stderr: -179> 2023-10-05T11:40:29.218+0000 7fc5fab4b880 5 AuthRegistry(0x7fff2cd5e340) adding con mode: secure 2023-10-05T11:40:29.299 INFO:tasks.workunit.client.0.smithi012.stderr: -178> 2023-10-05T11:40:29.218+0000 7fc5fab4b880 5 AuthRegistry(0x7fff2cd5e340) adding con mode: crc 2023-10-05T11:40:29.299 INFO:tasks.workunit.client.0.smithi012.stderr: -177> 2023-10-05T11:40:29.218+0000 7fc5fab4b880 5 AuthRegistry(0x7fff2cd5e340) adding con mode: secure 2023-10-05T11:40:29.299 INFO:tasks.workunit.client.0.smithi012.stderr: -176> 2023-10-05T11:40:29.218+0000 7fc5fab4b880 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-10-05T11:40:29.300 INFO:tasks.workunit.client.0.smithi012.stderr: -175> 2023-10-05T11:40:29.218+0000 7fc5fab4b880 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-10-05T11:40:29.300 INFO:tasks.workunit.client.0.smithi012.stderr: -174> 2023-10-05T11:40:29.219+0000 7fc5fab4b880 5 asok(0x5632592f6000) register_command rotate-key cmddesc rotate-key hook 0x7fff2cd5e488 EEXIST 2023-10-05T11:40:29.300 INFO:tasks.workunit.client.0.smithi012.stderr: -173> 2023-10-05T11:40:29.219+0000 7fc5fab4b880 10 monclient: _reopen_session rank -1 2023-10-05T11:40:29.300 INFO:tasks.workunit.client.0.smithi012.stderr: -172> 2023-10-05T11:40:29.219+0000 7fc5fab4b880 10 monclient: _add_conns ranks=[1,2,0] 2023-10-05T11:40:29.300 INFO:tasks.workunit.client.0.smithi012.stderr: -171> 2023-10-05T11:40:29.219+0000 7fc5fab4b880 10 monclient(hunting): picked mon.noname-b con 0x5632594dcc00 addr [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] 2023-10-05T11:40:29.300 INFO:tasks.workunit.client.0.smithi012.stderr: -170> 2023-10-05T11:40:29.219+0000 7fc5fab4b880 10 monclient(hunting): picked mon.noname-c con 0x5632594dd000 addr [v2:172.21.15.12:3301/0,v1:172.21.15.12:6790/0] 2023-10-05T11:40:29.300 INFO:tasks.workunit.client.0.smithi012.stderr: -169> 2023-10-05T11:40:29.219+0000 7fc5fab4b880 10 monclient(hunting): picked mon.noname-a con 0x5632594dd400 addr [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] 2023-10-05T11:40:29.300 INFO:tasks.workunit.client.0.smithi012.stderr: -168> 2023-10-05T11:40:29.219+0000 7fc5fab4b880 10 monclient(hunting): start opening mon connection 2023-10-05T11:40:29.300 INFO:tasks.workunit.client.0.smithi012.stderr: -167> 2023-10-05T11:40:29.219+0000 7fc5fab4b880 10 monclient(hunting): start opening mon connection 2023-10-05T11:40:29.300 INFO:tasks.workunit.client.0.smithi012.stderr: -166> 2023-10-05T11:40:29.219+0000 7fc5fab4b880 10 monclient(hunting): start opening mon connection 2023-10-05T11:40:29.300 INFO:tasks.workunit.client.0.smithi012.stderr: -165> 2023-10-05T11:40:29.219+0000 7fc5fab4b880 10 monclient(hunting): _renew_subs 2023-10-05T11:40:29.301 INFO:tasks.workunit.client.0.smithi012.stderr: -164> 2023-10-05T11:40:29.219+0000 7fc5fab4b880 10 monclient(hunting): authenticate will time out at 1537.387498s 2023-10-05T11:40:29.301 INFO:tasks.workunit.client.0.smithi012.stderr: -163> 2023-10-05T11:40:29.219+0000 7fc5f8aef640 10 monclient(hunting): get_auth_request con 0x5632594dd400 auth_method 0 2023-10-05T11:40:29.301 INFO:tasks.workunit.client.0.smithi012.stderr: -162> 2023-10-05T11:40:29.219+0000 7fc5f8aef640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-10-05T11:40:29.301 INFO:tasks.workunit.client.0.smithi012.stderr: -161> 2023-10-05T11:40:29.219+0000 7fc5f8aef640 10 monclient(hunting): _init_auth method 2 2023-10-05T11:40:29.301 INFO:tasks.workunit.client.0.smithi012.stderr: -160> 2023-10-05T11:40:29.219+0000 7fc5f8aef640 10 monclient(hunting): _init_auth creating new auth 2023-10-05T11:40:29.301 INFO:tasks.workunit.client.0.smithi012.stderr: -159> 2023-10-05T11:40:29.219+0000 7fc5f92f0640 10 monclient(hunting): get_auth_request con 0x5632594dd000 auth_method 0 2023-10-05T11:40:29.301 INFO:tasks.workunit.client.0.smithi012.stderr: -158> 2023-10-05T11:40:29.219+0000 7fc5f92f0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-10-05T11:40:29.301 INFO:tasks.workunit.client.0.smithi012.stderr: -157> 2023-10-05T11:40:29.219+0000 7fc5f92f0640 10 monclient(hunting): _init_auth method 2 2023-10-05T11:40:29.301 INFO:tasks.workunit.client.0.smithi012.stderr: -156> 2023-10-05T11:40:29.219+0000 7fc5f92f0640 10 monclient(hunting): _init_auth creating new auth 2023-10-05T11:40:29.301 INFO:tasks.workunit.client.0.smithi012.stderr: -155> 2023-10-05T11:40:29.219+0000 7fc5f8aef640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-10-05T11:40:29.302 INFO:tasks.workunit.client.0.smithi012.stderr: -154> 2023-10-05T11:40:29.219+0000 7fc5f8aef640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-10-05T11:40:29.302 INFO:tasks.workunit.client.0.smithi012.stderr: -153> 2023-10-05T11:40:29.219+0000 7fc5f8aef640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-10-05T11:40:29.302 INFO:tasks.workunit.client.0.smithi012.stderr: -152> 2023-10-05T11:40:29.219+0000 7fc5f92f0640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-10-05T11:40:29.302 INFO:tasks.workunit.client.0.smithi012.stderr: -151> 2023-10-05T11:40:29.219+0000 7fc5f92f0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-10-05T11:40:29.302 INFO:tasks.workunit.client.0.smithi012.stderr: -150> 2023-10-05T11:40:29.219+0000 7fc5f92f0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-10-05T11:40:29.302 INFO:tasks.workunit.client.0.smithi012.stderr: -149> 2023-10-05T11:40:29.219+0000 7fc5f9af1640 10 monclient(hunting): get_auth_request con 0x5632594dcc00 auth_method 0 2023-10-05T11:40:29.302 INFO:tasks.workunit.client.0.smithi012.stderr: -148> 2023-10-05T11:40:29.219+0000 7fc5f9af1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-10-05T11:40:29.302 INFO:tasks.workunit.client.0.smithi012.stderr: -147> 2023-10-05T11:40:29.219+0000 7fc5f9af1640 10 monclient(hunting): _init_auth method 2 2023-10-05T11:40:29.302 INFO:tasks.workunit.client.0.smithi012.stderr: -146> 2023-10-05T11:40:29.219+0000 7fc5f9af1640 10 monclient(hunting): _init_auth creating new auth 2023-10-05T11:40:29.302 INFO:tasks.workunit.client.0.smithi012.stderr: -145> 2023-10-05T11:40:29.219+0000 7fc5f92f0640 10 monclient(hunting): handle_auth_done global_id 6512 payload 274 2023-10-05T11:40:29.302 INFO:tasks.workunit.client.0.smithi012.stderr: -144> 2023-10-05T11:40:29.219+0000 7fc5f92f0640 10 monclient: _finish_hunting 0 2023-10-05T11:40:29.303 INFO:tasks.workunit.client.0.smithi012.stderr: -143> 2023-10-05T11:40:29.219+0000 7fc5f92f0640 1 monclient: found mon.noname-c 2023-10-05T11:40:29.303 INFO:tasks.workunit.client.0.smithi012.stderr: -142> 2023-10-05T11:40:29.219+0000 7fc5f92f0640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.12:3301/0 2023-10-05T11:40:29.303 INFO:tasks.workunit.client.0.smithi012.stderr: -141> 2023-10-05T11:40:29.219+0000 7fc5dfabd640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-10-05T11:40:29.303 INFO:tasks.workunit.client.0.smithi012.stderr: -140> 2023-10-05T11:40:29.219+0000 7fc5dfabd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2023-10-05T11:40:29.303 INFO:tasks.workunit.client.0.smithi012.stderr: -139> 2023-10-05T11:40:29.219+0000 7fc5dfabd640 10 monclient: dump: 2023-10-05T11:40:29.303 INFO:tasks.workunit.client.0.smithi012.stderr:epoch 1 2023-10-05T11:40:29.303 INFO:tasks.workunit.client.0.smithi012.stderr:fsid 7e015f46-293b-4b09-bd32-7d32b52f6e2f 2023-10-05T11:40:29.303 INFO:tasks.workunit.client.0.smithi012.stderr:last_changed 2023-10-05T11:27:38.366888+0000 2023-10-05T11:40:29.303 INFO:tasks.workunit.client.0.smithi012.stderr:created 2023-10-05T11:27:38.366888+0000 2023-10-05T11:40:29.303 INFO:tasks.workunit.client.0.smithi012.stderr:min_mon_release 18 (reef) 2023-10-05T11:40:29.303 INFO:tasks.workunit.client.0.smithi012.stderr:election_strategy: 1 2023-10-05T11:40:29.303 INFO:tasks.workunit.client.0.smithi012.stderr:0: [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon.a 2023-10-05T11:40:29.304 INFO:tasks.workunit.client.0.smithi012.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2023-10-05T11:40:29.304 INFO:tasks.workunit.client.0.smithi012.stderr:2: [v2:172.21.15.12:3301/0,v1:172.21.15.12:6790/0] mon.c 2023-10-05T11:40:29.304 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:40:29.304 INFO:tasks.workunit.client.0.smithi012.stderr: -138> 2023-10-05T11:40:29.219+0000 7fc5dfabd640 10 monclient: _finish_auth 0 2023-10-05T11:40:29.304 INFO:tasks.workunit.client.0.smithi012.stderr: -137> 2023-10-05T11:40:29.219+0000 7fc5dfabd640 10 monclient: _check_auth_tickets 2023-10-05T11:40:29.304 INFO:tasks.workunit.client.0.smithi012.stderr: -136> 2023-10-05T11:40:29.219+0000 7fc5dfabd640 10 monclient: handle_config config(0 keys) v1 2023-10-05T11:40:29.304 INFO:tasks.workunit.client.0.smithi012.stderr: -135> 2023-10-05T11:40:29.219+0000 7fc5dfabd640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-10-05T11:40:29.304 INFO:tasks.workunit.client.0.smithi012.stderr: -134> 2023-10-05T11:40:29.219+0000 7fc5dfabd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-10-05T11:40:29.304 INFO:tasks.workunit.client.0.smithi012.stderr: -133> 2023-10-05T11:40:29.219+0000 7fc5dfabd640 10 monclient: dump: 2023-10-05T11:40:29.304 INFO:tasks.workunit.client.0.smithi012.stderr:epoch 1 2023-10-05T11:40:29.304 INFO:tasks.workunit.client.0.smithi012.stderr:fsid 7e015f46-293b-4b09-bd32-7d32b52f6e2f 2023-10-05T11:40:29.305 INFO:tasks.workunit.client.0.smithi012.stderr:last_changed 2023-10-05T11:27:38.366888+0000 2023-10-05T11:40:29.305 INFO:tasks.workunit.client.0.smithi012.stderr:created 2023-10-05T11:27:38.366888+0000 2023-10-05T11:40:29.305 INFO:tasks.workunit.client.0.smithi012.stderr:min_mon_release 18 (reef) 2023-10-05T11:40:29.305 INFO:tasks.workunit.client.0.smithi012.stderr:election_strategy: 1 2023-10-05T11:40:29.305 INFO:tasks.workunit.client.0.smithi012.stderr:0: [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon.a 2023-10-05T11:40:29.305 INFO:tasks.workunit.client.0.smithi012.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2023-10-05T11:40:29.305 INFO:tasks.workunit.client.0.smithi012.stderr:2: [v2:172.21.15.12:3301/0,v1:172.21.15.12:6790/0] mon.c 2023-10-05T11:40:29.305 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:40:29.305 INFO:tasks.workunit.client.0.smithi012.stderr: -132> 2023-10-05T11:40:29.219+0000 7fc5fab4b880 5 monclient: authenticate success, global_id 6512 2023-10-05T11:40:29.305 INFO:tasks.workunit.client.0.smithi012.stderr: -131> 2023-10-05T11:40:29.219+0000 7fc5fab4b880 10 monclient: get_monmap_and_config success 2023-10-05T11:40:29.305 INFO:tasks.workunit.client.0.smithi012.stderr: -130> 2023-10-05T11:40:29.219+0000 7fc5fab4b880 4 set_mon_vals no callback set 2023-10-05T11:40:29.305 INFO:tasks.workunit.client.0.smithi012.stderr: -129> 2023-10-05T11:40:29.220+0000 7fc5fab4b880 10 monclient: shutdown 2023-10-05T11:40:29.306 INFO:tasks.workunit.client.0.smithi012.stderr: -128> 2023-10-05T11:40:29.220+0000 7fc5fab4b880 10 monclient: build_initial_monmap 2023-10-05T11:40:29.306 INFO:tasks.workunit.client.0.smithi012.stderr: -127> 2023-10-05T11:40:29.220+0000 7fc5fab4b880 1 build_initial for_mkfs: 0 2023-10-05T11:40:29.306 INFO:tasks.workunit.client.0.smithi012.stderr: -126> 2023-10-05T11:40:29.220+0000 7fc5fab4b880 10 monclient: monmap: 2023-10-05T11:40:29.306 INFO:tasks.workunit.client.0.smithi012.stderr:epoch 0 2023-10-05T11:40:29.306 INFO:tasks.workunit.client.0.smithi012.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-10-05T11:40:29.306 INFO:tasks.workunit.client.0.smithi012.stderr:last_changed 0.000000 2023-10-05T11:40:29.306 INFO:tasks.workunit.client.0.smithi012.stderr:created 0.000000 2023-10-05T11:40:29.306 INFO:tasks.workunit.client.0.smithi012.stderr:min_mon_release 0 (unknown) 2023-10-05T11:40:29.306 INFO:tasks.workunit.client.0.smithi012.stderr:election_strategy: 1 2023-10-05T11:40:29.306 INFO:tasks.workunit.client.0.smithi012.stderr:0: [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon.noname-a 2023-10-05T11:40:29.306 INFO:tasks.workunit.client.0.smithi012.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.noname-b 2023-10-05T11:40:29.307 INFO:tasks.workunit.client.0.smithi012.stderr:2: [v2:172.21.15.12:3301/0,v1:172.21.15.12:6790/0] mon.noname-c 2023-10-05T11:40:29.307 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:40:29.307 INFO:tasks.workunit.client.0.smithi012.stderr: -125> 2023-10-05T11:40:29.220+0000 7fc5fab4b880 5 AuthRegistry(0x563259da7c40) adding auth protocol: cephx 2023-10-05T11:40:29.307 INFO:tasks.workunit.client.0.smithi012.stderr: -124> 2023-10-05T11:40:29.220+0000 7fc5fab4b880 5 AuthRegistry(0x563259da7c40) adding auth protocol: cephx 2023-10-05T11:40:29.307 INFO:tasks.workunit.client.0.smithi012.stderr: -123> 2023-10-05T11:40:29.220+0000 7fc5fab4b880 5 AuthRegistry(0x563259da7c40) adding auth protocol: cephx 2023-10-05T11:40:29.307 INFO:tasks.workunit.client.0.smithi012.stderr: -122> 2023-10-05T11:40:29.220+0000 7fc5fab4b880 5 AuthRegistry(0x563259da7c40) adding con mode: secure 2023-10-05T11:40:29.307 INFO:tasks.workunit.client.0.smithi012.stderr: -121> 2023-10-05T11:40:29.220+0000 7fc5fab4b880 5 AuthRegistry(0x563259da7c40) adding con mode: crc 2023-10-05T11:40:29.307 INFO:tasks.workunit.client.0.smithi012.stderr: -120> 2023-10-05T11:40:29.220+0000 7fc5fab4b880 5 AuthRegistry(0x563259da7c40) adding con mode: secure 2023-10-05T11:40:29.307 INFO:tasks.workunit.client.0.smithi012.stderr: -119> 2023-10-05T11:40:29.220+0000 7fc5fab4b880 5 AuthRegistry(0x563259da7c40) adding con mode: crc 2023-10-05T11:40:29.307 INFO:tasks.workunit.client.0.smithi012.stderr: -118> 2023-10-05T11:40:29.220+0000 7fc5fab4b880 5 AuthRegistry(0x563259da7c40) adding con mode: secure 2023-10-05T11:40:29.307 INFO:tasks.workunit.client.0.smithi012.stderr: -117> 2023-10-05T11:40:29.220+0000 7fc5fab4b880 5 AuthRegistry(0x563259da7c40) adding con mode: crc 2023-10-05T11:40:29.307 INFO:tasks.workunit.client.0.smithi012.stderr: -116> 2023-10-05T11:40:29.220+0000 7fc5fab4b880 5 AuthRegistry(0x563259da7c40) adding con mode: crc 2023-10-05T11:40:29.308 INFO:tasks.workunit.client.0.smithi012.stderr: -115> 2023-10-05T11:40:29.220+0000 7fc5fab4b880 5 AuthRegistry(0x563259da7c40) adding con mode: secure 2023-10-05T11:40:29.308 INFO:tasks.workunit.client.0.smithi012.stderr: -114> 2023-10-05T11:40:29.220+0000 7fc5fab4b880 5 AuthRegistry(0x563259da7c40) adding con mode: crc 2023-10-05T11:40:29.308 INFO:tasks.workunit.client.0.smithi012.stderr: -113> 2023-10-05T11:40:29.220+0000 7fc5fab4b880 5 AuthRegistry(0x563259da7c40) adding con mode: secure 2023-10-05T11:40:29.308 INFO:tasks.workunit.client.0.smithi012.stderr: -112> 2023-10-05T11:40:29.220+0000 7fc5fab4b880 5 AuthRegistry(0x563259da7c40) adding con mode: crc 2023-10-05T11:40:29.308 INFO:tasks.workunit.client.0.smithi012.stderr: -111> 2023-10-05T11:40:29.220+0000 7fc5fab4b880 5 AuthRegistry(0x563259da7c40) adding con mode: secure 2023-10-05T11:40:29.308 INFO:tasks.workunit.client.0.smithi012.stderr: -110> 2023-10-05T11:40:29.220+0000 7fc5fab4b880 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-10-05T11:40:29.308 INFO:tasks.workunit.client.0.smithi012.stderr: -109> 2023-10-05T11:40:29.220+0000 7fc5fab4b880 1 librados: starting msgr at 2023-10-05T11:40:29.308 INFO:tasks.workunit.client.0.smithi012.stderr: -108> 2023-10-05T11:40:29.220+0000 7fc5fab4b880 1 librados: starting objecter 2023-10-05T11:40:29.308 INFO:tasks.workunit.client.0.smithi012.stderr: -107> 2023-10-05T11:40:29.220+0000 7fc5fab4b880 5 asok(0x5632592f6000) register_command objecter_requests cmddesc objecter_requests hook 0x5632590adca0 EEXIST 2023-10-05T11:40:29.308 INFO:tasks.workunit.client.0.smithi012.stderr: -106> 2023-10-05T11:40:29.220+0000 7fc5fab4b880 1 librados: setting wanted keys 2023-10-05T11:40:29.308 INFO:tasks.workunit.client.0.smithi012.stderr: -105> 2023-10-05T11:40:29.220+0000 7fc5fab4b880 1 librados: calling monclient init 2023-10-05T11:40:29.309 INFO:tasks.workunit.client.0.smithi012.stderr: -104> 2023-10-05T11:40:29.220+0000 7fc5fab4b880 10 monclient: init 2023-10-05T11:40:29.309 INFO:tasks.workunit.client.0.smithi012.stderr: -103> 2023-10-05T11:40:29.220+0000 7fc5fab4b880 5 AuthRegistry(0x5632594f60d8) adding auth protocol: cephx 2023-10-05T11:40:29.309 INFO:tasks.workunit.client.0.smithi012.stderr: -102> 2023-10-05T11:40:29.220+0000 7fc5fab4b880 5 AuthRegistry(0x5632594f60d8) adding auth protocol: cephx 2023-10-05T11:40:29.309 INFO:tasks.workunit.client.0.smithi012.stderr: -101> 2023-10-05T11:40:29.220+0000 7fc5fab4b880 5 AuthRegistry(0x5632594f60d8) adding auth protocol: cephx 2023-10-05T11:40:29.309 INFO:tasks.workunit.client.0.smithi012.stderr: -100> 2023-10-05T11:40:29.220+0000 7fc5fab4b880 5 AuthRegistry(0x5632594f60d8) adding con mode: secure 2023-10-05T11:40:29.309 INFO:tasks.workunit.client.0.smithi012.stderr: -99> 2023-10-05T11:40:29.220+0000 7fc5fab4b880 5 AuthRegistry(0x5632594f60d8) adding con mode: crc 2023-10-05T11:40:29.309 INFO:tasks.workunit.client.0.smithi012.stderr: -98> 2023-10-05T11:40:29.220+0000 7fc5fab4b880 5 AuthRegistry(0x5632594f60d8) adding con mode: secure 2023-10-05T11:40:29.309 INFO:tasks.workunit.client.0.smithi012.stderr: -97> 2023-10-05T11:40:29.220+0000 7fc5fab4b880 5 AuthRegistry(0x5632594f60d8) adding con mode: crc 2023-10-05T11:40:29.309 INFO:tasks.workunit.client.0.smithi012.stderr: -96> 2023-10-05T11:40:29.220+0000 7fc5fab4b880 5 AuthRegistry(0x5632594f60d8) adding con mode: secure 2023-10-05T11:40:29.309 INFO:tasks.workunit.client.0.smithi012.stderr: -95> 2023-10-05T11:40:29.220+0000 7fc5fab4b880 5 AuthRegistry(0x5632594f60d8) adding con mode: crc 2023-10-05T11:40:29.309 INFO:tasks.workunit.client.0.smithi012.stderr: -94> 2023-10-05T11:40:29.220+0000 7fc5fab4b880 5 AuthRegistry(0x5632594f60d8) adding con mode: crc 2023-10-05T11:40:29.310 INFO:tasks.workunit.client.0.smithi012.stderr: -93> 2023-10-05T11:40:29.220+0000 7fc5fab4b880 5 AuthRegistry(0x5632594f60d8) adding con mode: secure 2023-10-05T11:40:29.310 INFO:tasks.workunit.client.0.smithi012.stderr: -92> 2023-10-05T11:40:29.220+0000 7fc5fab4b880 5 AuthRegistry(0x5632594f60d8) adding con mode: crc 2023-10-05T11:40:29.310 INFO:tasks.workunit.client.0.smithi012.stderr: -91> 2023-10-05T11:40:29.220+0000 7fc5fab4b880 5 AuthRegistry(0x5632594f60d8) adding con mode: secure 2023-10-05T11:40:29.310 INFO:tasks.workunit.client.0.smithi012.stderr: -90> 2023-10-05T11:40:29.220+0000 7fc5fab4b880 5 AuthRegistry(0x5632594f60d8) adding con mode: crc 2023-10-05T11:40:29.310 INFO:tasks.workunit.client.0.smithi012.stderr: -89> 2023-10-05T11:40:29.220+0000 7fc5fab4b880 5 AuthRegistry(0x5632594f60d8) adding con mode: secure 2023-10-05T11:40:29.310 INFO:tasks.workunit.client.0.smithi012.stderr: -88> 2023-10-05T11:40:29.221+0000 7fc5fab4b880 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-10-05T11:40:29.310 INFO:tasks.workunit.client.0.smithi012.stderr: -87> 2023-10-05T11:40:29.221+0000 7fc5fab4b880 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-10-05T11:40:29.310 INFO:tasks.workunit.client.0.smithi012.stderr: -86> 2023-10-05T11:40:29.221+0000 7fc5fab4b880 5 asok(0x5632592f6000) register_command rotate-key cmddesc rotate-key hook 0x5632594f6220 EEXIST 2023-10-05T11:40:29.310 INFO:tasks.workunit.client.0.smithi012.stderr: -85> 2023-10-05T11:40:29.221+0000 7fc5fab4b880 10 monclient: _reopen_session rank -1 2023-10-05T11:40:29.310 INFO:tasks.workunit.client.0.smithi012.stderr: -84> 2023-10-05T11:40:29.221+0000 7fc5fab4b880 10 monclient: _add_conns ranks=[1,0,2] 2023-10-05T11:40:29.310 INFO:tasks.workunit.client.0.smithi012.stderr: -83> 2023-10-05T11:40:29.221+0000 7fc5fab4b880 10 monclient(hunting): picked mon.noname-b con 0x5632594dcc00 addr [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] 2023-10-05T11:40:29.311 INFO:tasks.workunit.client.0.smithi012.stderr: -82> 2023-10-05T11:40:29.221+0000 7fc5fab4b880 10 monclient(hunting): picked mon.noname-a con 0x5632594dd000 addr [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] 2023-10-05T11:40:29.311 INFO:tasks.workunit.client.0.smithi012.stderr: -81> 2023-10-05T11:40:29.221+0000 7fc5fab4b880 10 monclient(hunting): picked mon.noname-c con 0x5632594dd400 addr [v2:172.21.15.12:3301/0,v1:172.21.15.12:6790/0] 2023-10-05T11:40:29.311 INFO:tasks.workunit.client.0.smithi012.stderr: -80> 2023-10-05T11:40:29.221+0000 7fc5fab4b880 10 monclient(hunting): start opening mon connection 2023-10-05T11:40:29.311 INFO:tasks.workunit.client.0.smithi012.stderr: -79> 2023-10-05T11:40:29.221+0000 7fc5fab4b880 10 monclient(hunting): start opening mon connection 2023-10-05T11:40:29.311 INFO:tasks.workunit.client.0.smithi012.stderr: -78> 2023-10-05T11:40:29.221+0000 7fc5fab4b880 10 monclient(hunting): start opening mon connection 2023-10-05T11:40:29.311 INFO:tasks.workunit.client.0.smithi012.stderr: -77> 2023-10-05T11:40:29.221+0000 7fc5fab4b880 10 monclient(hunting): _renew_subs 2023-10-05T11:40:29.311 INFO:tasks.workunit.client.0.smithi012.stderr: -76> 2023-10-05T11:40:29.221+0000 7fc5fab4b880 10 monclient(hunting): authenticate will time out at 1537.389797s 2023-10-05T11:40:29.311 INFO:tasks.workunit.client.0.smithi012.stderr: -75> 2023-10-05T11:40:29.221+0000 7fc5f8aef640 10 monclient(hunting): get_auth_request con 0x5632594dd400 auth_method 0 2023-10-05T11:40:29.311 INFO:tasks.workunit.client.0.smithi012.stderr: -74> 2023-10-05T11:40:29.221+0000 7fc5f8aef640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-10-05T11:40:29.311 INFO:tasks.workunit.client.0.smithi012.stderr: -73> 2023-10-05T11:40:29.221+0000 7fc5f8aef640 10 monclient(hunting): _init_auth method 2 2023-10-05T11:40:29.311 INFO:tasks.workunit.client.0.smithi012.stderr: -72> 2023-10-05T11:40:29.221+0000 7fc5f8aef640 10 monclient(hunting): _init_auth creating new auth 2023-10-05T11:40:29.312 INFO:tasks.workunit.client.0.smithi012.stderr: -71> 2023-10-05T11:40:29.221+0000 7fc5f92f0640 10 monclient(hunting): get_auth_request con 0x5632594dd000 auth_method 0 2023-10-05T11:40:29.312 INFO:tasks.workunit.client.0.smithi012.stderr: -70> 2023-10-05T11:40:29.221+0000 7fc5f92f0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-10-05T11:40:29.312 INFO:tasks.workunit.client.0.smithi012.stderr: -69> 2023-10-05T11:40:29.221+0000 7fc5f92f0640 10 monclient(hunting): _init_auth method 2 2023-10-05T11:40:29.312 INFO:tasks.workunit.client.0.smithi012.stderr: -68> 2023-10-05T11:40:29.221+0000 7fc5f92f0640 10 monclient(hunting): _init_auth creating new auth 2023-10-05T11:40:29.312 INFO:tasks.workunit.client.0.smithi012.stderr: -67> 2023-10-05T11:40:29.221+0000 7fc5f92f0640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-10-05T11:40:29.312 INFO:tasks.workunit.client.0.smithi012.stderr: -66> 2023-10-05T11:40:29.221+0000 7fc5f92f0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-10-05T11:40:29.312 INFO:tasks.workunit.client.0.smithi012.stderr: -65> 2023-10-05T11:40:29.221+0000 7fc5f92f0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-10-05T11:40:29.312 INFO:tasks.workunit.client.0.smithi012.stderr: -64> 2023-10-05T11:40:29.221+0000 7fc5f8aef640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-10-05T11:40:29.312 INFO:tasks.workunit.client.0.smithi012.stderr: -63> 2023-10-05T11:40:29.221+0000 7fc5f8aef640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-10-05T11:40:29.312 INFO:tasks.workunit.client.0.smithi012.stderr: -62> 2023-10-05T11:40:29.221+0000 7fc5f8aef640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-10-05T11:40:29.312 INFO:tasks.workunit.client.0.smithi012.stderr: -61> 2023-10-05T11:40:29.221+0000 7fc5f8aef640 10 monclient(hunting): handle_auth_done global_id 6515 payload 824 2023-10-05T11:40:29.313 INFO:tasks.workunit.client.0.smithi012.stderr: -60> 2023-10-05T11:40:29.221+0000 7fc5f8aef640 10 monclient: _finish_hunting 0 2023-10-05T11:40:29.313 INFO:tasks.workunit.client.0.smithi012.stderr: -59> 2023-10-05T11:40:29.221+0000 7fc5f8aef640 1 monclient: found mon.noname-c 2023-10-05T11:40:29.313 INFO:tasks.workunit.client.0.smithi012.stderr: -58> 2023-10-05T11:40:29.221+0000 7fc5f8aef640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.12:3301/0 2023-10-05T11:40:29.313 INFO:tasks.workunit.client.0.smithi012.stderr: -57> 2023-10-05T11:40:29.221+0000 7fc5de2ba640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-10-05T11:40:29.313 INFO:tasks.workunit.client.0.smithi012.stderr: -56> 2023-10-05T11:40:29.221+0000 7fc5de2ba640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2023-10-05T11:40:29.313 INFO:tasks.workunit.client.0.smithi012.stderr: -55> 2023-10-05T11:40:29.221+0000 7fc5de2ba640 10 monclient: dump: 2023-10-05T11:40:29.313 INFO:tasks.workunit.client.0.smithi012.stderr:epoch 1 2023-10-05T11:40:29.313 INFO:tasks.workunit.client.0.smithi012.stderr:fsid 7e015f46-293b-4b09-bd32-7d32b52f6e2f 2023-10-05T11:40:29.313 INFO:tasks.workunit.client.0.smithi012.stderr:last_changed 2023-10-05T11:27:38.366888+0000 2023-10-05T11:40:29.313 INFO:tasks.workunit.client.0.smithi012.stderr:created 2023-10-05T11:27:38.366888+0000 2023-10-05T11:40:29.313 INFO:tasks.workunit.client.0.smithi012.stderr:min_mon_release 18 (reef) 2023-10-05T11:40:29.313 INFO:tasks.workunit.client.0.smithi012.stderr:election_strategy: 1 2023-10-05T11:40:29.314 INFO:tasks.workunit.client.0.smithi012.stderr:0: [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon.a 2023-10-05T11:40:29.314 INFO:tasks.workunit.client.0.smithi012.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2023-10-05T11:40:29.314 INFO:tasks.workunit.client.0.smithi012.stderr:2: [v2:172.21.15.12:3301/0,v1:172.21.15.12:6790/0] mon.c 2023-10-05T11:40:29.314 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:40:29.314 INFO:tasks.workunit.client.0.smithi012.stderr: -54> 2023-10-05T11:40:29.221+0000 7fc5de2ba640 10 monclient: _finish_auth 0 2023-10-05T11:40:29.314 INFO:tasks.workunit.client.0.smithi012.stderr: -53> 2023-10-05T11:40:29.221+0000 7fc5de2ba640 10 monclient: _check_auth_tickets 2023-10-05T11:40:29.314 INFO:tasks.workunit.client.0.smithi012.stderr: -52> 2023-10-05T11:40:29.221+0000 7fc5de2ba640 10 monclient: handle_config config(0 keys) v1 2023-10-05T11:40:29.314 INFO:tasks.workunit.client.0.smithi012.stderr: -51> 2023-10-05T11:40:29.221+0000 7fc5fab4b880 5 monclient: authenticate success, global_id 6515 2023-10-05T11:40:29.314 INFO:tasks.workunit.client.0.smithi012.stderr: -50> 2023-10-05T11:40:29.221+0000 7fc5dfabd640 4 set_mon_vals no callback set 2023-10-05T11:40:29.314 INFO:tasks.workunit.client.0.smithi012.stderr: -49> 2023-10-05T11:40:29.221+0000 7fc5fab4b880 10 monclient: _renew_subs 2023-10-05T11:40:29.314 INFO:tasks.workunit.client.0.smithi012.stderr: -48> 2023-10-05T11:40:29.221+0000 7fc5fab4b880 10 monclient: _send_mon_message to mon.c at v2:172.21.15.12:3301/0 2023-10-05T11:40:29.315 INFO:tasks.workunit.client.0.smithi012.stderr: -47> 2023-10-05T11:40:29.222+0000 7fc5de2ba640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-10-05T11:40:29.315 INFO:tasks.workunit.client.0.smithi012.stderr: -46> 2023-10-05T11:40:29.222+0000 7fc5de2ba640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-10-05T11:40:29.315 INFO:tasks.workunit.client.0.smithi012.stderr: -45> 2023-10-05T11:40:29.222+0000 7fc5de2ba640 10 monclient: dump: 2023-10-05T11:40:29.315 INFO:tasks.workunit.client.0.smithi012.stderr:epoch 1 2023-10-05T11:40:29.315 INFO:tasks.workunit.client.0.smithi012.stderr:fsid 7e015f46-293b-4b09-bd32-7d32b52f6e2f 2023-10-05T11:40:29.315 INFO:tasks.workunit.client.0.smithi012.stderr:last_changed 2023-10-05T11:27:38.366888+0000 2023-10-05T11:40:29.315 INFO:tasks.workunit.client.0.smithi012.stderr:created 2023-10-05T11:27:38.366888+0000 2023-10-05T11:40:29.315 INFO:tasks.workunit.client.0.smithi012.stderr:min_mon_release 18 (reef) 2023-10-05T11:40:29.315 INFO:tasks.workunit.client.0.smithi012.stderr:election_strategy: 1 2023-10-05T11:40:29.315 INFO:tasks.workunit.client.0.smithi012.stderr:0: [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon.a 2023-10-05T11:40:29.315 INFO:tasks.workunit.client.0.smithi012.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2023-10-05T11:40:29.316 INFO:tasks.workunit.client.0.smithi012.stderr:2: [v2:172.21.15.12:3301/0,v1:172.21.15.12:6790/0] mon.c 2023-10-05T11:40:29.316 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:40:29.316 INFO:tasks.workunit.client.0.smithi012.stderr: -44> 2023-10-05T11:40:29.222+0000 7fc5fab4b880 10 monclient: _renew_subs 2023-10-05T11:40:29.316 INFO:tasks.workunit.client.0.smithi012.stderr: -43> 2023-10-05T11:40:29.222+0000 7fc5fab4b880 10 monclient: _send_mon_message to mon.c at v2:172.21.15.12:3301/0 2023-10-05T11:40:29.316 INFO:tasks.workunit.client.0.smithi012.stderr: -42> 2023-10-05T11:40:29.222+0000 7fc5fab4b880 1 librados: init done 2023-10-05T11:40:29.316 INFO:tasks.workunit.client.0.smithi012.stderr: -41> 2023-10-05T11:40:29.222+0000 7fc5fab4b880 5 asok(0x5632592f6000) register_command cr dump hook 0x563259eb5408 2023-10-05T11:40:29.316 INFO:tasks.workunit.client.0.smithi012.stderr: -40> 2023-10-05T11:40:29.223+0000 7fc5de2ba640 4 mgrc handle_mgr_map Got map version 5 2023-10-05T11:40:29.316 INFO:tasks.workunit.client.0.smithi012.stderr: -39> 2023-10-05T11:40:29.223+0000 7fc5de2ba640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.170:6832/180516904,v1:172.21.15.170:6833/180516904] 2023-10-05T11:40:29.316 INFO:tasks.workunit.client.0.smithi012.stderr: -38> 2023-10-05T11:40:29.223+0000 7fc5de2ba640 4 mgrc reconnect Starting new session with [v2:172.21.15.170:6832/180516904,v1:172.21.15.170:6833/180516904] 2023-10-05T11:40:29.316 INFO:tasks.workunit.client.0.smithi012.stderr: -37> 2023-10-05T11:40:29.223+0000 7fc5fab4b880 5 note: GC not initialized 2023-10-05T11:40:29.317 INFO:tasks.workunit.client.0.smithi012.stderr: -36> 2023-10-05T11:40:29.223+0000 7fc5f9af1640 10 monclient: get_auth_request con 0x56325952b000 auth_method 0 2023-10-05T11:40:29.317 INFO:tasks.workunit.client.0.smithi012.stderr: -35> 2023-10-05T11:40:29.223+0000 7fc5dbab5640 20 reqs_thread_entry: start 2023-10-05T11:40:29.317 INFO:tasks.workunit.client.0.smithi012.stderr: -34> 2023-10-05T11:40:29.223+0000 7fc5fab4b880 5 asok(0x5632592f6000) register_command sync trace show hook 0x563259040a80 2023-10-05T11:40:29.317 INFO:tasks.workunit.client.0.smithi012.stderr: -33> 2023-10-05T11:40:29.223+0000 7fc5fab4b880 5 asok(0x5632592f6000) register_command sync trace history hook 0x563259040a80 2023-10-05T11:40:29.317 INFO:tasks.workunit.client.0.smithi012.stderr: -32> 2023-10-05T11:40:29.223+0000 7fc5fab4b880 5 asok(0x5632592f6000) register_command sync trace active hook 0x563259040a80 2023-10-05T11:40:29.317 INFO:tasks.workunit.client.0.smithi012.stderr: -31> 2023-10-05T11:40:29.223+0000 7fc5fab4b880 5 asok(0x5632592f6000) register_command sync trace active_short hook 0x563259040a80 2023-10-05T11:40:29.317 INFO:tasks.workunit.client.0.smithi012.stderr: -30> 2023-10-05T11:40:29.223+0000 7fc5fab4b880 20 init_complete bucket index max shards: 11 2023-10-05T11:40:29.317 INFO:tasks.workunit.client.0.smithi012.stderr: -29> 2023-10-05T11:40:29.223+0000 7fc5fab4b880 20 Filter name: none 2023-10-05T11:40:29.317 INFO:tasks.workunit.client.0.smithi012.stderr: -28> 2023-10-05T11:40:29.224+0000 7fc5d9ab1640 20 reqs_thread_entry: start 2023-10-05T11:40:29.317 INFO:tasks.workunit.client.0.smithi012.stderr: -27> 2023-10-05T11:40:29.224+0000 7fc5fab4b880 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2023-10-05T11:40:29.318 INFO:tasks.workunit.client.0.smithi012.stderr: -26> 2023-10-05T11:40:29.224+0000 7fc5fab4b880 20 rados->read ofs=0 len=0 2023-10-05T11:40:29.318 INFO:tasks.workunit.client.0.smithi012.stderr: -25> 2023-10-05T11:40:29.224+0000 7fc5fab4b880 20 rados_obj.operate() r=0 bl.length=213 2023-10-05T11:40:29.318 INFO:tasks.workunit.client.0.smithi012.stderr: -24> 2023-10-05T11:40:29.224+0000 7fc5fab4b880 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2023-10-05T11:40:29.318 INFO:tasks.workunit.client.0.smithi012.stderr: -23> 2023-10-05T11:40:29.224+0000 7fc5fab4b880 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2023-10-05T11:40:29.318 INFO:tasks.workunit.client.0.smithi012.stderr: -22> 2023-10-05T11:40:29.224+0000 7fc5fab4b880 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dff27d1e-df33-400e-a68a-7ba586947c99.4604.22 : miss 2023-10-05T11:40:29.318 INFO:tasks.workunit.client.0.smithi012.stderr: -21> 2023-10-05T11:40:29.224+0000 7fc5fab4b880 20 rados->read ofs=0 len=0 2023-10-05T11:40:29.318 INFO:tasks.workunit.client.0.smithi012.stderr: -20> 2023-10-05T11:40:29.225+0000 7fc5fab4b880 20 rados_obj.operate() r=0 bl.length=385 2023-10-05T11:40:29.318 INFO:tasks.workunit.client.0.smithi012.stderr: -19> 2023-10-05T11:40:29.225+0000 7fc5fab4b880 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dff27d1e-df33-400e-a68a-7ba586947c99.4604.22 info.flags=0x17 2023-10-05T11:40:29.318 INFO:tasks.workunit.client.0.smithi012.stderr: -18> 2023-10-05T11:40:29.225+0000 7fc5fab4b880 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dff27d1e-df33-400e-a68a-7ba586947c99.4604.22 to cache LRU end 2023-10-05T11:40:29.318 INFO:tasks.workunit.client.0.smithi012.stderr: -17> 2023-10-05T11:40:29.225+0000 7fc5fab4b880 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T11:40:29.318 INFO:tasks.workunit.client.0.smithi012.stderr: -16> 2023-10-05T11:40:29.225+0000 7fc5fab4b880 10 updating xattr: name=user.rgw.acl bl.length()=265 2023-10-05T11:40:29.319 INFO:tasks.workunit.client.0.smithi012.stderr: -15> 2023-10-05T11:40:29.225+0000 7fc5fab4b880 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dff27d1e-df33-400e-a68a-7ba586947c99.4604.22 2023-10-05T11:40:29.319 INFO:tasks.workunit.client.0.smithi012.stderr: -14> 2023-10-05T11:40:29.225+0000 7fc5f92f0640 10 monclient: get_auth_request con 0x5632594ddc00 auth_method 0 2023-10-05T11:40:29.319 INFO:tasks.workunit.client.0.smithi012.stderr: -13> 2023-10-05T11:40:29.230+0000 7fc5fab4b880 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dff27d1e-df33-400e-a68a-7ba586947c99.4604.22 info.flags=0x17 2023-10-05T11:40:29.319 INFO:tasks.workunit.client.0.smithi012.stderr: -12> 2023-10-05T11:40:29.230+0000 7fc5fab4b880 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dff27d1e-df33-400e-a68a-7ba586947c99.4604.22 to cache LRU end 2023-10-05T11:40:29.319 INFO:tasks.workunit.client.0.smithi012.stderr: -11> 2023-10-05T11:40:29.230+0000 7fc5fab4b880 10 updating xattr: name=user.rgw.acl bl.length()=265 2023-10-05T11:40:29.319 INFO:tasks.workunit.client.0.smithi012.stderr: -10> 2023-10-05T11:40:29.230+0000 7fc5fab4b880 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:dff27d1e-df33-400e-a68a-7ba586947c99.4604.22, ofs0, ns] 2023-10-05T11:40:29.319 INFO:tasks.workunit.client.0.smithi012.stderr: -9> 2023-10-05T11:40:29.231+0000 7fc5f3ae5640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1060856922165 cookie 94774246504448 notifier 6822 bl.length()=949 2023-10-05T11:40:29.319 INFO:tasks.workunit.client.0.smithi012.stderr: -8> 2023-10-05T11:40:29.231+0000 7fc5f3ae5640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dff27d1e-df33-400e-a68a-7ba586947c99.4604.22 info.flags=0x17 2023-10-05T11:40:29.319 INFO:tasks.workunit.client.0.smithi012.stderr: -7> 2023-10-05T11:40:29.231+0000 7fc5f3ae5640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dff27d1e-df33-400e-a68a-7ba586947c99.4604.22 to cache LRU end 2023-10-05T11:40:29.319 INFO:tasks.workunit.client.0.smithi012.stderr: -6> 2023-10-05T11:40:29.231+0000 7fc5f3ae5640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2023-10-05T11:40:29.320 INFO:tasks.workunit.client.0.smithi012.stderr: -5> 2023-10-05T11:40:29.233+0000 7fc5fab4b880 20 handle_bi_update(): bucket=:abort-at-block-writes[dff27d1e-df33-400e-a68a-7ba586947c99.4604.22]): orig_sources= new_sources= 2023-10-05T11:40:29.320 INFO:tasks.workunit.client.0.smithi012.stderr: -4> 2023-10-05T11:40:29.233+0000 7fc5fab4b880 20 handle_bi_update(): bucket=:abort-at-block-writes[dff27d1e-df33-400e-a68a-7ba586947c99.4604.22]): potential sources added=[] removed=[] 2023-10-05T11:40:29.320 INFO:tasks.workunit.client.0.smithi012.stderr: -3> 2023-10-05T11:40:29.233+0000 7fc5fab4b880 20 handle_bi_update(): bucket=:abort-at-block-writes[dff27d1e-df33-400e-a68a-7ba586947c99.4604.22]): orig_dests= new_dests= 2023-10-05T11:40:29.320 INFO:tasks.workunit.client.0.smithi012.stderr: -2> 2023-10-05T11:40:29.233+0000 7fc5fab4b880 20 handle_bi_update(): bucket=:abort-at-block-writes[dff27d1e-df33-400e-a68a-7ba586947c99.4604.22]): potential dests added=[] removed=[] 2023-10-05T11:40:29.320 INFO:tasks.workunit.client.0.smithi012.stderr: -1> 2023-10-05T11:40:29.233+0000 7fc5fab4b880 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6543-g38321be8/rpm/el9/BUILD/ceph-18.0.0-6543-g38321be8/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fc5fab4b880 time 2023-10-05T11:40:29.234434+0000 2023-10-05T11:40:29.320 INFO:tasks.workunit.client.0.smithi012.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6543-g38321be8/rpm/el9/BUILD/ceph-18.0.0-6543-g38321be8/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2023-10-05T11:40:29.320 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:40:29.320 INFO:tasks.workunit.client.0.smithi012.stderr: ceph version 18.0.0-6543-g38321be8 (38321be854743c0d616618a9ea8aa0b1d4dbc0bf) reef (dev) 2023-10-05T11:40:29.320 INFO:tasks.workunit.client.0.smithi012.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fc5ff76d15f] 2023-10-05T11:40:29.320 INFO:tasks.workunit.client.0.smithi012.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16d31d) [0x7fc5ff76d31d] 2023-10-05T11:40:29.320 INFO:tasks.workunit.client.0.smithi012.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56325759ac31] 2023-10-05T11:40:29.321 INFO:tasks.workunit.client.0.smithi012.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x2a4) [0x5632575b1734] 2023-10-05T11:40:29.321 INFO:tasks.workunit.client.0.smithi012.stderr: 5: main() 2023-10-05T11:40:29.321 INFO:tasks.workunit.client.0.smithi012.stderr: 6: /lib64/libc.so.6(+0x3feb0) [0x7fc5fcc3feb0] 2023-10-05T11:40:29.321 INFO:tasks.workunit.client.0.smithi012.stderr: 7: __libc_start_main() 2023-10-05T11:40:29.321 INFO:tasks.workunit.client.0.smithi012.stderr: 8: _start() 2023-10-05T11:40:29.321 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:40:29.321 INFO:tasks.workunit.client.0.smithi012.stderr: 0> 2023-10-05T11:40:29.234+0000 7fc5fab4b880 -1 *** Caught signal (Aborted) ** 2023-10-05T11:40:29.321 INFO:tasks.workunit.client.0.smithi012.stderr: in thread 7fc5fab4b880 thread_name:radosgw-admin 2023-10-05T11:40:29.321 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:40:29.321 INFO:tasks.workunit.client.0.smithi012.stderr: ceph version 18.0.0-6543-g38321be8 (38321be854743c0d616618a9ea8aa0b1d4dbc0bf) reef (dev) 2023-10-05T11:40:29.321 INFO:tasks.workunit.client.0.smithi012.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7fc5fcc54db0] 2023-10-05T11:40:29.322 INFO:tasks.workunit.client.0.smithi012.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7fc5fcca154c] 2023-10-05T11:40:29.322 INFO:tasks.workunit.client.0.smithi012.stderr: 3: raise() 2023-10-05T11:40:29.322 INFO:tasks.workunit.client.0.smithi012.stderr: 4: abort() 2023-10-05T11:40:29.322 INFO:tasks.workunit.client.0.smithi012.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fc5ff76d1b9] 2023-10-05T11:40:29.322 INFO:tasks.workunit.client.0.smithi012.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16d31d) [0x7fc5ff76d31d] 2023-10-05T11:40:29.322 INFO:tasks.workunit.client.0.smithi012.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56325759ac31] 2023-10-05T11:40:29.322 INFO:tasks.workunit.client.0.smithi012.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x2a4) [0x5632575b1734] 2023-10-05T11:40:29.322 INFO:tasks.workunit.client.0.smithi012.stderr: 9: main() 2023-10-05T11:40:29.322 INFO:tasks.workunit.client.0.smithi012.stderr: 10: /lib64/libc.so.6(+0x3feb0) [0x7fc5fcc3feb0] 2023-10-05T11:40:29.322 INFO:tasks.workunit.client.0.smithi012.stderr: 11: __libc_start_main() 2023-10-05T11:40:29.322 INFO:tasks.workunit.client.0.smithi012.stderr: 12: _start() 2023-10-05T11:40:29.323 INFO:tasks.workunit.client.0.smithi012.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-10-05T11:40:29.323 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:40:29.323 INFO:tasks.workunit.client.0.smithi012.stderr:--- logging levels --- 2023-10-05T11:40:29.323 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 none 2023-10-05T11:40:29.323 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 1 lockdep 2023-10-05T11:40:29.323 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 1 context 2023-10-05T11:40:29.323 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 1 crush 2023-10-05T11:40:29.323 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 mds 2023-10-05T11:40:29.323 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 mds_balancer 2023-10-05T11:40:29.323 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 mds_locker 2023-10-05T11:40:29.323 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 mds_log 2023-10-05T11:40:29.324 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 mds_log_expire 2023-10-05T11:40:29.324 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 mds_migrator 2023-10-05T11:40:29.324 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 1 buffer 2023-10-05T11:40:29.324 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 1 timer 2023-10-05T11:40:29.324 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 1 filer 2023-10-05T11:40:29.324 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 1 striper 2023-10-05T11:40:29.324 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 1 objecter 2023-10-05T11:40:29.324 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 rados 2023-10-05T11:40:29.324 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 rbd 2023-10-05T11:40:29.324 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 rbd_mirror 2023-10-05T11:40:29.324 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 rbd_replay 2023-10-05T11:40:29.325 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 rbd_pwl 2023-10-05T11:40:29.325 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 journaler 2023-10-05T11:40:29.325 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 objectcacher 2023-10-05T11:40:29.325 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 immutable_obj_cache 2023-10-05T11:40:29.325 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 client 2023-10-05T11:40:29.325 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 osd 2023-10-05T11:40:29.325 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 optracker 2023-10-05T11:40:29.325 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 objclass 2023-10-05T11:40:29.325 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 3 filestore 2023-10-05T11:40:29.325 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 3 journal 2023-10-05T11:40:29.325 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 0 ms 2023-10-05T11:40:29.325 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 mon 2023-10-05T11:40:29.326 INFO:tasks.workunit.client.0.smithi012.stderr: 0/10 monc 2023-10-05T11:40:29.326 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 paxos 2023-10-05T11:40:29.326 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 tp 2023-10-05T11:40:29.326 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 auth 2023-10-05T11:40:29.326 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 crypto 2023-10-05T11:40:29.326 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 1 finisher 2023-10-05T11:40:29.326 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 1 reserver 2023-10-05T11:40:29.326 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 heartbeatmap 2023-10-05T11:40:29.326 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 perfcounter 2023-10-05T11:40:29.326 INFO:tasks.workunit.client.0.smithi012.stderr: 20/20 rgw 2023-10-05T11:40:29.326 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 rgw_sync 2023-10-05T11:40:29.327 INFO:tasks.workunit.client.0.smithi012.stderr: 30/30 rgw_datacache 2023-10-05T11:40:29.327 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 rgw_access 2023-10-05T11:40:29.327 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 rgw_dbstore 2023-10-05T11:40:29.327 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 rgw_flight 2023-10-05T11:40:29.327 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 javaclient 2023-10-05T11:40:29.327 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 asok 2023-10-05T11:40:29.327 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 1 throttle 2023-10-05T11:40:29.327 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 0 refs 2023-10-05T11:40:29.327 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 compressor 2023-10-05T11:40:29.327 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 bluestore 2023-10-05T11:40:29.327 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 bluefs 2023-10-05T11:40:29.328 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 3 bdev 2023-10-05T11:40:29.328 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 kstore 2023-10-05T11:40:29.328 INFO:tasks.workunit.client.0.smithi012.stderr: 4/ 5 rocksdb 2023-10-05T11:40:29.328 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 fuse 2023-10-05T11:40:29.328 INFO:tasks.workunit.client.0.smithi012.stderr: 2/ 5 mgr 2023-10-05T11:40:29.328 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 mgrc 2023-10-05T11:40:29.328 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 dpdk 2023-10-05T11:40:29.328 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 eventtrace 2023-10-05T11:40:29.328 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 prioritycache 2023-10-05T11:40:29.328 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 test 2023-10-05T11:40:29.328 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 cephfs_mirror 2023-10-05T11:40:29.329 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 cephsqlite 2023-10-05T11:40:29.329 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 seastore 2023-10-05T11:40:29.329 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 seastore_onode 2023-10-05T11:40:29.329 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 seastore_odata 2023-10-05T11:40:29.329 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 seastore_omap 2023-10-05T11:40:29.329 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 seastore_tm 2023-10-05T11:40:29.329 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 seastore_t 2023-10-05T11:40:29.329 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 seastore_cleaner 2023-10-05T11:40:29.329 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 seastore_epm 2023-10-05T11:40:29.329 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 seastore_lba 2023-10-05T11:40:29.329 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 seastore_fixedkv_tree 2023-10-05T11:40:29.330 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 seastore_cache 2023-10-05T11:40:29.330 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 seastore_journal 2023-10-05T11:40:29.330 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 seastore_device 2023-10-05T11:40:29.330 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 seastore_backref 2023-10-05T11:40:29.330 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 alienstore 2023-10-05T11:40:29.330 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 mclock 2023-10-05T11:40:29.330 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 cyanstore 2023-10-05T11:40:29.330 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 ceph_exporter 2023-10-05T11:40:29.330 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 memstore 2023-10-05T11:40:29.330 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 trace 2023-10-05T11:40:29.330 INFO:tasks.workunit.client.0.smithi012.stderr: -2/-2 (syslog threshold) 2023-10-05T11:40:29.330 INFO:tasks.workunit.client.0.smithi012.stderr: 99/99 (stderr threshold) 2023-10-05T11:40:29.331 INFO:tasks.workunit.client.0.smithi012.stderr:--- pthread ID / name mapping for recent threads --- 2023-10-05T11:40:29.331 INFO:tasks.workunit.client.0.smithi012.stderr: 7fc5d9ab1640 / http_manager 2023-10-05T11:40:29.331 INFO:tasks.workunit.client.0.smithi012.stderr: 7fc5dbab5640 / http_manager 2023-10-05T11:40:29.331 INFO:tasks.workunit.client.0.smithi012.stderr: 7fc5de2ba640 / ms_dispatch 2023-10-05T11:40:29.331 INFO:tasks.workunit.client.0.smithi012.stderr: 7fc5dfabd640 / io_context_pool 2023-10-05T11:40:29.331 INFO:tasks.workunit.client.0.smithi012.stderr: 7fc5e02be640 / rgw_dt_lg_renew 2023-10-05T11:40:29.331 INFO:tasks.workunit.client.0.smithi012.stderr: 7fc5f22e2640 / ms_dispatch 2023-10-05T11:40:29.331 INFO:tasks.workunit.client.0.smithi012.stderr: 7fc5f3ae5640 / io_context_pool 2023-10-05T11:40:29.331 INFO:tasks.workunit.client.0.smithi012.stderr: 7fc5f62ea640 / ms_dispatch 2023-10-05T11:40:29.331 INFO:tasks.workunit.client.0.smithi012.stderr: 7fc5f7aed640 / io_context_pool 2023-10-05T11:40:29.331 INFO:tasks.workunit.client.0.smithi012.stderr: 7fc5f8aef640 / msgr-worker-2 2023-10-05T11:40:29.332 INFO:tasks.workunit.client.0.smithi012.stderr: 7fc5f92f0640 / msgr-worker-1 2023-10-05T11:40:29.332 INFO:tasks.workunit.client.0.smithi012.stderr: 7fc5f9af1640 / msgr-worker-0 2023-10-05T11:40:29.332 INFO:tasks.workunit.client.0.smithi012.stderr: 7fc5fab4b880 / radosgw-admin 2023-10-05T11:40:29.332 INFO:tasks.workunit.client.0.smithi012.stderr: max_recent 500 2023-10-05T11:40:29.332 INFO:tasks.workunit.client.0.smithi012.stderr: max_new 1000 2023-10-05T11:40:29.332 INFO:tasks.workunit.client.0.smithi012.stderr: log_file /var/log/ceph/ceph-client.admin.102493.log 2023-10-05T11:40:29.332 INFO:tasks.workunit.client.0.smithi012.stderr:--- end dump of recent events --- 2023-10-05T11:40:29.332 INFO:tasks.workunit.client.0.smithi012.stderr:--- begin dump of recent events --- 2023-10-05T11:40:29.332 INFO:tasks.workunit.client.0.smithi012.stderr: -499> 2023-10-05T11:40:29.186+0000 7fc5f62ea640 10 monclient: _finish_auth 0 2023-10-05T11:40:29.332 INFO:tasks.workunit.client.0.smithi012.stderr: -498> 2023-10-05T11:40:29.186+0000 7fc5f62ea640 10 monclient: _check_auth_tickets 2023-10-05T11:40:29.332 INFO:tasks.workunit.client.0.smithi012.stderr: -497> 2023-10-05T11:40:29.186+0000 7fc5fab4b880 5 monclient: authenticate success, global_id 6503 2023-10-05T11:40:29.333 INFO:tasks.workunit.client.0.smithi012.stderr: -496> 2023-10-05T11:40:29.186+0000 7fc5f62ea640 10 monclient: handle_config config(0 keys) v1 2023-10-05T11:40:29.333 INFO:tasks.workunit.client.0.smithi012.stderr: -495> 2023-10-05T11:40:29.186+0000 7fc5f62ea640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-10-05T11:40:29.333 INFO:tasks.workunit.client.0.smithi012.stderr: -494> 2023-10-05T11:40:29.186+0000 7fc5f62ea640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-10-05T11:40:29.333 INFO:tasks.workunit.client.0.smithi012.stderr: -493> 2023-10-05T11:40:29.186+0000 7fc5f62ea640 10 monclient: dump: 2023-10-05T11:40:29.333 INFO:tasks.workunit.client.0.smithi012.stderr:epoch 1 2023-10-05T11:40:29.333 INFO:tasks.workunit.client.0.smithi012.stderr:fsid 7e015f46-293b-4b09-bd32-7d32b52f6e2f 2023-10-05T11:40:29.333 INFO:tasks.workunit.client.0.smithi012.stderr:last_changed 2023-10-05T11:27:38.366888+0000 2023-10-05T11:40:29.333 INFO:tasks.workunit.client.0.smithi012.stderr:created 2023-10-05T11:27:38.366888+0000 2023-10-05T11:40:29.333 INFO:tasks.workunit.client.0.smithi012.stderr:min_mon_release 18 (reef) 2023-10-05T11:40:29.333 INFO:tasks.workunit.client.0.smithi012.stderr:election_strategy: 1 2023-10-05T11:40:29.333 INFO:tasks.workunit.client.0.smithi012.stderr:0: [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon.a 2023-10-05T11:40:29.333 INFO:tasks.workunit.client.0.smithi012.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2023-10-05T11:40:29.334 INFO:tasks.workunit.client.0.smithi012.stderr:2: [v2:172.21.15.12:3301/0,v1:172.21.15.12:6790/0] mon.c 2023-10-05T11:40:29.334 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:40:29.334 INFO:tasks.workunit.client.0.smithi012.stderr: -492> 2023-10-05T11:40:29.186+0000 7fc5f7aed640 4 set_mon_vals no callback set 2023-10-05T11:40:29.334 INFO:tasks.workunit.client.0.smithi012.stderr: -491> 2023-10-05T11:40:29.186+0000 7fc5fab4b880 10 monclient: _renew_subs 2023-10-05T11:40:29.334 INFO:tasks.workunit.client.0.smithi012.stderr: -490> 2023-10-05T11:40:29.186+0000 7fc5fab4b880 10 monclient: _send_mon_message to mon.c at v2:172.21.15.12:3301/0 2023-10-05T11:40:29.334 INFO:tasks.workunit.client.0.smithi012.stderr: -489> 2023-10-05T11:40:29.186+0000 7fc5fab4b880 10 monclient: _renew_subs 2023-10-05T11:40:29.334 INFO:tasks.workunit.client.0.smithi012.stderr: -488> 2023-10-05T11:40:29.186+0000 7fc5fab4b880 10 monclient: _send_mon_message to mon.c at v2:172.21.15.12:3301/0 2023-10-05T11:40:29.334 INFO:tasks.workunit.client.0.smithi012.stderr: -487> 2023-10-05T11:40:29.186+0000 7fc5fab4b880 1 librados: init done 2023-10-05T11:40:29.334 INFO:tasks.workunit.client.0.smithi012.stderr: -486> 2023-10-05T11:40:29.186+0000 7fc5fab4b880 10 monclient: get_monmap_and_config 2023-10-05T11:40:29.334 INFO:tasks.workunit.client.0.smithi012.stderr: -485> 2023-10-05T11:40:29.186+0000 7fc5fab4b880 10 monclient: build_initial_monmap 2023-10-05T11:40:29.335 INFO:tasks.workunit.client.0.smithi012.stderr: -484> 2023-10-05T11:40:29.186+0000 7fc5fab4b880 1 build_initial for_mkfs: 0 2023-10-05T11:40:29.335 INFO:tasks.workunit.client.0.smithi012.stderr: -483> 2023-10-05T11:40:29.186+0000 7fc5fab4b880 10 monclient: monmap: 2023-10-05T11:40:29.335 INFO:tasks.workunit.client.0.smithi012.stderr:epoch 0 2023-10-05T11:40:29.335 INFO:tasks.workunit.client.0.smithi012.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-10-05T11:40:29.335 INFO:tasks.workunit.client.0.smithi012.stderr:last_changed 0.000000 2023-10-05T11:40:29.335 INFO:tasks.workunit.client.0.smithi012.stderr:created 0.000000 2023-10-05T11:40:29.335 INFO:tasks.workunit.client.0.smithi012.stderr:min_mon_release 0 (unknown) 2023-10-05T11:40:29.335 INFO:tasks.workunit.client.0.smithi012.stderr:election_strategy: 1 2023-10-05T11:40:29.335 INFO:tasks.workunit.client.0.smithi012.stderr:0: [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon.noname-a 2023-10-05T11:40:29.335 INFO:tasks.workunit.client.0.smithi012.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.noname-b 2023-10-05T11:40:29.335 INFO:tasks.workunit.client.0.smithi012.stderr:2: [v2:172.21.15.12:3301/0,v1:172.21.15.12:6790/0] mon.noname-c 2023-10-05T11:40:29.336 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:40:29.336 INFO:tasks.workunit.client.0.smithi012.stderr: -482> 2023-10-05T11:40:29.186+0000 7fc5fab4b880 5 AuthRegistry(0x563259da7340) adding auth protocol: cephx 2023-10-05T11:40:29.336 INFO:tasks.workunit.client.0.smithi012.stderr: -481> 2023-10-05T11:40:29.186+0000 7fc5fab4b880 5 AuthRegistry(0x563259da7340) adding auth protocol: cephx 2023-10-05T11:40:29.336 INFO:tasks.workunit.client.0.smithi012.stderr: -480> 2023-10-05T11:40:29.186+0000 7fc5fab4b880 5 AuthRegistry(0x563259da7340) adding auth protocol: cephx 2023-10-05T11:40:29.336 INFO:tasks.workunit.client.0.smithi012.stderr: -479> 2023-10-05T11:40:29.186+0000 7fc5fab4b880 5 AuthRegistry(0x563259da7340) adding con mode: secure 2023-10-05T11:40:29.336 INFO:tasks.workunit.client.0.smithi012.stderr: -478> 2023-10-05T11:40:29.186+0000 7fc5fab4b880 5 AuthRegistry(0x563259da7340) adding con mode: crc 2023-10-05T11:40:29.336 INFO:tasks.workunit.client.0.smithi012.stderr: -477> 2023-10-05T11:40:29.186+0000 7fc5fab4b880 5 AuthRegistry(0x563259da7340) adding con mode: secure 2023-10-05T11:40:29.336 INFO:tasks.workunit.client.0.smithi012.stderr: -476> 2023-10-05T11:40:29.186+0000 7fc5fab4b880 5 AuthRegistry(0x563259da7340) adding con mode: crc 2023-10-05T11:40:29.336 INFO:tasks.workunit.client.0.smithi012.stderr: -475> 2023-10-05T11:40:29.186+0000 7fc5fab4b880 5 AuthRegistry(0x563259da7340) adding con mode: secure 2023-10-05T11:40:29.336 INFO:tasks.workunit.client.0.smithi012.stderr: -474> 2023-10-05T11:40:29.186+0000 7fc5fab4b880 5 AuthRegistry(0x563259da7340) adding con mode: crc 2023-10-05T11:40:29.336 INFO:tasks.workunit.client.0.smithi012.stderr: -473> 2023-10-05T11:40:29.186+0000 7fc5fab4b880 5 AuthRegistry(0x563259da7340) adding con mode: crc 2023-10-05T11:40:29.336 INFO:tasks.workunit.client.0.smithi012.stderr: -472> 2023-10-05T11:40:29.186+0000 7fc5fab4b880 5 AuthRegistry(0x563259da7340) adding con mode: secure 2023-10-05T11:40:29.337 INFO:tasks.workunit.client.0.smithi012.stderr: -471> 2023-10-05T11:40:29.186+0000 7fc5fab4b880 5 AuthRegistry(0x563259da7340) adding con mode: crc 2023-10-05T11:40:29.337 INFO:tasks.workunit.client.0.smithi012.stderr: -470> 2023-10-05T11:40:29.186+0000 7fc5fab4b880 5 AuthRegistry(0x563259da7340) adding con mode: secure 2023-10-05T11:40:29.337 INFO:tasks.workunit.client.0.smithi012.stderr: -469> 2023-10-05T11:40:29.186+0000 7fc5fab4b880 5 AuthRegistry(0x563259da7340) adding con mode: crc 2023-10-05T11:40:29.337 INFO:tasks.workunit.client.0.smithi012.stderr: -468> 2023-10-05T11:40:29.186+0000 7fc5fab4b880 5 AuthRegistry(0x563259da7340) adding con mode: secure 2023-10-05T11:40:29.337 INFO:tasks.workunit.client.0.smithi012.stderr: -467> 2023-10-05T11:40:29.186+0000 7fc5fab4b880 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-10-05T11:40:29.337 INFO:tasks.workunit.client.0.smithi012.stderr: -466> 2023-10-05T11:40:29.187+0000 7fc5fab4b880 10 monclient: init 2023-10-05T11:40:29.337 INFO:tasks.workunit.client.0.smithi012.stderr: -465> 2023-10-05T11:40:29.187+0000 7fc5fab4b880 5 AuthRegistry(0x7fff2cd5ddc0) adding auth protocol: cephx 2023-10-05T11:40:29.337 INFO:tasks.workunit.client.0.smithi012.stderr: -464> 2023-10-05T11:40:29.187+0000 7fc5fab4b880 5 AuthRegistry(0x7fff2cd5ddc0) adding auth protocol: cephx 2023-10-05T11:40:29.337 INFO:tasks.workunit.client.0.smithi012.stderr: -463> 2023-10-05T11:40:29.187+0000 7fc5fab4b880 5 AuthRegistry(0x7fff2cd5ddc0) adding auth protocol: cephx 2023-10-05T11:40:29.337 INFO:tasks.workunit.client.0.smithi012.stderr: -462> 2023-10-05T11:40:29.187+0000 7fc5fab4b880 5 AuthRegistry(0x7fff2cd5ddc0) adding con mode: secure 2023-10-05T11:40:29.337 INFO:tasks.workunit.client.0.smithi012.stderr: -461> 2023-10-05T11:40:29.187+0000 7fc5fab4b880 5 AuthRegistry(0x7fff2cd5ddc0) adding con mode: crc 2023-10-05T11:40:29.338 INFO:tasks.workunit.client.0.smithi012.stderr: -460> 2023-10-05T11:40:29.187+0000 7fc5fab4b880 5 AuthRegistry(0x7fff2cd5ddc0) adding con mode: secure 2023-10-05T11:40:29.338 INFO:tasks.workunit.client.0.smithi012.stderr: -459> 2023-10-05T11:40:29.187+0000 7fc5fab4b880 5 AuthRegistry(0x7fff2cd5ddc0) adding con mode: crc 2023-10-05T11:40:29.338 INFO:tasks.workunit.client.0.smithi012.stderr: -458> 2023-10-05T11:40:29.187+0000 7fc5fab4b880 5 AuthRegistry(0x7fff2cd5ddc0) adding con mode: secure 2023-10-05T11:40:29.338 INFO:tasks.workunit.client.0.smithi012.stderr: -457> 2023-10-05T11:40:29.187+0000 7fc5fab4b880 5 AuthRegistry(0x7fff2cd5ddc0) adding con mode: crc 2023-10-05T11:40:29.338 INFO:tasks.workunit.client.0.smithi012.stderr: -456> 2023-10-05T11:40:29.187+0000 7fc5fab4b880 5 AuthRegistry(0x7fff2cd5ddc0) adding con mode: crc 2023-10-05T11:40:29.338 INFO:tasks.workunit.client.0.smithi012.stderr: -455> 2023-10-05T11:40:29.187+0000 7fc5fab4b880 5 AuthRegistry(0x7fff2cd5ddc0) adding con mode: secure 2023-10-05T11:40:29.338 INFO:tasks.workunit.client.0.smithi012.stderr: -454> 2023-10-05T11:40:29.187+0000 7fc5fab4b880 5 AuthRegistry(0x7fff2cd5ddc0) adding con mode: crc 2023-10-05T11:40:29.338 INFO:tasks.workunit.client.0.smithi012.stderr: -453> 2023-10-05T11:40:29.187+0000 7fc5fab4b880 5 AuthRegistry(0x7fff2cd5ddc0) adding con mode: secure 2023-10-05T11:40:29.338 INFO:tasks.workunit.client.0.smithi012.stderr: -452> 2023-10-05T11:40:29.187+0000 7fc5fab4b880 5 AuthRegistry(0x7fff2cd5ddc0) adding con mode: crc 2023-10-05T11:40:29.338 INFO:tasks.workunit.client.0.smithi012.stderr: -451> 2023-10-05T11:40:29.187+0000 7fc5fab4b880 5 AuthRegistry(0x7fff2cd5ddc0) adding con mode: secure 2023-10-05T11:40:29.338 INFO:tasks.workunit.client.0.smithi012.stderr: -450> 2023-10-05T11:40:29.187+0000 7fc5fab4b880 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-10-05T11:40:29.338 INFO:tasks.workunit.client.0.smithi012.stderr: -449> 2023-10-05T11:40:29.187+0000 7fc5fab4b880 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-10-05T11:40:29.339 INFO:tasks.workunit.client.0.smithi012.stderr: -448> 2023-10-05T11:40:29.187+0000 7fc5fab4b880 5 asok(0x5632592f6000) register_command rotate-key cmddesc rotate-key hook 0x7fff2cd5df08 EEXIST 2023-10-05T11:40:29.339 INFO:tasks.workunit.client.0.smithi012.stderr: -447> 2023-10-05T11:40:29.187+0000 7fc5fab4b880 10 monclient: _reopen_session rank -1 2023-10-05T11:40:29.339 INFO:tasks.workunit.client.0.smithi012.stderr: -446> 2023-10-05T11:40:29.187+0000 7fc5fab4b880 10 monclient: _add_conns ranks=[0,1,2] 2023-10-05T11:40:29.339 INFO:tasks.workunit.client.0.smithi012.stderr: -445> 2023-10-05T11:40:29.187+0000 7fc5fab4b880 10 monclient(hunting): picked mon.noname-a con 0x563259eeec00 addr [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] 2023-10-05T11:40:29.339 INFO:tasks.workunit.client.0.smithi012.stderr: -444> 2023-10-05T11:40:29.187+0000 7fc5fab4b880 10 monclient(hunting): picked mon.noname-b con 0x563259eef000 addr [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] 2023-10-05T11:40:29.339 INFO:tasks.workunit.client.0.smithi012.stderr: -443> 2023-10-05T11:40:29.187+0000 7fc5fab4b880 10 monclient(hunting): picked mon.noname-c con 0x563259eef400 addr [v2:172.21.15.12:3301/0,v1:172.21.15.12:6790/0] 2023-10-05T11:40:29.339 INFO:tasks.workunit.client.0.smithi012.stderr: -442> 2023-10-05T11:40:29.187+0000 7fc5fab4b880 10 monclient(hunting): start opening mon connection 2023-10-05T11:40:29.339 INFO:tasks.workunit.client.0.smithi012.stderr: -441> 2023-10-05T11:40:29.187+0000 7fc5fab4b880 10 monclient(hunting): start opening mon connection 2023-10-05T11:40:29.339 INFO:tasks.workunit.client.0.smithi012.stderr: -440> 2023-10-05T11:40:29.187+0000 7fc5fab4b880 10 monclient(hunting): start opening mon connection 2023-10-05T11:40:29.339 INFO:tasks.workunit.client.0.smithi012.stderr: -439> 2023-10-05T11:40:29.187+0000 7fc5fab4b880 10 monclient(hunting): _renew_subs 2023-10-05T11:40:29.339 INFO:tasks.workunit.client.0.smithi012.stderr: -438> 2023-10-05T11:40:29.187+0000 7fc5fab4b880 10 monclient(hunting): authenticate will time out at 1537.355928s 2023-10-05T11:40:29.340 INFO:tasks.workunit.client.0.smithi012.stderr: -437> 2023-10-05T11:40:29.187+0000 7fc5f9af1640 10 monclient(hunting): get_auth_request con 0x563259eeec00 auth_method 0 2023-10-05T11:40:29.340 INFO:tasks.workunit.client.0.smithi012.stderr: -436> 2023-10-05T11:40:29.187+0000 7fc5f9af1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-10-05T11:40:29.340 INFO:tasks.workunit.client.0.smithi012.stderr: -435> 2023-10-05T11:40:29.187+0000 7fc5f9af1640 10 monclient(hunting): _init_auth method 2 2023-10-05T11:40:29.340 INFO:tasks.workunit.client.0.smithi012.stderr: -434> 2023-10-05T11:40:29.187+0000 7fc5f9af1640 10 monclient(hunting): _init_auth creating new auth 2023-10-05T11:40:29.340 INFO:tasks.workunit.client.0.smithi012.stderr: -433> 2023-10-05T11:40:29.187+0000 7fc5f8aef640 10 monclient(hunting): get_auth_request con 0x563259eef400 auth_method 0 2023-10-05T11:40:29.340 INFO:tasks.workunit.client.0.smithi012.stderr: -432> 2023-10-05T11:40:29.187+0000 7fc5f8aef640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-10-05T11:40:29.340 INFO:tasks.workunit.client.0.smithi012.stderr: -431> 2023-10-05T11:40:29.187+0000 7fc5f8aef640 10 monclient(hunting): _init_auth method 2 2023-10-05T11:40:29.340 INFO:tasks.workunit.client.0.smithi012.stderr: -430> 2023-10-05T11:40:29.187+0000 7fc5f8aef640 10 monclient(hunting): _init_auth creating new auth 2023-10-05T11:40:29.340 INFO:tasks.workunit.client.0.smithi012.stderr: -429> 2023-10-05T11:40:29.187+0000 7fc5f92f0640 10 monclient(hunting): get_auth_request con 0x563259eef000 auth_method 0 2023-10-05T11:40:29.340 INFO:tasks.workunit.client.0.smithi012.stderr: -428> 2023-10-05T11:40:29.187+0000 7fc5f92f0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-10-05T11:40:29.340 INFO:tasks.workunit.client.0.smithi012.stderr: -427> 2023-10-05T11:40:29.187+0000 7fc5f92f0640 10 monclient(hunting): _init_auth method 2 2023-10-05T11:40:29.340 INFO:tasks.workunit.client.0.smithi012.stderr: -426> 2023-10-05T11:40:29.187+0000 7fc5f92f0640 10 monclient(hunting): _init_auth creating new auth 2023-10-05T11:40:29.341 INFO:tasks.workunit.client.0.smithi012.stderr: -425> 2023-10-05T11:40:29.187+0000 7fc5f8aef640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-10-05T11:40:29.341 INFO:tasks.workunit.client.0.smithi012.stderr: -424> 2023-10-05T11:40:29.187+0000 7fc5f8aef640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-10-05T11:40:29.341 INFO:tasks.workunit.client.0.smithi012.stderr: -423> 2023-10-05T11:40:29.187+0000 7fc5f8aef640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-10-05T11:40:29.341 INFO:tasks.workunit.client.0.smithi012.stderr: -422> 2023-10-05T11:40:29.187+0000 7fc5f9af1640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-10-05T11:40:29.341 INFO:tasks.workunit.client.0.smithi012.stderr: -421> 2023-10-05T11:40:29.187+0000 7fc5f9af1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-10-05T11:40:29.341 INFO:tasks.workunit.client.0.smithi012.stderr: -420> 2023-10-05T11:40:29.187+0000 7fc5f9af1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-10-05T11:40:29.341 INFO:tasks.workunit.client.0.smithi012.stderr: -419> 2023-10-05T11:40:29.187+0000 7fc5f92f0640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-10-05T11:40:29.341 INFO:tasks.workunit.client.0.smithi012.stderr: -418> 2023-10-05T11:40:29.187+0000 7fc5f92f0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-10-05T11:40:29.341 INFO:tasks.workunit.client.0.smithi012.stderr: -417> 2023-10-05T11:40:29.187+0000 7fc5f92f0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-10-05T11:40:29.341 INFO:tasks.workunit.client.0.smithi012.stderr: -416> 2023-10-05T11:40:29.187+0000 7fc5f62ea640 4 mgrc handle_mgr_map Got map version 5 2023-10-05T11:40:29.341 INFO:tasks.workunit.client.0.smithi012.stderr: -415> 2023-10-05T11:40:29.187+0000 7fc5f62ea640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.170:6832/180516904,v1:172.21.15.170:6833/180516904] 2023-10-05T11:40:29.341 INFO:tasks.workunit.client.0.smithi012.stderr: -414> 2023-10-05T11:40:29.187+0000 7fc5f62ea640 4 mgrc reconnect Starting new session with [v2:172.21.15.170:6832/180516904,v1:172.21.15.170:6833/180516904] 2023-10-05T11:40:29.342 INFO:tasks.workunit.client.0.smithi012.stderr: -413> 2023-10-05T11:40:29.187+0000 7fc5f8aef640 10 monclient(hunting): handle_auth_done global_id 6506 payload 274 2023-10-05T11:40:29.342 INFO:tasks.workunit.client.0.smithi012.stderr: -412> 2023-10-05T11:40:29.187+0000 7fc5f8aef640 10 monclient: _finish_hunting 0 2023-10-05T11:40:29.342 INFO:tasks.workunit.client.0.smithi012.stderr: -411> 2023-10-05T11:40:29.187+0000 7fc5f8aef640 1 monclient: found mon.noname-c 2023-10-05T11:40:29.342 INFO:tasks.workunit.client.0.smithi012.stderr: -410> 2023-10-05T11:40:29.187+0000 7fc5f8aef640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.12:3301/0 2023-10-05T11:40:29.342 INFO:tasks.workunit.client.0.smithi012.stderr: -409> 2023-10-05T11:40:29.188+0000 7fc5f9af1640 10 monclient: get_auth_request con 0x5632593be000 auth_method 0 2023-10-05T11:40:29.342 INFO:tasks.workunit.client.0.smithi012.stderr: -408> 2023-10-05T11:40:29.188+0000 7fc5f3ae5640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-10-05T11:40:29.342 INFO:tasks.workunit.client.0.smithi012.stderr: -407> 2023-10-05T11:40:29.188+0000 7fc5f3ae5640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2023-10-05T11:40:29.342 INFO:tasks.workunit.client.0.smithi012.stderr: -406> 2023-10-05T11:40:29.188+0000 7fc5f3ae5640 10 monclient: dump: 2023-10-05T11:40:29.342 INFO:tasks.workunit.client.0.smithi012.stderr:epoch 1 2023-10-05T11:40:29.342 INFO:tasks.workunit.client.0.smithi012.stderr:fsid 7e015f46-293b-4b09-bd32-7d32b52f6e2f 2023-10-05T11:40:29.342 INFO:tasks.workunit.client.0.smithi012.stderr:last_changed 2023-10-05T11:27:38.366888+0000 2023-10-05T11:40:29.343 INFO:tasks.workunit.client.0.smithi012.stderr:created 2023-10-05T11:27:38.366888+0000 2023-10-05T11:40:29.343 INFO:tasks.workunit.client.0.smithi012.stderr:min_mon_release 18 (reef) 2023-10-05T11:40:29.343 INFO:tasks.workunit.client.0.smithi012.stderr:election_strategy: 1 2023-10-05T11:40:29.343 INFO:tasks.workunit.client.0.smithi012.stderr:0: [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon.a 2023-10-05T11:40:29.343 INFO:tasks.workunit.client.0.smithi012.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2023-10-05T11:40:29.343 INFO:tasks.workunit.client.0.smithi012.stderr:2: [v2:172.21.15.12:3301/0,v1:172.21.15.12:6790/0] mon.c 2023-10-05T11:40:29.343 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:40:29.343 INFO:tasks.workunit.client.0.smithi012.stderr: -405> 2023-10-05T11:40:29.188+0000 7fc5f3ae5640 10 monclient: _finish_auth 0 2023-10-05T11:40:29.343 INFO:tasks.workunit.client.0.smithi012.stderr: -404> 2023-10-05T11:40:29.188+0000 7fc5f3ae5640 10 monclient: _check_auth_tickets 2023-10-05T11:40:29.343 INFO:tasks.workunit.client.0.smithi012.stderr: -403> 2023-10-05T11:40:29.188+0000 7fc5f3ae5640 10 monclient: handle_config config(0 keys) v1 2023-10-05T11:40:29.343 INFO:tasks.workunit.client.0.smithi012.stderr: -402> 2023-10-05T11:40:29.188+0000 7fc5f3ae5640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-10-05T11:40:29.343 INFO:tasks.workunit.client.0.smithi012.stderr: -401> 2023-10-05T11:40:29.188+0000 7fc5f3ae5640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-10-05T11:40:29.344 INFO:tasks.workunit.client.0.smithi012.stderr: -400> 2023-10-05T11:40:29.188+0000 7fc5f3ae5640 10 monclient: dump: 2023-10-05T11:40:29.344 INFO:tasks.workunit.client.0.smithi012.stderr:epoch 1 2023-10-05T11:40:29.344 INFO:tasks.workunit.client.0.smithi012.stderr:fsid 7e015f46-293b-4b09-bd32-7d32b52f6e2f 2023-10-05T11:40:29.344 INFO:tasks.workunit.client.0.smithi012.stderr:last_changed 2023-10-05T11:27:38.366888+0000 2023-10-05T11:40:29.344 INFO:tasks.workunit.client.0.smithi012.stderr:created 2023-10-05T11:27:38.366888+0000 2023-10-05T11:40:29.344 INFO:tasks.workunit.client.0.smithi012.stderr:min_mon_release 18 (reef) 2023-10-05T11:40:29.344 INFO:tasks.workunit.client.0.smithi012.stderr:election_strategy: 1 2023-10-05T11:40:29.344 INFO:tasks.workunit.client.0.smithi012.stderr:0: [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon.a 2023-10-05T11:40:29.344 INFO:tasks.workunit.client.0.smithi012.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2023-10-05T11:40:29.344 INFO:tasks.workunit.client.0.smithi012.stderr:2: [v2:172.21.15.12:3301/0,v1:172.21.15.12:6790/0] mon.c 2023-10-05T11:40:29.344 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:40:29.345 INFO:tasks.workunit.client.0.smithi012.stderr: -399> 2023-10-05T11:40:29.188+0000 7fc5fab4b880 5 monclient: authenticate success, global_id 6506 2023-10-05T11:40:29.345 INFO:tasks.workunit.client.0.smithi012.stderr: -398> 2023-10-05T11:40:29.188+0000 7fc5fab4b880 10 monclient: get_monmap_and_config success 2023-10-05T11:40:29.345 INFO:tasks.workunit.client.0.smithi012.stderr: -397> 2023-10-05T11:40:29.188+0000 7fc5fab4b880 4 set_mon_vals no callback set 2023-10-05T11:40:29.345 INFO:tasks.workunit.client.0.smithi012.stderr: -396> 2023-10-05T11:40:29.188+0000 7fc5fab4b880 10 monclient: shutdown 2023-10-05T11:40:29.345 INFO:tasks.workunit.client.0.smithi012.stderr: -395> 2023-10-05T11:40:29.188+0000 7fc5fab4b880 10 monclient: build_initial_monmap 2023-10-05T11:40:29.345 INFO:tasks.workunit.client.0.smithi012.stderr: -394> 2023-10-05T11:40:29.188+0000 7fc5fab4b880 1 build_initial for_mkfs: 0 2023-10-05T11:40:29.345 INFO:tasks.workunit.client.0.smithi012.stderr: -393> 2023-10-05T11:40:29.188+0000 7fc5fab4b880 10 monclient: monmap: 2023-10-05T11:40:29.345 INFO:tasks.workunit.client.0.smithi012.stderr:epoch 0 2023-10-05T11:40:29.345 INFO:tasks.workunit.client.0.smithi012.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-10-05T11:40:29.345 INFO:tasks.workunit.client.0.smithi012.stderr:last_changed 0.000000 2023-10-05T11:40:29.345 INFO:tasks.workunit.client.0.smithi012.stderr:created 0.000000 2023-10-05T11:40:29.346 INFO:tasks.workunit.client.0.smithi012.stderr:min_mon_release 0 (unknown) 2023-10-05T11:40:29.346 INFO:tasks.workunit.client.0.smithi012.stderr:election_strategy: 1 2023-10-05T11:40:29.346 INFO:tasks.workunit.client.0.smithi012.stderr:0: [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon.noname-a 2023-10-05T11:40:29.346 INFO:tasks.workunit.client.0.smithi012.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.noname-b 2023-10-05T11:40:29.346 INFO:tasks.workunit.client.0.smithi012.stderr:2: [v2:172.21.15.12:3301/0,v1:172.21.15.12:6790/0] mon.noname-c 2023-10-05T11:40:29.346 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:40:29.346 INFO:tasks.workunit.client.0.smithi012.stderr: -392> 2023-10-05T11:40:29.188+0000 7fc5fab4b880 5 AuthRegistry(0x563259da7340) adding auth protocol: cephx 2023-10-05T11:40:29.346 INFO:tasks.workunit.client.0.smithi012.stderr: -391> 2023-10-05T11:40:29.188+0000 7fc5fab4b880 5 AuthRegistry(0x563259da7340) adding auth protocol: cephx 2023-10-05T11:40:29.346 INFO:tasks.workunit.client.0.smithi012.stderr: -390> 2023-10-05T11:40:29.188+0000 7fc5fab4b880 5 AuthRegistry(0x563259da7340) adding auth protocol: cephx 2023-10-05T11:40:29.346 INFO:tasks.workunit.client.0.smithi012.stderr: -389> 2023-10-05T11:40:29.188+0000 7fc5fab4b880 5 AuthRegistry(0x563259da7340) adding con mode: secure 2023-10-05T11:40:29.346 INFO:tasks.workunit.client.0.smithi012.stderr: -388> 2023-10-05T11:40:29.188+0000 7fc5fab4b880 5 AuthRegistry(0x563259da7340) adding con mode: crc 2023-10-05T11:40:29.346 INFO:tasks.workunit.client.0.smithi012.stderr: -387> 2023-10-05T11:40:29.188+0000 7fc5fab4b880 5 AuthRegistry(0x563259da7340) adding con mode: secure 2023-10-05T11:40:29.347 INFO:tasks.workunit.client.0.smithi012.stderr: -386> 2023-10-05T11:40:29.188+0000 7fc5fab4b880 5 AuthRegistry(0x563259da7340) adding con mode: crc 2023-10-05T11:40:29.347 INFO:tasks.workunit.client.0.smithi012.stderr: -385> 2023-10-05T11:40:29.188+0000 7fc5fab4b880 5 AuthRegistry(0x563259da7340) adding con mode: secure 2023-10-05T11:40:29.347 INFO:tasks.workunit.client.0.smithi012.stderr: -384> 2023-10-05T11:40:29.188+0000 7fc5fab4b880 5 AuthRegistry(0x563259da7340) adding con mode: crc 2023-10-05T11:40:29.347 INFO:tasks.workunit.client.0.smithi012.stderr: -383> 2023-10-05T11:40:29.188+0000 7fc5fab4b880 5 AuthRegistry(0x563259da7340) adding con mode: crc 2023-10-05T11:40:29.347 INFO:tasks.workunit.client.0.smithi012.stderr: -382> 2023-10-05T11:40:29.188+0000 7fc5fab4b880 5 AuthRegistry(0x563259da7340) adding con mode: secure 2023-10-05T11:40:29.347 INFO:tasks.workunit.client.0.smithi012.stderr: -381> 2023-10-05T11:40:29.188+0000 7fc5fab4b880 5 AuthRegistry(0x563259da7340) adding con mode: crc 2023-10-05T11:40:29.347 INFO:tasks.workunit.client.0.smithi012.stderr: -380> 2023-10-05T11:40:29.188+0000 7fc5fab4b880 5 AuthRegistry(0x563259da7340) adding con mode: secure 2023-10-05T11:40:29.347 INFO:tasks.workunit.client.0.smithi012.stderr: -379> 2023-10-05T11:40:29.188+0000 7fc5fab4b880 5 AuthRegistry(0x563259da7340) adding con mode: crc 2023-10-05T11:40:29.347 INFO:tasks.workunit.client.0.smithi012.stderr: -378> 2023-10-05T11:40:29.188+0000 7fc5fab4b880 5 AuthRegistry(0x563259da7340) adding con mode: secure 2023-10-05T11:40:29.347 INFO:tasks.workunit.client.0.smithi012.stderr: -377> 2023-10-05T11:40:29.188+0000 7fc5fab4b880 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-10-05T11:40:29.347 INFO:tasks.workunit.client.0.smithi012.stderr: -376> 2023-10-05T11:40:29.188+0000 7fc5fab4b880 1 librados: starting msgr at 2023-10-05T11:40:29.347 INFO:tasks.workunit.client.0.smithi012.stderr: -375> 2023-10-05T11:40:29.188+0000 7fc5fab4b880 1 librados: starting objecter 2023-10-05T11:40:29.348 INFO:tasks.workunit.client.0.smithi012.stderr: -374> 2023-10-05T11:40:29.189+0000 7fc5fab4b880 5 asok(0x5632592f6000) register_command objecter_requests cmddesc objecter_requests hook 0x5632590ad610 EEXIST 2023-10-05T11:40:29.348 INFO:tasks.workunit.client.0.smithi012.stderr: -373> 2023-10-05T11:40:29.189+0000 7fc5fab4b880 1 librados: setting wanted keys 2023-10-05T11:40:29.348 INFO:tasks.workunit.client.0.smithi012.stderr: -372> 2023-10-05T11:40:29.189+0000 7fc5fab4b880 1 librados: calling monclient init 2023-10-05T11:40:29.348 INFO:tasks.workunit.client.0.smithi012.stderr: -371> 2023-10-05T11:40:29.189+0000 7fc5fab4b880 10 monclient: init 2023-10-05T11:40:29.348 INFO:tasks.workunit.client.0.smithi012.stderr: -370> 2023-10-05T11:40:29.189+0000 7fc5fab4b880 5 AuthRegistry(0x5632591550d8) adding auth protocol: cephx 2023-10-05T11:40:29.348 INFO:tasks.workunit.client.0.smithi012.stderr: -369> 2023-10-05T11:40:29.189+0000 7fc5fab4b880 5 AuthRegistry(0x5632591550d8) adding auth protocol: cephx 2023-10-05T11:40:29.348 INFO:tasks.workunit.client.0.smithi012.stderr: -368> 2023-10-05T11:40:29.189+0000 7fc5fab4b880 5 AuthRegistry(0x5632591550d8) adding auth protocol: cephx 2023-10-05T11:40:29.348 INFO:tasks.workunit.client.0.smithi012.stderr: -367> 2023-10-05T11:40:29.189+0000 7fc5fab4b880 5 AuthRegistry(0x5632591550d8) adding con mode: secure 2023-10-05T11:40:29.348 INFO:tasks.workunit.client.0.smithi012.stderr: -366> 2023-10-05T11:40:29.189+0000 7fc5fab4b880 5 AuthRegistry(0x5632591550d8) adding con mode: crc 2023-10-05T11:40:29.348 INFO:tasks.workunit.client.0.smithi012.stderr: -365> 2023-10-05T11:40:29.189+0000 7fc5fab4b880 5 AuthRegistry(0x5632591550d8) adding con mode: secure 2023-10-05T11:40:29.348 INFO:tasks.workunit.client.0.smithi012.stderr: -364> 2023-10-05T11:40:29.189+0000 7fc5fab4b880 5 AuthRegistry(0x5632591550d8) adding con mode: crc 2023-10-05T11:40:29.348 INFO:tasks.workunit.client.0.smithi012.stderr: -363> 2023-10-05T11:40:29.189+0000 7fc5fab4b880 5 AuthRegistry(0x5632591550d8) adding con mode: secure 2023-10-05T11:40:29.349 INFO:tasks.workunit.client.0.smithi012.stderr: -362> 2023-10-05T11:40:29.189+0000 7fc5fab4b880 5 AuthRegistry(0x5632591550d8) adding con mode: crc 2023-10-05T11:40:29.349 INFO:tasks.workunit.client.0.smithi012.stderr: -361> 2023-10-05T11:40:29.189+0000 7fc5fab4b880 5 AuthRegistry(0x5632591550d8) adding con mode: crc 2023-10-05T11:40:29.349 INFO:tasks.workunit.client.0.smithi012.stderr: -360> 2023-10-05T11:40:29.189+0000 7fc5fab4b880 5 AuthRegistry(0x5632591550d8) adding con mode: secure 2023-10-05T11:40:29.349 INFO:tasks.workunit.client.0.smithi012.stderr: -359> 2023-10-05T11:40:29.189+0000 7fc5fab4b880 5 AuthRegistry(0x5632591550d8) adding con mode: crc 2023-10-05T11:40:29.349 INFO:tasks.workunit.client.0.smithi012.stderr: -358> 2023-10-05T11:40:29.189+0000 7fc5fab4b880 5 AuthRegistry(0x5632591550d8) adding con mode: secure 2023-10-05T11:40:29.349 INFO:tasks.workunit.client.0.smithi012.stderr: -357> 2023-10-05T11:40:29.189+0000 7fc5fab4b880 5 AuthRegistry(0x5632591550d8) adding con mode: crc 2023-10-05T11:40:29.349 INFO:tasks.workunit.client.0.smithi012.stderr: -356> 2023-10-05T11:40:29.189+0000 7fc5fab4b880 5 AuthRegistry(0x5632591550d8) adding con mode: secure 2023-10-05T11:40:29.349 INFO:tasks.workunit.client.0.smithi012.stderr: -355> 2023-10-05T11:40:29.189+0000 7fc5fab4b880 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-10-05T11:40:29.349 INFO:tasks.workunit.client.0.smithi012.stderr: -354> 2023-10-05T11:40:29.189+0000 7fc5fab4b880 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-10-05T11:40:29.349 INFO:tasks.workunit.client.0.smithi012.stderr: -353> 2023-10-05T11:40:29.189+0000 7fc5fab4b880 5 asok(0x5632592f6000) register_command rotate-key cmddesc rotate-key hook 0x563259155220 EEXIST 2023-10-05T11:40:29.349 INFO:tasks.workunit.client.0.smithi012.stderr: -352> 2023-10-05T11:40:29.189+0000 7fc5fab4b880 10 monclient: _reopen_session rank -1 2023-10-05T11:40:29.350 INFO:tasks.workunit.client.0.smithi012.stderr: -351> 2023-10-05T11:40:29.189+0000 7fc5fab4b880 10 monclient: _add_conns ranks=[0,2,1] 2023-10-05T11:40:29.350 INFO:tasks.workunit.client.0.smithi012.stderr: -350> 2023-10-05T11:40:29.189+0000 7fc5fab4b880 10 monclient(hunting): picked mon.noname-a con 0x563259eeec00 addr [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] 2023-10-05T11:40:29.350 INFO:tasks.workunit.client.0.smithi012.stderr: -349> 2023-10-05T11:40:29.189+0000 7fc5fab4b880 10 monclient(hunting): picked mon.noname-c con 0x563259eef000 addr [v2:172.21.15.12:3301/0,v1:172.21.15.12:6790/0] 2023-10-05T11:40:29.350 INFO:tasks.workunit.client.0.smithi012.stderr: -348> 2023-10-05T11:40:29.189+0000 7fc5fab4b880 10 monclient(hunting): picked mon.noname-b con 0x563259eef400 addr [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] 2023-10-05T11:40:29.350 INFO:tasks.workunit.client.0.smithi012.stderr: -347> 2023-10-05T11:40:29.189+0000 7fc5fab4b880 10 monclient(hunting): start opening mon connection 2023-10-05T11:40:29.350 INFO:tasks.workunit.client.0.smithi012.stderr: -346> 2023-10-05T11:40:29.189+0000 7fc5fab4b880 10 monclient(hunting): start opening mon connection 2023-10-05T11:40:29.350 INFO:tasks.workunit.client.0.smithi012.stderr: -345> 2023-10-05T11:40:29.189+0000 7fc5fab4b880 10 monclient(hunting): start opening mon connection 2023-10-05T11:40:29.350 INFO:tasks.workunit.client.0.smithi012.stderr: -344> 2023-10-05T11:40:29.189+0000 7fc5fab4b880 10 monclient(hunting): _renew_subs 2023-10-05T11:40:29.350 INFO:tasks.workunit.client.0.smithi012.stderr: -343> 2023-10-05T11:40:29.189+0000 7fc5fab4b880 10 monclient(hunting): authenticate will time out at 1537.357969s 2023-10-05T11:40:29.350 INFO:tasks.workunit.client.0.smithi012.stderr: -342> 2023-10-05T11:40:29.189+0000 7fc5f92f0640 10 monclient(hunting): get_auth_request con 0x563259eeec00 auth_method 0 2023-10-05T11:40:29.350 INFO:tasks.workunit.client.0.smithi012.stderr: -341> 2023-10-05T11:40:29.189+0000 7fc5f92f0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-10-05T11:40:29.351 INFO:tasks.workunit.client.0.smithi012.stderr: -340> 2023-10-05T11:40:29.189+0000 7fc5f92f0640 10 monclient(hunting): _init_auth method 2 2023-10-05T11:40:29.351 INFO:tasks.workunit.client.0.smithi012.stderr: -339> 2023-10-05T11:40:29.189+0000 7fc5f92f0640 10 monclient(hunting): _init_auth creating new auth 2023-10-05T11:40:29.351 INFO:tasks.workunit.client.0.smithi012.stderr: -338> 2023-10-05T11:40:29.189+0000 7fc5f8aef640 10 monclient(hunting): get_auth_request con 0x563259eef000 auth_method 0 2023-10-05T11:40:29.351 INFO:tasks.workunit.client.0.smithi012.stderr: -337> 2023-10-05T11:40:29.189+0000 7fc5f8aef640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-10-05T11:40:29.351 INFO:tasks.workunit.client.0.smithi012.stderr: -336> 2023-10-05T11:40:29.189+0000 7fc5f8aef640 10 monclient(hunting): _init_auth method 2 2023-10-05T11:40:29.351 INFO:tasks.workunit.client.0.smithi012.stderr: -335> 2023-10-05T11:40:29.189+0000 7fc5f8aef640 10 monclient(hunting): _init_auth creating new auth 2023-10-05T11:40:29.351 INFO:tasks.workunit.client.0.smithi012.stderr: -334> 2023-10-05T11:40:29.189+0000 7fc5f9af1640 10 monclient(hunting): get_auth_request con 0x563259eef400 auth_method 0 2023-10-05T11:40:29.351 INFO:tasks.workunit.client.0.smithi012.stderr: -333> 2023-10-05T11:40:29.189+0000 7fc5f9af1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-10-05T11:40:29.351 INFO:tasks.workunit.client.0.smithi012.stderr: -332> 2023-10-05T11:40:29.189+0000 7fc5f9af1640 10 monclient(hunting): _init_auth method 2 2023-10-05T11:40:29.351 INFO:tasks.workunit.client.0.smithi012.stderr: -331> 2023-10-05T11:40:29.189+0000 7fc5f9af1640 10 monclient(hunting): _init_auth creating new auth 2023-10-05T11:40:29.351 INFO:tasks.workunit.client.0.smithi012.stderr: -330> 2023-10-05T11:40:29.189+0000 7fc5f92f0640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-10-05T11:40:29.351 INFO:tasks.workunit.client.0.smithi012.stderr: -329> 2023-10-05T11:40:29.189+0000 7fc5f92f0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-10-05T11:40:29.352 INFO:tasks.workunit.client.0.smithi012.stderr: -328> 2023-10-05T11:40:29.189+0000 7fc5f92f0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-10-05T11:40:29.352 INFO:tasks.workunit.client.0.smithi012.stderr: -327> 2023-10-05T11:40:29.189+0000 7fc5f8aef640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-10-05T11:40:29.352 INFO:tasks.workunit.client.0.smithi012.stderr: -326> 2023-10-05T11:40:29.189+0000 7fc5f8aef640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-10-05T11:40:29.352 INFO:tasks.workunit.client.0.smithi012.stderr: -325> 2023-10-05T11:40:29.189+0000 7fc5f8aef640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-10-05T11:40:29.352 INFO:tasks.workunit.client.0.smithi012.stderr: -324> 2023-10-05T11:40:29.189+0000 7fc5f9af1640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-10-05T11:40:29.352 INFO:tasks.workunit.client.0.smithi012.stderr: -323> 2023-10-05T11:40:29.189+0000 7fc5f9af1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-10-05T11:40:29.352 INFO:tasks.workunit.client.0.smithi012.stderr: -322> 2023-10-05T11:40:29.189+0000 7fc5f9af1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-10-05T11:40:29.352 INFO:tasks.workunit.client.0.smithi012.stderr: -321> 2023-10-05T11:40:29.189+0000 7fc5f92f0640 10 monclient(hunting): handle_auth_done global_id 6822 payload 824 2023-10-05T11:40:29.352 INFO:tasks.workunit.client.0.smithi012.stderr: -320> 2023-10-05T11:40:29.189+0000 7fc5f92f0640 10 monclient: _finish_hunting 0 2023-10-05T11:40:29.352 INFO:tasks.workunit.client.0.smithi012.stderr: -319> 2023-10-05T11:40:29.189+0000 7fc5f92f0640 1 monclient: found mon.noname-a 2023-10-05T11:40:29.352 INFO:tasks.workunit.client.0.smithi012.stderr: -318> 2023-10-05T11:40:29.189+0000 7fc5f92f0640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.12:3300/0 2023-10-05T11:40:29.353 INFO:tasks.workunit.client.0.smithi012.stderr: -317> 2023-10-05T11:40:29.190+0000 7fc5f22e2640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-10-05T11:40:29.353 INFO:tasks.workunit.client.0.smithi012.stderr: -316> 2023-10-05T11:40:29.190+0000 7fc5f22e2640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2023-10-05T11:40:29.353 INFO:tasks.workunit.client.0.smithi012.stderr: -315> 2023-10-05T11:40:29.190+0000 7fc5f22e2640 10 monclient: dump: 2023-10-05T11:40:29.353 INFO:tasks.workunit.client.0.smithi012.stderr:epoch 1 2023-10-05T11:40:29.353 INFO:tasks.workunit.client.0.smithi012.stderr:fsid 7e015f46-293b-4b09-bd32-7d32b52f6e2f 2023-10-05T11:40:29.353 INFO:tasks.workunit.client.0.smithi012.stderr:last_changed 2023-10-05T11:27:38.366888+0000 2023-10-05T11:40:29.353 INFO:tasks.workunit.client.0.smithi012.stderr:created 2023-10-05T11:27:38.366888+0000 2023-10-05T11:40:29.353 INFO:tasks.workunit.client.0.smithi012.stderr:min_mon_release 18 (reef) 2023-10-05T11:40:29.353 INFO:tasks.workunit.client.0.smithi012.stderr:election_strategy: 1 2023-10-05T11:40:29.353 INFO:tasks.workunit.client.0.smithi012.stderr:0: [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon.a 2023-10-05T11:40:29.353 INFO:tasks.workunit.client.0.smithi012.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2023-10-05T11:40:29.354 INFO:tasks.workunit.client.0.smithi012.stderr:2: [v2:172.21.15.12:3301/0,v1:172.21.15.12:6790/0] mon.c 2023-10-05T11:40:29.354 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:40:29.354 INFO:tasks.workunit.client.0.smithi012.stderr: -314> 2023-10-05T11:40:29.190+0000 7fc5f22e2640 10 monclient: _finish_auth 0 2023-10-05T11:40:29.354 INFO:tasks.workunit.client.0.smithi012.stderr: -313> 2023-10-05T11:40:29.190+0000 7fc5f22e2640 10 monclient: _check_auth_tickets 2023-10-05T11:40:29.354 INFO:tasks.workunit.client.0.smithi012.stderr: -312> 2023-10-05T11:40:29.190+0000 7fc5f22e2640 10 monclient: handle_config config(0 keys) v1 2023-10-05T11:40:29.354 INFO:tasks.workunit.client.0.smithi012.stderr: -311> 2023-10-05T11:40:29.190+0000 7fc5f22e2640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-10-05T11:40:29.354 INFO:tasks.workunit.client.0.smithi012.stderr: -310> 2023-10-05T11:40:29.190+0000 7fc5f22e2640 10 monclient: got monmap 1 from mon.a (according to old e1) 2023-10-05T11:40:29.354 INFO:tasks.workunit.client.0.smithi012.stderr: -309> 2023-10-05T11:40:29.190+0000 7fc5f3ae5640 4 set_mon_vals no callback set 2023-10-05T11:40:29.354 INFO:tasks.workunit.client.0.smithi012.stderr: -308> 2023-10-05T11:40:29.190+0000 7fc5f22e2640 10 monclient: dump: 2023-10-05T11:40:29.354 INFO:tasks.workunit.client.0.smithi012.stderr:epoch 1 2023-10-05T11:40:29.354 INFO:tasks.workunit.client.0.smithi012.stderr:fsid 7e015f46-293b-4b09-bd32-7d32b52f6e2f 2023-10-05T11:40:29.355 INFO:tasks.workunit.client.0.smithi012.stderr:last_changed 2023-10-05T11:27:38.366888+0000 2023-10-05T11:40:29.355 INFO:tasks.workunit.client.0.smithi012.stderr:created 2023-10-05T11:27:38.366888+0000 2023-10-05T11:40:29.355 INFO:tasks.workunit.client.0.smithi012.stderr:min_mon_release 18 (reef) 2023-10-05T11:40:29.355 INFO:tasks.workunit.client.0.smithi012.stderr:election_strategy: 1 2023-10-05T11:40:29.355 INFO:tasks.workunit.client.0.smithi012.stderr:0: [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon.a 2023-10-05T11:40:29.355 INFO:tasks.workunit.client.0.smithi012.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2023-10-05T11:40:29.355 INFO:tasks.workunit.client.0.smithi012.stderr:2: [v2:172.21.15.12:3301/0,v1:172.21.15.12:6790/0] mon.c 2023-10-05T11:40:29.355 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:40:29.355 INFO:tasks.workunit.client.0.smithi012.stderr: -307> 2023-10-05T11:40:29.190+0000 7fc5fab4b880 5 monclient: authenticate success, global_id 6822 2023-10-05T11:40:29.355 INFO:tasks.workunit.client.0.smithi012.stderr: -306> 2023-10-05T11:40:29.190+0000 7fc5fab4b880 10 monclient: _renew_subs 2023-10-05T11:40:29.355 INFO:tasks.workunit.client.0.smithi012.stderr: -305> 2023-10-05T11:40:29.190+0000 7fc5fab4b880 10 monclient: _send_mon_message to mon.a at v2:172.21.15.12:3300/0 2023-10-05T11:40:29.356 INFO:tasks.workunit.client.0.smithi012.stderr: -304> 2023-10-05T11:40:29.190+0000 7fc5fab4b880 10 monclient: _renew_subs 2023-10-05T11:40:29.356 INFO:tasks.workunit.client.0.smithi012.stderr: -303> 2023-10-05T11:40:29.190+0000 7fc5fab4b880 10 monclient: _send_mon_message to mon.a at v2:172.21.15.12:3300/0 2023-10-05T11:40:29.356 INFO:tasks.workunit.client.0.smithi012.stderr: -302> 2023-10-05T11:40:29.190+0000 7fc5fab4b880 1 librados: init done 2023-10-05T11:40:29.356 INFO:tasks.workunit.client.0.smithi012.stderr: -301> 2023-10-05T11:40:29.191+0000 7fc5fab4b880 20 rados->read ofs=0 len=0 2023-10-05T11:40:29.356 INFO:tasks.workunit.client.0.smithi012.stderr: -300> 2023-10-05T11:40:29.191+0000 7fc5f22e2640 4 mgrc handle_mgr_map Got map version 5 2023-10-05T11:40:29.356 INFO:tasks.workunit.client.0.smithi012.stderr: -299> 2023-10-05T11:40:29.191+0000 7fc5f22e2640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.170:6832/180516904,v1:172.21.15.170:6833/180516904] 2023-10-05T11:40:29.356 INFO:tasks.workunit.client.0.smithi012.stderr: -298> 2023-10-05T11:40:29.191+0000 7fc5f22e2640 4 mgrc reconnect Starting new session with [v2:172.21.15.170:6832/180516904,v1:172.21.15.170:6833/180516904] 2023-10-05T11:40:29.356 INFO:tasks.workunit.client.0.smithi012.stderr: -297> 2023-10-05T11:40:29.191+0000 7fc5f8aef640 10 monclient: get_auth_request con 0x5632593ce400 auth_method 0 2023-10-05T11:40:29.356 INFO:tasks.workunit.client.0.smithi012.stderr: -296> 2023-10-05T11:40:29.192+0000 7fc5f9af1640 10 monclient: get_auth_request con 0x563259eef800 auth_method 0 2023-10-05T11:40:29.356 INFO:tasks.workunit.client.0.smithi012.stderr: -295> 2023-10-05T11:40:29.192+0000 7fc5fab4b880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:40:29.356 INFO:tasks.workunit.client.0.smithi012.stderr: -294> 2023-10-05T11:40:29.192+0000 7fc5fab4b880 20 realm 2023-10-05T11:40:29.356 INFO:tasks.workunit.client.0.smithi012.stderr: -293> 2023-10-05T11:40:29.192+0000 7fc5fab4b880 20 rados->read ofs=0 len=0 2023-10-05T11:40:29.357 INFO:tasks.workunit.client.0.smithi012.stderr: -292> 2023-10-05T11:40:29.192+0000 7fc5fab4b880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:40:29.357 INFO:tasks.workunit.client.0.smithi012.stderr: -291> 2023-10-05T11:40:29.192+0000 7fc5fab4b880 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T11:40:29.357 INFO:tasks.workunit.client.0.smithi012.stderr: -290> 2023-10-05T11:40:29.192+0000 7fc5fab4b880 20 rados->read ofs=0 len=0 2023-10-05T11:40:29.357 INFO:tasks.workunit.client.0.smithi012.stderr: -289> 2023-10-05T11:40:29.193+0000 7fc5fab4b880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:40:29.357 INFO:tasks.workunit.client.0.smithi012.stderr: -288> 2023-10-05T11:40:29.193+0000 7fc5fab4b880 20 rados->read ofs=0 len=0 2023-10-05T11:40:29.357 INFO:tasks.workunit.client.0.smithi012.stderr: -287> 2023-10-05T11:40:29.193+0000 7fc5f92f0640 10 monclient: get_auth_request con 0x563259eefc00 auth_method 0 2023-10-05T11:40:29.357 INFO:tasks.workunit.client.0.smithi012.stderr: -286> 2023-10-05T11:40:29.193+0000 7fc5fab4b880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:40:29.357 INFO:tasks.workunit.client.0.smithi012.stderr: -285> 2023-10-05T11:40:29.193+0000 7fc5fab4b880 20 rados->read ofs=0 len=0 2023-10-05T11:40:29.357 INFO:tasks.workunit.client.0.smithi012.stderr: -284> 2023-10-05T11:40:29.194+0000 7fc5f8aef640 10 monclient: get_auth_request con 0x5632593ce800 auth_method 0 2023-10-05T11:40:29.357 INFO:tasks.workunit.client.0.smithi012.stderr: -283> 2023-10-05T11:40:29.194+0000 7fc5fab4b880 20 rados_obj.operate() r=0 bl.length=1020 2023-10-05T11:40:29.357 INFO:tasks.workunit.client.0.smithi012.stderr: -282> 2023-10-05T11:40:29.194+0000 7fc5fab4b880 20 searching for the correct realm 2023-10-05T11:40:29.357 INFO:tasks.workunit.client.0.smithi012.stderr: -281> 2023-10-05T11:40:29.194+0000 7fc5f9af1640 10 monclient: get_auth_request con 0x5632593cec00 auth_method 0 2023-10-05T11:40:29.358 INFO:tasks.workunit.client.0.smithi012.stderr: -280> 2023-10-05T11:40:29.195+0000 7fc5f92f0640 10 monclient: get_auth_request con 0x5632594be000 auth_method 0 2023-10-05T11:40:29.358 INFO:tasks.workunit.client.0.smithi012.stderr: -279> 2023-10-05T11:40:29.196+0000 7fc5f8aef640 10 monclient: get_auth_request con 0x5632593bf400 auth_method 0 2023-10-05T11:40:29.358 INFO:tasks.workunit.client.0.smithi012.stderr: -278> 2023-10-05T11:40:29.198+0000 7fc5f9af1640 10 monclient: get_auth_request con 0x5632594be400 auth_method 0 2023-10-05T11:40:29.358 INFO:tasks.workunit.client.0.smithi012.stderr: -277> 2023-10-05T11:40:29.200+0000 7fc5f92f0640 10 monclient: get_auth_request con 0x5632594be800 auth_method 0 2023-10-05T11:40:29.358 INFO:tasks.workunit.client.0.smithi012.stderr: -276> 2023-10-05T11:40:29.202+0000 7fc5f92f0640 0 -- 172.21.15.12:0/2263745182 >> [v2:172.21.15.12:6808/396693578,v1:172.21.15.12:6809/396693578] conn(0x5632594be800 msgr2=0x5632593c5b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:40:29.358 INFO:tasks.workunit.client.0.smithi012.stderr: -275> 2023-10-05T11:40:29.202+0000 7fc5f22e2640 1 client.6822.objecter ms_handle_reset 0x5632594be800 session 0x5632592f0900 osd.0 2023-10-05T11:40:29.358 INFO:tasks.workunit.client.0.smithi012.stderr: -274> 2023-10-05T11:40:29.202+0000 7fc5f22e2640 10 monclient: _renew_subs 2023-10-05T11:40:29.358 INFO:tasks.workunit.client.0.smithi012.stderr: -273> 2023-10-05T11:40:29.202+0000 7fc5f22e2640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.12:3300/0 2023-10-05T11:40:29.358 INFO:tasks.workunit.client.0.smithi012.stderr: -272> 2023-10-05T11:40:29.203+0000 7fc5f92f0640 10 monclient: get_auth_request con 0x5632594bec00 auth_method 0 2023-10-05T11:40:29.358 INFO:tasks.workunit.client.0.smithi012.stderr: -271> 2023-10-05T11:40:29.204+0000 7fc5fab4b880 20 RGWRados::pool_iterate: got zone_info.dff27d1e-df33-400e-a68a-7ba586947c99 2023-10-05T11:40:29.358 INFO:tasks.workunit.client.0.smithi012.stderr: -270> 2023-10-05T11:40:29.204+0000 7fc5fab4b880 20 RGWRados::pool_iterate: got zonegroup_info.c78aa576-9d15-4e9d-b3c0-4af23a22062c 2023-10-05T11:40:29.358 INFO:tasks.workunit.client.0.smithi012.stderr: -269> 2023-10-05T11:40:29.204+0000 7fc5fab4b880 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T11:40:29.359 INFO:tasks.workunit.client.0.smithi012.stderr: -268> 2023-10-05T11:40:29.204+0000 7fc5fab4b880 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T11:40:29.359 INFO:tasks.workunit.client.0.smithi012.stderr: -267> 2023-10-05T11:40:29.204+0000 7fc5fab4b880 20 rados->read ofs=0 len=0 2023-10-05T11:40:29.359 INFO:tasks.workunit.client.0.smithi012.stderr: -266> 2023-10-05T11:40:29.205+0000 7fc5fab4b880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:40:29.359 INFO:tasks.workunit.client.0.smithi012.stderr: -265> 2023-10-05T11:40:29.205+0000 7fc5fab4b880 20 rados->read ofs=0 len=0 2023-10-05T11:40:29.359 INFO:tasks.workunit.client.0.smithi012.stderr: -264> 2023-10-05T11:40:29.205+0000 7fc5fab4b880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:40:29.359 INFO:tasks.workunit.client.0.smithi012.stderr: -263> 2023-10-05T11:40:29.205+0000 7fc5fab4b880 20 rados->read ofs=0 len=0 2023-10-05T11:40:29.359 INFO:tasks.workunit.client.0.smithi012.stderr: -262> 2023-10-05T11:40:29.205+0000 7fc5fab4b880 20 rados_obj.operate() r=0 bl.length=454 2023-10-05T11:40:29.359 INFO:tasks.workunit.client.0.smithi012.stderr: -261> 2023-10-05T11:40:29.205+0000 7fc5fab4b880 20 zone default found 2023-10-05T11:40:29.359 INFO:tasks.workunit.client.0.smithi012.stderr: -260> 2023-10-05T11:40:29.205+0000 7fc5fab4b880 4 Realm: () 2023-10-05T11:40:29.359 INFO:tasks.workunit.client.0.smithi012.stderr: -259> 2023-10-05T11:40:29.205+0000 7fc5fab4b880 4 ZoneGroup: default (c78aa576-9d15-4e9d-b3c0-4af23a22062c) 2023-10-05T11:40:29.360 INFO:tasks.workunit.client.0.smithi012.stderr: -258> 2023-10-05T11:40:29.205+0000 7fc5fab4b880 4 Zone: default (dff27d1e-df33-400e-a68a-7ba586947c99) 2023-10-05T11:40:29.360 INFO:tasks.workunit.client.0.smithi012.stderr: -257> 2023-10-05T11:40:29.205+0000 7fc5fab4b880 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T11:40:29.360 INFO:tasks.workunit.client.0.smithi012.stderr: -256> 2023-10-05T11:40:29.205+0000 7fc5fab4b880 20 zonegroup default 2023-10-05T11:40:29.360 INFO:tasks.workunit.client.0.smithi012.stderr: -255> 2023-10-05T11:40:29.205+0000 7fc5fab4b880 20 rados->read ofs=0 len=0 2023-10-05T11:40:29.360 INFO:tasks.workunit.client.0.smithi012.stderr: -254> 2023-10-05T11:40:29.205+0000 7fc5fab4b880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:40:29.360 INFO:tasks.workunit.client.0.smithi012.stderr: -253> 2023-10-05T11:40:29.205+0000 7fc5fab4b880 20 rados->read ofs=0 len=0 2023-10-05T11:40:29.360 INFO:tasks.workunit.client.0.smithi012.stderr: -252> 2023-10-05T11:40:29.206+0000 7fc5fab4b880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:40:29.360 INFO:tasks.workunit.client.0.smithi012.stderr: -251> 2023-10-05T11:40:29.206+0000 7fc5fab4b880 20 rados->read ofs=0 len=0 2023-10-05T11:40:29.360 INFO:tasks.workunit.client.0.smithi012.stderr: -250> 2023-10-05T11:40:29.206+0000 7fc5fab4b880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:40:29.360 INFO:tasks.workunit.client.0.smithi012.stderr: -249> 2023-10-05T11:40:29.206+0000 7fc5fab4b880 20 started sync module instance, tier type = 2023-10-05T11:40:29.360 INFO:tasks.workunit.client.0.smithi012.stderr: -248> 2023-10-05T11:40:29.206+0000 7fc5fab4b880 20 started zone id=dff27d1e-df33-400e-a68a-7ba586947c99 (name=default) with tier type = 2023-10-05T11:40:29.360 INFO:tasks.workunit.client.0.smithi012.stderr: -247> 2023-10-05T11:40:29.211+0000 7fc5f8aef640 0 -- 172.21.15.12:0/2263745182 >> [v2:172.21.15.170:6824/75773779,v1:172.21.15.170:6825/75773779] conn(0x5632593ce800 msgr2=0x5632592fd180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:40:29.361 INFO:tasks.workunit.client.0.smithi012.stderr: -246> 2023-10-05T11:40:29.211+0000 7fc5f22e2640 1 client.6822.objecter ms_handle_reset 0x5632593ce800 session 0x5632592f1200 osd.7 2023-10-05T11:40:29.361 INFO:tasks.workunit.client.0.smithi012.stderr: -245> 2023-10-05T11:40:29.211+0000 7fc5f8aef640 10 monclient: get_auth_request con 0x5632594be800 auth_method 0 2023-10-05T11:40:29.361 INFO:tasks.workunit.client.0.smithi012.stderr: -244> 2023-10-05T11:40:29.215+0000 7fc5fab4b880 20 add_watcher() i=0 2023-10-05T11:40:29.361 INFO:tasks.workunit.client.0.smithi012.stderr: -243> 2023-10-05T11:40:29.215+0000 7fc5fab4b880 20 add_watcher() i=1 2023-10-05T11:40:29.361 INFO:tasks.workunit.client.0.smithi012.stderr: -242> 2023-10-05T11:40:29.215+0000 7fc5fab4b880 20 add_watcher() i=2 2023-10-05T11:40:29.361 INFO:tasks.workunit.client.0.smithi012.stderr: -241> 2023-10-05T11:40:29.215+0000 7fc5fab4b880 20 add_watcher() i=3 2023-10-05T11:40:29.361 INFO:tasks.workunit.client.0.smithi012.stderr: -240> 2023-10-05T11:40:29.215+0000 7fc5fab4b880 20 add_watcher() i=4 2023-10-05T11:40:29.361 INFO:tasks.workunit.client.0.smithi012.stderr: -239> 2023-10-05T11:40:29.215+0000 7fc5fab4b880 20 add_watcher() i=5 2023-10-05T11:40:29.361 INFO:tasks.workunit.client.0.smithi012.stderr: -238> 2023-10-05T11:40:29.215+0000 7fc5fab4b880 20 add_watcher() i=6 2023-10-05T11:40:29.361 INFO:tasks.workunit.client.0.smithi012.stderr: -237> 2023-10-05T11:40:29.216+0000 7fc5fab4b880 20 add_watcher() i=7 2023-10-05T11:40:29.362 INFO:tasks.workunit.client.0.smithi012.stderr: -236> 2023-10-05T11:40:29.216+0000 7fc5fab4b880 2 all 8 watchers are set, enabling cache 2023-10-05T11:40:29.362 INFO:tasks.workunit.client.0.smithi012.stderr: -235> 2023-10-05T11:40:29.217+0000 7fc5fab4b880 5 AuthRegistry(0x7fff2cd5e7f0) adding auth protocol: cephx 2023-10-05T11:40:29.362 INFO:tasks.workunit.client.0.smithi012.stderr: -234> 2023-10-05T11:40:29.217+0000 7fc5fab4b880 5 AuthRegistry(0x7fff2cd5e7f0) adding auth protocol: cephx 2023-10-05T11:40:29.362 INFO:tasks.workunit.client.0.smithi012.stderr: -233> 2023-10-05T11:40:29.217+0000 7fc5fab4b880 5 AuthRegistry(0x7fff2cd5e7f0) adding auth protocol: cephx 2023-10-05T11:40:29.362 INFO:tasks.workunit.client.0.smithi012.stderr: -232> 2023-10-05T11:40:29.217+0000 7fc5fab4b880 5 AuthRegistry(0x7fff2cd5e7f0) adding con mode: secure 2023-10-05T11:40:29.362 INFO:tasks.workunit.client.0.smithi012.stderr: -231> 2023-10-05T11:40:29.217+0000 7fc5fab4b880 5 AuthRegistry(0x7fff2cd5e7f0) adding con mode: crc 2023-10-05T11:40:29.362 INFO:tasks.workunit.client.0.smithi012.stderr: -230> 2023-10-05T11:40:29.217+0000 7fc5fab4b880 5 AuthRegistry(0x7fff2cd5e7f0) adding con mode: secure 2023-10-05T11:40:29.362 INFO:tasks.workunit.client.0.smithi012.stderr: -229> 2023-10-05T11:40:29.217+0000 7fc5fab4b880 5 AuthRegistry(0x7fff2cd5e7f0) adding con mode: crc 2023-10-05T11:40:29.362 INFO:tasks.workunit.client.0.smithi012.stderr: -228> 2023-10-05T11:40:29.217+0000 7fc5e02be640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:40:29.362 INFO:tasks.workunit.client.0.smithi012.stderr: -227> 2023-10-05T11:40:29.217+0000 7fc5fab4b880 5 AuthRegistry(0x7fff2cd5e7f0) adding con mode: secure 2023-10-05T11:40:29.362 INFO:tasks.workunit.client.0.smithi012.stderr: -226> 2023-10-05T11:40:29.217+0000 7fc5fab4b880 5 AuthRegistry(0x7fff2cd5e7f0) adding con mode: crc 2023-10-05T11:40:29.363 INFO:tasks.workunit.client.0.smithi012.stderr: -225> 2023-10-05T11:40:29.217+0000 7fc5fab4b880 5 AuthRegistry(0x7fff2cd5e7f0) adding con mode: crc 2023-10-05T11:40:29.363 INFO:tasks.workunit.client.0.smithi012.stderr: -224> 2023-10-05T11:40:29.217+0000 7fc5fab4b880 5 AuthRegistry(0x7fff2cd5e7f0) adding con mode: secure 2023-10-05T11:40:29.363 INFO:tasks.workunit.client.0.smithi012.stderr: -223> 2023-10-05T11:40:29.217+0000 7fc5fab4b880 5 AuthRegistry(0x7fff2cd5e7f0) adding con mode: crc 2023-10-05T11:40:29.363 INFO:tasks.workunit.client.0.smithi012.stderr: -222> 2023-10-05T11:40:29.217+0000 7fc5fab4b880 5 AuthRegistry(0x7fff2cd5e7f0) adding con mode: secure 2023-10-05T11:40:29.363 INFO:tasks.workunit.client.0.smithi012.stderr: -221> 2023-10-05T11:40:29.217+0000 7fc5fab4b880 5 AuthRegistry(0x7fff2cd5e7f0) adding con mode: crc 2023-10-05T11:40:29.363 INFO:tasks.workunit.client.0.smithi012.stderr: -220> 2023-10-05T11:40:29.217+0000 7fc5fab4b880 5 AuthRegistry(0x7fff2cd5e7f0) adding con mode: secure 2023-10-05T11:40:29.363 INFO:tasks.workunit.client.0.smithi012.stderr: -219> 2023-10-05T11:40:29.218+0000 7fc5fab4b880 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-10-05T11:40:29.363 INFO:tasks.workunit.client.0.smithi012.stderr: -218> 2023-10-05T11:40:29.218+0000 7fc5fab4b880 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T11:40:29.363 INFO:tasks.workunit.client.0.smithi012.stderr: -217> 2023-10-05T11:40:29.218+0000 7fc5fab4b880 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T11:40:29.363 INFO:tasks.workunit.client.0.smithi012.stderr: -216> 2023-10-05T11:40:29.218+0000 7fc5fab4b880 5 asok(0x5632592f6000) register_command cache list hook 0x5632590ad480 2023-10-05T11:40:29.363 INFO:tasks.workunit.client.0.smithi012.stderr: -215> 2023-10-05T11:40:29.218+0000 7fc5fab4b880 5 asok(0x5632592f6000) register_command cache inspect hook 0x5632590ad480 2023-10-05T11:40:29.363 INFO:tasks.workunit.client.0.smithi012.stderr: -214> 2023-10-05T11:40:29.218+0000 7fc5fab4b880 5 asok(0x5632592f6000) register_command cache erase hook 0x5632590ad480 2023-10-05T11:40:29.363 INFO:tasks.workunit.client.0.smithi012.stderr: -213> 2023-10-05T11:40:29.218+0000 7fc5fab4b880 5 asok(0x5632592f6000) register_command cache zap hook 0x5632590ad480 2023-10-05T11:40:29.364 INFO:tasks.workunit.client.0.smithi012.stderr: -212> 2023-10-05T11:40:29.218+0000 7fc5fab4b880 10 monclient: get_monmap_and_config 2023-10-05T11:40:29.364 INFO:tasks.workunit.client.0.smithi012.stderr: -211> 2023-10-05T11:40:29.218+0000 7fc5fab4b880 10 monclient: build_initial_monmap 2023-10-05T11:40:29.364 INFO:tasks.workunit.client.0.smithi012.stderr: -210> 2023-10-05T11:40:29.218+0000 7fc5fab4b880 1 build_initial for_mkfs: 0 2023-10-05T11:40:29.364 INFO:tasks.workunit.client.0.smithi012.stderr: -209> 2023-10-05T11:40:29.218+0000 7fc5fab4b880 10 monclient: monmap: 2023-10-05T11:40:29.364 INFO:tasks.workunit.client.0.smithi012.stderr:epoch 0 2023-10-05T11:40:29.364 INFO:tasks.workunit.client.0.smithi012.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-10-05T11:40:29.364 INFO:tasks.workunit.client.0.smithi012.stderr:last_changed 0.000000 2023-10-05T11:40:29.364 INFO:tasks.workunit.client.0.smithi012.stderr:created 0.000000 2023-10-05T11:40:29.364 INFO:tasks.workunit.client.0.smithi012.stderr:min_mon_release 0 (unknown) 2023-10-05T11:40:29.364 INFO:tasks.workunit.client.0.smithi012.stderr:election_strategy: 1 2023-10-05T11:40:29.364 INFO:tasks.workunit.client.0.smithi012.stderr:0: [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon.noname-a 2023-10-05T11:40:29.364 INFO:tasks.workunit.client.0.smithi012.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.noname-b 2023-10-05T11:40:29.365 INFO:tasks.workunit.client.0.smithi012.stderr:2: [v2:172.21.15.12:3301/0,v1:172.21.15.12:6790/0] mon.noname-c 2023-10-05T11:40:29.365 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:40:29.365 INFO:tasks.workunit.client.0.smithi012.stderr: -208> 2023-10-05T11:40:29.218+0000 7fc5fab4b880 5 AuthRegistry(0x563259da7c40) adding auth protocol: cephx 2023-10-05T11:40:29.365 INFO:tasks.workunit.client.0.smithi012.stderr: -207> 2023-10-05T11:40:29.218+0000 7fc5fab4b880 5 AuthRegistry(0x563259da7c40) adding auth protocol: cephx 2023-10-05T11:40:29.365 INFO:tasks.workunit.client.0.smithi012.stderr: -206> 2023-10-05T11:40:29.218+0000 7fc5fab4b880 5 AuthRegistry(0x563259da7c40) adding auth protocol: cephx 2023-10-05T11:40:29.365 INFO:tasks.workunit.client.0.smithi012.stderr: -205> 2023-10-05T11:40:29.218+0000 7fc5fab4b880 5 AuthRegistry(0x563259da7c40) adding con mode: secure 2023-10-05T11:40:29.365 INFO:tasks.workunit.client.0.smithi012.stderr: -204> 2023-10-05T11:40:29.218+0000 7fc5fab4b880 5 AuthRegistry(0x563259da7c40) adding con mode: crc 2023-10-05T11:40:29.365 INFO:tasks.workunit.client.0.smithi012.stderr: -203> 2023-10-05T11:40:29.218+0000 7fc5fab4b880 5 AuthRegistry(0x563259da7c40) adding con mode: secure 2023-10-05T11:40:29.365 INFO:tasks.workunit.client.0.smithi012.stderr: -202> 2023-10-05T11:40:29.218+0000 7fc5fab4b880 5 AuthRegistry(0x563259da7c40) adding con mode: crc 2023-10-05T11:40:29.365 INFO:tasks.workunit.client.0.smithi012.stderr: -201> 2023-10-05T11:40:29.218+0000 7fc5fab4b880 5 AuthRegistry(0x563259da7c40) adding con mode: secure 2023-10-05T11:40:29.365 INFO:tasks.workunit.client.0.smithi012.stderr: -200> 2023-10-05T11:40:29.218+0000 7fc5fab4b880 5 AuthRegistry(0x563259da7c40) adding con mode: crc 2023-10-05T11:40:29.365 INFO:tasks.workunit.client.0.smithi012.stderr: -199> 2023-10-05T11:40:29.218+0000 7fc5fab4b880 5 AuthRegistry(0x563259da7c40) adding con mode: crc 2023-10-05T11:40:29.366 INFO:tasks.workunit.client.0.smithi012.stderr: -198> 2023-10-05T11:40:29.218+0000 7fc5fab4b880 5 AuthRegistry(0x563259da7c40) adding con mode: secure 2023-10-05T11:40:29.366 INFO:tasks.workunit.client.0.smithi012.stderr: -197> 2023-10-05T11:40:29.218+0000 7fc5fab4b880 5 AuthRegistry(0x563259da7c40) adding con mode: crc 2023-10-05T11:40:29.366 INFO:tasks.workunit.client.0.smithi012.stderr: -196> 2023-10-05T11:40:29.218+0000 7fc5fab4b880 5 AuthRegistry(0x563259da7c40) adding con mode: secure 2023-10-05T11:40:29.366 INFO:tasks.workunit.client.0.smithi012.stderr: -195> 2023-10-05T11:40:29.218+0000 7fc5fab4b880 5 AuthRegistry(0x563259da7c40) adding con mode: crc 2023-10-05T11:40:29.366 INFO:tasks.workunit.client.0.smithi012.stderr: -194> 2023-10-05T11:40:29.218+0000 7fc5fab4b880 5 AuthRegistry(0x563259da7c40) adding con mode: secure 2023-10-05T11:40:29.366 INFO:tasks.workunit.client.0.smithi012.stderr: -193> 2023-10-05T11:40:29.218+0000 7fc5fab4b880 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-10-05T11:40:29.366 INFO:tasks.workunit.client.0.smithi012.stderr: -192> 2023-10-05T11:40:29.218+0000 7fc5fab4b880 10 monclient: init 2023-10-05T11:40:29.366 INFO:tasks.workunit.client.0.smithi012.stderr: -191> 2023-10-05T11:40:29.218+0000 7fc5fab4b880 5 AuthRegistry(0x7fff2cd5e340) adding auth protocol: cephx 2023-10-05T11:40:29.366 INFO:tasks.workunit.client.0.smithi012.stderr: -190> 2023-10-05T11:40:29.218+0000 7fc5fab4b880 5 AuthRegistry(0x7fff2cd5e340) adding auth protocol: cephx 2023-10-05T11:40:29.366 INFO:tasks.workunit.client.0.smithi012.stderr: -189> 2023-10-05T11:40:29.218+0000 7fc5fab4b880 5 AuthRegistry(0x7fff2cd5e340) adding auth protocol: cephx 2023-10-05T11:40:29.367 INFO:tasks.workunit.client.0.smithi012.stderr: -188> 2023-10-05T11:40:29.218+0000 7fc5fab4b880 5 AuthRegistry(0x7fff2cd5e340) adding con mode: secure 2023-10-05T11:40:29.367 INFO:tasks.workunit.client.0.smithi012.stderr: -187> 2023-10-05T11:40:29.218+0000 7fc5fab4b880 5 AuthRegistry(0x7fff2cd5e340) adding con mode: crc 2023-10-05T11:40:29.367 INFO:tasks.workunit.client.0.smithi012.stderr: -186> 2023-10-05T11:40:29.218+0000 7fc5fab4b880 5 AuthRegistry(0x7fff2cd5e340) adding con mode: secure 2023-10-05T11:40:29.367 INFO:tasks.workunit.client.0.smithi012.stderr: -185> 2023-10-05T11:40:29.218+0000 7fc5fab4b880 5 AuthRegistry(0x7fff2cd5e340) adding con mode: crc 2023-10-05T11:40:29.367 INFO:tasks.workunit.client.0.smithi012.stderr: -184> 2023-10-05T11:40:29.218+0000 7fc5fab4b880 5 AuthRegistry(0x7fff2cd5e340) adding con mode: secure 2023-10-05T11:40:29.367 INFO:tasks.workunit.client.0.smithi012.stderr: -183> 2023-10-05T11:40:29.218+0000 7fc5fab4b880 5 AuthRegistry(0x7fff2cd5e340) adding con mode: crc 2023-10-05T11:40:29.367 INFO:tasks.workunit.client.0.smithi012.stderr: -182> 2023-10-05T11:40:29.218+0000 7fc5fab4b880 5 AuthRegistry(0x7fff2cd5e340) adding con mode: crc 2023-10-05T11:40:29.367 INFO:tasks.workunit.client.0.smithi012.stderr: -181> 2023-10-05T11:40:29.218+0000 7fc5fab4b880 5 AuthRegistry(0x7fff2cd5e340) adding con mode: secure 2023-10-05T11:40:29.367 INFO:tasks.workunit.client.0.smithi012.stderr: -180> 2023-10-05T11:40:29.218+0000 7fc5fab4b880 5 AuthRegistry(0x7fff2cd5e340) adding con mode: crc 2023-10-05T11:40:29.367 INFO:tasks.workunit.client.0.smithi012.stderr: -179> 2023-10-05T11:40:29.218+0000 7fc5fab4b880 5 AuthRegistry(0x7fff2cd5e340) adding con mode: secure 2023-10-05T11:40:29.367 INFO:tasks.workunit.client.0.smithi012.stderr: -178> 2023-10-05T11:40:29.218+0000 7fc5fab4b880 5 AuthRegistry(0x7fff2cd5e340) adding con mode: crc 2023-10-05T11:40:29.368 INFO:tasks.workunit.client.0.smithi012.stderr: -177> 2023-10-05T11:40:29.218+0000 7fc5fab4b880 5 AuthRegistry(0x7fff2cd5e340) adding con mode: secure 2023-10-05T11:40:29.368 INFO:tasks.workunit.client.0.smithi012.stderr: -176> 2023-10-05T11:40:29.218+0000 7fc5fab4b880 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-10-05T11:40:29.368 INFO:tasks.workunit.client.0.smithi012.stderr: -175> 2023-10-05T11:40:29.218+0000 7fc5fab4b880 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-10-05T11:40:29.368 INFO:tasks.workunit.client.0.smithi012.stderr: -174> 2023-10-05T11:40:29.219+0000 7fc5fab4b880 5 asok(0x5632592f6000) register_command rotate-key cmddesc rotate-key hook 0x7fff2cd5e488 EEXIST 2023-10-05T11:40:29.368 INFO:tasks.workunit.client.0.smithi012.stderr: -173> 2023-10-05T11:40:29.219+0000 7fc5fab4b880 10 monclient: _reopen_session rank -1 2023-10-05T11:40:29.368 INFO:tasks.workunit.client.0.smithi012.stderr: -172> 2023-10-05T11:40:29.219+0000 7fc5fab4b880 10 monclient: _add_conns ranks=[1,2,0] 2023-10-05T11:40:29.368 INFO:tasks.workunit.client.0.smithi012.stderr: -171> 2023-10-05T11:40:29.219+0000 7fc5fab4b880 10 monclient(hunting): picked mon.noname-b con 0x5632594dcc00 addr [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] 2023-10-05T11:40:29.368 INFO:tasks.workunit.client.0.smithi012.stderr: -170> 2023-10-05T11:40:29.219+0000 7fc5fab4b880 10 monclient(hunting): picked mon.noname-c con 0x5632594dd000 addr [v2:172.21.15.12:3301/0,v1:172.21.15.12:6790/0] 2023-10-05T11:40:29.368 INFO:tasks.workunit.client.0.smithi012.stderr: -169> 2023-10-05T11:40:29.219+0000 7fc5fab4b880 10 monclient(hunting): picked mon.noname-a con 0x5632594dd400 addr [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] 2023-10-05T11:40:29.368 INFO:tasks.workunit.client.0.smithi012.stderr: -168> 2023-10-05T11:40:29.219+0000 7fc5fab4b880 10 monclient(hunting): start opening mon connection 2023-10-05T11:40:29.368 INFO:tasks.workunit.client.0.smithi012.stderr: -167> 2023-10-05T11:40:29.219+0000 7fc5fab4b880 10 monclient(hunting): start opening mon connection 2023-10-05T11:40:29.368 INFO:tasks.workunit.client.0.smithi012.stderr: -166> 2023-10-05T11:40:29.219+0000 7fc5fab4b880 10 monclient(hunting): start opening mon connection 2023-10-05T11:40:29.369 INFO:tasks.workunit.client.0.smithi012.stderr: -165> 2023-10-05T11:40:29.219+0000 7fc5fab4b880 10 monclient(hunting): _renew_subs 2023-10-05T11:40:29.369 INFO:tasks.workunit.client.0.smithi012.stderr: -164> 2023-10-05T11:40:29.219+0000 7fc5fab4b880 10 monclient(hunting): authenticate will time out at 1537.387498s 2023-10-05T11:40:29.369 INFO:tasks.workunit.client.0.smithi012.stderr: -163> 2023-10-05T11:40:29.219+0000 7fc5f8aef640 10 monclient(hunting): get_auth_request con 0x5632594dd400 auth_method 0 2023-10-05T11:40:29.369 INFO:tasks.workunit.client.0.smithi012.stderr: -162> 2023-10-05T11:40:29.219+0000 7fc5f8aef640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-10-05T11:40:29.369 INFO:tasks.workunit.client.0.smithi012.stderr: -161> 2023-10-05T11:40:29.219+0000 7fc5f8aef640 10 monclient(hunting): _init_auth method 2 2023-10-05T11:40:29.369 INFO:tasks.workunit.client.0.smithi012.stderr: -160> 2023-10-05T11:40:29.219+0000 7fc5f8aef640 10 monclient(hunting): _init_auth creating new auth 2023-10-05T11:40:29.369 INFO:tasks.workunit.client.0.smithi012.stderr: -159> 2023-10-05T11:40:29.219+0000 7fc5f92f0640 10 monclient(hunting): get_auth_request con 0x5632594dd000 auth_method 0 2023-10-05T11:40:29.369 INFO:tasks.workunit.client.0.smithi012.stderr: -158> 2023-10-05T11:40:29.219+0000 7fc5f92f0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-10-05T11:40:29.369 INFO:tasks.workunit.client.0.smithi012.stderr: -157> 2023-10-05T11:40:29.219+0000 7fc5f92f0640 10 monclient(hunting): _init_auth method 2 2023-10-05T11:40:29.369 INFO:tasks.workunit.client.0.smithi012.stderr: -156> 2023-10-05T11:40:29.219+0000 7fc5f92f0640 10 monclient(hunting): _init_auth creating new auth 2023-10-05T11:40:29.369 INFO:tasks.workunit.client.0.smithi012.stderr: -155> 2023-10-05T11:40:29.219+0000 7fc5f8aef640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-10-05T11:40:29.370 INFO:tasks.workunit.client.0.smithi012.stderr: -154> 2023-10-05T11:40:29.219+0000 7fc5f8aef640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-10-05T11:40:29.370 INFO:tasks.workunit.client.0.smithi012.stderr: -153> 2023-10-05T11:40:29.219+0000 7fc5f8aef640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-10-05T11:40:29.370 INFO:tasks.workunit.client.0.smithi012.stderr: -152> 2023-10-05T11:40:29.219+0000 7fc5f92f0640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-10-05T11:40:29.370 INFO:tasks.workunit.client.0.smithi012.stderr: -151> 2023-10-05T11:40:29.219+0000 7fc5f92f0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-10-05T11:40:29.370 INFO:tasks.workunit.client.0.smithi012.stderr: -150> 2023-10-05T11:40:29.219+0000 7fc5f92f0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-10-05T11:40:29.370 INFO:tasks.workunit.client.0.smithi012.stderr: -149> 2023-10-05T11:40:29.219+0000 7fc5f9af1640 10 monclient(hunting): get_auth_request con 0x5632594dcc00 auth_method 0 2023-10-05T11:40:29.370 INFO:tasks.workunit.client.0.smithi012.stderr: -148> 2023-10-05T11:40:29.219+0000 7fc5f9af1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-10-05T11:40:29.370 INFO:tasks.workunit.client.0.smithi012.stderr: -147> 2023-10-05T11:40:29.219+0000 7fc5f9af1640 10 monclient(hunting): _init_auth method 2 2023-10-05T11:40:29.370 INFO:tasks.workunit.client.0.smithi012.stderr: -146> 2023-10-05T11:40:29.219+0000 7fc5f9af1640 10 monclient(hunting): _init_auth creating new auth 2023-10-05T11:40:29.370 INFO:tasks.workunit.client.0.smithi012.stderr: -145> 2023-10-05T11:40:29.219+0000 7fc5f92f0640 10 monclient(hunting): handle_auth_done global_id 6512 payload 274 2023-10-05T11:40:29.370 INFO:tasks.workunit.client.0.smithi012.stderr: -144> 2023-10-05T11:40:29.219+0000 7fc5f92f0640 10 monclient: _finish_hunting 0 2023-10-05T11:40:29.371 INFO:tasks.workunit.client.0.smithi012.stderr: -143> 2023-10-05T11:40:29.219+0000 7fc5f92f0640 1 monclient: found mon.noname-c 2023-10-05T11:40:29.371 INFO:tasks.workunit.client.0.smithi012.stderr: -142> 2023-10-05T11:40:29.219+0000 7fc5f92f0640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.12:3301/0 2023-10-05T11:40:29.371 INFO:tasks.workunit.client.0.smithi012.stderr: -141> 2023-10-05T11:40:29.219+0000 7fc5dfabd640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-10-05T11:40:29.371 INFO:tasks.workunit.client.0.smithi012.stderr: -140> 2023-10-05T11:40:29.219+0000 7fc5dfabd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2023-10-05T11:40:29.371 INFO:tasks.workunit.client.0.smithi012.stderr: -139> 2023-10-05T11:40:29.219+0000 7fc5dfabd640 10 monclient: dump: 2023-10-05T11:40:29.371 INFO:tasks.workunit.client.0.smithi012.stderr:epoch 1 2023-10-05T11:40:29.371 INFO:tasks.workunit.client.0.smithi012.stderr:fsid 7e015f46-293b-4b09-bd32-7d32b52f6e2f 2023-10-05T11:40:29.371 INFO:tasks.workunit.client.0.smithi012.stderr:last_changed 2023-10-05T11:27:38.366888+0000 2023-10-05T11:40:29.371 INFO:tasks.workunit.client.0.smithi012.stderr:created 2023-10-05T11:27:38.366888+0000 2023-10-05T11:40:29.371 INFO:tasks.workunit.client.0.smithi012.stderr:min_mon_release 18 (reef) 2023-10-05T11:40:29.371 INFO:tasks.workunit.client.0.smithi012.stderr:election_strategy: 1 2023-10-05T11:40:29.371 INFO:tasks.workunit.client.0.smithi012.stderr:0: [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon.a 2023-10-05T11:40:29.372 INFO:tasks.workunit.client.0.smithi012.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2023-10-05T11:40:29.372 INFO:tasks.workunit.client.0.smithi012.stderr:2: [v2:172.21.15.12:3301/0,v1:172.21.15.12:6790/0] mon.c 2023-10-05T11:40:29.372 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:40:29.372 INFO:tasks.workunit.client.0.smithi012.stderr: -138> 2023-10-05T11:40:29.219+0000 7fc5dfabd640 10 monclient: _finish_auth 0 2023-10-05T11:40:29.372 INFO:tasks.workunit.client.0.smithi012.stderr: -137> 2023-10-05T11:40:29.219+0000 7fc5dfabd640 10 monclient: _check_auth_tickets 2023-10-05T11:40:29.372 INFO:tasks.workunit.client.0.smithi012.stderr: -136> 2023-10-05T11:40:29.219+0000 7fc5dfabd640 10 monclient: handle_config config(0 keys) v1 2023-10-05T11:40:29.372 INFO:tasks.workunit.client.0.smithi012.stderr: -135> 2023-10-05T11:40:29.219+0000 7fc5dfabd640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-10-05T11:40:29.372 INFO:tasks.workunit.client.0.smithi012.stderr: -134> 2023-10-05T11:40:29.219+0000 7fc5dfabd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-10-05T11:40:29.372 INFO:tasks.workunit.client.0.smithi012.stderr: -133> 2023-10-05T11:40:29.219+0000 7fc5dfabd640 10 monclient: dump: 2023-10-05T11:40:29.372 INFO:tasks.workunit.client.0.smithi012.stderr:epoch 1 2023-10-05T11:40:29.372 INFO:tasks.workunit.client.0.smithi012.stderr:fsid 7e015f46-293b-4b09-bd32-7d32b52f6e2f 2023-10-05T11:40:29.372 INFO:tasks.workunit.client.0.smithi012.stderr:last_changed 2023-10-05T11:27:38.366888+0000 2023-10-05T11:40:29.373 INFO:tasks.workunit.client.0.smithi012.stderr:created 2023-10-05T11:27:38.366888+0000 2023-10-05T11:40:29.373 INFO:tasks.workunit.client.0.smithi012.stderr:min_mon_release 18 (reef) 2023-10-05T11:40:29.373 INFO:tasks.workunit.client.0.smithi012.stderr:election_strategy: 1 2023-10-05T11:40:29.373 INFO:tasks.workunit.client.0.smithi012.stderr:0: [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon.a 2023-10-05T11:40:29.373 INFO:tasks.workunit.client.0.smithi012.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2023-10-05T11:40:29.373 INFO:tasks.workunit.client.0.smithi012.stderr:2: [v2:172.21.15.12:3301/0,v1:172.21.15.12:6790/0] mon.c 2023-10-05T11:40:29.373 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:40:29.373 INFO:tasks.workunit.client.0.smithi012.stderr: -132> 2023-10-05T11:40:29.219+0000 7fc5fab4b880 5 monclient: authenticate success, global_id 6512 2023-10-05T11:40:29.373 INFO:tasks.workunit.client.0.smithi012.stderr: -131> 2023-10-05T11:40:29.219+0000 7fc5fab4b880 10 monclient: get_monmap_and_config success 2023-10-05T11:40:29.373 INFO:tasks.workunit.client.0.smithi012.stderr: -130> 2023-10-05T11:40:29.219+0000 7fc5fab4b880 4 set_mon_vals no callback set 2023-10-05T11:40:29.373 INFO:tasks.workunit.client.0.smithi012.stderr: -129> 2023-10-05T11:40:29.220+0000 7fc5fab4b880 10 monclient: shutdown 2023-10-05T11:40:29.373 INFO:tasks.workunit.client.0.smithi012.stderr: -128> 2023-10-05T11:40:29.220+0000 7fc5fab4b880 10 monclient: build_initial_monmap 2023-10-05T11:40:29.373 INFO:tasks.workunit.client.0.smithi012.stderr: -127> 2023-10-05T11:40:29.220+0000 7fc5fab4b880 1 build_initial for_mkfs: 0 2023-10-05T11:40:29.374 INFO:tasks.workunit.client.0.smithi012.stderr: -126> 2023-10-05T11:40:29.220+0000 7fc5fab4b880 10 monclient: monmap: 2023-10-05T11:40:29.374 INFO:tasks.workunit.client.0.smithi012.stderr:epoch 0 2023-10-05T11:40:29.374 INFO:tasks.workunit.client.0.smithi012.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-10-05T11:40:29.374 INFO:tasks.workunit.client.0.smithi012.stderr:last_changed 0.000000 2023-10-05T11:40:29.374 INFO:tasks.workunit.client.0.smithi012.stderr:created 0.000000 2023-10-05T11:40:29.374 INFO:tasks.workunit.client.0.smithi012.stderr:min_mon_release 0 (unknown) 2023-10-05T11:40:29.374 INFO:tasks.workunit.client.0.smithi012.stderr:election_strategy: 1 2023-10-05T11:40:29.374 INFO:tasks.workunit.client.0.smithi012.stderr:0: [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon.noname-a 2023-10-05T11:40:29.374 INFO:tasks.workunit.client.0.smithi012.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.noname-b 2023-10-05T11:40:29.374 INFO:tasks.workunit.client.0.smithi012.stderr:2: [v2:172.21.15.12:3301/0,v1:172.21.15.12:6790/0] mon.noname-c 2023-10-05T11:40:29.374 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:40:29.375 INFO:tasks.workunit.client.0.smithi012.stderr: -125> 2023-10-05T11:40:29.220+0000 7fc5fab4b880 5 AuthRegistry(0x563259da7c40) adding auth protocol: cephx 2023-10-05T11:40:29.375 INFO:tasks.workunit.client.0.smithi012.stderr: -124> 2023-10-05T11:40:29.220+0000 7fc5fab4b880 5 AuthRegistry(0x563259da7c40) adding auth protocol: cephx 2023-10-05T11:40:29.375 INFO:tasks.workunit.client.0.smithi012.stderr: -123> 2023-10-05T11:40:29.220+0000 7fc5fab4b880 5 AuthRegistry(0x563259da7c40) adding auth protocol: cephx 2023-10-05T11:40:29.375 INFO:tasks.workunit.client.0.smithi012.stderr: -122> 2023-10-05T11:40:29.220+0000 7fc5fab4b880 5 AuthRegistry(0x563259da7c40) adding con mode: secure 2023-10-05T11:40:29.375 INFO:tasks.workunit.client.0.smithi012.stderr: -121> 2023-10-05T11:40:29.220+0000 7fc5fab4b880 5 AuthRegistry(0x563259da7c40) adding con mode: crc 2023-10-05T11:40:29.375 INFO:tasks.workunit.client.0.smithi012.stderr: -120> 2023-10-05T11:40:29.220+0000 7fc5fab4b880 5 AuthRegistry(0x563259da7c40) adding con mode: secure 2023-10-05T11:40:29.375 INFO:tasks.workunit.client.0.smithi012.stderr: -119> 2023-10-05T11:40:29.220+0000 7fc5fab4b880 5 AuthRegistry(0x563259da7c40) adding con mode: crc 2023-10-05T11:40:29.375 INFO:tasks.workunit.client.0.smithi012.stderr: -118> 2023-10-05T11:40:29.220+0000 7fc5fab4b880 5 AuthRegistry(0x563259da7c40) adding con mode: secure 2023-10-05T11:40:29.375 INFO:tasks.workunit.client.0.smithi012.stderr: -117> 2023-10-05T11:40:29.220+0000 7fc5fab4b880 5 AuthRegistry(0x563259da7c40) adding con mode: crc 2023-10-05T11:40:29.375 INFO:tasks.workunit.client.0.smithi012.stderr: -116> 2023-10-05T11:40:29.220+0000 7fc5fab4b880 5 AuthRegistry(0x563259da7c40) adding con mode: crc 2023-10-05T11:40:29.375 INFO:tasks.workunit.client.0.smithi012.stderr: -115> 2023-10-05T11:40:29.220+0000 7fc5fab4b880 5 AuthRegistry(0x563259da7c40) adding con mode: secure 2023-10-05T11:40:29.375 INFO:tasks.workunit.client.0.smithi012.stderr: -114> 2023-10-05T11:40:29.220+0000 7fc5fab4b880 5 AuthRegistry(0x563259da7c40) adding con mode: crc 2023-10-05T11:40:29.375 INFO:tasks.workunit.client.0.smithi012.stderr: -113> 2023-10-05T11:40:29.220+0000 7fc5fab4b880 5 AuthRegistry(0x563259da7c40) adding con mode: secure 2023-10-05T11:40:29.376 INFO:tasks.workunit.client.0.smithi012.stderr: -112> 2023-10-05T11:40:29.220+0000 7fc5fab4b880 5 AuthRegistry(0x563259da7c40) adding con mode: crc 2023-10-05T11:40:29.376 INFO:tasks.workunit.client.0.smithi012.stderr: -111> 2023-10-05T11:40:29.220+0000 7fc5fab4b880 5 AuthRegistry(0x563259da7c40) adding con mode: secure 2023-10-05T11:40:29.376 INFO:tasks.workunit.client.0.smithi012.stderr: -110> 2023-10-05T11:40:29.220+0000 7fc5fab4b880 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-10-05T11:40:29.376 INFO:tasks.workunit.client.0.smithi012.stderr: -109> 2023-10-05T11:40:29.220+0000 7fc5fab4b880 1 librados: starting msgr at 2023-10-05T11:40:29.376 INFO:tasks.workunit.client.0.smithi012.stderr: -108> 2023-10-05T11:40:29.220+0000 7fc5fab4b880 1 librados: starting objecter 2023-10-05T11:40:29.376 INFO:tasks.workunit.client.0.smithi012.stderr: -107> 2023-10-05T11:40:29.220+0000 7fc5fab4b880 5 asok(0x5632592f6000) register_command objecter_requests cmddesc objecter_requests hook 0x5632590adca0 EEXIST 2023-10-05T11:40:29.376 INFO:tasks.workunit.client.0.smithi012.stderr: -106> 2023-10-05T11:40:29.220+0000 7fc5fab4b880 1 librados: setting wanted keys 2023-10-05T11:40:29.376 INFO:tasks.workunit.client.0.smithi012.stderr: -105> 2023-10-05T11:40:29.220+0000 7fc5fab4b880 1 librados: calling monclient init 2023-10-05T11:40:29.376 INFO:tasks.workunit.client.0.smithi012.stderr: -104> 2023-10-05T11:40:29.220+0000 7fc5fab4b880 10 monclient: init 2023-10-05T11:40:29.376 INFO:tasks.workunit.client.0.smithi012.stderr: -103> 2023-10-05T11:40:29.220+0000 7fc5fab4b880 5 AuthRegistry(0x5632594f60d8) adding auth protocol: cephx 2023-10-05T11:40:29.376 INFO:tasks.workunit.client.0.smithi012.stderr: -102> 2023-10-05T11:40:29.220+0000 7fc5fab4b880 5 AuthRegistry(0x5632594f60d8) adding auth protocol: cephx 2023-10-05T11:40:29.376 INFO:tasks.workunit.client.0.smithi012.stderr: -101> 2023-10-05T11:40:29.220+0000 7fc5fab4b880 5 AuthRegistry(0x5632594f60d8) adding auth protocol: cephx 2023-10-05T11:40:29.377 INFO:tasks.workunit.client.0.smithi012.stderr: -100> 2023-10-05T11:40:29.220+0000 7fc5fab4b880 5 AuthRegistry(0x5632594f60d8) adding con mode: secure 2023-10-05T11:40:29.377 INFO:tasks.workunit.client.0.smithi012.stderr: -99> 2023-10-05T11:40:29.220+0000 7fc5fab4b880 5 AuthRegistry(0x5632594f60d8) adding con mode: crc 2023-10-05T11:40:29.377 INFO:tasks.workunit.client.0.smithi012.stderr: -98> 2023-10-05T11:40:29.220+0000 7fc5fab4b880 5 AuthRegistry(0x5632594f60d8) adding con mode: secure 2023-10-05T11:40:29.377 INFO:tasks.workunit.client.0.smithi012.stderr: -97> 2023-10-05T11:40:29.220+0000 7fc5fab4b880 5 AuthRegistry(0x5632594f60d8) adding con mode: crc 2023-10-05T11:40:29.377 INFO:tasks.workunit.client.0.smithi012.stderr: -96> 2023-10-05T11:40:29.220+0000 7fc5fab4b880 5 AuthRegistry(0x5632594f60d8) adding con mode: secure 2023-10-05T11:40:29.377 INFO:tasks.workunit.client.0.smithi012.stderr: -95> 2023-10-05T11:40:29.220+0000 7fc5fab4b880 5 AuthRegistry(0x5632594f60d8) adding con mode: crc 2023-10-05T11:40:29.377 INFO:tasks.workunit.client.0.smithi012.stderr: -94> 2023-10-05T11:40:29.220+0000 7fc5fab4b880 5 AuthRegistry(0x5632594f60d8) adding con mode: crc 2023-10-05T11:40:29.377 INFO:tasks.workunit.client.0.smithi012.stderr: -93> 2023-10-05T11:40:29.220+0000 7fc5fab4b880 5 AuthRegistry(0x5632594f60d8) adding con mode: secure 2023-10-05T11:40:29.377 INFO:tasks.workunit.client.0.smithi012.stderr: -92> 2023-10-05T11:40:29.220+0000 7fc5fab4b880 5 AuthRegistry(0x5632594f60d8) adding con mode: crc 2023-10-05T11:40:29.377 INFO:tasks.workunit.client.0.smithi012.stderr: -91> 2023-10-05T11:40:29.220+0000 7fc5fab4b880 5 AuthRegistry(0x5632594f60d8) adding con mode: secure 2023-10-05T11:40:29.377 INFO:tasks.workunit.client.0.smithi012.stderr: -90> 2023-10-05T11:40:29.220+0000 7fc5fab4b880 5 AuthRegistry(0x5632594f60d8) adding con mode: crc 2023-10-05T11:40:29.377 INFO:tasks.workunit.client.0.smithi012.stderr: -89> 2023-10-05T11:40:29.220+0000 7fc5fab4b880 5 AuthRegistry(0x5632594f60d8) adding con mode: secure 2023-10-05T11:40:29.378 INFO:tasks.workunit.client.0.smithi012.stderr: -88> 2023-10-05T11:40:29.221+0000 7fc5fab4b880 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-10-05T11:40:29.378 INFO:tasks.workunit.client.0.smithi012.stderr: -87> 2023-10-05T11:40:29.221+0000 7fc5fab4b880 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-10-05T11:40:29.378 INFO:tasks.workunit.client.0.smithi012.stderr: -86> 2023-10-05T11:40:29.221+0000 7fc5fab4b880 5 asok(0x5632592f6000) register_command rotate-key cmddesc rotate-key hook 0x5632594f6220 EEXIST 2023-10-05T11:40:29.378 INFO:tasks.workunit.client.0.smithi012.stderr: -85> 2023-10-05T11:40:29.221+0000 7fc5fab4b880 10 monclient: _reopen_session rank -1 2023-10-05T11:40:29.378 INFO:tasks.workunit.client.0.smithi012.stderr: -84> 2023-10-05T11:40:29.221+0000 7fc5fab4b880 10 monclient: _add_conns ranks=[1,0,2] 2023-10-05T11:40:29.378 INFO:tasks.workunit.client.0.smithi012.stderr: -83> 2023-10-05T11:40:29.221+0000 7fc5fab4b880 10 monclient(hunting): picked mon.noname-b con 0x5632594dcc00 addr [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] 2023-10-05T11:40:29.378 INFO:tasks.workunit.client.0.smithi012.stderr: -82> 2023-10-05T11:40:29.221+0000 7fc5fab4b880 10 monclient(hunting): picked mon.noname-a con 0x5632594dd000 addr [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] 2023-10-05T11:40:29.378 INFO:tasks.workunit.client.0.smithi012.stderr: -81> 2023-10-05T11:40:29.221+0000 7fc5fab4b880 10 monclient(hunting): picked mon.noname-c con 0x5632594dd400 addr [v2:172.21.15.12:3301/0,v1:172.21.15.12:6790/0] 2023-10-05T11:40:29.378 INFO:tasks.workunit.client.0.smithi012.stderr: -80> 2023-10-05T11:40:29.221+0000 7fc5fab4b880 10 monclient(hunting): start opening mon connection 2023-10-05T11:40:29.378 INFO:tasks.workunit.client.0.smithi012.stderr: -79> 2023-10-05T11:40:29.221+0000 7fc5fab4b880 10 monclient(hunting): start opening mon connection 2023-10-05T11:40:29.378 INFO:tasks.workunit.client.0.smithi012.stderr: -78> 2023-10-05T11:40:29.221+0000 7fc5fab4b880 10 monclient(hunting): start opening mon connection 2023-10-05T11:40:29.378 INFO:tasks.workunit.client.0.smithi012.stderr: -77> 2023-10-05T11:40:29.221+0000 7fc5fab4b880 10 monclient(hunting): _renew_subs 2023-10-05T11:40:29.379 INFO:tasks.workunit.client.0.smithi012.stderr: -76> 2023-10-05T11:40:29.221+0000 7fc5fab4b880 10 monclient(hunting): authenticate will time out at 1537.389797s 2023-10-05T11:40:29.379 INFO:tasks.workunit.client.0.smithi012.stderr: -75> 2023-10-05T11:40:29.221+0000 7fc5f8aef640 10 monclient(hunting): get_auth_request con 0x5632594dd400 auth_method 0 2023-10-05T11:40:29.379 INFO:tasks.workunit.client.0.smithi012.stderr: -74> 2023-10-05T11:40:29.221+0000 7fc5f8aef640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-10-05T11:40:29.379 INFO:tasks.workunit.client.0.smithi012.stderr: -73> 2023-10-05T11:40:29.221+0000 7fc5f8aef640 10 monclient(hunting): _init_auth method 2 2023-10-05T11:40:29.379 INFO:tasks.workunit.client.0.smithi012.stderr: -72> 2023-10-05T11:40:29.221+0000 7fc5f8aef640 10 monclient(hunting): _init_auth creating new auth 2023-10-05T11:40:29.379 INFO:tasks.workunit.client.0.smithi012.stderr: -71> 2023-10-05T11:40:29.221+0000 7fc5f92f0640 10 monclient(hunting): get_auth_request con 0x5632594dd000 auth_method 0 2023-10-05T11:40:29.379 INFO:tasks.workunit.client.0.smithi012.stderr: -70> 2023-10-05T11:40:29.221+0000 7fc5f92f0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-10-05T11:40:29.379 INFO:tasks.workunit.client.0.smithi012.stderr: -69> 2023-10-05T11:40:29.221+0000 7fc5f92f0640 10 monclient(hunting): _init_auth method 2 2023-10-05T11:40:29.379 INFO:tasks.workunit.client.0.smithi012.stderr: -68> 2023-10-05T11:40:29.221+0000 7fc5f92f0640 10 monclient(hunting): _init_auth creating new auth 2023-10-05T11:40:29.379 INFO:tasks.workunit.client.0.smithi012.stderr: -67> 2023-10-05T11:40:29.221+0000 7fc5f92f0640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-10-05T11:40:29.379 INFO:tasks.workunit.client.0.smithi012.stderr: -66> 2023-10-05T11:40:29.221+0000 7fc5f92f0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-10-05T11:40:29.379 INFO:tasks.workunit.client.0.smithi012.stderr: -65> 2023-10-05T11:40:29.221+0000 7fc5f92f0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-10-05T11:40:29.380 INFO:tasks.workunit.client.0.smithi012.stderr: -64> 2023-10-05T11:40:29.221+0000 7fc5f8aef640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-10-05T11:40:29.380 INFO:tasks.workunit.client.0.smithi012.stderr: -63> 2023-10-05T11:40:29.221+0000 7fc5f8aef640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-10-05T11:40:29.380 INFO:tasks.workunit.client.0.smithi012.stderr: -62> 2023-10-05T11:40:29.221+0000 7fc5f8aef640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-10-05T11:40:29.380 INFO:tasks.workunit.client.0.smithi012.stderr: -61> 2023-10-05T11:40:29.221+0000 7fc5f8aef640 10 monclient(hunting): handle_auth_done global_id 6515 payload 824 2023-10-05T11:40:29.380 INFO:tasks.workunit.client.0.smithi012.stderr: -60> 2023-10-05T11:40:29.221+0000 7fc5f8aef640 10 monclient: _finish_hunting 0 2023-10-05T11:40:29.380 INFO:tasks.workunit.client.0.smithi012.stderr: -59> 2023-10-05T11:40:29.221+0000 7fc5f8aef640 1 monclient: found mon.noname-c 2023-10-05T11:40:29.380 INFO:tasks.workunit.client.0.smithi012.stderr: -58> 2023-10-05T11:40:29.221+0000 7fc5f8aef640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.12:3301/0 2023-10-05T11:40:29.380 INFO:tasks.workunit.client.0.smithi012.stderr: -57> 2023-10-05T11:40:29.221+0000 7fc5de2ba640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-10-05T11:40:29.380 INFO:tasks.workunit.client.0.smithi012.stderr: -56> 2023-10-05T11:40:29.221+0000 7fc5de2ba640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2023-10-05T11:40:29.380 INFO:tasks.workunit.client.0.smithi012.stderr: -55> 2023-10-05T11:40:29.221+0000 7fc5de2ba640 10 monclient: dump: 2023-10-05T11:40:29.380 INFO:tasks.workunit.client.0.smithi012.stderr:epoch 1 2023-10-05T11:40:29.381 INFO:tasks.workunit.client.0.smithi012.stderr:fsid 7e015f46-293b-4b09-bd32-7d32b52f6e2f 2023-10-05T11:40:29.381 INFO:tasks.workunit.client.0.smithi012.stderr:last_changed 2023-10-05T11:27:38.366888+0000 2023-10-05T11:40:29.381 INFO:tasks.workunit.client.0.smithi012.stderr:created 2023-10-05T11:27:38.366888+0000 2023-10-05T11:40:29.381 INFO:tasks.workunit.client.0.smithi012.stderr:min_mon_release 18 (reef) 2023-10-05T11:40:29.381 INFO:tasks.workunit.client.0.smithi012.stderr:election_strategy: 1 2023-10-05T11:40:29.381 INFO:tasks.workunit.client.0.smithi012.stderr:0: [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon.a 2023-10-05T11:40:29.381 INFO:tasks.workunit.client.0.smithi012.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2023-10-05T11:40:29.381 INFO:tasks.workunit.client.0.smithi012.stderr:2: [v2:172.21.15.12:3301/0,v1:172.21.15.12:6790/0] mon.c 2023-10-05T11:40:29.381 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:40:29.381 INFO:tasks.workunit.client.0.smithi012.stderr: -54> 2023-10-05T11:40:29.221+0000 7fc5de2ba640 10 monclient: _finish_auth 0 2023-10-05T11:40:29.381 INFO:tasks.workunit.client.0.smithi012.stderr: -53> 2023-10-05T11:40:29.221+0000 7fc5de2ba640 10 monclient: _check_auth_tickets 2023-10-05T11:40:29.381 INFO:tasks.workunit.client.0.smithi012.stderr: -52> 2023-10-05T11:40:29.221+0000 7fc5de2ba640 10 monclient: handle_config config(0 keys) v1 2023-10-05T11:40:29.381 INFO:tasks.workunit.client.0.smithi012.stderr: -51> 2023-10-05T11:40:29.221+0000 7fc5fab4b880 5 monclient: authenticate success, global_id 6515 2023-10-05T11:40:29.382 INFO:tasks.workunit.client.0.smithi012.stderr: -50> 2023-10-05T11:40:29.221+0000 7fc5dfabd640 4 set_mon_vals no callback set 2023-10-05T11:40:29.382 INFO:tasks.workunit.client.0.smithi012.stderr: -49> 2023-10-05T11:40:29.221+0000 7fc5fab4b880 10 monclient: _renew_subs 2023-10-05T11:40:29.382 INFO:tasks.workunit.client.0.smithi012.stderr: -48> 2023-10-05T11:40:29.221+0000 7fc5fab4b880 10 monclient: _send_mon_message to mon.c at v2:172.21.15.12:3301/0 2023-10-05T11:40:29.382 INFO:tasks.workunit.client.0.smithi012.stderr: -47> 2023-10-05T11:40:29.222+0000 7fc5de2ba640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-10-05T11:40:29.382 INFO:tasks.workunit.client.0.smithi012.stderr: -46> 2023-10-05T11:40:29.222+0000 7fc5de2ba640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-10-05T11:40:29.382 INFO:tasks.workunit.client.0.smithi012.stderr: -45> 2023-10-05T11:40:29.222+0000 7fc5de2ba640 10 monclient: dump: 2023-10-05T11:40:29.382 INFO:tasks.workunit.client.0.smithi012.stderr:epoch 1 2023-10-05T11:40:29.382 INFO:tasks.workunit.client.0.smithi012.stderr:fsid 7e015f46-293b-4b09-bd32-7d32b52f6e2f 2023-10-05T11:40:29.382 INFO:tasks.workunit.client.0.smithi012.stderr:last_changed 2023-10-05T11:27:38.366888+0000 2023-10-05T11:40:29.382 INFO:tasks.workunit.client.0.smithi012.stderr:created 2023-10-05T11:27:38.366888+0000 2023-10-05T11:40:29.382 INFO:tasks.workunit.client.0.smithi012.stderr:min_mon_release 18 (reef) 2023-10-05T11:40:29.382 INFO:tasks.workunit.client.0.smithi012.stderr:election_strategy: 1 2023-10-05T11:40:29.383 INFO:tasks.workunit.client.0.smithi012.stderr:0: [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon.a 2023-10-05T11:40:29.383 INFO:tasks.workunit.client.0.smithi012.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2023-10-05T11:40:29.383 INFO:tasks.workunit.client.0.smithi012.stderr:2: [v2:172.21.15.12:3301/0,v1:172.21.15.12:6790/0] mon.c 2023-10-05T11:40:29.383 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:40:29.383 INFO:tasks.workunit.client.0.smithi012.stderr: -44> 2023-10-05T11:40:29.222+0000 7fc5fab4b880 10 monclient: _renew_subs 2023-10-05T11:40:29.383 INFO:tasks.workunit.client.0.smithi012.stderr: -43> 2023-10-05T11:40:29.222+0000 7fc5fab4b880 10 monclient: _send_mon_message to mon.c at v2:172.21.15.12:3301/0 2023-10-05T11:40:29.383 INFO:tasks.workunit.client.0.smithi012.stderr: -42> 2023-10-05T11:40:29.222+0000 7fc5fab4b880 1 librados: init done 2023-10-05T11:40:29.383 INFO:tasks.workunit.client.0.smithi012.stderr: -41> 2023-10-05T11:40:29.222+0000 7fc5fab4b880 5 asok(0x5632592f6000) register_command cr dump hook 0x563259eb5408 2023-10-05T11:40:29.383 INFO:tasks.workunit.client.0.smithi012.stderr: -40> 2023-10-05T11:40:29.223+0000 7fc5de2ba640 4 mgrc handle_mgr_map Got map version 5 2023-10-05T11:40:29.383 INFO:tasks.workunit.client.0.smithi012.stderr: -39> 2023-10-05T11:40:29.223+0000 7fc5de2ba640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.170:6832/180516904,v1:172.21.15.170:6833/180516904] 2023-10-05T11:40:29.383 INFO:tasks.workunit.client.0.smithi012.stderr: -38> 2023-10-05T11:40:29.223+0000 7fc5de2ba640 4 mgrc reconnect Starting new session with [v2:172.21.15.170:6832/180516904,v1:172.21.15.170:6833/180516904] 2023-10-05T11:40:29.384 INFO:tasks.workunit.client.0.smithi012.stderr: -37> 2023-10-05T11:40:29.223+0000 7fc5fab4b880 5 note: GC not initialized 2023-10-05T11:40:29.384 INFO:tasks.workunit.client.0.smithi012.stderr: -36> 2023-10-05T11:40:29.223+0000 7fc5f9af1640 10 monclient: get_auth_request con 0x56325952b000 auth_method 0 2023-10-05T11:40:29.384 INFO:tasks.workunit.client.0.smithi012.stderr: -35> 2023-10-05T11:40:29.223+0000 7fc5dbab5640 20 reqs_thread_entry: start 2023-10-05T11:40:29.384 INFO:tasks.workunit.client.0.smithi012.stderr: -34> 2023-10-05T11:40:29.223+0000 7fc5fab4b880 5 asok(0x5632592f6000) register_command sync trace show hook 0x563259040a80 2023-10-05T11:40:29.384 INFO:tasks.workunit.client.0.smithi012.stderr: -33> 2023-10-05T11:40:29.223+0000 7fc5fab4b880 5 asok(0x5632592f6000) register_command sync trace history hook 0x563259040a80 2023-10-05T11:40:29.384 INFO:tasks.workunit.client.0.smithi012.stderr: -32> 2023-10-05T11:40:29.223+0000 7fc5fab4b880 5 asok(0x5632592f6000) register_command sync trace active hook 0x563259040a80 2023-10-05T11:40:29.384 INFO:tasks.workunit.client.0.smithi012.stderr: -31> 2023-10-05T11:40:29.223+0000 7fc5fab4b880 5 asok(0x5632592f6000) register_command sync trace active_short hook 0x563259040a80 2023-10-05T11:40:29.384 INFO:tasks.workunit.client.0.smithi012.stderr: -30> 2023-10-05T11:40:29.223+0000 7fc5fab4b880 20 init_complete bucket index max shards: 11 2023-10-05T11:40:29.384 INFO:tasks.workunit.client.0.smithi012.stderr: -29> 2023-10-05T11:40:29.223+0000 7fc5fab4b880 20 Filter name: none 2023-10-05T11:40:29.384 INFO:tasks.workunit.client.0.smithi012.stderr: -28> 2023-10-05T11:40:29.224+0000 7fc5d9ab1640 20 reqs_thread_entry: start 2023-10-05T11:40:29.384 INFO:tasks.workunit.client.0.smithi012.stderr: -27> 2023-10-05T11:40:29.224+0000 7fc5fab4b880 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2023-10-05T11:40:29.384 INFO:tasks.workunit.client.0.smithi012.stderr: -26> 2023-10-05T11:40:29.224+0000 7fc5fab4b880 20 rados->read ofs=0 len=0 2023-10-05T11:40:29.384 INFO:tasks.workunit.client.0.smithi012.stderr: -25> 2023-10-05T11:40:29.224+0000 7fc5fab4b880 20 rados_obj.operate() r=0 bl.length=213 2023-10-05T11:40:29.385 INFO:tasks.workunit.client.0.smithi012.stderr: -24> 2023-10-05T11:40:29.224+0000 7fc5fab4b880 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2023-10-05T11:40:29.385 INFO:tasks.workunit.client.0.smithi012.stderr: -23> 2023-10-05T11:40:29.224+0000 7fc5fab4b880 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2023-10-05T11:40:29.385 INFO:tasks.workunit.client.0.smithi012.stderr: -22> 2023-10-05T11:40:29.224+0000 7fc5fab4b880 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dff27d1e-df33-400e-a68a-7ba586947c99.4604.22 : miss 2023-10-05T11:40:29.385 INFO:tasks.workunit.client.0.smithi012.stderr: -21> 2023-10-05T11:40:29.224+0000 7fc5fab4b880 20 rados->read ofs=0 len=0 2023-10-05T11:40:29.385 INFO:tasks.workunit.client.0.smithi012.stderr: -20> 2023-10-05T11:40:29.225+0000 7fc5fab4b880 20 rados_obj.operate() r=0 bl.length=385 2023-10-05T11:40:29.385 INFO:tasks.workunit.client.0.smithi012.stderr: -19> 2023-10-05T11:40:29.225+0000 7fc5fab4b880 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dff27d1e-df33-400e-a68a-7ba586947c99.4604.22 info.flags=0x17 2023-10-05T11:40:29.385 INFO:tasks.workunit.client.0.smithi012.stderr: -18> 2023-10-05T11:40:29.225+0000 7fc5fab4b880 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dff27d1e-df33-400e-a68a-7ba586947c99.4604.22 to cache LRU end 2023-10-05T11:40:29.385 INFO:tasks.workunit.client.0.smithi012.stderr: -17> 2023-10-05T11:40:29.225+0000 7fc5fab4b880 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T11:40:29.385 INFO:tasks.workunit.client.0.smithi012.stderr: -16> 2023-10-05T11:40:29.225+0000 7fc5fab4b880 10 updating xattr: name=user.rgw.acl bl.length()=265 2023-10-05T11:40:29.385 INFO:tasks.workunit.client.0.smithi012.stderr: -15> 2023-10-05T11:40:29.225+0000 7fc5fab4b880 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dff27d1e-df33-400e-a68a-7ba586947c99.4604.22 2023-10-05T11:40:29.385 INFO:tasks.workunit.client.0.smithi012.stderr: -14> 2023-10-05T11:40:29.225+0000 7fc5f92f0640 10 monclient: get_auth_request con 0x5632594ddc00 auth_method 0 2023-10-05T11:40:29.385 INFO:tasks.workunit.client.0.smithi012.stderr: -13> 2023-10-05T11:40:29.230+0000 7fc5fab4b880 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dff27d1e-df33-400e-a68a-7ba586947c99.4604.22 info.flags=0x17 2023-10-05T11:40:29.386 INFO:tasks.workunit.client.0.smithi012.stderr: -12> 2023-10-05T11:40:29.230+0000 7fc5fab4b880 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dff27d1e-df33-400e-a68a-7ba586947c99.4604.22 to cache LRU end 2023-10-05T11:40:29.386 INFO:tasks.workunit.client.0.smithi012.stderr: -11> 2023-10-05T11:40:29.230+0000 7fc5fab4b880 10 updating xattr: name=user.rgw.acl bl.length()=265 2023-10-05T11:40:29.386 INFO:tasks.workunit.client.0.smithi012.stderr: -10> 2023-10-05T11:40:29.230+0000 7fc5fab4b880 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:dff27d1e-df33-400e-a68a-7ba586947c99.4604.22, ofs0, ns] 2023-10-05T11:40:29.386 INFO:tasks.workunit.client.0.smithi012.stderr: -9> 2023-10-05T11:40:29.231+0000 7fc5f3ae5640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1060856922165 cookie 94774246504448 notifier 6822 bl.length()=949 2023-10-05T11:40:29.386 INFO:tasks.workunit.client.0.smithi012.stderr: -8> 2023-10-05T11:40:29.231+0000 7fc5f3ae5640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dff27d1e-df33-400e-a68a-7ba586947c99.4604.22 info.flags=0x17 2023-10-05T11:40:29.386 INFO:tasks.workunit.client.0.smithi012.stderr: -7> 2023-10-05T11:40:29.231+0000 7fc5f3ae5640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dff27d1e-df33-400e-a68a-7ba586947c99.4604.22 to cache LRU end 2023-10-05T11:40:29.386 INFO:tasks.workunit.client.0.smithi012.stderr: -6> 2023-10-05T11:40:29.231+0000 7fc5f3ae5640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2023-10-05T11:40:29.386 INFO:tasks.workunit.client.0.smithi012.stderr: -5> 2023-10-05T11:40:29.233+0000 7fc5fab4b880 20 handle_bi_update(): bucket=:abort-at-block-writes[dff27d1e-df33-400e-a68a-7ba586947c99.4604.22]): orig_sources= new_sources= 2023-10-05T11:40:29.386 INFO:tasks.workunit.client.0.smithi012.stderr: -4> 2023-10-05T11:40:29.233+0000 7fc5fab4b880 20 handle_bi_update(): bucket=:abort-at-block-writes[dff27d1e-df33-400e-a68a-7ba586947c99.4604.22]): potential sources added=[] removed=[] 2023-10-05T11:40:29.386 INFO:tasks.workunit.client.0.smithi012.stderr: -3> 2023-10-05T11:40:29.233+0000 7fc5fab4b880 20 handle_bi_update(): bucket=:abort-at-block-writes[dff27d1e-df33-400e-a68a-7ba586947c99.4604.22]): orig_dests= new_dests= 2023-10-05T11:40:29.386 INFO:tasks.workunit.client.0.smithi012.stderr: -2> 2023-10-05T11:40:29.233+0000 7fc5fab4b880 20 handle_bi_update(): bucket=:abort-at-block-writes[dff27d1e-df33-400e-a68a-7ba586947c99.4604.22]): potential dests added=[] removed=[] 2023-10-05T11:40:29.387 INFO:tasks.workunit.client.0.smithi012.stderr: -1> 2023-10-05T11:40:29.233+0000 7fc5fab4b880 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6543-g38321be8/rpm/el9/BUILD/ceph-18.0.0-6543-g38321be8/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fc5fab4b880 time 2023-10-05T11:40:29.234434+0000 2023-10-05T11:40:29.387 INFO:tasks.workunit.client.0.smithi012.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6543-g38321be8/rpm/el9/BUILD/ceph-18.0.0-6543-g38321be8/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2023-10-05T11:40:29.387 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:40:29.387 INFO:tasks.workunit.client.0.smithi012.stderr: ceph version 18.0.0-6543-g38321be8 (38321be854743c0d616618a9ea8aa0b1d4dbc0bf) reef (dev) 2023-10-05T11:40:29.387 INFO:tasks.workunit.client.0.smithi012.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fc5ff76d15f] 2023-10-05T11:40:29.387 INFO:tasks.workunit.client.0.smithi012.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16d31d) [0x7fc5ff76d31d] 2023-10-05T11:40:29.387 INFO:tasks.workunit.client.0.smithi012.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56325759ac31] 2023-10-05T11:40:29.387 INFO:tasks.workunit.client.0.smithi012.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x2a4) [0x5632575b1734] 2023-10-05T11:40:29.387 INFO:tasks.workunit.client.0.smithi012.stderr: 5: main() 2023-10-05T11:40:29.387 INFO:tasks.workunit.client.0.smithi012.stderr: 6: /lib64/libc.so.6(+0x3feb0) [0x7fc5fcc3feb0] 2023-10-05T11:40:29.388 INFO:tasks.workunit.client.0.smithi012.stderr: 7: __libc_start_main() 2023-10-05T11:40:29.388 INFO:tasks.workunit.client.0.smithi012.stderr: 8: _start() 2023-10-05T11:40:29.388 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:40:29.388 INFO:tasks.workunit.client.0.smithi012.stderr: 0> 2023-10-05T11:40:29.234+0000 7fc5fab4b880 -1 *** Caught signal (Aborted) ** 2023-10-05T11:40:29.388 INFO:tasks.workunit.client.0.smithi012.stderr: in thread 7fc5fab4b880 thread_name:radosgw-admin 2023-10-05T11:40:29.388 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:40:29.388 INFO:tasks.workunit.client.0.smithi012.stderr: ceph version 18.0.0-6543-g38321be8 (38321be854743c0d616618a9ea8aa0b1d4dbc0bf) reef (dev) 2023-10-05T11:40:29.388 INFO:tasks.workunit.client.0.smithi012.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7fc5fcc54db0] 2023-10-05T11:40:29.388 INFO:tasks.workunit.client.0.smithi012.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7fc5fcca154c] 2023-10-05T11:40:29.388 INFO:tasks.workunit.client.0.smithi012.stderr: 3: raise() 2023-10-05T11:40:29.388 INFO:tasks.workunit.client.0.smithi012.stderr: 4: abort() 2023-10-05T11:40:29.388 INFO:tasks.workunit.client.0.smithi012.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fc5ff76d1b9] 2023-10-05T11:40:29.389 INFO:tasks.workunit.client.0.smithi012.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16d31d) [0x7fc5ff76d31d] 2023-10-05T11:40:29.389 INFO:tasks.workunit.client.0.smithi012.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56325759ac31] 2023-10-05T11:40:29.389 INFO:tasks.workunit.client.0.smithi012.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x2a4) [0x5632575b1734] 2023-10-05T11:40:29.389 INFO:tasks.workunit.client.0.smithi012.stderr: 9: main() 2023-10-05T11:40:29.389 INFO:tasks.workunit.client.0.smithi012.stderr: 10: /lib64/libc.so.6(+0x3feb0) [0x7fc5fcc3feb0] 2023-10-05T11:40:29.389 INFO:tasks.workunit.client.0.smithi012.stderr: 11: __libc_start_main() 2023-10-05T11:40:29.389 INFO:tasks.workunit.client.0.smithi012.stderr: 12: _start() 2023-10-05T11:40:29.389 INFO:tasks.workunit.client.0.smithi012.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-10-05T11:40:29.389 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:40:29.389 INFO:tasks.workunit.client.0.smithi012.stderr:--- logging levels --- 2023-10-05T11:40:29.389 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 none 2023-10-05T11:40:29.390 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 1 lockdep 2023-10-05T11:40:29.390 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 1 context 2023-10-05T11:40:29.390 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 1 crush 2023-10-05T11:40:29.390 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 mds 2023-10-05T11:40:29.390 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 mds_balancer 2023-10-05T11:40:29.390 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 mds_locker 2023-10-05T11:40:29.390 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 mds_log 2023-10-05T11:40:29.390 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 mds_log_expire 2023-10-05T11:40:29.390 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 mds_migrator 2023-10-05T11:40:29.390 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 1 buffer 2023-10-05T11:40:29.390 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 1 timer 2023-10-05T11:40:29.391 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 1 filer 2023-10-05T11:40:29.391 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 1 striper 2023-10-05T11:40:29.391 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 1 objecter 2023-10-05T11:40:29.391 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 rados 2023-10-05T11:40:29.391 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 rbd 2023-10-05T11:40:29.391 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 rbd_mirror 2023-10-05T11:40:29.391 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 rbd_replay 2023-10-05T11:40:29.391 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 rbd_pwl 2023-10-05T11:40:29.391 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 journaler 2023-10-05T11:40:29.391 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 objectcacher 2023-10-05T11:40:29.391 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 immutable_obj_cache 2023-10-05T11:40:29.392 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 client 2023-10-05T11:40:29.392 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 osd 2023-10-05T11:40:29.392 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 optracker 2023-10-05T11:40:29.392 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 objclass 2023-10-05T11:40:29.392 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 3 filestore 2023-10-05T11:40:29.392 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 3 journal 2023-10-05T11:40:29.392 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 0 ms 2023-10-05T11:40:29.392 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 mon 2023-10-05T11:40:29.392 INFO:tasks.workunit.client.0.smithi012.stderr: 0/10 monc 2023-10-05T11:40:29.392 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 paxos 2023-10-05T11:40:29.392 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 tp 2023-10-05T11:40:29.392 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 auth 2023-10-05T11:40:29.393 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 crypto 2023-10-05T11:40:29.393 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 1 finisher 2023-10-05T11:40:29.393 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 1 reserver 2023-10-05T11:40:29.393 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 heartbeatmap 2023-10-05T11:40:29.393 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 perfcounter 2023-10-05T11:40:29.393 INFO:tasks.workunit.client.0.smithi012.stderr: 20/20 rgw 2023-10-05T11:40:29.393 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 rgw_sync 2023-10-05T11:40:29.393 INFO:tasks.workunit.client.0.smithi012.stderr: 30/30 rgw_datacache 2023-10-05T11:40:29.393 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 rgw_access 2023-10-05T11:40:29.393 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 rgw_dbstore 2023-10-05T11:40:29.393 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 rgw_flight 2023-10-05T11:40:29.393 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 javaclient 2023-10-05T11:40:29.394 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 asok 2023-10-05T11:40:29.394 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 1 throttle 2023-10-05T11:40:29.394 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 0 refs 2023-10-05T11:40:29.394 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 compressor 2023-10-05T11:40:29.394 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 bluestore 2023-10-05T11:40:29.394 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 bluefs 2023-10-05T11:40:29.394 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 3 bdev 2023-10-05T11:40:29.394 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 kstore 2023-10-05T11:40:29.394 INFO:tasks.workunit.client.0.smithi012.stderr: 4/ 5 rocksdb 2023-10-05T11:40:29.394 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 fuse 2023-10-05T11:40:29.394 INFO:tasks.workunit.client.0.smithi012.stderr: 2/ 5 mgr 2023-10-05T11:40:29.395 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 mgrc 2023-10-05T11:40:29.395 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 dpdk 2023-10-05T11:40:29.395 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 eventtrace 2023-10-05T11:40:29.395 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 prioritycache 2023-10-05T11:40:29.395 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 test 2023-10-05T11:40:29.395 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 cephfs_mirror 2023-10-05T11:40:29.395 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 cephsqlite 2023-10-05T11:40:29.395 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 seastore 2023-10-05T11:40:29.395 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 seastore_onode 2023-10-05T11:40:29.395 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 seastore_odata 2023-10-05T11:40:29.395 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 seastore_omap 2023-10-05T11:40:29.395 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 seastore_tm 2023-10-05T11:40:29.395 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 seastore_t 2023-10-05T11:40:29.396 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 seastore_cleaner 2023-10-05T11:40:29.396 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 seastore_epm 2023-10-05T11:40:29.396 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 seastore_lba 2023-10-05T11:40:29.396 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 seastore_fixedkv_tree 2023-10-05T11:40:29.396 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 seastore_cache 2023-10-05T11:40:29.396 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 seastore_journal 2023-10-05T11:40:29.396 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 seastore_device 2023-10-05T11:40:29.396 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 seastore_backref 2023-10-05T11:40:29.396 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 alienstore 2023-10-05T11:40:29.396 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 mclock 2023-10-05T11:40:29.396 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 cyanstore 2023-10-05T11:40:29.396 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 ceph_exporter 2023-10-05T11:40:29.397 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 memstore 2023-10-05T11:40:29.397 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 trace 2023-10-05T11:40:29.397 INFO:tasks.workunit.client.0.smithi012.stderr: -2/-2 (syslog threshold) 2023-10-05T11:40:29.397 INFO:tasks.workunit.client.0.smithi012.stderr: 99/99 (stderr threshold) 2023-10-05T11:40:29.397 INFO:tasks.workunit.client.0.smithi012.stderr:--- pthread ID / name mapping for recent threads --- 2023-10-05T11:40:29.397 INFO:tasks.workunit.client.0.smithi012.stderr: 7fc5d9ab1640 / http_manager 2023-10-05T11:40:29.397 INFO:tasks.workunit.client.0.smithi012.stderr: 7fc5dbab5640 / http_manager 2023-10-05T11:40:29.397 INFO:tasks.workunit.client.0.smithi012.stderr: 7fc5de2ba640 / ms_dispatch 2023-10-05T11:40:29.397 INFO:tasks.workunit.client.0.smithi012.stderr: 7fc5dfabd640 / io_context_pool 2023-10-05T11:40:29.397 INFO:tasks.workunit.client.0.smithi012.stderr: 7fc5e02be640 / rgw_dt_lg_renew 2023-10-05T11:40:29.397 INFO:tasks.workunit.client.0.smithi012.stderr: 7fc5f22e2640 / ms_dispatch 2023-10-05T11:40:29.397 INFO:tasks.workunit.client.0.smithi012.stderr: 7fc5f3ae5640 / io_context_pool 2023-10-05T11:40:29.398 INFO:tasks.workunit.client.0.smithi012.stderr: 7fc5f62ea640 / ms_dispatch 2023-10-05T11:40:29.398 INFO:tasks.workunit.client.0.smithi012.stderr: 7fc5f7aed640 / io_context_pool 2023-10-05T11:40:29.398 INFO:tasks.workunit.client.0.smithi012.stderr: 7fc5f8aef640 / msgr-worker-2 2023-10-05T11:40:29.398 INFO:tasks.workunit.client.0.smithi012.stderr: 7fc5f92f0640 / msgr-worker-1 2023-10-05T11:40:29.398 INFO:tasks.workunit.client.0.smithi012.stderr: 7fc5f9af1640 / msgr-worker-0 2023-10-05T11:40:29.398 INFO:tasks.workunit.client.0.smithi012.stderr: 7fc5fab4b880 / radosgw-admin 2023-10-05T11:40:29.398 INFO:tasks.workunit.client.0.smithi012.stderr: max_recent 500 2023-10-05T11:40:29.398 INFO:tasks.workunit.client.0.smithi012.stderr: max_new 1000 2023-10-05T11:40:29.398 INFO:tasks.workunit.client.0.smithi012.stderr: log_file /var/lib/ceph/crash/2023-10-05T11:40:29.235775Z_6962fb9b-e1bc-4a33-b1b9-c6938d635662/log 2023-10-05T11:40:29.398 INFO:tasks.workunit.client.0.smithi012.stderr:--- end dump of recent events --- 2023-10-05T11:40:29.398 INFO:tasks.workunit.client.0.smithi012.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2023-10-05T11:40:29.403 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setuser ceph since I am not root 2023-10-05T11:40:29.403 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T11:40:29.404 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.281+0000 7fadb7f36880 20 rados->read ofs=0 len=0 2023-10-05T11:40:29.404 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.283+0000 7fadb7f36880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:40:29.404 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.283+0000 7fadb7f36880 20 realm 2023-10-05T11:40:29.404 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.283+0000 7fadb7f36880 20 rados->read ofs=0 len=0 2023-10-05T11:40:29.404 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.283+0000 7fadb7f36880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:40:29.404 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.283+0000 7fadb7f36880 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T11:40:29.404 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.283+0000 7fadb7f36880 20 rados->read ofs=0 len=0 2023-10-05T11:40:29.404 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.283+0000 7fadb7f36880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:40:29.404 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.283+0000 7fadb7f36880 20 rados->read ofs=0 len=0 2023-10-05T11:40:29.404 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.284+0000 7fadb7f36880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:40:29.404 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.284+0000 7fadb7f36880 20 rados->read ofs=0 len=0 2023-10-05T11:40:29.405 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.285+0000 7fadb7f36880 20 rados_obj.operate() r=0 bl.length=1020 2023-10-05T11:40:29.405 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.285+0000 7fadb7f36880 20 searching for the correct realm 2023-10-05T11:40:29.405 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.294+0000 7fadb4979640 0 -- 172.21.15.12:0/3342182103 >> [v2:172.21.15.170:6814/3150808418,v1:172.21.15.170:6816/3150808418] conn(0x55ea10cd3800 msgr2=0x55ea100e0c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:40:29.405 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.295+0000 7fadb7f36880 20 RGWRados::pool_iterate: got zone_info.dff27d1e-df33-400e-a68a-7ba586947c99 2023-10-05T11:40:29.405 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.295+0000 7fadb7f36880 20 RGWRados::pool_iterate: got zonegroup_info.c78aa576-9d15-4e9d-b3c0-4af23a22062c 2023-10-05T11:40:29.405 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.295+0000 7fadb7f36880 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T11:40:29.405 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.295+0000 7fadb7f36880 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T11:40:29.405 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.295+0000 7fadb7f36880 20 rados->read ofs=0 len=0 2023-10-05T11:40:29.405 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.295+0000 7fadb7f36880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:40:29.405 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.295+0000 7fadb7f36880 20 rados->read ofs=0 len=0 2023-10-05T11:40:29.406 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.296+0000 7fadb7f36880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:40:29.406 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.296+0000 7fadb7f36880 20 rados->read ofs=0 len=0 2023-10-05T11:40:29.406 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.296+0000 7fadb7f36880 20 rados_obj.operate() r=0 bl.length=454 2023-10-05T11:40:29.406 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.296+0000 7fadb7f36880 20 zone default found 2023-10-05T11:40:29.406 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.296+0000 7fadb7f36880 4 Realm: () 2023-10-05T11:40:29.406 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.296+0000 7fadb7f36880 4 ZoneGroup: default (c78aa576-9d15-4e9d-b3c0-4af23a22062c) 2023-10-05T11:40:29.406 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.296+0000 7fadb7f36880 4 Zone: default (dff27d1e-df33-400e-a68a-7ba586947c99) 2023-10-05T11:40:29.406 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.296+0000 7fadb7f36880 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T11:40:29.406 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.296+0000 7fadb7f36880 20 zonegroup default 2023-10-05T11:40:29.406 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.296+0000 7fadb7f36880 20 rados->read ofs=0 len=0 2023-10-05T11:40:29.407 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.296+0000 7fadb7f36880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:40:29.407 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.296+0000 7fadb7f36880 20 rados->read ofs=0 len=0 2023-10-05T11:40:29.407 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.297+0000 7fadb7f36880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:40:29.407 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.297+0000 7fadb7f36880 20 rados->read ofs=0 len=0 2023-10-05T11:40:29.407 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.297+0000 7fadb7f36880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:40:29.407 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.297+0000 7fadb7f36880 20 started sync module instance, tier type = 2023-10-05T11:40:29.407 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.297+0000 7fadb7f36880 20 started zone id=dff27d1e-df33-400e-a68a-7ba586947c99 (name=default) with tier type = 2023-10-05T11:40:29.407 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.303+0000 7fadb517a640 0 -- 172.21.15.12:0/3342182103 >> [v2:172.21.15.12:6824/2171933159,v1:172.21.15.12:6825/2171933159] conn(0x55ea1029c000 msgr2=0x55ea100e1700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-10-05T11:40:29.407 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.306+0000 7fadb7f36880 20 add_watcher() i=0 2023-10-05T11:40:29.407 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.306+0000 7fadb7f36880 20 add_watcher() i=1 2023-10-05T11:40:29.407 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.306+0000 7fadb7f36880 20 add_watcher() i=2 2023-10-05T11:40:29.407 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.306+0000 7fadb7f36880 20 add_watcher() i=3 2023-10-05T11:40:29.408 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.306+0000 7fadb7f36880 20 add_watcher() i=4 2023-10-05T11:40:29.408 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.306+0000 7fadb7f36880 20 add_watcher() i=5 2023-10-05T11:40:29.408 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.306+0000 7fadb7f36880 20 add_watcher() i=6 2023-10-05T11:40:29.408 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.307+0000 7fadb7f36880 20 add_watcher() i=7 2023-10-05T11:40:29.408 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.307+0000 7fadb7f36880 2 all 8 watchers are set, enabling cache 2023-10-05T11:40:29.408 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.308+0000 7fad9b947640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:40:29.408 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.309+0000 7fadb7f36880 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T11:40:29.408 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.309+0000 7fadb7f36880 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T11:40:29.408 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.314+0000 7fadb7f36880 5 note: GC not initialized 2023-10-05T11:40:29.408 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.314+0000 7fad9713e640 20 reqs_thread_entry: start 2023-10-05T11:40:29.408 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.314+0000 7fadb7f36880 20 init_complete bucket index max shards: 11 2023-10-05T11:40:29.409 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.314+0000 7fadb7f36880 20 Filter name: none 2023-10-05T11:40:29.409 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.315+0000 7fad9513a640 20 reqs_thread_entry: start 2023-10-05T11:40:29.409 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.315+0000 7fadb7f36880 20 rados->read ofs=0 len=0 2023-10-05T11:40:29.409 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.315+0000 7fadb7f36880 20 rados_obj.operate() r=0 bl.length=213 2023-10-05T11:40:29.409 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.315+0000 7fadb7f36880 20 rados->read ofs=0 len=0 2023-10-05T11:40:29.409 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.316+0000 7fadb7f36880 20 rados_obj.operate() r=0 bl.length=417 2023-10-05T11:40:29.409 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.316+0000 7fadb7f36880 20 couldn't put binfo cache entry, might have raced with data changes 2023-10-05T11:40:29.409 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.316+0000 7fadb7f36880 20 rados->read ofs=0 len=0 2023-10-05T11:40:29.409 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.316+0000 7fadb7f36880 20 rados_obj.operate() r=0 bl.length=213 2023-10-05T11:40:29.409 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.316+0000 7fadb7f36880 20 rados->read ofs=0 len=0 2023-10-05T11:40:29.409 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.316+0000 7fadb7f36880 20 rados_obj.operate() r=0 bl.length=417 2023-10-05T11:40:29.410 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.316+0000 7fadb7f36880 20 couldn't put binfo cache entry, might have raced with data changes 2023-10-05T11:40:29.410 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.317+0000 7fadb7f36880 20 rados->read ofs=0 len=0 2023-10-05T11:40:29.410 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.318+0000 7fadb7f36880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:40:29.410 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.318+0000 7fad9b947640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:40:29.410 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.321+0000 7fadb7f36880 20 remove_watcher() i=0 2023-10-05T11:40:29.410 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.321+0000 7fadb7f36880 2 removed watcher, disabling cache 2023-10-05T11:40:29.410 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.322+0000 7fadb7f36880 20 remove_watcher() i=1 2023-10-05T11:40:29.410 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.323+0000 7fadb7f36880 20 remove_watcher() i=2 2023-10-05T11:40:29.410 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.324+0000 7fadb7f36880 20 remove_watcher() i=3 2023-10-05T11:40:29.410 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.325+0000 7fadb7f36880 20 remove_watcher() i=4 2023-10-05T11:40:29.410 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.326+0000 7fadb7f36880 20 remove_watcher() i=5 2023-10-05T11:40:29.410 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.326+0000 7fadb7f36880 20 remove_watcher() i=6 2023-10-05T11:40:29.411 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.327+0000 7fadb7f36880 20 remove_watcher() i=7 2023-10-05T11:40:29.411 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:40:29.411 INFO:tasks.workunit.client.0.smithi012.stderr:BUCKET_STATS: 2023-10-05T11:40:29.411 INFO:tasks.workunit.client.0.smithi012.stderr:bucket: abort-at-block-writes id: dff27d1e-df33-400e-a68a-7ba586947c99.4604.22 num_objects: 20 size_kb: 1 num_shards: 11 2023-10-05T11:40:29.411 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:40:29.417 INFO:tasks.workunit.client.0.smithi012.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2023-10-05T11:40:29.451 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setuser ceph since I am not root 2023-10-05T11:40:29.451 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T11:40:29.461 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.458+0000 7f046df37880 20 rados->read ofs=0 len=0 2023-10-05T11:40:29.462 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.459+0000 7f046df37880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:40:29.463 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.459+0000 7f046df37880 20 realm 2023-10-05T11:40:29.463 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.459+0000 7f046df37880 20 rados->read ofs=0 len=0 2023-10-05T11:40:29.463 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.459+0000 7f046df37880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:40:29.463 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.459+0000 7f046df37880 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T11:40:29.463 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.459+0000 7f046df37880 20 rados->read ofs=0 len=0 2023-10-05T11:40:29.463 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.459+0000 7f046df37880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:40:29.463 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.459+0000 7f046df37880 20 rados->read ofs=0 len=0 2023-10-05T11:40:29.464 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.460+0000 7f046df37880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:40:29.464 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.460+0000 7f046df37880 20 rados->read ofs=0 len=0 2023-10-05T11:40:29.464 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.461+0000 7f046df37880 20 rados_obj.operate() r=0 bl.length=1020 2023-10-05T11:40:29.464 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.461+0000 7f046df37880 20 searching for the correct realm 2023-10-05T11:40:29.474 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.470+0000 7f046b11c640 0 -- 172.21.15.12:0/2572489495 >> [v2:172.21.15.12:6824/2171933159,v1:172.21.15.12:6825/2171933159] conn(0x55aa49b87400 msgr2=0x55aa499d7700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:40:29.474 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.471+0000 7f046df37880 20 RGWRados::pool_iterate: got zone_info.dff27d1e-df33-400e-a68a-7ba586947c99 2023-10-05T11:40:29.475 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.471+0000 7f046df37880 20 RGWRados::pool_iterate: got zonegroup_info.c78aa576-9d15-4e9d-b3c0-4af23a22062c 2023-10-05T11:40:29.475 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.471+0000 7f046df37880 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T11:40:29.475 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.471+0000 7f046df37880 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T11:40:29.475 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.471+0000 7f046df37880 20 rados->read ofs=0 len=0 2023-10-05T11:40:29.475 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.471+0000 7f046df37880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:40:29.475 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.471+0000 7f046df37880 20 rados->read ofs=0 len=0 2023-10-05T11:40:29.475 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.471+0000 7f046df37880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:40:29.475 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.471+0000 7f046df37880 20 rados->read ofs=0 len=0 2023-10-05T11:40:29.476 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.472+0000 7f046df37880 20 rados_obj.operate() r=0 bl.length=454 2023-10-05T11:40:29.477 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.472+0000 7f046df37880 20 zone default found 2023-10-05T11:40:29.477 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.472+0000 7f046df37880 4 Realm: () 2023-10-05T11:40:29.477 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.472+0000 7f046df37880 4 ZoneGroup: default (c78aa576-9d15-4e9d-b3c0-4af23a22062c) 2023-10-05T11:40:29.477 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.472+0000 7f046df37880 4 Zone: default (dff27d1e-df33-400e-a68a-7ba586947c99) 2023-10-05T11:40:29.477 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.472+0000 7f046df37880 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T11:40:29.477 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.472+0000 7f046df37880 20 zonegroup default 2023-10-05T11:40:29.477 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.472+0000 7f046df37880 20 rados->read ofs=0 len=0 2023-10-05T11:40:29.477 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.472+0000 7f046df37880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:40:29.477 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.472+0000 7f046df37880 20 rados->read ofs=0 len=0 2023-10-05T11:40:29.478 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.472+0000 7f046df37880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:40:29.478 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.472+0000 7f046df37880 20 rados->read ofs=0 len=0 2023-10-05T11:40:29.478 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.473+0000 7f046df37880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:40:29.478 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.473+0000 7f046df37880 20 started sync module instance, tier type = 2023-10-05T11:40:29.478 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.473+0000 7f046df37880 20 started zone id=dff27d1e-df33-400e-a68a-7ba586947c99 (name=default) with tier type = 2023-10-05T11:40:29.482 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.479+0000 7f046b11c640 0 -- 172.21.15.12:0/2572489495 >> [v2:172.21.15.12:6824/2171933159,v1:172.21.15.12:6825/2171933159] conn(0x55aa49bae000 msgr2=0x55aa49a9e100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-10-05T11:40:29.485 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.482+0000 7f046df37880 20 add_watcher() i=0 2023-10-05T11:40:29.485 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.482+0000 7f046df37880 20 add_watcher() i=1 2023-10-05T11:40:29.485 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.482+0000 7f046df37880 20 add_watcher() i=2 2023-10-05T11:40:29.485 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.482+0000 7f046df37880 20 add_watcher() i=3 2023-10-05T11:40:29.485 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.482+0000 7f046df37880 20 add_watcher() i=4 2023-10-05T11:40:29.485 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.482+0000 7f046df37880 20 add_watcher() i=5 2023-10-05T11:40:29.485 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.482+0000 7f046df37880 20 add_watcher() i=6 2023-10-05T11:40:29.486 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.482+0000 7f046df37880 20 add_watcher() i=7 2023-10-05T11:40:29.486 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.482+0000 7f046df37880 2 all 8 watchers are set, enabling cache 2023-10-05T11:40:29.487 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.484+0000 7f04518e9640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:40:29.487 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.484+0000 7f046df37880 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T11:40:29.488 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.484+0000 7f046df37880 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T11:40:29.493 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.490+0000 7f046df37880 5 note: GC not initialized 2023-10-05T11:40:29.494 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.490+0000 7f044d0e0640 20 reqs_thread_entry: start 2023-10-05T11:40:29.494 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.490+0000 7f046df37880 20 init_complete bucket index max shards: 11 2023-10-05T11:40:29.494 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.490+0000 7f046df37880 20 Filter name: none 2023-10-05T11:40:29.494 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.490+0000 7f044b0dc640 20 reqs_thread_entry: start 2023-10-05T11:40:29.495 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.490+0000 7f046df37880 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2023-10-05T11:40:29.495 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.490+0000 7f046df37880 20 rados->read ofs=0 len=0 2023-10-05T11:40:29.495 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.491+0000 7f046df37880 20 rados_obj.operate() r=0 bl.length=213 2023-10-05T11:40:29.495 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.491+0000 7f046df37880 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2023-10-05T11:40:29.495 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.491+0000 7f046df37880 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2023-10-05T11:40:29.495 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.491+0000 7f046df37880 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dff27d1e-df33-400e-a68a-7ba586947c99.4604.22 : miss 2023-10-05T11:40:29.495 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.491+0000 7f046df37880 20 rados->read ofs=0 len=0 2023-10-05T11:40:29.496 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.491+0000 7f046df37880 20 rados_obj.operate() r=0 bl.length=417 2023-10-05T11:40:29.496 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.491+0000 7f046df37880 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dff27d1e-df33-400e-a68a-7ba586947c99.4604.22 info.flags=0x17 2023-10-05T11:40:29.496 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.491+0000 7f046df37880 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dff27d1e-df33-400e-a68a-7ba586947c99.4604.22 to cache LRU end 2023-10-05T11:40:29.496 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.491+0000 7f046df37880 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T11:40:29.496 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.491+0000 7f046df37880 10 updating xattr: name=user.rgw.acl bl.length()=265 2023-10-05T11:40:29.496 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.491+0000 7f046df37880 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dff27d1e-df33-400e-a68a-7ba586947c99.4604.22 2023-10-05T11:40:29.496 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.493+0000 7f046df37880 0 INFO: RGWReshardLock::lock found lock on abort-at-block-writes:dff27d1e-df33-400e-a68a-7ba586947c99.4604.22 to be held by another RGW process; skipping for now 2023-10-05T11:40:29.497 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.493+0000 7f04518e9640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:40:29.499 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.495+0000 7f046df37880 20 remove_watcher() i=0 2023-10-05T11:40:29.499 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.495+0000 7f046df37880 2 removed watcher, disabling cache 2023-10-05T11:40:29.500 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.496+0000 7f046df37880 20 remove_watcher() i=1 2023-10-05T11:40:29.500 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.497+0000 7f046df37880 20 remove_watcher() i=2 2023-10-05T11:40:29.501 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.498+0000 7f046df37880 20 remove_watcher() i=3 2023-10-05T11:40:29.502 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.499+0000 7f046df37880 20 remove_watcher() i=4 2023-10-05T11:40:29.503 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.500+0000 7f046df37880 20 remove_watcher() i=5 2023-10-05T11:40:29.504 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.501+0000 7f046df37880 20 remove_watcher() i=6 2023-10-05T11:40:29.505 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:29.502+0000 7f046df37880 20 remove_watcher() i=7 2023-10-05T11:40:29.509 INFO:tasks.workunit.client.0.smithi012.stderr:waiting 30 seconds for reshard lock to expire... 2023-10-05T11:40:59.540 INFO:tasks.workunit.client.0.smithi012.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2023-10-05T11:40:59.576 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setuser ceph since I am not root 2023-10-05T11:40:59.576 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T11:40:59.591 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.587+0000 7f236c927880 20 rados->read ofs=0 len=0 2023-10-05T11:40:59.593 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.589+0000 7f236c927880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:40:59.593 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.589+0000 7f236c927880 20 realm 2023-10-05T11:40:59.593 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.589+0000 7f236c927880 20 rados->read ofs=0 len=0 2023-10-05T11:40:59.593 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.589+0000 7f236c927880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:40:59.593 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.589+0000 7f236c927880 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T11:40:59.593 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.589+0000 7f236c927880 20 rados->read ofs=0 len=0 2023-10-05T11:40:59.593 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.590+0000 7f236c927880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:40:59.594 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.590+0000 7f236c927880 20 rados->read ofs=0 len=0 2023-10-05T11:40:59.594 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.591+0000 7f236c927880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:40:59.594 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.591+0000 7f236c927880 20 rados->read ofs=0 len=0 2023-10-05T11:40:59.595 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.592+0000 7f236c927880 20 rados_obj.operate() r=0 bl.length=1020 2023-10-05T11:40:59.595 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.592+0000 7f236c927880 20 searching for the correct realm 2023-10-05T11:40:59.607 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.603+0000 7f23692d3640 0 -- 172.21.15.12:0/3602712602 >> [v2:172.21.15.170:6814/3150808418,v1:172.21.15.170:6816/3150808418] conn(0x55c9e6e8d400 msgr2=0x55c9e6294c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:40:59.608 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.605+0000 7f236c927880 20 RGWRados::pool_iterate: got zone_info.dff27d1e-df33-400e-a68a-7ba586947c99 2023-10-05T11:40:59.609 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.605+0000 7f236c927880 20 RGWRados::pool_iterate: got zonegroup_info.c78aa576-9d15-4e9d-b3c0-4af23a22062c 2023-10-05T11:40:59.609 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.605+0000 7f236c927880 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T11:40:59.609 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.605+0000 7f236c927880 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T11:40:59.609 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.605+0000 7f236c927880 20 rados->read ofs=0 len=0 2023-10-05T11:40:59.609 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.606+0000 7f236c927880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:40:59.609 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.606+0000 7f236c927880 20 rados->read ofs=0 len=0 2023-10-05T11:40:59.609 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.606+0000 7f236c927880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:40:59.610 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.606+0000 7f236c927880 20 rados->read ofs=0 len=0 2023-10-05T11:40:59.611 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.606+0000 7f236c927880 20 rados_obj.operate() r=0 bl.length=454 2023-10-05T11:40:59.611 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.606+0000 7f236c927880 20 zone default found 2023-10-05T11:40:59.611 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.606+0000 7f236c927880 4 Realm: () 2023-10-05T11:40:59.611 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.606+0000 7f236c927880 4 ZoneGroup: default (c78aa576-9d15-4e9d-b3c0-4af23a22062c) 2023-10-05T11:40:59.611 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.606+0000 7f236c927880 4 Zone: default (dff27d1e-df33-400e-a68a-7ba586947c99) 2023-10-05T11:40:59.611 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.606+0000 7f236c927880 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T11:40:59.611 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.606+0000 7f236c927880 20 zonegroup default 2023-10-05T11:40:59.611 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.606+0000 7f236c927880 20 rados->read ofs=0 len=0 2023-10-05T11:40:59.611 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.607+0000 7f236c927880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:40:59.611 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.607+0000 7f236c927880 20 rados->read ofs=0 len=0 2023-10-05T11:40:59.611 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.607+0000 7f236c927880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:40:59.611 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.607+0000 7f236c927880 20 rados->read ofs=0 len=0 2023-10-05T11:40:59.612 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.607+0000 7f236c927880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:40:59.612 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.607+0000 7f236c927880 20 started sync module instance, tier type = 2023-10-05T11:40:59.612 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.607+0000 7f236c927880 20 started zone id=dff27d1e-df33-400e-a68a-7ba586947c99 (name=default) with tier type = 2023-10-05T11:40:59.618 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.615+0000 7f2369ad4640 0 -- 172.21.15.12:0/3602712602 >> [v2:172.21.15.12:6824/2171933159,v1:172.21.15.12:6825/2171933159] conn(0x55c9e642c800 msgr2=0x55c9e6295700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:40:59.622 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.618+0000 7f236c927880 20 add_watcher() i=0 2023-10-05T11:40:59.622 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.618+0000 7f236c927880 20 add_watcher() i=1 2023-10-05T11:40:59.622 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.618+0000 7f236c927880 20 add_watcher() i=2 2023-10-05T11:40:59.622 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.618+0000 7f236c927880 20 add_watcher() i=3 2023-10-05T11:40:59.622 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.618+0000 7f236c927880 20 add_watcher() i=4 2023-10-05T11:40:59.622 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.618+0000 7f236c927880 20 add_watcher() i=5 2023-10-05T11:40:59.622 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.618+0000 7f236c927880 20 add_watcher() i=6 2023-10-05T11:40:59.623 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.619+0000 7f236c927880 20 add_watcher() i=7 2023-10-05T11:40:59.623 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.619+0000 7f236c927880 2 all 8 watchers are set, enabling cache 2023-10-05T11:40:59.625 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.621+0000 7f23502a1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:40:59.625 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.622+0000 7f236c927880 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T11:40:59.625 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.622+0000 7f236c927880 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T11:40:59.631 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.628+0000 7f236c927880 5 note: GC not initialized 2023-10-05T11:40:59.631 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.628+0000 7f234ba98640 20 reqs_thread_entry: start 2023-10-05T11:40:59.632 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.628+0000 7f236c927880 20 init_complete bucket index max shards: 11 2023-10-05T11:40:59.632 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.628+0000 7f236c927880 20 Filter name: none 2023-10-05T11:40:59.632 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.628+0000 7f2349a94640 20 reqs_thread_entry: start 2023-10-05T11:40:59.632 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.628+0000 7f236c927880 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2023-10-05T11:40:59.632 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.628+0000 7f236c927880 20 rados->read ofs=0 len=0 2023-10-05T11:40:59.633 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.629+0000 7f236c927880 20 rados_obj.operate() r=0 bl.length=213 2023-10-05T11:40:59.633 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.629+0000 7f236c927880 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2023-10-05T11:40:59.633 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.629+0000 7f236c927880 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2023-10-05T11:40:59.633 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.629+0000 7f236c927880 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dff27d1e-df33-400e-a68a-7ba586947c99.4604.22 : miss 2023-10-05T11:40:59.633 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.629+0000 7f236c927880 20 rados->read ofs=0 len=0 2023-10-05T11:40:59.633 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.629+0000 7f236c927880 20 rados_obj.operate() r=0 bl.length=417 2023-10-05T11:40:59.633 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.629+0000 7f236c927880 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dff27d1e-df33-400e-a68a-7ba586947c99.4604.22 info.flags=0x17 2023-10-05T11:40:59.633 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.629+0000 7f236c927880 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dff27d1e-df33-400e-a68a-7ba586947c99.4604.22 to cache LRU end 2023-10-05T11:40:59.633 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.629+0000 7f236c927880 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T11:40:59.633 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.629+0000 7f236c927880 10 updating xattr: name=user.rgw.acl bl.length()=265 2023-10-05T11:40:59.634 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.629+0000 7f236c927880 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dff27d1e-df33-400e-a68a-7ba586947c99.4604.22 2023-10-05T11:40:59.634 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.631+0000 7f236c927880 10 init_target_layout removing existing target index objects from a previous reshard attempt 2023-10-05T11:40:59.643 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.639+0000 7f236c927880 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dff27d1e-df33-400e-a68a-7ba586947c99.4604.22 info.flags=0x17 2023-10-05T11:40:59.643 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.639+0000 7f236c927880 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dff27d1e-df33-400e-a68a-7ba586947c99.4604.22 to cache LRU end 2023-10-05T11:40:59.643 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.639+0000 7f236c927880 10 updating xattr: name=user.rgw.acl bl.length()=265 2023-10-05T11:40:59.643 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.639+0000 7f236c927880 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:dff27d1e-df33-400e-a68a-7ba586947c99.4604.22, ofs0, ns] 2023-10-05T11:40:59.643 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.640+0000 7f23632c7640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1060856922166 cookie 94325640145920 notifier 6566 bl.length()=949 2023-10-05T11:40:59.643 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.640+0000 7f23632c7640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dff27d1e-df33-400e-a68a-7ba586947c99.4604.22 info.flags=0x17 2023-10-05T11:40:59.643 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.640+0000 7f23632c7640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dff27d1e-df33-400e-a68a-7ba586947c99.4604.22 to cache LRU end 2023-10-05T11:40:59.644 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.640+0000 7f23632c7640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2023-10-05T11:40:59.645 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.641+0000 7f236c927880 20 handle_bi_update(): bucket=:abort-at-block-writes[dff27d1e-df33-400e-a68a-7ba586947c99.4604.22]): orig_sources= new_sources= 2023-10-05T11:40:59.645 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.641+0000 7f236c927880 20 handle_bi_update(): bucket=:abort-at-block-writes[dff27d1e-df33-400e-a68a-7ba586947c99.4604.22]): potential sources added=[] removed=[] 2023-10-05T11:40:59.645 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.641+0000 7f236c927880 20 handle_bi_update(): bucket=:abort-at-block-writes[dff27d1e-df33-400e-a68a-7ba586947c99.4604.22]): orig_dests= new_dests= 2023-10-05T11:40:59.645 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.641+0000 7f236c927880 20 handle_bi_update(): bucket=:abort-at-block-writes[dff27d1e-df33-400e-a68a-7ba586947c99.4604.22]): potential dests added=[] removed=[] 2023-10-05T11:40:59.647 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.644+0000 7f236c927880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.22.2.0 2023-10-05T11:40:59.647 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.644+0000 7f236c927880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.22.2.0 2023-10-05T11:40:59.648 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.644+0000 7f236c927880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.22.2.1 2023-10-05T11:40:59.648 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.644+0000 7f236c927880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.22.2.1 2023-10-05T11:40:59.648 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.644+0000 7f236c927880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.22.2.2 2023-10-05T11:40:59.648 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.644+0000 7f236c927880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.22.2.2 2023-10-05T11:40:59.648 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.644+0000 7f236c927880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.22.2.3 2023-10-05T11:40:59.648 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.644+0000 7f236c927880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.22.2.3 2023-10-05T11:40:59.648 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.644+0000 7f236c927880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.22.2.4 2023-10-05T11:40:59.648 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.644+0000 7f236c927880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.22.2.4 2023-10-05T11:40:59.648 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.644+0000 7f236c927880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.22.2.5 2023-10-05T11:40:59.648 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.644+0000 7f236c927880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.22.2.5 2023-10-05T11:40:59.648 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.644+0000 7f236c927880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.22.2.6 2023-10-05T11:40:59.648 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.644+0000 7f236c927880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.22.2.6 2023-10-05T11:40:59.649 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.644+0000 7f236c927880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.22.2.7 2023-10-05T11:40:59.649 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.644+0000 7f236c927880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.22.2.7 2023-10-05T11:40:59.649 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.644+0000 7f236c927880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.22.2.8 2023-10-05T11:40:59.649 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.644+0000 7f236c927880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.22.2.8 2023-10-05T11:40:59.649 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.644+0000 7f236c927880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.22.2.9 2023-10-05T11:40:59.649 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.644+0000 7f236c927880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.22.2.9 2023-10-05T11:40:59.649 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.644+0000 7f236c927880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.22.2.10 2023-10-05T11:40:59.649 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.644+0000 7f236c927880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.22.2.10 2023-10-05T11:40:59.649 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.644+0000 7f236c927880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.22.2.11 2023-10-05T11:40:59.649 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.644+0000 7f236c927880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.22.2.11 2023-10-05T11:40:59.649 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.644+0000 7f236c927880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.22.0 2023-10-05T11:40:59.650 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.644+0000 7f236c927880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.22.1 2023-10-05T11:40:59.650 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.645+0000 7f236c927880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.22.2 2023-10-05T11:40:59.650 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.645+0000 7f236c927880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.22.3 2023-10-05T11:40:59.651 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.646+0000 7f236c927880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.22.4 2023-10-05T11:40:59.651 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.646+0000 7f236c927880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.22.5 2023-10-05T11:40:59.651 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.647+0000 7f236c927880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.22.6 2023-10-05T11:40:59.651 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.647+0000 7f236c927880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.22.7 2023-10-05T11:40:59.651 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.648+0000 7f236c927880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.22.8 2023-10-05T11:40:59.652 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.648+0000 7f236c927880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.22.9 2023-10-05T11:40:59.652 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.649+0000 7f236c927880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.22.10 2023-10-05T11:40:59.655 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.652+0000 7f236c927880 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dff27d1e-df33-400e-a68a-7ba586947c99.4604.22 : hit (requested=0x17, cached=0x17) 2023-10-05T11:40:59.655 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.652+0000 7f236c927880 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dff27d1e-df33-400e-a68a-7ba586947c99.4604.22 2023-10-05T11:40:59.657 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.653+0000 7f236c927880 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dff27d1e-df33-400e-a68a-7ba586947c99.4604.22 info.flags=0x17 2023-10-05T11:40:59.657 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.653+0000 7f236c927880 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dff27d1e-df33-400e-a68a-7ba586947c99.4604.22 to cache LRU end 2023-10-05T11:40:59.657 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.653+0000 7f236c927880 10 updating xattr: name=user.rgw.acl bl.length()=265 2023-10-05T11:40:59.657 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.653+0000 7f236c927880 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:dff27d1e-df33-400e-a68a-7ba586947c99.4604.22, ofs0, ns] 2023-10-05T11:40:59.657 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.654+0000 7f2363ac8640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1060856922167 cookie 94325640145920 notifier 6566 bl.length()=917 2023-10-05T11:40:59.657 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.654+0000 7f2363ac8640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dff27d1e-df33-400e-a68a-7ba586947c99.4604.22 info.flags=0x17 2023-10-05T11:40:59.657 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.654+0000 7f2363ac8640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dff27d1e-df33-400e-a68a-7ba586947c99.4604.22 to cache LRU end 2023-10-05T11:40:59.658 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.654+0000 7f2363ac8640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2023-10-05T11:40:59.659 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.656+0000 7f236c927880 20 handle_bi_update(): bucket=:abort-at-block-writes[dff27d1e-df33-400e-a68a-7ba586947c99.4604.22]): orig_sources= new_sources= 2023-10-05T11:40:59.659 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.656+0000 7f236c927880 20 handle_bi_update(): bucket=:abort-at-block-writes[dff27d1e-df33-400e-a68a-7ba586947c99.4604.22]): potential sources added=[] removed=[] 2023-10-05T11:40:59.659 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.656+0000 7f236c927880 20 handle_bi_update(): bucket=:abort-at-block-writes[dff27d1e-df33-400e-a68a-7ba586947c99.4604.22]): orig_dests= new_dests= 2023-10-05T11:40:59.659 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.656+0000 7f236c927880 20 handle_bi_update(): bucket=:abort-at-block-writes[dff27d1e-df33-400e-a68a-7ba586947c99.4604.22]): potential dests added=[] removed=[] 2023-10-05T11:40:59.661 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.658+0000 7f236c927880 1 execute INFO: reshard of bucket "abort-at-block-writes" completed successfully 2023-10-05T11:40:59.663 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.660+0000 7f23502a1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:40:59.665 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.662+0000 7f236c927880 20 remove_watcher() i=0 2023-10-05T11:40:59.666 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.662+0000 7f236c927880 2 removed watcher, disabling cache 2023-10-05T11:40:59.667 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.663+0000 7f236c927880 20 remove_watcher() i=1 2023-10-05T11:40:59.668 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.665+0000 7f236c927880 20 remove_watcher() i=2 2023-10-05T11:40:59.669 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.666+0000 7f236c927880 20 remove_watcher() i=3 2023-10-05T11:40:59.670 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.667+0000 7f236c927880 20 remove_watcher() i=4 2023-10-05T11:40:59.671 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.668+0000 7f236c927880 20 remove_watcher() i=5 2023-10-05T11:40:59.672 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.669+0000 7f236c927880 20 remove_watcher() i=6 2023-10-05T11:40:59.674 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.670+0000 7f236c927880 20 remove_watcher() i=7 2023-10-05T11:40:59.679 INFO:tasks.workunit.client.0.smithi012.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2023-10-05T11:40:59.708 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setuser ceph since I am not root 2023-10-05T11:40:59.708 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T11:40:59.720 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.717+0000 7f34810bc880 20 rados->read ofs=0 len=0 2023-10-05T11:40:59.722 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.719+0000 7f34810bc880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:40:59.722 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.719+0000 7f34810bc880 20 realm 2023-10-05T11:40:59.722 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.719+0000 7f34810bc880 20 rados->read ofs=0 len=0 2023-10-05T11:40:59.723 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.719+0000 7f34810bc880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:40:59.723 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.719+0000 7f34810bc880 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T11:40:59.723 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.719+0000 7f34810bc880 20 rados->read ofs=0 len=0 2023-10-05T11:40:59.723 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.719+0000 7f34810bc880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:40:59.723 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.719+0000 7f34810bc880 20 rados->read ofs=0 len=0 2023-10-05T11:40:59.723 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.720+0000 7f34810bc880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:40:59.723 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.720+0000 7f34810bc880 20 rados->read ofs=0 len=0 2023-10-05T11:40:59.724 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.721+0000 7f34810bc880 20 rados_obj.operate() r=0 bl.length=1020 2023-10-05T11:40:59.724 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.721+0000 7f34810bc880 20 searching for the correct realm 2023-10-05T11:40:59.733 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.729+0000 7f3480062640 0 -- 172.21.15.12:0/3372760558 >> [v2:172.21.15.12:6824/2171933159,v1:172.21.15.12:6825/2171933159] conn(0x560024e98c00 msgr2=0x560024da4100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:40:59.735 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.732+0000 7f34810bc880 20 RGWRados::pool_iterate: got zone_info.dff27d1e-df33-400e-a68a-7ba586947c99 2023-10-05T11:40:59.735 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.732+0000 7f34810bc880 20 RGWRados::pool_iterate: got zonegroup_info.c78aa576-9d15-4e9d-b3c0-4af23a22062c 2023-10-05T11:40:59.735 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.732+0000 7f34810bc880 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T11:40:59.735 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.732+0000 7f34810bc880 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T11:40:59.736 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.732+0000 7f34810bc880 20 rados->read ofs=0 len=0 2023-10-05T11:40:59.736 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.732+0000 7f34810bc880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:40:59.736 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.732+0000 7f34810bc880 20 rados->read ofs=0 len=0 2023-10-05T11:40:59.737 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.732+0000 7f34810bc880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:40:59.737 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.732+0000 7f34810bc880 20 rados->read ofs=0 len=0 2023-10-05T11:40:59.737 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.733+0000 7f34810bc880 20 rados_obj.operate() r=0 bl.length=454 2023-10-05T11:40:59.737 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.733+0000 7f34810bc880 20 zone default found 2023-10-05T11:40:59.737 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.733+0000 7f34810bc880 4 Realm: () 2023-10-05T11:40:59.737 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.733+0000 7f34810bc880 4 ZoneGroup: default (c78aa576-9d15-4e9d-b3c0-4af23a22062c) 2023-10-05T11:40:59.737 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.733+0000 7f34810bc880 4 Zone: default (dff27d1e-df33-400e-a68a-7ba586947c99) 2023-10-05T11:40:59.738 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.733+0000 7f34810bc880 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T11:40:59.738 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.733+0000 7f34810bc880 20 zonegroup default 2023-10-05T11:40:59.738 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.733+0000 7f34810bc880 20 rados->read ofs=0 len=0 2023-10-05T11:40:59.738 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.733+0000 7f34810bc880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:40:59.738 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.733+0000 7f34810bc880 20 rados->read ofs=0 len=0 2023-10-05T11:40:59.738 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.734+0000 7f34810bc880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:40:59.738 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.734+0000 7f34810bc880 20 rados->read ofs=0 len=0 2023-10-05T11:40:59.738 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.734+0000 7f34810bc880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:40:59.738 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.734+0000 7f34810bc880 20 started sync module instance, tier type = 2023-10-05T11:40:59.738 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.734+0000 7f34810bc880 20 started zone id=dff27d1e-df33-400e-a68a-7ba586947c99 (name=default) with tier type = 2023-10-05T11:40:59.741 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.738+0000 7f347f861640 0 -- 172.21.15.12:0/3372760558 >> [v2:172.21.15.12:6800/732466381,v1:172.21.15.12:6801/732466381] conn(0x560024e98000 msgr2=0x560024da2b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:40:59.746 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.742+0000 7f34810bc880 20 add_watcher() i=0 2023-10-05T11:40:59.746 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.742+0000 7f34810bc880 20 add_watcher() i=1 2023-10-05T11:40:59.746 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.742+0000 7f34810bc880 20 add_watcher() i=2 2023-10-05T11:40:59.746 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.742+0000 7f34810bc880 20 add_watcher() i=3 2023-10-05T11:40:59.746 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.742+0000 7f34810bc880 20 add_watcher() i=4 2023-10-05T11:40:59.746 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.742+0000 7f34810bc880 20 add_watcher() i=5 2023-10-05T11:40:59.746 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.743+0000 7f34810bc880 20 add_watcher() i=6 2023-10-05T11:40:59.747 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.743+0000 7f34810bc880 20 add_watcher() i=7 2023-10-05T11:40:59.747 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.743+0000 7f34810bc880 2 all 8 watchers are set, enabling cache 2023-10-05T11:40:59.748 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.745+0000 7f346682f640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:40:59.749 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.745+0000 7f34810bc880 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T11:40:59.749 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.745+0000 7f34810bc880 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T11:40:59.755 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.751+0000 7f34810bc880 5 note: GC not initialized 2023-10-05T11:40:59.755 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.751+0000 7f3462026640 20 reqs_thread_entry: start 2023-10-05T11:40:59.755 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.751+0000 7f34810bc880 20 init_complete bucket index max shards: 11 2023-10-05T11:40:59.755 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.751+0000 7f34810bc880 20 Filter name: none 2023-10-05T11:40:59.755 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.751+0000 7f3460022640 20 reqs_thread_entry: start 2023-10-05T11:40:59.755 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.751+0000 7f34810bc880 20 rados->read ofs=0 len=0 2023-10-05T11:40:59.756 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.752+0000 7f34810bc880 20 rados_obj.operate() r=0 bl.length=213 2023-10-05T11:40:59.756 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.752+0000 7f34810bc880 20 rados->read ofs=0 len=0 2023-10-05T11:40:59.756 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.752+0000 7f34810bc880 20 rados_obj.operate() r=0 bl.length=385 2023-10-05T11:40:59.756 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.752+0000 7f34810bc880 20 couldn't put binfo cache entry, might have raced with data changes 2023-10-05T11:40:59.756 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.752+0000 7f34810bc880 20 rados->read ofs=0 len=0 2023-10-05T11:40:59.756 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.753+0000 7f34810bc880 20 rados_obj.operate() r=0 bl.length=213 2023-10-05T11:40:59.757 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.753+0000 7f34810bc880 20 rados->read ofs=0 len=0 2023-10-05T11:40:59.757 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.753+0000 7f34810bc880 20 rados_obj.operate() r=0 bl.length=385 2023-10-05T11:40:59.757 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.753+0000 7f34810bc880 20 couldn't put binfo cache entry, might have raced with data changes 2023-10-05T11:40:59.757 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.754+0000 7f34810bc880 20 rados->read ofs=0 len=0 2023-10-05T11:40:59.757 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.754+0000 7f34810bc880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:40:59.758 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.754+0000 7f346682f640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:40:59.760 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.757+0000 7f34810bc880 20 remove_watcher() i=0 2023-10-05T11:40:59.760 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.757+0000 7f34810bc880 2 removed watcher, disabling cache 2023-10-05T11:40:59.761 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.758+0000 7f34810bc880 20 remove_watcher() i=1 2023-10-05T11:40:59.762 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.759+0000 7f34810bc880 20 remove_watcher() i=2 2023-10-05T11:40:59.763 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.760+0000 7f34810bc880 20 remove_watcher() i=3 2023-10-05T11:40:59.764 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.761+0000 7f34810bc880 20 remove_watcher() i=4 2023-10-05T11:40:59.765 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.762+0000 7f34810bc880 20 remove_watcher() i=5 2023-10-05T11:40:59.766 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.763+0000 7f34810bc880 20 remove_watcher() i=6 2023-10-05T11:40:59.767 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:40:59.764+0000 7f34810bc880 20 remove_watcher() i=7 2023-10-05T11:40:59.771 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:40:59.771 INFO:tasks.workunit.client.0.smithi012.stderr:BUCKET_STATS: 2023-10-05T11:40:59.771 INFO:tasks.workunit.client.0.smithi012.stderr:bucket: abort-at-block-writes id: dff27d1e-df33-400e-a68a-7ba586947c99.4604.22 num_objects: 19 size_kb: 1 num_shards: 12 2023-10-05T11:40:59.771 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:41:00.100 INFO:tasks.workunit.client.0.smithi012.stderr:TEST: reshard bucket with EIO injected at commit_target_layout 2023-10-05T11:41:00.100 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:41:00.809 INFO:tasks.workunit.client.0.smithi012.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2023-10-05T11:41:00.837 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setuser ceph since I am not root 2023-10-05T11:41:00.838 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T11:41:00.850 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.847+0000 7f0258a67880 20 rados->read ofs=0 len=0 2023-10-05T11:41:00.851 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.848+0000 7f0258a67880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:00.852 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.848+0000 7f0258a67880 20 realm 2023-10-05T11:41:00.852 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.848+0000 7f0258a67880 20 rados->read ofs=0 len=0 2023-10-05T11:41:00.852 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.848+0000 7f0258a67880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:00.852 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.848+0000 7f0258a67880 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T11:41:00.852 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.848+0000 7f0258a67880 20 rados->read ofs=0 len=0 2023-10-05T11:41:00.852 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.848+0000 7f0258a67880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:00.852 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.848+0000 7f0258a67880 20 rados->read ofs=0 len=0 2023-10-05T11:41:00.852 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.849+0000 7f0258a67880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:41:00.853 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.849+0000 7f0258a67880 20 rados->read ofs=0 len=0 2023-10-05T11:41:00.853 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.850+0000 7f0258a67880 20 rados_obj.operate() r=0 bl.length=1020 2023-10-05T11:41:00.853 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.850+0000 7f0258a67880 20 searching for the correct realm 2023-10-05T11:41:00.863 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.859+0000 7f025720c640 0 -- 172.21.15.12:0/2104998128 >> [v2:172.21.15.12:6800/732466381,v1:172.21.15.12:6801/732466381] conn(0x5637692ea000 msgr2=0x5637691eab00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:41:00.864 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.861+0000 7f0258a67880 20 RGWRados::pool_iterate: got zone_info.dff27d1e-df33-400e-a68a-7ba586947c99 2023-10-05T11:41:00.864 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.861+0000 7f0258a67880 20 RGWRados::pool_iterate: got zonegroup_info.c78aa576-9d15-4e9d-b3c0-4af23a22062c 2023-10-05T11:41:00.865 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.861+0000 7f0258a67880 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T11:41:00.865 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.861+0000 7f0258a67880 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T11:41:00.865 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.861+0000 7f0258a67880 20 rados->read ofs=0 len=0 2023-10-05T11:41:00.865 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.861+0000 7f0258a67880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:00.865 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.861+0000 7f0258a67880 20 rados->read ofs=0 len=0 2023-10-05T11:41:00.865 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.861+0000 7f0258a67880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:41:00.865 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.861+0000 7f0258a67880 20 rados->read ofs=0 len=0 2023-10-05T11:41:00.866 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.862+0000 7f0258a67880 20 rados_obj.operate() r=0 bl.length=454 2023-10-05T11:41:00.866 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.862+0000 7f0258a67880 20 zone default found 2023-10-05T11:41:00.866 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.862+0000 7f0258a67880 4 Realm: () 2023-10-05T11:41:00.866 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.862+0000 7f0258a67880 4 ZoneGroup: default (c78aa576-9d15-4e9d-b3c0-4af23a22062c) 2023-10-05T11:41:00.866 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.862+0000 7f0258a67880 4 Zone: default (dff27d1e-df33-400e-a68a-7ba586947c99) 2023-10-05T11:41:00.867 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.862+0000 7f0258a67880 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T11:41:00.867 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.862+0000 7f0258a67880 20 zonegroup default 2023-10-05T11:41:00.867 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.862+0000 7f0258a67880 20 rados->read ofs=0 len=0 2023-10-05T11:41:00.867 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.862+0000 7f0258a67880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:00.867 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.862+0000 7f0258a67880 20 rados->read ofs=0 len=0 2023-10-05T11:41:00.867 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.862+0000 7f0258a67880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:00.867 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.862+0000 7f0258a67880 20 rados->read ofs=0 len=0 2023-10-05T11:41:00.867 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.862+0000 7f0258a67880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:00.867 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.862+0000 7f0258a67880 20 started sync module instance, tier type = 2023-10-05T11:41:00.867 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.862+0000 7f0258a67880 20 started zone id=dff27d1e-df33-400e-a68a-7ba586947c99 (name=default) with tier type = 2023-10-05T11:41:00.871 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.868+0000 7f025720c640 0 -- 172.21.15.12:0/2104998128 >> [v2:172.21.15.12:6800/732466381,v1:172.21.15.12:6801/732466381] conn(0x5637692eac00 msgr2=0x5637691ec100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:41:00.875 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.871+0000 7f0258a67880 20 add_watcher() i=0 2023-10-05T11:41:00.875 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.871+0000 7f0258a67880 20 add_watcher() i=1 2023-10-05T11:41:00.875 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.871+0000 7f0258a67880 20 add_watcher() i=2 2023-10-05T11:41:00.875 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.871+0000 7f0258a67880 20 add_watcher() i=3 2023-10-05T11:41:00.875 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.871+0000 7f0258a67880 20 add_watcher() i=4 2023-10-05T11:41:00.875 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.871+0000 7f0258a67880 20 add_watcher() i=5 2023-10-05T11:41:00.875 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.871+0000 7f0258a67880 20 add_watcher() i=6 2023-10-05T11:41:00.876 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.872+0000 7f0258a67880 20 add_watcher() i=7 2023-10-05T11:41:00.876 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.872+0000 7f0258a67880 2 all 8 watchers are set, enabling cache 2023-10-05T11:41:00.877 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.874+0000 7f023e1da640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:41:00.877 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.874+0000 7f0258a67880 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T11:41:00.877 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.874+0000 7f0258a67880 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T11:41:00.884 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.880+0000 7f0258a67880 5 note: GC not initialized 2023-10-05T11:41:00.884 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.880+0000 7f02399d1640 20 reqs_thread_entry: start 2023-10-05T11:41:00.884 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.880+0000 7f0258a67880 20 init_complete bucket index max shards: 11 2023-10-05T11:41:00.884 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.880+0000 7f0258a67880 20 Filter name: none 2023-10-05T11:41:00.884 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.880+0000 7f02379cd640 20 reqs_thread_entry: start 2023-10-05T11:41:00.884 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.880+0000 7f0258a67880 20 rados->read ofs=0 len=0 2023-10-05T11:41:00.885 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.881+0000 7f0258a67880 20 rados_obj.operate() r=0 bl.length=221 2023-10-05T11:41:00.885 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.881+0000 7f0258a67880 20 rados->read ofs=0 len=0 2023-10-05T11:41:00.885 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.881+0000 7f0258a67880 20 rados_obj.operate() r=0 bl.length=393 2023-10-05T11:41:00.885 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.881+0000 7f0258a67880 20 couldn't put binfo cache entry, might have raced with data changes 2023-10-05T11:41:00.885 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.881+0000 7f0258a67880 20 rados->read ofs=0 len=0 2023-10-05T11:41:00.886 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.882+0000 7f0258a67880 20 rados_obj.operate() r=0 bl.length=221 2023-10-05T11:41:00.886 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.882+0000 7f0258a67880 20 rados->read ofs=0 len=0 2023-10-05T11:41:00.886 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.882+0000 7f0258a67880 20 rados_obj.operate() r=0 bl.length=393 2023-10-05T11:41:00.886 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.882+0000 7f0258a67880 20 couldn't put binfo cache entry, might have raced with data changes 2023-10-05T11:41:00.886 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.883+0000 7f0258a67880 20 rados->read ofs=0 len=0 2023-10-05T11:41:00.887 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.883+0000 7f0258a67880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:00.887 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.884+0000 7f023e1da640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:41:00.889 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.886+0000 7f0258a67880 20 remove_watcher() i=0 2023-10-05T11:41:00.889 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.886+0000 7f0258a67880 2 removed watcher, disabling cache 2023-10-05T11:41:00.890 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.887+0000 7f0258a67880 20 remove_watcher() i=1 2023-10-05T11:41:00.891 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.888+0000 7f0258a67880 20 remove_watcher() i=2 2023-10-05T11:41:00.892 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.889+0000 7f0258a67880 20 remove_watcher() i=3 2023-10-05T11:41:00.893 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.890+0000 7f0258a67880 20 remove_watcher() i=4 2023-10-05T11:41:00.894 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.891+0000 7f0258a67880 20 remove_watcher() i=5 2023-10-05T11:41:00.895 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.892+0000 7f0258a67880 20 remove_watcher() i=6 2023-10-05T11:41:00.897 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.893+0000 7f0258a67880 20 remove_watcher() i=7 2023-10-05T11:41:00.901 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:41:00.901 INFO:tasks.workunit.client.0.smithi012.stderr:BUCKET_STATS: 2023-10-05T11:41:00.901 INFO:tasks.workunit.client.0.smithi012.stderr:bucket: error-at-commit-target-layout id: dff27d1e-df33-400e-a68a-7ba586947c99.4604.23 num_objects: 20 size_kb: 1 num_shards: 11 2023-10-05T11:41:00.901 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:41:00.903 INFO:tasks.workunit.client.0.smithi012.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at commit_target_layout 2023-10-05T11:41:00.935 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setuser ceph since I am not root 2023-10-05T11:41:00.935 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T11:41:00.948 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.945+0000 7ffbe64c0880 20 rados->read ofs=0 len=0 2023-10-05T11:41:00.950 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.946+0000 7ffbe64c0880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:00.950 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.946+0000 7ffbe64c0880 20 realm 2023-10-05T11:41:00.950 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.946+0000 7ffbe64c0880 20 rados->read ofs=0 len=0 2023-10-05T11:41:00.950 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.947+0000 7ffbe64c0880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:00.950 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.947+0000 7ffbe64c0880 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T11:41:00.951 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.947+0000 7ffbe64c0880 20 rados->read ofs=0 len=0 2023-10-05T11:41:00.951 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.947+0000 7ffbe64c0880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:00.951 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.947+0000 7ffbe64c0880 20 rados->read ofs=0 len=0 2023-10-05T11:41:00.951 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.948+0000 7ffbe64c0880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:41:00.951 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.948+0000 7ffbe64c0880 20 rados->read ofs=0 len=0 2023-10-05T11:41:00.952 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.948+0000 7ffbe64c0880 20 rados_obj.operate() r=0 bl.length=1020 2023-10-05T11:41:00.952 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.948+0000 7ffbe64c0880 20 searching for the correct realm 2023-10-05T11:41:00.961 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.958+0000 7ffbe4c6c640 0 -- 172.21.15.12:0/994825061 >> [v2:172.21.15.170:6814/3150808418,v1:172.21.15.170:6816/3150808418] conn(0x56149e4d7000 msgr2=0x56149e429180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:41:00.963 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.959+0000 7ffbe64c0880 20 RGWRados::pool_iterate: got zone_info.dff27d1e-df33-400e-a68a-7ba586947c99 2023-10-05T11:41:00.963 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.959+0000 7ffbe64c0880 20 RGWRados::pool_iterate: got zonegroup_info.c78aa576-9d15-4e9d-b3c0-4af23a22062c 2023-10-05T11:41:00.963 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.959+0000 7ffbe64c0880 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T11:41:00.963 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.959+0000 7ffbe64c0880 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T11:41:00.963 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.959+0000 7ffbe64c0880 20 rados->read ofs=0 len=0 2023-10-05T11:41:00.963 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.959+0000 7ffbe64c0880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:00.963 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.959+0000 7ffbe64c0880 20 rados->read ofs=0 len=0 2023-10-05T11:41:00.964 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.960+0000 7ffbe64c0880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:41:00.964 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.960+0000 7ffbe64c0880 20 rados->read ofs=0 len=0 2023-10-05T11:41:00.964 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.960+0000 7ffbe64c0880 20 rados_obj.operate() r=0 bl.length=454 2023-10-05T11:41:00.964 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.960+0000 7ffbe64c0880 20 zone default found 2023-10-05T11:41:00.964 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.960+0000 7ffbe64c0880 4 Realm: () 2023-10-05T11:41:00.964 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.960+0000 7ffbe64c0880 4 ZoneGroup: default (c78aa576-9d15-4e9d-b3c0-4af23a22062c) 2023-10-05T11:41:00.964 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.960+0000 7ffbe64c0880 4 Zone: default (dff27d1e-df33-400e-a68a-7ba586947c99) 2023-10-05T11:41:00.965 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.960+0000 7ffbe64c0880 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T11:41:00.965 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.960+0000 7ffbe64c0880 20 zonegroup default 2023-10-05T11:41:00.965 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.960+0000 7ffbe64c0880 20 rados->read ofs=0 len=0 2023-10-05T11:41:00.965 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.960+0000 7ffbe64c0880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:00.965 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.960+0000 7ffbe64c0880 20 rados->read ofs=0 len=0 2023-10-05T11:41:00.965 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.961+0000 7ffbe64c0880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:00.965 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.961+0000 7ffbe64c0880 20 rados->read ofs=0 len=0 2023-10-05T11:41:00.966 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.961+0000 7ffbe64c0880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:00.966 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.961+0000 7ffbe64c0880 20 started sync module instance, tier type = 2023-10-05T11:41:00.966 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.961+0000 7ffbe64c0880 20 started zone id=dff27d1e-df33-400e-a68a-7ba586947c99 (name=default) with tier type = 2023-10-05T11:41:00.971 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.968+0000 7ffbe546d640 0 -- 172.21.15.12:0/994825061 >> [v2:172.21.15.12:6824/2171933159,v1:172.21.15.12:6825/2171933159] conn(0x56149e5ec000 msgr2=0x56149e5c8580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:41:00.974 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.970+0000 7ffbe64c0880 20 add_watcher() i=0 2023-10-05T11:41:00.974 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.970+0000 7ffbe64c0880 20 add_watcher() i=1 2023-10-05T11:41:00.974 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.970+0000 7ffbe64c0880 20 add_watcher() i=2 2023-10-05T11:41:00.974 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.970+0000 7ffbe64c0880 20 add_watcher() i=3 2023-10-05T11:41:00.974 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.970+0000 7ffbe64c0880 20 add_watcher() i=4 2023-10-05T11:41:00.974 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.970+0000 7ffbe64c0880 20 add_watcher() i=5 2023-10-05T11:41:00.974 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.970+0000 7ffbe64c0880 20 add_watcher() i=6 2023-10-05T11:41:00.975 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.971+0000 7ffbe64c0880 20 add_watcher() i=7 2023-10-05T11:41:00.975 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.971+0000 7ffbe64c0880 2 all 8 watchers are set, enabling cache 2023-10-05T11:41:00.976 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.973+0000 7ffbcbc3a640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:41:00.976 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.973+0000 7ffbe64c0880 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T11:41:00.976 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.973+0000 7ffbe64c0880 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T11:41:00.982 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.978+0000 7ffbe64c0880 5 note: GC not initialized 2023-10-05T11:41:00.982 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.979+0000 7ffbc7431640 20 reqs_thread_entry: start 2023-10-05T11:41:00.982 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.979+0000 7ffbe64c0880 20 init_complete bucket index max shards: 11 2023-10-05T11:41:00.982 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.979+0000 7ffbe64c0880 20 Filter name: none 2023-10-05T11:41:00.983 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.979+0000 7ffbc542d640 20 reqs_thread_entry: start 2023-10-05T11:41:00.983 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.979+0000 7ffbe64c0880 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2023-10-05T11:41:00.983 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.979+0000 7ffbe64c0880 20 rados->read ofs=0 len=0 2023-10-05T11:41:00.983 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.979+0000 7ffbe64c0880 20 rados_obj.operate() r=0 bl.length=221 2023-10-05T11:41:00.983 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.979+0000 7ffbe64c0880 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2023-10-05T11:41:00.983 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.979+0000 7ffbe64c0880 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2023-10-05T11:41:00.984 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.979+0000 7ffbe64c0880 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.23 : miss 2023-10-05T11:41:00.984 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.979+0000 7ffbe64c0880 20 rados->read ofs=0 len=0 2023-10-05T11:41:00.984 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.980+0000 7ffbe64c0880 20 rados_obj.operate() r=0 bl.length=393 2023-10-05T11:41:00.984 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.980+0000 7ffbe64c0880 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.23 info.flags=0x17 2023-10-05T11:41:00.984 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.980+0000 7ffbe64c0880 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.23 to cache LRU end 2023-10-05T11:41:00.984 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.980+0000 7ffbe64c0880 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T11:41:00.984 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.980+0000 7ffbe64c0880 10 updating xattr: name=user.rgw.acl bl.length()=265 2023-10-05T11:41:00.984 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.980+0000 7ffbe64c0880 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.23 2023-10-05T11:41:00.988 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.985+0000 7ffbe64c0880 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.23 info.flags=0x17 2023-10-05T11:41:00.988 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.985+0000 7ffbe64c0880 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.23 to cache LRU end 2023-10-05T11:41:00.988 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.985+0000 7ffbe64c0880 10 updating xattr: name=user.rgw.acl bl.length()=265 2023-10-05T11:41:00.988 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.985+0000 7ffbe64c0880 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.23, ofs0, ns] 2023-10-05T11:41:00.989 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.985+0000 7ffbdf461640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1060856922168 cookie 94646556346368 notifier 6623 bl.length()=965 2023-10-05T11:41:00.989 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.985+0000 7ffbdf461640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.23 info.flags=0x17 2023-10-05T11:41:00.989 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.985+0000 7ffbdf461640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.23 to cache LRU end 2023-10-05T11:41:00.989 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.985+0000 7ffbdf461640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2023-10-05T11:41:00.990 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.987+0000 7ffbe64c0880 20 handle_bi_update(): bucket=:error-at-commit-target-layout[dff27d1e-df33-400e-a68a-7ba586947c99.4604.23]): orig_sources= new_sources= 2023-10-05T11:41:00.990 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.987+0000 7ffbe64c0880 20 handle_bi_update(): bucket=:error-at-commit-target-layout[dff27d1e-df33-400e-a68a-7ba586947c99.4604.23]): potential sources added=[] removed=[] 2023-10-05T11:41:00.990 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.987+0000 7ffbe64c0880 20 handle_bi_update(): bucket=:error-at-commit-target-layout[dff27d1e-df33-400e-a68a-7ba586947c99.4604.23]): orig_dests= new_dests= 2023-10-05T11:41:00.990 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.987+0000 7ffbe64c0880 20 handle_bi_update(): bucket=:error-at-commit-target-layout[dff27d1e-df33-400e-a68a-7ba586947c99.4604.23]): potential dests added=[] removed=[] 2023-10-05T11:41:00.993 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.990+0000 7ffbe64c0880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.23.1.0 2023-10-05T11:41:00.993 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.990+0000 7ffbe64c0880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.23.1.0 2023-10-05T11:41:00.993 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.990+0000 7ffbe64c0880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.23.1.1 2023-10-05T11:41:00.993 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.990+0000 7ffbe64c0880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.23.1.1 2023-10-05T11:41:00.993 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.990+0000 7ffbe64c0880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.23.1.2 2023-10-05T11:41:00.993 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.990+0000 7ffbe64c0880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.23.1.2 2023-10-05T11:41:00.994 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.990+0000 7ffbe64c0880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.23.1.3 2023-10-05T11:41:00.994 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.990+0000 7ffbe64c0880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.23.1.3 2023-10-05T11:41:00.994 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.990+0000 7ffbe64c0880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.23.1.4 2023-10-05T11:41:00.994 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.990+0000 7ffbe64c0880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.23.1.4 2023-10-05T11:41:00.994 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.990+0000 7ffbe64c0880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.23.1.5 2023-10-05T11:41:00.994 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.990+0000 7ffbe64c0880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.23.1.5 2023-10-05T11:41:00.994 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.990+0000 7ffbe64c0880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.23.1.6 2023-10-05T11:41:00.994 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.990+0000 7ffbe64c0880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.23.1.6 2023-10-05T11:41:00.994 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.990+0000 7ffbe64c0880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.23.1.7 2023-10-05T11:41:00.994 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.990+0000 7ffbe64c0880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.23.1.7 2023-10-05T11:41:00.994 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.990+0000 7ffbe64c0880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.23.1.8 2023-10-05T11:41:00.994 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.990+0000 7ffbe64c0880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.23.1.8 2023-10-05T11:41:00.994 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.990+0000 7ffbe64c0880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.23.1.9 2023-10-05T11:41:00.995 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.990+0000 7ffbe64c0880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.23.1.9 2023-10-05T11:41:00.995 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.990+0000 7ffbe64c0880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.23.1.10 2023-10-05T11:41:00.995 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.990+0000 7ffbe64c0880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.23.1.10 2023-10-05T11:41:00.995 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.990+0000 7ffbe64c0880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.23.1.11 2023-10-05T11:41:00.995 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.990+0000 7ffbe64c0880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.23.1.11 2023-10-05T11:41:00.995 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.990+0000 7ffbe64c0880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.23.0 2023-10-05T11:41:00.996 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.990+0000 7ffbe64c0880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.23.1 2023-10-05T11:41:00.996 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.990+0000 7ffbe64c0880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.23.2 2023-10-05T11:41:00.996 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.991+0000 7ffbe64c0880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.23.3 2023-10-05T11:41:00.996 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.991+0000 7ffbe64c0880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.23.4 2023-10-05T11:41:00.996 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.992+0000 7ffbe64c0880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.23.5 2023-10-05T11:41:00.996 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.992+0000 7ffbe64c0880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.23.6 2023-10-05T11:41:00.996 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.993+0000 7ffbe64c0880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.23.7 2023-10-05T11:41:00.997 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.993+0000 7ffbe64c0880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.23.8 2023-10-05T11:41:00.997 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.993+0000 7ffbe64c0880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.23.9 2023-10-05T11:41:00.997 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.994+0000 7ffbe64c0880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.23.10 2023-10-05T11:41:01.000 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.997+0000 7ffbe64c0880 -1 Injecting error=-5 at location=commit_target_layout 2023-10-05T11:41:01.000 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:00.997+0000 7ffbe64c0880 0 ERROR: commit_reshard failed to commit target index layout: (5) Input/output error 2023-10-05T11:41:01.004 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.001+0000 7ffbcbc3a640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:41:01.006 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.003+0000 7ffbe64c0880 20 remove_watcher() i=0 2023-10-05T11:41:01.006 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.003+0000 7ffbe64c0880 2 removed watcher, disabling cache 2023-10-05T11:41:01.007 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.004+0000 7ffbe64c0880 20 remove_watcher() i=1 2023-10-05T11:41:01.008 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.005+0000 7ffbe64c0880 20 remove_watcher() i=2 2023-10-05T11:41:01.009 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.006+0000 7ffbe64c0880 20 remove_watcher() i=3 2023-10-05T11:41:01.010 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.007+0000 7ffbe64c0880 20 remove_watcher() i=4 2023-10-05T11:41:01.011 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.008+0000 7ffbe64c0880 20 remove_watcher() i=5 2023-10-05T11:41:01.012 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.009+0000 7ffbe64c0880 20 remove_watcher() i=6 2023-10-05T11:41:01.013 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.010+0000 7ffbe64c0880 20 remove_watcher() i=7 2023-10-05T11:41:01.019 INFO:tasks.workunit.client.0.smithi012.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2023-10-05T11:41:01.048 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setuser ceph since I am not root 2023-10-05T11:41:01.048 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T11:41:01.061 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.058+0000 7f0ec1232880 20 rados->read ofs=0 len=0 2023-10-05T11:41:01.063 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.059+0000 7f0ec1232880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:01.063 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.059+0000 7f0ec1232880 20 realm 2023-10-05T11:41:01.063 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.059+0000 7f0ec1232880 20 rados->read ofs=0 len=0 2023-10-05T11:41:01.063 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.059+0000 7f0ec1232880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:01.063 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.059+0000 7f0ec1232880 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T11:41:01.063 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.059+0000 7f0ec1232880 20 rados->read ofs=0 len=0 2023-10-05T11:41:01.063 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.060+0000 7f0ec1232880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:01.063 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.060+0000 7f0ec1232880 20 rados->read ofs=0 len=0 2023-10-05T11:41:01.064 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.060+0000 7f0ec1232880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:41:01.064 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.060+0000 7f0ec1232880 20 rados->read ofs=0 len=0 2023-10-05T11:41:01.064 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.061+0000 7f0ec1232880 20 rados_obj.operate() r=0 bl.length=1020 2023-10-05T11:41:01.064 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.061+0000 7f0ec1232880 20 searching for the correct realm 2023-10-05T11:41:01.073 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.070+0000 7f0ebd391640 0 -- 172.21.15.12:0/1520242935 >> [v2:172.21.15.12:6800/732466381,v1:172.21.15.12:6801/732466381] conn(0x55d2dc31e000 msgr2=0x55d2dc222b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-10-05T11:41:01.075 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.072+0000 7f0ec1232880 20 RGWRados::pool_iterate: got zone_info.dff27d1e-df33-400e-a68a-7ba586947c99 2023-10-05T11:41:01.076 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.072+0000 7f0ec1232880 20 RGWRados::pool_iterate: got zonegroup_info.c78aa576-9d15-4e9d-b3c0-4af23a22062c 2023-10-05T11:41:01.076 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.072+0000 7f0ec1232880 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T11:41:01.076 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.072+0000 7f0ec1232880 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T11:41:01.076 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.072+0000 7f0ec1232880 20 rados->read ofs=0 len=0 2023-10-05T11:41:01.076 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.072+0000 7f0ec1232880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:01.076 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.072+0000 7f0ec1232880 20 rados->read ofs=0 len=0 2023-10-05T11:41:01.078 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.073+0000 7f0ec1232880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:41:01.078 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.073+0000 7f0ec1232880 20 rados->read ofs=0 len=0 2023-10-05T11:41:01.079 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.073+0000 7f0ec1232880 20 rados_obj.operate() r=0 bl.length=454 2023-10-05T11:41:01.079 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.073+0000 7f0ec1232880 20 zone default found 2023-10-05T11:41:01.079 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.073+0000 7f0ec1232880 4 Realm: () 2023-10-05T11:41:01.079 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.073+0000 7f0ec1232880 4 ZoneGroup: default (c78aa576-9d15-4e9d-b3c0-4af23a22062c) 2023-10-05T11:41:01.079 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.073+0000 7f0ec1232880 4 Zone: default (dff27d1e-df33-400e-a68a-7ba586947c99) 2023-10-05T11:41:01.079 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.073+0000 7f0ec1232880 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T11:41:01.079 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.073+0000 7f0ec1232880 20 zonegroup default 2023-10-05T11:41:01.080 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.073+0000 7f0ec1232880 20 rados->read ofs=0 len=0 2023-10-05T11:41:01.080 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.073+0000 7f0ec1232880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:01.080 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.073+0000 7f0ec1232880 20 rados->read ofs=0 len=0 2023-10-05T11:41:01.080 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.074+0000 7f0ec1232880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:01.080 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.074+0000 7f0ec1232880 20 rados->read ofs=0 len=0 2023-10-05T11:41:01.080 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.074+0000 7f0ec1232880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:01.080 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.074+0000 7f0ec1232880 20 started sync module instance, tier type = 2023-10-05T11:41:01.080 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.074+0000 7f0ec1232880 20 started zone id=dff27d1e-df33-400e-a68a-7ba586947c99 (name=default) with tier type = 2023-10-05T11:41:01.082 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.079+0000 7f0ebd391640 0 -- 172.21.15.12:0/1520242935 >> [v2:172.21.15.12:6800/732466381,v1:172.21.15.12:6801/732466381] conn(0x55d2dc336000 msgr2=0x55d2dc224100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-10-05T11:41:01.086 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.083+0000 7f0ec1232880 20 add_watcher() i=0 2023-10-05T11:41:01.086 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.083+0000 7f0ec1232880 20 add_watcher() i=1 2023-10-05T11:41:01.086 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.083+0000 7f0ec1232880 20 add_watcher() i=2 2023-10-05T11:41:01.087 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.083+0000 7f0ec1232880 20 add_watcher() i=3 2023-10-05T11:41:01.087 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.083+0000 7f0ec1232880 20 add_watcher() i=4 2023-10-05T11:41:01.087 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.083+0000 7f0ec1232880 20 add_watcher() i=5 2023-10-05T11:41:01.087 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.083+0000 7f0ec1232880 20 add_watcher() i=6 2023-10-05T11:41:01.087 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.084+0000 7f0ec1232880 20 add_watcher() i=7 2023-10-05T11:41:01.087 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.084+0000 7f0ec1232880 2 all 8 watchers are set, enabling cache 2023-10-05T11:41:01.089 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.085+0000 7f0ea435f640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:41:01.089 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.086+0000 7f0ec1232880 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T11:41:01.089 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.086+0000 7f0ec1232880 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T11:41:01.095 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.091+0000 7f0ec1232880 5 note: GC not initialized 2023-10-05T11:41:01.095 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.092+0000 7f0e9fb56640 20 reqs_thread_entry: start 2023-10-05T11:41:01.095 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.092+0000 7f0ec1232880 20 init_complete bucket index max shards: 11 2023-10-05T11:41:01.095 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.092+0000 7f0ec1232880 20 Filter name: none 2023-10-05T11:41:01.096 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.092+0000 7f0e9db52640 20 reqs_thread_entry: start 2023-10-05T11:41:01.096 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.092+0000 7f0ec1232880 20 rados->read ofs=0 len=0 2023-10-05T11:41:01.096 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.092+0000 7f0ec1232880 20 rados_obj.operate() r=0 bl.length=221 2023-10-05T11:41:01.096 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.092+0000 7f0ec1232880 20 rados->read ofs=0 len=0 2023-10-05T11:41:01.097 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.093+0000 7f0ec1232880 20 rados_obj.operate() r=0 bl.length=425 2023-10-05T11:41:01.097 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.093+0000 7f0ec1232880 20 couldn't put binfo cache entry, might have raced with data changes 2023-10-05T11:41:01.097 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.093+0000 7f0ec1232880 20 rados->read ofs=0 len=0 2023-10-05T11:41:01.097 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.093+0000 7f0ec1232880 20 rados_obj.operate() r=0 bl.length=221 2023-10-05T11:41:01.097 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.093+0000 7f0ec1232880 20 rados->read ofs=0 len=0 2023-10-05T11:41:01.097 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.093+0000 7f0ec1232880 20 rados_obj.operate() r=0 bl.length=425 2023-10-05T11:41:01.097 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.093+0000 7f0ec1232880 20 couldn't put binfo cache entry, might have raced with data changes 2023-10-05T11:41:01.098 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.094+0000 7f0ec1232880 20 rados->read ofs=0 len=0 2023-10-05T11:41:01.098 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.095+0000 7f0ec1232880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:01.098 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.095+0000 7f0ea435f640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:41:01.100 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.097+0000 7f0ec1232880 20 remove_watcher() i=0 2023-10-05T11:41:01.100 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.097+0000 7f0ec1232880 2 removed watcher, disabling cache 2023-10-05T11:41:01.101 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.098+0000 7f0ec1232880 20 remove_watcher() i=1 2023-10-05T11:41:01.102 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.099+0000 7f0ec1232880 20 remove_watcher() i=2 2023-10-05T11:41:01.103 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.100+0000 7f0ec1232880 20 remove_watcher() i=3 2023-10-05T11:41:01.104 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.101+0000 7f0ec1232880 20 remove_watcher() i=4 2023-10-05T11:41:01.105 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.102+0000 7f0ec1232880 20 remove_watcher() i=5 2023-10-05T11:41:01.106 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.103+0000 7f0ec1232880 20 remove_watcher() i=6 2023-10-05T11:41:01.107 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.104+0000 7f0ec1232880 20 remove_watcher() i=7 2023-10-05T11:41:01.112 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:41:01.112 INFO:tasks.workunit.client.0.smithi012.stderr:BUCKET_STATS: 2023-10-05T11:41:01.112 INFO:tasks.workunit.client.0.smithi012.stderr:bucket: error-at-commit-target-layout id: dff27d1e-df33-400e-a68a-7ba586947c99.4604.23 num_objects: 20 size_kb: 1 num_shards: 11 2023-10-05T11:41:01.112 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:41:01.195 INFO:tasks.workunit.client.0.smithi012.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2023-10-05T11:41:01.227 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setuser ceph since I am not root 2023-10-05T11:41:01.227 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T11:41:01.240 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.236+0000 7fb1a092c880 20 rados->read ofs=0 len=0 2023-10-05T11:41:01.241 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.238+0000 7fb1a092c880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:01.241 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.238+0000 7fb1a092c880 20 realm 2023-10-05T11:41:01.242 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.238+0000 7fb1a092c880 20 rados->read ofs=0 len=0 2023-10-05T11:41:01.242 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.238+0000 7fb1a092c880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:01.242 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.238+0000 7fb1a092c880 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T11:41:01.242 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.238+0000 7fb1a092c880 20 rados->read ofs=0 len=0 2023-10-05T11:41:01.242 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.238+0000 7fb1a092c880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:01.242 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.238+0000 7fb1a092c880 20 rados->read ofs=0 len=0 2023-10-05T11:41:01.243 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.239+0000 7fb1a092c880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:41:01.243 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.239+0000 7fb1a092c880 20 rados->read ofs=0 len=0 2023-10-05T11:41:01.243 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.240+0000 7fb1a092c880 20 rados_obj.operate() r=0 bl.length=1020 2023-10-05T11:41:01.243 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.240+0000 7fb1a092c880 20 searching for the correct realm 2023-10-05T11:41:01.252 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.248+0000 7fb19d21c640 0 -- 172.21.15.12:0/114690247 >> [v2:172.21.15.170:6814/3150808418,v1:172.21.15.170:6816/3150808418] conn(0x55713d27bc00 msgr2=0x55713c680c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-10-05T11:41:01.254 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.250+0000 7fb1a092c880 20 RGWRados::pool_iterate: got zone_info.dff27d1e-df33-400e-a68a-7ba586947c99 2023-10-05T11:41:01.254 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.250+0000 7fb1a092c880 20 RGWRados::pool_iterate: got zonegroup_info.c78aa576-9d15-4e9d-b3c0-4af23a22062c 2023-10-05T11:41:01.254 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.250+0000 7fb1a092c880 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T11:41:01.254 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.250+0000 7fb1a092c880 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T11:41:01.254 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.250+0000 7fb1a092c880 20 rados->read ofs=0 len=0 2023-10-05T11:41:01.254 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.250+0000 7fb1a092c880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:01.254 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.250+0000 7fb1a092c880 20 rados->read ofs=0 len=0 2023-10-05T11:41:01.254 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.251+0000 7fb1a092c880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:41:01.254 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.251+0000 7fb1a092c880 20 rados->read ofs=0 len=0 2023-10-05T11:41:01.255 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.251+0000 7fb1a092c880 20 rados_obj.operate() r=0 bl.length=454 2023-10-05T11:41:01.255 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.251+0000 7fb1a092c880 20 zone default found 2023-10-05T11:41:01.256 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.251+0000 7fb1a092c880 4 Realm: () 2023-10-05T11:41:01.256 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.251+0000 7fb1a092c880 4 ZoneGroup: default (c78aa576-9d15-4e9d-b3c0-4af23a22062c) 2023-10-05T11:41:01.256 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.251+0000 7fb1a092c880 4 Zone: default (dff27d1e-df33-400e-a68a-7ba586947c99) 2023-10-05T11:41:01.256 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.251+0000 7fb1a092c880 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T11:41:01.256 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.251+0000 7fb1a092c880 20 zonegroup default 2023-10-05T11:41:01.256 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.251+0000 7fb1a092c880 20 rados->read ofs=0 len=0 2023-10-05T11:41:01.256 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.251+0000 7fb1a092c880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:01.256 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.251+0000 7fb1a092c880 20 rados->read ofs=0 len=0 2023-10-05T11:41:01.256 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.252+0000 7fb1a092c880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:01.256 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.252+0000 7fb1a092c880 20 rados->read ofs=0 len=0 2023-10-05T11:41:01.256 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.252+0000 7fb1a092c880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:01.257 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.252+0000 7fb1a092c880 20 started sync module instance, tier type = 2023-10-05T11:41:01.257 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.252+0000 7fb1a092c880 20 started zone id=dff27d1e-df33-400e-a68a-7ba586947c99 (name=default) with tier type = 2023-10-05T11:41:01.261 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.257+0000 7fb19da1d640 0 -- 172.21.15.12:0/114690247 >> [v2:172.21.15.170:6800/4137726411,v1:172.21.15.170:6801/4137726411] conn(0x55713c447400 msgr2=0x55713c747600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:41:01.264 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.261+0000 7fb1a092c880 20 add_watcher() i=0 2023-10-05T11:41:01.264 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.261+0000 7fb1a092c880 20 add_watcher() i=1 2023-10-05T11:41:01.264 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.261+0000 7fb1a092c880 20 add_watcher() i=2 2023-10-05T11:41:01.264 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.261+0000 7fb1a092c880 20 add_watcher() i=3 2023-10-05T11:41:01.264 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.261+0000 7fb1a092c880 20 add_watcher() i=4 2023-10-05T11:41:01.265 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.261+0000 7fb1a092c880 20 add_watcher() i=5 2023-10-05T11:41:01.265 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.261+0000 7fb1a092c880 20 add_watcher() i=6 2023-10-05T11:41:01.265 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.262+0000 7fb1a092c880 20 add_watcher() i=7 2023-10-05T11:41:01.265 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.262+0000 7fb1a092c880 2 all 8 watchers are set, enabling cache 2023-10-05T11:41:01.267 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.263+0000 7fb1841ea640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:41:01.267 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.264+0000 7fb1a092c880 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T11:41:01.267 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.264+0000 7fb1a092c880 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T11:41:01.273 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.269+0000 7fb1a092c880 5 note: GC not initialized 2023-10-05T11:41:01.273 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.269+0000 7fb17f9e1640 20 reqs_thread_entry: start 2023-10-05T11:41:01.273 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.269+0000 7fb1a092c880 20 init_complete bucket index max shards: 11 2023-10-05T11:41:01.273 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.270+0000 7fb1a092c880 20 Filter name: none 2023-10-05T11:41:01.273 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.270+0000 7fb17d9dd640 20 reqs_thread_entry: start 2023-10-05T11:41:01.273 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.270+0000 7fb1a092c880 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2023-10-05T11:41:01.273 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.270+0000 7fb1a092c880 20 rados->read ofs=0 len=0 2023-10-05T11:41:01.274 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.270+0000 7fb1a092c880 20 rados_obj.operate() r=0 bl.length=221 2023-10-05T11:41:01.274 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.270+0000 7fb1a092c880 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2023-10-05T11:41:01.274 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.270+0000 7fb1a092c880 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2023-10-05T11:41:01.274 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.270+0000 7fb1a092c880 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.23 : miss 2023-10-05T11:41:01.275 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.270+0000 7fb1a092c880 20 rados->read ofs=0 len=0 2023-10-05T11:41:01.275 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.271+0000 7fb1a092c880 20 rados_obj.operate() r=0 bl.length=425 2023-10-05T11:41:01.275 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.271+0000 7fb1a092c880 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.23 info.flags=0x17 2023-10-05T11:41:01.275 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.271+0000 7fb1a092c880 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.23 to cache LRU end 2023-10-05T11:41:01.275 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.271+0000 7fb1a092c880 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T11:41:01.275 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.271+0000 7fb1a092c880 10 updating xattr: name=user.rgw.acl bl.length()=265 2023-10-05T11:41:01.275 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.271+0000 7fb1a092c880 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.23 2023-10-05T11:41:01.275 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.272+0000 7fb1a092c880 10 init_target_layout removing existing target index objects from a previous reshard attempt 2023-10-05T11:41:01.281 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.278+0000 7fb1a092c880 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.23 info.flags=0x17 2023-10-05T11:41:01.281 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.278+0000 7fb1a092c880 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.23 to cache LRU end 2023-10-05T11:41:01.282 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.278+0000 7fb1a092c880 10 updating xattr: name=user.rgw.acl bl.length()=265 2023-10-05T11:41:01.282 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.278+0000 7fb1a092c880 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.23, ofs0, ns] 2023-10-05T11:41:01.282 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.278+0000 7fb197210640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1060856922169 cookie 93944835025920 notifier 7005 bl.length()=965 2023-10-05T11:41:01.282 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.279+0000 7fb197210640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.23 info.flags=0x17 2023-10-05T11:41:01.282 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.279+0000 7fb197210640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.23 to cache LRU end 2023-10-05T11:41:01.282 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.279+0000 7fb197210640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2023-10-05T11:41:01.284 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.280+0000 7fb1a092c880 20 handle_bi_update(): bucket=:error-at-commit-target-layout[dff27d1e-df33-400e-a68a-7ba586947c99.4604.23]): orig_sources= new_sources= 2023-10-05T11:41:01.284 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.280+0000 7fb1a092c880 20 handle_bi_update(): bucket=:error-at-commit-target-layout[dff27d1e-df33-400e-a68a-7ba586947c99.4604.23]): potential sources added=[] removed=[] 2023-10-05T11:41:01.284 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.280+0000 7fb1a092c880 20 handle_bi_update(): bucket=:error-at-commit-target-layout[dff27d1e-df33-400e-a68a-7ba586947c99.4604.23]): orig_dests= new_dests= 2023-10-05T11:41:01.284 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.280+0000 7fb1a092c880 20 handle_bi_update(): bucket=:error-at-commit-target-layout[dff27d1e-df33-400e-a68a-7ba586947c99.4604.23]): potential dests added=[] removed=[] 2023-10-05T11:41:01.286 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.283+0000 7fb1a092c880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.23.2.0 2023-10-05T11:41:01.286 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.283+0000 7fb1a092c880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.23.2.0 2023-10-05T11:41:01.287 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.283+0000 7fb1a092c880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.23.2.1 2023-10-05T11:41:01.287 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.283+0000 7fb1a092c880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.23.2.1 2023-10-05T11:41:01.287 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.283+0000 7fb1a092c880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.23.2.2 2023-10-05T11:41:01.287 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.283+0000 7fb1a092c880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.23.2.2 2023-10-05T11:41:01.287 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.283+0000 7fb1a092c880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.23.2.3 2023-10-05T11:41:01.287 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.283+0000 7fb1a092c880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.23.2.3 2023-10-05T11:41:01.287 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.283+0000 7fb1a092c880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.23.2.4 2023-10-05T11:41:01.287 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.283+0000 7fb1a092c880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.23.2.4 2023-10-05T11:41:01.287 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.283+0000 7fb1a092c880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.23.2.5 2023-10-05T11:41:01.287 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.283+0000 7fb1a092c880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.23.2.5 2023-10-05T11:41:01.287 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.283+0000 7fb1a092c880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.23.2.6 2023-10-05T11:41:01.287 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.283+0000 7fb1a092c880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.23.2.6 2023-10-05T11:41:01.288 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.283+0000 7fb1a092c880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.23.2.7 2023-10-05T11:41:01.288 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.283+0000 7fb1a092c880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.23.2.7 2023-10-05T11:41:01.288 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.283+0000 7fb1a092c880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.23.2.8 2023-10-05T11:41:01.288 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.283+0000 7fb1a092c880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.23.2.8 2023-10-05T11:41:01.288 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.283+0000 7fb1a092c880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.23.2.9 2023-10-05T11:41:01.288 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.283+0000 7fb1a092c880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.23.2.9 2023-10-05T11:41:01.288 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.283+0000 7fb1a092c880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.23.2.10 2023-10-05T11:41:01.288 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.283+0000 7fb1a092c880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.23.2.10 2023-10-05T11:41:01.288 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.283+0000 7fb1a092c880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.23.2.11 2023-10-05T11:41:01.288 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.283+0000 7fb1a092c880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.23.2.11 2023-10-05T11:41:01.288 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.283+0000 7fb1a092c880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.23.0 2023-10-05T11:41:01.288 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.283+0000 7fb1a092c880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.23.1 2023-10-05T11:41:01.289 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.284+0000 7fb1a092c880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.23.2 2023-10-05T11:41:01.289 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.284+0000 7fb1a092c880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.23.3 2023-10-05T11:41:01.289 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.285+0000 7fb1a092c880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.23.4 2023-10-05T11:41:01.290 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.285+0000 7fb1a092c880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.23.5 2023-10-05T11:41:01.290 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.285+0000 7fb1a092c880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.23.6 2023-10-05T11:41:01.290 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.286+0000 7fb1a092c880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.23.7 2023-10-05T11:41:01.290 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.286+0000 7fb1a092c880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.23.8 2023-10-05T11:41:01.290 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.287+0000 7fb1a092c880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.23.9 2023-10-05T11:41:01.291 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.287+0000 7fb1a092c880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.23.10 2023-10-05T11:41:01.293 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.290+0000 7fb1a092c880 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.23 : hit (requested=0x17, cached=0x17) 2023-10-05T11:41:01.293 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.290+0000 7fb1a092c880 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.23 2023-10-05T11:41:01.294 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.291+0000 7fb1a092c880 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.23 info.flags=0x17 2023-10-05T11:41:01.295 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.291+0000 7fb1a092c880 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.23 to cache LRU end 2023-10-05T11:41:01.295 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.291+0000 7fb1a092c880 10 updating xattr: name=user.rgw.acl bl.length()=265 2023-10-05T11:41:01.295 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.291+0000 7fb1a092c880 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.23, ofs0, ns] 2023-10-05T11:41:01.295 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.291+0000 7fb197210640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1060856922170 cookie 93944835025920 notifier 7005 bl.length()=933 2023-10-05T11:41:01.295 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.291+0000 7fb197210640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.23 info.flags=0x17 2023-10-05T11:41:01.295 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.291+0000 7fb197210640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.23 to cache LRU end 2023-10-05T11:41:01.295 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.291+0000 7fb197210640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2023-10-05T11:41:01.297 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.293+0000 7fb1a092c880 20 handle_bi_update(): bucket=:error-at-commit-target-layout[dff27d1e-df33-400e-a68a-7ba586947c99.4604.23]): orig_sources= new_sources= 2023-10-05T11:41:01.297 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.293+0000 7fb1a092c880 20 handle_bi_update(): bucket=:error-at-commit-target-layout[dff27d1e-df33-400e-a68a-7ba586947c99.4604.23]): potential sources added=[] removed=[] 2023-10-05T11:41:01.297 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.293+0000 7fb1a092c880 20 handle_bi_update(): bucket=:error-at-commit-target-layout[dff27d1e-df33-400e-a68a-7ba586947c99.4604.23]): orig_dests= new_dests= 2023-10-05T11:41:01.297 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.293+0000 7fb1a092c880 20 handle_bi_update(): bucket=:error-at-commit-target-layout[dff27d1e-df33-400e-a68a-7ba586947c99.4604.23]): potential dests added=[] removed=[] 2023-10-05T11:41:01.299 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.295+0000 7fb1a092c880 1 execute INFO: reshard of bucket "error-at-commit-target-layout" completed successfully 2023-10-05T11:41:01.300 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.297+0000 7fb1841ea640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:41:01.302 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.299+0000 7fb1a092c880 20 remove_watcher() i=0 2023-10-05T11:41:01.302 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.299+0000 7fb1a092c880 2 removed watcher, disabling cache 2023-10-05T11:41:01.304 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.300+0000 7fb1a092c880 20 remove_watcher() i=1 2023-10-05T11:41:01.305 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.302+0000 7fb1a092c880 20 remove_watcher() i=2 2023-10-05T11:41:01.306 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.303+0000 7fb1a092c880 20 remove_watcher() i=3 2023-10-05T11:41:01.307 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.304+0000 7fb1a092c880 20 remove_watcher() i=4 2023-10-05T11:41:01.308 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.305+0000 7fb1a092c880 20 remove_watcher() i=5 2023-10-05T11:41:01.309 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.306+0000 7fb1a092c880 20 remove_watcher() i=6 2023-10-05T11:41:01.310 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.307+0000 7fb1a092c880 20 remove_watcher() i=7 2023-10-05T11:41:01.316 INFO:tasks.workunit.client.0.smithi012.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2023-10-05T11:41:01.344 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setuser ceph since I am not root 2023-10-05T11:41:01.344 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T11:41:01.357 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.353+0000 7f597a426880 20 rados->read ofs=0 len=0 2023-10-05T11:41:01.359 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.355+0000 7f597a426880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:01.359 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.355+0000 7f597a426880 20 realm 2023-10-05T11:41:01.359 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.355+0000 7f597a426880 20 rados->read ofs=0 len=0 2023-10-05T11:41:01.359 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.355+0000 7f597a426880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:01.359 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.355+0000 7f597a426880 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T11:41:01.359 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.355+0000 7f597a426880 20 rados->read ofs=0 len=0 2023-10-05T11:41:01.359 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.355+0000 7f597a426880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:01.359 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.355+0000 7f597a426880 20 rados->read ofs=0 len=0 2023-10-05T11:41:01.360 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.356+0000 7f597a426880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:41:01.360 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.356+0000 7f597a426880 20 rados->read ofs=0 len=0 2023-10-05T11:41:01.360 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.357+0000 7f597a426880 20 rados_obj.operate() r=0 bl.length=1020 2023-10-05T11:41:01.360 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.357+0000 7f597a426880 20 searching for the correct realm 2023-10-05T11:41:01.370 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.367+0000 7f597699f640 0 -- 172.21.15.12:0/1467888042 >> [v2:172.21.15.170:6814/3150808418,v1:172.21.15.170:6816/3150808418] conn(0x55a5a6bd1c00 msgr2=0x55a5a5fe0c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:41:01.371 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.368+0000 7f597a426880 20 RGWRados::pool_iterate: got zone_info.dff27d1e-df33-400e-a68a-7ba586947c99 2023-10-05T11:41:01.371 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.368+0000 7f597a426880 20 RGWRados::pool_iterate: got zonegroup_info.c78aa576-9d15-4e9d-b3c0-4af23a22062c 2023-10-05T11:41:01.371 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.368+0000 7f597a426880 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T11:41:01.371 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.368+0000 7f597a426880 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T11:41:01.371 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.368+0000 7f597a426880 20 rados->read ofs=0 len=0 2023-10-05T11:41:01.372 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.368+0000 7f597a426880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:01.372 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.368+0000 7f597a426880 20 rados->read ofs=0 len=0 2023-10-05T11:41:01.373 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.368+0000 7f597a426880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:41:01.373 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.368+0000 7f597a426880 20 rados->read ofs=0 len=0 2023-10-05T11:41:01.373 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.368+0000 7f597a426880 20 rados_obj.operate() r=0 bl.length=454 2023-10-05T11:41:01.373 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.368+0000 7f597a426880 20 zone default found 2023-10-05T11:41:01.373 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.368+0000 7f597a426880 4 Realm: () 2023-10-05T11:41:01.373 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.368+0000 7f597a426880 4 ZoneGroup: default (c78aa576-9d15-4e9d-b3c0-4af23a22062c) 2023-10-05T11:41:01.373 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.368+0000 7f597a426880 4 Zone: default (dff27d1e-df33-400e-a68a-7ba586947c99) 2023-10-05T11:41:01.373 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.368+0000 7f597a426880 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T11:41:01.373 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.368+0000 7f597a426880 20 zonegroup default 2023-10-05T11:41:01.374 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.368+0000 7f597a426880 20 rados->read ofs=0 len=0 2023-10-05T11:41:01.374 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.369+0000 7f597a426880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:01.374 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.369+0000 7f597a426880 20 rados->read ofs=0 len=0 2023-10-05T11:41:01.374 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.369+0000 7f597a426880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:01.374 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.369+0000 7f597a426880 20 rados->read ofs=0 len=0 2023-10-05T11:41:01.374 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.369+0000 7f597a426880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:01.374 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.369+0000 7f597a426880 20 started sync module instance, tier type = 2023-10-05T11:41:01.374 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.369+0000 7f597a426880 20 started zone id=dff27d1e-df33-400e-a68a-7ba586947c99 (name=default) with tier type = 2023-10-05T11:41:01.380 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.377+0000 7f59771a0640 0 -- 172.21.15.12:0/1467888042 >> [v2:172.21.15.12:6824/2171933159,v1:172.21.15.12:6825/2171933159] conn(0x55a5a6198400 msgr2=0x55a5a5fe1700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:41:01.381 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.378+0000 7f597a426880 20 add_watcher() i=0 2023-10-05T11:41:01.381 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.378+0000 7f597a426880 20 add_watcher() i=1 2023-10-05T11:41:01.381 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.378+0000 7f597a426880 20 add_watcher() i=2 2023-10-05T11:41:01.381 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.378+0000 7f597a426880 20 add_watcher() i=3 2023-10-05T11:41:01.382 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.378+0000 7f597a426880 20 add_watcher() i=4 2023-10-05T11:41:01.382 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.378+0000 7f597a426880 20 add_watcher() i=5 2023-10-05T11:41:01.382 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.378+0000 7f597a426880 20 add_watcher() i=6 2023-10-05T11:41:01.382 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.379+0000 7f597a426880 20 add_watcher() i=7 2023-10-05T11:41:01.382 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.379+0000 7f597a426880 2 all 8 watchers are set, enabling cache 2023-10-05T11:41:01.384 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.381+0000 7f595d96d640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:41:01.384 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.381+0000 7f597a426880 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T11:41:01.384 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.381+0000 7f597a426880 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T11:41:01.390 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.386+0000 7f597a426880 5 note: GC not initialized 2023-10-05T11:41:01.390 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.386+0000 7f5959164640 20 reqs_thread_entry: start 2023-10-05T11:41:01.390 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.386+0000 7f597a426880 20 init_complete bucket index max shards: 11 2023-10-05T11:41:01.390 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.387+0000 7f597a426880 20 Filter name: none 2023-10-05T11:41:01.390 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.387+0000 7f5957160640 20 reqs_thread_entry: start 2023-10-05T11:41:01.390 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.387+0000 7f597a426880 20 rados->read ofs=0 len=0 2023-10-05T11:41:01.391 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.387+0000 7f597a426880 20 rados_obj.operate() r=0 bl.length=221 2023-10-05T11:41:01.391 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.387+0000 7f597a426880 20 rados->read ofs=0 len=0 2023-10-05T11:41:01.392 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.388+0000 7f597a426880 20 rados_obj.operate() r=0 bl.length=393 2023-10-05T11:41:01.392 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.388+0000 7f597a426880 20 couldn't put binfo cache entry, might have raced with data changes 2023-10-05T11:41:01.392 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.388+0000 7f597a426880 20 rados->read ofs=0 len=0 2023-10-05T11:41:01.392 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.388+0000 7f597a426880 20 rados_obj.operate() r=0 bl.length=221 2023-10-05T11:41:01.392 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.388+0000 7f597a426880 20 rados->read ofs=0 len=0 2023-10-05T11:41:01.392 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.389+0000 7f597a426880 20 rados_obj.operate() r=0 bl.length=393 2023-10-05T11:41:01.392 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.389+0000 7f597a426880 20 couldn't put binfo cache entry, might have raced with data changes 2023-10-05T11:41:01.393 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.389+0000 7f597a426880 20 rados->read ofs=0 len=0 2023-10-05T11:41:01.393 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.390+0000 7f597a426880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:01.393 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.390+0000 7f595d96d640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:41:01.396 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.392+0000 7f597a426880 20 remove_watcher() i=0 2023-10-05T11:41:01.396 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.392+0000 7f597a426880 2 removed watcher, disabling cache 2023-10-05T11:41:01.397 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.394+0000 7f597a426880 20 remove_watcher() i=1 2023-10-05T11:41:01.398 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.395+0000 7f597a426880 20 remove_watcher() i=2 2023-10-05T11:41:01.399 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.396+0000 7f597a426880 20 remove_watcher() i=3 2023-10-05T11:41:01.400 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.397+0000 7f597a426880 20 remove_watcher() i=4 2023-10-05T11:41:01.401 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.397+0000 7f597a426880 20 remove_watcher() i=5 2023-10-05T11:41:01.402 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.398+0000 7f597a426880 20 remove_watcher() i=6 2023-10-05T11:41:01.403 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:01.399+0000 7f597a426880 20 remove_watcher() i=7 2023-10-05T11:41:01.407 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:41:01.407 INFO:tasks.workunit.client.0.smithi012.stderr:BUCKET_STATS: 2023-10-05T11:41:01.407 INFO:tasks.workunit.client.0.smithi012.stderr:bucket: error-at-commit-target-layout id: dff27d1e-df33-400e-a68a-7ba586947c99.4604.23 num_objects: 19 size_kb: 1 num_shards: 12 2023-10-05T11:41:01.407 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:41:01.737 INFO:tasks.workunit.client.0.smithi012.stderr:TEST: reshard bucket with ECANCELED injected at commit_target_layout 2023-10-05T11:41:01.738 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:41:02.441 INFO:tasks.workunit.client.0.smithi012.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2023-10-05T11:41:02.469 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setuser ceph since I am not root 2023-10-05T11:41:02.470 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T11:41:02.483 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.480+0000 7fa139929880 20 rados->read ofs=0 len=0 2023-10-05T11:41:02.485 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.481+0000 7fa139929880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:02.485 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.481+0000 7fa139929880 20 realm 2023-10-05T11:41:02.485 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.481+0000 7fa139929880 20 rados->read ofs=0 len=0 2023-10-05T11:41:02.485 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.481+0000 7fa139929880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:02.485 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.481+0000 7fa139929880 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T11:41:02.485 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.481+0000 7fa139929880 20 rados->read ofs=0 len=0 2023-10-05T11:41:02.485 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.481+0000 7fa139929880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:02.485 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.481+0000 7fa139929880 20 rados->read ofs=0 len=0 2023-10-05T11:41:02.486 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.482+0000 7fa139929880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:41:02.486 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.482+0000 7fa139929880 20 rados->read ofs=0 len=0 2023-10-05T11:41:02.486 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.483+0000 7fa139929880 20 rados_obj.operate() r=0 bl.length=1020 2023-10-05T11:41:02.486 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.483+0000 7fa139929880 20 searching for the correct realm 2023-10-05T11:41:02.493 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.490+0000 7fa1359ff640 0 -- 172.21.15.12:0/3171172512 >> [v2:172.21.15.170:6824/75773779,v1:172.21.15.170:6825/75773779] conn(0x55d6814db400 msgr2=0x55d681325700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:41:02.497 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.493+0000 7fa139929880 20 RGWRados::pool_iterate: got zone_info.dff27d1e-df33-400e-a68a-7ba586947c99 2023-10-05T11:41:02.497 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.493+0000 7fa139929880 20 RGWRados::pool_iterate: got zonegroup_info.c78aa576-9d15-4e9d-b3c0-4af23a22062c 2023-10-05T11:41:02.497 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.493+0000 7fa139929880 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T11:41:02.497 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.493+0000 7fa139929880 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T11:41:02.497 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.493+0000 7fa139929880 20 rados->read ofs=0 len=0 2023-10-05T11:41:02.497 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.493+0000 7fa139929880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:02.497 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.494+0000 7fa139929880 20 rados->read ofs=0 len=0 2023-10-05T11:41:02.498 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.494+0000 7fa139929880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:41:02.498 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.494+0000 7fa139929880 20 rados->read ofs=0 len=0 2023-10-05T11:41:02.498 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.494+0000 7fa139929880 20 rados_obj.operate() r=0 bl.length=454 2023-10-05T11:41:02.499 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.494+0000 7fa139929880 20 zone default found 2023-10-05T11:41:02.499 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.494+0000 7fa139929880 4 Realm: () 2023-10-05T11:41:02.499 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.494+0000 7fa139929880 4 ZoneGroup: default (c78aa576-9d15-4e9d-b3c0-4af23a22062c) 2023-10-05T11:41:02.499 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.494+0000 7fa139929880 4 Zone: default (dff27d1e-df33-400e-a68a-7ba586947c99) 2023-10-05T11:41:02.499 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.494+0000 7fa139929880 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T11:41:02.499 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.494+0000 7fa139929880 20 zonegroup default 2023-10-05T11:41:02.499 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.494+0000 7fa139929880 20 rados->read ofs=0 len=0 2023-10-05T11:41:02.499 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.494+0000 7fa139929880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:02.499 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.494+0000 7fa139929880 20 rados->read ofs=0 len=0 2023-10-05T11:41:02.499 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.495+0000 7fa139929880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:02.499 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.495+0000 7fa139929880 20 rados->read ofs=0 len=0 2023-10-05T11:41:02.499 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.495+0000 7fa136a01640 0 -- 172.21.15.12:0/3171172512 >> [v2:172.21.15.12:6824/2171933159,v1:172.21.15.12:6825/2171933159] conn(0x55d6814db800 msgr2=0x55d6813eeb00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-10-05T11:41:02.500 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.495+0000 7fa139929880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:02.500 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.495+0000 7fa139929880 20 started sync module instance, tier type = 2023-10-05T11:41:02.500 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.495+0000 7fa139929880 20 started zone id=dff27d1e-df33-400e-a68a-7ba586947c99 (name=default) with tier type = 2023-10-05T11:41:02.507 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.504+0000 7fa139929880 20 add_watcher() i=0 2023-10-05T11:41:02.508 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.504+0000 7fa139929880 20 add_watcher() i=1 2023-10-05T11:41:02.508 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.504+0000 7fa139929880 20 add_watcher() i=2 2023-10-05T11:41:02.508 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.504+0000 7fa139929880 20 add_watcher() i=3 2023-10-05T11:41:02.508 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.504+0000 7fa139929880 20 add_watcher() i=4 2023-10-05T11:41:02.508 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.504+0000 7fa139929880 20 add_watcher() i=5 2023-10-05T11:41:02.508 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.504+0000 7fa139929880 20 add_watcher() i=6 2023-10-05T11:41:02.508 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.505+0000 7fa139929880 20 add_watcher() i=7 2023-10-05T11:41:02.508 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.505+0000 7fa139929880 2 all 8 watchers are set, enabling cache 2023-10-05T11:41:02.510 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.507+0000 7fa11d1ce640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:41:02.510 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.507+0000 7fa139929880 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T11:41:02.510 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.507+0000 7fa139929880 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T11:41:02.516 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.512+0000 7fa139929880 5 note: GC not initialized 2023-10-05T11:41:02.516 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.513+0000 7fa1189c5640 20 reqs_thread_entry: start 2023-10-05T11:41:02.517 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.513+0000 7fa139929880 20 init_complete bucket index max shards: 11 2023-10-05T11:41:02.517 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.513+0000 7fa139929880 20 Filter name: none 2023-10-05T11:41:02.517 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.513+0000 7fa1169c1640 20 reqs_thread_entry: start 2023-10-05T11:41:02.517 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.513+0000 7fa139929880 20 rados->read ofs=0 len=0 2023-10-05T11:41:02.518 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.513+0000 7fa139929880 20 rados_obj.operate() r=0 bl.length=221 2023-10-05T11:41:02.518 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.513+0000 7fa139929880 20 rados->read ofs=0 len=0 2023-10-05T11:41:02.518 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.514+0000 7fa139929880 20 rados_obj.operate() r=0 bl.length=393 2023-10-05T11:41:02.518 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.514+0000 7fa139929880 20 couldn't put binfo cache entry, might have raced with data changes 2023-10-05T11:41:02.518 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.514+0000 7fa139929880 20 rados->read ofs=0 len=0 2023-10-05T11:41:02.518 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.514+0000 7fa139929880 20 rados_obj.operate() r=0 bl.length=221 2023-10-05T11:41:02.518 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.514+0000 7fa139929880 20 rados->read ofs=0 len=0 2023-10-05T11:41:02.518 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.515+0000 7fa139929880 20 rados_obj.operate() r=0 bl.length=393 2023-10-05T11:41:02.518 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.515+0000 7fa139929880 20 couldn't put binfo cache entry, might have raced with data changes 2023-10-05T11:41:02.519 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.516+0000 7fa139929880 20 rados->read ofs=0 len=0 2023-10-05T11:41:02.519 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.516+0000 7fa139929880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:02.520 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.516+0000 7fa11d1ce640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:41:02.522 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.518+0000 7fa139929880 20 remove_watcher() i=0 2023-10-05T11:41:02.522 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.518+0000 7fa139929880 2 removed watcher, disabling cache 2023-10-05T11:41:02.523 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.520+0000 7fa139929880 20 remove_watcher() i=1 2023-10-05T11:41:02.524 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.521+0000 7fa139929880 20 remove_watcher() i=2 2023-10-05T11:41:02.525 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.521+0000 7fa139929880 20 remove_watcher() i=3 2023-10-05T11:41:02.526 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.523+0000 7fa139929880 20 remove_watcher() i=4 2023-10-05T11:41:02.527 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.524+0000 7fa139929880 20 remove_watcher() i=5 2023-10-05T11:41:02.528 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.524+0000 7fa139929880 20 remove_watcher() i=6 2023-10-05T11:41:02.529 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.526+0000 7fa139929880 20 remove_watcher() i=7 2023-10-05T11:41:02.533 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:41:02.534 INFO:tasks.workunit.client.0.smithi012.stderr:BUCKET_STATS: 2023-10-05T11:41:02.534 INFO:tasks.workunit.client.0.smithi012.stderr:bucket: error-at-commit-target-layout id: dff27d1e-df33-400e-a68a-7ba586947c99.4604.24 num_objects: 20 size_kb: 1 num_shards: 11 2023-10-05T11:41:02.534 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:41:02.535 INFO:tasks.workunit.client.0.smithi012.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at commit_target_layout --inject-error-code 125 2023-10-05T11:41:02.572 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setuser ceph since I am not root 2023-10-05T11:41:02.572 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T11:41:02.585 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.581+0000 7ffbcfb2d880 20 rados->read ofs=0 len=0 2023-10-05T11:41:02.586 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.583+0000 7ffbcfb2d880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:02.586 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.583+0000 7ffbcfb2d880 20 realm 2023-10-05T11:41:02.587 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.583+0000 7ffbcfb2d880 20 rados->read ofs=0 len=0 2023-10-05T11:41:02.587 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.583+0000 7ffbcfb2d880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:02.587 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.583+0000 7ffbcfb2d880 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T11:41:02.587 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.583+0000 7ffbcfb2d880 20 rados->read ofs=0 len=0 2023-10-05T11:41:02.587 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.583+0000 7ffbcfb2d880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:02.587 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.583+0000 7ffbcfb2d880 20 rados->read ofs=0 len=0 2023-10-05T11:41:02.587 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.584+0000 7ffbcfb2d880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:41:02.587 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.584+0000 7ffbcfb2d880 20 rados->read ofs=0 len=0 2023-10-05T11:41:02.588 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.585+0000 7ffbcfb2d880 20 rados_obj.operate() r=0 bl.length=1020 2023-10-05T11:41:02.588 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.585+0000 7ffbcfb2d880 20 searching for the correct realm 2023-10-05T11:41:02.798 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.795+0000 7ffbccd0e640 0 -- 172.21.15.12:0/1338439710 >> [v2:172.21.15.12:6824/2171933159,v1:172.21.15.12:6825/2171933159] conn(0x557ff35dac00 msgr2=0x557ff3509700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:41:02.800 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.797+0000 7ffbcfb2d880 20 RGWRados::pool_iterate: got zone_info.dff27d1e-df33-400e-a68a-7ba586947c99 2023-10-05T11:41:02.800 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.797+0000 7ffbcfb2d880 20 RGWRados::pool_iterate: got zonegroup_info.c78aa576-9d15-4e9d-b3c0-4af23a22062c 2023-10-05T11:41:02.800 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.797+0000 7ffbcfb2d880 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T11:41:02.800 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.797+0000 7ffbcfb2d880 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T11:41:02.800 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.797+0000 7ffbcfb2d880 20 rados->read ofs=0 len=0 2023-10-05T11:41:02.800 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.797+0000 7ffbcfb2d880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:02.801 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.797+0000 7ffbcfb2d880 20 rados->read ofs=0 len=0 2023-10-05T11:41:02.802 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.797+0000 7ffbcfb2d880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:41:02.802 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.797+0000 7ffbcfb2d880 20 rados->read ofs=0 len=0 2023-10-05T11:41:02.802 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.797+0000 7ffbcfb2d880 20 rados_obj.operate() r=0 bl.length=454 2023-10-05T11:41:02.802 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.797+0000 7ffbcfb2d880 20 zone default found 2023-10-05T11:41:02.802 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.797+0000 7ffbcfb2d880 4 Realm: () 2023-10-05T11:41:02.802 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.797+0000 7ffbcfb2d880 4 ZoneGroup: default (c78aa576-9d15-4e9d-b3c0-4af23a22062c) 2023-10-05T11:41:02.802 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.797+0000 7ffbcfb2d880 4 Zone: default (dff27d1e-df33-400e-a68a-7ba586947c99) 2023-10-05T11:41:02.802 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.797+0000 7ffbcfb2d880 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T11:41:02.802 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.797+0000 7ffbcfb2d880 20 zonegroup default 2023-10-05T11:41:02.802 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.797+0000 7ffbcfb2d880 20 rados->read ofs=0 len=0 2023-10-05T11:41:02.802 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.798+0000 7ffbcfb2d880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:02.803 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.798+0000 7ffbcfb2d880 20 rados->read ofs=0 len=0 2023-10-05T11:41:02.803 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.798+0000 7ffbcfb2d880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:02.803 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.798+0000 7ffbcfb2d880 20 rados->read ofs=0 len=0 2023-10-05T11:41:02.803 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.798+0000 7ffbcfb2d880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:02.803 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.798+0000 7ffbcfb2d880 20 started sync module instance, tier type = 2023-10-05T11:41:02.803 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.798+0000 7ffbcfb2d880 20 started zone id=dff27d1e-df33-400e-a68a-7ba586947c99 (name=default) with tier type = 2023-10-05T11:41:02.806 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.803+0000 7ffbcbd0c640 0 -- 172.21.15.12:0/1338439710 >> [v2:172.21.15.170:6824/75773779,v1:172.21.15.170:6825/75773779] conn(0x557ff35da800 msgr2=0x557ff3509180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:41:02.811 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.808+0000 7ffbcfb2d880 20 add_watcher() i=0 2023-10-05T11:41:02.811 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.808+0000 7ffbcfb2d880 20 add_watcher() i=1 2023-10-05T11:41:02.811 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.808+0000 7ffbcfb2d880 20 add_watcher() i=2 2023-10-05T11:41:02.812 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.808+0000 7ffbcfb2d880 20 add_watcher() i=3 2023-10-05T11:41:02.812 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.808+0000 7ffbcfb2d880 20 add_watcher() i=4 2023-10-05T11:41:02.812 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.808+0000 7ffbcfb2d880 20 add_watcher() i=5 2023-10-05T11:41:02.812 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.808+0000 7ffbcfb2d880 20 add_watcher() i=6 2023-10-05T11:41:02.813 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.809+0000 7ffbcfb2d880 20 add_watcher() i=7 2023-10-05T11:41:02.813 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.809+0000 7ffbcfb2d880 2 all 8 watchers are set, enabling cache 2023-10-05T11:41:02.814 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.810+0000 7ffbb34db640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:41:02.814 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.810+0000 7ffbcfb2d880 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T11:41:02.814 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.810+0000 7ffbcfb2d880 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T11:41:02.820 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.816+0000 7ffbcfb2d880 5 note: GC not initialized 2023-10-05T11:41:02.820 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.816+0000 7ffbaecd2640 20 reqs_thread_entry: start 2023-10-05T11:41:02.820 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.816+0000 7ffbcfb2d880 20 init_complete bucket index max shards: 11 2023-10-05T11:41:02.820 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.816+0000 7ffbcfb2d880 20 Filter name: none 2023-10-05T11:41:02.820 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.816+0000 7ffbaccce640 20 reqs_thread_entry: start 2023-10-05T11:41:02.820 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.816+0000 7ffbcfb2d880 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2023-10-05T11:41:02.820 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.816+0000 7ffbcfb2d880 20 rados->read ofs=0 len=0 2023-10-05T11:41:02.821 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.817+0000 7ffbcfb2d880 20 rados_obj.operate() r=0 bl.length=221 2023-10-05T11:41:02.822 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.817+0000 7ffbcfb2d880 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2023-10-05T11:41:02.822 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.817+0000 7ffbcfb2d880 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2023-10-05T11:41:02.822 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.817+0000 7ffbcfb2d880 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.24 : miss 2023-10-05T11:41:02.822 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.817+0000 7ffbcfb2d880 20 rados->read ofs=0 len=0 2023-10-05T11:41:02.822 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.817+0000 7ffbcfb2d880 20 rados_obj.operate() r=0 bl.length=393 2023-10-05T11:41:02.823 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.817+0000 7ffbcfb2d880 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.24 info.flags=0x17 2023-10-05T11:41:02.823 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.817+0000 7ffbcfb2d880 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.24 to cache LRU end 2023-10-05T11:41:02.823 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.817+0000 7ffbcfb2d880 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T11:41:02.823 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.817+0000 7ffbcfb2d880 10 updating xattr: name=user.rgw.acl bl.length()=265 2023-10-05T11:41:02.823 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.817+0000 7ffbcfb2d880 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.24 2023-10-05T11:41:02.826 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.823+0000 7ffbcfb2d880 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.24 info.flags=0x17 2023-10-05T11:41:02.826 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.823+0000 7ffbcfb2d880 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.24 to cache LRU end 2023-10-05T11:41:02.826 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.823+0000 7ffbcfb2d880 10 updating xattr: name=user.rgw.acl bl.length()=265 2023-10-05T11:41:02.826 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.823+0000 7ffbcfb2d880 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.24, ofs0, ns] 2023-10-05T11:41:02.827 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.823+0000 7ffbc6d02640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1060856922173 cookie 94008032211968 notifier 7071 bl.length()=965 2023-10-05T11:41:02.827 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.823+0000 7ffbc6d02640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.24 info.flags=0x17 2023-10-05T11:41:02.828 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.823+0000 7ffbc6d02640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.24 to cache LRU end 2023-10-05T11:41:02.828 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.823+0000 7ffbc6d02640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2023-10-05T11:41:02.828 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.825+0000 7ffbcfb2d880 20 handle_bi_update(): bucket=:error-at-commit-target-layout[dff27d1e-df33-400e-a68a-7ba586947c99.4604.24]): orig_sources= new_sources= 2023-10-05T11:41:02.829 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.825+0000 7ffbcfb2d880 20 handle_bi_update(): bucket=:error-at-commit-target-layout[dff27d1e-df33-400e-a68a-7ba586947c99.4604.24]): potential sources added=[] removed=[] 2023-10-05T11:41:02.829 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.825+0000 7ffbcfb2d880 20 handle_bi_update(): bucket=:error-at-commit-target-layout[dff27d1e-df33-400e-a68a-7ba586947c99.4604.24]): orig_dests= new_dests= 2023-10-05T11:41:02.829 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.825+0000 7ffbcfb2d880 20 handle_bi_update(): bucket=:error-at-commit-target-layout[dff27d1e-df33-400e-a68a-7ba586947c99.4604.24]): potential dests added=[] removed=[] 2023-10-05T11:41:02.831 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.827+0000 7ffbcfb2d880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.24.1.0 2023-10-05T11:41:02.831 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.827+0000 7ffbcfb2d880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.24.1.0 2023-10-05T11:41:02.831 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.827+0000 7ffbcfb2d880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.24.1.1 2023-10-05T11:41:02.832 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.827+0000 7ffbcfb2d880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.24.1.1 2023-10-05T11:41:02.832 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.827+0000 7ffbcfb2d880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.24.1.2 2023-10-05T11:41:02.832 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.827+0000 7ffbcfb2d880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.24.1.2 2023-10-05T11:41:02.832 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.827+0000 7ffbcfb2d880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.24.1.3 2023-10-05T11:41:02.832 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.827+0000 7ffbcfb2d880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.24.1.3 2023-10-05T11:41:02.832 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.827+0000 7ffbcfb2d880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.24.1.4 2023-10-05T11:41:02.833 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.827+0000 7ffbcfb2d880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.24.1.4 2023-10-05T11:41:02.833 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.827+0000 7ffbcfb2d880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.24.1.5 2023-10-05T11:41:02.833 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.827+0000 7ffbcfb2d880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.24.1.5 2023-10-05T11:41:02.833 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.827+0000 7ffbcfb2d880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.24.1.6 2023-10-05T11:41:02.833 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.827+0000 7ffbcfb2d880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.24.1.6 2023-10-05T11:41:02.834 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.827+0000 7ffbcfb2d880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.24.1.7 2023-10-05T11:41:02.834 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.827+0000 7ffbcfb2d880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.24.1.7 2023-10-05T11:41:02.834 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.827+0000 7ffbcfb2d880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.24.1.8 2023-10-05T11:41:02.834 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.827+0000 7ffbcfb2d880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.24.1.8 2023-10-05T11:41:02.834 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.827+0000 7ffbcfb2d880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.24.1.9 2023-10-05T11:41:02.835 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.827+0000 7ffbcfb2d880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.24.1.9 2023-10-05T11:41:02.835 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.827+0000 7ffbcfb2d880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.24.1.10 2023-10-05T11:41:02.835 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.827+0000 7ffbcfb2d880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.24.1.10 2023-10-05T11:41:02.835 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.827+0000 7ffbcfb2d880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.24.1.11 2023-10-05T11:41:02.835 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.827+0000 7ffbcfb2d880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.24.1.11 2023-10-05T11:41:02.835 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.827+0000 7ffbcfb2d880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.24.0 2023-10-05T11:41:02.835 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.828+0000 7ffbcfb2d880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.24.1 2023-10-05T11:41:02.836 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.828+0000 7ffbcfb2d880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.24.2 2023-10-05T11:41:02.837 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.829+0000 7ffbcfb2d880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.24.3 2023-10-05T11:41:02.837 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.829+0000 7ffbcfb2d880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.24.4 2023-10-05T11:41:02.837 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.829+0000 7ffbcfb2d880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.24.5 2023-10-05T11:41:02.837 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.830+0000 7ffbcfb2d880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.24.6 2023-10-05T11:41:02.837 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.830+0000 7ffbcfb2d880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.24.7 2023-10-05T11:41:02.837 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.831+0000 7ffbcfb2d880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.24.8 2023-10-05T11:41:02.837 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.831+0000 7ffbcfb2d880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.24.9 2023-10-05T11:41:02.837 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.832+0000 7ffbcfb2d880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.24.10 2023-10-05T11:41:02.838 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.834+0000 7ffbcfb2d880 -1 Injecting error=-125 at location=commit_target_layout 2023-10-05T11:41:02.838 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.834+0000 7ffbcfb2d880 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.24 : hit (requested=0x17, cached=0x17) 2023-10-05T11:41:02.838 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.834+0000 7ffbcfb2d880 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.24 2023-10-05T11:41:02.839 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.836+0000 7ffbcfb2d880 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.24 info.flags=0x17 2023-10-05T11:41:02.840 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.836+0000 7ffbcfb2d880 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.24 to cache LRU end 2023-10-05T11:41:02.840 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.836+0000 7ffbcfb2d880 10 updating xattr: name=user.rgw.acl bl.length()=265 2023-10-05T11:41:02.840 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.836+0000 7ffbcfb2d880 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.24, ofs0, ns] 2023-10-05T11:41:02.840 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.836+0000 7ffbc6d02640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1060856922174 cookie 94008032211968 notifier 7071 bl.length()=933 2023-10-05T11:41:02.840 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.836+0000 7ffbc6d02640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.24 info.flags=0x17 2023-10-05T11:41:02.841 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.836+0000 7ffbc6d02640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.24 to cache LRU end 2023-10-05T11:41:02.841 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.836+0000 7ffbc6d02640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2023-10-05T11:41:02.841 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.837+0000 7ffbcfb2d880 20 handle_bi_update(): bucket=:error-at-commit-target-layout[dff27d1e-df33-400e-a68a-7ba586947c99.4604.24]): orig_sources= new_sources= 2023-10-05T11:41:02.842 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.837+0000 7ffbcfb2d880 20 handle_bi_update(): bucket=:error-at-commit-target-layout[dff27d1e-df33-400e-a68a-7ba586947c99.4604.24]): potential sources added=[] removed=[] 2023-10-05T11:41:02.842 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.837+0000 7ffbcfb2d880 20 handle_bi_update(): bucket=:error-at-commit-target-layout[dff27d1e-df33-400e-a68a-7ba586947c99.4604.24]): orig_dests= new_dests= 2023-10-05T11:41:02.842 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.837+0000 7ffbcfb2d880 20 handle_bi_update(): bucket=:error-at-commit-target-layout[dff27d1e-df33-400e-a68a-7ba586947c99.4604.24]): potential dests added=[] removed=[] 2023-10-05T11:41:02.843 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.840+0000 7ffbcfb2d880 1 execute INFO: reshard of bucket "error-at-commit-target-layout" completed successfully 2023-10-05T11:41:02.845 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.842+0000 7ffbb34db640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:41:02.847 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.844+0000 7ffbcfb2d880 20 remove_watcher() i=0 2023-10-05T11:41:02.847 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.844+0000 7ffbcfb2d880 2 removed watcher, disabling cache 2023-10-05T11:41:02.848 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.845+0000 7ffbcfb2d880 20 remove_watcher() i=1 2023-10-05T11:41:02.849 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.846+0000 7ffbcfb2d880 20 remove_watcher() i=2 2023-10-05T11:41:02.850 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.847+0000 7ffbcfb2d880 20 remove_watcher() i=3 2023-10-05T11:41:02.851 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.848+0000 7ffbcfb2d880 20 remove_watcher() i=4 2023-10-05T11:41:02.852 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.849+0000 7ffbcfb2d880 20 remove_watcher() i=5 2023-10-05T11:41:02.853 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.850+0000 7ffbcfb2d880 20 remove_watcher() i=6 2023-10-05T11:41:02.854 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.851+0000 7ffbcfb2d880 20 remove_watcher() i=7 2023-10-05T11:41:02.860 INFO:tasks.workunit.client.0.smithi012.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2023-10-05T11:41:02.888 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setuser ceph since I am not root 2023-10-05T11:41:02.888 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T11:41:02.901 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.898+0000 7f8e39b20880 20 rados->read ofs=0 len=0 2023-10-05T11:41:02.903 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.899+0000 7f8e39b20880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:02.903 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.899+0000 7f8e39b20880 20 realm 2023-10-05T11:41:02.903 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.899+0000 7f8e39b20880 20 rados->read ofs=0 len=0 2023-10-05T11:41:02.903 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.899+0000 7f8e39b20880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:02.904 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.899+0000 7f8e39b20880 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T11:41:02.904 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.899+0000 7f8e39b20880 20 rados->read ofs=0 len=0 2023-10-05T11:41:02.904 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.900+0000 7f8e39b20880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:02.904 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.900+0000 7f8e39b20880 20 rados->read ofs=0 len=0 2023-10-05T11:41:02.904 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.901+0000 7f8e39b20880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:41:02.904 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.901+0000 7f8e39b20880 20 rados->read ofs=0 len=0 2023-10-05T11:41:02.905 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.901+0000 7f8e39b20880 20 rados_obj.operate() r=0 bl.length=1020 2023-10-05T11:41:02.905 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.901+0000 7f8e39b20880 20 searching for the correct realm 2023-10-05T11:41:02.913 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.910+0000 7f8e363d2640 0 -- 172.21.15.12:0/3357508342 >> [v2:172.21.15.12:6800/732466381,v1:172.21.15.12:6801/732466381] conn(0x562d5fb72800 msgr2=0x562d5f042b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:41:02.915 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.912+0000 7f8e39b20880 20 RGWRados::pool_iterate: got zone_info.dff27d1e-df33-400e-a68a-7ba586947c99 2023-10-05T11:41:02.915 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.912+0000 7f8e39b20880 20 RGWRados::pool_iterate: got zonegroup_info.c78aa576-9d15-4e9d-b3c0-4af23a22062c 2023-10-05T11:41:02.915 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.912+0000 7f8e39b20880 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T11:41:02.915 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.912+0000 7f8e39b20880 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T11:41:02.915 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.912+0000 7f8e39b20880 20 rados->read ofs=0 len=0 2023-10-05T11:41:02.916 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.912+0000 7f8e39b20880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:02.916 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.912+0000 7f8e39b20880 20 rados->read ofs=0 len=0 2023-10-05T11:41:02.917 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.912+0000 7f8e39b20880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:41:02.917 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.912+0000 7f8e39b20880 20 rados->read ofs=0 len=0 2023-10-05T11:41:02.917 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.912+0000 7f8e39b20880 20 rados_obj.operate() r=0 bl.length=454 2023-10-05T11:41:02.917 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.912+0000 7f8e39b20880 20 zone default found 2023-10-05T11:41:02.917 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.912+0000 7f8e39b20880 4 Realm: () 2023-10-05T11:41:02.918 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.912+0000 7f8e39b20880 4 ZoneGroup: default (c78aa576-9d15-4e9d-b3c0-4af23a22062c) 2023-10-05T11:41:02.918 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.912+0000 7f8e39b20880 4 Zone: default (dff27d1e-df33-400e-a68a-7ba586947c99) 2023-10-05T11:41:02.918 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.912+0000 7f8e39b20880 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T11:41:02.918 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.912+0000 7f8e39b20880 20 zonegroup default 2023-10-05T11:41:02.918 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.912+0000 7f8e39b20880 20 rados->read ofs=0 len=0 2023-10-05T11:41:02.918 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.913+0000 7f8e39b20880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:02.918 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.913+0000 7f8e39b20880 20 rados->read ofs=0 len=0 2023-10-05T11:41:02.918 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.913+0000 7f8e39b20880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:02.918 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.913+0000 7f8e39b20880 20 rados->read ofs=0 len=0 2023-10-05T11:41:02.918 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.913+0000 7f8e39b20880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:02.918 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.913+0000 7f8e39b20880 20 started sync module instance, tier type = 2023-10-05T11:41:02.919 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.913+0000 7f8e39b20880 20 started zone id=dff27d1e-df33-400e-a68a-7ba586947c99 (name=default) with tier type = 2023-10-05T11:41:02.922 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.919+0000 7f8e363d2640 0 -- 172.21.15.12:0/3357508342 >> [v2:172.21.15.12:6800/732466381,v1:172.21.15.12:6801/732466381] conn(0x562d5f14d000 msgr2=0x562d5f044100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:41:02.926 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.922+0000 7f8e39b20880 20 add_watcher() i=0 2023-10-05T11:41:02.926 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.922+0000 7f8e39b20880 20 add_watcher() i=1 2023-10-05T11:41:02.926 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.922+0000 7f8e39b20880 20 add_watcher() i=2 2023-10-05T11:41:02.926 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.922+0000 7f8e39b20880 20 add_watcher() i=3 2023-10-05T11:41:02.926 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.922+0000 7f8e39b20880 20 add_watcher() i=4 2023-10-05T11:41:02.926 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.922+0000 7f8e39b20880 20 add_watcher() i=5 2023-10-05T11:41:02.926 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.922+0000 7f8e39b20880 20 add_watcher() i=6 2023-10-05T11:41:02.927 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.923+0000 7f8e39b20880 20 add_watcher() i=7 2023-10-05T11:41:02.927 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.923+0000 7f8e39b20880 2 all 8 watchers are set, enabling cache 2023-10-05T11:41:02.928 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.925+0000 7f8e1d3a0640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:41:02.928 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.925+0000 7f8e39b20880 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T11:41:02.928 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.925+0000 7f8e39b20880 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T11:41:02.934 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.931+0000 7f8e39b20880 5 note: GC not initialized 2023-10-05T11:41:02.934 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.931+0000 7f8e18b97640 20 reqs_thread_entry: start 2023-10-05T11:41:02.935 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.931+0000 7f8e39b20880 20 init_complete bucket index max shards: 11 2023-10-05T11:41:02.935 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.931+0000 7f8e39b20880 20 Filter name: none 2023-10-05T11:41:02.935 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.931+0000 7f8e16b93640 20 reqs_thread_entry: start 2023-10-05T11:41:02.935 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.931+0000 7f8e39b20880 20 rados->read ofs=0 len=0 2023-10-05T11:41:02.936 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.931+0000 7f8e39b20880 20 rados_obj.operate() r=0 bl.length=221 2023-10-05T11:41:02.936 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.932+0000 7f8e39b20880 20 rados->read ofs=0 len=0 2023-10-05T11:41:02.936 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.932+0000 7f8e39b20880 20 rados_obj.operate() r=0 bl.length=393 2023-10-05T11:41:02.936 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.932+0000 7f8e39b20880 20 couldn't put binfo cache entry, might have raced with data changes 2023-10-05T11:41:02.936 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.932+0000 7f8e39b20880 20 rados->read ofs=0 len=0 2023-10-05T11:41:02.936 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.932+0000 7f8e39b20880 20 rados_obj.operate() r=0 bl.length=221 2023-10-05T11:41:02.936 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.932+0000 7f8e39b20880 20 rados->read ofs=0 len=0 2023-10-05T11:41:02.937 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.933+0000 7f8e39b20880 20 rados_obj.operate() r=0 bl.length=393 2023-10-05T11:41:02.937 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.933+0000 7f8e39b20880 20 couldn't put binfo cache entry, might have raced with data changes 2023-10-05T11:41:02.937 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.934+0000 7f8e39b20880 20 rados->read ofs=0 len=0 2023-10-05T11:41:02.937 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.934+0000 7f8e39b20880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:02.938 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.935+0000 7f8e1d3a0640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:41:02.941 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.937+0000 7f8e39b20880 20 remove_watcher() i=0 2023-10-05T11:41:02.941 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.937+0000 7f8e39b20880 2 removed watcher, disabling cache 2023-10-05T11:41:02.942 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.939+0000 7f8e39b20880 20 remove_watcher() i=1 2023-10-05T11:41:02.943 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.940+0000 7f8e39b20880 20 remove_watcher() i=2 2023-10-05T11:41:02.944 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.941+0000 7f8e39b20880 20 remove_watcher() i=3 2023-10-05T11:41:02.945 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.942+0000 7f8e39b20880 20 remove_watcher() i=4 2023-10-05T11:41:02.946 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.943+0000 7f8e39b20880 20 remove_watcher() i=5 2023-10-05T11:41:02.947 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.944+0000 7f8e39b20880 20 remove_watcher() i=6 2023-10-05T11:41:02.948 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:02.945+0000 7f8e39b20880 20 remove_watcher() i=7 2023-10-05T11:41:02.953 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:41:02.953 INFO:tasks.workunit.client.0.smithi012.stderr:BUCKET_STATS: 2023-10-05T11:41:02.953 INFO:tasks.workunit.client.0.smithi012.stderr:bucket: error-at-commit-target-layout id: dff27d1e-df33-400e-a68a-7ba586947c99.4604.24 num_objects: 20 size_kb: 1 num_shards: 12 2023-10-05T11:41:02.953 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:41:03.289 INFO:tasks.workunit.client.0.smithi012.stderr:TEST: reshard bucket with abort at commit_target_layout 2023-10-05T11:41:03.289 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:41:04.014 INFO:tasks.workunit.client.0.smithi012.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2023-10-05T11:41:04.042 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setuser ceph since I am not root 2023-10-05T11:41:04.043 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T11:41:04.056 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.052+0000 7f8901b27880 20 rados->read ofs=0 len=0 2023-10-05T11:41:04.058 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.054+0000 7f8901b27880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:04.058 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.054+0000 7f8901b27880 20 realm 2023-10-05T11:41:04.058 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.054+0000 7f8901b27880 20 rados->read ofs=0 len=0 2023-10-05T11:41:04.058 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.054+0000 7f8901b27880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:04.058 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.054+0000 7f8901b27880 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T11:41:04.058 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.054+0000 7f8901b27880 20 rados->read ofs=0 len=0 2023-10-05T11:41:04.058 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.054+0000 7f8901b27880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:04.059 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.054+0000 7f8901b27880 20 rados->read ofs=0 len=0 2023-10-05T11:41:04.059 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.055+0000 7f8901b27880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:41:04.059 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.055+0000 7f8901b27880 20 rados->read ofs=0 len=0 2023-10-05T11:41:04.059 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.056+0000 7f8901b27880 20 rados_obj.operate() r=0 bl.length=1020 2023-10-05T11:41:04.059 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.056+0000 7f8901b27880 20 searching for the correct realm 2023-10-05T11:41:04.067 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.064+0000 7f88fe564640 0 -- 172.21.15.12:0/1450289601 >> [v2:172.21.15.12:6800/732466381,v1:172.21.15.12:6801/732466381] conn(0x562ba0233800 msgr2=0x562ba0234b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:41:04.069 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.066+0000 7f8901b27880 20 RGWRados::pool_iterate: got zone_info.dff27d1e-df33-400e-a68a-7ba586947c99 2023-10-05T11:41:04.069 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.066+0000 7f8901b27880 20 RGWRados::pool_iterate: got zonegroup_info.c78aa576-9d15-4e9d-b3c0-4af23a22062c 2023-10-05T11:41:04.069 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.066+0000 7f8901b27880 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T11:41:04.069 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.066+0000 7f8901b27880 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T11:41:04.069 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.066+0000 7f8901b27880 20 rados->read ofs=0 len=0 2023-10-05T11:41:04.069 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.066+0000 7f8901b27880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:04.070 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.066+0000 7f8901b27880 20 rados->read ofs=0 len=0 2023-10-05T11:41:04.071 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.066+0000 7f8901b27880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:41:04.071 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.066+0000 7f8901b27880 20 rados->read ofs=0 len=0 2023-10-05T11:41:04.071 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.066+0000 7f8901b27880 20 rados_obj.operate() r=0 bl.length=454 2023-10-05T11:41:04.071 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.066+0000 7f8901b27880 20 zone default found 2023-10-05T11:41:04.071 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.066+0000 7f8901b27880 4 Realm: () 2023-10-05T11:41:04.071 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.066+0000 7f8901b27880 4 ZoneGroup: default (c78aa576-9d15-4e9d-b3c0-4af23a22062c) 2023-10-05T11:41:04.071 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.066+0000 7f8901b27880 4 Zone: default (dff27d1e-df33-400e-a68a-7ba586947c99) 2023-10-05T11:41:04.071 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.066+0000 7f8901b27880 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T11:41:04.071 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.066+0000 7f8901b27880 20 zonegroup default 2023-10-05T11:41:04.071 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.066+0000 7f8901b27880 20 rados->read ofs=0 len=0 2023-10-05T11:41:04.072 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.067+0000 7f8901b27880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:04.072 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.067+0000 7f8901b27880 20 rados->read ofs=0 len=0 2023-10-05T11:41:04.072 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.067+0000 7f8901b27880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:04.072 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.067+0000 7f8901b27880 20 rados->read ofs=0 len=0 2023-10-05T11:41:04.072 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.067+0000 7f8901b27880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:04.072 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.067+0000 7f8901b27880 20 started sync module instance, tier type = 2023-10-05T11:41:04.072 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.067+0000 7f8901b27880 20 started zone id=dff27d1e-df33-400e-a68a-7ba586947c99 (name=default) with tier type = 2023-10-05T11:41:04.076 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.073+0000 7f88fe564640 0 -- 172.21.15.12:0/1450289601 >> [v2:172.21.15.12:6800/732466381,v1:172.21.15.12:6801/732466381] conn(0x562ba033f000 msgr2=0x562ba0236100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:41:04.080 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.076+0000 7f8901b27880 20 add_watcher() i=0 2023-10-05T11:41:04.080 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.076+0000 7f8901b27880 20 add_watcher() i=1 2023-10-05T11:41:04.080 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.076+0000 7f8901b27880 20 add_watcher() i=2 2023-10-05T11:41:04.080 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.076+0000 7f8901b27880 20 add_watcher() i=3 2023-10-05T11:41:04.080 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.076+0000 7f8901b27880 20 add_watcher() i=4 2023-10-05T11:41:04.080 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.076+0000 7f8901b27880 20 add_watcher() i=5 2023-10-05T11:41:04.080 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.076+0000 7f8901b27880 20 add_watcher() i=6 2023-10-05T11:41:04.081 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.077+0000 7f8901b27880 20 add_watcher() i=7 2023-10-05T11:41:04.081 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.077+0000 7f8901b27880 2 all 8 watchers are set, enabling cache 2023-10-05T11:41:04.082 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.079+0000 7f88e5532640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:41:04.083 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.079+0000 7f8901b27880 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T11:41:04.083 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.079+0000 7f8901b27880 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T11:41:04.088 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.085+0000 7f8901b27880 5 note: GC not initialized 2023-10-05T11:41:04.088 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.085+0000 7f88e0d29640 20 reqs_thread_entry: start 2023-10-05T11:41:04.088 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.085+0000 7f8901b27880 20 init_complete bucket index max shards: 11 2023-10-05T11:41:04.089 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.085+0000 7f8901b27880 20 Filter name: none 2023-10-05T11:41:04.089 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.085+0000 7f88ded25640 20 reqs_thread_entry: start 2023-10-05T11:41:04.089 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.085+0000 7f8901b27880 20 rados->read ofs=0 len=0 2023-10-05T11:41:04.090 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.085+0000 7f8901b27880 20 rados_obj.operate() r=0 bl.length=221 2023-10-05T11:41:04.090 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.086+0000 7f8901b27880 20 rados->read ofs=0 len=0 2023-10-05T11:41:04.090 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.086+0000 7f8901b27880 20 rados_obj.operate() r=0 bl.length=393 2023-10-05T11:41:04.090 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.086+0000 7f8901b27880 20 couldn't put binfo cache entry, might have raced with data changes 2023-10-05T11:41:04.090 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.086+0000 7f8901b27880 20 rados->read ofs=0 len=0 2023-10-05T11:41:04.091 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.086+0000 7f8901b27880 20 rados_obj.operate() r=0 bl.length=221 2023-10-05T11:41:04.091 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.086+0000 7f8901b27880 20 rados->read ofs=0 len=0 2023-10-05T11:41:04.091 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.087+0000 7f8901b27880 20 rados_obj.operate() r=0 bl.length=393 2023-10-05T11:41:04.091 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.087+0000 7f8901b27880 20 couldn't put binfo cache entry, might have raced with data changes 2023-10-05T11:41:04.091 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.088+0000 7f8901b27880 20 rados->read ofs=0 len=0 2023-10-05T11:41:04.091 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.088+0000 7f8901b27880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:04.092 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.088+0000 7f88e5532640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:41:04.094 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.090+0000 7f8901b27880 20 remove_watcher() i=0 2023-10-05T11:41:04.094 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.090+0000 7f8901b27880 2 removed watcher, disabling cache 2023-10-05T11:41:04.095 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.091+0000 7f8901b27880 20 remove_watcher() i=1 2023-10-05T11:41:04.096 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.092+0000 7f8901b27880 20 remove_watcher() i=2 2023-10-05T11:41:04.096 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.093+0000 7f8901b27880 20 remove_watcher() i=3 2023-10-05T11:41:04.097 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.094+0000 7f8901b27880 20 remove_watcher() i=4 2023-10-05T11:41:04.099 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.095+0000 7f8901b27880 20 remove_watcher() i=5 2023-10-05T11:41:04.100 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.096+0000 7f8901b27880 20 remove_watcher() i=6 2023-10-05T11:41:04.100 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.097+0000 7f8901b27880 20 remove_watcher() i=7 2023-10-05T11:41:04.105 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:41:04.105 INFO:tasks.workunit.client.0.smithi012.stderr:BUCKET_STATS: 2023-10-05T11:41:04.105 INFO:tasks.workunit.client.0.smithi012.stderr:bucket: abort-at-commit-target-layout id: dff27d1e-df33-400e-a68a-7ba586947c99.4604.25 num_objects: 20 size_kb: 1 num_shards: 11 2023-10-05T11:41:04.105 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:41:04.106 INFO:tasks.workunit.client.0.smithi012.stderr:radosgw-admin bucket reshard --bucket abort-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at commit_target_layout 2023-10-05T11:41:04.139 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setuser ceph since I am not root 2023-10-05T11:41:04.140 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T11:41:04.152 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.149+0000 7fa0ea444880 20 rados->read ofs=0 len=0 2023-10-05T11:41:04.154 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.151+0000 7fa0ea444880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:04.154 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.151+0000 7fa0ea444880 20 realm 2023-10-05T11:41:04.154 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.151+0000 7fa0ea444880 20 rados->read ofs=0 len=0 2023-10-05T11:41:04.154 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.151+0000 7fa0ea444880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:04.154 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.151+0000 7fa0ea444880 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T11:41:04.155 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.151+0000 7fa0ea444880 20 rados->read ofs=0 len=0 2023-10-05T11:41:04.155 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.151+0000 7fa0ea444880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:04.155 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.151+0000 7fa0ea444880 20 rados->read ofs=0 len=0 2023-10-05T11:41:04.155 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.152+0000 7fa0ea444880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:41:04.155 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.152+0000 7fa0ea444880 20 rados->read ofs=0 len=0 2023-10-05T11:41:04.156 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.152+0000 7fa0ea444880 20 rados_obj.operate() r=0 bl.length=1020 2023-10-05T11:41:04.156 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.152+0000 7fa0ea444880 20 searching for the correct realm 2023-10-05T11:41:04.164 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.161+0000 7fa0e93ea640 0 -- 172.21.15.12:0/2179683232 >> [v2:172.21.15.12:6824/2171933159,v1:172.21.15.12:6825/2171933159] conn(0x55f0c9b1c000 msgr2=0x55f0c9963700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-10-05T11:41:04.167 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.163+0000 7fa0ea444880 20 RGWRados::pool_iterate: got zone_info.dff27d1e-df33-400e-a68a-7ba586947c99 2023-10-05T11:41:04.167 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.163+0000 7fa0ea444880 20 RGWRados::pool_iterate: got zonegroup_info.c78aa576-9d15-4e9d-b3c0-4af23a22062c 2023-10-05T11:41:04.167 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.163+0000 7fa0ea444880 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T11:41:04.167 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.163+0000 7fa0ea444880 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T11:41:04.167 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.163+0000 7fa0ea444880 20 rados->read ofs=0 len=0 2023-10-05T11:41:04.167 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.163+0000 7fa0ea444880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:04.168 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.163+0000 7fa0ea444880 20 rados->read ofs=0 len=0 2023-10-05T11:41:04.168 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.164+0000 7fa0ea444880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:41:04.168 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.164+0000 7fa0ea444880 20 rados->read ofs=0 len=0 2023-10-05T11:41:04.169 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.164+0000 7fa0ea444880 20 rados_obj.operate() r=0 bl.length=454 2023-10-05T11:41:04.169 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.164+0000 7fa0ea444880 20 zone default found 2023-10-05T11:41:04.169 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.164+0000 7fa0ea444880 4 Realm: () 2023-10-05T11:41:04.169 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.164+0000 7fa0ea444880 4 ZoneGroup: default (c78aa576-9d15-4e9d-b3c0-4af23a22062c) 2023-10-05T11:41:04.169 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.164+0000 7fa0ea444880 4 Zone: default (dff27d1e-df33-400e-a68a-7ba586947c99) 2023-10-05T11:41:04.169 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.164+0000 7fa0ea444880 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T11:41:04.169 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.164+0000 7fa0ea444880 20 zonegroup default 2023-10-05T11:41:04.169 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.164+0000 7fa0ea444880 20 rados->read ofs=0 len=0 2023-10-05T11:41:04.169 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.164+0000 7fa0ea444880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:04.169 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.164+0000 7fa0ea444880 20 rados->read ofs=0 len=0 2023-10-05T11:41:04.169 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.165+0000 7fa0ea444880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:04.170 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.165+0000 7fa0ea444880 20 rados->read ofs=0 len=0 2023-10-05T11:41:04.170 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.165+0000 7fa0ea444880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:04.170 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.165+0000 7fa0ea444880 20 started sync module instance, tier type = 2023-10-05T11:41:04.170 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.165+0000 7fa0ea444880 20 started zone id=dff27d1e-df33-400e-a68a-7ba586947c99 (name=default) with tier type = 2023-10-05T11:41:04.172 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.169+0000 7fa0e83e8640 0 -- 172.21.15.12:0/2179683232 >> [v2:172.21.15.170:6824/75773779,v1:172.21.15.170:6825/75773779] conn(0x55f0c9a29c00 msgr2=0x55f0c9963180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:41:04.177 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.174+0000 7fa0ea444880 20 add_watcher() i=0 2023-10-05T11:41:04.177 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.174+0000 7fa0ea444880 20 add_watcher() i=1 2023-10-05T11:41:04.178 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.174+0000 7fa0ea444880 20 add_watcher() i=2 2023-10-05T11:41:04.178 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.174+0000 7fa0ea444880 20 add_watcher() i=3 2023-10-05T11:41:04.178 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.174+0000 7fa0ea444880 20 add_watcher() i=4 2023-10-05T11:41:04.178 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.174+0000 7fa0ea444880 20 add_watcher() i=5 2023-10-05T11:41:04.178 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.174+0000 7fa0ea444880 20 add_watcher() i=6 2023-10-05T11:41:04.178 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.175+0000 7fa0ea444880 20 add_watcher() i=7 2023-10-05T11:41:04.179 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.175+0000 7fa0ea444880 2 all 8 watchers are set, enabling cache 2023-10-05T11:41:04.180 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.176+0000 7fa0cfbb7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:41:04.180 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.177+0000 7fa0ea444880 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T11:41:04.180 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.177+0000 7fa0ea444880 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T11:41:04.187 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.182+0000 7fa0ea444880 5 note: GC not initialized 2023-10-05T11:41:04.187 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.183+0000 7fa0cb3ae640 20 reqs_thread_entry: start 2023-10-05T11:41:04.187 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.183+0000 7fa0ea444880 20 init_complete bucket index max shards: 11 2023-10-05T11:41:04.187 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.183+0000 7fa0ea444880 20 Filter name: none 2023-10-05T11:41:04.187 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.183+0000 7fa0c93aa640 20 reqs_thread_entry: start 2023-10-05T11:41:04.188 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.183+0000 7fa0ea444880 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2023-10-05T11:41:04.188 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.183+0000 7fa0ea444880 20 rados->read ofs=0 len=0 2023-10-05T11:41:04.188 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.183+0000 7fa0ea444880 20 rados_obj.operate() r=0 bl.length=221 2023-10-05T11:41:04.188 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.183+0000 7fa0ea444880 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2023-10-05T11:41:04.188 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.183+0000 7fa0ea444880 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2023-10-05T11:41:04.188 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.183+0000 7fa0ea444880 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.25 : miss 2023-10-05T11:41:04.189 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.183+0000 7fa0ea444880 20 rados->read ofs=0 len=0 2023-10-05T11:41:04.189 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.184+0000 7fa0ea444880 20 rados_obj.operate() r=0 bl.length=393 2023-10-05T11:41:04.189 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.184+0000 7fa0ea444880 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.25 info.flags=0x17 2023-10-05T11:41:04.189 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.184+0000 7fa0ea444880 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.25 to cache LRU end 2023-10-05T11:41:04.189 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.184+0000 7fa0ea444880 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T11:41:04.189 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.184+0000 7fa0ea444880 10 updating xattr: name=user.rgw.acl bl.length()=265 2023-10-05T11:41:04.189 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.184+0000 7fa0ea444880 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.25 2023-10-05T11:41:04.193 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.190+0000 7fa0ea444880 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.25 info.flags=0x17 2023-10-05T11:41:04.193 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.190+0000 7fa0ea444880 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.25 to cache LRU end 2023-10-05T11:41:04.193 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.190+0000 7fa0ea444880 10 updating xattr: name=user.rgw.acl bl.length()=265 2023-10-05T11:41:04.193 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.190+0000 7fa0ea444880 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.25, ofs0, ns] 2023-10-05T11:41:04.194 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.190+0000 7fa0e2bdd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1060856922173 cookie 94492664382464 notifier 7140 bl.length()=965 2023-10-05T11:41:04.194 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.190+0000 7fa0e2bdd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.25 info.flags=0x17 2023-10-05T11:41:04.194 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.190+0000 7fa0e2bdd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.25 to cache LRU end 2023-10-05T11:41:04.194 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.190+0000 7fa0e2bdd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2023-10-05T11:41:04.195 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.192+0000 7fa0ea444880 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[dff27d1e-df33-400e-a68a-7ba586947c99.4604.25]): orig_sources= new_sources= 2023-10-05T11:41:04.195 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.192+0000 7fa0ea444880 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[dff27d1e-df33-400e-a68a-7ba586947c99.4604.25]): potential sources added=[] removed=[] 2023-10-05T11:41:04.195 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.192+0000 7fa0ea444880 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[dff27d1e-df33-400e-a68a-7ba586947c99.4604.25]): orig_dests= new_dests= 2023-10-05T11:41:04.195 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.192+0000 7fa0ea444880 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[dff27d1e-df33-400e-a68a-7ba586947c99.4604.25]): potential dests added=[] removed=[] 2023-10-05T11:41:04.198 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.194+0000 7fa0ea444880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.25.1.0 2023-10-05T11:41:04.198 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.194+0000 7fa0ea444880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.25.1.0 2023-10-05T11:41:04.198 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.194+0000 7fa0ea444880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.25.1.1 2023-10-05T11:41:04.198 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.194+0000 7fa0ea444880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.25.1.1 2023-10-05T11:41:04.198 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.194+0000 7fa0ea444880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.25.1.2 2023-10-05T11:41:04.198 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.194+0000 7fa0ea444880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.25.1.2 2023-10-05T11:41:04.199 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.194+0000 7fa0ea444880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.25.1.3 2023-10-05T11:41:04.199 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.194+0000 7fa0ea444880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.25.1.3 2023-10-05T11:41:04.199 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.194+0000 7fa0ea444880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.25.1.4 2023-10-05T11:41:04.199 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.194+0000 7fa0ea444880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.25.1.4 2023-10-05T11:41:04.199 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.194+0000 7fa0ea444880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.25.1.5 2023-10-05T11:41:04.199 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.194+0000 7fa0ea444880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.25.1.5 2023-10-05T11:41:04.199 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.194+0000 7fa0ea444880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.25.1.6 2023-10-05T11:41:04.199 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.194+0000 7fa0ea444880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.25.1.6 2023-10-05T11:41:04.199 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.194+0000 7fa0ea444880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.25.1.7 2023-10-05T11:41:04.199 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.194+0000 7fa0ea444880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.25.1.7 2023-10-05T11:41:04.200 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.194+0000 7fa0ea444880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.25.1.8 2023-10-05T11:41:04.200 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.194+0000 7fa0ea444880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.25.1.8 2023-10-05T11:41:04.200 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.194+0000 7fa0ea444880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.25.1.9 2023-10-05T11:41:04.200 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.194+0000 7fa0ea444880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.25.1.9 2023-10-05T11:41:04.200 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.194+0000 7fa0ea444880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.25.1.10 2023-10-05T11:41:04.200 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.194+0000 7fa0ea444880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.25.1.10 2023-10-05T11:41:04.200 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.194+0000 7fa0ea444880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.25.1.11 2023-10-05T11:41:04.200 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.194+0000 7fa0ea444880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.25.1.11 2023-10-05T11:41:04.200 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.194+0000 7fa0ea444880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.25.0 2023-10-05T11:41:04.200 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.195+0000 7fa0ea444880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.25.1 2023-10-05T11:41:04.201 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.195+0000 7fa0ea444880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.25.2 2023-10-05T11:41:04.201 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.195+0000 7fa0ea444880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.25.3 2023-10-05T11:41:04.202 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.196+0000 7fa0ea444880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.25.4 2023-10-05T11:41:04.202 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.196+0000 7fa0ea444880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.25.5 2023-10-05T11:41:04.202 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.197+0000 7fa0ea444880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.25.6 2023-10-05T11:41:04.202 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.197+0000 7fa0ea444880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.25.7 2023-10-05T11:41:04.202 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.198+0000 7fa0ea444880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.25.8 2023-10-05T11:41:04.202 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.198+0000 7fa0ea444880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.25.9 2023-10-05T11:41:04.202 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.198+0000 7fa0ea444880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.25.10 2023-10-05T11:41:04.205 INFO:tasks.workunit.client.0.smithi012.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6543-g38321be8/rpm/el9/BUILD/ceph-18.0.0-6543-g38321be8/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fa0ea444880 time 2023-10-05T11:41:04.203267+0000 2023-10-05T11:41:04.205 INFO:tasks.workunit.client.0.smithi012.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6543-g38321be8/rpm/el9/BUILD/ceph-18.0.0-6543-g38321be8/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2023-10-05T11:41:04.205 INFO:tasks.workunit.client.0.smithi012.stderr: ceph version 18.0.0-6543-g38321be8 (38321be854743c0d616618a9ea8aa0b1d4dbc0bf) reef (dev) 2023-10-05T11:41:04.205 INFO:tasks.workunit.client.0.smithi012.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fa0ef16d15f] 2023-10-05T11:41:04.205 INFO:tasks.workunit.client.0.smithi012.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16d31d) [0x7fa0ef16d31d] 2023-10-05T11:41:04.206 INFO:tasks.workunit.client.0.smithi012.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f0c8113c31] 2023-10-05T11:41:04.206 INFO:tasks.workunit.client.0.smithi012.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x5b8) [0x55f0c812aa48] 2023-10-05T11:41:04.206 INFO:tasks.workunit.client.0.smithi012.stderr: 5: main() 2023-10-05T11:41:04.206 INFO:tasks.workunit.client.0.smithi012.stderr: 6: /lib64/libc.so.6(+0x3feb0) [0x7fa0ec63feb0] 2023-10-05T11:41:04.206 INFO:tasks.workunit.client.0.smithi012.stderr: 7: __libc_start_main() 2023-10-05T11:41:04.206 INFO:tasks.workunit.client.0.smithi012.stderr: 8: _start() 2023-10-05T11:41:04.206 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.202+0000 7fa0ea444880 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6543-g38321be8/rpm/el9/BUILD/ceph-18.0.0-6543-g38321be8/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fa0ea444880 time 2023-10-05T11:41:04.203267+0000 2023-10-05T11:41:04.206 INFO:tasks.workunit.client.0.smithi012.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6543-g38321be8/rpm/el9/BUILD/ceph-18.0.0-6543-g38321be8/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2023-10-05T11:41:04.206 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:41:04.206 INFO:tasks.workunit.client.0.smithi012.stderr: ceph version 18.0.0-6543-g38321be8 (38321be854743c0d616618a9ea8aa0b1d4dbc0bf) reef (dev) 2023-10-05T11:41:04.207 INFO:tasks.workunit.client.0.smithi012.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fa0ef16d15f] 2023-10-05T11:41:04.207 INFO:tasks.workunit.client.0.smithi012.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16d31d) [0x7fa0ef16d31d] 2023-10-05T11:41:04.207 INFO:tasks.workunit.client.0.smithi012.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f0c8113c31] 2023-10-05T11:41:04.207 INFO:tasks.workunit.client.0.smithi012.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x5b8) [0x55f0c812aa48] 2023-10-05T11:41:04.207 INFO:tasks.workunit.client.0.smithi012.stderr: 5: main() 2023-10-05T11:41:04.207 INFO:tasks.workunit.client.0.smithi012.stderr: 6: /lib64/libc.so.6(+0x3feb0) [0x7fa0ec63feb0] 2023-10-05T11:41:04.207 INFO:tasks.workunit.client.0.smithi012.stderr: 7: __libc_start_main() 2023-10-05T11:41:04.207 INFO:tasks.workunit.client.0.smithi012.stderr: 8: _start() 2023-10-05T11:41:04.207 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:41:04.207 INFO:tasks.workunit.client.0.smithi012.stderr:*** Caught signal (Aborted) ** 2023-10-05T11:41:04.207 INFO:tasks.workunit.client.0.smithi012.stderr: in thread 7fa0ea444880 thread_name:radosgw-admin 2023-10-05T11:41:04.226 INFO:tasks.workunit.client.0.smithi012.stderr: ceph version 18.0.0-6543-g38321be8 (38321be854743c0d616618a9ea8aa0b1d4dbc0bf) reef (dev) 2023-10-05T11:41:04.226 INFO:tasks.workunit.client.0.smithi012.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7fa0ec654db0] 2023-10-05T11:41:04.226 INFO:tasks.workunit.client.0.smithi012.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7fa0ec6a154c] 2023-10-05T11:41:04.226 INFO:tasks.workunit.client.0.smithi012.stderr: 3: raise() 2023-10-05T11:41:04.226 INFO:tasks.workunit.client.0.smithi012.stderr: 4: abort() 2023-10-05T11:41:04.226 INFO:tasks.workunit.client.0.smithi012.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fa0ef16d1b9] 2023-10-05T11:41:04.227 INFO:tasks.workunit.client.0.smithi012.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16d31d) [0x7fa0ef16d31d] 2023-10-05T11:41:04.227 INFO:tasks.workunit.client.0.smithi012.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f0c8113c31] 2023-10-05T11:41:04.227 INFO:tasks.workunit.client.0.smithi012.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x5b8) [0x55f0c812aa48] 2023-10-05T11:41:04.227 INFO:tasks.workunit.client.0.smithi012.stderr: 9: main() 2023-10-05T11:41:04.227 INFO:tasks.workunit.client.0.smithi012.stderr: 10: /lib64/libc.so.6(+0x3feb0) [0x7fa0ec63feb0] 2023-10-05T11:41:04.227 INFO:tasks.workunit.client.0.smithi012.stderr: 11: __libc_start_main() 2023-10-05T11:41:04.227 INFO:tasks.workunit.client.0.smithi012.stderr: 12: _start() 2023-10-05T11:41:04.227 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.203+0000 7fa0ea444880 -1 *** Caught signal (Aborted) ** 2023-10-05T11:41:04.227 INFO:tasks.workunit.client.0.smithi012.stderr: in thread 7fa0ea444880 thread_name:radosgw-admin 2023-10-05T11:41:04.227 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:41:04.227 INFO:tasks.workunit.client.0.smithi012.stderr: ceph version 18.0.0-6543-g38321be8 (38321be854743c0d616618a9ea8aa0b1d4dbc0bf) reef (dev) 2023-10-05T11:41:04.228 INFO:tasks.workunit.client.0.smithi012.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7fa0ec654db0] 2023-10-05T11:41:04.228 INFO:tasks.workunit.client.0.smithi012.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7fa0ec6a154c] 2023-10-05T11:41:04.228 INFO:tasks.workunit.client.0.smithi012.stderr: 3: raise() 2023-10-05T11:41:04.228 INFO:tasks.workunit.client.0.smithi012.stderr: 4: abort() 2023-10-05T11:41:04.228 INFO:tasks.workunit.client.0.smithi012.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fa0ef16d1b9] 2023-10-05T11:41:04.228 INFO:tasks.workunit.client.0.smithi012.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16d31d) [0x7fa0ef16d31d] 2023-10-05T11:41:04.228 INFO:tasks.workunit.client.0.smithi012.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f0c8113c31] 2023-10-05T11:41:04.228 INFO:tasks.workunit.client.0.smithi012.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x5b8) [0x55f0c812aa48] 2023-10-05T11:41:04.228 INFO:tasks.workunit.client.0.smithi012.stderr: 9: main() 2023-10-05T11:41:04.228 INFO:tasks.workunit.client.0.smithi012.stderr: 10: /lib64/libc.so.6(+0x3feb0) [0x7fa0ec63feb0] 2023-10-05T11:41:04.228 INFO:tasks.workunit.client.0.smithi012.stderr: 11: __libc_start_main() 2023-10-05T11:41:04.228 INFO:tasks.workunit.client.0.smithi012.stderr: 12: _start() 2023-10-05T11:41:04.228 INFO:tasks.workunit.client.0.smithi012.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-10-05T11:41:04.229 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:41:04.229 INFO:tasks.workunit.client.0.smithi012.stderr:--- begin dump of recent events --- 2023-10-05T11:41:04.229 INFO:tasks.workunit.client.0.smithi012.stderr: -499> 2023-10-05T11:41:04.145+0000 7fa0ea444880 5 AuthRegistry(0x7ffdbe4c7100) adding con mode: crc 2023-10-05T11:41:04.229 INFO:tasks.workunit.client.0.smithi012.stderr: -498> 2023-10-05T11:41:04.145+0000 7fa0ea444880 5 AuthRegistry(0x7ffdbe4c7100) adding con mode: secure 2023-10-05T11:41:04.229 INFO:tasks.workunit.client.0.smithi012.stderr: -497> 2023-10-05T11:41:04.145+0000 7fa0ea444880 5 AuthRegistry(0x7ffdbe4c7100) adding con mode: crc 2023-10-05T11:41:04.229 INFO:tasks.workunit.client.0.smithi012.stderr: -496> 2023-10-05T11:41:04.145+0000 7fa0ea444880 5 AuthRegistry(0x7ffdbe4c7100) adding con mode: secure 2023-10-05T11:41:04.229 INFO:tasks.workunit.client.0.smithi012.stderr: -495> 2023-10-05T11:41:04.145+0000 7fa0ea444880 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-10-05T11:41:04.229 INFO:tasks.workunit.client.0.smithi012.stderr: -494> 2023-10-05T11:41:04.145+0000 7fa0ea444880 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-10-05T11:41:04.229 INFO:tasks.workunit.client.0.smithi012.stderr: -493> 2023-10-05T11:41:04.145+0000 7fa0ea444880 5 asok(0x55f0c995c000) register_command rotate-key cmddesc rotate-key hook 0x7ffdbe4c7248 EEXIST 2023-10-05T11:41:04.229 INFO:tasks.workunit.client.0.smithi012.stderr: -492> 2023-10-05T11:41:04.145+0000 7fa0ea444880 10 monclient: _reopen_session rank -1 2023-10-05T11:41:04.229 INFO:tasks.workunit.client.0.smithi012.stderr: -491> 2023-10-05T11:41:04.145+0000 7fa0ea444880 10 monclient: _add_conns ranks=[1,2,0] 2023-10-05T11:41:04.229 INFO:tasks.workunit.client.0.smithi012.stderr: -490> 2023-10-05T11:41:04.145+0000 7fa0ea444880 10 monclient(hunting): picked mon.noname-b con 0x55f0ca55c800 addr [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] 2023-10-05T11:41:04.230 INFO:tasks.workunit.client.0.smithi012.stderr: -489> 2023-10-05T11:41:04.145+0000 7fa0ea444880 10 monclient(hunting): picked mon.noname-c con 0x55f0ca55cc00 addr [v2:172.21.15.12:3301/0,v1:172.21.15.12:6790/0] 2023-10-05T11:41:04.230 INFO:tasks.workunit.client.0.smithi012.stderr: -488> 2023-10-05T11:41:04.145+0000 7fa0ea444880 10 monclient(hunting): picked mon.noname-a con 0x55f0ca55d000 addr [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] 2023-10-05T11:41:04.230 INFO:tasks.workunit.client.0.smithi012.stderr: -487> 2023-10-05T11:41:04.145+0000 7fa0ea444880 10 monclient(hunting): start opening mon connection 2023-10-05T11:41:04.230 INFO:tasks.workunit.client.0.smithi012.stderr: -486> 2023-10-05T11:41:04.145+0000 7fa0ea444880 10 monclient(hunting): start opening mon connection 2023-10-05T11:41:04.230 INFO:tasks.workunit.client.0.smithi012.stderr: -485> 2023-10-05T11:41:04.145+0000 7fa0ea444880 10 monclient(hunting): start opening mon connection 2023-10-05T11:41:04.230 INFO:tasks.workunit.client.0.smithi012.stderr: -484> 2023-10-05T11:41:04.145+0000 7fa0ea444880 10 monclient(hunting): _renew_subs 2023-10-05T11:41:04.230 INFO:tasks.workunit.client.0.smithi012.stderr: -483> 2023-10-05T11:41:04.145+0000 7fa0ea444880 10 monclient(hunting): authenticate will time out at 1572.314144s 2023-10-05T11:41:04.230 INFO:tasks.workunit.client.0.smithi012.stderr: -482> 2023-10-05T11:41:04.145+0000 7fa0e8be9640 10 monclient(hunting): get_auth_request con 0x55f0ca55cc00 auth_method 0 2023-10-05T11:41:04.231 INFO:tasks.workunit.client.0.smithi012.stderr: -481> 2023-10-05T11:41:04.145+0000 7fa0e8be9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-10-05T11:41:04.231 INFO:tasks.workunit.client.0.smithi012.stderr: -480> 2023-10-05T11:41:04.145+0000 7fa0e8be9640 10 monclient(hunting): _init_auth method 2 2023-10-05T11:41:04.231 INFO:tasks.workunit.client.0.smithi012.stderr: -479> 2023-10-05T11:41:04.145+0000 7fa0e8be9640 10 monclient(hunting): _init_auth creating new auth 2023-10-05T11:41:04.231 INFO:tasks.workunit.client.0.smithi012.stderr: -478> 2023-10-05T11:41:04.145+0000 7fa0e83e8640 10 monclient(hunting): get_auth_request con 0x55f0ca55d000 auth_method 0 2023-10-05T11:41:04.231 INFO:tasks.workunit.client.0.smithi012.stderr: -477> 2023-10-05T11:41:04.145+0000 7fa0e83e8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-10-05T11:41:04.231 INFO:tasks.workunit.client.0.smithi012.stderr: -476> 2023-10-05T11:41:04.145+0000 7fa0e83e8640 10 monclient(hunting): _init_auth method 2 2023-10-05T11:41:04.231 INFO:tasks.workunit.client.0.smithi012.stderr: -475> 2023-10-05T11:41:04.145+0000 7fa0e83e8640 10 monclient(hunting): _init_auth creating new auth 2023-10-05T11:41:04.231 INFO:tasks.workunit.client.0.smithi012.stderr: -474> 2023-10-05T11:41:04.145+0000 7fa0e93ea640 10 monclient(hunting): get_auth_request con 0x55f0ca55c800 auth_method 0 2023-10-05T11:41:04.231 INFO:tasks.workunit.client.0.smithi012.stderr: -473> 2023-10-05T11:41:04.145+0000 7fa0e93ea640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-10-05T11:41:04.231 INFO:tasks.workunit.client.0.smithi012.stderr: -472> 2023-10-05T11:41:04.145+0000 7fa0e93ea640 10 monclient(hunting): _init_auth method 2 2023-10-05T11:41:04.232 INFO:tasks.workunit.client.0.smithi012.stderr: -471> 2023-10-05T11:41:04.145+0000 7fa0e93ea640 10 monclient(hunting): _init_auth creating new auth 2023-10-05T11:41:04.232 INFO:tasks.workunit.client.0.smithi012.stderr: -470> 2023-10-05T11:41:04.145+0000 7fa0e8be9640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-10-05T11:41:04.232 INFO:tasks.workunit.client.0.smithi012.stderr: -469> 2023-10-05T11:41:04.145+0000 7fa0e8be9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-10-05T11:41:04.232 INFO:tasks.workunit.client.0.smithi012.stderr: -468> 2023-10-05T11:41:04.145+0000 7fa0e8be9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-10-05T11:41:04.232 INFO:tasks.workunit.client.0.smithi012.stderr: -467> 2023-10-05T11:41:04.145+0000 7fa0e83e8640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-10-05T11:41:04.232 INFO:tasks.workunit.client.0.smithi012.stderr: -466> 2023-10-05T11:41:04.145+0000 7fa0e83e8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-10-05T11:41:04.232 INFO:tasks.workunit.client.0.smithi012.stderr: -465> 2023-10-05T11:41:04.145+0000 7fa0e5be3640 4 mgrc handle_mgr_map Got map version 5 2023-10-05T11:41:04.232 INFO:tasks.workunit.client.0.smithi012.stderr: -464> 2023-10-05T11:41:04.145+0000 7fa0e83e8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-10-05T11:41:04.232 INFO:tasks.workunit.client.0.smithi012.stderr: -463> 2023-10-05T11:41:04.145+0000 7fa0e5be3640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.170:6832/180516904,v1:172.21.15.170:6833/180516904] 2023-10-05T11:41:04.232 INFO:tasks.workunit.client.0.smithi012.stderr: -462> 2023-10-05T11:41:04.145+0000 7fa0e5be3640 4 mgrc reconnect Starting new session with [v2:172.21.15.170:6832/180516904,v1:172.21.15.170:6833/180516904] 2023-10-05T11:41:04.232 INFO:tasks.workunit.client.0.smithi012.stderr: -461> 2023-10-05T11:41:04.146+0000 7fa0e93ea640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-10-05T11:41:04.232 INFO:tasks.workunit.client.0.smithi012.stderr: -460> 2023-10-05T11:41:04.146+0000 7fa0e93ea640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-10-05T11:41:04.233 INFO:tasks.workunit.client.0.smithi012.stderr: -459> 2023-10-05T11:41:04.146+0000 7fa0e93ea640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-10-05T11:41:04.233 INFO:tasks.workunit.client.0.smithi012.stderr: -458> 2023-10-05T11:41:04.146+0000 7fa0e8be9640 10 monclient(hunting): handle_auth_done global_id 6770 payload 274 2023-10-05T11:41:04.233 INFO:tasks.workunit.client.0.smithi012.stderr: -457> 2023-10-05T11:41:04.146+0000 7fa0e8be9640 10 monclient: _finish_hunting 0 2023-10-05T11:41:04.233 INFO:tasks.workunit.client.0.smithi012.stderr: -456> 2023-10-05T11:41:04.146+0000 7fa0e8be9640 1 monclient: found mon.noname-c 2023-10-05T11:41:04.233 INFO:tasks.workunit.client.0.smithi012.stderr: -455> 2023-10-05T11:41:04.146+0000 7fa0e8be9640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.12:3301/0 2023-10-05T11:41:04.233 INFO:tasks.workunit.client.0.smithi012.stderr: -454> 2023-10-05T11:41:04.146+0000 7fa0e93ea640 10 monclient: get_auth_request con 0x55f0ca55dc00 auth_method 0 2023-10-05T11:41:04.233 INFO:tasks.workunit.client.0.smithi012.stderr: -453> 2023-10-05T11:41:04.146+0000 7fa0e33de640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-10-05T11:41:04.233 INFO:tasks.workunit.client.0.smithi012.stderr: -452> 2023-10-05T11:41:04.146+0000 7fa0e33de640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2023-10-05T11:41:04.234 INFO:tasks.workunit.client.0.smithi012.stderr: -451> 2023-10-05T11:41:04.146+0000 7fa0e33de640 10 monclient: dump: 2023-10-05T11:41:04.234 INFO:tasks.workunit.client.0.smithi012.stderr:epoch 1 2023-10-05T11:41:04.234 INFO:tasks.workunit.client.0.smithi012.stderr:fsid 7e015f46-293b-4b09-bd32-7d32b52f6e2f 2023-10-05T11:41:04.234 INFO:tasks.workunit.client.0.smithi012.stderr:last_changed 2023-10-05T11:27:38.366888+0000 2023-10-05T11:41:04.234 INFO:tasks.workunit.client.0.smithi012.stderr:created 2023-10-05T11:27:38.366888+0000 2023-10-05T11:41:04.234 INFO:tasks.workunit.client.0.smithi012.stderr:min_mon_release 18 (reef) 2023-10-05T11:41:04.234 INFO:tasks.workunit.client.0.smithi012.stderr:election_strategy: 1 2023-10-05T11:41:04.234 INFO:tasks.workunit.client.0.smithi012.stderr:0: [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon.a 2023-10-05T11:41:04.235 INFO:tasks.workunit.client.0.smithi012.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2023-10-05T11:41:04.235 INFO:tasks.workunit.client.0.smithi012.stderr:2: [v2:172.21.15.12:3301/0,v1:172.21.15.12:6790/0] mon.c 2023-10-05T11:41:04.235 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:41:04.235 INFO:tasks.workunit.client.0.smithi012.stderr: -450> 2023-10-05T11:41:04.146+0000 7fa0e33de640 10 monclient: _finish_auth 0 2023-10-05T11:41:04.235 INFO:tasks.workunit.client.0.smithi012.stderr: -449> 2023-10-05T11:41:04.146+0000 7fa0e33de640 10 monclient: _check_auth_tickets 2023-10-05T11:41:04.235 INFO:tasks.workunit.client.0.smithi012.stderr: -448> 2023-10-05T11:41:04.146+0000 7fa0e33de640 10 monclient: handle_config config(0 keys) v1 2023-10-05T11:41:04.235 INFO:tasks.workunit.client.0.smithi012.stderr: -447> 2023-10-05T11:41:04.146+0000 7fa0ea444880 5 monclient: authenticate success, global_id 6770 2023-10-05T11:41:04.235 INFO:tasks.workunit.client.0.smithi012.stderr: -446> 2023-10-05T11:41:04.146+0000 7fa0ea444880 10 monclient: get_monmap_and_config success 2023-10-05T11:41:04.235 INFO:tasks.workunit.client.0.smithi012.stderr: -445> 2023-10-05T11:41:04.146+0000 7fa0ea444880 4 set_mon_vals no callback set 2023-10-05T11:41:04.235 INFO:tasks.workunit.client.0.smithi012.stderr: -444> 2023-10-05T11:41:04.146+0000 7fa0e33de640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-10-05T11:41:04.236 INFO:tasks.workunit.client.0.smithi012.stderr: -443> 2023-10-05T11:41:04.146+0000 7fa0e33de640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-10-05T11:41:04.236 INFO:tasks.workunit.client.0.smithi012.stderr: -442> 2023-10-05T11:41:04.146+0000 7fa0e33de640 10 monclient: dump: 2023-10-05T11:41:04.236 INFO:tasks.workunit.client.0.smithi012.stderr:epoch 1 2023-10-05T11:41:04.236 INFO:tasks.workunit.client.0.smithi012.stderr:fsid 7e015f46-293b-4b09-bd32-7d32b52f6e2f 2023-10-05T11:41:04.236 INFO:tasks.workunit.client.0.smithi012.stderr:last_changed 2023-10-05T11:27:38.366888+0000 2023-10-05T11:41:04.236 INFO:tasks.workunit.client.0.smithi012.stderr:created 2023-10-05T11:27:38.366888+0000 2023-10-05T11:41:04.236 INFO:tasks.workunit.client.0.smithi012.stderr:min_mon_release 18 (reef) 2023-10-05T11:41:04.236 INFO:tasks.workunit.client.0.smithi012.stderr:election_strategy: 1 2023-10-05T11:41:04.236 INFO:tasks.workunit.client.0.smithi012.stderr:0: [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon.a 2023-10-05T11:41:04.236 INFO:tasks.workunit.client.0.smithi012.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2023-10-05T11:41:04.236 INFO:tasks.workunit.client.0.smithi012.stderr:2: [v2:172.21.15.12:3301/0,v1:172.21.15.12:6790/0] mon.c 2023-10-05T11:41:04.236 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:41:04.236 INFO:tasks.workunit.client.0.smithi012.stderr: -441> 2023-10-05T11:41:04.146+0000 7fa0ea444880 10 monclient: shutdown 2023-10-05T11:41:04.237 INFO:tasks.workunit.client.0.smithi012.stderr: -440> 2023-10-05T11:41:04.146+0000 7fa0ea444880 10 monclient: build_initial_monmap 2023-10-05T11:41:04.237 INFO:tasks.workunit.client.0.smithi012.stderr: -439> 2023-10-05T11:41:04.146+0000 7fa0ea444880 1 build_initial for_mkfs: 0 2023-10-05T11:41:04.237 INFO:tasks.workunit.client.0.smithi012.stderr: -438> 2023-10-05T11:41:04.146+0000 7fa0ea444880 10 monclient: monmap: 2023-10-05T11:41:04.237 INFO:tasks.workunit.client.0.smithi012.stderr:epoch 0 2023-10-05T11:41:04.237 INFO:tasks.workunit.client.0.smithi012.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-10-05T11:41:04.237 INFO:tasks.workunit.client.0.smithi012.stderr:last_changed 0.000000 2023-10-05T11:41:04.237 INFO:tasks.workunit.client.0.smithi012.stderr:created 0.000000 2023-10-05T11:41:04.237 INFO:tasks.workunit.client.0.smithi012.stderr:min_mon_release 0 (unknown) 2023-10-05T11:41:04.237 INFO:tasks.workunit.client.0.smithi012.stderr:election_strategy: 1 2023-10-05T11:41:04.237 INFO:tasks.workunit.client.0.smithi012.stderr:0: [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon.noname-a 2023-10-05T11:41:04.237 INFO:tasks.workunit.client.0.smithi012.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.noname-b 2023-10-05T11:41:04.237 INFO:tasks.workunit.client.0.smithi012.stderr:2: [v2:172.21.15.12:3301/0,v1:172.21.15.12:6790/0] mon.noname-c 2023-10-05T11:41:04.238 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:41:04.238 INFO:tasks.workunit.client.0.smithi012.stderr: -437> 2023-10-05T11:41:04.146+0000 7fa0ea444880 5 AuthRegistry(0x55f0ca40d340) adding auth protocol: cephx 2023-10-05T11:41:04.238 INFO:tasks.workunit.client.0.smithi012.stderr: -436> 2023-10-05T11:41:04.146+0000 7fa0ea444880 5 AuthRegistry(0x55f0ca40d340) adding auth protocol: cephx 2023-10-05T11:41:04.238 INFO:tasks.workunit.client.0.smithi012.stderr: -435> 2023-10-05T11:41:04.146+0000 7fa0ea444880 5 AuthRegistry(0x55f0ca40d340) adding auth protocol: cephx 2023-10-05T11:41:04.238 INFO:tasks.workunit.client.0.smithi012.stderr: -434> 2023-10-05T11:41:04.146+0000 7fa0ea444880 5 AuthRegistry(0x55f0ca40d340) adding con mode: secure 2023-10-05T11:41:04.238 INFO:tasks.workunit.client.0.smithi012.stderr: -433> 2023-10-05T11:41:04.146+0000 7fa0ea444880 5 AuthRegistry(0x55f0ca40d340) adding con mode: crc 2023-10-05T11:41:04.238 INFO:tasks.workunit.client.0.smithi012.stderr: -432> 2023-10-05T11:41:04.146+0000 7fa0ea444880 5 AuthRegistry(0x55f0ca40d340) adding con mode: secure 2023-10-05T11:41:04.238 INFO:tasks.workunit.client.0.smithi012.stderr: -431> 2023-10-05T11:41:04.146+0000 7fa0ea444880 5 AuthRegistry(0x55f0ca40d340) adding con mode: crc 2023-10-05T11:41:04.238 INFO:tasks.workunit.client.0.smithi012.stderr: -430> 2023-10-05T11:41:04.146+0000 7fa0ea444880 5 AuthRegistry(0x55f0ca40d340) adding con mode: secure 2023-10-05T11:41:04.238 INFO:tasks.workunit.client.0.smithi012.stderr: -429> 2023-10-05T11:41:04.146+0000 7fa0ea444880 5 AuthRegistry(0x55f0ca40d340) adding con mode: crc 2023-10-05T11:41:04.238 INFO:tasks.workunit.client.0.smithi012.stderr: -428> 2023-10-05T11:41:04.146+0000 7fa0ea444880 5 AuthRegistry(0x55f0ca40d340) adding con mode: crc 2023-10-05T11:41:04.239 INFO:tasks.workunit.client.0.smithi012.stderr: -427> 2023-10-05T11:41:04.146+0000 7fa0ea444880 5 AuthRegistry(0x55f0ca40d340) adding con mode: secure 2023-10-05T11:41:04.239 INFO:tasks.workunit.client.0.smithi012.stderr: -426> 2023-10-05T11:41:04.146+0000 7fa0ea444880 5 AuthRegistry(0x55f0ca40d340) adding con mode: crc 2023-10-05T11:41:04.239 INFO:tasks.workunit.client.0.smithi012.stderr: -425> 2023-10-05T11:41:04.146+0000 7fa0ea444880 5 AuthRegistry(0x55f0ca40d340) adding con mode: secure 2023-10-05T11:41:04.239 INFO:tasks.workunit.client.0.smithi012.stderr: -424> 2023-10-05T11:41:04.146+0000 7fa0ea444880 5 AuthRegistry(0x55f0ca40d340) adding con mode: crc 2023-10-05T11:41:04.239 INFO:tasks.workunit.client.0.smithi012.stderr: -423> 2023-10-05T11:41:04.146+0000 7fa0ea444880 5 AuthRegistry(0x55f0ca40d340) adding con mode: secure 2023-10-05T11:41:04.239 INFO:tasks.workunit.client.0.smithi012.stderr: -422> 2023-10-05T11:41:04.147+0000 7fa0ea444880 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-10-05T11:41:04.239 INFO:tasks.workunit.client.0.smithi012.stderr: -421> 2023-10-05T11:41:04.147+0000 7fa0ea444880 1 librados: starting msgr at 2023-10-05T11:41:04.239 INFO:tasks.workunit.client.0.smithi012.stderr: -420> 2023-10-05T11:41:04.147+0000 7fa0ea444880 1 librados: starting objecter 2023-10-05T11:41:04.239 INFO:tasks.workunit.client.0.smithi012.stderr: -419> 2023-10-05T11:41:04.147+0000 7fa0ea444880 5 asok(0x55f0c995c000) register_command objecter_requests cmddesc objecter_requests hook 0x55f0c970b510 EEXIST 2023-10-05T11:41:04.239 INFO:tasks.workunit.client.0.smithi012.stderr: -418> 2023-10-05T11:41:04.147+0000 7fa0ea444880 1 librados: setting wanted keys 2023-10-05T11:41:04.239 INFO:tasks.workunit.client.0.smithi012.stderr: -417> 2023-10-05T11:41:04.147+0000 7fa0ea444880 1 librados: calling monclient init 2023-10-05T11:41:04.239 INFO:tasks.workunit.client.0.smithi012.stderr: -416> 2023-10-05T11:41:04.147+0000 7fa0ea444880 10 monclient: init 2023-10-05T11:41:04.240 INFO:tasks.workunit.client.0.smithi012.stderr: -415> 2023-10-05T11:41:04.147+0000 7fa0ea444880 5 AuthRegistry(0x55f0c97bb0d8) adding auth protocol: cephx 2023-10-05T11:41:04.240 INFO:tasks.workunit.client.0.smithi012.stderr: -414> 2023-10-05T11:41:04.147+0000 7fa0ea444880 5 AuthRegistry(0x55f0c97bb0d8) adding auth protocol: cephx 2023-10-05T11:41:04.240 INFO:tasks.workunit.client.0.smithi012.stderr: -413> 2023-10-05T11:41:04.147+0000 7fa0ea444880 5 AuthRegistry(0x55f0c97bb0d8) adding auth protocol: cephx 2023-10-05T11:41:04.240 INFO:tasks.workunit.client.0.smithi012.stderr: -412> 2023-10-05T11:41:04.147+0000 7fa0ea444880 5 AuthRegistry(0x55f0c97bb0d8) adding con mode: secure 2023-10-05T11:41:04.240 INFO:tasks.workunit.client.0.smithi012.stderr: -411> 2023-10-05T11:41:04.147+0000 7fa0ea444880 5 AuthRegistry(0x55f0c97bb0d8) adding con mode: crc 2023-10-05T11:41:04.240 INFO:tasks.workunit.client.0.smithi012.stderr: -410> 2023-10-05T11:41:04.147+0000 7fa0ea444880 5 AuthRegistry(0x55f0c97bb0d8) adding con mode: secure 2023-10-05T11:41:04.240 INFO:tasks.workunit.client.0.smithi012.stderr: -409> 2023-10-05T11:41:04.147+0000 7fa0ea444880 5 AuthRegistry(0x55f0c97bb0d8) adding con mode: crc 2023-10-05T11:41:04.240 INFO:tasks.workunit.client.0.smithi012.stderr: -408> 2023-10-05T11:41:04.147+0000 7fa0ea444880 5 AuthRegistry(0x55f0c97bb0d8) adding con mode: secure 2023-10-05T11:41:04.240 INFO:tasks.workunit.client.0.smithi012.stderr: -407> 2023-10-05T11:41:04.147+0000 7fa0ea444880 5 AuthRegistry(0x55f0c97bb0d8) adding con mode: crc 2023-10-05T11:41:04.240 INFO:tasks.workunit.client.0.smithi012.stderr: -406> 2023-10-05T11:41:04.147+0000 7fa0ea444880 5 AuthRegistry(0x55f0c97bb0d8) adding con mode: crc 2023-10-05T11:41:04.241 INFO:tasks.workunit.client.0.smithi012.stderr: -405> 2023-10-05T11:41:04.147+0000 7fa0ea444880 5 AuthRegistry(0x55f0c97bb0d8) adding con mode: secure 2023-10-05T11:41:04.241 INFO:tasks.workunit.client.0.smithi012.stderr: -404> 2023-10-05T11:41:04.147+0000 7fa0ea444880 5 AuthRegistry(0x55f0c97bb0d8) adding con mode: crc 2023-10-05T11:41:04.241 INFO:tasks.workunit.client.0.smithi012.stderr: -403> 2023-10-05T11:41:04.147+0000 7fa0ea444880 5 AuthRegistry(0x55f0c97bb0d8) adding con mode: secure 2023-10-05T11:41:04.241 INFO:tasks.workunit.client.0.smithi012.stderr: -402> 2023-10-05T11:41:04.147+0000 7fa0ea444880 5 AuthRegistry(0x55f0c97bb0d8) adding con mode: crc 2023-10-05T11:41:04.241 INFO:tasks.workunit.client.0.smithi012.stderr: -401> 2023-10-05T11:41:04.147+0000 7fa0ea444880 5 AuthRegistry(0x55f0c97bb0d8) adding con mode: secure 2023-10-05T11:41:04.241 INFO:tasks.workunit.client.0.smithi012.stderr: -400> 2023-10-05T11:41:04.147+0000 7fa0ea444880 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-10-05T11:41:04.241 INFO:tasks.workunit.client.0.smithi012.stderr: -399> 2023-10-05T11:41:04.147+0000 7fa0ea444880 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-10-05T11:41:04.241 INFO:tasks.workunit.client.0.smithi012.stderr: -398> 2023-10-05T11:41:04.147+0000 7fa0ea444880 5 asok(0x55f0c995c000) register_command rotate-key cmddesc rotate-key hook 0x55f0c97bb220 EEXIST 2023-10-05T11:41:04.241 INFO:tasks.workunit.client.0.smithi012.stderr: -397> 2023-10-05T11:41:04.147+0000 7fa0ea444880 10 monclient: _reopen_session rank -1 2023-10-05T11:41:04.242 INFO:tasks.workunit.client.0.smithi012.stderr: -396> 2023-10-05T11:41:04.147+0000 7fa0ea444880 10 monclient: _add_conns ranks=[0,2,1] 2023-10-05T11:41:04.242 INFO:tasks.workunit.client.0.smithi012.stderr: -395> 2023-10-05T11:41:04.147+0000 7fa0ea444880 10 monclient(hunting): picked mon.noname-a con 0x55f0ca55c800 addr [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] 2023-10-05T11:41:04.242 INFO:tasks.workunit.client.0.smithi012.stderr: -394> 2023-10-05T11:41:04.147+0000 7fa0ea444880 10 monclient(hunting): picked mon.noname-c con 0x55f0ca55cc00 addr [v2:172.21.15.12:3301/0,v1:172.21.15.12:6790/0] 2023-10-05T11:41:04.242 INFO:tasks.workunit.client.0.smithi012.stderr: -393> 2023-10-05T11:41:04.147+0000 7fa0ea444880 10 monclient(hunting): picked mon.noname-b con 0x55f0ca55d000 addr [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] 2023-10-05T11:41:04.242 INFO:tasks.workunit.client.0.smithi012.stderr: -392> 2023-10-05T11:41:04.147+0000 7fa0ea444880 10 monclient(hunting): start opening mon connection 2023-10-05T11:41:04.242 INFO:tasks.workunit.client.0.smithi012.stderr: -391> 2023-10-05T11:41:04.147+0000 7fa0ea444880 10 monclient(hunting): start opening mon connection 2023-10-05T11:41:04.242 INFO:tasks.workunit.client.0.smithi012.stderr: -390> 2023-10-05T11:41:04.147+0000 7fa0ea444880 10 monclient(hunting): start opening mon connection 2023-10-05T11:41:04.242 INFO:tasks.workunit.client.0.smithi012.stderr: -389> 2023-10-05T11:41:04.147+0000 7fa0ea444880 10 monclient(hunting): _renew_subs 2023-10-05T11:41:04.242 INFO:tasks.workunit.client.0.smithi012.stderr: -388> 2023-10-05T11:41:04.147+0000 7fa0ea444880 10 monclient(hunting): authenticate will time out at 1572.316211s 2023-10-05T11:41:04.242 INFO:tasks.workunit.client.0.smithi012.stderr: -387> 2023-10-05T11:41:04.147+0000 7fa0e83e8640 10 monclient(hunting): get_auth_request con 0x55f0ca55cc00 auth_method 0 2023-10-05T11:41:04.242 INFO:tasks.workunit.client.0.smithi012.stderr: -386> 2023-10-05T11:41:04.147+0000 7fa0e83e8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-10-05T11:41:04.243 INFO:tasks.workunit.client.0.smithi012.stderr: -385> 2023-10-05T11:41:04.147+0000 7fa0e83e8640 10 monclient(hunting): _init_auth method 2 2023-10-05T11:41:04.243 INFO:tasks.workunit.client.0.smithi012.stderr: -384> 2023-10-05T11:41:04.147+0000 7fa0e83e8640 10 monclient(hunting): _init_auth creating new auth 2023-10-05T11:41:04.243 INFO:tasks.workunit.client.0.smithi012.stderr: -383> 2023-10-05T11:41:04.147+0000 7fa0e8be9640 10 monclient(hunting): get_auth_request con 0x55f0ca55c800 auth_method 0 2023-10-05T11:41:04.243 INFO:tasks.workunit.client.0.smithi012.stderr: -382> 2023-10-05T11:41:04.147+0000 7fa0e8be9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-10-05T11:41:04.243 INFO:tasks.workunit.client.0.smithi012.stderr: -381> 2023-10-05T11:41:04.147+0000 7fa0e8be9640 10 monclient(hunting): _init_auth method 2 2023-10-05T11:41:04.243 INFO:tasks.workunit.client.0.smithi012.stderr: -380> 2023-10-05T11:41:04.147+0000 7fa0e8be9640 10 monclient(hunting): _init_auth creating new auth 2023-10-05T11:41:04.243 INFO:tasks.workunit.client.0.smithi012.stderr: -379> 2023-10-05T11:41:04.147+0000 7fa0e93ea640 10 monclient(hunting): get_auth_request con 0x55f0ca55d000 auth_method 0 2023-10-05T11:41:04.243 INFO:tasks.workunit.client.0.smithi012.stderr: -378> 2023-10-05T11:41:04.147+0000 7fa0e93ea640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-10-05T11:41:04.243 INFO:tasks.workunit.client.0.smithi012.stderr: -377> 2023-10-05T11:41:04.147+0000 7fa0e93ea640 10 monclient(hunting): _init_auth method 2 2023-10-05T11:41:04.243 INFO:tasks.workunit.client.0.smithi012.stderr: -376> 2023-10-05T11:41:04.147+0000 7fa0e93ea640 10 monclient(hunting): _init_auth creating new auth 2023-10-05T11:41:04.243 INFO:tasks.workunit.client.0.smithi012.stderr: -375> 2023-10-05T11:41:04.147+0000 7fa0e83e8640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-10-05T11:41:04.243 INFO:tasks.workunit.client.0.smithi012.stderr: -374> 2023-10-05T11:41:04.147+0000 7fa0e83e8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-10-05T11:41:04.243 INFO:tasks.workunit.client.0.smithi012.stderr: -373> 2023-10-05T11:41:04.147+0000 7fa0e83e8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-10-05T11:41:04.244 INFO:tasks.workunit.client.0.smithi012.stderr: -372> 2023-10-05T11:41:04.147+0000 7fa0e8be9640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-10-05T11:41:04.244 INFO:tasks.workunit.client.0.smithi012.stderr: -371> 2023-10-05T11:41:04.147+0000 7fa0e8be9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-10-05T11:41:04.244 INFO:tasks.workunit.client.0.smithi012.stderr: -370> 2023-10-05T11:41:04.147+0000 7fa0e8be9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-10-05T11:41:04.244 INFO:tasks.workunit.client.0.smithi012.stderr: -369> 2023-10-05T11:41:04.148+0000 7fa0e93ea640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-10-05T11:41:04.244 INFO:tasks.workunit.client.0.smithi012.stderr: -368> 2023-10-05T11:41:04.148+0000 7fa0e93ea640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-10-05T11:41:04.244 INFO:tasks.workunit.client.0.smithi012.stderr: -367> 2023-10-05T11:41:04.148+0000 7fa0e93ea640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-10-05T11:41:04.244 INFO:tasks.workunit.client.0.smithi012.stderr: -366> 2023-10-05T11:41:04.148+0000 7fa0e8be9640 10 monclient(hunting): handle_auth_done global_id 7140 payload 824 2023-10-05T11:41:04.244 INFO:tasks.workunit.client.0.smithi012.stderr: -365> 2023-10-05T11:41:04.148+0000 7fa0e8be9640 10 monclient: _finish_hunting 0 2023-10-05T11:41:04.244 INFO:tasks.workunit.client.0.smithi012.stderr: -364> 2023-10-05T11:41:04.148+0000 7fa0e8be9640 1 monclient: found mon.noname-a 2023-10-05T11:41:04.244 INFO:tasks.workunit.client.0.smithi012.stderr: -363> 2023-10-05T11:41:04.148+0000 7fa0e8be9640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.12:3300/0 2023-10-05T11:41:04.245 INFO:tasks.workunit.client.0.smithi012.stderr: -362> 2023-10-05T11:41:04.148+0000 7fa0e1bdb640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-10-05T11:41:04.245 INFO:tasks.workunit.client.0.smithi012.stderr: -361> 2023-10-05T11:41:04.148+0000 7fa0e1bdb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2023-10-05T11:41:04.245 INFO:tasks.workunit.client.0.smithi012.stderr: -360> 2023-10-05T11:41:04.148+0000 7fa0e1bdb640 10 monclient: dump: 2023-10-05T11:41:04.245 INFO:tasks.workunit.client.0.smithi012.stderr:epoch 1 2023-10-05T11:41:04.245 INFO:tasks.workunit.client.0.smithi012.stderr:fsid 7e015f46-293b-4b09-bd32-7d32b52f6e2f 2023-10-05T11:41:04.245 INFO:tasks.workunit.client.0.smithi012.stderr:last_changed 2023-10-05T11:27:38.366888+0000 2023-10-05T11:41:04.245 INFO:tasks.workunit.client.0.smithi012.stderr:created 2023-10-05T11:27:38.366888+0000 2023-10-05T11:41:04.245 INFO:tasks.workunit.client.0.smithi012.stderr:min_mon_release 18 (reef) 2023-10-05T11:41:04.245 INFO:tasks.workunit.client.0.smithi012.stderr:election_strategy: 1 2023-10-05T11:41:04.246 INFO:tasks.workunit.client.0.smithi012.stderr:0: [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon.a 2023-10-05T11:41:04.246 INFO:tasks.workunit.client.0.smithi012.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2023-10-05T11:41:04.246 INFO:tasks.workunit.client.0.smithi012.stderr:2: [v2:172.21.15.12:3301/0,v1:172.21.15.12:6790/0] mon.c 2023-10-05T11:41:04.246 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:41:04.246 INFO:tasks.workunit.client.0.smithi012.stderr: -359> 2023-10-05T11:41:04.148+0000 7fa0e1bdb640 10 monclient: _finish_auth 0 2023-10-05T11:41:04.246 INFO:tasks.workunit.client.0.smithi012.stderr: -358> 2023-10-05T11:41:04.148+0000 7fa0e1bdb640 10 monclient: _check_auth_tickets 2023-10-05T11:41:04.246 INFO:tasks.workunit.client.0.smithi012.stderr: -357> 2023-10-05T11:41:04.148+0000 7fa0e1bdb640 10 monclient: handle_config config(0 keys) v1 2023-10-05T11:41:04.246 INFO:tasks.workunit.client.0.smithi012.stderr: -356> 2023-10-05T11:41:04.148+0000 7fa0e1bdb640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-10-05T11:41:04.246 INFO:tasks.workunit.client.0.smithi012.stderr: -355> 2023-10-05T11:41:04.148+0000 7fa0e1bdb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2023-10-05T11:41:04.246 INFO:tasks.workunit.client.0.smithi012.stderr: -354> 2023-10-05T11:41:04.148+0000 7fa0e1bdb640 10 monclient: dump: 2023-10-05T11:41:04.246 INFO:tasks.workunit.client.0.smithi012.stderr:epoch 1 2023-10-05T11:41:04.247 INFO:tasks.workunit.client.0.smithi012.stderr:fsid 7e015f46-293b-4b09-bd32-7d32b52f6e2f 2023-10-05T11:41:04.247 INFO:tasks.workunit.client.0.smithi012.stderr:last_changed 2023-10-05T11:27:38.366888+0000 2023-10-05T11:41:04.247 INFO:tasks.workunit.client.0.smithi012.stderr:created 2023-10-05T11:27:38.366888+0000 2023-10-05T11:41:04.247 INFO:tasks.workunit.client.0.smithi012.stderr:min_mon_release 18 (reef) 2023-10-05T11:41:04.247 INFO:tasks.workunit.client.0.smithi012.stderr:election_strategy: 1 2023-10-05T11:41:04.247 INFO:tasks.workunit.client.0.smithi012.stderr:0: [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon.a 2023-10-05T11:41:04.247 INFO:tasks.workunit.client.0.smithi012.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2023-10-05T11:41:04.247 INFO:tasks.workunit.client.0.smithi012.stderr:2: [v2:172.21.15.12:3301/0,v1:172.21.15.12:6790/0] mon.c 2023-10-05T11:41:04.247 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:41:04.247 INFO:tasks.workunit.client.0.smithi012.stderr: -353> 2023-10-05T11:41:04.148+0000 7fa0e33de640 4 set_mon_vals no callback set 2023-10-05T11:41:04.247 INFO:tasks.workunit.client.0.smithi012.stderr: -352> 2023-10-05T11:41:04.148+0000 7fa0ea444880 5 monclient: authenticate success, global_id 7140 2023-10-05T11:41:04.247 INFO:tasks.workunit.client.0.smithi012.stderr: -351> 2023-10-05T11:41:04.148+0000 7fa0ea444880 10 monclient: _renew_subs 2023-10-05T11:41:04.247 INFO:tasks.workunit.client.0.smithi012.stderr: -350> 2023-10-05T11:41:04.148+0000 7fa0ea444880 10 monclient: _send_mon_message to mon.a at v2:172.21.15.12:3300/0 2023-10-05T11:41:04.248 INFO:tasks.workunit.client.0.smithi012.stderr: -349> 2023-10-05T11:41:04.148+0000 7fa0ea444880 10 monclient: _renew_subs 2023-10-05T11:41:04.248 INFO:tasks.workunit.client.0.smithi012.stderr: -348> 2023-10-05T11:41:04.148+0000 7fa0ea444880 10 monclient: _send_mon_message to mon.a at v2:172.21.15.12:3300/0 2023-10-05T11:41:04.248 INFO:tasks.workunit.client.0.smithi012.stderr: -347> 2023-10-05T11:41:04.148+0000 7fa0ea444880 1 librados: init done 2023-10-05T11:41:04.248 INFO:tasks.workunit.client.0.smithi012.stderr: -346> 2023-10-05T11:41:04.149+0000 7fa0ea444880 20 rados->read ofs=0 len=0 2023-10-05T11:41:04.248 INFO:tasks.workunit.client.0.smithi012.stderr: -345> 2023-10-05T11:41:04.150+0000 7fa0e1bdb640 4 mgrc handle_mgr_map Got map version 5 2023-10-05T11:41:04.248 INFO:tasks.workunit.client.0.smithi012.stderr: -344> 2023-10-05T11:41:04.150+0000 7fa0e1bdb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.170:6832/180516904,v1:172.21.15.170:6833/180516904] 2023-10-05T11:41:04.248 INFO:tasks.workunit.client.0.smithi012.stderr: -343> 2023-10-05T11:41:04.150+0000 7fa0e1bdb640 4 mgrc reconnect Starting new session with [v2:172.21.15.170:6832/180516904,v1:172.21.15.170:6833/180516904] 2023-10-05T11:41:04.248 INFO:tasks.workunit.client.0.smithi012.stderr: -342> 2023-10-05T11:41:04.150+0000 7fa0e83e8640 10 monclient: get_auth_request con 0x55f0c9a29800 auth_method 0 2023-10-05T11:41:04.248 INFO:tasks.workunit.client.0.smithi012.stderr: -341> 2023-10-05T11:41:04.150+0000 7fa0e93ea640 10 monclient: get_auth_request con 0x55f0ca55d400 auth_method 0 2023-10-05T11:41:04.248 INFO:tasks.workunit.client.0.smithi012.stderr: -340> 2023-10-05T11:41:04.151+0000 7fa0ea444880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:04.248 INFO:tasks.workunit.client.0.smithi012.stderr: -339> 2023-10-05T11:41:04.151+0000 7fa0ea444880 20 realm 2023-10-05T11:41:04.248 INFO:tasks.workunit.client.0.smithi012.stderr: -338> 2023-10-05T11:41:04.151+0000 7fa0ea444880 20 rados->read ofs=0 len=0 2023-10-05T11:41:04.248 INFO:tasks.workunit.client.0.smithi012.stderr: -337> 2023-10-05T11:41:04.151+0000 7fa0ea444880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:04.249 INFO:tasks.workunit.client.0.smithi012.stderr: -336> 2023-10-05T11:41:04.151+0000 7fa0ea444880 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T11:41:04.249 INFO:tasks.workunit.client.0.smithi012.stderr: -335> 2023-10-05T11:41:04.151+0000 7fa0ea444880 20 rados->read ofs=0 len=0 2023-10-05T11:41:04.249 INFO:tasks.workunit.client.0.smithi012.stderr: -334> 2023-10-05T11:41:04.151+0000 7fa0ea444880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:04.249 INFO:tasks.workunit.client.0.smithi012.stderr: -333> 2023-10-05T11:41:04.151+0000 7fa0ea444880 20 rados->read ofs=0 len=0 2023-10-05T11:41:04.249 INFO:tasks.workunit.client.0.smithi012.stderr: -332> 2023-10-05T11:41:04.151+0000 7fa0e8be9640 10 monclient: get_auth_request con 0x55f0ca55d800 auth_method 0 2023-10-05T11:41:04.249 INFO:tasks.workunit.client.0.smithi012.stderr: -331> 2023-10-05T11:41:04.152+0000 7fa0ea444880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:41:04.249 INFO:tasks.workunit.client.0.smithi012.stderr: -330> 2023-10-05T11:41:04.152+0000 7fa0ea444880 20 rados->read ofs=0 len=0 2023-10-05T11:41:04.249 INFO:tasks.workunit.client.0.smithi012.stderr: -329> 2023-10-05T11:41:04.152+0000 7fa0e83e8640 10 monclient: get_auth_request con 0x55f0c9a29c00 auth_method 0 2023-10-05T11:41:04.249 INFO:tasks.workunit.client.0.smithi012.stderr: -328> 2023-10-05T11:41:04.152+0000 7fa0ea444880 20 rados_obj.operate() r=0 bl.length=1020 2023-10-05T11:41:04.249 INFO:tasks.workunit.client.0.smithi012.stderr: -327> 2023-10-05T11:41:04.152+0000 7fa0ea444880 20 searching for the correct realm 2023-10-05T11:41:04.249 INFO:tasks.workunit.client.0.smithi012.stderr: -326> 2023-10-05T11:41:04.153+0000 7fa0e93ea640 10 monclient: get_auth_request con 0x55f0c9b1c000 auth_method 0 2023-10-05T11:41:04.249 INFO:tasks.workunit.client.0.smithi012.stderr: -325> 2023-10-05T11:41:04.154+0000 7fa0e8be9640 10 monclient: get_auth_request con 0x55f0c9773400 auth_method 0 2023-10-05T11:41:04.250 INFO:tasks.workunit.client.0.smithi012.stderr: -324> 2023-10-05T11:41:04.154+0000 7fa0e83e8640 10 monclient: get_auth_request con 0x55f0c9b1dc00 auth_method 0 2023-10-05T11:41:04.250 INFO:tasks.workunit.client.0.smithi012.stderr: -323> 2023-10-05T11:41:04.156+0000 7fa0e93ea640 10 monclient: get_auth_request con 0x55f0c9b2c000 auth_method 0 2023-10-05T11:41:04.250 INFO:tasks.workunit.client.0.smithi012.stderr: -322> 2023-10-05T11:41:04.158+0000 7fa0e8be9640 10 monclient: get_auth_request con 0x55f0c9b2c400 auth_method 0 2023-10-05T11:41:04.250 INFO:tasks.workunit.client.0.smithi012.stderr: -321> 2023-10-05T11:41:04.161+0000 7fa0e93ea640 0 -- 172.21.15.12:0/2179683232 >> [v2:172.21.15.12:6824/2171933159,v1:172.21.15.12:6825/2171933159] conn(0x55f0c9b1c000 msgr2=0x55f0c9963700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-10-05T11:41:04.250 INFO:tasks.workunit.client.0.smithi012.stderr: -320> 2023-10-05T11:41:04.161+0000 7fa0e1bdb640 1 client.7140.objecter ms_handle_reset 0x55f0c9b1c000 session 0x55f0c9956d80 osd.3 2023-10-05T11:41:04.250 INFO:tasks.workunit.client.0.smithi012.stderr: -319> 2023-10-05T11:41:04.161+0000 7fa0e1bdb640 10 monclient: _renew_subs 2023-10-05T11:41:04.250 INFO:tasks.workunit.client.0.smithi012.stderr: -318> 2023-10-05T11:41:04.161+0000 7fa0e1bdb640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.12:3300/0 2023-10-05T11:41:04.250 INFO:tasks.workunit.client.0.smithi012.stderr: -317> 2023-10-05T11:41:04.161+0000 7fa0e93ea640 10 monclient: get_auth_request con 0x55f0c9b2d000 auth_method 0 2023-10-05T11:41:04.250 INFO:tasks.workunit.client.0.smithi012.stderr: -316> 2023-10-05T11:41:04.163+0000 7fa0ea444880 20 RGWRados::pool_iterate: got zone_info.dff27d1e-df33-400e-a68a-7ba586947c99 2023-10-05T11:41:04.250 INFO:tasks.workunit.client.0.smithi012.stderr: -315> 2023-10-05T11:41:04.163+0000 7fa0ea444880 20 RGWRados::pool_iterate: got zonegroup_info.c78aa576-9d15-4e9d-b3c0-4af23a22062c 2023-10-05T11:41:04.250 INFO:tasks.workunit.client.0.smithi012.stderr: -314> 2023-10-05T11:41:04.163+0000 7fa0ea444880 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T11:41:04.251 INFO:tasks.workunit.client.0.smithi012.stderr: -313> 2023-10-05T11:41:04.163+0000 7fa0ea444880 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T11:41:04.251 INFO:tasks.workunit.client.0.smithi012.stderr: -312> 2023-10-05T11:41:04.163+0000 7fa0ea444880 20 rados->read ofs=0 len=0 2023-10-05T11:41:04.251 INFO:tasks.workunit.client.0.smithi012.stderr: -311> 2023-10-05T11:41:04.163+0000 7fa0ea444880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:04.251 INFO:tasks.workunit.client.0.smithi012.stderr: -310> 2023-10-05T11:41:04.163+0000 7fa0ea444880 20 rados->read ofs=0 len=0 2023-10-05T11:41:04.251 INFO:tasks.workunit.client.0.smithi012.stderr: -309> 2023-10-05T11:41:04.164+0000 7fa0ea444880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:41:04.251 INFO:tasks.workunit.client.0.smithi012.stderr: -308> 2023-10-05T11:41:04.164+0000 7fa0ea444880 20 rados->read ofs=0 len=0 2023-10-05T11:41:04.251 INFO:tasks.workunit.client.0.smithi012.stderr: -307> 2023-10-05T11:41:04.164+0000 7fa0ea444880 20 rados_obj.operate() r=0 bl.length=454 2023-10-05T11:41:04.251 INFO:tasks.workunit.client.0.smithi012.stderr: -306> 2023-10-05T11:41:04.164+0000 7fa0ea444880 20 zone default found 2023-10-05T11:41:04.251 INFO:tasks.workunit.client.0.smithi012.stderr: -305> 2023-10-05T11:41:04.164+0000 7fa0ea444880 4 Realm: () 2023-10-05T11:41:04.251 INFO:tasks.workunit.client.0.smithi012.stderr: -304> 2023-10-05T11:41:04.164+0000 7fa0ea444880 4 ZoneGroup: default (c78aa576-9d15-4e9d-b3c0-4af23a22062c) 2023-10-05T11:41:04.251 INFO:tasks.workunit.client.0.smithi012.stderr: -303> 2023-10-05T11:41:04.164+0000 7fa0ea444880 4 Zone: default (dff27d1e-df33-400e-a68a-7ba586947c99) 2023-10-05T11:41:04.252 INFO:tasks.workunit.client.0.smithi012.stderr: -302> 2023-10-05T11:41:04.164+0000 7fa0ea444880 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T11:41:04.252 INFO:tasks.workunit.client.0.smithi012.stderr: -301> 2023-10-05T11:41:04.164+0000 7fa0ea444880 20 zonegroup default 2023-10-05T11:41:04.252 INFO:tasks.workunit.client.0.smithi012.stderr: -300> 2023-10-05T11:41:04.164+0000 7fa0ea444880 20 rados->read ofs=0 len=0 2023-10-05T11:41:04.252 INFO:tasks.workunit.client.0.smithi012.stderr: -299> 2023-10-05T11:41:04.164+0000 7fa0ea444880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:04.252 INFO:tasks.workunit.client.0.smithi012.stderr: -298> 2023-10-05T11:41:04.164+0000 7fa0ea444880 20 rados->read ofs=0 len=0 2023-10-05T11:41:04.252 INFO:tasks.workunit.client.0.smithi012.stderr: -297> 2023-10-05T11:41:04.165+0000 7fa0ea444880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:04.252 INFO:tasks.workunit.client.0.smithi012.stderr: -296> 2023-10-05T11:41:04.165+0000 7fa0ea444880 20 rados->read ofs=0 len=0 2023-10-05T11:41:04.252 INFO:tasks.workunit.client.0.smithi012.stderr: -295> 2023-10-05T11:41:04.165+0000 7fa0ea444880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:04.252 INFO:tasks.workunit.client.0.smithi012.stderr: -294> 2023-10-05T11:41:04.165+0000 7fa0ea444880 20 started sync module instance, tier type = 2023-10-05T11:41:04.252 INFO:tasks.workunit.client.0.smithi012.stderr: -293> 2023-10-05T11:41:04.165+0000 7fa0ea444880 20 started zone id=dff27d1e-df33-400e-a68a-7ba586947c99 (name=default) with tier type = 2023-10-05T11:41:04.252 INFO:tasks.workunit.client.0.smithi012.stderr: -292> 2023-10-05T11:41:04.169+0000 7fa0e83e8640 0 -- 172.21.15.12:0/2179683232 >> [v2:172.21.15.170:6824/75773779,v1:172.21.15.170:6825/75773779] conn(0x55f0c9a29c00 msgr2=0x55f0c9963180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:41:04.253 INFO:tasks.workunit.client.0.smithi012.stderr: -291> 2023-10-05T11:41:04.169+0000 7fa0e1bdb640 1 client.7140.objecter ms_handle_reset 0x55f0c9a29c00 session 0x55f0c9956f00 osd.7 2023-10-05T11:41:04.253 INFO:tasks.workunit.client.0.smithi012.stderr: -290> 2023-10-05T11:41:04.169+0000 7fa0e83e8640 10 monclient: get_auth_request con 0x55f0c9b1c000 auth_method 0 2023-10-05T11:41:04.253 INFO:tasks.workunit.client.0.smithi012.stderr: -289> 2023-10-05T11:41:04.174+0000 7fa0ea444880 20 add_watcher() i=0 2023-10-05T11:41:04.253 INFO:tasks.workunit.client.0.smithi012.stderr: -288> 2023-10-05T11:41:04.174+0000 7fa0ea444880 20 add_watcher() i=1 2023-10-05T11:41:04.253 INFO:tasks.workunit.client.0.smithi012.stderr: -287> 2023-10-05T11:41:04.174+0000 7fa0ea444880 20 add_watcher() i=2 2023-10-05T11:41:04.253 INFO:tasks.workunit.client.0.smithi012.stderr: -286> 2023-10-05T11:41:04.174+0000 7fa0ea444880 20 add_watcher() i=3 2023-10-05T11:41:04.253 INFO:tasks.workunit.client.0.smithi012.stderr: -285> 2023-10-05T11:41:04.174+0000 7fa0ea444880 20 add_watcher() i=4 2023-10-05T11:41:04.253 INFO:tasks.workunit.client.0.smithi012.stderr: -284> 2023-10-05T11:41:04.174+0000 7fa0ea444880 20 add_watcher() i=5 2023-10-05T11:41:04.253 INFO:tasks.workunit.client.0.smithi012.stderr: -283> 2023-10-05T11:41:04.174+0000 7fa0ea444880 20 add_watcher() i=6 2023-10-05T11:41:04.253 INFO:tasks.workunit.client.0.smithi012.stderr: -282> 2023-10-05T11:41:04.175+0000 7fa0ea444880 20 add_watcher() i=7 2023-10-05T11:41:04.253 INFO:tasks.workunit.client.0.smithi012.stderr: -281> 2023-10-05T11:41:04.175+0000 7fa0ea444880 2 all 8 watchers are set, enabling cache 2023-10-05T11:41:04.253 INFO:tasks.workunit.client.0.smithi012.stderr: -280> 2023-10-05T11:41:04.176+0000 7fa0ea444880 5 AuthRegistry(0x7ffdbe4c7b30) adding auth protocol: cephx 2023-10-05T11:41:04.254 INFO:tasks.workunit.client.0.smithi012.stderr: -279> 2023-10-05T11:41:04.176+0000 7fa0ea444880 5 AuthRegistry(0x7ffdbe4c7b30) adding auth protocol: cephx 2023-10-05T11:41:04.254 INFO:tasks.workunit.client.0.smithi012.stderr: -278> 2023-10-05T11:41:04.176+0000 7fa0ea444880 5 AuthRegistry(0x7ffdbe4c7b30) adding auth protocol: cephx 2023-10-05T11:41:04.254 INFO:tasks.workunit.client.0.smithi012.stderr: -277> 2023-10-05T11:41:04.176+0000 7fa0ea444880 5 AuthRegistry(0x7ffdbe4c7b30) adding con mode: secure 2023-10-05T11:41:04.254 INFO:tasks.workunit.client.0.smithi012.stderr: -276> 2023-10-05T11:41:04.176+0000 7fa0ea444880 5 AuthRegistry(0x7ffdbe4c7b30) adding con mode: crc 2023-10-05T11:41:04.254 INFO:tasks.workunit.client.0.smithi012.stderr: -275> 2023-10-05T11:41:04.176+0000 7fa0ea444880 5 AuthRegistry(0x7ffdbe4c7b30) adding con mode: secure 2023-10-05T11:41:04.254 INFO:tasks.workunit.client.0.smithi012.stderr: -274> 2023-10-05T11:41:04.176+0000 7fa0ea444880 5 AuthRegistry(0x7ffdbe4c7b30) adding con mode: crc 2023-10-05T11:41:04.254 INFO:tasks.workunit.client.0.smithi012.stderr: -273> 2023-10-05T11:41:04.176+0000 7fa0ea444880 5 AuthRegistry(0x7ffdbe4c7b30) adding con mode: secure 2023-10-05T11:41:04.254 INFO:tasks.workunit.client.0.smithi012.stderr: -272> 2023-10-05T11:41:04.176+0000 7fa0cfbb7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:41:04.254 INFO:tasks.workunit.client.0.smithi012.stderr: -271> 2023-10-05T11:41:04.176+0000 7fa0ea444880 5 AuthRegistry(0x7ffdbe4c7b30) adding con mode: crc 2023-10-05T11:41:04.254 INFO:tasks.workunit.client.0.smithi012.stderr: -270> 2023-10-05T11:41:04.176+0000 7fa0ea444880 5 AuthRegistry(0x7ffdbe4c7b30) adding con mode: crc 2023-10-05T11:41:04.254 INFO:tasks.workunit.client.0.smithi012.stderr: -269> 2023-10-05T11:41:04.176+0000 7fa0ea444880 5 AuthRegistry(0x7ffdbe4c7b30) adding con mode: secure 2023-10-05T11:41:04.255 INFO:tasks.workunit.client.0.smithi012.stderr: -268> 2023-10-05T11:41:04.176+0000 7fa0ea444880 5 AuthRegistry(0x7ffdbe4c7b30) adding con mode: crc 2023-10-05T11:41:04.255 INFO:tasks.workunit.client.0.smithi012.stderr: -267> 2023-10-05T11:41:04.176+0000 7fa0ea444880 5 AuthRegistry(0x7ffdbe4c7b30) adding con mode: secure 2023-10-05T11:41:04.255 INFO:tasks.workunit.client.0.smithi012.stderr: -266> 2023-10-05T11:41:04.176+0000 7fa0ea444880 5 AuthRegistry(0x7ffdbe4c7b30) adding con mode: crc 2023-10-05T11:41:04.255 INFO:tasks.workunit.client.0.smithi012.stderr: -265> 2023-10-05T11:41:04.176+0000 7fa0ea444880 5 AuthRegistry(0x7ffdbe4c7b30) adding con mode: secure 2023-10-05T11:41:04.255 INFO:tasks.workunit.client.0.smithi012.stderr: -264> 2023-10-05T11:41:04.177+0000 7fa0ea444880 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-10-05T11:41:04.255 INFO:tasks.workunit.client.0.smithi012.stderr: -263> 2023-10-05T11:41:04.177+0000 7fa0ea444880 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T11:41:04.255 INFO:tasks.workunit.client.0.smithi012.stderr: -262> 2023-10-05T11:41:04.177+0000 7fa0ea444880 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T11:41:04.255 INFO:tasks.workunit.client.0.smithi012.stderr: -261> 2023-10-05T11:41:04.177+0000 7fa0ea444880 5 asok(0x55f0c995c000) register_command cache list hook 0x55f0c970b470 2023-10-05T11:41:04.255 INFO:tasks.workunit.client.0.smithi012.stderr: -260> 2023-10-05T11:41:04.177+0000 7fa0ea444880 5 asok(0x55f0c995c000) register_command cache inspect hook 0x55f0c970b470 2023-10-05T11:41:04.255 INFO:tasks.workunit.client.0.smithi012.stderr: -259> 2023-10-05T11:41:04.177+0000 7fa0ea444880 5 asok(0x55f0c995c000) register_command cache erase hook 0x55f0c970b470 2023-10-05T11:41:04.255 INFO:tasks.workunit.client.0.smithi012.stderr: -258> 2023-10-05T11:41:04.177+0000 7fa0ea444880 5 asok(0x55f0c995c000) register_command cache zap hook 0x55f0c970b470 2023-10-05T11:41:04.256 INFO:tasks.workunit.client.0.smithi012.stderr: -257> 2023-10-05T11:41:04.177+0000 7fa0ea444880 10 monclient: get_monmap_and_config 2023-10-05T11:41:04.256 INFO:tasks.workunit.client.0.smithi012.stderr: -256> 2023-10-05T11:41:04.177+0000 7fa0ea444880 10 monclient: build_initial_monmap 2023-10-05T11:41:04.256 INFO:tasks.workunit.client.0.smithi012.stderr: -255> 2023-10-05T11:41:04.177+0000 7fa0ea444880 1 build_initial for_mkfs: 0 2023-10-05T11:41:04.256 INFO:tasks.workunit.client.0.smithi012.stderr: -254> 2023-10-05T11:41:04.177+0000 7fa0ea444880 10 monclient: monmap: 2023-10-05T11:41:04.256 INFO:tasks.workunit.client.0.smithi012.stderr:epoch 0 2023-10-05T11:41:04.256 INFO:tasks.workunit.client.0.smithi012.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-10-05T11:41:04.256 INFO:tasks.workunit.client.0.smithi012.stderr:last_changed 0.000000 2023-10-05T11:41:04.256 INFO:tasks.workunit.client.0.smithi012.stderr:created 0.000000 2023-10-05T11:41:04.256 INFO:tasks.workunit.client.0.smithi012.stderr:min_mon_release 0 (unknown) 2023-10-05T11:41:04.256 INFO:tasks.workunit.client.0.smithi012.stderr:election_strategy: 1 2023-10-05T11:41:04.256 INFO:tasks.workunit.client.0.smithi012.stderr:0: [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon.noname-a 2023-10-05T11:41:04.257 INFO:tasks.workunit.client.0.smithi012.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.noname-b 2023-10-05T11:41:04.257 INFO:tasks.workunit.client.0.smithi012.stderr:2: [v2:172.21.15.12:3301/0,v1:172.21.15.12:6790/0] mon.noname-c 2023-10-05T11:41:04.257 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:41:04.257 INFO:tasks.workunit.client.0.smithi012.stderr: -253> 2023-10-05T11:41:04.177+0000 7fa0ea444880 5 AuthRegistry(0x55f0ca40dc40) adding auth protocol: cephx 2023-10-05T11:41:04.257 INFO:tasks.workunit.client.0.smithi012.stderr: -252> 2023-10-05T11:41:04.177+0000 7fa0ea444880 5 AuthRegistry(0x55f0ca40dc40) adding auth protocol: cephx 2023-10-05T11:41:04.257 INFO:tasks.workunit.client.0.smithi012.stderr: -251> 2023-10-05T11:41:04.177+0000 7fa0ea444880 5 AuthRegistry(0x55f0ca40dc40) adding auth protocol: cephx 2023-10-05T11:41:04.257 INFO:tasks.workunit.client.0.smithi012.stderr: -250> 2023-10-05T11:41:04.177+0000 7fa0ea444880 5 AuthRegistry(0x55f0ca40dc40) adding con mode: secure 2023-10-05T11:41:04.257 INFO:tasks.workunit.client.0.smithi012.stderr: -249> 2023-10-05T11:41:04.177+0000 7fa0ea444880 5 AuthRegistry(0x55f0ca40dc40) adding con mode: crc 2023-10-05T11:41:04.257 INFO:tasks.workunit.client.0.smithi012.stderr: -248> 2023-10-05T11:41:04.177+0000 7fa0ea444880 5 AuthRegistry(0x55f0ca40dc40) adding con mode: secure 2023-10-05T11:41:04.257 INFO:tasks.workunit.client.0.smithi012.stderr: -247> 2023-10-05T11:41:04.177+0000 7fa0ea444880 5 AuthRegistry(0x55f0ca40dc40) adding con mode: crc 2023-10-05T11:41:04.257 INFO:tasks.workunit.client.0.smithi012.stderr: -246> 2023-10-05T11:41:04.177+0000 7fa0ea444880 5 AuthRegistry(0x55f0ca40dc40) adding con mode: secure 2023-10-05T11:41:04.257 INFO:tasks.workunit.client.0.smithi012.stderr: -245> 2023-10-05T11:41:04.177+0000 7fa0ea444880 5 AuthRegistry(0x55f0ca40dc40) adding con mode: crc 2023-10-05T11:41:04.258 INFO:tasks.workunit.client.0.smithi012.stderr: -244> 2023-10-05T11:41:04.177+0000 7fa0ea444880 5 AuthRegistry(0x55f0ca40dc40) adding con mode: crc 2023-10-05T11:41:04.258 INFO:tasks.workunit.client.0.smithi012.stderr: -243> 2023-10-05T11:41:04.177+0000 7fa0ea444880 5 AuthRegistry(0x55f0ca40dc40) adding con mode: secure 2023-10-05T11:41:04.258 INFO:tasks.workunit.client.0.smithi012.stderr: -242> 2023-10-05T11:41:04.177+0000 7fa0ea444880 5 AuthRegistry(0x55f0ca40dc40) adding con mode: crc 2023-10-05T11:41:04.258 INFO:tasks.workunit.client.0.smithi012.stderr: -241> 2023-10-05T11:41:04.177+0000 7fa0ea444880 5 AuthRegistry(0x55f0ca40dc40) adding con mode: secure 2023-10-05T11:41:04.258 INFO:tasks.workunit.client.0.smithi012.stderr: -240> 2023-10-05T11:41:04.177+0000 7fa0ea444880 5 AuthRegistry(0x55f0ca40dc40) adding con mode: crc 2023-10-05T11:41:04.258 INFO:tasks.workunit.client.0.smithi012.stderr: -239> 2023-10-05T11:41:04.177+0000 7fa0ea444880 5 AuthRegistry(0x55f0ca40dc40) adding con mode: secure 2023-10-05T11:41:04.258 INFO:tasks.workunit.client.0.smithi012.stderr: -238> 2023-10-05T11:41:04.177+0000 7fa0ea444880 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-10-05T11:41:04.258 INFO:tasks.workunit.client.0.smithi012.stderr: -237> 2023-10-05T11:41:04.177+0000 7fa0ea444880 10 monclient: init 2023-10-05T11:41:04.258 INFO:tasks.workunit.client.0.smithi012.stderr: -236> 2023-10-05T11:41:04.177+0000 7fa0ea444880 5 AuthRegistry(0x7ffdbe4c7680) adding auth protocol: cephx 2023-10-05T11:41:04.258 INFO:tasks.workunit.client.0.smithi012.stderr: -235> 2023-10-05T11:41:04.177+0000 7fa0ea444880 5 AuthRegistry(0x7ffdbe4c7680) adding auth protocol: cephx 2023-10-05T11:41:04.258 INFO:tasks.workunit.client.0.smithi012.stderr: -234> 2023-10-05T11:41:04.177+0000 7fa0ea444880 5 AuthRegistry(0x7ffdbe4c7680) adding auth protocol: cephx 2023-10-05T11:41:04.259 INFO:tasks.workunit.client.0.smithi012.stderr: -233> 2023-10-05T11:41:04.177+0000 7fa0ea444880 5 AuthRegistry(0x7ffdbe4c7680) adding con mode: secure 2023-10-05T11:41:04.259 INFO:tasks.workunit.client.0.smithi012.stderr: -232> 2023-10-05T11:41:04.177+0000 7fa0ea444880 5 AuthRegistry(0x7ffdbe4c7680) adding con mode: crc 2023-10-05T11:41:04.259 INFO:tasks.workunit.client.0.smithi012.stderr: -231> 2023-10-05T11:41:04.177+0000 7fa0ea444880 5 AuthRegistry(0x7ffdbe4c7680) adding con mode: secure 2023-10-05T11:41:04.259 INFO:tasks.workunit.client.0.smithi012.stderr: -230> 2023-10-05T11:41:04.177+0000 7fa0ea444880 5 AuthRegistry(0x7ffdbe4c7680) adding con mode: crc 2023-10-05T11:41:04.259 INFO:tasks.workunit.client.0.smithi012.stderr: -229> 2023-10-05T11:41:04.177+0000 7fa0ea444880 5 AuthRegistry(0x7ffdbe4c7680) adding con mode: secure 2023-10-05T11:41:04.259 INFO:tasks.workunit.client.0.smithi012.stderr: -228> 2023-10-05T11:41:04.177+0000 7fa0ea444880 5 AuthRegistry(0x7ffdbe4c7680) adding con mode: crc 2023-10-05T11:41:04.259 INFO:tasks.workunit.client.0.smithi012.stderr: -227> 2023-10-05T11:41:04.177+0000 7fa0ea444880 5 AuthRegistry(0x7ffdbe4c7680) adding con mode: crc 2023-10-05T11:41:04.259 INFO:tasks.workunit.client.0.smithi012.stderr: -226> 2023-10-05T11:41:04.177+0000 7fa0ea444880 5 AuthRegistry(0x7ffdbe4c7680) adding con mode: secure 2023-10-05T11:41:04.259 INFO:tasks.workunit.client.0.smithi012.stderr: -225> 2023-10-05T11:41:04.177+0000 7fa0ea444880 5 AuthRegistry(0x7ffdbe4c7680) adding con mode: crc 2023-10-05T11:41:04.259 INFO:tasks.workunit.client.0.smithi012.stderr: -224> 2023-10-05T11:41:04.177+0000 7fa0ea444880 5 AuthRegistry(0x7ffdbe4c7680) adding con mode: secure 2023-10-05T11:41:04.259 INFO:tasks.workunit.client.0.smithi012.stderr: -223> 2023-10-05T11:41:04.177+0000 7fa0ea444880 5 AuthRegistry(0x7ffdbe4c7680) adding con mode: crc 2023-10-05T11:41:04.259 INFO:tasks.workunit.client.0.smithi012.stderr: -222> 2023-10-05T11:41:04.177+0000 7fa0ea444880 5 AuthRegistry(0x7ffdbe4c7680) adding con mode: secure 2023-10-05T11:41:04.260 INFO:tasks.workunit.client.0.smithi012.stderr: -221> 2023-10-05T11:41:04.177+0000 7fa0ea444880 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-10-05T11:41:04.260 INFO:tasks.workunit.client.0.smithi012.stderr: -220> 2023-10-05T11:41:04.177+0000 7fa0ea444880 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-10-05T11:41:04.260 INFO:tasks.workunit.client.0.smithi012.stderr: -219> 2023-10-05T11:41:04.177+0000 7fa0ea444880 5 asok(0x55f0c995c000) register_command rotate-key cmddesc rotate-key hook 0x7ffdbe4c77c8 EEXIST 2023-10-05T11:41:04.260 INFO:tasks.workunit.client.0.smithi012.stderr: -218> 2023-10-05T11:41:04.177+0000 7fa0ea444880 10 monclient: _reopen_session rank -1 2023-10-05T11:41:04.260 INFO:tasks.workunit.client.0.smithi012.stderr: -217> 2023-10-05T11:41:04.177+0000 7fa0ea444880 10 monclient: _add_conns ranks=[1,2,0] 2023-10-05T11:41:04.260 INFO:tasks.workunit.client.0.smithi012.stderr: -216> 2023-10-05T11:41:04.178+0000 7fa0ea444880 10 monclient(hunting): picked mon.noname-b con 0x55f0c9b3a800 addr [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] 2023-10-05T11:41:04.260 INFO:tasks.workunit.client.0.smithi012.stderr: -215> 2023-10-05T11:41:04.178+0000 7fa0ea444880 10 monclient(hunting): picked mon.noname-c con 0x55f0c9b3ac00 addr [v2:172.21.15.12:3301/0,v1:172.21.15.12:6790/0] 2023-10-05T11:41:04.260 INFO:tasks.workunit.client.0.smithi012.stderr: -214> 2023-10-05T11:41:04.178+0000 7fa0ea444880 10 monclient(hunting): picked mon.noname-a con 0x55f0c9b3b000 addr [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] 2023-10-05T11:41:04.260 INFO:tasks.workunit.client.0.smithi012.stderr: -213> 2023-10-05T11:41:04.178+0000 7fa0ea444880 10 monclient(hunting): start opening mon connection 2023-10-05T11:41:04.260 INFO:tasks.workunit.client.0.smithi012.stderr: -212> 2023-10-05T11:41:04.178+0000 7fa0ea444880 10 monclient(hunting): start opening mon connection 2023-10-05T11:41:04.260 INFO:tasks.workunit.client.0.smithi012.stderr: -211> 2023-10-05T11:41:04.178+0000 7fa0ea444880 10 monclient(hunting): start opening mon connection 2023-10-05T11:41:04.260 INFO:tasks.workunit.client.0.smithi012.stderr: -210> 2023-10-05T11:41:04.178+0000 7fa0ea444880 10 monclient(hunting): _renew_subs 2023-10-05T11:41:04.260 INFO:tasks.workunit.client.0.smithi012.stderr: -209> 2023-10-05T11:41:04.178+0000 7fa0ea444880 10 monclient(hunting): authenticate will time out at 1572.346477s 2023-10-05T11:41:04.261 INFO:tasks.workunit.client.0.smithi012.stderr: -208> 2023-10-05T11:41:04.178+0000 7fa0e83e8640 10 monclient(hunting): get_auth_request con 0x55f0c9b3b000 auth_method 0 2023-10-05T11:41:04.261 INFO:tasks.workunit.client.0.smithi012.stderr: -207> 2023-10-05T11:41:04.178+0000 7fa0e83e8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-10-05T11:41:04.261 INFO:tasks.workunit.client.0.smithi012.stderr: -206> 2023-10-05T11:41:04.178+0000 7fa0e83e8640 10 monclient(hunting): _init_auth method 2 2023-10-05T11:41:04.261 INFO:tasks.workunit.client.0.smithi012.stderr: -205> 2023-10-05T11:41:04.178+0000 7fa0e83e8640 10 monclient(hunting): _init_auth creating new auth 2023-10-05T11:41:04.261 INFO:tasks.workunit.client.0.smithi012.stderr: -204> 2023-10-05T11:41:04.178+0000 7fa0e8be9640 10 monclient(hunting): get_auth_request con 0x55f0c9b3ac00 auth_method 0 2023-10-05T11:41:04.261 INFO:tasks.workunit.client.0.smithi012.stderr: -203> 2023-10-05T11:41:04.178+0000 7fa0e8be9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-10-05T11:41:04.261 INFO:tasks.workunit.client.0.smithi012.stderr: -202> 2023-10-05T11:41:04.178+0000 7fa0e8be9640 10 monclient(hunting): _init_auth method 2 2023-10-05T11:41:04.261 INFO:tasks.workunit.client.0.smithi012.stderr: -201> 2023-10-05T11:41:04.178+0000 7fa0e8be9640 10 monclient(hunting): _init_auth creating new auth 2023-10-05T11:41:04.261 INFO:tasks.workunit.client.0.smithi012.stderr: -200> 2023-10-05T11:41:04.178+0000 7fa0e93ea640 10 monclient(hunting): get_auth_request con 0x55f0c9b3a800 auth_method 0 2023-10-05T11:41:04.261 INFO:tasks.workunit.client.0.smithi012.stderr: -199> 2023-10-05T11:41:04.178+0000 7fa0e93ea640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-10-05T11:41:04.261 INFO:tasks.workunit.client.0.smithi012.stderr: -198> 2023-10-05T11:41:04.178+0000 7fa0e93ea640 10 monclient(hunting): _init_auth method 2 2023-10-05T11:41:04.261 INFO:tasks.workunit.client.0.smithi012.stderr: -197> 2023-10-05T11:41:04.178+0000 7fa0e93ea640 10 monclient(hunting): _init_auth creating new auth 2023-10-05T11:41:04.262 INFO:tasks.workunit.client.0.smithi012.stderr: -196> 2023-10-05T11:41:04.178+0000 7fa0e83e8640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-10-05T11:41:04.262 INFO:tasks.workunit.client.0.smithi012.stderr: -195> 2023-10-05T11:41:04.178+0000 7fa0e83e8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-10-05T11:41:04.262 INFO:tasks.workunit.client.0.smithi012.stderr: -194> 2023-10-05T11:41:04.178+0000 7fa0e83e8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-10-05T11:41:04.262 INFO:tasks.workunit.client.0.smithi012.stderr: -193> 2023-10-05T11:41:04.178+0000 7fa0e8be9640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-10-05T11:41:04.262 INFO:tasks.workunit.client.0.smithi012.stderr: -192> 2023-10-05T11:41:04.178+0000 7fa0e8be9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-10-05T11:41:04.262 INFO:tasks.workunit.client.0.smithi012.stderr: -191> 2023-10-05T11:41:04.178+0000 7fa0e8be9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-10-05T11:41:04.262 INFO:tasks.workunit.client.0.smithi012.stderr: -190> 2023-10-05T11:41:04.178+0000 7fa0e93ea640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-10-05T11:41:04.262 INFO:tasks.workunit.client.0.smithi012.stderr: -189> 2023-10-05T11:41:04.178+0000 7fa0e93ea640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-10-05T11:41:04.262 INFO:tasks.workunit.client.0.smithi012.stderr: -188> 2023-10-05T11:41:04.178+0000 7fa0e93ea640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-10-05T11:41:04.263 INFO:tasks.workunit.client.0.smithi012.stderr: -187> 2023-10-05T11:41:04.178+0000 7fa0e83e8640 10 monclient(hunting): handle_auth_done global_id 7143 payload 274 2023-10-05T11:41:04.263 INFO:tasks.workunit.client.0.smithi012.stderr: -186> 2023-10-05T11:41:04.178+0000 7fa0e83e8640 10 monclient: _finish_hunting 0 2023-10-05T11:41:04.263 INFO:tasks.workunit.client.0.smithi012.stderr: -185> 2023-10-05T11:41:04.178+0000 7fa0e83e8640 1 monclient: found mon.noname-a 2023-10-05T11:41:04.263 INFO:tasks.workunit.client.0.smithi012.stderr: -184> 2023-10-05T11:41:04.178+0000 7fa0e83e8640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.12:3300/0 2023-10-05T11:41:04.263 INFO:tasks.workunit.client.0.smithi012.stderr: -183> 2023-10-05T11:41:04.178+0000 7fa0cf3b6640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-10-05T11:41:04.263 INFO:tasks.workunit.client.0.smithi012.stderr: -182> 2023-10-05T11:41:04.178+0000 7fa0cf3b6640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2023-10-05T11:41:04.263 INFO:tasks.workunit.client.0.smithi012.stderr: -181> 2023-10-05T11:41:04.178+0000 7fa0cf3b6640 10 monclient: dump: 2023-10-05T11:41:04.263 INFO:tasks.workunit.client.0.smithi012.stderr:epoch 1 2023-10-05T11:41:04.263 INFO:tasks.workunit.client.0.smithi012.stderr:fsid 7e015f46-293b-4b09-bd32-7d32b52f6e2f 2023-10-05T11:41:04.263 INFO:tasks.workunit.client.0.smithi012.stderr:last_changed 2023-10-05T11:27:38.366888+0000 2023-10-05T11:41:04.263 INFO:tasks.workunit.client.0.smithi012.stderr:created 2023-10-05T11:27:38.366888+0000 2023-10-05T11:41:04.263 INFO:tasks.workunit.client.0.smithi012.stderr:min_mon_release 18 (reef) 2023-10-05T11:41:04.263 INFO:tasks.workunit.client.0.smithi012.stderr:election_strategy: 1 2023-10-05T11:41:04.264 INFO:tasks.workunit.client.0.smithi012.stderr:0: [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon.a 2023-10-05T11:41:04.264 INFO:tasks.workunit.client.0.smithi012.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2023-10-05T11:41:04.264 INFO:tasks.workunit.client.0.smithi012.stderr:2: [v2:172.21.15.12:3301/0,v1:172.21.15.12:6790/0] mon.c 2023-10-05T11:41:04.264 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:41:04.264 INFO:tasks.workunit.client.0.smithi012.stderr: -180> 2023-10-05T11:41:04.178+0000 7fa0cf3b6640 10 monclient: _finish_auth 0 2023-10-05T11:41:04.264 INFO:tasks.workunit.client.0.smithi012.stderr: -179> 2023-10-05T11:41:04.178+0000 7fa0cf3b6640 10 monclient: _check_auth_tickets 2023-10-05T11:41:04.264 INFO:tasks.workunit.client.0.smithi012.stderr: -178> 2023-10-05T11:41:04.178+0000 7fa0cf3b6640 10 monclient: handle_config config(0 keys) v1 2023-10-05T11:41:04.264 INFO:tasks.workunit.client.0.smithi012.stderr: -177> 2023-10-05T11:41:04.178+0000 7fa0cf3b6640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-10-05T11:41:04.264 INFO:tasks.workunit.client.0.smithi012.stderr: -176> 2023-10-05T11:41:04.178+0000 7fa0cf3b6640 10 monclient: got monmap 1 from mon.a (according to old e1) 2023-10-05T11:41:04.264 INFO:tasks.workunit.client.0.smithi012.stderr: -175> 2023-10-05T11:41:04.178+0000 7fa0cf3b6640 10 monclient: dump: 2023-10-05T11:41:04.264 INFO:tasks.workunit.client.0.smithi012.stderr:epoch 1 2023-10-05T11:41:04.264 INFO:tasks.workunit.client.0.smithi012.stderr:fsid 7e015f46-293b-4b09-bd32-7d32b52f6e2f 2023-10-05T11:41:04.264 INFO:tasks.workunit.client.0.smithi012.stderr:last_changed 2023-10-05T11:27:38.366888+0000 2023-10-05T11:41:04.265 INFO:tasks.workunit.client.0.smithi012.stderr:created 2023-10-05T11:27:38.366888+0000 2023-10-05T11:41:04.265 INFO:tasks.workunit.client.0.smithi012.stderr:min_mon_release 18 (reef) 2023-10-05T11:41:04.265 INFO:tasks.workunit.client.0.smithi012.stderr:election_strategy: 1 2023-10-05T11:41:04.265 INFO:tasks.workunit.client.0.smithi012.stderr:0: [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon.a 2023-10-05T11:41:04.265 INFO:tasks.workunit.client.0.smithi012.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2023-10-05T11:41:04.265 INFO:tasks.workunit.client.0.smithi012.stderr:2: [v2:172.21.15.12:3301/0,v1:172.21.15.12:6790/0] mon.c 2023-10-05T11:41:04.265 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:41:04.265 INFO:tasks.workunit.client.0.smithi012.stderr: -174> 2023-10-05T11:41:04.178+0000 7fa0ea444880 5 monclient: authenticate success, global_id 7143 2023-10-05T11:41:04.265 INFO:tasks.workunit.client.0.smithi012.stderr: -173> 2023-10-05T11:41:04.178+0000 7fa0ea444880 10 monclient: get_monmap_and_config success 2023-10-05T11:41:04.265 INFO:tasks.workunit.client.0.smithi012.stderr: -172> 2023-10-05T11:41:04.178+0000 7fa0ea444880 4 set_mon_vals no callback set 2023-10-05T11:41:04.265 INFO:tasks.workunit.client.0.smithi012.stderr: -171> 2023-10-05T11:41:04.179+0000 7fa0ea444880 10 monclient: shutdown 2023-10-05T11:41:04.265 INFO:tasks.workunit.client.0.smithi012.stderr: -170> 2023-10-05T11:41:04.179+0000 7fa0ea444880 10 monclient: build_initial_monmap 2023-10-05T11:41:04.266 INFO:tasks.workunit.client.0.smithi012.stderr: -169> 2023-10-05T11:41:04.179+0000 7fa0ea444880 1 build_initial for_mkfs: 0 2023-10-05T11:41:04.266 INFO:tasks.workunit.client.0.smithi012.stderr: -168> 2023-10-05T11:41:04.179+0000 7fa0ea444880 10 monclient: monmap: 2023-10-05T11:41:04.266 INFO:tasks.workunit.client.0.smithi012.stderr:epoch 0 2023-10-05T11:41:04.266 INFO:tasks.workunit.client.0.smithi012.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-10-05T11:41:04.266 INFO:tasks.workunit.client.0.smithi012.stderr:last_changed 0.000000 2023-10-05T11:41:04.266 INFO:tasks.workunit.client.0.smithi012.stderr:created 0.000000 2023-10-05T11:41:04.266 INFO:tasks.workunit.client.0.smithi012.stderr:min_mon_release 0 (unknown) 2023-10-05T11:41:04.266 INFO:tasks.workunit.client.0.smithi012.stderr:election_strategy: 1 2023-10-05T11:41:04.266 INFO:tasks.workunit.client.0.smithi012.stderr:0: [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon.noname-a 2023-10-05T11:41:04.267 INFO:tasks.workunit.client.0.smithi012.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.noname-b 2023-10-05T11:41:04.267 INFO:tasks.workunit.client.0.smithi012.stderr:2: [v2:172.21.15.12:3301/0,v1:172.21.15.12:6790/0] mon.noname-c 2023-10-05T11:41:04.267 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:41:04.267 INFO:tasks.workunit.client.0.smithi012.stderr: -167> 2023-10-05T11:41:04.179+0000 7fa0ea444880 5 AuthRegistry(0x55f0ca40dc40) adding auth protocol: cephx 2023-10-05T11:41:04.267 INFO:tasks.workunit.client.0.smithi012.stderr: -166> 2023-10-05T11:41:04.179+0000 7fa0ea444880 5 AuthRegistry(0x55f0ca40dc40) adding auth protocol: cephx 2023-10-05T11:41:04.267 INFO:tasks.workunit.client.0.smithi012.stderr: -165> 2023-10-05T11:41:04.179+0000 7fa0ea444880 5 AuthRegistry(0x55f0ca40dc40) adding auth protocol: cephx 2023-10-05T11:41:04.267 INFO:tasks.workunit.client.0.smithi012.stderr: -164> 2023-10-05T11:41:04.179+0000 7fa0ea444880 5 AuthRegistry(0x55f0ca40dc40) adding con mode: secure 2023-10-05T11:41:04.267 INFO:tasks.workunit.client.0.smithi012.stderr: -163> 2023-10-05T11:41:04.179+0000 7fa0ea444880 5 AuthRegistry(0x55f0ca40dc40) adding con mode: crc 2023-10-05T11:41:04.267 INFO:tasks.workunit.client.0.smithi012.stderr: -162> 2023-10-05T11:41:04.179+0000 7fa0ea444880 5 AuthRegistry(0x55f0ca40dc40) adding con mode: secure 2023-10-05T11:41:04.267 INFO:tasks.workunit.client.0.smithi012.stderr: -161> 2023-10-05T11:41:04.179+0000 7fa0ea444880 5 AuthRegistry(0x55f0ca40dc40) adding con mode: crc 2023-10-05T11:41:04.267 INFO:tasks.workunit.client.0.smithi012.stderr: -160> 2023-10-05T11:41:04.179+0000 7fa0ea444880 5 AuthRegistry(0x55f0ca40dc40) adding con mode: secure 2023-10-05T11:41:04.267 INFO:tasks.workunit.client.0.smithi012.stderr: -159> 2023-10-05T11:41:04.179+0000 7fa0ea444880 5 AuthRegistry(0x55f0ca40dc40) adding con mode: crc 2023-10-05T11:41:04.268 INFO:tasks.workunit.client.0.smithi012.stderr: -158> 2023-10-05T11:41:04.179+0000 7fa0ea444880 5 AuthRegistry(0x55f0ca40dc40) adding con mode: crc 2023-10-05T11:41:04.268 INFO:tasks.workunit.client.0.smithi012.stderr: -157> 2023-10-05T11:41:04.179+0000 7fa0ea444880 5 AuthRegistry(0x55f0ca40dc40) adding con mode: secure 2023-10-05T11:41:04.268 INFO:tasks.workunit.client.0.smithi012.stderr: -156> 2023-10-05T11:41:04.179+0000 7fa0ea444880 5 AuthRegistry(0x55f0ca40dc40) adding con mode: crc 2023-10-05T11:41:04.268 INFO:tasks.workunit.client.0.smithi012.stderr: -155> 2023-10-05T11:41:04.179+0000 7fa0ea444880 5 AuthRegistry(0x55f0ca40dc40) adding con mode: secure 2023-10-05T11:41:04.268 INFO:tasks.workunit.client.0.smithi012.stderr: -154> 2023-10-05T11:41:04.179+0000 7fa0ea444880 5 AuthRegistry(0x55f0ca40dc40) adding con mode: crc 2023-10-05T11:41:04.268 INFO:tasks.workunit.client.0.smithi012.stderr: -153> 2023-10-05T11:41:04.179+0000 7fa0ea444880 5 AuthRegistry(0x55f0ca40dc40) adding con mode: secure 2023-10-05T11:41:04.268 INFO:tasks.workunit.client.0.smithi012.stderr: -152> 2023-10-05T11:41:04.179+0000 7fa0ea444880 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-10-05T11:41:04.268 INFO:tasks.workunit.client.0.smithi012.stderr: -151> 2023-10-05T11:41:04.179+0000 7fa0ea444880 1 librados: starting msgr at 2023-10-05T11:41:04.268 INFO:tasks.workunit.client.0.smithi012.stderr: -150> 2023-10-05T11:41:04.179+0000 7fa0ea444880 1 librados: starting objecter 2023-10-05T11:41:04.268 INFO:tasks.workunit.client.0.smithi012.stderr: -149> 2023-10-05T11:41:04.180+0000 7fa0ea444880 5 asok(0x55f0c995c000) register_command objecter_requests cmddesc objecter_requests hook 0x55f0c970bb80 EEXIST 2023-10-05T11:41:04.268 INFO:tasks.workunit.client.0.smithi012.stderr: -148> 2023-10-05T11:41:04.180+0000 7fa0ea444880 1 librados: setting wanted keys 2023-10-05T11:41:04.268 INFO:tasks.workunit.client.0.smithi012.stderr: -147> 2023-10-05T11:41:04.180+0000 7fa0ea444880 1 librados: calling monclient init 2023-10-05T11:41:04.269 INFO:tasks.workunit.client.0.smithi012.stderr: -146> 2023-10-05T11:41:04.180+0000 7fa0ea444880 10 monclient: init 2023-10-05T11:41:04.269 INFO:tasks.workunit.client.0.smithi012.stderr: -145> 2023-10-05T11:41:04.180+0000 7fa0ea444880 5 AuthRegistry(0x55f0c9b570d8) adding auth protocol: cephx 2023-10-05T11:41:04.269 INFO:tasks.workunit.client.0.smithi012.stderr: -144> 2023-10-05T11:41:04.180+0000 7fa0ea444880 5 AuthRegistry(0x55f0c9b570d8) adding auth protocol: cephx 2023-10-05T11:41:04.269 INFO:tasks.workunit.client.0.smithi012.stderr: -143> 2023-10-05T11:41:04.180+0000 7fa0ea444880 5 AuthRegistry(0x55f0c9b570d8) adding auth protocol: cephx 2023-10-05T11:41:04.269 INFO:tasks.workunit.client.0.smithi012.stderr: -142> 2023-10-05T11:41:04.180+0000 7fa0ea444880 5 AuthRegistry(0x55f0c9b570d8) adding con mode: secure 2023-10-05T11:41:04.269 INFO:tasks.workunit.client.0.smithi012.stderr: -141> 2023-10-05T11:41:04.180+0000 7fa0ea444880 5 AuthRegistry(0x55f0c9b570d8) adding con mode: crc 2023-10-05T11:41:04.269 INFO:tasks.workunit.client.0.smithi012.stderr: -140> 2023-10-05T11:41:04.180+0000 7fa0ea444880 5 AuthRegistry(0x55f0c9b570d8) adding con mode: secure 2023-10-05T11:41:04.269 INFO:tasks.workunit.client.0.smithi012.stderr: -139> 2023-10-05T11:41:04.180+0000 7fa0ea444880 5 AuthRegistry(0x55f0c9b570d8) adding con mode: crc 2023-10-05T11:41:04.269 INFO:tasks.workunit.client.0.smithi012.stderr: -138> 2023-10-05T11:41:04.180+0000 7fa0ea444880 5 AuthRegistry(0x55f0c9b570d8) adding con mode: secure 2023-10-05T11:41:04.269 INFO:tasks.workunit.client.0.smithi012.stderr: -137> 2023-10-05T11:41:04.180+0000 7fa0ea444880 5 AuthRegistry(0x55f0c9b570d8) adding con mode: crc 2023-10-05T11:41:04.269 INFO:tasks.workunit.client.0.smithi012.stderr: -136> 2023-10-05T11:41:04.180+0000 7fa0ea444880 5 AuthRegistry(0x55f0c9b570d8) adding con mode: crc 2023-10-05T11:41:04.269 INFO:tasks.workunit.client.0.smithi012.stderr: -135> 2023-10-05T11:41:04.180+0000 7fa0ea444880 5 AuthRegistry(0x55f0c9b570d8) adding con mode: secure 2023-10-05T11:41:04.269 INFO:tasks.workunit.client.0.smithi012.stderr: -134> 2023-10-05T11:41:04.180+0000 7fa0ea444880 5 AuthRegistry(0x55f0c9b570d8) adding con mode: crc 2023-10-05T11:41:04.270 INFO:tasks.workunit.client.0.smithi012.stderr: -133> 2023-10-05T11:41:04.180+0000 7fa0ea444880 5 AuthRegistry(0x55f0c9b570d8) adding con mode: secure 2023-10-05T11:41:04.270 INFO:tasks.workunit.client.0.smithi012.stderr: -132> 2023-10-05T11:41:04.180+0000 7fa0ea444880 5 AuthRegistry(0x55f0c9b570d8) adding con mode: crc 2023-10-05T11:41:04.270 INFO:tasks.workunit.client.0.smithi012.stderr: -131> 2023-10-05T11:41:04.180+0000 7fa0ea444880 5 AuthRegistry(0x55f0c9b570d8) adding con mode: secure 2023-10-05T11:41:04.270 INFO:tasks.workunit.client.0.smithi012.stderr: -130> 2023-10-05T11:41:04.180+0000 7fa0ea444880 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-10-05T11:41:04.270 INFO:tasks.workunit.client.0.smithi012.stderr: -129> 2023-10-05T11:41:04.180+0000 7fa0ea444880 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-10-05T11:41:04.270 INFO:tasks.workunit.client.0.smithi012.stderr: -128> 2023-10-05T11:41:04.180+0000 7fa0ea444880 5 asok(0x55f0c995c000) register_command rotate-key cmddesc rotate-key hook 0x55f0c9b57220 EEXIST 2023-10-05T11:41:04.270 INFO:tasks.workunit.client.0.smithi012.stderr: -127> 2023-10-05T11:41:04.180+0000 7fa0ea444880 10 monclient: _reopen_session rank -1 2023-10-05T11:41:04.270 INFO:tasks.workunit.client.0.smithi012.stderr: -126> 2023-10-05T11:41:04.180+0000 7fa0ea444880 10 monclient: _add_conns ranks=[2,0,1] 2023-10-05T11:41:04.270 INFO:tasks.workunit.client.0.smithi012.stderr: -125> 2023-10-05T11:41:04.180+0000 7fa0ea444880 10 monclient(hunting): picked mon.noname-c con 0x55f0c9b3a800 addr [v2:172.21.15.12:3301/0,v1:172.21.15.12:6790/0] 2023-10-05T11:41:04.270 INFO:tasks.workunit.client.0.smithi012.stderr: -124> 2023-10-05T11:41:04.180+0000 7fa0ea444880 10 monclient(hunting): picked mon.noname-a con 0x55f0c9b3ac00 addr [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] 2023-10-05T11:41:04.270 INFO:tasks.workunit.client.0.smithi012.stderr: -123> 2023-10-05T11:41:04.180+0000 7fa0ea444880 10 monclient(hunting): picked mon.noname-b con 0x55f0c9b3b000 addr [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] 2023-10-05T11:41:04.270 INFO:tasks.workunit.client.0.smithi012.stderr: -122> 2023-10-05T11:41:04.180+0000 7fa0ea444880 10 monclient(hunting): start opening mon connection 2023-10-05T11:41:04.271 INFO:tasks.workunit.client.0.smithi012.stderr: -121> 2023-10-05T11:41:04.180+0000 7fa0ea444880 10 monclient(hunting): start opening mon connection 2023-10-05T11:41:04.271 INFO:tasks.workunit.client.0.smithi012.stderr: -120> 2023-10-05T11:41:04.180+0000 7fa0ea444880 10 monclient(hunting): start opening mon connection 2023-10-05T11:41:04.271 INFO:tasks.workunit.client.0.smithi012.stderr: -119> 2023-10-05T11:41:04.180+0000 7fa0ea444880 10 monclient(hunting): _renew_subs 2023-10-05T11:41:04.271 INFO:tasks.workunit.client.0.smithi012.stderr: -118> 2023-10-05T11:41:04.180+0000 7fa0ea444880 10 monclient(hunting): authenticate will time out at 1572.349040s 2023-10-05T11:41:04.271 INFO:tasks.workunit.client.0.smithi012.stderr: -117> 2023-10-05T11:41:04.180+0000 7fa0e8be9640 10 monclient(hunting): get_auth_request con 0x55f0c9b3ac00 auth_method 0 2023-10-05T11:41:04.271 INFO:tasks.workunit.client.0.smithi012.stderr: -116> 2023-10-05T11:41:04.180+0000 7fa0e8be9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-10-05T11:41:04.271 INFO:tasks.workunit.client.0.smithi012.stderr: -115> 2023-10-05T11:41:04.180+0000 7fa0e8be9640 10 monclient(hunting): _init_auth method 2 2023-10-05T11:41:04.271 INFO:tasks.workunit.client.0.smithi012.stderr: -114> 2023-10-05T11:41:04.180+0000 7fa0e8be9640 10 monclient(hunting): _init_auth creating new auth 2023-10-05T11:41:04.271 INFO:tasks.workunit.client.0.smithi012.stderr: -113> 2023-10-05T11:41:04.180+0000 7fa0e93ea640 10 monclient(hunting): get_auth_request con 0x55f0c9b3a800 auth_method 0 2023-10-05T11:41:04.272 INFO:tasks.workunit.client.0.smithi012.stderr: -112> 2023-10-05T11:41:04.180+0000 7fa0e93ea640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-10-05T11:41:04.272 INFO:tasks.workunit.client.0.smithi012.stderr: -111> 2023-10-05T11:41:04.180+0000 7fa0e93ea640 10 monclient(hunting): _init_auth method 2 2023-10-05T11:41:04.272 INFO:tasks.workunit.client.0.smithi012.stderr: -110> 2023-10-05T11:41:04.180+0000 7fa0e93ea640 10 monclient(hunting): _init_auth creating new auth 2023-10-05T11:41:04.272 INFO:tasks.workunit.client.0.smithi012.stderr: -109> 2023-10-05T11:41:04.180+0000 7fa0e8be9640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-10-05T11:41:04.272 INFO:tasks.workunit.client.0.smithi012.stderr: -108> 2023-10-05T11:41:04.180+0000 7fa0e8be9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-10-05T11:41:04.272 INFO:tasks.workunit.client.0.smithi012.stderr: -107> 2023-10-05T11:41:04.180+0000 7fa0e8be9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-10-05T11:41:04.272 INFO:tasks.workunit.client.0.smithi012.stderr: -106> 2023-10-05T11:41:04.180+0000 7fa0e83e8640 10 monclient(hunting): get_auth_request con 0x55f0c9b3b000 auth_method 0 2023-10-05T11:41:04.272 INFO:tasks.workunit.client.0.smithi012.stderr: -105> 2023-10-05T11:41:04.180+0000 7fa0e83e8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-10-05T11:41:04.272 INFO:tasks.workunit.client.0.smithi012.stderr: -104> 2023-10-05T11:41:04.180+0000 7fa0e83e8640 10 monclient(hunting): _init_auth method 2 2023-10-05T11:41:04.272 INFO:tasks.workunit.client.0.smithi012.stderr: -103> 2023-10-05T11:41:04.180+0000 7fa0e83e8640 10 monclient(hunting): _init_auth creating new auth 2023-10-05T11:41:04.273 INFO:tasks.workunit.client.0.smithi012.stderr: -102> 2023-10-05T11:41:04.180+0000 7fa0e93ea640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-10-05T11:41:04.273 INFO:tasks.workunit.client.0.smithi012.stderr: -101> 2023-10-05T11:41:04.180+0000 7fa0e93ea640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-10-05T11:41:04.273 INFO:tasks.workunit.client.0.smithi012.stderr: -100> 2023-10-05T11:41:04.180+0000 7fa0e93ea640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-10-05T11:41:04.273 INFO:tasks.workunit.client.0.smithi012.stderr: -99> 2023-10-05T11:41:04.180+0000 7fa0e83e8640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-10-05T11:41:04.273 INFO:tasks.workunit.client.0.smithi012.stderr: -98> 2023-10-05T11:41:04.180+0000 7fa0e83e8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-10-05T11:41:04.273 INFO:tasks.workunit.client.0.smithi012.stderr: -97> 2023-10-05T11:41:04.180+0000 7fa0e83e8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-10-05T11:41:04.273 INFO:tasks.workunit.client.0.smithi012.stderr: -96> 2023-10-05T11:41:04.180+0000 7fa0e8be9640 10 monclient(hunting): handle_auth_done global_id 7146 payload 824 2023-10-05T11:41:04.273 INFO:tasks.workunit.client.0.smithi012.stderr: -95> 2023-10-05T11:41:04.180+0000 7fa0e8be9640 10 monclient: _finish_hunting 0 2023-10-05T11:41:04.273 INFO:tasks.workunit.client.0.smithi012.stderr: -94> 2023-10-05T11:41:04.180+0000 7fa0e8be9640 1 monclient: found mon.noname-a 2023-10-05T11:41:04.273 INFO:tasks.workunit.client.0.smithi012.stderr: -93> 2023-10-05T11:41:04.180+0000 7fa0e8be9640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.12:3300/0 2023-10-05T11:41:04.273 INFO:tasks.workunit.client.0.smithi012.stderr: -92> 2023-10-05T11:41:04.181+0000 7fa0cdbb3640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-10-05T11:41:04.273 INFO:tasks.workunit.client.0.smithi012.stderr: -91> 2023-10-05T11:41:04.181+0000 7fa0cdbb3640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2023-10-05T11:41:04.274 INFO:tasks.workunit.client.0.smithi012.stderr: -90> 2023-10-05T11:41:04.181+0000 7fa0cdbb3640 10 monclient: dump: 2023-10-05T11:41:04.274 INFO:tasks.workunit.client.0.smithi012.stderr:epoch 1 2023-10-05T11:41:04.274 INFO:tasks.workunit.client.0.smithi012.stderr:fsid 7e015f46-293b-4b09-bd32-7d32b52f6e2f 2023-10-05T11:41:04.274 INFO:tasks.workunit.client.0.smithi012.stderr:last_changed 2023-10-05T11:27:38.366888+0000 2023-10-05T11:41:04.274 INFO:tasks.workunit.client.0.smithi012.stderr:created 2023-10-05T11:27:38.366888+0000 2023-10-05T11:41:04.274 INFO:tasks.workunit.client.0.smithi012.stderr:min_mon_release 18 (reef) 2023-10-05T11:41:04.274 INFO:tasks.workunit.client.0.smithi012.stderr:election_strategy: 1 2023-10-05T11:41:04.274 INFO:tasks.workunit.client.0.smithi012.stderr:0: [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon.a 2023-10-05T11:41:04.274 INFO:tasks.workunit.client.0.smithi012.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2023-10-05T11:41:04.274 INFO:tasks.workunit.client.0.smithi012.stderr:2: [v2:172.21.15.12:3301/0,v1:172.21.15.12:6790/0] mon.c 2023-10-05T11:41:04.274 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:41:04.275 INFO:tasks.workunit.client.0.smithi012.stderr: -89> 2023-10-05T11:41:04.181+0000 7fa0cdbb3640 10 monclient: _finish_auth 0 2023-10-05T11:41:04.275 INFO:tasks.workunit.client.0.smithi012.stderr: -88> 2023-10-05T11:41:04.181+0000 7fa0cdbb3640 10 monclient: _check_auth_tickets 2023-10-05T11:41:04.275 INFO:tasks.workunit.client.0.smithi012.stderr: -87> 2023-10-05T11:41:04.181+0000 7fa0cdbb3640 10 monclient: handle_config config(0 keys) v1 2023-10-05T11:41:04.275 INFO:tasks.workunit.client.0.smithi012.stderr: -86> 2023-10-05T11:41:04.181+0000 7fa0cdbb3640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-10-05T11:41:04.275 INFO:tasks.workunit.client.0.smithi012.stderr: -85> 2023-10-05T11:41:04.181+0000 7fa0cdbb3640 10 monclient: got monmap 1 from mon.a (according to old e1) 2023-10-05T11:41:04.275 INFO:tasks.workunit.client.0.smithi012.stderr: -84> 2023-10-05T11:41:04.181+0000 7fa0cf3b6640 4 set_mon_vals no callback set 2023-10-05T11:41:04.275 INFO:tasks.workunit.client.0.smithi012.stderr: -83> 2023-10-05T11:41:04.181+0000 7fa0cdbb3640 10 monclient: dump: 2023-10-05T11:41:04.275 INFO:tasks.workunit.client.0.smithi012.stderr:epoch 1 2023-10-05T11:41:04.275 INFO:tasks.workunit.client.0.smithi012.stderr:fsid 7e015f46-293b-4b09-bd32-7d32b52f6e2f 2023-10-05T11:41:04.275 INFO:tasks.workunit.client.0.smithi012.stderr:last_changed 2023-10-05T11:27:38.366888+0000 2023-10-05T11:41:04.275 INFO:tasks.workunit.client.0.smithi012.stderr:created 2023-10-05T11:27:38.366888+0000 2023-10-05T11:41:04.275 INFO:tasks.workunit.client.0.smithi012.stderr:min_mon_release 18 (reef) 2023-10-05T11:41:04.275 INFO:tasks.workunit.client.0.smithi012.stderr:election_strategy: 1 2023-10-05T11:41:04.276 INFO:tasks.workunit.client.0.smithi012.stderr:0: [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon.a 2023-10-05T11:41:04.276 INFO:tasks.workunit.client.0.smithi012.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2023-10-05T11:41:04.276 INFO:tasks.workunit.client.0.smithi012.stderr:2: [v2:172.21.15.12:3301/0,v1:172.21.15.12:6790/0] mon.c 2023-10-05T11:41:04.276 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:41:04.276 INFO:tasks.workunit.client.0.smithi012.stderr: -82> 2023-10-05T11:41:04.181+0000 7fa0ea444880 5 monclient: authenticate success, global_id 7146 2023-10-05T11:41:04.276 INFO:tasks.workunit.client.0.smithi012.stderr: -81> 2023-10-05T11:41:04.181+0000 7fa0ea444880 10 monclient: _renew_subs 2023-10-05T11:41:04.276 INFO:tasks.workunit.client.0.smithi012.stderr: -80> 2023-10-05T11:41:04.181+0000 7fa0ea444880 10 monclient: _send_mon_message to mon.a at v2:172.21.15.12:3300/0 2023-10-05T11:41:04.276 INFO:tasks.workunit.client.0.smithi012.stderr: -79> 2023-10-05T11:41:04.181+0000 7fa0ea444880 10 monclient: _renew_subs 2023-10-05T11:41:04.276 INFO:tasks.workunit.client.0.smithi012.stderr: -78> 2023-10-05T11:41:04.181+0000 7fa0ea444880 10 monclient: _send_mon_message to mon.a at v2:172.21.15.12:3300/0 2023-10-05T11:41:04.276 INFO:tasks.workunit.client.0.smithi012.stderr: -77> 2023-10-05T11:41:04.181+0000 7fa0ea444880 1 librados: init done 2023-10-05T11:41:04.276 INFO:tasks.workunit.client.0.smithi012.stderr: -76> 2023-10-05T11:41:04.181+0000 7fa0ea444880 5 asok(0x55f0c995c000) register_command cr dump hook 0x55f0ca521358 2023-10-05T11:41:04.277 INFO:tasks.workunit.client.0.smithi012.stderr: -75> 2023-10-05T11:41:04.182+0000 7fa0cdbb3640 4 mgrc handle_mgr_map Got map version 5 2023-10-05T11:41:04.277 INFO:tasks.workunit.client.0.smithi012.stderr: -74> 2023-10-05T11:41:04.182+0000 7fa0cdbb3640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.170:6832/180516904,v1:172.21.15.170:6833/180516904] 2023-10-05T11:41:04.277 INFO:tasks.workunit.client.0.smithi012.stderr: -73> 2023-10-05T11:41:04.182+0000 7fa0cdbb3640 4 mgrc reconnect Starting new session with [v2:172.21.15.170:6832/180516904,v1:172.21.15.170:6833/180516904] 2023-10-05T11:41:04.277 INFO:tasks.workunit.client.0.smithi012.stderr: -72> 2023-10-05T11:41:04.182+0000 7fa0ea444880 5 note: GC not initialized 2023-10-05T11:41:04.277 INFO:tasks.workunit.client.0.smithi012.stderr: -71> 2023-10-05T11:41:04.182+0000 7fa0e93ea640 10 monclient: get_auth_request con 0x55f0c9c3c000 auth_method 0 2023-10-05T11:41:04.277 INFO:tasks.workunit.client.0.smithi012.stderr: -70> 2023-10-05T11:41:04.183+0000 7fa0cb3ae640 20 reqs_thread_entry: start 2023-10-05T11:41:04.277 INFO:tasks.workunit.client.0.smithi012.stderr: -69> 2023-10-05T11:41:04.183+0000 7fa0ea444880 5 asok(0x55f0c995c000) register_command sync trace show hook 0x55f0c96a6a80 2023-10-05T11:41:04.278 INFO:tasks.workunit.client.0.smithi012.stderr: -68> 2023-10-05T11:41:04.183+0000 7fa0ea444880 5 asok(0x55f0c995c000) register_command sync trace history hook 0x55f0c96a6a80 2023-10-05T11:41:04.278 INFO:tasks.workunit.client.0.smithi012.stderr: -67> 2023-10-05T11:41:04.183+0000 7fa0ea444880 5 asok(0x55f0c995c000) register_command sync trace active hook 0x55f0c96a6a80 2023-10-05T11:41:04.278 INFO:tasks.workunit.client.0.smithi012.stderr: -66> 2023-10-05T11:41:04.183+0000 7fa0ea444880 5 asok(0x55f0c995c000) register_command sync trace active_short hook 0x55f0c96a6a80 2023-10-05T11:41:04.278 INFO:tasks.workunit.client.0.smithi012.stderr: -65> 2023-10-05T11:41:04.183+0000 7fa0ea444880 20 init_complete bucket index max shards: 11 2023-10-05T11:41:04.278 INFO:tasks.workunit.client.0.smithi012.stderr: -64> 2023-10-05T11:41:04.183+0000 7fa0ea444880 20 Filter name: none 2023-10-05T11:41:04.278 INFO:tasks.workunit.client.0.smithi012.stderr: -63> 2023-10-05T11:41:04.183+0000 7fa0c93aa640 20 reqs_thread_entry: start 2023-10-05T11:41:04.278 INFO:tasks.workunit.client.0.smithi012.stderr: -62> 2023-10-05T11:41:04.183+0000 7fa0ea444880 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2023-10-05T11:41:04.278 INFO:tasks.workunit.client.0.smithi012.stderr: -61> 2023-10-05T11:41:04.183+0000 7fa0ea444880 20 rados->read ofs=0 len=0 2023-10-05T11:41:04.278 INFO:tasks.workunit.client.0.smithi012.stderr: -60> 2023-10-05T11:41:04.183+0000 7fa0ea444880 20 rados_obj.operate() r=0 bl.length=221 2023-10-05T11:41:04.278 INFO:tasks.workunit.client.0.smithi012.stderr: -59> 2023-10-05T11:41:04.183+0000 7fa0ea444880 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2023-10-05T11:41:04.278 INFO:tasks.workunit.client.0.smithi012.stderr: -58> 2023-10-05T11:41:04.183+0000 7fa0ea444880 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2023-10-05T11:41:04.279 INFO:tasks.workunit.client.0.smithi012.stderr: -57> 2023-10-05T11:41:04.183+0000 7fa0ea444880 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.25 : miss 2023-10-05T11:41:04.279 INFO:tasks.workunit.client.0.smithi012.stderr: -56> 2023-10-05T11:41:04.183+0000 7fa0ea444880 20 rados->read ofs=0 len=0 2023-10-05T11:41:04.279 INFO:tasks.workunit.client.0.smithi012.stderr: -55> 2023-10-05T11:41:04.184+0000 7fa0ea444880 20 rados_obj.operate() r=0 bl.length=393 2023-10-05T11:41:04.279 INFO:tasks.workunit.client.0.smithi012.stderr: -54> 2023-10-05T11:41:04.184+0000 7fa0ea444880 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.25 info.flags=0x17 2023-10-05T11:41:04.279 INFO:tasks.workunit.client.0.smithi012.stderr: -53> 2023-10-05T11:41:04.184+0000 7fa0ea444880 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.25 to cache LRU end 2023-10-05T11:41:04.279 INFO:tasks.workunit.client.0.smithi012.stderr: -52> 2023-10-05T11:41:04.184+0000 7fa0ea444880 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T11:41:04.279 INFO:tasks.workunit.client.0.smithi012.stderr: -51> 2023-10-05T11:41:04.184+0000 7fa0ea444880 10 updating xattr: name=user.rgw.acl bl.length()=265 2023-10-05T11:41:04.279 INFO:tasks.workunit.client.0.smithi012.stderr: -50> 2023-10-05T11:41:04.184+0000 7fa0ea444880 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.25 2023-10-05T11:41:04.279 INFO:tasks.workunit.client.0.smithi012.stderr: -49> 2023-10-05T11:41:04.184+0000 7fa0e83e8640 10 monclient: get_auth_request con 0x55f0c9b3b800 auth_method 0 2023-10-05T11:41:04.279 INFO:tasks.workunit.client.0.smithi012.stderr: -48> 2023-10-05T11:41:04.190+0000 7fa0ea444880 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.25 info.flags=0x17 2023-10-05T11:41:04.279 INFO:tasks.workunit.client.0.smithi012.stderr: -47> 2023-10-05T11:41:04.190+0000 7fa0ea444880 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.25 to cache LRU end 2023-10-05T11:41:04.279 INFO:tasks.workunit.client.0.smithi012.stderr: -46> 2023-10-05T11:41:04.190+0000 7fa0ea444880 10 updating xattr: name=user.rgw.acl bl.length()=265 2023-10-05T11:41:04.280 INFO:tasks.workunit.client.0.smithi012.stderr: -45> 2023-10-05T11:41:04.190+0000 7fa0ea444880 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.25, ofs0, ns] 2023-10-05T11:41:04.280 INFO:tasks.workunit.client.0.smithi012.stderr: -44> 2023-10-05T11:41:04.190+0000 7fa0e2bdd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1060856922173 cookie 94492664382464 notifier 7140 bl.length()=965 2023-10-05T11:41:04.280 INFO:tasks.workunit.client.0.smithi012.stderr: -43> 2023-10-05T11:41:04.190+0000 7fa0e2bdd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.25 info.flags=0x17 2023-10-05T11:41:04.280 INFO:tasks.workunit.client.0.smithi012.stderr: -42> 2023-10-05T11:41:04.190+0000 7fa0e2bdd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.25 to cache LRU end 2023-10-05T11:41:04.280 INFO:tasks.workunit.client.0.smithi012.stderr: -41> 2023-10-05T11:41:04.190+0000 7fa0e2bdd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2023-10-05T11:41:04.280 INFO:tasks.workunit.client.0.smithi012.stderr: -40> 2023-10-05T11:41:04.192+0000 7fa0ea444880 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[dff27d1e-df33-400e-a68a-7ba586947c99.4604.25]): orig_sources= new_sources= 2023-10-05T11:41:04.280 INFO:tasks.workunit.client.0.smithi012.stderr: -39> 2023-10-05T11:41:04.192+0000 7fa0ea444880 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[dff27d1e-df33-400e-a68a-7ba586947c99.4604.25]): potential sources added=[] removed=[] 2023-10-05T11:41:04.280 INFO:tasks.workunit.client.0.smithi012.stderr: -38> 2023-10-05T11:41:04.192+0000 7fa0ea444880 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[dff27d1e-df33-400e-a68a-7ba586947c99.4604.25]): orig_dests= new_dests= 2023-10-05T11:41:04.280 INFO:tasks.workunit.client.0.smithi012.stderr: -37> 2023-10-05T11:41:04.192+0000 7fa0ea444880 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[dff27d1e-df33-400e-a68a-7ba586947c99.4604.25]): potential dests added=[] removed=[] 2023-10-05T11:41:04.280 INFO:tasks.workunit.client.0.smithi012.stderr: -36> 2023-10-05T11:41:04.194+0000 7fa0ea444880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.25.1.0 2023-10-05T11:41:04.280 INFO:tasks.workunit.client.0.smithi012.stderr: -35> 2023-10-05T11:41:04.194+0000 7fa0ea444880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.25.1.0 2023-10-05T11:41:04.280 INFO:tasks.workunit.client.0.smithi012.stderr: -34> 2023-10-05T11:41:04.194+0000 7fa0ea444880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.25.1.1 2023-10-05T11:41:04.280 INFO:tasks.workunit.client.0.smithi012.stderr: -33> 2023-10-05T11:41:04.194+0000 7fa0ea444880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.25.1.1 2023-10-05T11:41:04.281 INFO:tasks.workunit.client.0.smithi012.stderr: -32> 2023-10-05T11:41:04.194+0000 7fa0ea444880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.25.1.2 2023-10-05T11:41:04.281 INFO:tasks.workunit.client.0.smithi012.stderr: -31> 2023-10-05T11:41:04.194+0000 7fa0ea444880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.25.1.2 2023-10-05T11:41:04.281 INFO:tasks.workunit.client.0.smithi012.stderr: -30> 2023-10-05T11:41:04.194+0000 7fa0ea444880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.25.1.3 2023-10-05T11:41:04.281 INFO:tasks.workunit.client.0.smithi012.stderr: -29> 2023-10-05T11:41:04.194+0000 7fa0ea444880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.25.1.3 2023-10-05T11:41:04.281 INFO:tasks.workunit.client.0.smithi012.stderr: -28> 2023-10-05T11:41:04.194+0000 7fa0ea444880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.25.1.4 2023-10-05T11:41:04.281 INFO:tasks.workunit.client.0.smithi012.stderr: -27> 2023-10-05T11:41:04.194+0000 7fa0ea444880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.25.1.4 2023-10-05T11:41:04.281 INFO:tasks.workunit.client.0.smithi012.stderr: -26> 2023-10-05T11:41:04.194+0000 7fa0ea444880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.25.1.5 2023-10-05T11:41:04.281 INFO:tasks.workunit.client.0.smithi012.stderr: -25> 2023-10-05T11:41:04.194+0000 7fa0ea444880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.25.1.5 2023-10-05T11:41:04.281 INFO:tasks.workunit.client.0.smithi012.stderr: -24> 2023-10-05T11:41:04.194+0000 7fa0ea444880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.25.1.6 2023-10-05T11:41:04.281 INFO:tasks.workunit.client.0.smithi012.stderr: -23> 2023-10-05T11:41:04.194+0000 7fa0ea444880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.25.1.6 2023-10-05T11:41:04.281 INFO:tasks.workunit.client.0.smithi012.stderr: -22> 2023-10-05T11:41:04.194+0000 7fa0ea444880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.25.1.7 2023-10-05T11:41:04.281 INFO:tasks.workunit.client.0.smithi012.stderr: -21> 2023-10-05T11:41:04.194+0000 7fa0ea444880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.25.1.7 2023-10-05T11:41:04.281 INFO:tasks.workunit.client.0.smithi012.stderr: -20> 2023-10-05T11:41:04.194+0000 7fa0ea444880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.25.1.8 2023-10-05T11:41:04.282 INFO:tasks.workunit.client.0.smithi012.stderr: -19> 2023-10-05T11:41:04.194+0000 7fa0ea444880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.25.1.8 2023-10-05T11:41:04.282 INFO:tasks.workunit.client.0.smithi012.stderr: -18> 2023-10-05T11:41:04.194+0000 7fa0ea444880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.25.1.9 2023-10-05T11:41:04.282 INFO:tasks.workunit.client.0.smithi012.stderr: -17> 2023-10-05T11:41:04.194+0000 7fa0ea444880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.25.1.9 2023-10-05T11:41:04.282 INFO:tasks.workunit.client.0.smithi012.stderr: -16> 2023-10-05T11:41:04.194+0000 7fa0ea444880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.25.1.10 2023-10-05T11:41:04.282 INFO:tasks.workunit.client.0.smithi012.stderr: -15> 2023-10-05T11:41:04.194+0000 7fa0ea444880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.25.1.10 2023-10-05T11:41:04.282 INFO:tasks.workunit.client.0.smithi012.stderr: -14> 2023-10-05T11:41:04.194+0000 7fa0ea444880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.25.1.11 2023-10-05T11:41:04.282 INFO:tasks.workunit.client.0.smithi012.stderr: -13> 2023-10-05T11:41:04.194+0000 7fa0ea444880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.25.1.11 2023-10-05T11:41:04.282 INFO:tasks.workunit.client.0.smithi012.stderr: -12> 2023-10-05T11:41:04.194+0000 7fa0ea444880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.25.0 2023-10-05T11:41:04.282 INFO:tasks.workunit.client.0.smithi012.stderr: -11> 2023-10-05T11:41:04.195+0000 7fa0ea444880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.25.1 2023-10-05T11:41:04.282 INFO:tasks.workunit.client.0.smithi012.stderr: -10> 2023-10-05T11:41:04.195+0000 7fa0ea444880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.25.2 2023-10-05T11:41:04.282 INFO:tasks.workunit.client.0.smithi012.stderr: -9> 2023-10-05T11:41:04.195+0000 7fa0ea444880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.25.3 2023-10-05T11:41:04.283 INFO:tasks.workunit.client.0.smithi012.stderr: -8> 2023-10-05T11:41:04.196+0000 7fa0ea444880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.25.4 2023-10-05T11:41:04.283 INFO:tasks.workunit.client.0.smithi012.stderr: -7> 2023-10-05T11:41:04.196+0000 7fa0ea444880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.25.5 2023-10-05T11:41:04.283 INFO:tasks.workunit.client.0.smithi012.stderr: -6> 2023-10-05T11:41:04.197+0000 7fa0ea444880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.25.6 2023-10-05T11:41:04.283 INFO:tasks.workunit.client.0.smithi012.stderr: -5> 2023-10-05T11:41:04.197+0000 7fa0ea444880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.25.7 2023-10-05T11:41:04.283 INFO:tasks.workunit.client.0.smithi012.stderr: -4> 2023-10-05T11:41:04.198+0000 7fa0ea444880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.25.8 2023-10-05T11:41:04.283 INFO:tasks.workunit.client.0.smithi012.stderr: -3> 2023-10-05T11:41:04.198+0000 7fa0ea444880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.25.9 2023-10-05T11:41:04.283 INFO:tasks.workunit.client.0.smithi012.stderr: -2> 2023-10-05T11:41:04.198+0000 7fa0ea444880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.25.10 2023-10-05T11:41:04.283 INFO:tasks.workunit.client.0.smithi012.stderr: -1> 2023-10-05T11:41:04.202+0000 7fa0ea444880 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6543-g38321be8/rpm/el9/BUILD/ceph-18.0.0-6543-g38321be8/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fa0ea444880 time 2023-10-05T11:41:04.203267+0000 2023-10-05T11:41:04.283 INFO:tasks.workunit.client.0.smithi012.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6543-g38321be8/rpm/el9/BUILD/ceph-18.0.0-6543-g38321be8/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2023-10-05T11:41:04.283 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:41:04.284 INFO:tasks.workunit.client.0.smithi012.stderr: ceph version 18.0.0-6543-g38321be8 (38321be854743c0d616618a9ea8aa0b1d4dbc0bf) reef (dev) 2023-10-05T11:41:04.284 INFO:tasks.workunit.client.0.smithi012.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fa0ef16d15f] 2023-10-05T11:41:04.284 INFO:tasks.workunit.client.0.smithi012.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16d31d) [0x7fa0ef16d31d] 2023-10-05T11:41:04.284 INFO:tasks.workunit.client.0.smithi012.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f0c8113c31] 2023-10-05T11:41:04.284 INFO:tasks.workunit.client.0.smithi012.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x5b8) [0x55f0c812aa48] 2023-10-05T11:41:04.284 INFO:tasks.workunit.client.0.smithi012.stderr: 5: main() 2023-10-05T11:41:04.284 INFO:tasks.workunit.client.0.smithi012.stderr: 6: /lib64/libc.so.6(+0x3feb0) [0x7fa0ec63feb0] 2023-10-05T11:41:04.284 INFO:tasks.workunit.client.0.smithi012.stderr: 7: __libc_start_main() 2023-10-05T11:41:04.284 INFO:tasks.workunit.client.0.smithi012.stderr: 8: _start() 2023-10-05T11:41:04.284 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:41:04.284 INFO:tasks.workunit.client.0.smithi012.stderr: 0> 2023-10-05T11:41:04.203+0000 7fa0ea444880 -1 *** Caught signal (Aborted) ** 2023-10-05T11:41:04.284 INFO:tasks.workunit.client.0.smithi012.stderr: in thread 7fa0ea444880 thread_name:radosgw-admin 2023-10-05T11:41:04.284 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:41:04.285 INFO:tasks.workunit.client.0.smithi012.stderr: ceph version 18.0.0-6543-g38321be8 (38321be854743c0d616618a9ea8aa0b1d4dbc0bf) reef (dev) 2023-10-05T11:41:04.285 INFO:tasks.workunit.client.0.smithi012.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7fa0ec654db0] 2023-10-05T11:41:04.285 INFO:tasks.workunit.client.0.smithi012.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7fa0ec6a154c] 2023-10-05T11:41:04.285 INFO:tasks.workunit.client.0.smithi012.stderr: 3: raise() 2023-10-05T11:41:04.285 INFO:tasks.workunit.client.0.smithi012.stderr: 4: abort() 2023-10-05T11:41:04.285 INFO:tasks.workunit.client.0.smithi012.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fa0ef16d1b9] 2023-10-05T11:41:04.285 INFO:tasks.workunit.client.0.smithi012.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16d31d) [0x7fa0ef16d31d] 2023-10-05T11:41:04.285 INFO:tasks.workunit.client.0.smithi012.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f0c8113c31] 2023-10-05T11:41:04.285 INFO:tasks.workunit.client.0.smithi012.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x5b8) [0x55f0c812aa48] 2023-10-05T11:41:04.285 INFO:tasks.workunit.client.0.smithi012.stderr: 9: main() 2023-10-05T11:41:04.285 INFO:tasks.workunit.client.0.smithi012.stderr: 10: /lib64/libc.so.6(+0x3feb0) [0x7fa0ec63feb0] 2023-10-05T11:41:04.285 INFO:tasks.workunit.client.0.smithi012.stderr: 11: __libc_start_main() 2023-10-05T11:41:04.286 INFO:tasks.workunit.client.0.smithi012.stderr: 12: _start() 2023-10-05T11:41:04.286 INFO:tasks.workunit.client.0.smithi012.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-10-05T11:41:04.286 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:41:04.286 INFO:tasks.workunit.client.0.smithi012.stderr:--- logging levels --- 2023-10-05T11:41:04.286 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 none 2023-10-05T11:41:04.286 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 1 lockdep 2023-10-05T11:41:04.286 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 1 context 2023-10-05T11:41:04.286 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 1 crush 2023-10-05T11:41:04.286 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 mds 2023-10-05T11:41:04.286 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 mds_balancer 2023-10-05T11:41:04.286 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 mds_locker 2023-10-05T11:41:04.287 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 mds_log 2023-10-05T11:41:04.287 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 mds_log_expire 2023-10-05T11:41:04.287 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 mds_migrator 2023-10-05T11:41:04.287 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 1 buffer 2023-10-05T11:41:04.287 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 1 timer 2023-10-05T11:41:04.287 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 1 filer 2023-10-05T11:41:04.287 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 1 striper 2023-10-05T11:41:04.287 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 1 objecter 2023-10-05T11:41:04.287 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 rados 2023-10-05T11:41:04.288 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 rbd 2023-10-05T11:41:04.288 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 rbd_mirror 2023-10-05T11:41:04.288 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 rbd_replay 2023-10-05T11:41:04.288 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 rbd_pwl 2023-10-05T11:41:04.288 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 journaler 2023-10-05T11:41:04.288 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 objectcacher 2023-10-05T11:41:04.288 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 immutable_obj_cache 2023-10-05T11:41:04.288 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 client 2023-10-05T11:41:04.288 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 osd 2023-10-05T11:41:04.288 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 optracker 2023-10-05T11:41:04.288 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 objclass 2023-10-05T11:41:04.288 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 3 filestore 2023-10-05T11:41:04.288 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 3 journal 2023-10-05T11:41:04.289 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 0 ms 2023-10-05T11:41:04.289 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 mon 2023-10-05T11:41:04.289 INFO:tasks.workunit.client.0.smithi012.stderr: 0/10 monc 2023-10-05T11:41:04.289 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 paxos 2023-10-05T11:41:04.289 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 tp 2023-10-05T11:41:04.289 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 auth 2023-10-05T11:41:04.289 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 crypto 2023-10-05T11:41:04.290 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 1 finisher 2023-10-05T11:41:04.290 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 1 reserver 2023-10-05T11:41:04.290 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 heartbeatmap 2023-10-05T11:41:04.290 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 perfcounter 2023-10-05T11:41:04.290 INFO:tasks.workunit.client.0.smithi012.stderr: 20/20 rgw 2023-10-05T11:41:04.290 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 rgw_sync 2023-10-05T11:41:04.290 INFO:tasks.workunit.client.0.smithi012.stderr: 30/30 rgw_datacache 2023-10-05T11:41:04.290 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 rgw_access 2023-10-05T11:41:04.290 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 rgw_dbstore 2023-10-05T11:41:04.290 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 rgw_flight 2023-10-05T11:41:04.290 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 javaclient 2023-10-05T11:41:04.290 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 asok 2023-10-05T11:41:04.291 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 1 throttle 2023-10-05T11:41:04.291 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 0 refs 2023-10-05T11:41:04.291 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 compressor 2023-10-05T11:41:04.291 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 bluestore 2023-10-05T11:41:04.291 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 bluefs 2023-10-05T11:41:04.291 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 3 bdev 2023-10-05T11:41:04.291 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 kstore 2023-10-05T11:41:04.291 INFO:tasks.workunit.client.0.smithi012.stderr: 4/ 5 rocksdb 2023-10-05T11:41:04.291 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 fuse 2023-10-05T11:41:04.291 INFO:tasks.workunit.client.0.smithi012.stderr: 2/ 5 mgr 2023-10-05T11:41:04.291 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 mgrc 2023-10-05T11:41:04.291 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 dpdk 2023-10-05T11:41:04.292 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 eventtrace 2023-10-05T11:41:04.292 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 prioritycache 2023-10-05T11:41:04.292 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 test 2023-10-05T11:41:04.292 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 cephfs_mirror 2023-10-05T11:41:04.292 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 cephsqlite 2023-10-05T11:41:04.292 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 seastore 2023-10-05T11:41:04.292 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 seastore_onode 2023-10-05T11:41:04.292 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 seastore_odata 2023-10-05T11:41:04.292 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 seastore_omap 2023-10-05T11:41:04.292 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 seastore_tm 2023-10-05T11:41:04.292 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 seastore_t 2023-10-05T11:41:04.292 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 seastore_cleaner 2023-10-05T11:41:04.292 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 seastore_epm 2023-10-05T11:41:04.293 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 seastore_lba 2023-10-05T11:41:04.293 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 seastore_fixedkv_tree 2023-10-05T11:41:04.293 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 seastore_cache 2023-10-05T11:41:04.293 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 seastore_journal 2023-10-05T11:41:04.293 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 seastore_device 2023-10-05T11:41:04.293 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 seastore_backref 2023-10-05T11:41:04.293 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 alienstore 2023-10-05T11:41:04.293 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 mclock 2023-10-05T11:41:04.293 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 cyanstore 2023-10-05T11:41:04.293 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 ceph_exporter 2023-10-05T11:41:04.294 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 memstore 2023-10-05T11:41:04.294 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 trace 2023-10-05T11:41:04.294 INFO:tasks.workunit.client.0.smithi012.stderr: -2/-2 (syslog threshold) 2023-10-05T11:41:04.294 INFO:tasks.workunit.client.0.smithi012.stderr: 99/99 (stderr threshold) 2023-10-05T11:41:04.294 INFO:tasks.workunit.client.0.smithi012.stderr:--- pthread ID / name mapping for recent threads --- 2023-10-05T11:41:04.294 INFO:tasks.workunit.client.0.smithi012.stderr: 7fa0c93aa640 / http_manager 2023-10-05T11:41:04.294 INFO:tasks.workunit.client.0.smithi012.stderr: 7fa0cb3ae640 / http_manager 2023-10-05T11:41:04.294 INFO:tasks.workunit.client.0.smithi012.stderr: 7fa0cdbb3640 / ms_dispatch 2023-10-05T11:41:04.294 INFO:tasks.workunit.client.0.smithi012.stderr: 7fa0cf3b6640 / io_context_pool 2023-10-05T11:41:04.294 INFO:tasks.workunit.client.0.smithi012.stderr: 7fa0cfbb7640 / rgw_dt_lg_renew 2023-10-05T11:41:04.294 INFO:tasks.workunit.client.0.smithi012.stderr: 7fa0e1bdb640 / ms_dispatch 2023-10-05T11:41:04.295 INFO:tasks.workunit.client.0.smithi012.stderr: 7fa0e2bdd640 / io_context_pool 2023-10-05T11:41:04.295 INFO:tasks.workunit.client.0.smithi012.stderr: 7fa0e33de640 / io_context_pool 2023-10-05T11:41:04.295 INFO:tasks.workunit.client.0.smithi012.stderr: 7fa0e5be3640 / ms_dispatch 2023-10-05T11:41:04.295 INFO:tasks.workunit.client.0.smithi012.stderr: 7fa0e83e8640 / msgr-worker-2 2023-10-05T11:41:04.295 INFO:tasks.workunit.client.0.smithi012.stderr: 7fa0e8be9640 / msgr-worker-1 2023-10-05T11:41:04.295 INFO:tasks.workunit.client.0.smithi012.stderr: 7fa0e93ea640 / msgr-worker-0 2023-10-05T11:41:04.295 INFO:tasks.workunit.client.0.smithi012.stderr: 7fa0ea444880 / radosgw-admin 2023-10-05T11:41:04.295 INFO:tasks.workunit.client.0.smithi012.stderr: max_recent 500 2023-10-05T11:41:04.295 INFO:tasks.workunit.client.0.smithi012.stderr: max_new 1000 2023-10-05T11:41:04.295 INFO:tasks.workunit.client.0.smithi012.stderr: log_file /var/log/ceph/ceph-client.admin.103643.log 2023-10-05T11:41:04.295 INFO:tasks.workunit.client.0.smithi012.stderr:--- end dump of recent events --- 2023-10-05T11:41:04.295 INFO:tasks.workunit.client.0.smithi012.stderr:--- begin dump of recent events --- 2023-10-05T11:41:04.295 INFO:tasks.workunit.client.0.smithi012.stderr: -499> 2023-10-05T11:41:04.145+0000 7fa0ea444880 5 AuthRegistry(0x7ffdbe4c7100) adding con mode: crc 2023-10-05T11:41:04.296 INFO:tasks.workunit.client.0.smithi012.stderr: -498> 2023-10-05T11:41:04.145+0000 7fa0ea444880 5 AuthRegistry(0x7ffdbe4c7100) adding con mode: secure 2023-10-05T11:41:04.296 INFO:tasks.workunit.client.0.smithi012.stderr: -497> 2023-10-05T11:41:04.145+0000 7fa0ea444880 5 AuthRegistry(0x7ffdbe4c7100) adding con mode: crc 2023-10-05T11:41:04.296 INFO:tasks.workunit.client.0.smithi012.stderr: -496> 2023-10-05T11:41:04.145+0000 7fa0ea444880 5 AuthRegistry(0x7ffdbe4c7100) adding con mode: secure 2023-10-05T11:41:04.296 INFO:tasks.workunit.client.0.smithi012.stderr: -495> 2023-10-05T11:41:04.145+0000 7fa0ea444880 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-10-05T11:41:04.296 INFO:tasks.workunit.client.0.smithi012.stderr: -494> 2023-10-05T11:41:04.145+0000 7fa0ea444880 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-10-05T11:41:04.296 INFO:tasks.workunit.client.0.smithi012.stderr: -493> 2023-10-05T11:41:04.145+0000 7fa0ea444880 5 asok(0x55f0c995c000) register_command rotate-key cmddesc rotate-key hook 0x7ffdbe4c7248 EEXIST 2023-10-05T11:41:04.296 INFO:tasks.workunit.client.0.smithi012.stderr: -492> 2023-10-05T11:41:04.145+0000 7fa0ea444880 10 monclient: _reopen_session rank -1 2023-10-05T11:41:04.296 INFO:tasks.workunit.client.0.smithi012.stderr: -491> 2023-10-05T11:41:04.145+0000 7fa0ea444880 10 monclient: _add_conns ranks=[1,2,0] 2023-10-05T11:41:04.296 INFO:tasks.workunit.client.0.smithi012.stderr: -490> 2023-10-05T11:41:04.145+0000 7fa0ea444880 10 monclient(hunting): picked mon.noname-b con 0x55f0ca55c800 addr [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] 2023-10-05T11:41:04.296 INFO:tasks.workunit.client.0.smithi012.stderr: -489> 2023-10-05T11:41:04.145+0000 7fa0ea444880 10 monclient(hunting): picked mon.noname-c con 0x55f0ca55cc00 addr [v2:172.21.15.12:3301/0,v1:172.21.15.12:6790/0] 2023-10-05T11:41:04.297 INFO:tasks.workunit.client.0.smithi012.stderr: -488> 2023-10-05T11:41:04.145+0000 7fa0ea444880 10 monclient(hunting): picked mon.noname-a con 0x55f0ca55d000 addr [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] 2023-10-05T11:41:04.297 INFO:tasks.workunit.client.0.smithi012.stderr: -487> 2023-10-05T11:41:04.145+0000 7fa0ea444880 10 monclient(hunting): start opening mon connection 2023-10-05T11:41:04.297 INFO:tasks.workunit.client.0.smithi012.stderr: -486> 2023-10-05T11:41:04.145+0000 7fa0ea444880 10 monclient(hunting): start opening mon connection 2023-10-05T11:41:04.297 INFO:tasks.workunit.client.0.smithi012.stderr: -485> 2023-10-05T11:41:04.145+0000 7fa0ea444880 10 monclient(hunting): start opening mon connection 2023-10-05T11:41:04.297 INFO:tasks.workunit.client.0.smithi012.stderr: -484> 2023-10-05T11:41:04.145+0000 7fa0ea444880 10 monclient(hunting): _renew_subs 2023-10-05T11:41:04.297 INFO:tasks.workunit.client.0.smithi012.stderr: -483> 2023-10-05T11:41:04.145+0000 7fa0ea444880 10 monclient(hunting): authenticate will time out at 1572.314144s 2023-10-05T11:41:04.297 INFO:tasks.workunit.client.0.smithi012.stderr: -482> 2023-10-05T11:41:04.145+0000 7fa0e8be9640 10 monclient(hunting): get_auth_request con 0x55f0ca55cc00 auth_method 0 2023-10-05T11:41:04.297 INFO:tasks.workunit.client.0.smithi012.stderr: -481> 2023-10-05T11:41:04.145+0000 7fa0e8be9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-10-05T11:41:04.297 INFO:tasks.workunit.client.0.smithi012.stderr: -480> 2023-10-05T11:41:04.145+0000 7fa0e8be9640 10 monclient(hunting): _init_auth method 2 2023-10-05T11:41:04.297 INFO:tasks.workunit.client.0.smithi012.stderr: -479> 2023-10-05T11:41:04.145+0000 7fa0e8be9640 10 monclient(hunting): _init_auth creating new auth 2023-10-05T11:41:04.298 INFO:tasks.workunit.client.0.smithi012.stderr: -478> 2023-10-05T11:41:04.145+0000 7fa0e83e8640 10 monclient(hunting): get_auth_request con 0x55f0ca55d000 auth_method 0 2023-10-05T11:41:04.298 INFO:tasks.workunit.client.0.smithi012.stderr: -477> 2023-10-05T11:41:04.145+0000 7fa0e83e8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-10-05T11:41:04.298 INFO:tasks.workunit.client.0.smithi012.stderr: -476> 2023-10-05T11:41:04.145+0000 7fa0e83e8640 10 monclient(hunting): _init_auth method 2 2023-10-05T11:41:04.298 INFO:tasks.workunit.client.0.smithi012.stderr: -475> 2023-10-05T11:41:04.145+0000 7fa0e83e8640 10 monclient(hunting): _init_auth creating new auth 2023-10-05T11:41:04.298 INFO:tasks.workunit.client.0.smithi012.stderr: -474> 2023-10-05T11:41:04.145+0000 7fa0e93ea640 10 monclient(hunting): get_auth_request con 0x55f0ca55c800 auth_method 0 2023-10-05T11:41:04.298 INFO:tasks.workunit.client.0.smithi012.stderr: -473> 2023-10-05T11:41:04.145+0000 7fa0e93ea640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-10-05T11:41:04.298 INFO:tasks.workunit.client.0.smithi012.stderr: -472> 2023-10-05T11:41:04.145+0000 7fa0e93ea640 10 monclient(hunting): _init_auth method 2 2023-10-05T11:41:04.298 INFO:tasks.workunit.client.0.smithi012.stderr: -471> 2023-10-05T11:41:04.145+0000 7fa0e93ea640 10 monclient(hunting): _init_auth creating new auth 2023-10-05T11:41:04.298 INFO:tasks.workunit.client.0.smithi012.stderr: -470> 2023-10-05T11:41:04.145+0000 7fa0e8be9640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-10-05T11:41:04.298 INFO:tasks.workunit.client.0.smithi012.stderr: -469> 2023-10-05T11:41:04.145+0000 7fa0e8be9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-10-05T11:41:04.299 INFO:tasks.workunit.client.0.smithi012.stderr: -468> 2023-10-05T11:41:04.145+0000 7fa0e8be9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-10-05T11:41:04.299 INFO:tasks.workunit.client.0.smithi012.stderr: -467> 2023-10-05T11:41:04.145+0000 7fa0e83e8640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-10-05T11:41:04.299 INFO:tasks.workunit.client.0.smithi012.stderr: -466> 2023-10-05T11:41:04.145+0000 7fa0e83e8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-10-05T11:41:04.299 INFO:tasks.workunit.client.0.smithi012.stderr: -465> 2023-10-05T11:41:04.145+0000 7fa0e5be3640 4 mgrc handle_mgr_map Got map version 5 2023-10-05T11:41:04.299 INFO:tasks.workunit.client.0.smithi012.stderr: -464> 2023-10-05T11:41:04.145+0000 7fa0e83e8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-10-05T11:41:04.299 INFO:tasks.workunit.client.0.smithi012.stderr: -463> 2023-10-05T11:41:04.145+0000 7fa0e5be3640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.170:6832/180516904,v1:172.21.15.170:6833/180516904] 2023-10-05T11:41:04.299 INFO:tasks.workunit.client.0.smithi012.stderr: -462> 2023-10-05T11:41:04.145+0000 7fa0e5be3640 4 mgrc reconnect Starting new session with [v2:172.21.15.170:6832/180516904,v1:172.21.15.170:6833/180516904] 2023-10-05T11:41:04.299 INFO:tasks.workunit.client.0.smithi012.stderr: -461> 2023-10-05T11:41:04.146+0000 7fa0e93ea640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-10-05T11:41:04.299 INFO:tasks.workunit.client.0.smithi012.stderr: -460> 2023-10-05T11:41:04.146+0000 7fa0e93ea640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-10-05T11:41:04.299 INFO:tasks.workunit.client.0.smithi012.stderr: -459> 2023-10-05T11:41:04.146+0000 7fa0e93ea640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-10-05T11:41:04.299 INFO:tasks.workunit.client.0.smithi012.stderr: -458> 2023-10-05T11:41:04.146+0000 7fa0e8be9640 10 monclient(hunting): handle_auth_done global_id 6770 payload 274 2023-10-05T11:41:04.299 INFO:tasks.workunit.client.0.smithi012.stderr: -457> 2023-10-05T11:41:04.146+0000 7fa0e8be9640 10 monclient: _finish_hunting 0 2023-10-05T11:41:04.300 INFO:tasks.workunit.client.0.smithi012.stderr: -456> 2023-10-05T11:41:04.146+0000 7fa0e8be9640 1 monclient: found mon.noname-c 2023-10-05T11:41:04.300 INFO:tasks.workunit.client.0.smithi012.stderr: -455> 2023-10-05T11:41:04.146+0000 7fa0e8be9640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.12:3301/0 2023-10-05T11:41:04.300 INFO:tasks.workunit.client.0.smithi012.stderr: -454> 2023-10-05T11:41:04.146+0000 7fa0e93ea640 10 monclient: get_auth_request con 0x55f0ca55dc00 auth_method 0 2023-10-05T11:41:04.300 INFO:tasks.workunit.client.0.smithi012.stderr: -453> 2023-10-05T11:41:04.146+0000 7fa0e33de640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-10-05T11:41:04.300 INFO:tasks.workunit.client.0.smithi012.stderr: -452> 2023-10-05T11:41:04.146+0000 7fa0e33de640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2023-10-05T11:41:04.300 INFO:tasks.workunit.client.0.smithi012.stderr: -451> 2023-10-05T11:41:04.146+0000 7fa0e33de640 10 monclient: dump: 2023-10-05T11:41:04.300 INFO:tasks.workunit.client.0.smithi012.stderr:epoch 1 2023-10-05T11:41:04.300 INFO:tasks.workunit.client.0.smithi012.stderr:fsid 7e015f46-293b-4b09-bd32-7d32b52f6e2f 2023-10-05T11:41:04.300 INFO:tasks.workunit.client.0.smithi012.stderr:last_changed 2023-10-05T11:27:38.366888+0000 2023-10-05T11:41:04.300 INFO:tasks.workunit.client.0.smithi012.stderr:created 2023-10-05T11:27:38.366888+0000 2023-10-05T11:41:04.300 INFO:tasks.workunit.client.0.smithi012.stderr:min_mon_release 18 (reef) 2023-10-05T11:41:04.300 INFO:tasks.workunit.client.0.smithi012.stderr:election_strategy: 1 2023-10-05T11:41:04.301 INFO:tasks.workunit.client.0.smithi012.stderr:0: [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon.a 2023-10-05T11:41:04.301 INFO:tasks.workunit.client.0.smithi012.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2023-10-05T11:41:04.301 INFO:tasks.workunit.client.0.smithi012.stderr:2: [v2:172.21.15.12:3301/0,v1:172.21.15.12:6790/0] mon.c 2023-10-05T11:41:04.301 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:41:04.301 INFO:tasks.workunit.client.0.smithi012.stderr: -450> 2023-10-05T11:41:04.146+0000 7fa0e33de640 10 monclient: _finish_auth 0 2023-10-05T11:41:04.301 INFO:tasks.workunit.client.0.smithi012.stderr: -449> 2023-10-05T11:41:04.146+0000 7fa0e33de640 10 monclient: _check_auth_tickets 2023-10-05T11:41:04.301 INFO:tasks.workunit.client.0.smithi012.stderr: -448> 2023-10-05T11:41:04.146+0000 7fa0e33de640 10 monclient: handle_config config(0 keys) v1 2023-10-05T11:41:04.301 INFO:tasks.workunit.client.0.smithi012.stderr: -447> 2023-10-05T11:41:04.146+0000 7fa0ea444880 5 monclient: authenticate success, global_id 6770 2023-10-05T11:41:04.301 INFO:tasks.workunit.client.0.smithi012.stderr: -446> 2023-10-05T11:41:04.146+0000 7fa0ea444880 10 monclient: get_monmap_and_config success 2023-10-05T11:41:04.301 INFO:tasks.workunit.client.0.smithi012.stderr: -445> 2023-10-05T11:41:04.146+0000 7fa0ea444880 4 set_mon_vals no callback set 2023-10-05T11:41:04.301 INFO:tasks.workunit.client.0.smithi012.stderr: -444> 2023-10-05T11:41:04.146+0000 7fa0e33de640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-10-05T11:41:04.301 INFO:tasks.workunit.client.0.smithi012.stderr: -443> 2023-10-05T11:41:04.146+0000 7fa0e33de640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-10-05T11:41:04.301 INFO:tasks.workunit.client.0.smithi012.stderr: -442> 2023-10-05T11:41:04.146+0000 7fa0e33de640 10 monclient: dump: 2023-10-05T11:41:04.302 INFO:tasks.workunit.client.0.smithi012.stderr:epoch 1 2023-10-05T11:41:04.302 INFO:tasks.workunit.client.0.smithi012.stderr:fsid 7e015f46-293b-4b09-bd32-7d32b52f6e2f 2023-10-05T11:41:04.302 INFO:tasks.workunit.client.0.smithi012.stderr:last_changed 2023-10-05T11:27:38.366888+0000 2023-10-05T11:41:04.302 INFO:tasks.workunit.client.0.smithi012.stderr:created 2023-10-05T11:27:38.366888+0000 2023-10-05T11:41:04.302 INFO:tasks.workunit.client.0.smithi012.stderr:min_mon_release 18 (reef) 2023-10-05T11:41:04.302 INFO:tasks.workunit.client.0.smithi012.stderr:election_strategy: 1 2023-10-05T11:41:04.302 INFO:tasks.workunit.client.0.smithi012.stderr:0: [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon.a 2023-10-05T11:41:04.302 INFO:tasks.workunit.client.0.smithi012.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2023-10-05T11:41:04.302 INFO:tasks.workunit.client.0.smithi012.stderr:2: [v2:172.21.15.12:3301/0,v1:172.21.15.12:6790/0] mon.c 2023-10-05T11:41:04.302 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:41:04.302 INFO:tasks.workunit.client.0.smithi012.stderr: -441> 2023-10-05T11:41:04.146+0000 7fa0ea444880 10 monclient: shutdown 2023-10-05T11:41:04.303 INFO:tasks.workunit.client.0.smithi012.stderr: -440> 2023-10-05T11:41:04.146+0000 7fa0ea444880 10 monclient: build_initial_monmap 2023-10-05T11:41:04.303 INFO:tasks.workunit.client.0.smithi012.stderr: -439> 2023-10-05T11:41:04.146+0000 7fa0ea444880 1 build_initial for_mkfs: 0 2023-10-05T11:41:04.303 INFO:tasks.workunit.client.0.smithi012.stderr: -438> 2023-10-05T11:41:04.146+0000 7fa0ea444880 10 monclient: monmap: 2023-10-05T11:41:04.303 INFO:tasks.workunit.client.0.smithi012.stderr:epoch 0 2023-10-05T11:41:04.303 INFO:tasks.workunit.client.0.smithi012.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-10-05T11:41:04.303 INFO:tasks.workunit.client.0.smithi012.stderr:last_changed 0.000000 2023-10-05T11:41:04.303 INFO:tasks.workunit.client.0.smithi012.stderr:created 0.000000 2023-10-05T11:41:04.303 INFO:tasks.workunit.client.0.smithi012.stderr:min_mon_release 0 (unknown) 2023-10-05T11:41:04.303 INFO:tasks.workunit.client.0.smithi012.stderr:election_strategy: 1 2023-10-05T11:41:04.303 INFO:tasks.workunit.client.0.smithi012.stderr:0: [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon.noname-a 2023-10-05T11:41:04.303 INFO:tasks.workunit.client.0.smithi012.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.noname-b 2023-10-05T11:41:04.304 INFO:tasks.workunit.client.0.smithi012.stderr:2: [v2:172.21.15.12:3301/0,v1:172.21.15.12:6790/0] mon.noname-c 2023-10-05T11:41:04.304 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:41:04.304 INFO:tasks.workunit.client.0.smithi012.stderr: -437> 2023-10-05T11:41:04.146+0000 7fa0ea444880 5 AuthRegistry(0x55f0ca40d340) adding auth protocol: cephx 2023-10-05T11:41:04.304 INFO:tasks.workunit.client.0.smithi012.stderr: -436> 2023-10-05T11:41:04.146+0000 7fa0ea444880 5 AuthRegistry(0x55f0ca40d340) adding auth protocol: cephx 2023-10-05T11:41:04.304 INFO:tasks.workunit.client.0.smithi012.stderr: -435> 2023-10-05T11:41:04.146+0000 7fa0ea444880 5 AuthRegistry(0x55f0ca40d340) adding auth protocol: cephx 2023-10-05T11:41:04.304 INFO:tasks.workunit.client.0.smithi012.stderr: -434> 2023-10-05T11:41:04.146+0000 7fa0ea444880 5 AuthRegistry(0x55f0ca40d340) adding con mode: secure 2023-10-05T11:41:04.304 INFO:tasks.workunit.client.0.smithi012.stderr: -433> 2023-10-05T11:41:04.146+0000 7fa0ea444880 5 AuthRegistry(0x55f0ca40d340) adding con mode: crc 2023-10-05T11:41:04.304 INFO:tasks.workunit.client.0.smithi012.stderr: -432> 2023-10-05T11:41:04.146+0000 7fa0ea444880 5 AuthRegistry(0x55f0ca40d340) adding con mode: secure 2023-10-05T11:41:04.304 INFO:tasks.workunit.client.0.smithi012.stderr: -431> 2023-10-05T11:41:04.146+0000 7fa0ea444880 5 AuthRegistry(0x55f0ca40d340) adding con mode: crc 2023-10-05T11:41:04.304 INFO:tasks.workunit.client.0.smithi012.stderr: -430> 2023-10-05T11:41:04.146+0000 7fa0ea444880 5 AuthRegistry(0x55f0ca40d340) adding con mode: secure 2023-10-05T11:41:04.304 INFO:tasks.workunit.client.0.smithi012.stderr: -429> 2023-10-05T11:41:04.146+0000 7fa0ea444880 5 AuthRegistry(0x55f0ca40d340) adding con mode: crc 2023-10-05T11:41:04.304 INFO:tasks.workunit.client.0.smithi012.stderr: -428> 2023-10-05T11:41:04.146+0000 7fa0ea444880 5 AuthRegistry(0x55f0ca40d340) adding con mode: crc 2023-10-05T11:41:04.305 INFO:tasks.workunit.client.0.smithi012.stderr: -427> 2023-10-05T11:41:04.146+0000 7fa0ea444880 5 AuthRegistry(0x55f0ca40d340) adding con mode: secure 2023-10-05T11:41:04.305 INFO:tasks.workunit.client.0.smithi012.stderr: -426> 2023-10-05T11:41:04.146+0000 7fa0ea444880 5 AuthRegistry(0x55f0ca40d340) adding con mode: crc 2023-10-05T11:41:04.305 INFO:tasks.workunit.client.0.smithi012.stderr: -425> 2023-10-05T11:41:04.146+0000 7fa0ea444880 5 AuthRegistry(0x55f0ca40d340) adding con mode: secure 2023-10-05T11:41:04.305 INFO:tasks.workunit.client.0.smithi012.stderr: -424> 2023-10-05T11:41:04.146+0000 7fa0ea444880 5 AuthRegistry(0x55f0ca40d340) adding con mode: crc 2023-10-05T11:41:04.305 INFO:tasks.workunit.client.0.smithi012.stderr: -423> 2023-10-05T11:41:04.146+0000 7fa0ea444880 5 AuthRegistry(0x55f0ca40d340) adding con mode: secure 2023-10-05T11:41:04.305 INFO:tasks.workunit.client.0.smithi012.stderr: -422> 2023-10-05T11:41:04.147+0000 7fa0ea444880 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-10-05T11:41:04.305 INFO:tasks.workunit.client.0.smithi012.stderr: -421> 2023-10-05T11:41:04.147+0000 7fa0ea444880 1 librados: starting msgr at 2023-10-05T11:41:04.305 INFO:tasks.workunit.client.0.smithi012.stderr: -420> 2023-10-05T11:41:04.147+0000 7fa0ea444880 1 librados: starting objecter 2023-10-05T11:41:04.305 INFO:tasks.workunit.client.0.smithi012.stderr: -419> 2023-10-05T11:41:04.147+0000 7fa0ea444880 5 asok(0x55f0c995c000) register_command objecter_requests cmddesc objecter_requests hook 0x55f0c970b510 EEXIST 2023-10-05T11:41:04.305 INFO:tasks.workunit.client.0.smithi012.stderr: -418> 2023-10-05T11:41:04.147+0000 7fa0ea444880 1 librados: setting wanted keys 2023-10-05T11:41:04.305 INFO:tasks.workunit.client.0.smithi012.stderr: -417> 2023-10-05T11:41:04.147+0000 7fa0ea444880 1 librados: calling monclient init 2023-10-05T11:41:04.305 INFO:tasks.workunit.client.0.smithi012.stderr: -416> 2023-10-05T11:41:04.147+0000 7fa0ea444880 10 monclient: init 2023-10-05T11:41:04.306 INFO:tasks.workunit.client.0.smithi012.stderr: -415> 2023-10-05T11:41:04.147+0000 7fa0ea444880 5 AuthRegistry(0x55f0c97bb0d8) adding auth protocol: cephx 2023-10-05T11:41:04.306 INFO:tasks.workunit.client.0.smithi012.stderr: -414> 2023-10-05T11:41:04.147+0000 7fa0ea444880 5 AuthRegistry(0x55f0c97bb0d8) adding auth protocol: cephx 2023-10-05T11:41:04.306 INFO:tasks.workunit.client.0.smithi012.stderr: -413> 2023-10-05T11:41:04.147+0000 7fa0ea444880 5 AuthRegistry(0x55f0c97bb0d8) adding auth protocol: cephx 2023-10-05T11:41:04.306 INFO:tasks.workunit.client.0.smithi012.stderr: -412> 2023-10-05T11:41:04.147+0000 7fa0ea444880 5 AuthRegistry(0x55f0c97bb0d8) adding con mode: secure 2023-10-05T11:41:04.306 INFO:tasks.workunit.client.0.smithi012.stderr: -411> 2023-10-05T11:41:04.147+0000 7fa0ea444880 5 AuthRegistry(0x55f0c97bb0d8) adding con mode: crc 2023-10-05T11:41:04.306 INFO:tasks.workunit.client.0.smithi012.stderr: -410> 2023-10-05T11:41:04.147+0000 7fa0ea444880 5 AuthRegistry(0x55f0c97bb0d8) adding con mode: secure 2023-10-05T11:41:04.307 INFO:tasks.workunit.client.0.smithi012.stderr: -409> 2023-10-05T11:41:04.147+0000 7fa0ea444880 5 AuthRegistry(0x55f0c97bb0d8) adding con mode: crc 2023-10-05T11:41:04.307 INFO:tasks.workunit.client.0.smithi012.stderr: -408> 2023-10-05T11:41:04.147+0000 7fa0ea444880 5 AuthRegistry(0x55f0c97bb0d8) adding con mode: secure 2023-10-05T11:41:04.307 INFO:tasks.workunit.client.0.smithi012.stderr: -407> 2023-10-05T11:41:04.147+0000 7fa0ea444880 5 AuthRegistry(0x55f0c97bb0d8) adding con mode: crc 2023-10-05T11:41:04.307 INFO:tasks.workunit.client.0.smithi012.stderr: -406> 2023-10-05T11:41:04.147+0000 7fa0ea444880 5 AuthRegistry(0x55f0c97bb0d8) adding con mode: crc 2023-10-05T11:41:04.307 INFO:tasks.workunit.client.0.smithi012.stderr: -405> 2023-10-05T11:41:04.147+0000 7fa0ea444880 5 AuthRegistry(0x55f0c97bb0d8) adding con mode: secure 2023-10-05T11:41:04.307 INFO:tasks.workunit.client.0.smithi012.stderr: -404> 2023-10-05T11:41:04.147+0000 7fa0ea444880 5 AuthRegistry(0x55f0c97bb0d8) adding con mode: crc 2023-10-05T11:41:04.308 INFO:tasks.workunit.client.0.smithi012.stderr: -403> 2023-10-05T11:41:04.147+0000 7fa0ea444880 5 AuthRegistry(0x55f0c97bb0d8) adding con mode: secure 2023-10-05T11:41:04.308 INFO:tasks.workunit.client.0.smithi012.stderr: -402> 2023-10-05T11:41:04.147+0000 7fa0ea444880 5 AuthRegistry(0x55f0c97bb0d8) adding con mode: crc 2023-10-05T11:41:04.308 INFO:tasks.workunit.client.0.smithi012.stderr: -401> 2023-10-05T11:41:04.147+0000 7fa0ea444880 5 AuthRegistry(0x55f0c97bb0d8) adding con mode: secure 2023-10-05T11:41:04.308 INFO:tasks.workunit.client.0.smithi012.stderr: -400> 2023-10-05T11:41:04.147+0000 7fa0ea444880 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-10-05T11:41:04.308 INFO:tasks.workunit.client.0.smithi012.stderr: -399> 2023-10-05T11:41:04.147+0000 7fa0ea444880 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-10-05T11:41:04.308 INFO:tasks.workunit.client.0.smithi012.stderr: -398> 2023-10-05T11:41:04.147+0000 7fa0ea444880 5 asok(0x55f0c995c000) register_command rotate-key cmddesc rotate-key hook 0x55f0c97bb220 EEXIST 2023-10-05T11:41:04.308 INFO:tasks.workunit.client.0.smithi012.stderr: -397> 2023-10-05T11:41:04.147+0000 7fa0ea444880 10 monclient: _reopen_session rank -1 2023-10-05T11:41:04.309 INFO:tasks.workunit.client.0.smithi012.stderr: -396> 2023-10-05T11:41:04.147+0000 7fa0ea444880 10 monclient: _add_conns ranks=[0,2,1] 2023-10-05T11:41:04.309 INFO:tasks.workunit.client.0.smithi012.stderr: -395> 2023-10-05T11:41:04.147+0000 7fa0ea444880 10 monclient(hunting): picked mon.noname-a con 0x55f0ca55c800 addr [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] 2023-10-05T11:41:04.309 INFO:tasks.workunit.client.0.smithi012.stderr: -394> 2023-10-05T11:41:04.147+0000 7fa0ea444880 10 monclient(hunting): picked mon.noname-c con 0x55f0ca55cc00 addr [v2:172.21.15.12:3301/0,v1:172.21.15.12:6790/0] 2023-10-05T11:41:04.309 INFO:tasks.workunit.client.0.smithi012.stderr: -393> 2023-10-05T11:41:04.147+0000 7fa0ea444880 10 monclient(hunting): picked mon.noname-b con 0x55f0ca55d000 addr [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] 2023-10-05T11:41:04.309 INFO:tasks.workunit.client.0.smithi012.stderr: -392> 2023-10-05T11:41:04.147+0000 7fa0ea444880 10 monclient(hunting): start opening mon connection 2023-10-05T11:41:04.309 INFO:tasks.workunit.client.0.smithi012.stderr: -391> 2023-10-05T11:41:04.147+0000 7fa0ea444880 10 monclient(hunting): start opening mon connection 2023-10-05T11:41:04.309 INFO:tasks.workunit.client.0.smithi012.stderr: -390> 2023-10-05T11:41:04.147+0000 7fa0ea444880 10 monclient(hunting): start opening mon connection 2023-10-05T11:41:04.310 INFO:tasks.workunit.client.0.smithi012.stderr: -389> 2023-10-05T11:41:04.147+0000 7fa0ea444880 10 monclient(hunting): _renew_subs 2023-10-05T11:41:04.310 INFO:tasks.workunit.client.0.smithi012.stderr: -388> 2023-10-05T11:41:04.147+0000 7fa0ea444880 10 monclient(hunting): authenticate will time out at 1572.316211s 2023-10-05T11:41:04.310 INFO:tasks.workunit.client.0.smithi012.stderr: -387> 2023-10-05T11:41:04.147+0000 7fa0e83e8640 10 monclient(hunting): get_auth_request con 0x55f0ca55cc00 auth_method 0 2023-10-05T11:41:04.310 INFO:tasks.workunit.client.0.smithi012.stderr: -386> 2023-10-05T11:41:04.147+0000 7fa0e83e8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-10-05T11:41:04.310 INFO:tasks.workunit.client.0.smithi012.stderr: -385> 2023-10-05T11:41:04.147+0000 7fa0e83e8640 10 monclient(hunting): _init_auth method 2 2023-10-05T11:41:04.310 INFO:tasks.workunit.client.0.smithi012.stderr: -384> 2023-10-05T11:41:04.147+0000 7fa0e83e8640 10 monclient(hunting): _init_auth creating new auth 2023-10-05T11:41:04.311 INFO:tasks.workunit.client.0.smithi012.stderr: -383> 2023-10-05T11:41:04.147+0000 7fa0e8be9640 10 monclient(hunting): get_auth_request con 0x55f0ca55c800 auth_method 0 2023-10-05T11:41:04.311 INFO:tasks.workunit.client.0.smithi012.stderr: -382> 2023-10-05T11:41:04.147+0000 7fa0e8be9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-10-05T11:41:04.311 INFO:tasks.workunit.client.0.smithi012.stderr: -381> 2023-10-05T11:41:04.147+0000 7fa0e8be9640 10 monclient(hunting): _init_auth method 2 2023-10-05T11:41:04.311 INFO:tasks.workunit.client.0.smithi012.stderr: -380> 2023-10-05T11:41:04.147+0000 7fa0e8be9640 10 monclient(hunting): _init_auth creating new auth 2023-10-05T11:41:04.311 INFO:tasks.workunit.client.0.smithi012.stderr: -379> 2023-10-05T11:41:04.147+0000 7fa0e93ea640 10 monclient(hunting): get_auth_request con 0x55f0ca55d000 auth_method 0 2023-10-05T11:41:04.311 INFO:tasks.workunit.client.0.smithi012.stderr: -378> 2023-10-05T11:41:04.147+0000 7fa0e93ea640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-10-05T11:41:04.311 INFO:tasks.workunit.client.0.smithi012.stderr: -377> 2023-10-05T11:41:04.147+0000 7fa0e93ea640 10 monclient(hunting): _init_auth method 2 2023-10-05T11:41:04.311 INFO:tasks.workunit.client.0.smithi012.stderr: -376> 2023-10-05T11:41:04.147+0000 7fa0e93ea640 10 monclient(hunting): _init_auth creating new auth 2023-10-05T11:41:04.311 INFO:tasks.workunit.client.0.smithi012.stderr: -375> 2023-10-05T11:41:04.147+0000 7fa0e83e8640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-10-05T11:41:04.311 INFO:tasks.workunit.client.0.smithi012.stderr: -374> 2023-10-05T11:41:04.147+0000 7fa0e83e8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-10-05T11:41:04.312 INFO:tasks.workunit.client.0.smithi012.stderr: -373> 2023-10-05T11:41:04.147+0000 7fa0e83e8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-10-05T11:41:04.313 INFO:tasks.workunit.client.0.smithi012.stderr: -372> 2023-10-05T11:41:04.147+0000 7fa0e8be9640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-10-05T11:41:04.313 INFO:tasks.workunit.client.0.smithi012.stderr: -371> 2023-10-05T11:41:04.147+0000 7fa0e8be9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-10-05T11:41:04.313 INFO:tasks.workunit.client.0.smithi012.stderr: -370> 2023-10-05T11:41:04.147+0000 7fa0e8be9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-10-05T11:41:04.313 INFO:tasks.workunit.client.0.smithi012.stderr: -369> 2023-10-05T11:41:04.148+0000 7fa0e93ea640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-10-05T11:41:04.313 INFO:tasks.workunit.client.0.smithi012.stderr: -368> 2023-10-05T11:41:04.148+0000 7fa0e93ea640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-10-05T11:41:04.313 INFO:tasks.workunit.client.0.smithi012.stderr: -367> 2023-10-05T11:41:04.148+0000 7fa0e93ea640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-10-05T11:41:04.314 INFO:tasks.workunit.client.0.smithi012.stderr: -366> 2023-10-05T11:41:04.148+0000 7fa0e8be9640 10 monclient(hunting): handle_auth_done global_id 7140 payload 824 2023-10-05T11:41:04.314 INFO:tasks.workunit.client.0.smithi012.stderr: -365> 2023-10-05T11:41:04.148+0000 7fa0e8be9640 10 monclient: _finish_hunting 0 2023-10-05T11:41:04.314 INFO:tasks.workunit.client.0.smithi012.stderr: -364> 2023-10-05T11:41:04.148+0000 7fa0e8be9640 1 monclient: found mon.noname-a 2023-10-05T11:41:04.314 INFO:tasks.workunit.client.0.smithi012.stderr: -363> 2023-10-05T11:41:04.148+0000 7fa0e8be9640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.12:3300/0 2023-10-05T11:41:04.314 INFO:tasks.workunit.client.0.smithi012.stderr: -362> 2023-10-05T11:41:04.148+0000 7fa0e1bdb640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-10-05T11:41:04.314 INFO:tasks.workunit.client.0.smithi012.stderr: -361> 2023-10-05T11:41:04.148+0000 7fa0e1bdb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2023-10-05T11:41:04.314 INFO:tasks.workunit.client.0.smithi012.stderr: -360> 2023-10-05T11:41:04.148+0000 7fa0e1bdb640 10 monclient: dump: 2023-10-05T11:41:04.314 INFO:tasks.workunit.client.0.smithi012.stderr:epoch 1 2023-10-05T11:41:04.314 INFO:tasks.workunit.client.0.smithi012.stderr:fsid 7e015f46-293b-4b09-bd32-7d32b52f6e2f 2023-10-05T11:41:04.315 INFO:tasks.workunit.client.0.smithi012.stderr:last_changed 2023-10-05T11:27:38.366888+0000 2023-10-05T11:41:04.315 INFO:tasks.workunit.client.0.smithi012.stderr:created 2023-10-05T11:27:38.366888+0000 2023-10-05T11:41:04.315 INFO:tasks.workunit.client.0.smithi012.stderr:min_mon_release 18 (reef) 2023-10-05T11:41:04.315 INFO:tasks.workunit.client.0.smithi012.stderr:election_strategy: 1 2023-10-05T11:41:04.315 INFO:tasks.workunit.client.0.smithi012.stderr:0: [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon.a 2023-10-05T11:41:04.315 INFO:tasks.workunit.client.0.smithi012.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2023-10-05T11:41:04.315 INFO:tasks.workunit.client.0.smithi012.stderr:2: [v2:172.21.15.12:3301/0,v1:172.21.15.12:6790/0] mon.c 2023-10-05T11:41:04.315 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:41:04.315 INFO:tasks.workunit.client.0.smithi012.stderr: -359> 2023-10-05T11:41:04.148+0000 7fa0e1bdb640 10 monclient: _finish_auth 0 2023-10-05T11:41:04.315 INFO:tasks.workunit.client.0.smithi012.stderr: -358> 2023-10-05T11:41:04.148+0000 7fa0e1bdb640 10 monclient: _check_auth_tickets 2023-10-05T11:41:04.315 INFO:tasks.workunit.client.0.smithi012.stderr: -357> 2023-10-05T11:41:04.148+0000 7fa0e1bdb640 10 monclient: handle_config config(0 keys) v1 2023-10-05T11:41:04.315 INFO:tasks.workunit.client.0.smithi012.stderr: -356> 2023-10-05T11:41:04.148+0000 7fa0e1bdb640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-10-05T11:41:04.316 INFO:tasks.workunit.client.0.smithi012.stderr: -355> 2023-10-05T11:41:04.148+0000 7fa0e1bdb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2023-10-05T11:41:04.316 INFO:tasks.workunit.client.0.smithi012.stderr: -354> 2023-10-05T11:41:04.148+0000 7fa0e1bdb640 10 monclient: dump: 2023-10-05T11:41:04.316 INFO:tasks.workunit.client.0.smithi012.stderr:epoch 1 2023-10-05T11:41:04.316 INFO:tasks.workunit.client.0.smithi012.stderr:fsid 7e015f46-293b-4b09-bd32-7d32b52f6e2f 2023-10-05T11:41:04.316 INFO:tasks.workunit.client.0.smithi012.stderr:last_changed 2023-10-05T11:27:38.366888+0000 2023-10-05T11:41:04.316 INFO:tasks.workunit.client.0.smithi012.stderr:created 2023-10-05T11:27:38.366888+0000 2023-10-05T11:41:04.316 INFO:tasks.workunit.client.0.smithi012.stderr:min_mon_release 18 (reef) 2023-10-05T11:41:04.316 INFO:tasks.workunit.client.0.smithi012.stderr:election_strategy: 1 2023-10-05T11:41:04.316 INFO:tasks.workunit.client.0.smithi012.stderr:0: [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon.a 2023-10-05T11:41:04.316 INFO:tasks.workunit.client.0.smithi012.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2023-10-05T11:41:04.316 INFO:tasks.workunit.client.0.smithi012.stderr:2: [v2:172.21.15.12:3301/0,v1:172.21.15.12:6790/0] mon.c 2023-10-05T11:41:04.316 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:41:04.317 INFO:tasks.workunit.client.0.smithi012.stderr: -353> 2023-10-05T11:41:04.148+0000 7fa0e33de640 4 set_mon_vals no callback set 2023-10-05T11:41:04.317 INFO:tasks.workunit.client.0.smithi012.stderr: -352> 2023-10-05T11:41:04.148+0000 7fa0ea444880 5 monclient: authenticate success, global_id 7140 2023-10-05T11:41:04.317 INFO:tasks.workunit.client.0.smithi012.stderr: -351> 2023-10-05T11:41:04.148+0000 7fa0ea444880 10 monclient: _renew_subs 2023-10-05T11:41:04.317 INFO:tasks.workunit.client.0.smithi012.stderr: -350> 2023-10-05T11:41:04.148+0000 7fa0ea444880 10 monclient: _send_mon_message to mon.a at v2:172.21.15.12:3300/0 2023-10-05T11:41:04.317 INFO:tasks.workunit.client.0.smithi012.stderr: -349> 2023-10-05T11:41:04.148+0000 7fa0ea444880 10 monclient: _renew_subs 2023-10-05T11:41:04.317 INFO:tasks.workunit.client.0.smithi012.stderr: -348> 2023-10-05T11:41:04.148+0000 7fa0ea444880 10 monclient: _send_mon_message to mon.a at v2:172.21.15.12:3300/0 2023-10-05T11:41:04.317 INFO:tasks.workunit.client.0.smithi012.stderr: -347> 2023-10-05T11:41:04.148+0000 7fa0ea444880 1 librados: init done 2023-10-05T11:41:04.317 INFO:tasks.workunit.client.0.smithi012.stderr: -346> 2023-10-05T11:41:04.149+0000 7fa0ea444880 20 rados->read ofs=0 len=0 2023-10-05T11:41:04.317 INFO:tasks.workunit.client.0.smithi012.stderr: -345> 2023-10-05T11:41:04.150+0000 7fa0e1bdb640 4 mgrc handle_mgr_map Got map version 5 2023-10-05T11:41:04.317 INFO:tasks.workunit.client.0.smithi012.stderr: -344> 2023-10-05T11:41:04.150+0000 7fa0e1bdb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.170:6832/180516904,v1:172.21.15.170:6833/180516904] 2023-10-05T11:41:04.317 INFO:tasks.workunit.client.0.smithi012.stderr: -343> 2023-10-05T11:41:04.150+0000 7fa0e1bdb640 4 mgrc reconnect Starting new session with [v2:172.21.15.170:6832/180516904,v1:172.21.15.170:6833/180516904] 2023-10-05T11:41:04.317 INFO:tasks.workunit.client.0.smithi012.stderr: -342> 2023-10-05T11:41:04.150+0000 7fa0e83e8640 10 monclient: get_auth_request con 0x55f0c9a29800 auth_method 0 2023-10-05T11:41:04.317 INFO:tasks.workunit.client.0.smithi012.stderr: -341> 2023-10-05T11:41:04.150+0000 7fa0e93ea640 10 monclient: get_auth_request con 0x55f0ca55d400 auth_method 0 2023-10-05T11:41:04.318 INFO:tasks.workunit.client.0.smithi012.stderr: -340> 2023-10-05T11:41:04.151+0000 7fa0ea444880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:04.318 INFO:tasks.workunit.client.0.smithi012.stderr: -339> 2023-10-05T11:41:04.151+0000 7fa0ea444880 20 realm 2023-10-05T11:41:04.318 INFO:tasks.workunit.client.0.smithi012.stderr: -338> 2023-10-05T11:41:04.151+0000 7fa0ea444880 20 rados->read ofs=0 len=0 2023-10-05T11:41:04.318 INFO:tasks.workunit.client.0.smithi012.stderr: -337> 2023-10-05T11:41:04.151+0000 7fa0ea444880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:04.318 INFO:tasks.workunit.client.0.smithi012.stderr: -336> 2023-10-05T11:41:04.151+0000 7fa0ea444880 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T11:41:04.318 INFO:tasks.workunit.client.0.smithi012.stderr: -335> 2023-10-05T11:41:04.151+0000 7fa0ea444880 20 rados->read ofs=0 len=0 2023-10-05T11:41:04.318 INFO:tasks.workunit.client.0.smithi012.stderr: -334> 2023-10-05T11:41:04.151+0000 7fa0ea444880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:04.318 INFO:tasks.workunit.client.0.smithi012.stderr: -333> 2023-10-05T11:41:04.151+0000 7fa0ea444880 20 rados->read ofs=0 len=0 2023-10-05T11:41:04.318 INFO:tasks.workunit.client.0.smithi012.stderr: -332> 2023-10-05T11:41:04.151+0000 7fa0e8be9640 10 monclient: get_auth_request con 0x55f0ca55d800 auth_method 0 2023-10-05T11:41:04.318 INFO:tasks.workunit.client.0.smithi012.stderr: -331> 2023-10-05T11:41:04.152+0000 7fa0ea444880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:41:04.318 INFO:tasks.workunit.client.0.smithi012.stderr: -330> 2023-10-05T11:41:04.152+0000 7fa0ea444880 20 rados->read ofs=0 len=0 2023-10-05T11:41:04.319 INFO:tasks.workunit.client.0.smithi012.stderr: -329> 2023-10-05T11:41:04.152+0000 7fa0e83e8640 10 monclient: get_auth_request con 0x55f0c9a29c00 auth_method 0 2023-10-05T11:41:04.319 INFO:tasks.workunit.client.0.smithi012.stderr: -328> 2023-10-05T11:41:04.152+0000 7fa0ea444880 20 rados_obj.operate() r=0 bl.length=1020 2023-10-05T11:41:04.319 INFO:tasks.workunit.client.0.smithi012.stderr: -327> 2023-10-05T11:41:04.152+0000 7fa0ea444880 20 searching for the correct realm 2023-10-05T11:41:04.319 INFO:tasks.workunit.client.0.smithi012.stderr: -326> 2023-10-05T11:41:04.153+0000 7fa0e93ea640 10 monclient: get_auth_request con 0x55f0c9b1c000 auth_method 0 2023-10-05T11:41:04.319 INFO:tasks.workunit.client.0.smithi012.stderr: -325> 2023-10-05T11:41:04.154+0000 7fa0e8be9640 10 monclient: get_auth_request con 0x55f0c9773400 auth_method 0 2023-10-05T11:41:04.319 INFO:tasks.workunit.client.0.smithi012.stderr: -324> 2023-10-05T11:41:04.154+0000 7fa0e83e8640 10 monclient: get_auth_request con 0x55f0c9b1dc00 auth_method 0 2023-10-05T11:41:04.319 INFO:tasks.workunit.client.0.smithi012.stderr: -323> 2023-10-05T11:41:04.156+0000 7fa0e93ea640 10 monclient: get_auth_request con 0x55f0c9b2c000 auth_method 0 2023-10-05T11:41:04.319 INFO:tasks.workunit.client.0.smithi012.stderr: -322> 2023-10-05T11:41:04.158+0000 7fa0e8be9640 10 monclient: get_auth_request con 0x55f0c9b2c400 auth_method 0 2023-10-05T11:41:04.319 INFO:tasks.workunit.client.0.smithi012.stderr: -321> 2023-10-05T11:41:04.161+0000 7fa0e93ea640 0 -- 172.21.15.12:0/2179683232 >> [v2:172.21.15.12:6824/2171933159,v1:172.21.15.12:6825/2171933159] conn(0x55f0c9b1c000 msgr2=0x55f0c9963700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-10-05T11:41:04.319 INFO:tasks.workunit.client.0.smithi012.stderr: -320> 2023-10-05T11:41:04.161+0000 7fa0e1bdb640 1 client.7140.objecter ms_handle_reset 0x55f0c9b1c000 session 0x55f0c9956d80 osd.3 2023-10-05T11:41:04.319 INFO:tasks.workunit.client.0.smithi012.stderr: -319> 2023-10-05T11:41:04.161+0000 7fa0e1bdb640 10 monclient: _renew_subs 2023-10-05T11:41:04.319 INFO:tasks.workunit.client.0.smithi012.stderr: -318> 2023-10-05T11:41:04.161+0000 7fa0e1bdb640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.12:3300/0 2023-10-05T11:41:04.319 INFO:tasks.workunit.client.0.smithi012.stderr: -317> 2023-10-05T11:41:04.161+0000 7fa0e93ea640 10 monclient: get_auth_request con 0x55f0c9b2d000 auth_method 0 2023-10-05T11:41:04.320 INFO:tasks.workunit.client.0.smithi012.stderr: -316> 2023-10-05T11:41:04.163+0000 7fa0ea444880 20 RGWRados::pool_iterate: got zone_info.dff27d1e-df33-400e-a68a-7ba586947c99 2023-10-05T11:41:04.320 INFO:tasks.workunit.client.0.smithi012.stderr: -315> 2023-10-05T11:41:04.163+0000 7fa0ea444880 20 RGWRados::pool_iterate: got zonegroup_info.c78aa576-9d15-4e9d-b3c0-4af23a22062c 2023-10-05T11:41:04.320 INFO:tasks.workunit.client.0.smithi012.stderr: -314> 2023-10-05T11:41:04.163+0000 7fa0ea444880 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T11:41:04.320 INFO:tasks.workunit.client.0.smithi012.stderr: -313> 2023-10-05T11:41:04.163+0000 7fa0ea444880 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T11:41:04.320 INFO:tasks.workunit.client.0.smithi012.stderr: -312> 2023-10-05T11:41:04.163+0000 7fa0ea444880 20 rados->read ofs=0 len=0 2023-10-05T11:41:04.320 INFO:tasks.workunit.client.0.smithi012.stderr: -311> 2023-10-05T11:41:04.163+0000 7fa0ea444880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:04.320 INFO:tasks.workunit.client.0.smithi012.stderr: -310> 2023-10-05T11:41:04.163+0000 7fa0ea444880 20 rados->read ofs=0 len=0 2023-10-05T11:41:04.320 INFO:tasks.workunit.client.0.smithi012.stderr: -309> 2023-10-05T11:41:04.164+0000 7fa0ea444880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:41:04.320 INFO:tasks.workunit.client.0.smithi012.stderr: -308> 2023-10-05T11:41:04.164+0000 7fa0ea444880 20 rados->read ofs=0 len=0 2023-10-05T11:41:04.320 INFO:tasks.workunit.client.0.smithi012.stderr: -307> 2023-10-05T11:41:04.164+0000 7fa0ea444880 20 rados_obj.operate() r=0 bl.length=454 2023-10-05T11:41:04.320 INFO:tasks.workunit.client.0.smithi012.stderr: -306> 2023-10-05T11:41:04.164+0000 7fa0ea444880 20 zone default found 2023-10-05T11:41:04.320 INFO:tasks.workunit.client.0.smithi012.stderr: -305> 2023-10-05T11:41:04.164+0000 7fa0ea444880 4 Realm: () 2023-10-05T11:41:04.321 INFO:tasks.workunit.client.0.smithi012.stderr: -304> 2023-10-05T11:41:04.164+0000 7fa0ea444880 4 ZoneGroup: default (c78aa576-9d15-4e9d-b3c0-4af23a22062c) 2023-10-05T11:41:04.321 INFO:tasks.workunit.client.0.smithi012.stderr: -303> 2023-10-05T11:41:04.164+0000 7fa0ea444880 4 Zone: default (dff27d1e-df33-400e-a68a-7ba586947c99) 2023-10-05T11:41:04.321 INFO:tasks.workunit.client.0.smithi012.stderr: -302> 2023-10-05T11:41:04.164+0000 7fa0ea444880 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T11:41:04.321 INFO:tasks.workunit.client.0.smithi012.stderr: -301> 2023-10-05T11:41:04.164+0000 7fa0ea444880 20 zonegroup default 2023-10-05T11:41:04.321 INFO:tasks.workunit.client.0.smithi012.stderr: -300> 2023-10-05T11:41:04.164+0000 7fa0ea444880 20 rados->read ofs=0 len=0 2023-10-05T11:41:04.321 INFO:tasks.workunit.client.0.smithi012.stderr: -299> 2023-10-05T11:41:04.164+0000 7fa0ea444880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:04.321 INFO:tasks.workunit.client.0.smithi012.stderr: -298> 2023-10-05T11:41:04.164+0000 7fa0ea444880 20 rados->read ofs=0 len=0 2023-10-05T11:41:04.321 INFO:tasks.workunit.client.0.smithi012.stderr: -297> 2023-10-05T11:41:04.165+0000 7fa0ea444880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:04.321 INFO:tasks.workunit.client.0.smithi012.stderr: -296> 2023-10-05T11:41:04.165+0000 7fa0ea444880 20 rados->read ofs=0 len=0 2023-10-05T11:41:04.321 INFO:tasks.workunit.client.0.smithi012.stderr: -295> 2023-10-05T11:41:04.165+0000 7fa0ea444880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:04.321 INFO:tasks.workunit.client.0.smithi012.stderr: -294> 2023-10-05T11:41:04.165+0000 7fa0ea444880 20 started sync module instance, tier type = 2023-10-05T11:41:04.322 INFO:tasks.workunit.client.0.smithi012.stderr: -293> 2023-10-05T11:41:04.165+0000 7fa0ea444880 20 started zone id=dff27d1e-df33-400e-a68a-7ba586947c99 (name=default) with tier type = 2023-10-05T11:41:04.322 INFO:tasks.workunit.client.0.smithi012.stderr: -292> 2023-10-05T11:41:04.169+0000 7fa0e83e8640 0 -- 172.21.15.12:0/2179683232 >> [v2:172.21.15.170:6824/75773779,v1:172.21.15.170:6825/75773779] conn(0x55f0c9a29c00 msgr2=0x55f0c9963180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:41:04.322 INFO:tasks.workunit.client.0.smithi012.stderr: -291> 2023-10-05T11:41:04.169+0000 7fa0e1bdb640 1 client.7140.objecter ms_handle_reset 0x55f0c9a29c00 session 0x55f0c9956f00 osd.7 2023-10-05T11:41:04.322 INFO:tasks.workunit.client.0.smithi012.stderr: -290> 2023-10-05T11:41:04.169+0000 7fa0e83e8640 10 monclient: get_auth_request con 0x55f0c9b1c000 auth_method 0 2023-10-05T11:41:04.322 INFO:tasks.workunit.client.0.smithi012.stderr: -289> 2023-10-05T11:41:04.174+0000 7fa0ea444880 20 add_watcher() i=0 2023-10-05T11:41:04.322 INFO:tasks.workunit.client.0.smithi012.stderr: -288> 2023-10-05T11:41:04.174+0000 7fa0ea444880 20 add_watcher() i=1 2023-10-05T11:41:04.322 INFO:tasks.workunit.client.0.smithi012.stderr: -287> 2023-10-05T11:41:04.174+0000 7fa0ea444880 20 add_watcher() i=2 2023-10-05T11:41:04.322 INFO:tasks.workunit.client.0.smithi012.stderr: -286> 2023-10-05T11:41:04.174+0000 7fa0ea444880 20 add_watcher() i=3 2023-10-05T11:41:04.322 INFO:tasks.workunit.client.0.smithi012.stderr: -285> 2023-10-05T11:41:04.174+0000 7fa0ea444880 20 add_watcher() i=4 2023-10-05T11:41:04.322 INFO:tasks.workunit.client.0.smithi012.stderr: -284> 2023-10-05T11:41:04.174+0000 7fa0ea444880 20 add_watcher() i=5 2023-10-05T11:41:04.322 INFO:tasks.workunit.client.0.smithi012.stderr: -283> 2023-10-05T11:41:04.174+0000 7fa0ea444880 20 add_watcher() i=6 2023-10-05T11:41:04.322 INFO:tasks.workunit.client.0.smithi012.stderr: -282> 2023-10-05T11:41:04.175+0000 7fa0ea444880 20 add_watcher() i=7 2023-10-05T11:41:04.323 INFO:tasks.workunit.client.0.smithi012.stderr: -281> 2023-10-05T11:41:04.175+0000 7fa0ea444880 2 all 8 watchers are set, enabling cache 2023-10-05T11:41:04.323 INFO:tasks.workunit.client.0.smithi012.stderr: -280> 2023-10-05T11:41:04.176+0000 7fa0ea444880 5 AuthRegistry(0x7ffdbe4c7b30) adding auth protocol: cephx 2023-10-05T11:41:04.323 INFO:tasks.workunit.client.0.smithi012.stderr: -279> 2023-10-05T11:41:04.176+0000 7fa0ea444880 5 AuthRegistry(0x7ffdbe4c7b30) adding auth protocol: cephx 2023-10-05T11:41:04.323 INFO:tasks.workunit.client.0.smithi012.stderr: -278> 2023-10-05T11:41:04.176+0000 7fa0ea444880 5 AuthRegistry(0x7ffdbe4c7b30) adding auth protocol: cephx 2023-10-05T11:41:04.323 INFO:tasks.workunit.client.0.smithi012.stderr: -277> 2023-10-05T11:41:04.176+0000 7fa0ea444880 5 AuthRegistry(0x7ffdbe4c7b30) adding con mode: secure 2023-10-05T11:41:04.323 INFO:tasks.workunit.client.0.smithi012.stderr: -276> 2023-10-05T11:41:04.176+0000 7fa0ea444880 5 AuthRegistry(0x7ffdbe4c7b30) adding con mode: crc 2023-10-05T11:41:04.323 INFO:tasks.workunit.client.0.smithi012.stderr: -275> 2023-10-05T11:41:04.176+0000 7fa0ea444880 5 AuthRegistry(0x7ffdbe4c7b30) adding con mode: secure 2023-10-05T11:41:04.323 INFO:tasks.workunit.client.0.smithi012.stderr: -274> 2023-10-05T11:41:04.176+0000 7fa0ea444880 5 AuthRegistry(0x7ffdbe4c7b30) adding con mode: crc 2023-10-05T11:41:04.323 INFO:tasks.workunit.client.0.smithi012.stderr: -273> 2023-10-05T11:41:04.176+0000 7fa0ea444880 5 AuthRegistry(0x7ffdbe4c7b30) adding con mode: secure 2023-10-05T11:41:04.323 INFO:tasks.workunit.client.0.smithi012.stderr: -272> 2023-10-05T11:41:04.176+0000 7fa0cfbb7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:41:04.323 INFO:tasks.workunit.client.0.smithi012.stderr: -271> 2023-10-05T11:41:04.176+0000 7fa0ea444880 5 AuthRegistry(0x7ffdbe4c7b30) adding con mode: crc 2023-10-05T11:41:04.324 INFO:tasks.workunit.client.0.smithi012.stderr: -270> 2023-10-05T11:41:04.176+0000 7fa0ea444880 5 AuthRegistry(0x7ffdbe4c7b30) adding con mode: crc 2023-10-05T11:41:04.324 INFO:tasks.workunit.client.0.smithi012.stderr: -269> 2023-10-05T11:41:04.176+0000 7fa0ea444880 5 AuthRegistry(0x7ffdbe4c7b30) adding con mode: secure 2023-10-05T11:41:04.324 INFO:tasks.workunit.client.0.smithi012.stderr: -268> 2023-10-05T11:41:04.176+0000 7fa0ea444880 5 AuthRegistry(0x7ffdbe4c7b30) adding con mode: crc 2023-10-05T11:41:04.324 INFO:tasks.workunit.client.0.smithi012.stderr: -267> 2023-10-05T11:41:04.176+0000 7fa0ea444880 5 AuthRegistry(0x7ffdbe4c7b30) adding con mode: secure 2023-10-05T11:41:04.324 INFO:tasks.workunit.client.0.smithi012.stderr: -266> 2023-10-05T11:41:04.176+0000 7fa0ea444880 5 AuthRegistry(0x7ffdbe4c7b30) adding con mode: crc 2023-10-05T11:41:04.324 INFO:tasks.workunit.client.0.smithi012.stderr: -265> 2023-10-05T11:41:04.176+0000 7fa0ea444880 5 AuthRegistry(0x7ffdbe4c7b30) adding con mode: secure 2023-10-05T11:41:04.324 INFO:tasks.workunit.client.0.smithi012.stderr: -264> 2023-10-05T11:41:04.177+0000 7fa0ea444880 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-10-05T11:41:04.324 INFO:tasks.workunit.client.0.smithi012.stderr: -263> 2023-10-05T11:41:04.177+0000 7fa0ea444880 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T11:41:04.324 INFO:tasks.workunit.client.0.smithi012.stderr: -262> 2023-10-05T11:41:04.177+0000 7fa0ea444880 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T11:41:04.324 INFO:tasks.workunit.client.0.smithi012.stderr: -261> 2023-10-05T11:41:04.177+0000 7fa0ea444880 5 asok(0x55f0c995c000) register_command cache list hook 0x55f0c970b470 2023-10-05T11:41:04.324 INFO:tasks.workunit.client.0.smithi012.stderr: -260> 2023-10-05T11:41:04.177+0000 7fa0ea444880 5 asok(0x55f0c995c000) register_command cache inspect hook 0x55f0c970b470 2023-10-05T11:41:04.325 INFO:tasks.workunit.client.0.smithi012.stderr: -259> 2023-10-05T11:41:04.177+0000 7fa0ea444880 5 asok(0x55f0c995c000) register_command cache erase hook 0x55f0c970b470 2023-10-05T11:41:04.325 INFO:tasks.workunit.client.0.smithi012.stderr: -258> 2023-10-05T11:41:04.177+0000 7fa0ea444880 5 asok(0x55f0c995c000) register_command cache zap hook 0x55f0c970b470 2023-10-05T11:41:04.325 INFO:tasks.workunit.client.0.smithi012.stderr: -257> 2023-10-05T11:41:04.177+0000 7fa0ea444880 10 monclient: get_monmap_and_config 2023-10-05T11:41:04.325 INFO:tasks.workunit.client.0.smithi012.stderr: -256> 2023-10-05T11:41:04.177+0000 7fa0ea444880 10 monclient: build_initial_monmap 2023-10-05T11:41:04.325 INFO:tasks.workunit.client.0.smithi012.stderr: -255> 2023-10-05T11:41:04.177+0000 7fa0ea444880 1 build_initial for_mkfs: 0 2023-10-05T11:41:04.325 INFO:tasks.workunit.client.0.smithi012.stderr: -254> 2023-10-05T11:41:04.177+0000 7fa0ea444880 10 monclient: monmap: 2023-10-05T11:41:04.325 INFO:tasks.workunit.client.0.smithi012.stderr:epoch 0 2023-10-05T11:41:04.325 INFO:tasks.workunit.client.0.smithi012.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-10-05T11:41:04.325 INFO:tasks.workunit.client.0.smithi012.stderr:last_changed 0.000000 2023-10-05T11:41:04.325 INFO:tasks.workunit.client.0.smithi012.stderr:created 0.000000 2023-10-05T11:41:04.325 INFO:tasks.workunit.client.0.smithi012.stderr:min_mon_release 0 (unknown) 2023-10-05T11:41:04.326 INFO:tasks.workunit.client.0.smithi012.stderr:election_strategy: 1 2023-10-05T11:41:04.326 INFO:tasks.workunit.client.0.smithi012.stderr:0: [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon.noname-a 2023-10-05T11:41:04.326 INFO:tasks.workunit.client.0.smithi012.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.noname-b 2023-10-05T11:41:04.326 INFO:tasks.workunit.client.0.smithi012.stderr:2: [v2:172.21.15.12:3301/0,v1:172.21.15.12:6790/0] mon.noname-c 2023-10-05T11:41:04.326 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:41:04.326 INFO:tasks.workunit.client.0.smithi012.stderr: -253> 2023-10-05T11:41:04.177+0000 7fa0ea444880 5 AuthRegistry(0x55f0ca40dc40) adding auth protocol: cephx 2023-10-05T11:41:04.326 INFO:tasks.workunit.client.0.smithi012.stderr: -252> 2023-10-05T11:41:04.177+0000 7fa0ea444880 5 AuthRegistry(0x55f0ca40dc40) adding auth protocol: cephx 2023-10-05T11:41:04.326 INFO:tasks.workunit.client.0.smithi012.stderr: -251> 2023-10-05T11:41:04.177+0000 7fa0ea444880 5 AuthRegistry(0x55f0ca40dc40) adding auth protocol: cephx 2023-10-05T11:41:04.326 INFO:tasks.workunit.client.0.smithi012.stderr: -250> 2023-10-05T11:41:04.177+0000 7fa0ea444880 5 AuthRegistry(0x55f0ca40dc40) adding con mode: secure 2023-10-05T11:41:04.326 INFO:tasks.workunit.client.0.smithi012.stderr: -249> 2023-10-05T11:41:04.177+0000 7fa0ea444880 5 AuthRegistry(0x55f0ca40dc40) adding con mode: crc 2023-10-05T11:41:04.326 INFO:tasks.workunit.client.0.smithi012.stderr: -248> 2023-10-05T11:41:04.177+0000 7fa0ea444880 5 AuthRegistry(0x55f0ca40dc40) adding con mode: secure 2023-10-05T11:41:04.326 INFO:tasks.workunit.client.0.smithi012.stderr: -247> 2023-10-05T11:41:04.177+0000 7fa0ea444880 5 AuthRegistry(0x55f0ca40dc40) adding con mode: crc 2023-10-05T11:41:04.327 INFO:tasks.workunit.client.0.smithi012.stderr: -246> 2023-10-05T11:41:04.177+0000 7fa0ea444880 5 AuthRegistry(0x55f0ca40dc40) adding con mode: secure 2023-10-05T11:41:04.327 INFO:tasks.workunit.client.0.smithi012.stderr: -245> 2023-10-05T11:41:04.177+0000 7fa0ea444880 5 AuthRegistry(0x55f0ca40dc40) adding con mode: crc 2023-10-05T11:41:04.327 INFO:tasks.workunit.client.0.smithi012.stderr: -244> 2023-10-05T11:41:04.177+0000 7fa0ea444880 5 AuthRegistry(0x55f0ca40dc40) adding con mode: crc 2023-10-05T11:41:04.327 INFO:tasks.workunit.client.0.smithi012.stderr: -243> 2023-10-05T11:41:04.177+0000 7fa0ea444880 5 AuthRegistry(0x55f0ca40dc40) adding con mode: secure 2023-10-05T11:41:04.327 INFO:tasks.workunit.client.0.smithi012.stderr: -242> 2023-10-05T11:41:04.177+0000 7fa0ea444880 5 AuthRegistry(0x55f0ca40dc40) adding con mode: crc 2023-10-05T11:41:04.327 INFO:tasks.workunit.client.0.smithi012.stderr: -241> 2023-10-05T11:41:04.177+0000 7fa0ea444880 5 AuthRegistry(0x55f0ca40dc40) adding con mode: secure 2023-10-05T11:41:04.327 INFO:tasks.workunit.client.0.smithi012.stderr: -240> 2023-10-05T11:41:04.177+0000 7fa0ea444880 5 AuthRegistry(0x55f0ca40dc40) adding con mode: crc 2023-10-05T11:41:04.327 INFO:tasks.workunit.client.0.smithi012.stderr: -239> 2023-10-05T11:41:04.177+0000 7fa0ea444880 5 AuthRegistry(0x55f0ca40dc40) adding con mode: secure 2023-10-05T11:41:04.327 INFO:tasks.workunit.client.0.smithi012.stderr: -238> 2023-10-05T11:41:04.177+0000 7fa0ea444880 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-10-05T11:41:04.327 INFO:tasks.workunit.client.0.smithi012.stderr: -237> 2023-10-05T11:41:04.177+0000 7fa0ea444880 10 monclient: init 2023-10-05T11:41:04.327 INFO:tasks.workunit.client.0.smithi012.stderr: -236> 2023-10-05T11:41:04.177+0000 7fa0ea444880 5 AuthRegistry(0x7ffdbe4c7680) adding auth protocol: cephx 2023-10-05T11:41:04.327 INFO:tasks.workunit.client.0.smithi012.stderr: -235> 2023-10-05T11:41:04.177+0000 7fa0ea444880 5 AuthRegistry(0x7ffdbe4c7680) adding auth protocol: cephx 2023-10-05T11:41:04.328 INFO:tasks.workunit.client.0.smithi012.stderr: -234> 2023-10-05T11:41:04.177+0000 7fa0ea444880 5 AuthRegistry(0x7ffdbe4c7680) adding auth protocol: cephx 2023-10-05T11:41:04.328 INFO:tasks.workunit.client.0.smithi012.stderr: -233> 2023-10-05T11:41:04.177+0000 7fa0ea444880 5 AuthRegistry(0x7ffdbe4c7680) adding con mode: secure 2023-10-05T11:41:04.328 INFO:tasks.workunit.client.0.smithi012.stderr: -232> 2023-10-05T11:41:04.177+0000 7fa0ea444880 5 AuthRegistry(0x7ffdbe4c7680) adding con mode: crc 2023-10-05T11:41:04.328 INFO:tasks.workunit.client.0.smithi012.stderr: -231> 2023-10-05T11:41:04.177+0000 7fa0ea444880 5 AuthRegistry(0x7ffdbe4c7680) adding con mode: secure 2023-10-05T11:41:04.328 INFO:tasks.workunit.client.0.smithi012.stderr: -230> 2023-10-05T11:41:04.177+0000 7fa0ea444880 5 AuthRegistry(0x7ffdbe4c7680) adding con mode: crc 2023-10-05T11:41:04.328 INFO:tasks.workunit.client.0.smithi012.stderr: -229> 2023-10-05T11:41:04.177+0000 7fa0ea444880 5 AuthRegistry(0x7ffdbe4c7680) adding con mode: secure 2023-10-05T11:41:04.328 INFO:tasks.workunit.client.0.smithi012.stderr: -228> 2023-10-05T11:41:04.177+0000 7fa0ea444880 5 AuthRegistry(0x7ffdbe4c7680) adding con mode: crc 2023-10-05T11:41:04.328 INFO:tasks.workunit.client.0.smithi012.stderr: -227> 2023-10-05T11:41:04.177+0000 7fa0ea444880 5 AuthRegistry(0x7ffdbe4c7680) adding con mode: crc 2023-10-05T11:41:04.328 INFO:tasks.workunit.client.0.smithi012.stderr: -226> 2023-10-05T11:41:04.177+0000 7fa0ea444880 5 AuthRegistry(0x7ffdbe4c7680) adding con mode: secure 2023-10-05T11:41:04.328 INFO:tasks.workunit.client.0.smithi012.stderr: -225> 2023-10-05T11:41:04.177+0000 7fa0ea444880 5 AuthRegistry(0x7ffdbe4c7680) adding con mode: crc 2023-10-05T11:41:04.328 INFO:tasks.workunit.client.0.smithi012.stderr: -224> 2023-10-05T11:41:04.177+0000 7fa0ea444880 5 AuthRegistry(0x7ffdbe4c7680) adding con mode: secure 2023-10-05T11:41:04.328 INFO:tasks.workunit.client.0.smithi012.stderr: -223> 2023-10-05T11:41:04.177+0000 7fa0ea444880 5 AuthRegistry(0x7ffdbe4c7680) adding con mode: crc 2023-10-05T11:41:04.329 INFO:tasks.workunit.client.0.smithi012.stderr: -222> 2023-10-05T11:41:04.177+0000 7fa0ea444880 5 AuthRegistry(0x7ffdbe4c7680) adding con mode: secure 2023-10-05T11:41:04.329 INFO:tasks.workunit.client.0.smithi012.stderr: -221> 2023-10-05T11:41:04.177+0000 7fa0ea444880 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-10-05T11:41:04.329 INFO:tasks.workunit.client.0.smithi012.stderr: -220> 2023-10-05T11:41:04.177+0000 7fa0ea444880 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-10-05T11:41:04.329 INFO:tasks.workunit.client.0.smithi012.stderr: -219> 2023-10-05T11:41:04.177+0000 7fa0ea444880 5 asok(0x55f0c995c000) register_command rotate-key cmddesc rotate-key hook 0x7ffdbe4c77c8 EEXIST 2023-10-05T11:41:04.329 INFO:tasks.workunit.client.0.smithi012.stderr: -218> 2023-10-05T11:41:04.177+0000 7fa0ea444880 10 monclient: _reopen_session rank -1 2023-10-05T11:41:04.329 INFO:tasks.workunit.client.0.smithi012.stderr: -217> 2023-10-05T11:41:04.177+0000 7fa0ea444880 10 monclient: _add_conns ranks=[1,2,0] 2023-10-05T11:41:04.329 INFO:tasks.workunit.client.0.smithi012.stderr: -216> 2023-10-05T11:41:04.178+0000 7fa0ea444880 10 monclient(hunting): picked mon.noname-b con 0x55f0c9b3a800 addr [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] 2023-10-05T11:41:04.329 INFO:tasks.workunit.client.0.smithi012.stderr: -215> 2023-10-05T11:41:04.178+0000 7fa0ea444880 10 monclient(hunting): picked mon.noname-c con 0x55f0c9b3ac00 addr [v2:172.21.15.12:3301/0,v1:172.21.15.12:6790/0] 2023-10-05T11:41:04.329 INFO:tasks.workunit.client.0.smithi012.stderr: -214> 2023-10-05T11:41:04.178+0000 7fa0ea444880 10 monclient(hunting): picked mon.noname-a con 0x55f0c9b3b000 addr [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] 2023-10-05T11:41:04.329 INFO:tasks.workunit.client.0.smithi012.stderr: -213> 2023-10-05T11:41:04.178+0000 7fa0ea444880 10 monclient(hunting): start opening mon connection 2023-10-05T11:41:04.330 INFO:tasks.workunit.client.0.smithi012.stderr: -212> 2023-10-05T11:41:04.178+0000 7fa0ea444880 10 monclient(hunting): start opening mon connection 2023-10-05T11:41:04.330 INFO:tasks.workunit.client.0.smithi012.stderr: -211> 2023-10-05T11:41:04.178+0000 7fa0ea444880 10 monclient(hunting): start opening mon connection 2023-10-05T11:41:04.330 INFO:tasks.workunit.client.0.smithi012.stderr: -210> 2023-10-05T11:41:04.178+0000 7fa0ea444880 10 monclient(hunting): _renew_subs 2023-10-05T11:41:04.330 INFO:tasks.workunit.client.0.smithi012.stderr: -209> 2023-10-05T11:41:04.178+0000 7fa0ea444880 10 monclient(hunting): authenticate will time out at 1572.346477s 2023-10-05T11:41:04.330 INFO:tasks.workunit.client.0.smithi012.stderr: -208> 2023-10-05T11:41:04.178+0000 7fa0e83e8640 10 monclient(hunting): get_auth_request con 0x55f0c9b3b000 auth_method 0 2023-10-05T11:41:04.330 INFO:tasks.workunit.client.0.smithi012.stderr: -207> 2023-10-05T11:41:04.178+0000 7fa0e83e8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-10-05T11:41:04.330 INFO:tasks.workunit.client.0.smithi012.stderr: -206> 2023-10-05T11:41:04.178+0000 7fa0e83e8640 10 monclient(hunting): _init_auth method 2 2023-10-05T11:41:04.330 INFO:tasks.workunit.client.0.smithi012.stderr: -205> 2023-10-05T11:41:04.178+0000 7fa0e83e8640 10 monclient(hunting): _init_auth creating new auth 2023-10-05T11:41:04.330 INFO:tasks.workunit.client.0.smithi012.stderr: -204> 2023-10-05T11:41:04.178+0000 7fa0e8be9640 10 monclient(hunting): get_auth_request con 0x55f0c9b3ac00 auth_method 0 2023-10-05T11:41:04.330 INFO:tasks.workunit.client.0.smithi012.stderr: -203> 2023-10-05T11:41:04.178+0000 7fa0e8be9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-10-05T11:41:04.330 INFO:tasks.workunit.client.0.smithi012.stderr: -202> 2023-10-05T11:41:04.178+0000 7fa0e8be9640 10 monclient(hunting): _init_auth method 2 2023-10-05T11:41:04.330 INFO:tasks.workunit.client.0.smithi012.stderr: -201> 2023-10-05T11:41:04.178+0000 7fa0e8be9640 10 monclient(hunting): _init_auth creating new auth 2023-10-05T11:41:04.331 INFO:tasks.workunit.client.0.smithi012.stderr: -200> 2023-10-05T11:41:04.178+0000 7fa0e93ea640 10 monclient(hunting): get_auth_request con 0x55f0c9b3a800 auth_method 0 2023-10-05T11:41:04.331 INFO:tasks.workunit.client.0.smithi012.stderr: -199> 2023-10-05T11:41:04.178+0000 7fa0e93ea640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-10-05T11:41:04.331 INFO:tasks.workunit.client.0.smithi012.stderr: -198> 2023-10-05T11:41:04.178+0000 7fa0e93ea640 10 monclient(hunting): _init_auth method 2 2023-10-05T11:41:04.331 INFO:tasks.workunit.client.0.smithi012.stderr: -197> 2023-10-05T11:41:04.178+0000 7fa0e93ea640 10 monclient(hunting): _init_auth creating new auth 2023-10-05T11:41:04.331 INFO:tasks.workunit.client.0.smithi012.stderr: -196> 2023-10-05T11:41:04.178+0000 7fa0e83e8640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-10-05T11:41:04.331 INFO:tasks.workunit.client.0.smithi012.stderr: -195> 2023-10-05T11:41:04.178+0000 7fa0e83e8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-10-05T11:41:04.331 INFO:tasks.workunit.client.0.smithi012.stderr: -194> 2023-10-05T11:41:04.178+0000 7fa0e83e8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-10-05T11:41:04.331 INFO:tasks.workunit.client.0.smithi012.stderr: -193> 2023-10-05T11:41:04.178+0000 7fa0e8be9640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-10-05T11:41:04.331 INFO:tasks.workunit.client.0.smithi012.stderr: -192> 2023-10-05T11:41:04.178+0000 7fa0e8be9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-10-05T11:41:04.331 INFO:tasks.workunit.client.0.smithi012.stderr: -191> 2023-10-05T11:41:04.178+0000 7fa0e8be9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-10-05T11:41:04.331 INFO:tasks.workunit.client.0.smithi012.stderr: -190> 2023-10-05T11:41:04.178+0000 7fa0e93ea640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-10-05T11:41:04.331 INFO:tasks.workunit.client.0.smithi012.stderr: -189> 2023-10-05T11:41:04.178+0000 7fa0e93ea640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-10-05T11:41:04.331 INFO:tasks.workunit.client.0.smithi012.stderr: -188> 2023-10-05T11:41:04.178+0000 7fa0e93ea640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-10-05T11:41:04.332 INFO:tasks.workunit.client.0.smithi012.stderr: -187> 2023-10-05T11:41:04.178+0000 7fa0e83e8640 10 monclient(hunting): handle_auth_done global_id 7143 payload 274 2023-10-05T11:41:04.332 INFO:tasks.workunit.client.0.smithi012.stderr: -186> 2023-10-05T11:41:04.178+0000 7fa0e83e8640 10 monclient: _finish_hunting 0 2023-10-05T11:41:04.332 INFO:tasks.workunit.client.0.smithi012.stderr: -185> 2023-10-05T11:41:04.178+0000 7fa0e83e8640 1 monclient: found mon.noname-a 2023-10-05T11:41:04.332 INFO:tasks.workunit.client.0.smithi012.stderr: -184> 2023-10-05T11:41:04.178+0000 7fa0e83e8640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.12:3300/0 2023-10-05T11:41:04.332 INFO:tasks.workunit.client.0.smithi012.stderr: -183> 2023-10-05T11:41:04.178+0000 7fa0cf3b6640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-10-05T11:41:04.332 INFO:tasks.workunit.client.0.smithi012.stderr: -182> 2023-10-05T11:41:04.178+0000 7fa0cf3b6640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2023-10-05T11:41:04.332 INFO:tasks.workunit.client.0.smithi012.stderr: -181> 2023-10-05T11:41:04.178+0000 7fa0cf3b6640 10 monclient: dump: 2023-10-05T11:41:04.332 INFO:tasks.workunit.client.0.smithi012.stderr:epoch 1 2023-10-05T11:41:04.332 INFO:tasks.workunit.client.0.smithi012.stderr:fsid 7e015f46-293b-4b09-bd32-7d32b52f6e2f 2023-10-05T11:41:04.332 INFO:tasks.workunit.client.0.smithi012.stderr:last_changed 2023-10-05T11:27:38.366888+0000 2023-10-05T11:41:04.332 INFO:tasks.workunit.client.0.smithi012.stderr:created 2023-10-05T11:27:38.366888+0000 2023-10-05T11:41:04.332 INFO:tasks.workunit.client.0.smithi012.stderr:min_mon_release 18 (reef) 2023-10-05T11:41:04.333 INFO:tasks.workunit.client.0.smithi012.stderr:election_strategy: 1 2023-10-05T11:41:04.333 INFO:tasks.workunit.client.0.smithi012.stderr:0: [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon.a 2023-10-05T11:41:04.333 INFO:tasks.workunit.client.0.smithi012.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2023-10-05T11:41:04.333 INFO:tasks.workunit.client.0.smithi012.stderr:2: [v2:172.21.15.12:3301/0,v1:172.21.15.12:6790/0] mon.c 2023-10-05T11:41:04.333 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:41:04.333 INFO:tasks.workunit.client.0.smithi012.stderr: -180> 2023-10-05T11:41:04.178+0000 7fa0cf3b6640 10 monclient: _finish_auth 0 2023-10-05T11:41:04.333 INFO:tasks.workunit.client.0.smithi012.stderr: -179> 2023-10-05T11:41:04.178+0000 7fa0cf3b6640 10 monclient: _check_auth_tickets 2023-10-05T11:41:04.333 INFO:tasks.workunit.client.0.smithi012.stderr: -178> 2023-10-05T11:41:04.178+0000 7fa0cf3b6640 10 monclient: handle_config config(0 keys) v1 2023-10-05T11:41:04.333 INFO:tasks.workunit.client.0.smithi012.stderr: -177> 2023-10-05T11:41:04.178+0000 7fa0cf3b6640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-10-05T11:41:04.333 INFO:tasks.workunit.client.0.smithi012.stderr: -176> 2023-10-05T11:41:04.178+0000 7fa0cf3b6640 10 monclient: got monmap 1 from mon.a (according to old e1) 2023-10-05T11:41:04.333 INFO:tasks.workunit.client.0.smithi012.stderr: -175> 2023-10-05T11:41:04.178+0000 7fa0cf3b6640 10 monclient: dump: 2023-10-05T11:41:04.333 INFO:tasks.workunit.client.0.smithi012.stderr:epoch 1 2023-10-05T11:41:04.333 INFO:tasks.workunit.client.0.smithi012.stderr:fsid 7e015f46-293b-4b09-bd32-7d32b52f6e2f 2023-10-05T11:41:04.334 INFO:tasks.workunit.client.0.smithi012.stderr:last_changed 2023-10-05T11:27:38.366888+0000 2023-10-05T11:41:04.334 INFO:tasks.workunit.client.0.smithi012.stderr:created 2023-10-05T11:27:38.366888+0000 2023-10-05T11:41:04.334 INFO:tasks.workunit.client.0.smithi012.stderr:min_mon_release 18 (reef) 2023-10-05T11:41:04.334 INFO:tasks.workunit.client.0.smithi012.stderr:election_strategy: 1 2023-10-05T11:41:04.334 INFO:tasks.workunit.client.0.smithi012.stderr:0: [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon.a 2023-10-05T11:41:04.334 INFO:tasks.workunit.client.0.smithi012.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2023-10-05T11:41:04.334 INFO:tasks.workunit.client.0.smithi012.stderr:2: [v2:172.21.15.12:3301/0,v1:172.21.15.12:6790/0] mon.c 2023-10-05T11:41:04.334 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:41:04.334 INFO:tasks.workunit.client.0.smithi012.stderr: -174> 2023-10-05T11:41:04.178+0000 7fa0ea444880 5 monclient: authenticate success, global_id 7143 2023-10-05T11:41:04.334 INFO:tasks.workunit.client.0.smithi012.stderr: -173> 2023-10-05T11:41:04.178+0000 7fa0ea444880 10 monclient: get_monmap_and_config success 2023-10-05T11:41:04.334 INFO:tasks.workunit.client.0.smithi012.stderr: -172> 2023-10-05T11:41:04.178+0000 7fa0ea444880 4 set_mon_vals no callback set 2023-10-05T11:41:04.334 INFO:tasks.workunit.client.0.smithi012.stderr: -171> 2023-10-05T11:41:04.179+0000 7fa0ea444880 10 monclient: shutdown 2023-10-05T11:41:04.335 INFO:tasks.workunit.client.0.smithi012.stderr: -170> 2023-10-05T11:41:04.179+0000 7fa0ea444880 10 monclient: build_initial_monmap 2023-10-05T11:41:04.335 INFO:tasks.workunit.client.0.smithi012.stderr: -169> 2023-10-05T11:41:04.179+0000 7fa0ea444880 1 build_initial for_mkfs: 0 2023-10-05T11:41:04.335 INFO:tasks.workunit.client.0.smithi012.stderr: -168> 2023-10-05T11:41:04.179+0000 7fa0ea444880 10 monclient: monmap: 2023-10-05T11:41:04.335 INFO:tasks.workunit.client.0.smithi012.stderr:epoch 0 2023-10-05T11:41:04.335 INFO:tasks.workunit.client.0.smithi012.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-10-05T11:41:04.335 INFO:tasks.workunit.client.0.smithi012.stderr:last_changed 0.000000 2023-10-05T11:41:04.335 INFO:tasks.workunit.client.0.smithi012.stderr:created 0.000000 2023-10-05T11:41:04.335 INFO:tasks.workunit.client.0.smithi012.stderr:min_mon_release 0 (unknown) 2023-10-05T11:41:04.335 INFO:tasks.workunit.client.0.smithi012.stderr:election_strategy: 1 2023-10-05T11:41:04.336 INFO:tasks.workunit.client.0.smithi012.stderr:0: [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon.noname-a 2023-10-05T11:41:04.336 INFO:tasks.workunit.client.0.smithi012.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.noname-b 2023-10-05T11:41:04.336 INFO:tasks.workunit.client.0.smithi012.stderr:2: [v2:172.21.15.12:3301/0,v1:172.21.15.12:6790/0] mon.noname-c 2023-10-05T11:41:04.336 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:41:04.336 INFO:tasks.workunit.client.0.smithi012.stderr: -167> 2023-10-05T11:41:04.179+0000 7fa0ea444880 5 AuthRegistry(0x55f0ca40dc40) adding auth protocol: cephx 2023-10-05T11:41:04.336 INFO:tasks.workunit.client.0.smithi012.stderr: -166> 2023-10-05T11:41:04.179+0000 7fa0ea444880 5 AuthRegistry(0x55f0ca40dc40) adding auth protocol: cephx 2023-10-05T11:41:04.336 INFO:tasks.workunit.client.0.smithi012.stderr: -165> 2023-10-05T11:41:04.179+0000 7fa0ea444880 5 AuthRegistry(0x55f0ca40dc40) adding auth protocol: cephx 2023-10-05T11:41:04.336 INFO:tasks.workunit.client.0.smithi012.stderr: -164> 2023-10-05T11:41:04.179+0000 7fa0ea444880 5 AuthRegistry(0x55f0ca40dc40) adding con mode: secure 2023-10-05T11:41:04.336 INFO:tasks.workunit.client.0.smithi012.stderr: -163> 2023-10-05T11:41:04.179+0000 7fa0ea444880 5 AuthRegistry(0x55f0ca40dc40) adding con mode: crc 2023-10-05T11:41:04.336 INFO:tasks.workunit.client.0.smithi012.stderr: -162> 2023-10-05T11:41:04.179+0000 7fa0ea444880 5 AuthRegistry(0x55f0ca40dc40) adding con mode: secure 2023-10-05T11:41:04.336 INFO:tasks.workunit.client.0.smithi012.stderr: -161> 2023-10-05T11:41:04.179+0000 7fa0ea444880 5 AuthRegistry(0x55f0ca40dc40) adding con mode: crc 2023-10-05T11:41:04.336 INFO:tasks.workunit.client.0.smithi012.stderr: -160> 2023-10-05T11:41:04.179+0000 7fa0ea444880 5 AuthRegistry(0x55f0ca40dc40) adding con mode: secure 2023-10-05T11:41:04.336 INFO:tasks.workunit.client.0.smithi012.stderr: -159> 2023-10-05T11:41:04.179+0000 7fa0ea444880 5 AuthRegistry(0x55f0ca40dc40) adding con mode: crc 2023-10-05T11:41:04.337 INFO:tasks.workunit.client.0.smithi012.stderr: -158> 2023-10-05T11:41:04.179+0000 7fa0ea444880 5 AuthRegistry(0x55f0ca40dc40) adding con mode: crc 2023-10-05T11:41:04.337 INFO:tasks.workunit.client.0.smithi012.stderr: -157> 2023-10-05T11:41:04.179+0000 7fa0ea444880 5 AuthRegistry(0x55f0ca40dc40) adding con mode: secure 2023-10-05T11:41:04.337 INFO:tasks.workunit.client.0.smithi012.stderr: -156> 2023-10-05T11:41:04.179+0000 7fa0ea444880 5 AuthRegistry(0x55f0ca40dc40) adding con mode: crc 2023-10-05T11:41:04.337 INFO:tasks.workunit.client.0.smithi012.stderr: -155> 2023-10-05T11:41:04.179+0000 7fa0ea444880 5 AuthRegistry(0x55f0ca40dc40) adding con mode: secure 2023-10-05T11:41:04.337 INFO:tasks.workunit.client.0.smithi012.stderr: -154> 2023-10-05T11:41:04.179+0000 7fa0ea444880 5 AuthRegistry(0x55f0ca40dc40) adding con mode: crc 2023-10-05T11:41:04.337 INFO:tasks.workunit.client.0.smithi012.stderr: -153> 2023-10-05T11:41:04.179+0000 7fa0ea444880 5 AuthRegistry(0x55f0ca40dc40) adding con mode: secure 2023-10-05T11:41:04.337 INFO:tasks.workunit.client.0.smithi012.stderr: -152> 2023-10-05T11:41:04.179+0000 7fa0ea444880 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-10-05T11:41:04.337 INFO:tasks.workunit.client.0.smithi012.stderr: -151> 2023-10-05T11:41:04.179+0000 7fa0ea444880 1 librados: starting msgr at 2023-10-05T11:41:04.337 INFO:tasks.workunit.client.0.smithi012.stderr: -150> 2023-10-05T11:41:04.179+0000 7fa0ea444880 1 librados: starting objecter 2023-10-05T11:41:04.337 INFO:tasks.workunit.client.0.smithi012.stderr: -149> 2023-10-05T11:41:04.180+0000 7fa0ea444880 5 asok(0x55f0c995c000) register_command objecter_requests cmddesc objecter_requests hook 0x55f0c970bb80 EEXIST 2023-10-05T11:41:04.337 INFO:tasks.workunit.client.0.smithi012.stderr: -148> 2023-10-05T11:41:04.180+0000 7fa0ea444880 1 librados: setting wanted keys 2023-10-05T11:41:04.337 INFO:tasks.workunit.client.0.smithi012.stderr: -147> 2023-10-05T11:41:04.180+0000 7fa0ea444880 1 librados: calling monclient init 2023-10-05T11:41:04.338 INFO:tasks.workunit.client.0.smithi012.stderr: -146> 2023-10-05T11:41:04.180+0000 7fa0ea444880 10 monclient: init 2023-10-05T11:41:04.338 INFO:tasks.workunit.client.0.smithi012.stderr: -145> 2023-10-05T11:41:04.180+0000 7fa0ea444880 5 AuthRegistry(0x55f0c9b570d8) adding auth protocol: cephx 2023-10-05T11:41:04.338 INFO:tasks.workunit.client.0.smithi012.stderr: -144> 2023-10-05T11:41:04.180+0000 7fa0ea444880 5 AuthRegistry(0x55f0c9b570d8) adding auth protocol: cephx 2023-10-05T11:41:04.338 INFO:tasks.workunit.client.0.smithi012.stderr: -143> 2023-10-05T11:41:04.180+0000 7fa0ea444880 5 AuthRegistry(0x55f0c9b570d8) adding auth protocol: cephx 2023-10-05T11:41:04.338 INFO:tasks.workunit.client.0.smithi012.stderr: -142> 2023-10-05T11:41:04.180+0000 7fa0ea444880 5 AuthRegistry(0x55f0c9b570d8) adding con mode: secure 2023-10-05T11:41:04.338 INFO:tasks.workunit.client.0.smithi012.stderr: -141> 2023-10-05T11:41:04.180+0000 7fa0ea444880 5 AuthRegistry(0x55f0c9b570d8) adding con mode: crc 2023-10-05T11:41:04.338 INFO:tasks.workunit.client.0.smithi012.stderr: -140> 2023-10-05T11:41:04.180+0000 7fa0ea444880 5 AuthRegistry(0x55f0c9b570d8) adding con mode: secure 2023-10-05T11:41:04.338 INFO:tasks.workunit.client.0.smithi012.stderr: -139> 2023-10-05T11:41:04.180+0000 7fa0ea444880 5 AuthRegistry(0x55f0c9b570d8) adding con mode: crc 2023-10-05T11:41:04.338 INFO:tasks.workunit.client.0.smithi012.stderr: -138> 2023-10-05T11:41:04.180+0000 7fa0ea444880 5 AuthRegistry(0x55f0c9b570d8) adding con mode: secure 2023-10-05T11:41:04.338 INFO:tasks.workunit.client.0.smithi012.stderr: -137> 2023-10-05T11:41:04.180+0000 7fa0ea444880 5 AuthRegistry(0x55f0c9b570d8) adding con mode: crc 2023-10-05T11:41:04.338 INFO:tasks.workunit.client.0.smithi012.stderr: -136> 2023-10-05T11:41:04.180+0000 7fa0ea444880 5 AuthRegistry(0x55f0c9b570d8) adding con mode: crc 2023-10-05T11:41:04.338 INFO:tasks.workunit.client.0.smithi012.stderr: -135> 2023-10-05T11:41:04.180+0000 7fa0ea444880 5 AuthRegistry(0x55f0c9b570d8) adding con mode: secure 2023-10-05T11:41:04.339 INFO:tasks.workunit.client.0.smithi012.stderr: -134> 2023-10-05T11:41:04.180+0000 7fa0ea444880 5 AuthRegistry(0x55f0c9b570d8) adding con mode: crc 2023-10-05T11:41:04.339 INFO:tasks.workunit.client.0.smithi012.stderr: -133> 2023-10-05T11:41:04.180+0000 7fa0ea444880 5 AuthRegistry(0x55f0c9b570d8) adding con mode: secure 2023-10-05T11:41:04.339 INFO:tasks.workunit.client.0.smithi012.stderr: -132> 2023-10-05T11:41:04.180+0000 7fa0ea444880 5 AuthRegistry(0x55f0c9b570d8) adding con mode: crc 2023-10-05T11:41:04.339 INFO:tasks.workunit.client.0.smithi012.stderr: -131> 2023-10-05T11:41:04.180+0000 7fa0ea444880 5 AuthRegistry(0x55f0c9b570d8) adding con mode: secure 2023-10-05T11:41:04.339 INFO:tasks.workunit.client.0.smithi012.stderr: -130> 2023-10-05T11:41:04.180+0000 7fa0ea444880 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-10-05T11:41:04.339 INFO:tasks.workunit.client.0.smithi012.stderr: -129> 2023-10-05T11:41:04.180+0000 7fa0ea444880 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-10-05T11:41:04.339 INFO:tasks.workunit.client.0.smithi012.stderr: -128> 2023-10-05T11:41:04.180+0000 7fa0ea444880 5 asok(0x55f0c995c000) register_command rotate-key cmddesc rotate-key hook 0x55f0c9b57220 EEXIST 2023-10-05T11:41:04.339 INFO:tasks.workunit.client.0.smithi012.stderr: -127> 2023-10-05T11:41:04.180+0000 7fa0ea444880 10 monclient: _reopen_session rank -1 2023-10-05T11:41:04.339 INFO:tasks.workunit.client.0.smithi012.stderr: -126> 2023-10-05T11:41:04.180+0000 7fa0ea444880 10 monclient: _add_conns ranks=[2,0,1] 2023-10-05T11:41:04.339 INFO:tasks.workunit.client.0.smithi012.stderr: -125> 2023-10-05T11:41:04.180+0000 7fa0ea444880 10 monclient(hunting): picked mon.noname-c con 0x55f0c9b3a800 addr [v2:172.21.15.12:3301/0,v1:172.21.15.12:6790/0] 2023-10-05T11:41:04.340 INFO:tasks.workunit.client.0.smithi012.stderr: -124> 2023-10-05T11:41:04.180+0000 7fa0ea444880 10 monclient(hunting): picked mon.noname-a con 0x55f0c9b3ac00 addr [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] 2023-10-05T11:41:04.340 INFO:tasks.workunit.client.0.smithi012.stderr: -123> 2023-10-05T11:41:04.180+0000 7fa0ea444880 10 monclient(hunting): picked mon.noname-b con 0x55f0c9b3b000 addr [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] 2023-10-05T11:41:04.340 INFO:tasks.workunit.client.0.smithi012.stderr: -122> 2023-10-05T11:41:04.180+0000 7fa0ea444880 10 monclient(hunting): start opening mon connection 2023-10-05T11:41:04.340 INFO:tasks.workunit.client.0.smithi012.stderr: -121> 2023-10-05T11:41:04.180+0000 7fa0ea444880 10 monclient(hunting): start opening mon connection 2023-10-05T11:41:04.340 INFO:tasks.workunit.client.0.smithi012.stderr: -120> 2023-10-05T11:41:04.180+0000 7fa0ea444880 10 monclient(hunting): start opening mon connection 2023-10-05T11:41:04.340 INFO:tasks.workunit.client.0.smithi012.stderr: -119> 2023-10-05T11:41:04.180+0000 7fa0ea444880 10 monclient(hunting): _renew_subs 2023-10-05T11:41:04.340 INFO:tasks.workunit.client.0.smithi012.stderr: -118> 2023-10-05T11:41:04.180+0000 7fa0ea444880 10 monclient(hunting): authenticate will time out at 1572.349040s 2023-10-05T11:41:04.340 INFO:tasks.workunit.client.0.smithi012.stderr: -117> 2023-10-05T11:41:04.180+0000 7fa0e8be9640 10 monclient(hunting): get_auth_request con 0x55f0c9b3ac00 auth_method 0 2023-10-05T11:41:04.340 INFO:tasks.workunit.client.0.smithi012.stderr: -116> 2023-10-05T11:41:04.180+0000 7fa0e8be9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-10-05T11:41:04.340 INFO:tasks.workunit.client.0.smithi012.stderr: -115> 2023-10-05T11:41:04.180+0000 7fa0e8be9640 10 monclient(hunting): _init_auth method 2 2023-10-05T11:41:04.340 INFO:tasks.workunit.client.0.smithi012.stderr: -114> 2023-10-05T11:41:04.180+0000 7fa0e8be9640 10 monclient(hunting): _init_auth creating new auth 2023-10-05T11:41:04.340 INFO:tasks.workunit.client.0.smithi012.stderr: -113> 2023-10-05T11:41:04.180+0000 7fa0e93ea640 10 monclient(hunting): get_auth_request con 0x55f0c9b3a800 auth_method 0 2023-10-05T11:41:04.341 INFO:tasks.workunit.client.0.smithi012.stderr: -112> 2023-10-05T11:41:04.180+0000 7fa0e93ea640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-10-05T11:41:04.341 INFO:tasks.workunit.client.0.smithi012.stderr: -111> 2023-10-05T11:41:04.180+0000 7fa0e93ea640 10 monclient(hunting): _init_auth method 2 2023-10-05T11:41:04.341 INFO:tasks.workunit.client.0.smithi012.stderr: -110> 2023-10-05T11:41:04.180+0000 7fa0e93ea640 10 monclient(hunting): _init_auth creating new auth 2023-10-05T11:41:04.341 INFO:tasks.workunit.client.0.smithi012.stderr: -109> 2023-10-05T11:41:04.180+0000 7fa0e8be9640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-10-05T11:41:04.341 INFO:tasks.workunit.client.0.smithi012.stderr: -108> 2023-10-05T11:41:04.180+0000 7fa0e8be9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-10-05T11:41:04.341 INFO:tasks.workunit.client.0.smithi012.stderr: -107> 2023-10-05T11:41:04.180+0000 7fa0e8be9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-10-05T11:41:04.341 INFO:tasks.workunit.client.0.smithi012.stderr: -106> 2023-10-05T11:41:04.180+0000 7fa0e83e8640 10 monclient(hunting): get_auth_request con 0x55f0c9b3b000 auth_method 0 2023-10-05T11:41:04.341 INFO:tasks.workunit.client.0.smithi012.stderr: -105> 2023-10-05T11:41:04.180+0000 7fa0e83e8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-10-05T11:41:04.341 INFO:tasks.workunit.client.0.smithi012.stderr: -104> 2023-10-05T11:41:04.180+0000 7fa0e83e8640 10 monclient(hunting): _init_auth method 2 2023-10-05T11:41:04.341 INFO:tasks.workunit.client.0.smithi012.stderr: -103> 2023-10-05T11:41:04.180+0000 7fa0e83e8640 10 monclient(hunting): _init_auth creating new auth 2023-10-05T11:41:04.341 INFO:tasks.workunit.client.0.smithi012.stderr: -102> 2023-10-05T11:41:04.180+0000 7fa0e93ea640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-10-05T11:41:04.341 INFO:tasks.workunit.client.0.smithi012.stderr: -101> 2023-10-05T11:41:04.180+0000 7fa0e93ea640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-10-05T11:41:04.341 INFO:tasks.workunit.client.0.smithi012.stderr: -100> 2023-10-05T11:41:04.180+0000 7fa0e93ea640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-10-05T11:41:04.342 INFO:tasks.workunit.client.0.smithi012.stderr: -99> 2023-10-05T11:41:04.180+0000 7fa0e83e8640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-10-05T11:41:04.342 INFO:tasks.workunit.client.0.smithi012.stderr: -98> 2023-10-05T11:41:04.180+0000 7fa0e83e8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-10-05T11:41:04.342 INFO:tasks.workunit.client.0.smithi012.stderr: -97> 2023-10-05T11:41:04.180+0000 7fa0e83e8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-10-05T11:41:04.342 INFO:tasks.workunit.client.0.smithi012.stderr: -96> 2023-10-05T11:41:04.180+0000 7fa0e8be9640 10 monclient(hunting): handle_auth_done global_id 7146 payload 824 2023-10-05T11:41:04.342 INFO:tasks.workunit.client.0.smithi012.stderr: -95> 2023-10-05T11:41:04.180+0000 7fa0e8be9640 10 monclient: _finish_hunting 0 2023-10-05T11:41:04.342 INFO:tasks.workunit.client.0.smithi012.stderr: -94> 2023-10-05T11:41:04.180+0000 7fa0e8be9640 1 monclient: found mon.noname-a 2023-10-05T11:41:04.342 INFO:tasks.workunit.client.0.smithi012.stderr: -93> 2023-10-05T11:41:04.180+0000 7fa0e8be9640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.12:3300/0 2023-10-05T11:41:04.342 INFO:tasks.workunit.client.0.smithi012.stderr: -92> 2023-10-05T11:41:04.181+0000 7fa0cdbb3640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-10-05T11:41:04.342 INFO:tasks.workunit.client.0.smithi012.stderr: -91> 2023-10-05T11:41:04.181+0000 7fa0cdbb3640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2023-10-05T11:41:04.342 INFO:tasks.workunit.client.0.smithi012.stderr: -90> 2023-10-05T11:41:04.181+0000 7fa0cdbb3640 10 monclient: dump: 2023-10-05T11:41:04.342 INFO:tasks.workunit.client.0.smithi012.stderr:epoch 1 2023-10-05T11:41:04.342 INFO:tasks.workunit.client.0.smithi012.stderr:fsid 7e015f46-293b-4b09-bd32-7d32b52f6e2f 2023-10-05T11:41:04.343 INFO:tasks.workunit.client.0.smithi012.stderr:last_changed 2023-10-05T11:27:38.366888+0000 2023-10-05T11:41:04.343 INFO:tasks.workunit.client.0.smithi012.stderr:created 2023-10-05T11:27:38.366888+0000 2023-10-05T11:41:04.343 INFO:tasks.workunit.client.0.smithi012.stderr:min_mon_release 18 (reef) 2023-10-05T11:41:04.343 INFO:tasks.workunit.client.0.smithi012.stderr:election_strategy: 1 2023-10-05T11:41:04.343 INFO:tasks.workunit.client.0.smithi012.stderr:0: [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon.a 2023-10-05T11:41:04.343 INFO:tasks.workunit.client.0.smithi012.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2023-10-05T11:41:04.343 INFO:tasks.workunit.client.0.smithi012.stderr:2: [v2:172.21.15.12:3301/0,v1:172.21.15.12:6790/0] mon.c 2023-10-05T11:41:04.343 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:41:04.343 INFO:tasks.workunit.client.0.smithi012.stderr: -89> 2023-10-05T11:41:04.181+0000 7fa0cdbb3640 10 monclient: _finish_auth 0 2023-10-05T11:41:04.343 INFO:tasks.workunit.client.0.smithi012.stderr: -88> 2023-10-05T11:41:04.181+0000 7fa0cdbb3640 10 monclient: _check_auth_tickets 2023-10-05T11:41:04.343 INFO:tasks.workunit.client.0.smithi012.stderr: -87> 2023-10-05T11:41:04.181+0000 7fa0cdbb3640 10 monclient: handle_config config(0 keys) v1 2023-10-05T11:41:04.343 INFO:tasks.workunit.client.0.smithi012.stderr: -86> 2023-10-05T11:41:04.181+0000 7fa0cdbb3640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-10-05T11:41:04.343 INFO:tasks.workunit.client.0.smithi012.stderr: -85> 2023-10-05T11:41:04.181+0000 7fa0cdbb3640 10 monclient: got monmap 1 from mon.a (according to old e1) 2023-10-05T11:41:04.344 INFO:tasks.workunit.client.0.smithi012.stderr: -84> 2023-10-05T11:41:04.181+0000 7fa0cf3b6640 4 set_mon_vals no callback set 2023-10-05T11:41:04.344 INFO:tasks.workunit.client.0.smithi012.stderr: -83> 2023-10-05T11:41:04.181+0000 7fa0cdbb3640 10 monclient: dump: 2023-10-05T11:41:04.344 INFO:tasks.workunit.client.0.smithi012.stderr:epoch 1 2023-10-05T11:41:04.344 INFO:tasks.workunit.client.0.smithi012.stderr:fsid 7e015f46-293b-4b09-bd32-7d32b52f6e2f 2023-10-05T11:41:04.344 INFO:tasks.workunit.client.0.smithi012.stderr:last_changed 2023-10-05T11:27:38.366888+0000 2023-10-05T11:41:04.344 INFO:tasks.workunit.client.0.smithi012.stderr:created 2023-10-05T11:27:38.366888+0000 2023-10-05T11:41:04.344 INFO:tasks.workunit.client.0.smithi012.stderr:min_mon_release 18 (reef) 2023-10-05T11:41:04.344 INFO:tasks.workunit.client.0.smithi012.stderr:election_strategy: 1 2023-10-05T11:41:04.344 INFO:tasks.workunit.client.0.smithi012.stderr:0: [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon.a 2023-10-05T11:41:04.344 INFO:tasks.workunit.client.0.smithi012.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2023-10-05T11:41:04.345 INFO:tasks.workunit.client.0.smithi012.stderr:2: [v2:172.21.15.12:3301/0,v1:172.21.15.12:6790/0] mon.c 2023-10-05T11:41:04.345 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:41:04.345 INFO:tasks.workunit.client.0.smithi012.stderr: -82> 2023-10-05T11:41:04.181+0000 7fa0ea444880 5 monclient: authenticate success, global_id 7146 2023-10-05T11:41:04.345 INFO:tasks.workunit.client.0.smithi012.stderr: -81> 2023-10-05T11:41:04.181+0000 7fa0ea444880 10 monclient: _renew_subs 2023-10-05T11:41:04.345 INFO:tasks.workunit.client.0.smithi012.stderr: -80> 2023-10-05T11:41:04.181+0000 7fa0ea444880 10 monclient: _send_mon_message to mon.a at v2:172.21.15.12:3300/0 2023-10-05T11:41:04.345 INFO:tasks.workunit.client.0.smithi012.stderr: -79> 2023-10-05T11:41:04.181+0000 7fa0ea444880 10 monclient: _renew_subs 2023-10-05T11:41:04.345 INFO:tasks.workunit.client.0.smithi012.stderr: -78> 2023-10-05T11:41:04.181+0000 7fa0ea444880 10 monclient: _send_mon_message to mon.a at v2:172.21.15.12:3300/0 2023-10-05T11:41:04.346 INFO:tasks.workunit.client.0.smithi012.stderr: -77> 2023-10-05T11:41:04.181+0000 7fa0ea444880 1 librados: init done 2023-10-05T11:41:04.346 INFO:tasks.workunit.client.0.smithi012.stderr: -76> 2023-10-05T11:41:04.181+0000 7fa0ea444880 5 asok(0x55f0c995c000) register_command cr dump hook 0x55f0ca521358 2023-10-05T11:41:04.346 INFO:tasks.workunit.client.0.smithi012.stderr: -75> 2023-10-05T11:41:04.182+0000 7fa0cdbb3640 4 mgrc handle_mgr_map Got map version 5 2023-10-05T11:41:04.346 INFO:tasks.workunit.client.0.smithi012.stderr: -74> 2023-10-05T11:41:04.182+0000 7fa0cdbb3640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.170:6832/180516904,v1:172.21.15.170:6833/180516904] 2023-10-05T11:41:04.346 INFO:tasks.workunit.client.0.smithi012.stderr: -73> 2023-10-05T11:41:04.182+0000 7fa0cdbb3640 4 mgrc reconnect Starting new session with [v2:172.21.15.170:6832/180516904,v1:172.21.15.170:6833/180516904] 2023-10-05T11:41:04.346 INFO:tasks.workunit.client.0.smithi012.stderr: -72> 2023-10-05T11:41:04.182+0000 7fa0ea444880 5 note: GC not initialized 2023-10-05T11:41:04.346 INFO:tasks.workunit.client.0.smithi012.stderr: -71> 2023-10-05T11:41:04.182+0000 7fa0e93ea640 10 monclient: get_auth_request con 0x55f0c9c3c000 auth_method 0 2023-10-05T11:41:04.346 INFO:tasks.workunit.client.0.smithi012.stderr: -70> 2023-10-05T11:41:04.183+0000 7fa0cb3ae640 20 reqs_thread_entry: start 2023-10-05T11:41:04.346 INFO:tasks.workunit.client.0.smithi012.stderr: -69> 2023-10-05T11:41:04.183+0000 7fa0ea444880 5 asok(0x55f0c995c000) register_command sync trace show hook 0x55f0c96a6a80 2023-10-05T11:41:04.346 INFO:tasks.workunit.client.0.smithi012.stderr: -68> 2023-10-05T11:41:04.183+0000 7fa0ea444880 5 asok(0x55f0c995c000) register_command sync trace history hook 0x55f0c96a6a80 2023-10-05T11:41:04.346 INFO:tasks.workunit.client.0.smithi012.stderr: -67> 2023-10-05T11:41:04.183+0000 7fa0ea444880 5 asok(0x55f0c995c000) register_command sync trace active hook 0x55f0c96a6a80 2023-10-05T11:41:04.346 INFO:tasks.workunit.client.0.smithi012.stderr: -66> 2023-10-05T11:41:04.183+0000 7fa0ea444880 5 asok(0x55f0c995c000) register_command sync trace active_short hook 0x55f0c96a6a80 2023-10-05T11:41:04.347 INFO:tasks.workunit.client.0.smithi012.stderr: -65> 2023-10-05T11:41:04.183+0000 7fa0ea444880 20 init_complete bucket index max shards: 11 2023-10-05T11:41:04.347 INFO:tasks.workunit.client.0.smithi012.stderr: -64> 2023-10-05T11:41:04.183+0000 7fa0ea444880 20 Filter name: none 2023-10-05T11:41:04.347 INFO:tasks.workunit.client.0.smithi012.stderr: -63> 2023-10-05T11:41:04.183+0000 7fa0c93aa640 20 reqs_thread_entry: start 2023-10-05T11:41:04.347 INFO:tasks.workunit.client.0.smithi012.stderr: -62> 2023-10-05T11:41:04.183+0000 7fa0ea444880 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2023-10-05T11:41:04.347 INFO:tasks.workunit.client.0.smithi012.stderr: -61> 2023-10-05T11:41:04.183+0000 7fa0ea444880 20 rados->read ofs=0 len=0 2023-10-05T11:41:04.347 INFO:tasks.workunit.client.0.smithi012.stderr: -60> 2023-10-05T11:41:04.183+0000 7fa0ea444880 20 rados_obj.operate() r=0 bl.length=221 2023-10-05T11:41:04.347 INFO:tasks.workunit.client.0.smithi012.stderr: -59> 2023-10-05T11:41:04.183+0000 7fa0ea444880 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2023-10-05T11:41:04.347 INFO:tasks.workunit.client.0.smithi012.stderr: -58> 2023-10-05T11:41:04.183+0000 7fa0ea444880 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2023-10-05T11:41:04.347 INFO:tasks.workunit.client.0.smithi012.stderr: -57> 2023-10-05T11:41:04.183+0000 7fa0ea444880 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.25 : miss 2023-10-05T11:41:04.347 INFO:tasks.workunit.client.0.smithi012.stderr: -56> 2023-10-05T11:41:04.183+0000 7fa0ea444880 20 rados->read ofs=0 len=0 2023-10-05T11:41:04.347 INFO:tasks.workunit.client.0.smithi012.stderr: -55> 2023-10-05T11:41:04.184+0000 7fa0ea444880 20 rados_obj.operate() r=0 bl.length=393 2023-10-05T11:41:04.347 INFO:tasks.workunit.client.0.smithi012.stderr: -54> 2023-10-05T11:41:04.184+0000 7fa0ea444880 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.25 info.flags=0x17 2023-10-05T11:41:04.347 INFO:tasks.workunit.client.0.smithi012.stderr: -53> 2023-10-05T11:41:04.184+0000 7fa0ea444880 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.25 to cache LRU end 2023-10-05T11:41:04.348 INFO:tasks.workunit.client.0.smithi012.stderr: -52> 2023-10-05T11:41:04.184+0000 7fa0ea444880 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T11:41:04.348 INFO:tasks.workunit.client.0.smithi012.stderr: -51> 2023-10-05T11:41:04.184+0000 7fa0ea444880 10 updating xattr: name=user.rgw.acl bl.length()=265 2023-10-05T11:41:04.348 INFO:tasks.workunit.client.0.smithi012.stderr: -50> 2023-10-05T11:41:04.184+0000 7fa0ea444880 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.25 2023-10-05T11:41:04.348 INFO:tasks.workunit.client.0.smithi012.stderr: -49> 2023-10-05T11:41:04.184+0000 7fa0e83e8640 10 monclient: get_auth_request con 0x55f0c9b3b800 auth_method 0 2023-10-05T11:41:04.348 INFO:tasks.workunit.client.0.smithi012.stderr: -48> 2023-10-05T11:41:04.190+0000 7fa0ea444880 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.25 info.flags=0x17 2023-10-05T11:41:04.348 INFO:tasks.workunit.client.0.smithi012.stderr: -47> 2023-10-05T11:41:04.190+0000 7fa0ea444880 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.25 to cache LRU end 2023-10-05T11:41:04.348 INFO:tasks.workunit.client.0.smithi012.stderr: -46> 2023-10-05T11:41:04.190+0000 7fa0ea444880 10 updating xattr: name=user.rgw.acl bl.length()=265 2023-10-05T11:41:04.348 INFO:tasks.workunit.client.0.smithi012.stderr: -45> 2023-10-05T11:41:04.190+0000 7fa0ea444880 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.25, ofs0, ns] 2023-10-05T11:41:04.348 INFO:tasks.workunit.client.0.smithi012.stderr: -44> 2023-10-05T11:41:04.190+0000 7fa0e2bdd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1060856922173 cookie 94492664382464 notifier 7140 bl.length()=965 2023-10-05T11:41:04.348 INFO:tasks.workunit.client.0.smithi012.stderr: -43> 2023-10-05T11:41:04.190+0000 7fa0e2bdd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.25 info.flags=0x17 2023-10-05T11:41:04.348 INFO:tasks.workunit.client.0.smithi012.stderr: -42> 2023-10-05T11:41:04.190+0000 7fa0e2bdd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.25 to cache LRU end 2023-10-05T11:41:04.348 INFO:tasks.workunit.client.0.smithi012.stderr: -41> 2023-10-05T11:41:04.190+0000 7fa0e2bdd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2023-10-05T11:41:04.349 INFO:tasks.workunit.client.0.smithi012.stderr: -40> 2023-10-05T11:41:04.192+0000 7fa0ea444880 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[dff27d1e-df33-400e-a68a-7ba586947c99.4604.25]): orig_sources= new_sources= 2023-10-05T11:41:04.349 INFO:tasks.workunit.client.0.smithi012.stderr: -39> 2023-10-05T11:41:04.192+0000 7fa0ea444880 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[dff27d1e-df33-400e-a68a-7ba586947c99.4604.25]): potential sources added=[] removed=[] 2023-10-05T11:41:04.349 INFO:tasks.workunit.client.0.smithi012.stderr: -38> 2023-10-05T11:41:04.192+0000 7fa0ea444880 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[dff27d1e-df33-400e-a68a-7ba586947c99.4604.25]): orig_dests= new_dests= 2023-10-05T11:41:04.349 INFO:tasks.workunit.client.0.smithi012.stderr: -37> 2023-10-05T11:41:04.192+0000 7fa0ea444880 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[dff27d1e-df33-400e-a68a-7ba586947c99.4604.25]): potential dests added=[] removed=[] 2023-10-05T11:41:04.349 INFO:tasks.workunit.client.0.smithi012.stderr: -36> 2023-10-05T11:41:04.194+0000 7fa0ea444880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.25.1.0 2023-10-05T11:41:04.349 INFO:tasks.workunit.client.0.smithi012.stderr: -35> 2023-10-05T11:41:04.194+0000 7fa0ea444880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.25.1.0 2023-10-05T11:41:04.349 INFO:tasks.workunit.client.0.smithi012.stderr: -34> 2023-10-05T11:41:04.194+0000 7fa0ea444880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.25.1.1 2023-10-05T11:41:04.349 INFO:tasks.workunit.client.0.smithi012.stderr: -33> 2023-10-05T11:41:04.194+0000 7fa0ea444880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.25.1.1 2023-10-05T11:41:04.349 INFO:tasks.workunit.client.0.smithi012.stderr: -32> 2023-10-05T11:41:04.194+0000 7fa0ea444880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.25.1.2 2023-10-05T11:41:04.349 INFO:tasks.workunit.client.0.smithi012.stderr: -31> 2023-10-05T11:41:04.194+0000 7fa0ea444880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.25.1.2 2023-10-05T11:41:04.349 INFO:tasks.workunit.client.0.smithi012.stderr: -30> 2023-10-05T11:41:04.194+0000 7fa0ea444880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.25.1.3 2023-10-05T11:41:04.350 INFO:tasks.workunit.client.0.smithi012.stderr: -29> 2023-10-05T11:41:04.194+0000 7fa0ea444880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.25.1.3 2023-10-05T11:41:04.350 INFO:tasks.workunit.client.0.smithi012.stderr: -28> 2023-10-05T11:41:04.194+0000 7fa0ea444880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.25.1.4 2023-10-05T11:41:04.350 INFO:tasks.workunit.client.0.smithi012.stderr: -27> 2023-10-05T11:41:04.194+0000 7fa0ea444880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.25.1.4 2023-10-05T11:41:04.350 INFO:tasks.workunit.client.0.smithi012.stderr: -26> 2023-10-05T11:41:04.194+0000 7fa0ea444880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.25.1.5 2023-10-05T11:41:04.350 INFO:tasks.workunit.client.0.smithi012.stderr: -25> 2023-10-05T11:41:04.194+0000 7fa0ea444880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.25.1.5 2023-10-05T11:41:04.350 INFO:tasks.workunit.client.0.smithi012.stderr: -24> 2023-10-05T11:41:04.194+0000 7fa0ea444880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.25.1.6 2023-10-05T11:41:04.350 INFO:tasks.workunit.client.0.smithi012.stderr: -23> 2023-10-05T11:41:04.194+0000 7fa0ea444880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.25.1.6 2023-10-05T11:41:04.350 INFO:tasks.workunit.client.0.smithi012.stderr: -22> 2023-10-05T11:41:04.194+0000 7fa0ea444880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.25.1.7 2023-10-05T11:41:04.351 INFO:tasks.workunit.client.0.smithi012.stderr: -21> 2023-10-05T11:41:04.194+0000 7fa0ea444880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.25.1.7 2023-10-05T11:41:04.351 INFO:tasks.workunit.client.0.smithi012.stderr: -20> 2023-10-05T11:41:04.194+0000 7fa0ea444880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.25.1.8 2023-10-05T11:41:04.351 INFO:tasks.workunit.client.0.smithi012.stderr: -19> 2023-10-05T11:41:04.194+0000 7fa0ea444880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.25.1.8 2023-10-05T11:41:04.351 INFO:tasks.workunit.client.0.smithi012.stderr: -18> 2023-10-05T11:41:04.194+0000 7fa0ea444880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.25.1.9 2023-10-05T11:41:04.351 INFO:tasks.workunit.client.0.smithi012.stderr: -17> 2023-10-05T11:41:04.194+0000 7fa0ea444880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.25.1.9 2023-10-05T11:41:04.351 INFO:tasks.workunit.client.0.smithi012.stderr: -16> 2023-10-05T11:41:04.194+0000 7fa0ea444880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.25.1.10 2023-10-05T11:41:04.351 INFO:tasks.workunit.client.0.smithi012.stderr: -15> 2023-10-05T11:41:04.194+0000 7fa0ea444880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.25.1.10 2023-10-05T11:41:04.351 INFO:tasks.workunit.client.0.smithi012.stderr: -14> 2023-10-05T11:41:04.194+0000 7fa0ea444880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.25.1.11 2023-10-05T11:41:04.351 INFO:tasks.workunit.client.0.smithi012.stderr: -13> 2023-10-05T11:41:04.194+0000 7fa0ea444880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.25.1.11 2023-10-05T11:41:04.351 INFO:tasks.workunit.client.0.smithi012.stderr: -12> 2023-10-05T11:41:04.194+0000 7fa0ea444880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.25.0 2023-10-05T11:41:04.351 INFO:tasks.workunit.client.0.smithi012.stderr: -11> 2023-10-05T11:41:04.195+0000 7fa0ea444880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.25.1 2023-10-05T11:41:04.351 INFO:tasks.workunit.client.0.smithi012.stderr: -10> 2023-10-05T11:41:04.195+0000 7fa0ea444880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.25.2 2023-10-05T11:41:04.352 INFO:tasks.workunit.client.0.smithi012.stderr: -9> 2023-10-05T11:41:04.195+0000 7fa0ea444880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.25.3 2023-10-05T11:41:04.352 INFO:tasks.workunit.client.0.smithi012.stderr: -8> 2023-10-05T11:41:04.196+0000 7fa0ea444880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.25.4 2023-10-05T11:41:04.352 INFO:tasks.workunit.client.0.smithi012.stderr: -7> 2023-10-05T11:41:04.196+0000 7fa0ea444880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.25.5 2023-10-05T11:41:04.352 INFO:tasks.workunit.client.0.smithi012.stderr: -6> 2023-10-05T11:41:04.197+0000 7fa0ea444880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.25.6 2023-10-05T11:41:04.352 INFO:tasks.workunit.client.0.smithi012.stderr: -5> 2023-10-05T11:41:04.197+0000 7fa0ea444880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.25.7 2023-10-05T11:41:04.352 INFO:tasks.workunit.client.0.smithi012.stderr: -4> 2023-10-05T11:41:04.198+0000 7fa0ea444880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.25.8 2023-10-05T11:41:04.352 INFO:tasks.workunit.client.0.smithi012.stderr: -3> 2023-10-05T11:41:04.198+0000 7fa0ea444880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.25.9 2023-10-05T11:41:04.352 INFO:tasks.workunit.client.0.smithi012.stderr: -2> 2023-10-05T11:41:04.198+0000 7fa0ea444880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.25.10 2023-10-05T11:41:04.352 INFO:tasks.workunit.client.0.smithi012.stderr: -1> 2023-10-05T11:41:04.202+0000 7fa0ea444880 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6543-g38321be8/rpm/el9/BUILD/ceph-18.0.0-6543-g38321be8/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fa0ea444880 time 2023-10-05T11:41:04.203267+0000 2023-10-05T11:41:04.352 INFO:tasks.workunit.client.0.smithi012.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6543-g38321be8/rpm/el9/BUILD/ceph-18.0.0-6543-g38321be8/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2023-10-05T11:41:04.352 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:41:04.352 INFO:tasks.workunit.client.0.smithi012.stderr: ceph version 18.0.0-6543-g38321be8 (38321be854743c0d616618a9ea8aa0b1d4dbc0bf) reef (dev) 2023-10-05T11:41:04.352 INFO:tasks.workunit.client.0.smithi012.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fa0ef16d15f] 2023-10-05T11:41:04.353 INFO:tasks.workunit.client.0.smithi012.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16d31d) [0x7fa0ef16d31d] 2023-10-05T11:41:04.353 INFO:tasks.workunit.client.0.smithi012.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f0c8113c31] 2023-10-05T11:41:04.353 INFO:tasks.workunit.client.0.smithi012.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x5b8) [0x55f0c812aa48] 2023-10-05T11:41:04.353 INFO:tasks.workunit.client.0.smithi012.stderr: 5: main() 2023-10-05T11:41:04.353 INFO:tasks.workunit.client.0.smithi012.stderr: 6: /lib64/libc.so.6(+0x3feb0) [0x7fa0ec63feb0] 2023-10-05T11:41:04.353 INFO:tasks.workunit.client.0.smithi012.stderr: 7: __libc_start_main() 2023-10-05T11:41:04.353 INFO:tasks.workunit.client.0.smithi012.stderr: 8: _start() 2023-10-05T11:41:04.353 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:41:04.353 INFO:tasks.workunit.client.0.smithi012.stderr: 0> 2023-10-05T11:41:04.203+0000 7fa0ea444880 -1 *** Caught signal (Aborted) ** 2023-10-05T11:41:04.353 INFO:tasks.workunit.client.0.smithi012.stderr: in thread 7fa0ea444880 thread_name:radosgw-admin 2023-10-05T11:41:04.353 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:41:04.353 INFO:tasks.workunit.client.0.smithi012.stderr: ceph version 18.0.0-6543-g38321be8 (38321be854743c0d616618a9ea8aa0b1d4dbc0bf) reef (dev) 2023-10-05T11:41:04.354 INFO:tasks.workunit.client.0.smithi012.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7fa0ec654db0] 2023-10-05T11:41:04.354 INFO:tasks.workunit.client.0.smithi012.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7fa0ec6a154c] 2023-10-05T11:41:04.354 INFO:tasks.workunit.client.0.smithi012.stderr: 3: raise() 2023-10-05T11:41:04.354 INFO:tasks.workunit.client.0.smithi012.stderr: 4: abort() 2023-10-05T11:41:04.354 INFO:tasks.workunit.client.0.smithi012.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fa0ef16d1b9] 2023-10-05T11:41:04.354 INFO:tasks.workunit.client.0.smithi012.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16d31d) [0x7fa0ef16d31d] 2023-10-05T11:41:04.354 INFO:tasks.workunit.client.0.smithi012.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f0c8113c31] 2023-10-05T11:41:04.354 INFO:tasks.workunit.client.0.smithi012.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x5b8) [0x55f0c812aa48] 2023-10-05T11:41:04.354 INFO:tasks.workunit.client.0.smithi012.stderr: 9: main() 2023-10-05T11:41:04.354 INFO:tasks.workunit.client.0.smithi012.stderr: 10: /lib64/libc.so.6(+0x3feb0) [0x7fa0ec63feb0] 2023-10-05T11:41:04.354 INFO:tasks.workunit.client.0.smithi012.stderr: 11: __libc_start_main() 2023-10-05T11:41:04.354 INFO:tasks.workunit.client.0.smithi012.stderr: 12: _start() 2023-10-05T11:41:04.355 INFO:tasks.workunit.client.0.smithi012.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-10-05T11:41:04.355 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:41:04.355 INFO:tasks.workunit.client.0.smithi012.stderr:--- logging levels --- 2023-10-05T11:41:04.355 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 none 2023-10-05T11:41:04.355 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 1 lockdep 2023-10-05T11:41:04.355 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 1 context 2023-10-05T11:41:04.355 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 1 crush 2023-10-05T11:41:04.355 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 mds 2023-10-05T11:41:04.355 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 mds_balancer 2023-10-05T11:41:04.355 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 mds_locker 2023-10-05T11:41:04.355 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 mds_log 2023-10-05T11:41:04.356 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 mds_log_expire 2023-10-05T11:41:04.356 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 mds_migrator 2023-10-05T11:41:04.356 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 1 buffer 2023-10-05T11:41:04.356 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 1 timer 2023-10-05T11:41:04.356 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 1 filer 2023-10-05T11:41:04.356 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 1 striper 2023-10-05T11:41:04.356 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 1 objecter 2023-10-05T11:41:04.356 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 rados 2023-10-05T11:41:04.356 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 rbd 2023-10-05T11:41:04.357 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 rbd_mirror 2023-10-05T11:41:04.357 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 rbd_replay 2023-10-05T11:41:04.357 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 rbd_pwl 2023-10-05T11:41:04.357 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 journaler 2023-10-05T11:41:04.357 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 objectcacher 2023-10-05T11:41:04.357 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 immutable_obj_cache 2023-10-05T11:41:04.357 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 client 2023-10-05T11:41:04.357 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 osd 2023-10-05T11:41:04.357 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 optracker 2023-10-05T11:41:04.357 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 objclass 2023-10-05T11:41:04.357 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 3 filestore 2023-10-05T11:41:04.357 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 3 journal 2023-10-05T11:41:04.358 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 0 ms 2023-10-05T11:41:04.358 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 mon 2023-10-05T11:41:04.358 INFO:tasks.workunit.client.0.smithi012.stderr: 0/10 monc 2023-10-05T11:41:04.358 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 paxos 2023-10-05T11:41:04.358 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 tp 2023-10-05T11:41:04.358 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 auth 2023-10-05T11:41:04.358 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 crypto 2023-10-05T11:41:04.358 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 1 finisher 2023-10-05T11:41:04.358 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 1 reserver 2023-10-05T11:41:04.358 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 heartbeatmap 2023-10-05T11:41:04.358 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 perfcounter 2023-10-05T11:41:04.358 INFO:tasks.workunit.client.0.smithi012.stderr: 20/20 rgw 2023-10-05T11:41:04.359 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 rgw_sync 2023-10-05T11:41:04.359 INFO:tasks.workunit.client.0.smithi012.stderr: 30/30 rgw_datacache 2023-10-05T11:41:04.359 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 rgw_access 2023-10-05T11:41:04.359 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 rgw_dbstore 2023-10-05T11:41:04.359 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 rgw_flight 2023-10-05T11:41:04.359 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 javaclient 2023-10-05T11:41:04.359 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 asok 2023-10-05T11:41:04.359 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 1 throttle 2023-10-05T11:41:04.359 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 0 refs 2023-10-05T11:41:04.359 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 compressor 2023-10-05T11:41:04.359 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 bluestore 2023-10-05T11:41:04.359 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 bluefs 2023-10-05T11:41:04.359 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 3 bdev 2023-10-05T11:41:04.360 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 kstore 2023-10-05T11:41:04.360 INFO:tasks.workunit.client.0.smithi012.stderr: 4/ 5 rocksdb 2023-10-05T11:41:04.360 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 fuse 2023-10-05T11:41:04.360 INFO:tasks.workunit.client.0.smithi012.stderr: 2/ 5 mgr 2023-10-05T11:41:04.360 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 mgrc 2023-10-05T11:41:04.360 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 dpdk 2023-10-05T11:41:04.360 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 eventtrace 2023-10-05T11:41:04.360 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 prioritycache 2023-10-05T11:41:04.360 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 test 2023-10-05T11:41:04.361 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 cephfs_mirror 2023-10-05T11:41:04.361 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 cephsqlite 2023-10-05T11:41:04.361 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 seastore 2023-10-05T11:41:04.361 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 seastore_onode 2023-10-05T11:41:04.361 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 seastore_odata 2023-10-05T11:41:04.361 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 seastore_omap 2023-10-05T11:41:04.361 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 seastore_tm 2023-10-05T11:41:04.361 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 seastore_t 2023-10-05T11:41:04.361 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 seastore_cleaner 2023-10-05T11:41:04.361 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 seastore_epm 2023-10-05T11:41:04.361 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 seastore_lba 2023-10-05T11:41:04.361 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 seastore_fixedkv_tree 2023-10-05T11:41:04.362 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 seastore_cache 2023-10-05T11:41:04.362 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 seastore_journal 2023-10-05T11:41:04.362 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 seastore_device 2023-10-05T11:41:04.362 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 seastore_backref 2023-10-05T11:41:04.362 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 alienstore 2023-10-05T11:41:04.362 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 mclock 2023-10-05T11:41:04.362 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 cyanstore 2023-10-05T11:41:04.363 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 ceph_exporter 2023-10-05T11:41:04.363 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 memstore 2023-10-05T11:41:04.363 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 trace 2023-10-05T11:41:04.363 INFO:tasks.workunit.client.0.smithi012.stderr: -2/-2 (syslog threshold) 2023-10-05T11:41:04.363 INFO:tasks.workunit.client.0.smithi012.stderr: 99/99 (stderr threshold) 2023-10-05T11:41:04.363 INFO:tasks.workunit.client.0.smithi012.stderr:--- pthread ID / name mapping for recent threads --- 2023-10-05T11:41:04.364 INFO:tasks.workunit.client.0.smithi012.stderr: 7fa0c93aa640 / http_manager 2023-10-05T11:41:04.364 INFO:tasks.workunit.client.0.smithi012.stderr: 7fa0cb3ae640 / http_manager 2023-10-05T11:41:04.364 INFO:tasks.workunit.client.0.smithi012.stderr: 7fa0cdbb3640 / ms_dispatch 2023-10-05T11:41:04.364 INFO:tasks.workunit.client.0.smithi012.stderr: 7fa0cf3b6640 / io_context_pool 2023-10-05T11:41:04.364 INFO:tasks.workunit.client.0.smithi012.stderr: 7fa0cfbb7640 / rgw_dt_lg_renew 2023-10-05T11:41:04.364 INFO:tasks.workunit.client.0.smithi012.stderr: 7fa0e1bdb640 / ms_dispatch 2023-10-05T11:41:04.365 INFO:tasks.workunit.client.0.smithi012.stderr: 7fa0e2bdd640 / io_context_pool 2023-10-05T11:41:04.365 INFO:tasks.workunit.client.0.smithi012.stderr: 7fa0e33de640 / io_context_pool 2023-10-05T11:41:04.365 INFO:tasks.workunit.client.0.smithi012.stderr: 7fa0e5be3640 / ms_dispatch 2023-10-05T11:41:04.365 INFO:tasks.workunit.client.0.smithi012.stderr: 7fa0e83e8640 / msgr-worker-2 2023-10-05T11:41:04.365 INFO:tasks.workunit.client.0.smithi012.stderr: 7fa0e8be9640 / msgr-worker-1 2023-10-05T11:41:04.365 INFO:tasks.workunit.client.0.smithi012.stderr: 7fa0e93ea640 / msgr-worker-0 2023-10-05T11:41:04.365 INFO:tasks.workunit.client.0.smithi012.stderr: 7fa0ea444880 / radosgw-admin 2023-10-05T11:41:04.365 INFO:tasks.workunit.client.0.smithi012.stderr: max_recent 500 2023-10-05T11:41:04.366 INFO:tasks.workunit.client.0.smithi012.stderr: max_new 1000 2023-10-05T11:41:04.366 INFO:tasks.workunit.client.0.smithi012.stderr: log_file /var/lib/ceph/crash/2023-10-05T11:41:04.204618Z_9ec427c5-b61e-4968-853c-3547cebfacf6/log 2023-10-05T11:41:04.366 INFO:tasks.workunit.client.0.smithi012.stderr:--- end dump of recent events --- 2023-10-05T11:41:04.366 INFO:tasks.workunit.client.0.smithi012.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2023-10-05T11:41:04.372 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setuser ceph since I am not root 2023-10-05T11:41:04.372 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T11:41:04.373 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.250+0000 7f78bf815880 20 rados->read ofs=0 len=0 2023-10-05T11:41:04.373 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.252+0000 7f78bf815880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:04.373 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.252+0000 7f78bf815880 20 realm 2023-10-05T11:41:04.373 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.252+0000 7f78bf815880 20 rados->read ofs=0 len=0 2023-10-05T11:41:04.373 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.252+0000 7f78bf815880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:04.373 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.252+0000 7f78bf815880 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T11:41:04.373 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.252+0000 7f78bf815880 20 rados->read ofs=0 len=0 2023-10-05T11:41:04.373 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.252+0000 7f78bf815880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:04.373 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.252+0000 7f78bf815880 20 rados->read ofs=0 len=0 2023-10-05T11:41:04.373 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.253+0000 7f78bf815880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:41:04.373 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.253+0000 7f78bf815880 20 rados->read ofs=0 len=0 2023-10-05T11:41:04.373 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.254+0000 7f78bf815880 20 rados_obj.operate() r=0 bl.length=1020 2023-10-05T11:41:04.374 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.254+0000 7f78bf815880 20 searching for the correct realm 2023-10-05T11:41:04.374 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.261+0000 7f78bc48f640 0 -- 172.21.15.12:0/2025577428 >> [v2:172.21.15.12:6813/3341239609,v1:172.21.15.12:6815/3341239609] conn(0x55da35709000 msgr2=0x55da34abcc00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:41:04.374 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.264+0000 7f78bf815880 20 RGWRados::pool_iterate: got zone_info.dff27d1e-df33-400e-a68a-7ba586947c99 2023-10-05T11:41:04.374 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.264+0000 7f78bf815880 20 RGWRados::pool_iterate: got zonegroup_info.c78aa576-9d15-4e9d-b3c0-4af23a22062c 2023-10-05T11:41:04.374 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.264+0000 7f78bf815880 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T11:41:04.374 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.264+0000 7f78bf815880 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T11:41:04.374 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.264+0000 7f78bf815880 20 rados->read ofs=0 len=0 2023-10-05T11:41:04.374 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.265+0000 7f78bf815880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:04.374 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.265+0000 7f78bf815880 20 rados->read ofs=0 len=0 2023-10-05T11:41:04.374 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.265+0000 7f78bf815880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:41:04.374 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.265+0000 7f78bf815880 20 rados->read ofs=0 len=0 2023-10-05T11:41:04.375 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.265+0000 7f78bf815880 20 rados_obj.operate() r=0 bl.length=454 2023-10-05T11:41:04.375 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.265+0000 7f78bf815880 20 zone default found 2023-10-05T11:41:04.375 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.265+0000 7f78bf815880 4 Realm: () 2023-10-05T11:41:04.375 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.265+0000 7f78bf815880 4 ZoneGroup: default (c78aa576-9d15-4e9d-b3c0-4af23a22062c) 2023-10-05T11:41:04.375 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.265+0000 7f78bf815880 4 Zone: default (dff27d1e-df33-400e-a68a-7ba586947c99) 2023-10-05T11:41:04.375 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.265+0000 7f78bf815880 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T11:41:04.375 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.265+0000 7f78bf815880 20 zonegroup default 2023-10-05T11:41:04.375 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.265+0000 7f78bf815880 20 rados->read ofs=0 len=0 2023-10-05T11:41:04.375 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.266+0000 7f78bf815880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:04.375 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.266+0000 7f78bf815880 20 rados->read ofs=0 len=0 2023-10-05T11:41:04.375 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.266+0000 7f78bf815880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:04.375 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.266+0000 7f78bf815880 20 rados->read ofs=0 len=0 2023-10-05T11:41:04.375 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.266+0000 7f78bc48f640 0 -- 172.21.15.12:0/2025577428 >> [v2:172.21.15.12:6824/2171933159,v1:172.21.15.12:6825/2171933159] conn(0x55da34c6b000 msgr2=0x55da34b88b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:41:04.376 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.266+0000 7f78bf815880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:04.376 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.266+0000 7f78bf815880 20 started sync module instance, tier type = 2023-10-05T11:41:04.376 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.266+0000 7f78bf815880 20 started zone id=dff27d1e-df33-400e-a68a-7ba586947c99 (name=default) with tier type = 2023-10-05T11:41:04.376 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.275+0000 7f78bf815880 20 add_watcher() i=0 2023-10-05T11:41:04.376 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.275+0000 7f78bf815880 20 add_watcher() i=1 2023-10-05T11:41:04.376 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.275+0000 7f78bf815880 20 add_watcher() i=2 2023-10-05T11:41:04.376 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.275+0000 7f78bf815880 20 add_watcher() i=3 2023-10-05T11:41:04.376 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.275+0000 7f78bf815880 20 add_watcher() i=4 2023-10-05T11:41:04.376 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.275+0000 7f78bf815880 20 add_watcher() i=5 2023-10-05T11:41:04.376 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.275+0000 7f78bf815880 20 add_watcher() i=6 2023-10-05T11:41:04.376 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.276+0000 7f78bf815880 20 add_watcher() i=7 2023-10-05T11:41:04.377 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.276+0000 7f78bf815880 2 all 8 watchers are set, enabling cache 2023-10-05T11:41:04.377 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.278+0000 7f78a2c5c640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:41:04.377 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.278+0000 7f78bf815880 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T11:41:04.377 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.278+0000 7f78bf815880 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T11:41:04.377 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.283+0000 7f78bf815880 5 note: GC not initialized 2023-10-05T11:41:04.377 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.284+0000 7f789e453640 20 reqs_thread_entry: start 2023-10-05T11:41:04.377 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.284+0000 7f78bf815880 20 init_complete bucket index max shards: 11 2023-10-05T11:41:04.377 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.284+0000 7f78bf815880 20 Filter name: none 2023-10-05T11:41:04.378 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.284+0000 7f789c44f640 20 reqs_thread_entry: start 2023-10-05T11:41:04.378 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.284+0000 7f78bf815880 20 rados->read ofs=0 len=0 2023-10-05T11:41:04.378 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.284+0000 7f78bf815880 20 rados_obj.operate() r=0 bl.length=221 2023-10-05T11:41:04.378 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.284+0000 7f78bf815880 20 rados->read ofs=0 len=0 2023-10-05T11:41:04.378 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.285+0000 7f78bf815880 20 rados_obj.operate() r=0 bl.length=425 2023-10-05T11:41:04.378 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.285+0000 7f78bf815880 20 couldn't put binfo cache entry, might have raced with data changes 2023-10-05T11:41:04.378 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.285+0000 7f78bf815880 20 rados->read ofs=0 len=0 2023-10-05T11:41:04.378 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.285+0000 7f78bf815880 20 rados_obj.operate() r=0 bl.length=221 2023-10-05T11:41:04.378 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.285+0000 7f78bf815880 20 rados->read ofs=0 len=0 2023-10-05T11:41:04.379 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.285+0000 7f78bf815880 20 rados_obj.operate() r=0 bl.length=425 2023-10-05T11:41:04.379 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.285+0000 7f78bf815880 20 couldn't put binfo cache entry, might have raced with data changes 2023-10-05T11:41:04.379 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.286+0000 7f78bf815880 20 rados->read ofs=0 len=0 2023-10-05T11:41:04.379 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.287+0000 7f78bf815880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:04.379 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.287+0000 7f78a2c5c640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:41:04.379 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.289+0000 7f78bf815880 20 remove_watcher() i=0 2023-10-05T11:41:04.379 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.289+0000 7f78bf815880 2 removed watcher, disabling cache 2023-10-05T11:41:04.379 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.291+0000 7f78bf815880 20 remove_watcher() i=1 2023-10-05T11:41:04.379 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.292+0000 7f78bf815880 20 remove_watcher() i=2 2023-10-05T11:41:04.379 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.293+0000 7f78bf815880 20 remove_watcher() i=3 2023-10-05T11:41:04.379 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.294+0000 7f78bf815880 20 remove_watcher() i=4 2023-10-05T11:41:04.379 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.295+0000 7f78bf815880 20 remove_watcher() i=5 2023-10-05T11:41:04.379 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.296+0000 7f78bf815880 20 remove_watcher() i=6 2023-10-05T11:41:04.380 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:04.297+0000 7f78bf815880 20 remove_watcher() i=7 2023-10-05T11:41:04.380 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:41:04.380 INFO:tasks.workunit.client.0.smithi012.stderr:BUCKET_STATS: 2023-10-05T11:41:04.380 INFO:tasks.workunit.client.0.smithi012.stderr:bucket: abort-at-commit-target-layout id: dff27d1e-df33-400e-a68a-7ba586947c99.4604.25 num_objects: 20 size_kb: 1 num_shards: 11 2023-10-05T11:41:04.380 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:41:34.499 INFO:tasks.workunit.client.0.smithi012.stderr:radosgw-admin bucket reshard --bucket abort-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2023-10-05T11:41:34.534 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setuser ceph since I am not root 2023-10-05T11:41:34.534 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T11:41:34.548 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.545+0000 7fb2f3a8b880 20 rados->read ofs=0 len=0 2023-10-05T11:41:34.549 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.547+0000 7fb2f3a8b880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:34.549 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.547+0000 7fb2f3a8b880 20 realm 2023-10-05T11:41:34.549 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.547+0000 7fb2f3a8b880 20 rados->read ofs=0 len=0 2023-10-05T11:41:34.549 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.547+0000 7fb2f3a8b880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:34.549 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.547+0000 7fb2f3a8b880 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T11:41:34.549 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.547+0000 7fb2f3a8b880 20 rados->read ofs=0 len=0 2023-10-05T11:41:34.550 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.547+0000 7fb2f3a8b880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:34.550 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.547+0000 7fb2f3a8b880 20 rados->read ofs=0 len=0 2023-10-05T11:41:34.550 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.548+0000 7fb2f3a8b880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:41:34.550 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.548+0000 7fb2f3a8b880 20 rados->read ofs=0 len=0 2023-10-05T11:41:34.551 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.549+0000 7fb2f3a8b880 20 rados_obj.operate() r=0 bl.length=1020 2023-10-05T11:41:34.551 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.549+0000 7fb2f3a8b880 20 searching for the correct realm 2023-10-05T11:41:34.561 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.559+0000 7fb2f2230640 0 -- 172.21.15.12:0/2066569174 >> [v2:172.21.15.170:6814/3150808418,v1:172.21.15.170:6816/3150808418] conn(0x56485c08d800 msgr2=0x56485b4bd180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:41:34.564 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.561+0000 7fb2f3a8b880 20 RGWRados::pool_iterate: got zone_info.dff27d1e-df33-400e-a68a-7ba586947c99 2023-10-05T11:41:34.564 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.561+0000 7fb2f3a8b880 20 RGWRados::pool_iterate: got zonegroup_info.c78aa576-9d15-4e9d-b3c0-4af23a22062c 2023-10-05T11:41:34.564 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.561+0000 7fb2f3a8b880 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T11:41:34.564 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.561+0000 7fb2f3a8b880 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T11:41:34.564 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.561+0000 7fb2f3a8b880 20 rados->read ofs=0 len=0 2023-10-05T11:41:34.564 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.562+0000 7fb2f3a8b880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:34.564 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.562+0000 7fb2f3a8b880 20 rados->read ofs=0 len=0 2023-10-05T11:41:34.565 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.562+0000 7fb2f3a8b880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:41:34.565 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.562+0000 7fb2f3a8b880 20 rados->read ofs=0 len=0 2023-10-05T11:41:34.565 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.562+0000 7fb2f3a8b880 20 rados_obj.operate() r=0 bl.length=454 2023-10-05T11:41:34.566 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.562+0000 7fb2f3a8b880 20 zone default found 2023-10-05T11:41:34.566 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.562+0000 7fb2f3a8b880 4 Realm: () 2023-10-05T11:41:34.566 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.562+0000 7fb2f3a8b880 4 ZoneGroup: default (c78aa576-9d15-4e9d-b3c0-4af23a22062c) 2023-10-05T11:41:34.566 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.562+0000 7fb2f3a8b880 4 Zone: default (dff27d1e-df33-400e-a68a-7ba586947c99) 2023-10-05T11:41:34.566 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.562+0000 7fb2f3a8b880 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T11:41:34.566 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.562+0000 7fb2f3a8b880 20 zonegroup default 2023-10-05T11:41:34.566 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.562+0000 7fb2f3a8b880 20 rados->read ofs=0 len=0 2023-10-05T11:41:34.566 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.563+0000 7fb2f3a8b880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:34.566 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.563+0000 7fb2f3a8b880 20 rados->read ofs=0 len=0 2023-10-05T11:41:34.566 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.563+0000 7fb2f3a8b880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:34.566 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.563+0000 7fb2f3a8b880 20 rados->read ofs=0 len=0 2023-10-05T11:41:34.567 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.563+0000 7fb2f3a8b880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:34.567 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.563+0000 7fb2f3a8b880 20 started sync module instance, tier type = 2023-10-05T11:41:34.567 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.563+0000 7fb2f3a8b880 20 started zone id=dff27d1e-df33-400e-a68a-7ba586947c99 (name=default) with tier type = 2023-10-05T11:41:34.573 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.570+0000 7fb2f2a31640 0 -- 172.21.15.12:0/2066569174 >> [v2:172.21.15.170:6800/4137726411,v1:172.21.15.170:6801/4137726411] conn(0x56485b58a800 msgr2=0x56485b643700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:41:34.577 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.575+0000 7fb2f3a8b880 20 add_watcher() i=0 2023-10-05T11:41:34.577 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.575+0000 7fb2f3a8b880 20 add_watcher() i=1 2023-10-05T11:41:34.577 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.575+0000 7fb2f3a8b880 20 add_watcher() i=2 2023-10-05T11:41:34.577 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.575+0000 7fb2f3a8b880 20 add_watcher() i=3 2023-10-05T11:41:34.577 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.575+0000 7fb2f3a8b880 20 add_watcher() i=4 2023-10-05T11:41:34.578 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.575+0000 7fb2f3a8b880 20 add_watcher() i=5 2023-10-05T11:41:34.578 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.575+0000 7fb2f3a8b880 20 add_watcher() i=6 2023-10-05T11:41:34.578 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.576+0000 7fb2f3a8b880 20 add_watcher() i=7 2023-10-05T11:41:34.578 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.576+0000 7fb2f3a8b880 2 all 8 watchers are set, enabling cache 2023-10-05T11:41:34.580 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.577+0000 7fb2d91fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:41:34.580 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.578+0000 7fb2f3a8b880 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T11:41:34.580 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.578+0000 7fb2f3a8b880 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T11:41:34.586 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.583+0000 7fb2f3a8b880 5 note: GC not initialized 2023-10-05T11:41:34.586 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.584+0000 7fb2d49f5640 20 reqs_thread_entry: start 2023-10-05T11:41:34.586 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.584+0000 7fb2f3a8b880 20 init_complete bucket index max shards: 11 2023-10-05T11:41:34.587 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.584+0000 7fb2f3a8b880 20 Filter name: none 2023-10-05T11:41:34.587 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.584+0000 7fb2d29f1640 20 reqs_thread_entry: start 2023-10-05T11:41:34.587 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.584+0000 7fb2f3a8b880 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2023-10-05T11:41:34.587 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.584+0000 7fb2f3a8b880 20 rados->read ofs=0 len=0 2023-10-05T11:41:34.587 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.584+0000 7fb2f3a8b880 20 rados_obj.operate() r=0 bl.length=221 2023-10-05T11:41:34.588 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.584+0000 7fb2f3a8b880 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2023-10-05T11:41:34.588 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.584+0000 7fb2f3a8b880 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2023-10-05T11:41:34.588 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.584+0000 7fb2f3a8b880 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.25 : miss 2023-10-05T11:41:34.588 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.584+0000 7fb2f3a8b880 20 rados->read ofs=0 len=0 2023-10-05T11:41:34.588 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.585+0000 7fb2f3a8b880 20 rados_obj.operate() r=0 bl.length=393 2023-10-05T11:41:34.588 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.585+0000 7fb2f3a8b880 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.25 info.flags=0x17 2023-10-05T11:41:34.588 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.585+0000 7fb2f3a8b880 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.25 to cache LRU end 2023-10-05T11:41:34.588 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.585+0000 7fb2f3a8b880 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T11:41:34.588 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.585+0000 7fb2f3a8b880 10 updating xattr: name=user.rgw.acl bl.length()=265 2023-10-05T11:41:34.588 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.585+0000 7fb2f3a8b880 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.25 2023-10-05T11:41:34.593 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.591+0000 7fb2f3a8b880 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.25 info.flags=0x17 2023-10-05T11:41:34.593 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.591+0000 7fb2f3a8b880 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.25 to cache LRU end 2023-10-05T11:41:34.593 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.591+0000 7fb2f3a8b880 10 updating xattr: name=user.rgw.acl bl.length()=265 2023-10-05T11:41:34.593 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.591+0000 7fb2f3a8b880 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.25, ofs0, ns] 2023-10-05T11:41:34.594 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.591+0000 7fb2ec224640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1060856922175 cookie 94868770199552 notifier 6812 bl.length()=965 2023-10-05T11:41:34.594 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.591+0000 7fb2ec224640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.25 info.flags=0x17 2023-10-05T11:41:34.594 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.591+0000 7fb2ec224640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.25 to cache LRU end 2023-10-05T11:41:34.594 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.591+0000 7fb2ec224640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2023-10-05T11:41:34.595 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.593+0000 7fb2f3a8b880 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[dff27d1e-df33-400e-a68a-7ba586947c99.4604.25]): orig_sources= new_sources= 2023-10-05T11:41:34.596 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.593+0000 7fb2f3a8b880 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[dff27d1e-df33-400e-a68a-7ba586947c99.4604.25]): potential sources added=[] removed=[] 2023-10-05T11:41:34.596 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.593+0000 7fb2f3a8b880 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[dff27d1e-df33-400e-a68a-7ba586947c99.4604.25]): orig_dests= new_dests= 2023-10-05T11:41:34.596 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.593+0000 7fb2f3a8b880 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[dff27d1e-df33-400e-a68a-7ba586947c99.4604.25]): potential dests added=[] removed=[] 2023-10-05T11:41:34.598 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.596+0000 7fb2f3a8b880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.25.1.0 2023-10-05T11:41:34.599 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.596+0000 7fb2f3a8b880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.25.1.0 2023-10-05T11:41:34.599 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.596+0000 7fb2f3a8b880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.25.1.1 2023-10-05T11:41:34.599 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.596+0000 7fb2f3a8b880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.25.1.1 2023-10-05T11:41:34.599 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.596+0000 7fb2f3a8b880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.25.1.2 2023-10-05T11:41:34.599 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.596+0000 7fb2f3a8b880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.25.1.2 2023-10-05T11:41:34.599 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.596+0000 7fb2f3a8b880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.25.1.3 2023-10-05T11:41:34.599 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.596+0000 7fb2f3a8b880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.25.1.3 2023-10-05T11:41:34.599 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.596+0000 7fb2f3a8b880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.25.1.4 2023-10-05T11:41:34.599 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.596+0000 7fb2f3a8b880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.25.1.4 2023-10-05T11:41:34.599 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.596+0000 7fb2f3a8b880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.25.1.5 2023-10-05T11:41:34.599 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.596+0000 7fb2f3a8b880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.25.1.5 2023-10-05T11:41:34.600 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.596+0000 7fb2f3a8b880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.25.1.6 2023-10-05T11:41:34.600 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.596+0000 7fb2f3a8b880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.25.1.6 2023-10-05T11:41:34.600 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.596+0000 7fb2f3a8b880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.25.1.7 2023-10-05T11:41:34.600 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.596+0000 7fb2f3a8b880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.25.1.7 2023-10-05T11:41:34.600 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.596+0000 7fb2f3a8b880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.25.1.8 2023-10-05T11:41:34.600 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.596+0000 7fb2f3a8b880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.25.1.8 2023-10-05T11:41:34.600 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.596+0000 7fb2f3a8b880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.25.1.9 2023-10-05T11:41:34.600 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.596+0000 7fb2f3a8b880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.25.1.9 2023-10-05T11:41:34.600 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.596+0000 7fb2f3a8b880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.25.1.10 2023-10-05T11:41:34.600 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.596+0000 7fb2f3a8b880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.25.1.10 2023-10-05T11:41:34.600 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.596+0000 7fb2f3a8b880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.25.1.11 2023-10-05T11:41:34.600 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.596+0000 7fb2f3a8b880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.25.1.11 2023-10-05T11:41:34.601 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.596+0000 7fb2f3a8b880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.25.0 2023-10-05T11:41:34.601 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.596+0000 7fb2f3a8b880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.25.1 2023-10-05T11:41:34.601 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.597+0000 7fb2f3a8b880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.25.2 2023-10-05T11:41:34.601 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.597+0000 7fb2f3a8b880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.25.3 2023-10-05T11:41:34.602 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.598+0000 7fb2f3a8b880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.25.4 2023-10-05T11:41:34.602 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.598+0000 7fb2f3a8b880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.25.5 2023-10-05T11:41:34.602 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.599+0000 7fb2f3a8b880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.25.6 2023-10-05T11:41:34.602 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.600+0000 7fb2f3a8b880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.25.7 2023-10-05T11:41:34.603 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.600+0000 7fb2f3a8b880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.25.8 2023-10-05T11:41:34.603 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.601+0000 7fb2f3a8b880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.25.9 2023-10-05T11:41:34.603 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.601+0000 7fb2f3a8b880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.25.10 2023-10-05T11:41:34.606 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.604+0000 7fb2f3a8b880 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.25 : hit (requested=0x17, cached=0x17) 2023-10-05T11:41:34.607 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.604+0000 7fb2f3a8b880 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.25 2023-10-05T11:41:34.608 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.606+0000 7fb2f3a8b880 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.25 info.flags=0x17 2023-10-05T11:41:34.608 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.606+0000 7fb2f3a8b880 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.25 to cache LRU end 2023-10-05T11:41:34.608 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.606+0000 7fb2f3a8b880 10 updating xattr: name=user.rgw.acl bl.length()=265 2023-10-05T11:41:34.608 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.606+0000 7fb2f3a8b880 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.25, ofs0, ns] 2023-10-05T11:41:34.609 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.606+0000 7fb2eca25640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1060856922176 cookie 94868770199552 notifier 6812 bl.length()=933 2023-10-05T11:41:34.609 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.606+0000 7fb2eca25640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.25 info.flags=0x17 2023-10-05T11:41:34.609 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.606+0000 7fb2eca25640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:dff27d1e-df33-400e-a68a-7ba586947c99.4604.25 to cache LRU end 2023-10-05T11:41:34.609 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.606+0000 7fb2eca25640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2023-10-05T11:41:34.613 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.611+0000 7fb2f3a8b880 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[dff27d1e-df33-400e-a68a-7ba586947c99.4604.25]): orig_sources= new_sources= 2023-10-05T11:41:34.613 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.611+0000 7fb2f3a8b880 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[dff27d1e-df33-400e-a68a-7ba586947c99.4604.25]): potential sources added=[] removed=[] 2023-10-05T11:41:34.613 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.611+0000 7fb2f3a8b880 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[dff27d1e-df33-400e-a68a-7ba586947c99.4604.25]): orig_dests= new_dests= 2023-10-05T11:41:34.613 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.611+0000 7fb2f3a8b880 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[dff27d1e-df33-400e-a68a-7ba586947c99.4604.25]): potential dests added=[] removed=[] 2023-10-05T11:41:34.615 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.613+0000 7fb2f3a8b880 1 execute INFO: reshard of bucket "abort-at-commit-target-layout" completed successfully 2023-10-05T11:41:34.617 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.615+0000 7fb2d91fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:41:34.619 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.617+0000 7fb2f3a8b880 20 remove_watcher() i=0 2023-10-05T11:41:34.619 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.617+0000 7fb2f3a8b880 2 removed watcher, disabling cache 2023-10-05T11:41:34.621 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.619+0000 7fb2f3a8b880 20 remove_watcher() i=1 2023-10-05T11:41:34.622 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.620+0000 7fb2f3a8b880 20 remove_watcher() i=2 2023-10-05T11:41:34.623 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.621+0000 7fb2f3a8b880 20 remove_watcher() i=3 2023-10-05T11:41:34.624 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.622+0000 7fb2f3a8b880 20 remove_watcher() i=4 2023-10-05T11:41:34.625 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.623+0000 7fb2f3a8b880 20 remove_watcher() i=5 2023-10-05T11:41:34.627 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.624+0000 7fb2f3a8b880 20 remove_watcher() i=6 2023-10-05T11:41:34.627 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.625+0000 7fb2f3a8b880 20 remove_watcher() i=7 2023-10-05T11:41:34.633 INFO:tasks.workunit.client.0.smithi012.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2023-10-05T11:41:34.662 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setuser ceph since I am not root 2023-10-05T11:41:34.663 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T11:41:34.676 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.674+0000 7f76d5d4b880 20 rados->read ofs=0 len=0 2023-10-05T11:41:34.678 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.675+0000 7f76d5d4b880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:34.678 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.675+0000 7f76d5d4b880 20 realm 2023-10-05T11:41:34.678 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.675+0000 7f76d5d4b880 20 rados->read ofs=0 len=0 2023-10-05T11:41:34.678 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.675+0000 7f76d5d4b880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:34.678 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.675+0000 7f76d5d4b880 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T11:41:34.678 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.675+0000 7f76d5d4b880 20 rados->read ofs=0 len=0 2023-10-05T11:41:34.678 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.675+0000 7f76d5d4b880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:34.678 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.676+0000 7f76d5d4b880 20 rados->read ofs=0 len=0 2023-10-05T11:41:34.679 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.676+0000 7f76d5d4b880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:41:34.679 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.676+0000 7f76d5d4b880 20 rados->read ofs=0 len=0 2023-10-05T11:41:34.679 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.677+0000 7f76d5d4b880 20 rados_obj.operate() r=0 bl.length=1020 2023-10-05T11:41:34.679 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.677+0000 7f76d5d4b880 20 searching for the correct realm 2023-10-05T11:41:34.690 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.688+0000 7f76d44f0640 0 -- 172.21.15.12:0/1770421666 >> [v2:172.21.15.170:6814/3150808418,v1:172.21.15.170:6816/3150808418] conn(0x55e8bcf79000 msgr2=0x55e8bc2e6c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:41:34.692 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.689+0000 7f76d5d4b880 20 RGWRados::pool_iterate: got zone_info.dff27d1e-df33-400e-a68a-7ba586947c99 2023-10-05T11:41:34.692 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.689+0000 7f76d5d4b880 20 RGWRados::pool_iterate: got zonegroup_info.c78aa576-9d15-4e9d-b3c0-4af23a22062c 2023-10-05T11:41:34.692 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.689+0000 7f76d5d4b880 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T11:41:34.692 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.689+0000 7f76d5d4b880 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T11:41:34.692 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.689+0000 7f76d5d4b880 20 rados->read ofs=0 len=0 2023-10-05T11:41:34.693 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.689+0000 7f76d5d4b880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:34.693 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.689+0000 7f76d5d4b880 20 rados->read ofs=0 len=0 2023-10-05T11:41:34.694 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.690+0000 7f76d5d4b880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:41:34.694 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.690+0000 7f76d5d4b880 20 rados->read ofs=0 len=0 2023-10-05T11:41:34.694 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.690+0000 7f76d5d4b880 20 rados_obj.operate() r=0 bl.length=454 2023-10-05T11:41:34.695 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.690+0000 7f76d5d4b880 20 zone default found 2023-10-05T11:41:34.695 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.690+0000 7f76d5d4b880 4 Realm: () 2023-10-05T11:41:34.695 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.690+0000 7f76d5d4b880 4 ZoneGroup: default (c78aa576-9d15-4e9d-b3c0-4af23a22062c) 2023-10-05T11:41:34.695 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.690+0000 7f76d5d4b880 4 Zone: default (dff27d1e-df33-400e-a68a-7ba586947c99) 2023-10-05T11:41:34.695 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.690+0000 7f76d5d4b880 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T11:41:34.695 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.690+0000 7f76d5d4b880 20 zonegroup default 2023-10-05T11:41:34.695 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.690+0000 7f76d5d4b880 20 rados->read ofs=0 len=0 2023-10-05T11:41:34.696 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.690+0000 7f76d5d4b880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:34.696 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.690+0000 7f76d5d4b880 20 rados->read ofs=0 len=0 2023-10-05T11:41:34.696 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.691+0000 7f76d5d4b880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:34.696 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.691+0000 7f76d5d4b880 20 rados->read ofs=0 len=0 2023-10-05T11:41:34.696 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.691+0000 7f76d5d4b880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:34.696 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.691+0000 7f76d5d4b880 20 started sync module instance, tier type = 2023-10-05T11:41:34.696 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.691+0000 7f76d5d4b880 20 started zone id=dff27d1e-df33-400e-a68a-7ba586947c99 (name=default) with tier type = 2023-10-05T11:41:34.700 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.698+0000 7f76d4cf1640 0 -- 172.21.15.12:0/1770421666 >> [v2:172.21.15.170:6800/4137726411,v1:172.21.15.170:6801/4137726411] conn(0x55e8bc4a9c00 msgr2=0x55e8bc3af600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:41:34.703 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.700+0000 7f76d5d4b880 20 add_watcher() i=0 2023-10-05T11:41:34.703 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.700+0000 7f76d5d4b880 20 add_watcher() i=1 2023-10-05T11:41:34.703 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.700+0000 7f76d5d4b880 20 add_watcher() i=2 2023-10-05T11:41:34.703 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.700+0000 7f76d5d4b880 20 add_watcher() i=3 2023-10-05T11:41:34.703 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.700+0000 7f76d5d4b880 20 add_watcher() i=4 2023-10-05T11:41:34.703 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.700+0000 7f76d5d4b880 20 add_watcher() i=5 2023-10-05T11:41:34.704 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.700+0000 7f76d5d4b880 20 add_watcher() i=6 2023-10-05T11:41:34.704 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.701+0000 7f76d5d4b880 20 add_watcher() i=7 2023-10-05T11:41:34.704 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.701+0000 7f76d5d4b880 2 all 8 watchers are set, enabling cache 2023-10-05T11:41:34.705 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.703+0000 7f76bb4be640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:41:34.706 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.703+0000 7f76d5d4b880 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T11:41:34.706 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.703+0000 7f76d5d4b880 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T11:41:34.711 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.709+0000 7f76d5d4b880 5 note: GC not initialized 2023-10-05T11:41:34.712 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.709+0000 7f76b6cb5640 20 reqs_thread_entry: start 2023-10-05T11:41:34.712 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.709+0000 7f76d5d4b880 20 init_complete bucket index max shards: 11 2023-10-05T11:41:34.712 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.709+0000 7f76d5d4b880 20 Filter name: none 2023-10-05T11:41:34.712 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.709+0000 7f76b4cb1640 20 reqs_thread_entry: start 2023-10-05T11:41:34.712 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.709+0000 7f76d5d4b880 20 rados->read ofs=0 len=0 2023-10-05T11:41:34.713 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.710+0000 7f76d5d4b880 20 rados_obj.operate() r=0 bl.length=221 2023-10-05T11:41:34.713 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.710+0000 7f76d5d4b880 20 rados->read ofs=0 len=0 2023-10-05T11:41:34.713 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.710+0000 7f76d5d4b880 20 rados_obj.operate() r=0 bl.length=393 2023-10-05T11:41:34.713 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.710+0000 7f76d5d4b880 20 couldn't put binfo cache entry, might have raced with data changes 2023-10-05T11:41:34.713 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.710+0000 7f76d5d4b880 20 rados->read ofs=0 len=0 2023-10-05T11:41:34.713 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.710+0000 7f76d5d4b880 20 rados_obj.operate() r=0 bl.length=221 2023-10-05T11:41:34.713 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.710+0000 7f76d5d4b880 20 rados->read ofs=0 len=0 2023-10-05T11:41:34.714 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.711+0000 7f76d5d4b880 20 rados_obj.operate() r=0 bl.length=393 2023-10-05T11:41:34.714 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.711+0000 7f76d5d4b880 20 couldn't put binfo cache entry, might have raced with data changes 2023-10-05T11:41:34.714 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.712+0000 7f76d5d4b880 20 rados->read ofs=0 len=0 2023-10-05T11:41:34.714 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.712+0000 7f76d5d4b880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:34.715 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.712+0000 7f76bb4be640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:41:34.717 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.715+0000 7f76d5d4b880 20 remove_watcher() i=0 2023-10-05T11:41:34.717 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.715+0000 7f76d5d4b880 2 removed watcher, disabling cache 2023-10-05T11:41:34.719 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.717+0000 7f76d5d4b880 20 remove_watcher() i=1 2023-10-05T11:41:34.721 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.719+0000 7f76d5d4b880 20 remove_watcher() i=2 2023-10-05T11:41:34.723 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.721+0000 7f76d5d4b880 20 remove_watcher() i=3 2023-10-05T11:41:34.725 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.722+0000 7f76d5d4b880 20 remove_watcher() i=4 2023-10-05T11:41:34.726 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.723+0000 7f76d5d4b880 20 remove_watcher() i=5 2023-10-05T11:41:34.726 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.724+0000 7f76d5d4b880 20 remove_watcher() i=6 2023-10-05T11:41:34.728 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:34.725+0000 7f76d5d4b880 20 remove_watcher() i=7 2023-10-05T11:41:34.732 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:41:34.732 INFO:tasks.workunit.client.0.smithi012.stderr:BUCKET_STATS: 2023-10-05T11:41:34.732 INFO:tasks.workunit.client.0.smithi012.stderr:bucket: abort-at-commit-target-layout id: dff27d1e-df33-400e-a68a-7ba586947c99.4604.25 num_objects: 19 size_kb: 1 num_shards: 12 2023-10-05T11:41:34.732 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:41:35.065 INFO:tasks.workunit.client.0.smithi012.stderr:TEST: reshard bucket with EIO injected at do_reshard 2023-10-05T11:41:35.065 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:41:35.769 INFO:tasks.workunit.client.0.smithi012.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2023-10-05T11:41:35.797 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setuser ceph since I am not root 2023-10-05T11:41:35.797 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T11:41:35.810 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.808+0000 7fc69009d880 20 rados->read ofs=0 len=0 2023-10-05T11:41:35.812 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.809+0000 7fc69009d880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:35.812 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.809+0000 7fc69009d880 20 realm 2023-10-05T11:41:35.812 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.809+0000 7fc69009d880 20 rados->read ofs=0 len=0 2023-10-05T11:41:35.812 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.810+0000 7fc69009d880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:35.812 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.810+0000 7fc69009d880 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T11:41:35.812 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.810+0000 7fc69009d880 20 rados->read ofs=0 len=0 2023-10-05T11:41:35.813 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.810+0000 7fc69009d880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:35.813 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.810+0000 7fc69009d880 20 rados->read ofs=0 len=0 2023-10-05T11:41:35.813 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.811+0000 7fc69009d880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:41:35.813 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.811+0000 7fc69009d880 20 rados->read ofs=0 len=0 2023-10-05T11:41:35.814 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.811+0000 7fc69009d880 20 rados_obj.operate() r=0 bl.length=1020 2023-10-05T11:41:35.814 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.811+0000 7fc69009d880 20 searching for the correct realm 2023-10-05T11:41:35.823 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.821+0000 7fc68e849640 0 -- 172.21.15.12:0/1370150194 >> [v2:172.21.15.170:6814/3150808418,v1:172.21.15.170:6816/3150808418] conn(0x5653c37d5000 msgr2=0x5653c3780c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:41:35.825 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.822+0000 7fc69009d880 20 RGWRados::pool_iterate: got zone_info.dff27d1e-df33-400e-a68a-7ba586947c99 2023-10-05T11:41:35.825 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.822+0000 7fc69009d880 20 RGWRados::pool_iterate: got zonegroup_info.c78aa576-9d15-4e9d-b3c0-4af23a22062c 2023-10-05T11:41:35.825 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.822+0000 7fc69009d880 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T11:41:35.825 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.822+0000 7fc69009d880 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T11:41:35.825 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.822+0000 7fc69009d880 20 rados->read ofs=0 len=0 2023-10-05T11:41:35.825 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.822+0000 7fc69009d880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:35.825 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.822+0000 7fc69009d880 20 rados->read ofs=0 len=0 2023-10-05T11:41:35.826 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.823+0000 7fc69009d880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:41:35.827 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.823+0000 7fc69009d880 20 rados->read ofs=0 len=0 2023-10-05T11:41:35.827 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.823+0000 7fc69009d880 20 rados_obj.operate() r=0 bl.length=454 2023-10-05T11:41:35.827 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.823+0000 7fc69009d880 20 zone default found 2023-10-05T11:41:35.827 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.823+0000 7fc69009d880 4 Realm: () 2023-10-05T11:41:35.827 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.823+0000 7fc69009d880 4 ZoneGroup: default (c78aa576-9d15-4e9d-b3c0-4af23a22062c) 2023-10-05T11:41:35.827 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.823+0000 7fc69009d880 4 Zone: default (dff27d1e-df33-400e-a68a-7ba586947c99) 2023-10-05T11:41:35.827 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.823+0000 7fc69009d880 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T11:41:35.827 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.823+0000 7fc69009d880 20 zonegroup default 2023-10-05T11:41:35.827 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.823+0000 7fc69009d880 20 rados->read ofs=0 len=0 2023-10-05T11:41:35.827 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.823+0000 7fc69009d880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:35.827 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.823+0000 7fc69009d880 20 rados->read ofs=0 len=0 2023-10-05T11:41:35.828 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.824+0000 7fc69009d880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:35.828 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.824+0000 7fc69009d880 20 rados->read ofs=0 len=0 2023-10-05T11:41:35.828 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.824+0000 7fc69009d880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:35.828 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.824+0000 7fc69009d880 20 started sync module instance, tier type = 2023-10-05T11:41:35.828 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.824+0000 7fc69009d880 20 started zone id=dff27d1e-df33-400e-a68a-7ba586947c99 (name=default) with tier type = 2023-10-05T11:41:35.831 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.829+0000 7fc68f04a640 0 -- 172.21.15.12:0/1370150194 >> [v2:172.21.15.170:6800/4137726411,v1:172.21.15.170:6801/4137726411] conn(0x5653c392a400 msgr2=0x5653c3845600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:41:35.835 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.833+0000 7fc69009d880 20 add_watcher() i=0 2023-10-05T11:41:35.835 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.833+0000 7fc69009d880 20 add_watcher() i=1 2023-10-05T11:41:35.835 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.833+0000 7fc69009d880 20 add_watcher() i=2 2023-10-05T11:41:35.835 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.833+0000 7fc69009d880 20 add_watcher() i=3 2023-10-05T11:41:35.835 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.833+0000 7fc69009d880 20 add_watcher() i=4 2023-10-05T11:41:35.835 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.833+0000 7fc69009d880 20 add_watcher() i=5 2023-10-05T11:41:35.836 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.833+0000 7fc69009d880 20 add_watcher() i=6 2023-10-05T11:41:35.836 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.834+0000 7fc69009d880 20 add_watcher() i=7 2023-10-05T11:41:35.836 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.834+0000 7fc69009d880 2 all 8 watchers are set, enabling cache 2023-10-05T11:41:35.838 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.836+0000 7fc675817640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:41:35.838 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.836+0000 7fc69009d880 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T11:41:35.838 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.836+0000 7fc69009d880 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T11:41:35.844 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.842+0000 7fc69009d880 5 note: GC not initialized 2023-10-05T11:41:35.845 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.842+0000 7fc67100e640 20 reqs_thread_entry: start 2023-10-05T11:41:35.845 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.842+0000 7fc69009d880 20 init_complete bucket index max shards: 11 2023-10-05T11:41:35.845 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.842+0000 7fc69009d880 20 Filter name: none 2023-10-05T11:41:35.845 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.842+0000 7fc66f00a640 20 reqs_thread_entry: start 2023-10-05T11:41:35.845 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.842+0000 7fc69009d880 20 rados->read ofs=0 len=0 2023-10-05T11:41:35.846 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.843+0000 7fc69009d880 20 rados_obj.operate() r=0 bl.length=211 2023-10-05T11:41:35.846 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.843+0000 7fc69009d880 20 rados->read ofs=0 len=0 2023-10-05T11:41:35.846 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.843+0000 7fc69009d880 20 rados_obj.operate() r=0 bl.length=383 2023-10-05T11:41:35.846 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.843+0000 7fc69009d880 20 couldn't put binfo cache entry, might have raced with data changes 2023-10-05T11:41:35.846 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.843+0000 7fc69009d880 20 rados->read ofs=0 len=0 2023-10-05T11:41:35.846 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.844+0000 7fc69009d880 20 rados_obj.operate() r=0 bl.length=211 2023-10-05T11:41:35.846 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.844+0000 7fc69009d880 20 rados->read ofs=0 len=0 2023-10-05T11:41:35.847 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.844+0000 7fc69009d880 20 rados_obj.operate() r=0 bl.length=383 2023-10-05T11:41:35.847 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.844+0000 7fc69009d880 20 couldn't put binfo cache entry, might have raced with data changes 2023-10-05T11:41:35.847 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.845+0000 7fc69009d880 20 rados->read ofs=0 len=0 2023-10-05T11:41:35.848 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.845+0000 7fc69009d880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:35.848 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.846+0000 7fc675817640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:41:35.850 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.848+0000 7fc69009d880 20 remove_watcher() i=0 2023-10-05T11:41:35.850 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.848+0000 7fc69009d880 2 removed watcher, disabling cache 2023-10-05T11:41:35.851 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.849+0000 7fc69009d880 20 remove_watcher() i=1 2023-10-05T11:41:35.852 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.850+0000 7fc69009d880 20 remove_watcher() i=2 2023-10-05T11:41:35.853 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.851+0000 7fc69009d880 20 remove_watcher() i=3 2023-10-05T11:41:35.854 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.852+0000 7fc69009d880 20 remove_watcher() i=4 2023-10-05T11:41:35.855 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.853+0000 7fc69009d880 20 remove_watcher() i=5 2023-10-05T11:41:35.857 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.854+0000 7fc69009d880 20 remove_watcher() i=6 2023-10-05T11:41:35.857 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.855+0000 7fc69009d880 20 remove_watcher() i=7 2023-10-05T11:41:35.862 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:41:35.862 INFO:tasks.workunit.client.0.smithi012.stderr:BUCKET_STATS: 2023-10-05T11:41:35.862 INFO:tasks.workunit.client.0.smithi012.stderr:bucket: error-at-do-reshard id: dff27d1e-df33-400e-a68a-7ba586947c99.4604.26 num_objects: 20 size_kb: 1 num_shards: 11 2023-10-05T11:41:35.862 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:41:35.863 INFO:tasks.workunit.client.0.smithi012.stderr:radosgw-admin bucket reshard --bucket error-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at do_reshard 2023-10-05T11:41:35.896 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setuser ceph since I am not root 2023-10-05T11:41:35.896 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T11:41:35.909 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.907+0000 7fbea6727880 20 rados->read ofs=0 len=0 2023-10-05T11:41:35.911 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.908+0000 7fbea6727880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:35.911 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.908+0000 7fbea6727880 20 realm 2023-10-05T11:41:35.911 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.908+0000 7fbea6727880 20 rados->read ofs=0 len=0 2023-10-05T11:41:35.911 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.908+0000 7fbea6727880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:35.911 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.908+0000 7fbea6727880 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T11:41:35.911 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.908+0000 7fbea6727880 20 rados->read ofs=0 len=0 2023-10-05T11:41:35.911 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.909+0000 7fbea6727880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:35.911 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.909+0000 7fbea6727880 20 rados->read ofs=0 len=0 2023-10-05T11:41:35.912 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.909+0000 7fbea6727880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:41:35.912 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.909+0000 7fbea6727880 20 rados->read ofs=0 len=0 2023-10-05T11:41:35.912 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.910+0000 7fbea6727880 20 rados_obj.operate() r=0 bl.length=1020 2023-10-05T11:41:35.912 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.910+0000 7fbea6727880 20 searching for the correct realm 2023-10-05T11:41:35.921 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.919+0000 7fbea30d3640 0 -- 172.21.15.12:0/3631079770 >> [v2:172.21.15.12:6800/732466381,v1:172.21.15.12:6801/732466381] conn(0x55d29eaf3800 msgr2=0x55d29ead8b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:41:35.923 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.920+0000 7fbea6727880 20 RGWRados::pool_iterate: got zone_info.dff27d1e-df33-400e-a68a-7ba586947c99 2023-10-05T11:41:35.923 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.920+0000 7fbea6727880 20 RGWRados::pool_iterate: got zonegroup_info.c78aa576-9d15-4e9d-b3c0-4af23a22062c 2023-10-05T11:41:35.923 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.920+0000 7fbea6727880 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T11:41:35.923 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.920+0000 7fbea6727880 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T11:41:35.923 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.920+0000 7fbea6727880 20 rados->read ofs=0 len=0 2023-10-05T11:41:35.923 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.921+0000 7fbea6727880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:35.923 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.921+0000 7fbea6727880 20 rados->read ofs=0 len=0 2023-10-05T11:41:35.924 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.921+0000 7fbea6727880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:41:35.924 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.921+0000 7fbea6727880 20 rados->read ofs=0 len=0 2023-10-05T11:41:35.924 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.921+0000 7fbea6727880 20 rados_obj.operate() r=0 bl.length=454 2023-10-05T11:41:35.925 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.921+0000 7fbea6727880 20 zone default found 2023-10-05T11:41:35.925 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.921+0000 7fbea6727880 4 Realm: () 2023-10-05T11:41:35.925 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.921+0000 7fbea6727880 4 ZoneGroup: default (c78aa576-9d15-4e9d-b3c0-4af23a22062c) 2023-10-05T11:41:35.925 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.921+0000 7fbea6727880 4 Zone: default (dff27d1e-df33-400e-a68a-7ba586947c99) 2023-10-05T11:41:35.925 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.921+0000 7fbea6727880 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T11:41:35.925 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.921+0000 7fbea6727880 20 zonegroup default 2023-10-05T11:41:35.925 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.921+0000 7fbea6727880 20 rados->read ofs=0 len=0 2023-10-05T11:41:35.925 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.921+0000 7fbea6727880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:35.925 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.921+0000 7fbea6727880 20 rados->read ofs=0 len=0 2023-10-05T11:41:35.925 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.922+0000 7fbea6727880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:35.925 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.922+0000 7fbea6727880 20 rados->read ofs=0 len=0 2023-10-05T11:41:35.925 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.922+0000 7fbea6727880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:35.926 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.922+0000 7fbea6727880 20 started sync module instance, tier type = 2023-10-05T11:41:35.926 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.922+0000 7fbea6727880 20 started zone id=dff27d1e-df33-400e-a68a-7ba586947c99 (name=default) with tier type = 2023-10-05T11:41:35.930 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.928+0000 7fbea30d3640 0 -- 172.21.15.12:0/3631079770 >> [v2:172.21.15.12:6800/732466381,v1:172.21.15.12:6801/732466381] conn(0x55d29ebda000 msgr2=0x55d29eada100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:41:35.935 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.933+0000 7fbea6727880 20 add_watcher() i=0 2023-10-05T11:41:35.935 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.933+0000 7fbea6727880 20 add_watcher() i=1 2023-10-05T11:41:35.935 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.933+0000 7fbea6727880 20 add_watcher() i=2 2023-10-05T11:41:35.935 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.933+0000 7fbea6727880 20 add_watcher() i=3 2023-10-05T11:41:35.935 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.933+0000 7fbea6727880 20 add_watcher() i=4 2023-10-05T11:41:35.935 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.933+0000 7fbea6727880 20 add_watcher() i=5 2023-10-05T11:41:35.935 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.933+0000 7fbea6727880 20 add_watcher() i=6 2023-10-05T11:41:35.936 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.933+0000 7fbea6727880 20 add_watcher() i=7 2023-10-05T11:41:35.936 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.933+0000 7fbea6727880 2 all 8 watchers are set, enabling cache 2023-10-05T11:41:35.938 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.936+0000 7fbe8a0a1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:41:35.938 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.936+0000 7fbea6727880 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T11:41:35.938 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.936+0000 7fbea6727880 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T11:41:35.944 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.941+0000 7fbea6727880 5 note: GC not initialized 2023-10-05T11:41:35.944 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.942+0000 7fbe85898640 20 reqs_thread_entry: start 2023-10-05T11:41:35.944 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.942+0000 7fbea6727880 20 init_complete bucket index max shards: 11 2023-10-05T11:41:35.944 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.942+0000 7fbea6727880 20 Filter name: none 2023-10-05T11:41:35.944 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.942+0000 7fbe83894640 20 reqs_thread_entry: start 2023-10-05T11:41:35.945 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.942+0000 7fbea6727880 10 cache get: name=default.rgw.meta+root+error-at-do-reshard : miss 2023-10-05T11:41:35.945 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.942+0000 7fbea6727880 20 rados->read ofs=0 len=0 2023-10-05T11:41:35.945 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.942+0000 7fbea6727880 20 rados_obj.operate() r=0 bl.length=211 2023-10-05T11:41:35.946 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.942+0000 7fbea6727880 10 cache put: name=default.rgw.meta+root+error-at-do-reshard info.flags=0x11 2023-10-05T11:41:35.946 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.942+0000 7fbea6727880 10 adding default.rgw.meta+root+error-at-do-reshard to cache LRU end 2023-10-05T11:41:35.946 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.942+0000 7fbea6727880 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:dff27d1e-df33-400e-a68a-7ba586947c99.4604.26 : miss 2023-10-05T11:41:35.946 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.942+0000 7fbea6727880 20 rados->read ofs=0 len=0 2023-10-05T11:41:35.946 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.943+0000 7fbea6727880 20 rados_obj.operate() r=0 bl.length=383 2023-10-05T11:41:35.946 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.943+0000 7fbea6727880 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:dff27d1e-df33-400e-a68a-7ba586947c99.4604.26 info.flags=0x17 2023-10-05T11:41:35.946 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.943+0000 7fbea6727880 10 adding default.rgw.meta+root+.bucket.meta.error-at-do-reshard:dff27d1e-df33-400e-a68a-7ba586947c99.4604.26 to cache LRU end 2023-10-05T11:41:35.946 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.943+0000 7fbea6727880 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T11:41:35.946 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.943+0000 7fbea6727880 10 updating xattr: name=user.rgw.acl bl.length()=265 2023-10-05T11:41:35.946 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.943+0000 7fbea6727880 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:dff27d1e-df33-400e-a68a-7ba586947c99.4604.26 2023-10-05T11:41:35.950 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.948+0000 7fbea6727880 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:dff27d1e-df33-400e-a68a-7ba586947c99.4604.26 info.flags=0x17 2023-10-05T11:41:35.950 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.948+0000 7fbea6727880 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:dff27d1e-df33-400e-a68a-7ba586947c99.4604.26 to cache LRU end 2023-10-05T11:41:35.950 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.948+0000 7fbea6727880 10 updating xattr: name=user.rgw.acl bl.length()=265 2023-10-05T11:41:35.950 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.948+0000 7fbea6727880 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:dff27d1e-df33-400e-a68a-7ba586947c99.4604.26, ofs0, ns] 2023-10-05T11:41:35.950 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.948+0000 7fbe9d8c8640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1060856922173 cookie 94363094723584 notifier 7251 bl.length()=945 2023-10-05T11:41:35.951 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.948+0000 7fbe9d8c8640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:dff27d1e-df33-400e-a68a-7ba586947c99.4604.26 info.flags=0x17 2023-10-05T11:41:35.951 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.948+0000 7fbe9d8c8640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:dff27d1e-df33-400e-a68a-7ba586947c99.4604.26 to cache LRU end 2023-10-05T11:41:35.951 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.948+0000 7fbe9d8c8640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2023-10-05T11:41:35.952 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.949+0000 7fbea6727880 20 handle_bi_update(): bucket=:error-at-do-reshard[dff27d1e-df33-400e-a68a-7ba586947c99.4604.26]): orig_sources= new_sources= 2023-10-05T11:41:35.952 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.949+0000 7fbea6727880 20 handle_bi_update(): bucket=:error-at-do-reshard[dff27d1e-df33-400e-a68a-7ba586947c99.4604.26]): potential sources added=[] removed=[] 2023-10-05T11:41:35.952 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.949+0000 7fbea6727880 20 handle_bi_update(): bucket=:error-at-do-reshard[dff27d1e-df33-400e-a68a-7ba586947c99.4604.26]): orig_dests= new_dests= 2023-10-05T11:41:35.952 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.949+0000 7fbea6727880 20 handle_bi_update(): bucket=:error-at-do-reshard[dff27d1e-df33-400e-a68a-7ba586947c99.4604.26]): potential dests added=[] removed=[] 2023-10-05T11:41:35.954 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.952+0000 7fbea6727880 -1 Injecting error=-5 at location=do_reshard 2023-10-05T11:41:35.959 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.957+0000 7fbea6727880 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:dff27d1e-df33-400e-a68a-7ba586947c99.4604.26 : hit (requested=0x17, cached=0x17) 2023-10-05T11:41:35.959 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.957+0000 7fbea6727880 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:dff27d1e-df33-400e-a68a-7ba586947c99.4604.26 2023-10-05T11:41:35.960 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.958+0000 7fbea6727880 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:dff27d1e-df33-400e-a68a-7ba586947c99.4604.26 info.flags=0x17 2023-10-05T11:41:35.960 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.958+0000 7fbea6727880 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:dff27d1e-df33-400e-a68a-7ba586947c99.4604.26 to cache LRU end 2023-10-05T11:41:35.960 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.958+0000 7fbea6727880 10 updating xattr: name=user.rgw.acl bl.length()=265 2023-10-05T11:41:35.961 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.958+0000 7fbea6727880 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:dff27d1e-df33-400e-a68a-7ba586947c99.4604.26, ofs0, ns] 2023-10-05T11:41:35.961 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.958+0000 7fbe9d8c8640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1060856922174 cookie 94363094723584 notifier 7251 bl.length()=913 2023-10-05T11:41:35.961 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.958+0000 7fbe9d8c8640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:dff27d1e-df33-400e-a68a-7ba586947c99.4604.26 info.flags=0x17 2023-10-05T11:41:35.961 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.958+0000 7fbe9d8c8640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:dff27d1e-df33-400e-a68a-7ba586947c99.4604.26 to cache LRU end 2023-10-05T11:41:35.961 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.958+0000 7fbe9d8c8640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2023-10-05T11:41:35.962 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.960+0000 7fbea6727880 20 handle_bi_update(): bucket=:error-at-do-reshard[dff27d1e-df33-400e-a68a-7ba586947c99.4604.26]): orig_sources= new_sources= 2023-10-05T11:41:35.962 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.960+0000 7fbea6727880 20 handle_bi_update(): bucket=:error-at-do-reshard[dff27d1e-df33-400e-a68a-7ba586947c99.4604.26]): potential sources added=[] removed=[] 2023-10-05T11:41:35.962 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.960+0000 7fbea6727880 20 handle_bi_update(): bucket=:error-at-do-reshard[dff27d1e-df33-400e-a68a-7ba586947c99.4604.26]): orig_dests= new_dests= 2023-10-05T11:41:35.962 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.960+0000 7fbea6727880 20 handle_bi_update(): bucket=:error-at-do-reshard[dff27d1e-df33-400e-a68a-7ba586947c99.4604.26]): potential dests added=[] removed=[] 2023-10-05T11:41:35.962 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.960+0000 7fbea6727880 1 execute INFO: reshard of bucket "error-at-do-reshard" canceled due to errors 2023-10-05T11:41:35.964 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.962+0000 7fbe8a0a1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:41:35.966 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.964+0000 7fbea6727880 20 remove_watcher() i=0 2023-10-05T11:41:35.966 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.964+0000 7fbea6727880 2 removed watcher, disabling cache 2023-10-05T11:41:35.967 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.965+0000 7fbea6727880 20 remove_watcher() i=1 2023-10-05T11:41:35.968 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.966+0000 7fbea6727880 20 remove_watcher() i=2 2023-10-05T11:41:35.969 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.967+0000 7fbea6727880 20 remove_watcher() i=3 2023-10-05T11:41:35.970 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.968+0000 7fbea6727880 20 remove_watcher() i=4 2023-10-05T11:41:35.971 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.969+0000 7fbea6727880 20 remove_watcher() i=5 2023-10-05T11:41:35.972 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.970+0000 7fbea6727880 20 remove_watcher() i=6 2023-10-05T11:41:35.973 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:35.970+0000 7fbea6727880 20 remove_watcher() i=7 2023-10-05T11:41:35.979 INFO:tasks.workunit.client.0.smithi012.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2023-10-05T11:41:36.008 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setuser ceph since I am not root 2023-10-05T11:41:36.085 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T11:41:36.090 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.018+0000 7f948dfdc880 20 rados->read ofs=0 len=0 2023-10-05T11:41:36.090 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.020+0000 7f948dfdc880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:36.090 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.020+0000 7f948dfdc880 20 realm 2023-10-05T11:41:36.090 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.020+0000 7f948dfdc880 20 rados->read ofs=0 len=0 2023-10-05T11:41:36.090 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.020+0000 7f948dfdc880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:36.090 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.020+0000 7f948dfdc880 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T11:41:36.090 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.020+0000 7f948dfdc880 20 rados->read ofs=0 len=0 2023-10-05T11:41:36.090 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.020+0000 7f948dfdc880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:36.090 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.020+0000 7f948dfdc880 20 rados->read ofs=0 len=0 2023-10-05T11:41:36.090 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.021+0000 7f948dfdc880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:41:36.091 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.021+0000 7f948dfdc880 20 rados->read ofs=0 len=0 2023-10-05T11:41:36.091 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.022+0000 7f948dfdc880 20 rados_obj.operate() r=0 bl.length=1020 2023-10-05T11:41:36.091 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.022+0000 7f948dfdc880 20 searching for the correct realm 2023-10-05T11:41:36.091 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.031+0000 7f948cf82640 0 -- 172.21.15.12:0/3076310097 >> [v2:172.21.15.12:6824/2171933159,v1:172.21.15.12:6825/2171933159] conn(0x563a1ee64000 msgr2=0x563a1e1bd700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:41:36.091 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.032+0000 7f948dfdc880 20 RGWRados::pool_iterate: got zone_info.dff27d1e-df33-400e-a68a-7ba586947c99 2023-10-05T11:41:36.091 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.032+0000 7f948dfdc880 20 RGWRados::pool_iterate: got zonegroup_info.c78aa576-9d15-4e9d-b3c0-4af23a22062c 2023-10-05T11:41:36.091 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.032+0000 7f948dfdc880 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T11:41:36.091 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.032+0000 7f948dfdc880 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T11:41:36.091 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.032+0000 7f948dfdc880 20 rados->read ofs=0 len=0 2023-10-05T11:41:36.091 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.032+0000 7f948dfdc880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:36.091 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.032+0000 7f948dfdc880 20 rados->read ofs=0 len=0 2023-10-05T11:41:36.091 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.032+0000 7f948dfdc880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:41:36.092 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.032+0000 7f948dfdc880 20 rados->read ofs=0 len=0 2023-10-05T11:41:36.092 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.033+0000 7f948dfdc880 20 rados_obj.operate() r=0 bl.length=454 2023-10-05T11:41:36.092 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.033+0000 7f948dfdc880 20 zone default found 2023-10-05T11:41:36.092 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.033+0000 7f948dfdc880 4 Realm: () 2023-10-05T11:41:36.092 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.033+0000 7f948dfdc880 4 ZoneGroup: default (c78aa576-9d15-4e9d-b3c0-4af23a22062c) 2023-10-05T11:41:36.092 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.033+0000 7f948dfdc880 4 Zone: default (dff27d1e-df33-400e-a68a-7ba586947c99) 2023-10-05T11:41:36.092 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.033+0000 7f948dfdc880 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T11:41:36.092 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.033+0000 7f948dfdc880 20 zonegroup default 2023-10-05T11:41:36.092 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.033+0000 7f948dfdc880 20 rados->read ofs=0 len=0 2023-10-05T11:41:36.092 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.033+0000 7f948dfdc880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:36.092 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.033+0000 7f948dfdc880 20 rados->read ofs=0 len=0 2023-10-05T11:41:36.092 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.033+0000 7f948dfdc880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:36.093 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.033+0000 7f948dfdc880 20 rados->read ofs=0 len=0 2023-10-05T11:41:36.093 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.033+0000 7f948dfdc880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:36.093 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.033+0000 7f948dfdc880 20 started sync module instance, tier type = 2023-10-05T11:41:36.093 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.033+0000 7f948dfdc880 20 started zone id=dff27d1e-df33-400e-a68a-7ba586947c99 (name=default) with tier type = 2023-10-05T11:41:36.093 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.040+0000 7f948cf82640 0 -- 172.21.15.12:0/3076310097 >> [v2:172.21.15.12:6824/2171933159,v1:172.21.15.12:6825/2171933159] conn(0x563a1e388000 msgr2=0x563a1e27c100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-10-05T11:41:36.093 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.043+0000 7f948dfdc880 20 add_watcher() i=0 2023-10-05T11:41:36.093 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.043+0000 7f948dfdc880 20 add_watcher() i=1 2023-10-05T11:41:36.093 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.043+0000 7f948dfdc880 20 add_watcher() i=2 2023-10-05T11:41:36.093 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.043+0000 7f948dfdc880 20 add_watcher() i=3 2023-10-05T11:41:36.093 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.043+0000 7f948dfdc880 20 add_watcher() i=4 2023-10-05T11:41:36.093 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.043+0000 7f948dfdc880 20 add_watcher() i=5 2023-10-05T11:41:36.093 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.043+0000 7f948dfdc880 20 add_watcher() i=6 2023-10-05T11:41:36.093 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.043+0000 7f948dfdc880 20 add_watcher() i=7 2023-10-05T11:41:36.094 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.043+0000 7f948dfdc880 2 all 8 watchers are set, enabling cache 2023-10-05T11:41:36.094 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.045+0000 7f947374f640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:41:36.094 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.045+0000 7f948dfdc880 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T11:41:36.094 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.045+0000 7f948dfdc880 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T11:41:36.094 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.051+0000 7f948dfdc880 5 note: GC not initialized 2023-10-05T11:41:36.094 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.051+0000 7f946ef46640 20 reqs_thread_entry: start 2023-10-05T11:41:36.094 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.051+0000 7f948dfdc880 20 init_complete bucket index max shards: 11 2023-10-05T11:41:36.094 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.051+0000 7f948dfdc880 20 Filter name: none 2023-10-05T11:41:36.094 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.051+0000 7f946cf42640 20 reqs_thread_entry: start 2023-10-05T11:41:36.094 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.051+0000 7f948dfdc880 20 rados->read ofs=0 len=0 2023-10-05T11:41:36.094 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.051+0000 7f948dfdc880 20 rados_obj.operate() r=0 bl.length=211 2023-10-05T11:41:36.095 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.051+0000 7f948dfdc880 20 rados->read ofs=0 len=0 2023-10-05T11:41:36.095 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.052+0000 7f948dfdc880 20 rados_obj.operate() r=0 bl.length=383 2023-10-05T11:41:36.095 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.052+0000 7f948dfdc880 20 couldn't put binfo cache entry, might have raced with data changes 2023-10-05T11:41:36.095 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.052+0000 7f948dfdc880 20 rados->read ofs=0 len=0 2023-10-05T11:41:36.095 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.052+0000 7f948dfdc880 20 rados_obj.operate() r=0 bl.length=211 2023-10-05T11:41:36.095 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.052+0000 7f948dfdc880 20 rados->read ofs=0 len=0 2023-10-05T11:41:36.095 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.053+0000 7f948dfdc880 20 rados_obj.operate() r=0 bl.length=383 2023-10-05T11:41:36.095 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.053+0000 7f948dfdc880 20 couldn't put binfo cache entry, might have raced with data changes 2023-10-05T11:41:36.095 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.054+0000 7f948dfdc880 20 rados->read ofs=0 len=0 2023-10-05T11:41:36.095 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.054+0000 7f948dfdc880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:36.095 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.054+0000 7f947374f640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:41:36.095 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.056+0000 7f948dfdc880 20 remove_watcher() i=0 2023-10-05T11:41:36.095 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.056+0000 7f948dfdc880 2 removed watcher, disabling cache 2023-10-05T11:41:36.096 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.057+0000 7f948dfdc880 20 remove_watcher() i=1 2023-10-05T11:41:36.096 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.058+0000 7f948dfdc880 20 remove_watcher() i=2 2023-10-05T11:41:36.096 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.059+0000 7f948dfdc880 20 remove_watcher() i=3 2023-10-05T11:41:36.096 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.060+0000 7f948dfdc880 20 remove_watcher() i=4 2023-10-05T11:41:36.096 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.061+0000 7f948dfdc880 20 remove_watcher() i=5 2023-10-05T11:41:36.096 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.062+0000 7f948dfdc880 20 remove_watcher() i=6 2023-10-05T11:41:36.096 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.063+0000 7f948dfdc880 20 remove_watcher() i=7 2023-10-05T11:41:36.096 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:41:36.096 INFO:tasks.workunit.client.0.smithi012.stderr:BUCKET_STATS: 2023-10-05T11:41:36.096 INFO:tasks.workunit.client.0.smithi012.stderr:bucket: error-at-do-reshard id: dff27d1e-df33-400e-a68a-7ba586947c99.4604.26 num_objects: 20 size_kb: 1 num_shards: 11 2023-10-05T11:41:36.096 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:41:36.152 INFO:tasks.workunit.client.0.smithi012.stderr:radosgw-admin bucket reshard --bucket error-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2023-10-05T11:41:36.184 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setuser ceph since I am not root 2023-10-05T11:41:36.184 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T11:41:36.197 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.195+0000 7fdb50d27880 20 rados->read ofs=0 len=0 2023-10-05T11:41:36.198 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.196+0000 7fdb50d27880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:36.199 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.196+0000 7fdb50d27880 20 realm 2023-10-05T11:41:36.199 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.196+0000 7fdb50d27880 20 rados->read ofs=0 len=0 2023-10-05T11:41:36.199 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.196+0000 7fdb50d27880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:36.199 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.196+0000 7fdb50d27880 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T11:41:36.199 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.196+0000 7fdb50d27880 20 rados->read ofs=0 len=0 2023-10-05T11:41:36.199 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.196+0000 7fdb50d27880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:36.199 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.196+0000 7fdb50d27880 20 rados->read ofs=0 len=0 2023-10-05T11:41:36.199 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.197+0000 7fdb50d27880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:41:36.200 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.197+0000 7fdb50d27880 20 rados->read ofs=0 len=0 2023-10-05T11:41:36.200 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.198+0000 7fdb50d27880 20 rados_obj.operate() r=0 bl.length=1020 2023-10-05T11:41:36.200 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.198+0000 7fdb50d27880 20 searching for the correct realm 2023-10-05T11:41:36.209 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.206+0000 7fdb4d764640 0 -- 172.21.15.12:0/2960062698 >> [v2:172.21.15.12:6800/732466381,v1:172.21.15.12:6801/732466381] conn(0x555ffa3c1800 msgr2=0x555ffa3b4b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:41:36.210 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.208+0000 7fdb50d27880 20 RGWRados::pool_iterate: got zone_info.dff27d1e-df33-400e-a68a-7ba586947c99 2023-10-05T11:41:36.210 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.208+0000 7fdb50d27880 20 RGWRados::pool_iterate: got zonegroup_info.c78aa576-9d15-4e9d-b3c0-4af23a22062c 2023-10-05T11:41:36.210 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.208+0000 7fdb50d27880 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T11:41:36.211 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.208+0000 7fdb50d27880 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T11:41:36.211 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.208+0000 7fdb50d27880 20 rados->read ofs=0 len=0 2023-10-05T11:41:36.211 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.208+0000 7fdb50d27880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:36.211 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.208+0000 7fdb50d27880 20 rados->read ofs=0 len=0 2023-10-05T11:41:36.211 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.208+0000 7fdb50d27880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:41:36.211 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.208+0000 7fdb50d27880 20 rados->read ofs=0 len=0 2023-10-05T11:41:36.212 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.208+0000 7fdb50d27880 20 rados_obj.operate() r=0 bl.length=454 2023-10-05T11:41:36.212 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.208+0000 7fdb50d27880 20 zone default found 2023-10-05T11:41:36.212 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.208+0000 7fdb50d27880 4 Realm: () 2023-10-05T11:41:36.212 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.208+0000 7fdb50d27880 4 ZoneGroup: default (c78aa576-9d15-4e9d-b3c0-4af23a22062c) 2023-10-05T11:41:36.212 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.208+0000 7fdb50d27880 4 Zone: default (dff27d1e-df33-400e-a68a-7ba586947c99) 2023-10-05T11:41:36.212 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.208+0000 7fdb50d27880 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T11:41:36.212 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.208+0000 7fdb50d27880 20 zonegroup default 2023-10-05T11:41:36.212 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.208+0000 7fdb50d27880 20 rados->read ofs=0 len=0 2023-10-05T11:41:36.212 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.209+0000 7fdb50d27880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:36.213 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.209+0000 7fdb50d27880 20 rados->read ofs=0 len=0 2023-10-05T11:41:36.213 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.209+0000 7fdb50d27880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:36.213 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.209+0000 7fdb50d27880 20 rados->read ofs=0 len=0 2023-10-05T11:41:36.213 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.209+0000 7fdb50d27880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:36.213 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.209+0000 7fdb50d27880 20 started sync module instance, tier type = 2023-10-05T11:41:36.213 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.209+0000 7fdb50d27880 20 started zone id=dff27d1e-df33-400e-a68a-7ba586947c99 (name=default) with tier type = 2023-10-05T11:41:36.217 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.214+0000 7fdb4df65640 0 -- 172.21.15.12:0/2960062698 >> [v2:172.21.15.170:6800/4137726411,v1:172.21.15.170:6801/4137726411] conn(0x555ffa3c1c00 msgr2=0x555ffa3b5600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:41:36.220 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.218+0000 7fdb50d27880 20 add_watcher() i=0 2023-10-05T11:41:36.220 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.218+0000 7fdb50d27880 20 add_watcher() i=1 2023-10-05T11:41:36.220 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.218+0000 7fdb50d27880 20 add_watcher() i=2 2023-10-05T11:41:36.221 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.218+0000 7fdb50d27880 20 add_watcher() i=3 2023-10-05T11:41:36.221 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.218+0000 7fdb50d27880 20 add_watcher() i=4 2023-10-05T11:41:36.221 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.218+0000 7fdb50d27880 20 add_watcher() i=5 2023-10-05T11:41:36.221 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.218+0000 7fdb50d27880 20 add_watcher() i=6 2023-10-05T11:41:36.221 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.219+0000 7fdb50d27880 20 add_watcher() i=7 2023-10-05T11:41:36.221 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.219+0000 7fdb50d27880 2 all 8 watchers are set, enabling cache 2023-10-05T11:41:36.222 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.220+0000 7fdb34732640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:41:36.223 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.221+0000 7fdb50d27880 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T11:41:36.223 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.221+0000 7fdb50d27880 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T11:41:36.229 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.226+0000 7fdb50d27880 5 note: GC not initialized 2023-10-05T11:41:36.229 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.226+0000 7fdb2ff29640 20 reqs_thread_entry: start 2023-10-05T11:41:36.229 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.226+0000 7fdb50d27880 20 init_complete bucket index max shards: 11 2023-10-05T11:41:36.229 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.226+0000 7fdb50d27880 20 Filter name: none 2023-10-05T11:41:36.229 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.226+0000 7fdb2df25640 20 reqs_thread_entry: start 2023-10-05T11:41:36.229 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.226+0000 7fdb50d27880 10 cache get: name=default.rgw.meta+root+error-at-do-reshard : miss 2023-10-05T11:41:36.229 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.226+0000 7fdb50d27880 20 rados->read ofs=0 len=0 2023-10-05T11:41:36.230 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.227+0000 7fdb50d27880 20 rados_obj.operate() r=0 bl.length=211 2023-10-05T11:41:36.230 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.227+0000 7fdb50d27880 10 cache put: name=default.rgw.meta+root+error-at-do-reshard info.flags=0x11 2023-10-05T11:41:36.230 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.227+0000 7fdb50d27880 10 adding default.rgw.meta+root+error-at-do-reshard to cache LRU end 2023-10-05T11:41:36.230 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.227+0000 7fdb50d27880 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:dff27d1e-df33-400e-a68a-7ba586947c99.4604.26 : miss 2023-10-05T11:41:36.230 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.227+0000 7fdb50d27880 20 rados->read ofs=0 len=0 2023-10-05T11:41:36.230 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.227+0000 7fdb50d27880 20 rados_obj.operate() r=0 bl.length=383 2023-10-05T11:41:36.230 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.227+0000 7fdb50d27880 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:dff27d1e-df33-400e-a68a-7ba586947c99.4604.26 info.flags=0x17 2023-10-05T11:41:36.230 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.227+0000 7fdb50d27880 10 adding default.rgw.meta+root+.bucket.meta.error-at-do-reshard:dff27d1e-df33-400e-a68a-7ba586947c99.4604.26 to cache LRU end 2023-10-05T11:41:36.231 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.227+0000 7fdb50d27880 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T11:41:36.231 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.227+0000 7fdb50d27880 10 updating xattr: name=user.rgw.acl bl.length()=265 2023-10-05T11:41:36.231 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.227+0000 7fdb50d27880 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:dff27d1e-df33-400e-a68a-7ba586947c99.4604.26 2023-10-05T11:41:36.234 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.232+0000 7fdb50d27880 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:dff27d1e-df33-400e-a68a-7ba586947c99.4604.26 info.flags=0x17 2023-10-05T11:41:36.234 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.232+0000 7fdb50d27880 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:dff27d1e-df33-400e-a68a-7ba586947c99.4604.26 to cache LRU end 2023-10-05T11:41:36.234 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.232+0000 7fdb50d27880 10 updating xattr: name=user.rgw.acl bl.length()=265 2023-10-05T11:41:36.234 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.232+0000 7fdb50d27880 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:dff27d1e-df33-400e-a68a-7ba586947c99.4604.26, ofs0, ns] 2023-10-05T11:41:36.235 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.232+0000 7fdb47758640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1060856922175 cookie 93870709595136 notifier 6908 bl.length()=945 2023-10-05T11:41:36.235 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.232+0000 7fdb47758640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:dff27d1e-df33-400e-a68a-7ba586947c99.4604.26 info.flags=0x17 2023-10-05T11:41:36.235 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.232+0000 7fdb47758640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:dff27d1e-df33-400e-a68a-7ba586947c99.4604.26 to cache LRU end 2023-10-05T11:41:36.235 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.232+0000 7fdb47758640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2023-10-05T11:41:36.236 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.234+0000 7fdb50d27880 20 handle_bi_update(): bucket=:error-at-do-reshard[dff27d1e-df33-400e-a68a-7ba586947c99.4604.26]): orig_sources= new_sources= 2023-10-05T11:41:36.236 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.234+0000 7fdb50d27880 20 handle_bi_update(): bucket=:error-at-do-reshard[dff27d1e-df33-400e-a68a-7ba586947c99.4604.26]): potential sources added=[] removed=[] 2023-10-05T11:41:36.236 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.234+0000 7fdb50d27880 20 handle_bi_update(): bucket=:error-at-do-reshard[dff27d1e-df33-400e-a68a-7ba586947c99.4604.26]): orig_dests= new_dests= 2023-10-05T11:41:36.236 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.234+0000 7fdb50d27880 20 handle_bi_update(): bucket=:error-at-do-reshard[dff27d1e-df33-400e-a68a-7ba586947c99.4604.26]): potential dests added=[] removed=[] 2023-10-05T11:41:36.239 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.237+0000 7fdb50d27880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.26.1.0 2023-10-05T11:41:36.239 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.237+0000 7fdb50d27880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.26.1.0 2023-10-05T11:41:36.239 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.237+0000 7fdb50d27880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.26.1.1 2023-10-05T11:41:36.239 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.237+0000 7fdb50d27880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.26.1.1 2023-10-05T11:41:36.239 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.237+0000 7fdb50d27880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.26.1.2 2023-10-05T11:41:36.240 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.237+0000 7fdb50d27880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.26.1.2 2023-10-05T11:41:36.240 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.237+0000 7fdb50d27880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.26.1.3 2023-10-05T11:41:36.240 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.237+0000 7fdb50d27880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.26.1.3 2023-10-05T11:41:36.240 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.237+0000 7fdb50d27880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.26.1.4 2023-10-05T11:41:36.240 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.237+0000 7fdb50d27880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.26.1.4 2023-10-05T11:41:36.240 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.237+0000 7fdb50d27880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.26.1.5 2023-10-05T11:41:36.240 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.237+0000 7fdb50d27880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.26.1.5 2023-10-05T11:41:36.240 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.237+0000 7fdb50d27880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.26.1.6 2023-10-05T11:41:36.240 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.237+0000 7fdb50d27880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.26.1.6 2023-10-05T11:41:36.240 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.237+0000 7fdb50d27880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.26.1.7 2023-10-05T11:41:36.240 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.237+0000 7fdb50d27880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.26.1.7 2023-10-05T11:41:36.240 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.237+0000 7fdb50d27880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.26.1.8 2023-10-05T11:41:36.240 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.237+0000 7fdb50d27880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.26.1.8 2023-10-05T11:41:36.241 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.237+0000 7fdb50d27880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.26.1.9 2023-10-05T11:41:36.241 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.237+0000 7fdb50d27880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.26.1.9 2023-10-05T11:41:36.241 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.237+0000 7fdb50d27880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.26.1.10 2023-10-05T11:41:36.241 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.237+0000 7fdb50d27880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.26.1.10 2023-10-05T11:41:36.241 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.237+0000 7fdb50d27880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.26.1.11 2023-10-05T11:41:36.241 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.237+0000 7fdb50d27880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.26.1.11 2023-10-05T11:41:36.241 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.237+0000 7fdb50d27880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.26.0 2023-10-05T11:41:36.242 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.237+0000 7fdb50d27880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.26.1 2023-10-05T11:41:36.242 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.238+0000 7fdb50d27880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.26.2 2023-10-05T11:41:36.242 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.238+0000 7fdb50d27880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.26.3 2023-10-05T11:41:36.242 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.238+0000 7fdb50d27880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.26.4 2023-10-05T11:41:36.242 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.239+0000 7fdb50d27880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.26.5 2023-10-05T11:41:36.242 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.239+0000 7fdb50d27880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.26.6 2023-10-05T11:41:36.243 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.240+0000 7fdb50d27880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.26.7 2023-10-05T11:41:36.243 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.240+0000 7fdb50d27880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.26.8 2023-10-05T11:41:36.243 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.241+0000 7fdb50d27880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.26.9 2023-10-05T11:41:36.243 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.241+0000 7fdb50d27880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.26.10 2023-10-05T11:41:36.246 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.243+0000 7fdb50d27880 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:dff27d1e-df33-400e-a68a-7ba586947c99.4604.26 : hit (requested=0x17, cached=0x17) 2023-10-05T11:41:36.246 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.243+0000 7fdb50d27880 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:dff27d1e-df33-400e-a68a-7ba586947c99.4604.26 2023-10-05T11:41:36.247 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.245+0000 7fdb50d27880 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:dff27d1e-df33-400e-a68a-7ba586947c99.4604.26 info.flags=0x17 2023-10-05T11:41:36.247 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.245+0000 7fdb50d27880 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:dff27d1e-df33-400e-a68a-7ba586947c99.4604.26 to cache LRU end 2023-10-05T11:41:36.247 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.245+0000 7fdb50d27880 10 updating xattr: name=user.rgw.acl bl.length()=265 2023-10-05T11:41:36.247 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.245+0000 7fdb50d27880 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:dff27d1e-df33-400e-a68a-7ba586947c99.4604.26, ofs0, ns] 2023-10-05T11:41:36.248 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.245+0000 7fdb47758640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1060856922176 cookie 93870709595136 notifier 6908 bl.length()=913 2023-10-05T11:41:36.248 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.245+0000 7fdb47758640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:dff27d1e-df33-400e-a68a-7ba586947c99.4604.26 info.flags=0x17 2023-10-05T11:41:36.248 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.245+0000 7fdb47758640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:dff27d1e-df33-400e-a68a-7ba586947c99.4604.26 to cache LRU end 2023-10-05T11:41:36.248 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.245+0000 7fdb47758640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2023-10-05T11:41:36.249 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.247+0000 7fdb50d27880 20 handle_bi_update(): bucket=:error-at-do-reshard[dff27d1e-df33-400e-a68a-7ba586947c99.4604.26]): orig_sources= new_sources= 2023-10-05T11:41:36.249 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.247+0000 7fdb50d27880 20 handle_bi_update(): bucket=:error-at-do-reshard[dff27d1e-df33-400e-a68a-7ba586947c99.4604.26]): potential sources added=[] removed=[] 2023-10-05T11:41:36.249 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.247+0000 7fdb50d27880 20 handle_bi_update(): bucket=:error-at-do-reshard[dff27d1e-df33-400e-a68a-7ba586947c99.4604.26]): orig_dests= new_dests= 2023-10-05T11:41:36.249 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.247+0000 7fdb50d27880 20 handle_bi_update(): bucket=:error-at-do-reshard[dff27d1e-df33-400e-a68a-7ba586947c99.4604.26]): potential dests added=[] removed=[] 2023-10-05T11:41:36.251 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.249+0000 7fdb50d27880 1 execute INFO: reshard of bucket "error-at-do-reshard" completed successfully 2023-10-05T11:41:36.253 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.251+0000 7fdb34732640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:41:36.256 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.253+0000 7fdb50d27880 20 remove_watcher() i=0 2023-10-05T11:41:36.256 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.253+0000 7fdb50d27880 2 removed watcher, disabling cache 2023-10-05T11:41:36.257 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.254+0000 7fdb50d27880 20 remove_watcher() i=1 2023-10-05T11:41:36.258 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.256+0000 7fdb50d27880 20 remove_watcher() i=2 2023-10-05T11:41:36.259 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.256+0000 7fdb50d27880 20 remove_watcher() i=3 2023-10-05T11:41:36.260 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.257+0000 7fdb50d27880 20 remove_watcher() i=4 2023-10-05T11:41:36.261 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.259+0000 7fdb50d27880 20 remove_watcher() i=5 2023-10-05T11:41:36.262 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.259+0000 7fdb50d27880 20 remove_watcher() i=6 2023-10-05T11:41:36.263 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.260+0000 7fdb50d27880 20 remove_watcher() i=7 2023-10-05T11:41:36.269 INFO:tasks.workunit.client.0.smithi012.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2023-10-05T11:41:36.296 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setuser ceph since I am not root 2023-10-05T11:41:36.297 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T11:41:36.310 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.308+0000 7f9fc7327880 20 rados->read ofs=0 len=0 2023-10-05T11:41:36.312 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.309+0000 7f9fc7327880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:36.312 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.309+0000 7f9fc7327880 20 realm 2023-10-05T11:41:36.312 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.309+0000 7f9fc7327880 20 rados->read ofs=0 len=0 2023-10-05T11:41:36.312 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.310+0000 7f9fc7327880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:36.312 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.310+0000 7f9fc7327880 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T11:41:36.312 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.310+0000 7f9fc7327880 20 rados->read ofs=0 len=0 2023-10-05T11:41:36.313 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.310+0000 7f9fc7327880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:36.313 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.310+0000 7f9fc7327880 20 rados->read ofs=0 len=0 2023-10-05T11:41:36.313 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.311+0000 7f9fc7327880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:41:36.313 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.311+0000 7f9fc7327880 20 rados->read ofs=0 len=0 2023-10-05T11:41:36.314 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.311+0000 7f9fc7327880 20 rados_obj.operate() r=0 bl.length=1020 2023-10-05T11:41:36.314 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.311+0000 7f9fc7327880 20 searching for the correct realm 2023-10-05T11:41:36.320 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.318+0000 7f9fc4565640 0 -- 172.21.15.12:0/3180648200 >> [v2:172.21.15.12:6813/3341239609,v1:172.21.15.12:6815/3341239609] conn(0x556ec7b65800 msgr2=0x556ec7a9d180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:41:36.324 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.321+0000 7f9fc7327880 20 RGWRados::pool_iterate: got zone_info.dff27d1e-df33-400e-a68a-7ba586947c99 2023-10-05T11:41:36.324 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.321+0000 7f9fc7327880 20 RGWRados::pool_iterate: got zonegroup_info.c78aa576-9d15-4e9d-b3c0-4af23a22062c 2023-10-05T11:41:36.324 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.321+0000 7f9fc7327880 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T11:41:36.324 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.321+0000 7f9fc7327880 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T11:41:36.324 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.321+0000 7f9fc7327880 20 rados->read ofs=0 len=0 2023-10-05T11:41:36.324 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.321+0000 7f9fc7327880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:36.324 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.321+0000 7f9fc7327880 20 rados->read ofs=0 len=0 2023-10-05T11:41:36.325 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.322+0000 7f9fc7327880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:41:36.325 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.322+0000 7f9fc7327880 20 rados->read ofs=0 len=0 2023-10-05T11:41:36.325 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.322+0000 7f9fc7327880 20 rados_obj.operate() r=0 bl.length=454 2023-10-05T11:41:36.325 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.322+0000 7f9fc7327880 20 zone default found 2023-10-05T11:41:36.325 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.322+0000 7f9fc7327880 4 Realm: () 2023-10-05T11:41:36.325 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.322+0000 7f9fc7327880 4 ZoneGroup: default (c78aa576-9d15-4e9d-b3c0-4af23a22062c) 2023-10-05T11:41:36.325 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.322+0000 7f9fc7327880 4 Zone: default (dff27d1e-df33-400e-a68a-7ba586947c99) 2023-10-05T11:41:36.326 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.322+0000 7f9fc7327880 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T11:41:36.326 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.322+0000 7f9fc7327880 20 zonegroup default 2023-10-05T11:41:36.326 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.322+0000 7f9fc7327880 20 rados->read ofs=0 len=0 2023-10-05T11:41:36.326 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.322+0000 7f9fc7327880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:36.326 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.322+0000 7f9fc7327880 20 rados->read ofs=0 len=0 2023-10-05T11:41:36.326 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.323+0000 7f9fc7327880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:36.326 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.323+0000 7f9fc7327880 20 rados->read ofs=0 len=0 2023-10-05T11:41:36.327 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.323+0000 7f9fc4565640 0 -- 172.21.15.12:0/3180648200 >> [v2:172.21.15.12:6824/2171933159,v1:172.21.15.12:6825/2171933159] conn(0x556ec7c41000 msgr2=0x556ec7c30b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:41:36.327 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.323+0000 7f9fc7327880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:36.327 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.323+0000 7f9fc7327880 20 started sync module instance, tier type = 2023-10-05T11:41:36.327 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.323+0000 7f9fc7327880 20 started zone id=dff27d1e-df33-400e-a68a-7ba586947c99 (name=default) with tier type = 2023-10-05T11:41:36.334 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.332+0000 7f9fc7327880 20 add_watcher() i=0 2023-10-05T11:41:36.334 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.332+0000 7f9fc7327880 20 add_watcher() i=1 2023-10-05T11:41:36.335 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.332+0000 7f9fc7327880 20 add_watcher() i=2 2023-10-05T11:41:36.335 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.332+0000 7f9fc7327880 20 add_watcher() i=3 2023-10-05T11:41:36.335 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.332+0000 7f9fc7327880 20 add_watcher() i=4 2023-10-05T11:41:36.335 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.332+0000 7f9fc7327880 20 add_watcher() i=5 2023-10-05T11:41:36.335 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.332+0000 7f9fc7327880 20 add_watcher() i=6 2023-10-05T11:41:36.335 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.333+0000 7f9fc7327880 20 add_watcher() i=7 2023-10-05T11:41:36.335 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.333+0000 7f9fc7327880 2 all 8 watchers are set, enabling cache 2023-10-05T11:41:36.337 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.334+0000 7f9faad32640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:41:36.337 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.335+0000 7f9fc7327880 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T11:41:36.337 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.335+0000 7f9fc7327880 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T11:41:36.343 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.340+0000 7f9fc7327880 5 note: GC not initialized 2023-10-05T11:41:36.343 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.340+0000 7f9fa6529640 20 reqs_thread_entry: start 2023-10-05T11:41:36.343 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.340+0000 7f9fc7327880 20 init_complete bucket index max shards: 11 2023-10-05T11:41:36.343 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.340+0000 7f9fc7327880 20 Filter name: none 2023-10-05T11:41:36.343 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.341+0000 7f9fa4525640 20 reqs_thread_entry: start 2023-10-05T11:41:36.343 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.341+0000 7f9fc7327880 20 rados->read ofs=0 len=0 2023-10-05T11:41:36.344 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.341+0000 7f9fc7327880 20 rados_obj.operate() r=0 bl.length=211 2023-10-05T11:41:36.344 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.341+0000 7f9fc7327880 20 rados->read ofs=0 len=0 2023-10-05T11:41:36.344 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.342+0000 7f9fc7327880 20 rados_obj.operate() r=0 bl.length=383 2023-10-05T11:41:36.344 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.342+0000 7f9fc7327880 20 couldn't put binfo cache entry, might have raced with data changes 2023-10-05T11:41:36.344 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.342+0000 7f9fc7327880 20 rados->read ofs=0 len=0 2023-10-05T11:41:36.344 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.342+0000 7f9fc7327880 20 rados_obj.operate() r=0 bl.length=211 2023-10-05T11:41:36.345 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.342+0000 7f9fc7327880 20 rados->read ofs=0 len=0 2023-10-05T11:41:36.345 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.342+0000 7f9fc7327880 20 rados_obj.operate() r=0 bl.length=383 2023-10-05T11:41:36.345 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.342+0000 7f9fc7327880 20 couldn't put binfo cache entry, might have raced with data changes 2023-10-05T11:41:36.345 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.343+0000 7f9fc7327880 20 rados->read ofs=0 len=0 2023-10-05T11:41:36.346 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.344+0000 7f9fc7327880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:36.346 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.344+0000 7f9faad32640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:41:36.348 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.346+0000 7f9fc7327880 20 remove_watcher() i=0 2023-10-05T11:41:36.348 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.346+0000 7f9fc7327880 2 removed watcher, disabling cache 2023-10-05T11:41:36.349 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.347+0000 7f9fc7327880 20 remove_watcher() i=1 2023-10-05T11:41:36.351 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.349+0000 7f9fc7327880 20 remove_watcher() i=2 2023-10-05T11:41:36.352 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.349+0000 7f9fc7327880 20 remove_watcher() i=3 2023-10-05T11:41:36.353 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.350+0000 7f9fc7327880 20 remove_watcher() i=4 2023-10-05T11:41:36.354 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.352+0000 7f9fc7327880 20 remove_watcher() i=5 2023-10-05T11:41:36.355 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.352+0000 7f9fc7327880 20 remove_watcher() i=6 2023-10-05T11:41:36.356 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:36.353+0000 7f9fc7327880 20 remove_watcher() i=7 2023-10-05T11:41:36.360 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:41:36.360 INFO:tasks.workunit.client.0.smithi012.stderr:BUCKET_STATS: 2023-10-05T11:41:36.360 INFO:tasks.workunit.client.0.smithi012.stderr:bucket: error-at-do-reshard id: dff27d1e-df33-400e-a68a-7ba586947c99.4604.26 num_objects: 19 size_kb: 1 num_shards: 12 2023-10-05T11:41:36.360 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:41:36.686 INFO:tasks.workunit.client.0.smithi012.stderr:TEST: reshard bucket with abort at do_reshard 2023-10-05T11:41:36.687 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:41:37.392 INFO:tasks.workunit.client.0.smithi012.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2023-10-05T11:41:37.420 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setuser ceph since I am not root 2023-10-05T11:41:37.420 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T11:41:37.432 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.430+0000 7f33bf88b880 20 rados->read ofs=0 len=0 2023-10-05T11:41:37.434 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.431+0000 7f33bf88b880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:37.434 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.431+0000 7f33bf88b880 20 realm 2023-10-05T11:41:37.434 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.431+0000 7f33bf88b880 20 rados->read ofs=0 len=0 2023-10-05T11:41:37.434 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.432+0000 7f33bf88b880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:37.434 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.432+0000 7f33bf88b880 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T11:41:37.434 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.432+0000 7f33bf88b880 20 rados->read ofs=0 len=0 2023-10-05T11:41:37.435 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.432+0000 7f33bf88b880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:37.435 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.432+0000 7f33bf88b880 20 rados->read ofs=0 len=0 2023-10-05T11:41:37.435 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.432+0000 7f33bf88b880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:41:37.435 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.432+0000 7f33bf88b880 20 rados->read ofs=0 len=0 2023-10-05T11:41:37.435 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.433+0000 7f33bf88b880 20 rados_obj.operate() r=0 bl.length=1020 2023-10-05T11:41:37.436 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.433+0000 7f33bf88b880 20 searching for the correct realm 2023-10-05T11:41:37.445 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.443+0000 7f33be030640 0 -- 172.21.15.12:0/817567061 >> [v2:172.21.15.170:6814/3150808418,v1:172.21.15.170:6816/3150808418] conn(0x55e7ce239000 msgr2=0x55e7cd5c2c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:41:37.447 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.443+0000 7f33bf88b880 20 RGWRados::pool_iterate: got zone_info.dff27d1e-df33-400e-a68a-7ba586947c99 2023-10-05T11:41:37.447 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.443+0000 7f33bf88b880 20 RGWRados::pool_iterate: got zonegroup_info.c78aa576-9d15-4e9d-b3c0-4af23a22062c 2023-10-05T11:41:37.447 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.443+0000 7f33bf88b880 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T11:41:37.447 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.443+0000 7f33bf88b880 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T11:41:37.447 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.443+0000 7f33bf88b880 20 rados->read ofs=0 len=0 2023-10-05T11:41:37.447 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.443+0000 7f33bf88b880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:37.447 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.443+0000 7f33bf88b880 20 rados->read ofs=0 len=0 2023-10-05T11:41:37.447 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.444+0000 7f33bf88b880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:41:37.447 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.444+0000 7f33bf88b880 20 rados->read ofs=0 len=0 2023-10-05T11:41:37.447 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.444+0000 7f33bf88b880 20 rados_obj.operate() r=0 bl.length=454 2023-10-05T11:41:37.447 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.444+0000 7f33bf88b880 20 zone default found 2023-10-05T11:41:37.448 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.444+0000 7f33bf88b880 4 Realm: () 2023-10-05T11:41:37.448 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.444+0000 7f33bf88b880 4 ZoneGroup: default (c78aa576-9d15-4e9d-b3c0-4af23a22062c) 2023-10-05T11:41:37.448 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.444+0000 7f33bf88b880 4 Zone: default (dff27d1e-df33-400e-a68a-7ba586947c99) 2023-10-05T11:41:37.448 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.444+0000 7f33bf88b880 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T11:41:37.448 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.444+0000 7f33bf88b880 20 zonegroup default 2023-10-05T11:41:37.448 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.444+0000 7f33bf88b880 20 rados->read ofs=0 len=0 2023-10-05T11:41:37.448 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.444+0000 7f33bf88b880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:37.448 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.444+0000 7f33bf88b880 20 rados->read ofs=0 len=0 2023-10-05T11:41:37.448 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.444+0000 7f33bf88b880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:37.448 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.444+0000 7f33bf88b880 20 rados->read ofs=0 len=0 2023-10-05T11:41:37.449 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.445+0000 7f33bf88b880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:37.449 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.445+0000 7f33bf88b880 20 started sync module instance, tier type = 2023-10-05T11:41:37.449 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.445+0000 7f33bf88b880 20 started zone id=dff27d1e-df33-400e-a68a-7ba586947c99 (name=default) with tier type = 2023-10-05T11:41:37.454 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.452+0000 7f33be831640 0 -- 172.21.15.12:0/817567061 >> [v2:172.21.15.12:6824/2171933159,v1:172.21.15.12:6825/2171933159] conn(0x55e7cd69cc00 msgr2=0x55e7cd5c3700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:41:37.456 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.453+0000 7f33bf88b880 20 add_watcher() i=0 2023-10-05T11:41:37.456 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.453+0000 7f33bf88b880 20 add_watcher() i=1 2023-10-05T11:41:37.456 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.453+0000 7f33bf88b880 20 add_watcher() i=2 2023-10-05T11:41:37.456 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.453+0000 7f33bf88b880 20 add_watcher() i=3 2023-10-05T11:41:37.456 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.453+0000 7f33bf88b880 20 add_watcher() i=4 2023-10-05T11:41:37.456 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.453+0000 7f33bf88b880 20 add_watcher() i=5 2023-10-05T11:41:37.457 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.454+0000 7f33bf88b880 20 add_watcher() i=6 2023-10-05T11:41:37.457 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.454+0000 7f33bf88b880 20 add_watcher() i=7 2023-10-05T11:41:37.457 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.454+0000 7f33bf88b880 2 all 8 watchers are set, enabling cache 2023-10-05T11:41:37.458 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.456+0000 7f33a4ffe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:41:37.458 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.456+0000 7f33bf88b880 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T11:41:37.459 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.456+0000 7f33bf88b880 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T11:41:37.464 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.462+0000 7f33bf88b880 5 note: GC not initialized 2023-10-05T11:41:37.464 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.462+0000 7f33a07f5640 20 reqs_thread_entry: start 2023-10-05T11:41:37.465 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.462+0000 7f33bf88b880 20 init_complete bucket index max shards: 11 2023-10-05T11:41:37.465 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.462+0000 7f33bf88b880 20 Filter name: none 2023-10-05T11:41:37.465 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.462+0000 7f339e7f1640 20 reqs_thread_entry: start 2023-10-05T11:41:37.465 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.462+0000 7f33bf88b880 20 rados->read ofs=0 len=0 2023-10-05T11:41:37.466 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.463+0000 7f33bf88b880 20 rados_obj.operate() r=0 bl.length=211 2023-10-05T11:41:37.466 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.463+0000 7f33bf88b880 20 rados->read ofs=0 len=0 2023-10-05T11:41:37.466 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.463+0000 7f33bf88b880 20 rados_obj.operate() r=0 bl.length=383 2023-10-05T11:41:37.466 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.463+0000 7f33bf88b880 20 couldn't put binfo cache entry, might have raced with data changes 2023-10-05T11:41:37.466 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.463+0000 7f33bf88b880 20 rados->read ofs=0 len=0 2023-10-05T11:41:37.466 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.463+0000 7f33bf88b880 20 rados_obj.operate() r=0 bl.length=211 2023-10-05T11:41:37.466 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.463+0000 7f33bf88b880 20 rados->read ofs=0 len=0 2023-10-05T11:41:37.467 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.464+0000 7f33bf88b880 20 rados_obj.operate() r=0 bl.length=383 2023-10-05T11:41:37.467 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.464+0000 7f33bf88b880 20 couldn't put binfo cache entry, might have raced with data changes 2023-10-05T11:41:37.467 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.465+0000 7f33bf88b880 20 rados->read ofs=0 len=0 2023-10-05T11:41:37.467 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.465+0000 7f33bf88b880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:37.468 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.465+0000 7f33a4ffe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:41:37.470 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.467+0000 7f33bf88b880 20 remove_watcher() i=0 2023-10-05T11:41:37.470 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.467+0000 7f33bf88b880 2 removed watcher, disabling cache 2023-10-05T11:41:37.471 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.468+0000 7f33bf88b880 20 remove_watcher() i=1 2023-10-05T11:41:37.472 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.470+0000 7f33bf88b880 20 remove_watcher() i=2 2023-10-05T11:41:37.473 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.471+0000 7f33bf88b880 20 remove_watcher() i=3 2023-10-05T11:41:37.474 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.471+0000 7f33bf88b880 20 remove_watcher() i=4 2023-10-05T11:41:37.475 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.472+0000 7f33bf88b880 20 remove_watcher() i=5 2023-10-05T11:41:37.475 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.473+0000 7f33bf88b880 20 remove_watcher() i=6 2023-10-05T11:41:37.477 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.474+0000 7f33bf88b880 20 remove_watcher() i=7 2023-10-05T11:41:37.481 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:41:37.481 INFO:tasks.workunit.client.0.smithi012.stderr:BUCKET_STATS: 2023-10-05T11:41:37.481 INFO:tasks.workunit.client.0.smithi012.stderr:bucket: abort-at-do-reshard id: dff27d1e-df33-400e-a68a-7ba586947c99.4604.27 num_objects: 20 size_kb: 1 num_shards: 11 2023-10-05T11:41:37.481 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:41:37.483 INFO:tasks.workunit.client.0.smithi012.stderr:radosgw-admin bucket reshard --bucket abort-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at do_reshard 2023-10-05T11:41:37.515 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setuser ceph since I am not root 2023-10-05T11:41:37.515 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T11:41:37.529 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.526+0000 7f7636013880 20 rados->read ofs=0 len=0 2023-10-05T11:41:37.531 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.528+0000 7f7636013880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:37.531 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.528+0000 7f7636013880 20 realm 2023-10-05T11:41:37.531 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.528+0000 7f7636013880 20 rados->read ofs=0 len=0 2023-10-05T11:41:37.531 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.528+0000 7f7636013880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:37.531 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.528+0000 7f7636013880 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T11:41:37.531 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.528+0000 7f7636013880 20 rados->read ofs=0 len=0 2023-10-05T11:41:37.532 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.528+0000 7f7636013880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:37.532 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.528+0000 7f7636013880 20 rados->read ofs=0 len=0 2023-10-05T11:41:37.532 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.529+0000 7f7636013880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:41:37.533 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.529+0000 7f7636013880 20 rados->read ofs=0 len=0 2023-10-05T11:41:37.533 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.530+0000 7f7636013880 20 rados_obj.operate() r=0 bl.length=1020 2023-10-05T11:41:37.533 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.530+0000 7f7636013880 20 searching for the correct realm 2023-10-05T11:41:37.541 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.539+0000 7f763248e640 0 -- 172.21.15.12:0/3739624321 >> [v2:172.21.15.12:6800/732466381,v1:172.21.15.12:6801/732466381] conn(0x561343505000 msgr2=0x5613435cac00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-10-05T11:41:37.543 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.540+0000 7f7636013880 20 RGWRados::pool_iterate: got zone_info.dff27d1e-df33-400e-a68a-7ba586947c99 2023-10-05T11:41:37.543 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.540+0000 7f7636013880 20 RGWRados::pool_iterate: got zonegroup_info.c78aa576-9d15-4e9d-b3c0-4af23a22062c 2023-10-05T11:41:37.543 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.540+0000 7f7636013880 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T11:41:37.543 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.540+0000 7f7636013880 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T11:41:37.543 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.540+0000 7f7636013880 20 rados->read ofs=0 len=0 2023-10-05T11:41:37.544 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.541+0000 7f7636013880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:37.544 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.541+0000 7f7636013880 20 rados->read ofs=0 len=0 2023-10-05T11:41:37.545 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.541+0000 7f7636013880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:41:37.545 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.541+0000 7f7636013880 20 rados->read ofs=0 len=0 2023-10-05T11:41:37.545 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.541+0000 7f7636013880 20 rados_obj.operate() r=0 bl.length=454 2023-10-05T11:41:37.546 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.541+0000 7f7636013880 20 zone default found 2023-10-05T11:41:37.546 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.541+0000 7f7636013880 4 Realm: () 2023-10-05T11:41:37.546 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.541+0000 7f7636013880 4 ZoneGroup: default (c78aa576-9d15-4e9d-b3c0-4af23a22062c) 2023-10-05T11:41:37.546 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.541+0000 7f7636013880 4 Zone: default (dff27d1e-df33-400e-a68a-7ba586947c99) 2023-10-05T11:41:37.546 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.541+0000 7f7636013880 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T11:41:37.546 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.541+0000 7f7636013880 20 zonegroup default 2023-10-05T11:41:37.547 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.541+0000 7f7636013880 20 rados->read ofs=0 len=0 2023-10-05T11:41:37.547 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.541+0000 7f7636013880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:37.547 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.541+0000 7f7636013880 20 rados->read ofs=0 len=0 2023-10-05T11:41:37.547 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.542+0000 7f7636013880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:37.547 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.542+0000 7f7636013880 20 rados->read ofs=0 len=0 2023-10-05T11:41:37.547 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.542+0000 7f7636013880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:37.548 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.542+0000 7f7636013880 20 started sync module instance, tier type = 2023-10-05T11:41:37.548 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.542+0000 7f7636013880 20 started zone id=dff27d1e-df33-400e-a68a-7ba586947c99 (name=default) with tier type = 2023-10-05T11:41:37.549 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.547+0000 7f7632c8f640 0 -- 172.21.15.12:0/3739624321 >> [v2:172.21.15.170:6800/4137726411,v1:172.21.15.170:6801/4137726411] conn(0x561343505400 msgr2=0x5613435cb700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-10-05T11:41:37.554 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.551+0000 7f7636013880 20 add_watcher() i=0 2023-10-05T11:41:37.554 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.551+0000 7f7636013880 20 add_watcher() i=1 2023-10-05T11:41:37.554 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.551+0000 7f7636013880 20 add_watcher() i=2 2023-10-05T11:41:37.554 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.551+0000 7f7636013880 20 add_watcher() i=3 2023-10-05T11:41:37.554 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.551+0000 7f7636013880 20 add_watcher() i=4 2023-10-05T11:41:37.554 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.551+0000 7f7636013880 20 add_watcher() i=5 2023-10-05T11:41:37.555 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.551+0000 7f7636013880 20 add_watcher() i=6 2023-10-05T11:41:37.555 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.552+0000 7f7636013880 20 add_watcher() i=7 2023-10-05T11:41:37.555 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.552+0000 7f7636013880 2 all 8 watchers are set, enabling cache 2023-10-05T11:41:37.556 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.554+0000 7f761945c640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:41:37.556 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.554+0000 7f7636013880 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T11:41:37.556 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.554+0000 7f7636013880 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T11:41:37.562 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.560+0000 7f7636013880 5 note: GC not initialized 2023-10-05T11:41:37.562 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.560+0000 7f7614c53640 20 reqs_thread_entry: start 2023-10-05T11:41:37.563 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.560+0000 7f7636013880 20 init_complete bucket index max shards: 11 2023-10-05T11:41:37.563 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.560+0000 7f7636013880 20 Filter name: none 2023-10-05T11:41:37.563 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.560+0000 7f7612c4f640 20 reqs_thread_entry: start 2023-10-05T11:41:37.563 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.560+0000 7f7636013880 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2023-10-05T11:41:37.563 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.560+0000 7f7636013880 20 rados->read ofs=0 len=0 2023-10-05T11:41:37.564 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.560+0000 7f7636013880 20 rados_obj.operate() r=0 bl.length=211 2023-10-05T11:41:37.564 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.560+0000 7f7636013880 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2023-10-05T11:41:37.564 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.560+0000 7f7636013880 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2023-10-05T11:41:37.565 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.560+0000 7f7636013880 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:dff27d1e-df33-400e-a68a-7ba586947c99.4604.27 : miss 2023-10-05T11:41:37.565 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.560+0000 7f7636013880 20 rados->read ofs=0 len=0 2023-10-05T11:41:37.565 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.561+0000 7f7636013880 20 rados_obj.operate() r=0 bl.length=383 2023-10-05T11:41:37.565 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.561+0000 7f7636013880 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:dff27d1e-df33-400e-a68a-7ba586947c99.4604.27 info.flags=0x17 2023-10-05T11:41:37.565 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.561+0000 7f7636013880 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:dff27d1e-df33-400e-a68a-7ba586947c99.4604.27 to cache LRU end 2023-10-05T11:41:37.565 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.561+0000 7f7636013880 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T11:41:37.566 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.561+0000 7f7636013880 10 updating xattr: name=user.rgw.acl bl.length()=265 2023-10-05T11:41:37.566 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.561+0000 7f7636013880 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:dff27d1e-df33-400e-a68a-7ba586947c99.4604.27 2023-10-05T11:41:37.569 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.567+0000 7f7636013880 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:dff27d1e-df33-400e-a68a-7ba586947c99.4604.27 info.flags=0x17 2023-10-05T11:41:37.569 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.567+0000 7f7636013880 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:dff27d1e-df33-400e-a68a-7ba586947c99.4604.27 to cache LRU end 2023-10-05T11:41:37.569 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.567+0000 7f7636013880 10 updating xattr: name=user.rgw.acl bl.length()=265 2023-10-05T11:41:37.569 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.567+0000 7f7636013880 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:dff27d1e-df33-400e-a68a-7ba586947c99.4604.27, ofs0, ns] 2023-10-05T11:41:37.570 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.567+0000 7f762cc83640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1060856922181 cookie 94640734760960 notifier 6968 bl.length()=945 2023-10-05T11:41:37.570 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.567+0000 7f762cc83640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:dff27d1e-df33-400e-a68a-7ba586947c99.4604.27 info.flags=0x17 2023-10-05T11:41:37.570 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.567+0000 7f762cc83640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:dff27d1e-df33-400e-a68a-7ba586947c99.4604.27 to cache LRU end 2023-10-05T11:41:37.570 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.567+0000 7f762cc83640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2023-10-05T11:41:37.571 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.569+0000 7f7636013880 20 handle_bi_update(): bucket=:abort-at-do-reshard[dff27d1e-df33-400e-a68a-7ba586947c99.4604.27]): orig_sources= new_sources= 2023-10-05T11:41:37.571 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.569+0000 7f7636013880 20 handle_bi_update(): bucket=:abort-at-do-reshard[dff27d1e-df33-400e-a68a-7ba586947c99.4604.27]): potential sources added=[] removed=[] 2023-10-05T11:41:37.571 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.569+0000 7f7636013880 20 handle_bi_update(): bucket=:abort-at-do-reshard[dff27d1e-df33-400e-a68a-7ba586947c99.4604.27]): orig_dests= new_dests= 2023-10-05T11:41:37.571 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.569+0000 7f7636013880 20 handle_bi_update(): bucket=:abort-at-do-reshard[dff27d1e-df33-400e-a68a-7ba586947c99.4604.27]): potential dests added=[] removed=[] 2023-10-05T11:41:37.573 INFO:tasks.workunit.client.0.smithi012.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6543-g38321be8/rpm/el9/BUILD/ceph-18.0.0-6543-g38321be8/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f7636013880 time 2023-10-05T11:41:37.572107+0000 2023-10-05T11:41:37.574 INFO:tasks.workunit.client.0.smithi012.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6543-g38321be8/rpm/el9/BUILD/ceph-18.0.0-6543-g38321be8/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2023-10-05T11:41:37.574 INFO:tasks.workunit.client.0.smithi012.stderr: ceph version 18.0.0-6543-g38321be8 (38321be854743c0d616618a9ea8aa0b1d4dbc0bf) reef (dev) 2023-10-05T11:41:37.574 INFO:tasks.workunit.client.0.smithi012.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f763896d15f] 2023-10-05T11:41:37.574 INFO:tasks.workunit.client.0.smithi012.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16d31d) [0x7f763896d31d] 2023-10-05T11:41:37.575 INFO:tasks.workunit.client.0.smithi012.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5613412dac31] 2023-10-05T11:41:37.575 INFO:tasks.workunit.client.0.smithi012.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x314) [0x5613412f17a4] 2023-10-05T11:41:37.575 INFO:tasks.workunit.client.0.smithi012.stderr: 5: main() 2023-10-05T11:41:37.575 INFO:tasks.workunit.client.0.smithi012.stderr: 6: /lib64/libc.so.6(+0x3feb0) [0x7f7635e3feb0] 2023-10-05T11:41:37.575 INFO:tasks.workunit.client.0.smithi012.stderr: 7: __libc_start_main() 2023-10-05T11:41:37.575 INFO:tasks.workunit.client.0.smithi012.stderr: 8: _start() 2023-10-05T11:41:37.575 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.572+0000 7f7636013880 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6543-g38321be8/rpm/el9/BUILD/ceph-18.0.0-6543-g38321be8/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f7636013880 time 2023-10-05T11:41:37.572107+0000 2023-10-05T11:41:37.576 INFO:tasks.workunit.client.0.smithi012.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6543-g38321be8/rpm/el9/BUILD/ceph-18.0.0-6543-g38321be8/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2023-10-05T11:41:37.576 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:41:37.576 INFO:tasks.workunit.client.0.smithi012.stderr: ceph version 18.0.0-6543-g38321be8 (38321be854743c0d616618a9ea8aa0b1d4dbc0bf) reef (dev) 2023-10-05T11:41:37.576 INFO:tasks.workunit.client.0.smithi012.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f763896d15f] 2023-10-05T11:41:37.576 INFO:tasks.workunit.client.0.smithi012.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16d31d) [0x7f763896d31d] 2023-10-05T11:41:37.576 INFO:tasks.workunit.client.0.smithi012.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5613412dac31] 2023-10-05T11:41:37.577 INFO:tasks.workunit.client.0.smithi012.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x314) [0x5613412f17a4] 2023-10-05T11:41:37.577 INFO:tasks.workunit.client.0.smithi012.stderr: 5: main() 2023-10-05T11:41:37.577 INFO:tasks.workunit.client.0.smithi012.stderr: 6: /lib64/libc.so.6(+0x3feb0) [0x7f7635e3feb0] 2023-10-05T11:41:37.577 INFO:tasks.workunit.client.0.smithi012.stderr: 7: __libc_start_main() 2023-10-05T11:41:37.577 INFO:tasks.workunit.client.0.smithi012.stderr: 8: _start() 2023-10-05T11:41:37.577 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:41:37.577 INFO:tasks.workunit.client.0.smithi012.stderr:*** Caught signal (Aborted) ** 2023-10-05T11:41:37.578 INFO:tasks.workunit.client.0.smithi012.stderr: in thread 7f7636013880 thread_name:radosgw-admin 2023-10-05T11:41:37.592 INFO:tasks.workunit.client.0.smithi012.stderr: ceph version 18.0.0-6543-g38321be8 (38321be854743c0d616618a9ea8aa0b1d4dbc0bf) reef (dev) 2023-10-05T11:41:37.592 INFO:tasks.workunit.client.0.smithi012.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f7635e54db0] 2023-10-05T11:41:37.592 INFO:tasks.workunit.client.0.smithi012.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f7635ea154c] 2023-10-05T11:41:37.592 INFO:tasks.workunit.client.0.smithi012.stderr: 3: raise() 2023-10-05T11:41:37.592 INFO:tasks.workunit.client.0.smithi012.stderr: 4: abort() 2023-10-05T11:41:37.592 INFO:tasks.workunit.client.0.smithi012.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f763896d1b9] 2023-10-05T11:41:37.593 INFO:tasks.workunit.client.0.smithi012.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16d31d) [0x7f763896d31d] 2023-10-05T11:41:37.593 INFO:tasks.workunit.client.0.smithi012.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5613412dac31] 2023-10-05T11:41:37.593 INFO:tasks.workunit.client.0.smithi012.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x314) [0x5613412f17a4] 2023-10-05T11:41:37.593 INFO:tasks.workunit.client.0.smithi012.stderr: 9: main() 2023-10-05T11:41:37.593 INFO:tasks.workunit.client.0.smithi012.stderr: 10: /lib64/libc.so.6(+0x3feb0) [0x7f7635e3feb0] 2023-10-05T11:41:37.593 INFO:tasks.workunit.client.0.smithi012.stderr: 11: __libc_start_main() 2023-10-05T11:41:37.594 INFO:tasks.workunit.client.0.smithi012.stderr: 12: _start() 2023-10-05T11:41:37.594 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.573+0000 7f7636013880 -1 *** Caught signal (Aborted) ** 2023-10-05T11:41:37.594 INFO:tasks.workunit.client.0.smithi012.stderr: in thread 7f7636013880 thread_name:radosgw-admin 2023-10-05T11:41:37.594 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:41:37.594 INFO:tasks.workunit.client.0.smithi012.stderr: ceph version 18.0.0-6543-g38321be8 (38321be854743c0d616618a9ea8aa0b1d4dbc0bf) reef (dev) 2023-10-05T11:41:37.594 INFO:tasks.workunit.client.0.smithi012.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f7635e54db0] 2023-10-05T11:41:37.594 INFO:tasks.workunit.client.0.smithi012.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f7635ea154c] 2023-10-05T11:41:37.594 INFO:tasks.workunit.client.0.smithi012.stderr: 3: raise() 2023-10-05T11:41:37.594 INFO:tasks.workunit.client.0.smithi012.stderr: 4: abort() 2023-10-05T11:41:37.595 INFO:tasks.workunit.client.0.smithi012.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f763896d1b9] 2023-10-05T11:41:37.595 INFO:tasks.workunit.client.0.smithi012.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16d31d) [0x7f763896d31d] 2023-10-05T11:41:37.595 INFO:tasks.workunit.client.0.smithi012.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5613412dac31] 2023-10-05T11:41:37.595 INFO:tasks.workunit.client.0.smithi012.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x314) [0x5613412f17a4] 2023-10-05T11:41:37.595 INFO:tasks.workunit.client.0.smithi012.stderr: 9: main() 2023-10-05T11:41:37.595 INFO:tasks.workunit.client.0.smithi012.stderr: 10: /lib64/libc.so.6(+0x3feb0) [0x7f7635e3feb0] 2023-10-05T11:41:37.596 INFO:tasks.workunit.client.0.smithi012.stderr: 11: __libc_start_main() 2023-10-05T11:41:37.596 INFO:tasks.workunit.client.0.smithi012.stderr: 12: _start() 2023-10-05T11:41:37.596 INFO:tasks.workunit.client.0.smithi012.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-10-05T11:41:37.596 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:41:37.596 INFO:tasks.workunit.client.0.smithi012.stderr:--- begin dump of recent events --- 2023-10-05T11:41:37.597 INFO:tasks.workunit.client.0.smithi012.stderr: -499> 2023-10-05T11:41:37.521+0000 7f762f488640 10 monclient: got monmap 1 from mon.a (according to old e1) 2023-10-05T11:41:37.597 INFO:tasks.workunit.client.0.smithi012.stderr: -498> 2023-10-05T11:41:37.521+0000 7f7630c8b640 4 set_mon_vals no callback set 2023-10-05T11:41:37.597 INFO:tasks.workunit.client.0.smithi012.stderr: -497> 2023-10-05T11:41:37.521+0000 7f762f488640 10 monclient: dump: 2023-10-05T11:41:37.597 INFO:tasks.workunit.client.0.smithi012.stderr:epoch 1 2023-10-05T11:41:37.597 INFO:tasks.workunit.client.0.smithi012.stderr:fsid 7e015f46-293b-4b09-bd32-7d32b52f6e2f 2023-10-05T11:41:37.597 INFO:tasks.workunit.client.0.smithi012.stderr:last_changed 2023-10-05T11:27:38.366888+0000 2023-10-05T11:41:37.598 INFO:tasks.workunit.client.0.smithi012.stderr:created 2023-10-05T11:27:38.366888+0000 2023-10-05T11:41:37.598 INFO:tasks.workunit.client.0.smithi012.stderr:min_mon_release 18 (reef) 2023-10-05T11:41:37.598 INFO:tasks.workunit.client.0.smithi012.stderr:election_strategy: 1 2023-10-05T11:41:37.598 INFO:tasks.workunit.client.0.smithi012.stderr:0: [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon.a 2023-10-05T11:41:37.598 INFO:tasks.workunit.client.0.smithi012.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2023-10-05T11:41:37.598 INFO:tasks.workunit.client.0.smithi012.stderr:2: [v2:172.21.15.12:3301/0,v1:172.21.15.12:6790/0] mon.c 2023-10-05T11:41:37.599 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:41:37.599 INFO:tasks.workunit.client.0.smithi012.stderr: -496> 2023-10-05T11:41:37.521+0000 7f7636013880 5 monclient: authenticate success, global_id 7353 2023-10-05T11:41:37.599 INFO:tasks.workunit.client.0.smithi012.stderr: -495> 2023-10-05T11:41:37.521+0000 7f7636013880 10 monclient: _renew_subs 2023-10-05T11:41:37.599 INFO:tasks.workunit.client.0.smithi012.stderr: -494> 2023-10-05T11:41:37.521+0000 7f7636013880 10 monclient: _send_mon_message to mon.a at v2:172.21.15.12:3300/0 2023-10-05T11:41:37.599 INFO:tasks.workunit.client.0.smithi012.stderr: -493> 2023-10-05T11:41:37.521+0000 7f7636013880 10 monclient: _renew_subs 2023-10-05T11:41:37.599 INFO:tasks.workunit.client.0.smithi012.stderr: -492> 2023-10-05T11:41:37.521+0000 7f7636013880 10 monclient: _send_mon_message to mon.a at v2:172.21.15.12:3300/0 2023-10-05T11:41:37.599 INFO:tasks.workunit.client.0.smithi012.stderr: -491> 2023-10-05T11:41:37.521+0000 7f7636013880 1 librados: init done 2023-10-05T11:41:37.599 INFO:tasks.workunit.client.0.smithi012.stderr: -490> 2023-10-05T11:41:37.521+0000 7f7636013880 10 monclient: get_monmap_and_config 2023-10-05T11:41:37.599 INFO:tasks.workunit.client.0.smithi012.stderr: -489> 2023-10-05T11:41:37.521+0000 7f7636013880 10 monclient: build_initial_monmap 2023-10-05T11:41:37.599 INFO:tasks.workunit.client.0.smithi012.stderr: -488> 2023-10-05T11:41:37.521+0000 7f7636013880 1 build_initial for_mkfs: 0 2023-10-05T11:41:37.599 INFO:tasks.workunit.client.0.smithi012.stderr: -487> 2023-10-05T11:41:37.521+0000 7f7636013880 10 monclient: monmap: 2023-10-05T11:41:37.600 INFO:tasks.workunit.client.0.smithi012.stderr:epoch 0 2023-10-05T11:41:37.600 INFO:tasks.workunit.client.0.smithi012.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-10-05T11:41:37.600 INFO:tasks.workunit.client.0.smithi012.stderr:last_changed 0.000000 2023-10-05T11:41:37.600 INFO:tasks.workunit.client.0.smithi012.stderr:created 0.000000 2023-10-05T11:41:37.600 INFO:tasks.workunit.client.0.smithi012.stderr:min_mon_release 0 (unknown) 2023-10-05T11:41:37.600 INFO:tasks.workunit.client.0.smithi012.stderr:election_strategy: 1 2023-10-05T11:41:37.600 INFO:tasks.workunit.client.0.smithi012.stderr:0: [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon.noname-a 2023-10-05T11:41:37.600 INFO:tasks.workunit.client.0.smithi012.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.noname-b 2023-10-05T11:41:37.600 INFO:tasks.workunit.client.0.smithi012.stderr:2: [v2:172.21.15.12:3301/0,v1:172.21.15.12:6790/0] mon.noname-c 2023-10-05T11:41:37.600 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:41:37.600 INFO:tasks.workunit.client.0.smithi012.stderr: -486> 2023-10-05T11:41:37.521+0000 7f7636013880 5 AuthRegistry(0x561343ee9340) adding auth protocol: cephx 2023-10-05T11:41:37.600 INFO:tasks.workunit.client.0.smithi012.stderr: -485> 2023-10-05T11:41:37.521+0000 7f7636013880 5 AuthRegistry(0x561343ee9340) adding auth protocol: cephx 2023-10-05T11:41:37.600 INFO:tasks.workunit.client.0.smithi012.stderr: -484> 2023-10-05T11:41:37.521+0000 7f7636013880 5 AuthRegistry(0x561343ee9340) adding auth protocol: cephx 2023-10-05T11:41:37.601 INFO:tasks.workunit.client.0.smithi012.stderr: -483> 2023-10-05T11:41:37.521+0000 7f7636013880 5 AuthRegistry(0x561343ee9340) adding con mode: secure 2023-10-05T11:41:37.601 INFO:tasks.workunit.client.0.smithi012.stderr: -482> 2023-10-05T11:41:37.521+0000 7f7636013880 5 AuthRegistry(0x561343ee9340) adding con mode: crc 2023-10-05T11:41:37.601 INFO:tasks.workunit.client.0.smithi012.stderr: -481> 2023-10-05T11:41:37.521+0000 7f7636013880 5 AuthRegistry(0x561343ee9340) adding con mode: secure 2023-10-05T11:41:37.601 INFO:tasks.workunit.client.0.smithi012.stderr: -480> 2023-10-05T11:41:37.521+0000 7f7636013880 5 AuthRegistry(0x561343ee9340) adding con mode: crc 2023-10-05T11:41:37.601 INFO:tasks.workunit.client.0.smithi012.stderr: -479> 2023-10-05T11:41:37.521+0000 7f7636013880 5 AuthRegistry(0x561343ee9340) adding con mode: secure 2023-10-05T11:41:37.601 INFO:tasks.workunit.client.0.smithi012.stderr: -478> 2023-10-05T11:41:37.521+0000 7f7636013880 5 AuthRegistry(0x561343ee9340) adding con mode: crc 2023-10-05T11:41:37.601 INFO:tasks.workunit.client.0.smithi012.stderr: -477> 2023-10-05T11:41:37.521+0000 7f7636013880 5 AuthRegistry(0x561343ee9340) adding con mode: crc 2023-10-05T11:41:37.601 INFO:tasks.workunit.client.0.smithi012.stderr: -476> 2023-10-05T11:41:37.521+0000 7f7636013880 5 AuthRegistry(0x561343ee9340) adding con mode: secure 2023-10-05T11:41:37.601 INFO:tasks.workunit.client.0.smithi012.stderr: -475> 2023-10-05T11:41:37.521+0000 7f7636013880 5 AuthRegistry(0x561343ee9340) adding con mode: crc 2023-10-05T11:41:37.601 INFO:tasks.workunit.client.0.smithi012.stderr: -474> 2023-10-05T11:41:37.521+0000 7f7636013880 5 AuthRegistry(0x561343ee9340) adding con mode: secure 2023-10-05T11:41:37.601 INFO:tasks.workunit.client.0.smithi012.stderr: -473> 2023-10-05T11:41:37.521+0000 7f7636013880 5 AuthRegistry(0x561343ee9340) adding con mode: crc 2023-10-05T11:41:37.601 INFO:tasks.workunit.client.0.smithi012.stderr: -472> 2023-10-05T11:41:37.521+0000 7f7636013880 5 AuthRegistry(0x561343ee9340) adding con mode: secure 2023-10-05T11:41:37.602 INFO:tasks.workunit.client.0.smithi012.stderr: -471> 2023-10-05T11:41:37.522+0000 7f7636013880 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-10-05T11:41:37.602 INFO:tasks.workunit.client.0.smithi012.stderr: -470> 2023-10-05T11:41:37.522+0000 7f7636013880 10 monclient: init 2023-10-05T11:41:37.602 INFO:tasks.workunit.client.0.smithi012.stderr: -469> 2023-10-05T11:41:37.522+0000 7f7636013880 5 AuthRegistry(0x7fff98e526b0) adding auth protocol: cephx 2023-10-05T11:41:37.602 INFO:tasks.workunit.client.0.smithi012.stderr: -468> 2023-10-05T11:41:37.522+0000 7f7636013880 5 AuthRegistry(0x7fff98e526b0) adding auth protocol: cephx 2023-10-05T11:41:37.602 INFO:tasks.workunit.client.0.smithi012.stderr: -467> 2023-10-05T11:41:37.522+0000 7f7636013880 5 AuthRegistry(0x7fff98e526b0) adding auth protocol: cephx 2023-10-05T11:41:37.602 INFO:tasks.workunit.client.0.smithi012.stderr: -466> 2023-10-05T11:41:37.522+0000 7f7636013880 5 AuthRegistry(0x7fff98e526b0) adding con mode: secure 2023-10-05T11:41:37.602 INFO:tasks.workunit.client.0.smithi012.stderr: -465> 2023-10-05T11:41:37.522+0000 7f7636013880 5 AuthRegistry(0x7fff98e526b0) adding con mode: crc 2023-10-05T11:41:37.602 INFO:tasks.workunit.client.0.smithi012.stderr: -464> 2023-10-05T11:41:37.522+0000 7f7636013880 5 AuthRegistry(0x7fff98e526b0) adding con mode: secure 2023-10-05T11:41:37.602 INFO:tasks.workunit.client.0.smithi012.stderr: -463> 2023-10-05T11:41:37.522+0000 7f7636013880 5 AuthRegistry(0x7fff98e526b0) adding con mode: crc 2023-10-05T11:41:37.602 INFO:tasks.workunit.client.0.smithi012.stderr: -462> 2023-10-05T11:41:37.522+0000 7f7636013880 5 AuthRegistry(0x7fff98e526b0) adding con mode: secure 2023-10-05T11:41:37.602 INFO:tasks.workunit.client.0.smithi012.stderr: -461> 2023-10-05T11:41:37.522+0000 7f7636013880 5 AuthRegistry(0x7fff98e526b0) adding con mode: crc 2023-10-05T11:41:37.603 INFO:tasks.workunit.client.0.smithi012.stderr: -460> 2023-10-05T11:41:37.522+0000 7f7636013880 5 AuthRegistry(0x7fff98e526b0) adding con mode: crc 2023-10-05T11:41:37.603 INFO:tasks.workunit.client.0.smithi012.stderr: -459> 2023-10-05T11:41:37.522+0000 7f7636013880 5 AuthRegistry(0x7fff98e526b0) adding con mode: secure 2023-10-05T11:41:37.603 INFO:tasks.workunit.client.0.smithi012.stderr: -458> 2023-10-05T11:41:37.522+0000 7f7636013880 5 AuthRegistry(0x7fff98e526b0) adding con mode: crc 2023-10-05T11:41:37.603 INFO:tasks.workunit.client.0.smithi012.stderr: -457> 2023-10-05T11:41:37.522+0000 7f7636013880 5 AuthRegistry(0x7fff98e526b0) adding con mode: secure 2023-10-05T11:41:37.603 INFO:tasks.workunit.client.0.smithi012.stderr: -456> 2023-10-05T11:41:37.522+0000 7f7636013880 5 AuthRegistry(0x7fff98e526b0) adding con mode: crc 2023-10-05T11:41:37.604 INFO:tasks.workunit.client.0.smithi012.stderr: -455> 2023-10-05T11:41:37.522+0000 7f7636013880 5 AuthRegistry(0x7fff98e526b0) adding con mode: secure 2023-10-05T11:41:37.604 INFO:tasks.workunit.client.0.smithi012.stderr: -454> 2023-10-05T11:41:37.522+0000 7f762f488640 4 mgrc handle_mgr_map Got map version 5 2023-10-05T11:41:37.604 INFO:tasks.workunit.client.0.smithi012.stderr: -453> 2023-10-05T11:41:37.522+0000 7f762f488640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.170:6832/180516904,v1:172.21.15.170:6833/180516904] 2023-10-05T11:41:37.604 INFO:tasks.workunit.client.0.smithi012.stderr: -452> 2023-10-05T11:41:37.522+0000 7f762f488640 4 mgrc reconnect Starting new session with [v2:172.21.15.170:6832/180516904,v1:172.21.15.170:6833/180516904] 2023-10-05T11:41:37.604 INFO:tasks.workunit.client.0.smithi012.stderr: -451> 2023-10-05T11:41:37.522+0000 7f7636013880 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-10-05T11:41:37.604 INFO:tasks.workunit.client.0.smithi012.stderr: -450> 2023-10-05T11:41:37.523+0000 7f7636013880 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-10-05T11:41:37.605 INFO:tasks.workunit.client.0.smithi012.stderr: -449> 2023-10-05T11:41:37.523+0000 7f7636013880 5 asok(0x561343438000) register_command rotate-key cmddesc rotate-key hook 0x7fff98e527f8 EEXIST 2023-10-05T11:41:37.605 INFO:tasks.workunit.client.0.smithi012.stderr: -448> 2023-10-05T11:41:37.523+0000 7f7636013880 10 monclient: _reopen_session rank -1 2023-10-05T11:41:37.605 INFO:tasks.workunit.client.0.smithi012.stderr: -447> 2023-10-05T11:41:37.523+0000 7f7636013880 10 monclient: _add_conns ranks=[2,1,0] 2023-10-05T11:41:37.605 INFO:tasks.workunit.client.0.smithi012.stderr: -446> 2023-10-05T11:41:37.523+0000 7f7636013880 10 monclient(hunting): picked mon.noname-c con 0x561344036800 addr [v2:172.21.15.12:3301/0,v1:172.21.15.12:6790/0] 2023-10-05T11:41:37.605 INFO:tasks.workunit.client.0.smithi012.stderr: -445> 2023-10-05T11:41:37.523+0000 7f7636013880 10 monclient(hunting): picked mon.noname-b con 0x561344036c00 addr [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] 2023-10-05T11:41:37.605 INFO:tasks.workunit.client.0.smithi012.stderr: -444> 2023-10-05T11:41:37.523+0000 7f7636013880 10 monclient(hunting): picked mon.noname-a con 0x561344037000 addr [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] 2023-10-05T11:41:37.605 INFO:tasks.workunit.client.0.smithi012.stderr: -443> 2023-10-05T11:41:37.523+0000 7f7636013880 10 monclient(hunting): start opening mon connection 2023-10-05T11:41:37.605 INFO:tasks.workunit.client.0.smithi012.stderr: -442> 2023-10-05T11:41:37.523+0000 7f7636013880 10 monclient(hunting): start opening mon connection 2023-10-05T11:41:37.605 INFO:tasks.workunit.client.0.smithi012.stderr: -441> 2023-10-05T11:41:37.523+0000 7f7636013880 10 monclient(hunting): start opening mon connection 2023-10-05T11:41:37.605 INFO:tasks.workunit.client.0.smithi012.stderr: -440> 2023-10-05T11:41:37.523+0000 7f7636013880 10 monclient(hunting): _renew_subs 2023-10-05T11:41:37.605 INFO:tasks.workunit.client.0.smithi012.stderr: -439> 2023-10-05T11:41:37.523+0000 7f7636013880 10 monclient(hunting): authenticate will time out at 1605.690638s 2023-10-05T11:41:37.605 INFO:tasks.workunit.client.0.smithi012.stderr: -438> 2023-10-05T11:41:37.523+0000 7f763248e640 10 monclient(hunting): get_auth_request con 0x561344036800 auth_method 0 2023-10-05T11:41:37.606 INFO:tasks.workunit.client.0.smithi012.stderr: -437> 2023-10-05T11:41:37.523+0000 7f763248e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-10-05T11:41:37.606 INFO:tasks.workunit.client.0.smithi012.stderr: -436> 2023-10-05T11:41:37.523+0000 7f763248e640 10 monclient(hunting): _init_auth method 2 2023-10-05T11:41:37.606 INFO:tasks.workunit.client.0.smithi012.stderr: -435> 2023-10-05T11:41:37.523+0000 7f763248e640 10 monclient(hunting): _init_auth creating new auth 2023-10-05T11:41:37.606 INFO:tasks.workunit.client.0.smithi012.stderr: -434> 2023-10-05T11:41:37.523+0000 7f7632c8f640 10 monclient(hunting): get_auth_request con 0x561344037000 auth_method 0 2023-10-05T11:41:37.606 INFO:tasks.workunit.client.0.smithi012.stderr: -433> 2023-10-05T11:41:37.523+0000 7f7632c8f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-10-05T11:41:37.606 INFO:tasks.workunit.client.0.smithi012.stderr: -432> 2023-10-05T11:41:37.523+0000 7f7632c8f640 10 monclient(hunting): _init_auth method 2 2023-10-05T11:41:37.606 INFO:tasks.workunit.client.0.smithi012.stderr: -431> 2023-10-05T11:41:37.523+0000 7f7632c8f640 10 monclient(hunting): _init_auth creating new auth 2023-10-05T11:41:37.606 INFO:tasks.workunit.client.0.smithi012.stderr: -430> 2023-10-05T11:41:37.523+0000 7f7631c8d640 10 monclient: get_auth_request con 0x561344036400 auth_method 0 2023-10-05T11:41:37.606 INFO:tasks.workunit.client.0.smithi012.stderr: -429> 2023-10-05T11:41:37.523+0000 7f763248e640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-10-05T11:41:37.606 INFO:tasks.workunit.client.0.smithi012.stderr: -428> 2023-10-05T11:41:37.523+0000 7f763248e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-10-05T11:41:37.606 INFO:tasks.workunit.client.0.smithi012.stderr: -427> 2023-10-05T11:41:37.523+0000 7f763248e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-10-05T11:41:37.606 INFO:tasks.workunit.client.0.smithi012.stderr: -426> 2023-10-05T11:41:37.523+0000 7f7632c8f640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-10-05T11:41:37.606 INFO:tasks.workunit.client.0.smithi012.stderr: -425> 2023-10-05T11:41:37.523+0000 7f7632c8f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-10-05T11:41:37.607 INFO:tasks.workunit.client.0.smithi012.stderr: -424> 2023-10-05T11:41:37.523+0000 7f7632c8f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-10-05T11:41:37.607 INFO:tasks.workunit.client.0.smithi012.stderr: -423> 2023-10-05T11:41:37.523+0000 7f763248e640 10 monclient(hunting): handle_auth_done global_id 6965 payload 274 2023-10-05T11:41:37.607 INFO:tasks.workunit.client.0.smithi012.stderr: -422> 2023-10-05T11:41:37.523+0000 7f763248e640 10 monclient: _finish_hunting 0 2023-10-05T11:41:37.607 INFO:tasks.workunit.client.0.smithi012.stderr: -421> 2023-10-05T11:41:37.523+0000 7f763248e640 1 monclient: found mon.noname-c 2023-10-05T11:41:37.607 INFO:tasks.workunit.client.0.smithi012.stderr: -420> 2023-10-05T11:41:37.523+0000 7f763248e640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.12:3301/0 2023-10-05T11:41:37.607 INFO:tasks.workunit.client.0.smithi012.stderr: -419> 2023-10-05T11:41:37.523+0000 7f7631c8d640 10 monclient: get_auth_request con 0x561344036c00 auth_method 0 2023-10-05T11:41:37.607 INFO:tasks.workunit.client.0.smithi012.stderr: -418> 2023-10-05T11:41:37.523+0000 7f762cc83640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-10-05T11:41:37.607 INFO:tasks.workunit.client.0.smithi012.stderr: -417> 2023-10-05T11:41:37.523+0000 7f762cc83640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2023-10-05T11:41:37.607 INFO:tasks.workunit.client.0.smithi012.stderr: -416> 2023-10-05T11:41:37.523+0000 7f762cc83640 10 monclient: dump: 2023-10-05T11:41:37.607 INFO:tasks.workunit.client.0.smithi012.stderr:epoch 1 2023-10-05T11:41:37.607 INFO:tasks.workunit.client.0.smithi012.stderr:fsid 7e015f46-293b-4b09-bd32-7d32b52f6e2f 2023-10-05T11:41:37.607 INFO:tasks.workunit.client.0.smithi012.stderr:last_changed 2023-10-05T11:27:38.366888+0000 2023-10-05T11:41:37.608 INFO:tasks.workunit.client.0.smithi012.stderr:created 2023-10-05T11:27:38.366888+0000 2023-10-05T11:41:37.608 INFO:tasks.workunit.client.0.smithi012.stderr:min_mon_release 18 (reef) 2023-10-05T11:41:37.608 INFO:tasks.workunit.client.0.smithi012.stderr:election_strategy: 1 2023-10-05T11:41:37.608 INFO:tasks.workunit.client.0.smithi012.stderr:0: [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon.a 2023-10-05T11:41:37.608 INFO:tasks.workunit.client.0.smithi012.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2023-10-05T11:41:37.608 INFO:tasks.workunit.client.0.smithi012.stderr:2: [v2:172.21.15.12:3301/0,v1:172.21.15.12:6790/0] mon.c 2023-10-05T11:41:37.608 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:41:37.608 INFO:tasks.workunit.client.0.smithi012.stderr: -415> 2023-10-05T11:41:37.523+0000 7f762cc83640 10 monclient: _finish_auth 0 2023-10-05T11:41:37.608 INFO:tasks.workunit.client.0.smithi012.stderr: -414> 2023-10-05T11:41:37.523+0000 7f762cc83640 10 monclient: _check_auth_tickets 2023-10-05T11:41:37.608 INFO:tasks.workunit.client.0.smithi012.stderr: -413> 2023-10-05T11:41:37.523+0000 7f7636013880 5 monclient: authenticate success, global_id 6965 2023-10-05T11:41:37.609 INFO:tasks.workunit.client.0.smithi012.stderr: -412> 2023-10-05T11:41:37.523+0000 7f762cc83640 10 monclient: handle_config config(0 keys) v1 2023-10-05T11:41:37.609 INFO:tasks.workunit.client.0.smithi012.stderr: -411> 2023-10-05T11:41:37.523+0000 7f7636013880 10 monclient: get_monmap_and_config success 2023-10-05T11:41:37.609 INFO:tasks.workunit.client.0.smithi012.stderr: -410> 2023-10-05T11:41:37.523+0000 7f7636013880 4 set_mon_vals no callback set 2023-10-05T11:41:37.609 INFO:tasks.workunit.client.0.smithi012.stderr: -409> 2023-10-05T11:41:37.523+0000 7f762cc83640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-10-05T11:41:37.609 INFO:tasks.workunit.client.0.smithi012.stderr: -408> 2023-10-05T11:41:37.523+0000 7f762cc83640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-10-05T11:41:37.609 INFO:tasks.workunit.client.0.smithi012.stderr: -407> 2023-10-05T11:41:37.523+0000 7f762cc83640 10 monclient: dump: 2023-10-05T11:41:37.609 INFO:tasks.workunit.client.0.smithi012.stderr:epoch 1 2023-10-05T11:41:37.609 INFO:tasks.workunit.client.0.smithi012.stderr:fsid 7e015f46-293b-4b09-bd32-7d32b52f6e2f 2023-10-05T11:41:37.609 INFO:tasks.workunit.client.0.smithi012.stderr:last_changed 2023-10-05T11:27:38.366888+0000 2023-10-05T11:41:37.609 INFO:tasks.workunit.client.0.smithi012.stderr:created 2023-10-05T11:27:38.366888+0000 2023-10-05T11:41:37.610 INFO:tasks.workunit.client.0.smithi012.stderr:min_mon_release 18 (reef) 2023-10-05T11:41:37.610 INFO:tasks.workunit.client.0.smithi012.stderr:election_strategy: 1 2023-10-05T11:41:37.610 INFO:tasks.workunit.client.0.smithi012.stderr:0: [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon.a 2023-10-05T11:41:37.610 INFO:tasks.workunit.client.0.smithi012.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2023-10-05T11:41:37.610 INFO:tasks.workunit.client.0.smithi012.stderr:2: [v2:172.21.15.12:3301/0,v1:172.21.15.12:6790/0] mon.c 2023-10-05T11:41:37.610 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:41:37.610 INFO:tasks.workunit.client.0.smithi012.stderr: -406> 2023-10-05T11:41:37.524+0000 7f7636013880 10 monclient: shutdown 2023-10-05T11:41:37.610 INFO:tasks.workunit.client.0.smithi012.stderr: -405> 2023-10-05T11:41:37.524+0000 7f7636013880 10 monclient: build_initial_monmap 2023-10-05T11:41:37.610 INFO:tasks.workunit.client.0.smithi012.stderr: -404> 2023-10-05T11:41:37.524+0000 7f7636013880 1 build_initial for_mkfs: 0 2023-10-05T11:41:37.610 INFO:tasks.workunit.client.0.smithi012.stderr: -403> 2023-10-05T11:41:37.524+0000 7f7636013880 10 monclient: monmap: 2023-10-05T11:41:37.610 INFO:tasks.workunit.client.0.smithi012.stderr:epoch 0 2023-10-05T11:41:37.611 INFO:tasks.workunit.client.0.smithi012.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-10-05T11:41:37.611 INFO:tasks.workunit.client.0.smithi012.stderr:last_changed 0.000000 2023-10-05T11:41:37.611 INFO:tasks.workunit.client.0.smithi012.stderr:created 0.000000 2023-10-05T11:41:37.611 INFO:tasks.workunit.client.0.smithi012.stderr:min_mon_release 0 (unknown) 2023-10-05T11:41:37.611 INFO:tasks.workunit.client.0.smithi012.stderr:election_strategy: 1 2023-10-05T11:41:37.611 INFO:tasks.workunit.client.0.smithi012.stderr:0: [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon.noname-a 2023-10-05T11:41:37.611 INFO:tasks.workunit.client.0.smithi012.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.noname-b 2023-10-05T11:41:37.611 INFO:tasks.workunit.client.0.smithi012.stderr:2: [v2:172.21.15.12:3301/0,v1:172.21.15.12:6790/0] mon.noname-c 2023-10-05T11:41:37.611 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:41:37.611 INFO:tasks.workunit.client.0.smithi012.stderr: -402> 2023-10-05T11:41:37.524+0000 7f7636013880 5 AuthRegistry(0x561343ee9340) adding auth protocol: cephx 2023-10-05T11:41:37.611 INFO:tasks.workunit.client.0.smithi012.stderr: -401> 2023-10-05T11:41:37.524+0000 7f7636013880 5 AuthRegistry(0x561343ee9340) adding auth protocol: cephx 2023-10-05T11:41:37.611 INFO:tasks.workunit.client.0.smithi012.stderr: -400> 2023-10-05T11:41:37.524+0000 7f7636013880 5 AuthRegistry(0x561343ee9340) adding auth protocol: cephx 2023-10-05T11:41:37.612 INFO:tasks.workunit.client.0.smithi012.stderr: -399> 2023-10-05T11:41:37.524+0000 7f7636013880 5 AuthRegistry(0x561343ee9340) adding con mode: secure 2023-10-05T11:41:37.612 INFO:tasks.workunit.client.0.smithi012.stderr: -398> 2023-10-05T11:41:37.524+0000 7f7636013880 5 AuthRegistry(0x561343ee9340) adding con mode: crc 2023-10-05T11:41:37.612 INFO:tasks.workunit.client.0.smithi012.stderr: -397> 2023-10-05T11:41:37.524+0000 7f7636013880 5 AuthRegistry(0x561343ee9340) adding con mode: secure 2023-10-05T11:41:37.612 INFO:tasks.workunit.client.0.smithi012.stderr: -396> 2023-10-05T11:41:37.524+0000 7f7636013880 5 AuthRegistry(0x561343ee9340) adding con mode: crc 2023-10-05T11:41:37.612 INFO:tasks.workunit.client.0.smithi012.stderr: -395> 2023-10-05T11:41:37.524+0000 7f7636013880 5 AuthRegistry(0x561343ee9340) adding con mode: secure 2023-10-05T11:41:37.612 INFO:tasks.workunit.client.0.smithi012.stderr: -394> 2023-10-05T11:41:37.524+0000 7f7636013880 5 AuthRegistry(0x561343ee9340) adding con mode: crc 2023-10-05T11:41:37.612 INFO:tasks.workunit.client.0.smithi012.stderr: -393> 2023-10-05T11:41:37.524+0000 7f7636013880 5 AuthRegistry(0x561343ee9340) adding con mode: crc 2023-10-05T11:41:37.612 INFO:tasks.workunit.client.0.smithi012.stderr: -392> 2023-10-05T11:41:37.524+0000 7f7636013880 5 AuthRegistry(0x561343ee9340) adding con mode: secure 2023-10-05T11:41:37.612 INFO:tasks.workunit.client.0.smithi012.stderr: -391> 2023-10-05T11:41:37.524+0000 7f7636013880 5 AuthRegistry(0x561343ee9340) adding con mode: crc 2023-10-05T11:41:37.612 INFO:tasks.workunit.client.0.smithi012.stderr: -390> 2023-10-05T11:41:37.524+0000 7f7636013880 5 AuthRegistry(0x561343ee9340) adding con mode: secure 2023-10-05T11:41:37.612 INFO:tasks.workunit.client.0.smithi012.stderr: -389> 2023-10-05T11:41:37.524+0000 7f7636013880 5 AuthRegistry(0x561343ee9340) adding con mode: crc 2023-10-05T11:41:37.612 INFO:tasks.workunit.client.0.smithi012.stderr: -388> 2023-10-05T11:41:37.524+0000 7f7636013880 5 AuthRegistry(0x561343ee9340) adding con mode: secure 2023-10-05T11:41:37.613 INFO:tasks.workunit.client.0.smithi012.stderr: -387> 2023-10-05T11:41:37.524+0000 7f7636013880 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-10-05T11:41:37.613 INFO:tasks.workunit.client.0.smithi012.stderr: -386> 2023-10-05T11:41:37.524+0000 7f7636013880 1 librados: starting msgr at 2023-10-05T11:41:37.613 INFO:tasks.workunit.client.0.smithi012.stderr: -385> 2023-10-05T11:41:37.524+0000 7f7636013880 1 librados: starting objecter 2023-10-05T11:41:37.613 INFO:tasks.workunit.client.0.smithi012.stderr: -384> 2023-10-05T11:41:37.524+0000 7f7636013880 5 asok(0x561343438000) register_command objecter_requests cmddesc objecter_requests hook 0x561343f496a0 EEXIST 2023-10-05T11:41:37.613 INFO:tasks.workunit.client.0.smithi012.stderr: -383> 2023-10-05T11:41:37.524+0000 7f7636013880 1 librados: setting wanted keys 2023-10-05T11:41:37.613 INFO:tasks.workunit.client.0.smithi012.stderr: -382> 2023-10-05T11:41:37.524+0000 7f7636013880 1 librados: calling monclient init 2023-10-05T11:41:37.613 INFO:tasks.workunit.client.0.smithi012.stderr: -381> 2023-10-05T11:41:37.524+0000 7f7636013880 10 monclient: init 2023-10-05T11:41:37.613 INFO:tasks.workunit.client.0.smithi012.stderr: -380> 2023-10-05T11:41:37.524+0000 7f7636013880 5 AuthRegistry(0x5613432970d8) adding auth protocol: cephx 2023-10-05T11:41:37.613 INFO:tasks.workunit.client.0.smithi012.stderr: -379> 2023-10-05T11:41:37.524+0000 7f7636013880 5 AuthRegistry(0x5613432970d8) adding auth protocol: cephx 2023-10-05T11:41:37.613 INFO:tasks.workunit.client.0.smithi012.stderr: -378> 2023-10-05T11:41:37.524+0000 7f7636013880 5 AuthRegistry(0x5613432970d8) adding auth protocol: cephx 2023-10-05T11:41:37.613 INFO:tasks.workunit.client.0.smithi012.stderr: -377> 2023-10-05T11:41:37.524+0000 7f7636013880 5 AuthRegistry(0x5613432970d8) adding con mode: secure 2023-10-05T11:41:37.613 INFO:tasks.workunit.client.0.smithi012.stderr: -376> 2023-10-05T11:41:37.524+0000 7f7636013880 5 AuthRegistry(0x5613432970d8) adding con mode: crc 2023-10-05T11:41:37.614 INFO:tasks.workunit.client.0.smithi012.stderr: -375> 2023-10-05T11:41:37.524+0000 7f7636013880 5 AuthRegistry(0x5613432970d8) adding con mode: secure 2023-10-05T11:41:37.614 INFO:tasks.workunit.client.0.smithi012.stderr: -374> 2023-10-05T11:41:37.524+0000 7f7636013880 5 AuthRegistry(0x5613432970d8) adding con mode: crc 2023-10-05T11:41:37.614 INFO:tasks.workunit.client.0.smithi012.stderr: -373> 2023-10-05T11:41:37.524+0000 7f7636013880 5 AuthRegistry(0x5613432970d8) adding con mode: secure 2023-10-05T11:41:37.614 INFO:tasks.workunit.client.0.smithi012.stderr: -372> 2023-10-05T11:41:37.524+0000 7f7636013880 5 AuthRegistry(0x5613432970d8) adding con mode: crc 2023-10-05T11:41:37.614 INFO:tasks.workunit.client.0.smithi012.stderr: -371> 2023-10-05T11:41:37.524+0000 7f7636013880 5 AuthRegistry(0x5613432970d8) adding con mode: crc 2023-10-05T11:41:37.614 INFO:tasks.workunit.client.0.smithi012.stderr: -370> 2023-10-05T11:41:37.524+0000 7f7636013880 5 AuthRegistry(0x5613432970d8) adding con mode: secure 2023-10-05T11:41:37.614 INFO:tasks.workunit.client.0.smithi012.stderr: -369> 2023-10-05T11:41:37.524+0000 7f7636013880 5 AuthRegistry(0x5613432970d8) adding con mode: crc 2023-10-05T11:41:37.614 INFO:tasks.workunit.client.0.smithi012.stderr: -368> 2023-10-05T11:41:37.524+0000 7f7636013880 5 AuthRegistry(0x5613432970d8) adding con mode: secure 2023-10-05T11:41:37.614 INFO:tasks.workunit.client.0.smithi012.stderr: -367> 2023-10-05T11:41:37.524+0000 7f7636013880 5 AuthRegistry(0x5613432970d8) adding con mode: crc 2023-10-05T11:41:37.614 INFO:tasks.workunit.client.0.smithi012.stderr: -366> 2023-10-05T11:41:37.524+0000 7f7636013880 5 AuthRegistry(0x5613432970d8) adding con mode: secure 2023-10-05T11:41:37.615 INFO:tasks.workunit.client.0.smithi012.stderr: -365> 2023-10-05T11:41:37.524+0000 7f7636013880 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-10-05T11:41:37.615 INFO:tasks.workunit.client.0.smithi012.stderr: -364> 2023-10-05T11:41:37.525+0000 7f7636013880 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-10-05T11:41:37.615 INFO:tasks.workunit.client.0.smithi012.stderr: -363> 2023-10-05T11:41:37.525+0000 7f7636013880 5 asok(0x561343438000) register_command rotate-key cmddesc rotate-key hook 0x561343297220 EEXIST 2023-10-05T11:41:37.615 INFO:tasks.workunit.client.0.smithi012.stderr: -362> 2023-10-05T11:41:37.525+0000 7f7636013880 10 monclient: _reopen_session rank -1 2023-10-05T11:41:37.615 INFO:tasks.workunit.client.0.smithi012.stderr: -361> 2023-10-05T11:41:37.525+0000 7f7636013880 10 monclient: _add_conns ranks=[0,2,1] 2023-10-05T11:41:37.615 INFO:tasks.workunit.client.0.smithi012.stderr: -360> 2023-10-05T11:41:37.525+0000 7f7636013880 10 monclient(hunting): picked mon.noname-a con 0x561344036800 addr [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] 2023-10-05T11:41:37.615 INFO:tasks.workunit.client.0.smithi012.stderr: -359> 2023-10-05T11:41:37.525+0000 7f7636013880 10 monclient(hunting): picked mon.noname-c con 0x561344036c00 addr [v2:172.21.15.12:3301/0,v1:172.21.15.12:6790/0] 2023-10-05T11:41:37.615 INFO:tasks.workunit.client.0.smithi012.stderr: -358> 2023-10-05T11:41:37.525+0000 7f7636013880 10 monclient(hunting): picked mon.noname-b con 0x561344037000 addr [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] 2023-10-05T11:41:37.615 INFO:tasks.workunit.client.0.smithi012.stderr: -357> 2023-10-05T11:41:37.525+0000 7f7636013880 10 monclient(hunting): start opening mon connection 2023-10-05T11:41:37.615 INFO:tasks.workunit.client.0.smithi012.stderr: -356> 2023-10-05T11:41:37.525+0000 7f7636013880 10 monclient(hunting): start opening mon connection 2023-10-05T11:41:37.615 INFO:tasks.workunit.client.0.smithi012.stderr: -355> 2023-10-05T11:41:37.525+0000 7f7636013880 10 monclient(hunting): start opening mon connection 2023-10-05T11:41:37.615 INFO:tasks.workunit.client.0.smithi012.stderr: -354> 2023-10-05T11:41:37.525+0000 7f7636013880 10 monclient(hunting): _renew_subs 2023-10-05T11:41:37.616 INFO:tasks.workunit.client.0.smithi012.stderr: -353> 2023-10-05T11:41:37.525+0000 7f7636013880 10 monclient(hunting): authenticate will time out at 1605.692614s 2023-10-05T11:41:37.616 INFO:tasks.workunit.client.0.smithi012.stderr: -352> 2023-10-05T11:41:37.525+0000 7f763248e640 10 monclient(hunting): get_auth_request con 0x561344036800 auth_method 0 2023-10-05T11:41:37.616 INFO:tasks.workunit.client.0.smithi012.stderr: -351> 2023-10-05T11:41:37.525+0000 7f763248e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-10-05T11:41:37.616 INFO:tasks.workunit.client.0.smithi012.stderr: -350> 2023-10-05T11:41:37.525+0000 7f763248e640 10 monclient(hunting): _init_auth method 2 2023-10-05T11:41:37.616 INFO:tasks.workunit.client.0.smithi012.stderr: -349> 2023-10-05T11:41:37.525+0000 7f763248e640 10 monclient(hunting): _init_auth creating new auth 2023-10-05T11:41:37.616 INFO:tasks.workunit.client.0.smithi012.stderr: -348> 2023-10-05T11:41:37.525+0000 7f7631c8d640 10 monclient(hunting): get_auth_request con 0x561344036c00 auth_method 0 2023-10-05T11:41:37.616 INFO:tasks.workunit.client.0.smithi012.stderr: -347> 2023-10-05T11:41:37.525+0000 7f7631c8d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-10-05T11:41:37.616 INFO:tasks.workunit.client.0.smithi012.stderr: -346> 2023-10-05T11:41:37.525+0000 7f7631c8d640 10 monclient(hunting): _init_auth method 2 2023-10-05T11:41:37.616 INFO:tasks.workunit.client.0.smithi012.stderr: -345> 2023-10-05T11:41:37.525+0000 7f7631c8d640 10 monclient(hunting): _init_auth creating new auth 2023-10-05T11:41:37.616 INFO:tasks.workunit.client.0.smithi012.stderr: -344> 2023-10-05T11:41:37.525+0000 7f763248e640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-10-05T11:41:37.616 INFO:tasks.workunit.client.0.smithi012.stderr: -343> 2023-10-05T11:41:37.525+0000 7f763248e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-10-05T11:41:37.616 INFO:tasks.workunit.client.0.smithi012.stderr: -342> 2023-10-05T11:41:37.525+0000 7f763248e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-10-05T11:41:37.617 INFO:tasks.workunit.client.0.smithi012.stderr: -341> 2023-10-05T11:41:37.525+0000 7f7631c8d640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-10-05T11:41:37.617 INFO:tasks.workunit.client.0.smithi012.stderr: -340> 2023-10-05T11:41:37.525+0000 7f7631c8d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-10-05T11:41:37.617 INFO:tasks.workunit.client.0.smithi012.stderr: -339> 2023-10-05T11:41:37.525+0000 7f7631c8d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-10-05T11:41:37.617 INFO:tasks.workunit.client.0.smithi012.stderr: -338> 2023-10-05T11:41:37.525+0000 7f7632c8f640 10 monclient(hunting): get_auth_request con 0x561344037000 auth_method 0 2023-10-05T11:41:37.617 INFO:tasks.workunit.client.0.smithi012.stderr: -337> 2023-10-05T11:41:37.525+0000 7f7632c8f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-10-05T11:41:37.617 INFO:tasks.workunit.client.0.smithi012.stderr: -336> 2023-10-05T11:41:37.525+0000 7f7632c8f640 10 monclient(hunting): _init_auth method 2 2023-10-05T11:41:37.617 INFO:tasks.workunit.client.0.smithi012.stderr: -335> 2023-10-05T11:41:37.525+0000 7f7632c8f640 10 monclient(hunting): _init_auth creating new auth 2023-10-05T11:41:37.617 INFO:tasks.workunit.client.0.smithi012.stderr: -334> 2023-10-05T11:41:37.525+0000 7f7632c8f640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-10-05T11:41:37.617 INFO:tasks.workunit.client.0.smithi012.stderr: -333> 2023-10-05T11:41:37.525+0000 7f7632c8f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-10-05T11:41:37.617 INFO:tasks.workunit.client.0.smithi012.stderr: -332> 2023-10-05T11:41:37.525+0000 7f7632c8f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-10-05T11:41:37.617 INFO:tasks.workunit.client.0.smithi012.stderr: -331> 2023-10-05T11:41:37.525+0000 7f7631c8d640 10 monclient(hunting): handle_auth_done global_id 6968 payload 824 2023-10-05T11:41:37.617 INFO:tasks.workunit.client.0.smithi012.stderr: -330> 2023-10-05T11:41:37.525+0000 7f7631c8d640 10 monclient: _finish_hunting 0 2023-10-05T11:41:37.617 INFO:tasks.workunit.client.0.smithi012.stderr: -329> 2023-10-05T11:41:37.525+0000 7f7631c8d640 1 monclient: found mon.noname-c 2023-10-05T11:41:37.618 INFO:tasks.workunit.client.0.smithi012.stderr: -328> 2023-10-05T11:41:37.525+0000 7f7631c8d640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.12:3301/0 2023-10-05T11:41:37.618 INFO:tasks.workunit.client.0.smithi012.stderr: -327> 2023-10-05T11:41:37.525+0000 7f762b480640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-10-05T11:41:37.618 INFO:tasks.workunit.client.0.smithi012.stderr: -326> 2023-10-05T11:41:37.525+0000 7f762b480640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2023-10-05T11:41:37.618 INFO:tasks.workunit.client.0.smithi012.stderr: -325> 2023-10-05T11:41:37.525+0000 7f762b480640 10 monclient: dump: 2023-10-05T11:41:37.618 INFO:tasks.workunit.client.0.smithi012.stderr:epoch 1 2023-10-05T11:41:37.618 INFO:tasks.workunit.client.0.smithi012.stderr:fsid 7e015f46-293b-4b09-bd32-7d32b52f6e2f 2023-10-05T11:41:37.618 INFO:tasks.workunit.client.0.smithi012.stderr:last_changed 2023-10-05T11:27:38.366888+0000 2023-10-05T11:41:37.618 INFO:tasks.workunit.client.0.smithi012.stderr:created 2023-10-05T11:27:38.366888+0000 2023-10-05T11:41:37.618 INFO:tasks.workunit.client.0.smithi012.stderr:min_mon_release 18 (reef) 2023-10-05T11:41:37.618 INFO:tasks.workunit.client.0.smithi012.stderr:election_strategy: 1 2023-10-05T11:41:37.618 INFO:tasks.workunit.client.0.smithi012.stderr:0: [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon.a 2023-10-05T11:41:37.619 INFO:tasks.workunit.client.0.smithi012.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2023-10-05T11:41:37.619 INFO:tasks.workunit.client.0.smithi012.stderr:2: [v2:172.21.15.12:3301/0,v1:172.21.15.12:6790/0] mon.c 2023-10-05T11:41:37.619 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:41:37.619 INFO:tasks.workunit.client.0.smithi012.stderr: -324> 2023-10-05T11:41:37.525+0000 7f762b480640 10 monclient: _finish_auth 0 2023-10-05T11:41:37.619 INFO:tasks.workunit.client.0.smithi012.stderr: -323> 2023-10-05T11:41:37.525+0000 7f762b480640 10 monclient: _check_auth_tickets 2023-10-05T11:41:37.619 INFO:tasks.workunit.client.0.smithi012.stderr: -322> 2023-10-05T11:41:37.525+0000 7f762b480640 10 monclient: handle_config config(0 keys) v1 2023-10-05T11:41:37.619 INFO:tasks.workunit.client.0.smithi012.stderr: -321> 2023-10-05T11:41:37.525+0000 7f762b480640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-10-05T11:41:37.619 INFO:tasks.workunit.client.0.smithi012.stderr: -320> 2023-10-05T11:41:37.525+0000 7f762b480640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-10-05T11:41:37.619 INFO:tasks.workunit.client.0.smithi012.stderr: -319> 2023-10-05T11:41:37.525+0000 7f762b480640 10 monclient: dump: 2023-10-05T11:41:37.619 INFO:tasks.workunit.client.0.smithi012.stderr:epoch 1 2023-10-05T11:41:37.619 INFO:tasks.workunit.client.0.smithi012.stderr:fsid 7e015f46-293b-4b09-bd32-7d32b52f6e2f 2023-10-05T11:41:37.619 INFO:tasks.workunit.client.0.smithi012.stderr:last_changed 2023-10-05T11:27:38.366888+0000 2023-10-05T11:41:37.620 INFO:tasks.workunit.client.0.smithi012.stderr:created 2023-10-05T11:27:38.366888+0000 2023-10-05T11:41:37.620 INFO:tasks.workunit.client.0.smithi012.stderr:min_mon_release 18 (reef) 2023-10-05T11:41:37.620 INFO:tasks.workunit.client.0.smithi012.stderr:election_strategy: 1 2023-10-05T11:41:37.620 INFO:tasks.workunit.client.0.smithi012.stderr:0: [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon.a 2023-10-05T11:41:37.620 INFO:tasks.workunit.client.0.smithi012.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2023-10-05T11:41:37.620 INFO:tasks.workunit.client.0.smithi012.stderr:2: [v2:172.21.15.12:3301/0,v1:172.21.15.12:6790/0] mon.c 2023-10-05T11:41:37.620 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:41:37.620 INFO:tasks.workunit.client.0.smithi012.stderr: -318> 2023-10-05T11:41:37.525+0000 7f762cc83640 4 set_mon_vals no callback set 2023-10-05T11:41:37.620 INFO:tasks.workunit.client.0.smithi012.stderr: -317> 2023-10-05T11:41:37.525+0000 7f7636013880 5 monclient: authenticate success, global_id 6968 2023-10-05T11:41:37.621 INFO:tasks.workunit.client.0.smithi012.stderr: -316> 2023-10-05T11:41:37.525+0000 7f7636013880 10 monclient: _renew_subs 2023-10-05T11:41:37.621 INFO:tasks.workunit.client.0.smithi012.stderr: -315> 2023-10-05T11:41:37.525+0000 7f7636013880 10 monclient: _send_mon_message to mon.c at v2:172.21.15.12:3301/0 2023-10-05T11:41:37.621 INFO:tasks.workunit.client.0.smithi012.stderr: -314> 2023-10-05T11:41:37.525+0000 7f7636013880 10 monclient: _renew_subs 2023-10-05T11:41:37.621 INFO:tasks.workunit.client.0.smithi012.stderr: -313> 2023-10-05T11:41:37.525+0000 7f7636013880 10 monclient: _send_mon_message to mon.c at v2:172.21.15.12:3301/0 2023-10-05T11:41:37.621 INFO:tasks.workunit.client.0.smithi012.stderr: -312> 2023-10-05T11:41:37.525+0000 7f7636013880 1 librados: init done 2023-10-05T11:41:37.621 INFO:tasks.workunit.client.0.smithi012.stderr: -311> 2023-10-05T11:41:37.526+0000 7f7636013880 20 rados->read ofs=0 len=0 2023-10-05T11:41:37.621 INFO:tasks.workunit.client.0.smithi012.stderr: -310> 2023-10-05T11:41:37.527+0000 7f762b480640 4 mgrc handle_mgr_map Got map version 5 2023-10-05T11:41:37.621 INFO:tasks.workunit.client.0.smithi012.stderr: -309> 2023-10-05T11:41:37.527+0000 7f762b480640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.170:6832/180516904,v1:172.21.15.170:6833/180516904] 2023-10-05T11:41:37.621 INFO:tasks.workunit.client.0.smithi012.stderr: -308> 2023-10-05T11:41:37.527+0000 7f762b480640 4 mgrc reconnect Starting new session with [v2:172.21.15.170:6832/180516904,v1:172.21.15.170:6833/180516904] 2023-10-05T11:41:37.621 INFO:tasks.workunit.client.0.smithi012.stderr: -307> 2023-10-05T11:41:37.527+0000 7f763248e640 10 monclient: get_auth_request con 0x5613435c6000 auth_method 0 2023-10-05T11:41:37.621 INFO:tasks.workunit.client.0.smithi012.stderr: -306> 2023-10-05T11:41:37.527+0000 7f7632c8f640 10 monclient: get_auth_request con 0x561344037400 auth_method 0 2023-10-05T11:41:37.621 INFO:tasks.workunit.client.0.smithi012.stderr: -305> 2023-10-05T11:41:37.528+0000 7f7636013880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:37.622 INFO:tasks.workunit.client.0.smithi012.stderr: -304> 2023-10-05T11:41:37.528+0000 7f7636013880 20 realm 2023-10-05T11:41:37.622 INFO:tasks.workunit.client.0.smithi012.stderr: -303> 2023-10-05T11:41:37.528+0000 7f7636013880 20 rados->read ofs=0 len=0 2023-10-05T11:41:37.622 INFO:tasks.workunit.client.0.smithi012.stderr: -302> 2023-10-05T11:41:37.528+0000 7f7636013880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:37.622 INFO:tasks.workunit.client.0.smithi012.stderr: -301> 2023-10-05T11:41:37.528+0000 7f7636013880 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T11:41:37.622 INFO:tasks.workunit.client.0.smithi012.stderr: -300> 2023-10-05T11:41:37.528+0000 7f7636013880 20 rados->read ofs=0 len=0 2023-10-05T11:41:37.622 INFO:tasks.workunit.client.0.smithi012.stderr: -299> 2023-10-05T11:41:37.528+0000 7f7636013880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:37.622 INFO:tasks.workunit.client.0.smithi012.stderr: -298> 2023-10-05T11:41:37.528+0000 7f7636013880 20 rados->read ofs=0 len=0 2023-10-05T11:41:37.622 INFO:tasks.workunit.client.0.smithi012.stderr: -297> 2023-10-05T11:41:37.529+0000 7f763248e640 10 monclient: get_auth_request con 0x561344037800 auth_method 0 2023-10-05T11:41:37.622 INFO:tasks.workunit.client.0.smithi012.stderr: -296> 2023-10-05T11:41:37.529+0000 7f7636013880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:41:37.622 INFO:tasks.workunit.client.0.smithi012.stderr: -295> 2023-10-05T11:41:37.529+0000 7f7636013880 20 rados->read ofs=0 len=0 2023-10-05T11:41:37.622 INFO:tasks.workunit.client.0.smithi012.stderr: -294> 2023-10-05T11:41:37.529+0000 7f7631c8d640 10 monclient: get_auth_request con 0x5613435c7000 auth_method 0 2023-10-05T11:41:37.623 INFO:tasks.workunit.client.0.smithi012.stderr: -293> 2023-10-05T11:41:37.530+0000 7f7636013880 20 rados_obj.operate() r=0 bl.length=1020 2023-10-05T11:41:37.623 INFO:tasks.workunit.client.0.smithi012.stderr: -292> 2023-10-05T11:41:37.530+0000 7f7636013880 20 searching for the correct realm 2023-10-05T11:41:37.623 INFO:tasks.workunit.client.0.smithi012.stderr: -291> 2023-10-05T11:41:37.530+0000 7f7632c8f640 10 monclient: get_auth_request con 0x5613435c7400 auth_method 0 2023-10-05T11:41:37.623 INFO:tasks.workunit.client.0.smithi012.stderr: -290> 2023-10-05T11:41:37.531+0000 7f763248e640 10 monclient: get_auth_request con 0x561343505000 auth_method 0 2023-10-05T11:41:37.623 INFO:tasks.workunit.client.0.smithi012.stderr: -289> 2023-10-05T11:41:37.532+0000 7f7631c8d640 10 monclient: get_auth_request con 0x5613435c6800 auth_method 0 2023-10-05T11:41:37.623 INFO:tasks.workunit.client.0.smithi012.stderr: -288> 2023-10-05T11:41:37.534+0000 7f7632c8f640 10 monclient: get_auth_request con 0x561343505400 auth_method 0 2023-10-05T11:41:37.623 INFO:tasks.workunit.client.0.smithi012.stderr: -287> 2023-10-05T11:41:37.536+0000 7f763248e640 10 monclient: get_auth_request con 0x561343505800 auth_method 0 2023-10-05T11:41:37.623 INFO:tasks.workunit.client.0.smithi012.stderr: -286> 2023-10-05T11:41:37.539+0000 7f763248e640 0 -- 172.21.15.12:0/3739624321 >> [v2:172.21.15.12:6800/732466381,v1:172.21.15.12:6801/732466381] conn(0x561343505000 msgr2=0x5613435cac00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-10-05T11:41:37.623 INFO:tasks.workunit.client.0.smithi012.stderr: -285> 2023-10-05T11:41:37.539+0000 7f762b480640 1 client.6968.objecter ms_handle_reset 0x561343505000 session 0x56134350e180 osd.2 2023-10-05T11:41:37.623 INFO:tasks.workunit.client.0.smithi012.stderr: -284> 2023-10-05T11:41:37.539+0000 7f762b480640 10 monclient: _renew_subs 2023-10-05T11:41:37.623 INFO:tasks.workunit.client.0.smithi012.stderr: -283> 2023-10-05T11:41:37.539+0000 7f762b480640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.12:3301/0 2023-10-05T11:41:37.624 INFO:tasks.workunit.client.0.smithi012.stderr: -282> 2023-10-05T11:41:37.539+0000 7f763248e640 10 monclient: get_auth_request con 0x561343606000 auth_method 0 2023-10-05T11:41:37.624 INFO:tasks.workunit.client.0.smithi012.stderr: -281> 2023-10-05T11:41:37.540+0000 7f7636013880 20 RGWRados::pool_iterate: got zone_info.dff27d1e-df33-400e-a68a-7ba586947c99 2023-10-05T11:41:37.624 INFO:tasks.workunit.client.0.smithi012.stderr: -280> 2023-10-05T11:41:37.540+0000 7f7636013880 20 RGWRados::pool_iterate: got zonegroup_info.c78aa576-9d15-4e9d-b3c0-4af23a22062c 2023-10-05T11:41:37.624 INFO:tasks.workunit.client.0.smithi012.stderr: -279> 2023-10-05T11:41:37.540+0000 7f7636013880 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T11:41:37.624 INFO:tasks.workunit.client.0.smithi012.stderr: -278> 2023-10-05T11:41:37.540+0000 7f7636013880 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T11:41:37.624 INFO:tasks.workunit.client.0.smithi012.stderr: -277> 2023-10-05T11:41:37.540+0000 7f7636013880 20 rados->read ofs=0 len=0 2023-10-05T11:41:37.624 INFO:tasks.workunit.client.0.smithi012.stderr: -276> 2023-10-05T11:41:37.541+0000 7f7636013880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:37.624 INFO:tasks.workunit.client.0.smithi012.stderr: -275> 2023-10-05T11:41:37.541+0000 7f7636013880 20 rados->read ofs=0 len=0 2023-10-05T11:41:37.624 INFO:tasks.workunit.client.0.smithi012.stderr: -274> 2023-10-05T11:41:37.541+0000 7f7636013880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:41:37.624 INFO:tasks.workunit.client.0.smithi012.stderr: -273> 2023-10-05T11:41:37.541+0000 7f7636013880 20 rados->read ofs=0 len=0 2023-10-05T11:41:37.624 INFO:tasks.workunit.client.0.smithi012.stderr: -272> 2023-10-05T11:41:37.541+0000 7f7636013880 20 rados_obj.operate() r=0 bl.length=454 2023-10-05T11:41:37.624 INFO:tasks.workunit.client.0.smithi012.stderr: -271> 2023-10-05T11:41:37.541+0000 7f7636013880 20 zone default found 2023-10-05T11:41:37.625 INFO:tasks.workunit.client.0.smithi012.stderr: -270> 2023-10-05T11:41:37.541+0000 7f7636013880 4 Realm: () 2023-10-05T11:41:37.625 INFO:tasks.workunit.client.0.smithi012.stderr: -269> 2023-10-05T11:41:37.541+0000 7f7636013880 4 ZoneGroup: default (c78aa576-9d15-4e9d-b3c0-4af23a22062c) 2023-10-05T11:41:37.625 INFO:tasks.workunit.client.0.smithi012.stderr: -268> 2023-10-05T11:41:37.541+0000 7f7636013880 4 Zone: default (dff27d1e-df33-400e-a68a-7ba586947c99) 2023-10-05T11:41:37.625 INFO:tasks.workunit.client.0.smithi012.stderr: -267> 2023-10-05T11:41:37.541+0000 7f7636013880 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T11:41:37.625 INFO:tasks.workunit.client.0.smithi012.stderr: -266> 2023-10-05T11:41:37.541+0000 7f7636013880 20 zonegroup default 2023-10-05T11:41:37.625 INFO:tasks.workunit.client.0.smithi012.stderr: -265> 2023-10-05T11:41:37.541+0000 7f7636013880 20 rados->read ofs=0 len=0 2023-10-05T11:41:37.625 INFO:tasks.workunit.client.0.smithi012.stderr: -264> 2023-10-05T11:41:37.541+0000 7f7636013880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:37.625 INFO:tasks.workunit.client.0.smithi012.stderr: -263> 2023-10-05T11:41:37.541+0000 7f7636013880 20 rados->read ofs=0 len=0 2023-10-05T11:41:37.625 INFO:tasks.workunit.client.0.smithi012.stderr: -262> 2023-10-05T11:41:37.542+0000 7f7636013880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:37.625 INFO:tasks.workunit.client.0.smithi012.stderr: -261> 2023-10-05T11:41:37.542+0000 7f7636013880 20 rados->read ofs=0 len=0 2023-10-05T11:41:37.625 INFO:tasks.workunit.client.0.smithi012.stderr: -260> 2023-10-05T11:41:37.542+0000 7f7636013880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:37.625 INFO:tasks.workunit.client.0.smithi012.stderr: -259> 2023-10-05T11:41:37.542+0000 7f7636013880 20 started sync module instance, tier type = 2023-10-05T11:41:37.626 INFO:tasks.workunit.client.0.smithi012.stderr: -258> 2023-10-05T11:41:37.542+0000 7f7636013880 20 started zone id=dff27d1e-df33-400e-a68a-7ba586947c99 (name=default) with tier type = 2023-10-05T11:41:37.626 INFO:tasks.workunit.client.0.smithi012.stderr: -257> 2023-10-05T11:41:37.547+0000 7f7632c8f640 0 -- 172.21.15.12:0/3739624321 >> [v2:172.21.15.170:6800/4137726411,v1:172.21.15.170:6801/4137726411] conn(0x561343505400 msgr2=0x5613435cb700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-10-05T11:41:37.626 INFO:tasks.workunit.client.0.smithi012.stderr: -256> 2023-10-05T11:41:37.547+0000 7f762b480640 1 client.6968.objecter ms_handle_reset 0x561343505400 session 0x56134350e600 osd.6 2023-10-05T11:41:37.626 INFO:tasks.workunit.client.0.smithi012.stderr: -255> 2023-10-05T11:41:37.547+0000 7f7632c8f640 10 monclient: get_auth_request con 0x561343505000 auth_method 0 2023-10-05T11:41:37.626 INFO:tasks.workunit.client.0.smithi012.stderr: -254> 2023-10-05T11:41:37.551+0000 7f7636013880 20 add_watcher() i=0 2023-10-05T11:41:37.626 INFO:tasks.workunit.client.0.smithi012.stderr: -253> 2023-10-05T11:41:37.551+0000 7f7636013880 20 add_watcher() i=1 2023-10-05T11:41:37.626 INFO:tasks.workunit.client.0.smithi012.stderr: -252> 2023-10-05T11:41:37.551+0000 7f7636013880 20 add_watcher() i=2 2023-10-05T11:41:37.626 INFO:tasks.workunit.client.0.smithi012.stderr: -251> 2023-10-05T11:41:37.551+0000 7f7636013880 20 add_watcher() i=3 2023-10-05T11:41:37.626 INFO:tasks.workunit.client.0.smithi012.stderr: -250> 2023-10-05T11:41:37.551+0000 7f7636013880 20 add_watcher() i=4 2023-10-05T11:41:37.626 INFO:tasks.workunit.client.0.smithi012.stderr: -249> 2023-10-05T11:41:37.551+0000 7f7636013880 20 add_watcher() i=5 2023-10-05T11:41:37.626 INFO:tasks.workunit.client.0.smithi012.stderr: -248> 2023-10-05T11:41:37.551+0000 7f7636013880 20 add_watcher() i=6 2023-10-05T11:41:37.627 INFO:tasks.workunit.client.0.smithi012.stderr: -247> 2023-10-05T11:41:37.552+0000 7f7636013880 20 add_watcher() i=7 2023-10-05T11:41:37.627 INFO:tasks.workunit.client.0.smithi012.stderr: -246> 2023-10-05T11:41:37.552+0000 7f7636013880 2 all 8 watchers are set, enabling cache 2023-10-05T11:41:37.627 INFO:tasks.workunit.client.0.smithi012.stderr: -245> 2023-10-05T11:41:37.554+0000 7f7636013880 5 AuthRegistry(0x7fff98e530e0) adding auth protocol: cephx 2023-10-05T11:41:37.627 INFO:tasks.workunit.client.0.smithi012.stderr: -244> 2023-10-05T11:41:37.554+0000 7f7636013880 5 AuthRegistry(0x7fff98e530e0) adding auth protocol: cephx 2023-10-05T11:41:37.627 INFO:tasks.workunit.client.0.smithi012.stderr: -243> 2023-10-05T11:41:37.554+0000 7f7636013880 5 AuthRegistry(0x7fff98e530e0) adding auth protocol: cephx 2023-10-05T11:41:37.628 INFO:tasks.workunit.client.0.smithi012.stderr: -242> 2023-10-05T11:41:37.554+0000 7f7636013880 5 AuthRegistry(0x7fff98e530e0) adding con mode: secure 2023-10-05T11:41:37.628 INFO:tasks.workunit.client.0.smithi012.stderr: -241> 2023-10-05T11:41:37.554+0000 7f7636013880 5 AuthRegistry(0x7fff98e530e0) adding con mode: crc 2023-10-05T11:41:37.628 INFO:tasks.workunit.client.0.smithi012.stderr: -240> 2023-10-05T11:41:37.554+0000 7f7636013880 5 AuthRegistry(0x7fff98e530e0) adding con mode: secure 2023-10-05T11:41:37.628 INFO:tasks.workunit.client.0.smithi012.stderr: -239> 2023-10-05T11:41:37.554+0000 7f7636013880 5 AuthRegistry(0x7fff98e530e0) adding con mode: crc 2023-10-05T11:41:37.628 INFO:tasks.workunit.client.0.smithi012.stderr: -238> 2023-10-05T11:41:37.554+0000 7f761945c640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:41:37.628 INFO:tasks.workunit.client.0.smithi012.stderr: -237> 2023-10-05T11:41:37.554+0000 7f7636013880 5 AuthRegistry(0x7fff98e530e0) adding con mode: secure 2023-10-05T11:41:37.628 INFO:tasks.workunit.client.0.smithi012.stderr: -236> 2023-10-05T11:41:37.554+0000 7f7636013880 5 AuthRegistry(0x7fff98e530e0) adding con mode: crc 2023-10-05T11:41:37.628 INFO:tasks.workunit.client.0.smithi012.stderr: -235> 2023-10-05T11:41:37.554+0000 7f7636013880 5 AuthRegistry(0x7fff98e530e0) adding con mode: crc 2023-10-05T11:41:37.628 INFO:tasks.workunit.client.0.smithi012.stderr: -234> 2023-10-05T11:41:37.554+0000 7f7636013880 5 AuthRegistry(0x7fff98e530e0) adding con mode: secure 2023-10-05T11:41:37.628 INFO:tasks.workunit.client.0.smithi012.stderr: -233> 2023-10-05T11:41:37.554+0000 7f7636013880 5 AuthRegistry(0x7fff98e530e0) adding con mode: crc 2023-10-05T11:41:37.628 INFO:tasks.workunit.client.0.smithi012.stderr: -232> 2023-10-05T11:41:37.554+0000 7f7636013880 5 AuthRegistry(0x7fff98e530e0) adding con mode: secure 2023-10-05T11:41:37.629 INFO:tasks.workunit.client.0.smithi012.stderr: -231> 2023-10-05T11:41:37.554+0000 7f7636013880 5 AuthRegistry(0x7fff98e530e0) adding con mode: crc 2023-10-05T11:41:37.629 INFO:tasks.workunit.client.0.smithi012.stderr: -230> 2023-10-05T11:41:37.554+0000 7f7636013880 5 AuthRegistry(0x7fff98e530e0) adding con mode: secure 2023-10-05T11:41:37.629 INFO:tasks.workunit.client.0.smithi012.stderr: -229> 2023-10-05T11:41:37.554+0000 7f7636013880 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-10-05T11:41:37.629 INFO:tasks.workunit.client.0.smithi012.stderr: -228> 2023-10-05T11:41:37.554+0000 7f7636013880 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T11:41:37.629 INFO:tasks.workunit.client.0.smithi012.stderr: -227> 2023-10-05T11:41:37.554+0000 7f7636013880 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T11:41:37.629 INFO:tasks.workunit.client.0.smithi012.stderr: -226> 2023-10-05T11:41:37.554+0000 7f7636013880 5 asok(0x561343438000) register_command cache list hook 0x561343f49480 2023-10-05T11:41:37.629 INFO:tasks.workunit.client.0.smithi012.stderr: -225> 2023-10-05T11:41:37.554+0000 7f7636013880 5 asok(0x561343438000) register_command cache inspect hook 0x561343f49480 2023-10-05T11:41:37.629 INFO:tasks.workunit.client.0.smithi012.stderr: -224> 2023-10-05T11:41:37.554+0000 7f7636013880 5 asok(0x561343438000) register_command cache erase hook 0x561343f49480 2023-10-05T11:41:37.629 INFO:tasks.workunit.client.0.smithi012.stderr: -223> 2023-10-05T11:41:37.554+0000 7f7636013880 5 asok(0x561343438000) register_command cache zap hook 0x561343f49480 2023-10-05T11:41:37.629 INFO:tasks.workunit.client.0.smithi012.stderr: -222> 2023-10-05T11:41:37.554+0000 7f7636013880 10 monclient: get_monmap_and_config 2023-10-05T11:41:37.629 INFO:tasks.workunit.client.0.smithi012.stderr: -221> 2023-10-05T11:41:37.554+0000 7f7636013880 10 monclient: build_initial_monmap 2023-10-05T11:41:37.629 INFO:tasks.workunit.client.0.smithi012.stderr: -220> 2023-10-05T11:41:37.554+0000 7f7636013880 1 build_initial for_mkfs: 0 2023-10-05T11:41:37.630 INFO:tasks.workunit.client.0.smithi012.stderr: -219> 2023-10-05T11:41:37.554+0000 7f7636013880 10 monclient: monmap: 2023-10-05T11:41:37.630 INFO:tasks.workunit.client.0.smithi012.stderr:epoch 0 2023-10-05T11:41:37.630 INFO:tasks.workunit.client.0.smithi012.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-10-05T11:41:37.630 INFO:tasks.workunit.client.0.smithi012.stderr:last_changed 0.000000 2023-10-05T11:41:37.630 INFO:tasks.workunit.client.0.smithi012.stderr:created 0.000000 2023-10-05T11:41:37.630 INFO:tasks.workunit.client.0.smithi012.stderr:min_mon_release 0 (unknown) 2023-10-05T11:41:37.630 INFO:tasks.workunit.client.0.smithi012.stderr:election_strategy: 1 2023-10-05T11:41:37.630 INFO:tasks.workunit.client.0.smithi012.stderr:0: [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon.noname-a 2023-10-05T11:41:37.630 INFO:tasks.workunit.client.0.smithi012.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.noname-b 2023-10-05T11:41:37.630 INFO:tasks.workunit.client.0.smithi012.stderr:2: [v2:172.21.15.12:3301/0,v1:172.21.15.12:6790/0] mon.noname-c 2023-10-05T11:41:37.631 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:41:37.631 INFO:tasks.workunit.client.0.smithi012.stderr: -218> 2023-10-05T11:41:37.554+0000 7f7636013880 5 AuthRegistry(0x561343ee9c40) adding auth protocol: cephx 2023-10-05T11:41:37.631 INFO:tasks.workunit.client.0.smithi012.stderr: -217> 2023-10-05T11:41:37.554+0000 7f7636013880 5 AuthRegistry(0x561343ee9c40) adding auth protocol: cephx 2023-10-05T11:41:37.631 INFO:tasks.workunit.client.0.smithi012.stderr: -216> 2023-10-05T11:41:37.554+0000 7f7636013880 5 AuthRegistry(0x561343ee9c40) adding auth protocol: cephx 2023-10-05T11:41:37.631 INFO:tasks.workunit.client.0.smithi012.stderr: -215> 2023-10-05T11:41:37.554+0000 7f7636013880 5 AuthRegistry(0x561343ee9c40) adding con mode: secure 2023-10-05T11:41:37.631 INFO:tasks.workunit.client.0.smithi012.stderr: -214> 2023-10-05T11:41:37.554+0000 7f7636013880 5 AuthRegistry(0x561343ee9c40) adding con mode: crc 2023-10-05T11:41:37.631 INFO:tasks.workunit.client.0.smithi012.stderr: -213> 2023-10-05T11:41:37.554+0000 7f7636013880 5 AuthRegistry(0x561343ee9c40) adding con mode: secure 2023-10-05T11:41:37.632 INFO:tasks.workunit.client.0.smithi012.stderr: -212> 2023-10-05T11:41:37.554+0000 7f7636013880 5 AuthRegistry(0x561343ee9c40) adding con mode: crc 2023-10-05T11:41:37.632 INFO:tasks.workunit.client.0.smithi012.stderr: -211> 2023-10-05T11:41:37.554+0000 7f7636013880 5 AuthRegistry(0x561343ee9c40) adding con mode: secure 2023-10-05T11:41:37.632 INFO:tasks.workunit.client.0.smithi012.stderr: -210> 2023-10-05T11:41:37.554+0000 7f7636013880 5 AuthRegistry(0x561343ee9c40) adding con mode: crc 2023-10-05T11:41:37.632 INFO:tasks.workunit.client.0.smithi012.stderr: -209> 2023-10-05T11:41:37.554+0000 7f7636013880 5 AuthRegistry(0x561343ee9c40) adding con mode: crc 2023-10-05T11:41:37.632 INFO:tasks.workunit.client.0.smithi012.stderr: -208> 2023-10-05T11:41:37.554+0000 7f7636013880 5 AuthRegistry(0x561343ee9c40) adding con mode: secure 2023-10-05T11:41:37.632 INFO:tasks.workunit.client.0.smithi012.stderr: -207> 2023-10-05T11:41:37.554+0000 7f7636013880 5 AuthRegistry(0x561343ee9c40) adding con mode: crc 2023-10-05T11:41:37.632 INFO:tasks.workunit.client.0.smithi012.stderr: -206> 2023-10-05T11:41:37.554+0000 7f7636013880 5 AuthRegistry(0x561343ee9c40) adding con mode: secure 2023-10-05T11:41:37.633 INFO:tasks.workunit.client.0.smithi012.stderr: -205> 2023-10-05T11:41:37.554+0000 7f7636013880 5 AuthRegistry(0x561343ee9c40) adding con mode: crc 2023-10-05T11:41:37.633 INFO:tasks.workunit.client.0.smithi012.stderr: -204> 2023-10-05T11:41:37.554+0000 7f7636013880 5 AuthRegistry(0x561343ee9c40) adding con mode: secure 2023-10-05T11:41:37.633 INFO:tasks.workunit.client.0.smithi012.stderr: -203> 2023-10-05T11:41:37.554+0000 7f7636013880 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-10-05T11:41:37.633 INFO:tasks.workunit.client.0.smithi012.stderr: -202> 2023-10-05T11:41:37.554+0000 7f7636013880 10 monclient: init 2023-10-05T11:41:37.633 INFO:tasks.workunit.client.0.smithi012.stderr: -201> 2023-10-05T11:41:37.554+0000 7f7636013880 5 AuthRegistry(0x7fff98e52c30) adding auth protocol: cephx 2023-10-05T11:41:37.633 INFO:tasks.workunit.client.0.smithi012.stderr: -200> 2023-10-05T11:41:37.554+0000 7f7636013880 5 AuthRegistry(0x7fff98e52c30) adding auth protocol: cephx 2023-10-05T11:41:37.634 INFO:tasks.workunit.client.0.smithi012.stderr: -199> 2023-10-05T11:41:37.554+0000 7f7636013880 5 AuthRegistry(0x7fff98e52c30) adding auth protocol: cephx 2023-10-05T11:41:37.634 INFO:tasks.workunit.client.0.smithi012.stderr: -198> 2023-10-05T11:41:37.554+0000 7f7636013880 5 AuthRegistry(0x7fff98e52c30) adding con mode: secure 2023-10-05T11:41:37.634 INFO:tasks.workunit.client.0.smithi012.stderr: -197> 2023-10-05T11:41:37.554+0000 7f7636013880 5 AuthRegistry(0x7fff98e52c30) adding con mode: crc 2023-10-05T11:41:37.634 INFO:tasks.workunit.client.0.smithi012.stderr: -196> 2023-10-05T11:41:37.554+0000 7f7636013880 5 AuthRegistry(0x7fff98e52c30) adding con mode: secure 2023-10-05T11:41:37.634 INFO:tasks.workunit.client.0.smithi012.stderr: -195> 2023-10-05T11:41:37.554+0000 7f7636013880 5 AuthRegistry(0x7fff98e52c30) adding con mode: crc 2023-10-05T11:41:37.634 INFO:tasks.workunit.client.0.smithi012.stderr: -194> 2023-10-05T11:41:37.554+0000 7f7636013880 5 AuthRegistry(0x7fff98e52c30) adding con mode: secure 2023-10-05T11:41:37.634 INFO:tasks.workunit.client.0.smithi012.stderr: -193> 2023-10-05T11:41:37.554+0000 7f7636013880 5 AuthRegistry(0x7fff98e52c30) adding con mode: crc 2023-10-05T11:41:37.634 INFO:tasks.workunit.client.0.smithi012.stderr: -192> 2023-10-05T11:41:37.554+0000 7f7636013880 5 AuthRegistry(0x7fff98e52c30) adding con mode: crc 2023-10-05T11:41:37.635 INFO:tasks.workunit.client.0.smithi012.stderr: -191> 2023-10-05T11:41:37.554+0000 7f7636013880 5 AuthRegistry(0x7fff98e52c30) adding con mode: secure 2023-10-05T11:41:37.635 INFO:tasks.workunit.client.0.smithi012.stderr: -190> 2023-10-05T11:41:37.554+0000 7f7636013880 5 AuthRegistry(0x7fff98e52c30) adding con mode: crc 2023-10-05T11:41:37.635 INFO:tasks.workunit.client.0.smithi012.stderr: -189> 2023-10-05T11:41:37.554+0000 7f7636013880 5 AuthRegistry(0x7fff98e52c30) adding con mode: secure 2023-10-05T11:41:37.635 INFO:tasks.workunit.client.0.smithi012.stderr: -188> 2023-10-05T11:41:37.554+0000 7f7636013880 5 AuthRegistry(0x7fff98e52c30) adding con mode: crc 2023-10-05T11:41:37.635 INFO:tasks.workunit.client.0.smithi012.stderr: -187> 2023-10-05T11:41:37.554+0000 7f7636013880 5 AuthRegistry(0x7fff98e52c30) adding con mode: secure 2023-10-05T11:41:37.635 INFO:tasks.workunit.client.0.smithi012.stderr: -186> 2023-10-05T11:41:37.555+0000 7f7636013880 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-10-05T11:41:37.635 INFO:tasks.workunit.client.0.smithi012.stderr: -185> 2023-10-05T11:41:37.555+0000 7f7636013880 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-10-05T11:41:37.635 INFO:tasks.workunit.client.0.smithi012.stderr: -184> 2023-10-05T11:41:37.555+0000 7f7636013880 5 asok(0x561343438000) register_command rotate-key cmddesc rotate-key hook 0x7fff98e52d78 EEXIST 2023-10-05T11:41:37.636 INFO:tasks.workunit.client.0.smithi012.stderr: -183> 2023-10-05T11:41:37.555+0000 7f7636013880 10 monclient: _reopen_session rank -1 2023-10-05T11:41:37.636 INFO:tasks.workunit.client.0.smithi012.stderr: -182> 2023-10-05T11:41:37.555+0000 7f7636013880 10 monclient: _add_conns ranks=[0,2,1] 2023-10-05T11:41:37.636 INFO:tasks.workunit.client.0.smithi012.stderr: -181> 2023-10-05T11:41:37.555+0000 7f7636013880 10 monclient(hunting): picked mon.noname-a con 0x561343616800 addr [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] 2023-10-05T11:41:37.636 INFO:tasks.workunit.client.0.smithi012.stderr: -180> 2023-10-05T11:41:37.555+0000 7f7636013880 10 monclient(hunting): picked mon.noname-c con 0x561343616c00 addr [v2:172.21.15.12:3301/0,v1:172.21.15.12:6790/0] 2023-10-05T11:41:37.636 INFO:tasks.workunit.client.0.smithi012.stderr: -179> 2023-10-05T11:41:37.555+0000 7f7636013880 10 monclient(hunting): picked mon.noname-b con 0x561343617000 addr [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] 2023-10-05T11:41:37.636 INFO:tasks.workunit.client.0.smithi012.stderr: -178> 2023-10-05T11:41:37.555+0000 7f7636013880 10 monclient(hunting): start opening mon connection 2023-10-05T11:41:37.636 INFO:tasks.workunit.client.0.smithi012.stderr: -177> 2023-10-05T11:41:37.555+0000 7f7636013880 10 monclient(hunting): start opening mon connection 2023-10-05T11:41:37.636 INFO:tasks.workunit.client.0.smithi012.stderr: -176> 2023-10-05T11:41:37.555+0000 7f7636013880 10 monclient(hunting): start opening mon connection 2023-10-05T11:41:37.637 INFO:tasks.workunit.client.0.smithi012.stderr: -175> 2023-10-05T11:41:37.555+0000 7f7636013880 10 monclient(hunting): _renew_subs 2023-10-05T11:41:37.637 INFO:tasks.workunit.client.0.smithi012.stderr: -174> 2023-10-05T11:41:37.555+0000 7f7636013880 10 monclient(hunting): authenticate will time out at 1605.722824s 2023-10-05T11:41:37.637 INFO:tasks.workunit.client.0.smithi012.stderr: -173> 2023-10-05T11:41:37.555+0000 7f7632c8f640 10 monclient(hunting): get_auth_request con 0x561343616800 auth_method 0 2023-10-05T11:41:37.637 INFO:tasks.workunit.client.0.smithi012.stderr: -172> 2023-10-05T11:41:37.555+0000 7f7632c8f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-10-05T11:41:37.637 INFO:tasks.workunit.client.0.smithi012.stderr: -171> 2023-10-05T11:41:37.555+0000 7f7632c8f640 10 monclient(hunting): _init_auth method 2 2023-10-05T11:41:37.637 INFO:tasks.workunit.client.0.smithi012.stderr: -170> 2023-10-05T11:41:37.555+0000 7f7632c8f640 10 monclient(hunting): _init_auth creating new auth 2023-10-05T11:41:37.638 INFO:tasks.workunit.client.0.smithi012.stderr: -169> 2023-10-05T11:41:37.555+0000 7f763248e640 10 monclient(hunting): get_auth_request con 0x561343616c00 auth_method 0 2023-10-05T11:41:37.638 INFO:tasks.workunit.client.0.smithi012.stderr: -168> 2023-10-05T11:41:37.555+0000 7f763248e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-10-05T11:41:37.638 INFO:tasks.workunit.client.0.smithi012.stderr: -167> 2023-10-05T11:41:37.555+0000 7f763248e640 10 monclient(hunting): _init_auth method 2 2023-10-05T11:41:37.638 INFO:tasks.workunit.client.0.smithi012.stderr: -166> 2023-10-05T11:41:37.555+0000 7f763248e640 10 monclient(hunting): _init_auth creating new auth 2023-10-05T11:41:37.638 INFO:tasks.workunit.client.0.smithi012.stderr: -165> 2023-10-05T11:41:37.555+0000 7f7631c8d640 10 monclient(hunting): get_auth_request con 0x561343617000 auth_method 0 2023-10-05T11:41:37.638 INFO:tasks.workunit.client.0.smithi012.stderr: -164> 2023-10-05T11:41:37.555+0000 7f7631c8d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-10-05T11:41:37.638 INFO:tasks.workunit.client.0.smithi012.stderr: -163> 2023-10-05T11:41:37.555+0000 7f7631c8d640 10 monclient(hunting): _init_auth method 2 2023-10-05T11:41:37.638 INFO:tasks.workunit.client.0.smithi012.stderr: -162> 2023-10-05T11:41:37.555+0000 7f7631c8d640 10 monclient(hunting): _init_auth creating new auth 2023-10-05T11:41:37.639 INFO:tasks.workunit.client.0.smithi012.stderr: -161> 2023-10-05T11:41:37.555+0000 7f7632c8f640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-10-05T11:41:37.639 INFO:tasks.workunit.client.0.smithi012.stderr: -160> 2023-10-05T11:41:37.555+0000 7f7632c8f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-10-05T11:41:37.639 INFO:tasks.workunit.client.0.smithi012.stderr: -159> 2023-10-05T11:41:37.555+0000 7f7632c8f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-10-05T11:41:37.639 INFO:tasks.workunit.client.0.smithi012.stderr: -158> 2023-10-05T11:41:37.555+0000 7f763248e640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-10-05T11:41:37.639 INFO:tasks.workunit.client.0.smithi012.stderr: -157> 2023-10-05T11:41:37.555+0000 7f763248e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-10-05T11:41:37.639 INFO:tasks.workunit.client.0.smithi012.stderr: -156> 2023-10-05T11:41:37.555+0000 7f763248e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-10-05T11:41:37.639 INFO:tasks.workunit.client.0.smithi012.stderr: -155> 2023-10-05T11:41:37.555+0000 7f7631c8d640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-10-05T11:41:37.639 INFO:tasks.workunit.client.0.smithi012.stderr: -154> 2023-10-05T11:41:37.555+0000 7f7631c8d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-10-05T11:41:37.639 INFO:tasks.workunit.client.0.smithi012.stderr: -153> 2023-10-05T11:41:37.555+0000 7f7631c8d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-10-05T11:41:37.639 INFO:tasks.workunit.client.0.smithi012.stderr: -152> 2023-10-05T11:41:37.555+0000 7f763248e640 10 monclient(hunting): handle_auth_done global_id 6971 payload 274 2023-10-05T11:41:37.639 INFO:tasks.workunit.client.0.smithi012.stderr: -151> 2023-10-05T11:41:37.555+0000 7f763248e640 10 monclient: _finish_hunting 0 2023-10-05T11:41:37.639 INFO:tasks.workunit.client.0.smithi012.stderr: -150> 2023-10-05T11:41:37.555+0000 7f763248e640 1 monclient: found mon.noname-c 2023-10-05T11:41:37.640 INFO:tasks.workunit.client.0.smithi012.stderr: -149> 2023-10-05T11:41:37.555+0000 7f763248e640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.12:3301/0 2023-10-05T11:41:37.640 INFO:tasks.workunit.client.0.smithi012.stderr: -148> 2023-10-05T11:41:37.556+0000 7f7618c5b640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-10-05T11:41:37.640 INFO:tasks.workunit.client.0.smithi012.stderr: -147> 2023-10-05T11:41:37.556+0000 7f7618c5b640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2023-10-05T11:41:37.640 INFO:tasks.workunit.client.0.smithi012.stderr: -146> 2023-10-05T11:41:37.556+0000 7f7618c5b640 10 monclient: dump: 2023-10-05T11:41:37.640 INFO:tasks.workunit.client.0.smithi012.stderr:epoch 1 2023-10-05T11:41:37.640 INFO:tasks.workunit.client.0.smithi012.stderr:fsid 7e015f46-293b-4b09-bd32-7d32b52f6e2f 2023-10-05T11:41:37.640 INFO:tasks.workunit.client.0.smithi012.stderr:last_changed 2023-10-05T11:27:38.366888+0000 2023-10-05T11:41:37.640 INFO:tasks.workunit.client.0.smithi012.stderr:created 2023-10-05T11:27:38.366888+0000 2023-10-05T11:41:37.640 INFO:tasks.workunit.client.0.smithi012.stderr:min_mon_release 18 (reef) 2023-10-05T11:41:37.641 INFO:tasks.workunit.client.0.smithi012.stderr:election_strategy: 1 2023-10-05T11:41:37.641 INFO:tasks.workunit.client.0.smithi012.stderr:0: [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon.a 2023-10-05T11:41:37.641 INFO:tasks.workunit.client.0.smithi012.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2023-10-05T11:41:37.641 INFO:tasks.workunit.client.0.smithi012.stderr:2: [v2:172.21.15.12:3301/0,v1:172.21.15.12:6790/0] mon.c 2023-10-05T11:41:37.641 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:41:37.641 INFO:tasks.workunit.client.0.smithi012.stderr: -145> 2023-10-05T11:41:37.556+0000 7f7618c5b640 10 monclient: _finish_auth 0 2023-10-05T11:41:37.641 INFO:tasks.workunit.client.0.smithi012.stderr: -144> 2023-10-05T11:41:37.556+0000 7f7618c5b640 10 monclient: _check_auth_tickets 2023-10-05T11:41:37.641 INFO:tasks.workunit.client.0.smithi012.stderr: -143> 2023-10-05T11:41:37.556+0000 7f7618c5b640 10 monclient: handle_config config(0 keys) v1 2023-10-05T11:41:37.641 INFO:tasks.workunit.client.0.smithi012.stderr: -142> 2023-10-05T11:41:37.556+0000 7f7618c5b640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-10-05T11:41:37.641 INFO:tasks.workunit.client.0.smithi012.stderr: -141> 2023-10-05T11:41:37.556+0000 7f7618c5b640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-10-05T11:41:37.641 INFO:tasks.workunit.client.0.smithi012.stderr: -140> 2023-10-05T11:41:37.556+0000 7f7618c5b640 10 monclient: dump: 2023-10-05T11:41:37.641 INFO:tasks.workunit.client.0.smithi012.stderr:epoch 1 2023-10-05T11:41:37.641 INFO:tasks.workunit.client.0.smithi012.stderr:fsid 7e015f46-293b-4b09-bd32-7d32b52f6e2f 2023-10-05T11:41:37.641 INFO:tasks.workunit.client.0.smithi012.stderr:last_changed 2023-10-05T11:27:38.366888+0000 2023-10-05T11:41:37.642 INFO:tasks.workunit.client.0.smithi012.stderr:created 2023-10-05T11:27:38.366888+0000 2023-10-05T11:41:37.642 INFO:tasks.workunit.client.0.smithi012.stderr:min_mon_release 18 (reef) 2023-10-05T11:41:37.642 INFO:tasks.workunit.client.0.smithi012.stderr:election_strategy: 1 2023-10-05T11:41:37.642 INFO:tasks.workunit.client.0.smithi012.stderr:0: [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon.a 2023-10-05T11:41:37.642 INFO:tasks.workunit.client.0.smithi012.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2023-10-05T11:41:37.642 INFO:tasks.workunit.client.0.smithi012.stderr:2: [v2:172.21.15.12:3301/0,v1:172.21.15.12:6790/0] mon.c 2023-10-05T11:41:37.642 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:41:37.642 INFO:tasks.workunit.client.0.smithi012.stderr: -139> 2023-10-05T11:41:37.556+0000 7f7636013880 5 monclient: authenticate success, global_id 6971 2023-10-05T11:41:37.642 INFO:tasks.workunit.client.0.smithi012.stderr: -138> 2023-10-05T11:41:37.556+0000 7f7636013880 10 monclient: get_monmap_and_config success 2023-10-05T11:41:37.642 INFO:tasks.workunit.client.0.smithi012.stderr: -137> 2023-10-05T11:41:37.556+0000 7f7636013880 4 set_mon_vals no callback set 2023-10-05T11:41:37.642 INFO:tasks.workunit.client.0.smithi012.stderr: -136> 2023-10-05T11:41:37.556+0000 7f7636013880 10 monclient: shutdown 2023-10-05T11:41:37.643 INFO:tasks.workunit.client.0.smithi012.stderr: -135> 2023-10-05T11:41:37.556+0000 7f7636013880 10 monclient: build_initial_monmap 2023-10-05T11:41:37.643 INFO:tasks.workunit.client.0.smithi012.stderr: -134> 2023-10-05T11:41:37.556+0000 7f7636013880 1 build_initial for_mkfs: 0 2023-10-05T11:41:37.643 INFO:tasks.workunit.client.0.smithi012.stderr: -133> 2023-10-05T11:41:37.556+0000 7f7636013880 10 monclient: monmap: 2023-10-05T11:41:37.643 INFO:tasks.workunit.client.0.smithi012.stderr:epoch 0 2023-10-05T11:41:37.643 INFO:tasks.workunit.client.0.smithi012.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-10-05T11:41:37.643 INFO:tasks.workunit.client.0.smithi012.stderr:last_changed 0.000000 2023-10-05T11:41:37.643 INFO:tasks.workunit.client.0.smithi012.stderr:created 0.000000 2023-10-05T11:41:37.643 INFO:tasks.workunit.client.0.smithi012.stderr:min_mon_release 0 (unknown) 2023-10-05T11:41:37.643 INFO:tasks.workunit.client.0.smithi012.stderr:election_strategy: 1 2023-10-05T11:41:37.643 INFO:tasks.workunit.client.0.smithi012.stderr:0: [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon.noname-a 2023-10-05T11:41:37.643 INFO:tasks.workunit.client.0.smithi012.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.noname-b 2023-10-05T11:41:37.644 INFO:tasks.workunit.client.0.smithi012.stderr:2: [v2:172.21.15.12:3301/0,v1:172.21.15.12:6790/0] mon.noname-c 2023-10-05T11:41:37.644 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:41:37.644 INFO:tasks.workunit.client.0.smithi012.stderr: -132> 2023-10-05T11:41:37.556+0000 7f7636013880 5 AuthRegistry(0x561343ee9c40) adding auth protocol: cephx 2023-10-05T11:41:37.644 INFO:tasks.workunit.client.0.smithi012.stderr: -131> 2023-10-05T11:41:37.556+0000 7f7636013880 5 AuthRegistry(0x561343ee9c40) adding auth protocol: cephx 2023-10-05T11:41:37.644 INFO:tasks.workunit.client.0.smithi012.stderr: -130> 2023-10-05T11:41:37.556+0000 7f7636013880 5 AuthRegistry(0x561343ee9c40) adding auth protocol: cephx 2023-10-05T11:41:37.644 INFO:tasks.workunit.client.0.smithi012.stderr: -129> 2023-10-05T11:41:37.556+0000 7f7636013880 5 AuthRegistry(0x561343ee9c40) adding con mode: secure 2023-10-05T11:41:37.644 INFO:tasks.workunit.client.0.smithi012.stderr: -128> 2023-10-05T11:41:37.556+0000 7f7636013880 5 AuthRegistry(0x561343ee9c40) adding con mode: crc 2023-10-05T11:41:37.644 INFO:tasks.workunit.client.0.smithi012.stderr: -127> 2023-10-05T11:41:37.556+0000 7f7636013880 5 AuthRegistry(0x561343ee9c40) adding con mode: secure 2023-10-05T11:41:37.644 INFO:tasks.workunit.client.0.smithi012.stderr: -126> 2023-10-05T11:41:37.556+0000 7f7636013880 5 AuthRegistry(0x561343ee9c40) adding con mode: crc 2023-10-05T11:41:37.644 INFO:tasks.workunit.client.0.smithi012.stderr: -125> 2023-10-05T11:41:37.556+0000 7f7636013880 5 AuthRegistry(0x561343ee9c40) adding con mode: secure 2023-10-05T11:41:37.644 INFO:tasks.workunit.client.0.smithi012.stderr: -124> 2023-10-05T11:41:37.556+0000 7f7636013880 5 AuthRegistry(0x561343ee9c40) adding con mode: crc 2023-10-05T11:41:37.644 INFO:tasks.workunit.client.0.smithi012.stderr: -123> 2023-10-05T11:41:37.556+0000 7f7636013880 5 AuthRegistry(0x561343ee9c40) adding con mode: crc 2023-10-05T11:41:37.645 INFO:tasks.workunit.client.0.smithi012.stderr: -122> 2023-10-05T11:41:37.556+0000 7f7636013880 5 AuthRegistry(0x561343ee9c40) adding con mode: secure 2023-10-05T11:41:37.645 INFO:tasks.workunit.client.0.smithi012.stderr: -121> 2023-10-05T11:41:37.556+0000 7f7636013880 5 AuthRegistry(0x561343ee9c40) adding con mode: crc 2023-10-05T11:41:37.645 INFO:tasks.workunit.client.0.smithi012.stderr: -120> 2023-10-05T11:41:37.556+0000 7f7636013880 5 AuthRegistry(0x561343ee9c40) adding con mode: secure 2023-10-05T11:41:37.645 INFO:tasks.workunit.client.0.smithi012.stderr: -119> 2023-10-05T11:41:37.556+0000 7f7636013880 5 AuthRegistry(0x561343ee9c40) adding con mode: crc 2023-10-05T11:41:37.645 INFO:tasks.workunit.client.0.smithi012.stderr: -118> 2023-10-05T11:41:37.556+0000 7f7636013880 5 AuthRegistry(0x561343ee9c40) adding con mode: secure 2023-10-05T11:41:37.645 INFO:tasks.workunit.client.0.smithi012.stderr: -117> 2023-10-05T11:41:37.557+0000 7f7636013880 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-10-05T11:41:37.645 INFO:tasks.workunit.client.0.smithi012.stderr: -116> 2023-10-05T11:41:37.557+0000 7f7636013880 1 librados: starting msgr at 2023-10-05T11:41:37.645 INFO:tasks.workunit.client.0.smithi012.stderr: -115> 2023-10-05T11:41:37.557+0000 7f7636013880 1 librados: starting objecter 2023-10-05T11:41:37.645 INFO:tasks.workunit.client.0.smithi012.stderr: -114> 2023-10-05T11:41:37.557+0000 7f7636013880 5 asok(0x561343438000) register_command objecter_requests cmddesc objecter_requests hook 0x561343f49c40 EEXIST 2023-10-05T11:41:37.645 INFO:tasks.workunit.client.0.smithi012.stderr: -113> 2023-10-05T11:41:37.557+0000 7f7636013880 1 librados: setting wanted keys 2023-10-05T11:41:37.645 INFO:tasks.workunit.client.0.smithi012.stderr: -112> 2023-10-05T11:41:37.557+0000 7f7636013880 1 librados: calling monclient init 2023-10-05T11:41:37.645 INFO:tasks.workunit.client.0.smithi012.stderr: -111> 2023-10-05T11:41:37.557+0000 7f7636013880 10 monclient: init 2023-10-05T11:41:37.645 INFO:tasks.workunit.client.0.smithi012.stderr: -110> 2023-10-05T11:41:37.557+0000 7f7636013880 5 AuthRegistry(0x56134362f0d8) adding auth protocol: cephx 2023-10-05T11:41:37.646 INFO:tasks.workunit.client.0.smithi012.stderr: -109> 2023-10-05T11:41:37.557+0000 7f7636013880 5 AuthRegistry(0x56134362f0d8) adding auth protocol: cephx 2023-10-05T11:41:37.646 INFO:tasks.workunit.client.0.smithi012.stderr: -108> 2023-10-05T11:41:37.557+0000 7f7636013880 5 AuthRegistry(0x56134362f0d8) adding auth protocol: cephx 2023-10-05T11:41:37.646 INFO:tasks.workunit.client.0.smithi012.stderr: -107> 2023-10-05T11:41:37.557+0000 7f7636013880 5 AuthRegistry(0x56134362f0d8) adding con mode: secure 2023-10-05T11:41:37.646 INFO:tasks.workunit.client.0.smithi012.stderr: -106> 2023-10-05T11:41:37.557+0000 7f7636013880 5 AuthRegistry(0x56134362f0d8) adding con mode: crc 2023-10-05T11:41:37.646 INFO:tasks.workunit.client.0.smithi012.stderr: -105> 2023-10-05T11:41:37.557+0000 7f7636013880 5 AuthRegistry(0x56134362f0d8) adding con mode: secure 2023-10-05T11:41:37.646 INFO:tasks.workunit.client.0.smithi012.stderr: -104> 2023-10-05T11:41:37.557+0000 7f7636013880 5 AuthRegistry(0x56134362f0d8) adding con mode: crc 2023-10-05T11:41:37.646 INFO:tasks.workunit.client.0.smithi012.stderr: -103> 2023-10-05T11:41:37.557+0000 7f7636013880 5 AuthRegistry(0x56134362f0d8) adding con mode: secure 2023-10-05T11:41:37.646 INFO:tasks.workunit.client.0.smithi012.stderr: -102> 2023-10-05T11:41:37.557+0000 7f7636013880 5 AuthRegistry(0x56134362f0d8) adding con mode: crc 2023-10-05T11:41:37.646 INFO:tasks.workunit.client.0.smithi012.stderr: -101> 2023-10-05T11:41:37.557+0000 7f7636013880 5 AuthRegistry(0x56134362f0d8) adding con mode: crc 2023-10-05T11:41:37.646 INFO:tasks.workunit.client.0.smithi012.stderr: -100> 2023-10-05T11:41:37.557+0000 7f7636013880 5 AuthRegistry(0x56134362f0d8) adding con mode: secure 2023-10-05T11:41:37.646 INFO:tasks.workunit.client.0.smithi012.stderr: -99> 2023-10-05T11:41:37.557+0000 7f7636013880 5 AuthRegistry(0x56134362f0d8) adding con mode: crc 2023-10-05T11:41:37.647 INFO:tasks.workunit.client.0.smithi012.stderr: -98> 2023-10-05T11:41:37.557+0000 7f7636013880 5 AuthRegistry(0x56134362f0d8) adding con mode: secure 2023-10-05T11:41:37.647 INFO:tasks.workunit.client.0.smithi012.stderr: -97> 2023-10-05T11:41:37.557+0000 7f7636013880 5 AuthRegistry(0x56134362f0d8) adding con mode: crc 2023-10-05T11:41:37.647 INFO:tasks.workunit.client.0.smithi012.stderr: -96> 2023-10-05T11:41:37.557+0000 7f7636013880 5 AuthRegistry(0x56134362f0d8) adding con mode: secure 2023-10-05T11:41:37.647 INFO:tasks.workunit.client.0.smithi012.stderr: -95> 2023-10-05T11:41:37.557+0000 7f7636013880 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-10-05T11:41:37.647 INFO:tasks.workunit.client.0.smithi012.stderr: -94> 2023-10-05T11:41:37.557+0000 7f7636013880 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-10-05T11:41:37.647 INFO:tasks.workunit.client.0.smithi012.stderr: -93> 2023-10-05T11:41:37.557+0000 7f7636013880 5 asok(0x561343438000) register_command rotate-key cmddesc rotate-key hook 0x56134362f220 EEXIST 2023-10-05T11:41:37.647 INFO:tasks.workunit.client.0.smithi012.stderr: -92> 2023-10-05T11:41:37.557+0000 7f7636013880 10 monclient: _reopen_session rank -1 2023-10-05T11:41:37.647 INFO:tasks.workunit.client.0.smithi012.stderr: -91> 2023-10-05T11:41:37.557+0000 7f7636013880 10 monclient: _add_conns ranks=[0,2,1] 2023-10-05T11:41:37.647 INFO:tasks.workunit.client.0.smithi012.stderr: -90> 2023-10-05T11:41:37.557+0000 7f7636013880 10 monclient(hunting): picked mon.noname-a con 0x561343616800 addr [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] 2023-10-05T11:41:37.647 INFO:tasks.workunit.client.0.smithi012.stderr: -89> 2023-10-05T11:41:37.557+0000 7f7636013880 10 monclient(hunting): picked mon.noname-c con 0x561343616c00 addr [v2:172.21.15.12:3301/0,v1:172.21.15.12:6790/0] 2023-10-05T11:41:37.647 INFO:tasks.workunit.client.0.smithi012.stderr: -88> 2023-10-05T11:41:37.557+0000 7f7636013880 10 monclient(hunting): picked mon.noname-b con 0x561343617000 addr [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] 2023-10-05T11:41:37.647 INFO:tasks.workunit.client.0.smithi012.stderr: -87> 2023-10-05T11:41:37.557+0000 7f7636013880 10 monclient(hunting): start opening mon connection 2023-10-05T11:41:37.648 INFO:tasks.workunit.client.0.smithi012.stderr: -86> 2023-10-05T11:41:37.557+0000 7f7636013880 10 monclient(hunting): start opening mon connection 2023-10-05T11:41:37.648 INFO:tasks.workunit.client.0.smithi012.stderr: -85> 2023-10-05T11:41:37.557+0000 7f7636013880 10 monclient(hunting): start opening mon connection 2023-10-05T11:41:37.648 INFO:tasks.workunit.client.0.smithi012.stderr: -84> 2023-10-05T11:41:37.557+0000 7f7636013880 10 monclient(hunting): _renew_subs 2023-10-05T11:41:37.648 INFO:tasks.workunit.client.0.smithi012.stderr: -83> 2023-10-05T11:41:37.557+0000 7f7636013880 10 monclient(hunting): authenticate will time out at 1605.725099s 2023-10-05T11:41:37.648 INFO:tasks.workunit.client.0.smithi012.stderr: -82> 2023-10-05T11:41:37.557+0000 7f7632c8f640 10 monclient(hunting): get_auth_request con 0x561343616800 auth_method 0 2023-10-05T11:41:37.648 INFO:tasks.workunit.client.0.smithi012.stderr: -81> 2023-10-05T11:41:37.557+0000 7f7632c8f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-10-05T11:41:37.648 INFO:tasks.workunit.client.0.smithi012.stderr: -80> 2023-10-05T11:41:37.557+0000 7f7632c8f640 10 monclient(hunting): _init_auth method 2 2023-10-05T11:41:37.648 INFO:tasks.workunit.client.0.smithi012.stderr: -79> 2023-10-05T11:41:37.557+0000 7f7632c8f640 10 monclient(hunting): _init_auth creating new auth 2023-10-05T11:41:37.648 INFO:tasks.workunit.client.0.smithi012.stderr: -78> 2023-10-05T11:41:37.557+0000 7f763248e640 10 monclient(hunting): get_auth_request con 0x561343616c00 auth_method 0 2023-10-05T11:41:37.648 INFO:tasks.workunit.client.0.smithi012.stderr: -77> 2023-10-05T11:41:37.557+0000 7f763248e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-10-05T11:41:37.648 INFO:tasks.workunit.client.0.smithi012.stderr: -76> 2023-10-05T11:41:37.557+0000 7f763248e640 10 monclient(hunting): _init_auth method 2 2023-10-05T11:41:37.648 INFO:tasks.workunit.client.0.smithi012.stderr: -75> 2023-10-05T11:41:37.557+0000 7f763248e640 10 monclient(hunting): _init_auth creating new auth 2023-10-05T11:41:37.649 INFO:tasks.workunit.client.0.smithi012.stderr: -74> 2023-10-05T11:41:37.557+0000 7f7631c8d640 10 monclient(hunting): get_auth_request con 0x561343617000 auth_method 0 2023-10-05T11:41:37.649 INFO:tasks.workunit.client.0.smithi012.stderr: -73> 2023-10-05T11:41:37.557+0000 7f7631c8d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-10-05T11:41:37.649 INFO:tasks.workunit.client.0.smithi012.stderr: -72> 2023-10-05T11:41:37.557+0000 7f7631c8d640 10 monclient(hunting): _init_auth method 2 2023-10-05T11:41:37.649 INFO:tasks.workunit.client.0.smithi012.stderr: -71> 2023-10-05T11:41:37.557+0000 7f7631c8d640 10 monclient(hunting): _init_auth creating new auth 2023-10-05T11:41:37.649 INFO:tasks.workunit.client.0.smithi012.stderr: -70> 2023-10-05T11:41:37.557+0000 7f7632c8f640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-10-05T11:41:37.649 INFO:tasks.workunit.client.0.smithi012.stderr: -69> 2023-10-05T11:41:37.557+0000 7f7632c8f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-10-05T11:41:37.649 INFO:tasks.workunit.client.0.smithi012.stderr: -68> 2023-10-05T11:41:37.557+0000 7f7632c8f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-10-05T11:41:37.649 INFO:tasks.workunit.client.0.smithi012.stderr: -67> 2023-10-05T11:41:37.557+0000 7f763248e640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-10-05T11:41:37.649 INFO:tasks.workunit.client.0.smithi012.stderr: -66> 2023-10-05T11:41:37.557+0000 7f763248e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-10-05T11:41:37.649 INFO:tasks.workunit.client.0.smithi012.stderr: -65> 2023-10-05T11:41:37.557+0000 7f763248e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-10-05T11:41:37.649 INFO:tasks.workunit.client.0.smithi012.stderr: -64> 2023-10-05T11:41:37.557+0000 7f7631c8d640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-10-05T11:41:37.649 INFO:tasks.workunit.client.0.smithi012.stderr: -63> 2023-10-05T11:41:37.557+0000 7f7631c8d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-10-05T11:41:37.650 INFO:tasks.workunit.client.0.smithi012.stderr: -62> 2023-10-05T11:41:37.557+0000 7f7631c8d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-10-05T11:41:37.650 INFO:tasks.workunit.client.0.smithi012.stderr: -61> 2023-10-05T11:41:37.558+0000 7f7632c8f640 10 monclient(hunting): handle_auth_done global_id 7365 payload 824 2023-10-05T11:41:37.650 INFO:tasks.workunit.client.0.smithi012.stderr: -60> 2023-10-05T11:41:37.558+0000 7f7632c8f640 10 monclient: _finish_hunting 0 2023-10-05T11:41:37.650 INFO:tasks.workunit.client.0.smithi012.stderr: -59> 2023-10-05T11:41:37.558+0000 7f7632c8f640 1 monclient: found mon.noname-a 2023-10-05T11:41:37.650 INFO:tasks.workunit.client.0.smithi012.stderr: -58> 2023-10-05T11:41:37.558+0000 7f7632c8f640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.12:3300/0 2023-10-05T11:41:37.650 INFO:tasks.workunit.client.0.smithi012.stderr: -57> 2023-10-05T11:41:37.558+0000 7f7617458640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-10-05T11:41:37.650 INFO:tasks.workunit.client.0.smithi012.stderr: -56> 2023-10-05T11:41:37.558+0000 7f7617458640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2023-10-05T11:41:37.650 INFO:tasks.workunit.client.0.smithi012.stderr: -55> 2023-10-05T11:41:37.558+0000 7f7617458640 10 monclient: dump: 2023-10-05T11:41:37.650 INFO:tasks.workunit.client.0.smithi012.stderr:epoch 1 2023-10-05T11:41:37.650 INFO:tasks.workunit.client.0.smithi012.stderr:fsid 7e015f46-293b-4b09-bd32-7d32b52f6e2f 2023-10-05T11:41:37.650 INFO:tasks.workunit.client.0.smithi012.stderr:last_changed 2023-10-05T11:27:38.366888+0000 2023-10-05T11:41:37.651 INFO:tasks.workunit.client.0.smithi012.stderr:created 2023-10-05T11:27:38.366888+0000 2023-10-05T11:41:37.651 INFO:tasks.workunit.client.0.smithi012.stderr:min_mon_release 18 (reef) 2023-10-05T11:41:37.651 INFO:tasks.workunit.client.0.smithi012.stderr:election_strategy: 1 2023-10-05T11:41:37.651 INFO:tasks.workunit.client.0.smithi012.stderr:0: [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon.a 2023-10-05T11:41:37.651 INFO:tasks.workunit.client.0.smithi012.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2023-10-05T11:41:37.651 INFO:tasks.workunit.client.0.smithi012.stderr:2: [v2:172.21.15.12:3301/0,v1:172.21.15.12:6790/0] mon.c 2023-10-05T11:41:37.651 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:41:37.651 INFO:tasks.workunit.client.0.smithi012.stderr: -54> 2023-10-05T11:41:37.558+0000 7f7617458640 10 monclient: _finish_auth 0 2023-10-05T11:41:37.651 INFO:tasks.workunit.client.0.smithi012.stderr: -53> 2023-10-05T11:41:37.558+0000 7f7617458640 10 monclient: _check_auth_tickets 2023-10-05T11:41:37.651 INFO:tasks.workunit.client.0.smithi012.stderr: -52> 2023-10-05T11:41:37.558+0000 7f7617458640 10 monclient: handle_config config(0 keys) v1 2023-10-05T11:41:37.651 INFO:tasks.workunit.client.0.smithi012.stderr: -51> 2023-10-05T11:41:37.558+0000 7f7617458640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-10-05T11:41:37.652 INFO:tasks.workunit.client.0.smithi012.stderr: -50> 2023-10-05T11:41:37.558+0000 7f7617458640 10 monclient: got monmap 1 from mon.a (according to old e1) 2023-10-05T11:41:37.652 INFO:tasks.workunit.client.0.smithi012.stderr: -49> 2023-10-05T11:41:37.558+0000 7f7618c5b640 4 set_mon_vals no callback set 2023-10-05T11:41:37.652 INFO:tasks.workunit.client.0.smithi012.stderr: -48> 2023-10-05T11:41:37.558+0000 7f7617458640 10 monclient: dump: 2023-10-05T11:41:37.652 INFO:tasks.workunit.client.0.smithi012.stderr:epoch 1 2023-10-05T11:41:37.652 INFO:tasks.workunit.client.0.smithi012.stderr:fsid 7e015f46-293b-4b09-bd32-7d32b52f6e2f 2023-10-05T11:41:37.652 INFO:tasks.workunit.client.0.smithi012.stderr:last_changed 2023-10-05T11:27:38.366888+0000 2023-10-05T11:41:37.652 INFO:tasks.workunit.client.0.smithi012.stderr:created 2023-10-05T11:27:38.366888+0000 2023-10-05T11:41:37.652 INFO:tasks.workunit.client.0.smithi012.stderr:min_mon_release 18 (reef) 2023-10-05T11:41:37.652 INFO:tasks.workunit.client.0.smithi012.stderr:election_strategy: 1 2023-10-05T11:41:37.652 INFO:tasks.workunit.client.0.smithi012.stderr:0: [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon.a 2023-10-05T11:41:37.653 INFO:tasks.workunit.client.0.smithi012.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2023-10-05T11:41:37.653 INFO:tasks.workunit.client.0.smithi012.stderr:2: [v2:172.21.15.12:3301/0,v1:172.21.15.12:6790/0] mon.c 2023-10-05T11:41:37.653 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:41:37.653 INFO:tasks.workunit.client.0.smithi012.stderr: -47> 2023-10-05T11:41:37.558+0000 7f7636013880 5 monclient: authenticate success, global_id 7365 2023-10-05T11:41:37.653 INFO:tasks.workunit.client.0.smithi012.stderr: -46> 2023-10-05T11:41:37.558+0000 7f7636013880 10 monclient: _renew_subs 2023-10-05T11:41:37.653 INFO:tasks.workunit.client.0.smithi012.stderr: -45> 2023-10-05T11:41:37.558+0000 7f7636013880 10 monclient: _send_mon_message to mon.a at v2:172.21.15.12:3300/0 2023-10-05T11:41:37.653 INFO:tasks.workunit.client.0.smithi012.stderr: -44> 2023-10-05T11:41:37.558+0000 7f7636013880 10 monclient: _renew_subs 2023-10-05T11:41:37.653 INFO:tasks.workunit.client.0.smithi012.stderr: -43> 2023-10-05T11:41:37.558+0000 7f7636013880 10 monclient: _send_mon_message to mon.a at v2:172.21.15.12:3300/0 2023-10-05T11:41:37.653 INFO:tasks.workunit.client.0.smithi012.stderr: -42> 2023-10-05T11:41:37.558+0000 7f7636013880 1 librados: init done 2023-10-05T11:41:37.653 INFO:tasks.workunit.client.0.smithi012.stderr: -41> 2023-10-05T11:41:37.558+0000 7f7636013880 5 asok(0x561343438000) register_command cr dump hook 0x5613440071f8 2023-10-05T11:41:37.653 INFO:tasks.workunit.client.0.smithi012.stderr: -40> 2023-10-05T11:41:37.559+0000 7f7617458640 4 mgrc handle_mgr_map Got map version 5 2023-10-05T11:41:37.653 INFO:tasks.workunit.client.0.smithi012.stderr: -39> 2023-10-05T11:41:37.559+0000 7f7617458640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.170:6832/180516904,v1:172.21.15.170:6833/180516904] 2023-10-05T11:41:37.654 INFO:tasks.workunit.client.0.smithi012.stderr: -38> 2023-10-05T11:41:37.559+0000 7f7617458640 4 mgrc reconnect Starting new session with [v2:172.21.15.170:6832/180516904,v1:172.21.15.170:6833/180516904] 2023-10-05T11:41:37.654 INFO:tasks.workunit.client.0.smithi012.stderr: -37> 2023-10-05T11:41:37.560+0000 7f7636013880 5 note: GC not initialized 2023-10-05T11:41:37.654 INFO:tasks.workunit.client.0.smithi012.stderr: -36> 2023-10-05T11:41:37.560+0000 7f7614c53640 20 reqs_thread_entry: start 2023-10-05T11:41:37.654 INFO:tasks.workunit.client.0.smithi012.stderr: -35> 2023-10-05T11:41:37.560+0000 7f763248e640 10 monclient: get_auth_request con 0x561343667000 auth_method 0 2023-10-05T11:41:37.654 INFO:tasks.workunit.client.0.smithi012.stderr: -34> 2023-10-05T11:41:37.560+0000 7f7636013880 5 asok(0x561343438000) register_command sync trace show hook 0x561343182a80 2023-10-05T11:41:37.654 INFO:tasks.workunit.client.0.smithi012.stderr: -33> 2023-10-05T11:41:37.560+0000 7f7636013880 5 asok(0x561343438000) register_command sync trace history hook 0x561343182a80 2023-10-05T11:41:37.654 INFO:tasks.workunit.client.0.smithi012.stderr: -32> 2023-10-05T11:41:37.560+0000 7f7636013880 5 asok(0x561343438000) register_command sync trace active hook 0x561343182a80 2023-10-05T11:41:37.654 INFO:tasks.workunit.client.0.smithi012.stderr: -31> 2023-10-05T11:41:37.560+0000 7f7636013880 5 asok(0x561343438000) register_command sync trace active_short hook 0x561343182a80 2023-10-05T11:41:37.654 INFO:tasks.workunit.client.0.smithi012.stderr: -30> 2023-10-05T11:41:37.560+0000 7f7636013880 20 init_complete bucket index max shards: 11 2023-10-05T11:41:37.654 INFO:tasks.workunit.client.0.smithi012.stderr: -29> 2023-10-05T11:41:37.560+0000 7f7636013880 20 Filter name: none 2023-10-05T11:41:37.654 INFO:tasks.workunit.client.0.smithi012.stderr: -28> 2023-10-05T11:41:37.560+0000 7f7612c4f640 20 reqs_thread_entry: start 2023-10-05T11:41:37.655 INFO:tasks.workunit.client.0.smithi012.stderr: -27> 2023-10-05T11:41:37.560+0000 7f7636013880 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2023-10-05T11:41:37.655 INFO:tasks.workunit.client.0.smithi012.stderr: -26> 2023-10-05T11:41:37.560+0000 7f7636013880 20 rados->read ofs=0 len=0 2023-10-05T11:41:37.655 INFO:tasks.workunit.client.0.smithi012.stderr: -25> 2023-10-05T11:41:37.560+0000 7f7636013880 20 rados_obj.operate() r=0 bl.length=211 2023-10-05T11:41:37.655 INFO:tasks.workunit.client.0.smithi012.stderr: -24> 2023-10-05T11:41:37.560+0000 7f7636013880 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2023-10-05T11:41:37.655 INFO:tasks.workunit.client.0.smithi012.stderr: -23> 2023-10-05T11:41:37.560+0000 7f7636013880 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2023-10-05T11:41:37.655 INFO:tasks.workunit.client.0.smithi012.stderr: -22> 2023-10-05T11:41:37.560+0000 7f7636013880 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:dff27d1e-df33-400e-a68a-7ba586947c99.4604.27 : miss 2023-10-05T11:41:37.655 INFO:tasks.workunit.client.0.smithi012.stderr: -21> 2023-10-05T11:41:37.560+0000 7f7636013880 20 rados->read ofs=0 len=0 2023-10-05T11:41:37.656 INFO:tasks.workunit.client.0.smithi012.stderr: -20> 2023-10-05T11:41:37.561+0000 7f7636013880 20 rados_obj.operate() r=0 bl.length=383 2023-10-05T11:41:37.656 INFO:tasks.workunit.client.0.smithi012.stderr: -19> 2023-10-05T11:41:37.561+0000 7f7636013880 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:dff27d1e-df33-400e-a68a-7ba586947c99.4604.27 info.flags=0x17 2023-10-05T11:41:37.656 INFO:tasks.workunit.client.0.smithi012.stderr: -18> 2023-10-05T11:41:37.561+0000 7f7636013880 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:dff27d1e-df33-400e-a68a-7ba586947c99.4604.27 to cache LRU end 2023-10-05T11:41:37.656 INFO:tasks.workunit.client.0.smithi012.stderr: -17> 2023-10-05T11:41:37.561+0000 7f7636013880 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T11:41:37.656 INFO:tasks.workunit.client.0.smithi012.stderr: -16> 2023-10-05T11:41:37.561+0000 7f7636013880 10 updating xattr: name=user.rgw.acl bl.length()=265 2023-10-05T11:41:37.656 INFO:tasks.workunit.client.0.smithi012.stderr: -15> 2023-10-05T11:41:37.561+0000 7f7636013880 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:dff27d1e-df33-400e-a68a-7ba586947c99.4604.27 2023-10-05T11:41:37.656 INFO:tasks.workunit.client.0.smithi012.stderr: -14> 2023-10-05T11:41:37.561+0000 7f7631c8d640 10 monclient: get_auth_request con 0x561343617800 auth_method 0 2023-10-05T11:41:37.656 INFO:tasks.workunit.client.0.smithi012.stderr: -13> 2023-10-05T11:41:37.567+0000 7f7636013880 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:dff27d1e-df33-400e-a68a-7ba586947c99.4604.27 info.flags=0x17 2023-10-05T11:41:37.656 INFO:tasks.workunit.client.0.smithi012.stderr: -12> 2023-10-05T11:41:37.567+0000 7f7636013880 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:dff27d1e-df33-400e-a68a-7ba586947c99.4604.27 to cache LRU end 2023-10-05T11:41:37.656 INFO:tasks.workunit.client.0.smithi012.stderr: -11> 2023-10-05T11:41:37.567+0000 7f7636013880 10 updating xattr: name=user.rgw.acl bl.length()=265 2023-10-05T11:41:37.656 INFO:tasks.workunit.client.0.smithi012.stderr: -10> 2023-10-05T11:41:37.567+0000 7f7636013880 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:dff27d1e-df33-400e-a68a-7ba586947c99.4604.27, ofs0, ns] 2023-10-05T11:41:37.656 INFO:tasks.workunit.client.0.smithi012.stderr: -9> 2023-10-05T11:41:37.567+0000 7f762cc83640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1060856922181 cookie 94640734760960 notifier 6968 bl.length()=945 2023-10-05T11:41:37.657 INFO:tasks.workunit.client.0.smithi012.stderr: -8> 2023-10-05T11:41:37.567+0000 7f762cc83640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:dff27d1e-df33-400e-a68a-7ba586947c99.4604.27 info.flags=0x17 2023-10-05T11:41:37.657 INFO:tasks.workunit.client.0.smithi012.stderr: -7> 2023-10-05T11:41:37.567+0000 7f762cc83640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:dff27d1e-df33-400e-a68a-7ba586947c99.4604.27 to cache LRU end 2023-10-05T11:41:37.657 INFO:tasks.workunit.client.0.smithi012.stderr: -6> 2023-10-05T11:41:37.567+0000 7f762cc83640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2023-10-05T11:41:37.657 INFO:tasks.workunit.client.0.smithi012.stderr: -5> 2023-10-05T11:41:37.569+0000 7f7636013880 20 handle_bi_update(): bucket=:abort-at-do-reshard[dff27d1e-df33-400e-a68a-7ba586947c99.4604.27]): orig_sources= new_sources= 2023-10-05T11:41:37.657 INFO:tasks.workunit.client.0.smithi012.stderr: -4> 2023-10-05T11:41:37.569+0000 7f7636013880 20 handle_bi_update(): bucket=:abort-at-do-reshard[dff27d1e-df33-400e-a68a-7ba586947c99.4604.27]): potential sources added=[] removed=[] 2023-10-05T11:41:37.657 INFO:tasks.workunit.client.0.smithi012.stderr: -3> 2023-10-05T11:41:37.569+0000 7f7636013880 20 handle_bi_update(): bucket=:abort-at-do-reshard[dff27d1e-df33-400e-a68a-7ba586947c99.4604.27]): orig_dests= new_dests= 2023-10-05T11:41:37.657 INFO:tasks.workunit.client.0.smithi012.stderr: -2> 2023-10-05T11:41:37.569+0000 7f7636013880 20 handle_bi_update(): bucket=:abort-at-do-reshard[dff27d1e-df33-400e-a68a-7ba586947c99.4604.27]): potential dests added=[] removed=[] 2023-10-05T11:41:37.657 INFO:tasks.workunit.client.0.smithi012.stderr: -1> 2023-10-05T11:41:37.572+0000 7f7636013880 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6543-g38321be8/rpm/el9/BUILD/ceph-18.0.0-6543-g38321be8/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f7636013880 time 2023-10-05T11:41:37.572107+0000 2023-10-05T11:41:37.657 INFO:tasks.workunit.client.0.smithi012.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6543-g38321be8/rpm/el9/BUILD/ceph-18.0.0-6543-g38321be8/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2023-10-05T11:41:37.657 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:41:37.658 INFO:tasks.workunit.client.0.smithi012.stderr: ceph version 18.0.0-6543-g38321be8 (38321be854743c0d616618a9ea8aa0b1d4dbc0bf) reef (dev) 2023-10-05T11:41:37.658 INFO:tasks.workunit.client.0.smithi012.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f763896d15f] 2023-10-05T11:41:37.658 INFO:tasks.workunit.client.0.smithi012.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16d31d) [0x7f763896d31d] 2023-10-05T11:41:37.658 INFO:tasks.workunit.client.0.smithi012.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5613412dac31] 2023-10-05T11:41:37.658 INFO:tasks.workunit.client.0.smithi012.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x314) [0x5613412f17a4] 2023-10-05T11:41:37.658 INFO:tasks.workunit.client.0.smithi012.stderr: 5: main() 2023-10-05T11:41:37.658 INFO:tasks.workunit.client.0.smithi012.stderr: 6: /lib64/libc.so.6(+0x3feb0) [0x7f7635e3feb0] 2023-10-05T11:41:37.658 INFO:tasks.workunit.client.0.smithi012.stderr: 7: __libc_start_main() 2023-10-05T11:41:37.659 INFO:tasks.workunit.client.0.smithi012.stderr: 8: _start() 2023-10-05T11:41:37.659 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:41:37.659 INFO:tasks.workunit.client.0.smithi012.stderr: 0> 2023-10-05T11:41:37.573+0000 7f7636013880 -1 *** Caught signal (Aborted) ** 2023-10-05T11:41:37.659 INFO:tasks.workunit.client.0.smithi012.stderr: in thread 7f7636013880 thread_name:radosgw-admin 2023-10-05T11:41:37.659 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:41:37.659 INFO:tasks.workunit.client.0.smithi012.stderr: ceph version 18.0.0-6543-g38321be8 (38321be854743c0d616618a9ea8aa0b1d4dbc0bf) reef (dev) 2023-10-05T11:41:37.659 INFO:tasks.workunit.client.0.smithi012.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f7635e54db0] 2023-10-05T11:41:37.659 INFO:tasks.workunit.client.0.smithi012.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f7635ea154c] 2023-10-05T11:41:37.659 INFO:tasks.workunit.client.0.smithi012.stderr: 3: raise() 2023-10-05T11:41:37.659 INFO:tasks.workunit.client.0.smithi012.stderr: 4: abort() 2023-10-05T11:41:37.660 INFO:tasks.workunit.client.0.smithi012.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f763896d1b9] 2023-10-05T11:41:37.660 INFO:tasks.workunit.client.0.smithi012.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16d31d) [0x7f763896d31d] 2023-10-05T11:41:37.660 INFO:tasks.workunit.client.0.smithi012.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5613412dac31] 2023-10-05T11:41:37.660 INFO:tasks.workunit.client.0.smithi012.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x314) [0x5613412f17a4] 2023-10-05T11:41:37.660 INFO:tasks.workunit.client.0.smithi012.stderr: 9: main() 2023-10-05T11:41:37.660 INFO:tasks.workunit.client.0.smithi012.stderr: 10: /lib64/libc.so.6(+0x3feb0) [0x7f7635e3feb0] 2023-10-05T11:41:37.660 INFO:tasks.workunit.client.0.smithi012.stderr: 11: __libc_start_main() 2023-10-05T11:41:37.660 INFO:tasks.workunit.client.0.smithi012.stderr: 12: _start() 2023-10-05T11:41:37.660 INFO:tasks.workunit.client.0.smithi012.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-10-05T11:41:37.660 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:41:37.660 INFO:tasks.workunit.client.0.smithi012.stderr:--- logging levels --- 2023-10-05T11:41:37.660 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 none 2023-10-05T11:41:37.661 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 1 lockdep 2023-10-05T11:41:37.661 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 1 context 2023-10-05T11:41:37.661 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 1 crush 2023-10-05T11:41:37.661 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 mds 2023-10-05T11:41:37.661 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 mds_balancer 2023-10-05T11:41:37.661 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 mds_locker 2023-10-05T11:41:37.661 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 mds_log 2023-10-05T11:41:37.661 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 mds_log_expire 2023-10-05T11:41:37.661 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 mds_migrator 2023-10-05T11:41:37.661 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 1 buffer 2023-10-05T11:41:37.661 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 1 timer 2023-10-05T11:41:37.662 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 1 filer 2023-10-05T11:41:37.662 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 1 striper 2023-10-05T11:41:37.662 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 1 objecter 2023-10-05T11:41:37.662 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 rados 2023-10-05T11:41:37.662 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 rbd 2023-10-05T11:41:37.662 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 rbd_mirror 2023-10-05T11:41:37.662 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 rbd_replay 2023-10-05T11:41:37.662 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 rbd_pwl 2023-10-05T11:41:37.662 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 journaler 2023-10-05T11:41:37.662 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 objectcacher 2023-10-05T11:41:37.662 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 immutable_obj_cache 2023-10-05T11:41:37.663 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 client 2023-10-05T11:41:37.663 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 osd 2023-10-05T11:41:37.663 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 optracker 2023-10-05T11:41:37.663 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 objclass 2023-10-05T11:41:37.663 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 3 filestore 2023-10-05T11:41:37.663 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 3 journal 2023-10-05T11:41:37.663 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 0 ms 2023-10-05T11:41:37.663 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 mon 2023-10-05T11:41:37.663 INFO:tasks.workunit.client.0.smithi012.stderr: 0/10 monc 2023-10-05T11:41:37.663 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 paxos 2023-10-05T11:41:37.663 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 tp 2023-10-05T11:41:37.663 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 auth 2023-10-05T11:41:37.663 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 crypto 2023-10-05T11:41:37.664 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 1 finisher 2023-10-05T11:41:37.664 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 1 reserver 2023-10-05T11:41:37.664 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 heartbeatmap 2023-10-05T11:41:37.664 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 perfcounter 2023-10-05T11:41:37.664 INFO:tasks.workunit.client.0.smithi012.stderr: 20/20 rgw 2023-10-05T11:41:37.664 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 rgw_sync 2023-10-05T11:41:37.664 INFO:tasks.workunit.client.0.smithi012.stderr: 30/30 rgw_datacache 2023-10-05T11:41:37.664 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 rgw_access 2023-10-05T11:41:37.664 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 rgw_dbstore 2023-10-05T11:41:37.664 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 rgw_flight 2023-10-05T11:41:37.664 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 javaclient 2023-10-05T11:41:37.664 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 asok 2023-10-05T11:41:37.664 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 1 throttle 2023-10-05T11:41:37.664 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 0 refs 2023-10-05T11:41:37.665 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 compressor 2023-10-05T11:41:37.665 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 bluestore 2023-10-05T11:41:37.665 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 bluefs 2023-10-05T11:41:37.665 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 3 bdev 2023-10-05T11:41:37.665 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 kstore 2023-10-05T11:41:37.665 INFO:tasks.workunit.client.0.smithi012.stderr: 4/ 5 rocksdb 2023-10-05T11:41:37.665 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 fuse 2023-10-05T11:41:37.665 INFO:tasks.workunit.client.0.smithi012.stderr: 2/ 5 mgr 2023-10-05T11:41:37.665 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 mgrc 2023-10-05T11:41:37.666 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 dpdk 2023-10-05T11:41:37.666 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 eventtrace 2023-10-05T11:41:37.666 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 prioritycache 2023-10-05T11:41:37.666 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 test 2023-10-05T11:41:37.666 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 cephfs_mirror 2023-10-05T11:41:37.666 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 cephsqlite 2023-10-05T11:41:37.666 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 seastore 2023-10-05T11:41:37.667 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 seastore_onode 2023-10-05T11:41:37.667 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 seastore_odata 2023-10-05T11:41:37.667 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 seastore_omap 2023-10-05T11:41:37.667 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 seastore_tm 2023-10-05T11:41:37.667 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 seastore_t 2023-10-05T11:41:37.667 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 seastore_cleaner 2023-10-05T11:41:37.667 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 seastore_epm 2023-10-05T11:41:37.667 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 seastore_lba 2023-10-05T11:41:37.667 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 seastore_fixedkv_tree 2023-10-05T11:41:37.667 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 seastore_cache 2023-10-05T11:41:37.667 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 seastore_journal 2023-10-05T11:41:37.667 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 seastore_device 2023-10-05T11:41:37.667 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 seastore_backref 2023-10-05T11:41:37.668 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 alienstore 2023-10-05T11:41:37.668 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 mclock 2023-10-05T11:41:37.668 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 cyanstore 2023-10-05T11:41:37.668 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 ceph_exporter 2023-10-05T11:41:37.668 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 memstore 2023-10-05T11:41:37.668 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 trace 2023-10-05T11:41:37.668 INFO:tasks.workunit.client.0.smithi012.stderr: -2/-2 (syslog threshold) 2023-10-05T11:41:37.668 INFO:tasks.workunit.client.0.smithi012.stderr: 99/99 (stderr threshold) 2023-10-05T11:41:37.668 INFO:tasks.workunit.client.0.smithi012.stderr:--- pthread ID / name mapping for recent threads --- 2023-10-05T11:41:37.668 INFO:tasks.workunit.client.0.smithi012.stderr: 7f7612c4f640 / http_manager 2023-10-05T11:41:37.668 INFO:tasks.workunit.client.0.smithi012.stderr: 7f7614c53640 / http_manager 2023-10-05T11:41:37.668 INFO:tasks.workunit.client.0.smithi012.stderr: 7f7617458640 / ms_dispatch 2023-10-05T11:41:37.669 INFO:tasks.workunit.client.0.smithi012.stderr: 7f7618c5b640 / io_context_pool 2023-10-05T11:41:37.669 INFO:tasks.workunit.client.0.smithi012.stderr: 7f761945c640 / rgw_dt_lg_renew 2023-10-05T11:41:37.669 INFO:tasks.workunit.client.0.smithi012.stderr: 7f762b480640 / ms_dispatch 2023-10-05T11:41:37.669 INFO:tasks.workunit.client.0.smithi012.stderr: 7f762cc83640 / io_context_pool 2023-10-05T11:41:37.669 INFO:tasks.workunit.client.0.smithi012.stderr: 7f762f488640 / ms_dispatch 2023-10-05T11:41:37.669 INFO:tasks.workunit.client.0.smithi012.stderr: 7f7630c8b640 / io_context_pool 2023-10-05T11:41:37.669 INFO:tasks.workunit.client.0.smithi012.stderr: 7f7631c8d640 / msgr-worker-2 2023-10-05T11:41:37.669 INFO:tasks.workunit.client.0.smithi012.stderr: 7f763248e640 / msgr-worker-1 2023-10-05T11:41:37.669 INFO:tasks.workunit.client.0.smithi012.stderr: 7f7632c8f640 / msgr-worker-0 2023-10-05T11:41:37.669 INFO:tasks.workunit.client.0.smithi012.stderr: 7f7636013880 / radosgw-admin 2023-10-05T11:41:37.669 INFO:tasks.workunit.client.0.smithi012.stderr: max_recent 500 2023-10-05T11:41:37.669 INFO:tasks.workunit.client.0.smithi012.stderr: max_new 1000 2023-10-05T11:41:37.670 INFO:tasks.workunit.client.0.smithi012.stderr: log_file /var/log/ceph/ceph-client.admin.104463.log 2023-10-05T11:41:37.670 INFO:tasks.workunit.client.0.smithi012.stderr:--- end dump of recent events --- 2023-10-05T11:41:37.670 INFO:tasks.workunit.client.0.smithi012.stderr:--- begin dump of recent events --- 2023-10-05T11:41:37.670 INFO:tasks.workunit.client.0.smithi012.stderr: -499> 2023-10-05T11:41:37.521+0000 7f762f488640 10 monclient: got monmap 1 from mon.a (according to old e1) 2023-10-05T11:41:37.670 INFO:tasks.workunit.client.0.smithi012.stderr: -498> 2023-10-05T11:41:37.521+0000 7f7630c8b640 4 set_mon_vals no callback set 2023-10-05T11:41:37.670 INFO:tasks.workunit.client.0.smithi012.stderr: -497> 2023-10-05T11:41:37.521+0000 7f762f488640 10 monclient: dump: 2023-10-05T11:41:37.670 INFO:tasks.workunit.client.0.smithi012.stderr:epoch 1 2023-10-05T11:41:37.670 INFO:tasks.workunit.client.0.smithi012.stderr:fsid 7e015f46-293b-4b09-bd32-7d32b52f6e2f 2023-10-05T11:41:37.670 INFO:tasks.workunit.client.0.smithi012.stderr:last_changed 2023-10-05T11:27:38.366888+0000 2023-10-05T11:41:37.670 INFO:tasks.workunit.client.0.smithi012.stderr:created 2023-10-05T11:27:38.366888+0000 2023-10-05T11:41:37.671 INFO:tasks.workunit.client.0.smithi012.stderr:min_mon_release 18 (reef) 2023-10-05T11:41:37.671 INFO:tasks.workunit.client.0.smithi012.stderr:election_strategy: 1 2023-10-05T11:41:37.671 INFO:tasks.workunit.client.0.smithi012.stderr:0: [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon.a 2023-10-05T11:41:37.671 INFO:tasks.workunit.client.0.smithi012.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2023-10-05T11:41:37.671 INFO:tasks.workunit.client.0.smithi012.stderr:2: [v2:172.21.15.12:3301/0,v1:172.21.15.12:6790/0] mon.c 2023-10-05T11:41:37.671 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:41:37.671 INFO:tasks.workunit.client.0.smithi012.stderr: -496> 2023-10-05T11:41:37.521+0000 7f7636013880 5 monclient: authenticate success, global_id 7353 2023-10-05T11:41:37.671 INFO:tasks.workunit.client.0.smithi012.stderr: -495> 2023-10-05T11:41:37.521+0000 7f7636013880 10 monclient: _renew_subs 2023-10-05T11:41:37.671 INFO:tasks.workunit.client.0.smithi012.stderr: -494> 2023-10-05T11:41:37.521+0000 7f7636013880 10 monclient: _send_mon_message to mon.a at v2:172.21.15.12:3300/0 2023-10-05T11:41:37.672 INFO:tasks.workunit.client.0.smithi012.stderr: -493> 2023-10-05T11:41:37.521+0000 7f7636013880 10 monclient: _renew_subs 2023-10-05T11:41:37.672 INFO:tasks.workunit.client.0.smithi012.stderr: -492> 2023-10-05T11:41:37.521+0000 7f7636013880 10 monclient: _send_mon_message to mon.a at v2:172.21.15.12:3300/0 2023-10-05T11:41:37.672 INFO:tasks.workunit.client.0.smithi012.stderr: -491> 2023-10-05T11:41:37.521+0000 7f7636013880 1 librados: init done 2023-10-05T11:41:37.672 INFO:tasks.workunit.client.0.smithi012.stderr: -490> 2023-10-05T11:41:37.521+0000 7f7636013880 10 monclient: get_monmap_and_config 2023-10-05T11:41:37.672 INFO:tasks.workunit.client.0.smithi012.stderr: -489> 2023-10-05T11:41:37.521+0000 7f7636013880 10 monclient: build_initial_monmap 2023-10-05T11:41:37.672 INFO:tasks.workunit.client.0.smithi012.stderr: -488> 2023-10-05T11:41:37.521+0000 7f7636013880 1 build_initial for_mkfs: 0 2023-10-05T11:41:37.672 INFO:tasks.workunit.client.0.smithi012.stderr: -487> 2023-10-05T11:41:37.521+0000 7f7636013880 10 monclient: monmap: 2023-10-05T11:41:37.672 INFO:tasks.workunit.client.0.smithi012.stderr:epoch 0 2023-10-05T11:41:37.672 INFO:tasks.workunit.client.0.smithi012.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-10-05T11:41:37.672 INFO:tasks.workunit.client.0.smithi012.stderr:last_changed 0.000000 2023-10-05T11:41:37.672 INFO:tasks.workunit.client.0.smithi012.stderr:created 0.000000 2023-10-05T11:41:37.673 INFO:tasks.workunit.client.0.smithi012.stderr:min_mon_release 0 (unknown) 2023-10-05T11:41:37.673 INFO:tasks.workunit.client.0.smithi012.stderr:election_strategy: 1 2023-10-05T11:41:37.673 INFO:tasks.workunit.client.0.smithi012.stderr:0: [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon.noname-a 2023-10-05T11:41:37.673 INFO:tasks.workunit.client.0.smithi012.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.noname-b 2023-10-05T11:41:37.673 INFO:tasks.workunit.client.0.smithi012.stderr:2: [v2:172.21.15.12:3301/0,v1:172.21.15.12:6790/0] mon.noname-c 2023-10-05T11:41:37.673 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:41:37.673 INFO:tasks.workunit.client.0.smithi012.stderr: -486> 2023-10-05T11:41:37.521+0000 7f7636013880 5 AuthRegistry(0x561343ee9340) adding auth protocol: cephx 2023-10-05T11:41:37.673 INFO:tasks.workunit.client.0.smithi012.stderr: -485> 2023-10-05T11:41:37.521+0000 7f7636013880 5 AuthRegistry(0x561343ee9340) adding auth protocol: cephx 2023-10-05T11:41:37.673 INFO:tasks.workunit.client.0.smithi012.stderr: -484> 2023-10-05T11:41:37.521+0000 7f7636013880 5 AuthRegistry(0x561343ee9340) adding auth protocol: cephx 2023-10-05T11:41:37.673 INFO:tasks.workunit.client.0.smithi012.stderr: -483> 2023-10-05T11:41:37.521+0000 7f7636013880 5 AuthRegistry(0x561343ee9340) adding con mode: secure 2023-10-05T11:41:37.673 INFO:tasks.workunit.client.0.smithi012.stderr: -482> 2023-10-05T11:41:37.521+0000 7f7636013880 5 AuthRegistry(0x561343ee9340) adding con mode: crc 2023-10-05T11:41:37.673 INFO:tasks.workunit.client.0.smithi012.stderr: -481> 2023-10-05T11:41:37.521+0000 7f7636013880 5 AuthRegistry(0x561343ee9340) adding con mode: secure 2023-10-05T11:41:37.674 INFO:tasks.workunit.client.0.smithi012.stderr: -480> 2023-10-05T11:41:37.521+0000 7f7636013880 5 AuthRegistry(0x561343ee9340) adding con mode: crc 2023-10-05T11:41:37.674 INFO:tasks.workunit.client.0.smithi012.stderr: -479> 2023-10-05T11:41:37.521+0000 7f7636013880 5 AuthRegistry(0x561343ee9340) adding con mode: secure 2023-10-05T11:41:37.674 INFO:tasks.workunit.client.0.smithi012.stderr: -478> 2023-10-05T11:41:37.521+0000 7f7636013880 5 AuthRegistry(0x561343ee9340) adding con mode: crc 2023-10-05T11:41:37.674 INFO:tasks.workunit.client.0.smithi012.stderr: -477> 2023-10-05T11:41:37.521+0000 7f7636013880 5 AuthRegistry(0x561343ee9340) adding con mode: crc 2023-10-05T11:41:37.674 INFO:tasks.workunit.client.0.smithi012.stderr: -476> 2023-10-05T11:41:37.521+0000 7f7636013880 5 AuthRegistry(0x561343ee9340) adding con mode: secure 2023-10-05T11:41:37.674 INFO:tasks.workunit.client.0.smithi012.stderr: -475> 2023-10-05T11:41:37.521+0000 7f7636013880 5 AuthRegistry(0x561343ee9340) adding con mode: crc 2023-10-05T11:41:37.674 INFO:tasks.workunit.client.0.smithi012.stderr: -474> 2023-10-05T11:41:37.521+0000 7f7636013880 5 AuthRegistry(0x561343ee9340) adding con mode: secure 2023-10-05T11:41:37.674 INFO:tasks.workunit.client.0.smithi012.stderr: -473> 2023-10-05T11:41:37.521+0000 7f7636013880 5 AuthRegistry(0x561343ee9340) adding con mode: crc 2023-10-05T11:41:37.674 INFO:tasks.workunit.client.0.smithi012.stderr: -472> 2023-10-05T11:41:37.521+0000 7f7636013880 5 AuthRegistry(0x561343ee9340) adding con mode: secure 2023-10-05T11:41:37.674 INFO:tasks.workunit.client.0.smithi012.stderr: -471> 2023-10-05T11:41:37.522+0000 7f7636013880 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-10-05T11:41:37.674 INFO:tasks.workunit.client.0.smithi012.stderr: -470> 2023-10-05T11:41:37.522+0000 7f7636013880 10 monclient: init 2023-10-05T11:41:37.675 INFO:tasks.workunit.client.0.smithi012.stderr: -469> 2023-10-05T11:41:37.522+0000 7f7636013880 5 AuthRegistry(0x7fff98e526b0) adding auth protocol: cephx 2023-10-05T11:41:37.675 INFO:tasks.workunit.client.0.smithi012.stderr: -468> 2023-10-05T11:41:37.522+0000 7f7636013880 5 AuthRegistry(0x7fff98e526b0) adding auth protocol: cephx 2023-10-05T11:41:37.675 INFO:tasks.workunit.client.0.smithi012.stderr: -467> 2023-10-05T11:41:37.522+0000 7f7636013880 5 AuthRegistry(0x7fff98e526b0) adding auth protocol: cephx 2023-10-05T11:41:37.675 INFO:tasks.workunit.client.0.smithi012.stderr: -466> 2023-10-05T11:41:37.522+0000 7f7636013880 5 AuthRegistry(0x7fff98e526b0) adding con mode: secure 2023-10-05T11:41:37.675 INFO:tasks.workunit.client.0.smithi012.stderr: -465> 2023-10-05T11:41:37.522+0000 7f7636013880 5 AuthRegistry(0x7fff98e526b0) adding con mode: crc 2023-10-05T11:41:37.675 INFO:tasks.workunit.client.0.smithi012.stderr: -464> 2023-10-05T11:41:37.522+0000 7f7636013880 5 AuthRegistry(0x7fff98e526b0) adding con mode: secure 2023-10-05T11:41:37.675 INFO:tasks.workunit.client.0.smithi012.stderr: -463> 2023-10-05T11:41:37.522+0000 7f7636013880 5 AuthRegistry(0x7fff98e526b0) adding con mode: crc 2023-10-05T11:41:37.675 INFO:tasks.workunit.client.0.smithi012.stderr: -462> 2023-10-05T11:41:37.522+0000 7f7636013880 5 AuthRegistry(0x7fff98e526b0) adding con mode: secure 2023-10-05T11:41:37.675 INFO:tasks.workunit.client.0.smithi012.stderr: -461> 2023-10-05T11:41:37.522+0000 7f7636013880 5 AuthRegistry(0x7fff98e526b0) adding con mode: crc 2023-10-05T11:41:37.675 INFO:tasks.workunit.client.0.smithi012.stderr: -460> 2023-10-05T11:41:37.522+0000 7f7636013880 5 AuthRegistry(0x7fff98e526b0) adding con mode: crc 2023-10-05T11:41:37.675 INFO:tasks.workunit.client.0.smithi012.stderr: -459> 2023-10-05T11:41:37.522+0000 7f7636013880 5 AuthRegistry(0x7fff98e526b0) adding con mode: secure 2023-10-05T11:41:37.676 INFO:tasks.workunit.client.0.smithi012.stderr: -458> 2023-10-05T11:41:37.522+0000 7f7636013880 5 AuthRegistry(0x7fff98e526b0) adding con mode: crc 2023-10-05T11:41:37.676 INFO:tasks.workunit.client.0.smithi012.stderr: -457> 2023-10-05T11:41:37.522+0000 7f7636013880 5 AuthRegistry(0x7fff98e526b0) adding con mode: secure 2023-10-05T11:41:37.676 INFO:tasks.workunit.client.0.smithi012.stderr: -456> 2023-10-05T11:41:37.522+0000 7f7636013880 5 AuthRegistry(0x7fff98e526b0) adding con mode: crc 2023-10-05T11:41:37.676 INFO:tasks.workunit.client.0.smithi012.stderr: -455> 2023-10-05T11:41:37.522+0000 7f7636013880 5 AuthRegistry(0x7fff98e526b0) adding con mode: secure 2023-10-05T11:41:37.676 INFO:tasks.workunit.client.0.smithi012.stderr: -454> 2023-10-05T11:41:37.522+0000 7f762f488640 4 mgrc handle_mgr_map Got map version 5 2023-10-05T11:41:37.676 INFO:tasks.workunit.client.0.smithi012.stderr: -453> 2023-10-05T11:41:37.522+0000 7f762f488640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.170:6832/180516904,v1:172.21.15.170:6833/180516904] 2023-10-05T11:41:37.676 INFO:tasks.workunit.client.0.smithi012.stderr: -452> 2023-10-05T11:41:37.522+0000 7f762f488640 4 mgrc reconnect Starting new session with [v2:172.21.15.170:6832/180516904,v1:172.21.15.170:6833/180516904] 2023-10-05T11:41:37.676 INFO:tasks.workunit.client.0.smithi012.stderr: -451> 2023-10-05T11:41:37.522+0000 7f7636013880 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-10-05T11:41:37.676 INFO:tasks.workunit.client.0.smithi012.stderr: -450> 2023-10-05T11:41:37.523+0000 7f7636013880 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-10-05T11:41:37.676 INFO:tasks.workunit.client.0.smithi012.stderr: -449> 2023-10-05T11:41:37.523+0000 7f7636013880 5 asok(0x561343438000) register_command rotate-key cmddesc rotate-key hook 0x7fff98e527f8 EEXIST 2023-10-05T11:41:37.676 INFO:tasks.workunit.client.0.smithi012.stderr: -448> 2023-10-05T11:41:37.523+0000 7f7636013880 10 monclient: _reopen_session rank -1 2023-10-05T11:41:37.676 INFO:tasks.workunit.client.0.smithi012.stderr: -447> 2023-10-05T11:41:37.523+0000 7f7636013880 10 monclient: _add_conns ranks=[2,1,0] 2023-10-05T11:41:37.677 INFO:tasks.workunit.client.0.smithi012.stderr: -446> 2023-10-05T11:41:37.523+0000 7f7636013880 10 monclient(hunting): picked mon.noname-c con 0x561344036800 addr [v2:172.21.15.12:3301/0,v1:172.21.15.12:6790/0] 2023-10-05T11:41:37.677 INFO:tasks.workunit.client.0.smithi012.stderr: -445> 2023-10-05T11:41:37.523+0000 7f7636013880 10 monclient(hunting): picked mon.noname-b con 0x561344036c00 addr [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] 2023-10-05T11:41:37.677 INFO:tasks.workunit.client.0.smithi012.stderr: -444> 2023-10-05T11:41:37.523+0000 7f7636013880 10 monclient(hunting): picked mon.noname-a con 0x561344037000 addr [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] 2023-10-05T11:41:37.677 INFO:tasks.workunit.client.0.smithi012.stderr: -443> 2023-10-05T11:41:37.523+0000 7f7636013880 10 monclient(hunting): start opening mon connection 2023-10-05T11:41:37.677 INFO:tasks.workunit.client.0.smithi012.stderr: -442> 2023-10-05T11:41:37.523+0000 7f7636013880 10 monclient(hunting): start opening mon connection 2023-10-05T11:41:37.677 INFO:tasks.workunit.client.0.smithi012.stderr: -441> 2023-10-05T11:41:37.523+0000 7f7636013880 10 monclient(hunting): start opening mon connection 2023-10-05T11:41:37.677 INFO:tasks.workunit.client.0.smithi012.stderr: -440> 2023-10-05T11:41:37.523+0000 7f7636013880 10 monclient(hunting): _renew_subs 2023-10-05T11:41:37.677 INFO:tasks.workunit.client.0.smithi012.stderr: -439> 2023-10-05T11:41:37.523+0000 7f7636013880 10 monclient(hunting): authenticate will time out at 1605.690638s 2023-10-05T11:41:37.677 INFO:tasks.workunit.client.0.smithi012.stderr: -438> 2023-10-05T11:41:37.523+0000 7f763248e640 10 monclient(hunting): get_auth_request con 0x561344036800 auth_method 0 2023-10-05T11:41:37.677 INFO:tasks.workunit.client.0.smithi012.stderr: -437> 2023-10-05T11:41:37.523+0000 7f763248e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-10-05T11:41:37.677 INFO:tasks.workunit.client.0.smithi012.stderr: -436> 2023-10-05T11:41:37.523+0000 7f763248e640 10 monclient(hunting): _init_auth method 2 2023-10-05T11:41:37.677 INFO:tasks.workunit.client.0.smithi012.stderr: -435> 2023-10-05T11:41:37.523+0000 7f763248e640 10 monclient(hunting): _init_auth creating new auth 2023-10-05T11:41:37.678 INFO:tasks.workunit.client.0.smithi012.stderr: -434> 2023-10-05T11:41:37.523+0000 7f7632c8f640 10 monclient(hunting): get_auth_request con 0x561344037000 auth_method 0 2023-10-05T11:41:37.678 INFO:tasks.workunit.client.0.smithi012.stderr: -433> 2023-10-05T11:41:37.523+0000 7f7632c8f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-10-05T11:41:37.678 INFO:tasks.workunit.client.0.smithi012.stderr: -432> 2023-10-05T11:41:37.523+0000 7f7632c8f640 10 monclient(hunting): _init_auth method 2 2023-10-05T11:41:37.678 INFO:tasks.workunit.client.0.smithi012.stderr: -431> 2023-10-05T11:41:37.523+0000 7f7632c8f640 10 monclient(hunting): _init_auth creating new auth 2023-10-05T11:41:37.678 INFO:tasks.workunit.client.0.smithi012.stderr: -430> 2023-10-05T11:41:37.523+0000 7f7631c8d640 10 monclient: get_auth_request con 0x561344036400 auth_method 0 2023-10-05T11:41:37.678 INFO:tasks.workunit.client.0.smithi012.stderr: -429> 2023-10-05T11:41:37.523+0000 7f763248e640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-10-05T11:41:37.678 INFO:tasks.workunit.client.0.smithi012.stderr: -428> 2023-10-05T11:41:37.523+0000 7f763248e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-10-05T11:41:37.678 INFO:tasks.workunit.client.0.smithi012.stderr: -427> 2023-10-05T11:41:37.523+0000 7f763248e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-10-05T11:41:37.678 INFO:tasks.workunit.client.0.smithi012.stderr: -426> 2023-10-05T11:41:37.523+0000 7f7632c8f640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-10-05T11:41:37.678 INFO:tasks.workunit.client.0.smithi012.stderr: -425> 2023-10-05T11:41:37.523+0000 7f7632c8f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-10-05T11:41:37.678 INFO:tasks.workunit.client.0.smithi012.stderr: -424> 2023-10-05T11:41:37.523+0000 7f7632c8f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-10-05T11:41:37.679 INFO:tasks.workunit.client.0.smithi012.stderr: -423> 2023-10-05T11:41:37.523+0000 7f763248e640 10 monclient(hunting): handle_auth_done global_id 6965 payload 274 2023-10-05T11:41:37.679 INFO:tasks.workunit.client.0.smithi012.stderr: -422> 2023-10-05T11:41:37.523+0000 7f763248e640 10 monclient: _finish_hunting 0 2023-10-05T11:41:37.679 INFO:tasks.workunit.client.0.smithi012.stderr: -421> 2023-10-05T11:41:37.523+0000 7f763248e640 1 monclient: found mon.noname-c 2023-10-05T11:41:37.679 INFO:tasks.workunit.client.0.smithi012.stderr: -420> 2023-10-05T11:41:37.523+0000 7f763248e640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.12:3301/0 2023-10-05T11:41:37.679 INFO:tasks.workunit.client.0.smithi012.stderr: -419> 2023-10-05T11:41:37.523+0000 7f7631c8d640 10 monclient: get_auth_request con 0x561344036c00 auth_method 0 2023-10-05T11:41:37.679 INFO:tasks.workunit.client.0.smithi012.stderr: -418> 2023-10-05T11:41:37.523+0000 7f762cc83640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-10-05T11:41:37.679 INFO:tasks.workunit.client.0.smithi012.stderr: -417> 2023-10-05T11:41:37.523+0000 7f762cc83640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2023-10-05T11:41:37.679 INFO:tasks.workunit.client.0.smithi012.stderr: -416> 2023-10-05T11:41:37.523+0000 7f762cc83640 10 monclient: dump: 2023-10-05T11:41:37.679 INFO:tasks.workunit.client.0.smithi012.stderr:epoch 1 2023-10-05T11:41:37.679 INFO:tasks.workunit.client.0.smithi012.stderr:fsid 7e015f46-293b-4b09-bd32-7d32b52f6e2f 2023-10-05T11:41:37.679 INFO:tasks.workunit.client.0.smithi012.stderr:last_changed 2023-10-05T11:27:38.366888+0000 2023-10-05T11:41:37.679 INFO:tasks.workunit.client.0.smithi012.stderr:created 2023-10-05T11:27:38.366888+0000 2023-10-05T11:41:37.680 INFO:tasks.workunit.client.0.smithi012.stderr:min_mon_release 18 (reef) 2023-10-05T11:41:37.680 INFO:tasks.workunit.client.0.smithi012.stderr:election_strategy: 1 2023-10-05T11:41:37.680 INFO:tasks.workunit.client.0.smithi012.stderr:0: [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon.a 2023-10-05T11:41:37.680 INFO:tasks.workunit.client.0.smithi012.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2023-10-05T11:41:37.680 INFO:tasks.workunit.client.0.smithi012.stderr:2: [v2:172.21.15.12:3301/0,v1:172.21.15.12:6790/0] mon.c 2023-10-05T11:41:37.680 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:41:37.680 INFO:tasks.workunit.client.0.smithi012.stderr: -415> 2023-10-05T11:41:37.523+0000 7f762cc83640 10 monclient: _finish_auth 0 2023-10-05T11:41:37.680 INFO:tasks.workunit.client.0.smithi012.stderr: -414> 2023-10-05T11:41:37.523+0000 7f762cc83640 10 monclient: _check_auth_tickets 2023-10-05T11:41:37.680 INFO:tasks.workunit.client.0.smithi012.stderr: -413> 2023-10-05T11:41:37.523+0000 7f7636013880 5 monclient: authenticate success, global_id 6965 2023-10-05T11:41:37.680 INFO:tasks.workunit.client.0.smithi012.stderr: -412> 2023-10-05T11:41:37.523+0000 7f762cc83640 10 monclient: handle_config config(0 keys) v1 2023-10-05T11:41:37.680 INFO:tasks.workunit.client.0.smithi012.stderr: -411> 2023-10-05T11:41:37.523+0000 7f7636013880 10 monclient: get_monmap_and_config success 2023-10-05T11:41:37.680 INFO:tasks.workunit.client.0.smithi012.stderr: -410> 2023-10-05T11:41:37.523+0000 7f7636013880 4 set_mon_vals no callback set 2023-10-05T11:41:37.681 INFO:tasks.workunit.client.0.smithi012.stderr: -409> 2023-10-05T11:41:37.523+0000 7f762cc83640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-10-05T11:41:37.681 INFO:tasks.workunit.client.0.smithi012.stderr: -408> 2023-10-05T11:41:37.523+0000 7f762cc83640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-10-05T11:41:37.681 INFO:tasks.workunit.client.0.smithi012.stderr: -407> 2023-10-05T11:41:37.523+0000 7f762cc83640 10 monclient: dump: 2023-10-05T11:41:37.681 INFO:tasks.workunit.client.0.smithi012.stderr:epoch 1 2023-10-05T11:41:37.681 INFO:tasks.workunit.client.0.smithi012.stderr:fsid 7e015f46-293b-4b09-bd32-7d32b52f6e2f 2023-10-05T11:41:37.681 INFO:tasks.workunit.client.0.smithi012.stderr:last_changed 2023-10-05T11:27:38.366888+0000 2023-10-05T11:41:37.681 INFO:tasks.workunit.client.0.smithi012.stderr:created 2023-10-05T11:27:38.366888+0000 2023-10-05T11:41:37.681 INFO:tasks.workunit.client.0.smithi012.stderr:min_mon_release 18 (reef) 2023-10-05T11:41:37.681 INFO:tasks.workunit.client.0.smithi012.stderr:election_strategy: 1 2023-10-05T11:41:37.681 INFO:tasks.workunit.client.0.smithi012.stderr:0: [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon.a 2023-10-05T11:41:37.681 INFO:tasks.workunit.client.0.smithi012.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2023-10-05T11:41:37.681 INFO:tasks.workunit.client.0.smithi012.stderr:2: [v2:172.21.15.12:3301/0,v1:172.21.15.12:6790/0] mon.c 2023-10-05T11:41:37.682 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:41:37.682 INFO:tasks.workunit.client.0.smithi012.stderr: -406> 2023-10-05T11:41:37.524+0000 7f7636013880 10 monclient: shutdown 2023-10-05T11:41:37.682 INFO:tasks.workunit.client.0.smithi012.stderr: -405> 2023-10-05T11:41:37.524+0000 7f7636013880 10 monclient: build_initial_monmap 2023-10-05T11:41:37.682 INFO:tasks.workunit.client.0.smithi012.stderr: -404> 2023-10-05T11:41:37.524+0000 7f7636013880 1 build_initial for_mkfs: 0 2023-10-05T11:41:37.682 INFO:tasks.workunit.client.0.smithi012.stderr: -403> 2023-10-05T11:41:37.524+0000 7f7636013880 10 monclient: monmap: 2023-10-05T11:41:37.682 INFO:tasks.workunit.client.0.smithi012.stderr:epoch 0 2023-10-05T11:41:37.682 INFO:tasks.workunit.client.0.smithi012.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-10-05T11:41:37.682 INFO:tasks.workunit.client.0.smithi012.stderr:last_changed 0.000000 2023-10-05T11:41:37.682 INFO:tasks.workunit.client.0.smithi012.stderr:created 0.000000 2023-10-05T11:41:37.682 INFO:tasks.workunit.client.0.smithi012.stderr:min_mon_release 0 (unknown) 2023-10-05T11:41:37.682 INFO:tasks.workunit.client.0.smithi012.stderr:election_strategy: 1 2023-10-05T11:41:37.683 INFO:tasks.workunit.client.0.smithi012.stderr:0: [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon.noname-a 2023-10-05T11:41:37.683 INFO:tasks.workunit.client.0.smithi012.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.noname-b 2023-10-05T11:41:37.683 INFO:tasks.workunit.client.0.smithi012.stderr:2: [v2:172.21.15.12:3301/0,v1:172.21.15.12:6790/0] mon.noname-c 2023-10-05T11:41:37.683 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:41:37.683 INFO:tasks.workunit.client.0.smithi012.stderr: -402> 2023-10-05T11:41:37.524+0000 7f7636013880 5 AuthRegistry(0x561343ee9340) adding auth protocol: cephx 2023-10-05T11:41:37.683 INFO:tasks.workunit.client.0.smithi012.stderr: -401> 2023-10-05T11:41:37.524+0000 7f7636013880 5 AuthRegistry(0x561343ee9340) adding auth protocol: cephx 2023-10-05T11:41:37.683 INFO:tasks.workunit.client.0.smithi012.stderr: -400> 2023-10-05T11:41:37.524+0000 7f7636013880 5 AuthRegistry(0x561343ee9340) adding auth protocol: cephx 2023-10-05T11:41:37.683 INFO:tasks.workunit.client.0.smithi012.stderr: -399> 2023-10-05T11:41:37.524+0000 7f7636013880 5 AuthRegistry(0x561343ee9340) adding con mode: secure 2023-10-05T11:41:37.683 INFO:tasks.workunit.client.0.smithi012.stderr: -398> 2023-10-05T11:41:37.524+0000 7f7636013880 5 AuthRegistry(0x561343ee9340) adding con mode: crc 2023-10-05T11:41:37.683 INFO:tasks.workunit.client.0.smithi012.stderr: -397> 2023-10-05T11:41:37.524+0000 7f7636013880 5 AuthRegistry(0x561343ee9340) adding con mode: secure 2023-10-05T11:41:37.683 INFO:tasks.workunit.client.0.smithi012.stderr: -396> 2023-10-05T11:41:37.524+0000 7f7636013880 5 AuthRegistry(0x561343ee9340) adding con mode: crc 2023-10-05T11:41:37.683 INFO:tasks.workunit.client.0.smithi012.stderr: -395> 2023-10-05T11:41:37.524+0000 7f7636013880 5 AuthRegistry(0x561343ee9340) adding con mode: secure 2023-10-05T11:41:37.683 INFO:tasks.workunit.client.0.smithi012.stderr: -394> 2023-10-05T11:41:37.524+0000 7f7636013880 5 AuthRegistry(0x561343ee9340) adding con mode: crc 2023-10-05T11:41:37.684 INFO:tasks.workunit.client.0.smithi012.stderr: -393> 2023-10-05T11:41:37.524+0000 7f7636013880 5 AuthRegistry(0x561343ee9340) adding con mode: crc 2023-10-05T11:41:37.684 INFO:tasks.workunit.client.0.smithi012.stderr: -392> 2023-10-05T11:41:37.524+0000 7f7636013880 5 AuthRegistry(0x561343ee9340) adding con mode: secure 2023-10-05T11:41:37.684 INFO:tasks.workunit.client.0.smithi012.stderr: -391> 2023-10-05T11:41:37.524+0000 7f7636013880 5 AuthRegistry(0x561343ee9340) adding con mode: crc 2023-10-05T11:41:37.684 INFO:tasks.workunit.client.0.smithi012.stderr: -390> 2023-10-05T11:41:37.524+0000 7f7636013880 5 AuthRegistry(0x561343ee9340) adding con mode: secure 2023-10-05T11:41:37.684 INFO:tasks.workunit.client.0.smithi012.stderr: -389> 2023-10-05T11:41:37.524+0000 7f7636013880 5 AuthRegistry(0x561343ee9340) adding con mode: crc 2023-10-05T11:41:37.684 INFO:tasks.workunit.client.0.smithi012.stderr: -388> 2023-10-05T11:41:37.524+0000 7f7636013880 5 AuthRegistry(0x561343ee9340) adding con mode: secure 2023-10-05T11:41:37.684 INFO:tasks.workunit.client.0.smithi012.stderr: -387> 2023-10-05T11:41:37.524+0000 7f7636013880 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-10-05T11:41:37.684 INFO:tasks.workunit.client.0.smithi012.stderr: -386> 2023-10-05T11:41:37.524+0000 7f7636013880 1 librados: starting msgr at 2023-10-05T11:41:37.684 INFO:tasks.workunit.client.0.smithi012.stderr: -385> 2023-10-05T11:41:37.524+0000 7f7636013880 1 librados: starting objecter 2023-10-05T11:41:37.684 INFO:tasks.workunit.client.0.smithi012.stderr: -384> 2023-10-05T11:41:37.524+0000 7f7636013880 5 asok(0x561343438000) register_command objecter_requests cmddesc objecter_requests hook 0x561343f496a0 EEXIST 2023-10-05T11:41:37.685 INFO:tasks.workunit.client.0.smithi012.stderr: -383> 2023-10-05T11:41:37.524+0000 7f7636013880 1 librados: setting wanted keys 2023-10-05T11:41:37.685 INFO:tasks.workunit.client.0.smithi012.stderr: -382> 2023-10-05T11:41:37.524+0000 7f7636013880 1 librados: calling monclient init 2023-10-05T11:41:37.685 INFO:tasks.workunit.client.0.smithi012.stderr: -381> 2023-10-05T11:41:37.524+0000 7f7636013880 10 monclient: init 2023-10-05T11:41:37.685 INFO:tasks.workunit.client.0.smithi012.stderr: -380> 2023-10-05T11:41:37.524+0000 7f7636013880 5 AuthRegistry(0x5613432970d8) adding auth protocol: cephx 2023-10-05T11:41:37.685 INFO:tasks.workunit.client.0.smithi012.stderr: -379> 2023-10-05T11:41:37.524+0000 7f7636013880 5 AuthRegistry(0x5613432970d8) adding auth protocol: cephx 2023-10-05T11:41:37.685 INFO:tasks.workunit.client.0.smithi012.stderr: -378> 2023-10-05T11:41:37.524+0000 7f7636013880 5 AuthRegistry(0x5613432970d8) adding auth protocol: cephx 2023-10-05T11:41:37.685 INFO:tasks.workunit.client.0.smithi012.stderr: -377> 2023-10-05T11:41:37.524+0000 7f7636013880 5 AuthRegistry(0x5613432970d8) adding con mode: secure 2023-10-05T11:41:37.685 INFO:tasks.workunit.client.0.smithi012.stderr: -376> 2023-10-05T11:41:37.524+0000 7f7636013880 5 AuthRegistry(0x5613432970d8) adding con mode: crc 2023-10-05T11:41:37.685 INFO:tasks.workunit.client.0.smithi012.stderr: -375> 2023-10-05T11:41:37.524+0000 7f7636013880 5 AuthRegistry(0x5613432970d8) adding con mode: secure 2023-10-05T11:41:37.685 INFO:tasks.workunit.client.0.smithi012.stderr: -374> 2023-10-05T11:41:37.524+0000 7f7636013880 5 AuthRegistry(0x5613432970d8) adding con mode: crc 2023-10-05T11:41:37.685 INFO:tasks.workunit.client.0.smithi012.stderr: -373> 2023-10-05T11:41:37.524+0000 7f7636013880 5 AuthRegistry(0x5613432970d8) adding con mode: secure 2023-10-05T11:41:37.685 INFO:tasks.workunit.client.0.smithi012.stderr: -372> 2023-10-05T11:41:37.524+0000 7f7636013880 5 AuthRegistry(0x5613432970d8) adding con mode: crc 2023-10-05T11:41:37.686 INFO:tasks.workunit.client.0.smithi012.stderr: -371> 2023-10-05T11:41:37.524+0000 7f7636013880 5 AuthRegistry(0x5613432970d8) adding con mode: crc 2023-10-05T11:41:37.686 INFO:tasks.workunit.client.0.smithi012.stderr: -370> 2023-10-05T11:41:37.524+0000 7f7636013880 5 AuthRegistry(0x5613432970d8) adding con mode: secure 2023-10-05T11:41:37.686 INFO:tasks.workunit.client.0.smithi012.stderr: -369> 2023-10-05T11:41:37.524+0000 7f7636013880 5 AuthRegistry(0x5613432970d8) adding con mode: crc 2023-10-05T11:41:37.686 INFO:tasks.workunit.client.0.smithi012.stderr: -368> 2023-10-05T11:41:37.524+0000 7f7636013880 5 AuthRegistry(0x5613432970d8) adding con mode: secure 2023-10-05T11:41:37.686 INFO:tasks.workunit.client.0.smithi012.stderr: -367> 2023-10-05T11:41:37.524+0000 7f7636013880 5 AuthRegistry(0x5613432970d8) adding con mode: crc 2023-10-05T11:41:37.686 INFO:tasks.workunit.client.0.smithi012.stderr: -366> 2023-10-05T11:41:37.524+0000 7f7636013880 5 AuthRegistry(0x5613432970d8) adding con mode: secure 2023-10-05T11:41:37.686 INFO:tasks.workunit.client.0.smithi012.stderr: -365> 2023-10-05T11:41:37.524+0000 7f7636013880 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-10-05T11:41:37.686 INFO:tasks.workunit.client.0.smithi012.stderr: -364> 2023-10-05T11:41:37.525+0000 7f7636013880 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-10-05T11:41:37.686 INFO:tasks.workunit.client.0.smithi012.stderr: -363> 2023-10-05T11:41:37.525+0000 7f7636013880 5 asok(0x561343438000) register_command rotate-key cmddesc rotate-key hook 0x561343297220 EEXIST 2023-10-05T11:41:37.686 INFO:tasks.workunit.client.0.smithi012.stderr: -362> 2023-10-05T11:41:37.525+0000 7f7636013880 10 monclient: _reopen_session rank -1 2023-10-05T11:41:37.687 INFO:tasks.workunit.client.0.smithi012.stderr: -361> 2023-10-05T11:41:37.525+0000 7f7636013880 10 monclient: _add_conns ranks=[0,2,1] 2023-10-05T11:41:37.687 INFO:tasks.workunit.client.0.smithi012.stderr: -360> 2023-10-05T11:41:37.525+0000 7f7636013880 10 monclient(hunting): picked mon.noname-a con 0x561344036800 addr [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] 2023-10-05T11:41:37.687 INFO:tasks.workunit.client.0.smithi012.stderr: -359> 2023-10-05T11:41:37.525+0000 7f7636013880 10 monclient(hunting): picked mon.noname-c con 0x561344036c00 addr [v2:172.21.15.12:3301/0,v1:172.21.15.12:6790/0] 2023-10-05T11:41:37.687 INFO:tasks.workunit.client.0.smithi012.stderr: -358> 2023-10-05T11:41:37.525+0000 7f7636013880 10 monclient(hunting): picked mon.noname-b con 0x561344037000 addr [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] 2023-10-05T11:41:37.687 INFO:tasks.workunit.client.0.smithi012.stderr: -357> 2023-10-05T11:41:37.525+0000 7f7636013880 10 monclient(hunting): start opening mon connection 2023-10-05T11:41:37.687 INFO:tasks.workunit.client.0.smithi012.stderr: -356> 2023-10-05T11:41:37.525+0000 7f7636013880 10 monclient(hunting): start opening mon connection 2023-10-05T11:41:37.687 INFO:tasks.workunit.client.0.smithi012.stderr: -355> 2023-10-05T11:41:37.525+0000 7f7636013880 10 monclient(hunting): start opening mon connection 2023-10-05T11:41:37.687 INFO:tasks.workunit.client.0.smithi012.stderr: -354> 2023-10-05T11:41:37.525+0000 7f7636013880 10 monclient(hunting): _renew_subs 2023-10-05T11:41:37.687 INFO:tasks.workunit.client.0.smithi012.stderr: -353> 2023-10-05T11:41:37.525+0000 7f7636013880 10 monclient(hunting): authenticate will time out at 1605.692614s 2023-10-05T11:41:37.687 INFO:tasks.workunit.client.0.smithi012.stderr: -352> 2023-10-05T11:41:37.525+0000 7f763248e640 10 monclient(hunting): get_auth_request con 0x561344036800 auth_method 0 2023-10-05T11:41:37.687 INFO:tasks.workunit.client.0.smithi012.stderr: -351> 2023-10-05T11:41:37.525+0000 7f763248e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-10-05T11:41:37.688 INFO:tasks.workunit.client.0.smithi012.stderr: -350> 2023-10-05T11:41:37.525+0000 7f763248e640 10 monclient(hunting): _init_auth method 2 2023-10-05T11:41:37.688 INFO:tasks.workunit.client.0.smithi012.stderr: -349> 2023-10-05T11:41:37.525+0000 7f763248e640 10 monclient(hunting): _init_auth creating new auth 2023-10-05T11:41:37.688 INFO:tasks.workunit.client.0.smithi012.stderr: -348> 2023-10-05T11:41:37.525+0000 7f7631c8d640 10 monclient(hunting): get_auth_request con 0x561344036c00 auth_method 0 2023-10-05T11:41:37.688 INFO:tasks.workunit.client.0.smithi012.stderr: -347> 2023-10-05T11:41:37.525+0000 7f7631c8d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-10-05T11:41:37.688 INFO:tasks.workunit.client.0.smithi012.stderr: -346> 2023-10-05T11:41:37.525+0000 7f7631c8d640 10 monclient(hunting): _init_auth method 2 2023-10-05T11:41:37.688 INFO:tasks.workunit.client.0.smithi012.stderr: -345> 2023-10-05T11:41:37.525+0000 7f7631c8d640 10 monclient(hunting): _init_auth creating new auth 2023-10-05T11:41:37.688 INFO:tasks.workunit.client.0.smithi012.stderr: -344> 2023-10-05T11:41:37.525+0000 7f763248e640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-10-05T11:41:37.688 INFO:tasks.workunit.client.0.smithi012.stderr: -343> 2023-10-05T11:41:37.525+0000 7f763248e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-10-05T11:41:37.688 INFO:tasks.workunit.client.0.smithi012.stderr: -342> 2023-10-05T11:41:37.525+0000 7f763248e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-10-05T11:41:37.688 INFO:tasks.workunit.client.0.smithi012.stderr: -341> 2023-10-05T11:41:37.525+0000 7f7631c8d640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-10-05T11:41:37.688 INFO:tasks.workunit.client.0.smithi012.stderr: -340> 2023-10-05T11:41:37.525+0000 7f7631c8d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-10-05T11:41:37.688 INFO:tasks.workunit.client.0.smithi012.stderr: -339> 2023-10-05T11:41:37.525+0000 7f7631c8d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-10-05T11:41:37.689 INFO:tasks.workunit.client.0.smithi012.stderr: -338> 2023-10-05T11:41:37.525+0000 7f7632c8f640 10 monclient(hunting): get_auth_request con 0x561344037000 auth_method 0 2023-10-05T11:41:37.689 INFO:tasks.workunit.client.0.smithi012.stderr: -337> 2023-10-05T11:41:37.525+0000 7f7632c8f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-10-05T11:41:37.689 INFO:tasks.workunit.client.0.smithi012.stderr: -336> 2023-10-05T11:41:37.525+0000 7f7632c8f640 10 monclient(hunting): _init_auth method 2 2023-10-05T11:41:37.689 INFO:tasks.workunit.client.0.smithi012.stderr: -335> 2023-10-05T11:41:37.525+0000 7f7632c8f640 10 monclient(hunting): _init_auth creating new auth 2023-10-05T11:41:37.689 INFO:tasks.workunit.client.0.smithi012.stderr: -334> 2023-10-05T11:41:37.525+0000 7f7632c8f640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-10-05T11:41:37.689 INFO:tasks.workunit.client.0.smithi012.stderr: -333> 2023-10-05T11:41:37.525+0000 7f7632c8f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-10-05T11:41:37.689 INFO:tasks.workunit.client.0.smithi012.stderr: -332> 2023-10-05T11:41:37.525+0000 7f7632c8f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-10-05T11:41:37.689 INFO:tasks.workunit.client.0.smithi012.stderr: -331> 2023-10-05T11:41:37.525+0000 7f7631c8d640 10 monclient(hunting): handle_auth_done global_id 6968 payload 824 2023-10-05T11:41:37.689 INFO:tasks.workunit.client.0.smithi012.stderr: -330> 2023-10-05T11:41:37.525+0000 7f7631c8d640 10 monclient: _finish_hunting 0 2023-10-05T11:41:37.689 INFO:tasks.workunit.client.0.smithi012.stderr: -329> 2023-10-05T11:41:37.525+0000 7f7631c8d640 1 monclient: found mon.noname-c 2023-10-05T11:41:37.689 INFO:tasks.workunit.client.0.smithi012.stderr: -328> 2023-10-05T11:41:37.525+0000 7f7631c8d640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.12:3301/0 2023-10-05T11:41:37.689 INFO:tasks.workunit.client.0.smithi012.stderr: -327> 2023-10-05T11:41:37.525+0000 7f762b480640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-10-05T11:41:37.690 INFO:tasks.workunit.client.0.smithi012.stderr: -326> 2023-10-05T11:41:37.525+0000 7f762b480640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2023-10-05T11:41:37.690 INFO:tasks.workunit.client.0.smithi012.stderr: -325> 2023-10-05T11:41:37.525+0000 7f762b480640 10 monclient: dump: 2023-10-05T11:41:37.690 INFO:tasks.workunit.client.0.smithi012.stderr:epoch 1 2023-10-05T11:41:37.690 INFO:tasks.workunit.client.0.smithi012.stderr:fsid 7e015f46-293b-4b09-bd32-7d32b52f6e2f 2023-10-05T11:41:37.690 INFO:tasks.workunit.client.0.smithi012.stderr:last_changed 2023-10-05T11:27:38.366888+0000 2023-10-05T11:41:37.690 INFO:tasks.workunit.client.0.smithi012.stderr:created 2023-10-05T11:27:38.366888+0000 2023-10-05T11:41:37.690 INFO:tasks.workunit.client.0.smithi012.stderr:min_mon_release 18 (reef) 2023-10-05T11:41:37.690 INFO:tasks.workunit.client.0.smithi012.stderr:election_strategy: 1 2023-10-05T11:41:37.690 INFO:tasks.workunit.client.0.smithi012.stderr:0: [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon.a 2023-10-05T11:41:37.690 INFO:tasks.workunit.client.0.smithi012.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2023-10-05T11:41:37.690 INFO:tasks.workunit.client.0.smithi012.stderr:2: [v2:172.21.15.12:3301/0,v1:172.21.15.12:6790/0] mon.c 2023-10-05T11:41:37.690 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:41:37.691 INFO:tasks.workunit.client.0.smithi012.stderr: -324> 2023-10-05T11:41:37.525+0000 7f762b480640 10 monclient: _finish_auth 0 2023-10-05T11:41:37.691 INFO:tasks.workunit.client.0.smithi012.stderr: -323> 2023-10-05T11:41:37.525+0000 7f762b480640 10 monclient: _check_auth_tickets 2023-10-05T11:41:37.691 INFO:tasks.workunit.client.0.smithi012.stderr: -322> 2023-10-05T11:41:37.525+0000 7f762b480640 10 monclient: handle_config config(0 keys) v1 2023-10-05T11:41:37.691 INFO:tasks.workunit.client.0.smithi012.stderr: -321> 2023-10-05T11:41:37.525+0000 7f762b480640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-10-05T11:41:37.691 INFO:tasks.workunit.client.0.smithi012.stderr: -320> 2023-10-05T11:41:37.525+0000 7f762b480640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-10-05T11:41:37.691 INFO:tasks.workunit.client.0.smithi012.stderr: -319> 2023-10-05T11:41:37.525+0000 7f762b480640 10 monclient: dump: 2023-10-05T11:41:37.691 INFO:tasks.workunit.client.0.smithi012.stderr:epoch 1 2023-10-05T11:41:37.691 INFO:tasks.workunit.client.0.smithi012.stderr:fsid 7e015f46-293b-4b09-bd32-7d32b52f6e2f 2023-10-05T11:41:37.691 INFO:tasks.workunit.client.0.smithi012.stderr:last_changed 2023-10-05T11:27:38.366888+0000 2023-10-05T11:41:37.691 INFO:tasks.workunit.client.0.smithi012.stderr:created 2023-10-05T11:27:38.366888+0000 2023-10-05T11:41:37.691 INFO:tasks.workunit.client.0.smithi012.stderr:min_mon_release 18 (reef) 2023-10-05T11:41:37.691 INFO:tasks.workunit.client.0.smithi012.stderr:election_strategy: 1 2023-10-05T11:41:37.692 INFO:tasks.workunit.client.0.smithi012.stderr:0: [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon.a 2023-10-05T11:41:37.692 INFO:tasks.workunit.client.0.smithi012.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2023-10-05T11:41:37.692 INFO:tasks.workunit.client.0.smithi012.stderr:2: [v2:172.21.15.12:3301/0,v1:172.21.15.12:6790/0] mon.c 2023-10-05T11:41:37.692 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:41:37.692 INFO:tasks.workunit.client.0.smithi012.stderr: -318> 2023-10-05T11:41:37.525+0000 7f762cc83640 4 set_mon_vals no callback set 2023-10-05T11:41:37.692 INFO:tasks.workunit.client.0.smithi012.stderr: -317> 2023-10-05T11:41:37.525+0000 7f7636013880 5 monclient: authenticate success, global_id 6968 2023-10-05T11:41:37.692 INFO:tasks.workunit.client.0.smithi012.stderr: -316> 2023-10-05T11:41:37.525+0000 7f7636013880 10 monclient: _renew_subs 2023-10-05T11:41:37.692 INFO:tasks.workunit.client.0.smithi012.stderr: -315> 2023-10-05T11:41:37.525+0000 7f7636013880 10 monclient: _send_mon_message to mon.c at v2:172.21.15.12:3301/0 2023-10-05T11:41:37.692 INFO:tasks.workunit.client.0.smithi012.stderr: -314> 2023-10-05T11:41:37.525+0000 7f7636013880 10 monclient: _renew_subs 2023-10-05T11:41:37.692 INFO:tasks.workunit.client.0.smithi012.stderr: -313> 2023-10-05T11:41:37.525+0000 7f7636013880 10 monclient: _send_mon_message to mon.c at v2:172.21.15.12:3301/0 2023-10-05T11:41:37.692 INFO:tasks.workunit.client.0.smithi012.stderr: -312> 2023-10-05T11:41:37.525+0000 7f7636013880 1 librados: init done 2023-10-05T11:41:37.692 INFO:tasks.workunit.client.0.smithi012.stderr: -311> 2023-10-05T11:41:37.526+0000 7f7636013880 20 rados->read ofs=0 len=0 2023-10-05T11:41:37.692 INFO:tasks.workunit.client.0.smithi012.stderr: -310> 2023-10-05T11:41:37.527+0000 7f762b480640 4 mgrc handle_mgr_map Got map version 5 2023-10-05T11:41:37.693 INFO:tasks.workunit.client.0.smithi012.stderr: -309> 2023-10-05T11:41:37.527+0000 7f762b480640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.170:6832/180516904,v1:172.21.15.170:6833/180516904] 2023-10-05T11:41:37.693 INFO:tasks.workunit.client.0.smithi012.stderr: -308> 2023-10-05T11:41:37.527+0000 7f762b480640 4 mgrc reconnect Starting new session with [v2:172.21.15.170:6832/180516904,v1:172.21.15.170:6833/180516904] 2023-10-05T11:41:37.693 INFO:tasks.workunit.client.0.smithi012.stderr: -307> 2023-10-05T11:41:37.527+0000 7f763248e640 10 monclient: get_auth_request con 0x5613435c6000 auth_method 0 2023-10-05T11:41:37.693 INFO:tasks.workunit.client.0.smithi012.stderr: -306> 2023-10-05T11:41:37.527+0000 7f7632c8f640 10 monclient: get_auth_request con 0x561344037400 auth_method 0 2023-10-05T11:41:37.693 INFO:tasks.workunit.client.0.smithi012.stderr: -305> 2023-10-05T11:41:37.528+0000 7f7636013880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:37.693 INFO:tasks.workunit.client.0.smithi012.stderr: -304> 2023-10-05T11:41:37.528+0000 7f7636013880 20 realm 2023-10-05T11:41:37.693 INFO:tasks.workunit.client.0.smithi012.stderr: -303> 2023-10-05T11:41:37.528+0000 7f7636013880 20 rados->read ofs=0 len=0 2023-10-05T11:41:37.693 INFO:tasks.workunit.client.0.smithi012.stderr: -302> 2023-10-05T11:41:37.528+0000 7f7636013880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:37.693 INFO:tasks.workunit.client.0.smithi012.stderr: -301> 2023-10-05T11:41:37.528+0000 7f7636013880 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T11:41:37.693 INFO:tasks.workunit.client.0.smithi012.stderr: -300> 2023-10-05T11:41:37.528+0000 7f7636013880 20 rados->read ofs=0 len=0 2023-10-05T11:41:37.693 INFO:tasks.workunit.client.0.smithi012.stderr: -299> 2023-10-05T11:41:37.528+0000 7f7636013880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:37.693 INFO:tasks.workunit.client.0.smithi012.stderr: -298> 2023-10-05T11:41:37.528+0000 7f7636013880 20 rados->read ofs=0 len=0 2023-10-05T11:41:37.693 INFO:tasks.workunit.client.0.smithi012.stderr: -297> 2023-10-05T11:41:37.529+0000 7f763248e640 10 monclient: get_auth_request con 0x561344037800 auth_method 0 2023-10-05T11:41:37.694 INFO:tasks.workunit.client.0.smithi012.stderr: -296> 2023-10-05T11:41:37.529+0000 7f7636013880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:41:37.694 INFO:tasks.workunit.client.0.smithi012.stderr: -295> 2023-10-05T11:41:37.529+0000 7f7636013880 20 rados->read ofs=0 len=0 2023-10-05T11:41:37.694 INFO:tasks.workunit.client.0.smithi012.stderr: -294> 2023-10-05T11:41:37.529+0000 7f7631c8d640 10 monclient: get_auth_request con 0x5613435c7000 auth_method 0 2023-10-05T11:41:37.694 INFO:tasks.workunit.client.0.smithi012.stderr: -293> 2023-10-05T11:41:37.530+0000 7f7636013880 20 rados_obj.operate() r=0 bl.length=1020 2023-10-05T11:41:37.694 INFO:tasks.workunit.client.0.smithi012.stderr: -292> 2023-10-05T11:41:37.530+0000 7f7636013880 20 searching for the correct realm 2023-10-05T11:41:37.694 INFO:tasks.workunit.client.0.smithi012.stderr: -291> 2023-10-05T11:41:37.530+0000 7f7632c8f640 10 monclient: get_auth_request con 0x5613435c7400 auth_method 0 2023-10-05T11:41:37.694 INFO:tasks.workunit.client.0.smithi012.stderr: -290> 2023-10-05T11:41:37.531+0000 7f763248e640 10 monclient: get_auth_request con 0x561343505000 auth_method 0 2023-10-05T11:41:37.694 INFO:tasks.workunit.client.0.smithi012.stderr: -289> 2023-10-05T11:41:37.532+0000 7f7631c8d640 10 monclient: get_auth_request con 0x5613435c6800 auth_method 0 2023-10-05T11:41:37.694 INFO:tasks.workunit.client.0.smithi012.stderr: -288> 2023-10-05T11:41:37.534+0000 7f7632c8f640 10 monclient: get_auth_request con 0x561343505400 auth_method 0 2023-10-05T11:41:37.694 INFO:tasks.workunit.client.0.smithi012.stderr: -287> 2023-10-05T11:41:37.536+0000 7f763248e640 10 monclient: get_auth_request con 0x561343505800 auth_method 0 2023-10-05T11:41:37.694 INFO:tasks.workunit.client.0.smithi012.stderr: -286> 2023-10-05T11:41:37.539+0000 7f763248e640 0 -- 172.21.15.12:0/3739624321 >> [v2:172.21.15.12:6800/732466381,v1:172.21.15.12:6801/732466381] conn(0x561343505000 msgr2=0x5613435cac00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-10-05T11:41:37.695 INFO:tasks.workunit.client.0.smithi012.stderr: -285> 2023-10-05T11:41:37.539+0000 7f762b480640 1 client.6968.objecter ms_handle_reset 0x561343505000 session 0x56134350e180 osd.2 2023-10-05T11:41:37.695 INFO:tasks.workunit.client.0.smithi012.stderr: -284> 2023-10-05T11:41:37.539+0000 7f762b480640 10 monclient: _renew_subs 2023-10-05T11:41:37.695 INFO:tasks.workunit.client.0.smithi012.stderr: -283> 2023-10-05T11:41:37.539+0000 7f762b480640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.12:3301/0 2023-10-05T11:41:37.695 INFO:tasks.workunit.client.0.smithi012.stderr: -282> 2023-10-05T11:41:37.539+0000 7f763248e640 10 monclient: get_auth_request con 0x561343606000 auth_method 0 2023-10-05T11:41:37.695 INFO:tasks.workunit.client.0.smithi012.stderr: -281> 2023-10-05T11:41:37.540+0000 7f7636013880 20 RGWRados::pool_iterate: got zone_info.dff27d1e-df33-400e-a68a-7ba586947c99 2023-10-05T11:41:37.695 INFO:tasks.workunit.client.0.smithi012.stderr: -280> 2023-10-05T11:41:37.540+0000 7f7636013880 20 RGWRados::pool_iterate: got zonegroup_info.c78aa576-9d15-4e9d-b3c0-4af23a22062c 2023-10-05T11:41:37.695 INFO:tasks.workunit.client.0.smithi012.stderr: -279> 2023-10-05T11:41:37.540+0000 7f7636013880 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T11:41:37.695 INFO:tasks.workunit.client.0.smithi012.stderr: -278> 2023-10-05T11:41:37.540+0000 7f7636013880 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T11:41:37.695 INFO:tasks.workunit.client.0.smithi012.stderr: -277> 2023-10-05T11:41:37.540+0000 7f7636013880 20 rados->read ofs=0 len=0 2023-10-05T11:41:37.695 INFO:tasks.workunit.client.0.smithi012.stderr: -276> 2023-10-05T11:41:37.541+0000 7f7636013880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:37.695 INFO:tasks.workunit.client.0.smithi012.stderr: -275> 2023-10-05T11:41:37.541+0000 7f7636013880 20 rados->read ofs=0 len=0 2023-10-05T11:41:37.696 INFO:tasks.workunit.client.0.smithi012.stderr: -274> 2023-10-05T11:41:37.541+0000 7f7636013880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:41:37.696 INFO:tasks.workunit.client.0.smithi012.stderr: -273> 2023-10-05T11:41:37.541+0000 7f7636013880 20 rados->read ofs=0 len=0 2023-10-05T11:41:37.696 INFO:tasks.workunit.client.0.smithi012.stderr: -272> 2023-10-05T11:41:37.541+0000 7f7636013880 20 rados_obj.operate() r=0 bl.length=454 2023-10-05T11:41:37.696 INFO:tasks.workunit.client.0.smithi012.stderr: -271> 2023-10-05T11:41:37.541+0000 7f7636013880 20 zone default found 2023-10-05T11:41:37.696 INFO:tasks.workunit.client.0.smithi012.stderr: -270> 2023-10-05T11:41:37.541+0000 7f7636013880 4 Realm: () 2023-10-05T11:41:37.696 INFO:tasks.workunit.client.0.smithi012.stderr: -269> 2023-10-05T11:41:37.541+0000 7f7636013880 4 ZoneGroup: default (c78aa576-9d15-4e9d-b3c0-4af23a22062c) 2023-10-05T11:41:37.696 INFO:tasks.workunit.client.0.smithi012.stderr: -268> 2023-10-05T11:41:37.541+0000 7f7636013880 4 Zone: default (dff27d1e-df33-400e-a68a-7ba586947c99) 2023-10-05T11:41:37.696 INFO:tasks.workunit.client.0.smithi012.stderr: -267> 2023-10-05T11:41:37.541+0000 7f7636013880 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T11:41:37.696 INFO:tasks.workunit.client.0.smithi012.stderr: -266> 2023-10-05T11:41:37.541+0000 7f7636013880 20 zonegroup default 2023-10-05T11:41:37.696 INFO:tasks.workunit.client.0.smithi012.stderr: -265> 2023-10-05T11:41:37.541+0000 7f7636013880 20 rados->read ofs=0 len=0 2023-10-05T11:41:37.696 INFO:tasks.workunit.client.0.smithi012.stderr: -264> 2023-10-05T11:41:37.541+0000 7f7636013880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:37.696 INFO:tasks.workunit.client.0.smithi012.stderr: -263> 2023-10-05T11:41:37.541+0000 7f7636013880 20 rados->read ofs=0 len=0 2023-10-05T11:41:37.697 INFO:tasks.workunit.client.0.smithi012.stderr: -262> 2023-10-05T11:41:37.542+0000 7f7636013880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:37.697 INFO:tasks.workunit.client.0.smithi012.stderr: -261> 2023-10-05T11:41:37.542+0000 7f7636013880 20 rados->read ofs=0 len=0 2023-10-05T11:41:37.697 INFO:tasks.workunit.client.0.smithi012.stderr: -260> 2023-10-05T11:41:37.542+0000 7f7636013880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:37.697 INFO:tasks.workunit.client.0.smithi012.stderr: -259> 2023-10-05T11:41:37.542+0000 7f7636013880 20 started sync module instance, tier type = 2023-10-05T11:41:37.697 INFO:tasks.workunit.client.0.smithi012.stderr: -258> 2023-10-05T11:41:37.542+0000 7f7636013880 20 started zone id=dff27d1e-df33-400e-a68a-7ba586947c99 (name=default) with tier type = 2023-10-05T11:41:37.697 INFO:tasks.workunit.client.0.smithi012.stderr: -257> 2023-10-05T11:41:37.547+0000 7f7632c8f640 0 -- 172.21.15.12:0/3739624321 >> [v2:172.21.15.170:6800/4137726411,v1:172.21.15.170:6801/4137726411] conn(0x561343505400 msgr2=0x5613435cb700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-10-05T11:41:37.697 INFO:tasks.workunit.client.0.smithi012.stderr: -256> 2023-10-05T11:41:37.547+0000 7f762b480640 1 client.6968.objecter ms_handle_reset 0x561343505400 session 0x56134350e600 osd.6 2023-10-05T11:41:37.697 INFO:tasks.workunit.client.0.smithi012.stderr: -255> 2023-10-05T11:41:37.547+0000 7f7632c8f640 10 monclient: get_auth_request con 0x561343505000 auth_method 0 2023-10-05T11:41:37.697 INFO:tasks.workunit.client.0.smithi012.stderr: -254> 2023-10-05T11:41:37.551+0000 7f7636013880 20 add_watcher() i=0 2023-10-05T11:41:37.697 INFO:tasks.workunit.client.0.smithi012.stderr: -253> 2023-10-05T11:41:37.551+0000 7f7636013880 20 add_watcher() i=1 2023-10-05T11:41:37.697 INFO:tasks.workunit.client.0.smithi012.stderr: -252> 2023-10-05T11:41:37.551+0000 7f7636013880 20 add_watcher() i=2 2023-10-05T11:41:37.697 INFO:tasks.workunit.client.0.smithi012.stderr: -251> 2023-10-05T11:41:37.551+0000 7f7636013880 20 add_watcher() i=3 2023-10-05T11:41:37.698 INFO:tasks.workunit.client.0.smithi012.stderr: -250> 2023-10-05T11:41:37.551+0000 7f7636013880 20 add_watcher() i=4 2023-10-05T11:41:37.698 INFO:tasks.workunit.client.0.smithi012.stderr: -249> 2023-10-05T11:41:37.551+0000 7f7636013880 20 add_watcher() i=5 2023-10-05T11:41:37.698 INFO:tasks.workunit.client.0.smithi012.stderr: -248> 2023-10-05T11:41:37.551+0000 7f7636013880 20 add_watcher() i=6 2023-10-05T11:41:37.698 INFO:tasks.workunit.client.0.smithi012.stderr: -247> 2023-10-05T11:41:37.552+0000 7f7636013880 20 add_watcher() i=7 2023-10-05T11:41:37.698 INFO:tasks.workunit.client.0.smithi012.stderr: -246> 2023-10-05T11:41:37.552+0000 7f7636013880 2 all 8 watchers are set, enabling cache 2023-10-05T11:41:37.698 INFO:tasks.workunit.client.0.smithi012.stderr: -245> 2023-10-05T11:41:37.554+0000 7f7636013880 5 AuthRegistry(0x7fff98e530e0) adding auth protocol: cephx 2023-10-05T11:41:37.698 INFO:tasks.workunit.client.0.smithi012.stderr: -244> 2023-10-05T11:41:37.554+0000 7f7636013880 5 AuthRegistry(0x7fff98e530e0) adding auth protocol: cephx 2023-10-05T11:41:37.698 INFO:tasks.workunit.client.0.smithi012.stderr: -243> 2023-10-05T11:41:37.554+0000 7f7636013880 5 AuthRegistry(0x7fff98e530e0) adding auth protocol: cephx 2023-10-05T11:41:37.698 INFO:tasks.workunit.client.0.smithi012.stderr: -242> 2023-10-05T11:41:37.554+0000 7f7636013880 5 AuthRegistry(0x7fff98e530e0) adding con mode: secure 2023-10-05T11:41:37.698 INFO:tasks.workunit.client.0.smithi012.stderr: -241> 2023-10-05T11:41:37.554+0000 7f7636013880 5 AuthRegistry(0x7fff98e530e0) adding con mode: crc 2023-10-05T11:41:37.699 INFO:tasks.workunit.client.0.smithi012.stderr: -240> 2023-10-05T11:41:37.554+0000 7f7636013880 5 AuthRegistry(0x7fff98e530e0) adding con mode: secure 2023-10-05T11:41:37.699 INFO:tasks.workunit.client.0.smithi012.stderr: -239> 2023-10-05T11:41:37.554+0000 7f7636013880 5 AuthRegistry(0x7fff98e530e0) adding con mode: crc 2023-10-05T11:41:37.699 INFO:tasks.workunit.client.0.smithi012.stderr: -238> 2023-10-05T11:41:37.554+0000 7f761945c640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:41:37.699 INFO:tasks.workunit.client.0.smithi012.stderr: -237> 2023-10-05T11:41:37.554+0000 7f7636013880 5 AuthRegistry(0x7fff98e530e0) adding con mode: secure 2023-10-05T11:41:37.699 INFO:tasks.workunit.client.0.smithi012.stderr: -236> 2023-10-05T11:41:37.554+0000 7f7636013880 5 AuthRegistry(0x7fff98e530e0) adding con mode: crc 2023-10-05T11:41:37.699 INFO:tasks.workunit.client.0.smithi012.stderr: -235> 2023-10-05T11:41:37.554+0000 7f7636013880 5 AuthRegistry(0x7fff98e530e0) adding con mode: crc 2023-10-05T11:41:37.699 INFO:tasks.workunit.client.0.smithi012.stderr: -234> 2023-10-05T11:41:37.554+0000 7f7636013880 5 AuthRegistry(0x7fff98e530e0) adding con mode: secure 2023-10-05T11:41:37.699 INFO:tasks.workunit.client.0.smithi012.stderr: -233> 2023-10-05T11:41:37.554+0000 7f7636013880 5 AuthRegistry(0x7fff98e530e0) adding con mode: crc 2023-10-05T11:41:37.699 INFO:tasks.workunit.client.0.smithi012.stderr: -232> 2023-10-05T11:41:37.554+0000 7f7636013880 5 AuthRegistry(0x7fff98e530e0) adding con mode: secure 2023-10-05T11:41:37.699 INFO:tasks.workunit.client.0.smithi012.stderr: -231> 2023-10-05T11:41:37.554+0000 7f7636013880 5 AuthRegistry(0x7fff98e530e0) adding con mode: crc 2023-10-05T11:41:37.699 INFO:tasks.workunit.client.0.smithi012.stderr: -230> 2023-10-05T11:41:37.554+0000 7f7636013880 5 AuthRegistry(0x7fff98e530e0) adding con mode: secure 2023-10-05T11:41:37.699 INFO:tasks.workunit.client.0.smithi012.stderr: -229> 2023-10-05T11:41:37.554+0000 7f7636013880 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-10-05T11:41:37.699 INFO:tasks.workunit.client.0.smithi012.stderr: -228> 2023-10-05T11:41:37.554+0000 7f7636013880 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T11:41:37.700 INFO:tasks.workunit.client.0.smithi012.stderr: -227> 2023-10-05T11:41:37.554+0000 7f7636013880 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T11:41:37.700 INFO:tasks.workunit.client.0.smithi012.stderr: -226> 2023-10-05T11:41:37.554+0000 7f7636013880 5 asok(0x561343438000) register_command cache list hook 0x561343f49480 2023-10-05T11:41:37.700 INFO:tasks.workunit.client.0.smithi012.stderr: -225> 2023-10-05T11:41:37.554+0000 7f7636013880 5 asok(0x561343438000) register_command cache inspect hook 0x561343f49480 2023-10-05T11:41:37.700 INFO:tasks.workunit.client.0.smithi012.stderr: -224> 2023-10-05T11:41:37.554+0000 7f7636013880 5 asok(0x561343438000) register_command cache erase hook 0x561343f49480 2023-10-05T11:41:37.700 INFO:tasks.workunit.client.0.smithi012.stderr: -223> 2023-10-05T11:41:37.554+0000 7f7636013880 5 asok(0x561343438000) register_command cache zap hook 0x561343f49480 2023-10-05T11:41:37.700 INFO:tasks.workunit.client.0.smithi012.stderr: -222> 2023-10-05T11:41:37.554+0000 7f7636013880 10 monclient: get_monmap_and_config 2023-10-05T11:41:37.700 INFO:tasks.workunit.client.0.smithi012.stderr: -221> 2023-10-05T11:41:37.554+0000 7f7636013880 10 monclient: build_initial_monmap 2023-10-05T11:41:37.700 INFO:tasks.workunit.client.0.smithi012.stderr: -220> 2023-10-05T11:41:37.554+0000 7f7636013880 1 build_initial for_mkfs: 0 2023-10-05T11:41:37.700 INFO:tasks.workunit.client.0.smithi012.stderr: -219> 2023-10-05T11:41:37.554+0000 7f7636013880 10 monclient: monmap: 2023-10-05T11:41:37.700 INFO:tasks.workunit.client.0.smithi012.stderr:epoch 0 2023-10-05T11:41:37.700 INFO:tasks.workunit.client.0.smithi012.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-10-05T11:41:37.701 INFO:tasks.workunit.client.0.smithi012.stderr:last_changed 0.000000 2023-10-05T11:41:37.701 INFO:tasks.workunit.client.0.smithi012.stderr:created 0.000000 2023-10-05T11:41:37.701 INFO:tasks.workunit.client.0.smithi012.stderr:min_mon_release 0 (unknown) 2023-10-05T11:41:37.701 INFO:tasks.workunit.client.0.smithi012.stderr:election_strategy: 1 2023-10-05T11:41:37.701 INFO:tasks.workunit.client.0.smithi012.stderr:0: [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon.noname-a 2023-10-05T11:41:37.701 INFO:tasks.workunit.client.0.smithi012.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.noname-b 2023-10-05T11:41:37.701 INFO:tasks.workunit.client.0.smithi012.stderr:2: [v2:172.21.15.12:3301/0,v1:172.21.15.12:6790/0] mon.noname-c 2023-10-05T11:41:37.701 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:41:37.701 INFO:tasks.workunit.client.0.smithi012.stderr: -218> 2023-10-05T11:41:37.554+0000 7f7636013880 5 AuthRegistry(0x561343ee9c40) adding auth protocol: cephx 2023-10-05T11:41:37.701 INFO:tasks.workunit.client.0.smithi012.stderr: -217> 2023-10-05T11:41:37.554+0000 7f7636013880 5 AuthRegistry(0x561343ee9c40) adding auth protocol: cephx 2023-10-05T11:41:37.701 INFO:tasks.workunit.client.0.smithi012.stderr: -216> 2023-10-05T11:41:37.554+0000 7f7636013880 5 AuthRegistry(0x561343ee9c40) adding auth protocol: cephx 2023-10-05T11:41:37.701 INFO:tasks.workunit.client.0.smithi012.stderr: -215> 2023-10-05T11:41:37.554+0000 7f7636013880 5 AuthRegistry(0x561343ee9c40) adding con mode: secure 2023-10-05T11:41:37.702 INFO:tasks.workunit.client.0.smithi012.stderr: -214> 2023-10-05T11:41:37.554+0000 7f7636013880 5 AuthRegistry(0x561343ee9c40) adding con mode: crc 2023-10-05T11:41:37.702 INFO:tasks.workunit.client.0.smithi012.stderr: -213> 2023-10-05T11:41:37.554+0000 7f7636013880 5 AuthRegistry(0x561343ee9c40) adding con mode: secure 2023-10-05T11:41:37.702 INFO:tasks.workunit.client.0.smithi012.stderr: -212> 2023-10-05T11:41:37.554+0000 7f7636013880 5 AuthRegistry(0x561343ee9c40) adding con mode: crc 2023-10-05T11:41:37.702 INFO:tasks.workunit.client.0.smithi012.stderr: -211> 2023-10-05T11:41:37.554+0000 7f7636013880 5 AuthRegistry(0x561343ee9c40) adding con mode: secure 2023-10-05T11:41:37.702 INFO:tasks.workunit.client.0.smithi012.stderr: -210> 2023-10-05T11:41:37.554+0000 7f7636013880 5 AuthRegistry(0x561343ee9c40) adding con mode: crc 2023-10-05T11:41:37.702 INFO:tasks.workunit.client.0.smithi012.stderr: -209> 2023-10-05T11:41:37.554+0000 7f7636013880 5 AuthRegistry(0x561343ee9c40) adding con mode: crc 2023-10-05T11:41:37.702 INFO:tasks.workunit.client.0.smithi012.stderr: -208> 2023-10-05T11:41:37.554+0000 7f7636013880 5 AuthRegistry(0x561343ee9c40) adding con mode: secure 2023-10-05T11:41:37.702 INFO:tasks.workunit.client.0.smithi012.stderr: -207> 2023-10-05T11:41:37.554+0000 7f7636013880 5 AuthRegistry(0x561343ee9c40) adding con mode: crc 2023-10-05T11:41:37.702 INFO:tasks.workunit.client.0.smithi012.stderr: -206> 2023-10-05T11:41:37.554+0000 7f7636013880 5 AuthRegistry(0x561343ee9c40) adding con mode: secure 2023-10-05T11:41:37.702 INFO:tasks.workunit.client.0.smithi012.stderr: -205> 2023-10-05T11:41:37.554+0000 7f7636013880 5 AuthRegistry(0x561343ee9c40) adding con mode: crc 2023-10-05T11:41:37.702 INFO:tasks.workunit.client.0.smithi012.stderr: -204> 2023-10-05T11:41:37.554+0000 7f7636013880 5 AuthRegistry(0x561343ee9c40) adding con mode: secure 2023-10-05T11:41:37.702 INFO:tasks.workunit.client.0.smithi012.stderr: -203> 2023-10-05T11:41:37.554+0000 7f7636013880 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-10-05T11:41:37.703 INFO:tasks.workunit.client.0.smithi012.stderr: -202> 2023-10-05T11:41:37.554+0000 7f7636013880 10 monclient: init 2023-10-05T11:41:37.703 INFO:tasks.workunit.client.0.smithi012.stderr: -201> 2023-10-05T11:41:37.554+0000 7f7636013880 5 AuthRegistry(0x7fff98e52c30) adding auth protocol: cephx 2023-10-05T11:41:37.703 INFO:tasks.workunit.client.0.smithi012.stderr: -200> 2023-10-05T11:41:37.554+0000 7f7636013880 5 AuthRegistry(0x7fff98e52c30) adding auth protocol: cephx 2023-10-05T11:41:37.703 INFO:tasks.workunit.client.0.smithi012.stderr: -199> 2023-10-05T11:41:37.554+0000 7f7636013880 5 AuthRegistry(0x7fff98e52c30) adding auth protocol: cephx 2023-10-05T11:41:37.703 INFO:tasks.workunit.client.0.smithi012.stderr: -198> 2023-10-05T11:41:37.554+0000 7f7636013880 5 AuthRegistry(0x7fff98e52c30) adding con mode: secure 2023-10-05T11:41:37.703 INFO:tasks.workunit.client.0.smithi012.stderr: -197> 2023-10-05T11:41:37.554+0000 7f7636013880 5 AuthRegistry(0x7fff98e52c30) adding con mode: crc 2023-10-05T11:41:37.703 INFO:tasks.workunit.client.0.smithi012.stderr: -196> 2023-10-05T11:41:37.554+0000 7f7636013880 5 AuthRegistry(0x7fff98e52c30) adding con mode: secure 2023-10-05T11:41:37.703 INFO:tasks.workunit.client.0.smithi012.stderr: -195> 2023-10-05T11:41:37.554+0000 7f7636013880 5 AuthRegistry(0x7fff98e52c30) adding con mode: crc 2023-10-05T11:41:37.703 INFO:tasks.workunit.client.0.smithi012.stderr: -194> 2023-10-05T11:41:37.554+0000 7f7636013880 5 AuthRegistry(0x7fff98e52c30) adding con mode: secure 2023-10-05T11:41:37.703 INFO:tasks.workunit.client.0.smithi012.stderr: -193> 2023-10-05T11:41:37.554+0000 7f7636013880 5 AuthRegistry(0x7fff98e52c30) adding con mode: crc 2023-10-05T11:41:37.703 INFO:tasks.workunit.client.0.smithi012.stderr: -192> 2023-10-05T11:41:37.554+0000 7f7636013880 5 AuthRegistry(0x7fff98e52c30) adding con mode: crc 2023-10-05T11:41:37.703 INFO:tasks.workunit.client.0.smithi012.stderr: -191> 2023-10-05T11:41:37.554+0000 7f7636013880 5 AuthRegistry(0x7fff98e52c30) adding con mode: secure 2023-10-05T11:41:37.703 INFO:tasks.workunit.client.0.smithi012.stderr: -190> 2023-10-05T11:41:37.554+0000 7f7636013880 5 AuthRegistry(0x7fff98e52c30) adding con mode: crc 2023-10-05T11:41:37.703 INFO:tasks.workunit.client.0.smithi012.stderr: -189> 2023-10-05T11:41:37.554+0000 7f7636013880 5 AuthRegistry(0x7fff98e52c30) adding con mode: secure 2023-10-05T11:41:37.704 INFO:tasks.workunit.client.0.smithi012.stderr: -188> 2023-10-05T11:41:37.554+0000 7f7636013880 5 AuthRegistry(0x7fff98e52c30) adding con mode: crc 2023-10-05T11:41:37.704 INFO:tasks.workunit.client.0.smithi012.stderr: -187> 2023-10-05T11:41:37.554+0000 7f7636013880 5 AuthRegistry(0x7fff98e52c30) adding con mode: secure 2023-10-05T11:41:37.704 INFO:tasks.workunit.client.0.smithi012.stderr: -186> 2023-10-05T11:41:37.555+0000 7f7636013880 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-10-05T11:41:37.704 INFO:tasks.workunit.client.0.smithi012.stderr: -185> 2023-10-05T11:41:37.555+0000 7f7636013880 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-10-05T11:41:37.704 INFO:tasks.workunit.client.0.smithi012.stderr: -184> 2023-10-05T11:41:37.555+0000 7f7636013880 5 asok(0x561343438000) register_command rotate-key cmddesc rotate-key hook 0x7fff98e52d78 EEXIST 2023-10-05T11:41:37.704 INFO:tasks.workunit.client.0.smithi012.stderr: -183> 2023-10-05T11:41:37.555+0000 7f7636013880 10 monclient: _reopen_session rank -1 2023-10-05T11:41:37.704 INFO:tasks.workunit.client.0.smithi012.stderr: -182> 2023-10-05T11:41:37.555+0000 7f7636013880 10 monclient: _add_conns ranks=[0,2,1] 2023-10-05T11:41:37.704 INFO:tasks.workunit.client.0.smithi012.stderr: -181> 2023-10-05T11:41:37.555+0000 7f7636013880 10 monclient(hunting): picked mon.noname-a con 0x561343616800 addr [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] 2023-10-05T11:41:37.704 INFO:tasks.workunit.client.0.smithi012.stderr: -180> 2023-10-05T11:41:37.555+0000 7f7636013880 10 monclient(hunting): picked mon.noname-c con 0x561343616c00 addr [v2:172.21.15.12:3301/0,v1:172.21.15.12:6790/0] 2023-10-05T11:41:37.704 INFO:tasks.workunit.client.0.smithi012.stderr: -179> 2023-10-05T11:41:37.555+0000 7f7636013880 10 monclient(hunting): picked mon.noname-b con 0x561343617000 addr [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] 2023-10-05T11:41:37.704 INFO:tasks.workunit.client.0.smithi012.stderr: -178> 2023-10-05T11:41:37.555+0000 7f7636013880 10 monclient(hunting): start opening mon connection 2023-10-05T11:41:37.704 INFO:tasks.workunit.client.0.smithi012.stderr: -177> 2023-10-05T11:41:37.555+0000 7f7636013880 10 monclient(hunting): start opening mon connection 2023-10-05T11:41:37.705 INFO:tasks.workunit.client.0.smithi012.stderr: -176> 2023-10-05T11:41:37.555+0000 7f7636013880 10 monclient(hunting): start opening mon connection 2023-10-05T11:41:37.705 INFO:tasks.workunit.client.0.smithi012.stderr: -175> 2023-10-05T11:41:37.555+0000 7f7636013880 10 monclient(hunting): _renew_subs 2023-10-05T11:41:37.705 INFO:tasks.workunit.client.0.smithi012.stderr: -174> 2023-10-05T11:41:37.555+0000 7f7636013880 10 monclient(hunting): authenticate will time out at 1605.722824s 2023-10-05T11:41:37.705 INFO:tasks.workunit.client.0.smithi012.stderr: -173> 2023-10-05T11:41:37.555+0000 7f7632c8f640 10 monclient(hunting): get_auth_request con 0x561343616800 auth_method 0 2023-10-05T11:41:37.705 INFO:tasks.workunit.client.0.smithi012.stderr: -172> 2023-10-05T11:41:37.555+0000 7f7632c8f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-10-05T11:41:37.705 INFO:tasks.workunit.client.0.smithi012.stderr: -171> 2023-10-05T11:41:37.555+0000 7f7632c8f640 10 monclient(hunting): _init_auth method 2 2023-10-05T11:41:37.705 INFO:tasks.workunit.client.0.smithi012.stderr: -170> 2023-10-05T11:41:37.555+0000 7f7632c8f640 10 monclient(hunting): _init_auth creating new auth 2023-10-05T11:41:37.705 INFO:tasks.workunit.client.0.smithi012.stderr: -169> 2023-10-05T11:41:37.555+0000 7f763248e640 10 monclient(hunting): get_auth_request con 0x561343616c00 auth_method 0 2023-10-05T11:41:37.705 INFO:tasks.workunit.client.0.smithi012.stderr: -168> 2023-10-05T11:41:37.555+0000 7f763248e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-10-05T11:41:37.705 INFO:tasks.workunit.client.0.smithi012.stderr: -167> 2023-10-05T11:41:37.555+0000 7f763248e640 10 monclient(hunting): _init_auth method 2 2023-10-05T11:41:37.705 INFO:tasks.workunit.client.0.smithi012.stderr: -166> 2023-10-05T11:41:37.555+0000 7f763248e640 10 monclient(hunting): _init_auth creating new auth 2023-10-05T11:41:37.705 INFO:tasks.workunit.client.0.smithi012.stderr: -165> 2023-10-05T11:41:37.555+0000 7f7631c8d640 10 monclient(hunting): get_auth_request con 0x561343617000 auth_method 0 2023-10-05T11:41:37.705 INFO:tasks.workunit.client.0.smithi012.stderr: -164> 2023-10-05T11:41:37.555+0000 7f7631c8d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-10-05T11:41:37.706 INFO:tasks.workunit.client.0.smithi012.stderr: -163> 2023-10-05T11:41:37.555+0000 7f7631c8d640 10 monclient(hunting): _init_auth method 2 2023-10-05T11:41:37.706 INFO:tasks.workunit.client.0.smithi012.stderr: -162> 2023-10-05T11:41:37.555+0000 7f7631c8d640 10 monclient(hunting): _init_auth creating new auth 2023-10-05T11:41:37.706 INFO:tasks.workunit.client.0.smithi012.stderr: -161> 2023-10-05T11:41:37.555+0000 7f7632c8f640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-10-05T11:41:37.706 INFO:tasks.workunit.client.0.smithi012.stderr: -160> 2023-10-05T11:41:37.555+0000 7f7632c8f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-10-05T11:41:37.706 INFO:tasks.workunit.client.0.smithi012.stderr: -159> 2023-10-05T11:41:37.555+0000 7f7632c8f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-10-05T11:41:37.706 INFO:tasks.workunit.client.0.smithi012.stderr: -158> 2023-10-05T11:41:37.555+0000 7f763248e640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-10-05T11:41:37.706 INFO:tasks.workunit.client.0.smithi012.stderr: -157> 2023-10-05T11:41:37.555+0000 7f763248e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-10-05T11:41:37.706 INFO:tasks.workunit.client.0.smithi012.stderr: -156> 2023-10-05T11:41:37.555+0000 7f763248e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-10-05T11:41:37.706 INFO:tasks.workunit.client.0.smithi012.stderr: -155> 2023-10-05T11:41:37.555+0000 7f7631c8d640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-10-05T11:41:37.706 INFO:tasks.workunit.client.0.smithi012.stderr: -154> 2023-10-05T11:41:37.555+0000 7f7631c8d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-10-05T11:41:37.706 INFO:tasks.workunit.client.0.smithi012.stderr: -153> 2023-10-05T11:41:37.555+0000 7f7631c8d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-10-05T11:41:37.706 INFO:tasks.workunit.client.0.smithi012.stderr: -152> 2023-10-05T11:41:37.555+0000 7f763248e640 10 monclient(hunting): handle_auth_done global_id 6971 payload 274 2023-10-05T11:41:37.707 INFO:tasks.workunit.client.0.smithi012.stderr: -151> 2023-10-05T11:41:37.555+0000 7f763248e640 10 monclient: _finish_hunting 0 2023-10-05T11:41:37.707 INFO:tasks.workunit.client.0.smithi012.stderr: -150> 2023-10-05T11:41:37.555+0000 7f763248e640 1 monclient: found mon.noname-c 2023-10-05T11:41:37.707 INFO:tasks.workunit.client.0.smithi012.stderr: -149> 2023-10-05T11:41:37.555+0000 7f763248e640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.12:3301/0 2023-10-05T11:41:37.707 INFO:tasks.workunit.client.0.smithi012.stderr: -148> 2023-10-05T11:41:37.556+0000 7f7618c5b640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-10-05T11:41:37.707 INFO:tasks.workunit.client.0.smithi012.stderr: -147> 2023-10-05T11:41:37.556+0000 7f7618c5b640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2023-10-05T11:41:37.707 INFO:tasks.workunit.client.0.smithi012.stderr: -146> 2023-10-05T11:41:37.556+0000 7f7618c5b640 10 monclient: dump: 2023-10-05T11:41:37.707 INFO:tasks.workunit.client.0.smithi012.stderr:epoch 1 2023-10-05T11:41:37.707 INFO:tasks.workunit.client.0.smithi012.stderr:fsid 7e015f46-293b-4b09-bd32-7d32b52f6e2f 2023-10-05T11:41:37.708 INFO:tasks.workunit.client.0.smithi012.stderr:last_changed 2023-10-05T11:27:38.366888+0000 2023-10-05T11:41:37.708 INFO:tasks.workunit.client.0.smithi012.stderr:created 2023-10-05T11:27:38.366888+0000 2023-10-05T11:41:37.708 INFO:tasks.workunit.client.0.smithi012.stderr:min_mon_release 18 (reef) 2023-10-05T11:41:37.708 INFO:tasks.workunit.client.0.smithi012.stderr:election_strategy: 1 2023-10-05T11:41:37.708 INFO:tasks.workunit.client.0.smithi012.stderr:0: [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon.a 2023-10-05T11:41:37.708 INFO:tasks.workunit.client.0.smithi012.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2023-10-05T11:41:37.708 INFO:tasks.workunit.client.0.smithi012.stderr:2: [v2:172.21.15.12:3301/0,v1:172.21.15.12:6790/0] mon.c 2023-10-05T11:41:37.708 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:41:37.708 INFO:tasks.workunit.client.0.smithi012.stderr: -145> 2023-10-05T11:41:37.556+0000 7f7618c5b640 10 monclient: _finish_auth 0 2023-10-05T11:41:37.708 INFO:tasks.workunit.client.0.smithi012.stderr: -144> 2023-10-05T11:41:37.556+0000 7f7618c5b640 10 monclient: _check_auth_tickets 2023-10-05T11:41:37.708 INFO:tasks.workunit.client.0.smithi012.stderr: -143> 2023-10-05T11:41:37.556+0000 7f7618c5b640 10 monclient: handle_config config(0 keys) v1 2023-10-05T11:41:37.708 INFO:tasks.workunit.client.0.smithi012.stderr: -142> 2023-10-05T11:41:37.556+0000 7f7618c5b640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-10-05T11:41:37.709 INFO:tasks.workunit.client.0.smithi012.stderr: -141> 2023-10-05T11:41:37.556+0000 7f7618c5b640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-10-05T11:41:37.709 INFO:tasks.workunit.client.0.smithi012.stderr: -140> 2023-10-05T11:41:37.556+0000 7f7618c5b640 10 monclient: dump: 2023-10-05T11:41:37.709 INFO:tasks.workunit.client.0.smithi012.stderr:epoch 1 2023-10-05T11:41:37.709 INFO:tasks.workunit.client.0.smithi012.stderr:fsid 7e015f46-293b-4b09-bd32-7d32b52f6e2f 2023-10-05T11:41:37.709 INFO:tasks.workunit.client.0.smithi012.stderr:last_changed 2023-10-05T11:27:38.366888+0000 2023-10-05T11:41:37.709 INFO:tasks.workunit.client.0.smithi012.stderr:created 2023-10-05T11:27:38.366888+0000 2023-10-05T11:41:37.709 INFO:tasks.workunit.client.0.smithi012.stderr:min_mon_release 18 (reef) 2023-10-05T11:41:37.709 INFO:tasks.workunit.client.0.smithi012.stderr:election_strategy: 1 2023-10-05T11:41:37.709 INFO:tasks.workunit.client.0.smithi012.stderr:0: [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon.a 2023-10-05T11:41:37.709 INFO:tasks.workunit.client.0.smithi012.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2023-10-05T11:41:37.710 INFO:tasks.workunit.client.0.smithi012.stderr:2: [v2:172.21.15.12:3301/0,v1:172.21.15.12:6790/0] mon.c 2023-10-05T11:41:37.710 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:41:37.710 INFO:tasks.workunit.client.0.smithi012.stderr: -139> 2023-10-05T11:41:37.556+0000 7f7636013880 5 monclient: authenticate success, global_id 6971 2023-10-05T11:41:37.710 INFO:tasks.workunit.client.0.smithi012.stderr: -138> 2023-10-05T11:41:37.556+0000 7f7636013880 10 monclient: get_monmap_and_config success 2023-10-05T11:41:37.710 INFO:tasks.workunit.client.0.smithi012.stderr: -137> 2023-10-05T11:41:37.556+0000 7f7636013880 4 set_mon_vals no callback set 2023-10-05T11:41:37.710 INFO:tasks.workunit.client.0.smithi012.stderr: -136> 2023-10-05T11:41:37.556+0000 7f7636013880 10 monclient: shutdown 2023-10-05T11:41:37.710 INFO:tasks.workunit.client.0.smithi012.stderr: -135> 2023-10-05T11:41:37.556+0000 7f7636013880 10 monclient: build_initial_monmap 2023-10-05T11:41:37.710 INFO:tasks.workunit.client.0.smithi012.stderr: -134> 2023-10-05T11:41:37.556+0000 7f7636013880 1 build_initial for_mkfs: 0 2023-10-05T11:41:37.710 INFO:tasks.workunit.client.0.smithi012.stderr: -133> 2023-10-05T11:41:37.556+0000 7f7636013880 10 monclient: monmap: 2023-10-05T11:41:37.710 INFO:tasks.workunit.client.0.smithi012.stderr:epoch 0 2023-10-05T11:41:37.710 INFO:tasks.workunit.client.0.smithi012.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-10-05T11:41:37.710 INFO:tasks.workunit.client.0.smithi012.stderr:last_changed 0.000000 2023-10-05T11:41:37.711 INFO:tasks.workunit.client.0.smithi012.stderr:created 0.000000 2023-10-05T11:41:37.711 INFO:tasks.workunit.client.0.smithi012.stderr:min_mon_release 0 (unknown) 2023-10-05T11:41:37.711 INFO:tasks.workunit.client.0.smithi012.stderr:election_strategy: 1 2023-10-05T11:41:37.711 INFO:tasks.workunit.client.0.smithi012.stderr:0: [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon.noname-a 2023-10-05T11:41:37.711 INFO:tasks.workunit.client.0.smithi012.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.noname-b 2023-10-05T11:41:37.711 INFO:tasks.workunit.client.0.smithi012.stderr:2: [v2:172.21.15.12:3301/0,v1:172.21.15.12:6790/0] mon.noname-c 2023-10-05T11:41:37.711 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:41:37.711 INFO:tasks.workunit.client.0.smithi012.stderr: -132> 2023-10-05T11:41:37.556+0000 7f7636013880 5 AuthRegistry(0x561343ee9c40) adding auth protocol: cephx 2023-10-05T11:41:37.711 INFO:tasks.workunit.client.0.smithi012.stderr: -131> 2023-10-05T11:41:37.556+0000 7f7636013880 5 AuthRegistry(0x561343ee9c40) adding auth protocol: cephx 2023-10-05T11:41:37.711 INFO:tasks.workunit.client.0.smithi012.stderr: -130> 2023-10-05T11:41:37.556+0000 7f7636013880 5 AuthRegistry(0x561343ee9c40) adding auth protocol: cephx 2023-10-05T11:41:37.711 INFO:tasks.workunit.client.0.smithi012.stderr: -129> 2023-10-05T11:41:37.556+0000 7f7636013880 5 AuthRegistry(0x561343ee9c40) adding con mode: secure 2023-10-05T11:41:37.711 INFO:tasks.workunit.client.0.smithi012.stderr: -128> 2023-10-05T11:41:37.556+0000 7f7636013880 5 AuthRegistry(0x561343ee9c40) adding con mode: crc 2023-10-05T11:41:37.712 INFO:tasks.workunit.client.0.smithi012.stderr: -127> 2023-10-05T11:41:37.556+0000 7f7636013880 5 AuthRegistry(0x561343ee9c40) adding con mode: secure 2023-10-05T11:41:37.712 INFO:tasks.workunit.client.0.smithi012.stderr: -126> 2023-10-05T11:41:37.556+0000 7f7636013880 5 AuthRegistry(0x561343ee9c40) adding con mode: crc 2023-10-05T11:41:37.712 INFO:tasks.workunit.client.0.smithi012.stderr: -125> 2023-10-05T11:41:37.556+0000 7f7636013880 5 AuthRegistry(0x561343ee9c40) adding con mode: secure 2023-10-05T11:41:37.712 INFO:tasks.workunit.client.0.smithi012.stderr: -124> 2023-10-05T11:41:37.556+0000 7f7636013880 5 AuthRegistry(0x561343ee9c40) adding con mode: crc 2023-10-05T11:41:37.712 INFO:tasks.workunit.client.0.smithi012.stderr: -123> 2023-10-05T11:41:37.556+0000 7f7636013880 5 AuthRegistry(0x561343ee9c40) adding con mode: crc 2023-10-05T11:41:37.712 INFO:tasks.workunit.client.0.smithi012.stderr: -122> 2023-10-05T11:41:37.556+0000 7f7636013880 5 AuthRegistry(0x561343ee9c40) adding con mode: secure 2023-10-05T11:41:37.712 INFO:tasks.workunit.client.0.smithi012.stderr: -121> 2023-10-05T11:41:37.556+0000 7f7636013880 5 AuthRegistry(0x561343ee9c40) adding con mode: crc 2023-10-05T11:41:37.712 INFO:tasks.workunit.client.0.smithi012.stderr: -120> 2023-10-05T11:41:37.556+0000 7f7636013880 5 AuthRegistry(0x561343ee9c40) adding con mode: secure 2023-10-05T11:41:37.712 INFO:tasks.workunit.client.0.smithi012.stderr: -119> 2023-10-05T11:41:37.556+0000 7f7636013880 5 AuthRegistry(0x561343ee9c40) adding con mode: crc 2023-10-05T11:41:37.712 INFO:tasks.workunit.client.0.smithi012.stderr: -118> 2023-10-05T11:41:37.556+0000 7f7636013880 5 AuthRegistry(0x561343ee9c40) adding con mode: secure 2023-10-05T11:41:37.712 INFO:tasks.workunit.client.0.smithi012.stderr: -117> 2023-10-05T11:41:37.557+0000 7f7636013880 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-10-05T11:41:37.712 INFO:tasks.workunit.client.0.smithi012.stderr: -116> 2023-10-05T11:41:37.557+0000 7f7636013880 1 librados: starting msgr at 2023-10-05T11:41:37.713 INFO:tasks.workunit.client.0.smithi012.stderr: -115> 2023-10-05T11:41:37.557+0000 7f7636013880 1 librados: starting objecter 2023-10-05T11:41:37.713 INFO:tasks.workunit.client.0.smithi012.stderr: -114> 2023-10-05T11:41:37.557+0000 7f7636013880 5 asok(0x561343438000) register_command objecter_requests cmddesc objecter_requests hook 0x561343f49c40 EEXIST 2023-10-05T11:41:37.713 INFO:tasks.workunit.client.0.smithi012.stderr: -113> 2023-10-05T11:41:37.557+0000 7f7636013880 1 librados: setting wanted keys 2023-10-05T11:41:37.713 INFO:tasks.workunit.client.0.smithi012.stderr: -112> 2023-10-05T11:41:37.557+0000 7f7636013880 1 librados: calling monclient init 2023-10-05T11:41:37.713 INFO:tasks.workunit.client.0.smithi012.stderr: -111> 2023-10-05T11:41:37.557+0000 7f7636013880 10 monclient: init 2023-10-05T11:41:37.713 INFO:tasks.workunit.client.0.smithi012.stderr: -110> 2023-10-05T11:41:37.557+0000 7f7636013880 5 AuthRegistry(0x56134362f0d8) adding auth protocol: cephx 2023-10-05T11:41:37.713 INFO:tasks.workunit.client.0.smithi012.stderr: -109> 2023-10-05T11:41:37.557+0000 7f7636013880 5 AuthRegistry(0x56134362f0d8) adding auth protocol: cephx 2023-10-05T11:41:37.713 INFO:tasks.workunit.client.0.smithi012.stderr: -108> 2023-10-05T11:41:37.557+0000 7f7636013880 5 AuthRegistry(0x56134362f0d8) adding auth protocol: cephx 2023-10-05T11:41:37.713 INFO:tasks.workunit.client.0.smithi012.stderr: -107> 2023-10-05T11:41:37.557+0000 7f7636013880 5 AuthRegistry(0x56134362f0d8) adding con mode: secure 2023-10-05T11:41:37.713 INFO:tasks.workunit.client.0.smithi012.stderr: -106> 2023-10-05T11:41:37.557+0000 7f7636013880 5 AuthRegistry(0x56134362f0d8) adding con mode: crc 2023-10-05T11:41:37.713 INFO:tasks.workunit.client.0.smithi012.stderr: -105> 2023-10-05T11:41:37.557+0000 7f7636013880 5 AuthRegistry(0x56134362f0d8) adding con mode: secure 2023-10-05T11:41:37.713 INFO:tasks.workunit.client.0.smithi012.stderr: -104> 2023-10-05T11:41:37.557+0000 7f7636013880 5 AuthRegistry(0x56134362f0d8) adding con mode: crc 2023-10-05T11:41:37.714 INFO:tasks.workunit.client.0.smithi012.stderr: -103> 2023-10-05T11:41:37.557+0000 7f7636013880 5 AuthRegistry(0x56134362f0d8) adding con mode: secure 2023-10-05T11:41:37.714 INFO:tasks.workunit.client.0.smithi012.stderr: -102> 2023-10-05T11:41:37.557+0000 7f7636013880 5 AuthRegistry(0x56134362f0d8) adding con mode: crc 2023-10-05T11:41:37.714 INFO:tasks.workunit.client.0.smithi012.stderr: -101> 2023-10-05T11:41:37.557+0000 7f7636013880 5 AuthRegistry(0x56134362f0d8) adding con mode: crc 2023-10-05T11:41:37.714 INFO:tasks.workunit.client.0.smithi012.stderr: -100> 2023-10-05T11:41:37.557+0000 7f7636013880 5 AuthRegistry(0x56134362f0d8) adding con mode: secure 2023-10-05T11:41:37.714 INFO:tasks.workunit.client.0.smithi012.stderr: -99> 2023-10-05T11:41:37.557+0000 7f7636013880 5 AuthRegistry(0x56134362f0d8) adding con mode: crc 2023-10-05T11:41:37.714 INFO:tasks.workunit.client.0.smithi012.stderr: -98> 2023-10-05T11:41:37.557+0000 7f7636013880 5 AuthRegistry(0x56134362f0d8) adding con mode: secure 2023-10-05T11:41:37.714 INFO:tasks.workunit.client.0.smithi012.stderr: -97> 2023-10-05T11:41:37.557+0000 7f7636013880 5 AuthRegistry(0x56134362f0d8) adding con mode: crc 2023-10-05T11:41:37.714 INFO:tasks.workunit.client.0.smithi012.stderr: -96> 2023-10-05T11:41:37.557+0000 7f7636013880 5 AuthRegistry(0x56134362f0d8) adding con mode: secure 2023-10-05T11:41:37.714 INFO:tasks.workunit.client.0.smithi012.stderr: -95> 2023-10-05T11:41:37.557+0000 7f7636013880 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-10-05T11:41:37.714 INFO:tasks.workunit.client.0.smithi012.stderr: -94> 2023-10-05T11:41:37.557+0000 7f7636013880 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-10-05T11:41:37.714 INFO:tasks.workunit.client.0.smithi012.stderr: -93> 2023-10-05T11:41:37.557+0000 7f7636013880 5 asok(0x561343438000) register_command rotate-key cmddesc rotate-key hook 0x56134362f220 EEXIST 2023-10-05T11:41:37.714 INFO:tasks.workunit.client.0.smithi012.stderr: -92> 2023-10-05T11:41:37.557+0000 7f7636013880 10 monclient: _reopen_session rank -1 2023-10-05T11:41:37.715 INFO:tasks.workunit.client.0.smithi012.stderr: -91> 2023-10-05T11:41:37.557+0000 7f7636013880 10 monclient: _add_conns ranks=[0,2,1] 2023-10-05T11:41:37.715 INFO:tasks.workunit.client.0.smithi012.stderr: -90> 2023-10-05T11:41:37.557+0000 7f7636013880 10 monclient(hunting): picked mon.noname-a con 0x561343616800 addr [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] 2023-10-05T11:41:37.715 INFO:tasks.workunit.client.0.smithi012.stderr: -89> 2023-10-05T11:41:37.557+0000 7f7636013880 10 monclient(hunting): picked mon.noname-c con 0x561343616c00 addr [v2:172.21.15.12:3301/0,v1:172.21.15.12:6790/0] 2023-10-05T11:41:37.715 INFO:tasks.workunit.client.0.smithi012.stderr: -88> 2023-10-05T11:41:37.557+0000 7f7636013880 10 monclient(hunting): picked mon.noname-b con 0x561343617000 addr [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] 2023-10-05T11:41:37.715 INFO:tasks.workunit.client.0.smithi012.stderr: -87> 2023-10-05T11:41:37.557+0000 7f7636013880 10 monclient(hunting): start opening mon connection 2023-10-05T11:41:37.715 INFO:tasks.workunit.client.0.smithi012.stderr: -86> 2023-10-05T11:41:37.557+0000 7f7636013880 10 monclient(hunting): start opening mon connection 2023-10-05T11:41:37.715 INFO:tasks.workunit.client.0.smithi012.stderr: -85> 2023-10-05T11:41:37.557+0000 7f7636013880 10 monclient(hunting): start opening mon connection 2023-10-05T11:41:37.715 INFO:tasks.workunit.client.0.smithi012.stderr: -84> 2023-10-05T11:41:37.557+0000 7f7636013880 10 monclient(hunting): _renew_subs 2023-10-05T11:41:37.715 INFO:tasks.workunit.client.0.smithi012.stderr: -83> 2023-10-05T11:41:37.557+0000 7f7636013880 10 monclient(hunting): authenticate will time out at 1605.725099s 2023-10-05T11:41:37.715 INFO:tasks.workunit.client.0.smithi012.stderr: -82> 2023-10-05T11:41:37.557+0000 7f7632c8f640 10 monclient(hunting): get_auth_request con 0x561343616800 auth_method 0 2023-10-05T11:41:37.715 INFO:tasks.workunit.client.0.smithi012.stderr: -81> 2023-10-05T11:41:37.557+0000 7f7632c8f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-10-05T11:41:37.715 INFO:tasks.workunit.client.0.smithi012.stderr: -80> 2023-10-05T11:41:37.557+0000 7f7632c8f640 10 monclient(hunting): _init_auth method 2 2023-10-05T11:41:37.716 INFO:tasks.workunit.client.0.smithi012.stderr: -79> 2023-10-05T11:41:37.557+0000 7f7632c8f640 10 monclient(hunting): _init_auth creating new auth 2023-10-05T11:41:37.716 INFO:tasks.workunit.client.0.smithi012.stderr: -78> 2023-10-05T11:41:37.557+0000 7f763248e640 10 monclient(hunting): get_auth_request con 0x561343616c00 auth_method 0 2023-10-05T11:41:37.716 INFO:tasks.workunit.client.0.smithi012.stderr: -77> 2023-10-05T11:41:37.557+0000 7f763248e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-10-05T11:41:37.716 INFO:tasks.workunit.client.0.smithi012.stderr: -76> 2023-10-05T11:41:37.557+0000 7f763248e640 10 monclient(hunting): _init_auth method 2 2023-10-05T11:41:37.716 INFO:tasks.workunit.client.0.smithi012.stderr: -75> 2023-10-05T11:41:37.557+0000 7f763248e640 10 monclient(hunting): _init_auth creating new auth 2023-10-05T11:41:37.716 INFO:tasks.workunit.client.0.smithi012.stderr: -74> 2023-10-05T11:41:37.557+0000 7f7631c8d640 10 monclient(hunting): get_auth_request con 0x561343617000 auth_method 0 2023-10-05T11:41:37.716 INFO:tasks.workunit.client.0.smithi012.stderr: -73> 2023-10-05T11:41:37.557+0000 7f7631c8d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-10-05T11:41:37.716 INFO:tasks.workunit.client.0.smithi012.stderr: -72> 2023-10-05T11:41:37.557+0000 7f7631c8d640 10 monclient(hunting): _init_auth method 2 2023-10-05T11:41:37.716 INFO:tasks.workunit.client.0.smithi012.stderr: -71> 2023-10-05T11:41:37.557+0000 7f7631c8d640 10 monclient(hunting): _init_auth creating new auth 2023-10-05T11:41:37.716 INFO:tasks.workunit.client.0.smithi012.stderr: -70> 2023-10-05T11:41:37.557+0000 7f7632c8f640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-10-05T11:41:37.716 INFO:tasks.workunit.client.0.smithi012.stderr: -69> 2023-10-05T11:41:37.557+0000 7f7632c8f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-10-05T11:41:37.716 INFO:tasks.workunit.client.0.smithi012.stderr: -68> 2023-10-05T11:41:37.557+0000 7f7632c8f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-10-05T11:41:37.717 INFO:tasks.workunit.client.0.smithi012.stderr: -67> 2023-10-05T11:41:37.557+0000 7f763248e640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-10-05T11:41:37.717 INFO:tasks.workunit.client.0.smithi012.stderr: -66> 2023-10-05T11:41:37.557+0000 7f763248e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-10-05T11:41:37.717 INFO:tasks.workunit.client.0.smithi012.stderr: -65> 2023-10-05T11:41:37.557+0000 7f763248e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-10-05T11:41:37.717 INFO:tasks.workunit.client.0.smithi012.stderr: -64> 2023-10-05T11:41:37.557+0000 7f7631c8d640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-10-05T11:41:37.717 INFO:tasks.workunit.client.0.smithi012.stderr: -63> 2023-10-05T11:41:37.557+0000 7f7631c8d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-10-05T11:41:37.717 INFO:tasks.workunit.client.0.smithi012.stderr: -62> 2023-10-05T11:41:37.557+0000 7f7631c8d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-10-05T11:41:37.717 INFO:tasks.workunit.client.0.smithi012.stderr: -61> 2023-10-05T11:41:37.558+0000 7f7632c8f640 10 monclient(hunting): handle_auth_done global_id 7365 payload 824 2023-10-05T11:41:37.717 INFO:tasks.workunit.client.0.smithi012.stderr: -60> 2023-10-05T11:41:37.558+0000 7f7632c8f640 10 monclient: _finish_hunting 0 2023-10-05T11:41:37.717 INFO:tasks.workunit.client.0.smithi012.stderr: -59> 2023-10-05T11:41:37.558+0000 7f7632c8f640 1 monclient: found mon.noname-a 2023-10-05T11:41:37.717 INFO:tasks.workunit.client.0.smithi012.stderr: -58> 2023-10-05T11:41:37.558+0000 7f7632c8f640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.12:3300/0 2023-10-05T11:41:37.717 INFO:tasks.workunit.client.0.smithi012.stderr: -57> 2023-10-05T11:41:37.558+0000 7f7617458640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-10-05T11:41:37.718 INFO:tasks.workunit.client.0.smithi012.stderr: -56> 2023-10-05T11:41:37.558+0000 7f7617458640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2023-10-05T11:41:37.718 INFO:tasks.workunit.client.0.smithi012.stderr: -55> 2023-10-05T11:41:37.558+0000 7f7617458640 10 monclient: dump: 2023-10-05T11:41:37.718 INFO:tasks.workunit.client.0.smithi012.stderr:epoch 1 2023-10-05T11:41:37.718 INFO:tasks.workunit.client.0.smithi012.stderr:fsid 7e015f46-293b-4b09-bd32-7d32b52f6e2f 2023-10-05T11:41:37.718 INFO:tasks.workunit.client.0.smithi012.stderr:last_changed 2023-10-05T11:27:38.366888+0000 2023-10-05T11:41:37.718 INFO:tasks.workunit.client.0.smithi012.stderr:created 2023-10-05T11:27:38.366888+0000 2023-10-05T11:41:37.718 INFO:tasks.workunit.client.0.smithi012.stderr:min_mon_release 18 (reef) 2023-10-05T11:41:37.718 INFO:tasks.workunit.client.0.smithi012.stderr:election_strategy: 1 2023-10-05T11:41:37.718 INFO:tasks.workunit.client.0.smithi012.stderr:0: [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon.a 2023-10-05T11:41:37.718 INFO:tasks.workunit.client.0.smithi012.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2023-10-05T11:41:37.718 INFO:tasks.workunit.client.0.smithi012.stderr:2: [v2:172.21.15.12:3301/0,v1:172.21.15.12:6790/0] mon.c 2023-10-05T11:41:37.719 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:41:37.719 INFO:tasks.workunit.client.0.smithi012.stderr: -54> 2023-10-05T11:41:37.558+0000 7f7617458640 10 monclient: _finish_auth 0 2023-10-05T11:41:37.719 INFO:tasks.workunit.client.0.smithi012.stderr: -53> 2023-10-05T11:41:37.558+0000 7f7617458640 10 monclient: _check_auth_tickets 2023-10-05T11:41:37.719 INFO:tasks.workunit.client.0.smithi012.stderr: -52> 2023-10-05T11:41:37.558+0000 7f7617458640 10 monclient: handle_config config(0 keys) v1 2023-10-05T11:41:37.719 INFO:tasks.workunit.client.0.smithi012.stderr: -51> 2023-10-05T11:41:37.558+0000 7f7617458640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-10-05T11:41:37.719 INFO:tasks.workunit.client.0.smithi012.stderr: -50> 2023-10-05T11:41:37.558+0000 7f7617458640 10 monclient: got monmap 1 from mon.a (according to old e1) 2023-10-05T11:41:37.719 INFO:tasks.workunit.client.0.smithi012.stderr: -49> 2023-10-05T11:41:37.558+0000 7f7618c5b640 4 set_mon_vals no callback set 2023-10-05T11:41:37.719 INFO:tasks.workunit.client.0.smithi012.stderr: -48> 2023-10-05T11:41:37.558+0000 7f7617458640 10 monclient: dump: 2023-10-05T11:41:37.719 INFO:tasks.workunit.client.0.smithi012.stderr:epoch 1 2023-10-05T11:41:37.719 INFO:tasks.workunit.client.0.smithi012.stderr:fsid 7e015f46-293b-4b09-bd32-7d32b52f6e2f 2023-10-05T11:41:37.719 INFO:tasks.workunit.client.0.smithi012.stderr:last_changed 2023-10-05T11:27:38.366888+0000 2023-10-05T11:41:37.719 INFO:tasks.workunit.client.0.smithi012.stderr:created 2023-10-05T11:27:38.366888+0000 2023-10-05T11:41:37.720 INFO:tasks.workunit.client.0.smithi012.stderr:min_mon_release 18 (reef) 2023-10-05T11:41:37.720 INFO:tasks.workunit.client.0.smithi012.stderr:election_strategy: 1 2023-10-05T11:41:37.720 INFO:tasks.workunit.client.0.smithi012.stderr:0: [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon.a 2023-10-05T11:41:37.720 INFO:tasks.workunit.client.0.smithi012.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2023-10-05T11:41:37.720 INFO:tasks.workunit.client.0.smithi012.stderr:2: [v2:172.21.15.12:3301/0,v1:172.21.15.12:6790/0] mon.c 2023-10-05T11:41:37.720 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:41:37.720 INFO:tasks.workunit.client.0.smithi012.stderr: -47> 2023-10-05T11:41:37.558+0000 7f7636013880 5 monclient: authenticate success, global_id 7365 2023-10-05T11:41:37.720 INFO:tasks.workunit.client.0.smithi012.stderr: -46> 2023-10-05T11:41:37.558+0000 7f7636013880 10 monclient: _renew_subs 2023-10-05T11:41:37.720 INFO:tasks.workunit.client.0.smithi012.stderr: -45> 2023-10-05T11:41:37.558+0000 7f7636013880 10 monclient: _send_mon_message to mon.a at v2:172.21.15.12:3300/0 2023-10-05T11:41:37.720 INFO:tasks.workunit.client.0.smithi012.stderr: -44> 2023-10-05T11:41:37.558+0000 7f7636013880 10 monclient: _renew_subs 2023-10-05T11:41:37.720 INFO:tasks.workunit.client.0.smithi012.stderr: -43> 2023-10-05T11:41:37.558+0000 7f7636013880 10 monclient: _send_mon_message to mon.a at v2:172.21.15.12:3300/0 2023-10-05T11:41:37.720 INFO:tasks.workunit.client.0.smithi012.stderr: -42> 2023-10-05T11:41:37.558+0000 7f7636013880 1 librados: init done 2023-10-05T11:41:37.721 INFO:tasks.workunit.client.0.smithi012.stderr: -41> 2023-10-05T11:41:37.558+0000 7f7636013880 5 asok(0x561343438000) register_command cr dump hook 0x5613440071f8 2023-10-05T11:41:37.721 INFO:tasks.workunit.client.0.smithi012.stderr: -40> 2023-10-05T11:41:37.559+0000 7f7617458640 4 mgrc handle_mgr_map Got map version 5 2023-10-05T11:41:37.721 INFO:tasks.workunit.client.0.smithi012.stderr: -39> 2023-10-05T11:41:37.559+0000 7f7617458640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.170:6832/180516904,v1:172.21.15.170:6833/180516904] 2023-10-05T11:41:37.721 INFO:tasks.workunit.client.0.smithi012.stderr: -38> 2023-10-05T11:41:37.559+0000 7f7617458640 4 mgrc reconnect Starting new session with [v2:172.21.15.170:6832/180516904,v1:172.21.15.170:6833/180516904] 2023-10-05T11:41:37.721 INFO:tasks.workunit.client.0.smithi012.stderr: -37> 2023-10-05T11:41:37.560+0000 7f7636013880 5 note: GC not initialized 2023-10-05T11:41:37.721 INFO:tasks.workunit.client.0.smithi012.stderr: -36> 2023-10-05T11:41:37.560+0000 7f7614c53640 20 reqs_thread_entry: start 2023-10-05T11:41:37.721 INFO:tasks.workunit.client.0.smithi012.stderr: -35> 2023-10-05T11:41:37.560+0000 7f763248e640 10 monclient: get_auth_request con 0x561343667000 auth_method 0 2023-10-05T11:41:37.721 INFO:tasks.workunit.client.0.smithi012.stderr: -34> 2023-10-05T11:41:37.560+0000 7f7636013880 5 asok(0x561343438000) register_command sync trace show hook 0x561343182a80 2023-10-05T11:41:37.721 INFO:tasks.workunit.client.0.smithi012.stderr: -33> 2023-10-05T11:41:37.560+0000 7f7636013880 5 asok(0x561343438000) register_command sync trace history hook 0x561343182a80 2023-10-05T11:41:37.721 INFO:tasks.workunit.client.0.smithi012.stderr: -32> 2023-10-05T11:41:37.560+0000 7f7636013880 5 asok(0x561343438000) register_command sync trace active hook 0x561343182a80 2023-10-05T11:41:37.721 INFO:tasks.workunit.client.0.smithi012.stderr: -31> 2023-10-05T11:41:37.560+0000 7f7636013880 5 asok(0x561343438000) register_command sync trace active_short hook 0x561343182a80 2023-10-05T11:41:37.721 INFO:tasks.workunit.client.0.smithi012.stderr: -30> 2023-10-05T11:41:37.560+0000 7f7636013880 20 init_complete bucket index max shards: 11 2023-10-05T11:41:37.722 INFO:tasks.workunit.client.0.smithi012.stderr: -29> 2023-10-05T11:41:37.560+0000 7f7636013880 20 Filter name: none 2023-10-05T11:41:37.722 INFO:tasks.workunit.client.0.smithi012.stderr: -28> 2023-10-05T11:41:37.560+0000 7f7612c4f640 20 reqs_thread_entry: start 2023-10-05T11:41:37.722 INFO:tasks.workunit.client.0.smithi012.stderr: -27> 2023-10-05T11:41:37.560+0000 7f7636013880 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2023-10-05T11:41:37.722 INFO:tasks.workunit.client.0.smithi012.stderr: -26> 2023-10-05T11:41:37.560+0000 7f7636013880 20 rados->read ofs=0 len=0 2023-10-05T11:41:37.722 INFO:tasks.workunit.client.0.smithi012.stderr: -25> 2023-10-05T11:41:37.560+0000 7f7636013880 20 rados_obj.operate() r=0 bl.length=211 2023-10-05T11:41:37.722 INFO:tasks.workunit.client.0.smithi012.stderr: -24> 2023-10-05T11:41:37.560+0000 7f7636013880 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2023-10-05T11:41:37.722 INFO:tasks.workunit.client.0.smithi012.stderr: -23> 2023-10-05T11:41:37.560+0000 7f7636013880 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2023-10-05T11:41:37.722 INFO:tasks.workunit.client.0.smithi012.stderr: -22> 2023-10-05T11:41:37.560+0000 7f7636013880 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:dff27d1e-df33-400e-a68a-7ba586947c99.4604.27 : miss 2023-10-05T11:41:37.722 INFO:tasks.workunit.client.0.smithi012.stderr: -21> 2023-10-05T11:41:37.560+0000 7f7636013880 20 rados->read ofs=0 len=0 2023-10-05T11:41:37.722 INFO:tasks.workunit.client.0.smithi012.stderr: -20> 2023-10-05T11:41:37.561+0000 7f7636013880 20 rados_obj.operate() r=0 bl.length=383 2023-10-05T11:41:37.722 INFO:tasks.workunit.client.0.smithi012.stderr: -19> 2023-10-05T11:41:37.561+0000 7f7636013880 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:dff27d1e-df33-400e-a68a-7ba586947c99.4604.27 info.flags=0x17 2023-10-05T11:41:37.722 INFO:tasks.workunit.client.0.smithi012.stderr: -18> 2023-10-05T11:41:37.561+0000 7f7636013880 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:dff27d1e-df33-400e-a68a-7ba586947c99.4604.27 to cache LRU end 2023-10-05T11:41:37.723 INFO:tasks.workunit.client.0.smithi012.stderr: -17> 2023-10-05T11:41:37.561+0000 7f7636013880 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T11:41:37.723 INFO:tasks.workunit.client.0.smithi012.stderr: -16> 2023-10-05T11:41:37.561+0000 7f7636013880 10 updating xattr: name=user.rgw.acl bl.length()=265 2023-10-05T11:41:37.723 INFO:tasks.workunit.client.0.smithi012.stderr: -15> 2023-10-05T11:41:37.561+0000 7f7636013880 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:dff27d1e-df33-400e-a68a-7ba586947c99.4604.27 2023-10-05T11:41:37.723 INFO:tasks.workunit.client.0.smithi012.stderr: -14> 2023-10-05T11:41:37.561+0000 7f7631c8d640 10 monclient: get_auth_request con 0x561343617800 auth_method 0 2023-10-05T11:41:37.723 INFO:tasks.workunit.client.0.smithi012.stderr: -13> 2023-10-05T11:41:37.567+0000 7f7636013880 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:dff27d1e-df33-400e-a68a-7ba586947c99.4604.27 info.flags=0x17 2023-10-05T11:41:37.723 INFO:tasks.workunit.client.0.smithi012.stderr: -12> 2023-10-05T11:41:37.567+0000 7f7636013880 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:dff27d1e-df33-400e-a68a-7ba586947c99.4604.27 to cache LRU end 2023-10-05T11:41:37.723 INFO:tasks.workunit.client.0.smithi012.stderr: -11> 2023-10-05T11:41:37.567+0000 7f7636013880 10 updating xattr: name=user.rgw.acl bl.length()=265 2023-10-05T11:41:37.723 INFO:tasks.workunit.client.0.smithi012.stderr: -10> 2023-10-05T11:41:37.567+0000 7f7636013880 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:dff27d1e-df33-400e-a68a-7ba586947c99.4604.27, ofs0, ns] 2023-10-05T11:41:37.723 INFO:tasks.workunit.client.0.smithi012.stderr: -9> 2023-10-05T11:41:37.567+0000 7f762cc83640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1060856922181 cookie 94640734760960 notifier 6968 bl.length()=945 2023-10-05T11:41:37.723 INFO:tasks.workunit.client.0.smithi012.stderr: -8> 2023-10-05T11:41:37.567+0000 7f762cc83640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:dff27d1e-df33-400e-a68a-7ba586947c99.4604.27 info.flags=0x17 2023-10-05T11:41:37.723 INFO:tasks.workunit.client.0.smithi012.stderr: -7> 2023-10-05T11:41:37.567+0000 7f762cc83640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:dff27d1e-df33-400e-a68a-7ba586947c99.4604.27 to cache LRU end 2023-10-05T11:41:37.723 INFO:tasks.workunit.client.0.smithi012.stderr: -6> 2023-10-05T11:41:37.567+0000 7f762cc83640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2023-10-05T11:41:37.724 INFO:tasks.workunit.client.0.smithi012.stderr: -5> 2023-10-05T11:41:37.569+0000 7f7636013880 20 handle_bi_update(): bucket=:abort-at-do-reshard[dff27d1e-df33-400e-a68a-7ba586947c99.4604.27]): orig_sources= new_sources= 2023-10-05T11:41:37.724 INFO:tasks.workunit.client.0.smithi012.stderr: -4> 2023-10-05T11:41:37.569+0000 7f7636013880 20 handle_bi_update(): bucket=:abort-at-do-reshard[dff27d1e-df33-400e-a68a-7ba586947c99.4604.27]): potential sources added=[] removed=[] 2023-10-05T11:41:37.724 INFO:tasks.workunit.client.0.smithi012.stderr: -3> 2023-10-05T11:41:37.569+0000 7f7636013880 20 handle_bi_update(): bucket=:abort-at-do-reshard[dff27d1e-df33-400e-a68a-7ba586947c99.4604.27]): orig_dests= new_dests= 2023-10-05T11:41:37.724 INFO:tasks.workunit.client.0.smithi012.stderr: -2> 2023-10-05T11:41:37.569+0000 7f7636013880 20 handle_bi_update(): bucket=:abort-at-do-reshard[dff27d1e-df33-400e-a68a-7ba586947c99.4604.27]): potential dests added=[] removed=[] 2023-10-05T11:41:37.724 INFO:tasks.workunit.client.0.smithi012.stderr: -1> 2023-10-05T11:41:37.572+0000 7f7636013880 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6543-g38321be8/rpm/el9/BUILD/ceph-18.0.0-6543-g38321be8/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f7636013880 time 2023-10-05T11:41:37.572107+0000 2023-10-05T11:41:37.724 INFO:tasks.workunit.client.0.smithi012.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-6543-g38321be8/rpm/el9/BUILD/ceph-18.0.0-6543-g38321be8/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2023-10-05T11:41:37.724 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:41:37.724 INFO:tasks.workunit.client.0.smithi012.stderr: ceph version 18.0.0-6543-g38321be8 (38321be854743c0d616618a9ea8aa0b1d4dbc0bf) reef (dev) 2023-10-05T11:41:37.724 INFO:tasks.workunit.client.0.smithi012.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f763896d15f] 2023-10-05T11:41:37.724 INFO:tasks.workunit.client.0.smithi012.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16d31d) [0x7f763896d31d] 2023-10-05T11:41:37.724 INFO:tasks.workunit.client.0.smithi012.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5613412dac31] 2023-10-05T11:41:37.724 INFO:tasks.workunit.client.0.smithi012.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x314) [0x5613412f17a4] 2023-10-05T11:41:37.725 INFO:tasks.workunit.client.0.smithi012.stderr: 5: main() 2023-10-05T11:41:37.725 INFO:tasks.workunit.client.0.smithi012.stderr: 6: /lib64/libc.so.6(+0x3feb0) [0x7f7635e3feb0] 2023-10-05T11:41:37.725 INFO:tasks.workunit.client.0.smithi012.stderr: 7: __libc_start_main() 2023-10-05T11:41:37.725 INFO:tasks.workunit.client.0.smithi012.stderr: 8: _start() 2023-10-05T11:41:37.725 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:41:37.725 INFO:tasks.workunit.client.0.smithi012.stderr: 0> 2023-10-05T11:41:37.573+0000 7f7636013880 -1 *** Caught signal (Aborted) ** 2023-10-05T11:41:37.725 INFO:tasks.workunit.client.0.smithi012.stderr: in thread 7f7636013880 thread_name:radosgw-admin 2023-10-05T11:41:37.725 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:41:37.725 INFO:tasks.workunit.client.0.smithi012.stderr: ceph version 18.0.0-6543-g38321be8 (38321be854743c0d616618a9ea8aa0b1d4dbc0bf) reef (dev) 2023-10-05T11:41:37.725 INFO:tasks.workunit.client.0.smithi012.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f7635e54db0] 2023-10-05T11:41:37.725 INFO:tasks.workunit.client.0.smithi012.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f7635ea154c] 2023-10-05T11:41:37.725 INFO:tasks.workunit.client.0.smithi012.stderr: 3: raise() 2023-10-05T11:41:37.726 INFO:tasks.workunit.client.0.smithi012.stderr: 4: abort() 2023-10-05T11:41:37.726 INFO:tasks.workunit.client.0.smithi012.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f763896d1b9] 2023-10-05T11:41:37.726 INFO:tasks.workunit.client.0.smithi012.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16d31d) [0x7f763896d31d] 2023-10-05T11:41:37.726 INFO:tasks.workunit.client.0.smithi012.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5613412dac31] 2023-10-05T11:41:37.726 INFO:tasks.workunit.client.0.smithi012.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x314) [0x5613412f17a4] 2023-10-05T11:41:37.726 INFO:tasks.workunit.client.0.smithi012.stderr: 9: main() 2023-10-05T11:41:37.726 INFO:tasks.workunit.client.0.smithi012.stderr: 10: /lib64/libc.so.6(+0x3feb0) [0x7f7635e3feb0] 2023-10-05T11:41:37.726 INFO:tasks.workunit.client.0.smithi012.stderr: 11: __libc_start_main() 2023-10-05T11:41:37.726 INFO:tasks.workunit.client.0.smithi012.stderr: 12: _start() 2023-10-05T11:41:37.726 INFO:tasks.workunit.client.0.smithi012.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-10-05T11:41:37.726 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:41:37.726 INFO:tasks.workunit.client.0.smithi012.stderr:--- logging levels --- 2023-10-05T11:41:37.727 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 none 2023-10-05T11:41:37.727 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 1 lockdep 2023-10-05T11:41:37.727 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 1 context 2023-10-05T11:41:37.727 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 1 crush 2023-10-05T11:41:37.727 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 mds 2023-10-05T11:41:37.727 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 mds_balancer 2023-10-05T11:41:37.727 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 mds_locker 2023-10-05T11:41:37.727 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 mds_log 2023-10-05T11:41:37.727 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 mds_log_expire 2023-10-05T11:41:37.727 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 mds_migrator 2023-10-05T11:41:37.727 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 1 buffer 2023-10-05T11:41:37.727 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 1 timer 2023-10-05T11:41:37.727 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 1 filer 2023-10-05T11:41:37.727 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 1 striper 2023-10-05T11:41:37.728 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 1 objecter 2023-10-05T11:41:37.728 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 rados 2023-10-05T11:41:37.728 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 rbd 2023-10-05T11:41:37.728 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 rbd_mirror 2023-10-05T11:41:37.728 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 rbd_replay 2023-10-05T11:41:37.728 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 rbd_pwl 2023-10-05T11:41:37.728 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 journaler 2023-10-05T11:41:37.728 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 objectcacher 2023-10-05T11:41:37.728 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 immutable_obj_cache 2023-10-05T11:41:37.728 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 client 2023-10-05T11:41:37.728 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 osd 2023-10-05T11:41:37.728 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 optracker 2023-10-05T11:41:37.728 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 objclass 2023-10-05T11:41:37.728 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 3 filestore 2023-10-05T11:41:37.729 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 3 journal 2023-10-05T11:41:37.729 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 0 ms 2023-10-05T11:41:37.729 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 mon 2023-10-05T11:41:37.729 INFO:tasks.workunit.client.0.smithi012.stderr: 0/10 monc 2023-10-05T11:41:37.729 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 paxos 2023-10-05T11:41:37.729 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 tp 2023-10-05T11:41:37.729 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 auth 2023-10-05T11:41:37.729 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 crypto 2023-10-05T11:41:37.729 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 1 finisher 2023-10-05T11:41:37.729 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 1 reserver 2023-10-05T11:41:37.729 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 heartbeatmap 2023-10-05T11:41:37.729 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 perfcounter 2023-10-05T11:41:37.729 INFO:tasks.workunit.client.0.smithi012.stderr: 20/20 rgw 2023-10-05T11:41:37.730 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 rgw_sync 2023-10-05T11:41:37.730 INFO:tasks.workunit.client.0.smithi012.stderr: 30/30 rgw_datacache 2023-10-05T11:41:37.730 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 rgw_access 2023-10-05T11:41:37.730 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 rgw_dbstore 2023-10-05T11:41:37.730 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 rgw_flight 2023-10-05T11:41:37.730 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 javaclient 2023-10-05T11:41:37.730 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 asok 2023-10-05T11:41:37.730 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 1 throttle 2023-10-05T11:41:37.730 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 0 refs 2023-10-05T11:41:37.730 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 compressor 2023-10-05T11:41:37.730 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 bluestore 2023-10-05T11:41:37.730 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 bluefs 2023-10-05T11:41:37.731 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 3 bdev 2023-10-05T11:41:37.731 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 kstore 2023-10-05T11:41:37.731 INFO:tasks.workunit.client.0.smithi012.stderr: 4/ 5 rocksdb 2023-10-05T11:41:37.731 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 fuse 2023-10-05T11:41:37.731 INFO:tasks.workunit.client.0.smithi012.stderr: 2/ 5 mgr 2023-10-05T11:41:37.731 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 mgrc 2023-10-05T11:41:37.731 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 dpdk 2023-10-05T11:41:37.731 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 eventtrace 2023-10-05T11:41:37.731 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 prioritycache 2023-10-05T11:41:37.731 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 test 2023-10-05T11:41:37.731 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 cephfs_mirror 2023-10-05T11:41:37.731 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 cephsqlite 2023-10-05T11:41:37.731 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 seastore 2023-10-05T11:41:37.731 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 seastore_onode 2023-10-05T11:41:37.732 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 seastore_odata 2023-10-05T11:41:37.732 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 seastore_omap 2023-10-05T11:41:37.732 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 seastore_tm 2023-10-05T11:41:37.732 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 seastore_t 2023-10-05T11:41:37.732 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 seastore_cleaner 2023-10-05T11:41:37.732 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 seastore_epm 2023-10-05T11:41:37.732 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 seastore_lba 2023-10-05T11:41:37.732 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 seastore_fixedkv_tree 2023-10-05T11:41:37.732 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 seastore_cache 2023-10-05T11:41:37.732 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 seastore_journal 2023-10-05T11:41:37.732 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 seastore_device 2023-10-05T11:41:37.733 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 seastore_backref 2023-10-05T11:41:37.733 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 alienstore 2023-10-05T11:41:37.733 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 mclock 2023-10-05T11:41:37.733 INFO:tasks.workunit.client.0.smithi012.stderr: 0/ 5 cyanstore 2023-10-05T11:41:37.733 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 ceph_exporter 2023-10-05T11:41:37.733 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 memstore 2023-10-05T11:41:37.733 INFO:tasks.workunit.client.0.smithi012.stderr: 1/ 5 trace 2023-10-05T11:41:37.733 INFO:tasks.workunit.client.0.smithi012.stderr: -2/-2 (syslog threshold) 2023-10-05T11:41:37.733 INFO:tasks.workunit.client.0.smithi012.stderr: 99/99 (stderr threshold) 2023-10-05T11:41:37.733 INFO:tasks.workunit.client.0.smithi012.stderr:--- pthread ID / name mapping for recent threads --- 2023-10-05T11:41:37.733 INFO:tasks.workunit.client.0.smithi012.stderr: 7f7612c4f640 / http_manager 2023-10-05T11:41:37.733 INFO:tasks.workunit.client.0.smithi012.stderr: 7f7614c53640 / http_manager 2023-10-05T11:41:37.733 INFO:tasks.workunit.client.0.smithi012.stderr: 7f7617458640 / ms_dispatch 2023-10-05T11:41:37.734 INFO:tasks.workunit.client.0.smithi012.stderr: 7f7618c5b640 / io_context_pool 2023-10-05T11:41:37.734 INFO:tasks.workunit.client.0.smithi012.stderr: 7f761945c640 / rgw_dt_lg_renew 2023-10-05T11:41:37.734 INFO:tasks.workunit.client.0.smithi012.stderr: 7f762b480640 / ms_dispatch 2023-10-05T11:41:37.734 INFO:tasks.workunit.client.0.smithi012.stderr: 7f762cc83640 / io_context_pool 2023-10-05T11:41:37.734 INFO:tasks.workunit.client.0.smithi012.stderr: 7f762f488640 / ms_dispatch 2023-10-05T11:41:37.734 INFO:tasks.workunit.client.0.smithi012.stderr: 7f7630c8b640 / io_context_pool 2023-10-05T11:41:37.734 INFO:tasks.workunit.client.0.smithi012.stderr: 7f7631c8d640 / msgr-worker-2 2023-10-05T11:41:37.734 INFO:tasks.workunit.client.0.smithi012.stderr: 7f763248e640 / msgr-worker-1 2023-10-05T11:41:37.734 INFO:tasks.workunit.client.0.smithi012.stderr: 7f7632c8f640 / msgr-worker-0 2023-10-05T11:41:37.734 INFO:tasks.workunit.client.0.smithi012.stderr: 7f7636013880 / radosgw-admin 2023-10-05T11:41:37.734 INFO:tasks.workunit.client.0.smithi012.stderr: max_recent 500 2023-10-05T11:41:37.734 INFO:tasks.workunit.client.0.smithi012.stderr: max_new 1000 2023-10-05T11:41:37.735 INFO:tasks.workunit.client.0.smithi012.stderr: log_file /var/lib/ceph/crash/2023-10-05T11:41:37.573451Z_9dbf9991-11ff-40b6-b424-befd22b1f309/log 2023-10-05T11:41:37.735 INFO:tasks.workunit.client.0.smithi012.stderr:--- end dump of recent events --- 2023-10-05T11:41:37.735 INFO:tasks.workunit.client.0.smithi012.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2023-10-05T11:41:37.739 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setuser ceph since I am not root 2023-10-05T11:41:37.739 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T11:41:37.740 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.619+0000 7f5861729880 20 rados->read ofs=0 len=0 2023-10-05T11:41:37.740 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.621+0000 7f5861729880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:37.740 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.621+0000 7f5861729880 20 realm 2023-10-05T11:41:37.740 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.621+0000 7f5861729880 20 rados->read ofs=0 len=0 2023-10-05T11:41:37.740 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.621+0000 7f5861729880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:37.740 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.621+0000 7f5861729880 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T11:41:37.740 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.621+0000 7f5861729880 20 rados->read ofs=0 len=0 2023-10-05T11:41:37.740 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.621+0000 7f5861729880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:37.740 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.621+0000 7f5861729880 20 rados->read ofs=0 len=0 2023-10-05T11:41:37.740 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.622+0000 7f5861729880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:41:37.741 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.622+0000 7f5861729880 20 rados->read ofs=0 len=0 2023-10-05T11:41:37.741 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.623+0000 7f5861729880 20 rados_obj.operate() r=0 bl.length=1020 2023-10-05T11:41:37.741 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.623+0000 7f5861729880 20 searching for the correct realm 2023-10-05T11:41:37.741 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.632+0000 7f585e12a640 0 -- 172.21.15.12:0/3344326031 >> [v2:172.21.15.170:6814/3150808418,v1:172.21.15.170:6816/3150808418] conn(0x56384e8b7c00 msgr2=0x56384dcc0c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-10-05T11:41:37.741 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.633+0000 7f5861729880 20 RGWRados::pool_iterate: got zone_info.dff27d1e-df33-400e-a68a-7ba586947c99 2023-10-05T11:41:37.741 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.633+0000 7f5861729880 20 RGWRados::pool_iterate: got zonegroup_info.c78aa576-9d15-4e9d-b3c0-4af23a22062c 2023-10-05T11:41:37.741 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.633+0000 7f5861729880 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T11:41:37.741 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.633+0000 7f5861729880 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T11:41:37.741 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.633+0000 7f5861729880 20 rados->read ofs=0 len=0 2023-10-05T11:41:37.741 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.633+0000 7f5861729880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:37.741 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.633+0000 7f5861729880 20 rados->read ofs=0 len=0 2023-10-05T11:41:37.741 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.634+0000 7f5861729880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:41:37.742 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.634+0000 7f5861729880 20 rados->read ofs=0 len=0 2023-10-05T11:41:37.742 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.634+0000 7f5861729880 20 rados_obj.operate() r=0 bl.length=454 2023-10-05T11:41:37.742 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.634+0000 7f5861729880 20 zone default found 2023-10-05T11:41:37.742 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.634+0000 7f5861729880 4 Realm: () 2023-10-05T11:41:37.742 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.634+0000 7f5861729880 4 ZoneGroup: default (c78aa576-9d15-4e9d-b3c0-4af23a22062c) 2023-10-05T11:41:37.742 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.634+0000 7f5861729880 4 Zone: default (dff27d1e-df33-400e-a68a-7ba586947c99) 2023-10-05T11:41:37.742 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.634+0000 7f5861729880 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T11:41:37.742 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.634+0000 7f5861729880 20 zonegroup default 2023-10-05T11:41:37.742 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.634+0000 7f5861729880 20 rados->read ofs=0 len=0 2023-10-05T11:41:37.742 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.634+0000 7f5861729880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:37.742 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.634+0000 7f5861729880 20 rados->read ofs=0 len=0 2023-10-05T11:41:37.743 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.634+0000 7f5861729880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:37.743 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.634+0000 7f5861729880 20 rados->read ofs=0 len=0 2023-10-05T11:41:37.743 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.635+0000 7f5861729880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:37.743 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.635+0000 7f5861729880 20 started sync module instance, tier type = 2023-10-05T11:41:37.743 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.635+0000 7f5861729880 20 started zone id=dff27d1e-df33-400e-a68a-7ba586947c99 (name=default) with tier type = 2023-10-05T11:41:37.743 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.641+0000 7f585e92b640 0 -- 172.21.15.12:0/3344326031 >> [v2:172.21.15.170:6800/4137726411,v1:172.21.15.170:6801/4137726411] conn(0x56384de77c00 msgr2=0x56384dd89600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:41:37.743 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.644+0000 7f5861729880 20 add_watcher() i=0 2023-10-05T11:41:37.743 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.644+0000 7f5861729880 20 add_watcher() i=1 2023-10-05T11:41:37.743 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.644+0000 7f5861729880 20 add_watcher() i=2 2023-10-05T11:41:37.743 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.644+0000 7f5861729880 20 add_watcher() i=3 2023-10-05T11:41:37.744 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.644+0000 7f5861729880 20 add_watcher() i=4 2023-10-05T11:41:37.744 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.644+0000 7f5861729880 20 add_watcher() i=5 2023-10-05T11:41:37.744 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.644+0000 7f5861729880 20 add_watcher() i=6 2023-10-05T11:41:37.744 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.645+0000 7f5861729880 20 add_watcher() i=7 2023-10-05T11:41:37.744 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.645+0000 7f5861729880 2 all 8 watchers are set, enabling cache 2023-10-05T11:41:37.744 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.646+0000 7f58450f8640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:41:37.744 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.647+0000 7f5861729880 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T11:41:37.744 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.647+0000 7f5861729880 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T11:41:37.744 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.652+0000 7f5861729880 5 note: GC not initialized 2023-10-05T11:41:37.744 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.652+0000 7f58408ef640 20 reqs_thread_entry: start 2023-10-05T11:41:37.744 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.652+0000 7f5861729880 20 init_complete bucket index max shards: 11 2023-10-05T11:41:37.744 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.652+0000 7f5861729880 20 Filter name: none 2023-10-05T11:41:37.745 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.652+0000 7f583e8eb640 20 reqs_thread_entry: start 2023-10-05T11:41:37.745 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.652+0000 7f5861729880 20 rados->read ofs=0 len=0 2023-10-05T11:41:37.745 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.653+0000 7f5861729880 20 rados_obj.operate() r=0 bl.length=211 2023-10-05T11:41:37.745 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.653+0000 7f5861729880 20 rados->read ofs=0 len=0 2023-10-05T11:41:37.745 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.653+0000 7f5861729880 20 rados_obj.operate() r=0 bl.length=415 2023-10-05T11:41:37.745 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.653+0000 7f5861729880 20 couldn't put binfo cache entry, might have raced with data changes 2023-10-05T11:41:37.745 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.653+0000 7f5861729880 20 rados->read ofs=0 len=0 2023-10-05T11:41:37.745 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.654+0000 7f5861729880 20 rados_obj.operate() r=0 bl.length=211 2023-10-05T11:41:37.745 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.654+0000 7f5861729880 20 rados->read ofs=0 len=0 2023-10-05T11:41:37.745 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.654+0000 7f5861729880 20 rados_obj.operate() r=0 bl.length=415 2023-10-05T11:41:37.745 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.654+0000 7f5861729880 20 couldn't put binfo cache entry, might have raced with data changes 2023-10-05T11:41:37.746 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.655+0000 7f5861729880 20 rados->read ofs=0 len=0 2023-10-05T11:41:37.746 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.655+0000 7f5861729880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:41:37.746 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.656+0000 7f58450f8640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:41:37.746 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.658+0000 7f5861729880 20 remove_watcher() i=0 2023-10-05T11:41:37.746 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.658+0000 7f5861729880 2 removed watcher, disabling cache 2023-10-05T11:41:37.746 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.659+0000 7f5861729880 20 remove_watcher() i=1 2023-10-05T11:41:37.746 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.660+0000 7f5861729880 20 remove_watcher() i=2 2023-10-05T11:41:37.746 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.661+0000 7f5861729880 20 remove_watcher() i=3 2023-10-05T11:41:37.746 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.662+0000 7f5861729880 20 remove_watcher() i=4 2023-10-05T11:41:37.746 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.663+0000 7f5861729880 20 remove_watcher() i=5 2023-10-05T11:41:37.746 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.664+0000 7f5861729880 20 remove_watcher() i=6 2023-10-05T11:41:37.746 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:41:37.665+0000 7f5861729880 20 remove_watcher() i=7 2023-10-05T11:41:37.746 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:41:37.747 INFO:tasks.workunit.client.0.smithi012.stderr:BUCKET_STATS: 2023-10-05T11:41:37.747 INFO:tasks.workunit.client.0.smithi012.stderr:bucket: abort-at-do-reshard id: dff27d1e-df33-400e-a68a-7ba586947c99.4604.27 num_objects: 20 size_kb: 1 num_shards: 11 2023-10-05T11:41:37.747 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:42:07.838 INFO:tasks.workunit.client.0.smithi012.stderr:radosgw-admin bucket reshard --bucket abort-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2023-10-05T11:42:07.873 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setuser ceph since I am not root 2023-10-05T11:42:07.874 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T11:42:07.888 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:07.885+0000 7fab0ae8b880 20 rados->read ofs=0 len=0 2023-10-05T11:42:07.889 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:07.887+0000 7fab0ae8b880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:42:07.889 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:07.887+0000 7fab0ae8b880 20 realm 2023-10-05T11:42:07.890 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:07.887+0000 7fab0ae8b880 20 rados->read ofs=0 len=0 2023-10-05T11:42:07.890 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:07.887+0000 7fab0ae8b880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:42:07.890 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:07.887+0000 7fab0ae8b880 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T11:42:07.890 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:07.887+0000 7fab0ae8b880 20 rados->read ofs=0 len=0 2023-10-05T11:42:07.890 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:07.887+0000 7fab0ae8b880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:42:07.890 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:07.887+0000 7fab0ae8b880 20 rados->read ofs=0 len=0 2023-10-05T11:42:07.890 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:07.888+0000 7fab0ae8b880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:42:07.891 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:07.888+0000 7fab0ae8b880 20 rados->read ofs=0 len=0 2023-10-05T11:42:07.893 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:07.889+0000 7fab0ae8b880 20 rados_obj.operate() r=0 bl.length=1020 2023-10-05T11:42:07.893 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:07.889+0000 7fab0ae8b880 20 searching for the correct realm 2023-10-05T11:42:07.902 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:07.900+0000 7fab09630640 0 -- 172.21.15.12:0/4169393163 >> [v2:172.21.15.12:6800/732466381,v1:172.21.15.12:6801/732466381] conn(0x555b709fd800 msgr2=0x555b709e8100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:42:07.905 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:07.901+0000 7fab0ae8b880 20 RGWRados::pool_iterate: got zone_info.dff27d1e-df33-400e-a68a-7ba586947c99 2023-10-05T11:42:07.905 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:07.901+0000 7fab0ae8b880 20 RGWRados::pool_iterate: got zonegroup_info.c78aa576-9d15-4e9d-b3c0-4af23a22062c 2023-10-05T11:42:07.905 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:07.901+0000 7fab0ae8b880 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T11:42:07.905 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:07.901+0000 7fab0ae8b880 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T11:42:07.905 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:07.901+0000 7fab0ae8b880 20 rados->read ofs=0 len=0 2023-10-05T11:42:07.905 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:07.902+0000 7fab0ae8b880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:42:07.905 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:07.902+0000 7fab0ae8b880 20 rados->read ofs=0 len=0 2023-10-05T11:42:07.905 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:07.902+0000 7fab0ae8b880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:42:07.905 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:07.902+0000 7fab0ae8b880 20 rados->read ofs=0 len=0 2023-10-05T11:42:07.906 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:07.902+0000 7fab0ae8b880 20 rados_obj.operate() r=0 bl.length=454 2023-10-05T11:42:07.906 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:07.902+0000 7fab0ae8b880 20 zone default found 2023-10-05T11:42:07.906 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:07.902+0000 7fab0ae8b880 4 Realm: () 2023-10-05T11:42:07.906 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:07.902+0000 7fab0ae8b880 4 ZoneGroup: default (c78aa576-9d15-4e9d-b3c0-4af23a22062c) 2023-10-05T11:42:07.906 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:07.902+0000 7fab0ae8b880 4 Zone: default (dff27d1e-df33-400e-a68a-7ba586947c99) 2023-10-05T11:42:07.906 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:07.902+0000 7fab0ae8b880 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T11:42:07.906 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:07.902+0000 7fab0ae8b880 20 zonegroup default 2023-10-05T11:42:07.906 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:07.902+0000 7fab0ae8b880 20 rados->read ofs=0 len=0 2023-10-05T11:42:07.906 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:07.902+0000 7fab0ae8b880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:42:07.906 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:07.902+0000 7fab0ae8b880 20 rados->read ofs=0 len=0 2023-10-05T11:42:07.907 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:07.903+0000 7fab0ae8b880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:42:07.907 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:07.903+0000 7fab0ae8b880 20 rados->read ofs=0 len=0 2023-10-05T11:42:07.907 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:07.903+0000 7fab0ae8b880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:42:07.907 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:07.903+0000 7fab0ae8b880 20 started sync module instance, tier type = 2023-10-05T11:42:07.907 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:07.903+0000 7fab0ae8b880 20 started zone id=dff27d1e-df33-400e-a68a-7ba586947c99 (name=default) with tier type = 2023-10-05T11:42:07.911 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:07.909+0000 7fab09630640 0 -- 172.21.15.12:0/4169393163 >> [v2:172.21.15.12:6800/732466381,v1:172.21.15.12:6801/732466381] conn(0x555b709ea000 msgr2=0x555b709e6b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:42:07.915 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:07.913+0000 7fab0ae8b880 20 add_watcher() i=0 2023-10-05T11:42:07.915 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:07.913+0000 7fab0ae8b880 20 add_watcher() i=1 2023-10-05T11:42:07.915 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:07.913+0000 7fab0ae8b880 20 add_watcher() i=2 2023-10-05T11:42:07.915 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:07.913+0000 7fab0ae8b880 20 add_watcher() i=3 2023-10-05T11:42:07.915 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:07.913+0000 7fab0ae8b880 20 add_watcher() i=4 2023-10-05T11:42:07.915 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:07.913+0000 7fab0ae8b880 20 add_watcher() i=5 2023-10-05T11:42:07.915 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:07.913+0000 7fab0ae8b880 20 add_watcher() i=6 2023-10-05T11:42:07.916 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:07.914+0000 7fab0ae8b880 20 add_watcher() i=7 2023-10-05T11:42:07.916 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:07.914+0000 7fab0ae8b880 2 all 8 watchers are set, enabling cache 2023-10-05T11:42:07.918 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:07.915+0000 7faaf05fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:42:07.918 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:07.916+0000 7fab0ae8b880 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T11:42:07.918 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:07.916+0000 7fab0ae8b880 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T11:42:07.924 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:07.921+0000 7fab0ae8b880 5 note: GC not initialized 2023-10-05T11:42:07.924 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:07.921+0000 7faaebdf5640 20 reqs_thread_entry: start 2023-10-05T11:42:07.924 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:07.922+0000 7fab0ae8b880 20 init_complete bucket index max shards: 11 2023-10-05T11:42:07.924 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:07.922+0000 7fab0ae8b880 20 Filter name: none 2023-10-05T11:42:07.924 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:07.922+0000 7faae9df1640 20 reqs_thread_entry: start 2023-10-05T11:42:07.924 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:07.922+0000 7fab0ae8b880 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2023-10-05T11:42:07.925 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:07.922+0000 7fab0ae8b880 20 rados->read ofs=0 len=0 2023-10-05T11:42:07.925 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:07.922+0000 7fab0ae8b880 20 rados_obj.operate() r=0 bl.length=211 2023-10-05T11:42:07.926 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:07.922+0000 7fab0ae8b880 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2023-10-05T11:42:07.926 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:07.922+0000 7fab0ae8b880 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2023-10-05T11:42:07.926 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:07.922+0000 7fab0ae8b880 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:dff27d1e-df33-400e-a68a-7ba586947c99.4604.27 : miss 2023-10-05T11:42:07.926 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:07.922+0000 7fab0ae8b880 20 rados->read ofs=0 len=0 2023-10-05T11:42:07.926 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:07.923+0000 7fab0ae8b880 20 rados_obj.operate() r=0 bl.length=383 2023-10-05T11:42:07.926 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:07.923+0000 7fab0ae8b880 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:dff27d1e-df33-400e-a68a-7ba586947c99.4604.27 info.flags=0x17 2023-10-05T11:42:07.926 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:07.923+0000 7fab0ae8b880 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:dff27d1e-df33-400e-a68a-7ba586947c99.4604.27 to cache LRU end 2023-10-05T11:42:07.926 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:07.923+0000 7fab0ae8b880 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T11:42:07.926 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:07.923+0000 7fab0ae8b880 10 updating xattr: name=user.rgw.acl bl.length()=265 2023-10-05T11:42:07.926 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:07.923+0000 7fab0ae8b880 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:dff27d1e-df33-400e-a68a-7ba586947c99.4604.27 2023-10-05T11:42:07.931 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:07.928+0000 7fab0ae8b880 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:dff27d1e-df33-400e-a68a-7ba586947c99.4604.27 info.flags=0x17 2023-10-05T11:42:07.931 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:07.928+0000 7fab0ae8b880 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:dff27d1e-df33-400e-a68a-7ba586947c99.4604.27 to cache LRU end 2023-10-05T11:42:07.931 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:07.928+0000 7fab0ae8b880 10 updating xattr: name=user.rgw.acl bl.length()=265 2023-10-05T11:42:07.931 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:07.928+0000 7fab0ae8b880 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:dff27d1e-df33-400e-a68a-7ba586947c99.4604.27, ofs0, ns] 2023-10-05T11:42:07.931 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:07.929+0000 7fab03624640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1060856922183 cookie 93851221020672 notifier 7401 bl.length()=945 2023-10-05T11:42:07.931 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:07.929+0000 7fab03624640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:dff27d1e-df33-400e-a68a-7ba586947c99.4604.27 info.flags=0x17 2023-10-05T11:42:07.931 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:07.929+0000 7fab03624640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:dff27d1e-df33-400e-a68a-7ba586947c99.4604.27 to cache LRU end 2023-10-05T11:42:07.931 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:07.929+0000 7fab03624640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2023-10-05T11:42:07.933 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:07.931+0000 7fab0ae8b880 20 handle_bi_update(): bucket=:abort-at-do-reshard[dff27d1e-df33-400e-a68a-7ba586947c99.4604.27]): orig_sources= new_sources= 2023-10-05T11:42:07.933 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:07.931+0000 7fab0ae8b880 20 handle_bi_update(): bucket=:abort-at-do-reshard[dff27d1e-df33-400e-a68a-7ba586947c99.4604.27]): potential sources added=[] removed=[] 2023-10-05T11:42:07.933 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:07.931+0000 7fab0ae8b880 20 handle_bi_update(): bucket=:abort-at-do-reshard[dff27d1e-df33-400e-a68a-7ba586947c99.4604.27]): orig_dests= new_dests= 2023-10-05T11:42:07.933 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:07.931+0000 7fab0ae8b880 20 handle_bi_update(): bucket=:abort-at-do-reshard[dff27d1e-df33-400e-a68a-7ba586947c99.4604.27]): potential dests added=[] removed=[] 2023-10-05T11:42:07.935 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:07.933+0000 7fab0ae8b880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.27.1.0 2023-10-05T11:42:07.936 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:07.933+0000 7fab0ae8b880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.27.1.0 2023-10-05T11:42:07.936 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:07.933+0000 7fab0ae8b880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.27.1.1 2023-10-05T11:42:07.936 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:07.933+0000 7fab0ae8b880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.27.1.1 2023-10-05T11:42:07.936 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:07.933+0000 7fab0ae8b880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.27.1.2 2023-10-05T11:42:07.936 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:07.933+0000 7fab0ae8b880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.27.1.2 2023-10-05T11:42:07.936 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:07.933+0000 7fab0ae8b880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.27.1.3 2023-10-05T11:42:07.936 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:07.933+0000 7fab0ae8b880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.27.1.3 2023-10-05T11:42:07.936 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:07.933+0000 7fab0ae8b880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.27.1.4 2023-10-05T11:42:07.936 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:07.933+0000 7fab0ae8b880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.27.1.4 2023-10-05T11:42:07.936 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:07.933+0000 7fab0ae8b880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.27.1.5 2023-10-05T11:42:07.936 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:07.933+0000 7fab0ae8b880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.27.1.5 2023-10-05T11:42:07.937 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:07.933+0000 7fab0ae8b880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.27.1.6 2023-10-05T11:42:07.937 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:07.933+0000 7fab0ae8b880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.27.1.6 2023-10-05T11:42:07.937 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:07.933+0000 7fab0ae8b880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.27.1.7 2023-10-05T11:42:07.937 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:07.933+0000 7fab0ae8b880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.27.1.7 2023-10-05T11:42:07.937 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:07.933+0000 7fab0ae8b880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.27.1.8 2023-10-05T11:42:07.937 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:07.933+0000 7fab0ae8b880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.27.1.8 2023-10-05T11:42:07.937 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:07.933+0000 7fab0ae8b880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.27.1.9 2023-10-05T11:42:07.937 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:07.933+0000 7fab0ae8b880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.27.1.9 2023-10-05T11:42:07.937 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:07.933+0000 7fab0ae8b880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.27.1.10 2023-10-05T11:42:07.937 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:07.933+0000 7fab0ae8b880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.27.1.10 2023-10-05T11:42:07.937 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:07.933+0000 7fab0ae8b880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.27.1.11 2023-10-05T11:42:07.937 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:07.933+0000 7fab0ae8b880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.27.1.11 2023-10-05T11:42:07.938 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:07.933+0000 7fab0ae8b880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.27.0 2023-10-05T11:42:07.938 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:07.934+0000 7fab0ae8b880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.27.1 2023-10-05T11:42:07.939 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:07.934+0000 7fab0ae8b880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.27.2 2023-10-05T11:42:07.939 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:07.934+0000 7fab0ae8b880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.27.3 2023-10-05T11:42:07.939 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:07.935+0000 7fab0ae8b880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.27.4 2023-10-05T11:42:07.939 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:07.935+0000 7fab0ae8b880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.27.5 2023-10-05T11:42:07.939 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:07.936+0000 7fab0ae8b880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.27.6 2023-10-05T11:42:07.939 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:07.936+0000 7fab0ae8b880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.27.7 2023-10-05T11:42:07.939 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:07.937+0000 7fab0ae8b880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.27.8 2023-10-05T11:42:07.940 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:07.937+0000 7fab0ae8b880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.27.9 2023-10-05T11:42:07.940 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:07.938+0000 7fab0ae8b880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.27.10 2023-10-05T11:42:07.943 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:07.941+0000 7fab0ae8b880 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:dff27d1e-df33-400e-a68a-7ba586947c99.4604.27 : hit (requested=0x17, cached=0x17) 2023-10-05T11:42:07.943 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:07.941+0000 7fab0ae8b880 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:dff27d1e-df33-400e-a68a-7ba586947c99.4604.27 2023-10-05T11:42:07.944 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:07.942+0000 7fab0ae8b880 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:dff27d1e-df33-400e-a68a-7ba586947c99.4604.27 info.flags=0x17 2023-10-05T11:42:07.944 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:07.942+0000 7fab0ae8b880 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:dff27d1e-df33-400e-a68a-7ba586947c99.4604.27 to cache LRU end 2023-10-05T11:42:07.944 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:07.942+0000 7fab0ae8b880 10 updating xattr: name=user.rgw.acl bl.length()=265 2023-10-05T11:42:07.945 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:07.942+0000 7fab0ae8b880 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:dff27d1e-df33-400e-a68a-7ba586947c99.4604.27, ofs0, ns] 2023-10-05T11:42:07.945 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:07.942+0000 7fab03e25640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1060856922184 cookie 93851221020672 notifier 7401 bl.length()=913 2023-10-05T11:42:07.945 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:07.942+0000 7fab03e25640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:dff27d1e-df33-400e-a68a-7ba586947c99.4604.27 info.flags=0x17 2023-10-05T11:42:07.945 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:07.942+0000 7fab03e25640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:dff27d1e-df33-400e-a68a-7ba586947c99.4604.27 to cache LRU end 2023-10-05T11:42:07.945 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:07.942+0000 7fab03e25640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2023-10-05T11:42:07.946 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:07.944+0000 7fab0ae8b880 20 handle_bi_update(): bucket=:abort-at-do-reshard[dff27d1e-df33-400e-a68a-7ba586947c99.4604.27]): orig_sources= new_sources= 2023-10-05T11:42:07.946 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:07.944+0000 7fab0ae8b880 20 handle_bi_update(): bucket=:abort-at-do-reshard[dff27d1e-df33-400e-a68a-7ba586947c99.4604.27]): potential sources added=[] removed=[] 2023-10-05T11:42:07.946 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:07.944+0000 7fab0ae8b880 20 handle_bi_update(): bucket=:abort-at-do-reshard[dff27d1e-df33-400e-a68a-7ba586947c99.4604.27]): orig_dests= new_dests= 2023-10-05T11:42:07.946 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:07.944+0000 7fab0ae8b880 20 handle_bi_update(): bucket=:abort-at-do-reshard[dff27d1e-df33-400e-a68a-7ba586947c99.4604.27]): potential dests added=[] removed=[] 2023-10-05T11:42:07.948 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:07.946+0000 7fab0ae8b880 1 execute INFO: reshard of bucket "abort-at-do-reshard" completed successfully 2023-10-05T11:42:07.950 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:07.948+0000 7faaf05fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:42:07.952 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:07.950+0000 7fab0ae8b880 20 remove_watcher() i=0 2023-10-05T11:42:07.953 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:07.950+0000 7fab0ae8b880 2 removed watcher, disabling cache 2023-10-05T11:42:07.954 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:07.952+0000 7fab0ae8b880 20 remove_watcher() i=1 2023-10-05T11:42:07.955 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:07.953+0000 7fab0ae8b880 20 remove_watcher() i=2 2023-10-05T11:42:07.956 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:07.954+0000 7fab0ae8b880 20 remove_watcher() i=3 2023-10-05T11:42:07.957 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:07.955+0000 7fab0ae8b880 20 remove_watcher() i=4 2023-10-05T11:42:07.958 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:07.956+0000 7fab0ae8b880 20 remove_watcher() i=5 2023-10-05T11:42:07.959 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:07.957+0000 7fab0ae8b880 20 remove_watcher() i=6 2023-10-05T11:42:07.960 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:07.958+0000 7fab0ae8b880 20 remove_watcher() i=7 2023-10-05T11:42:07.966 INFO:tasks.workunit.client.0.smithi012.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2023-10-05T11:42:07.994 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setuser ceph since I am not root 2023-10-05T11:42:07.994 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T11:42:08.007 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.005+0000 7fd104c44880 20 rados->read ofs=0 len=0 2023-10-05T11:42:08.009 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.006+0000 7fd104c44880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:42:08.009 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.006+0000 7fd104c44880 20 realm 2023-10-05T11:42:08.009 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.006+0000 7fd104c44880 20 rados->read ofs=0 len=0 2023-10-05T11:42:08.009 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.007+0000 7fd104c44880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:42:08.009 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.007+0000 7fd104c44880 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T11:42:08.009 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.007+0000 7fd104c44880 20 rados->read ofs=0 len=0 2023-10-05T11:42:08.010 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.007+0000 7fd104c44880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:42:08.010 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.007+0000 7fd104c44880 20 rados->read ofs=0 len=0 2023-10-05T11:42:08.010 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.008+0000 7fd104c44880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:42:08.010 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.008+0000 7fd104c44880 20 rados->read ofs=0 len=0 2023-10-05T11:42:08.011 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.008+0000 7fd104c44880 20 rados_obj.operate() r=0 bl.length=1020 2023-10-05T11:42:08.011 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.008+0000 7fd104c44880 20 searching for the correct realm 2023-10-05T11:42:08.020 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.018+0000 7fd1033e9640 0 -- 172.21.15.12:0/3203201770 >> [v2:172.21.15.170:6814/3150808418,v1:172.21.15.170:6816/3150808418] conn(0x5574b5505400 msgr2=0x5574b491ac00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-10-05T11:42:08.022 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.019+0000 7fd104c44880 20 RGWRados::pool_iterate: got zone_info.dff27d1e-df33-400e-a68a-7ba586947c99 2023-10-05T11:42:08.022 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.019+0000 7fd104c44880 20 RGWRados::pool_iterate: got zonegroup_info.c78aa576-9d15-4e9d-b3c0-4af23a22062c 2023-10-05T11:42:08.022 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.019+0000 7fd104c44880 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T11:42:08.022 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.019+0000 7fd104c44880 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T11:42:08.022 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.019+0000 7fd104c44880 20 rados->read ofs=0 len=0 2023-10-05T11:42:08.022 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.020+0000 7fd104c44880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:42:08.022 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.020+0000 7fd104c44880 20 rados->read ofs=0 len=0 2023-10-05T11:42:08.023 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.020+0000 7fd104c44880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:42:08.023 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.020+0000 7fd104c44880 20 rados->read ofs=0 len=0 2023-10-05T11:42:08.024 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.020+0000 7fd104c44880 20 rados_obj.operate() r=0 bl.length=454 2023-10-05T11:42:08.024 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.020+0000 7fd104c44880 20 zone default found 2023-10-05T11:42:08.024 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.020+0000 7fd104c44880 4 Realm: () 2023-10-05T11:42:08.024 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.020+0000 7fd104c44880 4 ZoneGroup: default (c78aa576-9d15-4e9d-b3c0-4af23a22062c) 2023-10-05T11:42:08.024 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.020+0000 7fd104c44880 4 Zone: default (dff27d1e-df33-400e-a68a-7ba586947c99) 2023-10-05T11:42:08.024 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.020+0000 7fd104c44880 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T11:42:08.024 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.020+0000 7fd104c44880 20 zonegroup default 2023-10-05T11:42:08.024 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.020+0000 7fd104c44880 20 rados->read ofs=0 len=0 2023-10-05T11:42:08.024 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.020+0000 7fd104c44880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:42:08.024 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.020+0000 7fd104c44880 20 rados->read ofs=0 len=0 2023-10-05T11:42:08.024 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.021+0000 7fd104c44880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:42:08.025 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.021+0000 7fd104c44880 20 rados->read ofs=0 len=0 2023-10-05T11:42:08.025 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.021+0000 7fd104c44880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:42:08.025 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.021+0000 7fd104c44880 20 started sync module instance, tier type = 2023-10-05T11:42:08.025 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.021+0000 7fd104c44880 20 started zone id=dff27d1e-df33-400e-a68a-7ba586947c99 (name=default) with tier type = 2023-10-05T11:42:08.030 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.028+0000 7fd103bea640 0 -- 172.21.15.12:0/3203201770 >> [v2:172.21.15.12:6824/2171933159,v1:172.21.15.12:6825/2171933159] conn(0x5574b4acd400 msgr2=0x5574b491b700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:42:08.032 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.030+0000 7fd104c44880 20 add_watcher() i=0 2023-10-05T11:42:08.033 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.030+0000 7fd104c44880 20 add_watcher() i=1 2023-10-05T11:42:08.033 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.030+0000 7fd104c44880 20 add_watcher() i=2 2023-10-05T11:42:08.033 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.030+0000 7fd104c44880 20 add_watcher() i=3 2023-10-05T11:42:08.033 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.030+0000 7fd104c44880 20 add_watcher() i=4 2023-10-05T11:42:08.033 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.030+0000 7fd104c44880 20 add_watcher() i=5 2023-10-05T11:42:08.033 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.030+0000 7fd104c44880 20 add_watcher() i=6 2023-10-05T11:42:08.033 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.031+0000 7fd104c44880 20 add_watcher() i=7 2023-10-05T11:42:08.034 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.031+0000 7fd104c44880 2 all 8 watchers are set, enabling cache 2023-10-05T11:42:08.035 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.033+0000 7fd0ea3b7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:42:08.035 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.033+0000 7fd104c44880 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T11:42:08.035 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.033+0000 7fd104c44880 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T11:42:08.041 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.038+0000 7fd104c44880 5 note: GC not initialized 2023-10-05T11:42:08.041 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.039+0000 7fd0e5bae640 20 reqs_thread_entry: start 2023-10-05T11:42:08.041 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.039+0000 7fd104c44880 20 init_complete bucket index max shards: 11 2023-10-05T11:42:08.041 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.039+0000 7fd104c44880 20 Filter name: none 2023-10-05T11:42:08.041 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.039+0000 7fd0e3baa640 20 reqs_thread_entry: start 2023-10-05T11:42:08.042 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.039+0000 7fd104c44880 20 rados->read ofs=0 len=0 2023-10-05T11:42:08.042 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.039+0000 7fd104c44880 20 rados_obj.operate() r=0 bl.length=211 2023-10-05T11:42:08.042 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.039+0000 7fd104c44880 20 rados->read ofs=0 len=0 2023-10-05T11:42:08.043 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.040+0000 7fd104c44880 20 rados_obj.operate() r=0 bl.length=383 2023-10-05T11:42:08.043 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.040+0000 7fd104c44880 20 couldn't put binfo cache entry, might have raced with data changes 2023-10-05T11:42:08.043 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.040+0000 7fd104c44880 20 rados->read ofs=0 len=0 2023-10-05T11:42:08.043 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.040+0000 7fd104c44880 20 rados_obj.operate() r=0 bl.length=211 2023-10-05T11:42:08.043 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.040+0000 7fd104c44880 20 rados->read ofs=0 len=0 2023-10-05T11:42:08.043 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.040+0000 7fd104c44880 20 rados_obj.operate() r=0 bl.length=383 2023-10-05T11:42:08.043 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.040+0000 7fd104c44880 20 couldn't put binfo cache entry, might have raced with data changes 2023-10-05T11:42:08.044 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.041+0000 7fd104c44880 20 rados->read ofs=0 len=0 2023-10-05T11:42:08.044 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.042+0000 7fd104c44880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:42:08.044 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.042+0000 7fd0ea3b7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:42:08.046 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.044+0000 7fd104c44880 20 remove_watcher() i=0 2023-10-05T11:42:08.047 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.044+0000 7fd104c44880 2 removed watcher, disabling cache 2023-10-05T11:42:08.047 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.045+0000 7fd104c44880 20 remove_watcher() i=1 2023-10-05T11:42:08.048 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.046+0000 7fd104c44880 20 remove_watcher() i=2 2023-10-05T11:42:08.049 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.047+0000 7fd104c44880 20 remove_watcher() i=3 2023-10-05T11:42:08.050 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.048+0000 7fd104c44880 20 remove_watcher() i=4 2023-10-05T11:42:08.052 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.049+0000 7fd104c44880 20 remove_watcher() i=5 2023-10-05T11:42:08.053 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.050+0000 7fd104c44880 20 remove_watcher() i=6 2023-10-05T11:42:08.054 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.051+0000 7fd104c44880 20 remove_watcher() i=7 2023-10-05T11:42:08.058 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:42:08.058 INFO:tasks.workunit.client.0.smithi012.stderr:BUCKET_STATS: 2023-10-05T11:42:08.058 INFO:tasks.workunit.client.0.smithi012.stderr:bucket: abort-at-do-reshard id: dff27d1e-df33-400e-a68a-7ba586947c99.4604.27 num_objects: 19 size_kb: 1 num_shards: 12 2023-10-05T11:42:08.058 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:42:08.386 INFO:tasks.workunit.client.0.smithi012.stderr: test: reshard versioned bucket 2023-10-05T11:42:08.388 INFO:tasks.workunit.client.0.smithi012.stderr:radosgw-admin bucket stats --bucket myver 2023-10-05T11:42:08.417 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setuser ceph since I am not root 2023-10-05T11:42:08.417 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T11:42:08.430 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.427+0000 7f6917d36880 20 rados->read ofs=0 len=0 2023-10-05T11:42:08.431 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.429+0000 7f6917d36880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:42:08.432 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.429+0000 7f6917d36880 20 realm 2023-10-05T11:42:08.432 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.429+0000 7f6917d36880 20 rados->read ofs=0 len=0 2023-10-05T11:42:08.432 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.429+0000 7f6917d36880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:42:08.432 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.429+0000 7f6917d36880 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T11:42:08.432 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.429+0000 7f6917d36880 20 rados->read ofs=0 len=0 2023-10-05T11:42:08.432 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.429+0000 7f6917d36880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:42:08.432 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.429+0000 7f6917d36880 20 rados->read ofs=0 len=0 2023-10-05T11:42:08.432 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.430+0000 7f6917d36880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:42:08.433 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.430+0000 7f6917d36880 20 rados->read ofs=0 len=0 2023-10-05T11:42:08.433 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.431+0000 7f6917d36880 20 rados_obj.operate() r=0 bl.length=1020 2023-10-05T11:42:08.433 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.431+0000 7f6917d36880 20 searching for the correct realm 2023-10-05T11:42:08.443 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.440+0000 7f6914772640 0 -- 172.21.15.12:0/2184878081 >> [v2:172.21.15.170:6814/3150808418,v1:172.21.15.170:6816/3150808418] conn(0x55741745bc00 msgr2=0x557416862c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:42:08.444 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.441+0000 7f6917d36880 20 RGWRados::pool_iterate: got zone_info.dff27d1e-df33-400e-a68a-7ba586947c99 2023-10-05T11:42:08.444 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.441+0000 7f6917d36880 20 RGWRados::pool_iterate: got zonegroup_info.c78aa576-9d15-4e9d-b3c0-4af23a22062c 2023-10-05T11:42:08.444 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.441+0000 7f6917d36880 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T11:42:08.444 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.442+0000 7f6917d36880 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T11:42:08.444 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.442+0000 7f6917d36880 20 rados->read ofs=0 len=0 2023-10-05T11:42:08.445 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.442+0000 7f6917d36880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:42:08.445 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.442+0000 7f6917d36880 20 rados->read ofs=0 len=0 2023-10-05T11:42:08.445 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.442+0000 7f6917d36880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:42:08.445 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.442+0000 7f6917d36880 20 rados->read ofs=0 len=0 2023-10-05T11:42:08.446 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.442+0000 7f6917d36880 20 rados_obj.operate() r=0 bl.length=454 2023-10-05T11:42:08.446 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.442+0000 7f6917d36880 20 zone default found 2023-10-05T11:42:08.446 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.442+0000 7f6917d36880 4 Realm: () 2023-10-05T11:42:08.446 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.442+0000 7f6917d36880 4 ZoneGroup: default (c78aa576-9d15-4e9d-b3c0-4af23a22062c) 2023-10-05T11:42:08.446 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.442+0000 7f6917d36880 4 Zone: default (dff27d1e-df33-400e-a68a-7ba586947c99) 2023-10-05T11:42:08.446 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.442+0000 7f6917d36880 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T11:42:08.446 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.442+0000 7f6917d36880 20 zonegroup default 2023-10-05T11:42:08.447 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.442+0000 7f6917d36880 20 rados->read ofs=0 len=0 2023-10-05T11:42:08.447 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.442+0000 7f6917d36880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:42:08.447 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.442+0000 7f6917d36880 20 rados->read ofs=0 len=0 2023-10-05T11:42:08.447 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.443+0000 7f6917d36880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:42:08.447 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.443+0000 7f6917d36880 20 rados->read ofs=0 len=0 2023-10-05T11:42:08.447 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.443+0000 7f6917d36880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:42:08.447 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.443+0000 7f6917d36880 20 started sync module instance, tier type = 2023-10-05T11:42:08.447 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.443+0000 7f6917d36880 20 started zone id=dff27d1e-df33-400e-a68a-7ba586947c99 (name=default) with tier type = 2023-10-05T11:42:08.451 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.449+0000 7f6914f73640 0 -- 172.21.15.12:0/2184878081 >> [v2:172.21.15.12:6824/2171933159,v1:172.21.15.12:6825/2171933159] conn(0x557416a04800 msgr2=0x557416863700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:42:08.454 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.452+0000 7f6917d36880 20 add_watcher() i=0 2023-10-05T11:42:08.454 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.452+0000 7f6917d36880 20 add_watcher() i=1 2023-10-05T11:42:08.454 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.452+0000 7f6917d36880 20 add_watcher() i=2 2023-10-05T11:42:08.454 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.452+0000 7f6917d36880 20 add_watcher() i=3 2023-10-05T11:42:08.455 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.452+0000 7f6917d36880 20 add_watcher() i=4 2023-10-05T11:42:08.455 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.452+0000 7f6917d36880 20 add_watcher() i=5 2023-10-05T11:42:08.455 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.452+0000 7f6917d36880 20 add_watcher() i=6 2023-10-05T11:42:08.455 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.453+0000 7f6917d36880 20 add_watcher() i=7 2023-10-05T11:42:08.455 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.453+0000 7f6917d36880 2 all 8 watchers are set, enabling cache 2023-10-05T11:42:08.456 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.454+0000 7f68fb740640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:42:08.457 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.454+0000 7f6917d36880 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T11:42:08.457 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.454+0000 7f6917d36880 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T11:42:08.462 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.460+0000 7f6917d36880 5 note: GC not initialized 2023-10-05T11:42:08.463 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.460+0000 7f68f6f37640 20 reqs_thread_entry: start 2023-10-05T11:42:08.463 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.460+0000 7f6917d36880 20 init_complete bucket index max shards: 11 2023-10-05T11:42:08.463 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.460+0000 7f6917d36880 20 Filter name: none 2023-10-05T11:42:08.463 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.460+0000 7f68f4f33640 20 reqs_thread_entry: start 2023-10-05T11:42:08.463 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.460+0000 7f6917d36880 20 rados->read ofs=0 len=0 2023-10-05T11:42:08.464 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.461+0000 7f6917d36880 20 rados_obj.operate() r=0 bl.length=197 2023-10-05T11:42:08.464 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.461+0000 7f6917d36880 20 rados->read ofs=0 len=0 2023-10-05T11:42:08.464 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.461+0000 7f6917d36880 20 rados_obj.operate() r=0 bl.length=369 2023-10-05T11:42:08.464 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.461+0000 7f6917d36880 20 couldn't put binfo cache entry, might have raced with data changes 2023-10-05T11:42:08.464 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.461+0000 7f6917d36880 20 rados->read ofs=0 len=0 2023-10-05T11:42:08.464 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.462+0000 7f6917d36880 20 rados_obj.operate() r=0 bl.length=197 2023-10-05T11:42:08.464 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.462+0000 7f6917d36880 20 rados->read ofs=0 len=0 2023-10-05T11:42:08.465 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.462+0000 7f6917d36880 20 rados_obj.operate() r=0 bl.length=369 2023-10-05T11:42:08.465 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.462+0000 7f6917d36880 20 couldn't put binfo cache entry, might have raced with data changes 2023-10-05T11:42:08.465 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.463+0000 7f6917d36880 20 rados->read ofs=0 len=0 2023-10-05T11:42:08.465 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.463+0000 7f6917d36880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:42:08.466 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.464+0000 7f68fb740640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:42:08.468 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.466+0000 7f6917d36880 20 remove_watcher() i=0 2023-10-05T11:42:08.468 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.466+0000 7f6917d36880 2 removed watcher, disabling cache 2023-10-05T11:42:08.469 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.467+0000 7f6917d36880 20 remove_watcher() i=1 2023-10-05T11:42:08.470 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.468+0000 7f6917d36880 20 remove_watcher() i=2 2023-10-05T11:42:08.471 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.469+0000 7f6917d36880 20 remove_watcher() i=3 2023-10-05T11:42:08.472 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.470+0000 7f6917d36880 20 remove_watcher() i=4 2023-10-05T11:42:08.473 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.471+0000 7f6917d36880 20 remove_watcher() i=5 2023-10-05T11:42:08.474 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.472+0000 7f6917d36880 20 remove_watcher() i=6 2023-10-05T11:42:08.475 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.473+0000 7f6917d36880 20 remove_watcher() i=7 2023-10-05T11:42:08.479 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:42:08.480 INFO:tasks.workunit.client.0.smithi012.stderr:BUCKET_STATS: 2023-10-05T11:42:08.480 INFO:tasks.workunit.client.0.smithi012.stderr:bucket: myver id: dff27d1e-df33-400e-a68a-7ba586947c99.4604.17 num_objects: 0 size_kb: 0 num_shards: 11 2023-10-05T11:42:08.480 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:42:08.481 INFO:tasks.workunit.client.0.smithi012.stderr:radosgw-admin bucket reshard --bucket myver --num-shards 12 2023-10-05T11:42:08.513 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setuser ceph since I am not root 2023-10-05T11:42:08.560 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T11:42:08.564 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.521+0000 7fe17262d880 20 rados->read ofs=0 len=0 2023-10-05T11:42:08.564 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.523+0000 7fe17262d880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:42:08.565 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.523+0000 7fe17262d880 20 realm 2023-10-05T11:42:08.565 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.523+0000 7fe17262d880 20 rados->read ofs=0 len=0 2023-10-05T11:42:08.565 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.523+0000 7fe17262d880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:42:08.565 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.523+0000 7fe17262d880 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T11:42:08.565 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.523+0000 7fe17262d880 20 rados->read ofs=0 len=0 2023-10-05T11:42:08.565 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.523+0000 7fe17262d880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:42:08.565 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.523+0000 7fe17262d880 20 rados->read ofs=0 len=0 2023-10-05T11:42:08.565 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.524+0000 7fe17262d880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:42:08.565 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.524+0000 7fe17262d880 20 rados->read ofs=0 len=0 2023-10-05T11:42:08.565 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.525+0000 7fe17262d880 20 rados_obj.operate() r=0 bl.length=1020 2023-10-05T11:42:08.565 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.525+0000 7fe17262d880 20 searching for the correct realm 2023-10-05T11:42:08.566 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.534+0000 7fe16eee2640 0 -- 172.21.15.12:0/1603996327 >> [v2:172.21.15.12:6824/2171933159,v1:172.21.15.12:6825/2171933159] conn(0x55a842546c00 msgr2=0x55a84239f700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-10-05T11:42:08.566 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.535+0000 7fe17262d880 20 RGWRados::pool_iterate: got zone_info.dff27d1e-df33-400e-a68a-7ba586947c99 2023-10-05T11:42:08.566 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.535+0000 7fe17262d880 20 RGWRados::pool_iterate: got zonegroup_info.c78aa576-9d15-4e9d-b3c0-4af23a22062c 2023-10-05T11:42:08.566 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.535+0000 7fe17262d880 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T11:42:08.566 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.535+0000 7fe17262d880 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T11:42:08.566 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.535+0000 7fe17262d880 20 rados->read ofs=0 len=0 2023-10-05T11:42:08.566 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.536+0000 7fe17262d880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:42:08.566 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.536+0000 7fe17262d880 20 rados->read ofs=0 len=0 2023-10-05T11:42:08.566 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.536+0000 7fe17262d880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:42:08.566 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.536+0000 7fe17262d880 20 rados->read ofs=0 len=0 2023-10-05T11:42:08.566 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.536+0000 7fe17262d880 20 rados_obj.operate() r=0 bl.length=454 2023-10-05T11:42:08.566 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.536+0000 7fe17262d880 20 zone default found 2023-10-05T11:42:08.567 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.536+0000 7fe17262d880 4 Realm: () 2023-10-05T11:42:08.567 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.536+0000 7fe17262d880 4 ZoneGroup: default (c78aa576-9d15-4e9d-b3c0-4af23a22062c) 2023-10-05T11:42:08.567 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.536+0000 7fe17262d880 4 Zone: default (dff27d1e-df33-400e-a68a-7ba586947c99) 2023-10-05T11:42:08.567 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.536+0000 7fe17262d880 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T11:42:08.567 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.536+0000 7fe17262d880 20 zonegroup default 2023-10-05T11:42:08.567 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.536+0000 7fe17262d880 20 rados->read ofs=0 len=0 2023-10-05T11:42:08.567 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.536+0000 7fe17262d880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:42:08.567 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.536+0000 7fe17262d880 20 rados->read ofs=0 len=0 2023-10-05T11:42:08.567 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.537+0000 7fe17262d880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:42:08.567 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.537+0000 7fe17262d880 20 rados->read ofs=0 len=0 2023-10-05T11:42:08.567 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.537+0000 7fe17262d880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:42:08.567 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.537+0000 7fe17262d880 20 started sync module instance, tier type = 2023-10-05T11:42:08.568 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.537+0000 7fe17262d880 20 started zone id=dff27d1e-df33-400e-a68a-7ba586947c99 (name=default) with tier type = 2023-10-05T11:42:08.568 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.543+0000 7fe16eee2640 0 -- 172.21.15.12:0/1603996327 >> [v2:172.21.15.170:6800/4137726411,v1:172.21.15.170:6801/4137726411] conn(0x55a84245cc00 msgr2=0x55a842463600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:42:08.568 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.546+0000 7fe17262d880 20 add_watcher() i=0 2023-10-05T11:42:08.568 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.546+0000 7fe17262d880 20 add_watcher() i=1 2023-10-05T11:42:08.568 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.546+0000 7fe17262d880 20 add_watcher() i=2 2023-10-05T11:42:08.568 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.546+0000 7fe17262d880 20 add_watcher() i=3 2023-10-05T11:42:08.568 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.546+0000 7fe17262d880 20 add_watcher() i=4 2023-10-05T11:42:08.568 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.546+0000 7fe17262d880 20 add_watcher() i=5 2023-10-05T11:42:08.568 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.546+0000 7fe17262d880 20 add_watcher() i=6 2023-10-05T11:42:08.568 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.547+0000 7fe17262d880 20 add_watcher() i=7 2023-10-05T11:42:08.568 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.547+0000 7fe17262d880 2 all 8 watchers are set, enabling cache 2023-10-05T11:42:08.568 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.548+0000 7fe1556af640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:42:08.568 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.548+0000 7fe17262d880 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T11:42:08.569 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.548+0000 7fe17262d880 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T11:42:08.569 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.554+0000 7fe17262d880 5 note: GC not initialized 2023-10-05T11:42:08.569 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.554+0000 7fe150ea6640 20 reqs_thread_entry: start 2023-10-05T11:42:08.569 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.554+0000 7fe17262d880 20 init_complete bucket index max shards: 11 2023-10-05T11:42:08.569 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.554+0000 7fe17262d880 20 Filter name: none 2023-10-05T11:42:08.569 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.554+0000 7fe14eea2640 20 reqs_thread_entry: start 2023-10-05T11:42:08.569 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.554+0000 7fe17262d880 10 cache get: name=default.rgw.meta+root+myver : miss 2023-10-05T11:42:08.569 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.554+0000 7fe17262d880 20 rados->read ofs=0 len=0 2023-10-05T11:42:08.569 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.555+0000 7fe17262d880 20 rados_obj.operate() r=0 bl.length=197 2023-10-05T11:42:08.569 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.555+0000 7fe17262d880 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2023-10-05T11:42:08.569 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.555+0000 7fe17262d880 10 adding default.rgw.meta+root+myver to cache LRU end 2023-10-05T11:42:08.569 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.555+0000 7fe17262d880 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:dff27d1e-df33-400e-a68a-7ba586947c99.4604.17 : miss 2023-10-05T11:42:08.570 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.555+0000 7fe17262d880 20 rados->read ofs=0 len=0 2023-10-05T11:42:08.570 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.555+0000 7fe17262d880 20 rados_obj.operate() r=0 bl.length=369 2023-10-05T11:42:08.570 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.555+0000 7fe17262d880 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:dff27d1e-df33-400e-a68a-7ba586947c99.4604.17 info.flags=0x17 2023-10-05T11:42:08.570 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.555+0000 7fe17262d880 10 adding default.rgw.meta+root+.bucket.meta.myver:dff27d1e-df33-400e-a68a-7ba586947c99.4604.17 to cache LRU end 2023-10-05T11:42:08.570 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.555+0000 7fe17262d880 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T11:42:08.570 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.555+0000 7fe17262d880 10 updating xattr: name=user.rgw.acl bl.length()=203 2023-10-05T11:42:08.570 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.555+0000 7fe17262d880 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:dff27d1e-df33-400e-a68a-7ba586947c99.4604.17 2023-10-05T11:42:08.570 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.561+0000 7fe17262d880 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:dff27d1e-df33-400e-a68a-7ba586947c99.4604.17 info.flags=0x17 2023-10-05T11:42:08.570 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.561+0000 7fe17262d880 10 moving default.rgw.meta+root+.bucket.meta.myver:dff27d1e-df33-400e-a68a-7ba586947c99.4604.17 to cache LRU end 2023-10-05T11:42:08.570 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.561+0000 7fe17262d880 10 updating xattr: name=user.rgw.acl bl.length()=203 2023-10-05T11:42:08.570 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.561+0000 7fe17262d880 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:dff27d1e-df33-400e-a68a-7ba586947c99.4604.17, ofs0, ns] 2023-10-05T11:42:08.570 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.561+0000 7fe168ed6640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1060856922179 cookie 94181155697664 notifier 7064 bl.length()=855 2023-10-05T11:42:08.571 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.561+0000 7fe168ed6640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:dff27d1e-df33-400e-a68a-7ba586947c99.4604.17 info.flags=0x17 2023-10-05T11:42:08.571 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.561+0000 7fe168ed6640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:dff27d1e-df33-400e-a68a-7ba586947c99.4604.17 to cache LRU end 2023-10-05T11:42:08.571 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.561+0000 7fe168ed6640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2023-10-05T11:42:08.572 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.563+0000 7fe17262d880 20 handle_bi_update(): bucket=:myver[dff27d1e-df33-400e-a68a-7ba586947c99.4604.17]): orig_sources= new_sources= 2023-10-05T11:42:08.573 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.563+0000 7fe17262d880 20 handle_bi_update(): bucket=:myver[dff27d1e-df33-400e-a68a-7ba586947c99.4604.17]): potential sources added=[] removed=[] 2023-10-05T11:42:08.573 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.563+0000 7fe17262d880 20 handle_bi_update(): bucket=:myver[dff27d1e-df33-400e-a68a-7ba586947c99.4604.17]): orig_dests= new_dests= 2023-10-05T11:42:08.573 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.563+0000 7fe17262d880 20 handle_bi_update(): bucket=:myver[dff27d1e-df33-400e-a68a-7ba586947c99.4604.17]): potential dests added=[] removed=[] 2023-10-05T11:42:08.573 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.565+0000 7fe17262d880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.1.0 2023-10-05T11:42:08.573 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.565+0000 7fe17262d880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.1.0 2023-10-05T11:42:08.573 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.565+0000 7fe17262d880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.1.1 2023-10-05T11:42:08.573 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.565+0000 7fe17262d880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.1.1 2023-10-05T11:42:08.573 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.565+0000 7fe17262d880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.1.2 2023-10-05T11:42:08.573 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.565+0000 7fe17262d880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.1.2 2023-10-05T11:42:08.573 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.565+0000 7fe17262d880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.1.3 2023-10-05T11:42:08.573 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.565+0000 7fe17262d880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.1.3 2023-10-05T11:42:08.573 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.565+0000 7fe17262d880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.1.4 2023-10-05T11:42:08.574 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.565+0000 7fe17262d880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.1.4 2023-10-05T11:42:08.574 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.565+0000 7fe17262d880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.1.5 2023-10-05T11:42:08.574 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.565+0000 7fe17262d880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.1.5 2023-10-05T11:42:08.574 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.565+0000 7fe17262d880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.1.6 2023-10-05T11:42:08.574 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.565+0000 7fe17262d880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.1.6 2023-10-05T11:42:08.574 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.565+0000 7fe17262d880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.1.7 2023-10-05T11:42:08.574 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.565+0000 7fe17262d880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.1.7 2023-10-05T11:42:08.574 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.565+0000 7fe17262d880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.1.8 2023-10-05T11:42:08.574 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.565+0000 7fe17262d880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.1.8 2023-10-05T11:42:08.574 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.565+0000 7fe17262d880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.1.9 2023-10-05T11:42:08.574 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.565+0000 7fe17262d880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.1.9 2023-10-05T11:42:08.574 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.565+0000 7fe17262d880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.1.10 2023-10-05T11:42:08.575 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.565+0000 7fe17262d880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.1.10 2023-10-05T11:42:08.575 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.565+0000 7fe17262d880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.1.11 2023-10-05T11:42:08.575 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.565+0000 7fe17262d880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.1.11 2023-10-05T11:42:08.575 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.565+0000 7fe17262d880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.0 2023-10-05T11:42:08.575 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.565+0000 7fe17262d880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.1 2023-10-05T11:42:08.575 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.566+0000 7fe17262d880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.2 2023-10-05T11:42:08.575 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.566+0000 7fe17262d880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.3 2023-10-05T11:42:08.575 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.566+0000 7fe17262d880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.4 2023-10-05T11:42:08.575 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.567+0000 7fe17262d880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.5 2023-10-05T11:42:08.575 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.567+0000 7fe17262d880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.6 2023-10-05T11:42:08.575 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.568+0000 7fe17262d880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.7 2023-10-05T11:42:08.575 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.568+0000 7fe17262d880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.8 2023-10-05T11:42:08.576 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.569+0000 7fe17262d880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.9 2023-10-05T11:42:08.576 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.569+0000 7fe17262d880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.10 2023-10-05T11:42:08.576 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.569+0000 7fe17262d880 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:dff27d1e-df33-400e-a68a-7ba586947c99.4604.17 : hit (requested=0x17, cached=0x17) 2023-10-05T11:42:08.576 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.569+0000 7fe17262d880 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:dff27d1e-df33-400e-a68a-7ba586947c99.4604.17 2023-10-05T11:42:08.577 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.571+0000 7fe17262d880 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:dff27d1e-df33-400e-a68a-7ba586947c99.4604.17 info.flags=0x17 2023-10-05T11:42:08.577 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.571+0000 7fe17262d880 10 moving default.rgw.meta+root+.bucket.meta.myver:dff27d1e-df33-400e-a68a-7ba586947c99.4604.17 to cache LRU end 2023-10-05T11:42:08.577 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.571+0000 7fe17262d880 10 updating xattr: name=user.rgw.acl bl.length()=203 2023-10-05T11:42:08.577 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.571+0000 7fe17262d880 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:dff27d1e-df33-400e-a68a-7ba586947c99.4604.17, ofs0, ns] 2023-10-05T11:42:08.577 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.571+0000 7fe1686d5640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1060856922180 cookie 94181155697664 notifier 7064 bl.length()=823 2023-10-05T11:42:08.577 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.571+0000 7fe1686d5640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:dff27d1e-df33-400e-a68a-7ba586947c99.4604.17 info.flags=0x17 2023-10-05T11:42:08.577 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.571+0000 7fe1686d5640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:dff27d1e-df33-400e-a68a-7ba586947c99.4604.17 to cache LRU end 2023-10-05T11:42:08.577 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.571+0000 7fe1686d5640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2023-10-05T11:42:08.577 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.573+0000 7fe17262d880 20 handle_bi_update(): bucket=:myver[dff27d1e-df33-400e-a68a-7ba586947c99.4604.17]): orig_sources= new_sources= 2023-10-05T11:42:08.578 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.573+0000 7fe17262d880 20 handle_bi_update(): bucket=:myver[dff27d1e-df33-400e-a68a-7ba586947c99.4604.17]): potential sources added=[] removed=[] 2023-10-05T11:42:08.578 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.573+0000 7fe17262d880 20 handle_bi_update(): bucket=:myver[dff27d1e-df33-400e-a68a-7ba586947c99.4604.17]): orig_dests= new_dests= 2023-10-05T11:42:08.578 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.573+0000 7fe17262d880 20 handle_bi_update(): bucket=:myver[dff27d1e-df33-400e-a68a-7ba586947c99.4604.17]): potential dests added=[] removed=[] 2023-10-05T11:42:08.578 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.575+0000 7fe17262d880 1 execute INFO: reshard of bucket "myver" completed successfully 2023-10-05T11:42:08.579 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.576+0000 7fe1556af640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:42:08.581 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.578+0000 7fe17262d880 20 remove_watcher() i=0 2023-10-05T11:42:08.581 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.578+0000 7fe17262d880 2 removed watcher, disabling cache 2023-10-05T11:42:08.581 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.579+0000 7fe17262d880 20 remove_watcher() i=1 2023-10-05T11:42:08.582 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.580+0000 7fe17262d880 20 remove_watcher() i=2 2023-10-05T11:42:08.584 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.581+0000 7fe17262d880 20 remove_watcher() i=3 2023-10-05T11:42:08.584 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.582+0000 7fe17262d880 20 remove_watcher() i=4 2023-10-05T11:42:08.585 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.583+0000 7fe17262d880 20 remove_watcher() i=5 2023-10-05T11:42:08.587 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.584+0000 7fe17262d880 20 remove_watcher() i=6 2023-10-05T11:42:08.587 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.585+0000 7fe17262d880 20 remove_watcher() i=7 2023-10-05T11:42:08.593 INFO:tasks.workunit.client.0.smithi012.stderr:radosgw-admin bucket stats --bucket myver 2023-10-05T11:42:08.621 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setuser ceph since I am not root 2023-10-05T11:42:08.621 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T11:42:08.634 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.631+0000 7faa19936880 20 rados->read ofs=0 len=0 2023-10-05T11:42:08.635 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.633+0000 7faa19936880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:42:08.636 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.633+0000 7faa19936880 20 realm 2023-10-05T11:42:08.636 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.633+0000 7faa19936880 20 rados->read ofs=0 len=0 2023-10-05T11:42:08.636 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.633+0000 7faa19936880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:42:08.636 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.633+0000 7faa19936880 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T11:42:08.636 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.633+0000 7faa19936880 20 rados->read ofs=0 len=0 2023-10-05T11:42:08.636 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.633+0000 7faa19936880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:42:08.636 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.633+0000 7faa19936880 20 rados->read ofs=0 len=0 2023-10-05T11:42:08.637 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.634+0000 7faa19936880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:42:08.637 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.634+0000 7faa19936880 20 rados->read ofs=0 len=0 2023-10-05T11:42:08.637 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.635+0000 7faa19936880 20 rados_obj.operate() r=0 bl.length=1020 2023-10-05T11:42:08.637 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.635+0000 7faa19936880 20 searching for the correct realm 2023-10-05T11:42:08.646 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.644+0000 7faa16283640 0 -- 172.21.15.12:0/3590807131 >> [v2:172.21.15.170:6814/3150808418,v1:172.21.15.170:6816/3150808418] conn(0x556af9e43c00 msgr2=0x556af924cc00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:42:08.648 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.645+0000 7faa19936880 20 RGWRados::pool_iterate: got zone_info.dff27d1e-df33-400e-a68a-7ba586947c99 2023-10-05T11:42:08.648 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.645+0000 7faa19936880 20 RGWRados::pool_iterate: got zonegroup_info.c78aa576-9d15-4e9d-b3c0-4af23a22062c 2023-10-05T11:42:08.648 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.645+0000 7faa19936880 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T11:42:08.648 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.645+0000 7faa19936880 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T11:42:08.648 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.645+0000 7faa19936880 20 rados->read ofs=0 len=0 2023-10-05T11:42:08.648 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.645+0000 7faa19936880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:42:08.648 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.645+0000 7faa19936880 20 rados->read ofs=0 len=0 2023-10-05T11:42:08.650 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.646+0000 7faa19936880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:42:08.650 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.646+0000 7faa19936880 20 rados->read ofs=0 len=0 2023-10-05T11:42:08.650 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.646+0000 7faa19936880 20 rados_obj.operate() r=0 bl.length=454 2023-10-05T11:42:08.650 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.646+0000 7faa19936880 20 zone default found 2023-10-05T11:42:08.650 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.646+0000 7faa19936880 4 Realm: () 2023-10-05T11:42:08.650 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.646+0000 7faa19936880 4 ZoneGroup: default (c78aa576-9d15-4e9d-b3c0-4af23a22062c) 2023-10-05T11:42:08.650 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.646+0000 7faa19936880 4 Zone: default (dff27d1e-df33-400e-a68a-7ba586947c99) 2023-10-05T11:42:08.650 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.646+0000 7faa19936880 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T11:42:08.650 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.646+0000 7faa19936880 20 zonegroup default 2023-10-05T11:42:08.650 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.646+0000 7faa19936880 20 rados->read ofs=0 len=0 2023-10-05T11:42:08.651 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.646+0000 7faa19936880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:42:08.651 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.646+0000 7faa19936880 20 rados->read ofs=0 len=0 2023-10-05T11:42:08.651 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.647+0000 7faa19936880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:42:08.651 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.647+0000 7faa19936880 20 rados->read ofs=0 len=0 2023-10-05T11:42:08.651 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.647+0000 7faa19936880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:42:08.651 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.647+0000 7faa19936880 20 started sync module instance, tier type = 2023-10-05T11:42:08.651 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.647+0000 7faa19936880 20 started zone id=dff27d1e-df33-400e-a68a-7ba586947c99 (name=default) with tier type = 2023-10-05T11:42:08.655 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.653+0000 7faa16a84640 0 -- 172.21.15.12:0/3590807131 >> [v2:172.21.15.170:6800/4137726411,v1:172.21.15.170:6801/4137726411] conn(0x556af930b800 msgr2=0x556af9311600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:42:08.658 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.656+0000 7faa19936880 20 add_watcher() i=0 2023-10-05T11:42:08.658 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.656+0000 7faa19936880 20 add_watcher() i=1 2023-10-05T11:42:08.658 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.656+0000 7faa19936880 20 add_watcher() i=2 2023-10-05T11:42:08.658 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.656+0000 7faa19936880 20 add_watcher() i=3 2023-10-05T11:42:08.658 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.656+0000 7faa19936880 20 add_watcher() i=4 2023-10-05T11:42:08.659 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.656+0000 7faa19936880 20 add_watcher() i=5 2023-10-05T11:42:08.659 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.656+0000 7faa19936880 20 add_watcher() i=6 2023-10-05T11:42:08.660 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.657+0000 7faa19936880 20 add_watcher() i=7 2023-10-05T11:42:08.660 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.657+0000 7faa19936880 2 all 8 watchers are set, enabling cache 2023-10-05T11:42:08.660 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.658+0000 7fa9fd251640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:42:08.661 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.658+0000 7faa19936880 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T11:42:08.661 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.658+0000 7faa19936880 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T11:42:08.669 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.664+0000 7faa19936880 5 note: GC not initialized 2023-10-05T11:42:08.669 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.664+0000 7fa9f8a48640 20 reqs_thread_entry: start 2023-10-05T11:42:08.669 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.664+0000 7faa19936880 20 init_complete bucket index max shards: 11 2023-10-05T11:42:08.669 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.664+0000 7faa19936880 20 Filter name: none 2023-10-05T11:42:08.670 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.664+0000 7fa9f6a44640 20 reqs_thread_entry: start 2023-10-05T11:42:08.670 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.664+0000 7faa19936880 20 rados->read ofs=0 len=0 2023-10-05T11:42:08.670 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.665+0000 7faa19936880 20 rados_obj.operate() r=0 bl.length=197 2023-10-05T11:42:08.670 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.665+0000 7faa19936880 20 rados->read ofs=0 len=0 2023-10-05T11:42:08.670 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.665+0000 7faa19936880 20 rados_obj.operate() r=0 bl.length=369 2023-10-05T11:42:08.671 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.665+0000 7faa19936880 20 couldn't put binfo cache entry, might have raced with data changes 2023-10-05T11:42:08.671 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.665+0000 7faa19936880 20 rados->read ofs=0 len=0 2023-10-05T11:42:08.671 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.666+0000 7faa19936880 20 rados_obj.operate() r=0 bl.length=197 2023-10-05T11:42:08.671 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.666+0000 7faa19936880 20 rados->read ofs=0 len=0 2023-10-05T11:42:08.671 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.666+0000 7faa19936880 20 rados_obj.operate() r=0 bl.length=369 2023-10-05T11:42:08.671 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.666+0000 7faa19936880 20 couldn't put binfo cache entry, might have raced with data changes 2023-10-05T11:42:08.672 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.667+0000 7faa19936880 20 rados->read ofs=0 len=0 2023-10-05T11:42:08.672 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.667+0000 7faa19936880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:42:08.672 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.668+0000 7fa9fd251640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:42:08.673 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.670+0000 7faa19936880 20 remove_watcher() i=0 2023-10-05T11:42:08.673 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.670+0000 7faa19936880 2 removed watcher, disabling cache 2023-10-05T11:42:08.673 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.671+0000 7faa19936880 20 remove_watcher() i=1 2023-10-05T11:42:08.674 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.672+0000 7faa19936880 20 remove_watcher() i=2 2023-10-05T11:42:08.675 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.673+0000 7faa19936880 20 remove_watcher() i=3 2023-10-05T11:42:08.676 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.674+0000 7faa19936880 20 remove_watcher() i=4 2023-10-05T11:42:08.677 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.675+0000 7faa19936880 20 remove_watcher() i=5 2023-10-05T11:42:08.678 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.676+0000 7faa19936880 20 remove_watcher() i=6 2023-10-05T11:42:08.679 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.677+0000 7faa19936880 20 remove_watcher() i=7 2023-10-05T11:42:08.683 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:42:08.684 INFO:tasks.workunit.client.0.smithi012.stderr:BUCKET_STATS: 2023-10-05T11:42:08.684 INFO:tasks.workunit.client.0.smithi012.stderr:bucket: myver id: dff27d1e-df33-400e-a68a-7ba586947c99.4604.17 num_objects: 0 size_kb: 0 num_shards: 12 2023-10-05T11:42:08.684 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:42:08.750 INFO:tasks.workunit.client.0.smithi012.stderr: test: reshard removes olh entries with empty name 2023-10-05T11:42:08.911 INFO:tasks.workunit.client.0.smithi012.stderr:radosgw-admin bucket stats --bucket a-bucket 2023-10-05T11:42:08.939 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setuser ceph since I am not root 2023-10-05T11:42:08.940 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T11:42:08.952 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.950+0000 7fd3e351a880 20 rados->read ofs=0 len=0 2023-10-05T11:42:08.953 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.951+0000 7fd3e351a880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:42:08.954 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.951+0000 7fd3e351a880 20 realm 2023-10-05T11:42:08.954 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.951+0000 7fd3e351a880 20 rados->read ofs=0 len=0 2023-10-05T11:42:08.954 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.951+0000 7fd3e351a880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:42:08.954 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.951+0000 7fd3e351a880 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T11:42:08.954 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.951+0000 7fd3e351a880 20 rados->read ofs=0 len=0 2023-10-05T11:42:08.954 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.951+0000 7fd3e351a880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:42:08.954 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.951+0000 7fd3e351a880 20 rados->read ofs=0 len=0 2023-10-05T11:42:08.955 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.952+0000 7fd3e351a880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:42:08.955 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.952+0000 7fd3e351a880 20 rados->read ofs=0 len=0 2023-10-05T11:42:08.955 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.953+0000 7fd3e351a880 20 rados_obj.operate() r=0 bl.length=1020 2023-10-05T11:42:08.955 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.953+0000 7fd3e351a880 20 searching for the correct realm 2023-10-05T11:42:08.964 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.962+0000 7fd3e1cbf640 0 -- 172.21.15.12:0/1537674495 >> [v2:172.21.15.170:6814/3150808418,v1:172.21.15.170:6816/3150808418] conn(0x561fe3826c00 msgr2=0x561fe2b88c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:42:08.965 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.963+0000 7fd3e351a880 20 RGWRados::pool_iterate: got zone_info.dff27d1e-df33-400e-a68a-7ba586947c99 2023-10-05T11:42:08.965 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.963+0000 7fd3e351a880 20 RGWRados::pool_iterate: got zonegroup_info.c78aa576-9d15-4e9d-b3c0-4af23a22062c 2023-10-05T11:42:08.965 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.963+0000 7fd3e351a880 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T11:42:08.966 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.963+0000 7fd3e351a880 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T11:42:08.966 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.963+0000 7fd3e351a880 20 rados->read ofs=0 len=0 2023-10-05T11:42:08.966 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.963+0000 7fd3e351a880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:42:08.966 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.963+0000 7fd3e351a880 20 rados->read ofs=0 len=0 2023-10-05T11:42:08.967 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.963+0000 7fd3e351a880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:42:08.967 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.963+0000 7fd3e351a880 20 rados->read ofs=0 len=0 2023-10-05T11:42:08.967 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.964+0000 7fd3e351a880 20 rados_obj.operate() r=0 bl.length=454 2023-10-05T11:42:08.967 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.964+0000 7fd3e351a880 20 zone default found 2023-10-05T11:42:08.967 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.964+0000 7fd3e351a880 4 Realm: () 2023-10-05T11:42:08.967 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.964+0000 7fd3e351a880 4 ZoneGroup: default (c78aa576-9d15-4e9d-b3c0-4af23a22062c) 2023-10-05T11:42:08.968 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.964+0000 7fd3e351a880 4 Zone: default (dff27d1e-df33-400e-a68a-7ba586947c99) 2023-10-05T11:42:08.968 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.964+0000 7fd3e351a880 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T11:42:08.968 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.964+0000 7fd3e351a880 20 zonegroup default 2023-10-05T11:42:08.968 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.964+0000 7fd3e351a880 20 rados->read ofs=0 len=0 2023-10-05T11:42:08.968 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.964+0000 7fd3e351a880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:42:08.968 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.964+0000 7fd3e351a880 20 rados->read ofs=0 len=0 2023-10-05T11:42:08.968 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.964+0000 7fd3e351a880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:42:08.968 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.964+0000 7fd3e351a880 20 rados->read ofs=0 len=0 2023-10-05T11:42:08.968 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.964+0000 7fd3e351a880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:42:08.968 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.964+0000 7fd3e351a880 20 started sync module instance, tier type = 2023-10-05T11:42:08.968 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.964+0000 7fd3e351a880 20 started zone id=dff27d1e-df33-400e-a68a-7ba586947c99 (name=default) with tier type = 2023-10-05T11:42:08.973 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.971+0000 7fd3e24c0640 0 -- 172.21.15.12:0/1537674495 >> [v2:172.21.15.12:6824/2171933159,v1:172.21.15.12:6825/2171933159] conn(0x561fe3826400 msgr2=0x561fe2b89700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:42:08.975 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.973+0000 7fd3e351a880 20 add_watcher() i=0 2023-10-05T11:42:08.976 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.973+0000 7fd3e351a880 20 add_watcher() i=1 2023-10-05T11:42:08.976 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.973+0000 7fd3e351a880 20 add_watcher() i=2 2023-10-05T11:42:08.976 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.973+0000 7fd3e351a880 20 add_watcher() i=3 2023-10-05T11:42:08.976 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.973+0000 7fd3e351a880 20 add_watcher() i=4 2023-10-05T11:42:08.976 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.973+0000 7fd3e351a880 20 add_watcher() i=5 2023-10-05T11:42:08.976 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.973+0000 7fd3e351a880 20 add_watcher() i=6 2023-10-05T11:42:08.976 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.974+0000 7fd3e351a880 20 add_watcher() i=7 2023-10-05T11:42:08.977 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.974+0000 7fd3e351a880 2 all 8 watchers are set, enabling cache 2023-10-05T11:42:08.978 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.976+0000 7fd3c8c8d640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:42:08.978 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.976+0000 7fd3e351a880 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T11:42:08.978 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.976+0000 7fd3e351a880 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T11:42:08.984 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.981+0000 7fd3e351a880 5 note: GC not initialized 2023-10-05T11:42:08.984 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.982+0000 7fd3c4484640 20 reqs_thread_entry: start 2023-10-05T11:42:08.984 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.982+0000 7fd3e351a880 20 init_complete bucket index max shards: 11 2023-10-05T11:42:08.984 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.982+0000 7fd3e351a880 20 Filter name: none 2023-10-05T11:42:08.985 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.982+0000 7fd3c2480640 20 reqs_thread_entry: start 2023-10-05T11:42:08.985 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.982+0000 7fd3e351a880 20 rados->read ofs=0 len=0 2023-10-05T11:42:08.985 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.982+0000 7fd3e351a880 20 rados_obj.operate() r=0 bl.length=200 2023-10-05T11:42:08.986 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.982+0000 7fd3e351a880 20 rados->read ofs=0 len=0 2023-10-05T11:42:08.986 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.983+0000 7fd3e351a880 20 rados_obj.operate() r=0 bl.length=372 2023-10-05T11:42:08.986 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.983+0000 7fd3e351a880 20 couldn't put binfo cache entry, might have raced with data changes 2023-10-05T11:42:08.986 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.983+0000 7fd3e351a880 20 rados->read ofs=0 len=0 2023-10-05T11:42:08.986 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.983+0000 7fd3e351a880 20 rados_obj.operate() r=0 bl.length=200 2023-10-05T11:42:08.986 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.983+0000 7fd3e351a880 20 rados->read ofs=0 len=0 2023-10-05T11:42:08.986 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.983+0000 7fd3e351a880 20 rados_obj.operate() r=0 bl.length=372 2023-10-05T11:42:08.986 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.983+0000 7fd3e351a880 20 couldn't put binfo cache entry, might have raced with data changes 2023-10-05T11:42:08.987 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.984+0000 7fd3e351a880 20 rados->read ofs=0 len=0 2023-10-05T11:42:08.987 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.985+0000 7fd3e351a880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:42:08.987 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.985+0000 7fd3c8c8d640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:42:08.989 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.987+0000 7fd3e351a880 20 remove_watcher() i=0 2023-10-05T11:42:08.990 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.987+0000 7fd3e351a880 2 removed watcher, disabling cache 2023-10-05T11:42:08.991 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.988+0000 7fd3e351a880 20 remove_watcher() i=1 2023-10-05T11:42:08.991 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.989+0000 7fd3e351a880 20 remove_watcher() i=2 2023-10-05T11:42:08.993 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.990+0000 7fd3e351a880 20 remove_watcher() i=3 2023-10-05T11:42:08.994 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.991+0000 7fd3e351a880 20 remove_watcher() i=4 2023-10-05T11:42:08.995 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.992+0000 7fd3e351a880 20 remove_watcher() i=5 2023-10-05T11:42:08.995 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.993+0000 7fd3e351a880 20 remove_watcher() i=6 2023-10-05T11:42:08.996 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:08.994+0000 7fd3e351a880 20 remove_watcher() i=7 2023-10-05T11:42:09.001 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:42:09.001 INFO:tasks.workunit.client.0.smithi012.stderr:BUCKET_STATS: 2023-10-05T11:42:09.001 INFO:tasks.workunit.client.0.smithi012.stderr:bucket: a-bucket id: dff27d1e-df33-400e-a68a-7ba586947c99.4604.16 num_objects: 0 size_kb: 0 num_shards: 13 2023-10-05T11:42:09.001 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:42:09.002 INFO:tasks.workunit.client.0.smithi012.stderr:radosgw-admin bucket layout --bucket a-bucket 2023-10-05T11:42:09.030 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setuser ceph since I am not root 2023-10-05T11:42:09.030 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T11:42:09.044 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.042+0000 7f75dca44880 20 rados->read ofs=0 len=0 2023-10-05T11:42:09.045 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.043+0000 7f75dca44880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:42:09.045 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.043+0000 7f75dca44880 20 realm 2023-10-05T11:42:09.045 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.043+0000 7f75dca44880 20 rados->read ofs=0 len=0 2023-10-05T11:42:09.046 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.043+0000 7f75dca44880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:42:09.046 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.043+0000 7f75dca44880 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T11:42:09.046 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.043+0000 7f75dca44880 20 rados->read ofs=0 len=0 2023-10-05T11:42:09.046 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.043+0000 7f75dca44880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:42:09.046 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.043+0000 7f75dca44880 20 rados->read ofs=0 len=0 2023-10-05T11:42:09.046 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.044+0000 7f75dca44880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:42:09.046 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.044+0000 7f75dca44880 20 rados->read ofs=0 len=0 2023-10-05T11:42:09.047 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.045+0000 7f75dca44880 20 rados_obj.operate() r=0 bl.length=1020 2023-10-05T11:42:09.047 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.045+0000 7f75dca44880 20 searching for the correct realm 2023-10-05T11:42:09.054 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.052+0000 7f75db1f0640 0 -- 172.21.15.12:0/1585702390 >> [v2:172.21.15.12:6808/396693578,v1:172.21.15.12:6809/396693578] conn(0x556492054400 msgr2=0x556492056000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:42:09.057 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.055+0000 7f75dca44880 20 RGWRados::pool_iterate: got zone_info.dff27d1e-df33-400e-a68a-7ba586947c99 2023-10-05T11:42:09.057 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.055+0000 7f75dca44880 20 RGWRados::pool_iterate: got zonegroup_info.c78aa576-9d15-4e9d-b3c0-4af23a22062c 2023-10-05T11:42:09.058 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.055+0000 7f75dca44880 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T11:42:09.058 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.055+0000 7f75dca44880 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T11:42:09.058 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.055+0000 7f75dca44880 20 rados->read ofs=0 len=0 2023-10-05T11:42:09.058 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.055+0000 7f75dca44880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:42:09.058 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.055+0000 7f75dca44880 20 rados->read ofs=0 len=0 2023-10-05T11:42:09.059 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.056+0000 7f75dca44880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:42:09.059 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.056+0000 7f75dca44880 20 rados->read ofs=0 len=0 2023-10-05T11:42:09.060 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.056+0000 7f75dca44880 20 rados_obj.operate() r=0 bl.length=454 2023-10-05T11:42:09.060 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.056+0000 7f75dca44880 20 zone default found 2023-10-05T11:42:09.060 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.056+0000 7f75dca44880 4 Realm: () 2023-10-05T11:42:09.060 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.056+0000 7f75dca44880 4 ZoneGroup: default (c78aa576-9d15-4e9d-b3c0-4af23a22062c) 2023-10-05T11:42:09.060 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.056+0000 7f75dca44880 4 Zone: default (dff27d1e-df33-400e-a68a-7ba586947c99) 2023-10-05T11:42:09.060 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.056+0000 7f75dca44880 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T11:42:09.060 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.056+0000 7f75dca44880 20 zonegroup default 2023-10-05T11:42:09.060 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.056+0000 7f75dca44880 20 rados->read ofs=0 len=0 2023-10-05T11:42:09.060 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.056+0000 7f75dca44880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:42:09.060 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.056+0000 7f75dca44880 20 rados->read ofs=0 len=0 2023-10-05T11:42:09.060 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.056+0000 7f75dca44880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:42:09.061 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.056+0000 7f75dca44880 20 rados->read ofs=0 len=0 2023-10-05T11:42:09.061 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.057+0000 7f75dca44880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:42:09.061 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.057+0000 7f75dca44880 20 started sync module instance, tier type = 2023-10-05T11:42:09.061 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.057+0000 7f75dca44880 20 started zone id=dff27d1e-df33-400e-a68a-7ba586947c99 (name=default) with tier type = 2023-10-05T11:42:09.061 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.058+0000 7f75db9f1640 0 -- 172.21.15.12:0/1585702390 >> [v2:172.21.15.170:6800/4137726411,v1:172.21.15.170:6801/4137726411] conn(0x556492054000 msgr2=0x556492027700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:42:09.068 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.065+0000 7f75dca44880 20 add_watcher() i=0 2023-10-05T11:42:09.068 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.065+0000 7f75dca44880 20 add_watcher() i=1 2023-10-05T11:42:09.068 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.065+0000 7f75dca44880 20 add_watcher() i=2 2023-10-05T11:42:09.068 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.065+0000 7f75dca44880 20 add_watcher() i=3 2023-10-05T11:42:09.068 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.065+0000 7f75dca44880 20 add_watcher() i=4 2023-10-05T11:42:09.068 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.065+0000 7f75dca44880 20 add_watcher() i=5 2023-10-05T11:42:09.068 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.065+0000 7f75dca44880 20 add_watcher() i=6 2023-10-05T11:42:09.069 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.066+0000 7f75dca44880 20 add_watcher() i=7 2023-10-05T11:42:09.069 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.066+0000 7f75dca44880 2 all 8 watchers are set, enabling cache 2023-10-05T11:42:09.070 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.068+0000 7f75c21be640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:42:09.070 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.068+0000 7f75dca44880 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T11:42:09.071 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.068+0000 7f75dca44880 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T11:42:09.076 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.074+0000 7f75dca44880 5 note: GC not initialized 2023-10-05T11:42:09.076 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.074+0000 7f75bd9b5640 20 reqs_thread_entry: start 2023-10-05T11:42:09.077 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.074+0000 7f75dca44880 20 init_complete bucket index max shards: 11 2023-10-05T11:42:09.077 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.074+0000 7f75dca44880 20 Filter name: none 2023-10-05T11:42:09.077 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.074+0000 7f75bb9b1640 20 reqs_thread_entry: start 2023-10-05T11:42:09.077 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.074+0000 7f75dca44880 20 rados->read ofs=0 len=0 2023-10-05T11:42:09.078 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.074+0000 7f75dca44880 20 rados_obj.operate() r=0 bl.length=200 2023-10-05T11:42:09.078 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.074+0000 7f75dca44880 20 rados->read ofs=0 len=0 2023-10-05T11:42:09.078 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.075+0000 7f75dca44880 20 rados_obj.operate() r=0 bl.length=372 2023-10-05T11:42:09.078 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.075+0000 7f75dca44880 20 couldn't put binfo cache entry, might have raced with data changes 2023-10-05T11:42:09.078 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.076+0000 7f75c21be640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:42:09.080 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.077+0000 7f75dca44880 20 remove_watcher() i=0 2023-10-05T11:42:09.080 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.077+0000 7f75dca44880 2 removed watcher, disabling cache 2023-10-05T11:42:09.081 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.079+0000 7f75dca44880 20 remove_watcher() i=1 2023-10-05T11:42:09.082 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.080+0000 7f75dca44880 20 remove_watcher() i=2 2023-10-05T11:42:09.083 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.081+0000 7f75dca44880 20 remove_watcher() i=3 2023-10-05T11:42:09.084 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.082+0000 7f75dca44880 20 remove_watcher() i=4 2023-10-05T11:42:09.085 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.083+0000 7f75dca44880 20 remove_watcher() i=5 2023-10-05T11:42:09.086 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.083+0000 7f75dca44880 20 remove_watcher() i=6 2023-10-05T11:42:09.087 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.084+0000 7f75dca44880 20 remove_watcher() i=7 2023-10-05T11:42:09.092 INFO:tasks.workunit.client.0.smithi012.stderr:rados -p default.rgw.buckets.index setomapval .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.16.2.0 --omap-key-file /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/olh_noname_key < /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/olh_noname_val 2023-10-05T11:42:09.117 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setuser ceph since I am not root 2023-10-05T11:42:09.117 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T11:42:09.133 INFO:tasks.workunit.client.0.smithi012.stderr:radosgw-admin bi list --bucket a-bucket 2023-10-05T11:42:09.161 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setuser ceph since I am not root 2023-10-05T11:42:09.161 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T11:42:09.174 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.172+0000 7f896811a880 20 rados->read ofs=0 len=0 2023-10-05T11:42:09.176 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.173+0000 7f896811a880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:42:09.176 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.173+0000 7f896811a880 20 realm 2023-10-05T11:42:09.176 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.174+0000 7f896811a880 20 rados->read ofs=0 len=0 2023-10-05T11:42:09.176 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.174+0000 7f896811a880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:42:09.176 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.174+0000 7f896811a880 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T11:42:09.177 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.174+0000 7f896811a880 20 rados->read ofs=0 len=0 2023-10-05T11:42:09.177 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.174+0000 7f896811a880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:42:09.177 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.174+0000 7f896811a880 20 rados->read ofs=0 len=0 2023-10-05T11:42:09.177 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.175+0000 7f896811a880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:42:09.177 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.175+0000 7f896811a880 20 rados->read ofs=0 len=0 2023-10-05T11:42:09.178 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.175+0000 7f896811a880 20 rados_obj.operate() r=0 bl.length=1020 2023-10-05T11:42:09.178 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.175+0000 7f896811a880 20 searching for the correct realm 2023-10-05T11:42:09.186 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.184+0000 7f89668bf640 0 -- 172.21.15.12:0/2903942557 >> [v2:172.21.15.12:6800/732466381,v1:172.21.15.12:6801/732466381] conn(0x5611b9e79400 msgr2=0x5611b9f50c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:42:09.188 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.185+0000 7f896811a880 20 RGWRados::pool_iterate: got zone_info.dff27d1e-df33-400e-a68a-7ba586947c99 2023-10-05T11:42:09.188 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.185+0000 7f896811a880 20 RGWRados::pool_iterate: got zonegroup_info.c78aa576-9d15-4e9d-b3c0-4af23a22062c 2023-10-05T11:42:09.188 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.185+0000 7f896811a880 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T11:42:09.188 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.185+0000 7f896811a880 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T11:42:09.188 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.185+0000 7f896811a880 20 rados->read ofs=0 len=0 2023-10-05T11:42:09.188 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.185+0000 7f896811a880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:42:09.188 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.185+0000 7f896811a880 20 rados->read ofs=0 len=0 2023-10-05T11:42:09.189 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.186+0000 7f896811a880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:42:09.190 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.186+0000 7f896811a880 20 rados->read ofs=0 len=0 2023-10-05T11:42:09.190 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.186+0000 7f896811a880 20 rados_obj.operate() r=0 bl.length=454 2023-10-05T11:42:09.190 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.186+0000 7f896811a880 20 zone default found 2023-10-05T11:42:09.190 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.186+0000 7f896811a880 4 Realm: () 2023-10-05T11:42:09.190 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.186+0000 7f896811a880 4 ZoneGroup: default (c78aa576-9d15-4e9d-b3c0-4af23a22062c) 2023-10-05T11:42:09.190 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.186+0000 7f896811a880 4 Zone: default (dff27d1e-df33-400e-a68a-7ba586947c99) 2023-10-05T11:42:09.190 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.186+0000 7f896811a880 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T11:42:09.190 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.186+0000 7f896811a880 20 zonegroup default 2023-10-05T11:42:09.190 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.186+0000 7f896811a880 20 rados->read ofs=0 len=0 2023-10-05T11:42:09.190 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.186+0000 7f896811a880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:42:09.190 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.186+0000 7f896811a880 20 rados->read ofs=0 len=0 2023-10-05T11:42:09.191 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.187+0000 7f896811a880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:42:09.191 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.187+0000 7f896811a880 20 rados->read ofs=0 len=0 2023-10-05T11:42:09.191 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.187+0000 7f896811a880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:42:09.191 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.187+0000 7f896811a880 20 started sync module instance, tier type = 2023-10-05T11:42:09.191 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.187+0000 7f896811a880 20 started zone id=dff27d1e-df33-400e-a68a-7ba586947c99 (name=default) with tier type = 2023-10-05T11:42:09.194 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.192+0000 7f89670c0640 0 -- 172.21.15.12:0/2903942557 >> [v2:172.21.15.170:6800/4137726411,v1:172.21.15.170:6801/4137726411] conn(0x5611b9f65800 msgr2=0x5611b9f51700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:42:09.198 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.196+0000 7f896811a880 20 add_watcher() i=0 2023-10-05T11:42:09.198 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.196+0000 7f896811a880 20 add_watcher() i=1 2023-10-05T11:42:09.198 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.196+0000 7f896811a880 20 add_watcher() i=2 2023-10-05T11:42:09.198 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.196+0000 7f896811a880 20 add_watcher() i=3 2023-10-05T11:42:09.198 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.196+0000 7f896811a880 20 add_watcher() i=4 2023-10-05T11:42:09.198 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.196+0000 7f896811a880 20 add_watcher() i=5 2023-10-05T11:42:09.199 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.196+0000 7f896811a880 20 add_watcher() i=6 2023-10-05T11:42:09.199 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.197+0000 7f896811a880 20 add_watcher() i=7 2023-10-05T11:42:09.199 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.197+0000 7f896811a880 2 all 8 watchers are set, enabling cache 2023-10-05T11:42:09.200 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.198+0000 7f894d88d640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:42:09.201 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.199+0000 7f896811a880 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T11:42:09.201 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.199+0000 7f896811a880 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T11:42:09.207 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.204+0000 7f896811a880 5 note: GC not initialized 2023-10-05T11:42:09.207 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.205+0000 7f8949084640 20 reqs_thread_entry: start 2023-10-05T11:42:09.207 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.205+0000 7f896811a880 20 init_complete bucket index max shards: 11 2023-10-05T11:42:09.207 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.205+0000 7f896811a880 20 Filter name: none 2023-10-05T11:42:09.207 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.205+0000 7f8947080640 20 reqs_thread_entry: start 2023-10-05T11:42:09.208 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.205+0000 7f896811a880 20 rados->read ofs=0 len=0 2023-10-05T11:42:09.209 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.205+0000 7f896811a880 20 rados_obj.operate() r=0 bl.length=200 2023-10-05T11:42:09.209 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.205+0000 7f896811a880 20 rados->read ofs=0 len=0 2023-10-05T11:42:09.209 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.206+0000 7f896811a880 20 rados_obj.operate() r=0 bl.length=372 2023-10-05T11:42:09.209 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.206+0000 7f896811a880 20 couldn't put binfo cache entry, might have raced with data changes 2023-10-05T11:42:09.210 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.206+0000 7f896811a880 20 INFO: main: max_entries=1000, index=gen=2, max_shards=13 2023-10-05T11:42:09.210 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.206+0000 7f896811a880 20 INFO: main: starting shard=0 2023-10-05T11:42:09.210 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.206+0000 7f896811a880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.16.2.0 2023-10-05T11:42:09.210 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.206+0000 7f896811a880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.16.2.0 2023-10-05T11:42:09.210 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.206+0000 7f896811a880 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2023-10-05T11:42:09.210 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.206+0000 7f896811a880 20 INFO: main: starting shard=1 2023-10-05T11:42:09.210 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.206+0000 7f896811a880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.16.2.1 2023-10-05T11:42:09.210 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.206+0000 7f896811a880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.16.2.1 2023-10-05T11:42:09.210 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.207+0000 7f896811a880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:42:09.210 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.207+0000 7f896811a880 20 INFO: main: starting shard=2 2023-10-05T11:42:09.210 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.207+0000 7f896811a880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.16.2.2 2023-10-05T11:42:09.211 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.207+0000 7f896811a880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.16.2.2 2023-10-05T11:42:09.211 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.207+0000 7f896811a880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:42:09.211 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.207+0000 7f896811a880 20 INFO: main: starting shard=3 2023-10-05T11:42:09.211 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.207+0000 7f896811a880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.16.2.3 2023-10-05T11:42:09.212 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.207+0000 7f896811a880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.16.2.3 2023-10-05T11:42:09.213 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.207+0000 7f896811a880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:42:09.213 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.207+0000 7f896811a880 20 INFO: main: starting shard=4 2023-10-05T11:42:09.213 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.207+0000 7f896811a880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.16.2.4 2023-10-05T11:42:09.213 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.207+0000 7f896811a880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.16.2.4 2023-10-05T11:42:09.213 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.208+0000 7f896811a880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:42:09.213 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.208+0000 7f896811a880 20 INFO: main: starting shard=5 2023-10-05T11:42:09.214 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.208+0000 7f896811a880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.16.2.5 2023-10-05T11:42:09.214 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.208+0000 7f896811a880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.16.2.5 2023-10-05T11:42:09.214 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.208+0000 7f896811a880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:42:09.214 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.208+0000 7f896811a880 20 INFO: main: starting shard=6 2023-10-05T11:42:09.215 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.208+0000 7f896811a880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.16.2.6 2023-10-05T11:42:09.215 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.208+0000 7f896811a880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.16.2.6 2023-10-05T11:42:09.215 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.209+0000 7f896811a880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:42:09.215 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.209+0000 7f896811a880 20 INFO: main: starting shard=7 2023-10-05T11:42:09.215 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.209+0000 7f896811a880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.16.2.7 2023-10-05T11:42:09.215 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.209+0000 7f896811a880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.16.2.7 2023-10-05T11:42:09.215 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.209+0000 7f896811a880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:42:09.215 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.209+0000 7f896811a880 20 INFO: main: starting shard=8 2023-10-05T11:42:09.215 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.209+0000 7f896811a880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.16.2.8 2023-10-05T11:42:09.215 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.209+0000 7f896811a880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.16.2.8 2023-10-05T11:42:09.215 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.210+0000 7f896811a880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:42:09.216 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.210+0000 7f896811a880 20 INFO: main: starting shard=9 2023-10-05T11:42:09.216 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.210+0000 7f896811a880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.16.2.9 2023-10-05T11:42:09.216 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.210+0000 7f896811a880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.16.2.9 2023-10-05T11:42:09.216 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.210+0000 7f896811a880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:42:09.216 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.210+0000 7f896811a880 20 INFO: main: starting shard=10 2023-10-05T11:42:09.216 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.210+0000 7f896811a880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.16.2.10 2023-10-05T11:42:09.216 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.210+0000 7f896811a880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.16.2.10 2023-10-05T11:42:09.217 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.211+0000 7f896811a880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:42:09.217 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.211+0000 7f896811a880 20 INFO: main: starting shard=11 2023-10-05T11:42:09.217 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.211+0000 7f896811a880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.16.2.11 2023-10-05T11:42:09.217 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.211+0000 7f896811a880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.16.2.11 2023-10-05T11:42:09.219 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.211+0000 7f896811a880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:42:09.220 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.211+0000 7f896811a880 20 INFO: main: starting shard=12 2023-10-05T11:42:09.220 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.211+0000 7f896811a880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.16.2.12 2023-10-05T11:42:09.220 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.211+0000 7f896811a880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.16.2.12 2023-10-05T11:42:09.220 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.212+0000 7f896811a880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:42:09.220 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.212+0000 7f896811a880 20 INFO: main: done 2023-10-05T11:42:09.220 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.212+0000 7f894d88d640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:42:09.220 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.214+0000 7f896811a880 20 remove_watcher() i=0 2023-10-05T11:42:09.220 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.214+0000 7f896811a880 2 removed watcher, disabling cache 2023-10-05T11:42:09.220 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.216+0000 7f896811a880 20 remove_watcher() i=1 2023-10-05T11:42:09.220 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.217+0000 7f896811a880 20 remove_watcher() i=2 2023-10-05T11:42:09.221 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.218+0000 7f896811a880 20 remove_watcher() i=3 2023-10-05T11:42:09.221 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.219+0000 7f896811a880 20 remove_watcher() i=4 2023-10-05T11:42:09.222 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.220+0000 7f896811a880 20 remove_watcher() i=5 2023-10-05T11:42:09.223 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.221+0000 7f896811a880 20 remove_watcher() i=6 2023-10-05T11:42:09.224 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.222+0000 7f896811a880 20 remove_watcher() i=7 2023-10-05T11:42:09.230 INFO:tasks.workunit.client.0.smithi012.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 1 --yes-i-really-mean-it 2023-10-05T11:42:09.261 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setuser ceph since I am not root 2023-10-05T11:42:09.261 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T11:42:09.273 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.271+0000 7face1a0f880 20 rados->read ofs=0 len=0 2023-10-05T11:42:09.275 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.273+0000 7face1a0f880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:42:09.275 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.273+0000 7face1a0f880 20 realm 2023-10-05T11:42:09.275 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.273+0000 7face1a0f880 20 rados->read ofs=0 len=0 2023-10-05T11:42:09.275 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.273+0000 7face1a0f880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:42:09.276 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.273+0000 7face1a0f880 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T11:42:09.276 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.273+0000 7face1a0f880 20 rados->read ofs=0 len=0 2023-10-05T11:42:09.276 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.273+0000 7face1a0f880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:42:09.276 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.273+0000 7face1a0f880 20 rados->read ofs=0 len=0 2023-10-05T11:42:09.276 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.274+0000 7face1a0f880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:42:09.276 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.274+0000 7face1a0f880 20 rados->read ofs=0 len=0 2023-10-05T11:42:09.277 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.274+0000 7face1a0f880 20 rados_obj.operate() r=0 bl.length=1020 2023-10-05T11:42:09.277 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.274+0000 7face1a0f880 20 searching for the correct realm 2023-10-05T11:42:09.286 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.283+0000 7facddeda640 0 -- 172.21.15.12:0/3064307034 >> [v2:172.21.15.170:6814/3150808418,v1:172.21.15.170:6816/3150808418] conn(0x55c3cd4b0c00 msgr2=0x55c3cd30ac00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:42:09.288 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.285+0000 7face1a0f880 20 RGWRados::pool_iterate: got zone_info.dff27d1e-df33-400e-a68a-7ba586947c99 2023-10-05T11:42:09.289 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.285+0000 7face1a0f880 20 RGWRados::pool_iterate: got zonegroup_info.c78aa576-9d15-4e9d-b3c0-4af23a22062c 2023-10-05T11:42:09.289 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.285+0000 7face1a0f880 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T11:42:09.289 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.285+0000 7face1a0f880 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T11:42:09.289 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.285+0000 7face1a0f880 20 rados->read ofs=0 len=0 2023-10-05T11:42:09.289 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.285+0000 7face1a0f880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:42:09.289 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.285+0000 7face1a0f880 20 rados->read ofs=0 len=0 2023-10-05T11:42:09.289 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.285+0000 7face1a0f880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:42:09.289 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.285+0000 7face1a0f880 20 rados->read ofs=0 len=0 2023-10-05T11:42:09.289 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.285+0000 7face1a0f880 20 rados_obj.operate() r=0 bl.length=454 2023-10-05T11:42:09.289 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.285+0000 7face1a0f880 20 zone default found 2023-10-05T11:42:09.290 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.285+0000 7face1a0f880 4 Realm: () 2023-10-05T11:42:09.290 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.285+0000 7face1a0f880 4 ZoneGroup: default (c78aa576-9d15-4e9d-b3c0-4af23a22062c) 2023-10-05T11:42:09.290 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.285+0000 7face1a0f880 4 Zone: default (dff27d1e-df33-400e-a68a-7ba586947c99) 2023-10-05T11:42:09.290 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.285+0000 7face1a0f880 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T11:42:09.290 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.285+0000 7face1a0f880 20 zonegroup default 2023-10-05T11:42:09.290 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.285+0000 7face1a0f880 20 rados->read ofs=0 len=0 2023-10-05T11:42:09.290 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.286+0000 7face1a0f880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:42:09.290 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.286+0000 7face1a0f880 20 rados->read ofs=0 len=0 2023-10-05T11:42:09.290 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.286+0000 7face1a0f880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:42:09.290 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.286+0000 7face1a0f880 20 rados->read ofs=0 len=0 2023-10-05T11:42:09.290 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.286+0000 7face1a0f880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:42:09.291 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.286+0000 7face1a0f880 20 started sync module instance, tier type = 2023-10-05T11:42:09.291 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.286+0000 7face1a0f880 20 started zone id=dff27d1e-df33-400e-a68a-7ba586947c99 (name=default) with tier type = 2023-10-05T11:42:09.295 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.293+0000 7facde6db640 0 -- 172.21.15.12:0/3064307034 >> [v2:172.21.15.12:6824/2171933159,v1:172.21.15.12:6825/2171933159] conn(0x55c3cd4b1400 msgr2=0x55c3cd30b700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:42:09.298 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.295+0000 7face1a0f880 20 add_watcher() i=0 2023-10-05T11:42:09.298 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.295+0000 7face1a0f880 20 add_watcher() i=1 2023-10-05T11:42:09.298 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.295+0000 7face1a0f880 20 add_watcher() i=2 2023-10-05T11:42:09.298 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.295+0000 7face1a0f880 20 add_watcher() i=3 2023-10-05T11:42:09.298 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.295+0000 7face1a0f880 20 add_watcher() i=4 2023-10-05T11:42:09.298 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.295+0000 7face1a0f880 20 add_watcher() i=5 2023-10-05T11:42:09.298 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.295+0000 7face1a0f880 20 add_watcher() i=6 2023-10-05T11:42:09.299 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.296+0000 7face1a0f880 20 add_watcher() i=7 2023-10-05T11:42:09.299 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.296+0000 7face1a0f880 2 all 8 watchers are set, enabling cache 2023-10-05T11:42:09.300 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.298+0000 7facc4ea8640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:42:09.300 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.298+0000 7face1a0f880 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T11:42:09.300 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.298+0000 7face1a0f880 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T11:42:09.306 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.303+0000 7face1a0f880 5 note: GC not initialized 2023-10-05T11:42:09.306 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.304+0000 7facc069f640 20 reqs_thread_entry: start 2023-10-05T11:42:09.306 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.304+0000 7face1a0f880 20 init_complete bucket index max shards: 11 2023-10-05T11:42:09.306 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.304+0000 7face1a0f880 20 Filter name: none 2023-10-05T11:42:09.307 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.304+0000 7facbe69b640 20 reqs_thread_entry: start 2023-10-05T11:42:09.307 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.304+0000 7face1a0f880 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2023-10-05T11:42:09.307 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.304+0000 7face1a0f880 20 rados->read ofs=0 len=0 2023-10-05T11:42:09.307 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.304+0000 7face1a0f880 20 rados_obj.operate() r=0 bl.length=200 2023-10-05T11:42:09.308 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.304+0000 7face1a0f880 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2023-10-05T11:42:09.308 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.304+0000 7face1a0f880 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2023-10-05T11:42:09.308 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.304+0000 7face1a0f880 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:dff27d1e-df33-400e-a68a-7ba586947c99.4604.16 : miss 2023-10-05T11:42:09.308 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.304+0000 7face1a0f880 20 rados->read ofs=0 len=0 2023-10-05T11:42:09.308 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.305+0000 7face1a0f880 20 rados_obj.operate() r=0 bl.length=372 2023-10-05T11:42:09.308 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.305+0000 7face1a0f880 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:dff27d1e-df33-400e-a68a-7ba586947c99.4604.16 info.flags=0x17 2023-10-05T11:42:09.308 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.305+0000 7face1a0f880 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:dff27d1e-df33-400e-a68a-7ba586947c99.4604.16 to cache LRU end 2023-10-05T11:42:09.308 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.305+0000 7face1a0f880 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T11:42:09.308 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.305+0000 7face1a0f880 10 updating xattr: name=user.rgw.acl bl.length()=203 2023-10-05T11:42:09.308 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.305+0000 7face1a0f880 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:dff27d1e-df33-400e-a68a-7ba586947c99.4604.16 2023-10-05T11:42:09.311 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.309+0000 7face1a0f880 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:dff27d1e-df33-400e-a68a-7ba586947c99.4604.16 info.flags=0x17 2023-10-05T11:42:09.311 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.309+0000 7face1a0f880 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:dff27d1e-df33-400e-a68a-7ba586947c99.4604.16 to cache LRU end 2023-10-05T11:42:09.311 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.309+0000 7face1a0f880 10 updating xattr: name=user.rgw.acl bl.length()=203 2023-10-05T11:42:09.312 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.309+0000 7face1a0f880 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:dff27d1e-df33-400e-a68a-7ba586947c99.4604.16, ofs0, ns] 2023-10-05T11:42:09.312 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.309+0000 7facd7ece640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1060856922186 cookie 94299451234304 notifier 7590 bl.length()=861 2023-10-05T11:42:09.312 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.309+0000 7facd7ece640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:dff27d1e-df33-400e-a68a-7ba586947c99.4604.16 info.flags=0x17 2023-10-05T11:42:09.312 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.309+0000 7facd7ece640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:dff27d1e-df33-400e-a68a-7ba586947c99.4604.16 to cache LRU end 2023-10-05T11:42:09.312 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.309+0000 7facd7ece640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2023-10-05T11:42:09.313 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.311+0000 7face1a0f880 20 handle_bi_update(): bucket=:a-bucket[dff27d1e-df33-400e-a68a-7ba586947c99.4604.16]): orig_sources= new_sources= 2023-10-05T11:42:09.314 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.311+0000 7face1a0f880 20 handle_bi_update(): bucket=:a-bucket[dff27d1e-df33-400e-a68a-7ba586947c99.4604.16]): potential sources added=[] removed=[] 2023-10-05T11:42:09.314 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.311+0000 7face1a0f880 20 handle_bi_update(): bucket=:a-bucket[dff27d1e-df33-400e-a68a-7ba586947c99.4604.16]): orig_dests= new_dests= 2023-10-05T11:42:09.314 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.311+0000 7face1a0f880 20 handle_bi_update(): bucket=:a-bucket[dff27d1e-df33-400e-a68a-7ba586947c99.4604.16]): potential dests added=[] removed=[] 2023-10-05T11:42:09.317 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.314+0000 7face1a0f880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.16.3.0 2023-10-05T11:42:09.317 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.314+0000 7face1a0f880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.16.3.0 2023-10-05T11:42:09.317 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.314+0000 7face1a0f880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.16.2.0 2023-10-05T11:42:09.317 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.314+0000 7face1a0f880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.16.2.0 2023-10-05T11:42:09.317 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.314+0000 7face1a0f880 10 Dropping entry with empty name, idx=�1001_04/57/0457f727ec113e418d5b16d206b200ed068c0533554883ce811df7c932a3df68/2018_12_11/2889999/3386469/metadata.gz 2023-10-05T11:42:09.317 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.314+0000 7face1a0f880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.16.2.1 2023-10-05T11:42:09.317 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.314+0000 7face1a0f880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.16.2.1 2023-10-05T11:42:09.318 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.315+0000 7face1a0f880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.16.2.2 2023-10-05T11:42:09.318 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.315+0000 7face1a0f880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.16.2.2 2023-10-05T11:42:09.318 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.315+0000 7face1a0f880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.16.2.3 2023-10-05T11:42:09.318 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.315+0000 7face1a0f880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.16.2.3 2023-10-05T11:42:09.318 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.316+0000 7face1a0f880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.16.2.4 2023-10-05T11:42:09.319 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.316+0000 7face1a0f880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.16.2.4 2023-10-05T11:42:09.319 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.316+0000 7face1a0f880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.16.2.5 2023-10-05T11:42:09.319 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.316+0000 7face1a0f880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.16.2.5 2023-10-05T11:42:09.319 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.317+0000 7face1a0f880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.16.2.6 2023-10-05T11:42:09.320 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.317+0000 7face1a0f880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.16.2.6 2023-10-05T11:42:09.320 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.317+0000 7face1a0f880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.16.2.7 2023-10-05T11:42:09.320 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.317+0000 7face1a0f880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.16.2.7 2023-10-05T11:42:09.320 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.317+0000 7face1a0f880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.16.2.8 2023-10-05T11:42:09.320 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.317+0000 7face1a0f880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.16.2.8 2023-10-05T11:42:09.320 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.318+0000 7face1a0f880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.16.2.9 2023-10-05T11:42:09.320 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.318+0000 7face1a0f880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.16.2.9 2023-10-05T11:42:09.321 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.318+0000 7face1a0f880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.16.2.10 2023-10-05T11:42:09.321 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.318+0000 7face1a0f880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.16.2.10 2023-10-05T11:42:09.321 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.319+0000 7face1a0f880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.16.2.11 2023-10-05T11:42:09.321 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.319+0000 7face1a0f880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.16.2.11 2023-10-05T11:42:09.322 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.319+0000 7face1a0f880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.16.2.12 2023-10-05T11:42:09.322 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.319+0000 7face1a0f880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.16.2.12 2023-10-05T11:42:09.322 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.320+0000 7face1a0f880 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:dff27d1e-df33-400e-a68a-7ba586947c99.4604.16 : hit (requested=0x17, cached=0x17) 2023-10-05T11:42:09.322 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.320+0000 7face1a0f880 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:dff27d1e-df33-400e-a68a-7ba586947c99.4604.16 2023-10-05T11:42:09.324 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.321+0000 7face1a0f880 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:dff27d1e-df33-400e-a68a-7ba586947c99.4604.16 info.flags=0x17 2023-10-05T11:42:09.324 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.321+0000 7face1a0f880 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:dff27d1e-df33-400e-a68a-7ba586947c99.4604.16 to cache LRU end 2023-10-05T11:42:09.324 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.321+0000 7face1a0f880 10 updating xattr: name=user.rgw.acl bl.length()=203 2023-10-05T11:42:09.324 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.321+0000 7face1a0f880 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:dff27d1e-df33-400e-a68a-7ba586947c99.4604.16, ofs0, ns] 2023-10-05T11:42:09.324 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.321+0000 7facd7ece640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1060856922187 cookie 94299451234304 notifier 7590 bl.length()=829 2023-10-05T11:42:09.324 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.321+0000 7facd7ece640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:dff27d1e-df33-400e-a68a-7ba586947c99.4604.16 info.flags=0x17 2023-10-05T11:42:09.324 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.321+0000 7facd7ece640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:dff27d1e-df33-400e-a68a-7ba586947c99.4604.16 to cache LRU end 2023-10-05T11:42:09.325 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.321+0000 7facd7ece640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2023-10-05T11:42:09.325 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.323+0000 7face1a0f880 20 handle_bi_update(): bucket=:a-bucket[dff27d1e-df33-400e-a68a-7ba586947c99.4604.16]): orig_sources= new_sources= 2023-10-05T11:42:09.326 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.323+0000 7face1a0f880 20 handle_bi_update(): bucket=:a-bucket[dff27d1e-df33-400e-a68a-7ba586947c99.4604.16]): potential sources added=[] removed=[] 2023-10-05T11:42:09.326 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.323+0000 7face1a0f880 20 handle_bi_update(): bucket=:a-bucket[dff27d1e-df33-400e-a68a-7ba586947c99.4604.16]): orig_dests= new_dests= 2023-10-05T11:42:09.326 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.323+0000 7face1a0f880 20 handle_bi_update(): bucket=:a-bucket[dff27d1e-df33-400e-a68a-7ba586947c99.4604.16]): potential dests added=[] removed=[] 2023-10-05T11:42:09.328 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.326+0000 7face1a0f880 1 execute INFO: reshard of bucket "a-bucket" completed successfully 2023-10-05T11:42:09.329 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.327+0000 7facc4ea8640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:42:09.334 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.329+0000 7face1a0f880 20 remove_watcher() i=0 2023-10-05T11:42:09.334 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.329+0000 7face1a0f880 2 removed watcher, disabling cache 2023-10-05T11:42:09.334 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.330+0000 7face1a0f880 20 remove_watcher() i=1 2023-10-05T11:42:09.334 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.331+0000 7face1a0f880 20 remove_watcher() i=2 2023-10-05T11:42:09.335 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.332+0000 7face1a0f880 20 remove_watcher() i=3 2023-10-05T11:42:09.335 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.333+0000 7face1a0f880 20 remove_watcher() i=4 2023-10-05T11:42:09.336 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.334+0000 7face1a0f880 20 remove_watcher() i=5 2023-10-05T11:42:09.337 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.335+0000 7face1a0f880 20 remove_watcher() i=6 2023-10-05T11:42:09.338 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.336+0000 7face1a0f880 20 remove_watcher() i=7 2023-10-05T11:42:09.344 INFO:tasks.workunit.client.0.smithi012.stderr:radosgw-admin bi list --bucket a-bucket 2023-10-05T11:42:09.372 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setuser ceph since I am not root 2023-10-05T11:42:09.372 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T11:42:09.385 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.383+0000 7f8fd094b880 20 rados->read ofs=0 len=0 2023-10-05T11:42:09.386 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.384+0000 7f8fd094b880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:42:09.387 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.384+0000 7f8fd094b880 20 realm 2023-10-05T11:42:09.387 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.384+0000 7f8fd094b880 20 rados->read ofs=0 len=0 2023-10-05T11:42:09.387 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.384+0000 7f8fd094b880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:42:09.387 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.384+0000 7f8fd094b880 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T11:42:09.387 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.384+0000 7f8fd094b880 20 rados->read ofs=0 len=0 2023-10-05T11:42:09.387 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.384+0000 7f8fd094b880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:42:09.387 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.384+0000 7f8fd094b880 20 rados->read ofs=0 len=0 2023-10-05T11:42:09.388 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.385+0000 7f8fd094b880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:42:09.388 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.385+0000 7f8fd094b880 20 rados->read ofs=0 len=0 2023-10-05T11:42:09.388 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.386+0000 7f8fd094b880 20 rados_obj.operate() r=0 bl.length=1020 2023-10-05T11:42:09.388 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.386+0000 7f8fd094b880 20 searching for the correct realm 2023-10-05T11:42:09.397 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.395+0000 7f8fcf0f0640 0 -- 172.21.15.12:0/3731747613 >> [v2:172.21.15.170:6814/3150808418,v1:172.21.15.170:6816/3150808418] conn(0x55c0c1ac9c00 msgr2=0x55c0c0ecb180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-10-05T11:42:09.399 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.396+0000 7f8fd094b880 20 RGWRados::pool_iterate: got zone_info.dff27d1e-df33-400e-a68a-7ba586947c99 2023-10-05T11:42:09.399 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.396+0000 7f8fd094b880 20 RGWRados::pool_iterate: got zonegroup_info.c78aa576-9d15-4e9d-b3c0-4af23a22062c 2023-10-05T11:42:09.399 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.396+0000 7f8fd094b880 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T11:42:09.399 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.396+0000 7f8fd094b880 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T11:42:09.399 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.396+0000 7f8fd094b880 20 rados->read ofs=0 len=0 2023-10-05T11:42:09.399 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.397+0000 7f8fd094b880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:42:09.399 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.397+0000 7f8fd094b880 20 rados->read ofs=0 len=0 2023-10-05T11:42:09.400 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.397+0000 7f8fd094b880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:42:09.400 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.397+0000 7f8fd094b880 20 rados->read ofs=0 len=0 2023-10-05T11:42:09.401 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.397+0000 7f8fd094b880 20 rados_obj.operate() r=0 bl.length=454 2023-10-05T11:42:09.401 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.397+0000 7f8fd094b880 20 zone default found 2023-10-05T11:42:09.401 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.397+0000 7f8fd094b880 4 Realm: () 2023-10-05T11:42:09.401 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.397+0000 7f8fd094b880 4 ZoneGroup: default (c78aa576-9d15-4e9d-b3c0-4af23a22062c) 2023-10-05T11:42:09.401 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.397+0000 7f8fd094b880 4 Zone: default (dff27d1e-df33-400e-a68a-7ba586947c99) 2023-10-05T11:42:09.401 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.397+0000 7f8fd094b880 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T11:42:09.401 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.397+0000 7f8fd094b880 20 zonegroup default 2023-10-05T11:42:09.401 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.397+0000 7f8fd094b880 20 rados->read ofs=0 len=0 2023-10-05T11:42:09.401 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.397+0000 7f8fd094b880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:42:09.401 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.397+0000 7f8fd094b880 20 rados->read ofs=0 len=0 2023-10-05T11:42:09.402 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.398+0000 7f8fd094b880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:42:09.402 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.398+0000 7f8fd094b880 20 rados->read ofs=0 len=0 2023-10-05T11:42:09.402 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.398+0000 7f8fd094b880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:42:09.402 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.398+0000 7f8fd094b880 20 started sync module instance, tier type = 2023-10-05T11:42:09.402 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.398+0000 7f8fd094b880 20 started zone id=dff27d1e-df33-400e-a68a-7ba586947c99 (name=default) with tier type = 2023-10-05T11:42:09.406 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.404+0000 7f8fcf8f1640 0 -- 172.21.15.12:0/3731747613 >> [v2:172.21.15.170:6800/4137726411,v1:172.21.15.170:6801/4137726411] conn(0x55c0c108bc00 msgr2=0x55c0c106b700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:42:09.409 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.407+0000 7f8fd094b880 20 add_watcher() i=0 2023-10-05T11:42:09.409 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.407+0000 7f8fd094b880 20 add_watcher() i=1 2023-10-05T11:42:09.409 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.407+0000 7f8fd094b880 20 add_watcher() i=2 2023-10-05T11:42:09.409 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.407+0000 7f8fd094b880 20 add_watcher() i=3 2023-10-05T11:42:09.409 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.407+0000 7f8fd094b880 20 add_watcher() i=4 2023-10-05T11:42:09.409 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.407+0000 7f8fd094b880 20 add_watcher() i=5 2023-10-05T11:42:09.409 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.407+0000 7f8fd094b880 20 add_watcher() i=6 2023-10-05T11:42:09.410 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.407+0000 7f8fd094b880 20 add_watcher() i=7 2023-10-05T11:42:09.410 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.407+0000 7f8fd094b880 2 all 8 watchers are set, enabling cache 2023-10-05T11:42:09.411 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.409+0000 7f8fb60be640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:42:09.411 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.409+0000 7f8fd094b880 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T11:42:09.411 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.409+0000 7f8fd094b880 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T11:42:09.416 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.414+0000 7f8fd094b880 5 note: GC not initialized 2023-10-05T11:42:09.417 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.415+0000 7f8fb18b5640 20 reqs_thread_entry: start 2023-10-05T11:42:09.418 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.415+0000 7f8fd094b880 20 init_complete bucket index max shards: 11 2023-10-05T11:42:09.418 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.415+0000 7f8fd094b880 20 Filter name: none 2023-10-05T11:42:09.418 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.415+0000 7f8faf8b1640 20 reqs_thread_entry: start 2023-10-05T11:42:09.418 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.415+0000 7f8fd094b880 20 rados->read ofs=0 len=0 2023-10-05T11:42:09.418 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.415+0000 7f8fd094b880 20 rados_obj.operate() r=0 bl.length=200 2023-10-05T11:42:09.418 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.415+0000 7f8fd094b880 20 rados->read ofs=0 len=0 2023-10-05T11:42:09.419 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.416+0000 7f8fd094b880 20 rados_obj.operate() r=0 bl.length=372 2023-10-05T11:42:09.419 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.416+0000 7f8fd094b880 20 couldn't put binfo cache entry, might have raced with data changes 2023-10-05T11:42:09.419 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.416+0000 7f8fd094b880 20 INFO: main: max_entries=1000, index=gen=3, max_shards=1 2023-10-05T11:42:09.419 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.416+0000 7f8fd094b880 20 INFO: main: starting shard=0 2023-10-05T11:42:09.419 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.416+0000 7f8fd094b880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.16.3.0 2023-10-05T11:42:09.420 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.416+0000 7f8fd094b880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.16.3.0 2023-10-05T11:42:09.420 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.416+0000 7f8fd094b880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:42:09.420 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.416+0000 7f8fd094b880 20 INFO: main: done 2023-10-05T11:42:09.420 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.417+0000 7f8fb60be640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:42:09.422 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.419+0000 7f8fd094b880 20 remove_watcher() i=0 2023-10-05T11:42:09.422 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.419+0000 7f8fd094b880 2 removed watcher, disabling cache 2023-10-05T11:42:09.423 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.420+0000 7f8fd094b880 20 remove_watcher() i=1 2023-10-05T11:42:09.423 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.421+0000 7f8fd094b880 20 remove_watcher() i=2 2023-10-05T11:42:09.425 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.422+0000 7f8fd094b880 20 remove_watcher() i=3 2023-10-05T11:42:09.426 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.423+0000 7f8fd094b880 20 remove_watcher() i=4 2023-10-05T11:42:09.427 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.424+0000 7f8fd094b880 20 remove_watcher() i=5 2023-10-05T11:42:09.428 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.425+0000 7f8fd094b880 20 remove_watcher() i=6 2023-10-05T11:42:09.428 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.426+0000 7f8fd094b880 20 remove_watcher() i=7 2023-10-05T11:42:09.433 INFO:tasks.workunit.client.0.smithi012.stderr: test: PUT succeeds during reshard 2023-10-05T11:42:09.434 INFO:tasks.workunit.client.0.smithi012.stderr:radosgw-admin bucket stats --bucket myver 2023-10-05T11:42:09.462 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setuser ceph since I am not root 2023-10-05T11:42:09.462 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T11:42:09.475 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.473+0000 7f2972332880 20 rados->read ofs=0 len=0 2023-10-05T11:42:09.477 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.474+0000 7f2972332880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:42:09.477 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.474+0000 7f2972332880 20 realm 2023-10-05T11:42:09.477 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.474+0000 7f2972332880 20 rados->read ofs=0 len=0 2023-10-05T11:42:09.477 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.474+0000 7f2972332880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:42:09.477 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.474+0000 7f2972332880 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T11:42:09.477 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.474+0000 7f2972332880 20 rados->read ofs=0 len=0 2023-10-05T11:42:09.477 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.474+0000 7f2972332880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:42:09.477 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.474+0000 7f2972332880 20 rados->read ofs=0 len=0 2023-10-05T11:42:09.478 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.475+0000 7f2972332880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:42:09.478 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.475+0000 7f2972332880 20 rados->read ofs=0 len=0 2023-10-05T11:42:09.479 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.476+0000 7f2972332880 20 rados_obj.operate() r=0 bl.length=1020 2023-10-05T11:42:09.479 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.476+0000 7f2972332880 20 searching for the correct realm 2023-10-05T11:42:09.487 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.485+0000 7f296ec80640 0 -- 172.21.15.12:0/3073563800 >> [v2:172.21.15.170:6814/3150808418,v1:172.21.15.170:6816/3150808418] conn(0x558a7f969000 msgr2=0x558a7eccac00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:42:09.488 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.486+0000 7f2972332880 20 RGWRados::pool_iterate: got zone_info.dff27d1e-df33-400e-a68a-7ba586947c99 2023-10-05T11:42:09.489 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.486+0000 7f2972332880 20 RGWRados::pool_iterate: got zonegroup_info.c78aa576-9d15-4e9d-b3c0-4af23a22062c 2023-10-05T11:42:09.489 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.486+0000 7f2972332880 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T11:42:09.489 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.486+0000 7f2972332880 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T11:42:09.489 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.486+0000 7f2972332880 20 rados->read ofs=0 len=0 2023-10-05T11:42:09.489 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.486+0000 7f2972332880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:42:09.489 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.486+0000 7f2972332880 20 rados->read ofs=0 len=0 2023-10-05T11:42:09.490 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.487+0000 7f2972332880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:42:09.490 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.487+0000 7f2972332880 20 rados->read ofs=0 len=0 2023-10-05T11:42:09.490 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.487+0000 7f2972332880 20 rados_obj.operate() r=0 bl.length=454 2023-10-05T11:42:09.490 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.487+0000 7f2972332880 20 zone default found 2023-10-05T11:42:09.490 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.487+0000 7f2972332880 4 Realm: () 2023-10-05T11:42:09.490 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.487+0000 7f2972332880 4 ZoneGroup: default (c78aa576-9d15-4e9d-b3c0-4af23a22062c) 2023-10-05T11:42:09.491 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.487+0000 7f2972332880 4 Zone: default (dff27d1e-df33-400e-a68a-7ba586947c99) 2023-10-05T11:42:09.491 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.487+0000 7f2972332880 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T11:42:09.491 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.487+0000 7f2972332880 20 zonegroup default 2023-10-05T11:42:09.491 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.487+0000 7f2972332880 20 rados->read ofs=0 len=0 2023-10-05T11:42:09.491 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.487+0000 7f2972332880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:42:09.491 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.487+0000 7f2972332880 20 rados->read ofs=0 len=0 2023-10-05T11:42:09.491 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.487+0000 7f2972332880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:42:09.491 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.487+0000 7f2972332880 20 rados->read ofs=0 len=0 2023-10-05T11:42:09.491 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.488+0000 7f2972332880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:42:09.491 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.488+0000 7f2972332880 20 started sync module instance, tier type = 2023-10-05T11:42:09.491 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.488+0000 7f2972332880 20 started zone id=dff27d1e-df33-400e-a68a-7ba586947c99 (name=default) with tier type = 2023-10-05T11:42:09.496 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.494+0000 7f296f481640 0 -- 172.21.15.12:0/3073563800 >> [v2:172.21.15.12:6824/2171933159,v1:172.21.15.12:6825/2171933159] conn(0x558a7ee80400 msgr2=0x558a7eccb700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:42:09.499 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.497+0000 7f2972332880 20 add_watcher() i=0 2023-10-05T11:42:09.499 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.497+0000 7f2972332880 20 add_watcher() i=1 2023-10-05T11:42:09.499 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.497+0000 7f2972332880 20 add_watcher() i=2 2023-10-05T11:42:09.499 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.497+0000 7f2972332880 20 add_watcher() i=3 2023-10-05T11:42:09.500 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.497+0000 7f2972332880 20 add_watcher() i=4 2023-10-05T11:42:09.500 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.497+0000 7f2972332880 20 add_watcher() i=5 2023-10-05T11:42:09.500 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.497+0000 7f2972332880 20 add_watcher() i=6 2023-10-05T11:42:09.501 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.498+0000 7f2972332880 20 add_watcher() i=7 2023-10-05T11:42:09.501 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.498+0000 7f2972332880 2 all 8 watchers are set, enabling cache 2023-10-05T11:42:09.501 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.499+0000 7f2955c4e640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:42:09.501 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.499+0000 7f2972332880 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T11:42:09.502 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.499+0000 7f2972332880 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T11:42:09.507 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.505+0000 7f2972332880 5 note: GC not initialized 2023-10-05T11:42:09.508 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.505+0000 7f2951445640 20 reqs_thread_entry: start 2023-10-05T11:42:09.508 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.505+0000 7f2972332880 20 init_complete bucket index max shards: 11 2023-10-05T11:42:09.508 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.505+0000 7f2972332880 20 Filter name: none 2023-10-05T11:42:09.508 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.505+0000 7f294f441640 20 reqs_thread_entry: start 2023-10-05T11:42:09.508 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.505+0000 7f2972332880 20 rados->read ofs=0 len=0 2023-10-05T11:42:09.509 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.506+0000 7f2972332880 20 rados_obj.operate() r=0 bl.length=197 2023-10-05T11:42:09.509 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.506+0000 7f2972332880 20 rados->read ofs=0 len=0 2023-10-05T11:42:09.509 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.506+0000 7f2972332880 20 rados_obj.operate() r=0 bl.length=369 2023-10-05T11:42:09.509 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.506+0000 7f2972332880 20 couldn't put binfo cache entry, might have raced with data changes 2023-10-05T11:42:09.509 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.506+0000 7f2972332880 20 rados->read ofs=0 len=0 2023-10-05T11:42:09.509 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.506+0000 7f2972332880 20 rados_obj.operate() r=0 bl.length=197 2023-10-05T11:42:09.509 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.506+0000 7f2972332880 20 rados->read ofs=0 len=0 2023-10-05T11:42:09.509 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.507+0000 7f2972332880 20 rados_obj.operate() r=0 bl.length=369 2023-10-05T11:42:09.510 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.507+0000 7f2972332880 20 couldn't put binfo cache entry, might have raced with data changes 2023-10-05T11:42:09.510 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.507+0000 7f2972332880 20 rados->read ofs=0 len=0 2023-10-05T11:42:09.510 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.508+0000 7f2972332880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:42:09.511 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.508+0000 7f2955c4e640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:42:09.513 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.510+0000 7f2972332880 20 remove_watcher() i=0 2023-10-05T11:42:09.513 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.510+0000 7f2972332880 2 removed watcher, disabling cache 2023-10-05T11:42:09.514 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.511+0000 7f2972332880 20 remove_watcher() i=1 2023-10-05T11:42:09.515 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.512+0000 7f2972332880 20 remove_watcher() i=2 2023-10-05T11:42:09.515 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.513+0000 7f2972332880 20 remove_watcher() i=3 2023-10-05T11:42:09.516 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.514+0000 7f2972332880 20 remove_watcher() i=4 2023-10-05T11:42:09.517 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.515+0000 7f2972332880 20 remove_watcher() i=5 2023-10-05T11:42:09.519 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.516+0000 7f2972332880 20 remove_watcher() i=6 2023-10-05T11:42:09.520 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.517+0000 7f2972332880 20 remove_watcher() i=7 2023-10-05T11:42:09.524 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:42:09.524 INFO:tasks.workunit.client.0.smithi012.stderr:BUCKET_STATS: 2023-10-05T11:42:09.524 INFO:tasks.workunit.client.0.smithi012.stderr:bucket: myver id: dff27d1e-df33-400e-a68a-7ba586947c99.4604.17 num_objects: 0 size_kb: 0 num_shards: 12 2023-10-05T11:42:09.524 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:42:09.525 INFO:tasks.workunit.client.0.smithi012.stderr:radosgw-admin --inject-delay-at=do_reshard --inject-delay-ms=5000 bucket reshard --bucket myver --num-shards 13 2023-10-05T11:42:09.557 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setuser ceph since I am not root 2023-10-05T11:42:09.558 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T11:42:09.570 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.568+0000 7fef75329880 20 rados->read ofs=0 len=0 2023-10-05T11:42:09.572 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.569+0000 7fef75329880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:42:09.572 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.569+0000 7fef75329880 20 realm 2023-10-05T11:42:09.572 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.569+0000 7fef75329880 20 rados->read ofs=0 len=0 2023-10-05T11:42:09.572 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.570+0000 7fef75329880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:42:09.572 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.570+0000 7fef75329880 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T11:42:09.573 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.570+0000 7fef75329880 20 rados->read ofs=0 len=0 2023-10-05T11:42:09.573 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.570+0000 7fef75329880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:42:09.573 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.570+0000 7fef75329880 20 rados->read ofs=0 len=0 2023-10-05T11:42:09.573 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.571+0000 7fef75329880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:42:09.573 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.571+0000 7fef75329880 20 rados->read ofs=0 len=0 2023-10-05T11:42:09.574 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.571+0000 7fef75329880 20 rados_obj.operate() r=0 bl.length=1020 2023-10-05T11:42:09.574 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.571+0000 7fef75329880 20 searching for the correct realm 2023-10-05T11:42:09.582 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.580+0000 7fef71bf9640 0 -- 172.21.15.12:0/379630045 >> [v2:172.21.15.170:6814/3150808418,v1:172.21.15.170:6816/3150808418] conn(0x55e02fed5c00 msgr2=0x55e02f2e6c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:42:09.584 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.581+0000 7fef75329880 20 RGWRados::pool_iterate: got zone_info.dff27d1e-df33-400e-a68a-7ba586947c99 2023-10-05T11:42:09.584 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.581+0000 7fef75329880 20 RGWRados::pool_iterate: got zonegroup_info.c78aa576-9d15-4e9d-b3c0-4af23a22062c 2023-10-05T11:42:09.584 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.581+0000 7fef75329880 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T11:42:09.584 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.581+0000 7fef75329880 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T11:42:09.584 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.581+0000 7fef75329880 20 rados->read ofs=0 len=0 2023-10-05T11:42:09.584 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.581+0000 7fef75329880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:42:09.584 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.581+0000 7fef75329880 20 rados->read ofs=0 len=0 2023-10-05T11:42:09.584 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.582+0000 7fef75329880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:42:09.584 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.582+0000 7fef75329880 20 rados->read ofs=0 len=0 2023-10-05T11:42:09.585 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.582+0000 7fef75329880 20 rados_obj.operate() r=0 bl.length=454 2023-10-05T11:42:09.585 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.582+0000 7fef75329880 20 zone default found 2023-10-05T11:42:09.586 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.582+0000 7fef75329880 4 Realm: () 2023-10-05T11:42:09.586 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.582+0000 7fef75329880 4 ZoneGroup: default (c78aa576-9d15-4e9d-b3c0-4af23a22062c) 2023-10-05T11:42:09.586 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.582+0000 7fef75329880 4 Zone: default (dff27d1e-df33-400e-a68a-7ba586947c99) 2023-10-05T11:42:09.586 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.582+0000 7fef75329880 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T11:42:09.586 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.582+0000 7fef75329880 20 zonegroup default 2023-10-05T11:42:09.586 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.582+0000 7fef75329880 20 rados->read ofs=0 len=0 2023-10-05T11:42:09.586 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.582+0000 7fef75329880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:42:09.586 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.582+0000 7fef75329880 20 rados->read ofs=0 len=0 2023-10-05T11:42:09.586 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.582+0000 7fef75329880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:42:09.586 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.582+0000 7fef75329880 20 rados->read ofs=0 len=0 2023-10-05T11:42:09.586 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.583+0000 7fef75329880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:42:09.587 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.583+0000 7fef75329880 20 started sync module instance, tier type = 2023-10-05T11:42:09.587 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.583+0000 7fef75329880 20 started zone id=dff27d1e-df33-400e-a68a-7ba586947c99 (name=default) with tier type = 2023-10-05T11:42:09.591 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.589+0000 7fef723fa640 0 -- 172.21.15.12:0/379630045 >> [v2:172.21.15.170:6800/4137726411,v1:172.21.15.170:6801/4137726411] conn(0x55e02f4ae000 msgr2=0x55e02f3a9600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:42:09.593 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.591+0000 7fef75329880 20 add_watcher() i=0 2023-10-05T11:42:09.594 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.591+0000 7fef75329880 20 add_watcher() i=1 2023-10-05T11:42:09.594 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.591+0000 7fef75329880 20 add_watcher() i=2 2023-10-05T11:42:09.594 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.591+0000 7fef75329880 20 add_watcher() i=3 2023-10-05T11:42:09.594 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.591+0000 7fef75329880 20 add_watcher() i=4 2023-10-05T11:42:09.594 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.591+0000 7fef75329880 20 add_watcher() i=5 2023-10-05T11:42:09.594 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.591+0000 7fef75329880 20 add_watcher() i=6 2023-10-05T11:42:09.594 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.592+0000 7fef75329880 20 add_watcher() i=7 2023-10-05T11:42:09.594 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.592+0000 7fef75329880 2 all 8 watchers are set, enabling cache 2023-10-05T11:42:09.596 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.594+0000 7fef58bc7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:42:09.596 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.594+0000 7fef75329880 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T11:42:09.596 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.594+0000 7fef75329880 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T11:42:09.602 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.599+0000 7fef75329880 5 note: GC not initialized 2023-10-05T11:42:09.602 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.600+0000 7fef543be640 20 reqs_thread_entry: start 2023-10-05T11:42:09.603 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.600+0000 7fef75329880 20 init_complete bucket index max shards: 11 2023-10-05T11:42:09.603 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.600+0000 7fef75329880 20 Filter name: none 2023-10-05T11:42:09.603 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.600+0000 7fef523ba640 20 reqs_thread_entry: start 2023-10-05T11:42:09.603 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.600+0000 7fef75329880 10 cache get: name=default.rgw.meta+root+myver : miss 2023-10-05T11:42:09.603 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.600+0000 7fef75329880 20 rados->read ofs=0 len=0 2023-10-05T11:42:09.604 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.600+0000 7fef75329880 20 rados_obj.operate() r=0 bl.length=197 2023-10-05T11:42:09.604 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.600+0000 7fef75329880 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2023-10-05T11:42:09.604 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.600+0000 7fef75329880 10 adding default.rgw.meta+root+myver to cache LRU end 2023-10-05T11:42:09.604 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.600+0000 7fef75329880 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:dff27d1e-df33-400e-a68a-7ba586947c99.4604.17 : miss 2023-10-05T11:42:09.604 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.600+0000 7fef75329880 20 rados->read ofs=0 len=0 2023-10-05T11:42:09.605 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.601+0000 7fef75329880 20 rados_obj.operate() r=0 bl.length=369 2023-10-05T11:42:09.605 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.601+0000 7fef75329880 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:dff27d1e-df33-400e-a68a-7ba586947c99.4604.17 info.flags=0x17 2023-10-05T11:42:09.605 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.601+0000 7fef75329880 10 adding default.rgw.meta+root+.bucket.meta.myver:dff27d1e-df33-400e-a68a-7ba586947c99.4604.17 to cache LRU end 2023-10-05T11:42:09.605 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.601+0000 7fef75329880 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T11:42:09.605 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.601+0000 7fef75329880 10 updating xattr: name=user.rgw.acl bl.length()=203 2023-10-05T11:42:09.605 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.601+0000 7fef75329880 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:dff27d1e-df33-400e-a68a-7ba586947c99.4604.17 2023-10-05T11:42:09.608 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.606+0000 7fef75329880 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:dff27d1e-df33-400e-a68a-7ba586947c99.4604.17 info.flags=0x17 2023-10-05T11:42:09.608 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.606+0000 7fef75329880 10 moving default.rgw.meta+root+.bucket.meta.myver:dff27d1e-df33-400e-a68a-7ba586947c99.4604.17 to cache LRU end 2023-10-05T11:42:09.608 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.606+0000 7fef75329880 10 updating xattr: name=user.rgw.acl bl.length()=203 2023-10-05T11:42:09.608 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.606+0000 7fef75329880 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:dff27d1e-df33-400e-a68a-7ba586947c99.4604.17, ofs0, ns] 2023-10-05T11:42:09.609 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.606+0000 7fef6c3ee640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1060856922181 cookie 94421353501696 notifier 7232 bl.length()=855 2023-10-05T11:42:09.609 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.606+0000 7fef6c3ee640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:dff27d1e-df33-400e-a68a-7ba586947c99.4604.17 info.flags=0x17 2023-10-05T11:42:09.609 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.607+0000 7fef6c3ee640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:dff27d1e-df33-400e-a68a-7ba586947c99.4604.17 to cache LRU end 2023-10-05T11:42:09.609 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.607+0000 7fef6c3ee640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2023-10-05T11:42:09.610 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.608+0000 7fef75329880 20 handle_bi_update(): bucket=:myver[dff27d1e-df33-400e-a68a-7ba586947c99.4604.17]): orig_sources= new_sources= 2023-10-05T11:42:09.610 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.608+0000 7fef75329880 20 handle_bi_update(): bucket=:myver[dff27d1e-df33-400e-a68a-7ba586947c99.4604.17]): potential sources added=[] removed=[] 2023-10-05T11:42:09.611 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.608+0000 7fef75329880 20 handle_bi_update(): bucket=:myver[dff27d1e-df33-400e-a68a-7ba586947c99.4604.17]): orig_dests= new_dests= 2023-10-05T11:42:09.611 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.608+0000 7fef75329880 20 handle_bi_update(): bucket=:myver[dff27d1e-df33-400e-a68a-7ba586947c99.4604.17]): potential dests added=[] removed=[] 2023-10-05T11:42:09.613 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:09.611+0000 7fef75329880 -1 Injecting delay=5.000000000s at location=do_reshard 2023-10-05T11:42:14.614 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:14.610+0000 7fef75329880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.2.0 2023-10-05T11:42:14.614 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:14.610+0000 7fef75329880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.2.0 2023-10-05T11:42:14.614 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:14.610+0000 7fef75329880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.2.1 2023-10-05T11:42:14.614 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:14.610+0000 7fef75329880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.2.1 2023-10-05T11:42:14.614 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:14.610+0000 7fef75329880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.2.2 2023-10-05T11:42:14.615 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:14.610+0000 7fef75329880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.2.2 2023-10-05T11:42:14.615 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:14.610+0000 7fef75329880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.2.3 2023-10-05T11:42:14.615 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:14.610+0000 7fef75329880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.2.3 2023-10-05T11:42:14.615 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:14.610+0000 7fef75329880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.2.4 2023-10-05T11:42:14.615 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:14.610+0000 7fef75329880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.2.4 2023-10-05T11:42:14.615 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:14.610+0000 7fef75329880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.2.5 2023-10-05T11:42:14.616 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:14.610+0000 7fef75329880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.2.5 2023-10-05T11:42:14.616 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:14.610+0000 7fef75329880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.2.6 2023-10-05T11:42:14.616 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:14.610+0000 7fef75329880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.2.6 2023-10-05T11:42:14.616 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:14.610+0000 7fef75329880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.2.7 2023-10-05T11:42:14.616 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:14.610+0000 7fef75329880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.2.7 2023-10-05T11:42:14.616 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:14.610+0000 7fef75329880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.2.8 2023-10-05T11:42:14.616 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:14.610+0000 7fef75329880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.2.8 2023-10-05T11:42:14.617 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:14.610+0000 7fef75329880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.2.9 2023-10-05T11:42:14.617 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:14.610+0000 7fef75329880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.2.9 2023-10-05T11:42:14.617 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:14.610+0000 7fef75329880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.2.10 2023-10-05T11:42:14.617 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:14.610+0000 7fef75329880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.2.10 2023-10-05T11:42:14.617 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:14.610+0000 7fef75329880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.2.11 2023-10-05T11:42:14.617 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:14.610+0000 7fef75329880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.2.11 2023-10-05T11:42:14.618 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:14.610+0000 7fef75329880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.2.12 2023-10-05T11:42:14.618 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:14.610+0000 7fef75329880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.2.12 2023-10-05T11:42:14.618 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:14.610+0000 7fef75329880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.1.0 2023-10-05T11:42:14.618 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:14.610+0000 7fef75329880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.1.0 2023-10-05T11:42:14.619 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:14.611+0000 7fef75329880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.1.1 2023-10-05T11:42:14.619 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:14.611+0000 7fef75329880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.1.1 2023-10-05T11:42:14.620 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:14.612+0000 7fef75329880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.1.2 2023-10-05T11:42:14.620 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:14.612+0000 7fef75329880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.1.2 2023-10-05T11:42:14.620 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:14.612+0000 7fef75329880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.1.3 2023-10-05T11:42:14.620 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:14.612+0000 7fef75329880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.1.3 2023-10-05T11:42:14.620 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:14.613+0000 7fef75329880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.1.4 2023-10-05T11:42:14.620 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:14.613+0000 7fef75329880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.1.4 2023-10-05T11:42:14.620 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:14.613+0000 7fef75329880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.1.5 2023-10-05T11:42:14.620 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:14.613+0000 7fef75329880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.1.5 2023-10-05T11:42:14.620 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:14.614+0000 7fef75329880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.1.6 2023-10-05T11:42:14.620 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:14.614+0000 7fef75329880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.1.6 2023-10-05T11:42:14.621 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:14.615+0000 7fef75329880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.1.7 2023-10-05T11:42:14.621 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:14.615+0000 7fef75329880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.1.7 2023-10-05T11:42:14.621 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:14.615+0000 7fef75329880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.1.8 2023-10-05T11:42:14.621 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:14.615+0000 7fef75329880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.1.8 2023-10-05T11:42:14.621 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:14.616+0000 7fef75329880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.1.9 2023-10-05T11:42:14.621 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:14.616+0000 7fef75329880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.1.9 2023-10-05T11:42:14.621 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:14.617+0000 7fef75329880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.1.10 2023-10-05T11:42:14.622 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:14.617+0000 7fef75329880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.1.10 2023-10-05T11:42:14.622 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:14.617+0000 7fef75329880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.1.11 2023-10-05T11:42:14.622 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:14.617+0000 7fef75329880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.1.11 2023-10-05T11:42:14.622 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:14.618+0000 7fef75329880 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:dff27d1e-df33-400e-a68a-7ba586947c99.4604.17 : hit (requested=0x17, cached=0x17) 2023-10-05T11:42:14.622 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:14.618+0000 7fef75329880 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:dff27d1e-df33-400e-a68a-7ba586947c99.4604.17 2023-10-05T11:42:14.623 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:14.620+0000 7fef75329880 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:dff27d1e-df33-400e-a68a-7ba586947c99.4604.17 info.flags=0x17 2023-10-05T11:42:14.624 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:14.620+0000 7fef75329880 10 moving default.rgw.meta+root+.bucket.meta.myver:dff27d1e-df33-400e-a68a-7ba586947c99.4604.17 to cache LRU end 2023-10-05T11:42:14.624 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:14.620+0000 7fef75329880 10 updating xattr: name=user.rgw.acl bl.length()=203 2023-10-05T11:42:14.624 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:14.620+0000 7fef75329880 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:dff27d1e-df33-400e-a68a-7ba586947c99.4604.17, ofs0, ns] 2023-10-05T11:42:14.625 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:14.620+0000 7fef6c3ee640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1060856922182 cookie 94421353501696 notifier 7232 bl.length()=823 2023-10-05T11:42:14.625 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:14.620+0000 7fef6c3ee640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:dff27d1e-df33-400e-a68a-7ba586947c99.4604.17 info.flags=0x17 2023-10-05T11:42:14.625 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:14.620+0000 7fef6c3ee640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:dff27d1e-df33-400e-a68a-7ba586947c99.4604.17 to cache LRU end 2023-10-05T11:42:14.625 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:14.620+0000 7fef6c3ee640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2023-10-05T11:42:14.630 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:14.627+0000 7fef75329880 20 handle_bi_update(): bucket=:myver[dff27d1e-df33-400e-a68a-7ba586947c99.4604.17]): orig_sources= new_sources= 2023-10-05T11:42:14.630 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:14.627+0000 7fef75329880 20 handle_bi_update(): bucket=:myver[dff27d1e-df33-400e-a68a-7ba586947c99.4604.17]): potential sources added=[] removed=[] 2023-10-05T11:42:14.630 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:14.627+0000 7fef75329880 20 handle_bi_update(): bucket=:myver[dff27d1e-df33-400e-a68a-7ba586947c99.4604.17]): orig_dests= new_dests= 2023-10-05T11:42:14.631 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:14.627+0000 7fef75329880 20 handle_bi_update(): bucket=:myver[dff27d1e-df33-400e-a68a-7ba586947c99.4604.17]): potential dests added=[] removed=[] 2023-10-05T11:42:14.633 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:14.630+0000 7fef75329880 1 execute INFO: reshard of bucket "myver" completed successfully 2023-10-05T11:42:14.635 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:14.632+0000 7fef58bc7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:42:14.638 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:14.635+0000 7fef75329880 20 remove_watcher() i=0 2023-10-05T11:42:14.638 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:14.635+0000 7fef75329880 2 removed watcher, disabling cache 2023-10-05T11:42:14.639 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:14.636+0000 7fef75329880 20 remove_watcher() i=1 2023-10-05T11:42:14.641 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:14.638+0000 7fef75329880 20 remove_watcher() i=2 2023-10-05T11:42:14.642 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:14.639+0000 7fef75329880 20 remove_watcher() i=3 2023-10-05T11:42:14.643 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:14.640+0000 7fef75329880 20 remove_watcher() i=4 2023-10-05T11:42:14.644 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:14.641+0000 7fef75329880 20 remove_watcher() i=5 2023-10-05T11:42:14.646 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:14.643+0000 7fef75329880 20 remove_watcher() i=6 2023-10-05T11:42:14.647 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:14.644+0000 7fef75329880 20 remove_watcher() i=7 2023-10-05T11:42:15.620 INFO:tasks.workunit.client.0.smithi012.stderr:put object successful 2023-10-05T11:42:15.620 INFO:tasks.workunit.client.0.smithi012.stderr:TEST: check that bucket stats are correct after reshard with unlinked entries 2023-10-05T11:42:15.620 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-10-05T11:42:15.947 INFO:tasks.workunit.client.0.smithi012.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2023-10-05T11:42:16.356 INFO:tasks.workunit.client.0.smithi012.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2023-10-05T11:42:17.839 INFO:tasks.workunit.client.0.smithi012.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2023-10-05T11:42:17.840 INFO:tasks.workunit.client.0.smithi012.stderr:radosgw-admin bi list --bucket myver --object x 2023-10-05T11:42:17.873 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setuser ceph since I am not root 2023-10-05T11:42:17.874 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T11:42:17.889 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:17.885+0000 7fe0e9615880 20 rados->read ofs=0 len=0 2023-10-05T11:42:17.890 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:17.887+0000 7fe0e9615880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:42:17.890 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:17.887+0000 7fe0e9615880 20 realm 2023-10-05T11:42:17.890 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:17.887+0000 7fe0e9615880 20 rados->read ofs=0 len=0 2023-10-05T11:42:17.891 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:17.887+0000 7fe0e9615880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:42:17.891 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:17.887+0000 7fe0e9615880 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T11:42:17.891 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:17.887+0000 7fe0e9615880 20 rados->read ofs=0 len=0 2023-10-05T11:42:17.891 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:17.888+0000 7fe0e9615880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:42:17.891 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:17.888+0000 7fe0e9615880 20 rados->read ofs=0 len=0 2023-10-05T11:42:17.892 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:17.889+0000 7fe0e9615880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:42:17.892 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:17.889+0000 7fe0e9615880 20 rados->read ofs=0 len=0 2023-10-05T11:42:17.893 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:17.889+0000 7fe0e9615880 20 rados_obj.operate() r=0 bl.length=1020 2023-10-05T11:42:17.893 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:17.890+0000 7fe0e9615880 20 searching for the correct realm 2023-10-05T11:42:17.904 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:17.901+0000 7fe0e628f640 0 -- 172.21.15.12:0/699364015 >> [v2:172.21.15.12:6824/2171933159,v1:172.21.15.12:6825/2171933159] conn(0x55ef77120800 msgr2=0x55ef7710c580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:42:17.905 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:17.901+0000 7fe0e9615880 20 RGWRados::pool_iterate: got zone_info.dff27d1e-df33-400e-a68a-7ba586947c99 2023-10-05T11:42:17.905 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:17.901+0000 7fe0e9615880 20 RGWRados::pool_iterate: got zonegroup_info.c78aa576-9d15-4e9d-b3c0-4af23a22062c 2023-10-05T11:42:17.905 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:17.901+0000 7fe0e9615880 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T11:42:17.905 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:17.901+0000 7fe0e9615880 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T11:42:17.905 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:17.901+0000 7fe0e9615880 20 rados->read ofs=0 len=0 2023-10-05T11:42:17.905 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:17.902+0000 7fe0e9615880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:42:17.905 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:17.902+0000 7fe0e9615880 20 rados->read ofs=0 len=0 2023-10-05T11:42:17.906 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:17.902+0000 7fe0e9615880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:42:17.907 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:17.902+0000 7fe0e9615880 20 rados->read ofs=0 len=0 2023-10-05T11:42:17.907 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:17.902+0000 7fe0e9615880 20 rados_obj.operate() r=0 bl.length=454 2023-10-05T11:42:17.907 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:17.902+0000 7fe0e9615880 20 zone default found 2023-10-05T11:42:17.907 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:17.902+0000 7fe0e9615880 4 Realm: () 2023-10-05T11:42:17.907 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:17.902+0000 7fe0e9615880 4 ZoneGroup: default (c78aa576-9d15-4e9d-b3c0-4af23a22062c) 2023-10-05T11:42:17.907 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:17.902+0000 7fe0e9615880 4 Zone: default (dff27d1e-df33-400e-a68a-7ba586947c99) 2023-10-05T11:42:17.907 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:17.902+0000 7fe0e9615880 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T11:42:17.907 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:17.902+0000 7fe0e9615880 20 zonegroup default 2023-10-05T11:42:17.907 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:17.902+0000 7fe0e9615880 20 rados->read ofs=0 len=0 2023-10-05T11:42:17.907 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:17.903+0000 7fe0e9615880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:42:17.907 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:17.903+0000 7fe0e9615880 20 rados->read ofs=0 len=0 2023-10-05T11:42:17.908 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:17.903+0000 7fe0e9615880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:42:17.908 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:17.903+0000 7fe0e9615880 20 rados->read ofs=0 len=0 2023-10-05T11:42:17.908 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:17.903+0000 7fe0e9615880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:42:17.908 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:17.903+0000 7fe0e9615880 20 started sync module instance, tier type = 2023-10-05T11:42:17.908 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:17.903+0000 7fe0e9615880 20 started zone id=dff27d1e-df33-400e-a68a-7ba586947c99 (name=default) with tier type = 2023-10-05T11:42:17.915 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:17.912+0000 7fe0e628f640 0 -- 172.21.15.12:0/699364015 >> [v2:172.21.15.12:6824/2171933159,v1:172.21.15.12:6825/2171933159] conn(0x55ef7714e000 msgr2=0x55ef77141080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:42:17.917 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:17.914+0000 7fe0e9615880 20 add_watcher() i=0 2023-10-05T11:42:17.918 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:17.914+0000 7fe0e9615880 20 add_watcher() i=1 2023-10-05T11:42:17.918 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:17.914+0000 7fe0e9615880 20 add_watcher() i=2 2023-10-05T11:42:17.918 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:17.914+0000 7fe0e9615880 20 add_watcher() i=3 2023-10-05T11:42:17.918 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:17.914+0000 7fe0e9615880 20 add_watcher() i=4 2023-10-05T11:42:17.918 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:17.914+0000 7fe0e9615880 20 add_watcher() i=5 2023-10-05T11:42:17.918 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:17.914+0000 7fe0e9615880 20 add_watcher() i=6 2023-10-05T11:42:17.919 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:17.915+0000 7fe0e9615880 20 add_watcher() i=7 2023-10-05T11:42:17.919 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:17.915+0000 7fe0e9615880 2 all 8 watchers are set, enabling cache 2023-10-05T11:42:17.920 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:17.917+0000 7fe0cca5c640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:42:17.921 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:17.917+0000 7fe0e9615880 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T11:42:17.921 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:17.917+0000 7fe0e9615880 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T11:42:17.927 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:17.923+0000 7fe0e9615880 5 note: GC not initialized 2023-10-05T11:42:17.927 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:17.923+0000 7fe0c8253640 20 reqs_thread_entry: start 2023-10-05T11:42:17.927 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:17.923+0000 7fe0e9615880 20 init_complete bucket index max shards: 11 2023-10-05T11:42:17.927 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:17.923+0000 7fe0e9615880 20 Filter name: none 2023-10-05T11:42:17.927 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:17.923+0000 7fe0c624f640 20 reqs_thread_entry: start 2023-10-05T11:42:17.927 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:17.923+0000 7fe0e9615880 20 rados->read ofs=0 len=0 2023-10-05T11:42:17.928 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:17.924+0000 7fe0e9615880 20 rados_obj.operate() r=0 bl.length=197 2023-10-05T11:42:17.928 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:17.924+0000 7fe0e9615880 20 rados->read ofs=0 len=0 2023-10-05T11:42:17.929 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:17.925+0000 7fe0e9615880 20 rados_obj.operate() r=0 bl.length=369 2023-10-05T11:42:17.929 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:17.925+0000 7fe0e9615880 20 couldn't put binfo cache entry, might have raced with data changes 2023-10-05T11:42:17.929 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:17.925+0000 7fe0e9615880 20 INFO: main: max_entries=1000, index=gen=2, max_shards=13 2023-10-05T11:42:17.929 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:17.925+0000 7fe0e9615880 20 INFO: main: starting shard=0 2023-10-05T11:42:17.929 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:17.925+0000 7fe0e9615880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.2.0 2023-10-05T11:42:17.929 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:17.925+0000 7fe0e9615880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.2.0 2023-10-05T11:42:17.929 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:17.925+0000 7fe0e9615880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:42:17.929 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:17.925+0000 7fe0e9615880 20 INFO: main: starting shard=1 2023-10-05T11:42:17.929 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:17.925+0000 7fe0e9615880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.2.1 2023-10-05T11:42:17.929 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:17.925+0000 7fe0e9615880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.2.1 2023-10-05T11:42:17.930 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:17.926+0000 7fe0e9615880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:42:17.930 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:17.926+0000 7fe0e9615880 20 INFO: main: starting shard=2 2023-10-05T11:42:17.931 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:17.926+0000 7fe0e9615880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.2.2 2023-10-05T11:42:17.931 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:17.926+0000 7fe0e9615880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.2.2 2023-10-05T11:42:17.931 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:17.926+0000 7fe0e9615880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:42:17.931 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:17.926+0000 7fe0e9615880 20 INFO: main: starting shard=3 2023-10-05T11:42:17.931 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:17.926+0000 7fe0e9615880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.2.3 2023-10-05T11:42:17.931 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:17.926+0000 7fe0e9615880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.2.3 2023-10-05T11:42:17.931 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:17.927+0000 7fe0e9615880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:42:17.931 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:17.927+0000 7fe0e9615880 20 INFO: main: starting shard=4 2023-10-05T11:42:17.931 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:17.927+0000 7fe0e9615880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.2.4 2023-10-05T11:42:17.931 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:17.927+0000 7fe0e9615880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.2.4 2023-10-05T11:42:17.932 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:17.927+0000 7fe0e9615880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:42:17.932 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:17.927+0000 7fe0e9615880 20 INFO: main: starting shard=5 2023-10-05T11:42:17.932 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:17.927+0000 7fe0e9615880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.2.5 2023-10-05T11:42:17.932 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:17.927+0000 7fe0e9615880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.2.5 2023-10-05T11:42:17.933 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:17.928+0000 7fe0e9615880 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2023-10-05T11:42:17.933 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:17.928+0000 7fe0e9615880 20 INFO: main: starting shard=6 2023-10-05T11:42:17.933 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:17.928+0000 7fe0e9615880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.2.6 2023-10-05T11:42:17.933 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:17.928+0000 7fe0e9615880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.2.6 2023-10-05T11:42:17.934 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:17.928+0000 7fe0e9615880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:42:17.934 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:17.928+0000 7fe0e9615880 20 INFO: main: starting shard=7 2023-10-05T11:42:17.934 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:17.928+0000 7fe0e9615880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.2.7 2023-10-05T11:42:17.934 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:17.928+0000 7fe0e9615880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.2.7 2023-10-05T11:42:17.934 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:17.929+0000 7fe0e9615880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:42:17.934 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:17.929+0000 7fe0e9615880 20 INFO: main: starting shard=8 2023-10-05T11:42:17.934 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:17.929+0000 7fe0e9615880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.2.8 2023-10-05T11:42:17.935 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:17.929+0000 7fe0e9615880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.2.8 2023-10-05T11:42:17.935 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:17.929+0000 7fe0e9615880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:42:17.935 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:17.929+0000 7fe0e9615880 20 INFO: main: starting shard=9 2023-10-05T11:42:17.935 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:17.929+0000 7fe0e9615880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.2.9 2023-10-05T11:42:17.935 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:17.929+0000 7fe0e9615880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.2.9 2023-10-05T11:42:17.936 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:17.930+0000 7fe0e9615880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:42:17.936 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:17.930+0000 7fe0e9615880 20 INFO: main: starting shard=10 2023-10-05T11:42:17.936 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:17.930+0000 7fe0e9615880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.2.10 2023-10-05T11:42:17.936 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:17.930+0000 7fe0e9615880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.2.10 2023-10-05T11:42:17.938 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:17.930+0000 7fe0e9615880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:42:17.938 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:17.930+0000 7fe0e9615880 20 INFO: main: starting shard=11 2023-10-05T11:42:17.938 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:17.930+0000 7fe0e9615880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.2.11 2023-10-05T11:42:17.938 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:17.930+0000 7fe0e9615880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.2.11 2023-10-05T11:42:17.938 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:17.931+0000 7fe0e9615880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:42:17.938 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:17.931+0000 7fe0e9615880 20 INFO: main: starting shard=12 2023-10-05T11:42:17.938 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:17.931+0000 7fe0e9615880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.2.12 2023-10-05T11:42:17.938 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:17.931+0000 7fe0e9615880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.2.12 2023-10-05T11:42:17.938 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:17.931+0000 7fe0e9615880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:42:17.939 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:17.931+0000 7fe0e9615880 20 INFO: main: done 2023-10-05T11:42:17.939 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:17.932+0000 7fe0cca5c640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:42:17.939 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:17.934+0000 7fe0e9615880 20 remove_watcher() i=0 2023-10-05T11:42:17.939 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:17.934+0000 7fe0e9615880 2 removed watcher, disabling cache 2023-10-05T11:42:17.939 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:17.936+0000 7fe0e9615880 20 remove_watcher() i=1 2023-10-05T11:42:17.940 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:17.937+0000 7fe0e9615880 20 remove_watcher() i=2 2023-10-05T11:42:17.941 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:17.938+0000 7fe0e9615880 20 remove_watcher() i=3 2023-10-05T11:42:17.942 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:17.939+0000 7fe0e9615880 20 remove_watcher() i=4 2023-10-05T11:42:17.943 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:17.940+0000 7fe0e9615880 20 remove_watcher() i=5 2023-10-05T11:42:17.944 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:17.941+0000 7fe0e9615880 20 remove_watcher() i=6 2023-10-05T11:42:17.945 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:17.942+0000 7fe0e9615880 20 remove_watcher() i=7 2023-10-05T11:42:18.048 INFO:tasks.workunit.client.0.smithi012.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2023-10-05T11:42:18.050 INFO:tasks.workunit.client.0.smithi012.stderr:radosgw-admin bi list --bucket myver --object y 2023-10-05T11:42:18.083 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setuser ceph since I am not root 2023-10-05T11:42:18.084 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T11:42:18.097 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.094+0000 7f357ae13880 20 rados->read ofs=0 len=0 2023-10-05T11:42:18.099 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.095+0000 7f357ae13880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:42:18.099 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.095+0000 7f357ae13880 20 realm 2023-10-05T11:42:18.099 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.095+0000 7f357ae13880 20 rados->read ofs=0 len=0 2023-10-05T11:42:18.099 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.095+0000 7f357ae13880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:42:18.099 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.095+0000 7f357ae13880 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T11:42:18.099 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.095+0000 7f357ae13880 20 rados->read ofs=0 len=0 2023-10-05T11:42:18.099 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.095+0000 7f357ae13880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:42:18.099 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.095+0000 7f357ae13880 20 rados->read ofs=0 len=0 2023-10-05T11:42:18.100 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.096+0000 7f357ae13880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:42:18.100 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.096+0000 7f357ae13880 20 rados->read ofs=0 len=0 2023-10-05T11:42:18.100 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.097+0000 7f357ae13880 20 rados_obj.operate() r=0 bl.length=1020 2023-10-05T11:42:18.101 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.097+0000 7f357ae13880 20 searching for the correct realm 2023-10-05T11:42:18.110 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.107+0000 7f35795b8640 0 -- 172.21.15.12:0/3195717057 >> [v2:172.21.15.170:6814/3150808418,v1:172.21.15.170:6816/3150808418] conn(0x55da0030fc00 msgr2=0x55d9ff71ac00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-10-05T11:42:18.112 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.108+0000 7f357ae13880 20 RGWRados::pool_iterate: got zone_info.dff27d1e-df33-400e-a68a-7ba586947c99 2023-10-05T11:42:18.112 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.108+0000 7f357ae13880 20 RGWRados::pool_iterate: got zonegroup_info.c78aa576-9d15-4e9d-b3c0-4af23a22062c 2023-10-05T11:42:18.112 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.108+0000 7f357ae13880 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T11:42:18.112 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.108+0000 7f357ae13880 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T11:42:18.112 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.108+0000 7f357ae13880 20 rados->read ofs=0 len=0 2023-10-05T11:42:18.112 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.108+0000 7f357ae13880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:42:18.112 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.108+0000 7f357ae13880 20 rados->read ofs=0 len=0 2023-10-05T11:42:18.113 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.109+0000 7f357ae13880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:42:18.113 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.109+0000 7f357ae13880 20 rados->read ofs=0 len=0 2023-10-05T11:42:18.113 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.109+0000 7f357ae13880 20 rados_obj.operate() r=0 bl.length=454 2023-10-05T11:42:18.114 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.109+0000 7f357ae13880 20 zone default found 2023-10-05T11:42:18.114 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.109+0000 7f357ae13880 4 Realm: () 2023-10-05T11:42:18.114 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.109+0000 7f357ae13880 4 ZoneGroup: default (c78aa576-9d15-4e9d-b3c0-4af23a22062c) 2023-10-05T11:42:18.114 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.109+0000 7f357ae13880 4 Zone: default (dff27d1e-df33-400e-a68a-7ba586947c99) 2023-10-05T11:42:18.114 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.109+0000 7f357ae13880 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T11:42:18.114 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.109+0000 7f357ae13880 20 zonegroup default 2023-10-05T11:42:18.114 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.109+0000 7f357ae13880 20 rados->read ofs=0 len=0 2023-10-05T11:42:18.114 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.109+0000 7f357ae13880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:42:18.114 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.109+0000 7f357ae13880 20 rados->read ofs=0 len=0 2023-10-05T11:42:18.114 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.109+0000 7f357ae13880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:42:18.114 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.109+0000 7f357ae13880 20 rados->read ofs=0 len=0 2023-10-05T11:42:18.115 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.110+0000 7f357ae13880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:42:18.115 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.110+0000 7f357ae13880 20 started sync module instance, tier type = 2023-10-05T11:42:18.115 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.110+0000 7f357ae13880 20 started zone id=dff27d1e-df33-400e-a68a-7ba586947c99 (name=default) with tier type = 2023-10-05T11:42:18.120 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.117+0000 7f3579db9640 0 -- 172.21.15.12:0/3195717057 >> [v2:172.21.15.12:6824/2171933159,v1:172.21.15.12:6825/2171933159] conn(0x55d9ff7eec00 msgr2=0x55d9ff71b700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:42:18.123 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.119+0000 7f357ae13880 20 add_watcher() i=0 2023-10-05T11:42:18.123 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.119+0000 7f357ae13880 20 add_watcher() i=1 2023-10-05T11:42:18.123 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.119+0000 7f357ae13880 20 add_watcher() i=2 2023-10-05T11:42:18.123 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.119+0000 7f357ae13880 20 add_watcher() i=3 2023-10-05T11:42:18.123 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.119+0000 7f357ae13880 20 add_watcher() i=4 2023-10-05T11:42:18.123 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.119+0000 7f357ae13880 20 add_watcher() i=5 2023-10-05T11:42:18.123 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.119+0000 7f357ae13880 20 add_watcher() i=6 2023-10-05T11:42:18.124 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.120+0000 7f357ae13880 20 add_watcher() i=7 2023-10-05T11:42:18.124 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.120+0000 7f357ae13880 2 all 8 watchers are set, enabling cache 2023-10-05T11:42:18.125 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.122+0000 7f3560586640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:42:18.125 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.122+0000 7f357ae13880 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T11:42:18.126 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.122+0000 7f357ae13880 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T11:42:18.131 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.128+0000 7f357ae13880 5 note: GC not initialized 2023-10-05T11:42:18.132 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.128+0000 7f355bd7d640 20 reqs_thread_entry: start 2023-10-05T11:42:18.132 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.128+0000 7f357ae13880 20 init_complete bucket index max shards: 11 2023-10-05T11:42:18.132 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.128+0000 7f357ae13880 20 Filter name: none 2023-10-05T11:42:18.132 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.128+0000 7f3559d79640 20 reqs_thread_entry: start 2023-10-05T11:42:18.132 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.128+0000 7f357ae13880 20 rados->read ofs=0 len=0 2023-10-05T11:42:18.133 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.129+0000 7f357ae13880 20 rados_obj.operate() r=0 bl.length=197 2023-10-05T11:42:18.133 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.129+0000 7f357ae13880 20 rados->read ofs=0 len=0 2023-10-05T11:42:18.133 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.129+0000 7f357ae13880 20 rados_obj.operate() r=0 bl.length=369 2023-10-05T11:42:18.133 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.129+0000 7f357ae13880 20 couldn't put binfo cache entry, might have raced with data changes 2023-10-05T11:42:18.134 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.129+0000 7f357ae13880 20 INFO: main: max_entries=1000, index=gen=2, max_shards=13 2023-10-05T11:42:18.134 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.129+0000 7f357ae13880 20 INFO: main: starting shard=0 2023-10-05T11:42:18.134 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.129+0000 7f357ae13880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.2.0 2023-10-05T11:42:18.134 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.129+0000 7f357ae13880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.2.0 2023-10-05T11:42:18.134 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.129+0000 7f357ae13880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:42:18.134 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.129+0000 7f357ae13880 20 INFO: main: starting shard=1 2023-10-05T11:42:18.134 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.129+0000 7f357ae13880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.2.1 2023-10-05T11:42:18.134 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.129+0000 7f357ae13880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.2.1 2023-10-05T11:42:18.134 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.130+0000 7f357ae13880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:42:18.134 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.130+0000 7f357ae13880 20 INFO: main: starting shard=2 2023-10-05T11:42:18.135 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.130+0000 7f357ae13880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.2.2 2023-10-05T11:42:18.135 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.130+0000 7f357ae13880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.2.2 2023-10-05T11:42:18.136 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.131+0000 7f357ae13880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:42:18.136 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.131+0000 7f357ae13880 20 INFO: main: starting shard=3 2023-10-05T11:42:18.136 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.131+0000 7f357ae13880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.2.3 2023-10-05T11:42:18.136 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.131+0000 7f357ae13880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.2.3 2023-10-05T11:42:18.136 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.131+0000 7f357ae13880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:42:18.137 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.131+0000 7f357ae13880 20 INFO: main: starting shard=4 2023-10-05T11:42:18.137 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.131+0000 7f357ae13880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.2.4 2023-10-05T11:42:18.137 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.131+0000 7f357ae13880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.2.4 2023-10-05T11:42:18.137 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.131+0000 7f357ae13880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:42:18.137 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.131+0000 7f357ae13880 20 INFO: main: starting shard=5 2023-10-05T11:42:18.137 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.131+0000 7f357ae13880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.2.5 2023-10-05T11:42:18.137 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.131+0000 7f357ae13880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.2.5 2023-10-05T11:42:18.137 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.132+0000 7f357ae13880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:42:18.137 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.132+0000 7f357ae13880 20 INFO: main: starting shard=6 2023-10-05T11:42:18.137 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.132+0000 7f357ae13880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.2.6 2023-10-05T11:42:18.138 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.132+0000 7f357ae13880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.2.6 2023-10-05T11:42:18.138 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.132+0000 7f357ae13880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:42:18.138 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.132+0000 7f357ae13880 20 INFO: main: starting shard=7 2023-10-05T11:42:18.138 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.132+0000 7f357ae13880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.2.7 2023-10-05T11:42:18.138 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.132+0000 7f357ae13880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.2.7 2023-10-05T11:42:18.138 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.133+0000 7f357ae13880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:42:18.138 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.133+0000 7f357ae13880 20 INFO: main: starting shard=8 2023-10-05T11:42:18.138 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.133+0000 7f357ae13880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.2.8 2023-10-05T11:42:18.138 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.133+0000 7f357ae13880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.2.8 2023-10-05T11:42:18.139 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.133+0000 7f357ae13880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:42:18.139 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.133+0000 7f357ae13880 20 INFO: main: starting shard=9 2023-10-05T11:42:18.140 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.133+0000 7f357ae13880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.2.9 2023-10-05T11:42:18.140 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.133+0000 7f357ae13880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.2.9 2023-10-05T11:42:18.140 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.134+0000 7f357ae13880 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2023-10-05T11:42:18.140 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.134+0000 7f357ae13880 20 INFO: main: starting shard=10 2023-10-05T11:42:18.140 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.134+0000 7f357ae13880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.2.10 2023-10-05T11:42:18.140 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.134+0000 7f357ae13880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.2.10 2023-10-05T11:42:18.140 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.134+0000 7f357ae13880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:42:18.140 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.134+0000 7f357ae13880 20 INFO: main: starting shard=11 2023-10-05T11:42:18.140 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.134+0000 7f357ae13880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.2.11 2023-10-05T11:42:18.140 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.134+0000 7f357ae13880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.2.11 2023-10-05T11:42:18.140 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.135+0000 7f357ae13880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:42:18.141 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.135+0000 7f357ae13880 20 INFO: main: starting shard=12 2023-10-05T11:42:18.141 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.135+0000 7f357ae13880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.2.12 2023-10-05T11:42:18.141 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.135+0000 7f357ae13880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.2.12 2023-10-05T11:42:18.141 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.135+0000 7f357ae13880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:42:18.141 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.135+0000 7f357ae13880 20 INFO: main: done 2023-10-05T11:42:18.141 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.136+0000 7f3560586640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:42:18.175 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.171+0000 7f357ae13880 20 remove_watcher() i=0 2023-10-05T11:42:18.175 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.171+0000 7f357ae13880 2 removed watcher, disabling cache 2023-10-05T11:42:18.176 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.173+0000 7f357ae13880 20 remove_watcher() i=1 2023-10-05T11:42:18.177 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.174+0000 7f357ae13880 20 remove_watcher() i=2 2023-10-05T11:42:18.178 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.175+0000 7f357ae13880 20 remove_watcher() i=3 2023-10-05T11:42:18.180 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.176+0000 7f357ae13880 20 remove_watcher() i=4 2023-10-05T11:42:18.181 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.177+0000 7f357ae13880 20 remove_watcher() i=5 2023-10-05T11:42:18.182 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.179+0000 7f357ae13880 20 remove_watcher() i=6 2023-10-05T11:42:18.183 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.180+0000 7f357ae13880 20 remove_watcher() i=7 2023-10-05T11:42:18.286 INFO:tasks.workunit.client.0.smithi012.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2023-10-05T11:42:18.288 INFO:tasks.workunit.client.0.smithi012.stderr:radosgw-admin bi list --bucket myver --object z 2023-10-05T11:42:18.318 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setuser ceph since I am not root 2023-10-05T11:42:18.318 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T11:42:18.331 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.328+0000 7fc131819880 20 rados->read ofs=0 len=0 2023-10-05T11:42:18.333 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.329+0000 7fc131819880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:42:18.333 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.329+0000 7fc131819880 20 realm 2023-10-05T11:42:18.333 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.329+0000 7fc131819880 20 rados->read ofs=0 len=0 2023-10-05T11:42:18.333 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.329+0000 7fc131819880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:42:18.333 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.329+0000 7fc131819880 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T11:42:18.333 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.329+0000 7fc131819880 20 rados->read ofs=0 len=0 2023-10-05T11:42:18.333 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.329+0000 7fc131819880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:42:18.333 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.329+0000 7fc131819880 20 rados->read ofs=0 len=0 2023-10-05T11:42:18.334 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.330+0000 7fc131819880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:42:18.334 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.330+0000 7fc131819880 20 rados->read ofs=0 len=0 2023-10-05T11:42:18.335 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.331+0000 7fc131819880 20 rados_obj.operate() r=0 bl.length=1020 2023-10-05T11:42:18.335 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.331+0000 7fc131819880 20 searching for the correct realm 2023-10-05T11:42:18.345 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.342+0000 7fc12dd00640 0 -- 172.21.15.12:0/4242447769 >> [v2:172.21.15.170:6814/3150808418,v1:172.21.15.170:6816/3150808418] conn(0x55ca05955c00 msgr2=0x55ca04d65180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:42:18.347 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.343+0000 7fc131819880 20 RGWRados::pool_iterate: got zone_info.dff27d1e-df33-400e-a68a-7ba586947c99 2023-10-05T11:42:18.347 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.343+0000 7fc131819880 20 RGWRados::pool_iterate: got zonegroup_info.c78aa576-9d15-4e9d-b3c0-4af23a22062c 2023-10-05T11:42:18.347 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.343+0000 7fc131819880 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T11:42:18.347 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.343+0000 7fc131819880 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T11:42:18.348 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.343+0000 7fc131819880 20 rados->read ofs=0 len=0 2023-10-05T11:42:18.348 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.343+0000 7fc131819880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:42:18.348 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.343+0000 7fc131819880 20 rados->read ofs=0 len=0 2023-10-05T11:42:18.348 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.343+0000 7fc131819880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:42:18.348 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.343+0000 7fc131819880 20 rados->read ofs=0 len=0 2023-10-05T11:42:18.348 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.343+0000 7fc131819880 20 rados_obj.operate() r=0 bl.length=454 2023-10-05T11:42:18.348 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.343+0000 7fc131819880 20 zone default found 2023-10-05T11:42:18.348 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.343+0000 7fc131819880 4 Realm: () 2023-10-05T11:42:18.348 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.343+0000 7fc131819880 4 ZoneGroup: default (c78aa576-9d15-4e9d-b3c0-4af23a22062c) 2023-10-05T11:42:18.348 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.343+0000 7fc131819880 4 Zone: default (dff27d1e-df33-400e-a68a-7ba586947c99) 2023-10-05T11:42:18.348 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.343+0000 7fc131819880 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T11:42:18.349 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.343+0000 7fc131819880 20 zonegroup default 2023-10-05T11:42:18.349 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.343+0000 7fc131819880 20 rados->read ofs=0 len=0 2023-10-05T11:42:18.349 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.344+0000 7fc131819880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:42:18.349 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.344+0000 7fc131819880 20 rados->read ofs=0 len=0 2023-10-05T11:42:18.349 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.344+0000 7fc131819880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:42:18.349 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.344+0000 7fc131819880 20 rados->read ofs=0 len=0 2023-10-05T11:42:18.349 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.344+0000 7fc131819880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:42:18.350 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.344+0000 7fc131819880 20 started sync module instance, tier type = 2023-10-05T11:42:18.350 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.344+0000 7fc131819880 20 started zone id=dff27d1e-df33-400e-a68a-7ba586947c99 (name=default) with tier type = 2023-10-05T11:42:18.356 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.353+0000 7fc12e501640 0 -- 172.21.15.12:0/4242447769 >> [v2:172.21.15.12:6824/2171933159,v1:172.21.15.12:6825/2171933159] conn(0x55ca04f26000 msgr2=0x55ca04f02580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:42:18.357 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.354+0000 7fc131819880 20 add_watcher() i=0 2023-10-05T11:42:18.357 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.354+0000 7fc131819880 20 add_watcher() i=1 2023-10-05T11:42:18.358 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.354+0000 7fc131819880 20 add_watcher() i=2 2023-10-05T11:42:18.358 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.354+0000 7fc131819880 20 add_watcher() i=3 2023-10-05T11:42:18.358 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.354+0000 7fc131819880 20 add_watcher() i=4 2023-10-05T11:42:18.358 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.354+0000 7fc131819880 20 add_watcher() i=5 2023-10-05T11:42:18.358 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.355+0000 7fc131819880 20 add_watcher() i=6 2023-10-05T11:42:18.359 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.355+0000 7fc131819880 20 add_watcher() i=7 2023-10-05T11:42:18.359 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.355+0000 7fc131819880 2 all 8 watchers are set, enabling cache 2023-10-05T11:42:18.360 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.357+0000 7fc114cce640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:42:18.360 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.357+0000 7fc131819880 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T11:42:18.360 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.357+0000 7fc131819880 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T11:42:18.366 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.362+0000 7fc131819880 5 note: GC not initialized 2023-10-05T11:42:18.366 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.362+0000 7fc1104c5640 20 reqs_thread_entry: start 2023-10-05T11:42:18.366 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.362+0000 7fc131819880 20 init_complete bucket index max shards: 11 2023-10-05T11:42:18.366 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.363+0000 7fc131819880 20 Filter name: none 2023-10-05T11:42:18.366 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.363+0000 7fc10e4c1640 20 reqs_thread_entry: start 2023-10-05T11:42:18.366 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.363+0000 7fc131819880 20 rados->read ofs=0 len=0 2023-10-05T11:42:18.368 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.363+0000 7fc131819880 20 rados_obj.operate() r=0 bl.length=197 2023-10-05T11:42:18.368 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.363+0000 7fc131819880 20 rados->read ofs=0 len=0 2023-10-05T11:42:18.368 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.363+0000 7fc131819880 20 rados_obj.operate() r=0 bl.length=369 2023-10-05T11:42:18.368 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.363+0000 7fc131819880 20 couldn't put binfo cache entry, might have raced with data changes 2023-10-05T11:42:18.368 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.363+0000 7fc131819880 20 INFO: main: max_entries=1000, index=gen=2, max_shards=13 2023-10-05T11:42:18.368 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.363+0000 7fc131819880 20 INFO: main: starting shard=0 2023-10-05T11:42:18.368 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.363+0000 7fc131819880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.2.0 2023-10-05T11:42:18.368 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.363+0000 7fc131819880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.2.0 2023-10-05T11:42:18.369 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.364+0000 7fc131819880 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2023-10-05T11:42:18.369 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.364+0000 7fc131819880 20 INFO: main: starting shard=1 2023-10-05T11:42:18.369 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.364+0000 7fc131819880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.2.1 2023-10-05T11:42:18.369 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.364+0000 7fc131819880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.2.1 2023-10-05T11:42:18.369 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.364+0000 7fc131819880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:42:18.369 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.364+0000 7fc131819880 20 INFO: main: starting shard=2 2023-10-05T11:42:18.369 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.364+0000 7fc131819880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.2.2 2023-10-05T11:42:18.369 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.364+0000 7fc131819880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.2.2 2023-10-05T11:42:18.370 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.365+0000 7fc131819880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:42:18.371 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.365+0000 7fc131819880 20 INFO: main: starting shard=3 2023-10-05T11:42:18.371 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.365+0000 7fc131819880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.2.3 2023-10-05T11:42:18.371 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.365+0000 7fc131819880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.2.3 2023-10-05T11:42:18.371 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.365+0000 7fc131819880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:42:18.371 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.365+0000 7fc131819880 20 INFO: main: starting shard=4 2023-10-05T11:42:18.371 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.365+0000 7fc131819880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.2.4 2023-10-05T11:42:18.371 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.365+0000 7fc131819880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.2.4 2023-10-05T11:42:18.371 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.366+0000 7fc131819880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:42:18.372 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.366+0000 7fc131819880 20 INFO: main: starting shard=5 2023-10-05T11:42:18.372 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.366+0000 7fc131819880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.2.5 2023-10-05T11:42:18.372 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.366+0000 7fc131819880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.2.5 2023-10-05T11:42:18.372 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.367+0000 7fc131819880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:42:18.372 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.367+0000 7fc131819880 20 INFO: main: starting shard=6 2023-10-05T11:42:18.372 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.367+0000 7fc131819880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.2.6 2023-10-05T11:42:18.372 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.367+0000 7fc131819880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.2.6 2023-10-05T11:42:18.372 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.367+0000 7fc131819880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:42:18.372 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.367+0000 7fc131819880 20 INFO: main: starting shard=7 2023-10-05T11:42:18.372 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.367+0000 7fc131819880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.2.7 2023-10-05T11:42:18.372 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.367+0000 7fc131819880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.2.7 2023-10-05T11:42:18.374 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.368+0000 7fc131819880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:42:18.374 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.368+0000 7fc131819880 20 INFO: main: starting shard=8 2023-10-05T11:42:18.374 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.368+0000 7fc131819880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.2.8 2023-10-05T11:42:18.374 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.368+0000 7fc131819880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.2.8 2023-10-05T11:42:18.374 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.368+0000 7fc131819880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:42:18.374 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.368+0000 7fc131819880 20 INFO: main: starting shard=9 2023-10-05T11:42:18.374 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.368+0000 7fc131819880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.2.9 2023-10-05T11:42:18.375 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.368+0000 7fc131819880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.2.9 2023-10-05T11:42:18.375 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.369+0000 7fc131819880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:42:18.375 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.369+0000 7fc131819880 20 INFO: main: starting shard=10 2023-10-05T11:42:18.375 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.369+0000 7fc131819880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.2.10 2023-10-05T11:42:18.375 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.369+0000 7fc131819880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.2.10 2023-10-05T11:42:18.375 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.369+0000 7fc131819880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:42:18.375 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.369+0000 7fc131819880 20 INFO: main: starting shard=11 2023-10-05T11:42:18.375 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.369+0000 7fc131819880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.2.11 2023-10-05T11:42:18.375 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.369+0000 7fc131819880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.2.11 2023-10-05T11:42:18.375 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.370+0000 7fc131819880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:42:18.375 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.370+0000 7fc131819880 20 INFO: main: starting shard=12 2023-10-05T11:42:18.376 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.370+0000 7fc131819880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.2.12 2023-10-05T11:42:18.376 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.370+0000 7fc131819880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.2.12 2023-10-05T11:42:18.376 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.370+0000 7fc131819880 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-10-05T11:42:18.376 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.370+0000 7fc131819880 20 INFO: main: done 2023-10-05T11:42:18.376 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.371+0000 7fc114cce640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:42:18.377 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.373+0000 7fc131819880 20 remove_watcher() i=0 2023-10-05T11:42:18.377 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.373+0000 7fc131819880 2 removed watcher, disabling cache 2023-10-05T11:42:18.377 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.374+0000 7fc131819880 20 remove_watcher() i=1 2023-10-05T11:42:18.378 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.375+0000 7fc131819880 20 remove_watcher() i=2 2023-10-05T11:42:18.379 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.376+0000 7fc131819880 20 remove_watcher() i=3 2023-10-05T11:42:18.381 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.377+0000 7fc131819880 20 remove_watcher() i=4 2023-10-05T11:42:18.382 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.378+0000 7fc131819880 20 remove_watcher() i=5 2023-10-05T11:42:18.383 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.379+0000 7fc131819880 20 remove_watcher() i=6 2023-10-05T11:42:18.383 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:18.380+0000 7fc131819880 20 remove_watcher() i=7 2023-10-05T11:42:18.408 INFO:tasks.workunit.client.0.smithi012.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2023-10-05T11:42:18.811 INFO:tasks.workunit.client.0.smithi012.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2023-10-05T11:42:19.213 INFO:tasks.workunit.client.0.smithi012.stderr:radosgw-admin bucket reshard --bucket myver --num-shards 17 --yes-i-really-mean-it 2023-10-05T11:42:19.245 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setuser ceph since I am not root 2023-10-05T11:42:19.245 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T11:42:19.258 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.255+0000 7ff263c0a880 20 rados->read ofs=0 len=0 2023-10-05T11:42:19.260 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.257+0000 7ff263c0a880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:42:19.261 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.257+0000 7ff263c0a880 20 realm 2023-10-05T11:42:19.261 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.257+0000 7ff263c0a880 20 rados->read ofs=0 len=0 2023-10-05T11:42:19.261 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.257+0000 7ff263c0a880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:42:19.261 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.257+0000 7ff263c0a880 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T11:42:19.261 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.257+0000 7ff263c0a880 20 rados->read ofs=0 len=0 2023-10-05T11:42:19.262 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.257+0000 7ff263c0a880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:42:19.262 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.257+0000 7ff263c0a880 20 rados->read ofs=0 len=0 2023-10-05T11:42:19.263 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.258+0000 7ff263c0a880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:42:19.263 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.258+0000 7ff263c0a880 20 rados->read ofs=0 len=0 2023-10-05T11:42:19.263 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.259+0000 7ff263c0a880 20 rados_obj.operate() r=0 bl.length=1020 2023-10-05T11:42:19.263 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.259+0000 7ff263c0a880 20 searching for the correct realm 2023-10-05T11:42:19.273 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.269+0000 7ff2623af640 0 -- 172.21.15.12:0/123286129 >> [v2:172.21.15.12:6800/732466381,v1:172.21.15.12:6801/732466381] conn(0x5596e9808c00 msgr2=0x5596e98c6c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:42:19.274 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.271+0000 7ff263c0a880 20 RGWRados::pool_iterate: got zone_info.dff27d1e-df33-400e-a68a-7ba586947c99 2023-10-05T11:42:19.275 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.271+0000 7ff263c0a880 20 RGWRados::pool_iterate: got zonegroup_info.c78aa576-9d15-4e9d-b3c0-4af23a22062c 2023-10-05T11:42:19.275 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.271+0000 7ff263c0a880 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T11:42:19.275 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.271+0000 7ff263c0a880 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T11:42:19.275 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.271+0000 7ff263c0a880 20 rados->read ofs=0 len=0 2023-10-05T11:42:19.275 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.271+0000 7ff263c0a880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:42:19.276 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.271+0000 7ff263c0a880 20 rados->read ofs=0 len=0 2023-10-05T11:42:19.277 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.271+0000 7ff263c0a880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:42:19.277 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.271+0000 7ff263c0a880 20 rados->read ofs=0 len=0 2023-10-05T11:42:19.277 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.271+0000 7ff263c0a880 20 rados_obj.operate() r=0 bl.length=454 2023-10-05T11:42:19.278 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.272+0000 7ff263c0a880 20 zone default found 2023-10-05T11:42:19.278 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.272+0000 7ff263c0a880 4 Realm: () 2023-10-05T11:42:19.278 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.272+0000 7ff263c0a880 4 ZoneGroup: default (c78aa576-9d15-4e9d-b3c0-4af23a22062c) 2023-10-05T11:42:19.278 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.272+0000 7ff263c0a880 4 Zone: default (dff27d1e-df33-400e-a68a-7ba586947c99) 2023-10-05T11:42:19.279 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.272+0000 7ff263c0a880 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T11:42:19.279 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.272+0000 7ff263c0a880 20 zonegroup default 2023-10-05T11:42:19.279 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.272+0000 7ff263c0a880 20 rados->read ofs=0 len=0 2023-10-05T11:42:19.279 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.272+0000 7ff263c0a880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:42:19.279 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.272+0000 7ff263c0a880 20 rados->read ofs=0 len=0 2023-10-05T11:42:19.279 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.272+0000 7ff263c0a880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:42:19.280 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.272+0000 7ff263c0a880 20 rados->read ofs=0 len=0 2023-10-05T11:42:19.280 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.272+0000 7ff263c0a880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:42:19.280 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.272+0000 7ff263c0a880 20 started sync module instance, tier type = 2023-10-05T11:42:19.280 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.272+0000 7ff263c0a880 20 started zone id=dff27d1e-df33-400e-a68a-7ba586947c99 (name=default) with tier type = 2023-10-05T11:42:19.282 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.279+0000 7ff262bb0640 0 -- 172.21.15.12:0/123286129 >> [v2:172.21.15.170:6800/4137726411,v1:172.21.15.170:6801/4137726411] conn(0x5596e9809000 msgr2=0x5596e98c7700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:42:19.285 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.282+0000 7ff263c0a880 20 add_watcher() i=0 2023-10-05T11:42:19.286 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.282+0000 7ff263c0a880 20 add_watcher() i=1 2023-10-05T11:42:19.286 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.282+0000 7ff263c0a880 20 add_watcher() i=2 2023-10-05T11:42:19.286 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.282+0000 7ff263c0a880 20 add_watcher() i=3 2023-10-05T11:42:19.286 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.282+0000 7ff263c0a880 20 add_watcher() i=4 2023-10-05T11:42:19.286 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.282+0000 7ff263c0a880 20 add_watcher() i=5 2023-10-05T11:42:19.287 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.282+0000 7ff263c0a880 20 add_watcher() i=6 2023-10-05T11:42:19.287 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.283+0000 7ff263c0a880 20 add_watcher() i=7 2023-10-05T11:42:19.287 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.283+0000 7ff263c0a880 2 all 8 watchers are set, enabling cache 2023-10-05T11:42:19.288 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.285+0000 7ff24937d640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:42:19.288 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.285+0000 7ff263c0a880 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T11:42:19.289 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.285+0000 7ff263c0a880 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T11:42:19.294 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.291+0000 7ff263c0a880 5 note: GC not initialized 2023-10-05T11:42:19.294 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.291+0000 7ff244b74640 20 reqs_thread_entry: start 2023-10-05T11:42:19.295 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.291+0000 7ff263c0a880 20 init_complete bucket index max shards: 11 2023-10-05T11:42:19.295 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.291+0000 7ff263c0a880 20 Filter name: none 2023-10-05T11:42:19.295 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.291+0000 7ff242b70640 20 reqs_thread_entry: start 2023-10-05T11:42:19.296 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.291+0000 7ff263c0a880 10 cache get: name=default.rgw.meta+root+myver : miss 2023-10-05T11:42:19.296 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.291+0000 7ff263c0a880 20 rados->read ofs=0 len=0 2023-10-05T11:42:19.297 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.291+0000 7ff263c0a880 20 rados_obj.operate() r=0 bl.length=197 2023-10-05T11:42:19.297 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.291+0000 7ff263c0a880 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2023-10-05T11:42:19.297 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.291+0000 7ff263c0a880 10 adding default.rgw.meta+root+myver to cache LRU end 2023-10-05T11:42:19.297 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.291+0000 7ff263c0a880 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:dff27d1e-df33-400e-a68a-7ba586947c99.4604.17 : miss 2023-10-05T11:42:19.297 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.291+0000 7ff263c0a880 20 rados->read ofs=0 len=0 2023-10-05T11:42:19.297 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.292+0000 7ff263c0a880 20 rados_obj.operate() r=0 bl.length=369 2023-10-05T11:42:19.297 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.292+0000 7ff263c0a880 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:dff27d1e-df33-400e-a68a-7ba586947c99.4604.17 info.flags=0x17 2023-10-05T11:42:19.297 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.292+0000 7ff263c0a880 10 adding default.rgw.meta+root+.bucket.meta.myver:dff27d1e-df33-400e-a68a-7ba586947c99.4604.17 to cache LRU end 2023-10-05T11:42:19.297 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.292+0000 7ff263c0a880 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T11:42:19.297 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.292+0000 7ff263c0a880 10 updating xattr: name=user.rgw.acl bl.length()=203 2023-10-05T11:42:19.298 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.292+0000 7ff263c0a880 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:dff27d1e-df33-400e-a68a-7ba586947c99.4604.17 2023-10-05T11:42:19.302 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.298+0000 7ff263c0a880 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:dff27d1e-df33-400e-a68a-7ba586947c99.4604.17 info.flags=0x17 2023-10-05T11:42:19.302 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.298+0000 7ff263c0a880 10 moving default.rgw.meta+root+.bucket.meta.myver:dff27d1e-df33-400e-a68a-7ba586947c99.4604.17 to cache LRU end 2023-10-05T11:42:19.302 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.298+0000 7ff263c0a880 10 updating xattr: name=user.rgw.acl bl.length()=203 2023-10-05T11:42:19.302 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.298+0000 7ff263c0a880 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:dff27d1e-df33-400e-a68a-7ba586947c99.4604.17, ofs0, ns] 2023-10-05T11:42:19.302 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.299+0000 7ff25cba4640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1060856922183 cookie 94106651819008 notifier 7331 bl.length()=855 2023-10-05T11:42:19.302 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.299+0000 7ff25cba4640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:dff27d1e-df33-400e-a68a-7ba586947c99.4604.17 info.flags=0x17 2023-10-05T11:42:19.302 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.299+0000 7ff25cba4640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:dff27d1e-df33-400e-a68a-7ba586947c99.4604.17 to cache LRU end 2023-10-05T11:42:19.303 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.299+0000 7ff25cba4640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2023-10-05T11:42:19.304 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.301+0000 7ff263c0a880 20 handle_bi_update(): bucket=:myver[dff27d1e-df33-400e-a68a-7ba586947c99.4604.17]): orig_sources= new_sources= 2023-10-05T11:42:19.304 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.301+0000 7ff263c0a880 20 handle_bi_update(): bucket=:myver[dff27d1e-df33-400e-a68a-7ba586947c99.4604.17]): potential sources added=[] removed=[] 2023-10-05T11:42:19.304 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.301+0000 7ff263c0a880 20 handle_bi_update(): bucket=:myver[dff27d1e-df33-400e-a68a-7ba586947c99.4604.17]): orig_dests= new_dests= 2023-10-05T11:42:19.304 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.301+0000 7ff263c0a880 20 handle_bi_update(): bucket=:myver[dff27d1e-df33-400e-a68a-7ba586947c99.4604.17]): potential dests added=[] removed=[] 2023-10-05T11:42:19.307 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.303+0000 7ff263c0a880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.3.0 2023-10-05T11:42:19.307 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.303+0000 7ff263c0a880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.3.0 2023-10-05T11:42:19.307 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.303+0000 7ff263c0a880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.3.1 2023-10-05T11:42:19.307 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.303+0000 7ff263c0a880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.3.1 2023-10-05T11:42:19.307 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.303+0000 7ff263c0a880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.3.2 2023-10-05T11:42:19.307 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.303+0000 7ff263c0a880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.3.2 2023-10-05T11:42:19.307 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.303+0000 7ff263c0a880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.3.3 2023-10-05T11:42:19.308 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.303+0000 7ff263c0a880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.3.3 2023-10-05T11:42:19.308 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.303+0000 7ff263c0a880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.3.4 2023-10-05T11:42:19.308 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.303+0000 7ff263c0a880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.3.4 2023-10-05T11:42:19.308 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.303+0000 7ff263c0a880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.3.5 2023-10-05T11:42:19.308 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.303+0000 7ff263c0a880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.3.5 2023-10-05T11:42:19.308 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.303+0000 7ff263c0a880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.3.6 2023-10-05T11:42:19.308 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.303+0000 7ff263c0a880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.3.6 2023-10-05T11:42:19.308 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.303+0000 7ff263c0a880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.3.7 2023-10-05T11:42:19.308 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.303+0000 7ff263c0a880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.3.7 2023-10-05T11:42:19.308 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.303+0000 7ff263c0a880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.3.8 2023-10-05T11:42:19.308 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.303+0000 7ff263c0a880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.3.8 2023-10-05T11:42:19.308 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.303+0000 7ff263c0a880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.3.9 2023-10-05T11:42:19.309 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.303+0000 7ff263c0a880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.3.9 2023-10-05T11:42:19.309 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.303+0000 7ff263c0a880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.3.10 2023-10-05T11:42:19.309 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.303+0000 7ff263c0a880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.3.10 2023-10-05T11:42:19.309 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.303+0000 7ff263c0a880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.3.11 2023-10-05T11:42:19.309 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.303+0000 7ff263c0a880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.3.11 2023-10-05T11:42:19.309 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.303+0000 7ff263c0a880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.3.12 2023-10-05T11:42:19.309 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.303+0000 7ff263c0a880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.3.12 2023-10-05T11:42:19.309 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.303+0000 7ff263c0a880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.3.13 2023-10-05T11:42:19.309 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.303+0000 7ff263c0a880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.3.13 2023-10-05T11:42:19.309 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.303+0000 7ff263c0a880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.3.14 2023-10-05T11:42:19.309 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.303+0000 7ff263c0a880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.3.14 2023-10-05T11:42:19.309 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.303+0000 7ff263c0a880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.3.15 2023-10-05T11:42:19.309 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.303+0000 7ff263c0a880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.3.15 2023-10-05T11:42:19.310 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.303+0000 7ff263c0a880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.3.16 2023-10-05T11:42:19.310 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.303+0000 7ff263c0a880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.3.16 2023-10-05T11:42:19.310 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.303+0000 7ff263c0a880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.2.0 2023-10-05T11:42:19.310 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.303+0000 7ff263c0a880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.2.0 2023-10-05T11:42:19.310 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.303+0000 7ff263c0a880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.2.1 2023-10-05T11:42:19.310 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.303+0000 7ff263c0a880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.2.1 2023-10-05T11:42:19.310 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.304+0000 7ff263c0a880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.2.2 2023-10-05T11:42:19.310 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.304+0000 7ff263c0a880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.2.2 2023-10-05T11:42:19.311 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.304+0000 7ff263c0a880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.2.3 2023-10-05T11:42:19.311 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.304+0000 7ff263c0a880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.2.3 2023-10-05T11:42:19.311 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.305+0000 7ff263c0a880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.2.4 2023-10-05T11:42:19.311 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.305+0000 7ff263c0a880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.2.4 2023-10-05T11:42:19.312 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.306+0000 7ff263c0a880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.2.5 2023-10-05T11:42:19.312 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.306+0000 7ff263c0a880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.2.5 2023-10-05T11:42:19.312 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.306+0000 7ff263c0a880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.2.6 2023-10-05T11:42:19.312 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.306+0000 7ff263c0a880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.2.6 2023-10-05T11:42:19.312 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.306+0000 7ff263c0a880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.2.7 2023-10-05T11:42:19.312 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.306+0000 7ff263c0a880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.2.7 2023-10-05T11:42:19.312 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.307+0000 7ff263c0a880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.2.8 2023-10-05T11:42:19.312 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.307+0000 7ff263c0a880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.2.8 2023-10-05T11:42:19.312 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.307+0000 7ff263c0a880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.2.9 2023-10-05T11:42:19.312 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.307+0000 7ff263c0a880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.2.9 2023-10-05T11:42:19.312 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.308+0000 7ff263c0a880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.2.10 2023-10-05T11:42:19.312 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.308+0000 7ff263c0a880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.2.10 2023-10-05T11:42:19.313 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.309+0000 7ff263c0a880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.2.11 2023-10-05T11:42:19.313 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.309+0000 7ff263c0a880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.2.11 2023-10-05T11:42:19.314 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.309+0000 7ff263c0a880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.2.12 2023-10-05T11:42:19.314 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.309+0000 7ff263c0a880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.2.12 2023-10-05T11:42:19.314 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.311+0000 7ff263c0a880 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:dff27d1e-df33-400e-a68a-7ba586947c99.4604.17 : hit (requested=0x17, cached=0x17) 2023-10-05T11:42:19.314 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.311+0000 7ff263c0a880 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:dff27d1e-df33-400e-a68a-7ba586947c99.4604.17 2023-10-05T11:42:19.316 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.312+0000 7ff263c0a880 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:dff27d1e-df33-400e-a68a-7ba586947c99.4604.17 info.flags=0x17 2023-10-05T11:42:19.316 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.312+0000 7ff263c0a880 10 moving default.rgw.meta+root+.bucket.meta.myver:dff27d1e-df33-400e-a68a-7ba586947c99.4604.17 to cache LRU end 2023-10-05T11:42:19.316 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.312+0000 7ff263c0a880 10 updating xattr: name=user.rgw.acl bl.length()=203 2023-10-05T11:42:19.316 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.312+0000 7ff263c0a880 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:dff27d1e-df33-400e-a68a-7ba586947c99.4604.17, ofs0, ns] 2023-10-05T11:42:19.317 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.313+0000 7ff25cba4640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1060856922184 cookie 94106651819008 notifier 7331 bl.length()=823 2023-10-05T11:42:19.317 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.313+0000 7ff25cba4640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:dff27d1e-df33-400e-a68a-7ba586947c99.4604.17 info.flags=0x17 2023-10-05T11:42:19.317 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.313+0000 7ff25cba4640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:dff27d1e-df33-400e-a68a-7ba586947c99.4604.17 to cache LRU end 2023-10-05T11:42:19.317 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.313+0000 7ff25cba4640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2023-10-05T11:42:19.318 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.315+0000 7ff263c0a880 20 handle_bi_update(): bucket=:myver[dff27d1e-df33-400e-a68a-7ba586947c99.4604.17]): orig_sources= new_sources= 2023-10-05T11:42:19.318 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.315+0000 7ff263c0a880 20 handle_bi_update(): bucket=:myver[dff27d1e-df33-400e-a68a-7ba586947c99.4604.17]): potential sources added=[] removed=[] 2023-10-05T11:42:19.318 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.315+0000 7ff263c0a880 20 handle_bi_update(): bucket=:myver[dff27d1e-df33-400e-a68a-7ba586947c99.4604.17]): orig_dests= new_dests= 2023-10-05T11:42:19.318 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.315+0000 7ff263c0a880 20 handle_bi_update(): bucket=:myver[dff27d1e-df33-400e-a68a-7ba586947c99.4604.17]): potential dests added=[] removed=[] 2023-10-05T11:42:19.320 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.317+0000 7ff263c0a880 1 execute INFO: reshard of bucket "myver" completed successfully 2023-10-05T11:42:19.322 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.319+0000 7ff24937d640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:42:19.324 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.321+0000 7ff263c0a880 20 remove_watcher() i=0 2023-10-05T11:42:19.324 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.321+0000 7ff263c0a880 2 removed watcher, disabling cache 2023-10-05T11:42:19.325 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.322+0000 7ff263c0a880 20 remove_watcher() i=1 2023-10-05T11:42:19.326 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.323+0000 7ff263c0a880 20 remove_watcher() i=2 2023-10-05T11:42:19.327 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.324+0000 7ff263c0a880 20 remove_watcher() i=3 2023-10-05T11:42:19.328 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.325+0000 7ff263c0a880 20 remove_watcher() i=4 2023-10-05T11:42:19.329 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.326+0000 7ff263c0a880 20 remove_watcher() i=5 2023-10-05T11:42:19.330 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.327+0000 7ff263c0a880 20 remove_watcher() i=6 2023-10-05T11:42:19.331 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.328+0000 7ff263c0a880 20 remove_watcher() i=7 2023-10-05T11:42:19.337 INFO:tasks.workunit.client.0.smithi012.stderr:radosgw-admin bucket check unlinked --bucket myver --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2023-10-05T11:42:19.371 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setuser ceph since I am not root 2023-10-05T11:42:19.371 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T11:42:19.384 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.381+0000 7feea6215880 20 rados->read ofs=0 len=0 2023-10-05T11:42:19.386 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.382+0000 7feea6215880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:42:19.386 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.382+0000 7feea6215880 20 realm 2023-10-05T11:42:19.386 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.382+0000 7feea6215880 20 rados->read ofs=0 len=0 2023-10-05T11:42:19.386 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.382+0000 7feea6215880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:42:19.386 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.382+0000 7feea6215880 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T11:42:19.386 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.382+0000 7feea6215880 20 rados->read ofs=0 len=0 2023-10-05T11:42:19.387 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.382+0000 7feea6215880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:42:19.387 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.382+0000 7feea6215880 20 rados->read ofs=0 len=0 2023-10-05T11:42:19.387 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.383+0000 7feea6215880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:42:19.387 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.383+0000 7feea6215880 20 rados->read ofs=0 len=0 2023-10-05T11:42:19.389 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.384+0000 7feea6215880 20 rados_obj.operate() r=0 bl.length=1020 2023-10-05T11:42:19.389 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.384+0000 7feea6215880 20 searching for the correct realm 2023-10-05T11:42:19.394 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.391+0000 7feea2f7e640 0 -- 172.21.15.12:0/1628223258 >> [v2:172.21.15.170:6800/4137726411,v1:172.21.15.170:6801/4137726411] conn(0x5575971a1000 msgr2=0x557597197700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:42:19.398 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.394+0000 7feea6215880 20 RGWRados::pool_iterate: got zone_info.dff27d1e-df33-400e-a68a-7ba586947c99 2023-10-05T11:42:19.398 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.394+0000 7feea6215880 20 RGWRados::pool_iterate: got zonegroup_info.c78aa576-9d15-4e9d-b3c0-4af23a22062c 2023-10-05T11:42:19.398 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.394+0000 7feea6215880 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T11:42:19.398 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.394+0000 7feea6215880 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T11:42:19.398 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.394+0000 7feea6215880 20 rados->read ofs=0 len=0 2023-10-05T11:42:19.399 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.395+0000 7feea6215880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:42:19.399 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.395+0000 7feea6215880 20 rados->read ofs=0 len=0 2023-10-05T11:42:19.399 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.395+0000 7feea6215880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:42:19.399 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.395+0000 7feea6215880 20 rados->read ofs=0 len=0 2023-10-05T11:42:19.400 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.395+0000 7feea6215880 20 rados_obj.operate() r=0 bl.length=454 2023-10-05T11:42:19.400 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.395+0000 7feea6215880 20 zone default found 2023-10-05T11:42:19.400 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.395+0000 7feea6215880 4 Realm: () 2023-10-05T11:42:19.400 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.395+0000 7feea6215880 4 ZoneGroup: default (c78aa576-9d15-4e9d-b3c0-4af23a22062c) 2023-10-05T11:42:19.400 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.395+0000 7feea6215880 4 Zone: default (dff27d1e-df33-400e-a68a-7ba586947c99) 2023-10-05T11:42:19.401 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.395+0000 7feea6215880 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T11:42:19.401 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.395+0000 7feea6215880 20 zonegroup default 2023-10-05T11:42:19.401 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.395+0000 7feea6215880 20 rados->read ofs=0 len=0 2023-10-05T11:42:19.401 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.395+0000 7feea277d640 0 -- 172.21.15.12:0/1628223258 >> [v2:172.21.15.12:6808/396693578,v1:172.21.15.12:6809/396693578] conn(0x5575971a1400 msgr2=0x55759729e000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-10-05T11:42:19.401 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.396+0000 7feea6215880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:42:19.401 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.396+0000 7feea6215880 20 rados->read ofs=0 len=0 2023-10-05T11:42:19.401 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.396+0000 7feea6215880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:42:19.401 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.396+0000 7feea6215880 20 rados->read ofs=0 len=0 2023-10-05T11:42:19.401 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.396+0000 7feea6215880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:42:19.401 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.396+0000 7feea6215880 20 started sync module instance, tier type = 2023-10-05T11:42:19.401 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.396+0000 7feea6215880 20 started zone id=dff27d1e-df33-400e-a68a-7ba586947c99 (name=default) with tier type = 2023-10-05T11:42:19.410 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.407+0000 7feea6215880 20 add_watcher() i=0 2023-10-05T11:42:19.410 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.407+0000 7feea6215880 20 add_watcher() i=1 2023-10-05T11:42:19.410 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.407+0000 7feea6215880 20 add_watcher() i=2 2023-10-05T11:42:19.410 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.407+0000 7feea6215880 20 add_watcher() i=3 2023-10-05T11:42:19.410 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.407+0000 7feea6215880 20 add_watcher() i=4 2023-10-05T11:42:19.410 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.407+0000 7feea6215880 20 add_watcher() i=5 2023-10-05T11:42:19.410 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.407+0000 7feea6215880 20 add_watcher() i=6 2023-10-05T11:42:19.411 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.408+0000 7feea6215880 20 add_watcher() i=7 2023-10-05T11:42:19.411 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.408+0000 7feea6215880 2 all 8 watchers are set, enabling cache 2023-10-05T11:42:19.412 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.409+0000 7fee8974b640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:42:19.413 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.410+0000 7feea6215880 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T11:42:19.413 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.410+0000 7feea6215880 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T11:42:19.418 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.415+0000 7feea6215880 5 note: GC not initialized 2023-10-05T11:42:19.419 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.415+0000 7fee84f42640 20 reqs_thread_entry: start 2023-10-05T11:42:19.419 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.415+0000 7feea6215880 20 init_complete bucket index max shards: 11 2023-10-05T11:42:19.419 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.416+0000 7feea6215880 20 Filter name: none 2023-10-05T11:42:19.420 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.416+0000 7fee82f3e640 20 reqs_thread_entry: start 2023-10-05T11:42:19.420 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.416+0000 7feea6215880 10 cache get: name=default.rgw.meta+root+myver : miss 2023-10-05T11:42:19.420 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.416+0000 7feea6215880 20 rados->read ofs=0 len=0 2023-10-05T11:42:19.420 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.416+0000 7feea6215880 20 rados_obj.operate() r=0 bl.length=197 2023-10-05T11:42:19.420 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.416+0000 7feea6215880 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2023-10-05T11:42:19.420 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.416+0000 7feea6215880 10 adding default.rgw.meta+root+myver to cache LRU end 2023-10-05T11:42:19.420 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.416+0000 7feea6215880 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:dff27d1e-df33-400e-a68a-7ba586947c99.4604.17 : miss 2023-10-05T11:42:19.420 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.416+0000 7feea6215880 20 rados->read ofs=0 len=0 2023-10-05T11:42:19.421 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.417+0000 7feea6215880 20 rados_obj.operate() r=0 bl.length=369 2023-10-05T11:42:19.421 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.417+0000 7feea6215880 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:dff27d1e-df33-400e-a68a-7ba586947c99.4604.17 info.flags=0x17 2023-10-05T11:42:19.421 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.417+0000 7feea6215880 10 adding default.rgw.meta+root+.bucket.meta.myver:dff27d1e-df33-400e-a68a-7ba586947c99.4604.17 to cache LRU end 2023-10-05T11:42:19.421 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.417+0000 7feea6215880 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T11:42:19.421 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.417+0000 7feea6215880 10 updating xattr: name=user.rgw.acl bl.length()=203 2023-10-05T11:42:19.421 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.417+0000 7feea6215880 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:dff27d1e-df33-400e-a68a-7ba586947c99.4604.17 2023-10-05T11:42:19.421 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.417+0000 7feea6215880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.3.0 2023-10-05T11:42:19.422 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.417+0000 7feea6215880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.3.0 2023-10-05T11:42:19.422 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.417+0000 7feea6215880 1 NOTICE: finished shard 0 (0 entries removed) 2023-10-05T11:42:19.422 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.417+0000 7feea6215880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.3.1 2023-10-05T11:42:19.422 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.417+0000 7feea6215880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.3.1 2023-10-05T11:42:19.422 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.418+0000 7feea6215880 1 NOTICE: finished shard 1 (0 entries removed) 2023-10-05T11:42:19.422 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.418+0000 7feea6215880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.3.2 2023-10-05T11:42:19.422 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.418+0000 7feea6215880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.3.2 2023-10-05T11:42:19.423 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.418+0000 7feea6215880 1 NOTICE: finished shard 2 (0 entries removed) 2023-10-05T11:42:19.423 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.418+0000 7feea6215880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.3.3 2023-10-05T11:42:19.423 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.418+0000 7feea6215880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.3.3 2023-10-05T11:42:19.423 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.419+0000 7feea6215880 1 NOTICE: finished shard 3 (0 entries removed) 2023-10-05T11:42:19.423 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.419+0000 7feea6215880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.3.4 2023-10-05T11:42:19.424 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.419+0000 7feea6215880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.3.4 2023-10-05T11:42:19.424 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.419+0000 7feea6215880 1 NOTICE: finished shard 4 (0 entries removed) 2023-10-05T11:42:19.424 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.419+0000 7feea6215880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.3.5 2023-10-05T11:42:19.424 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.419+0000 7feea6215880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.3.5 2023-10-05T11:42:19.424 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.419+0000 7feea6215880 1 NOTICE: finished shard 5 (0 entries removed) 2023-10-05T11:42:19.424 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.419+0000 7feea6215880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.3.6 2023-10-05T11:42:19.424 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.419+0000 7feea6215880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.3.6 2023-10-05T11:42:19.424 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.420+0000 7feea6215880 1 NOTICE: finished shard 6 (0 entries removed) 2023-10-05T11:42:19.424 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.420+0000 7feea6215880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.3.7 2023-10-05T11:42:19.424 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.420+0000 7feea6215880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.3.7 2023-10-05T11:42:19.425 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.420+0000 7feea6215880 1 NOTICE: finished shard 7 (0 entries removed) 2023-10-05T11:42:19.425 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.420+0000 7feea6215880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.3.8 2023-10-05T11:42:19.426 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.420+0000 7feea6215880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.3.8 2023-10-05T11:42:19.426 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.421+0000 7feea6215880 1 NOTICE: finished shard 8 (0 entries removed) 2023-10-05T11:42:19.426 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.421+0000 7feea6215880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.3.9 2023-10-05T11:42:19.426 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.421+0000 7feea6215880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.3.9 2023-10-05T11:42:19.426 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.421+0000 7feea6215880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.3.10 2023-10-05T11:42:19.426 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.421+0000 7feea6215880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.3.10 2023-10-05T11:42:19.426 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.422+0000 7feea6215880 1 NOTICE: finished shard 10 (0 entries removed) 2023-10-05T11:42:19.426 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.422+0000 7feea6215880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.3.11 2023-10-05T11:42:19.426 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.422+0000 7feea6215880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.3.11 2023-10-05T11:42:19.426 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.422+0000 7feea6215880 1 NOTICE: finished shard 11 (0 entries removed) 2023-10-05T11:42:19.426 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.422+0000 7feea6215880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.3.12 2023-10-05T11:42:19.427 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.422+0000 7feea6215880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.3.12 2023-10-05T11:42:19.427 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.422+0000 7feea6215880 1 NOTICE: finished shard 12 (0 entries removed) 2023-10-05T11:42:19.427 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.422+0000 7feea6215880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.3.13 2023-10-05T11:42:19.427 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.422+0000 7feea6215880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.3.13 2023-10-05T11:42:19.428 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.423+0000 7feea6215880 1 NOTICE: finished shard 13 (0 entries removed) 2023-10-05T11:42:19.428 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.423+0000 7feea6215880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.3.14 2023-10-05T11:42:19.428 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.423+0000 7feea6215880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.3.14 2023-10-05T11:42:19.428 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.423+0000 7feea6215880 1 NOTICE: finished shard 14 (0 entries removed) 2023-10-05T11:42:19.428 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.423+0000 7feea6215880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.3.15 2023-10-05T11:42:19.428 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.423+0000 7feea6215880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.3.15 2023-10-05T11:42:19.428 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.423+0000 7feea6215880 1 NOTICE: finished shard 15 (0 entries removed) 2023-10-05T11:42:19.428 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.423+0000 7feea6215880 10 bucket_obj is .dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.3.16 2023-10-05T11:42:19.428 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.423+0000 7feea6215880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.3.16 2023-10-05T11:42:19.428 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.424+0000 7feea6215880 1 NOTICE: finished shard 16 (0 entries removed) 2023-10-05T11:42:19.429 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.424+0000 7feea6215880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.3.9 2023-10-05T11:42:19.429 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.424+0000 7feea6215880 20 get_obj_state: rctx=0x5575971c2cb0 obj=myver:x state=0x557597c1ede8 s->prefetch_data=0 2023-10-05T11:42:19.429 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.424+0000 7feea6215880 20 get_obj_state: setting s->obj_tag to 5aeo75pkdg5z5l03ceecjunodisqadoj 2023-10-05T11:42:19.429 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.424+0000 7feea6215880 20 get_obj_state_impl: setting s->olh_tag to vths8ckvcwct6ynzpdkufq9jdnig2kbg 2023-10-05T11:42:19.429 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.424+0000 7feea6215880 20 bucket_index_guard_olh_op(): olh_state.olh_tag=vths8ckvcwct6ynzpdkufq9jdnig2kbg 2023-10-05T11:42:19.429 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.426+0000 7feea6215880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.3.9 2023-10-05T11:42:19.431 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.427+0000 7feea6215880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.3.9 2023-10-05T11:42:19.431 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.428+0000 7feea6215880 20 olh_log_entry: epoch=2 op=2 key=x[] 2023-10-05T11:42:19.431 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.428+0000 7feea6215880 20 olh_log_entry: epoch=2 op=3 key=x[IJ7yTfRw7PDrppPgAIx5lfi8urG0lRZ] 2023-10-05T11:42:19.431 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.428+0000 7feea6215880 20 get_obj_state: rctx=0x5575971c2cb0 obj=myver:_:IJ7yTfRw7PDrppPgAIx5lfi8urG0lRZ_x state=0x557597c1f9e8 s->prefetch_data=0 2023-10-05T11:42:19.431 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.428+0000 7feea6215880 10 manifest: total_size = 22 2023-10-05T11:42:19.432 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.428+0000 7feea6215880 20 get_obj_state: setting s->obj_tag to dff27d1e-df33-400e-a68a-7ba586947c99.4543.8433898007412591539 2023-10-05T11:42:19.432 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.428+0000 7feea6215880 20 get_obj_state: rctx=0x5575971c2cb0 obj=myver:_:IJ7yTfRw7PDrppPgAIx5lfi8urG0lRZ_x state=0x557597c1f9e8 s->prefetch_data=0 2023-10-05T11:42:19.432 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.428+0000 7feea6215880 20 prepare_atomic_modification: state is not atomic. state=0x557597c1f9e8 2023-10-05T11:42:19.432 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.428+0000 7feea6215880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.3.9 2023-10-05T11:42:19.434 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.431+0000 7feea6215880 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-10-05T11:42:19.434 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.431+0000 7feea6215880 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2023-10-05T11:42:19.434 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.431+0000 7feea6215880 0 deleting objects inline since gc isn't initialized 2023-10-05T11:42:19.434 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.431+0000 7feea6215880 5 delete_objs_inline: removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.17__shadow:IJ7yTfRw7PDrppPgAIx5lfi8urG0lRZ_.dvTzUCU56hIqewtr6VenK3d5sIXTOm2_0 2023-10-05T11:42:19.435 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.432+0000 7fee9cf72640 20 handle_completion(): completion ok for obj=x[IJ7yTfRw7PDrppPgAIx5lfi8urG0lRZ] 2023-10-05T11:42:19.436 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.433+0000 7feea6215880 5 delete_objs_inline: refcount put returned error -2 2023-10-05T11:42:19.437 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.434+0000 7feea6215880 20 get_obj_state: rctx=0x5575971c2cb0 obj=myver:x state=0x557597c1ede8 s->prefetch_data=0 2023-10-05T11:42:19.437 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.434+0000 7feea6215880 20 bucket_index_guard_olh_op(): olh_state.olh_tag=vths8ckvcwct6ynzpdkufq9jdnig2kbg 2023-10-05T11:42:19.440 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.437+0000 7feea6215880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.3.9 2023-10-05T11:42:19.441 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.438+0000 7feea6215880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.3.9 2023-10-05T11:42:19.441 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.438+0000 7feea6215880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.3.9 2023-10-05T11:42:19.442 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.439+0000 7feea6215880 20 get_obj_state: rctx=0x5575971c2cb0 obj=myver:y state=0x557597c1ede8 s->prefetch_data=0 2023-10-05T11:42:19.442 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.439+0000 7feea6215880 20 get_obj_state: setting s->obj_tag to 20xyay499dg8ikowv6o6gui5dmxdflq8 2023-10-05T11:42:19.442 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.439+0000 7feea6215880 20 get_obj_state_impl: setting s->olh_tag to xfrau3t784jqtwzilh038m0cj2kgqoi0 2023-10-05T11:42:19.442 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.439+0000 7feea6215880 20 bucket_index_guard_olh_op(): olh_state.olh_tag=xfrau3t784jqtwzilh038m0cj2kgqoi0 2023-10-05T11:42:19.443 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.440+0000 7feea6215880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.3.9 2023-10-05T11:42:19.445 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.442+0000 7feea6215880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.3.9 2023-10-05T11:42:19.445 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.442+0000 7feea6215880 20 olh_log_entry: epoch=2 op=2 key=y[] 2023-10-05T11:42:19.445 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.442+0000 7feea6215880 20 olh_log_entry: epoch=2 op=3 key=y[R9MV0eQbD5GMEKDPc8J5I3Oe1BDcXdx] 2023-10-05T11:42:19.445 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.442+0000 7feea6215880 20 get_obj_state: rctx=0x5575971c2cb0 obj=myver:_:R9MV0eQbD5GMEKDPc8J5I3Oe1BDcXdx_y state=0x557597c1f9e8 s->prefetch_data=0 2023-10-05T11:42:19.446 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.442+0000 7feea6215880 10 manifest: total_size = 9 2023-10-05T11:42:19.446 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.442+0000 7feea6215880 20 get_obj_state: setting s->obj_tag to dff27d1e-df33-400e-a68a-7ba586947c99.4543.4808445967109638458 2023-10-05T11:42:19.446 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.442+0000 7feea6215880 20 get_obj_state: rctx=0x5575971c2cb0 obj=myver:_:R9MV0eQbD5GMEKDPc8J5I3Oe1BDcXdx_y state=0x557597c1f9e8 s->prefetch_data=0 2023-10-05T11:42:19.446 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.442+0000 7feea6215880 20 prepare_atomic_modification: state is not atomic. state=0x557597c1f9e8 2023-10-05T11:42:19.446 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.442+0000 7feea6215880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.3.9 2023-10-05T11:42:19.448 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.445+0000 7feea6215880 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-10-05T11:42:19.448 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.445+0000 7feea6215880 20 RGWObjManifest::operator++(): result: ofs=9 stripe_ofs=9 part_ofs=0 rule->part_size=0 2023-10-05T11:42:19.448 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.445+0000 7feea6215880 0 deleting objects inline since gc isn't initialized 2023-10-05T11:42:19.448 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.445+0000 7feea6215880 5 delete_objs_inline: removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.17__shadow:R9MV0eQbD5GMEKDPc8J5I3Oe1BDcXdx_.4nm8siP8qPgOQ8sFmv6EmMRKQEXtVlb_0 2023-10-05T11:42:19.449 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.446+0000 7fee9c771640 20 handle_completion(): completion ok for obj=y[R9MV0eQbD5GMEKDPc8J5I3Oe1BDcXdx] 2023-10-05T11:42:19.450 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.447+0000 7feea6215880 5 delete_objs_inline: refcount put returned error -2 2023-10-05T11:42:19.451 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.448+0000 7feea6215880 20 get_obj_state: rctx=0x5575971c2cb0 obj=myver:y state=0x557597c1ede8 s->prefetch_data=0 2023-10-05T11:42:19.451 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.448+0000 7feea6215880 20 bucket_index_guard_olh_op(): olh_state.olh_tag=xfrau3t784jqtwzilh038m0cj2kgqoi0 2023-10-05T11:42:19.453 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.450+0000 7feea6215880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.3.9 2023-10-05T11:42:19.455 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.452+0000 7feea6215880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.3.9 2023-10-05T11:42:19.455 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.452+0000 7feea6215880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.3.9 2023-10-05T11:42:19.455 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.452+0000 7feea6215880 20 get_obj_state: rctx=0x5575971c2cb0 obj=myver:z state=0x557597c1ede8 s->prefetch_data=0 2023-10-05T11:42:19.456 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.452+0000 7feea6215880 20 get_obj_state: setting s->obj_tag to jmwy49v3lsvys963yqnrx2eez08wvroq 2023-10-05T11:42:19.456 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.452+0000 7feea6215880 20 get_obj_state_impl: setting s->olh_tag to ukfn4t1eiayh4vbvcqg78uy44zp1do05 2023-10-05T11:42:19.456 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.452+0000 7feea6215880 20 bucket_index_guard_olh_op(): olh_state.olh_tag=ukfn4t1eiayh4vbvcqg78uy44zp1do05 2023-10-05T11:42:19.457 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.454+0000 7feea6215880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.3.9 2023-10-05T11:42:19.458 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.455+0000 7feea6215880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.3.9 2023-10-05T11:42:19.458 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.455+0000 7feea6215880 20 olh_log_entry: epoch=2 op=2 key=z[] 2023-10-05T11:42:19.458 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.455+0000 7feea6215880 20 olh_log_entry: epoch=2 op=3 key=z[Eswgy.vjeZdWznWrgRTs0jVypAyE9Qg] 2023-10-05T11:42:19.459 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.455+0000 7feea6215880 20 get_obj_state: rctx=0x5575971c2cb0 obj=myver:_:Eswgy.vjeZdWznWrgRTs0jVypAyE9Qg_z state=0x557597c1f9e8 s->prefetch_data=0 2023-10-05T11:42:19.459 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.456+0000 7feea6215880 10 manifest: total_size = 22 2023-10-05T11:42:19.459 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.456+0000 7feea6215880 20 get_obj_state: setting s->obj_tag to dff27d1e-df33-400e-a68a-7ba586947c99.4543.1066010291332623636 2023-10-05T11:42:19.459 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.456+0000 7feea6215880 20 get_obj_state: rctx=0x5575971c2cb0 obj=myver:_:Eswgy.vjeZdWznWrgRTs0jVypAyE9Qg_z state=0x557597c1f9e8 s->prefetch_data=0 2023-10-05T11:42:19.459 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.456+0000 7feea6215880 20 prepare_atomic_modification: state is not atomic. state=0x557597c1f9e8 2023-10-05T11:42:19.459 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.456+0000 7feea6215880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.3.9 2023-10-05T11:42:19.461 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.458+0000 7feea6215880 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-10-05T11:42:19.462 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.458+0000 7feea6215880 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2023-10-05T11:42:19.462 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.458+0000 7feea6215880 0 deleting objects inline since gc isn't initialized 2023-10-05T11:42:19.462 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.458+0000 7feea6215880 5 delete_objs_inline: removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.17__shadow:Eswgy.vjeZdWznWrgRTs0jVypAyE9Qg_.FUfqZcFFtx6ZVLq2kUi-PTh6RVM293s_0 2023-10-05T11:42:19.462 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.459+0000 7fee9cf72640 20 handle_completion(): completion ok for obj=z[Eswgy.vjeZdWznWrgRTs0jVypAyE9Qg] 2023-10-05T11:42:19.463 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.460+0000 7feea6215880 5 delete_objs_inline: refcount put returned error -2 2023-10-05T11:42:19.464 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.461+0000 7feea6215880 20 get_obj_state: rctx=0x5575971c2cb0 obj=myver:z state=0x557597c1ede8 s->prefetch_data=0 2023-10-05T11:42:19.464 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.461+0000 7feea6215880 20 bucket_index_guard_olh_op(): olh_state.olh_tag=ukfn4t1eiayh4vbvcqg78uy44zp1do05 2023-10-05T11:42:19.467 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.464+0000 7feea6215880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.3.9 2023-10-05T11:42:19.468 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.465+0000 7feea6215880 20 bucket index object: default.rgw.buckets.index:.dir.dff27d1e-df33-400e-a68a-7ba586947c99.4604.17.3.9 2023-10-05T11:42:19.468 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.465+0000 7feea6215880 1 NOTICE: finished shard 9 (3 entries removed) 2023-10-05T11:42:19.468 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.465+0000 7feea6215880 1 NOTICE: finished all shards (3 entries removed) 2023-10-05T11:42:19.469 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.466+0000 7fee8974b640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:42:19.471 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.468+0000 7feea6215880 20 remove_watcher() i=0 2023-10-05T11:42:19.471 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.468+0000 7feea6215880 2 removed watcher, disabling cache 2023-10-05T11:42:19.472 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.469+0000 7feea6215880 20 remove_watcher() i=1 2023-10-05T11:42:19.473 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.470+0000 7feea6215880 20 remove_watcher() i=2 2023-10-05T11:42:19.474 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.471+0000 7feea6215880 20 remove_watcher() i=3 2023-10-05T11:42:19.475 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.472+0000 7feea6215880 20 remove_watcher() i=4 2023-10-05T11:42:19.476 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.473+0000 7feea6215880 20 remove_watcher() i=5 2023-10-05T11:42:19.477 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.474+0000 7feea6215880 20 remove_watcher() i=6 2023-10-05T11:42:19.478 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.475+0000 7feea6215880 20 remove_watcher() i=7 2023-10-05T11:42:19.608 INFO:tasks.workunit.client.0.smithi012.stderr:radosgw-admin bucket stats --bucket myver 2023-10-05T11:42:19.636 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setuser ceph since I am not root 2023-10-05T11:42:19.636 INFO:tasks.workunit.client.0.smithi012.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T11:42:19.649 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.646+0000 7fb7d1f33880 20 rados->read ofs=0 len=0 2023-10-05T11:42:19.651 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.647+0000 7fb7d1f33880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:42:19.651 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.647+0000 7fb7d1f33880 20 realm 2023-10-05T11:42:19.651 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.647+0000 7fb7d1f33880 20 rados->read ofs=0 len=0 2023-10-05T11:42:19.651 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.647+0000 7fb7d1f33880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:42:19.651 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.647+0000 7fb7d1f33880 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T11:42:19.651 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.647+0000 7fb7d1f33880 20 rados->read ofs=0 len=0 2023-10-05T11:42:19.651 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.648+0000 7fb7d1f33880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:42:19.651 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.648+0000 7fb7d1f33880 20 rados->read ofs=0 len=0 2023-10-05T11:42:19.652 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.648+0000 7fb7d1f33880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:42:19.652 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.648+0000 7fb7d1f33880 20 rados->read ofs=0 len=0 2023-10-05T11:42:19.652 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.649+0000 7fb7d1f33880 20 rados_obj.operate() r=0 bl.length=1020 2023-10-05T11:42:19.652 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.649+0000 7fb7d1f33880 20 searching for the correct realm 2023-10-05T11:42:19.661 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.658+0000 7fb7ce827640 0 -- 172.21.15.12:0/248654074 >> [v2:172.21.15.12:6800/732466381,v1:172.21.15.12:6801/732466381] conn(0x55970fe5a000 msgr2=0x55970fd5cb00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:42:19.662 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.659+0000 7fb7d1f33880 20 RGWRados::pool_iterate: got zone_info.dff27d1e-df33-400e-a68a-7ba586947c99 2023-10-05T11:42:19.662 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.659+0000 7fb7d1f33880 20 RGWRados::pool_iterate: got zonegroup_info.c78aa576-9d15-4e9d-b3c0-4af23a22062c 2023-10-05T11:42:19.663 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.659+0000 7fb7d1f33880 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T11:42:19.663 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.659+0000 7fb7d1f33880 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T11:42:19.663 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.659+0000 7fb7d1f33880 20 rados->read ofs=0 len=0 2023-10-05T11:42:19.663 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.659+0000 7fb7d1f33880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:42:19.663 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.659+0000 7fb7d1f33880 20 rados->read ofs=0 len=0 2023-10-05T11:42:19.664 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.660+0000 7fb7d1f33880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:42:19.664 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.660+0000 7fb7d1f33880 20 rados->read ofs=0 len=0 2023-10-05T11:42:19.664 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.660+0000 7fb7d1f33880 20 rados_obj.operate() r=0 bl.length=454 2023-10-05T11:42:19.664 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.660+0000 7fb7d1f33880 20 zone default found 2023-10-05T11:42:19.664 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.660+0000 7fb7d1f33880 4 Realm: () 2023-10-05T11:42:19.664 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.660+0000 7fb7d1f33880 4 ZoneGroup: default (c78aa576-9d15-4e9d-b3c0-4af23a22062c) 2023-10-05T11:42:19.664 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.660+0000 7fb7d1f33880 4 Zone: default (dff27d1e-df33-400e-a68a-7ba586947c99) 2023-10-05T11:42:19.664 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.660+0000 7fb7d1f33880 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T11:42:19.665 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.660+0000 7fb7d1f33880 20 zonegroup default 2023-10-05T11:42:19.665 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.660+0000 7fb7d1f33880 20 rados->read ofs=0 len=0 2023-10-05T11:42:19.665 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.660+0000 7fb7d1f33880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:42:19.665 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.660+0000 7fb7d1f33880 20 rados->read ofs=0 len=0 2023-10-05T11:42:19.665 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.661+0000 7fb7d1f33880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:42:19.665 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.661+0000 7fb7d1f33880 20 rados->read ofs=0 len=0 2023-10-05T11:42:19.665 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.661+0000 7fb7d1f33880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:42:19.666 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.661+0000 7fb7d1f33880 20 started sync module instance, tier type = 2023-10-05T11:42:19.666 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.661+0000 7fb7d1f33880 20 started zone id=dff27d1e-df33-400e-a68a-7ba586947c99 (name=default) with tier type = 2023-10-05T11:42:19.670 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.666+0000 7fb7ce827640 0 -- 172.21.15.12:0/248654074 >> [v2:172.21.15.12:6800/732466381,v1:172.21.15.12:6801/732466381] conn(0x55970fe6a000 msgr2=0x55970fd5e100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:42:19.674 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.670+0000 7fb7d1f33880 20 add_watcher() i=0 2023-10-05T11:42:19.674 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.670+0000 7fb7d1f33880 20 add_watcher() i=1 2023-10-05T11:42:19.674 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.670+0000 7fb7d1f33880 20 add_watcher() i=2 2023-10-05T11:42:19.674 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.670+0000 7fb7d1f33880 20 add_watcher() i=3 2023-10-05T11:42:19.674 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.670+0000 7fb7d1f33880 20 add_watcher() i=4 2023-10-05T11:42:19.674 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.670+0000 7fb7d1f33880 20 add_watcher() i=5 2023-10-05T11:42:19.674 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.670+0000 7fb7d1f33880 20 add_watcher() i=6 2023-10-05T11:42:19.676 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.673+0000 7fb7d1f33880 20 add_watcher() i=7 2023-10-05T11:42:19.676 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.673+0000 7fb7d1f33880 2 all 8 watchers are set, enabling cache 2023-10-05T11:42:19.678 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.675+0000 7fb7b57f5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:42:19.678 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.675+0000 7fb7d1f33880 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T11:42:19.678 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.675+0000 7fb7d1f33880 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T11:42:19.683 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.680+0000 7fb7d1f33880 5 note: GC not initialized 2023-10-05T11:42:19.684 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.680+0000 7fb7b0fec640 20 reqs_thread_entry: start 2023-10-05T11:42:19.684 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.681+0000 7fb7d1f33880 20 init_complete bucket index max shards: 11 2023-10-05T11:42:19.684 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.681+0000 7fb7d1f33880 20 Filter name: none 2023-10-05T11:42:19.685 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.681+0000 7fb7aefe8640 20 reqs_thread_entry: start 2023-10-05T11:42:19.685 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.681+0000 7fb7d1f33880 20 rados->read ofs=0 len=0 2023-10-05T11:42:19.685 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.681+0000 7fb7d1f33880 20 rados_obj.operate() r=0 bl.length=197 2023-10-05T11:42:19.685 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.681+0000 7fb7d1f33880 20 rados->read ofs=0 len=0 2023-10-05T11:42:19.685 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.682+0000 7fb7d1f33880 20 rados_obj.operate() r=0 bl.length=369 2023-10-05T11:42:19.686 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.682+0000 7fb7d1f33880 20 couldn't put binfo cache entry, might have raced with data changes 2023-10-05T11:42:19.686 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.682+0000 7fb7d1f33880 20 rados->read ofs=0 len=0 2023-10-05T11:42:19.686 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.682+0000 7fb7d1f33880 20 rados_obj.operate() r=0 bl.length=197 2023-10-05T11:42:19.686 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.682+0000 7fb7d1f33880 20 rados->read ofs=0 len=0 2023-10-05T11:42:19.686 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.682+0000 7fb7d1f33880 20 rados_obj.operate() r=0 bl.length=369 2023-10-05T11:42:19.686 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.682+0000 7fb7d1f33880 20 couldn't put binfo cache entry, might have raced with data changes 2023-10-05T11:42:19.686 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.683+0000 7fb7d1f33880 20 rados->read ofs=0 len=0 2023-10-05T11:42:19.687 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.684+0000 7fb7d1f33880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:42:19.687 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.684+0000 7fb7b57f5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:42:19.689 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.686+0000 7fb7d1f33880 20 remove_watcher() i=0 2023-10-05T11:42:19.689 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.686+0000 7fb7d1f33880 2 removed watcher, disabling cache 2023-10-05T11:42:19.690 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.687+0000 7fb7d1f33880 20 remove_watcher() i=1 2023-10-05T11:42:19.691 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.688+0000 7fb7d1f33880 20 remove_watcher() i=2 2023-10-05T11:42:19.693 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.689+0000 7fb7d1f33880 20 remove_watcher() i=3 2023-10-05T11:42:19.694 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.691+0000 7fb7d1f33880 20 remove_watcher() i=4 2023-10-05T11:42:19.695 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.692+0000 7fb7d1f33880 20 remove_watcher() i=5 2023-10-05T11:42:19.696 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.693+0000 7fb7d1f33880 20 remove_watcher() i=6 2023-10-05T11:42:19.697 INFO:tasks.workunit.client.0.smithi012.stderr:2023-10-05T11:42:19.694+0000 7fb7d1f33880 20 remove_watcher() i=7 2023-10-05T11:42:19.702 INFO:tasks.workunit.client.0.smithi012.stderr:{'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}} 2023-10-05T11:42:19.702 INFO:tasks.workunit.client.0.smithi012.stderr:Deleting bucket a-bucket 2023-10-05T11:42:19.769 INFO:tasks.workunit.client.0.smithi012.stderr:Deleting bucket myver 2023-10-05T11:42:19.996 INFO:tasks.workunit.client.0.smithi012.stderr:Completed resharding tests 2023-10-05T11:42:19.997 INFO:tasks.workunit.client.0.smithi012.stdout:connected to http://localhost:80 2023-10-05T11:42:20.060 INFO:tasks.workunit.client.0.smithi012.stderr:+ deactivate 2023-10-05T11:42:20.060 INFO:tasks.workunit.client.0.smithi012.stderr:+ '[' -n /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin ']' 2023-10-05T11:42:20.060 INFO:tasks.workunit.client.0.smithi012.stderr:+ PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2023-10-05T11:42:20.060 INFO:tasks.workunit.client.0.smithi012.stderr:+ export PATH 2023-10-05T11:42:20.060 INFO:tasks.workunit.client.0.smithi012.stderr:+ unset _OLD_VIRTUAL_PATH 2023-10-05T11:42:20.060 INFO:tasks.workunit.client.0.smithi012.stderr:+ '[' -n '' ']' 2023-10-05T11:42:20.060 INFO:tasks.workunit.client.0.smithi012.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2023-10-05T11:42:20.061 INFO:tasks.workunit.client.0.smithi012.stderr:+ hash -r 2023-10-05T11:42:20.061 INFO:tasks.workunit.client.0.smithi012.stderr:+ '[' -n '' ']' 2023-10-05T11:42:20.061 INFO:tasks.workunit.client.0.smithi012.stderr:+ unset VIRTUAL_ENV 2023-10-05T11:42:20.061 INFO:tasks.workunit.client.0.smithi012.stderr:+ '[' '!' '' = nondestructive ']' 2023-10-05T11:42:20.061 INFO:tasks.workunit.client.0.smithi012.stderr:+ unset -f deactivate 2023-10-05T11:42:20.061 INFO:tasks.workunit.client.0.smithi012.stderr:+ echo OK. 2023-10-05T11:42:20.062 INFO:tasks.workunit.client.0.smithi012.stdout:OK. 2023-10-05T11:42:20.062 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-10-05T11:42:20.062 DEBUG:teuthology.orchestra.run.smithi012:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-10-05T11:42:20.133 INFO:tasks.workunit:Stopping ['rgw/run-reshard.sh'] on client.0... 2023-10-05T11:42:20.134 DEBUG:teuthology.orchestra.run.smithi012:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2023-10-05T11:42:20.543 DEBUG:teuthology.parallel:result is None 2023-10-05T11:42:20.543 DEBUG:teuthology.orchestra.run.smithi012:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2023-10-05T11:42:20.573 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2023-10-05T11:42:20.574 DEBUG:teuthology.orchestra.run.smithi012:> rmdir -- /home/ubuntu/cephtest/mnt.0 2023-10-05T11:42:20.629 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2023-10-05T11:42:20.629 INFO:teuthology.run_tasks:Running task s3tests-java... 2023-10-05T11:42:20.643 DEBUG:tasks.s3tests_java:S3 Tests Java: __INIT__ 2023-10-05T11:42:20.643 DEBUG:tasks.s3tests_java:S3 Tests Java: SETUP 2023-10-05T11:42:20.643 INFO:tasks.s3tests_java:S3 Tests Java: Downloading test suite... 2023-10-05T11:42:20.644 DEBUG:teuthology.orchestra.run.smithi012:> git clone -b ceph-master https://github.com/ceph/java_s3tests.git /home/ubuntu/cephtest/s3-tests-java 2023-10-05T11:42:20.684 INFO:teuthology.orchestra.run.smithi012.stderr:Cloning into '/home/ubuntu/cephtest/s3-tests-java'... 2023-10-05T11:42:25.473 INFO:tasks.s3tests_java:S3 Tests Java: Installing required packages... 2023-10-05T11:42:25.474 DEBUG:teuthology.orchestra.run.smithi012:> /home/ubuntu/cephtest/s3-tests-java/bootstrap.sh 2023-10-05T11:42:28.386 INFO:teuthology.orchestra.run.smithi012.stderr:/home/ubuntu/cephtest/s3-tests-java/bootstrap.sh: missing required RPM packages. Installing via sudo. 2023-10-05T11:42:28.973 INFO:teuthology.orchestra.run.smithi012.stdout:Last metadata expiration check: 0:16:18 ago on Thu 05 Oct 2023 11:26:10 AM UTC. 2023-10-05T11:42:29.277 INFO:teuthology.orchestra.run.smithi012.stderr:Modular dependency problems: 2023-10-05T11:42:29.277 INFO:teuthology.orchestra.run.smithi012.stderr: 2023-10-05T11:42:29.277 INFO:teuthology.orchestra.run.smithi012.stderr: Problem 1: conflicting requests 2023-10-05T11:42:29.277 INFO:teuthology.orchestra.run.smithi012.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820230825121312:20125149.x86_64 from CentOS-AppStream 2023-10-05T11:42:29.277 INFO:teuthology.orchestra.run.smithi012.stderr: Problem 2: conflicting requests 2023-10-05T11:42:29.277 INFO:teuthology.orchestra.run.smithi012.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2023-10-05T11:42:29.277 INFO:teuthology.orchestra.run.smithi012.stderr: Problem 3: conflicting requests 2023-10-05T11:42:29.277 INFO:teuthology.orchestra.run.smithi012.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2023-10-05T11:42:29.277 INFO:teuthology.orchestra.run.smithi012.stderr: Problem 4: conflicting requests 2023-10-05T11:42:29.278 INFO:teuthology.orchestra.run.smithi012.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2023-10-05T11:42:29.278 INFO:teuthology.orchestra.run.smithi012.stderr: Problem 5: conflicting requests 2023-10-05T11:42:29.278 INFO:teuthology.orchestra.run.smithi012.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820230817143732:b754926a.x86_64 from CentOS-AppStream 2023-10-05T11:42:29.278 INFO:teuthology.orchestra.run.smithi012.stderr: Problem 6: conflicting requests 2023-10-05T11:42:29.278 INFO:teuthology.orchestra.run.smithi012.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2023-10-05T11:42:29.278 INFO:teuthology.orchestra.run.smithi012.stderr: Problem 7: conflicting requests 2023-10-05T11:42:29.278 INFO:teuthology.orchestra.run.smithi012.stderr: - nothing provides module(platform:el8) needed by module idm:client:820230831144315:49cc9d1b.x86_64 from CentOS-AppStream 2023-10-05T11:42:29.278 INFO:teuthology.orchestra.run.smithi012.stderr: Problem 8: conflicting requests 2023-10-05T11:42:29.278 INFO:teuthology.orchestra.run.smithi012.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2023-10-05T11:42:29.278 INFO:teuthology.orchestra.run.smithi012.stderr: Problem 9: conflicting requests 2023-10-05T11:42:29.279 INFO:teuthology.orchestra.run.smithi012.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2023-10-05T11:42:29.279 INFO:teuthology.orchestra.run.smithi012.stderr: Problem 10: conflicting requests 2023-10-05T11:42:29.279 INFO:teuthology.orchestra.run.smithi012.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820230803191529:9edba152.x86_64 from CentOS-AppStream 2023-10-05T11:42:29.279 INFO:teuthology.orchestra.run.smithi012.stderr: Problem 11: conflicting requests 2023-10-05T11:42:29.279 INFO:teuthology.orchestra.run.smithi012.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2023-10-05T11:42:29.279 INFO:teuthology.orchestra.run.smithi012.stderr: Problem 12: conflicting requests 2023-10-05T11:42:29.279 INFO:teuthology.orchestra.run.smithi012.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:8050020210527144100:fd901a62.x86_64 from CentOS-AppStream 2023-10-05T11:42:29.279 INFO:teuthology.orchestra.run.smithi012.stderr: Problem 13: conflicting requests 2023-10-05T11:42:29.279 INFO:teuthology.orchestra.run.smithi012.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2023-10-05T11:42:29.279 INFO:teuthology.orchestra.run.smithi012.stderr: Problem 14: conflicting requests 2023-10-05T11:42:29.279 INFO:teuthology.orchestra.run.smithi012.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2023-10-05T11:42:29.279 INFO:teuthology.orchestra.run.smithi012.stderr: Problem 15: conflicting requests 2023-10-05T11:42:29.280 INFO:teuthology.orchestra.run.smithi012.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2023-10-05T11:42:29.280 INFO:teuthology.orchestra.run.smithi012.stderr: Problem 16: conflicting requests 2023-10-05T11:42:29.280 INFO:teuthology.orchestra.run.smithi012.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2023-10-05T11:42:29.280 INFO:teuthology.orchestra.run.smithi012.stderr: Problem 17: conflicting requests 2023-10-05T11:42:29.280 INFO:teuthology.orchestra.run.smithi012.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2023-10-05T11:42:29.280 INFO:teuthology.orchestra.run.smithi012.stderr: Problem 18: conflicting requests 2023-10-05T11:42:29.280 INFO:teuthology.orchestra.run.smithi012.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2023-10-05T11:42:29.280 INFO:teuthology.orchestra.run.smithi012.stderr: Problem 19: conflicting requests 2023-10-05T11:42:29.280 INFO:teuthology.orchestra.run.smithi012.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2023-10-05T11:42:29.280 INFO:teuthology.orchestra.run.smithi012.stderr: Problem 20: conflicting requests 2023-10-05T11:42:29.280 INFO:teuthology.orchestra.run.smithi012.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2023-10-05T11:42:29.280 INFO:teuthology.orchestra.run.smithi012.stderr: Problem 21: conflicting requests 2023-10-05T11:42:29.281 INFO:teuthology.orchestra.run.smithi012.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2023-10-05T11:42:29.281 INFO:teuthology.orchestra.run.smithi012.stderr: Problem 22: conflicting requests 2023-10-05T11:42:29.281 INFO:teuthology.orchestra.run.smithi012.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230720113118:9edba152.x86_64 from CentOS-AppStream 2023-10-05T11:42:29.281 INFO:teuthology.orchestra.run.smithi012.stderr: Problem 23: conflicting requests 2023-10-05T11:42:29.281 INFO:teuthology.orchestra.run.smithi012.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820230724122240:182f7c73.x86_64 from CentOS-AppStream 2023-10-05T11:42:29.281 INFO:teuthology.orchestra.run.smithi012.stderr: Problem 24: conflicting requests 2023-10-05T11:42:29.281 INFO:teuthology.orchestra.run.smithi012.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2023-10-05T11:42:29.281 INFO:teuthology.orchestra.run.smithi012.stderr: Problem 25: conflicting requests 2023-10-05T11:42:29.281 INFO:teuthology.orchestra.run.smithi012.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2023-10-05T11:42:29.281 INFO:teuthology.orchestra.run.smithi012.stderr: Problem 26: conflicting requests 2023-10-05T11:42:29.281 INFO:teuthology.orchestra.run.smithi012.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820230810143808:17377f89.x86_64 from CentOS-AppStream 2023-10-05T11:42:29.281 INFO:teuthology.orchestra.run.smithi012.stderr: Problem 27: conflicting requests 2023-10-05T11:42:29.281 INFO:teuthology.orchestra.run.smithi012.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2023-10-05T11:42:29.282 INFO:teuthology.orchestra.run.smithi012.stderr: Problem 28: conflicting requests 2023-10-05T11:42:29.282 INFO:teuthology.orchestra.run.smithi012.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2023-10-05T11:42:29.282 INFO:teuthology.orchestra.run.smithi012.stderr: Problem 29: conflicting requests 2023-10-05T11:42:29.282 INFO:teuthology.orchestra.run.smithi012.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2023-10-05T11:42:29.282 INFO:teuthology.orchestra.run.smithi012.stderr: Problem 30: conflicting requests 2023-10-05T11:42:29.282 INFO:teuthology.orchestra.run.smithi012.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820230814191405:b09eea91.x86_64 from CentOS-AppStream 2023-10-05T11:42:29.282 INFO:teuthology.orchestra.run.smithi012.stderr: Problem 31: conflicting requests 2023-10-05T11:42:29.282 INFO:teuthology.orchestra.run.smithi012.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2023-10-05T11:42:29.282 INFO:teuthology.orchestra.run.smithi012.stderr: Problem 32: conflicting requests 2023-10-05T11:42:29.282 INFO:teuthology.orchestra.run.smithi012.stderr: - nothing provides module(platform:el8) needed by module squid:4:8080020221220134440:fd72936b.x86_64 from CentOS-AppStream 2023-10-05T11:42:29.282 INFO:teuthology.orchestra.run.smithi012.stderr: Problem 33: conflicting requests 2023-10-05T11:42:29.282 INFO:teuthology.orchestra.run.smithi012.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2023-10-05T11:42:29.283 INFO:teuthology.orchestra.run.smithi012.stderr: Problem 34: conflicting requests 2023-10-05T11:42:29.283 INFO:teuthology.orchestra.run.smithi012.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2023-10-05T11:42:29.283 INFO:teuthology.orchestra.run.smithi012.stderr: Problem 35: conflicting requests 2023-10-05T11:42:29.283 INFO:teuthology.orchestra.run.smithi012.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2023-10-05T11:42:29.283 INFO:teuthology.orchestra.run.smithi012.stderr: Problem 36: conflicting requests 2023-10-05T11:42:29.283 INFO:teuthology.orchestra.run.smithi012.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820230907101217:9edba152.x86_64 from CentOS-AppStream 2023-10-05T11:42:29.283 INFO:teuthology.orchestra.run.smithi012.stderr: Problem 37: conflicting requests 2023-10-05T11:42:29.283 INFO:teuthology.orchestra.run.smithi012.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2023-10-05T11:42:29.283 INFO:teuthology.orchestra.run.smithi012.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2023-10-05T11:42:29.283 INFO:teuthology.orchestra.run.smithi012.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2023-10-05T11:42:29.283 INFO:teuthology.orchestra.run.smithi012.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:5e136183.x86_64 from CentOS-AppStream 2023-10-05T11:42:29.283 INFO:teuthology.orchestra.run.smithi012.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:d4f97118.x86_64 from CentOS-AppStream 2023-10-05T11:42:29.284 INFO:teuthology.orchestra.run.smithi012.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:e63f0836.x86_64 from CentOS-AppStream 2023-10-05T11:42:29.284 INFO:teuthology.orchestra.run.smithi012.stderr: Problem 38: cannot install the best candidate for the job 2023-10-05T11:42:29.284 INFO:teuthology.orchestra.run.smithi012.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2023-10-05T11:42:29.284 INFO:teuthology.orchestra.run.smithi012.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2023-10-05T11:42:29.284 INFO:teuthology.orchestra.run.smithi012.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2023-10-05T11:42:29.284 INFO:teuthology.orchestra.run.smithi012.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2023-10-05T11:42:29.284 INFO:teuthology.orchestra.run.smithi012.stderr: Problem 39: conflicting requests 2023-10-05T11:42:29.284 INFO:teuthology.orchestra.run.smithi012.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2023-10-05T11:42:29.284 INFO:teuthology.orchestra.run.smithi012.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2023-10-05T11:42:29.284 INFO:teuthology.orchestra.run.smithi012.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2023-10-05T11:42:29.284 INFO:teuthology.orchestra.run.smithi012.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2023-10-05T11:42:29.284 INFO:teuthology.orchestra.run.smithi012.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2023-10-05T11:42:29.285 INFO:teuthology.orchestra.run.smithi012.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2023-10-05T11:42:29.285 INFO:teuthology.orchestra.run.smithi012.stderr: Problem 40: cannot install the best candidate for the job 2023-10-05T11:42:29.285 INFO:teuthology.orchestra.run.smithi012.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2023-10-05T11:42:29.285 INFO:teuthology.orchestra.run.smithi012.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2023-10-05T11:42:29.285 INFO:teuthology.orchestra.run.smithi012.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2023-10-05T11:42:29.285 INFO:teuthology.orchestra.run.smithi012.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2023-10-05T11:42:29.285 INFO:teuthology.orchestra.run.smithi012.stderr: Problem 41: cannot install the best candidate for the job 2023-10-05T11:42:29.285 INFO:teuthology.orchestra.run.smithi012.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2023-10-05T11:42:29.285 INFO:teuthology.orchestra.run.smithi012.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2023-10-05T11:42:29.285 INFO:teuthology.orchestra.run.smithi012.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2023-10-05T11:42:29.285 INFO:teuthology.orchestra.run.smithi012.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2023-10-05T11:42:29.286 INFO:teuthology.orchestra.run.smithi012.stderr: Problem 42: cannot install the best candidate for the job 2023-10-05T11:42:29.286 INFO:teuthology.orchestra.run.smithi012.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2023-10-05T11:42:29.286 INFO:teuthology.orchestra.run.smithi012.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2023-10-05T11:42:29.286 INFO:teuthology.orchestra.run.smithi012.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2023-10-05T11:42:29.286 INFO:teuthology.orchestra.run.smithi012.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2023-10-05T11:42:29.286 INFO:teuthology.orchestra.run.smithi012.stderr: Problem 43: cannot install the best candidate for the job 2023-10-05T11:42:29.286 INFO:teuthology.orchestra.run.smithi012.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2023-10-05T11:42:29.286 INFO:teuthology.orchestra.run.smithi012.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2023-10-05T11:42:29.286 INFO:teuthology.orchestra.run.smithi012.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2023-10-05T11:42:29.286 INFO:teuthology.orchestra.run.smithi012.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2023-10-05T11:42:29.286 INFO:teuthology.orchestra.run.smithi012.stderr: Problem 44: cannot install the best candidate for the job 2023-10-05T11:42:29.287 INFO:teuthology.orchestra.run.smithi012.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2023-10-05T11:42:29.287 INFO:teuthology.orchestra.run.smithi012.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2023-10-05T11:42:29.287 INFO:teuthology.orchestra.run.smithi012.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2023-10-05T11:42:29.287 INFO:teuthology.orchestra.run.smithi012.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2023-10-05T11:42:29.287 INFO:teuthology.orchestra.run.smithi012.stderr: Problem 45: cannot install the best candidate for the job 2023-10-05T11:42:29.287 INFO:teuthology.orchestra.run.smithi012.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2023-10-05T11:42:29.287 INFO:teuthology.orchestra.run.smithi012.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2023-10-05T11:42:29.287 INFO:teuthology.orchestra.run.smithi012.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2023-10-05T11:42:29.287 INFO:teuthology.orchestra.run.smithi012.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2023-10-05T11:42:29.366 INFO:teuthology.orchestra.run.smithi012.stdout:Dependencies resolved. 2023-10-05T11:42:29.375 INFO:teuthology.orchestra.run.smithi012.stdout:======================================================================================================== 2023-10-05T11:42:29.375 INFO:teuthology.orchestra.run.smithi012.stdout: Package Arch Version Repository Size 2023-10-05T11:42:29.375 INFO:teuthology.orchestra.run.smithi012.stdout:======================================================================================================== 2023-10-05T11:42:29.375 INFO:teuthology.orchestra.run.smithi012.stdout:Installing: 2023-10-05T11:42:29.375 INFO:teuthology.orchestra.run.smithi012.stdout: java-1.8.0-openjdk x86_64 1:1.8.0.362.b09-4.el9 appstream 426 k 2023-10-05T11:42:29.375 INFO:teuthology.orchestra.run.smithi012.stdout: java-1.8.0-openjdk-devel x86_64 1:1.8.0.362.b09-4.el9 appstream 9.3 M 2023-10-05T11:42:29.375 INFO:teuthology.orchestra.run.smithi012.stdout:Installing dependencies: 2023-10-05T11:42:29.375 INFO:teuthology.orchestra.run.smithi012.stdout: ModemManager-glib x86_64 1.20.2-1.el9 baseos 335 k 2023-10-05T11:42:29.375 INFO:teuthology.orchestra.run.smithi012.stdout: adwaita-cursor-theme noarch 40.1.1-3.el9 appstream 650 k 2023-10-05T11:42:29.376 INFO:teuthology.orchestra.run.smithi012.stdout: adwaita-icon-theme noarch 40.1.1-3.el9 appstream 12 M 2023-10-05T11:42:29.376 INFO:teuthology.orchestra.run.smithi012.stdout: alsa-lib x86_64 1.2.9-1.el9 appstream 518 k 2023-10-05T11:42:29.376 INFO:teuthology.orchestra.run.smithi012.stdout: at-spi2-atk x86_64 2.38.0-4.el9 appstream 87 k 2023-10-05T11:42:29.376 INFO:teuthology.orchestra.run.smithi012.stdout: at-spi2-core x86_64 2.40.3-1.el9 appstream 195 k 2023-10-05T11:42:29.376 INFO:teuthology.orchestra.run.smithi012.stdout: atk x86_64 2.36.0-5.el9 appstream 292 k 2023-10-05T11:42:29.376 INFO:teuthology.orchestra.run.smithi012.stdout: avahi-glib x86_64 0.8-12.el9 appstream 15 k 2023-10-05T11:42:29.376 INFO:teuthology.orchestra.run.smithi012.stdout: bluez-libs x86_64 5.63-1.el8 CentOS-BaseOS 113 k 2023-10-05T11:42:29.376 INFO:teuthology.orchestra.run.smithi012.stdout: bubblewrap x86_64 0.4.1-6.el9 baseos 50 k 2023-10-05T11:42:29.376 INFO:teuthology.orchestra.run.smithi012.stdout: colord-libs x86_64 1.4.5-4.el9 appstream 229 k 2023-10-05T11:42:29.376 INFO:teuthology.orchestra.run.smithi012.stdout: copy-jdk-configs noarch 4.0-3.el9 appstream 28 k 2023-10-05T11:42:29.376 INFO:teuthology.orchestra.run.smithi012.stdout: cups-libs x86_64 1:2.3.3op2-21.el9 baseos 263 k 2023-10-05T11:42:29.376 INFO:teuthology.orchestra.run.smithi012.stdout: exempi x86_64 2.6.0-0.2.20211007gite23c213.el9 appstream 525 k 2023-10-05T11:42:29.377 INFO:teuthology.orchestra.run.smithi012.stdout: exiv2-libs x86_64 0.27.5-2.el9 appstream 781 k 2023-10-05T11:42:29.377 INFO:teuthology.orchestra.run.smithi012.stdout: fdk-aac-free x86_64 2.0.0-8.el9 appstream 325 k 2023-10-05T11:42:29.377 INFO:teuthology.orchestra.run.smithi012.stdout: flac-libs x86_64 1.3.3-12.el9 appstream 218 k 2023-10-05T11:42:29.377 INFO:teuthology.orchestra.run.smithi012.stdout: flatpak-selinux noarch 1.12.8-1.el9 appstream 21 k 2023-10-05T11:42:29.377 INFO:teuthology.orchestra.run.smithi012.stdout: flatpak-session-helper x86_64 1.12.8-1.el9 appstream 74 k 2023-10-05T11:42:29.377 INFO:teuthology.orchestra.run.smithi012.stdout: gdk-pixbuf2-modules x86_64 2.42.6-3.el9 appstream 88 k 2023-10-05T11:42:29.377 INFO:teuthology.orchestra.run.smithi012.stdout: geoclue2 x86_64 2.6.0-7.el9 appstream 124 k 2023-10-05T11:42:29.377 INFO:teuthology.orchestra.run.smithi012.stdout: giflib x86_64 5.2.1-9.el9 appstream 49 k 2023-10-05T11:42:29.377 INFO:teuthology.orchestra.run.smithi012.stdout: graphene x86_64 1.10.6-2.el9 appstream 64 k 2023-10-05T11:42:29.377 INFO:teuthology.orchestra.run.smithi012.stdout: gsm x86_64 1.0.19-6.el9 appstream 34 k 2023-10-05T11:42:29.377 INFO:teuthology.orchestra.run.smithi012.stdout: gstreamer1 x86_64 1.22.1-2.el9 appstream 1.4 M 2023-10-05T11:42:29.378 INFO:teuthology.orchestra.run.smithi012.stdout: gstreamer1-plugins-base x86_64 1.22.1-1.el9 appstream 2.2 M 2023-10-05T11:42:29.378 INFO:teuthology.orchestra.run.smithi012.stdout: gtk-update-icon-cache x86_64 3.24.31-2.el9 appstream 35 k 2023-10-05T11:42:29.378 INFO:teuthology.orchestra.run.smithi012.stdout: gtk3 x86_64 3.24.31-2.el9 appstream 4.9 M 2023-10-05T11:42:29.378 INFO:teuthology.orchestra.run.smithi012.stdout: hicolor-icon-theme noarch 0.17-13.el9 appstream 219 k 2023-10-05T11:42:29.378 INFO:teuthology.orchestra.run.smithi012.stdout: iso-codes noarch 4.6.0-3.el9 appstream 3.5 M 2023-10-05T11:42:29.378 INFO:teuthology.orchestra.run.smithi012.stdout: java-1.8.0-openjdk-headless x86_64 1:1.8.0.362.b09-4.el9 appstream 32 M 2023-10-05T11:42:29.378 INFO:teuthology.orchestra.run.smithi012.stdout: javapackages-filesystem noarch 5.3.0-1.module_el8.0.0+11+5b8c10bd CentOS-AppStream 29 k 2023-10-05T11:42:29.378 INFO:teuthology.orchestra.run.smithi012.stdout: jbigkit-libs x86_64 2.1-23.el9 appstream 53 k 2023-10-05T11:42:29.378 INFO:teuthology.orchestra.run.smithi012.stdout: lcms2 x86_64 2.12-3.el9 appstream 168 k 2023-10-05T11:42:29.378 INFO:teuthology.orchestra.run.smithi012.stdout: libX11-xcb x86_64 1.7.0-8.el9 appstream 11 k 2023-10-05T11:42:29.378 INFO:teuthology.orchestra.run.smithi012.stdout: libXcomposite x86_64 0.4.5-7.el9 appstream 24 k 2023-10-05T11:42:29.379 INFO:teuthology.orchestra.run.smithi012.stdout: libXcursor x86_64 1.2.0-7.el9 appstream 31 k 2023-10-05T11:42:29.379 INFO:teuthology.orchestra.run.smithi012.stdout: libXdamage x86_64 1.1.5-7.el9 appstream 23 k 2023-10-05T11:42:29.379 INFO:teuthology.orchestra.run.smithi012.stdout: libXfixes x86_64 5.0.3-16.el9 appstream 20 k 2023-10-05T11:42:29.379 INFO:teuthology.orchestra.run.smithi012.stdout: libXi x86_64 1.7.10-8.el9 appstream 40 k 2023-10-05T11:42:29.379 INFO:teuthology.orchestra.run.smithi012.stdout: libXinerama x86_64 1.1.4-10.el9 appstream 15 k 2023-10-05T11:42:29.379 INFO:teuthology.orchestra.run.smithi012.stdout: libXrandr x86_64 1.5.2-8.el9 appstream 28 k 2023-10-05T11:42:29.379 INFO:teuthology.orchestra.run.smithi012.stdout: libXtst x86_64 1.2.3-16.el9 appstream 21 k 2023-10-05T11:42:29.379 INFO:teuthology.orchestra.run.smithi012.stdout: libXv x86_64 1.0.11-16.el9 appstream 19 k 2023-10-05T11:42:29.379 INFO:teuthology.orchestra.run.smithi012.stdout: libXxf86vm x86_64 1.1.4-18.el9 appstream 19 k 2023-10-05T11:42:29.379 INFO:teuthology.orchestra.run.smithi012.stdout: libasyncns x86_64 0.8-22.el9 appstream 30 k 2023-10-05T11:42:29.379 INFO:teuthology.orchestra.run.smithi012.stdout: libcanberra x86_64 0.30-27.el9 appstream 86 k 2023-10-05T11:42:29.379 INFO:teuthology.orchestra.run.smithi012.stdout: libcanberra-gtk3 x86_64 0.30-27.el9 appstream 32 k 2023-10-05T11:42:29.380 INFO:teuthology.orchestra.run.smithi012.stdout: libdrm x86_64 2.4.115-1.el9 appstream 160 k 2023-10-05T11:42:29.380 INFO:teuthology.orchestra.run.smithi012.stdout: libepoxy x86_64 1.5.8-1.el8 CentOS-AppStream 224 k 2023-10-05T11:42:29.380 INFO:teuthology.orchestra.run.smithi012.stdout: libexif x86_64 0.6.22-6.el9 appstream 435 k 2023-10-05T11:42:29.380 INFO:teuthology.orchestra.run.smithi012.stdout: libfontenc x86_64 1.1.3-17.el9 appstream 31 k 2023-10-05T11:42:29.380 INFO:teuthology.orchestra.run.smithi012.stdout: libgexiv2 x86_64 0.12.3-1.el9 appstream 83 k 2023-10-05T11:42:29.380 INFO:teuthology.orchestra.run.smithi012.stdout: libglvnd x86_64 1:1.3.4-1.el9 appstream 135 k 2023-10-05T11:42:29.380 INFO:teuthology.orchestra.run.smithi012.stdout: libglvnd-egl x86_64 1:1.3.4-1.el9 appstream 37 k 2023-10-05T11:42:29.380 INFO:teuthology.orchestra.run.smithi012.stdout: libglvnd-glx x86_64 1:1.3.4-1.el9 appstream 142 k 2023-10-05T11:42:29.380 INFO:teuthology.orchestra.run.smithi012.stdout: libgsf x86_64 1.14.47-5.el9 appstream 256 k 2023-10-05T11:42:29.380 INFO:teuthology.orchestra.run.smithi012.stdout: libgxps x86_64 0.3.2-3.el9 appstream 79 k 2023-10-05T11:42:29.380 INFO:teuthology.orchestra.run.smithi012.stdout: libiptcdata x86_64 1.0.5-9.el9 appstream 62 k 2023-10-05T11:42:29.380 INFO:teuthology.orchestra.run.smithi012.stdout: libldac x86_64 2.0.2.3-10.el9 appstream 41 k 2023-10-05T11:42:29.381 INFO:teuthology.orchestra.run.smithi012.stdout: libnotify x86_64 0.7.9-8.el9 appstream 44 k 2023-10-05T11:42:29.381 INFO:teuthology.orchestra.run.smithi012.stdout: libogg x86_64 2:1.3.4-6.el9 appstream 34 k 2023-10-05T11:42:29.381 INFO:teuthology.orchestra.run.smithi012.stdout: libosinfo x86_64 1.10.0-1.el9 appstream 319 k 2023-10-05T11:42:29.381 INFO:teuthology.orchestra.run.smithi012.stdout: libpciaccess x86_64 0.16-6.el9 baseos 28 k 2023-10-05T11:42:29.381 INFO:teuthology.orchestra.run.smithi012.stdout: libsbc x86_64 1.4-9.el9 appstream 45 k 2023-10-05T11:42:29.381 INFO:teuthology.orchestra.run.smithi012.stdout: libsndfile x86_64 1.0.31-7.el9 appstream 207 k 2023-10-05T11:42:29.381 INFO:teuthology.orchestra.run.smithi012.stdout: libtheora x86_64 1:1.1.1-31.el9 appstream 164 k 2023-10-05T11:42:29.381 INFO:teuthology.orchestra.run.smithi012.stdout: libtiff x86_64 4.4.0-10.el9 appstream 197 k 2023-10-05T11:42:29.381 INFO:teuthology.orchestra.run.smithi012.stdout: libtool-ltdl x86_64 2.4.6-45.el9 appstream 37 k 2023-10-05T11:42:29.381 INFO:teuthology.orchestra.run.smithi012.stdout: libtracker-sparql x86_64 3.1.2-3.el9 appstream 324 k 2023-10-05T11:42:29.381 INFO:teuthology.orchestra.run.smithi012.stdout: libvisual x86_64 1:0.4.0-34.el9 appstream 144 k 2023-10-05T11:42:29.382 INFO:teuthology.orchestra.run.smithi012.stdout: libvorbis x86_64 1:1.3.7-5.el9 appstream 193 k 2023-10-05T11:42:29.382 INFO:teuthology.orchestra.run.smithi012.stdout: libwayland-client x86_64 1.21.0-1.el9 appstream 33 k 2023-10-05T11:42:29.382 INFO:teuthology.orchestra.run.smithi012.stdout: libwayland-cursor x86_64 1.21.0-1.el9 appstream 19 k 2023-10-05T11:42:29.382 INFO:teuthology.orchestra.run.smithi012.stdout: libwayland-egl x86_64 1.21.0-1.el9 appstream 13 k 2023-10-05T11:42:29.382 INFO:teuthology.orchestra.run.smithi012.stdout: libwayland-server x86_64 1.21.0-1.el9 appstream 42 k 2023-10-05T11:42:29.382 INFO:teuthology.orchestra.run.smithi012.stdout: libwebp x86_64 1.2.0-8.el9 appstream 277 k 2023-10-05T11:42:29.382 INFO:teuthology.orchestra.run.smithi012.stdout: libxkbcommon x86_64 1.0.3-4.el9 appstream 133 k 2023-10-05T11:42:29.382 INFO:teuthology.orchestra.run.smithi012.stdout: libxshmfence x86_64 1.3-10.el9 appstream 13 k 2023-10-05T11:42:29.382 INFO:teuthology.orchestra.run.smithi012.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2023-10-05T11:42:29.382 INFO:teuthology.orchestra.run.smithi012.stdout: low-memory-monitor x86_64 2.1-4.el9 appstream 36 k 2023-10-05T11:42:29.382 INFO:teuthology.orchestra.run.smithi012.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2023-10-05T11:42:29.383 INFO:teuthology.orchestra.run.smithi012.stdout: lua-posix x86_64 35.0-8.el9 appstream 151 k 2023-10-05T11:42:29.383 INFO:teuthology.orchestra.run.smithi012.stdout: mesa-libEGL x86_64 23.1.4-1.el9 appstream 125 k 2023-10-05T11:42:29.383 INFO:teuthology.orchestra.run.smithi012.stdout: mesa-libGL x86_64 23.1.4-1.el9 appstream 166 k 2023-10-05T11:42:29.383 INFO:teuthology.orchestra.run.smithi012.stdout: mesa-libgbm x86_64 23.1.4-1.el9 appstream 38 k 2023-10-05T11:42:29.383 INFO:teuthology.orchestra.run.smithi012.stdout: mesa-libglapi x86_64 23.1.4-1.el9 appstream 47 k 2023-10-05T11:42:29.383 INFO:teuthology.orchestra.run.smithi012.stdout: mesa-vulkan-drivers x86_64 23.1.4-1.el9 appstream 9.2 M 2023-10-05T11:42:29.383 INFO:teuthology.orchestra.run.smithi012.stdout: mkfontscale x86_64 1.2.1-3.el9 appstream 32 k 2023-10-05T11:42:29.383 INFO:teuthology.orchestra.run.smithi012.stdout: openjpeg2 x86_64 2.4.0-7.el9 appstream 163 k 2023-10-05T11:42:29.383 INFO:teuthology.orchestra.run.smithi012.stdout: opus x86_64 1.3.1-10.el9 appstream 200 k 2023-10-05T11:42:29.383 INFO:teuthology.orchestra.run.smithi012.stdout: orc x86_64 0.4.31-6.el9 appstream 184 k 2023-10-05T11:42:29.383 INFO:teuthology.orchestra.run.smithi012.stdout: osinfo-db noarch 20230518-1.el9 appstream 503 k 2023-10-05T11:42:29.384 INFO:teuthology.orchestra.run.smithi012.stdout: osinfo-db-tools x86_64 1.10.0-1.el9 appstream 74 k 2023-10-05T11:42:29.384 INFO:teuthology.orchestra.run.smithi012.stdout: ostree-libs x86_64 2023.6-1.el9 appstream 471 k 2023-10-05T11:42:29.384 INFO:teuthology.orchestra.run.smithi012.stdout: pipewire-libs x86_64 0.3.67-2.el9 appstream 1.7 M 2023-10-05T11:42:29.384 INFO:teuthology.orchestra.run.smithi012.stdout: poppler x86_64 21.01.0-18.el9 appstream 1.1 M 2023-10-05T11:42:29.384 INFO:teuthology.orchestra.run.smithi012.stdout: poppler-data noarch 0.4.9-9.el9 appstream 1.9 M 2023-10-05T11:42:29.384 INFO:teuthology.orchestra.run.smithi012.stdout: poppler-glib x86_64 21.01.0-18.el9 appstream 152 k 2023-10-05T11:42:29.384 INFO:teuthology.orchestra.run.smithi012.stdout: pulseaudio-libs x86_64 15.0-2.el9 appstream 679 k 2023-10-05T11:42:29.384 INFO:teuthology.orchestra.run.smithi012.stdout: pulseaudio-utils x86_64 15.0-2.el9 appstream 76 k 2023-10-05T11:42:29.384 INFO:teuthology.orchestra.run.smithi012.stdout: rtkit x86_64 0.11-28.el9 appstream 56 k 2023-10-05T11:42:29.384 INFO:teuthology.orchestra.run.smithi012.stdout: sound-theme-freedesktop noarch 0.8-17.el9 appstream 383 k 2023-10-05T11:42:29.385 INFO:teuthology.orchestra.run.smithi012.stdout: totem-pl-parser x86_64 3.26.6-2.el9 appstream 152 k 2023-10-05T11:42:29.385 INFO:teuthology.orchestra.run.smithi012.stdout: tracker x86_64 3.1.2-3.el9 appstream 555 k 2023-10-05T11:42:29.385 INFO:teuthology.orchestra.run.smithi012.stdout: ttmkfdir x86_64 3.0.9-65.el9 appstream 53 k 2023-10-05T11:42:29.385 INFO:teuthology.orchestra.run.smithi012.stdout: tzdata-java noarch 2023c-1.el9 appstream 230 k 2023-10-05T11:42:29.385 INFO:teuthology.orchestra.run.smithi012.stdout: upower x86_64 0.99.11-11.el9 appstream 173 k 2023-10-05T11:42:29.385 INFO:teuthology.orchestra.run.smithi012.stdout: vulkan-loader x86_64 1.3.250.1-1.el9 appstream 141 k 2023-10-05T11:42:29.385 INFO:teuthology.orchestra.run.smithi012.stdout: webrtc-audio-processing x86_64 0.3.1-8.el9 appstream 306 k 2023-10-05T11:42:29.385 INFO:teuthology.orchestra.run.smithi012.stdout: wireplumber x86_64 0.4.14-1.el9 appstream 96 k 2023-10-05T11:42:29.385 INFO:teuthology.orchestra.run.smithi012.stdout: wireplumber-libs x86_64 0.4.14-1.el9 appstream 358 k 2023-10-05T11:42:29.385 INFO:teuthology.orchestra.run.smithi012.stdout: xdg-dbus-proxy x86_64 0.1.3-1.el9 appstream 42 k 2023-10-05T11:42:29.385 INFO:teuthology.orchestra.run.smithi012.stdout: xdg-desktop-portal x86_64 1.12.4-1.el9 appstream 383 k 2023-10-05T11:42:29.385 INFO:teuthology.orchestra.run.smithi012.stdout: xkeyboard-config noarch 2.33-2.el9 appstream 859 k 2023-10-05T11:42:29.386 INFO:teuthology.orchestra.run.smithi012.stdout: xorg-x11-fonts-Type1 noarch 7.5-33.el9 appstream 505 k 2023-10-05T11:42:29.386 INFO:teuthology.orchestra.run.smithi012.stdout:Installing weak dependencies: 2023-10-05T11:42:29.386 INFO:teuthology.orchestra.run.smithi012.stdout: dconf x86_64 0.40.0-6.el9 appstream 113 k 2023-10-05T11:42:29.386 INFO:teuthology.orchestra.run.smithi012.stdout: exiv2 x86_64 0.27.5-2.el9 appstream 980 k 2023-10-05T11:42:29.386 INFO:teuthology.orchestra.run.smithi012.stdout: flatpak x86_64 1.12.8-1.el9 appstream 1.7 M 2023-10-05T11:42:29.386 INFO:teuthology.orchestra.run.smithi012.stdout: gtk2 x86_64 2.24.33-8.el9 appstream 3.5 M 2023-10-05T11:42:29.386 INFO:teuthology.orchestra.run.smithi012.stdout: libcanberra-gtk2 x86_64 0.30-27.el9 appstream 26 k 2023-10-05T11:42:29.386 INFO:teuthology.orchestra.run.smithi012.stdout: p11-kit-server x86_64 0.24.1-2.el9 appstream 199 k 2023-10-05T11:42:29.386 INFO:teuthology.orchestra.run.smithi012.stdout: pipewire x86_64 0.3.67-2.el9 appstream 87 k 2023-10-05T11:42:29.386 INFO:teuthology.orchestra.run.smithi012.stdout: pipewire-alsa x86_64 0.3.67-2.el9 appstream 56 k 2023-10-05T11:42:29.387 INFO:teuthology.orchestra.run.smithi012.stdout: pipewire-jack-audio-connection-kit x86_64 0.3.67-2.el9 appstream 127 k 2023-10-05T11:42:29.387 INFO:teuthology.orchestra.run.smithi012.stdout: pipewire-pulseaudio x86_64 0.3.67-2.el9 appstream 19 k 2023-10-05T11:42:29.387 INFO:teuthology.orchestra.run.smithi012.stdout: tracker-miners x86_64 3.1.2-3.el9 appstream 939 k 2023-10-05T11:42:29.387 INFO:teuthology.orchestra.run.smithi012.stdout: xdg-desktop-portal-gtk x86_64 1.12.0-3.el9 appstream 134 k 2023-10-05T11:42:29.387 INFO:teuthology.orchestra.run.smithi012.stdout:Enabling module streams: 2023-10-05T11:42:29.387 INFO:teuthology.orchestra.run.smithi012.stdout: javapackages-runtime 201801 2023-10-05T11:42:29.387 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:42:29.387 INFO:teuthology.orchestra.run.smithi012.stdout:Transaction Summary 2023-10-05T11:42:29.387 INFO:teuthology.orchestra.run.smithi012.stdout:======================================================================================================== 2023-10-05T11:42:29.387 INFO:teuthology.orchestra.run.smithi012.stdout:Install 130 Packages 2023-10-05T11:42:29.387 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:42:29.388 INFO:teuthology.orchestra.run.smithi012.stdout:Total download size: 105 M 2023-10-05T11:42:29.388 INFO:teuthology.orchestra.run.smithi012.stdout:Installed size: 379 M 2023-10-05T11:42:29.388 INFO:teuthology.orchestra.run.smithi012.stdout:Downloading Packages: 2023-10-05T11:42:29.941 INFO:teuthology.orchestra.run.smithi012.stdout:(1/130): bluez-libs-5.63-1.el8.x86_64.rpm 397 kB/s | 113 kB 00:00 2023-10-05T11:42:29.966 INFO:teuthology.orchestra.run.smithi012.stdout:(2/130): javapackages-filesystem-5.3.0-1.module 94 kB/s | 29 kB 00:00 2023-10-05T11:42:29.992 INFO:teuthology.orchestra.run.smithi012.stdout:(3/130): libepoxy-1.5.8-1.el8.x86_64.rpm 667 kB/s | 224 kB 00:00 2023-10-05T11:42:30.784 INFO:teuthology.orchestra.run.smithi012.stdout:(4/130): bubblewrap-0.4.1-6.el9.x86_64.rpm 61 kB/s | 50 kB 00:00 2023-10-05T11:42:31.117 INFO:teuthology.orchestra.run.smithi012.stdout:(5/130): cups-libs-2.3.3op2-21.el9.x86_64.rpm 234 kB/s | 263 kB 00:01 2023-10-05T11:42:31.176 INFO:teuthology.orchestra.run.smithi012.stdout:(6/130): ModemManager-glib-1.20.2-1.el9.x86_64. 271 kB/s | 335 kB 00:01 2023-10-05T11:42:31.476 INFO:teuthology.orchestra.run.smithi012.stdout:(7/130): libpciaccess-0.16-6.el9.x86_64.rpm 40 kB/s | 28 kB 00:00 2023-10-05T11:42:31.926 INFO:teuthology.orchestra.run.smithi012.stdout:(8/130): lksctp-tools-1.0.19-2.el9.x86_64.rpm 116 kB/s | 94 kB 00:00 2023-10-05T11:42:32.060 INFO:teuthology.orchestra.run.smithi012.stdout:(9/130): adwaita-cursor-theme-40.1.1-3.el9.noar 736 kB/s | 650 kB 00:00 2023-10-05T11:42:32.310 INFO:teuthology.orchestra.run.smithi012.stdout:(10/130): at-spi2-atk-2.38.0-4.el9.x86_64.rpm 348 kB/s | 87 kB 00:00 2023-10-05T11:42:32.652 INFO:teuthology.orchestra.run.smithi012.stdout:(11/130): adwaita-icon-theme-40.1.1-3.el9.noarc 10 MB/s | 12 MB 00:01 2023-10-05T11:42:32.669 INFO:teuthology.orchestra.run.smithi012.stdout:(12/130): at-spi2-core-2.40.3-1.el9.x86_64.rpm 544 kB/s | 195 kB 00:00 2023-10-05T11:42:32.694 INFO:teuthology.orchestra.run.smithi012.stdout:(13/130): alsa-lib-1.2.9-1.el9.x86_64.rpm 676 kB/s | 518 kB 00:00 2023-10-05T11:42:32.770 INFO:teuthology.orchestra.run.smithi012.stdout:(14/130): atk-2.36.0-5.el9.x86_64.rpm 2.4 MB/s | 292 kB 00:00 2023-10-05T11:42:32.795 INFO:teuthology.orchestra.run.smithi012.stdout:(15/130): avahi-glib-0.8-12.el9.x86_64.rpm 118 kB/s | 15 kB 00:00 2023-10-05T11:42:32.820 INFO:teuthology.orchestra.run.smithi012.stdout:(16/130): colord-libs-1.4.5-4.el9.x86_64.rpm 1.8 MB/s | 229 kB 00:00 2023-10-05T11:42:32.887 INFO:teuthology.orchestra.run.smithi012.stdout:(17/130): copy-jdk-configs-4.0-3.el9.noarch.rpm 241 kB/s | 28 kB 00:00 2023-10-05T11:42:32.912 INFO:teuthology.orchestra.run.smithi012.stdout:(18/130): dconf-0.40.0-6.el9.x86_64.rpm 966 kB/s | 113 kB 00:00 2023-10-05T11:42:32.946 INFO:teuthology.orchestra.run.smithi012.stdout:(19/130): exempi-2.6.0-0.2.20211007gite23c213.e 4.1 MB/s | 525 kB 00:00 2023-10-05T11:42:33.030 INFO:teuthology.orchestra.run.smithi012.stdout:(20/130): exiv2-0.27.5-2.el9.x86_64.rpm 6.7 MB/s | 980 kB 00:00 2023-10-05T11:42:33.072 INFO:teuthology.orchestra.run.smithi012.stdout:(21/130): exiv2-libs-0.27.5-2.el9.x86_64.rpm 4.8 MB/s | 781 kB 00:00 2023-10-05T11:42:33.097 INFO:teuthology.orchestra.run.smithi012.stdout:(22/130): fdk-aac-free-2.0.0-8.el9.x86_64.rpm 2.1 MB/s | 325 kB 00:00 2023-10-05T11:42:33.147 INFO:teuthology.orchestra.run.smithi012.stdout:(23/130): flac-libs-1.3.3-12.el9.x86_64.rpm 1.8 MB/s | 218 kB 00:00 2023-10-05T11:42:33.223 INFO:teuthology.orchestra.run.smithi012.stdout:(24/130): flatpak-1.12.8-1.el9.x86_64.rpm 11 MB/s | 1.7 MB 00:00 2023-10-05T11:42:33.248 INFO:teuthology.orchestra.run.smithi012.stdout:(25/130): flatpak-selinux-1.12.8-1.el9.noarch.r 142 kB/s | 21 kB 00:00 2023-10-05T11:42:33.273 INFO:teuthology.orchestra.run.smithi012.stdout:(26/130): flatpak-session-helper-1.12.8-1.el9.x 588 kB/s | 74 kB 00:00 2023-10-05T11:42:33.340 INFO:teuthology.orchestra.run.smithi012.stdout:(27/130): gdk-pixbuf2-modules-2.42.6-3.el9.x86_ 757 kB/s | 88 kB 00:00 2023-10-05T11:42:33.374 INFO:teuthology.orchestra.run.smithi012.stdout:(28/130): geoclue2-2.6.0-7.el9.x86_64.rpm 993 kB/s | 124 kB 00:00 2023-10-05T11:42:33.399 INFO:teuthology.orchestra.run.smithi012.stdout:(29/130): giflib-5.2.1-9.el9.x86_64.rpm 386 kB/s | 49 kB 00:00 2023-10-05T11:42:33.466 INFO:teuthology.orchestra.run.smithi012.stdout:(30/130): graphene-1.10.6-2.el9.x86_64.rpm 513 kB/s | 64 kB 00:00 2023-10-05T11:42:33.491 INFO:teuthology.orchestra.run.smithi012.stdout:(31/130): gsm-1.0.19-6.el9.x86_64.rpm 291 kB/s | 34 kB 00:00 2023-10-05T11:42:33.558 INFO:teuthology.orchestra.run.smithi012.stdout:(32/130): gstreamer1-1.22.1-2.el9.x86_64.rpm 9.0 MB/s | 1.4 MB 00:00 2023-10-05T11:42:33.650 INFO:teuthology.orchestra.run.smithi012.stdout:(33/130): gstreamer1-plugins-base-1.22.1-1.el9. 12 MB/s | 2.2 MB 00:00 2023-10-05T11:42:33.675 INFO:teuthology.orchestra.run.smithi012.stdout:(34/130): gtk-update-icon-cache-3.24.31-2.el9.x 192 kB/s | 35 kB 00:00 2023-10-05T11:42:33.868 INFO:teuthology.orchestra.run.smithi012.stdout:(35/130): gtk2-2.24.33-8.el9.x86_64.rpm 11 MB/s | 3.5 MB 00:00 2023-10-05T11:42:33.993 INFO:teuthology.orchestra.run.smithi012.stdout:(36/130): hicolor-icon-theme-0.17-13.el9.noarch 692 kB/s | 219 kB 00:00 2023-10-05T11:42:34.060 INFO:teuthology.orchestra.run.smithi012.stdout:(37/130): gtk3-3.24.31-2.el9.x86_64.rpm 12 MB/s | 4.9 MB 00:00 2023-10-05T11:42:34.168 INFO:teuthology.orchestra.run.smithi012.stdout:(38/130): iso-codes-4.6.0-3.el9.noarch.rpm 12 MB/s | 3.5 MB 00:00 2023-10-05T11:42:34.194 INFO:teuthology.orchestra.run.smithi012.stdout:(39/130): java-1.8.0-openjdk-1.8.0.362.b09-4.el 2.1 MB/s | 426 kB 00:00 2023-10-05T11:42:34.319 INFO:teuthology.orchestra.run.smithi012.stdout:(40/130): jbigkit-libs-2.1-23.el9.x86_64.rpm 427 kB/s | 53 kB 00:00 2023-10-05T11:42:34.653 INFO:teuthology.orchestra.run.smithi012.stdout:(41/130): java-1.8.0-openjdk-devel-1.8.0.362.b0 16 MB/s | 9.3 MB 00:00 2023-10-05T11:42:34.678 INFO:teuthology.orchestra.run.smithi012.stdout:(42/130): lcms2-2.12-3.el9.x86_64.rpm 472 kB/s | 168 kB 00:00 2023-10-05T11:42:34.845 INFO:teuthology.orchestra.run.smithi012.stdout:(43/130): libX11-xcb-1.7.0-8.el9.x86_64.rpm 57 kB/s | 11 kB 00:00 2023-10-05T11:42:34.870 INFO:teuthology.orchestra.run.smithi012.stdout:(44/130): libXcomposite-0.4.5-7.el9.x86_64.rpm 127 kB/s | 24 kB 00:00 2023-10-05T11:42:34.995 INFO:teuthology.orchestra.run.smithi012.stdout:(45/130): libXcursor-1.2.0-7.el9.x86_64.rpm 205 kB/s | 31 kB 00:00 2023-10-05T11:42:35.021 INFO:teuthology.orchestra.run.smithi012.stdout:(46/130): libXdamage-1.1.5-7.el9.x86_64.rpm 154 kB/s | 23 kB 00:00 2023-10-05T11:42:35.188 INFO:teuthology.orchestra.run.smithi012.stdout:(47/130): libXfixes-5.0.3-16.el9.x86_64.rpm 103 kB/s | 20 kB 00:00 2023-10-05T11:42:35.213 INFO:teuthology.orchestra.run.smithi012.stdout:(48/130): libXi-1.7.10-8.el9.x86_64.rpm 209 kB/s | 40 kB 00:00 2023-10-05T11:42:35.347 INFO:teuthology.orchestra.run.smithi012.stdout:(49/130): libXinerama-1.1.4-10.el9.x86_64.rpm 95 kB/s | 15 kB 00:00 2023-10-05T11:42:35.414 INFO:teuthology.orchestra.run.smithi012.stdout:(50/130): libXrandr-1.5.2-8.el9.x86_64.rpm 143 kB/s | 28 kB 00:00 2023-10-05T11:42:35.539 INFO:teuthology.orchestra.run.smithi012.stdout:(51/130): libXtst-1.2.3-16.el9.x86_64.rpm 113 kB/s | 21 kB 00:00 2023-10-05T11:42:35.573 INFO:teuthology.orchestra.run.smithi012.stdout:(52/130): libXv-1.0.11-16.el9.x86_64.rpm 122 kB/s | 19 kB 00:00 2023-10-05T11:42:35.706 INFO:teuthology.orchestra.run.smithi012.stdout:(53/130): libXxf86vm-1.1.4-18.el9.x86_64.rpm 114 kB/s | 19 kB 00:00 2023-10-05T11:42:35.732 INFO:teuthology.orchestra.run.smithi012.stdout:(54/130): libasyncns-0.8-22.el9.x86_64.rpm 193 kB/s | 30 kB 00:00 2023-10-05T11:42:36.032 INFO:teuthology.orchestra.run.smithi012.stdout:(55/130): java-1.8.0-openjdk-headless-1.8.0.362 17 MB/s | 32 MB 00:01 2023-10-05T11:42:36.057 INFO:teuthology.orchestra.run.smithi012.stdout:(56/130): libcanberra-0.30-27.el9.x86_64.rpm 246 kB/s | 86 kB 00:00 2023-10-05T11:42:36.074 INFO:teuthology.orchestra.run.smithi012.stdout:(57/130): libcanberra-gtk2-0.30-27.el9.x86_64.r 76 kB/s | 26 kB 00:00 2023-10-05T11:42:36.132 INFO:teuthology.orchestra.run.smithi012.stdout:(58/130): libcanberra-gtk3-0.30-27.el9.x86_64.r 318 kB/s | 32 kB 00:00 2023-10-05T11:42:36.183 INFO:teuthology.orchestra.run.smithi012.stdout:(59/130): libdrm-2.4.115-1.el9.x86_64.rpm 1.4 MB/s | 160 kB 00:00 2023-10-05T11:42:36.208 INFO:teuthology.orchestra.run.smithi012.stdout:(60/130): libexif-0.6.22-6.el9.x86_64.rpm 3.2 MB/s | 435 kB 00:00 2023-10-05T11:42:36.242 INFO:teuthology.orchestra.run.smithi012.stdout:(61/130): libfontenc-1.1.3-17.el9.x86_64.rpm 284 kB/s | 31 kB 00:00 2023-10-05T11:42:36.301 INFO:teuthology.orchestra.run.smithi012.stdout:(62/130): libgexiv2-0.12.3-1.el9.x86_64.rpm 711 kB/s | 83 kB 00:00 2023-10-05T11:42:36.326 INFO:teuthology.orchestra.run.smithi012.stdout:(63/130): libglvnd-1.3.4-1.el9.x86_64.rpm 1.1 MB/s | 135 kB 00:00 2023-10-05T11:42:36.351 INFO:teuthology.orchestra.run.smithi012.stdout:(64/130): libglvnd-egl-1.3.4-1.el9.x86_64.rpm 337 kB/s | 37 kB 00:00 2023-10-05T11:42:36.418 INFO:teuthology.orchestra.run.smithi012.stdout:(65/130): libglvnd-glx-1.3.4-1.el9.x86_64.rpm 1.2 MB/s | 142 kB 00:00 2023-10-05T11:42:36.443 INFO:teuthology.orchestra.run.smithi012.stdout:(66/130): libgsf-1.14.47-5.el9.x86_64.rpm 2.1 MB/s | 256 kB 00:00 2023-10-05T11:42:36.469 INFO:teuthology.orchestra.run.smithi012.stdout:(67/130): libgxps-0.3.2-3.el9.x86_64.rpm 672 kB/s | 79 kB 00:00 2023-10-05T11:42:36.536 INFO:teuthology.orchestra.run.smithi012.stdout:(68/130): libiptcdata-1.0.5-9.el9.x86_64.rpm 531 kB/s | 62 kB 00:00 2023-10-05T11:42:36.561 INFO:teuthology.orchestra.run.smithi012.stdout:(69/130): libldac-2.0.2.3-10.el9.x86_64.rpm 352 kB/s | 41 kB 00:00 2023-10-05T11:42:36.603 INFO:teuthology.orchestra.run.smithi012.stdout:(70/130): libnotify-0.7.9-8.el9.x86_64.rpm 326 kB/s | 44 kB 00:00 2023-10-05T11:42:36.653 INFO:teuthology.orchestra.run.smithi012.stdout:(71/130): libogg-1.3.4-6.el9.x86_64.rpm 287 kB/s | 34 kB 00:00 2023-10-05T11:42:36.687 INFO:teuthology.orchestra.run.smithi012.stdout:(72/130): libosinfo-1.10.0-1.el9.x86_64.rpm 2.5 MB/s | 319 kB 00:00 2023-10-05T11:42:36.720 INFO:teuthology.orchestra.run.smithi012.stdout:(73/130): libsbc-1.4-9.el9.x86_64.rpm 382 kB/s | 45 kB 00:00 2023-10-05T11:42:36.771 INFO:teuthology.orchestra.run.smithi012.stdout:(74/130): libsndfile-1.0.31-7.el9.x86_64.rpm 1.7 MB/s | 207 kB 00:00 2023-10-05T11:42:36.804 INFO:teuthology.orchestra.run.smithi012.stdout:(75/130): libtheora-1.1.1-31.el9.x86_64.rpm 1.4 MB/s | 164 kB 00:00 2023-10-05T11:42:36.847 INFO:teuthology.orchestra.run.smithi012.stdout:(76/130): libtiff-4.4.0-10.el9.x86_64.rpm 1.5 MB/s | 197 kB 00:00 2023-10-05T11:42:36.888 INFO:teuthology.orchestra.run.smithi012.stdout:(77/130): libtool-ltdl-2.4.6-45.el9.x86_64.rpm 316 kB/s | 37 kB 00:00 2023-10-05T11:42:36.930 INFO:teuthology.orchestra.run.smithi012.stdout:(78/130): libtracker-sparql-3.1.2-3.el9.x86_64. 2.5 MB/s | 324 kB 00:00 2023-10-05T11:42:36.964 INFO:teuthology.orchestra.run.smithi012.stdout:(79/130): libvisual-0.4.0-34.el9.x86_64.rpm 1.2 MB/s | 144 kB 00:00 2023-10-05T11:42:37.006 INFO:teuthology.orchestra.run.smithi012.stdout:(80/130): libvorbis-1.3.7-5.el9.x86_64.rpm 1.6 MB/s | 193 kB 00:00 2023-10-05T11:42:37.040 INFO:teuthology.orchestra.run.smithi012.stdout:(81/130): libwayland-client-1.21.0-1.el9.x86_64 306 kB/s | 33 kB 00:00 2023-10-05T11:42:37.082 INFO:teuthology.orchestra.run.smithi012.stdout:(82/130): libwayland-cursor-1.21.0-1.el9.x86_64 165 kB/s | 19 kB 00:00 2023-10-05T11:42:37.115 INFO:teuthology.orchestra.run.smithi012.stdout:(83/130): libwayland-egl-1.21.0-1.el9.x86_64.rp 118 kB/s | 13 kB 00:00 2023-10-05T11:42:37.157 INFO:teuthology.orchestra.run.smithi012.stdout:(84/130): libwayland-server-1.21.0-1.el9.x86_64 356 kB/s | 42 kB 00:00 2023-10-05T11:42:37.191 INFO:teuthology.orchestra.run.smithi012.stdout:(85/130): libwebp-1.2.0-8.el9.x86_64.rpm 2.5 MB/s | 277 kB 00:00 2023-10-05T11:42:37.224 INFO:teuthology.orchestra.run.smithi012.stdout:(86/130): libxkbcommon-1.0.3-4.el9.x86_64.rpm 1.2 MB/s | 133 kB 00:00 2023-10-05T11:42:37.258 INFO:teuthology.orchestra.run.smithi012.stdout:(87/130): libxshmfence-1.3-10.el9.x86_64.rpm 125 kB/s | 13 kB 00:00 2023-10-05T11:42:37.292 INFO:teuthology.orchestra.run.smithi012.stdout:(88/130): low-memory-monitor-2.1-4.el9.x86_64.r 357 kB/s | 36 kB 00:00 2023-10-05T11:42:37.334 INFO:teuthology.orchestra.run.smithi012.stdout:(89/130): lua-5.4.4-4.el9.x86_64.rpm 1.7 MB/s | 188 kB 00:00 2023-10-05T11:42:37.367 INFO:teuthology.orchestra.run.smithi012.stdout:(90/130): lua-posix-35.0-8.el9.x86_64.rpm 1.4 MB/s | 151 kB 00:00 2023-10-05T11:42:37.401 INFO:teuthology.orchestra.run.smithi012.stdout:(91/130): mesa-libEGL-23.1.4-1.el9.x86_64.rpm 1.1 MB/s | 125 kB 00:00 2023-10-05T11:42:37.443 INFO:teuthology.orchestra.run.smithi012.stdout:(92/130): mesa-libGL-23.1.4-1.el9.x86_64.rpm 1.5 MB/s | 166 kB 00:00 2023-10-05T11:42:37.477 INFO:teuthology.orchestra.run.smithi012.stdout:(93/130): mesa-libgbm-23.1.4-1.el9.x86_64.rpm 344 kB/s | 38 kB 00:00 2023-10-05T11:42:37.510 INFO:teuthology.orchestra.run.smithi012.stdout:(94/130): mesa-libglapi-23.1.4-1.el9.x86_64.rpm 428 kB/s | 47 kB 00:00 2023-10-05T11:42:37.660 INFO:teuthology.orchestra.run.smithi012.stdout:(95/130): mkfontscale-1.2.1-3.el9.x86_64.rpm 176 kB/s | 32 kB 00:00 2023-10-05T11:42:37.769 INFO:teuthology.orchestra.run.smithi012.stdout:(96/130): openjpeg2-2.4.0-7.el9.x86_64.rpm 631 kB/s | 163 kB 00:00 2023-10-05T11:42:37.929 INFO:teuthology.orchestra.run.smithi012.stdout:(97/130): mesa-vulkan-drivers-23.1.4-1.el9.x86_ 20 MB/s | 9.2 MB 00:00 2023-10-05T11:42:37.929 INFO:teuthology.orchestra.run.smithi012.stdout:(98/130): opus-1.3.1-10.el9.x86_64.rpm 772 kB/s | 200 kB 00:00 2023-10-05T11:42:37.945 INFO:teuthology.orchestra.run.smithi012.stdout:(99/130): orc-0.4.31-6.el9.x86_64.rpm 1.0 MB/s | 184 kB 00:00 2023-10-05T11:42:38.020 INFO:teuthology.orchestra.run.smithi012.stdout:(100/130): osinfo-db-20230518-1.el9.noarch.rpm 3.9 MB/s | 503 kB 00:00 2023-10-05T11:42:38.054 INFO:teuthology.orchestra.run.smithi012.stdout:(101/130): osinfo-db-tools-1.10.0-1.el9.x86_64. 679 kB/s | 74 kB 00:00 2023-10-05T11:42:38.079 INFO:teuthology.orchestra.run.smithi012.stdout:(102/130): ostree-libs-2023.6-1.el9.x86_64.rpm 3.4 MB/s | 471 kB 00:00 2023-10-05T11:42:38.129 INFO:teuthology.orchestra.run.smithi012.stdout:(103/130): p11-kit-server-0.24.1-2.el9.x86_64.r 1.8 MB/s | 199 kB 00:00 2023-10-05T11:42:38.163 INFO:teuthology.orchestra.run.smithi012.stdout:(104/130): pipewire-0.3.67-2.el9.x86_64.rpm 804 kB/s | 87 kB 00:00 2023-10-05T11:42:38.188 INFO:teuthology.orchestra.run.smithi012.stdout:(105/130): pipewire-alsa-0.3.67-2.el9.x86_64.rp 512 kB/s | 56 kB 00:00 2023-10-05T11:42:38.239 INFO:teuthology.orchestra.run.smithi012.stdout:(106/130): pipewire-jack-audio-connection-kit-0 1.1 MB/s | 127 kB 00:00 2023-10-05T11:42:38.322 INFO:teuthology.orchestra.run.smithi012.stdout:(107/130): pipewire-libs-0.3.67-2.el9.x86_64.rp 11 MB/s | 1.7 MB 00:00 2023-10-05T11:42:38.348 INFO:teuthology.orchestra.run.smithi012.stdout:(108/130): pipewire-pulseaudio-0.3.67-2.el9.x86 118 kB/s | 19 kB 00:00 2023-10-05T11:42:39.073 INFO:teuthology.orchestra.run.smithi012.stdout:(109/130): poppler-glib-21.01.0-18.el9.x86_64.r 210 kB/s | 152 kB 00:00 2023-10-05T11:42:39.306 INFO:teuthology.orchestra.run.smithi012.stdout:(110/130): poppler-21.01.0-18.el9.x86_64.rpm 1.0 MB/s | 1.1 MB 00:01 2023-10-05T11:42:39.374 INFO:teuthology.orchestra.run.smithi012.stdout:(111/130): pulseaudio-libs-15.0-2.el9.x86_64.rp 2.2 MB/s | 679 kB 00:00 2023-10-05T11:42:39.440 INFO:teuthology.orchestra.run.smithi012.stdout:(112/130): poppler-data-0.4.9-9.el9.noarch.rpm 1.7 MB/s | 1.9 MB 00:01 2023-10-05T11:42:39.466 INFO:teuthology.orchestra.run.smithi012.stdout:(113/130): pulseaudio-utils-15.0-2.el9.x86_64.r 486 kB/s | 76 kB 00:00 2023-10-05T11:42:39.491 INFO:teuthology.orchestra.run.smithi012.stdout:(114/130): rtkit-0.11-28.el9.x86_64.rpm 481 kB/s | 56 kB 00:00 2023-10-05T11:42:39.591 INFO:teuthology.orchestra.run.smithi012.stdout:(115/130): sound-theme-freedesktop-0.8-17.el9.n 3.0 MB/s | 383 kB 00:00 2023-10-05T11:42:39.616 INFO:teuthology.orchestra.run.smithi012.stdout:(116/130): totem-pl-parser-3.26.6-2.el9.x86_64. 1.0 MB/s | 152 kB 00:00 2023-10-05T11:42:39.650 INFO:teuthology.orchestra.run.smithi012.stdout:(117/130): tracker-3.1.2-3.el9.x86_64.rpm 3.4 MB/s | 555 kB 00:00 2023-10-05T11:42:39.750 INFO:teuthology.orchestra.run.smithi012.stdout:(118/130): tracker-miners-3.1.2-3.el9.x86_64.rp 5.8 MB/s | 939 kB 00:00 2023-10-05T11:42:39.776 INFO:teuthology.orchestra.run.smithi012.stdout:(119/130): ttmkfdir-3.0.9-65.el9.x86_64.rpm 335 kB/s | 53 kB 00:00 2023-10-05T11:42:39.801 INFO:teuthology.orchestra.run.smithi012.stdout:(120/130): tzdata-java-2023c-1.el9.noarch.rpm 1.5 MB/s | 230 kB 00:00 2023-10-05T11:42:39.868 INFO:teuthology.orchestra.run.smithi012.stdout:(121/130): upower-0.99.11-11.el9.x86_64.rpm 1.4 MB/s | 173 kB 00:00 2023-10-05T11:42:39.918 INFO:teuthology.orchestra.run.smithi012.stdout:(122/130): vulkan-loader-1.3.250.1-1.el9.x86_64 1.2 MB/s | 141 kB 00:00 2023-10-05T11:42:39.952 INFO:teuthology.orchestra.run.smithi012.stdout:(123/130): webrtc-audio-processing-0.3.1-8.el9. 2.0 MB/s | 306 kB 00:00 2023-10-05T11:42:39.977 INFO:teuthology.orchestra.run.smithi012.stdout:(124/130): wireplumber-0.4.14-1.el9.x86_64.rpm 886 kB/s | 96 kB 00:00 2023-10-05T11:42:40.052 INFO:teuthology.orchestra.run.smithi012.stdout:(125/130): wireplumber-libs-0.4.14-1.el9.x86_64 2.6 MB/s | 358 kB 00:00 2023-10-05T11:42:40.078 INFO:teuthology.orchestra.run.smithi012.stdout:(126/130): xdg-dbus-proxy-0.1.3-1.el9.x86_64.rp 338 kB/s | 42 kB 00:00 2023-10-05T11:42:40.111 INFO:teuthology.orchestra.run.smithi012.stdout:(127/130): xdg-desktop-portal-1.12.4-1.el9.x86_ 2.8 MB/s | 383 kB 00:00 2023-10-05T11:42:40.162 INFO:teuthology.orchestra.run.smithi012.stdout:(128/130): xdg-desktop-portal-gtk-1.12.0-3.el9. 1.2 MB/s | 134 kB 00:00 2023-10-05T11:42:40.229 INFO:teuthology.orchestra.run.smithi012.stdout:(129/130): xkeyboard-config-2.33-2.el9.noarch.r 5.6 MB/s | 859 kB 00:00 2023-10-05T11:42:40.262 INFO:teuthology.orchestra.run.smithi012.stdout:(130/130): xorg-x11-fonts-Type1-7.5-33.el9.noar 3.3 MB/s | 505 kB 00:00 2023-10-05T11:42:40.268 INFO:teuthology.orchestra.run.smithi012.stdout:-------------------------------------------------------------------------------- 2023-10-05T11:42:40.269 INFO:teuthology.orchestra.run.smithi012.stdout:Total 9.6 MB/s | 105 MB 00:10 2023-10-05T11:42:42.312 INFO:teuthology.orchestra.run.smithi012.stdout:Running transaction check 2023-10-05T11:42:42.413 INFO:teuthology.orchestra.run.smithi012.stdout:Transaction check succeeded. 2023-10-05T11:42:42.413 INFO:teuthology.orchestra.run.smithi012.stdout:Running transaction test 2023-10-05T11:42:43.775 INFO:teuthology.orchestra.run.smithi012.stdout:Transaction test succeeded. 2023-10-05T11:42:43.775 INFO:teuthology.orchestra.run.smithi012.stdout:Running transaction 2023-10-05T11:42:48.447 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: copy-jdk-configs-4.0-3.el9.noarch 1/1 2023-10-05T11:42:48.519 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x8 1/1 2023-10-05T11:42:48.687 INFO:teuthology.orchestra.run.smithi012.stdout: Preparing : 1/1 2023-10-05T11:42:48.757 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libXi-1.7.10-8.el9.x86_64 1/130 2023-10-05T11:42:48.783 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libwayland-client-1.21.0-1.el9.x86_64 2/130 2023-10-05T11:42:48.813 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libogg-2:1.3.4-6.el9.x86_64 3/130 2023-10-05T11:42:48.842 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libvorbis-1:1.3.7-5.el9.x86_64 4/130 2023-10-05T11:42:48.986 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libXfixes-5.0.3-16.el9.x86_64 5/130 2023-10-05T11:42:49.065 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : atk-2.36.0-5.el9.x86_64 6/130 2023-10-05T11:42:49.097 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : alsa-lib-1.2.9-1.el9.x86_64 7/130 2023-10-05T11:42:49.126 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libX11-xcb-1.7.0-8.el9.x86_64 8/130 2023-10-05T11:42:49.155 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : opus-1.3.1-10.el9.x86_64 9/130 2023-10-05T11:42:49.182 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libxshmfence-1.3-10.el9.x86_64 10/130 2023-10-05T11:42:49.212 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libtool-ltdl-2.4.6-45.el9.x86_64 11/130 2023-10-05T11:42:49.244 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libXcomposite-0.4.5-7.el9.x86_64 12/130 2023-10-05T11:42:49.344 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : lcms2-2.12-3.el9.x86_64 13/130 2023-10-05T11:42:49.391 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : gstreamer1-1.22.1-2.el9.x86_64 14/130 2023-10-05T11:42:49.422 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : cups-libs-1:2.3.3op2-21.el9.x86_64 15/130 2023-10-05T11:42:49.447 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libXcursor-1.2.0-7.el9.x86_64 16/130 2023-10-05T11:42:49.474 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libXdamage-1.1.5-7.el9.x86_64 17/130 2023-10-05T11:42:49.499 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libwayland-cursor-1.21.0-1.el9.x86_64 18/130 2023-10-05T11:42:49.525 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libXtst-1.2.3-16.el9.x86_64 19/130 2023-10-05T11:42:49.558 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : mesa-libglapi-23.1.4-1.el9.x86_64 20/130 2023-10-05T11:42:49.583 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libwayland-server-1.21.0-1.el9.x86_64 21/130 2023-10-05T11:42:49.612 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libwayland-egl-1.21.0-1.el9.x86_64 22/130 2023-10-05T11:42:49.644 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libglvnd-1:1.3.4-1.el9.x86_64 23/130 2023-10-05T11:42:49.668 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libXrandr-1.5.2-8.el9.x86_64 24/130 2023-10-05T11:42:49.791 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libXinerama-1.1.4-10.el9.x86_64 25/130 2023-10-05T11:42:49.845 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : hicolor-icon-theme-0.17-13.el9.noarch 26/130 2023-10-05T11:42:49.895 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : gtk-update-icon-cache-3.24.31-2.el9.x86_64 27/130 2023-10-05T11:42:49.927 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : dconf-0.40.0-6.el9.x86_64 28/130 2023-10-05T11:42:49.990 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: dconf-0.40.0-6.el9.x86_64 28/130 2023-10-05T11:42:50.037 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : at-spi2-core-2.40.3-1.el9.x86_64 29/130 2023-10-05T11:42:50.082 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : at-spi2-atk-2.38.0-4.el9.x86_64 30/130 2023-10-05T11:42:50.123 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : colord-libs-1.4.5-4.el9.x86_64 31/130 2023-10-05T11:42:50.156 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : flac-libs-1.3.3-12.el9.x86_64 32/130 2023-10-05T11:42:50.198 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libtheora-1:1.1.1-31.el9.x86_64 33/130 2023-10-05T11:42:50.273 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : exiv2-libs-0.27.5-2.el9.x86_64 34/130 2023-10-05T11:42:50.307 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : exiv2-0.27.5-2.el9.x86_64 35/130 2023-10-05T11:42:50.528 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libgexiv2-0.12.3-1.el9.x86_64 36/130 2023-10-05T11:42:50.569 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : xkeyboard-config-2.33-2.el9.noarch 37/130 2023-10-05T11:42:50.601 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libxkbcommon-1.0.3-4.el9.x86_64 38/130 2023-10-05T11:42:50.631 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : xdg-dbus-proxy-0.1.3-1.el9.x86_64 39/130 2023-10-05T11:42:50.673 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : webrtc-audio-processing-0.3.1-8.el9.x86_64 40/130 2023-10-05T11:42:50.700 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : upower-0.99.11-11.el9.x86_64 41/130 2023-10-05T11:42:50.713 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: upower-0.99.11-11.el9.x86_64 41/130 2023-10-05T11:42:50.714 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/graphical.target.wants/upower.service → /usr/lib/systemd/system/upower.service. 2023-10-05T11:42:50.714 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:42:50.913 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : tzdata-java-2023c-1.el9.noarch 42/130 2023-10-05T11:42:50.985 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ttmkfdir-3.0.9-65.el9.x86_64 43/130 2023-10-05T11:42:51.034 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : totem-pl-parser-3.26.6-2.el9.x86_64 44/130 2023-10-05T11:42:51.058 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : sound-theme-freedesktop-0.8-17.el9.noarch 45/130 2023-10-05T11:42:51.064 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: sound-theme-freedesktop-0.8-17.el9.noarch 45/130 2023-10-05T11:42:51.490 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: rtkit-0.11-28.el9.x86_64 46/130 2023-10-05T11:42:51.521 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : rtkit-0.11-28.el9.x86_64 46/130 2023-10-05T11:42:51.534 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: rtkit-0.11-28.el9.x86_64 46/130 2023-10-05T11:42:51.534 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/graphical.target.wants/rtkit-daemon.service → /usr/lib/systemd/system/rtkit-daemon.service. 2023-10-05T11:42:51.534 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:42:51.755 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : poppler-data-0.4.9-9.el9.noarch 47/130 2023-10-05T11:42:51.789 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : p11-kit-server-0.24.1-2.el9.x86_64 48/130 2023-10-05T11:42:51.833 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ostree-libs-2023.6-1.el9.x86_64 49/130 2023-10-05T11:42:52.339 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : osinfo-db-tools-1.10.0-1.el9.x86_64 50/130 2023-10-05T11:42:52.400 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : osinfo-db-20230518-1.el9.noarch 51/130 2023-10-05T11:42:52.445 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libosinfo-1.10.0-1.el9.x86_64 52/130 2023-10-05T11:42:52.479 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : orc-0.4.31-6.el9.x86_64 53/130 2023-10-05T11:42:52.542 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : openjpeg2-2.4.0-7.el9.x86_64 54/130 2023-10-05T11:42:52.585 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : lua-posix-35.0-8.el9.x86_64 55/130 2023-10-05T11:42:52.612 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : lua-5.4.4-4.el9.x86_64 56/130 2023-10-05T11:42:52.640 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : copy-jdk-configs-4.0-3.el9.noarch 57/130 2023-10-05T11:42:52.669 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : low-memory-monitor-2.1-4.el9.x86_64 58/130 2023-10-05T11:42:52.680 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: low-memory-monitor-2.1-4.el9.x86_64 58/130 2023-10-05T11:42:52.680 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/basic.target.wants/low-memory-monitor.service → /usr/lib/systemd/system/low-memory-monitor.service. 2023-10-05T11:42:52.681 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:42:52.728 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libwebp-1.2.0-8.el9.x86_64 59/130 2023-10-05T11:42:52.806 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libvisual-1:0.4.0-34.el9.x86_64 60/130 2023-10-05T11:42:52.978 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libsbc-1.4-9.el9.x86_64 61/130 2023-10-05T11:42:53.010 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libnotify-0.7.9-8.el9.x86_64 62/130 2023-10-05T11:42:53.047 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libldac-2.0.2.3-10.el9.x86_64 63/130 2023-10-05T11:42:53.107 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libiptcdata-1.0.5-9.el9.x86_64 64/130 2023-10-05T11:42:53.146 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libgsf-1.14.47-5.el9.x86_64 65/130 2023-10-05T11:42:53.172 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libfontenc-1.1.3-17.el9.x86_64 66/130 2023-10-05T11:42:53.209 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : mkfontscale-1.2.1-3.el9.x86_64 67/130 2023-10-05T11:42:53.236 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : xorg-x11-fonts-Type1-7.5-33.el9.noarch 68/130 2023-10-05T11:42:53.539 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: xorg-x11-fonts-Type1-7.5-33.el9.noarch 68/130 2023-10-05T11:42:53.575 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libexif-0.6.22-6.el9.x86_64 69/130 2023-10-05T11:42:53.600 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libasyncns-0.8-22.el9.x86_64 70/130 2023-10-05T11:42:53.626 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libXxf86vm-1.1.4-18.el9.x86_64 71/130 2023-10-05T11:42:53.654 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libXv-1.0.11-16.el9.x86_64 72/130 2023-10-05T11:42:53.690 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : jbigkit-libs-2.1-23.el9.x86_64 73/130 2023-10-05T11:42:53.734 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libtiff-4.4.0-10.el9.x86_64 74/130 2023-10-05T11:42:53.773 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : gdk-pixbuf2-modules-2.42.6-3.el9.x86_64 75/130 2023-10-05T11:42:53.822 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libgxps-0.3.2-3.el9.x86_64 76/130 2023-10-05T11:42:53.857 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : poppler-21.01.0-18.el9.x86_64 77/130 2023-10-05T11:42:54.356 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : poppler-glib-21.01.0-18.el9.x86_64 78/130 2023-10-05T11:42:54.406 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : iso-codes-4.6.0-3.el9.noarch 79/130 2023-10-05T11:42:54.433 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : gsm-1.0.19-6.el9.x86_64 80/130 2023-10-05T11:42:54.502 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libsndfile-1.0.31-7.el9.x86_64 81/130 2023-10-05T11:42:54.541 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : pulseaudio-libs-15.0-2.el9.x86_64 82/130 2023-10-05T11:42:54.573 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libcanberra-0.30-27.el9.x86_64 83/130 2023-10-05T11:42:54.599 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: libcanberra-0.30-27.el9.x86_64 83/130 2023-10-05T11:42:54.628 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : pulseaudio-utils-15.0-2.el9.x86_64 84/130 2023-10-05T11:42:54.662 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : graphene-1.10.6-2.el9.x86_64 85/130 2023-10-05T11:42:54.689 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : giflib-5.2.1-9.el9.x86_64 86/130 2023-10-05T11:42:54.719 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : flatpak-session-helper-1.12.8-1.el9.x86_64 87/130 2023-10-05T11:42:54.743 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : flatpak-selinux-1.12.8-1.el9.noarch 88/130 2023-10-05T11:43:04.321 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: flatpak-selinux-1.12.8-1.el9.noarch 88/130 2023-10-05T11:43:04.368 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : fdk-aac-free-2.0.0-8.el9.x86_64 89/130 2023-10-05T11:43:04.392 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 90/130 2023-10-05T11:43:04.498 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : avahi-glib-0.8-12.el9.x86_64 91/130 2023-10-05T11:43:07.522 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : adwaita-cursor-theme-40.1.1-3.el9.noarch 92/130 2023-10-05T11:43:07.635 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : adwaita-icon-theme-40.1.1-3.el9.noarch 93/130 2023-10-05T11:43:07.668 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 94/130 2023-10-05T11:43:07.699 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libpciaccess-0.16-6.el9.x86_64 95/130 2023-10-05T11:43:07.727 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libdrm-2.4.115-1.el9.x86_64 96/130 2023-10-05T11:43:07.754 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : mesa-libgbm-23.1.4-1.el9.x86_64 97/130 2023-10-05T11:43:07.780 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libglvnd-egl-1:1.3.4-1.el9.x86_64 98/130 2023-10-05T11:43:07.807 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : mesa-libEGL-23.1.4-1.el9.x86_64 99/130 2023-10-05T11:43:07.840 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libglvnd-glx-1:1.3.4-1.el9.x86_64 100/130 2023-10-05T11:43:07.970 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : mesa-libGL-23.1.4-1.el9.x86_64 101/130 2023-10-05T11:43:08.032 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : gstreamer1-plugins-base-1.22.1-1.el9.x86_64 102/130 2023-10-05T11:43:08.100 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libtracker-sparql-3.1.2-3.el9.x86_64 103/130 2023-10-05T11:43:08.127 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : tracker-3.1.2-3.el9.x86_64 104/130 2023-10-05T11:43:08.238 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: tracker-3.1.2-3.el9.x86_64 104/130 2023-10-05T11:43:08.283 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : tracker-miners-3.1.2-3.el9.x86_64 105/130 2023-10-05T11:43:08.302 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: tracker-miners-3.1.2-3.el9.x86_64 105/130 2023-10-05T11:43:08.522 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : vulkan-loader-1.3.250.1-1.el9.x86_64 106/130 2023-10-05T11:43:08.554 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : mesa-vulkan-drivers-23.1.4-1.el9.x86_64 107/130 2023-10-05T11:43:08.586 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : bubblewrap-0.4.1-6.el9.x86_64 108/130 2023-10-05T11:43:08.611 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ModemManager-glib-1.20.2-1.el9.x86_64 109/130 2023-10-05T11:43:09.086 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: geoclue2-2.6.0-7.el9.x86_64 110/130 2023-10-05T11:43:09.116 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : geoclue2-2.6.0-7.el9.x86_64 110/130 2023-10-05T11:43:09.142 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: geoclue2-2.6.0-7.el9.x86_64 110/130 2023-10-05T11:43:09.167 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : bluez-libs-5.63-1.el8.x86_64 111/130 2023-10-05T11:43:09.605 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: pipewire-0.3.67-2.el9.x86_64 112/130 2023-10-05T11:43:09.629 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : pipewire-0.3.67-2.el9.x86_64 112/130 2023-10-05T11:43:09.647 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: pipewire-0.3.67-2.el9.x86_64 112/130 2023-10-05T11:43:09.647 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/user/sockets.target.wants/pipewire.socket → /usr/lib/systemd/user/pipewire.socket. 2023-10-05T11:43:09.647 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:43:09.866 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : pipewire-libs-0.3.67-2.el9.x86_64 113/130 2023-10-05T11:43:09.934 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : wireplumber-0.4.14-1.el9.x86_64 114/130 2023-10-05T11:43:09.967 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : wireplumber-libs-0.4.14-1.el9.x86_64 115/130 2023-10-05T11:43:10.541 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: flatpak-1.12.8-1.el9.x86_64 116/130 2023-10-05T11:43:10.628 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : flatpak-1.12.8-1.el9.x86_64 116/130 2023-10-05T11:43:10.657 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : xdg-desktop-portal-1.12.4-1.el9.x86_64 117/130 2023-10-05T11:43:10.705 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: xdg-desktop-portal-1.12.4-1.el9.x86_64 117/130 2023-10-05T11:43:10.738 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libepoxy-1.5.8-1.el8.x86_64 118/130 2023-10-05T11:43:10.783 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libcanberra-gtk3-0.30-27.el9.x86_64 119/130 2023-10-05T11:43:10.809 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 120/130 2023-10-05T11:43:10.992 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 120/130 2023-10-05T11:43:11.150 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : gtk3-3.24.31-2.el9.x86_64 121/130 2023-10-05T11:43:11.190 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : gtk2-2.24.33-8.el9.x86_64 122/130 2023-10-05T11:43:11.217 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libcanberra-gtk2-0.30-27.el9.x86_64 123/130 2023-10-05T11:43:11.838 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : javapackages-filesystem-5.3.0-1.module_el8.0.0+1 124/130 2023-10-05T11:43:11.877 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el 125/130 2023-10-05T11:43:12.140 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el 125/130 2023-10-05T11:43:12.169 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 126/130 2023-10-05T11:43:12.407 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 126/130 2023-10-05T11:43:12.448 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x 127/130 2023-10-05T11:43:12.460 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x 127/130 2023-10-05T11:43:12.506 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : pipewire-alsa-0.3.67-2.el9.x86_64 128/130 2023-10-05T11:43:12.536 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : pipewire-jack-audio-connection-kit-0.3.67-2.el9. 129/130 2023-10-05T11:43:12.558 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : pipewire-pulseaudio-0.3.67-2.el9.x86_64 130/130 2023-10-05T11:43:12.574 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: pipewire-pulseaudio-0.3.67-2.el9.x86_64 130/130 2023-10-05T11:43:12.574 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/user/sockets.target.wants/pipewire-pulse.socket → /usr/lib/systemd/user/pipewire-pulse.socket. 2023-10-05T11:43:12.574 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:43:12.599 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: dconf-0.40.0-6.el9.x86_64 130/130 2023-10-05T11:43:12.605 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: copy-jdk-configs-4.0-3.el9.noarch 130/130 2023-10-05T11:43:12.615 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: wireplumber-0.4.14-1.el9.x86_64 130/130 2023-10-05T11:43:12.615 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/user/pipewire-session-manager.service → /usr/lib/systemd/user/wireplumber.service. 2023-10-05T11:43:12.615 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/user/pipewire.service.wants/wireplumber.service → /usr/lib/systemd/user/wireplumber.service. 2023-10-05T11:43:12.615 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:43:12.637 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el 130/130 2023-10-05T11:43:12.739 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 130/130 2023-10-05T11:43:12.816 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x 130/130 2023-10-05T11:43:18.131 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: pipewire-pulseaudio-0.3.67-2.el9.x86_64 130/130 2023-10-05T11:43:18.131 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : javapackages-filesystem-5.3.0-1.module_el8.0.0+1 1/130 2023-10-05T11:43:18.131 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libepoxy-1.5.8-1.el8.x86_64 2/130 2023-10-05T11:43:18.131 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : bluez-libs-5.63-1.el8.x86_64 3/130 2023-10-05T11:43:18.132 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ModemManager-glib-1.20.2-1.el9.x86_64 4/130 2023-10-05T11:43:18.132 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : bubblewrap-0.4.1-6.el9.x86_64 5/130 2023-10-05T11:43:18.132 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : cups-libs-1:2.3.3op2-21.el9.x86_64 6/130 2023-10-05T11:43:18.132 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libpciaccess-0.16-6.el9.x86_64 7/130 2023-10-05T11:43:18.132 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 8/130 2023-10-05T11:43:18.132 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : adwaita-cursor-theme-40.1.1-3.el9.noarch 9/130 2023-10-05T11:43:18.132 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : adwaita-icon-theme-40.1.1-3.el9.noarch 10/130 2023-10-05T11:43:18.132 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : alsa-lib-1.2.9-1.el9.x86_64 11/130 2023-10-05T11:43:18.132 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : at-spi2-atk-2.38.0-4.el9.x86_64 12/130 2023-10-05T11:43:18.132 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : at-spi2-core-2.40.3-1.el9.x86_64 13/130 2023-10-05T11:43:18.132 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : atk-2.36.0-5.el9.x86_64 14/130 2023-10-05T11:43:18.132 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : avahi-glib-0.8-12.el9.x86_64 15/130 2023-10-05T11:43:18.133 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : colord-libs-1.4.5-4.el9.x86_64 16/130 2023-10-05T11:43:18.133 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : copy-jdk-configs-4.0-3.el9.noarch 17/130 2023-10-05T11:43:18.133 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : dconf-0.40.0-6.el9.x86_64 18/130 2023-10-05T11:43:18.133 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 19/130 2023-10-05T11:43:18.133 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : exiv2-0.27.5-2.el9.x86_64 20/130 2023-10-05T11:43:18.133 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : exiv2-libs-0.27.5-2.el9.x86_64 21/130 2023-10-05T11:43:18.133 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : fdk-aac-free-2.0.0-8.el9.x86_64 22/130 2023-10-05T11:43:18.133 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : flac-libs-1.3.3-12.el9.x86_64 23/130 2023-10-05T11:43:18.133 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : flatpak-1.12.8-1.el9.x86_64 24/130 2023-10-05T11:43:18.133 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : flatpak-selinux-1.12.8-1.el9.noarch 25/130 2023-10-05T11:43:18.133 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : flatpak-session-helper-1.12.8-1.el9.x86_64 26/130 2023-10-05T11:43:18.133 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : gdk-pixbuf2-modules-2.42.6-3.el9.x86_64 27/130 2023-10-05T11:43:18.142 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : geoclue2-2.6.0-7.el9.x86_64 28/130 2023-10-05T11:43:18.142 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : giflib-5.2.1-9.el9.x86_64 29/130 2023-10-05T11:43:18.142 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : graphene-1.10.6-2.el9.x86_64 30/130 2023-10-05T11:43:18.142 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : gsm-1.0.19-6.el9.x86_64 31/130 2023-10-05T11:43:18.142 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : gstreamer1-1.22.1-2.el9.x86_64 32/130 2023-10-05T11:43:18.143 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : gstreamer1-plugins-base-1.22.1-1.el9.x86_64 33/130 2023-10-05T11:43:18.143 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : gtk-update-icon-cache-3.24.31-2.el9.x86_64 34/130 2023-10-05T11:43:18.143 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : gtk2-2.24.33-8.el9.x86_64 35/130 2023-10-05T11:43:18.143 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : gtk3-3.24.31-2.el9.x86_64 36/130 2023-10-05T11:43:18.143 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : hicolor-icon-theme-0.17-13.el9.noarch 37/130 2023-10-05T11:43:18.143 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : iso-codes-4.6.0-3.el9.noarch 38/130 2023-10-05T11:43:18.143 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 39/130 2023-10-05T11:43:18.143 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x 40/130 2023-10-05T11:43:18.143 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el 41/130 2023-10-05T11:43:18.143 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : jbigkit-libs-2.1-23.el9.x86_64 42/130 2023-10-05T11:43:18.143 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : lcms2-2.12-3.el9.x86_64 43/130 2023-10-05T11:43:18.144 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libX11-xcb-1.7.0-8.el9.x86_64 44/130 2023-10-05T11:43:18.144 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libXcomposite-0.4.5-7.el9.x86_64 45/130 2023-10-05T11:43:18.144 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libXcursor-1.2.0-7.el9.x86_64 46/130 2023-10-05T11:43:18.144 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libXdamage-1.1.5-7.el9.x86_64 47/130 2023-10-05T11:43:18.144 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libXfixes-5.0.3-16.el9.x86_64 48/130 2023-10-05T11:43:18.144 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libXi-1.7.10-8.el9.x86_64 49/130 2023-10-05T11:43:18.144 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libXinerama-1.1.4-10.el9.x86_64 50/130 2023-10-05T11:43:18.144 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libXrandr-1.5.2-8.el9.x86_64 51/130 2023-10-05T11:43:18.144 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libXtst-1.2.3-16.el9.x86_64 52/130 2023-10-05T11:43:18.144 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libXv-1.0.11-16.el9.x86_64 53/130 2023-10-05T11:43:18.144 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libXxf86vm-1.1.4-18.el9.x86_64 54/130 2023-10-05T11:43:18.145 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libasyncns-0.8-22.el9.x86_64 55/130 2023-10-05T11:43:18.145 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libcanberra-0.30-27.el9.x86_64 56/130 2023-10-05T11:43:18.145 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libcanberra-gtk2-0.30-27.el9.x86_64 57/130 2023-10-05T11:43:18.145 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libcanberra-gtk3-0.30-27.el9.x86_64 58/130 2023-10-05T11:43:18.145 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libdrm-2.4.115-1.el9.x86_64 59/130 2023-10-05T11:43:18.145 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libexif-0.6.22-6.el9.x86_64 60/130 2023-10-05T11:43:18.145 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libfontenc-1.1.3-17.el9.x86_64 61/130 2023-10-05T11:43:18.145 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libgexiv2-0.12.3-1.el9.x86_64 62/130 2023-10-05T11:43:18.145 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libglvnd-1:1.3.4-1.el9.x86_64 63/130 2023-10-05T11:43:18.145 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libglvnd-egl-1:1.3.4-1.el9.x86_64 64/130 2023-10-05T11:43:18.145 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libglvnd-glx-1:1.3.4-1.el9.x86_64 65/130 2023-10-05T11:43:18.145 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libgsf-1.14.47-5.el9.x86_64 66/130 2023-10-05T11:43:18.145 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libgxps-0.3.2-3.el9.x86_64 67/130 2023-10-05T11:43:18.146 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libiptcdata-1.0.5-9.el9.x86_64 68/130 2023-10-05T11:43:18.146 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libldac-2.0.2.3-10.el9.x86_64 69/130 2023-10-05T11:43:18.146 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libnotify-0.7.9-8.el9.x86_64 70/130 2023-10-05T11:43:18.146 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libogg-2:1.3.4-6.el9.x86_64 71/130 2023-10-05T11:43:18.146 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libosinfo-1.10.0-1.el9.x86_64 72/130 2023-10-05T11:43:18.146 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libsbc-1.4-9.el9.x86_64 73/130 2023-10-05T11:43:18.146 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libsndfile-1.0.31-7.el9.x86_64 74/130 2023-10-05T11:43:18.146 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libtheora-1:1.1.1-31.el9.x86_64 75/130 2023-10-05T11:43:18.146 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libtiff-4.4.0-10.el9.x86_64 76/130 2023-10-05T11:43:18.146 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libtool-ltdl-2.4.6-45.el9.x86_64 77/130 2023-10-05T11:43:18.146 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libtracker-sparql-3.1.2-3.el9.x86_64 78/130 2023-10-05T11:43:18.147 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libvisual-1:0.4.0-34.el9.x86_64 79/130 2023-10-05T11:43:18.147 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libvorbis-1:1.3.7-5.el9.x86_64 80/130 2023-10-05T11:43:18.147 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libwayland-client-1.21.0-1.el9.x86_64 81/130 2023-10-05T11:43:18.147 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libwayland-cursor-1.21.0-1.el9.x86_64 82/130 2023-10-05T11:43:18.147 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libwayland-egl-1.21.0-1.el9.x86_64 83/130 2023-10-05T11:43:18.147 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libwayland-server-1.21.0-1.el9.x86_64 84/130 2023-10-05T11:43:18.147 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libwebp-1.2.0-8.el9.x86_64 85/130 2023-10-05T11:43:18.147 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libxkbcommon-1.0.3-4.el9.x86_64 86/130 2023-10-05T11:43:18.147 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libxshmfence-1.3-10.el9.x86_64 87/130 2023-10-05T11:43:18.147 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : low-memory-monitor-2.1-4.el9.x86_64 88/130 2023-10-05T11:43:18.147 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : lua-5.4.4-4.el9.x86_64 89/130 2023-10-05T11:43:18.147 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : lua-posix-35.0-8.el9.x86_64 90/130 2023-10-05T11:43:18.148 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : mesa-libEGL-23.1.4-1.el9.x86_64 91/130 2023-10-05T11:43:18.148 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : mesa-libGL-23.1.4-1.el9.x86_64 92/130 2023-10-05T11:43:18.148 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : mesa-libgbm-23.1.4-1.el9.x86_64 93/130 2023-10-05T11:43:18.148 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : mesa-libglapi-23.1.4-1.el9.x86_64 94/130 2023-10-05T11:43:18.148 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : mesa-vulkan-drivers-23.1.4-1.el9.x86_64 95/130 2023-10-05T11:43:18.148 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : mkfontscale-1.2.1-3.el9.x86_64 96/130 2023-10-05T11:43:18.148 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : openjpeg2-2.4.0-7.el9.x86_64 97/130 2023-10-05T11:43:18.148 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : opus-1.3.1-10.el9.x86_64 98/130 2023-10-05T11:43:18.148 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : orc-0.4.31-6.el9.x86_64 99/130 2023-10-05T11:43:18.148 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : osinfo-db-20230518-1.el9.noarch 100/130 2023-10-05T11:43:18.148 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : osinfo-db-tools-1.10.0-1.el9.x86_64 101/130 2023-10-05T11:43:18.148 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ostree-libs-2023.6-1.el9.x86_64 102/130 2023-10-05T11:43:18.148 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : p11-kit-server-0.24.1-2.el9.x86_64 103/130 2023-10-05T11:43:18.149 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : pipewire-0.3.67-2.el9.x86_64 104/130 2023-10-05T11:43:18.149 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : pipewire-alsa-0.3.67-2.el9.x86_64 105/130 2023-10-05T11:43:18.149 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : pipewire-jack-audio-connection-kit-0.3.67-2.el9. 106/130 2023-10-05T11:43:18.149 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : pipewire-libs-0.3.67-2.el9.x86_64 107/130 2023-10-05T11:43:18.149 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : pipewire-pulseaudio-0.3.67-2.el9.x86_64 108/130 2023-10-05T11:43:18.149 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : poppler-21.01.0-18.el9.x86_64 109/130 2023-10-05T11:43:18.149 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : poppler-data-0.4.9-9.el9.noarch 110/130 2023-10-05T11:43:18.149 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : poppler-glib-21.01.0-18.el9.x86_64 111/130 2023-10-05T11:43:18.149 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : pulseaudio-libs-15.0-2.el9.x86_64 112/130 2023-10-05T11:43:18.149 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : pulseaudio-utils-15.0-2.el9.x86_64 113/130 2023-10-05T11:43:18.149 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : rtkit-0.11-28.el9.x86_64 114/130 2023-10-05T11:43:18.149 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : sound-theme-freedesktop-0.8-17.el9.noarch 115/130 2023-10-05T11:43:18.150 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : totem-pl-parser-3.26.6-2.el9.x86_64 116/130 2023-10-05T11:43:18.150 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : tracker-3.1.2-3.el9.x86_64 117/130 2023-10-05T11:43:18.150 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : tracker-miners-3.1.2-3.el9.x86_64 118/130 2023-10-05T11:43:18.150 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ttmkfdir-3.0.9-65.el9.x86_64 119/130 2023-10-05T11:43:18.150 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : tzdata-java-2023c-1.el9.noarch 120/130 2023-10-05T11:43:18.150 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : upower-0.99.11-11.el9.x86_64 121/130 2023-10-05T11:43:18.150 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : vulkan-loader-1.3.250.1-1.el9.x86_64 122/130 2023-10-05T11:43:18.150 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : webrtc-audio-processing-0.3.1-8.el9.x86_64 123/130 2023-10-05T11:43:18.150 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : wireplumber-0.4.14-1.el9.x86_64 124/130 2023-10-05T11:43:18.150 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : wireplumber-libs-0.4.14-1.el9.x86_64 125/130 2023-10-05T11:43:18.150 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : xdg-dbus-proxy-0.1.3-1.el9.x86_64 126/130 2023-10-05T11:43:18.150 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : xdg-desktop-portal-1.12.4-1.el9.x86_64 127/130 2023-10-05T11:43:18.151 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 128/130 2023-10-05T11:43:18.151 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : xkeyboard-config-2.33-2.el9.noarch 129/130 2023-10-05T11:43:20.218 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : xorg-x11-fonts-Type1-7.5-33.el9.noarch 130/130 2023-10-05T11:43:20.218 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:43:20.218 INFO:teuthology.orchestra.run.smithi012.stdout:Installed: 2023-10-05T11:43:20.218 INFO:teuthology.orchestra.run.smithi012.stdout: ModemManager-glib-1.20.2-1.el9.x86_64 2023-10-05T11:43:20.218 INFO:teuthology.orchestra.run.smithi012.stdout: adwaita-cursor-theme-40.1.1-3.el9.noarch 2023-10-05T11:43:20.218 INFO:teuthology.orchestra.run.smithi012.stdout: adwaita-icon-theme-40.1.1-3.el9.noarch 2023-10-05T11:43:20.218 INFO:teuthology.orchestra.run.smithi012.stdout: alsa-lib-1.2.9-1.el9.x86_64 2023-10-05T11:43:20.218 INFO:teuthology.orchestra.run.smithi012.stdout: at-spi2-atk-2.38.0-4.el9.x86_64 2023-10-05T11:43:20.219 INFO:teuthology.orchestra.run.smithi012.stdout: at-spi2-core-2.40.3-1.el9.x86_64 2023-10-05T11:43:20.219 INFO:teuthology.orchestra.run.smithi012.stdout: atk-2.36.0-5.el9.x86_64 2023-10-05T11:43:20.219 INFO:teuthology.orchestra.run.smithi012.stdout: avahi-glib-0.8-12.el9.x86_64 2023-10-05T11:43:20.219 INFO:teuthology.orchestra.run.smithi012.stdout: bluez-libs-5.63-1.el8.x86_64 2023-10-05T11:43:20.219 INFO:teuthology.orchestra.run.smithi012.stdout: bubblewrap-0.4.1-6.el9.x86_64 2023-10-05T11:43:20.219 INFO:teuthology.orchestra.run.smithi012.stdout: colord-libs-1.4.5-4.el9.x86_64 2023-10-05T11:43:20.219 INFO:teuthology.orchestra.run.smithi012.stdout: copy-jdk-configs-4.0-3.el9.noarch 2023-10-05T11:43:20.219 INFO:teuthology.orchestra.run.smithi012.stdout: cups-libs-1:2.3.3op2-21.el9.x86_64 2023-10-05T11:43:20.219 INFO:teuthology.orchestra.run.smithi012.stdout: dconf-0.40.0-6.el9.x86_64 2023-10-05T11:43:20.219 INFO:teuthology.orchestra.run.smithi012.stdout: exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 2023-10-05T11:43:20.219 INFO:teuthology.orchestra.run.smithi012.stdout: exiv2-0.27.5-2.el9.x86_64 2023-10-05T11:43:20.220 INFO:teuthology.orchestra.run.smithi012.stdout: exiv2-libs-0.27.5-2.el9.x86_64 2023-10-05T11:43:20.220 INFO:teuthology.orchestra.run.smithi012.stdout: fdk-aac-free-2.0.0-8.el9.x86_64 2023-10-05T11:43:20.220 INFO:teuthology.orchestra.run.smithi012.stdout: flac-libs-1.3.3-12.el9.x86_64 2023-10-05T11:43:20.220 INFO:teuthology.orchestra.run.smithi012.stdout: flatpak-1.12.8-1.el9.x86_64 2023-10-05T11:43:20.220 INFO:teuthology.orchestra.run.smithi012.stdout: flatpak-selinux-1.12.8-1.el9.noarch 2023-10-05T11:43:20.220 INFO:teuthology.orchestra.run.smithi012.stdout: flatpak-session-helper-1.12.8-1.el9.x86_64 2023-10-05T11:43:20.220 INFO:teuthology.orchestra.run.smithi012.stdout: gdk-pixbuf2-modules-2.42.6-3.el9.x86_64 2023-10-05T11:43:20.220 INFO:teuthology.orchestra.run.smithi012.stdout: geoclue2-2.6.0-7.el9.x86_64 2023-10-05T11:43:20.220 INFO:teuthology.orchestra.run.smithi012.stdout: giflib-5.2.1-9.el9.x86_64 2023-10-05T11:43:20.220 INFO:teuthology.orchestra.run.smithi012.stdout: graphene-1.10.6-2.el9.x86_64 2023-10-05T11:43:20.221 INFO:teuthology.orchestra.run.smithi012.stdout: gsm-1.0.19-6.el9.x86_64 2023-10-05T11:43:20.221 INFO:teuthology.orchestra.run.smithi012.stdout: gstreamer1-1.22.1-2.el9.x86_64 2023-10-05T11:43:20.221 INFO:teuthology.orchestra.run.smithi012.stdout: gstreamer1-plugins-base-1.22.1-1.el9.x86_64 2023-10-05T11:43:20.221 INFO:teuthology.orchestra.run.smithi012.stdout: gtk-update-icon-cache-3.24.31-2.el9.x86_64 2023-10-05T11:43:20.221 INFO:teuthology.orchestra.run.smithi012.stdout: gtk2-2.24.33-8.el9.x86_64 2023-10-05T11:43:20.221 INFO:teuthology.orchestra.run.smithi012.stdout: gtk3-3.24.31-2.el9.x86_64 2023-10-05T11:43:20.221 INFO:teuthology.orchestra.run.smithi012.stdout: hicolor-icon-theme-0.17-13.el9.noarch 2023-10-05T11:43:20.221 INFO:teuthology.orchestra.run.smithi012.stdout: iso-codes-4.6.0-3.el9.noarch 2023-10-05T11:43:20.221 INFO:teuthology.orchestra.run.smithi012.stdout: java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 2023-10-05T11:43:20.221 INFO:teuthology.orchestra.run.smithi012.stdout: java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x86_64 2023-10-05T11:43:20.222 INFO:teuthology.orchestra.run.smithi012.stdout: java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x86_64 2023-10-05T11:43:20.222 INFO:teuthology.orchestra.run.smithi012.stdout: javapackages-filesystem-5.3.0-1.module_el8.0.0+11+5b8c10bd.noarch 2023-10-05T11:43:20.222 INFO:teuthology.orchestra.run.smithi012.stdout: jbigkit-libs-2.1-23.el9.x86_64 2023-10-05T11:43:20.222 INFO:teuthology.orchestra.run.smithi012.stdout: lcms2-2.12-3.el9.x86_64 2023-10-05T11:43:20.222 INFO:teuthology.orchestra.run.smithi012.stdout: libX11-xcb-1.7.0-8.el9.x86_64 2023-10-05T11:43:20.222 INFO:teuthology.orchestra.run.smithi012.stdout: libXcomposite-0.4.5-7.el9.x86_64 2023-10-05T11:43:20.222 INFO:teuthology.orchestra.run.smithi012.stdout: libXcursor-1.2.0-7.el9.x86_64 2023-10-05T11:43:20.222 INFO:teuthology.orchestra.run.smithi012.stdout: libXdamage-1.1.5-7.el9.x86_64 2023-10-05T11:43:20.222 INFO:teuthology.orchestra.run.smithi012.stdout: libXfixes-5.0.3-16.el9.x86_64 2023-10-05T11:43:20.222 INFO:teuthology.orchestra.run.smithi012.stdout: libXi-1.7.10-8.el9.x86_64 2023-10-05T11:43:20.223 INFO:teuthology.orchestra.run.smithi012.stdout: libXinerama-1.1.4-10.el9.x86_64 2023-10-05T11:43:20.223 INFO:teuthology.orchestra.run.smithi012.stdout: libXrandr-1.5.2-8.el9.x86_64 2023-10-05T11:43:20.223 INFO:teuthology.orchestra.run.smithi012.stdout: libXtst-1.2.3-16.el9.x86_64 2023-10-05T11:43:20.223 INFO:teuthology.orchestra.run.smithi012.stdout: libXv-1.0.11-16.el9.x86_64 2023-10-05T11:43:20.223 INFO:teuthology.orchestra.run.smithi012.stdout: libXxf86vm-1.1.4-18.el9.x86_64 2023-10-05T11:43:20.223 INFO:teuthology.orchestra.run.smithi012.stdout: libasyncns-0.8-22.el9.x86_64 2023-10-05T11:43:20.223 INFO:teuthology.orchestra.run.smithi012.stdout: libcanberra-0.30-27.el9.x86_64 2023-10-05T11:43:20.223 INFO:teuthology.orchestra.run.smithi012.stdout: libcanberra-gtk2-0.30-27.el9.x86_64 2023-10-05T11:43:20.223 INFO:teuthology.orchestra.run.smithi012.stdout: libcanberra-gtk3-0.30-27.el9.x86_64 2023-10-05T11:43:20.223 INFO:teuthology.orchestra.run.smithi012.stdout: libdrm-2.4.115-1.el9.x86_64 2023-10-05T11:43:20.224 INFO:teuthology.orchestra.run.smithi012.stdout: libepoxy-1.5.8-1.el8.x86_64 2023-10-05T11:43:20.224 INFO:teuthology.orchestra.run.smithi012.stdout: libexif-0.6.22-6.el9.x86_64 2023-10-05T11:43:20.224 INFO:teuthology.orchestra.run.smithi012.stdout: libfontenc-1.1.3-17.el9.x86_64 2023-10-05T11:43:20.224 INFO:teuthology.orchestra.run.smithi012.stdout: libgexiv2-0.12.3-1.el9.x86_64 2023-10-05T11:43:20.224 INFO:teuthology.orchestra.run.smithi012.stdout: libglvnd-1:1.3.4-1.el9.x86_64 2023-10-05T11:43:20.224 INFO:teuthology.orchestra.run.smithi012.stdout: libglvnd-egl-1:1.3.4-1.el9.x86_64 2023-10-05T11:43:20.224 INFO:teuthology.orchestra.run.smithi012.stdout: libglvnd-glx-1:1.3.4-1.el9.x86_64 2023-10-05T11:43:20.224 INFO:teuthology.orchestra.run.smithi012.stdout: libgsf-1.14.47-5.el9.x86_64 2023-10-05T11:43:20.224 INFO:teuthology.orchestra.run.smithi012.stdout: libgxps-0.3.2-3.el9.x86_64 2023-10-05T11:43:20.224 INFO:teuthology.orchestra.run.smithi012.stdout: libiptcdata-1.0.5-9.el9.x86_64 2023-10-05T11:43:20.224 INFO:teuthology.orchestra.run.smithi012.stdout: libldac-2.0.2.3-10.el9.x86_64 2023-10-05T11:43:20.224 INFO:teuthology.orchestra.run.smithi012.stdout: libnotify-0.7.9-8.el9.x86_64 2023-10-05T11:43:20.225 INFO:teuthology.orchestra.run.smithi012.stdout: libogg-2:1.3.4-6.el9.x86_64 2023-10-05T11:43:20.225 INFO:teuthology.orchestra.run.smithi012.stdout: libosinfo-1.10.0-1.el9.x86_64 2023-10-05T11:43:20.225 INFO:teuthology.orchestra.run.smithi012.stdout: libpciaccess-0.16-6.el9.x86_64 2023-10-05T11:43:20.225 INFO:teuthology.orchestra.run.smithi012.stdout: libsbc-1.4-9.el9.x86_64 2023-10-05T11:43:20.225 INFO:teuthology.orchestra.run.smithi012.stdout: libsndfile-1.0.31-7.el9.x86_64 2023-10-05T11:43:20.225 INFO:teuthology.orchestra.run.smithi012.stdout: libtheora-1:1.1.1-31.el9.x86_64 2023-10-05T11:43:20.225 INFO:teuthology.orchestra.run.smithi012.stdout: libtiff-4.4.0-10.el9.x86_64 2023-10-05T11:43:20.225 INFO:teuthology.orchestra.run.smithi012.stdout: libtool-ltdl-2.4.6-45.el9.x86_64 2023-10-05T11:43:20.225 INFO:teuthology.orchestra.run.smithi012.stdout: libtracker-sparql-3.1.2-3.el9.x86_64 2023-10-05T11:43:20.226 INFO:teuthology.orchestra.run.smithi012.stdout: libvisual-1:0.4.0-34.el9.x86_64 2023-10-05T11:43:20.226 INFO:teuthology.orchestra.run.smithi012.stdout: libvorbis-1:1.3.7-5.el9.x86_64 2023-10-05T11:43:20.226 INFO:teuthology.orchestra.run.smithi012.stdout: libwayland-client-1.21.0-1.el9.x86_64 2023-10-05T11:43:20.226 INFO:teuthology.orchestra.run.smithi012.stdout: libwayland-cursor-1.21.0-1.el9.x86_64 2023-10-05T11:43:20.226 INFO:teuthology.orchestra.run.smithi012.stdout: libwayland-egl-1.21.0-1.el9.x86_64 2023-10-05T11:43:20.226 INFO:teuthology.orchestra.run.smithi012.stdout: libwayland-server-1.21.0-1.el9.x86_64 2023-10-05T11:43:20.226 INFO:teuthology.orchestra.run.smithi012.stdout: libwebp-1.2.0-8.el9.x86_64 2023-10-05T11:43:20.226 INFO:teuthology.orchestra.run.smithi012.stdout: libxkbcommon-1.0.3-4.el9.x86_64 2023-10-05T11:43:20.227 INFO:teuthology.orchestra.run.smithi012.stdout: libxshmfence-1.3-10.el9.x86_64 2023-10-05T11:43:20.227 INFO:teuthology.orchestra.run.smithi012.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2023-10-05T11:43:20.227 INFO:teuthology.orchestra.run.smithi012.stdout: low-memory-monitor-2.1-4.el9.x86_64 2023-10-05T11:43:20.228 INFO:teuthology.orchestra.run.smithi012.stdout: lua-5.4.4-4.el9.x86_64 2023-10-05T11:43:20.228 INFO:teuthology.orchestra.run.smithi012.stdout: lua-posix-35.0-8.el9.x86_64 2023-10-05T11:43:20.228 INFO:teuthology.orchestra.run.smithi012.stdout: mesa-libEGL-23.1.4-1.el9.x86_64 2023-10-05T11:43:20.228 INFO:teuthology.orchestra.run.smithi012.stdout: mesa-libGL-23.1.4-1.el9.x86_64 2023-10-05T11:43:20.228 INFO:teuthology.orchestra.run.smithi012.stdout: mesa-libgbm-23.1.4-1.el9.x86_64 2023-10-05T11:43:20.228 INFO:teuthology.orchestra.run.smithi012.stdout: mesa-libglapi-23.1.4-1.el9.x86_64 2023-10-05T11:43:20.228 INFO:teuthology.orchestra.run.smithi012.stdout: mesa-vulkan-drivers-23.1.4-1.el9.x86_64 2023-10-05T11:43:20.228 INFO:teuthology.orchestra.run.smithi012.stdout: mkfontscale-1.2.1-3.el9.x86_64 2023-10-05T11:43:20.229 INFO:teuthology.orchestra.run.smithi012.stdout: openjpeg2-2.4.0-7.el9.x86_64 2023-10-05T11:43:20.229 INFO:teuthology.orchestra.run.smithi012.stdout: opus-1.3.1-10.el9.x86_64 2023-10-05T11:43:20.229 INFO:teuthology.orchestra.run.smithi012.stdout: orc-0.4.31-6.el9.x86_64 2023-10-05T11:43:20.229 INFO:teuthology.orchestra.run.smithi012.stdout: osinfo-db-20230518-1.el9.noarch 2023-10-05T11:43:20.229 INFO:teuthology.orchestra.run.smithi012.stdout: osinfo-db-tools-1.10.0-1.el9.x86_64 2023-10-05T11:43:20.229 INFO:teuthology.orchestra.run.smithi012.stdout: ostree-libs-2023.6-1.el9.x86_64 2023-10-05T11:43:20.229 INFO:teuthology.orchestra.run.smithi012.stdout: p11-kit-server-0.24.1-2.el9.x86_64 2023-10-05T11:43:20.229 INFO:teuthology.orchestra.run.smithi012.stdout: pipewire-0.3.67-2.el9.x86_64 2023-10-05T11:43:20.229 INFO:teuthology.orchestra.run.smithi012.stdout: pipewire-alsa-0.3.67-2.el9.x86_64 2023-10-05T11:43:20.230 INFO:teuthology.orchestra.run.smithi012.stdout: pipewire-jack-audio-connection-kit-0.3.67-2.el9.x86_64 2023-10-05T11:43:20.230 INFO:teuthology.orchestra.run.smithi012.stdout: pipewire-libs-0.3.67-2.el9.x86_64 2023-10-05T11:43:20.230 INFO:teuthology.orchestra.run.smithi012.stdout: pipewire-pulseaudio-0.3.67-2.el9.x86_64 2023-10-05T11:43:20.230 INFO:teuthology.orchestra.run.smithi012.stdout: poppler-21.01.0-18.el9.x86_64 2023-10-05T11:43:20.230 INFO:teuthology.orchestra.run.smithi012.stdout: poppler-data-0.4.9-9.el9.noarch 2023-10-05T11:43:20.230 INFO:teuthology.orchestra.run.smithi012.stdout: poppler-glib-21.01.0-18.el9.x86_64 2023-10-05T11:43:20.230 INFO:teuthology.orchestra.run.smithi012.stdout: pulseaudio-libs-15.0-2.el9.x86_64 2023-10-05T11:43:20.230 INFO:teuthology.orchestra.run.smithi012.stdout: pulseaudio-utils-15.0-2.el9.x86_64 2023-10-05T11:43:20.230 INFO:teuthology.orchestra.run.smithi012.stdout: rtkit-0.11-28.el9.x86_64 2023-10-05T11:43:20.230 INFO:teuthology.orchestra.run.smithi012.stdout: sound-theme-freedesktop-0.8-17.el9.noarch 2023-10-05T11:43:20.230 INFO:teuthology.orchestra.run.smithi012.stdout: totem-pl-parser-3.26.6-2.el9.x86_64 2023-10-05T11:43:20.231 INFO:teuthology.orchestra.run.smithi012.stdout: tracker-3.1.2-3.el9.x86_64 2023-10-05T11:43:20.231 INFO:teuthology.orchestra.run.smithi012.stdout: tracker-miners-3.1.2-3.el9.x86_64 2023-10-05T11:43:20.231 INFO:teuthology.orchestra.run.smithi012.stdout: ttmkfdir-3.0.9-65.el9.x86_64 2023-10-05T11:43:20.231 INFO:teuthology.orchestra.run.smithi012.stdout: tzdata-java-2023c-1.el9.noarch 2023-10-05T11:43:20.231 INFO:teuthology.orchestra.run.smithi012.stdout: upower-0.99.11-11.el9.x86_64 2023-10-05T11:43:20.231 INFO:teuthology.orchestra.run.smithi012.stdout: vulkan-loader-1.3.250.1-1.el9.x86_64 2023-10-05T11:43:20.231 INFO:teuthology.orchestra.run.smithi012.stdout: webrtc-audio-processing-0.3.1-8.el9.x86_64 2023-10-05T11:43:20.231 INFO:teuthology.orchestra.run.smithi012.stdout: wireplumber-0.4.14-1.el9.x86_64 2023-10-05T11:43:20.231 INFO:teuthology.orchestra.run.smithi012.stdout: wireplumber-libs-0.4.14-1.el9.x86_64 2023-10-05T11:43:20.231 INFO:teuthology.orchestra.run.smithi012.stdout: xdg-dbus-proxy-0.1.3-1.el9.x86_64 2023-10-05T11:43:20.231 INFO:teuthology.orchestra.run.smithi012.stdout: xdg-desktop-portal-1.12.4-1.el9.x86_64 2023-10-05T11:43:20.232 INFO:teuthology.orchestra.run.smithi012.stdout: xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 2023-10-05T11:43:20.232 INFO:teuthology.orchestra.run.smithi012.stdout: xkeyboard-config-2.33-2.el9.noarch 2023-10-05T11:43:20.232 INFO:teuthology.orchestra.run.smithi012.stdout: xorg-x11-fonts-Type1-7.5-33.el9.noarch 2023-10-05T11:43:20.232 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:43:20.232 INFO:teuthology.orchestra.run.smithi012.stdout:Complete! 2023-10-05T11:43:20.575 INFO:teuthology.orchestra.run.smithi012.stdout: Gradle will be installed under /opt/gradle 2023-10-05T11:43:20.617 INFO:teuthology.orchestra.run.smithi012.stderr:--2023-10-05 11:43:20-- https://services.gradle.org/distributions/gradle-6.0.1-bin.zip 2023-10-05T11:43:20.813 INFO:teuthology.orchestra.run.smithi012.stderr:Resolving services.gradle.org (services.gradle.org)... 104.17.129.37, 104.17.128.37, 2606:4700::6811:8125, ... 2023-10-05T11:43:20.854 INFO:teuthology.orchestra.run.smithi012.stderr:Connecting to services.gradle.org (services.gradle.org)|104.17.129.37|:443... connected. 2023-10-05T11:43:20.964 INFO:teuthology.orchestra.run.smithi012.stderr:HTTP request sent, awaiting response... 301 Moved Permanently 2023-10-05T11:43:20.964 INFO:teuthology.orchestra.run.smithi012.stderr:Location: https://downloads.gradle.org/distributions/gradle-6.0.1-bin.zip [following] 2023-10-05T11:43:20.964 INFO:teuthology.orchestra.run.smithi012.stderr:--2023-10-05 11:43:20-- https://downloads.gradle.org/distributions/gradle-6.0.1-bin.zip 2023-10-05T11:43:20.975 INFO:teuthology.orchestra.run.smithi012.stderr:Resolving downloads.gradle.org (downloads.gradle.org)... 104.17.128.37, 104.17.129.37, 2606:4700::6811:8125, ... 2023-10-05T11:43:20.984 INFO:teuthology.orchestra.run.smithi012.stderr:Connecting to downloads.gradle.org (downloads.gradle.org)|104.17.128.37|:443... connected. 2023-10-05T11:43:21.039 INFO:teuthology.orchestra.run.smithi012.stderr:HTTP request sent, awaiting response... 200 OK 2023-10-05T11:43:21.040 INFO:teuthology.orchestra.run.smithi012.stderr:Length: 95129672 (91M) [application/zip] 2023-10-05T11:43:21.040 INFO:teuthology.orchestra.run.smithi012.stderr:Saving to: ‘gradle-6.0.1-bin.zip’ 2023-10-05T11:43:21.040 INFO:teuthology.orchestra.run.smithi012.stderr: 2023-10-05T11:43:21.041 INFO:teuthology.orchestra.run.smithi012.stderr: 0K .......... .......... .......... .......... .......... 0% 65.0M 1s 2023-10-05T11:43:21.044 INFO:teuthology.orchestra.run.smithi012.stderr: 50K .......... .......... .......... .......... .......... 0% 5.35M 9s 2023-10-05T11:43:21.054 INFO:teuthology.orchestra.run.smithi012.stderr: 100K .......... .......... .......... .......... .......... 0% 5.78M 11s 2023-10-05T11:43:21.054 INFO:teuthology.orchestra.run.smithi012.stderr: 150K .......... .......... .......... .......... .......... 0% 63.6M 9s 2023-10-05T11:43:21.054 INFO:teuthology.orchestra.run.smithi012.stderr: 200K .......... .......... .......... .......... .......... 0% 104M 7s 2023-10-05T11:43:21.066 INFO:teuthology.orchestra.run.smithi012.stderr: 250K .......... .......... .......... .......... .......... 0% 6.31M 8s 2023-10-05T11:43:21.066 INFO:teuthology.orchestra.run.smithi012.stderr: 300K .......... .......... .......... .......... .......... 0% 98.5M 7s 2023-10-05T11:43:21.066 INFO:teuthology.orchestra.run.smithi012.stderr: 350K .......... .......... .......... .......... .......... 0% 81.6M 7s 2023-10-05T11:43:21.066 INFO:teuthology.orchestra.run.smithi012.stderr: 400K .......... .......... .......... .......... .......... 0% 73.3M 6s 2023-10-05T11:43:21.067 INFO:teuthology.orchestra.run.smithi012.stderr: 450K .......... .......... .......... .......... .......... 0% 113M 5s 2023-10-05T11:43:21.067 INFO:teuthology.orchestra.run.smithi012.stderr: 500K .......... .......... .......... .......... .......... 0% 102M 5s 2023-10-05T11:43:21.067 INFO:teuthology.orchestra.run.smithi012.stderr: 550K .......... .......... .......... .......... .......... 0% 63.8M 5s 2023-10-05T11:43:22.369 INFO:teuthology.orchestra.run.smithi012.stderr: 600K .......... .......... .......... .......... .......... 0% 9.73M 5s 2023-10-05T11:43:22.369 INFO:teuthology.orchestra.run.smithi012.stderr: 650K .......... .......... .......... .......... .......... 0% 111M 5s 2023-10-05T11:43:22.369 INFO:teuthology.orchestra.run.smithi012.stderr: 700K .......... .......... .......... .......... .......... 0% 75.3M 5s 2023-10-05T11:43:22.369 INFO:teuthology.orchestra.run.smithi012.stderr: 750K .......... .......... .......... .......... .......... 0% 53.8M 4s 2023-10-05T11:43:22.369 INFO:teuthology.orchestra.run.smithi012.stderr: 800K .......... .......... .......... .......... .......... 0% 116M 4s 2023-10-05T11:43:22.369 INFO:teuthology.orchestra.run.smithi012.stderr: 850K .......... .......... .......... .......... .......... 0% 112M 4s 2023-10-05T11:43:22.370 INFO:teuthology.orchestra.run.smithi012.stderr: 900K .......... .......... .......... .......... .......... 1% 119M 4s 2023-10-05T11:43:22.370 INFO:teuthology.orchestra.run.smithi012.stderr: 950K .......... .......... .......... .......... .......... 1% 106M 4s 2023-10-05T11:43:22.370 INFO:teuthology.orchestra.run.smithi012.stderr: 1000K .......... .......... .......... .......... .......... 1% 113M 3s 2023-10-05T11:43:22.370 INFO:teuthology.orchestra.run.smithi012.stderr: 1050K .......... .......... .......... .......... .......... 1% 109M 3s 2023-10-05T11:43:22.370 INFO:teuthology.orchestra.run.smithi012.stderr: 1100K .......... .......... .......... .......... .......... 1% 123M 3s 2023-10-05T11:43:22.370 INFO:teuthology.orchestra.run.smithi012.stderr: 1150K .......... .......... .......... .......... .......... 1% 87.9M 3s 2023-10-05T11:43:22.370 INFO:teuthology.orchestra.run.smithi012.stderr: 1200K .......... .......... .......... .......... .......... 1% 116M 3s 2023-10-05T11:43:22.370 INFO:teuthology.orchestra.run.smithi012.stderr: 1250K .......... .......... .......... .......... .......... 1% 101M 3s 2023-10-05T11:43:22.370 INFO:teuthology.orchestra.run.smithi012.stderr: 1300K .......... .......... .......... .......... .......... 1% 63.5M 3s 2023-10-05T11:43:22.370 INFO:teuthology.orchestra.run.smithi012.stderr: 1350K .......... .......... .......... .......... .......... 1% 95.7M 3s 2023-10-05T11:43:22.370 INFO:teuthology.orchestra.run.smithi012.stderr: 1400K .......... .......... .......... .......... .......... 1% 73.5M 3s 2023-10-05T11:43:22.370 INFO:teuthology.orchestra.run.smithi012.stderr: 1450K .......... .......... .......... .......... .......... 1% 33.0M 3s 2023-10-05T11:43:22.371 INFO:teuthology.orchestra.run.smithi012.stderr: 1500K .......... .......... .......... .......... .......... 1% 120M 3s 2023-10-05T11:43:22.371 INFO:teuthology.orchestra.run.smithi012.stderr: 1550K .......... .......... .......... .......... .......... 1% 83.3M 3s 2023-10-05T11:43:22.371 INFO:teuthology.orchestra.run.smithi012.stderr: 1600K .......... .......... .......... .......... .......... 1% 104M 3s 2023-10-05T11:43:22.371 INFO:teuthology.orchestra.run.smithi012.stderr: 1650K .......... .......... .......... .......... .......... 1% 92.7M 3s 2023-10-05T11:43:22.371 INFO:teuthology.orchestra.run.smithi012.stderr: 1700K .......... .......... .......... .......... .......... 1% 130M 3s 2023-10-05T11:43:22.371 INFO:teuthology.orchestra.run.smithi012.stderr: 1750K .......... .......... .......... .......... .......... 1% 101M 2s 2023-10-05T11:43:22.371 INFO:teuthology.orchestra.run.smithi012.stderr: 1800K .......... .......... .......... .......... .......... 1% 115M 2s 2023-10-05T11:43:22.371 INFO:teuthology.orchestra.run.smithi012.stderr: 1850K .......... .......... .......... .......... .......... 2% 83.9M 2s 2023-10-05T11:43:22.371 INFO:teuthology.orchestra.run.smithi012.stderr: 1900K .......... .......... .......... .......... .......... 2% 136M 2s 2023-10-05T11:43:22.371 INFO:teuthology.orchestra.run.smithi012.stderr: 1950K .......... .......... .......... .......... .......... 2% 88.1M 2s 2023-10-05T11:43:22.371 INFO:teuthology.orchestra.run.smithi012.stderr: 2000K .......... .......... .......... .......... .......... 2% 113M 2s 2023-10-05T11:43:22.372 INFO:teuthology.orchestra.run.smithi012.stderr: 2050K .......... .......... .......... .......... .......... 2% 118M 2s 2023-10-05T11:43:22.372 INFO:teuthology.orchestra.run.smithi012.stderr: 2100K .......... .......... .......... .......... .......... 2% 115M 2s 2023-10-05T11:43:22.372 INFO:teuthology.orchestra.run.smithi012.stderr: 2150K .......... .......... .......... .......... .......... 2% 112M 2s 2023-10-05T11:43:22.372 INFO:teuthology.orchestra.run.smithi012.stderr: 2200K .......... .......... .......... .......... .......... 2% 108M 2s 2023-10-05T11:43:22.372 INFO:teuthology.orchestra.run.smithi012.stderr: 2250K .......... .......... .......... .......... .......... 2% 112M 2s 2023-10-05T11:43:22.372 INFO:teuthology.orchestra.run.smithi012.stderr: 2300K .......... .......... .......... .......... .......... 2% 115M 2s 2023-10-05T11:43:22.372 INFO:teuthology.orchestra.run.smithi012.stderr: 2350K .......... .......... .......... .......... .......... 2% 86.5M 2s 2023-10-05T11:43:22.372 INFO:teuthology.orchestra.run.smithi012.stderr: 2400K .......... .......... .......... .......... .......... 2% 115M 2s 2023-10-05T11:43:22.372 INFO:teuthology.orchestra.run.smithi012.stderr: 2450K .......... .......... .......... .......... .......... 2% 112M 2s 2023-10-05T11:43:22.372 INFO:teuthology.orchestra.run.smithi012.stderr: 2500K .......... .......... .......... .......... .......... 2% 125M 2s 2023-10-05T11:43:22.372 INFO:teuthology.orchestra.run.smithi012.stderr: 2550K .......... .......... .......... .......... .......... 2% 107M 2s 2023-10-05T11:43:22.372 INFO:teuthology.orchestra.run.smithi012.stderr: 2600K .......... .......... .......... .......... .......... 2% 119M 2s 2023-10-05T11:43:22.373 INFO:teuthology.orchestra.run.smithi012.stderr: 2650K .......... .......... .......... .......... .......... 2% 109M 2s 2023-10-05T11:43:22.373 INFO:teuthology.orchestra.run.smithi012.stderr: 2700K .......... .......... .......... .......... .......... 2% 121M 2s 2023-10-05T11:43:22.373 INFO:teuthology.orchestra.run.smithi012.stderr: 2750K .......... .......... .......... .......... .......... 3% 85.9M 2s 2023-10-05T11:43:22.373 INFO:teuthology.orchestra.run.smithi012.stderr: 2800K .......... .......... .......... .......... .......... 3% 91.9M 2s 2023-10-05T11:43:22.373 INFO:teuthology.orchestra.run.smithi012.stderr: 2850K .......... .......... .......... .......... .......... 3% 137M 2s 2023-10-05T11:43:22.373 INFO:teuthology.orchestra.run.smithi012.stderr: 2900K .......... .......... .......... .......... .......... 3% 138M 2s 2023-10-05T11:43:22.373 INFO:teuthology.orchestra.run.smithi012.stderr: 2950K .......... .......... .......... .......... .......... 3% 109M 2s 2023-10-05T11:43:22.373 INFO:teuthology.orchestra.run.smithi012.stderr: 3000K .......... .......... .......... .......... .......... 3% 117M 2s 2023-10-05T11:43:22.373 INFO:teuthology.orchestra.run.smithi012.stderr: 3050K .......... .......... .......... .......... .......... 3% 119M 2s 2023-10-05T11:43:22.373 INFO:teuthology.orchestra.run.smithi012.stderr: 3100K .......... .......... .......... .......... .......... 3% 112M 2s 2023-10-05T11:43:22.373 INFO:teuthology.orchestra.run.smithi012.stderr: 3150K .......... .......... .......... .......... .......... 3% 82.4M 2s 2023-10-05T11:43:22.373 INFO:teuthology.orchestra.run.smithi012.stderr: 3200K .......... .......... .......... .......... .......... 3% 113M 2s 2023-10-05T11:43:22.374 INFO:teuthology.orchestra.run.smithi012.stderr: 3250K .......... .......... .......... .......... .......... 3% 126M 2s 2023-10-05T11:43:22.374 INFO:teuthology.orchestra.run.smithi012.stderr: 3300K .......... .......... .......... .......... .......... 3% 119M 2s 2023-10-05T11:43:22.374 INFO:teuthology.orchestra.run.smithi012.stderr: 3350K .......... .......... .......... .......... .......... 3% 110M 2s 2023-10-05T11:43:22.374 INFO:teuthology.orchestra.run.smithi012.stderr: 3400K .......... .......... .......... .......... .......... 3% 81.8M 2s 2023-10-05T11:43:22.374 INFO:teuthology.orchestra.run.smithi012.stderr: 3450K .......... .......... .......... .......... .......... 3% 116M 2s 2023-10-05T11:43:22.374 INFO:teuthology.orchestra.run.smithi012.stderr: 3500K .......... .......... .......... .......... .......... 3% 122M 2s 2023-10-05T11:43:22.374 INFO:teuthology.orchestra.run.smithi012.stderr: 3550K .......... .......... .......... .......... .......... 3% 70.3M 2s 2023-10-05T11:43:22.374 INFO:teuthology.orchestra.run.smithi012.stderr: 3600K .......... .......... .......... .......... .......... 3% 69.5M 2s 2023-10-05T11:43:22.374 INFO:teuthology.orchestra.run.smithi012.stderr: 3650K .......... .......... .......... .......... .......... 3% 87.9M 2s 2023-10-05T11:43:22.374 INFO:teuthology.orchestra.run.smithi012.stderr: 3700K .......... .......... .......... .......... .......... 4% 111M 2s 2023-10-05T11:43:22.374 INFO:teuthology.orchestra.run.smithi012.stderr: 3750K .......... .......... .......... .......... .......... 4% 121M 2s 2023-10-05T11:43:22.374 INFO:teuthology.orchestra.run.smithi012.stderr: 3800K .......... .......... .......... .......... .......... 4% 83.6M 2s 2023-10-05T11:43:22.375 INFO:teuthology.orchestra.run.smithi012.stderr: 3850K .......... .......... .......... .......... .......... 4% 122M 2s 2023-10-05T11:43:22.375 INFO:teuthology.orchestra.run.smithi012.stderr: 3900K .......... .......... .......... .......... .......... 4% 114M 2s 2023-10-05T11:43:22.375 INFO:teuthology.orchestra.run.smithi012.stderr: 3950K .......... .......... .......... .......... .......... 4% 90.7M 2s 2023-10-05T11:43:22.375 INFO:teuthology.orchestra.run.smithi012.stderr: 4000K .......... .......... .......... .......... .......... 4% 97.8M 2s 2023-10-05T11:43:22.375 INFO:teuthology.orchestra.run.smithi012.stderr: 4050K .......... .......... .......... .......... .......... 4% 96.2M 2s 2023-10-05T11:43:22.375 INFO:teuthology.orchestra.run.smithi012.stderr: 4100K .......... .......... .......... .......... .......... 4% 115M 2s 2023-10-05T11:43:22.375 INFO:teuthology.orchestra.run.smithi012.stderr: 4150K .......... .......... .......... .......... .......... 4% 109M 1s 2023-10-05T11:43:22.375 INFO:teuthology.orchestra.run.smithi012.stderr: 4200K .......... .......... .......... .......... .......... 4% 89.9M 1s 2023-10-05T11:43:22.375 INFO:teuthology.orchestra.run.smithi012.stderr: 4250K .......... .......... .......... .......... .......... 4% 94.1M 1s 2023-10-05T11:43:22.375 INFO:teuthology.orchestra.run.smithi012.stderr: 4300K .......... .......... .......... .......... .......... 4% 140M 1s 2023-10-05T11:43:22.375 INFO:teuthology.orchestra.run.smithi012.stderr: 4350K .......... .......... .......... .......... .......... 4% 91.7M 1s 2023-10-05T11:43:22.375 INFO:teuthology.orchestra.run.smithi012.stderr: 4400K .......... .......... .......... .......... .......... 4% 111M 1s 2023-10-05T11:43:22.376 INFO:teuthology.orchestra.run.smithi012.stderr: 4450K .......... .......... .......... .......... .......... 4% 86.8M 1s 2023-10-05T11:43:22.376 INFO:teuthology.orchestra.run.smithi012.stderr: 4500K .......... .......... .......... .......... .......... 4% 111M 1s 2023-10-05T11:43:22.376 INFO:teuthology.orchestra.run.smithi012.stderr: 4550K .......... .......... .......... .......... .......... 4% 110M 1s 2023-10-05T11:43:22.376 INFO:teuthology.orchestra.run.smithi012.stderr: 4600K .......... .......... .......... .......... .......... 5% 104M 1s 2023-10-05T11:43:22.376 INFO:teuthology.orchestra.run.smithi012.stderr: 4650K .......... .......... .......... .......... .......... 5% 97.2M 1s 2023-10-05T11:43:22.376 INFO:teuthology.orchestra.run.smithi012.stderr: 4700K .......... .......... .......... .......... .......... 5% 91.0M 1s 2023-10-05T11:43:22.376 INFO:teuthology.orchestra.run.smithi012.stderr: 4750K .......... .......... .......... .......... .......... 5% 91.3M 1s 2023-10-05T11:43:22.376 INFO:teuthology.orchestra.run.smithi012.stderr: 4800K .......... .......... .......... .......... .......... 5% 90.2M 1s 2023-10-05T11:43:22.376 INFO:teuthology.orchestra.run.smithi012.stderr: 4850K .......... .......... .......... .......... .......... 5% 114M 1s 2023-10-05T11:43:22.376 INFO:teuthology.orchestra.run.smithi012.stderr: 4900K .......... .......... .......... .......... .......... 5% 108M 1s 2023-10-05T11:43:22.376 INFO:teuthology.orchestra.run.smithi012.stderr: 4950K .......... .......... .......... .......... .......... 5% 115M 1s 2023-10-05T11:43:22.376 INFO:teuthology.orchestra.run.smithi012.stderr: 5000K .......... .......... .......... .......... .......... 5% 54.4M 1s 2023-10-05T11:43:22.377 INFO:teuthology.orchestra.run.smithi012.stderr: 5050K .......... .......... .......... .......... .......... 5% 114M 1s 2023-10-05T11:43:22.377 INFO:teuthology.orchestra.run.smithi012.stderr: 5100K .......... .......... .......... .......... .......... 5% 121M 1s 2023-10-05T11:43:22.377 INFO:teuthology.orchestra.run.smithi012.stderr: 5150K .......... .......... .......... .......... .......... 5% 43.1M 1s 2023-10-05T11:43:22.377 INFO:teuthology.orchestra.run.smithi012.stderr: 5200K .......... .......... .......... .......... .......... 5% 115M 1s 2023-10-05T11:43:22.377 INFO:teuthology.orchestra.run.smithi012.stderr: 5250K .......... .......... .......... .......... .......... 5% 108M 1s 2023-10-05T11:43:22.377 INFO:teuthology.orchestra.run.smithi012.stderr: 5300K .......... .......... .......... .......... .......... 5% 122M 1s 2023-10-05T11:43:22.377 INFO:teuthology.orchestra.run.smithi012.stderr: 5350K .......... .......... .......... .......... .......... 5% 107M 1s 2023-10-05T11:43:22.377 INFO:teuthology.orchestra.run.smithi012.stderr: 5400K .......... .......... .......... .......... .......... 5% 112M 1s 2023-10-05T11:43:22.377 INFO:teuthology.orchestra.run.smithi012.stderr: 5450K .......... .......... .......... .......... .......... 5% 69.3M 1s 2023-10-05T11:43:22.377 INFO:teuthology.orchestra.run.smithi012.stderr: 5500K .......... .......... .......... .......... .......... 5% 104M 1s 2023-10-05T11:43:22.377 INFO:teuthology.orchestra.run.smithi012.stderr: 5550K .......... .......... .......... .......... .......... 6% 92.4M 1s 2023-10-05T11:43:22.377 INFO:teuthology.orchestra.run.smithi012.stderr: 5600K .......... .......... .......... .......... .......... 6% 116M 1s 2023-10-05T11:43:22.378 INFO:teuthology.orchestra.run.smithi012.stderr: 5650K .......... .......... .......... .......... .......... 6% 113M 1s 2023-10-05T11:43:22.378 INFO:teuthology.orchestra.run.smithi012.stderr: 5700K .......... .......... .......... .......... .......... 6% 114M 1s 2023-10-05T11:43:22.378 INFO:teuthology.orchestra.run.smithi012.stderr: 5750K .......... .......... .......... .......... .......... 6% 111M 1s 2023-10-05T11:43:22.378 INFO:teuthology.orchestra.run.smithi012.stderr: 5800K .......... .......... .......... .......... .......... 6% 120M 1s 2023-10-05T11:43:22.378 INFO:teuthology.orchestra.run.smithi012.stderr: 5850K .......... .......... .......... .......... .......... 6% 118M 1s 2023-10-05T11:43:22.378 INFO:teuthology.orchestra.run.smithi012.stderr: 5900K .......... .......... .......... .......... .......... 6% 112M 1s 2023-10-05T11:43:22.378 INFO:teuthology.orchestra.run.smithi012.stderr: 5950K .......... .......... .......... .......... .......... 6% 80.6M 1s 2023-10-05T11:43:22.378 INFO:teuthology.orchestra.run.smithi012.stderr: 6000K .......... .......... .......... .......... .......... 6% 105M 1s 2023-10-05T11:43:22.378 INFO:teuthology.orchestra.run.smithi012.stderr: 6050K .......... .......... .......... .......... .......... 6% 132M 1s 2023-10-05T11:43:22.378 INFO:teuthology.orchestra.run.smithi012.stderr: 6100K .......... .......... .......... .......... .......... 6% 127M 1s 2023-10-05T11:43:22.378 INFO:teuthology.orchestra.run.smithi012.stderr: 6150K .......... .......... .......... .......... .......... 6% 90.5M 1s 2023-10-05T11:43:22.378 INFO:teuthology.orchestra.run.smithi012.stderr: 6200K .......... .......... .......... .......... .......... 6% 125M 1s 2023-10-05T11:43:22.379 INFO:teuthology.orchestra.run.smithi012.stderr: 6250K .......... .......... .......... .......... .......... 6% 125M 1s 2023-10-05T11:43:22.379 INFO:teuthology.orchestra.run.smithi012.stderr: 6300K .......... .......... .......... .......... .......... 6% 95.1M 1s 2023-10-05T11:43:22.379 INFO:teuthology.orchestra.run.smithi012.stderr: 6350K .......... .......... .......... .......... .......... 6% 118M 1s 2023-10-05T11:43:22.379 INFO:teuthology.orchestra.run.smithi012.stderr: 6400K .......... .......... .......... .......... .......... 6% 53.8M 1s 2023-10-05T11:43:22.379 INFO:teuthology.orchestra.run.smithi012.stderr: 6450K .......... .......... .......... .......... .......... 6% 119M 1s 2023-10-05T11:43:22.379 INFO:teuthology.orchestra.run.smithi012.stderr: 6500K .......... .......... .......... .......... .......... 7% 121M 1s 2023-10-05T11:43:22.379 INFO:teuthology.orchestra.run.smithi012.stderr: 6550K .......... .......... .......... .......... .......... 7% 92.9M 1s 2023-10-05T11:43:22.379 INFO:teuthology.orchestra.run.smithi012.stderr: 6600K .......... .......... .......... .......... .......... 7% 131M 1s 2023-10-05T11:43:22.379 INFO:teuthology.orchestra.run.smithi012.stderr: 6650K .......... .......... .......... .......... .......... 7% 104M 1s 2023-10-05T11:43:22.379 INFO:teuthology.orchestra.run.smithi012.stderr: 6700K .......... .......... .......... .......... .......... 7% 116M 1s 2023-10-05T11:43:22.379 INFO:teuthology.orchestra.run.smithi012.stderr: 6750K .......... .......... .......... .......... .......... 7% 71.6M 1s 2023-10-05T11:43:22.379 INFO:teuthology.orchestra.run.smithi012.stderr: 6800K .......... .......... .......... .......... .......... 7% 93.2M 1s 2023-10-05T11:43:22.380 INFO:teuthology.orchestra.run.smithi012.stderr: 6850K .......... .......... .......... .......... .......... 7% 86.7M 1s 2023-10-05T11:43:22.380 INFO:teuthology.orchestra.run.smithi012.stderr: 6900K .......... .......... .......... .......... .......... 7% 96.8M 1s 2023-10-05T11:43:22.380 INFO:teuthology.orchestra.run.smithi012.stderr: 6950K .......... .......... .......... .......... .......... 7% 129M 1s 2023-10-05T11:43:22.380 INFO:teuthology.orchestra.run.smithi012.stderr: 7000K .......... .......... .......... .......... .......... 7% 106M 1s 2023-10-05T11:43:22.380 INFO:teuthology.orchestra.run.smithi012.stderr: 7050K .......... .......... .......... .......... .......... 7% 63.5M 1s 2023-10-05T11:43:22.380 INFO:teuthology.orchestra.run.smithi012.stderr: 7100K .......... .......... .......... .......... .......... 7% 81.3M 1s 2023-10-05T11:43:22.380 INFO:teuthology.orchestra.run.smithi012.stderr: 7150K .......... .......... .......... .......... .......... 7% 83.1M 1s 2023-10-05T11:43:22.380 INFO:teuthology.orchestra.run.smithi012.stderr: 7200K .......... .......... .......... .......... .......... 7% 93.2M 1s 2023-10-05T11:43:22.380 INFO:teuthology.orchestra.run.smithi012.stderr: 7250K .......... .......... .......... .......... .......... 7% 72.0M 1s 2023-10-05T11:43:22.380 INFO:teuthology.orchestra.run.smithi012.stderr: 7300K .......... .......... .......... .......... .......... 7% 31.3M 1s 2023-10-05T11:43:22.380 INFO:teuthology.orchestra.run.smithi012.stderr: 7350K .......... .......... .......... .......... .......... 7% 109M 1s 2023-10-05T11:43:22.380 INFO:teuthology.orchestra.run.smithi012.stderr: 7400K .......... .......... .......... .......... .......... 8% 71.1M 1s 2023-10-05T11:43:22.381 INFO:teuthology.orchestra.run.smithi012.stderr: 7450K .......... .......... .......... .......... .......... 8% 157M 1s 2023-10-05T11:43:22.381 INFO:teuthology.orchestra.run.smithi012.stderr: 7500K .......... .......... .......... .......... .......... 8% 159M 1s 2023-10-05T11:43:22.381 INFO:teuthology.orchestra.run.smithi012.stderr: 7550K .......... .......... .......... .......... .......... 8% 38.8M 1s 2023-10-05T11:43:22.381 INFO:teuthology.orchestra.run.smithi012.stderr: 7600K .......... .......... .......... .......... .......... 8% 51.1M 1s 2023-10-05T11:43:22.381 INFO:teuthology.orchestra.run.smithi012.stderr: 7650K .......... .......... .......... .......... .......... 8% 70.6M 1s 2023-10-05T11:43:22.381 INFO:teuthology.orchestra.run.smithi012.stderr: 7700K .......... .......... .......... .......... .......... 8% 116M 1s 2023-10-05T11:43:22.381 INFO:teuthology.orchestra.run.smithi012.stderr: 7750K .......... .......... .......... .......... .......... 8% 44.9M 1s 2023-10-05T11:43:22.381 INFO:teuthology.orchestra.run.smithi012.stderr: 7800K .......... .......... .......... .......... .......... 8% 84.9M 1s 2023-10-05T11:43:22.381 INFO:teuthology.orchestra.run.smithi012.stderr: 7850K .......... .......... .......... .......... .......... 8% 43.5M 1s 2023-10-05T11:43:22.381 INFO:teuthology.orchestra.run.smithi012.stderr: 7900K .......... .......... .......... .......... .......... 8% 121M 1s 2023-10-05T11:43:22.381 INFO:teuthology.orchestra.run.smithi012.stderr: 7950K .......... .......... .......... .......... .......... 8% 35.8M 1s 2023-10-05T11:43:22.381 INFO:teuthology.orchestra.run.smithi012.stderr: 8000K .......... .......... .......... .......... .......... 8% 111M 1s 2023-10-05T11:43:22.382 INFO:teuthology.orchestra.run.smithi012.stderr: 8050K .......... .......... .......... .......... .......... 8% 39.4M 1s 2023-10-05T11:43:22.382 INFO:teuthology.orchestra.run.smithi012.stderr: 8100K .......... .......... .......... .......... .......... 8% 37.8M 1s 2023-10-05T11:43:22.382 INFO:teuthology.orchestra.run.smithi012.stderr: 8150K .......... .......... .......... .......... .......... 8% 105M 1s 2023-10-05T11:43:22.382 INFO:teuthology.orchestra.run.smithi012.stderr: 8200K .......... .......... .......... .......... .......... 8% 85.0M 1s 2023-10-05T11:43:22.382 INFO:teuthology.orchestra.run.smithi012.stderr: 8250K .......... .......... .......... .......... .......... 8% 63.8M 1s 2023-10-05T11:43:22.382 INFO:teuthology.orchestra.run.smithi012.stderr: 8300K .......... .......... .......... .......... .......... 8% 41.8M 1s 2023-10-05T11:43:22.382 INFO:teuthology.orchestra.run.smithi012.stderr: 8350K .......... .......... .......... .......... .......... 9% 93.2M 1s 2023-10-05T11:43:22.382 INFO:teuthology.orchestra.run.smithi012.stderr: 8400K .......... .......... .......... .......... .......... 9% 50.4M 1s 2023-10-05T11:43:22.382 INFO:teuthology.orchestra.run.smithi012.stderr: 8450K .......... .......... .......... .......... .......... 9% 106M 1s 2023-10-05T11:43:22.382 INFO:teuthology.orchestra.run.smithi012.stderr: 8500K .......... .......... .......... .......... .......... 9% 87.1M 1s 2023-10-05T11:43:22.382 INFO:teuthology.orchestra.run.smithi012.stderr: 8550K .......... .......... .......... .......... .......... 9% 59.5M 1s 2023-10-05T11:43:22.383 INFO:teuthology.orchestra.run.smithi012.stderr: 8600K .......... .......... .......... .......... .......... 9% 70.4M 1s 2023-10-05T11:43:22.383 INFO:teuthology.orchestra.run.smithi012.stderr: 8650K .......... .......... .......... .......... .......... 9% 68.7M 1s 2023-10-05T11:43:22.383 INFO:teuthology.orchestra.run.smithi012.stderr: 8700K .......... .......... .......... .......... .......... 9% 115M 1s 2023-10-05T11:43:22.383 INFO:teuthology.orchestra.run.smithi012.stderr: 8750K .......... .......... .......... .......... .......... 9% 44.7M 1s 2023-10-05T11:43:22.383 INFO:teuthology.orchestra.run.smithi012.stderr: 8800K .......... .......... .......... .......... .......... 9% 114M 1s 2023-10-05T11:43:22.383 INFO:teuthology.orchestra.run.smithi012.stderr: 8850K .......... .......... .......... .......... .......... 9% 48.7M 1s 2023-10-05T11:43:22.383 INFO:teuthology.orchestra.run.smithi012.stderr: 8900K .......... .......... .......... .......... .......... 9% 81.0M 1s 2023-10-05T11:43:22.383 INFO:teuthology.orchestra.run.smithi012.stderr: 8950K .......... .......... .......... .......... .......... 9% 33.7M 1s 2023-10-05T11:43:22.383 INFO:teuthology.orchestra.run.smithi012.stderr: 9000K .......... .......... .......... .......... .......... 9% 39.7M 1s 2023-10-05T11:43:22.383 INFO:teuthology.orchestra.run.smithi012.stderr: 9050K .......... .......... .......... .......... .......... 9% 114M 1s 2023-10-05T11:43:22.383 INFO:teuthology.orchestra.run.smithi012.stderr: 9100K .......... .......... .......... .......... .......... 9% 119M 1s 2023-10-05T11:43:22.383 INFO:teuthology.orchestra.run.smithi012.stderr: 9150K .......... .......... .......... .......... .......... 9% 27.1M 1s 2023-10-05T11:43:22.384 INFO:teuthology.orchestra.run.smithi012.stderr: 9200K .......... .......... .......... .......... .......... 9% 118M 1s 2023-10-05T11:43:22.384 INFO:teuthology.orchestra.run.smithi012.stderr: 9250K .......... .......... .......... .......... .......... 10% 115M 1s 2023-10-05T11:43:22.384 INFO:teuthology.orchestra.run.smithi012.stderr: 9300K .......... .......... .......... .......... .......... 10% 113M 1s 2023-10-05T11:43:22.384 INFO:teuthology.orchestra.run.smithi012.stderr: 9350K .......... .......... .......... .......... .......... 10% 49.0M 1s 2023-10-05T11:43:22.384 INFO:teuthology.orchestra.run.smithi012.stderr: 9400K .......... .......... .......... .......... .......... 10% 89.9M 1s 2023-10-05T11:43:22.384 INFO:teuthology.orchestra.run.smithi012.stderr: 9450K .......... .......... .......... .......... .......... 10% 45.6M 1s 2023-10-05T11:43:22.384 INFO:teuthology.orchestra.run.smithi012.stderr: 9500K .......... .......... .......... .......... .......... 10% 90.6M 1s 2023-10-05T11:43:22.384 INFO:teuthology.orchestra.run.smithi012.stderr: 9550K .......... .......... .......... .......... .......... 10% 44.7M 1s 2023-10-05T11:43:22.384 INFO:teuthology.orchestra.run.smithi012.stderr: 9600K .......... .......... .......... .......... .......... 10% 79.5M 1s 2023-10-05T11:43:22.384 INFO:teuthology.orchestra.run.smithi012.stderr: 9650K .......... .......... .......... .......... .......... 10% 42.0M 1s 2023-10-05T11:43:22.384 INFO:teuthology.orchestra.run.smithi012.stderr: 9700K .......... .......... .......... .......... .......... 10% 78.8M 1s 2023-10-05T11:43:22.384 INFO:teuthology.orchestra.run.smithi012.stderr: 9750K .......... .......... .......... .......... .......... 10% 45.6M 1s 2023-10-05T11:43:22.384 INFO:teuthology.orchestra.run.smithi012.stderr: 9800K .......... .......... .......... .......... .......... 10% 94.7M 1s 2023-10-05T11:43:22.385 INFO:teuthology.orchestra.run.smithi012.stderr: 9850K .......... .......... .......... .......... .......... 10% 136M 1s 2023-10-05T11:43:22.385 INFO:teuthology.orchestra.run.smithi012.stderr: 9900K .......... .......... .......... .......... .......... 10% 128M 1s 2023-10-05T11:43:22.385 INFO:teuthology.orchestra.run.smithi012.stderr: 9950K .......... .......... .......... .......... .......... 10% 77.0M 1s 2023-10-05T11:43:22.385 INFO:teuthology.orchestra.run.smithi012.stderr: 10000K .......... .......... .......... .......... .......... 10% 71.8M 1s 2023-10-05T11:43:22.385 INFO:teuthology.orchestra.run.smithi012.stderr: 10050K .......... .......... .......... .......... .......... 10% 122M 1s 2023-10-05T11:43:22.385 INFO:teuthology.orchestra.run.smithi012.stderr: 10100K .......... .......... .......... .......... .......... 10% 84.9M 1s 2023-10-05T11:43:22.385 INFO:teuthology.orchestra.run.smithi012.stderr: 10150K .......... .......... .......... .......... .......... 10% 56.1M 1s 2023-10-05T11:43:22.385 INFO:teuthology.orchestra.run.smithi012.stderr: 10200K .......... .......... .......... .......... .......... 11% 174M 1s 2023-10-05T11:43:22.385 INFO:teuthology.orchestra.run.smithi012.stderr: 10250K .......... .......... .......... .......... .......... 11% 135M 1s 2023-10-05T11:43:22.385 INFO:teuthology.orchestra.run.smithi012.stderr: 10300K .......... .......... .......... .......... .......... 11% 209M 1s 2023-10-05T11:43:22.385 INFO:teuthology.orchestra.run.smithi012.stderr: 10350K .......... .......... .......... .......... .......... 11% 163M 1s 2023-10-05T11:43:22.385 INFO:teuthology.orchestra.run.smithi012.stderr: 10400K .......... .......... .......... .......... .......... 11% 165M 1s 2023-10-05T11:43:22.386 INFO:teuthology.orchestra.run.smithi012.stderr: 10450K .......... .......... .......... .......... .......... 11% 93.3M 1s 2023-10-05T11:43:22.386 INFO:teuthology.orchestra.run.smithi012.stderr: 10500K .......... .......... .......... .......... .......... 11% 116M 1s 2023-10-05T11:43:22.386 INFO:teuthology.orchestra.run.smithi012.stderr: 10550K .......... .......... .......... .......... .......... 11% 91.7M 1s 2023-10-05T11:43:22.386 INFO:teuthology.orchestra.run.smithi012.stderr: 10600K .......... .......... .......... .......... .......... 11% 90.1M 1s 2023-10-05T11:43:22.386 INFO:teuthology.orchestra.run.smithi012.stderr: 10650K .......... .......... .......... .......... .......... 11% 134M 1s 2023-10-05T11:43:22.386 INFO:teuthology.orchestra.run.smithi012.stderr: 10700K .......... .......... .......... .......... .......... 11% 130M 1s 2023-10-05T11:43:22.386 INFO:teuthology.orchestra.run.smithi012.stderr: 10750K .......... .......... .......... .......... .......... 11% 114M 1s 2023-10-05T11:43:22.386 INFO:teuthology.orchestra.run.smithi012.stderr: 10800K .......... .......... .......... .......... .......... 11% 104M 1s 2023-10-05T11:43:22.386 INFO:teuthology.orchestra.run.smithi012.stderr: 10850K .......... .......... .......... .......... .......... 11% 137M 1s 2023-10-05T11:43:22.386 INFO:teuthology.orchestra.run.smithi012.stderr: 10900K .......... .......... .......... .......... .......... 11% 133M 1s 2023-10-05T11:43:22.386 INFO:teuthology.orchestra.run.smithi012.stderr: 10950K .......... .......... .......... .......... .......... 11% 66.9M 1s 2023-10-05T11:43:22.387 INFO:teuthology.orchestra.run.smithi012.stderr: 11000K .......... .......... .......... .......... .......... 11% 47.2M 1s 2023-10-05T11:43:22.387 INFO:teuthology.orchestra.run.smithi012.stderr: 11050K .......... .......... .......... .......... .......... 11% 66.5M 1s 2023-10-05T11:43:22.387 INFO:teuthology.orchestra.run.smithi012.stderr: 11100K .......... .......... .......... .......... .......... 12% 41.7M 1s 2023-10-05T11:43:22.387 INFO:teuthology.orchestra.run.smithi012.stderr: 11150K .......... .......... .......... .......... .......... 12% 93.0M 1s 2023-10-05T11:43:22.387 INFO:teuthology.orchestra.run.smithi012.stderr: 11200K .......... .......... .......... .......... .......... 12% 50.1M 1s 2023-10-05T11:43:22.387 INFO:teuthology.orchestra.run.smithi012.stderr: 11250K .......... .......... .......... .......... .......... 12% 11.7M 1s 2023-10-05T11:43:22.387 INFO:teuthology.orchestra.run.smithi012.stderr: 11300K .......... .......... .......... .......... .......... 12% 199M 1s 2023-10-05T11:43:22.387 INFO:teuthology.orchestra.run.smithi012.stderr: 11350K .......... .......... .......... .......... .......... 12% 190M 1s 2023-10-05T11:43:22.387 INFO:teuthology.orchestra.run.smithi012.stderr: 11400K .......... .......... .......... .......... .......... 12% 192M 1s 2023-10-05T11:43:22.387 INFO:teuthology.orchestra.run.smithi012.stderr: 11450K .......... .......... .......... .......... .......... 12% 174M 1s 2023-10-05T11:43:22.387 INFO:teuthology.orchestra.run.smithi012.stderr: 11500K .......... .......... .......... .......... .......... 12% 163M 1s 2023-10-05T11:43:22.387 INFO:teuthology.orchestra.run.smithi012.stderr: 11550K .......... .......... .......... .......... .......... 12% 38.7M 1s 2023-10-05T11:43:22.388 INFO:teuthology.orchestra.run.smithi012.stderr: 11600K .......... .......... .......... .......... .......... 12% 124M 1s 2023-10-05T11:43:22.388 INFO:teuthology.orchestra.run.smithi012.stderr: 11650K .......... .......... .......... .......... .......... 12% 54.8M 1s 2023-10-05T11:43:22.388 INFO:teuthology.orchestra.run.smithi012.stderr: 11700K .......... .......... .......... .......... .......... 12% 67.4M 1s 2023-10-05T11:43:22.388 INFO:teuthology.orchestra.run.smithi012.stderr: 11750K .......... .......... .......... .......... .......... 12% 131M 1s 2023-10-05T11:43:22.388 INFO:teuthology.orchestra.run.smithi012.stderr: 11800K .......... .......... .......... .......... .......... 12% 124M 1s 2023-10-05T11:43:22.388 INFO:teuthology.orchestra.run.smithi012.stderr: 11850K .......... .......... .......... .......... .......... 12% 81.7M 1s 2023-10-05T11:43:22.388 INFO:teuthology.orchestra.run.smithi012.stderr: 11900K .......... .......... .......... .......... .......... 12% 40.0M 1s 2023-10-05T11:43:22.388 INFO:teuthology.orchestra.run.smithi012.stderr: 11950K .......... .......... .......... .......... .......... 12% 11.1M 1s 2023-10-05T11:43:22.388 INFO:teuthology.orchestra.run.smithi012.stderr: 12000K .......... .......... .......... .......... .......... 12% 114M 1s 2023-10-05T11:43:22.388 INFO:teuthology.orchestra.run.smithi012.stderr: 12050K .......... .......... .......... .......... .......... 13% 68.1M 1s 2023-10-05T11:43:22.388 INFO:teuthology.orchestra.run.smithi012.stderr: 12100K .......... .......... .......... .......... .......... 13% 47.5M 1s 2023-10-05T11:43:22.388 INFO:teuthology.orchestra.run.smithi012.stderr: 12150K .......... .......... .......... .......... .......... 13% 111M 1s 2023-10-05T11:43:22.389 INFO:teuthology.orchestra.run.smithi012.stderr: 12200K .......... .......... .......... .......... .......... 13% 72.3M 1s 2023-10-05T11:43:22.389 INFO:teuthology.orchestra.run.smithi012.stderr: 12250K .......... .......... .......... .......... .......... 13% 112M 1s 2023-10-05T11:43:22.389 INFO:teuthology.orchestra.run.smithi012.stderr: 12300K .......... .......... .......... .......... .......... 13% 72.4M 1s 2023-10-05T11:43:22.389 INFO:teuthology.orchestra.run.smithi012.stderr: 12350K .......... .......... .......... .......... .......... 13% 60.3M 1s 2023-10-05T11:43:22.389 INFO:teuthology.orchestra.run.smithi012.stderr: 12400K .......... .......... .......... .......... .......... 13% 65.1M 1s 2023-10-05T11:43:22.389 INFO:teuthology.orchestra.run.smithi012.stderr: 12450K .......... .......... .......... .......... .......... 13% 69.3M 1s 2023-10-05T11:43:22.389 INFO:teuthology.orchestra.run.smithi012.stderr: 12500K .......... .......... .......... .......... .......... 13% 120M 1s 2023-10-05T11:43:22.389 INFO:teuthology.orchestra.run.smithi012.stderr: 12550K .......... .......... .......... .......... .......... 13% 66.5M 1s 2023-10-05T11:43:22.389 INFO:teuthology.orchestra.run.smithi012.stderr: 12600K .......... .......... .......... .......... .......... 13% 48.9M 1s 2023-10-05T11:43:22.389 INFO:teuthology.orchestra.run.smithi012.stderr: 12650K .......... .......... .......... .......... .......... 13% 59.4M 1s 2023-10-05T11:43:22.389 INFO:teuthology.orchestra.run.smithi012.stderr: 12700K .......... .......... .......... .......... .......... 13% 87.8M 1s 2023-10-05T11:43:22.389 INFO:teuthology.orchestra.run.smithi012.stderr: 12750K .......... .......... .......... .......... .......... 13% 60.4M 1s 2023-10-05T11:43:22.390 INFO:teuthology.orchestra.run.smithi012.stderr: 12800K .......... .......... .......... .......... .......... 13% 67.6M 1s 2023-10-05T11:43:22.390 INFO:teuthology.orchestra.run.smithi012.stderr: 12850K .......... .......... .......... .......... .......... 13% 68.0M 1s 2023-10-05T11:43:22.390 INFO:teuthology.orchestra.run.smithi012.stderr: 12900K .......... .......... .......... .......... .......... 13% 122M 1s 2023-10-05T11:43:22.390 INFO:teuthology.orchestra.run.smithi012.stderr: 12950K .......... .......... .......... .......... .......... 13% 110M 1s 2023-10-05T11:43:22.390 INFO:teuthology.orchestra.run.smithi012.stderr: 13000K .......... .......... .......... .......... .......... 14% 49.4M 1s 2023-10-05T11:43:22.390 INFO:teuthology.orchestra.run.smithi012.stderr: 13050K .......... .......... .......... .......... .......... 14% 118M 1s 2023-10-05T11:43:22.390 INFO:teuthology.orchestra.run.smithi012.stderr: 13100K .......... .......... .......... .......... .......... 14% 65.6M 1s 2023-10-05T11:43:22.390 INFO:teuthology.orchestra.run.smithi012.stderr: 13150K .......... .......... .......... .......... .......... 14% 93.6M 1s 2023-10-05T11:43:22.390 INFO:teuthology.orchestra.run.smithi012.stderr: 13200K .......... .......... .......... .......... .......... 14% 76.8M 1s 2023-10-05T11:43:22.390 INFO:teuthology.orchestra.run.smithi012.stderr: 13250K .......... .......... .......... .......... .......... 14% 94.6M 1s 2023-10-05T11:43:22.390 INFO:teuthology.orchestra.run.smithi012.stderr: 13300K .......... .......... .......... .......... .......... 14% 127M 1s 2023-10-05T11:43:22.390 INFO:teuthology.orchestra.run.smithi012.stderr: 13350K .......... .......... .......... .......... .......... 14% 65.7M 1s 2023-10-05T11:43:22.391 INFO:teuthology.orchestra.run.smithi012.stderr: 13400K .......... .......... .......... .......... .......... 14% 119M 1s 2023-10-05T11:43:22.391 INFO:teuthology.orchestra.run.smithi012.stderr: 13450K .......... .......... .......... .......... .......... 14% 120M 1s 2023-10-05T11:43:22.391 INFO:teuthology.orchestra.run.smithi012.stderr: 13500K .......... .......... .......... .......... .......... 14% 114M 1s 2023-10-05T11:43:22.391 INFO:teuthology.orchestra.run.smithi012.stderr: 13550K .......... .......... .......... .......... .......... 14% 59.9M 1s 2023-10-05T11:43:22.391 INFO:teuthology.orchestra.run.smithi012.stderr: 13600K .......... .......... .......... .......... .......... 14% 66.8M 1s 2023-10-05T11:43:22.391 INFO:teuthology.orchestra.run.smithi012.stderr: 13650K .......... .......... .......... .......... .......... 14% 120M 1s 2023-10-05T11:43:22.391 INFO:teuthology.orchestra.run.smithi012.stderr: 13700K .......... .......... .......... .......... .......... 14% 115M 1s 2023-10-05T11:43:22.391 INFO:teuthology.orchestra.run.smithi012.stderr: 13750K .......... .......... .......... .......... .......... 14% 69.8M 1s 2023-10-05T11:43:22.391 INFO:teuthology.orchestra.run.smithi012.stderr: 13800K .......... .......... .......... .......... .......... 14% 99.2M 1s 2023-10-05T11:43:22.391 INFO:teuthology.orchestra.run.smithi012.stderr: 13850K .......... .......... .......... .......... .......... 14% 75.4M 1s 2023-10-05T11:43:22.391 INFO:teuthology.orchestra.run.smithi012.stderr: 13900K .......... .......... .......... .......... .......... 15% 110M 1s 2023-10-05T11:43:22.391 INFO:teuthology.orchestra.run.smithi012.stderr: 13950K .......... .......... .......... .......... .......... 15% 59.7M 1s 2023-10-05T11:43:22.392 INFO:teuthology.orchestra.run.smithi012.stderr: 14000K .......... .......... .......... .......... .......... 15% 60.2M 1s 2023-10-05T11:43:22.392 INFO:teuthology.orchestra.run.smithi012.stderr: 14050K .......... .......... .......... .......... .......... 15% 44.6M 1s 2023-10-05T11:43:22.392 INFO:teuthology.orchestra.run.smithi012.stderr: 14100K .......... .......... .......... .......... .......... 15% 105M 1s 2023-10-05T11:43:22.392 INFO:teuthology.orchestra.run.smithi012.stderr: 14150K .......... .......... .......... .......... .......... 15% 54.8M 1s 2023-10-05T11:43:22.392 INFO:teuthology.orchestra.run.smithi012.stderr: 14200K .......... .......... .......... .......... .......... 15% 70.7M 1s 2023-10-05T11:43:22.392 INFO:teuthology.orchestra.run.smithi012.stderr: 14250K .......... .......... .......... .......... .......... 15% 38.5M 1s 2023-10-05T11:43:22.392 INFO:teuthology.orchestra.run.smithi012.stderr: 14300K .......... .......... .......... .......... .......... 15% 31.2M 1s 2023-10-05T11:43:22.392 INFO:teuthology.orchestra.run.smithi012.stderr: 14350K .......... .......... .......... .......... .......... 15% 71.0M 1s 2023-10-05T11:43:22.392 INFO:teuthology.orchestra.run.smithi012.stderr: 14400K .......... .......... .......... .......... .......... 15% 60.6M 1s 2023-10-05T11:43:22.392 INFO:teuthology.orchestra.run.smithi012.stderr: 14450K .......... .......... .......... .......... .......... 15% 83.8M 1s 2023-10-05T11:43:22.392 INFO:teuthology.orchestra.run.smithi012.stderr: 14500K .......... .......... .......... .......... .......... 15% 58.6M 1s 2023-10-05T11:43:22.392 INFO:teuthology.orchestra.run.smithi012.stderr: 14550K .......... .......... .......... .......... .......... 15% 110M 1s 2023-10-05T11:43:22.393 INFO:teuthology.orchestra.run.smithi012.stderr: 14600K .......... .......... .......... .......... .......... 15% 82.1M 1s 2023-10-05T11:43:22.393 INFO:teuthology.orchestra.run.smithi012.stderr: 14650K .......... .......... .......... .......... .......... 15% 59.7M 1s 2023-10-05T11:43:22.393 INFO:teuthology.orchestra.run.smithi012.stderr: 14700K .......... .......... .......... .......... .......... 15% 89.0M 1s 2023-10-05T11:43:22.393 INFO:teuthology.orchestra.run.smithi012.stderr: 14750K .......... .......... .......... .......... .......... 15% 88.6M 1s 2023-10-05T11:43:22.393 INFO:teuthology.orchestra.run.smithi012.stderr: 14800K .......... .......... .......... .......... .......... 15% 113M 1s 2023-10-05T11:43:22.393 INFO:teuthology.orchestra.run.smithi012.stderr: 14850K .......... .......... .......... .......... .......... 16% 108M 1s 2023-10-05T11:43:22.393 INFO:teuthology.orchestra.run.smithi012.stderr: 14900K .......... .......... .......... .......... .......... 16% 47.2M 1s 2023-10-05T11:43:22.393 INFO:teuthology.orchestra.run.smithi012.stderr: 14950K .......... .......... .......... .......... .......... 16% 78.9M 1s 2023-10-05T11:43:22.393 INFO:teuthology.orchestra.run.smithi012.stderr: 15000K .......... .......... .......... .......... .......... 16% 113M 1s 2023-10-05T11:43:22.393 INFO:teuthology.orchestra.run.smithi012.stderr: 15050K .......... .......... .......... .......... .......... 16% 115M 1s 2023-10-05T11:43:22.393 INFO:teuthology.orchestra.run.smithi012.stderr: 15100K .......... .......... .......... .......... .......... 16% 110M 1s 2023-10-05T11:43:22.393 INFO:teuthology.orchestra.run.smithi012.stderr: 15150K .......... .......... .......... .......... .......... 16% 93.0M 1s 2023-10-05T11:43:22.394 INFO:teuthology.orchestra.run.smithi012.stderr: 15200K .......... .......... .......... .......... .......... 16% 117M 1s 2023-10-05T11:43:22.394 INFO:teuthology.orchestra.run.smithi012.stderr: 15250K .......... .......... .......... .......... .......... 16% 110M 1s 2023-10-05T11:43:22.394 INFO:teuthology.orchestra.run.smithi012.stderr: 15300K .......... .......... .......... .......... .......... 16% 112M 1s 2023-10-05T11:43:22.394 INFO:teuthology.orchestra.run.smithi012.stderr: 15350K .......... .......... .......... .......... .......... 16% 100M 1s 2023-10-05T11:43:22.394 INFO:teuthology.orchestra.run.smithi012.stderr: 15400K .......... .......... .......... .......... .......... 16% 100M 1s 2023-10-05T11:43:22.394 INFO:teuthology.orchestra.run.smithi012.stderr: 15450K .......... .......... .......... .......... .......... 16% 113M 1s 2023-10-05T11:43:22.394 INFO:teuthology.orchestra.run.smithi012.stderr: 15500K .......... .......... .......... .......... .......... 16% 117M 1s 2023-10-05T11:43:22.394 INFO:teuthology.orchestra.run.smithi012.stderr: 15550K .......... .......... .......... .......... .......... 16% 83.0M 1s 2023-10-05T11:43:22.394 INFO:teuthology.orchestra.run.smithi012.stderr: 15600K .......... .......... .......... .......... .......... 16% 107M 1s 2023-10-05T11:43:22.394 INFO:teuthology.orchestra.run.smithi012.stderr: 15650K .......... .......... .......... .......... .......... 16% 79.1M 1s 2023-10-05T11:43:22.394 INFO:teuthology.orchestra.run.smithi012.stderr: 15700K .......... .......... .......... .......... .......... 16% 91.7M 1s 2023-10-05T11:43:22.394 INFO:teuthology.orchestra.run.smithi012.stderr: 15750K .......... .......... .......... .......... .......... 17% 104M 1s 2023-10-05T11:43:22.395 INFO:teuthology.orchestra.run.smithi012.stderr: 15800K .......... .......... .......... .......... .......... 17% 112M 1s 2023-10-05T11:43:22.395 INFO:teuthology.orchestra.run.smithi012.stderr: 15850K .......... .......... .......... .......... .......... 17% 110M 1s 2023-10-05T11:43:22.395 INFO:teuthology.orchestra.run.smithi012.stderr: 15900K .......... .......... .......... .......... .......... 17% 115M 1s 2023-10-05T11:43:22.395 INFO:teuthology.orchestra.run.smithi012.stderr: 15950K .......... .......... .......... .......... .......... 17% 50.9M 1s 2023-10-05T11:43:22.395 INFO:teuthology.orchestra.run.smithi012.stderr: 16000K .......... .......... .......... .......... .......... 17% 113M 1s 2023-10-05T11:43:22.395 INFO:teuthology.orchestra.run.smithi012.stderr: 16050K .......... .......... .......... .......... .......... 17% 58.0M 1s 2023-10-05T11:43:22.395 INFO:teuthology.orchestra.run.smithi012.stderr: 16100K .......... .......... .......... .......... .......... 17% 87.2M 1s 2023-10-05T11:43:22.395 INFO:teuthology.orchestra.run.smithi012.stderr: 16150K .......... .......... .......... .......... .......... 17% 19.3M 1s 2023-10-05T11:43:22.395 INFO:teuthology.orchestra.run.smithi012.stderr: 16200K .......... .......... .......... .......... .......... 17% 111M 1s 2023-10-05T11:43:22.395 INFO:teuthology.orchestra.run.smithi012.stderr: 16250K .......... .......... .......... .......... .......... 17% 113M 1s 2023-10-05T11:43:22.395 INFO:teuthology.orchestra.run.smithi012.stderr: 16300K .......... .......... .......... .......... .......... 17% 113M 1s 2023-10-05T11:43:22.395 INFO:teuthology.orchestra.run.smithi012.stderr: 16350K .......... .......... .......... .......... .......... 17% 95.2M 1s 2023-10-05T11:43:22.396 INFO:teuthology.orchestra.run.smithi012.stderr: 16400K .......... .......... .......... .......... .......... 17% 81.9M 1s 2023-10-05T11:43:22.396 INFO:teuthology.orchestra.run.smithi012.stderr: 16450K .......... .......... .......... .......... .......... 17% 114M 1s 2023-10-05T11:43:22.396 INFO:teuthology.orchestra.run.smithi012.stderr: 16500K .......... .......... .......... .......... .......... 17% 66.4M 1s 2023-10-05T11:43:22.396 INFO:teuthology.orchestra.run.smithi012.stderr: 16550K .......... .......... .......... .......... .......... 17% 99.4M 1s 2023-10-05T11:43:22.396 INFO:teuthology.orchestra.run.smithi012.stderr: 16600K .......... .......... .......... .......... .......... 17% 114M 1s 2023-10-05T11:43:22.396 INFO:teuthology.orchestra.run.smithi012.stderr: 16650K .......... .......... .......... .......... .......... 17% 118M 1s 2023-10-05T11:43:22.396 INFO:teuthology.orchestra.run.smithi012.stderr: 16700K .......... .......... .......... .......... .......... 18% 85.1M 1s 2023-10-05T11:43:22.396 INFO:teuthology.orchestra.run.smithi012.stderr: 16750K .......... .......... .......... .......... .......... 18% 52.1M 1s 2023-10-05T11:43:22.396 INFO:teuthology.orchestra.run.smithi012.stderr: 16800K .......... .......... .......... .......... .......... 18% 117M 1s 2023-10-05T11:43:22.396 INFO:teuthology.orchestra.run.smithi012.stderr: 16850K .......... .......... .......... .......... .......... 18% 48.3M 1s 2023-10-05T11:43:22.396 INFO:teuthology.orchestra.run.smithi012.stderr: 16900K .......... .......... .......... .......... .......... 18% 111M 1s 2023-10-05T11:43:22.397 INFO:teuthology.orchestra.run.smithi012.stderr: 16950K .......... .......... .......... .......... .......... 18% 50.0M 1s 2023-10-05T11:43:22.397 INFO:teuthology.orchestra.run.smithi012.stderr: 17000K .......... .......... .......... .......... .......... 18% 118M 1s 2023-10-05T11:43:22.397 INFO:teuthology.orchestra.run.smithi012.stderr: 17050K .......... .......... .......... .......... .......... 18% 87.8M 1s 2023-10-05T11:43:22.397 INFO:teuthology.orchestra.run.smithi012.stderr: 17100K .......... .......... .......... .......... .......... 18% 56.0M 1s 2023-10-05T11:43:22.397 INFO:teuthology.orchestra.run.smithi012.stderr: 17150K .......... .......... .......... .......... .......... 18% 46.6M 1s 2023-10-05T11:43:22.397 INFO:teuthology.orchestra.run.smithi012.stderr: 17200K .......... .......... .......... .......... .......... 18% 34.3M 1s 2023-10-05T11:43:22.397 INFO:teuthology.orchestra.run.smithi012.stderr: 17250K .......... .......... .......... .......... .......... 18% 116M 1s 2023-10-05T11:43:22.397 INFO:teuthology.orchestra.run.smithi012.stderr: 17300K .......... .......... .......... .......... .......... 18% 43.3M 1s 2023-10-05T11:43:22.397 INFO:teuthology.orchestra.run.smithi012.stderr: 17350K .......... .......... .......... .......... .......... 18% 48.8M 1s 2023-10-05T11:43:22.397 INFO:teuthology.orchestra.run.smithi012.stderr: 17400K .......... .......... .......... .......... .......... 18% 60.2M 1s 2023-10-05T11:43:22.397 INFO:teuthology.orchestra.run.smithi012.stderr: 17450K .......... .......... .......... .......... .......... 18% 115M 1s 2023-10-05T11:43:22.397 INFO:teuthology.orchestra.run.smithi012.stderr: 17500K .......... .......... .......... .......... .......... 18% 75.3M 1s 2023-10-05T11:43:22.398 INFO:teuthology.orchestra.run.smithi012.stderr: 17550K .......... .......... .......... .......... .......... 18% 50.7M 1s 2023-10-05T11:43:22.398 INFO:teuthology.orchestra.run.smithi012.stderr: 17600K .......... .......... .......... .......... .......... 18% 27.1M 1s 2023-10-05T11:43:22.398 INFO:teuthology.orchestra.run.smithi012.stderr: 17650K .......... .......... .......... .......... .......... 19% 14.1M 1s 2023-10-05T11:43:22.398 INFO:teuthology.orchestra.run.smithi012.stderr: 17700K .......... .......... .......... .......... .......... 19% 114M 1s 2023-10-05T11:43:22.398 INFO:teuthology.orchestra.run.smithi012.stderr: 17750K .......... .......... .......... .......... .......... 19% 57.7M 1s 2023-10-05T11:43:22.398 INFO:teuthology.orchestra.run.smithi012.stderr: 17800K .......... .......... .......... .......... .......... 19% 81.7M 1s 2023-10-05T11:43:22.398 INFO:teuthology.orchestra.run.smithi012.stderr: 17850K .......... .......... .......... .......... .......... 19% 61.1M 1s 2023-10-05T11:43:22.398 INFO:teuthology.orchestra.run.smithi012.stderr: 17900K .......... .......... .......... .......... .......... 19% 115M 1s 2023-10-05T11:43:22.398 INFO:teuthology.orchestra.run.smithi012.stderr: 17950K .......... .......... .......... .......... .......... 19% 44.6M 1s 2023-10-05T11:43:22.398 INFO:teuthology.orchestra.run.smithi012.stderr: 18000K .......... .......... .......... .......... .......... 19% 80.5M 1s 2023-10-05T11:43:22.398 INFO:teuthology.orchestra.run.smithi012.stderr: 18050K .......... .......... .......... .......... .......... 19% 60.8M 1s 2023-10-05T11:43:22.398 INFO:teuthology.orchestra.run.smithi012.stderr: 18100K .......... .......... .......... .......... .......... 19% 117M 1s 2023-10-05T11:43:22.399 INFO:teuthology.orchestra.run.smithi012.stderr: 18150K .......... .......... .......... .......... .......... 19% 103M 1s 2023-10-05T11:43:22.399 INFO:teuthology.orchestra.run.smithi012.stderr: 18200K .......... .......... .......... .......... .......... 19% 51.4M 1s 2023-10-05T11:43:22.399 INFO:teuthology.orchestra.run.smithi012.stderr: 18250K .......... .......... .......... .......... .......... 19% 114M 1s 2023-10-05T11:43:22.399 INFO:teuthology.orchestra.run.smithi012.stderr: 18300K .......... .......... .......... .......... .......... 19% 119M 1s 2023-10-05T11:43:22.399 INFO:teuthology.orchestra.run.smithi012.stderr: 18350K .......... .......... .......... .......... .......... 19% 42.8M 1s 2023-10-05T11:43:22.399 INFO:teuthology.orchestra.run.smithi012.stderr: 18400K .......... .......... .......... .......... .......... 19% 102M 1s 2023-10-05T11:43:22.399 INFO:teuthology.orchestra.run.smithi012.stderr: 18450K .......... .......... .......... .......... .......... 19% 54.5M 1s 2023-10-05T11:43:22.399 INFO:teuthology.orchestra.run.smithi012.stderr: 18500K .......... .......... .......... .......... .......... 19% 90.2M 1s 2023-10-05T11:43:22.399 INFO:teuthology.orchestra.run.smithi012.stderr: 18550K .......... .......... .......... .......... .......... 20% 44.1M 1s 2023-10-05T11:43:22.399 INFO:teuthology.orchestra.run.smithi012.stderr: 18600K .......... .......... .......... .......... .......... 20% 56.2M 1s 2023-10-05T11:43:22.399 INFO:teuthology.orchestra.run.smithi012.stderr: 18650K .......... .......... .......... .......... .......... 20% 50.9M 1s 2023-10-05T11:43:22.399 INFO:teuthology.orchestra.run.smithi012.stderr: 18700K .......... .......... .......... .......... .......... 20% 98.6M 1s 2023-10-05T11:43:22.400 INFO:teuthology.orchestra.run.smithi012.stderr: 18750K .......... .......... .......... .......... .......... 20% 38.8M 1s 2023-10-05T11:43:22.400 INFO:teuthology.orchestra.run.smithi012.stderr: 18800K .......... .......... .......... .......... .......... 20% 92.6M 1s 2023-10-05T11:43:22.400 INFO:teuthology.orchestra.run.smithi012.stderr: 18850K .......... .......... .......... .......... .......... 20% 64.4M 1s 2023-10-05T11:43:22.400 INFO:teuthology.orchestra.run.smithi012.stderr: 18900K .......... .......... .......... .......... .......... 20% 63.6M 1s 2023-10-05T11:43:22.400 INFO:teuthology.orchestra.run.smithi012.stderr: 18950K .......... .......... .......... .......... .......... 20% 97.4M 1s 2023-10-05T11:43:22.400 INFO:teuthology.orchestra.run.smithi012.stderr: 19000K .......... .......... .......... .......... .......... 20% 55.9M 1s 2023-10-05T11:43:22.400 INFO:teuthology.orchestra.run.smithi012.stderr: 19050K .......... .......... .......... .......... .......... 20% 70.3M 1s 2023-10-05T11:43:22.400 INFO:teuthology.orchestra.run.smithi012.stderr: 19100K .......... .......... .......... .......... .......... 20% 50.7M 1s 2023-10-05T11:43:22.400 INFO:teuthology.orchestra.run.smithi012.stderr: 19150K .......... .......... .......... .......... .......... 20% 38.7M 1s 2023-10-05T11:43:22.400 INFO:teuthology.orchestra.run.smithi012.stderr: 19200K .......... .......... .......... .......... .......... 20% 97.7M 1s 2023-10-05T11:43:22.400 INFO:teuthology.orchestra.run.smithi012.stderr: 19250K .......... .......... .......... .......... .......... 20% 121M 1s 2023-10-05T11:43:22.400 INFO:teuthology.orchestra.run.smithi012.stderr: 19300K .......... .......... .......... .......... .......... 20% 70.4M 1s 2023-10-05T11:43:22.401 INFO:teuthology.orchestra.run.smithi012.stderr: 19350K .......... .......... .......... .......... .......... 20% 83.9M 1s 2023-10-05T11:43:22.401 INFO:teuthology.orchestra.run.smithi012.stderr: 19400K .......... .......... .......... .......... .......... 20% 66.6M 1s 2023-10-05T11:43:22.401 INFO:teuthology.orchestra.run.smithi012.stderr: 19450K .......... .......... .......... .......... .......... 20% 185M 1s 2023-10-05T11:43:22.401 INFO:teuthology.orchestra.run.smithi012.stderr: 19500K .......... .......... .......... .......... .......... 21% 115M 1s 2023-10-05T11:43:22.401 INFO:teuthology.orchestra.run.smithi012.stderr: 19550K .......... .......... .......... .......... .......... 21% 59.6M 1s 2023-10-05T11:43:22.401 INFO:teuthology.orchestra.run.smithi012.stderr: 19600K .......... .......... .......... .......... .......... 21% 81.7M 1s 2023-10-05T11:43:22.401 INFO:teuthology.orchestra.run.smithi012.stderr: 19650K .......... .......... .......... .......... .......... 21% 71.6M 1s 2023-10-05T11:43:22.401 INFO:teuthology.orchestra.run.smithi012.stderr: 19700K .......... .......... .......... .......... .......... 21% 127M 1s 2023-10-05T11:43:22.401 INFO:teuthology.orchestra.run.smithi012.stderr: 19750K .......... .......... .......... .......... .......... 21% 76.6M 1s 2023-10-05T11:43:22.401 INFO:teuthology.orchestra.run.smithi012.stderr: 19800K .......... .......... .......... .......... .......... 21% 55.7M 1s 2023-10-05T11:43:22.401 INFO:teuthology.orchestra.run.smithi012.stderr: 19850K .......... .......... .......... .......... .......... 21% 31.4M 1s 2023-10-05T11:43:22.401 INFO:teuthology.orchestra.run.smithi012.stderr: 19900K .......... .......... .......... .......... .......... 21% 123M 1s 2023-10-05T11:43:22.402 INFO:teuthology.orchestra.run.smithi012.stderr: 19950K .......... .......... .......... .......... .......... 21% 115M 1s 2023-10-05T11:43:22.402 INFO:teuthology.orchestra.run.smithi012.stderr: 20000K .......... .......... .......... .......... .......... 21% 47.4M 1s 2023-10-05T11:43:22.402 INFO:teuthology.orchestra.run.smithi012.stderr: 20050K .......... .......... .......... .......... .......... 21% 62.1M 1s 2023-10-05T11:43:22.402 INFO:teuthology.orchestra.run.smithi012.stderr: 20100K .......... .......... .......... .......... .......... 21% 55.5M 1s 2023-10-05T11:43:22.402 INFO:teuthology.orchestra.run.smithi012.stderr: 20150K .......... .......... .......... .......... .......... 21% 141M 1s 2023-10-05T11:43:22.402 INFO:teuthology.orchestra.run.smithi012.stderr: 20200K .......... .......... .......... .......... .......... 21% 60.0M 1s 2023-10-05T11:43:22.402 INFO:teuthology.orchestra.run.smithi012.stderr: 20250K .......... .......... .......... .......... .......... 21% 40.3M 1s 2023-10-05T11:43:22.402 INFO:teuthology.orchestra.run.smithi012.stderr: 20300K .......... .......... .......... .......... .......... 21% 58.6M 1s 2023-10-05T11:43:22.402 INFO:teuthology.orchestra.run.smithi012.stderr: 20350K .......... .......... .......... .......... .......... 21% 41.5M 1s 2023-10-05T11:43:22.402 INFO:teuthology.orchestra.run.smithi012.stderr: 20400K .......... .......... .......... .......... .......... 22% 124M 1s 2023-10-05T11:43:22.402 INFO:teuthology.orchestra.run.smithi012.stderr: 20450K .......... .......... .......... .......... .......... 22% 49.1M 1s 2023-10-05T11:43:22.402 INFO:teuthology.orchestra.run.smithi012.stderr: 20500K .......... .......... .......... .......... .......... 22% 75.7M 1s 2023-10-05T11:43:22.403 INFO:teuthology.orchestra.run.smithi012.stderr: 20550K .......... .......... .......... .......... .......... 22% 58.7M 1s 2023-10-05T11:43:22.403 INFO:teuthology.orchestra.run.smithi012.stderr: 20600K .......... .......... .......... .......... .......... 22% 108M 1s 2023-10-05T11:43:22.403 INFO:teuthology.orchestra.run.smithi012.stderr: 20650K .......... .......... .......... .......... .......... 22% 21.9M 1s 2023-10-05T11:43:22.403 INFO:teuthology.orchestra.run.smithi012.stderr: 20700K .......... .......... .......... .......... .......... 22% 28.4M 1s 2023-10-05T11:43:22.403 INFO:teuthology.orchestra.run.smithi012.stderr: 20750K .......... .......... .......... .......... .......... 22% 52.5M 1s 2023-10-05T11:43:22.403 INFO:teuthology.orchestra.run.smithi012.stderr: 20800K .......... .......... .......... .......... .......... 22% 50.6M 1s 2023-10-05T11:43:22.403 INFO:teuthology.orchestra.run.smithi012.stderr: 20850K .......... .......... .......... .......... .......... 22% 115M 1s 2023-10-05T11:43:22.403 INFO:teuthology.orchestra.run.smithi012.stderr: 20900K .......... .......... .......... .......... .......... 22% 81.1M 1s 2023-10-05T11:43:22.403 INFO:teuthology.orchestra.run.smithi012.stderr: 20950K .......... .......... .......... .......... .......... 22% 57.0M 1s 2023-10-05T11:43:22.403 INFO:teuthology.orchestra.run.smithi012.stderr: 21000K .......... .......... .......... .......... .......... 22% 51.0M 1s 2023-10-05T11:43:22.403 INFO:teuthology.orchestra.run.smithi012.stderr: 21050K .......... .......... .......... .......... .......... 22% 115M 1s 2023-10-05T11:43:22.403 INFO:teuthology.orchestra.run.smithi012.stderr: 21100K .......... .......... .......... .......... .......... 22% 55.0M 1s 2023-10-05T11:43:22.404 INFO:teuthology.orchestra.run.smithi012.stderr: 21150K .......... .......... .......... .......... .......... 22% 77.8M 1s 2023-10-05T11:43:22.404 INFO:teuthology.orchestra.run.smithi012.stderr: 21200K .......... .......... .......... .......... .......... 22% 48.8M 1s 2023-10-05T11:43:22.404 INFO:teuthology.orchestra.run.smithi012.stderr: 21250K .......... .......... .......... .......... .......... 22% 102M 1s 2023-10-05T11:43:22.404 INFO:teuthology.orchestra.run.smithi012.stderr: 21300K .......... .......... .......... .......... .......... 22% 114M 1s 2023-10-05T11:43:22.404 INFO:teuthology.orchestra.run.smithi012.stderr: 21350K .......... .......... .......... .......... .......... 23% 42.0M 1s 2023-10-05T11:43:22.404 INFO:teuthology.orchestra.run.smithi012.stderr: 21400K .......... .......... .......... .......... .......... 23% 86.3M 1s 2023-10-05T11:43:22.404 INFO:teuthology.orchestra.run.smithi012.stderr: 21450K .......... .......... .......... .......... .......... 23% 49.3M 1s 2023-10-05T11:43:22.404 INFO:teuthology.orchestra.run.smithi012.stderr: 21500K .......... .......... .......... .......... .......... 23% 119M 1s 2023-10-05T11:43:22.404 INFO:teuthology.orchestra.run.smithi012.stderr: 21550K .......... .......... .......... .......... .......... 23% 44.4M 1s 2023-10-05T11:43:22.404 INFO:teuthology.orchestra.run.smithi012.stderr: 21600K .......... .......... .......... .......... .......... 23% 60.4M 1s 2023-10-05T11:43:22.404 INFO:teuthology.orchestra.run.smithi012.stderr: 21650K .......... .......... .......... .......... .......... 23% 48.5M 1s 2023-10-05T11:43:22.404 INFO:teuthology.orchestra.run.smithi012.stderr: 21700K .......... .......... .......... .......... .......... 23% 43.5M 1s 2023-10-05T11:43:22.405 INFO:teuthology.orchestra.run.smithi012.stderr: 21750K .......... .......... .......... .......... .......... 23% 110M 1s 2023-10-05T11:43:22.405 INFO:teuthology.orchestra.run.smithi012.stderr: 21800K .......... .......... .......... .......... .......... 23% 57.6M 1s 2023-10-05T11:43:22.405 INFO:teuthology.orchestra.run.smithi012.stderr: 21850K .......... .......... .......... .......... .......... 23% 49.8M 1s 2023-10-05T11:43:22.405 INFO:teuthology.orchestra.run.smithi012.stderr: 21900K .......... .......... .......... .......... .......... 23% 85.7M 1s 2023-10-05T11:43:22.405 INFO:teuthology.orchestra.run.smithi012.stderr: 21950K .......... .......... .......... .......... .......... 23% 45.0M 1s 2023-10-05T11:43:22.405 INFO:teuthology.orchestra.run.smithi012.stderr: 22000K .......... .......... .......... .......... .......... 23% 60.4M 1s 2023-10-05T11:43:22.405 INFO:teuthology.orchestra.run.smithi012.stderr: 22050K .......... .......... .......... .......... .......... 23% 118M 1s 2023-10-05T11:43:22.405 INFO:teuthology.orchestra.run.smithi012.stderr: 22100K .......... .......... .......... .......... .......... 23% 50.3M 1s 2023-10-05T11:43:22.405 INFO:teuthology.orchestra.run.smithi012.stderr: 22150K .......... .......... .......... .......... .......... 23% 80.8M 1s 2023-10-05T11:43:22.405 INFO:teuthology.orchestra.run.smithi012.stderr: 22200K .......... .......... .......... .......... .......... 23% 59.7M 1s 2023-10-05T11:43:22.405 INFO:teuthology.orchestra.run.smithi012.stderr: 22250K .......... .......... .......... .......... .......... 24% 120M 1s 2023-10-05T11:43:22.406 INFO:teuthology.orchestra.run.smithi012.stderr: 22300K .......... .......... .......... .......... .......... 24% 49.7M 1s 2023-10-05T11:43:22.406 INFO:teuthology.orchestra.run.smithi012.stderr: 22350K .......... .......... .......... .......... .......... 24% 91.4M 1s 2023-10-05T11:43:22.406 INFO:teuthology.orchestra.run.smithi012.stderr: 22400K .......... .......... .......... .......... .......... 24% 106M 1s 2023-10-05T11:43:22.406 INFO:teuthology.orchestra.run.smithi012.stderr: 22450K .......... .......... .......... .......... .......... 24% 53.0M 1s 2023-10-05T11:43:22.406 INFO:teuthology.orchestra.run.smithi012.stderr: 22500K .......... .......... .......... .......... .......... 24% 108M 1s 2023-10-05T11:43:22.406 INFO:teuthology.orchestra.run.smithi012.stderr: 22550K .......... .......... .......... .......... .......... 24% 117M 1s 2023-10-05T11:43:22.406 INFO:teuthology.orchestra.run.smithi012.stderr: 22600K .......... .......... .......... .......... .......... 24% 78.2M 1s 2023-10-05T11:43:22.406 INFO:teuthology.orchestra.run.smithi012.stderr: 22650K .......... .......... .......... .......... .......... 24% 62.1M 1s 2023-10-05T11:43:22.406 INFO:teuthology.orchestra.run.smithi012.stderr: 22700K .......... .......... .......... .......... .......... 24% 51.0M 1s 2023-10-05T11:43:22.406 INFO:teuthology.orchestra.run.smithi012.stderr: 22750K .......... .......... .......... .......... .......... 24% 85.1M 1s 2023-10-05T11:43:22.406 INFO:teuthology.orchestra.run.smithi012.stderr: 22800K .......... .......... .......... .......... .......... 24% 119M 1s 2023-10-05T11:43:22.407 INFO:teuthology.orchestra.run.smithi012.stderr: 22850K .......... .......... .......... .......... .......... 24% 48.5M 1s 2023-10-05T11:43:22.407 INFO:teuthology.orchestra.run.smithi012.stderr: 22900K .......... .......... .......... .......... .......... 24% 48.5M 1s 2023-10-05T11:43:22.407 INFO:teuthology.orchestra.run.smithi012.stderr: 22950K .......... .......... .......... .......... .......... 24% 116M 1s 2023-10-05T11:43:22.407 INFO:teuthology.orchestra.run.smithi012.stderr: 23000K .......... .......... .......... .......... .......... 24% 80.9M 1s 2023-10-05T11:43:22.407 INFO:teuthology.orchestra.run.smithi012.stderr: 23050K .......... .......... .......... .......... .......... 24% 115M 1s 2023-10-05T11:43:22.407 INFO:teuthology.orchestra.run.smithi012.stderr: 23100K .......... .......... .......... .......... .......... 24% 108M 1s 2023-10-05T11:43:22.407 INFO:teuthology.orchestra.run.smithi012.stderr: 23150K .......... .......... .......... .......... .......... 24% 53.1M 1s 2023-10-05T11:43:22.407 INFO:teuthology.orchestra.run.smithi012.stderr: 23200K .......... .......... .......... .......... .......... 25% 12.0M 1s 2023-10-05T11:43:22.407 INFO:teuthology.orchestra.run.smithi012.stderr: 23250K .......... .......... .......... .......... .......... 25% 46.2M 1s 2023-10-05T11:43:22.407 INFO:teuthology.orchestra.run.smithi012.stderr: 23300K .......... .......... .......... .......... .......... 25% 114M 1s 2023-10-05T11:43:22.407 INFO:teuthology.orchestra.run.smithi012.stderr: 23350K .......... .......... .......... .......... .......... 25% 83.7M 1s 2023-10-05T11:43:22.407 INFO:teuthology.orchestra.run.smithi012.stderr: 23400K .......... .......... .......... .......... .......... 25% 58.3M 1s 2023-10-05T11:43:22.408 INFO:teuthology.orchestra.run.smithi012.stderr: 23450K .......... .......... .......... .......... .......... 25% 48.6M 1s 2023-10-05T11:43:22.408 INFO:teuthology.orchestra.run.smithi012.stderr: 23500K .......... .......... .......... .......... .......... 25% 90.5M 1s 2023-10-05T11:43:22.408 INFO:teuthology.orchestra.run.smithi012.stderr: 23550K .......... .......... .......... .......... .......... 25% 51.3M 1s 2023-10-05T11:43:22.408 INFO:teuthology.orchestra.run.smithi012.stderr: 23600K .......... .......... .......... .......... .......... 25% 84.4M 1s 2023-10-05T11:43:22.408 INFO:teuthology.orchestra.run.smithi012.stderr: 23650K .......... .......... .......... .......... .......... 25% 32.7M 1s 2023-10-05T11:43:22.408 INFO:teuthology.orchestra.run.smithi012.stderr: 23700K .......... .......... .......... .......... .......... 25% 42.9M 1s 2023-10-05T11:43:22.408 INFO:teuthology.orchestra.run.smithi012.stderr: 23750K .......... .......... .......... .......... .......... 25% 69.6M 1s 2023-10-05T11:43:22.408 INFO:teuthology.orchestra.run.smithi012.stderr: 23800K .......... .......... .......... .......... .......... 25% 70.3M 1s 2023-10-05T11:43:22.408 INFO:teuthology.orchestra.run.smithi012.stderr: 23850K .......... .......... .......... .......... .......... 25% 58.6M 1s 2023-10-05T11:43:22.408 INFO:teuthology.orchestra.run.smithi012.stderr: 23900K .......... .......... .......... .......... .......... 25% 48.3M 1s 2023-10-05T11:43:22.408 INFO:teuthology.orchestra.run.smithi012.stderr: 23950K .......... .......... .......... .......... .......... 25% 71.1M 1s 2023-10-05T11:43:22.408 INFO:teuthology.orchestra.run.smithi012.stderr: 24000K .......... .......... .......... .......... .......... 25% 122M 1s 2023-10-05T11:43:22.409 INFO:teuthology.orchestra.run.smithi012.stderr: 24050K .......... .......... .......... .......... .......... 25% 48.0M 1s 2023-10-05T11:43:22.409 INFO:teuthology.orchestra.run.smithi012.stderr: 24100K .......... .......... .......... .......... .......... 25% 60.0M 1s 2023-10-05T11:43:22.409 INFO:teuthology.orchestra.run.smithi012.stderr: 24150K .......... .......... .......... .......... .......... 26% 82.4M 1s 2023-10-05T11:43:22.409 INFO:teuthology.orchestra.run.smithi012.stderr: 24200K .......... .......... .......... .......... .......... 26% 122M 1s 2023-10-05T11:43:22.409 INFO:teuthology.orchestra.run.smithi012.stderr: 24250K .......... .......... .......... .......... .......... 26% 46.3M 1s 2023-10-05T11:43:22.409 INFO:teuthology.orchestra.run.smithi012.stderr: 24300K .......... .......... .......... .......... .......... 26% 50.6M 1s 2023-10-05T11:43:22.409 INFO:teuthology.orchestra.run.smithi012.stderr: 24350K .......... .......... .......... .......... .......... 26% 54.1M 1s 2023-10-05T11:43:22.409 INFO:teuthology.orchestra.run.smithi012.stderr: 24400K .......... .......... .......... .......... .......... 26% 101M 1s 2023-10-05T11:43:22.409 INFO:teuthology.orchestra.run.smithi012.stderr: 24450K .......... .......... .......... .......... .......... 26% 91.1M 1s 2023-10-05T11:43:22.409 INFO:teuthology.orchestra.run.smithi012.stderr: 24500K .......... .......... .......... .......... .......... 26% 57.4M 1s 2023-10-05T11:43:22.409 INFO:teuthology.orchestra.run.smithi012.stderr: 24550K .......... .......... .......... .......... .......... 26% 50.4M 1s 2023-10-05T11:43:22.409 INFO:teuthology.orchestra.run.smithi012.stderr: 24600K .......... .......... .......... .......... .......... 26% 49.7M 1s 2023-10-05T11:43:22.410 INFO:teuthology.orchestra.run.smithi012.stderr: 24650K .......... .......... .......... .......... .......... 26% 119M 1s 2023-10-05T11:43:22.410 INFO:teuthology.orchestra.run.smithi012.stderr: 24700K .......... .......... .......... .......... .......... 26% 48.9M 1s 2023-10-05T11:43:22.410 INFO:teuthology.orchestra.run.smithi012.stderr: 24750K .......... .......... .......... .......... .......... 26% 66.5M 1s 2023-10-05T11:43:22.410 INFO:teuthology.orchestra.run.smithi012.stderr: 24800K .......... .......... .......... .......... .......... 26% 58.7M 1s 2023-10-05T11:43:22.410 INFO:teuthology.orchestra.run.smithi012.stderr: 24850K .......... .......... .......... .......... .......... 26% 49.8M 1s 2023-10-05T11:43:22.410 INFO:teuthology.orchestra.run.smithi012.stderr: 24900K .......... .......... .......... .......... .......... 26% 122M 1s 2023-10-05T11:43:22.410 INFO:teuthology.orchestra.run.smithi012.stderr: 24950K .......... .......... .......... .......... .......... 26% 49.4M 1s 2023-10-05T11:43:22.410 INFO:teuthology.orchestra.run.smithi012.stderr: 25000K .......... .......... .......... .......... .......... 26% 82.5M 1s 2023-10-05T11:43:22.410 INFO:teuthology.orchestra.run.smithi012.stderr: 25050K .......... .......... .......... .......... .......... 27% 59.2M 1s 2023-10-05T11:43:22.410 INFO:teuthology.orchestra.run.smithi012.stderr: 25100K .......... .......... .......... .......... .......... 27% 121M 1s 2023-10-05T11:43:22.410 INFO:teuthology.orchestra.run.smithi012.stderr: 25150K .......... .......... .......... .......... .......... 27% 41.9M 1s 2023-10-05T11:43:22.410 INFO:teuthology.orchestra.run.smithi012.stderr: 25200K .......... .......... .......... .......... .......... 27% 49.0M 1s 2023-10-05T11:43:22.411 INFO:teuthology.orchestra.run.smithi012.stderr: 25250K .......... .......... .......... .......... .......... 27% 52.5M 1s 2023-10-05T11:43:22.411 INFO:teuthology.orchestra.run.smithi012.stderr: 25300K .......... .......... .......... .......... .......... 27% 102M 1s 2023-10-05T11:43:22.411 INFO:teuthology.orchestra.run.smithi012.stderr: 25350K .......... .......... .......... .......... .......... 27% 87.4M 1s 2023-10-05T11:43:22.411 INFO:teuthology.orchestra.run.smithi012.stderr: 25400K .......... .......... .......... .......... .......... 27% 61.0M 1s 2023-10-05T11:43:22.411 INFO:teuthology.orchestra.run.smithi012.stderr: 25450K .......... .......... .......... .......... .......... 27% 82.7M 1s 2023-10-05T11:43:22.411 INFO:teuthology.orchestra.run.smithi012.stderr: 25500K .......... .......... .......... .......... .......... 27% 60.1M 1s 2023-10-05T11:43:22.411 INFO:teuthology.orchestra.run.smithi012.stderr: 25550K .......... .......... .......... .......... .......... 27% 67.9M 1s 2023-10-05T11:43:22.411 INFO:teuthology.orchestra.run.smithi012.stderr: 25600K .......... .......... .......... .......... .......... 27% 117M 1s 2023-10-05T11:43:22.411 INFO:teuthology.orchestra.run.smithi012.stderr: 25650K .......... .......... .......... .......... .......... 27% 56.3M 1s 2023-10-05T11:43:22.411 INFO:teuthology.orchestra.run.smithi012.stderr: 25700K .......... .......... .......... .......... .......... 27% 50.9M 1s 2023-10-05T11:43:22.411 INFO:teuthology.orchestra.run.smithi012.stderr: 25750K .......... .......... .......... .......... .......... 27% 82.0M 1s 2023-10-05T11:43:22.411 INFO:teuthology.orchestra.run.smithi012.stderr: 25800K .......... .......... .......... .......... .......... 27% 59.3M 1s 2023-10-05T11:43:22.412 INFO:teuthology.orchestra.run.smithi012.stderr: 25850K .......... .......... .......... .......... .......... 27% 106M 1s 2023-10-05T11:43:22.412 INFO:teuthology.orchestra.run.smithi012.stderr: 25900K .......... .......... .......... .......... .......... 27% 48.9M 1s 2023-10-05T11:43:22.412 INFO:teuthology.orchestra.run.smithi012.stderr: 25950K .......... .......... .......... .......... .......... 27% 76.9M 1s 2023-10-05T11:43:22.412 INFO:teuthology.orchestra.run.smithi012.stderr: 26000K .......... .......... .......... .......... .......... 28% 52.9M 1s 2023-10-05T11:43:22.412 INFO:teuthology.orchestra.run.smithi012.stderr: 26050K .......... .......... .......... .......... .......... 28% 50.8M 1s 2023-10-05T11:43:22.412 INFO:teuthology.orchestra.run.smithi012.stderr: 26100K .......... .......... .......... .......... .......... 28% 114M 1s 2023-10-05T11:43:22.412 INFO:teuthology.orchestra.run.smithi012.stderr: 26150K .......... .......... .......... .......... .......... 28% 47.8M 1s 2023-10-05T11:43:22.412 INFO:teuthology.orchestra.run.smithi012.stderr: 26200K .......... .......... .......... .......... .......... 28% 16.8M 1s 2023-10-05T11:43:22.412 INFO:teuthology.orchestra.run.smithi012.stderr: 26250K .......... .......... .......... .......... .......... 28% 45.8M 1s 2023-10-05T11:43:22.412 INFO:teuthology.orchestra.run.smithi012.stderr: 26300K .......... .......... .......... .......... .......... 28% 81.7M 1s 2023-10-05T11:43:22.412 INFO:teuthology.orchestra.run.smithi012.stderr: 26350K .......... .......... .......... .......... .......... 28% 51.3M 1s 2023-10-05T11:43:22.412 INFO:teuthology.orchestra.run.smithi012.stderr: 26400K .......... .......... .......... .......... .......... 28% 42.5M 1s 2023-10-05T11:43:22.413 INFO:teuthology.orchestra.run.smithi012.stderr: 26450K .......... .......... .......... .......... .......... 28% 109M 1s 2023-10-05T11:43:22.413 INFO:teuthology.orchestra.run.smithi012.stderr: 26500K .......... .......... .......... .......... .......... 28% 27.6M 1s 2023-10-05T11:43:22.413 INFO:teuthology.orchestra.run.smithi012.stderr: 26550K .......... .......... .......... .......... .......... 28% 96.4M 1s 2023-10-05T11:43:22.413 INFO:teuthology.orchestra.run.smithi012.stderr: 26600K .......... .......... .......... .......... .......... 28% 80.4M 1s 2023-10-05T11:43:22.413 INFO:teuthology.orchestra.run.smithi012.stderr: 26650K .......... .......... .......... .......... .......... 28% 40.5M 1s 2023-10-05T11:43:22.413 INFO:teuthology.orchestra.run.smithi012.stderr: 26700K .......... .......... .......... .......... .......... 28% 45.9M 1s 2023-10-05T11:43:22.413 INFO:teuthology.orchestra.run.smithi012.stderr: 26750K .......... .......... .......... .......... .......... 28% 38.1M 1s 2023-10-05T11:43:22.413 INFO:teuthology.orchestra.run.smithi012.stderr: 26800K .......... .......... .......... .......... .......... 28% 62.9M 1s 2023-10-05T11:43:22.413 INFO:teuthology.orchestra.run.smithi012.stderr: 26850K .......... .......... .......... .......... .......... 28% 86.0M 1s 2023-10-05T11:43:22.413 INFO:teuthology.orchestra.run.smithi012.stderr: 26900K .......... .......... .......... .......... .......... 29% 78.1M 1s 2023-10-05T11:43:22.413 INFO:teuthology.orchestra.run.smithi012.stderr: 26950K .......... .......... .......... .......... .......... 29% 61.0M 1s 2023-10-05T11:43:22.413 INFO:teuthology.orchestra.run.smithi012.stderr: 27000K .......... .......... .......... .......... .......... 29% 91.0M 1s 2023-10-05T11:43:22.414 INFO:teuthology.orchestra.run.smithi012.stderr: 27050K .......... .......... .......... .......... .......... 29% 84.5M 1s 2023-10-05T11:43:22.414 INFO:teuthology.orchestra.run.smithi012.stderr: 27100K .......... .......... .......... .......... .......... 29% 92.6M 1s 2023-10-05T11:43:22.414 INFO:teuthology.orchestra.run.smithi012.stderr: 27150K .......... .......... .......... .......... .......... 29% 84.0M 1s 2023-10-05T11:43:22.414 INFO:teuthology.orchestra.run.smithi012.stderr: 27200K .......... .......... .......... .......... .......... 29% 56.7M 1s 2023-10-05T11:43:22.414 INFO:teuthology.orchestra.run.smithi012.stderr: 27250K .......... .......... .......... .......... .......... 29% 149M 1s 2023-10-05T11:43:22.414 INFO:teuthology.orchestra.run.smithi012.stderr: 27300K .......... .......... .......... .......... .......... 29% 67.4M 1s 2023-10-05T11:43:22.414 INFO:teuthology.orchestra.run.smithi012.stderr: 27350K .......... .......... .......... .......... .......... 29% 76.9M 1s 2023-10-05T11:43:22.414 INFO:teuthology.orchestra.run.smithi012.stderr: 27400K .......... .......... .......... .......... .......... 29% 145M 1s 2023-10-05T11:43:22.414 INFO:teuthology.orchestra.run.smithi012.stderr: 27450K .......... .......... .......... .......... .......... 29% 154M 1s 2023-10-05T11:43:22.414 INFO:teuthology.orchestra.run.smithi012.stderr: 27500K .......... .......... .......... .......... .......... 29% 76.6M 1s 2023-10-05T11:43:22.414 INFO:teuthology.orchestra.run.smithi012.stderr: 27550K .......... .......... .......... .......... .......... 29% 47.7M 1s 2023-10-05T11:43:22.415 INFO:teuthology.orchestra.run.smithi012.stderr: 27600K .......... .......... .......... .......... .......... 29% 57.1M 1s 2023-10-05T11:43:22.415 INFO:teuthology.orchestra.run.smithi012.stderr: 27650K .......... .......... .......... .......... .......... 29% 49.6M 1s 2023-10-05T11:43:22.415 INFO:teuthology.orchestra.run.smithi012.stderr: 27700K .......... .......... .......... .......... .......... 29% 108M 1s 2023-10-05T11:43:22.415 INFO:teuthology.orchestra.run.smithi012.stderr: 27750K .......... .......... .......... .......... .......... 29% 66.9M 1s 2023-10-05T11:43:22.415 INFO:teuthology.orchestra.run.smithi012.stderr: 27800K .......... .......... .......... .......... .......... 29% 71.6M 1s 2023-10-05T11:43:22.415 INFO:teuthology.orchestra.run.smithi012.stderr: 27850K .......... .......... .......... .......... .......... 30% 69.1M 1s 2023-10-05T11:43:22.415 INFO:teuthology.orchestra.run.smithi012.stderr: 27900K .......... .......... .......... .......... .......... 30% 109M 1s 2023-10-05T11:43:22.415 INFO:teuthology.orchestra.run.smithi012.stderr: 27950K .......... .......... .......... .......... .......... 30% 60.4M 1s 2023-10-05T11:43:22.415 INFO:teuthology.orchestra.run.smithi012.stderr: 28000K .......... .......... .......... .......... .......... 30% 69.4M 1s 2023-10-05T11:43:22.415 INFO:teuthology.orchestra.run.smithi012.stderr: 28050K .......... .......... .......... .......... .......... 30% 70.8M 1s 2023-10-05T11:43:22.415 INFO:teuthology.orchestra.run.smithi012.stderr: 28100K .......... .......... .......... .......... .......... 30% 51.9M 1s 2023-10-05T11:43:22.415 INFO:teuthology.orchestra.run.smithi012.stderr: 28150K .......... .......... .......... .......... .......... 30% 100M 1s 2023-10-05T11:43:22.416 INFO:teuthology.orchestra.run.smithi012.stderr: 28200K .......... .......... .......... .......... .......... 30% 67.8M 1s 2023-10-05T11:43:22.416 INFO:teuthology.orchestra.run.smithi012.stderr: 28250K .......... .......... .......... .......... .......... 30% 64.5M 1s 2023-10-05T11:43:22.416 INFO:teuthology.orchestra.run.smithi012.stderr: 28300K .......... .......... .......... .......... .......... 30% 61.5M 1s 2023-10-05T11:43:22.416 INFO:teuthology.orchestra.run.smithi012.stderr: 28350K .......... .......... .......... .......... .......... 30% 59.7M 1s 2023-10-05T11:43:22.416 INFO:teuthology.orchestra.run.smithi012.stderr: 28400K .......... .......... .......... .......... .......... 30% 65.8M 1s 2023-10-05T11:43:22.416 INFO:teuthology.orchestra.run.smithi012.stderr: 28450K .......... .......... .......... .......... .......... 30% 121M 1s 2023-10-05T11:43:22.416 INFO:teuthology.orchestra.run.smithi012.stderr: 28500K .......... .......... .......... .......... .......... 30% 65.2M 1s 2023-10-05T11:43:22.416 INFO:teuthology.orchestra.run.smithi012.stderr: 28550K .......... .......... .......... .......... .......... 30% 25.9M 1s 2023-10-05T11:43:22.416 INFO:teuthology.orchestra.run.smithi012.stderr: 28600K .......... .......... .......... .......... .......... 30% 14.0M 1s 2023-10-05T11:43:22.416 INFO:teuthology.orchestra.run.smithi012.stderr: 28650K .......... .......... .......... .......... .......... 30% 125M 1s 2023-10-05T11:43:22.416 INFO:teuthology.orchestra.run.smithi012.stderr: 28700K .......... .......... .......... .......... .......... 30% 46.9M 1s 2023-10-05T11:43:22.416 INFO:teuthology.orchestra.run.smithi012.stderr: 28750K .......... .......... .......... .......... .......... 31% 62.9M 1s 2023-10-05T11:43:22.417 INFO:teuthology.orchestra.run.smithi012.stderr: 28800K .......... .......... .......... .......... .......... 31% 81.9M 1s 2023-10-05T11:43:22.417 INFO:teuthology.orchestra.run.smithi012.stderr: 28850K .......... .......... .......... .......... .......... 31% 50.0M 1s 2023-10-05T11:43:22.417 INFO:teuthology.orchestra.run.smithi012.stderr: 28900K .......... .......... .......... .......... .......... 31% 66.9M 1s 2023-10-05T11:43:22.417 INFO:teuthology.orchestra.run.smithi012.stderr: 28950K .......... .......... .......... .......... .......... 31% 115M 1s 2023-10-05T11:43:22.417 INFO:teuthology.orchestra.run.smithi012.stderr: 29000K .......... .......... .......... .......... .......... 31% 71.7M 1s 2023-10-05T11:43:22.417 INFO:teuthology.orchestra.run.smithi012.stderr: 29050K .......... .......... .......... .......... .......... 31% 64.5M 1s 2023-10-05T11:43:22.417 INFO:teuthology.orchestra.run.smithi012.stderr: 29100K .......... .......... .......... .......... .......... 31% 73.9M 1s 2023-10-05T11:43:22.417 INFO:teuthology.orchestra.run.smithi012.stderr: 29150K .......... .......... .......... .......... .......... 31% 58.7M 1s 2023-10-05T11:43:22.417 INFO:teuthology.orchestra.run.smithi012.stderr: 29200K .......... .......... .......... .......... .......... 31% 116M 1s 2023-10-05T11:43:22.417 INFO:teuthology.orchestra.run.smithi012.stderr: 29250K .......... .......... .......... .......... .......... 31% 26.4M 1s 2023-10-05T11:43:22.417 INFO:teuthology.orchestra.run.smithi012.stderr: 29300K .......... .......... .......... .......... .......... 31% 50.0M 1s 2023-10-05T11:43:22.417 INFO:teuthology.orchestra.run.smithi012.stderr: 29350K .......... .......... .......... .......... .......... 31% 106M 1s 2023-10-05T11:43:22.418 INFO:teuthology.orchestra.run.smithi012.stderr: 29400K .......... .......... .......... .......... .......... 31% 113M 1s 2023-10-05T11:43:22.418 INFO:teuthology.orchestra.run.smithi012.stderr: 29450K .......... .......... .......... .......... .......... 31% 45.9M 1s 2023-10-05T11:43:22.418 INFO:teuthology.orchestra.run.smithi012.stderr: 29500K .......... .......... .......... .......... .......... 31% 52.3M 1s 2023-10-05T11:43:22.418 INFO:teuthology.orchestra.run.smithi012.stderr: 29550K .......... .......... .......... .......... .......... 31% 42.9M 1s 2023-10-05T11:43:22.418 INFO:teuthology.orchestra.run.smithi012.stderr: 29600K .......... .......... .......... .......... .......... 31% 43.3M 1s 2023-10-05T11:43:22.418 INFO:teuthology.orchestra.run.smithi012.stderr: 29650K .......... .......... .......... .......... .......... 31% 104M 1s 2023-10-05T11:43:22.418 INFO:teuthology.orchestra.run.smithi012.stderr: 29700K .......... .......... .......... .......... .......... 32% 61.7M 1s 2023-10-05T11:43:22.418 INFO:teuthology.orchestra.run.smithi012.stderr: 29750K .......... .......... .......... .......... .......... 32% 42.1M 1s 2023-10-05T11:43:22.418 INFO:teuthology.orchestra.run.smithi012.stderr: 29800K .......... .......... .......... .......... .......... 32% 59.4M 1s 2023-10-05T11:43:22.418 INFO:teuthology.orchestra.run.smithi012.stderr: 29850K .......... .......... .......... .......... .......... 32% 50.5M 1s 2023-10-05T11:43:22.418 INFO:teuthology.orchestra.run.smithi012.stderr: 29900K .......... .......... .......... .......... .......... 32% 110M 1s 2023-10-05T11:43:22.418 INFO:teuthology.orchestra.run.smithi012.stderr: 29950K .......... .......... .......... .......... .......... 32% 83.7M 1s 2023-10-05T11:43:22.419 INFO:teuthology.orchestra.run.smithi012.stderr: 30000K .......... .......... .......... .......... .......... 32% 51.7M 1s 2023-10-05T11:43:22.419 INFO:teuthology.orchestra.run.smithi012.stderr: 30050K .......... .......... .......... .......... .......... 32% 120M 1s 2023-10-05T11:43:22.419 INFO:teuthology.orchestra.run.smithi012.stderr: 30100K .......... .......... .......... .......... .......... 32% 47.1M 1s 2023-10-05T11:43:22.419 INFO:teuthology.orchestra.run.smithi012.stderr: 30150K .......... .......... .......... .......... .......... 32% 136M 1s 2023-10-05T11:43:22.419 INFO:teuthology.orchestra.run.smithi012.stderr: 30200K .......... .......... .......... .......... .......... 32% 50.6M 1s 2023-10-05T11:43:22.419 INFO:teuthology.orchestra.run.smithi012.stderr: 30250K .......... .......... .......... .......... .......... 32% 114M 1s 2023-10-05T11:43:22.419 INFO:teuthology.orchestra.run.smithi012.stderr: 30300K .......... .......... .......... .......... .......... 32% 83.7M 1s 2023-10-05T11:43:22.419 INFO:teuthology.orchestra.run.smithi012.stderr: 30350K .......... .......... .......... .......... .......... 32% 52.8M 1s 2023-10-05T11:43:22.419 INFO:teuthology.orchestra.run.smithi012.stderr: 30400K .......... .......... .......... .......... .......... 32% 117M 1s 2023-10-05T11:43:22.419 INFO:teuthology.orchestra.run.smithi012.stderr: 30450K .......... .......... .......... .......... .......... 32% 103M 1s 2023-10-05T11:43:22.419 INFO:teuthology.orchestra.run.smithi012.stderr: 30500K .......... .......... .......... .......... .......... 32% 52.3M 1s 2023-10-05T11:43:22.419 INFO:teuthology.orchestra.run.smithi012.stderr: 30550K .......... .......... .......... .......... .......... 32% 63.7M 1s 2023-10-05T11:43:22.419 INFO:teuthology.orchestra.run.smithi012.stderr: 30600K .......... .......... .......... .......... .......... 32% 107M 1s 2023-10-05T11:43:22.420 INFO:teuthology.orchestra.run.smithi012.stderr: 30650K .......... .......... .......... .......... .......... 33% 64.5M 1s 2023-10-05T11:43:22.420 INFO:teuthology.orchestra.run.smithi012.stderr: 30700K .......... .......... .......... .......... .......... 33% 46.1M 1s 2023-10-05T11:43:22.420 INFO:teuthology.orchestra.run.smithi012.stderr: 30750K .......... .......... .......... .......... .......... 33% 40.5M 1s 2023-10-05T11:43:22.420 INFO:teuthology.orchestra.run.smithi012.stderr: 30800K .......... .......... .......... .......... .......... 33% 89.2M 1s 2023-10-05T11:43:22.420 INFO:teuthology.orchestra.run.smithi012.stderr: 30850K .......... .......... .......... .......... .......... 33% 93.0M 1s 2023-10-05T11:43:22.420 INFO:teuthology.orchestra.run.smithi012.stderr: 30900K .......... .......... .......... .......... .......... 33% 44.7M 1s 2023-10-05T11:43:22.420 INFO:teuthology.orchestra.run.smithi012.stderr: 30950K .......... .......... .......... .......... .......... 33% 61.2M 1s 2023-10-05T11:43:22.420 INFO:teuthology.orchestra.run.smithi012.stderr: 31000K .......... .......... .......... .......... .......... 33% 44.8M 1s 2023-10-05T11:43:22.420 INFO:teuthology.orchestra.run.smithi012.stderr: 31050K .......... .......... .......... .......... .......... 33% 134M 1s 2023-10-05T11:43:22.420 INFO:teuthology.orchestra.run.smithi012.stderr: 31100K .......... .......... .......... .......... .......... 33% 39.7M 1s 2023-10-05T11:43:22.420 INFO:teuthology.orchestra.run.smithi012.stderr: 31150K .......... .......... .......... .......... .......... 33% 36.9M 1s 2023-10-05T11:43:22.420 INFO:teuthology.orchestra.run.smithi012.stderr: 31200K .......... .......... .......... .......... .......... 33% 112M 1s 2023-10-05T11:43:22.421 INFO:teuthology.orchestra.run.smithi012.stderr: 31250K .......... .......... .......... .......... .......... 33% 65.4M 1s 2023-10-05T11:43:22.421 INFO:teuthology.orchestra.run.smithi012.stderr: 31300K .......... .......... .......... .......... .......... 33% 178M 1s 2023-10-05T11:43:22.421 INFO:teuthology.orchestra.run.smithi012.stderr: 31350K .......... .......... .......... .......... .......... 33% 52.4M 1s 2023-10-05T11:43:22.421 INFO:teuthology.orchestra.run.smithi012.stderr: 31400K .......... .......... .......... .......... .......... 33% 119M 1s 2023-10-05T11:43:22.421 INFO:teuthology.orchestra.run.smithi012.stderr: 31450K .......... .......... .......... .......... .......... 33% 67.4M 1s 2023-10-05T11:43:22.421 INFO:teuthology.orchestra.run.smithi012.stderr: 31500K .......... .......... .......... .......... .......... 33% 134M 1s 2023-10-05T11:43:22.421 INFO:teuthology.orchestra.run.smithi012.stderr: 31550K .......... .......... .......... .......... .......... 34% 50.9M 1s 2023-10-05T11:43:22.421 INFO:teuthology.orchestra.run.smithi012.stderr: 31600K .......... .......... .......... .......... .......... 34% 30.6M 1s 2023-10-05T11:43:22.421 INFO:teuthology.orchestra.run.smithi012.stderr: 31650K .......... .......... .......... .......... .......... 34% 27.9M 1s 2023-10-05T11:43:22.421 INFO:teuthology.orchestra.run.smithi012.stderr: 31700K .......... .......... .......... .......... .......... 34% 50.5M 1s 2023-10-05T11:43:22.421 INFO:teuthology.orchestra.run.smithi012.stderr: 31750K .......... .......... .......... .......... .......... 34% 110M 1s 2023-10-05T11:43:22.421 INFO:teuthology.orchestra.run.smithi012.stderr: 31800K .......... .......... .......... .......... .......... 34% 80.3M 1s 2023-10-05T11:43:22.421 INFO:teuthology.orchestra.run.smithi012.stderr: 31850K .......... .......... .......... .......... .......... 34% 60.9M 1s 2023-10-05T11:43:22.422 INFO:teuthology.orchestra.run.smithi012.stderr: 31900K .......... .......... .......... .......... .......... 34% 49.1M 1s 2023-10-05T11:43:22.422 INFO:teuthology.orchestra.run.smithi012.stderr: 31950K .......... .......... .......... .......... .......... 34% 70.6M 1s 2023-10-05T11:43:22.422 INFO:teuthology.orchestra.run.smithi012.stderr: 32000K .......... .......... .......... .......... .......... 34% 117M 1s 2023-10-05T11:43:22.422 INFO:teuthology.orchestra.run.smithi012.stderr: 32050K .......... .......... .......... .......... .......... 34% 58.1M 1s 2023-10-05T11:43:22.422 INFO:teuthology.orchestra.run.smithi012.stderr: 32100K .......... .......... .......... .......... .......... 34% 51.4M 1s 2023-10-05T11:43:22.422 INFO:teuthology.orchestra.run.smithi012.stderr: 32150K .......... .......... .......... .......... .......... 34% 81.4M 1s 2023-10-05T11:43:22.422 INFO:teuthology.orchestra.run.smithi012.stderr: 32200K .......... .......... .......... .......... .......... 34% 46.7M 1s 2023-10-05T11:43:22.422 INFO:teuthology.orchestra.run.smithi012.stderr: 32250K .......... .......... .......... .......... .......... 34% 62.4M 1s 2023-10-05T11:43:22.422 INFO:teuthology.orchestra.run.smithi012.stderr: 32300K .......... .......... .......... .......... .......... 34% 50.1M 1s 2023-10-05T11:43:22.422 INFO:teuthology.orchestra.run.smithi012.stderr: 32350K .......... .......... .......... .......... .......... 34% 91.4M 1s 2023-10-05T11:43:22.422 INFO:teuthology.orchestra.run.smithi012.stderr: 32400K .......... .......... .......... .......... .......... 34% 50.7M 1s 2023-10-05T11:43:22.422 INFO:teuthology.orchestra.run.smithi012.stderr: 32450K .......... .......... .......... .......... .......... 34% 50.2M 1s 2023-10-05T11:43:22.423 INFO:teuthology.orchestra.run.smithi012.stderr: 32500K .......... .......... .......... .......... .......... 35% 112M 1s 2023-10-05T11:43:22.423 INFO:teuthology.orchestra.run.smithi012.stderr: 32550K .......... .......... .......... .......... .......... 35% 48.3M 1s 2023-10-05T11:43:22.423 INFO:teuthology.orchestra.run.smithi012.stderr: 32600K .......... .......... .......... .......... .......... 35% 50.5M 1s 2023-10-05T11:43:22.423 INFO:teuthology.orchestra.run.smithi012.stderr: 32650K .......... .......... .......... .......... .......... 35% 73.3M 1s 2023-10-05T11:43:22.423 INFO:teuthology.orchestra.run.smithi012.stderr: 32700K .......... .......... .......... .......... .......... 35% 126M 1s 2023-10-05T11:43:22.423 INFO:teuthology.orchestra.run.smithi012.stderr: 32750K .......... .......... .......... .......... .......... 35% 83.1M 1s 2023-10-05T11:43:22.423 INFO:teuthology.orchestra.run.smithi012.stderr: 32800K .......... .......... .......... .......... .......... 35% 116M 1s 2023-10-05T11:43:22.423 INFO:teuthology.orchestra.run.smithi012.stderr: 32850K .......... .......... .......... .......... .......... 35% 57.6M 1s 2023-10-05T11:43:22.423 INFO:teuthology.orchestra.run.smithi012.stderr: 32900K .......... .......... .......... .......... .......... 35% 84.3M 1s 2023-10-05T11:43:22.423 INFO:teuthology.orchestra.run.smithi012.stderr: 32950K .......... .......... .......... .......... .......... 35% 93.8M 1s 2023-10-05T11:43:22.423 INFO:teuthology.orchestra.run.smithi012.stderr: 33000K .......... .......... .......... .......... .......... 35% 79.7M 1s 2023-10-05T11:43:22.423 INFO:teuthology.orchestra.run.smithi012.stderr: 33050K .......... .......... .......... .......... .......... 35% 67.0M 1s 2023-10-05T11:43:22.424 INFO:teuthology.orchestra.run.smithi012.stderr: 33100K .......... .......... .......... .......... .......... 35% 58.8M 1s 2023-10-05T11:43:22.424 INFO:teuthology.orchestra.run.smithi012.stderr: 33150K .......... .......... .......... .......... .......... 35% 91.4M 1s 2023-10-05T11:43:22.424 INFO:teuthology.orchestra.run.smithi012.stderr: 33200K .......... .......... .......... .......... .......... 35% 49.4M 1s 2023-10-05T11:43:22.424 INFO:teuthology.orchestra.run.smithi012.stderr: 33250K .......... .......... .......... .......... .......... 35% 82.8M 1s 2023-10-05T11:43:22.424 INFO:teuthology.orchestra.run.smithi012.stderr: 33300K .......... .......... .......... .......... .......... 35% 123M 1s 2023-10-05T11:43:22.424 INFO:teuthology.orchestra.run.smithi012.stderr: 33350K .......... .......... .......... .......... .......... 35% 109M 1s 2023-10-05T11:43:22.424 INFO:teuthology.orchestra.run.smithi012.stderr: 33400K .......... .......... .......... .......... .......... 36% 50.7M 1s 2023-10-05T11:43:22.424 INFO:teuthology.orchestra.run.smithi012.stderr: 33450K .......... .......... .......... .......... .......... 36% 57.5M 1s 2023-10-05T11:43:22.424 INFO:teuthology.orchestra.run.smithi012.stderr: 33500K .......... .......... .......... .......... .......... 36% 111M 1s 2023-10-05T11:43:22.424 INFO:teuthology.orchestra.run.smithi012.stderr: 33550K .......... .......... .......... .......... .......... 36% 75.0M 1s 2023-10-05T11:43:22.424 INFO:teuthology.orchestra.run.smithi012.stderr: 33600K .......... .......... .......... .......... .......... 36% 50.4M 1s 2023-10-05T11:43:22.424 INFO:teuthology.orchestra.run.smithi012.stderr: 33650K .......... .......... .......... .......... .......... 36% 59.1M 1s 2023-10-05T11:43:22.425 INFO:teuthology.orchestra.run.smithi012.stderr: 33700K .......... .......... .......... .......... .......... 36% 80.8M 1s 2023-10-05T11:43:22.425 INFO:teuthology.orchestra.run.smithi012.stderr: 33750K .......... .......... .......... .......... .......... 36% 60.3M 1s 2023-10-05T11:43:22.425 INFO:teuthology.orchestra.run.smithi012.stderr: 33800K .......... .......... .......... .......... .......... 36% 50.3M 1s 2023-10-05T11:43:22.425 INFO:teuthology.orchestra.run.smithi012.stderr: 33850K .......... .......... .......... .......... .......... 36% 49.5M 1s 2023-10-05T11:43:22.425 INFO:teuthology.orchestra.run.smithi012.stderr: 33900K .......... .......... .......... .......... .......... 36% 49.2M 1s 2023-10-05T11:43:22.425 INFO:teuthology.orchestra.run.smithi012.stderr: 33950K .......... .......... .......... .......... .......... 36% 10.3M 1s 2023-10-05T11:43:22.425 INFO:teuthology.orchestra.run.smithi012.stderr: 34000K .......... .......... .......... .......... .......... 36% 105M 1s 2023-10-05T11:43:22.425 INFO:teuthology.orchestra.run.smithi012.stderr: 34050K .......... .......... .......... .......... .......... 36% 50.5M 1s 2023-10-05T11:43:22.425 INFO:teuthology.orchestra.run.smithi012.stderr: 34100K .......... .......... .......... .......... .......... 36% 30.6M 1s 2023-10-05T11:43:22.425 INFO:teuthology.orchestra.run.smithi012.stderr: 34150K .......... .......... .......... .......... .......... 36% 47.3M 1s 2023-10-05T11:43:22.425 INFO:teuthology.orchestra.run.smithi012.stderr: 34200K .......... .......... .......... .......... .......... 36% 115M 1s 2023-10-05T11:43:22.425 INFO:teuthology.orchestra.run.smithi012.stderr: 34250K .......... .......... .......... .......... .......... 36% 114M 1s 2023-10-05T11:43:22.426 INFO:teuthology.orchestra.run.smithi012.stderr: 34300K .......... .......... .......... .......... .......... 36% 49.7M 1s 2023-10-05T11:43:22.426 INFO:teuthology.orchestra.run.smithi012.stderr: 34350K .......... .......... .......... .......... .......... 37% 70.5M 1s 2023-10-05T11:43:22.426 INFO:teuthology.orchestra.run.smithi012.stderr: 34400K .......... .......... .......... .......... .......... 37% 103M 1s 2023-10-05T11:43:22.426 INFO:teuthology.orchestra.run.smithi012.stderr: 34450K .......... .......... .......... .......... .......... 37% 56.1M 1s 2023-10-05T11:43:22.426 INFO:teuthology.orchestra.run.smithi012.stderr: 34500K .......... .......... .......... .......... .......... 37% 125M 1s 2023-10-05T11:43:22.426 INFO:teuthology.orchestra.run.smithi012.stderr: 34550K .......... .......... .......... .......... .......... 37% 43.1M 1s 2023-10-05T11:43:22.426 INFO:teuthology.orchestra.run.smithi012.stderr: 34600K .......... .......... .......... .......... .......... 37% 55.3M 1s 2023-10-05T11:43:22.426 INFO:teuthology.orchestra.run.smithi012.stderr: 34650K .......... .......... .......... .......... .......... 37% 78.0M 1s 2023-10-05T11:43:22.426 INFO:teuthology.orchestra.run.smithi012.stderr: 34700K .......... .......... .......... .......... .......... 37% 130M 1s 2023-10-05T11:43:22.426 INFO:teuthology.orchestra.run.smithi012.stderr: 34750K .......... .......... .......... .......... .......... 37% 31.9M 1s 2023-10-05T11:43:22.426 INFO:teuthology.orchestra.run.smithi012.stderr: 34800K .......... .......... .......... .......... .......... 37% 83.1M 1s 2023-10-05T11:43:22.426 INFO:teuthology.orchestra.run.smithi012.stderr: 34850K .......... .......... .......... .......... .......... 37% 46.8M 1s 2023-10-05T11:43:22.427 INFO:teuthology.orchestra.run.smithi012.stderr: 34900K .......... .......... .......... .......... .......... 37% 37.8M 1s 2023-10-05T11:43:22.427 INFO:teuthology.orchestra.run.smithi012.stderr: 34950K .......... .......... .......... .......... .......... 37% 139M 1s 2023-10-05T11:43:22.427 INFO:teuthology.orchestra.run.smithi012.stderr: 35000K .......... .......... .......... .......... .......... 37% 84.2M 1s 2023-10-05T11:43:22.427 INFO:teuthology.orchestra.run.smithi012.stderr: 35050K .......... .......... .......... .......... .......... 37% 56.8M 1s 2023-10-05T11:43:22.427 INFO:teuthology.orchestra.run.smithi012.stderr: 35100K .......... .......... .......... .......... .......... 37% 95.1M 1s 2023-10-05T11:43:22.427 INFO:teuthology.orchestra.run.smithi012.stderr: 35150K .......... .......... .......... .......... .......... 37% 57.5M 1s 2023-10-05T11:43:22.427 INFO:teuthology.orchestra.run.smithi012.stderr: 35200K .......... .......... .......... .......... .......... 37% 75.3M 1s 2023-10-05T11:43:22.427 INFO:teuthology.orchestra.run.smithi012.stderr: 35250K .......... .......... .......... .......... .......... 37% 60.1M 1s 2023-10-05T11:43:22.427 INFO:teuthology.orchestra.run.smithi012.stderr: 35300K .......... .......... .......... .......... .......... 38% 76.5M 1s 2023-10-05T11:43:22.427 INFO:teuthology.orchestra.run.smithi012.stderr: 35350K .......... .......... .......... .......... .......... 38% 114M 1s 2023-10-05T11:43:22.427 INFO:teuthology.orchestra.run.smithi012.stderr: 35400K .......... .......... .......... .......... .......... 38% 105M 1s 2023-10-05T11:43:22.427 INFO:teuthology.orchestra.run.smithi012.stderr: 35450K .......... .......... .......... .......... .......... 38% 42.9M 1s 2023-10-05T11:43:22.427 INFO:teuthology.orchestra.run.smithi012.stderr: 35500K .......... .......... .......... .......... .......... 38% 59.1M 1s 2023-10-05T11:43:22.428 INFO:teuthology.orchestra.run.smithi012.stderr: 35550K .......... .......... .......... .......... .......... 38% 52.1M 1s 2023-10-05T11:43:22.428 INFO:teuthology.orchestra.run.smithi012.stderr: 35600K .......... .......... .......... .......... .......... 38% 43.9M 1s 2023-10-05T11:43:22.428 INFO:teuthology.orchestra.run.smithi012.stderr: 35650K .......... .......... .......... .......... .......... 38% 116M 1s 2023-10-05T11:43:22.428 INFO:teuthology.orchestra.run.smithi012.stderr: 35700K .......... .......... .......... .......... .......... 38% 60.5M 1s 2023-10-05T11:43:22.428 INFO:teuthology.orchestra.run.smithi012.stderr: 35750K .......... .......... .......... .......... .......... 38% 73.1M 1s 2023-10-05T11:43:22.428 INFO:teuthology.orchestra.run.smithi012.stderr: 35800K .......... .......... .......... .......... .......... 38% 32.8M 1s 2023-10-05T11:43:22.428 INFO:teuthology.orchestra.run.smithi012.stderr: 35850K .......... .......... .......... .......... .......... 38% 131M 1s 2023-10-05T11:43:22.428 INFO:teuthology.orchestra.run.smithi012.stderr: 35900K .......... .......... .......... .......... .......... 38% 108M 1s 2023-10-05T11:43:22.428 INFO:teuthology.orchestra.run.smithi012.stderr: 35950K .......... .......... .......... .......... .......... 38% 67.6M 1s 2023-10-05T11:43:22.428 INFO:teuthology.orchestra.run.smithi012.stderr: 36000K .......... .......... .......... .......... .......... 38% 51.0M 1s 2023-10-05T11:43:22.428 INFO:teuthology.orchestra.run.smithi012.stderr: 36050K .......... .......... .......... .......... .......... 38% 91.3M 1s 2023-10-05T11:43:22.428 INFO:teuthology.orchestra.run.smithi012.stderr: 36100K .......... .......... .......... .......... .......... 38% 50.3M 1s 2023-10-05T11:43:22.429 INFO:teuthology.orchestra.run.smithi012.stderr: 36150K .......... .......... .......... .......... .......... 38% 88.2M 1s 2023-10-05T11:43:22.429 INFO:teuthology.orchestra.run.smithi012.stderr: 36200K .......... .......... .......... .......... .......... 39% 38.7M 1s 2023-10-05T11:43:22.429 INFO:teuthology.orchestra.run.smithi012.stderr: 36250K .......... .......... .......... .......... .......... 39% 97.4M 1s 2023-10-05T11:43:22.429 INFO:teuthology.orchestra.run.smithi012.stderr: 36300K .......... .......... .......... .......... .......... 39% 41.8M 1s 2023-10-05T11:43:22.429 INFO:teuthology.orchestra.run.smithi012.stderr: 36350K .......... .......... .......... .......... .......... 39% 91.3M 1s 2023-10-05T11:43:22.429 INFO:teuthology.orchestra.run.smithi012.stderr: 36400K .......... .......... .......... .......... .......... 39% 41.9M 1s 2023-10-05T11:43:22.429 INFO:teuthology.orchestra.run.smithi012.stderr: 36450K .......... .......... .......... .......... .......... 39% 88.8M 1s 2023-10-05T11:43:22.429 INFO:teuthology.orchestra.run.smithi012.stderr: 36500K .......... .......... .......... .......... .......... 39% 112M 1s 2023-10-05T11:43:22.429 INFO:teuthology.orchestra.run.smithi012.stderr: 36550K .......... .......... .......... .......... .......... 39% 147M 1s 2023-10-05T11:43:22.429 INFO:teuthology.orchestra.run.smithi012.stderr: 36600K .......... .......... .......... .......... .......... 39% 57.7M 1s 2023-10-05T11:43:22.429 INFO:teuthology.orchestra.run.smithi012.stderr: 36650K .......... .......... .......... .......... .......... 39% 59.8M 1s 2023-10-05T11:43:22.429 INFO:teuthology.orchestra.run.smithi012.stderr: 36700K .......... .......... .......... .......... .......... 39% 149M 1s 2023-10-05T11:43:22.429 INFO:teuthology.orchestra.run.smithi012.stderr: 36750K .......... .......... .......... .......... .......... 39% 86.0M 1s 2023-10-05T11:43:22.430 INFO:teuthology.orchestra.run.smithi012.stderr: 36800K .......... .......... .......... .......... .......... 39% 50.6M 1s 2023-10-05T11:43:22.430 INFO:teuthology.orchestra.run.smithi012.stderr: 36850K .......... .......... .......... .......... .......... 39% 51.7M 1s 2023-10-05T11:43:22.430 INFO:teuthology.orchestra.run.smithi012.stderr: 36900K .......... .......... .......... .......... .......... 39% 72.6M 1s 2023-10-05T11:43:22.430 INFO:teuthology.orchestra.run.smithi012.stderr: 36950K .......... .......... .......... .......... .......... 39% 15.5M 1s 2023-10-05T11:43:22.430 INFO:teuthology.orchestra.run.smithi012.stderr: 37000K .......... .......... .......... .......... .......... 39% 62.0M 1s 2023-10-05T11:43:22.430 INFO:teuthology.orchestra.run.smithi012.stderr: 37050K .......... .......... .......... .......... .......... 39% 86.3M 1s 2023-10-05T11:43:22.430 INFO:teuthology.orchestra.run.smithi012.stderr: 37100K .......... .......... .......... .......... .......... 39% 49.6M 1s 2023-10-05T11:43:22.430 INFO:teuthology.orchestra.run.smithi012.stderr: 37150K .......... .......... .......... .......... .......... 40% 32.4M 1s 2023-10-05T11:43:22.430 INFO:teuthology.orchestra.run.smithi012.stderr: 37200K .......... .......... .......... .......... .......... 40% 110M 1s 2023-10-05T11:43:22.430 INFO:teuthology.orchestra.run.smithi012.stderr: 37250K .......... .......... .......... .......... .......... 40% 127M 1s 2023-10-05T11:43:22.430 INFO:teuthology.orchestra.run.smithi012.stderr: 37300K .......... .......... .......... .......... .......... 40% 50.4M 1s 2023-10-05T11:43:22.430 INFO:teuthology.orchestra.run.smithi012.stderr: 37350K .......... .......... .......... .......... .......... 40% 81.3M 1s 2023-10-05T11:43:22.431 INFO:teuthology.orchestra.run.smithi012.stderr: 37400K .......... .......... .......... .......... .......... 40% 60.9M 1s 2023-10-05T11:43:22.431 INFO:teuthology.orchestra.run.smithi012.stderr: 37450K .......... .......... .......... .......... .......... 40% 109M 1s 2023-10-05T11:43:22.431 INFO:teuthology.orchestra.run.smithi012.stderr: 37500K .......... .......... .......... .......... .......... 40% 72.8M 1s 2023-10-05T11:43:22.431 INFO:teuthology.orchestra.run.smithi012.stderr: 37550K .......... .......... .......... .......... .......... 40% 89.6M 1s 2023-10-05T11:43:22.431 INFO:teuthology.orchestra.run.smithi012.stderr: 37600K .......... .......... .......... .......... .......... 40% 109M 1s 2023-10-05T11:43:22.431 INFO:teuthology.orchestra.run.smithi012.stderr: 37650K .......... .......... .......... .......... .......... 40% 117M 1s 2023-10-05T11:43:22.431 INFO:teuthology.orchestra.run.smithi012.stderr: 37700K .......... .......... .......... .......... .......... 40% 105M 1s 2023-10-05T11:43:22.431 INFO:teuthology.orchestra.run.smithi012.stderr: 37750K .......... .......... .......... .......... .......... 40% 107M 1s 2023-10-05T11:43:22.431 INFO:teuthology.orchestra.run.smithi012.stderr: 37800K .......... .......... .......... .......... .......... 40% 82.2M 1s 2023-10-05T11:43:22.431 INFO:teuthology.orchestra.run.smithi012.stderr: 37850K .......... .......... .......... .......... .......... 40% 157M 1s 2023-10-05T11:43:22.431 INFO:teuthology.orchestra.run.smithi012.stderr: 37900K .......... .......... .......... .......... .......... 40% 123M 1s 2023-10-05T11:43:22.431 INFO:teuthology.orchestra.run.smithi012.stderr: 37950K .......... .......... .......... .......... .......... 40% 99.3M 1s 2023-10-05T11:43:22.432 INFO:teuthology.orchestra.run.smithi012.stderr: 38000K .......... .......... .......... .......... .......... 40% 115M 1s 2023-10-05T11:43:22.432 INFO:teuthology.orchestra.run.smithi012.stderr: 38050K .......... .......... .......... .......... .......... 41% 115M 1s 2023-10-05T11:43:22.432 INFO:teuthology.orchestra.run.smithi012.stderr: 38100K .......... .......... .......... .......... .......... 41% 113M 1s 2023-10-05T11:43:22.432 INFO:teuthology.orchestra.run.smithi012.stderr: 38150K .......... .......... .......... .......... .......... 41% 97.4M 1s 2023-10-05T11:43:22.432 INFO:teuthology.orchestra.run.smithi012.stderr: 38200K .......... .......... .......... .......... .......... 41% 108M 1s 2023-10-05T11:43:22.432 INFO:teuthology.orchestra.run.smithi012.stderr: 38250K .......... .......... .......... .......... .......... 41% 106M 1s 2023-10-05T11:43:22.432 INFO:teuthology.orchestra.run.smithi012.stderr: 38300K .......... .......... .......... .......... .......... 41% 130M 1s 2023-10-05T11:43:22.432 INFO:teuthology.orchestra.run.smithi012.stderr: 38350K .......... .......... .......... .......... .......... 41% 78.1M 1s 2023-10-05T11:43:22.432 INFO:teuthology.orchestra.run.smithi012.stderr: 38400K .......... .......... .......... .......... .......... 41% 126M 1s 2023-10-05T11:43:22.432 INFO:teuthology.orchestra.run.smithi012.stderr: 38450K .......... .......... .......... .......... .......... 41% 113M 1s 2023-10-05T11:43:22.432 INFO:teuthology.orchestra.run.smithi012.stderr: 38500K .......... .......... .......... .......... .......... 41% 115M 1s 2023-10-05T11:43:22.432 INFO:teuthology.orchestra.run.smithi012.stderr: 38550K .......... .......... .......... .......... .......... 41% 113M 1s 2023-10-05T11:43:22.433 INFO:teuthology.orchestra.run.smithi012.stderr: 38600K .......... .......... .......... .......... .......... 41% 130M 1s 2023-10-05T11:43:22.433 INFO:teuthology.orchestra.run.smithi012.stderr: 38650K .......... .......... .......... .......... .......... 41% 119M 1s 2023-10-05T11:43:22.433 INFO:teuthology.orchestra.run.smithi012.stderr: 38700K .......... .......... .......... .......... .......... 41% 106M 1s 2023-10-05T11:43:22.433 INFO:teuthology.orchestra.run.smithi012.stderr: 38750K .......... .......... .......... .......... .......... 41% 90.3M 1s 2023-10-05T11:43:22.433 INFO:teuthology.orchestra.run.smithi012.stderr: 38800K .......... .......... .......... .......... .......... 41% 40.9M 1s 2023-10-05T11:43:22.433 INFO:teuthology.orchestra.run.smithi012.stderr: 38850K .......... .......... .......... .......... .......... 41% 36.8M 1s 2023-10-05T11:43:22.433 INFO:teuthology.orchestra.run.smithi012.stderr: 38900K .......... .......... .......... .......... .......... 41% 20.8M 1s 2023-10-05T11:43:22.433 INFO:teuthology.orchestra.run.smithi012.stderr: 38950K .......... .......... .......... .......... .......... 41% 106M 1s 2023-10-05T11:43:22.433 INFO:teuthology.orchestra.run.smithi012.stderr: 39000K .......... .......... .......... .......... .......... 42% 104M 1s 2023-10-05T11:43:22.433 INFO:teuthology.orchestra.run.smithi012.stderr: 39050K .......... .......... .......... .......... .......... 42% 119M 1s 2023-10-05T11:43:22.433 INFO:teuthology.orchestra.run.smithi012.stderr: 39100K .......... .......... .......... .......... .......... 42% 113M 1s 2023-10-05T11:43:22.433 INFO:teuthology.orchestra.run.smithi012.stderr: 39150K .......... .......... .......... .......... .......... 42% 91.3M 1s 2023-10-05T11:43:22.433 INFO:teuthology.orchestra.run.smithi012.stderr: 39200K .......... .......... .......... .......... .......... 42% 99.9M 1s 2023-10-05T11:43:22.434 INFO:teuthology.orchestra.run.smithi012.stderr: 39250K .......... .......... .......... .......... .......... 42% 120M 1s 2023-10-05T11:43:22.434 INFO:teuthology.orchestra.run.smithi012.stderr: 39300K .......... .......... .......... .......... .......... 42% 92.3M 1s 2023-10-05T11:43:22.434 INFO:teuthology.orchestra.run.smithi012.stderr: 39350K .......... .......... .......... .......... .......... 42% 104M 1s 2023-10-05T11:43:22.434 INFO:teuthology.orchestra.run.smithi012.stderr: 39400K .......... .......... .......... .......... .......... 42% 147M 1s 2023-10-05T11:43:22.434 INFO:teuthology.orchestra.run.smithi012.stderr: 39450K .......... .......... .......... .......... .......... 42% 100M 1s 2023-10-05T11:43:22.434 INFO:teuthology.orchestra.run.smithi012.stderr: 39500K .......... .......... .......... .......... .......... 42% 103M 1s 2023-10-05T11:43:22.434 INFO:teuthology.orchestra.run.smithi012.stderr: 39550K .......... .......... .......... .......... .......... 42% 58.3M 1s 2023-10-05T11:43:22.434 INFO:teuthology.orchestra.run.smithi012.stderr: 39600K .......... .......... .......... .......... .......... 42% 85.9M 1s 2023-10-05T11:43:22.434 INFO:teuthology.orchestra.run.smithi012.stderr: 39650K .......... .......... .......... .......... .......... 42% 69.8M 1s 2023-10-05T11:43:22.434 INFO:teuthology.orchestra.run.smithi012.stderr: 39700K .......... .......... .......... .......... .......... 42% 89.7M 1s 2023-10-05T11:43:22.434 INFO:teuthology.orchestra.run.smithi012.stderr: 39750K .......... .......... .......... .......... .......... 42% 80.3M 1s 2023-10-05T11:43:22.435 INFO:teuthology.orchestra.run.smithi012.stderr: 39800K .......... .......... .......... .......... .......... 42% 87.7M 1s 2023-10-05T11:43:22.435 INFO:teuthology.orchestra.run.smithi012.stderr: 39850K .......... .......... .......... .......... .......... 42% 83.2M 1s 2023-10-05T11:43:22.435 INFO:teuthology.orchestra.run.smithi012.stderr: 39900K .......... .......... .......... .......... .......... 43% 94.0M 1s 2023-10-05T11:43:22.435 INFO:teuthology.orchestra.run.smithi012.stderr: 39950K .......... .......... .......... .......... .......... 43% 27.6M 1s 2023-10-05T11:43:22.435 INFO:teuthology.orchestra.run.smithi012.stderr: 40000K .......... .......... .......... .......... .......... 43% 135M 1s 2023-10-05T11:43:22.435 INFO:teuthology.orchestra.run.smithi012.stderr: 40050K .......... .......... .......... .......... .......... 43% 120M 1s 2023-10-05T11:43:22.435 INFO:teuthology.orchestra.run.smithi012.stderr: 40100K .......... .......... .......... .......... .......... 43% 203M 1s 2023-10-05T11:43:22.435 INFO:teuthology.orchestra.run.smithi012.stderr: 40150K .......... .......... .......... .......... .......... 43% 127M 1s 2023-10-05T11:43:22.435 INFO:teuthology.orchestra.run.smithi012.stderr: 40200K .......... .......... .......... .......... .......... 43% 81.4M 1s 2023-10-05T11:43:22.435 INFO:teuthology.orchestra.run.smithi012.stderr: 40250K .......... .......... .......... .......... .......... 43% 86.7M 1s 2023-10-05T11:43:22.435 INFO:teuthology.orchestra.run.smithi012.stderr: 40300K .......... .......... .......... .......... .......... 43% 77.8M 1s 2023-10-05T11:43:22.435 INFO:teuthology.orchestra.run.smithi012.stderr: 40350K .......... .......... .......... .......... .......... 43% 96.7M 1s 2023-10-05T11:43:22.435 INFO:teuthology.orchestra.run.smithi012.stderr: 40400K .......... .......... .......... .......... .......... 43% 109M 1s 2023-10-05T11:43:22.436 INFO:teuthology.orchestra.run.smithi012.stderr: 40450K .......... .......... .......... .......... .......... 43% 196M 1s 2023-10-05T11:43:22.436 INFO:teuthology.orchestra.run.smithi012.stderr: 40500K .......... .......... .......... .......... .......... 43% 126M 1s 2023-10-05T11:43:22.436 INFO:teuthology.orchestra.run.smithi012.stderr: 40550K .......... .......... .......... .......... .......... 43% 90.3M 1s 2023-10-05T11:43:22.436 INFO:teuthology.orchestra.run.smithi012.stderr: 40600K .......... .......... .......... .......... .......... 43% 86.0M 1s 2023-10-05T11:43:22.436 INFO:teuthology.orchestra.run.smithi012.stderr: 40650K .......... .......... .......... .......... .......... 43% 172M 1s 2023-10-05T11:43:22.436 INFO:teuthology.orchestra.run.smithi012.stderr: 40700K .......... .......... .......... .......... .......... 43% 210M 1s 2023-10-05T11:43:22.436 INFO:teuthology.orchestra.run.smithi012.stderr: 40750K .......... .......... .......... .......... .......... 43% 175M 1s 2023-10-05T11:43:22.436 INFO:teuthology.orchestra.run.smithi012.stderr: 40800K .......... .......... .......... .......... .......... 43% 217M 1s 2023-10-05T11:43:22.436 INFO:teuthology.orchestra.run.smithi012.stderr: 40850K .......... .......... .......... .......... .......... 44% 223M 1s 2023-10-05T11:43:22.436 INFO:teuthology.orchestra.run.smithi012.stderr: 40900K .......... .......... .......... .......... .......... 44% 212M 1s 2023-10-05T11:43:22.436 INFO:teuthology.orchestra.run.smithi012.stderr: 40950K .......... .......... .......... .......... .......... 44% 208M 1s 2023-10-05T11:43:22.436 INFO:teuthology.orchestra.run.smithi012.stderr: 41000K .......... .......... .......... .......... .......... 44% 226M 1s 2023-10-05T11:43:22.437 INFO:teuthology.orchestra.run.smithi012.stderr: 41050K .......... .......... .......... .......... .......... 44% 218M 1s 2023-10-05T11:43:22.437 INFO:teuthology.orchestra.run.smithi012.stderr: 41100K .......... .......... .......... .......... .......... 44% 133M 1s 2023-10-05T11:43:22.437 INFO:teuthology.orchestra.run.smithi012.stderr: 41150K .......... .......... .......... .......... .......... 44% 85.1M 1s 2023-10-05T11:43:22.437 INFO:teuthology.orchestra.run.smithi012.stderr: 41200K .......... .......... .......... .......... .......... 44% 111M 1s 2023-10-05T11:43:22.437 INFO:teuthology.orchestra.run.smithi012.stderr: 41250K .......... .......... .......... .......... .......... 44% 115M 1s 2023-10-05T11:43:22.437 INFO:teuthology.orchestra.run.smithi012.stderr: 41300K .......... .......... .......... .......... .......... 44% 96.8M 1s 2023-10-05T11:43:22.437 INFO:teuthology.orchestra.run.smithi012.stderr: 41350K .......... .......... .......... .......... .......... 44% 125M 1s 2023-10-05T11:43:22.437 INFO:teuthology.orchestra.run.smithi012.stderr: 41400K .......... .......... .......... .......... .......... 44% 114M 1s 2023-10-05T11:43:22.437 INFO:teuthology.orchestra.run.smithi012.stderr: 41450K .......... .......... .......... .......... .......... 44% 120M 1s 2023-10-05T11:43:22.437 INFO:teuthology.orchestra.run.smithi012.stderr: 41500K .......... .......... .......... .......... .......... 44% 105M 1s 2023-10-05T11:43:22.437 INFO:teuthology.orchestra.run.smithi012.stderr: 41550K .......... .......... .......... .......... .......... 44% 79.3M 1s 2023-10-05T11:43:22.437 INFO:teuthology.orchestra.run.smithi012.stderr: 41600K .......... .......... .......... .......... .......... 44% 108M 1s 2023-10-05T11:43:22.438 INFO:teuthology.orchestra.run.smithi012.stderr: 41650K .......... .......... .......... .......... .......... 44% 119M 1s 2023-10-05T11:43:22.438 INFO:teuthology.orchestra.run.smithi012.stderr: 41700K .......... .......... .......... .......... .......... 44% 109M 1s 2023-10-05T11:43:22.438 INFO:teuthology.orchestra.run.smithi012.stderr: 41750K .......... .......... .......... .......... .......... 44% 110M 1s 2023-10-05T11:43:22.438 INFO:teuthology.orchestra.run.smithi012.stderr: 41800K .......... .......... .......... .......... .......... 45% 49.7M 1s 2023-10-05T11:43:22.438 INFO:teuthology.orchestra.run.smithi012.stderr: 41850K .......... .......... .......... .......... .......... 45% 78.9M 1s 2023-10-05T11:43:22.438 INFO:teuthology.orchestra.run.smithi012.stderr: 41900K .......... .......... .......... .......... .......... 45% 14.4M 1s 2023-10-05T11:43:22.438 INFO:teuthology.orchestra.run.smithi012.stderr: 41950K .......... .......... .......... .......... .......... 45% 87.7M 1s 2023-10-05T11:43:22.438 INFO:teuthology.orchestra.run.smithi012.stderr: 42000K .......... .......... .......... .......... .......... 45% 89.8M 1s 2023-10-05T11:43:22.438 INFO:teuthology.orchestra.run.smithi012.stderr: 42050K .......... .......... .......... .......... .......... 45% 129M 1s 2023-10-05T11:43:22.438 INFO:teuthology.orchestra.run.smithi012.stderr: 42100K .......... .......... .......... .......... .......... 45% 112M 1s 2023-10-05T11:43:22.438 INFO:teuthology.orchestra.run.smithi012.stderr: 42150K .......... .......... .......... .......... .......... 45% 114M 1s 2023-10-05T11:43:22.438 INFO:teuthology.orchestra.run.smithi012.stderr: 42200K .......... .......... .......... .......... .......... 45% 104M 1s 2023-10-05T11:43:22.439 INFO:teuthology.orchestra.run.smithi012.stderr: 42250K .......... .......... .......... .......... .......... 45% 114M 1s 2023-10-05T11:43:22.439 INFO:teuthology.orchestra.run.smithi012.stderr: 42300K .......... .......... .......... .......... .......... 45% 118M 1s 2023-10-05T11:43:22.439 INFO:teuthology.orchestra.run.smithi012.stderr: 42350K .......... .......... .......... .......... .......... 45% 88.3M 1s 2023-10-05T11:43:22.439 INFO:teuthology.orchestra.run.smithi012.stderr: 42400K .......... .......... .......... .......... .......... 45% 111M 1s 2023-10-05T11:43:22.439 INFO:teuthology.orchestra.run.smithi012.stderr: 42450K .......... .......... .......... .......... .......... 45% 123M 1s 2023-10-05T11:43:22.439 INFO:teuthology.orchestra.run.smithi012.stderr: 42500K .......... .......... .......... .......... .......... 45% 109M 1s 2023-10-05T11:43:22.439 INFO:teuthology.orchestra.run.smithi012.stderr: 42550K .......... .......... .......... .......... .......... 45% 45.2M 1s 2023-10-05T11:43:22.439 INFO:teuthology.orchestra.run.smithi012.stderr: 42600K .......... .......... .......... .......... .......... 45% 108M 1s 2023-10-05T11:43:22.439 INFO:teuthology.orchestra.run.smithi012.stderr: 42650K .......... .......... .......... .......... .......... 45% 117M 1s 2023-10-05T11:43:22.439 INFO:teuthology.orchestra.run.smithi012.stderr: 42700K .......... .......... .......... .......... .......... 46% 103M 1s 2023-10-05T11:43:22.439 INFO:teuthology.orchestra.run.smithi012.stderr: 42750K .......... .......... .......... .......... .......... 46% 94.2M 1s 2023-10-05T11:43:22.439 INFO:teuthology.orchestra.run.smithi012.stderr: 42800K .......... .......... .......... .......... .......... 46% 105M 1s 2023-10-05T11:43:22.440 INFO:teuthology.orchestra.run.smithi012.stderr: 42850K .......... .......... .......... .......... .......... 46% 120M 1s 2023-10-05T11:43:22.440 INFO:teuthology.orchestra.run.smithi012.stderr: 42900K .......... .......... .......... .......... .......... 46% 117M 1s 2023-10-05T11:43:22.440 INFO:teuthology.orchestra.run.smithi012.stderr: 42950K .......... .......... .......... .......... .......... 46% 98.6M 1s 2023-10-05T11:43:22.440 INFO:teuthology.orchestra.run.smithi012.stderr: 43000K .......... .......... .......... .......... .......... 46% 35.6M 1s 2023-10-05T11:43:22.440 INFO:teuthology.orchestra.run.smithi012.stderr: 43050K .......... .......... .......... .......... .......... 46% 123M 1s 2023-10-05T11:43:22.440 INFO:teuthology.orchestra.run.smithi012.stderr: 43100K .......... .......... .......... .......... .......... 46% 114M 1s 2023-10-05T11:43:22.440 INFO:teuthology.orchestra.run.smithi012.stderr: 43150K .......... .......... .......... .......... .......... 46% 90.0M 1s 2023-10-05T11:43:22.440 INFO:teuthology.orchestra.run.smithi012.stderr: 43200K .......... .......... .......... .......... .......... 46% 118M 1s 2023-10-05T11:43:22.440 INFO:teuthology.orchestra.run.smithi012.stderr: 43250K .......... .......... .......... .......... .......... 46% 111M 1s 2023-10-05T11:43:22.440 INFO:teuthology.orchestra.run.smithi012.stderr: 43300K .......... .......... .......... .......... .......... 46% 111M 1s 2023-10-05T11:43:22.440 INFO:teuthology.orchestra.run.smithi012.stderr: 43350K .......... .......... .......... .......... .......... 46% 102M 1s 2023-10-05T11:43:22.440 INFO:teuthology.orchestra.run.smithi012.stderr: 43400K .......... .......... .......... .......... .......... 46% 111M 1s 2023-10-05T11:43:22.440 INFO:teuthology.orchestra.run.smithi012.stderr: 43450K .......... .......... .......... .......... .......... 46% 138M 1s 2023-10-05T11:43:22.441 INFO:teuthology.orchestra.run.smithi012.stderr: 43500K .......... .......... .......... .......... .......... 46% 113M 1s 2023-10-05T11:43:22.441 INFO:teuthology.orchestra.run.smithi012.stderr: 43550K .......... .......... .......... .......... .......... 46% 90.6M 1s 2023-10-05T11:43:22.441 INFO:teuthology.orchestra.run.smithi012.stderr: 43600K .......... .......... .......... .......... .......... 46% 118M 1s 2023-10-05T11:43:22.441 INFO:teuthology.orchestra.run.smithi012.stderr: 43650K .......... .......... .......... .......... .......... 47% 114M 1s 2023-10-05T11:43:22.441 INFO:teuthology.orchestra.run.smithi012.stderr: 43700K .......... .......... .......... .......... .......... 47% 119M 1s 2023-10-05T11:43:22.441 INFO:teuthology.orchestra.run.smithi012.stderr: 43750K .......... .......... .......... .......... .......... 47% 109M 1s 2023-10-05T11:43:22.441 INFO:teuthology.orchestra.run.smithi012.stderr: 43800K .......... .......... .......... .......... .......... 47% 102M 1s 2023-10-05T11:43:22.441 INFO:teuthology.orchestra.run.smithi012.stderr: 43850K .......... .......... .......... .......... .......... 47% 140M 1s 2023-10-05T11:43:22.441 INFO:teuthology.orchestra.run.smithi012.stderr: 43900K .......... .......... .......... .......... .......... 47% 115M 1s 2023-10-05T11:43:22.441 INFO:teuthology.orchestra.run.smithi012.stderr: 43950K .......... .......... .......... .......... .......... 47% 88.2M 1s 2023-10-05T11:43:22.441 INFO:teuthology.orchestra.run.smithi012.stderr: 44000K .......... .......... .......... .......... .......... 47% 109M 1s 2023-10-05T11:43:22.441 INFO:teuthology.orchestra.run.smithi012.stderr: 44050K .......... .......... .......... .......... .......... 47% 122M 1s 2023-10-05T11:43:22.442 INFO:teuthology.orchestra.run.smithi012.stderr: 44100K .......... .......... .......... .......... .......... 47% 115M 1s 2023-10-05T11:43:22.442 INFO:teuthology.orchestra.run.smithi012.stderr: 44150K .......... .......... .......... .......... .......... 47% 111M 1s 2023-10-05T11:43:22.442 INFO:teuthology.orchestra.run.smithi012.stderr: 44200K .......... .......... .......... .......... .......... 47% 112M 1s 2023-10-05T11:43:22.442 INFO:teuthology.orchestra.run.smithi012.stderr: 44250K .......... .......... .......... .......... .......... 47% 114M 1s 2023-10-05T11:43:22.442 INFO:teuthology.orchestra.run.smithi012.stderr: 44300K .......... .......... .......... .......... .......... 47% 111M 1s 2023-10-05T11:43:22.442 INFO:teuthology.orchestra.run.smithi012.stderr: 44350K .......... .......... .......... .......... .......... 47% 87.9M 1s 2023-10-05T11:43:22.442 INFO:teuthology.orchestra.run.smithi012.stderr: 44400K .......... .......... .......... .......... .......... 47% 112M 1s 2023-10-05T11:43:22.442 INFO:teuthology.orchestra.run.smithi012.stderr: 44450K .......... .......... .......... .......... .......... 47% 112M 1s 2023-10-05T11:43:22.442 INFO:teuthology.orchestra.run.smithi012.stderr: 44500K .......... .......... .......... .......... .......... 47% 115M 1s 2023-10-05T11:43:22.442 INFO:teuthology.orchestra.run.smithi012.stderr: 44550K .......... .......... .......... .......... .......... 48% 91.7M 1s 2023-10-05T11:43:22.442 INFO:teuthology.orchestra.run.smithi012.stderr: 44600K .......... .......... .......... .......... .......... 48% 74.1M 1s 2023-10-05T11:43:22.442 INFO:teuthology.orchestra.run.smithi012.stderr: 44650K .......... .......... .......... .......... .......... 48% 113M 1s 2023-10-05T11:43:22.443 INFO:teuthology.orchestra.run.smithi012.stderr: 44700K .......... .......... .......... .......... .......... 48% 113M 1s 2023-10-05T11:43:22.443 INFO:teuthology.orchestra.run.smithi012.stderr: 44750K .......... .......... .......... .......... .......... 48% 78.8M 1s 2023-10-05T11:43:22.443 INFO:teuthology.orchestra.run.smithi012.stderr: 44800K .......... .......... .......... .......... .......... 48% 11.7M 1s 2023-10-05T11:43:22.443 INFO:teuthology.orchestra.run.smithi012.stderr: 44850K .......... .......... .......... .......... .......... 48% 66.6M 1s 2023-10-05T11:43:22.443 INFO:teuthology.orchestra.run.smithi012.stderr: 44900K .......... .......... .......... .......... .......... 48% 102M 1s 2023-10-05T11:43:22.443 INFO:teuthology.orchestra.run.smithi012.stderr: 44950K .......... .......... .......... .......... .......... 48% 142M 1s 2023-10-05T11:43:22.443 INFO:teuthology.orchestra.run.smithi012.stderr: 45000K .......... .......... .......... .......... .......... 48% 47.8M 1s 2023-10-05T11:43:22.443 INFO:teuthology.orchestra.run.smithi012.stderr: 45050K .......... .......... .......... .......... .......... 48% 17.0M 1s 2023-10-05T11:43:22.443 INFO:teuthology.orchestra.run.smithi012.stderr: 45100K .......... .......... .......... .......... .......... 48% 17.4M 1s 2023-10-05T11:43:22.443 INFO:teuthology.orchestra.run.smithi012.stderr: 45150K .......... .......... .......... .......... .......... 48% 61.8M 1s 2023-10-05T11:43:22.443 INFO:teuthology.orchestra.run.smithi012.stderr: 45200K .......... .......... .......... .......... .......... 48% 44.4M 1s 2023-10-05T11:43:22.443 INFO:teuthology.orchestra.run.smithi012.stderr: 45250K .......... .......... .......... .......... .......... 48% 31.9M 1s 2023-10-05T11:43:22.443 INFO:teuthology.orchestra.run.smithi012.stderr: 45300K .......... .......... .......... .......... .......... 48% 210M 1s 2023-10-05T11:43:22.444 INFO:teuthology.orchestra.run.smithi012.stderr: 45350K .......... .......... .......... .......... .......... 48% 195M 1s 2023-10-05T11:43:22.444 INFO:teuthology.orchestra.run.smithi012.stderr: 45400K .......... .......... .......... .......... .......... 48% 212M 1s 2023-10-05T11:43:22.444 INFO:teuthology.orchestra.run.smithi012.stderr: 45450K .......... .......... .......... .......... .......... 48% 214M 1s 2023-10-05T11:43:22.444 INFO:teuthology.orchestra.run.smithi012.stderr: 45500K .......... .......... .......... .......... .......... 49% 219M 1s 2023-10-05T11:43:22.444 INFO:teuthology.orchestra.run.smithi012.stderr: 45550K .......... .......... .......... .......... .......... 49% 173M 1s 2023-10-05T11:43:22.444 INFO:teuthology.orchestra.run.smithi012.stderr: 45600K .......... .......... .......... .......... .......... 49% 210M 1s 2023-10-05T11:43:22.444 INFO:teuthology.orchestra.run.smithi012.stderr: 45650K .......... .......... .......... .......... .......... 49% 143M 1s 2023-10-05T11:43:22.444 INFO:teuthology.orchestra.run.smithi012.stderr: 45700K .......... .......... .......... .......... .......... 49% 53.1M 1s 2023-10-05T11:43:22.444 INFO:teuthology.orchestra.run.smithi012.stderr: 45750K .......... .......... .......... .......... .......... 49% 54.0M 1s 2023-10-05T11:43:22.444 INFO:teuthology.orchestra.run.smithi012.stderr: 45800K .......... .......... .......... .......... .......... 49% 91.8M 1s 2023-10-05T11:43:22.444 INFO:teuthology.orchestra.run.smithi012.stderr: 45850K .......... .......... .......... .......... .......... 49% 58.1M 1s 2023-10-05T11:43:22.444 INFO:teuthology.orchestra.run.smithi012.stderr: 45900K .......... .......... .......... .......... .......... 49% 52.4M 1s 2023-10-05T11:43:22.445 INFO:teuthology.orchestra.run.smithi012.stderr: 45950K .......... .......... .......... .......... .......... 49% 45.0M 1s 2023-10-05T11:43:22.445 INFO:teuthology.orchestra.run.smithi012.stderr: 46000K .......... .......... .......... .......... .......... 49% 45.4M 1s 2023-10-05T11:43:22.445 INFO:teuthology.orchestra.run.smithi012.stderr: 46050K .......... .......... .......... .......... .......... 49% 115M 1s 2023-10-05T11:43:22.445 INFO:teuthology.orchestra.run.smithi012.stderr: 46100K .......... .......... .......... .......... .......... 49% 61.1M 1s 2023-10-05T11:43:22.445 INFO:teuthology.orchestra.run.smithi012.stderr: 46150K .......... .......... .......... .......... .......... 49% 75.6M 1s 2023-10-05T11:43:22.445 INFO:teuthology.orchestra.run.smithi012.stderr: 46200K .......... .......... .......... .......... .......... 49% 102M 1s 2023-10-05T11:43:22.445 INFO:teuthology.orchestra.run.smithi012.stderr: 46250K .......... .......... .......... .......... .......... 49% 115M 1s 2023-10-05T11:43:22.445 INFO:teuthology.orchestra.run.smithi012.stderr: 46300K .......... .......... .......... .......... .......... 49% 62.9M 1s 2023-10-05T11:43:22.445 INFO:teuthology.orchestra.run.smithi012.stderr: 46350K .......... .......... .......... .......... .......... 49% 85.4M 1s 2023-10-05T11:43:22.445 INFO:teuthology.orchestra.run.smithi012.stderr: 46400K .......... .......... .......... .......... .......... 49% 95.6M 1s 2023-10-05T11:43:22.445 INFO:teuthology.orchestra.run.smithi012.stderr: 46450K .......... .......... .......... .......... .......... 50% 70.6M 1s 2023-10-05T11:43:22.445 INFO:teuthology.orchestra.run.smithi012.stderr: 46500K .......... .......... .......... .......... .......... 50% 105M 1s 2023-10-05T11:43:22.446 INFO:teuthology.orchestra.run.smithi012.stderr: 46550K .......... .......... .......... .......... .......... 50% 51.3M 1s 2023-10-05T11:43:22.446 INFO:teuthology.orchestra.run.smithi012.stderr: 46600K .......... .......... .......... .......... .......... 50% 75.3M 1s 2023-10-05T11:43:22.446 INFO:teuthology.orchestra.run.smithi012.stderr: 46650K .......... .......... .......... .......... .......... 50% 91.3M 1s 2023-10-05T11:43:22.446 INFO:teuthology.orchestra.run.smithi012.stderr: 46700K .......... .......... .......... .......... .......... 50% 108M 1s 2023-10-05T11:43:22.446 INFO:teuthology.orchestra.run.smithi012.stderr: 46750K .......... .......... .......... .......... .......... 50% 65.0M 1s 2023-10-05T11:43:22.446 INFO:teuthology.orchestra.run.smithi012.stderr: 46800K .......... .......... .......... .......... .......... 50% 45.7M 1s 2023-10-05T11:43:22.446 INFO:teuthology.orchestra.run.smithi012.stderr: 46850K .......... .......... .......... .......... .......... 50% 55.3M 1s 2023-10-05T11:43:22.446 INFO:teuthology.orchestra.run.smithi012.stderr: 46900K .......... .......... .......... .......... .......... 50% 93.0M 1s 2023-10-05T11:43:22.446 INFO:teuthology.orchestra.run.smithi012.stderr: 46950K .......... .......... .......... .......... .......... 50% 112M 1s 2023-10-05T11:43:22.446 INFO:teuthology.orchestra.run.smithi012.stderr: 47000K .......... .......... .......... .......... .......... 50% 91.6M 1s 2023-10-05T11:43:22.446 INFO:teuthology.orchestra.run.smithi012.stderr: 47050K .......... .......... .......... .......... .......... 50% 91.3M 1s 2023-10-05T11:43:22.446 INFO:teuthology.orchestra.run.smithi012.stderr: 47100K .......... .......... .......... .......... .......... 50% 77.4M 1s 2023-10-05T11:43:22.447 INFO:teuthology.orchestra.run.smithi012.stderr: 47150K .......... .......... .......... .......... .......... 50% 86.2M 1s 2023-10-05T11:43:22.447 INFO:teuthology.orchestra.run.smithi012.stderr: 47200K .......... .......... .......... .......... .......... 50% 96.3M 1s 2023-10-05T11:43:22.447 INFO:teuthology.orchestra.run.smithi012.stderr: 47250K .......... .......... .......... .......... .......... 50% 80.1M 1s 2023-10-05T11:43:22.447 INFO:teuthology.orchestra.run.smithi012.stderr: 47300K .......... .......... .......... .......... .......... 50% 55.6M 1s 2023-10-05T11:43:22.447 INFO:teuthology.orchestra.run.smithi012.stderr: 47350K .......... .......... .......... .......... .......... 51% 80.8M 1s 2023-10-05T11:43:22.447 INFO:teuthology.orchestra.run.smithi012.stderr: 47400K .......... .......... .......... .......... .......... 51% 94.8M 1s 2023-10-05T11:43:22.447 INFO:teuthology.orchestra.run.smithi012.stderr: 47450K .......... .......... .......... .......... .......... 51% 61.7M 1s 2023-10-05T11:43:22.447 INFO:teuthology.orchestra.run.smithi012.stderr: 47500K .......... .......... .......... .......... .......... 51% 75.9M 1s 2023-10-05T11:43:22.447 INFO:teuthology.orchestra.run.smithi012.stderr: 47550K .......... .......... .......... .......... .......... 51% 57.9M 1s 2023-10-05T11:43:22.447 INFO:teuthology.orchestra.run.smithi012.stderr: 47600K .......... .......... .......... .......... .......... 51% 66.7M 1s 2023-10-05T11:43:22.447 INFO:teuthology.orchestra.run.smithi012.stderr: 47650K .......... .......... .......... .......... .......... 51% 117M 1s 2023-10-05T11:43:22.447 INFO:teuthology.orchestra.run.smithi012.stderr: 47700K .......... .......... .......... .......... .......... 51% 47.6M 1s 2023-10-05T11:43:22.447 INFO:teuthology.orchestra.run.smithi012.stderr: 47750K .......... .......... .......... .......... .......... 51% 55.5M 1s 2023-10-05T11:43:22.448 INFO:teuthology.orchestra.run.smithi012.stderr: 47800K .......... .......... .......... .......... .......... 51% 37.5M 1s 2023-10-05T11:43:22.448 INFO:teuthology.orchestra.run.smithi012.stderr: 47850K .......... .......... .......... .......... .......... 51% 119M 1s 2023-10-05T11:43:22.448 INFO:teuthology.orchestra.run.smithi012.stderr: 47900K .......... .......... .......... .......... .......... 51% 72.6M 1s 2023-10-05T11:43:22.448 INFO:teuthology.orchestra.run.smithi012.stderr: 47950K .......... .......... .......... .......... .......... 51% 72.4M 1s 2023-10-05T11:43:22.448 INFO:teuthology.orchestra.run.smithi012.stderr: 48000K .......... .......... .......... .......... .......... 51% 52.5M 1s 2023-10-05T11:43:22.448 INFO:teuthology.orchestra.run.smithi012.stderr: 48050K .......... .......... .......... .......... .......... 51% 61.0M 1s 2023-10-05T11:43:22.448 INFO:teuthology.orchestra.run.smithi012.stderr: 48100K .......... .......... .......... .......... .......... 51% 84.6M 1s 2023-10-05T11:43:22.448 INFO:teuthology.orchestra.run.smithi012.stderr: 48150K .......... .......... .......... .......... .......... 51% 62.0M 1s 2023-10-05T11:43:22.448 INFO:teuthology.orchestra.run.smithi012.stderr: 48200K .......... .......... .......... .......... .......... 51% 106M 1s 2023-10-05T11:43:22.448 INFO:teuthology.orchestra.run.smithi012.stderr: 48250K .......... .......... .......... .......... .......... 51% 90.0M 1s 2023-10-05T11:43:22.448 INFO:teuthology.orchestra.run.smithi012.stderr: 48300K .......... .......... .......... .......... .......... 52% 108M 1s 2023-10-05T11:43:22.448 INFO:teuthology.orchestra.run.smithi012.stderr: 48350K .......... .......... .......... .......... .......... 52% 90.6M 1s 2023-10-05T11:43:22.449 INFO:teuthology.orchestra.run.smithi012.stderr: 48400K .......... .......... .......... .......... .......... 52% 35.9M 1s 2023-10-05T11:43:22.449 INFO:teuthology.orchestra.run.smithi012.stderr: 48450K .......... .......... .......... .......... .......... 52% 32.2M 1s 2023-10-05T11:43:22.449 INFO:teuthology.orchestra.run.smithi012.stderr: 48500K .......... .......... .......... .......... .......... 52% 41.6M 1s 2023-10-05T11:43:22.449 INFO:teuthology.orchestra.run.smithi012.stderr: 48550K .......... .......... .......... .......... .......... 52% 115M 1s 2023-10-05T11:43:22.449 INFO:teuthology.orchestra.run.smithi012.stderr: 48600K .......... .......... .......... .......... .......... 52% 109M 1s 2023-10-05T11:43:22.449 INFO:teuthology.orchestra.run.smithi012.stderr: 48650K .......... .......... .......... .......... .......... 52% 113M 1s 2023-10-05T11:43:22.449 INFO:teuthology.orchestra.run.smithi012.stderr: 48700K .......... .......... .......... .......... .......... 52% 68.7M 1s 2023-10-05T11:43:22.449 INFO:teuthology.orchestra.run.smithi012.stderr: 48750K .......... .......... .......... .......... .......... 52% 55.8M 1s 2023-10-05T11:43:22.449 INFO:teuthology.orchestra.run.smithi012.stderr: 48800K .......... .......... .......... .......... .......... 52% 119M 1s 2023-10-05T11:43:22.449 INFO:teuthology.orchestra.run.smithi012.stderr: 48850K .......... .......... .......... .......... .......... 52% 76.2M 1s 2023-10-05T11:43:22.449 INFO:teuthology.orchestra.run.smithi012.stderr: 48900K .......... .......... .......... .......... .......... 52% 112M 1s 2023-10-05T11:43:22.449 INFO:teuthology.orchestra.run.smithi012.stderr: 48950K .......... .......... .......... .......... .......... 52% 106M 1s 2023-10-05T11:43:22.450 INFO:teuthology.orchestra.run.smithi012.stderr: 49000K .......... .......... .......... .......... .......... 52% 119M 1s 2023-10-05T11:43:22.450 INFO:teuthology.orchestra.run.smithi012.stderr: 49050K .......... .......... .......... .......... .......... 52% 36.4M 1s 2023-10-05T11:43:22.450 INFO:teuthology.orchestra.run.smithi012.stderr: 49100K .......... .......... .......... .......... .......... 52% 96.8M 1s 2023-10-05T11:43:22.450 INFO:teuthology.orchestra.run.smithi012.stderr: 49150K .......... .......... .......... .......... .......... 52% 60.8M 1s 2023-10-05T11:43:22.450 INFO:teuthology.orchestra.run.smithi012.stderr: 49200K .......... .......... .......... .......... .......... 53% 122M 1s 2023-10-05T11:43:22.450 INFO:teuthology.orchestra.run.smithi012.stderr: 49250K .......... .......... .......... .......... .......... 53% 64.8M 1s 2023-10-05T11:43:22.450 INFO:teuthology.orchestra.run.smithi012.stderr: 49300K .......... .......... .......... .......... .......... 53% 76.3M 1s 2023-10-05T11:43:22.450 INFO:teuthology.orchestra.run.smithi012.stderr: 49350K .......... .......... .......... .......... .......... 53% 57.2M 1s 2023-10-05T11:43:22.450 INFO:teuthology.orchestra.run.smithi012.stderr: 49400K .......... .......... .......... .......... .......... 53% 107M 1s 2023-10-05T11:43:22.450 INFO:teuthology.orchestra.run.smithi012.stderr: 49450K .......... .......... .......... .......... .......... 53% 118M 1s 2023-10-05T11:43:22.450 INFO:teuthology.orchestra.run.smithi012.stderr: 49500K .......... .......... .......... .......... .......... 53% 49.8M 1s 2023-10-05T11:43:22.450 INFO:teuthology.orchestra.run.smithi012.stderr: 49550K .......... .......... .......... .......... .......... 53% 93.3M 1s 2023-10-05T11:43:22.451 INFO:teuthology.orchestra.run.smithi012.stderr: 49600K .......... .......... .......... .......... .......... 53% 71.7M 1s 2023-10-05T11:43:22.451 INFO:teuthology.orchestra.run.smithi012.stderr: 49650K .......... .......... .......... .......... .......... 53% 115M 1s 2023-10-05T11:43:22.451 INFO:teuthology.orchestra.run.smithi012.stderr: 49700K .......... .......... .......... .......... .......... 53% 67.3M 1s 2023-10-05T11:43:22.451 INFO:teuthology.orchestra.run.smithi012.stderr: 49750K .......... .......... .......... .......... .......... 53% 111M 1s 2023-10-05T11:43:22.451 INFO:teuthology.orchestra.run.smithi012.stderr: 49800K .......... .......... .......... .......... .......... 53% 82.4M 1s 2023-10-05T11:43:22.451 INFO:teuthology.orchestra.run.smithi012.stderr: 49850K .......... .......... .......... .......... .......... 53% 103M 1s 2023-10-05T11:43:22.451 INFO:teuthology.orchestra.run.smithi012.stderr: 49900K .......... .......... .......... .......... .......... 53% 121M 1s 2023-10-05T11:43:22.451 INFO:teuthology.orchestra.run.smithi012.stderr: 49950K .......... .......... .......... .......... .......... 53% 31.1M 1s 2023-10-05T11:43:22.451 INFO:teuthology.orchestra.run.smithi012.stderr: 50000K .......... .......... .......... .......... .......... 53% 135M 1s 2023-10-05T11:43:22.451 INFO:teuthology.orchestra.run.smithi012.stderr: 50050K .......... .......... .......... .......... .......... 53% 111M 1s 2023-10-05T11:43:22.451 INFO:teuthology.orchestra.run.smithi012.stderr: 50100K .......... .......... .......... .......... .......... 53% 116M 1s 2023-10-05T11:43:22.452 INFO:teuthology.orchestra.run.smithi012.stderr: 50150K .......... .......... .......... .......... .......... 54% 107M 1s 2023-10-05T11:43:22.452 INFO:teuthology.orchestra.run.smithi012.stderr: 50200K .......... .......... .......... .......... .......... 54% 112M 1s 2023-10-05T11:43:22.452 INFO:teuthology.orchestra.run.smithi012.stderr: 50250K .......... .......... .......... .......... .......... 54% 116M 1s 2023-10-05T11:43:22.452 INFO:teuthology.orchestra.run.smithi012.stderr: 50300K .......... .......... .......... .......... .......... 54% 111M 1s 2023-10-05T11:43:22.452 INFO:teuthology.orchestra.run.smithi012.stderr: 50350K .......... .......... .......... .......... .......... 54% 77.7M 1s 2023-10-05T11:43:22.452 INFO:teuthology.orchestra.run.smithi012.stderr: 50400K .......... .......... .......... .......... .......... 54% 116M 1s 2023-10-05T11:43:22.452 INFO:teuthology.orchestra.run.smithi012.stderr: 50450K .......... .......... .......... .......... .......... 54% 125M 1s 2023-10-05T11:43:22.452 INFO:teuthology.orchestra.run.smithi012.stderr: 50500K .......... .......... .......... .......... .......... 54% 113M 1s 2023-10-05T11:43:22.452 INFO:teuthology.orchestra.run.smithi012.stderr: 50550K .......... .......... .......... .......... .......... 54% 112M 1s 2023-10-05T11:43:22.452 INFO:teuthology.orchestra.run.smithi012.stderr: 50600K .......... .......... .......... .......... .......... 54% 117M 1s 2023-10-05T11:43:22.452 INFO:teuthology.orchestra.run.smithi012.stderr: 50650K .......... .......... .......... .......... .......... 54% 104M 1s 2023-10-05T11:43:22.452 INFO:teuthology.orchestra.run.smithi012.stderr: 50700K .......... .......... .......... .......... .......... 54% 113M 1s 2023-10-05T11:43:22.452 INFO:teuthology.orchestra.run.smithi012.stderr: 50750K .......... .......... .......... .......... .......... 54% 88.6M 1s 2023-10-05T11:43:22.453 INFO:teuthology.orchestra.run.smithi012.stderr: 50800K .......... .......... .......... .......... .......... 54% 115M 1s 2023-10-05T11:43:22.453 INFO:teuthology.orchestra.run.smithi012.stderr: 50850K .......... .......... .......... .......... .......... 54% 108M 1s 2023-10-05T11:43:22.453 INFO:teuthology.orchestra.run.smithi012.stderr: 50900K .......... .......... .......... .......... .......... 54% 82.8M 1s 2023-10-05T11:43:22.453 INFO:teuthology.orchestra.run.smithi012.stderr: 50950K .......... .......... .......... .......... .......... 54% 89.2M 1s 2023-10-05T11:43:22.453 INFO:teuthology.orchestra.run.smithi012.stderr: 51000K .......... .......... .......... .......... .......... 54% 74.7M 1s 2023-10-05T11:43:22.453 INFO:teuthology.orchestra.run.smithi012.stderr: 51050K .......... .......... .......... .......... .......... 55% 114M 1s 2023-10-05T11:43:22.453 INFO:teuthology.orchestra.run.smithi012.stderr: 51100K .......... .......... .......... .......... .......... 55% 75.7M 1s 2023-10-05T11:43:22.453 INFO:teuthology.orchestra.run.smithi012.stderr: 51150K .......... .......... .......... .......... .......... 55% 73.6M 1s 2023-10-05T11:43:22.453 INFO:teuthology.orchestra.run.smithi012.stderr: 51200K .......... .......... .......... .......... .......... 55% 79.2M 1s 2023-10-05T11:43:22.453 INFO:teuthology.orchestra.run.smithi012.stderr: 51250K .......... .......... .......... .......... .......... 55% 51.3M 1s 2023-10-05T11:43:22.453 INFO:teuthology.orchestra.run.smithi012.stderr: 51300K .......... .......... .......... .......... .......... 55% 103M 1s 2023-10-05T11:43:22.453 INFO:teuthology.orchestra.run.smithi012.stderr: 51350K .......... .......... .......... .......... .......... 55% 31.4M 1s 2023-10-05T11:43:22.454 INFO:teuthology.orchestra.run.smithi012.stderr: 51400K .......... .......... .......... .......... .......... 55% 71.5M 1s 2023-10-05T11:43:22.454 INFO:teuthology.orchestra.run.smithi012.stderr: 51450K .......... .......... .......... .......... .......... 55% 65.8M 1s 2023-10-05T11:43:22.454 INFO:teuthology.orchestra.run.smithi012.stderr: 51500K .......... .......... .......... .......... .......... 55% 63.3M 1s 2023-10-05T11:43:22.454 INFO:teuthology.orchestra.run.smithi012.stderr: 51550K .......... .......... .......... .......... .......... 55% 55.8M 1s 2023-10-05T11:43:22.454 INFO:teuthology.orchestra.run.smithi012.stderr: 51600K .......... .......... .......... .......... .......... 55% 44.4M 1s 2023-10-05T11:43:22.454 INFO:teuthology.orchestra.run.smithi012.stderr: 51650K .......... .......... .......... .......... .......... 55% 101M 1s 2023-10-05T11:43:22.454 INFO:teuthology.orchestra.run.smithi012.stderr: 51700K .......... .......... .......... .......... .......... 55% 97.8M 1s 2023-10-05T11:43:22.454 INFO:teuthology.orchestra.run.smithi012.stderr: 51750K .......... .......... .......... .......... .......... 55% 105M 1s 2023-10-05T11:43:22.454 INFO:teuthology.orchestra.run.smithi012.stderr: 51800K .......... .......... .......... .......... .......... 55% 87.6M 1s 2023-10-05T11:43:22.454 INFO:teuthology.orchestra.run.smithi012.stderr: 51850K .......... .......... .......... .......... .......... 55% 78.4M 1s 2023-10-05T11:43:22.454 INFO:teuthology.orchestra.run.smithi012.stderr: 51900K .......... .......... .......... .......... .......... 55% 66.7M 1s 2023-10-05T11:43:22.454 INFO:teuthology.orchestra.run.smithi012.stderr: 51950K .......... .......... .......... .......... .......... 55% 83.5M 1s 2023-10-05T11:43:22.455 INFO:teuthology.orchestra.run.smithi012.stderr: 52000K .......... .......... .......... .......... .......... 56% 140M 1s 2023-10-05T11:43:22.455 INFO:teuthology.orchestra.run.smithi012.stderr: 52050K .......... .......... .......... .......... .......... 56% 82.8M 1s 2023-10-05T11:43:22.455 INFO:teuthology.orchestra.run.smithi012.stderr: 52100K .......... .......... .......... .......... .......... 56% 84.9M 1s 2023-10-05T11:43:22.455 INFO:teuthology.orchestra.run.smithi012.stderr: 52150K .......... .......... .......... .......... .......... 56% 53.0M 1s 2023-10-05T11:43:22.455 INFO:teuthology.orchestra.run.smithi012.stderr: 52200K .......... .......... .......... .......... .......... 56% 149M 1s 2023-10-05T11:43:22.455 INFO:teuthology.orchestra.run.smithi012.stderr: 52250K .......... .......... .......... .......... .......... 56% 168M 1s 2023-10-05T11:43:22.455 INFO:teuthology.orchestra.run.smithi012.stderr: 52300K .......... .......... .......... .......... .......... 56% 50.7M 1s 2023-10-05T11:43:22.455 INFO:teuthology.orchestra.run.smithi012.stderr: 52350K .......... .......... .......... .......... .......... 56% 91.0M 1s 2023-10-05T11:43:22.455 INFO:teuthology.orchestra.run.smithi012.stderr: 52400K .......... .......... .......... .......... .......... 56% 71.0M 1s 2023-10-05T11:43:22.455 INFO:teuthology.orchestra.run.smithi012.stderr: 52450K .......... .......... .......... .......... .......... 56% 186M 1s 2023-10-05T11:43:22.455 INFO:teuthology.orchestra.run.smithi012.stderr: 52500K .......... .......... .......... .......... .......... 56% 114M 1s 2023-10-05T11:43:22.455 INFO:teuthology.orchestra.run.smithi012.stderr: 52550K .......... .......... .......... .......... .......... 56% 82.8M 1s 2023-10-05T11:43:22.456 INFO:teuthology.orchestra.run.smithi012.stderr: 52600K .......... .......... .......... .......... .......... 56% 165M 1s 2023-10-05T11:43:22.456 INFO:teuthology.orchestra.run.smithi012.stderr: 52650K .......... .......... .......... .......... .......... 56% 85.6M 1s 2023-10-05T11:43:22.456 INFO:teuthology.orchestra.run.smithi012.stderr: 52700K .......... .......... .......... .......... .......... 56% 187M 1s 2023-10-05T11:43:22.456 INFO:teuthology.orchestra.run.smithi012.stderr: 52750K .......... .......... .......... .......... .......... 56% 81.2M 1s 2023-10-05T11:43:22.456 INFO:teuthology.orchestra.run.smithi012.stderr: 52800K .......... .......... .......... .......... .......... 56% 91.0M 1s 2023-10-05T11:43:22.456 INFO:teuthology.orchestra.run.smithi012.stderr: 52850K .......... .......... .......... .......... .......... 56% 106M 1s 2023-10-05T11:43:22.456 INFO:teuthology.orchestra.run.smithi012.stderr: 52900K .......... .......... .......... .......... .......... 56% 95.3M 1s 2023-10-05T11:43:22.456 INFO:teuthology.orchestra.run.smithi012.stderr: 52950K .......... .......... .......... .......... .......... 57% 109M 1s 2023-10-05T11:43:22.456 INFO:teuthology.orchestra.run.smithi012.stderr: 53000K .......... .......... .......... .......... .......... 57% 97.3M 1s 2023-10-05T11:43:22.456 INFO:teuthology.orchestra.run.smithi012.stderr: 53050K .......... .......... .......... .......... .......... 57% 62.0M 1s 2023-10-05T11:43:22.456 INFO:teuthology.orchestra.run.smithi012.stderr: 53100K .......... .......... .......... .......... .......... 57% 72.6M 1s 2023-10-05T11:43:22.456 INFO:teuthology.orchestra.run.smithi012.stderr: 53150K .......... .......... .......... .......... .......... 57% 46.5M 1s 2023-10-05T11:43:22.457 INFO:teuthology.orchestra.run.smithi012.stderr: 53200K .......... .......... .......... .......... .......... 57% 109M 1s 2023-10-05T11:43:22.457 INFO:teuthology.orchestra.run.smithi012.stderr: 53250K .......... .......... .......... .......... .......... 57% 59.9M 1s 2023-10-05T11:43:22.457 INFO:teuthology.orchestra.run.smithi012.stderr: 53300K .......... .......... .......... .......... .......... 57% 48.0M 1s 2023-10-05T11:43:22.457 INFO:teuthology.orchestra.run.smithi012.stderr: 53350K .......... .......... .......... .......... .......... 57% 51.7M 1s 2023-10-05T11:43:22.457 INFO:teuthology.orchestra.run.smithi012.stderr: 53400K .......... .......... .......... .......... .......... 57% 114M 1s 2023-10-05T11:43:22.457 INFO:teuthology.orchestra.run.smithi012.stderr: 53450K .......... .......... .......... .......... .......... 57% 51.6M 1s 2023-10-05T11:43:22.457 INFO:teuthology.orchestra.run.smithi012.stderr: 53500K .......... .......... .......... .......... .......... 57% 83.8M 1s 2023-10-05T11:43:22.457 INFO:teuthology.orchestra.run.smithi012.stderr: 53550K .......... .......... .......... .......... .......... 57% 81.3M 1s 2023-10-05T11:43:22.457 INFO:teuthology.orchestra.run.smithi012.stderr: 53600K .......... .......... .......... .......... .......... 57% 75.4M 1s 2023-10-05T11:43:22.457 INFO:teuthology.orchestra.run.smithi012.stderr: 53650K .......... .......... .......... .......... .......... 57% 121M 1s 2023-10-05T11:43:22.457 INFO:teuthology.orchestra.run.smithi012.stderr: 53700K .......... .......... .......... .......... .......... 57% 83.5M 1s 2023-10-05T11:43:22.457 INFO:teuthology.orchestra.run.smithi012.stderr: 53750K .......... .......... .......... .......... .......... 57% 79.7M 1s 2023-10-05T11:43:22.458 INFO:teuthology.orchestra.run.smithi012.stderr: 53800K .......... .......... .......... .......... .......... 57% 139M 1s 2023-10-05T11:43:22.458 INFO:teuthology.orchestra.run.smithi012.stderr: 53850K .......... .......... .......... .......... .......... 58% 108M 1s 2023-10-05T11:43:22.458 INFO:teuthology.orchestra.run.smithi012.stderr: 53900K .......... .......... .......... .......... .......... 58% 81.8M 1s 2023-10-05T11:43:22.458 INFO:teuthology.orchestra.run.smithi012.stderr: 53950K .......... .......... .......... .......... .......... 58% 70.3M 1s 2023-10-05T11:43:22.458 INFO:teuthology.orchestra.run.smithi012.stderr: 54000K .......... .......... .......... .......... .......... 58% 116M 1s 2023-10-05T11:43:22.458 INFO:teuthology.orchestra.run.smithi012.stderr: 54050K .......... .......... .......... .......... .......... 58% 114M 1s 2023-10-05T11:43:22.458 INFO:teuthology.orchestra.run.smithi012.stderr: 54100K .......... .......... .......... .......... .......... 58% 119M 1s 2023-10-05T11:43:22.458 INFO:teuthology.orchestra.run.smithi012.stderr: 54150K .......... .......... .......... .......... .......... 58% 78.9M 1s 2023-10-05T11:43:22.458 INFO:teuthology.orchestra.run.smithi012.stderr: 54200K .......... .......... .......... .......... .......... 58% 115M 1s 2023-10-05T11:43:22.458 INFO:teuthology.orchestra.run.smithi012.stderr: 54250K .......... .......... .......... .......... .......... 58% 58.5M 1s 2023-10-05T11:43:22.458 INFO:teuthology.orchestra.run.smithi012.stderr: 54300K .......... .......... .......... .......... .......... 58% 110M 1s 2023-10-05T11:43:22.458 INFO:teuthology.orchestra.run.smithi012.stderr: 54350K .......... .......... .......... .......... .......... 58% 69.8M 1s 2023-10-05T11:43:22.459 INFO:teuthology.orchestra.run.smithi012.stderr: 54400K .......... .......... .......... .......... .......... 58% 58.6M 1s 2023-10-05T11:43:22.459 INFO:teuthology.orchestra.run.smithi012.stderr: 54450K .......... .......... .......... .......... .......... 58% 89.3M 1s 2023-10-05T11:43:22.459 INFO:teuthology.orchestra.run.smithi012.stderr: 54500K .......... .......... .......... .......... .......... 58% 80.5M 1s 2023-10-05T11:43:22.459 INFO:teuthology.orchestra.run.smithi012.stderr: 54550K .......... .......... .......... .......... .......... 58% 105M 1s 2023-10-05T11:43:22.459 INFO:teuthology.orchestra.run.smithi012.stderr: 54600K .......... .......... .......... .......... .......... 58% 58.2M 1s 2023-10-05T11:43:22.459 INFO:teuthology.orchestra.run.smithi012.stderr: 54650K .......... .......... .......... .......... .......... 58% 97.6M 1s 2023-10-05T11:43:22.459 INFO:teuthology.orchestra.run.smithi012.stderr: 54700K .......... .......... .......... .......... .......... 58% 105M 1s 2023-10-05T11:43:22.459 INFO:teuthology.orchestra.run.smithi012.stderr: 54750K .......... .......... .......... .......... .......... 58% 75.1M 1s 2023-10-05T11:43:22.459 INFO:teuthology.orchestra.run.smithi012.stderr: 54800K .......... .......... .......... .......... .......... 59% 153M 1s 2023-10-05T11:43:22.459 INFO:teuthology.orchestra.run.smithi012.stderr: 54850K .......... .......... .......... .......... .......... 59% 59.8M 1s 2023-10-05T11:43:22.459 INFO:teuthology.orchestra.run.smithi012.stderr: 54900K .......... .......... .......... .......... .......... 59% 114M 1s 2023-10-05T11:43:22.459 INFO:teuthology.orchestra.run.smithi012.stderr: 54950K .......... .......... .......... .......... .......... 59% 80.2M 1s 2023-10-05T11:43:22.460 INFO:teuthology.orchestra.run.smithi012.stderr: 55000K .......... .......... .......... .......... .......... 59% 117M 1s 2023-10-05T11:43:22.460 INFO:teuthology.orchestra.run.smithi012.stderr: 55050K .......... .......... .......... .......... .......... 59% 90.0M 1s 2023-10-05T11:43:22.460 INFO:teuthology.orchestra.run.smithi012.stderr: 55100K .......... .......... .......... .......... .......... 59% 119M 1s 2023-10-05T11:43:22.460 INFO:teuthology.orchestra.run.smithi012.stderr: 55150K .......... .......... .......... .......... .......... 59% 59.2M 1s 2023-10-05T11:43:22.460 INFO:teuthology.orchestra.run.smithi012.stderr: 55200K .......... .......... .......... .......... .......... 59% 108M 1s 2023-10-05T11:43:22.460 INFO:teuthology.orchestra.run.smithi012.stderr: 55250K .......... .......... .......... .......... .......... 59% 120M 1s 2023-10-05T11:43:22.460 INFO:teuthology.orchestra.run.smithi012.stderr: 55300K .......... .......... .......... .......... .......... 59% 78.8M 1s 2023-10-05T11:43:22.460 INFO:teuthology.orchestra.run.smithi012.stderr: 55350K .......... .......... .......... .......... .......... 59% 112M 1s 2023-10-05T11:43:22.460 INFO:teuthology.orchestra.run.smithi012.stderr: 55400K .......... .......... .......... .......... .......... 59% 98.4M 1s 2023-10-05T11:43:22.460 INFO:teuthology.orchestra.run.smithi012.stderr: 55450K .......... .......... .......... .......... .......... 59% 111M 1s 2023-10-05T11:43:22.460 INFO:teuthology.orchestra.run.smithi012.stderr: 55500K .......... .......... .......... .......... .......... 59% 119M 1s 2023-10-05T11:43:22.460 INFO:teuthology.orchestra.run.smithi012.stderr: 55550K .......... .......... .......... .......... .......... 59% 70.3M 1s 2023-10-05T11:43:22.461 INFO:teuthology.orchestra.run.smithi012.stderr: 55600K .......... .......... .......... .......... .......... 59% 104M 1s 2023-10-05T11:43:22.461 INFO:teuthology.orchestra.run.smithi012.stderr: 55650K .......... .......... .......... .......... .......... 59% 105M 1s 2023-10-05T11:43:22.461 INFO:teuthology.orchestra.run.smithi012.stderr: 55700K .......... .......... .......... .......... .......... 60% 105M 1s 2023-10-05T11:43:22.461 INFO:teuthology.orchestra.run.smithi012.stderr: 55750K .......... .......... .......... .......... .......... 60% 129M 1s 2023-10-05T11:43:22.461 INFO:teuthology.orchestra.run.smithi012.stderr: 55800K .......... .......... .......... .......... .......... 60% 41.7M 1s 2023-10-05T11:43:22.461 INFO:teuthology.orchestra.run.smithi012.stderr: 55850K .......... .......... .......... .......... .......... 60% 52.8M 1s 2023-10-05T11:43:22.461 INFO:teuthology.orchestra.run.smithi012.stderr: 55900K .......... .......... .......... .......... .......... 60% 40.7M 1s 2023-10-05T11:43:22.461 INFO:teuthology.orchestra.run.smithi012.stderr: 55950K .......... .......... .......... .......... .......... 60% 48.4M 1s 2023-10-05T11:43:22.461 INFO:teuthology.orchestra.run.smithi012.stderr: 56000K .......... .......... .......... .......... .......... 60% 73.6M 1s 2023-10-05T11:43:22.461 INFO:teuthology.orchestra.run.smithi012.stderr: 56050K .......... .......... .......... .......... .......... 60% 33.9M 1s 2023-10-05T11:43:22.461 INFO:teuthology.orchestra.run.smithi012.stderr: 56100K .......... .......... .......... .......... .......... 60% 28.6M 1s 2023-10-05T11:43:22.462 INFO:teuthology.orchestra.run.smithi012.stderr: 56150K .......... .......... .......... .......... .......... 60% 127M 1s 2023-10-05T11:43:22.462 INFO:teuthology.orchestra.run.smithi012.stderr: 56200K .......... .......... .......... .......... .......... 60% 134M 1s 2023-10-05T11:43:22.462 INFO:teuthology.orchestra.run.smithi012.stderr: 56250K .......... .......... .......... .......... .......... 60% 184M 1s 2023-10-05T11:43:22.462 INFO:teuthology.orchestra.run.smithi012.stderr: 56300K .......... .......... .......... .......... .......... 60% 217M 1s 2023-10-05T11:43:22.462 INFO:teuthology.orchestra.run.smithi012.stderr: 56350K .......... .......... .......... .......... .......... 60% 171M 1s 2023-10-05T11:43:22.462 INFO:teuthology.orchestra.run.smithi012.stderr: 56400K .......... .......... .......... .......... .......... 60% 89.0M 1s 2023-10-05T11:43:22.462 INFO:teuthology.orchestra.run.smithi012.stderr: 56450K .......... .......... .......... .......... .......... 60% 138M 1s 2023-10-05T11:43:22.462 INFO:teuthology.orchestra.run.smithi012.stderr: 56500K .......... .......... .......... .......... .......... 60% 91.4M 1s 2023-10-05T11:43:22.462 INFO:teuthology.orchestra.run.smithi012.stderr: 56550K .......... .......... .......... .......... .......... 60% 74.7M 1s 2023-10-05T11:43:22.462 INFO:teuthology.orchestra.run.smithi012.stderr: 56600K .......... .......... .......... .......... .......... 60% 97.3M 1s 2023-10-05T11:43:22.462 INFO:teuthology.orchestra.run.smithi012.stderr: 56650K .......... .......... .......... .......... .......... 61% 123M 1s 2023-10-05T11:43:22.462 INFO:teuthology.orchestra.run.smithi012.stderr: 56700K .......... .......... .......... .......... .......... 61% 39.3M 1s 2023-10-05T11:43:22.463 INFO:teuthology.orchestra.run.smithi012.stderr: 56750K .......... .......... .......... .......... .......... 61% 65.0M 1s 2023-10-05T11:43:22.463 INFO:teuthology.orchestra.run.smithi012.stderr: 56800K .......... .......... .......... .......... .......... 61% 83.6M 1s 2023-10-05T11:43:22.463 INFO:teuthology.orchestra.run.smithi012.stderr: 56850K .......... .......... .......... .......... .......... 61% 109M 1s 2023-10-05T11:43:22.463 INFO:teuthology.orchestra.run.smithi012.stderr: 56900K .......... .......... .......... .......... .......... 61% 114M 1s 2023-10-05T11:43:22.463 INFO:teuthology.orchestra.run.smithi012.stderr: 56950K .......... .......... .......... .......... .......... 61% 51.3M 1s 2023-10-05T11:43:22.463 INFO:teuthology.orchestra.run.smithi012.stderr: 57000K .......... .......... .......... .......... .......... 61% 62.5M 1s 2023-10-05T11:43:22.463 INFO:teuthology.orchestra.run.smithi012.stderr: 57050K .......... .......... .......... .......... .......... 61% 117M 1s 2023-10-05T11:43:22.463 INFO:teuthology.orchestra.run.smithi012.stderr: 57100K .......... .......... .......... .......... .......... 61% 118M 1s 2023-10-05T11:43:22.463 INFO:teuthology.orchestra.run.smithi012.stderr: 57150K .......... .......... .......... .......... .......... 61% 60.5M 1s 2023-10-05T11:43:22.463 INFO:teuthology.orchestra.run.smithi012.stderr: 57200K .......... .......... .......... .......... .......... 61% 118M 1s 2023-10-05T11:43:22.463 INFO:teuthology.orchestra.run.smithi012.stderr: 57250K .......... .......... .......... .......... .......... 61% 61.0M 1s 2023-10-05T11:43:22.463 INFO:teuthology.orchestra.run.smithi012.stderr: 57300K .......... .......... .......... .......... .......... 61% 66.2M 1s 2023-10-05T11:43:22.464 INFO:teuthology.orchestra.run.smithi012.stderr: 57350K .......... .......... .......... .......... .......... 61% 108M 1s 2023-10-05T11:43:22.464 INFO:teuthology.orchestra.run.smithi012.stderr: 57400K .......... .......... .......... .......... .......... 61% 50.5M 0s 2023-10-05T11:43:22.464 INFO:teuthology.orchestra.run.smithi012.stderr: 57450K .......... .......... .......... .......... .......... 61% 77.1M 0s 2023-10-05T11:43:22.464 INFO:teuthology.orchestra.run.smithi012.stderr: 57500K .......... .......... .......... .......... .......... 61% 114M 0s 2023-10-05T11:43:22.464 INFO:teuthology.orchestra.run.smithi012.stderr: 57550K .......... .......... .......... .......... .......... 62% 64.7M 0s 2023-10-05T11:43:22.464 INFO:teuthology.orchestra.run.smithi012.stderr: 57600K .......... .......... .......... .......... .......... 62% 95.3M 0s 2023-10-05T11:43:22.464 INFO:teuthology.orchestra.run.smithi012.stderr: 57650K .......... .......... .......... .......... .......... 62% 130M 0s 2023-10-05T11:43:22.464 INFO:teuthology.orchestra.run.smithi012.stderr: 57700K .......... .......... .......... .......... .......... 62% 93.4M 0s 2023-10-05T11:43:22.464 INFO:teuthology.orchestra.run.smithi012.stderr: 57750K .......... .......... .......... .......... .......... 62% 110M 0s 2023-10-05T11:43:22.464 INFO:teuthology.orchestra.run.smithi012.stderr: 57800K .......... .......... .......... .......... .......... 62% 113M 0s 2023-10-05T11:43:22.464 INFO:teuthology.orchestra.run.smithi012.stderr: 57850K .......... .......... .......... .......... .......... 62% 79.3M 0s 2023-10-05T11:43:22.464 INFO:teuthology.orchestra.run.smithi012.stderr: 57900K .......... .......... .......... .......... .......... 62% 122M 0s 2023-10-05T11:43:22.465 INFO:teuthology.orchestra.run.smithi012.stderr: 57950K .......... .......... .......... .......... .......... 62% 67.2M 0s 2023-10-05T11:43:22.465 INFO:teuthology.orchestra.run.smithi012.stderr: 58000K .......... .......... .......... .......... .......... 62% 123M 0s 2023-10-05T11:43:22.465 INFO:teuthology.orchestra.run.smithi012.stderr: 58050K .......... .......... .......... .......... .......... 62% 117M 0s 2023-10-05T11:43:22.465 INFO:teuthology.orchestra.run.smithi012.stderr: 58100K .......... .......... .......... .......... .......... 62% 112M 0s 2023-10-05T11:43:22.465 INFO:teuthology.orchestra.run.smithi012.stderr: 58150K .......... .......... .......... .......... .......... 62% 109M 0s 2023-10-05T11:43:22.465 INFO:teuthology.orchestra.run.smithi012.stderr: 58200K .......... .......... .......... .......... .......... 62% 119M 0s 2023-10-05T11:43:22.465 INFO:teuthology.orchestra.run.smithi012.stderr: 58250K .......... .......... .......... .......... .......... 62% 109M 0s 2023-10-05T11:43:22.465 INFO:teuthology.orchestra.run.smithi012.stderr: 58300K .......... .......... .......... .......... .......... 62% 79.6M 0s 2023-10-05T11:43:22.465 INFO:teuthology.orchestra.run.smithi012.stderr: 58350K .......... .......... .......... .......... .......... 62% 88.1M 0s 2023-10-05T11:43:22.465 INFO:teuthology.orchestra.run.smithi012.stderr: 58400K .......... .......... .......... .......... .......... 62% 114M 0s 2023-10-05T11:43:22.465 INFO:teuthology.orchestra.run.smithi012.stderr: 58450K .......... .......... .......... .......... .......... 62% 110M 0s 2023-10-05T11:43:22.465 INFO:teuthology.orchestra.run.smithi012.stderr: 58500K .......... .......... .......... .......... .......... 63% 113M 0s 2023-10-05T11:43:22.466 INFO:teuthology.orchestra.run.smithi012.stderr: 58550K .......... .......... .......... .......... .......... 63% 58.6M 0s 2023-10-05T11:43:22.466 INFO:teuthology.orchestra.run.smithi012.stderr: 58600K .......... .......... .......... .......... .......... 63% 35.5M 0s 2023-10-05T11:43:22.466 INFO:teuthology.orchestra.run.smithi012.stderr: 58650K .......... .......... .......... .......... .......... 63% 87.4M 0s 2023-10-05T11:43:22.466 INFO:teuthology.orchestra.run.smithi012.stderr: 58700K .......... .......... .......... .......... .......... 63% 115M 0s 2023-10-05T11:43:22.466 INFO:teuthology.orchestra.run.smithi012.stderr: 58750K .......... .......... .......... .......... .......... 63% 43.2M 0s 2023-10-05T11:43:22.466 INFO:teuthology.orchestra.run.smithi012.stderr: 58800K .......... .......... .......... .......... .......... 63% 38.1M 0s 2023-10-05T11:43:22.466 INFO:teuthology.orchestra.run.smithi012.stderr: 58850K .......... .......... .......... .......... .......... 63% 35.1M 0s 2023-10-05T11:43:22.466 INFO:teuthology.orchestra.run.smithi012.stderr: 58900K .......... .......... .......... .......... .......... 63% 51.5M 0s 2023-10-05T11:43:22.466 INFO:teuthology.orchestra.run.smithi012.stderr: 58950K .......... .......... .......... .......... .......... 63% 106M 0s 2023-10-05T11:43:22.466 INFO:teuthology.orchestra.run.smithi012.stderr: 59000K .......... .......... .......... .......... .......... 63% 88.1M 0s 2023-10-05T11:43:22.466 INFO:teuthology.orchestra.run.smithi012.stderr: 59050K .......... .......... .......... .......... .......... 63% 95.5M 0s 2023-10-05T11:43:22.466 INFO:teuthology.orchestra.run.smithi012.stderr: 59100K .......... .......... .......... .......... .......... 63% 64.3M 0s 2023-10-05T11:43:22.467 INFO:teuthology.orchestra.run.smithi012.stderr: 59150K .......... .......... .......... .......... .......... 63% 48.1M 0s 2023-10-05T11:43:22.467 INFO:teuthology.orchestra.run.smithi012.stderr: 59200K .......... .......... .......... .......... .......... 63% 98.9M 0s 2023-10-05T11:43:22.467 INFO:teuthology.orchestra.run.smithi012.stderr: 59250K .......... .......... .......... .......... .......... 63% 51.9M 0s 2023-10-05T11:43:22.467 INFO:teuthology.orchestra.run.smithi012.stderr: 59300K .......... .......... .......... .......... .......... 63% 93.3M 0s 2023-10-05T11:43:22.467 INFO:teuthology.orchestra.run.smithi012.stderr: 59350K .......... .......... .......... .......... .......... 63% 60.7M 0s 2023-10-05T11:43:22.467 INFO:teuthology.orchestra.run.smithi012.stderr: 59400K .......... .......... .......... .......... .......... 63% 97.4M 0s 2023-10-05T11:43:22.467 INFO:teuthology.orchestra.run.smithi012.stderr: 59450K .......... .......... .......... .......... .......... 64% 30.1M 0s 2023-10-05T11:43:22.467 INFO:teuthology.orchestra.run.smithi012.stderr: 59500K .......... .......... .......... .......... .......... 64% 94.4M 0s 2023-10-05T11:43:22.467 INFO:teuthology.orchestra.run.smithi012.stderr: 59550K .......... .......... .......... .......... .......... 64% 53.3M 0s 2023-10-05T11:43:22.467 INFO:teuthology.orchestra.run.smithi012.stderr: 59600K .......... .......... .......... .......... .......... 64% 63.0M 0s 2023-10-05T11:43:22.467 INFO:teuthology.orchestra.run.smithi012.stderr: 59650K .......... .......... .......... .......... .......... 64% 135M 0s 2023-10-05T11:43:22.467 INFO:teuthology.orchestra.run.smithi012.stderr: 59700K .......... .......... .......... .......... .......... 64% 125M 0s 2023-10-05T11:43:22.468 INFO:teuthology.orchestra.run.smithi012.stderr: 59750K .......... .......... .......... .......... .......... 64% 142M 0s 2023-10-05T11:43:22.468 INFO:teuthology.orchestra.run.smithi012.stderr: 59800K .......... .......... .......... .......... .......... 64% 151M 0s 2023-10-05T11:43:22.468 INFO:teuthology.orchestra.run.smithi012.stderr: 59850K .......... .......... .......... .......... .......... 64% 155M 0s 2023-10-05T11:43:22.468 INFO:teuthology.orchestra.run.smithi012.stderr: 59900K .......... .......... .......... .......... .......... 64% 156M 0s 2023-10-05T11:43:22.468 INFO:teuthology.orchestra.run.smithi012.stderr: 59950K .......... .......... .......... .......... .......... 64% 123M 0s 2023-10-05T11:43:22.468 INFO:teuthology.orchestra.run.smithi012.stderr: 60000K .......... .......... .......... .......... .......... 64% 125M 0s 2023-10-05T11:43:22.468 INFO:teuthology.orchestra.run.smithi012.stderr: 60050K .......... .......... .......... .......... .......... 64% 114M 0s 2023-10-05T11:43:22.468 INFO:teuthology.orchestra.run.smithi012.stderr: 60100K .......... .......... .......... .......... .......... 64% 77.7M 0s 2023-10-05T11:43:22.468 INFO:teuthology.orchestra.run.smithi012.stderr: 60150K .......... .......... .......... .......... .......... 64% 108M 0s 2023-10-05T11:43:22.468 INFO:teuthology.orchestra.run.smithi012.stderr: 60200K .......... .......... .......... .......... .......... 64% 119M 0s 2023-10-05T11:43:22.468 INFO:teuthology.orchestra.run.smithi012.stderr: 60250K .......... .......... .......... .......... .......... 64% 82.8M 0s 2023-10-05T11:43:22.468 INFO:teuthology.orchestra.run.smithi012.stderr: 60300K .......... .......... .......... .......... .......... 64% 82.5M 0s 2023-10-05T11:43:22.469 INFO:teuthology.orchestra.run.smithi012.stderr: 60350K .......... .......... .......... .......... .......... 65% 97.5M 0s 2023-10-05T11:43:22.469 INFO:teuthology.orchestra.run.smithi012.stderr: 60400K .......... .......... .......... .......... .......... 65% 114M 0s 2023-10-05T11:43:22.469 INFO:teuthology.orchestra.run.smithi012.stderr: 60450K .......... .......... .......... .......... .......... 65% 68.6M 0s 2023-10-05T11:43:22.469 INFO:teuthology.orchestra.run.smithi012.stderr: 60500K .......... .......... .......... .......... .......... 65% 117M 0s 2023-10-05T11:43:22.469 INFO:teuthology.orchestra.run.smithi012.stderr: 60550K .......... .......... .......... .......... .......... 65% 109M 0s 2023-10-05T11:43:22.469 INFO:teuthology.orchestra.run.smithi012.stderr: 60600K .......... .......... .......... .......... .......... 65% 113M 0s 2023-10-05T11:43:22.469 INFO:teuthology.orchestra.run.smithi012.stderr: 60650K .......... .......... .......... .......... .......... 65% 113M 0s 2023-10-05T11:43:22.469 INFO:teuthology.orchestra.run.smithi012.stderr: 60700K .......... .......... .......... .......... .......... 65% 101M 0s 2023-10-05T11:43:22.469 INFO:teuthology.orchestra.run.smithi012.stderr: 60750K .......... .......... .......... .......... .......... 65% 83.7M 0s 2023-10-05T11:43:22.469 INFO:teuthology.orchestra.run.smithi012.stderr: 60800K .......... .......... .......... .......... .......... 65% 138M 0s 2023-10-05T11:43:22.469 INFO:teuthology.orchestra.run.smithi012.stderr: 60850K .......... .......... .......... .......... .......... 65% 119M 0s 2023-10-05T11:43:22.469 INFO:teuthology.orchestra.run.smithi012.stderr: 60900K .......... .......... .......... .......... .......... 65% 108M 0s 2023-10-05T11:43:22.470 INFO:teuthology.orchestra.run.smithi012.stderr: 60950K .......... .......... .......... .......... .......... 65% 113M 0s 2023-10-05T11:43:22.470 INFO:teuthology.orchestra.run.smithi012.stderr: 61000K .......... .......... .......... .......... .......... 65% 98.8M 0s 2023-10-05T11:43:22.470 INFO:teuthology.orchestra.run.smithi012.stderr: 61050K .......... .......... .......... .......... .......... 65% 117M 0s 2023-10-05T11:43:22.470 INFO:teuthology.orchestra.run.smithi012.stderr: 61100K .......... .......... .......... .......... .......... 65% 115M 0s 2023-10-05T11:43:22.470 INFO:teuthology.orchestra.run.smithi012.stderr: 61150K .......... .......... .......... .......... .......... 65% 85.1M 0s 2023-10-05T11:43:22.470 INFO:teuthology.orchestra.run.smithi012.stderr: 61200K .......... .......... .......... .......... .......... 65% 94.1M 0s 2023-10-05T11:43:22.470 INFO:teuthology.orchestra.run.smithi012.stderr: 61250K .......... .......... .......... .......... .......... 65% 34.7M 0s 2023-10-05T11:43:22.470 INFO:teuthology.orchestra.run.smithi012.stderr: 61300K .......... .......... .......... .......... .......... 66% 169M 0s 2023-10-05T11:43:22.470 INFO:teuthology.orchestra.run.smithi012.stderr: 61350K .......... .......... .......... .......... .......... 66% 74.5M 0s 2023-10-05T11:43:22.470 INFO:teuthology.orchestra.run.smithi012.stderr: 61400K .......... .......... .......... .......... .......... 66% 71.9M 0s 2023-10-05T11:43:22.470 INFO:teuthology.orchestra.run.smithi012.stderr: 61450K .......... .......... .......... .......... .......... 66% 40.8M 0s 2023-10-05T11:43:22.470 INFO:teuthology.orchestra.run.smithi012.stderr: 61500K .......... .......... .......... .......... .......... 66% 103M 0s 2023-10-05T11:43:22.471 INFO:teuthology.orchestra.run.smithi012.stderr: 61550K .......... .......... .......... .......... .......... 66% 47.9M 0s 2023-10-05T11:43:22.471 INFO:teuthology.orchestra.run.smithi012.stderr: 61600K .......... .......... .......... .......... .......... 66% 58.4M 0s 2023-10-05T11:43:22.471 INFO:teuthology.orchestra.run.smithi012.stderr: 61650K .......... .......... .......... .......... .......... 66% 74.5M 0s 2023-10-05T11:43:22.471 INFO:teuthology.orchestra.run.smithi012.stderr: 61700K .......... .......... .......... .......... .......... 66% 109M 0s 2023-10-05T11:43:22.471 INFO:teuthology.orchestra.run.smithi012.stderr: 61750K .......... .......... .......... .......... .......... 66% 118M 0s 2023-10-05T11:43:22.471 INFO:teuthology.orchestra.run.smithi012.stderr: 61800K .......... .......... .......... .......... .......... 66% 61.4M 0s 2023-10-05T11:43:22.471 INFO:teuthology.orchestra.run.smithi012.stderr: 61850K .......... .......... .......... .......... .......... 66% 54.2M 0s 2023-10-05T11:43:22.471 INFO:teuthology.orchestra.run.smithi012.stderr: 61900K .......... .......... .......... .......... .......... 66% 55.3M 0s 2023-10-05T11:43:22.471 INFO:teuthology.orchestra.run.smithi012.stderr: 61950K .......... .......... .......... .......... .......... 66% 85.3M 0s 2023-10-05T11:43:22.471 INFO:teuthology.orchestra.run.smithi012.stderr: 62000K .......... .......... .......... .......... .......... 66% 119M 0s 2023-10-05T11:43:22.471 INFO:teuthology.orchestra.run.smithi012.stderr: 62050K .......... .......... .......... .......... .......... 66% 68.2M 0s 2023-10-05T11:43:22.471 INFO:teuthology.orchestra.run.smithi012.stderr: 62100K .......... .......... .......... .......... .......... 66% 53.3M 0s 2023-10-05T11:43:22.472 INFO:teuthology.orchestra.run.smithi012.stderr: 62150K .......... .......... .......... .......... .......... 66% 77.4M 0s 2023-10-05T11:43:22.472 INFO:teuthology.orchestra.run.smithi012.stderr: 62200K .......... .......... .......... .......... .......... 67% 79.6M 0s 2023-10-05T11:43:22.472 INFO:teuthology.orchestra.run.smithi012.stderr: 62250K .......... .......... .......... .......... .......... 67% 54.4M 0s 2023-10-05T11:43:22.472 INFO:teuthology.orchestra.run.smithi012.stderr: 62300K .......... .......... .......... .......... .......... 67% 56.7M 0s 2023-10-05T11:43:22.472 INFO:teuthology.orchestra.run.smithi012.stderr: 62350K .......... .......... .......... .......... .......... 67% 65.7M 0s 2023-10-05T11:43:22.472 INFO:teuthology.orchestra.run.smithi012.stderr: 62400K .......... .......... .......... .......... .......... 67% 55.1M 0s 2023-10-05T11:43:22.472 INFO:teuthology.orchestra.run.smithi012.stderr: 62450K .......... .......... .......... .......... .......... 67% 63.8M 0s 2023-10-05T11:43:22.472 INFO:teuthology.orchestra.run.smithi012.stderr: 62500K .......... .......... .......... .......... .......... 67% 66.5M 0s 2023-10-05T11:43:22.472 INFO:teuthology.orchestra.run.smithi012.stderr: 62550K .......... .......... .......... .......... .......... 67% 97.0M 0s 2023-10-05T11:43:22.472 INFO:teuthology.orchestra.run.smithi012.stderr: 62600K .......... .......... .......... .......... .......... 67% 77.7M 0s 2023-10-05T11:43:22.472 INFO:teuthology.orchestra.run.smithi012.stderr: 62650K .......... .......... .......... .......... .......... 67% 171M 0s 2023-10-05T11:43:22.472 INFO:teuthology.orchestra.run.smithi012.stderr: 62700K .......... .......... .......... .......... .......... 67% 202M 0s 2023-10-05T11:43:22.472 INFO:teuthology.orchestra.run.smithi012.stderr: 62750K .......... .......... .......... .......... .......... 67% 161M 0s 2023-10-05T11:43:22.473 INFO:teuthology.orchestra.run.smithi012.stderr: 62800K .......... .......... .......... .......... .......... 67% 210M 0s 2023-10-05T11:43:22.473 INFO:teuthology.orchestra.run.smithi012.stderr: 62850K .......... .......... .......... .......... .......... 67% 160M 0s 2023-10-05T11:43:22.473 INFO:teuthology.orchestra.run.smithi012.stderr: 62900K .......... .......... .......... .......... .......... 67% 74.9M 0s 2023-10-05T11:43:22.473 INFO:teuthology.orchestra.run.smithi012.stderr: 62950K .......... .......... .......... .......... .......... 67% 112M 0s 2023-10-05T11:43:22.473 INFO:teuthology.orchestra.run.smithi012.stderr: 63000K .......... .......... .......... .......... .......... 67% 120M 0s 2023-10-05T11:43:22.473 INFO:teuthology.orchestra.run.smithi012.stderr: 63050K .......... .......... .......... .......... .......... 67% 89.6M 0s 2023-10-05T11:43:22.473 INFO:teuthology.orchestra.run.smithi012.stderr: 63100K .......... .......... .......... .......... .......... 67% 98.7M 0s 2023-10-05T11:43:22.473 INFO:teuthology.orchestra.run.smithi012.stderr: 63150K .......... .......... .......... .......... .......... 68% 81.1M 0s 2023-10-05T11:43:22.473 INFO:teuthology.orchestra.run.smithi012.stderr: 63200K .......... .......... .......... .......... .......... 68% 118M 0s 2023-10-05T11:43:22.473 INFO:teuthology.orchestra.run.smithi012.stderr: 63250K .......... .......... .......... .......... .......... 68% 116M 0s 2023-10-05T11:43:22.473 INFO:teuthology.orchestra.run.smithi012.stderr: 63300K .......... .......... .......... .......... .......... 68% 112M 0s 2023-10-05T11:43:22.473 INFO:teuthology.orchestra.run.smithi012.stderr: 63350K .......... .......... .......... .......... .......... 68% 74.3M 0s 2023-10-05T11:43:22.474 INFO:teuthology.orchestra.run.smithi012.stderr: 63400K .......... .......... .......... .......... .......... 68% 103M 0s 2023-10-05T11:43:22.474 INFO:teuthology.orchestra.run.smithi012.stderr: 63450K .......... .......... .......... .......... .......... 68% 55.4M 0s 2023-10-05T11:43:22.474 INFO:teuthology.orchestra.run.smithi012.stderr: 63500K .......... .......... .......... .......... .......... 68% 78.8M 0s 2023-10-05T11:43:22.474 INFO:teuthology.orchestra.run.smithi012.stderr: 63550K .......... .......... .......... .......... .......... 68% 39.5M 0s 2023-10-05T11:43:22.474 INFO:teuthology.orchestra.run.smithi012.stderr: 63600K .......... .......... .......... .......... .......... 68% 34.7M 0s 2023-10-05T11:43:22.474 INFO:teuthology.orchestra.run.smithi012.stderr: 63650K .......... .......... .......... .......... .......... 68% 39.0M 0s 2023-10-05T11:43:22.474 INFO:teuthology.orchestra.run.smithi012.stderr: 63700K .......... .......... .......... .......... .......... 68% 59.5M 0s 2023-10-05T11:43:22.474 INFO:teuthology.orchestra.run.smithi012.stderr: 63750K .......... .......... .......... .......... .......... 68% 130M 0s 2023-10-05T11:43:22.474 INFO:teuthology.orchestra.run.smithi012.stderr: 63800K .......... .......... .......... .......... .......... 68% 69.3M 0s 2023-10-05T11:43:22.474 INFO:teuthology.orchestra.run.smithi012.stderr: 63850K .......... .......... .......... .......... .......... 68% 71.1M 0s 2023-10-05T11:43:22.474 INFO:teuthology.orchestra.run.smithi012.stderr: 63900K .......... .......... .......... .......... .......... 68% 85.2M 0s 2023-10-05T11:43:22.474 INFO:teuthology.orchestra.run.smithi012.stderr: 63950K .......... .......... .......... .......... .......... 68% 144M 0s 2023-10-05T11:43:22.474 INFO:teuthology.orchestra.run.smithi012.stderr: 64000K .......... .......... .......... .......... .......... 68% 201M 0s 2023-10-05T11:43:22.475 INFO:teuthology.orchestra.run.smithi012.stderr: 64050K .......... .......... .......... .......... .......... 68% 174M 0s 2023-10-05T11:43:22.475 INFO:teuthology.orchestra.run.smithi012.stderr: 64100K .......... .......... .......... .......... .......... 69% 103M 0s 2023-10-05T11:43:22.475 INFO:teuthology.orchestra.run.smithi012.stderr: 64150K .......... .......... .......... .......... .......... 69% 75.4M 0s 2023-10-05T11:43:22.475 INFO:teuthology.orchestra.run.smithi012.stderr: 64200K .......... .......... .......... .......... .......... 69% 91.8M 0s 2023-10-05T11:43:22.475 INFO:teuthology.orchestra.run.smithi012.stderr: 64250K .......... .......... .......... .......... .......... 69% 107M 0s 2023-10-05T11:43:22.475 INFO:teuthology.orchestra.run.smithi012.stderr: 64300K .......... .......... .......... .......... .......... 69% 60.7M 0s 2023-10-05T11:43:22.475 INFO:teuthology.orchestra.run.smithi012.stderr: 64350K .......... .......... .......... .......... .......... 69% 56.3M 0s 2023-10-05T11:43:22.475 INFO:teuthology.orchestra.run.smithi012.stderr: 64400K .......... .......... .......... .......... .......... 69% 53.0M 0s 2023-10-05T11:43:22.475 INFO:teuthology.orchestra.run.smithi012.stderr: 64450K .......... .......... .......... .......... .......... 69% 83.7M 0s 2023-10-05T11:43:22.475 INFO:teuthology.orchestra.run.smithi012.stderr: 64500K .......... .......... .......... .......... .......... 69% 103M 0s 2023-10-05T11:43:22.475 INFO:teuthology.orchestra.run.smithi012.stderr: 64550K .......... .......... .......... .......... .......... 69% 52.1M 0s 2023-10-05T11:43:22.475 INFO:teuthology.orchestra.run.smithi012.stderr: 64600K .......... .......... .......... .......... .......... 69% 188M 0s 2023-10-05T11:43:22.476 INFO:teuthology.orchestra.run.smithi012.stderr: 64650K .......... .......... .......... .......... .......... 69% 117M 0s 2023-10-05T11:43:22.476 INFO:teuthology.orchestra.run.smithi012.stderr: 64700K .......... .......... .......... .......... .......... 69% 72.4M 0s 2023-10-05T11:43:22.476 INFO:teuthology.orchestra.run.smithi012.stderr: 64750K .......... .......... .......... .......... .......... 69% 93.5M 0s 2023-10-05T11:43:22.476 INFO:teuthology.orchestra.run.smithi012.stderr: 64800K .......... .......... .......... .......... .......... 69% 65.5M 0s 2023-10-05T11:43:22.476 INFO:teuthology.orchestra.run.smithi012.stderr: 64850K .......... .......... .......... .......... .......... 69% 75.3M 0s 2023-10-05T11:43:22.476 INFO:teuthology.orchestra.run.smithi012.stderr: 64900K .......... .......... .......... .......... .......... 69% 114M 0s 2023-10-05T11:43:22.476 INFO:teuthology.orchestra.run.smithi012.stderr: 64950K .......... .......... .......... .......... .......... 69% 112M 0s 2023-10-05T11:43:22.476 INFO:teuthology.orchestra.run.smithi012.stderr: 65000K .......... .......... .......... .......... .......... 70% 79.9M 0s 2023-10-05T11:43:22.476 INFO:teuthology.orchestra.run.smithi012.stderr: 65050K .......... .......... .......... .......... .......... 70% 111M 0s 2023-10-05T11:43:22.476 INFO:teuthology.orchestra.run.smithi012.stderr: 65100K .......... .......... .......... .......... .......... 70% 113M 0s 2023-10-05T11:43:22.476 INFO:teuthology.orchestra.run.smithi012.stderr: 65150K .......... .......... .......... .......... .......... 70% 94.6M 0s 2023-10-05T11:43:22.476 INFO:teuthology.orchestra.run.smithi012.stderr: 65200K .......... .......... .......... .......... .......... 70% 100M 0s 2023-10-05T11:43:22.476 INFO:teuthology.orchestra.run.smithi012.stderr: 65250K .......... .......... .......... .......... .......... 70% 102M 0s 2023-10-05T11:43:22.477 INFO:teuthology.orchestra.run.smithi012.stderr: 65300K .......... .......... .......... .......... .......... 70% 93.4M 0s 2023-10-05T11:43:22.477 INFO:teuthology.orchestra.run.smithi012.stderr: 65350K .......... .......... .......... .......... .......... 70% 103M 0s 2023-10-05T11:43:22.477 INFO:teuthology.orchestra.run.smithi012.stderr: 65400K .......... .......... .......... .......... .......... 70% 106M 0s 2023-10-05T11:43:22.477 INFO:teuthology.orchestra.run.smithi012.stderr: 65450K .......... .......... .......... .......... .......... 70% 112M 0s 2023-10-05T11:43:22.477 INFO:teuthology.orchestra.run.smithi012.stderr: 65500K .......... .......... .......... .......... .......... 70% 68.2M 0s 2023-10-05T11:43:22.477 INFO:teuthology.orchestra.run.smithi012.stderr: 65550K .......... .......... .......... .......... .......... 70% 84.1M 0s 2023-10-05T11:43:22.477 INFO:teuthology.orchestra.run.smithi012.stderr: 65600K .......... .......... .......... .......... .......... 70% 115M 0s 2023-10-05T11:43:22.477 INFO:teuthology.orchestra.run.smithi012.stderr: 65650K .......... .......... .......... .......... .......... 70% 77.0M 0s 2023-10-05T11:43:22.477 INFO:teuthology.orchestra.run.smithi012.stderr: 65700K .......... .......... .......... .......... .......... 70% 60.3M 0s 2023-10-05T11:43:22.477 INFO:teuthology.orchestra.run.smithi012.stderr: 65750K .......... .......... .......... .......... .......... 70% 71.6M 0s 2023-10-05T11:43:22.477 INFO:teuthology.orchestra.run.smithi012.stderr: 65800K .......... .......... .......... .......... .......... 70% 90.6M 0s 2023-10-05T11:43:22.478 INFO:teuthology.orchestra.run.smithi012.stderr: 65850K .......... .......... .......... .......... .......... 70% 71.2M 0s 2023-10-05T11:43:22.478 INFO:teuthology.orchestra.run.smithi012.stderr: 65900K .......... .......... .......... .......... .......... 70% 65.4M 0s 2023-10-05T11:43:22.478 INFO:teuthology.orchestra.run.smithi012.stderr: 65950K .......... .......... .......... .......... .......... 71% 64.9M 0s 2023-10-05T11:43:22.478 INFO:teuthology.orchestra.run.smithi012.stderr: 66000K .......... .......... .......... .......... .......... 71% 58.5M 0s 2023-10-05T11:43:22.478 INFO:teuthology.orchestra.run.smithi012.stderr: 66050K .......... .......... .......... .......... .......... 71% 44.6M 0s 2023-10-05T11:43:22.478 INFO:teuthology.orchestra.run.smithi012.stderr: 66100K .......... .......... .......... .......... .......... 71% 95.6M 0s 2023-10-05T11:43:22.478 INFO:teuthology.orchestra.run.smithi012.stderr: 66150K .......... .......... .......... .......... .......... 71% 58.7M 0s 2023-10-05T11:43:22.478 INFO:teuthology.orchestra.run.smithi012.stderr: 66200K .......... .......... .......... .......... .......... 71% 59.3M 0s 2023-10-05T11:43:22.478 INFO:teuthology.orchestra.run.smithi012.stderr: 66250K .......... .......... .......... .......... .......... 71% 111M 0s 2023-10-05T11:43:22.478 INFO:teuthology.orchestra.run.smithi012.stderr: 66300K .......... .......... .......... .......... .......... 71% 116M 0s 2023-10-05T11:43:22.478 INFO:teuthology.orchestra.run.smithi012.stderr: 66350K .......... .......... .......... .......... .......... 71% 69.9M 0s 2023-10-05T11:43:22.478 INFO:teuthology.orchestra.run.smithi012.stderr: 66400K .......... .......... .......... .......... .......... 71% 56.8M 0s 2023-10-05T11:43:22.478 INFO:teuthology.orchestra.run.smithi012.stderr: 66450K .......... .......... .......... .......... .......... 71% 116M 0s 2023-10-05T11:43:22.479 INFO:teuthology.orchestra.run.smithi012.stderr: 66500K .......... .......... .......... .......... .......... 71% 61.1M 0s 2023-10-05T11:43:22.479 INFO:teuthology.orchestra.run.smithi012.stderr: 66550K .......... .......... .......... .......... .......... 71% 113M 0s 2023-10-05T11:43:22.479 INFO:teuthology.orchestra.run.smithi012.stderr: 66600K .......... .......... .......... .......... .......... 71% 52.2M 0s 2023-10-05T11:43:22.479 INFO:teuthology.orchestra.run.smithi012.stderr: 66650K .......... .......... .......... .......... .......... 71% 112M 0s 2023-10-05T11:43:22.479 INFO:teuthology.orchestra.run.smithi012.stderr: 66700K .......... .......... .......... .......... .......... 71% 78.4M 0s 2023-10-05T11:43:22.479 INFO:teuthology.orchestra.run.smithi012.stderr: 66750K .......... .......... .......... .......... .......... 71% 54.5M 0s 2023-10-05T11:43:22.479 INFO:teuthology.orchestra.run.smithi012.stderr: 66800K .......... .......... .......... .......... .......... 71% 107M 0s 2023-10-05T11:43:22.479 INFO:teuthology.orchestra.run.smithi012.stderr: 66850K .......... .......... .......... .......... .......... 72% 119M 0s 2023-10-05T11:43:22.479 INFO:teuthology.orchestra.run.smithi012.stderr: 66900K .......... .......... .......... .......... .......... 72% 74.6M 0s 2023-10-05T11:43:22.479 INFO:teuthology.orchestra.run.smithi012.stderr: 66950K .......... .......... .......... .......... .......... 72% 72.1M 0s 2023-10-05T11:43:22.479 INFO:teuthology.orchestra.run.smithi012.stderr: 67000K .......... .......... .......... .......... .......... 72% 114M 0s 2023-10-05T11:43:22.479 INFO:teuthology.orchestra.run.smithi012.stderr: 67050K .......... .......... .......... .......... .......... 72% 83.1M 0s 2023-10-05T11:43:22.480 INFO:teuthology.orchestra.run.smithi012.stderr: 67100K .......... .......... .......... .......... .......... 72% 46.3M 0s 2023-10-05T11:43:22.480 INFO:teuthology.orchestra.run.smithi012.stderr: 67150K .......... .......... .......... .......... .......... 72% 67.1M 0s 2023-10-05T11:43:22.480 INFO:teuthology.orchestra.run.smithi012.stderr: 67200K .......... .......... .......... .......... .......... 72% 108M 0s 2023-10-05T11:43:22.480 INFO:teuthology.orchestra.run.smithi012.stderr: 67250K .......... .......... .......... .......... .......... 72% 121M 0s 2023-10-05T11:43:22.480 INFO:teuthology.orchestra.run.smithi012.stderr: 67300K .......... .......... .......... .......... .......... 72% 88.6M 0s 2023-10-05T11:43:22.480 INFO:teuthology.orchestra.run.smithi012.stderr: 67350K .......... .......... .......... .......... .......... 72% 95.9M 0s 2023-10-05T11:43:22.480 INFO:teuthology.orchestra.run.smithi012.stderr: 67400K .......... .......... .......... .......... .......... 72% 102M 0s 2023-10-05T11:43:22.480 INFO:teuthology.orchestra.run.smithi012.stderr: 67450K .......... .......... .......... .......... .......... 72% 112M 0s 2023-10-05T11:43:22.480 INFO:teuthology.orchestra.run.smithi012.stderr: 67500K .......... .......... .......... .......... .......... 72% 112M 0s 2023-10-05T11:43:22.480 INFO:teuthology.orchestra.run.smithi012.stderr: 67550K .......... .......... .......... .......... .......... 72% 78.6M 0s 2023-10-05T11:43:22.480 INFO:teuthology.orchestra.run.smithi012.stderr: 67600K .......... .......... .......... .......... .......... 72% 122M 0s 2023-10-05T11:43:22.480 INFO:teuthology.orchestra.run.smithi012.stderr: 67650K .......... .......... .......... .......... .......... 72% 63.3M 0s 2023-10-05T11:43:22.480 INFO:teuthology.orchestra.run.smithi012.stderr: 67700K .......... .......... .......... .......... .......... 72% 116M 0s 2023-10-05T11:43:22.481 INFO:teuthology.orchestra.run.smithi012.stderr: 67750K .......... .......... .......... .......... .......... 72% 87.9M 0s 2023-10-05T11:43:22.481 INFO:teuthology.orchestra.run.smithi012.stderr: 67800K .......... .......... .......... .......... .......... 73% 66.1M 0s 2023-10-05T11:43:22.481 INFO:teuthology.orchestra.run.smithi012.stderr: 67850K .......... .......... .......... .......... .......... 73% 72.1M 0s 2023-10-05T11:43:22.481 INFO:teuthology.orchestra.run.smithi012.stderr: 67900K .......... .......... .......... .......... .......... 73% 121M 0s 2023-10-05T11:43:22.481 INFO:teuthology.orchestra.run.smithi012.stderr: 67950K .......... .......... .......... .......... .......... 73% 67.4M 0s 2023-10-05T11:43:22.481 INFO:teuthology.orchestra.run.smithi012.stderr: 68000K .......... .......... .......... .......... .......... 73% 76.7M 0s 2023-10-05T11:43:22.481 INFO:teuthology.orchestra.run.smithi012.stderr: 68050K .......... .......... .......... .......... .......... 73% 63.4M 0s 2023-10-05T11:43:22.481 INFO:teuthology.orchestra.run.smithi012.stderr: 68100K .......... .......... .......... .......... .......... 73% 61.7M 0s 2023-10-05T11:43:22.481 INFO:teuthology.orchestra.run.smithi012.stderr: 68150K .......... .......... .......... .......... .......... 73% 111M 0s 2023-10-05T11:43:22.481 INFO:teuthology.orchestra.run.smithi012.stderr: 68200K .......... .......... .......... .......... .......... 73% 53.9M 0s 2023-10-05T11:43:22.481 INFO:teuthology.orchestra.run.smithi012.stderr: 68250K .......... .......... .......... .......... .......... 73% 41.6M 0s 2023-10-05T11:43:22.481 INFO:teuthology.orchestra.run.smithi012.stderr: 68300K .......... .......... .......... .......... .......... 73% 60.4M 0s 2023-10-05T11:43:22.481 INFO:teuthology.orchestra.run.smithi012.stderr: 68350K .......... .......... .......... .......... .......... 73% 49.5M 0s 2023-10-05T11:43:22.482 INFO:teuthology.orchestra.run.smithi012.stderr: 68400K .......... .......... .......... .......... .......... 73% 113M 0s 2023-10-05T11:43:22.482 INFO:teuthology.orchestra.run.smithi012.stderr: 68450K .......... .......... .......... .......... .......... 73% 115M 0s 2023-10-05T11:43:22.482 INFO:teuthology.orchestra.run.smithi012.stderr: 68500K .......... .......... .......... .......... .......... 73% 88.5M 0s 2023-10-05T11:43:22.482 INFO:teuthology.orchestra.run.smithi012.stderr: 68550K .......... .......... .......... .......... .......... 73% 78.5M 0s 2023-10-05T11:43:22.482 INFO:teuthology.orchestra.run.smithi012.stderr: 68600K .......... .......... .......... .......... .......... 73% 114M 0s 2023-10-05T11:43:22.482 INFO:teuthology.orchestra.run.smithi012.stderr: 68650K .......... .......... .......... .......... .......... 73% 74.3M 0s 2023-10-05T11:43:22.482 INFO:teuthology.orchestra.run.smithi012.stderr: 68700K .......... .......... .......... .......... .......... 74% 73.7M 0s 2023-10-05T11:43:22.482 INFO:teuthology.orchestra.run.smithi012.stderr: 68750K .......... .......... .......... .......... .......... 74% 50.1M 0s 2023-10-05T11:43:22.482 INFO:teuthology.orchestra.run.smithi012.stderr: 68800K .......... .......... .......... .......... .......... 74% 67.6M 0s 2023-10-05T11:43:22.482 INFO:teuthology.orchestra.run.smithi012.stderr: 68850K .......... .......... .......... .......... .......... 74% 59.8M 0s 2023-10-05T11:43:22.482 INFO:teuthology.orchestra.run.smithi012.stderr: 68900K .......... .......... .......... .......... .......... 74% 119M 0s 2023-10-05T11:43:22.482 INFO:teuthology.orchestra.run.smithi012.stderr: 68950K .......... .......... .......... .......... .......... 74% 68.9M 0s 2023-10-05T11:43:22.483 INFO:teuthology.orchestra.run.smithi012.stderr: 69000K .......... .......... .......... .......... .......... 74% 110M 0s 2023-10-05T11:43:22.483 INFO:teuthology.orchestra.run.smithi012.stderr: 69050K .......... .......... .......... .......... .......... 74% 84.4M 0s 2023-10-05T11:43:22.483 INFO:teuthology.orchestra.run.smithi012.stderr: 69100K .......... .......... .......... .......... .......... 74% 111M 0s 2023-10-05T11:43:22.483 INFO:teuthology.orchestra.run.smithi012.stderr: 69150K .......... .......... .......... .......... .......... 74% 52.2M 0s 2023-10-05T11:43:22.483 INFO:teuthology.orchestra.run.smithi012.stderr: 69200K .......... .......... .......... .......... .......... 74% 94.3M 0s 2023-10-05T11:43:22.483 INFO:teuthology.orchestra.run.smithi012.stderr: 69250K .......... .......... .......... .......... .......... 74% 103M 0s 2023-10-05T11:43:22.483 INFO:teuthology.orchestra.run.smithi012.stderr: 69300K .......... .......... .......... .......... .......... 74% 84.3M 0s 2023-10-05T11:43:22.483 INFO:teuthology.orchestra.run.smithi012.stderr: 69350K .......... .......... .......... .......... .......... 74% 109M 0s 2023-10-05T11:43:22.483 INFO:teuthology.orchestra.run.smithi012.stderr: 69400K .......... .......... .......... .......... .......... 74% 77.8M 0s 2023-10-05T11:43:22.483 INFO:teuthology.orchestra.run.smithi012.stderr: 69450K .......... .......... .......... .......... .......... 74% 102M 0s 2023-10-05T11:43:22.483 INFO:teuthology.orchestra.run.smithi012.stderr: 69500K .......... .......... .......... .......... .......... 74% 85.6M 0s 2023-10-05T11:43:22.483 INFO:teuthology.orchestra.run.smithi012.stderr: 69550K .......... .......... .......... .......... .......... 74% 85.4M 0s 2023-10-05T11:43:22.483 INFO:teuthology.orchestra.run.smithi012.stderr: 69600K .......... .......... .......... .......... .......... 74% 114M 0s 2023-10-05T11:43:22.484 INFO:teuthology.orchestra.run.smithi012.stderr: 69650K .......... .......... .......... .......... .......... 75% 108M 0s 2023-10-05T11:43:22.484 INFO:teuthology.orchestra.run.smithi012.stderr: 69700K .......... .......... .......... .......... .......... 75% 83.3M 0s 2023-10-05T11:43:22.484 INFO:teuthology.orchestra.run.smithi012.stderr: 69750K .......... .......... .......... .......... .......... 75% 93.5M 0s 2023-10-05T11:43:22.484 INFO:teuthology.orchestra.run.smithi012.stderr: 69800K .......... .......... .......... .......... .......... 75% 114M 0s 2023-10-05T11:43:22.484 INFO:teuthology.orchestra.run.smithi012.stderr: 69850K .......... .......... .......... .......... .......... 75% 66.1M 0s 2023-10-05T11:43:22.484 INFO:teuthology.orchestra.run.smithi012.stderr: 69900K .......... .......... .......... .......... .......... 75% 97.4M 0s 2023-10-05T11:43:22.484 INFO:teuthology.orchestra.run.smithi012.stderr: 69950K .......... .......... .......... .......... .......... 75% 50.2M 0s 2023-10-05T11:43:22.484 INFO:teuthology.orchestra.run.smithi012.stderr: 70000K .......... .......... .......... .......... .......... 75% 63.6M 0s 2023-10-05T11:43:22.484 INFO:teuthology.orchestra.run.smithi012.stderr: 70050K .......... .......... .......... .......... .......... 75% 117M 0s 2023-10-05T11:43:22.484 INFO:teuthology.orchestra.run.smithi012.stderr: 70100K .......... .......... .......... .......... .......... 75% 102M 0s 2023-10-05T11:43:22.484 INFO:teuthology.orchestra.run.smithi012.stderr: 70150K .......... .......... .......... .......... .......... 75% 60.6M 0s 2023-10-05T11:43:22.485 INFO:teuthology.orchestra.run.smithi012.stderr: 70200K .......... .......... .......... .......... .......... 75% 74.9M 0s 2023-10-05T11:43:22.485 INFO:teuthology.orchestra.run.smithi012.stderr: 70250K .......... .......... .......... .......... .......... 75% 120M 0s 2023-10-05T11:43:22.485 INFO:teuthology.orchestra.run.smithi012.stderr: 70300K .......... .......... .......... .......... .......... 75% 57.2M 0s 2023-10-05T11:43:22.485 INFO:teuthology.orchestra.run.smithi012.stderr: 70350K .......... .......... .......... .......... .......... 75% 34.3M 0s 2023-10-05T11:43:22.485 INFO:teuthology.orchestra.run.smithi012.stderr: 70400K .......... .......... .......... .......... .......... 75% 58.0M 0s 2023-10-05T11:43:22.485 INFO:teuthology.orchestra.run.smithi012.stderr: 70450K .......... .......... .......... .......... .......... 75% 48.5M 0s 2023-10-05T11:43:22.485 INFO:teuthology.orchestra.run.smithi012.stderr: 70500K .......... .......... .......... .......... .......... 75% 118M 0s 2023-10-05T11:43:22.485 INFO:teuthology.orchestra.run.smithi012.stderr: 70550K .......... .......... .......... .......... .......... 75% 109M 0s 2023-10-05T11:43:22.485 INFO:teuthology.orchestra.run.smithi012.stderr: 70600K .......... .......... .......... .......... .......... 76% 95.2M 0s 2023-10-05T11:43:22.485 INFO:teuthology.orchestra.run.smithi012.stderr: 70650K .......... .......... .......... .......... .......... 76% 78.4M 0s 2023-10-05T11:43:22.485 INFO:teuthology.orchestra.run.smithi012.stderr: 70700K .......... .......... .......... .......... .......... 76% 117M 0s 2023-10-05T11:43:22.485 INFO:teuthology.orchestra.run.smithi012.stderr: 70750K .......... .......... .......... .......... .......... 76% 90.5M 0s 2023-10-05T11:43:22.486 INFO:teuthology.orchestra.run.smithi012.stderr: 70800K .......... .......... .......... .......... .......... 76% 60.1M 0s 2023-10-05T11:43:22.486 INFO:teuthology.orchestra.run.smithi012.stderr: 70850K .......... .......... .......... .......... .......... 76% 80.9M 0s 2023-10-05T11:43:22.486 INFO:teuthology.orchestra.run.smithi012.stderr: 70900K .......... .......... .......... .......... .......... 76% 74.8M 0s 2023-10-05T11:43:22.486 INFO:teuthology.orchestra.run.smithi012.stderr: 70950K .......... .......... .......... .......... .......... 76% 69.0M 0s 2023-10-05T11:43:22.486 INFO:teuthology.orchestra.run.smithi012.stderr: 71000K .......... .......... .......... .......... .......... 76% 53.0M 0s 2023-10-05T11:43:22.486 INFO:teuthology.orchestra.run.smithi012.stderr: 71050K .......... .......... .......... .......... .......... 76% 109M 0s 2023-10-05T11:43:22.486 INFO:teuthology.orchestra.run.smithi012.stderr: 71100K .......... .......... .......... .......... .......... 76% 84.1M 0s 2023-10-05T11:43:22.486 INFO:teuthology.orchestra.run.smithi012.stderr: 71150K .......... .......... .......... .......... .......... 76% 69.6M 0s 2023-10-05T11:43:22.486 INFO:teuthology.orchestra.run.smithi012.stderr: 71200K .......... .......... .......... .......... .......... 76% 118M 0s 2023-10-05T11:43:22.486 INFO:teuthology.orchestra.run.smithi012.stderr: 71250K .......... .......... .......... .......... .......... 76% 55.3M 0s 2023-10-05T11:43:22.486 INFO:teuthology.orchestra.run.smithi012.stderr: 71300K .......... .......... .......... .......... .......... 76% 117M 0s 2023-10-05T11:43:22.486 INFO:teuthology.orchestra.run.smithi012.stderr: 71350K .......... .......... .......... .......... .......... 76% 91.4M 0s 2023-10-05T11:43:22.487 INFO:teuthology.orchestra.run.smithi012.stderr: 71400K .......... .......... .......... .......... .......... 76% 93.6M 0s 2023-10-05T11:43:22.487 INFO:teuthology.orchestra.run.smithi012.stderr: 71450K .......... .......... .......... .......... .......... 76% 110M 0s 2023-10-05T11:43:22.487 INFO:teuthology.orchestra.run.smithi012.stderr: 71500K .......... .......... .......... .......... .......... 77% 112M 0s 2023-10-05T11:43:22.487 INFO:teuthology.orchestra.run.smithi012.stderr: 71550K .......... .......... .......... .......... .......... 77% 55.7M 0s 2023-10-05T11:43:22.487 INFO:teuthology.orchestra.run.smithi012.stderr: 71600K .......... .......... .......... .......... .......... 77% 104M 0s 2023-10-05T11:43:22.487 INFO:teuthology.orchestra.run.smithi012.stderr: 71650K .......... .......... .......... .......... .......... 77% 87.4M 0s 2023-10-05T11:43:22.487 INFO:teuthology.orchestra.run.smithi012.stderr: 71700K .......... .......... .......... .......... .......... 77% 102M 0s 2023-10-05T11:43:22.487 INFO:teuthology.orchestra.run.smithi012.stderr: 71750K .......... .......... .......... .......... .......... 77% 118M 0s 2023-10-05T11:43:22.487 INFO:teuthology.orchestra.run.smithi012.stderr: 71800K .......... .......... .......... .......... .......... 77% 103M 0s 2023-10-05T11:43:22.487 INFO:teuthology.orchestra.run.smithi012.stderr: 71850K .......... .......... .......... .......... .......... 77% 67.3M 0s 2023-10-05T11:43:22.487 INFO:teuthology.orchestra.run.smithi012.stderr: 71900K .......... .......... .......... .......... .......... 77% 69.9M 0s 2023-10-05T11:43:22.487 INFO:teuthology.orchestra.run.smithi012.stderr: 71950K .......... .......... .......... .......... .......... 77% 82.8M 0s 2023-10-05T11:43:22.488 INFO:teuthology.orchestra.run.smithi012.stderr: 72000K .......... .......... .......... .......... .......... 77% 72.8M 0s 2023-10-05T11:43:22.488 INFO:teuthology.orchestra.run.smithi012.stderr: 72050K .......... .......... .......... .......... .......... 77% 92.9M 0s 2023-10-05T11:43:22.488 INFO:teuthology.orchestra.run.smithi012.stderr: 72100K .......... .......... .......... .......... .......... 77% 75.3M 0s 2023-10-05T11:43:22.488 INFO:teuthology.orchestra.run.smithi012.stderr: 72150K .......... .......... .......... .......... .......... 77% 47.8M 0s 2023-10-05T11:43:22.488 INFO:teuthology.orchestra.run.smithi012.stderr: 72200K .......... .......... .......... .......... .......... 77% 106M 0s 2023-10-05T11:43:22.488 INFO:teuthology.orchestra.run.smithi012.stderr: 72250K .......... .......... .......... .......... .......... 77% 116M 0s 2023-10-05T11:43:22.488 INFO:teuthology.orchestra.run.smithi012.stderr: 72300K .......... .......... .......... .......... .......... 77% 68.5M 0s 2023-10-05T11:43:22.488 INFO:teuthology.orchestra.run.smithi012.stderr: 72350K .......... .......... .......... .......... .......... 77% 42.6M 0s 2023-10-05T11:43:22.488 INFO:teuthology.orchestra.run.smithi012.stderr: 72400K .......... .......... .......... .......... .......... 77% 60.8M 0s 2023-10-05T11:43:22.488 INFO:teuthology.orchestra.run.smithi012.stderr: 72450K .......... .......... .......... .......... .......... 78% 45.0M 0s 2023-10-05T11:43:22.488 INFO:teuthology.orchestra.run.smithi012.stderr: 72500K .......... .......... .......... .......... .......... 78% 54.3M 0s 2023-10-05T11:43:22.488 INFO:teuthology.orchestra.run.smithi012.stderr: 72550K .......... .......... .......... .......... .......... 78% 112M 0s 2023-10-05T11:43:22.489 INFO:teuthology.orchestra.run.smithi012.stderr: 72600K .......... .......... .......... .......... .......... 78% 49.1M 0s 2023-10-05T11:43:22.489 INFO:teuthology.orchestra.run.smithi012.stderr: 72650K .......... .......... .......... .......... .......... 78% 114M 0s 2023-10-05T11:43:22.489 INFO:teuthology.orchestra.run.smithi012.stderr: 72700K .......... .......... .......... .......... .......... 78% 77.3M 0s 2023-10-05T11:43:22.489 INFO:teuthology.orchestra.run.smithi012.stderr: 72750K .......... .......... .......... .......... .......... 78% 84.7M 0s 2023-10-05T11:43:22.489 INFO:teuthology.orchestra.run.smithi012.stderr: 72800K .......... .......... .......... .......... .......... 78% 118M 0s 2023-10-05T11:43:22.489 INFO:teuthology.orchestra.run.smithi012.stderr: 72850K .......... .......... .......... .......... .......... 78% 108M 0s 2023-10-05T11:43:22.489 INFO:teuthology.orchestra.run.smithi012.stderr: 72900K .......... .......... .......... .......... .......... 78% 79.1M 0s 2023-10-05T11:43:22.489 INFO:teuthology.orchestra.run.smithi012.stderr: 72950K .......... .......... .......... .......... .......... 78% 57.4M 0s 2023-10-05T11:43:22.489 INFO:teuthology.orchestra.run.smithi012.stderr: 73000K .......... .......... .......... .......... .......... 78% 124M 0s 2023-10-05T11:43:22.489 INFO:teuthology.orchestra.run.smithi012.stderr: 73050K .......... .......... .......... .......... .......... 78% 114M 0s 2023-10-05T11:43:22.489 INFO:teuthology.orchestra.run.smithi012.stderr: 73100K .......... .......... .......... .......... .......... 78% 53.7M 0s 2023-10-05T11:43:22.489 INFO:teuthology.orchestra.run.smithi012.stderr: 73150K .......... .......... .......... .......... .......... 78% 52.6M 0s 2023-10-05T11:43:22.490 INFO:teuthology.orchestra.run.smithi012.stderr: 73200K .......... .......... .......... .......... .......... 78% 73.4M 0s 2023-10-05T11:43:22.490 INFO:teuthology.orchestra.run.smithi012.stderr: 73250K .......... .......... .......... .......... .......... 78% 118M 0s 2023-10-05T11:43:22.490 INFO:teuthology.orchestra.run.smithi012.stderr: 73300K .......... .......... .......... .......... .......... 78% 74.7M 0s 2023-10-05T11:43:22.490 INFO:teuthology.orchestra.run.smithi012.stderr: 73350K .......... .......... .......... .......... .......... 79% 110M 0s 2023-10-05T11:43:22.490 INFO:teuthology.orchestra.run.smithi012.stderr: 73400K .......... .......... .......... .......... .......... 79% 62.6M 0s 2023-10-05T11:43:22.490 INFO:teuthology.orchestra.run.smithi012.stderr: 73450K .......... .......... .......... .......... .......... 79% 118M 0s 2023-10-05T11:43:22.490 INFO:teuthology.orchestra.run.smithi012.stderr: 73500K .......... .......... .......... .......... .......... 79% 74.8M 0s 2023-10-05T11:43:22.490 INFO:teuthology.orchestra.run.smithi012.stderr: 73550K .......... .......... .......... .......... .......... 79% 77.0M 0s 2023-10-05T11:43:22.490 INFO:teuthology.orchestra.run.smithi012.stderr: 73600K .......... .......... .......... .......... .......... 79% 149M 0s 2023-10-05T11:43:22.490 INFO:teuthology.orchestra.run.smithi012.stderr: 73650K .......... .......... .......... .......... .......... 79% 62.8M 0s 2023-10-05T11:43:22.490 INFO:teuthology.orchestra.run.smithi012.stderr: 73700K .......... .......... .......... .......... .......... 79% 117M 0s 2023-10-05T11:43:22.490 INFO:teuthology.orchestra.run.smithi012.stderr: 73750K .......... .......... .......... .......... .......... 79% 113M 0s 2023-10-05T11:43:22.491 INFO:teuthology.orchestra.run.smithi012.stderr: 73800K .......... .......... .......... .......... .......... 79% 97.9M 0s 2023-10-05T11:43:22.491 INFO:teuthology.orchestra.run.smithi012.stderr: 73850K .......... .......... .......... .......... .......... 79% 89.6M 0s 2023-10-05T11:43:22.491 INFO:teuthology.orchestra.run.smithi012.stderr: 73900K .......... .......... .......... .......... .......... 79% 167M 0s 2023-10-05T11:43:22.491 INFO:teuthology.orchestra.run.smithi012.stderr: 73950K .......... .......... .......... .......... .......... 79% 74.2M 0s 2023-10-05T11:43:22.491 INFO:teuthology.orchestra.run.smithi012.stderr: 74000K .......... .......... .......... .......... .......... 79% 63.5M 0s 2023-10-05T11:43:22.491 INFO:teuthology.orchestra.run.smithi012.stderr: 74050K .......... .......... .......... .......... .......... 79% 75.7M 0s 2023-10-05T11:43:22.491 INFO:teuthology.orchestra.run.smithi012.stderr: 74100K .......... .......... .......... .......... .......... 79% 83.1M 0s 2023-10-05T11:43:22.491 INFO:teuthology.orchestra.run.smithi012.stderr: 74150K .......... .......... .......... .......... .......... 79% 112M 0s 2023-10-05T11:43:22.491 INFO:teuthology.orchestra.run.smithi012.stderr: 74200K .......... .......... .......... .......... .......... 79% 60.8M 0s 2023-10-05T11:43:22.491 INFO:teuthology.orchestra.run.smithi012.stderr: 74250K .......... .......... .......... .......... .......... 79% 64.9M 0s 2023-10-05T11:43:22.491 INFO:teuthology.orchestra.run.smithi012.stderr: 74300K .......... .......... .......... .......... .......... 80% 94.1M 0s 2023-10-05T11:43:22.491 INFO:teuthology.orchestra.run.smithi012.stderr: 74350K .......... .......... .......... .......... .......... 80% 81.0M 0s 2023-10-05T11:43:22.491 INFO:teuthology.orchestra.run.smithi012.stderr: 74400K .......... .......... .......... .......... .......... 80% 122M 0s 2023-10-05T11:43:22.492 INFO:teuthology.orchestra.run.smithi012.stderr: 74450K .......... .......... .......... .......... .......... 80% 57.0M 0s 2023-10-05T11:43:22.492 INFO:teuthology.orchestra.run.smithi012.stderr: 74500K .......... .......... .......... .......... .......... 80% 82.8M 0s 2023-10-05T11:43:22.492 INFO:teuthology.orchestra.run.smithi012.stderr: 74550K .......... .......... .......... .......... .......... 80% 49.6M 0s 2023-10-05T11:43:22.492 INFO:teuthology.orchestra.run.smithi012.stderr: 74600K .......... .......... .......... .......... .......... 80% 104M 0s 2023-10-05T11:43:22.492 INFO:teuthology.orchestra.run.smithi012.stderr: 74650K .......... .......... .......... .......... .......... 80% 60.8M 0s 2023-10-05T11:43:22.492 INFO:teuthology.orchestra.run.smithi012.stderr: 74700K .......... .......... .......... .......... .......... 80% 39.0M 0s 2023-10-05T11:43:22.492 INFO:teuthology.orchestra.run.smithi012.stderr: 74750K .......... .......... .......... .......... .......... 80% 49.8M 0s 2023-10-05T11:43:22.492 INFO:teuthology.orchestra.run.smithi012.stderr: 74800K .......... .......... .......... .......... .......... 80% 51.5M 0s 2023-10-05T11:43:22.492 INFO:teuthology.orchestra.run.smithi012.stderr: 74850K .......... .......... .......... .......... .......... 80% 98.9M 0s 2023-10-05T11:43:22.492 INFO:teuthology.orchestra.run.smithi012.stderr: 74900K .......... .......... .......... .......... .......... 80% 77.3M 0s 2023-10-05T11:43:22.492 INFO:teuthology.orchestra.run.smithi012.stderr: 74950K .......... .......... .......... .......... .......... 80% 88.4M 0s 2023-10-05T11:43:22.492 INFO:teuthology.orchestra.run.smithi012.stderr: 75000K .......... .......... .......... .......... .......... 80% 52.4M 0s 2023-10-05T11:43:22.493 INFO:teuthology.orchestra.run.smithi012.stderr: 75050K .......... .......... .......... .......... .......... 80% 96.7M 0s 2023-10-05T11:43:22.493 INFO:teuthology.orchestra.run.smithi012.stderr: 75100K .......... .......... .......... .......... .......... 80% 76.3M 0s 2023-10-05T11:43:22.493 INFO:teuthology.orchestra.run.smithi012.stderr: 75150K .......... .......... .......... .......... .......... 80% 67.4M 0s 2023-10-05T11:43:22.493 INFO:teuthology.orchestra.run.smithi012.stderr: 75200K .......... .......... .......... .......... .......... 81% 75.3M 0s 2023-10-05T11:43:22.493 INFO:teuthology.orchestra.run.smithi012.stderr: 75250K .......... .......... .......... .......... .......... 81% 49.5M 0s 2023-10-05T11:43:22.493 INFO:teuthology.orchestra.run.smithi012.stderr: 75300K .......... .......... .......... .......... .......... 81% 89.4M 0s 2023-10-05T11:43:22.493 INFO:teuthology.orchestra.run.smithi012.stderr: 75350K .......... .......... .......... .......... .......... 81% 102M 0s 2023-10-05T11:43:22.493 INFO:teuthology.orchestra.run.smithi012.stderr: 75400K .......... .......... .......... .......... .......... 81% 96.2M 0s 2023-10-05T11:43:22.493 INFO:teuthology.orchestra.run.smithi012.stderr: 75450K .......... .......... .......... .......... .......... 81% 87.7M 0s 2023-10-05T11:43:22.493 INFO:teuthology.orchestra.run.smithi012.stderr: 75500K .......... .......... .......... .......... .......... 81% 71.8M 0s 2023-10-05T11:43:22.493 INFO:teuthology.orchestra.run.smithi012.stderr: 75550K .......... .......... .......... .......... .......... 81% 56.7M 0s 2023-10-05T11:43:22.493 INFO:teuthology.orchestra.run.smithi012.stderr: 75600K .......... .......... .......... .......... .......... 81% 126M 0s 2023-10-05T11:43:22.493 INFO:teuthology.orchestra.run.smithi012.stderr: 75650K .......... .......... .......... .......... .......... 81% 119M 0s 2023-10-05T11:43:22.494 INFO:teuthology.orchestra.run.smithi012.stderr: 75700K .......... .......... .......... .......... .......... 81% 72.4M 0s 2023-10-05T11:43:22.494 INFO:teuthology.orchestra.run.smithi012.stderr: 75750K .......... .......... .......... .......... .......... 81% 66.4M 0s 2023-10-05T11:43:22.494 INFO:teuthology.orchestra.run.smithi012.stderr: 75800K .......... .......... .......... .......... .......... 81% 95.0M 0s 2023-10-05T11:43:22.494 INFO:teuthology.orchestra.run.smithi012.stderr: 75850K .......... .......... .......... .......... .......... 81% 61.4M 0s 2023-10-05T11:43:22.494 INFO:teuthology.orchestra.run.smithi012.stderr: 75900K .......... .......... .......... .......... .......... 81% 109M 0s 2023-10-05T11:43:22.494 INFO:teuthology.orchestra.run.smithi012.stderr: 75950K .......... .......... .......... .......... .......... 81% 94.7M 0s 2023-10-05T11:43:22.494 INFO:teuthology.orchestra.run.smithi012.stderr: 76000K .......... .......... .......... .......... .......... 81% 124M 0s 2023-10-05T11:43:22.494 INFO:teuthology.orchestra.run.smithi012.stderr: 76050K .......... .......... .......... .......... .......... 81% 140M 0s 2023-10-05T11:43:22.494 INFO:teuthology.orchestra.run.smithi012.stderr: 76100K .......... .......... .......... .......... .......... 81% 99.8M 0s 2023-10-05T11:43:22.494 INFO:teuthology.orchestra.run.smithi012.stderr: 76150K .......... .......... .......... .......... .......... 82% 54.9M 0s 2023-10-05T11:43:22.494 INFO:teuthology.orchestra.run.smithi012.stderr: 76200K .......... .......... .......... .......... .......... 82% 95.1M 0s 2023-10-05T11:43:22.494 INFO:teuthology.orchestra.run.smithi012.stderr: 76250K .......... .......... .......... .......... .......... 82% 165M 0s 2023-10-05T11:43:22.495 INFO:teuthology.orchestra.run.smithi012.stderr: 76300K .......... .......... .......... .......... .......... 82% 75.0M 0s 2023-10-05T11:43:22.495 INFO:teuthology.orchestra.run.smithi012.stderr: 76350K .......... .......... .......... .......... .......... 82% 58.3M 0s 2023-10-05T11:43:22.495 INFO:teuthology.orchestra.run.smithi012.stderr: 76400K .......... .......... .......... .......... .......... 82% 143M 0s 2023-10-05T11:43:22.495 INFO:teuthology.orchestra.run.smithi012.stderr: 76450K .......... .......... .......... .......... .......... 82% 93.8M 0s 2023-10-05T11:43:22.495 INFO:teuthology.orchestra.run.smithi012.stderr: 76500K .......... .......... .......... .......... .......... 82% 114M 0s 2023-10-05T11:43:22.495 INFO:teuthology.orchestra.run.smithi012.stderr: 76550K .......... .......... .......... .......... .......... 82% 55.5M 0s 2023-10-05T11:43:22.495 INFO:teuthology.orchestra.run.smithi012.stderr: 76600K .......... .......... .......... .......... .......... 82% 82.1M 0s 2023-10-05T11:43:22.495 INFO:teuthology.orchestra.run.smithi012.stderr: 76650K .......... .......... .......... .......... .......... 82% 62.5M 0s 2023-10-05T11:43:22.495 INFO:teuthology.orchestra.run.smithi012.stderr: 76700K .......... .......... .......... .......... .......... 82% 175M 0s 2023-10-05T11:43:22.495 INFO:teuthology.orchestra.run.smithi012.stderr: 76750K .......... .......... .......... .......... .......... 82% 74.9M 0s 2023-10-05T11:43:22.495 INFO:teuthology.orchestra.run.smithi012.stderr: 76800K .......... .......... .......... .......... .......... 82% 75.0M 0s 2023-10-05T11:43:22.495 INFO:teuthology.orchestra.run.smithi012.stderr: 76850K .......... .......... .......... .......... .......... 82% 76.1M 0s 2023-10-05T11:43:22.496 INFO:teuthology.orchestra.run.smithi012.stderr: 76900K .......... .......... .......... .......... .......... 82% 152M 0s 2023-10-05T11:43:22.496 INFO:teuthology.orchestra.run.smithi012.stderr: 76950K .......... .......... .......... .......... .......... 82% 129M 0s 2023-10-05T11:43:22.496 INFO:teuthology.orchestra.run.smithi012.stderr: 77000K .......... .......... .......... .......... .......... 82% 95.2M 0s 2023-10-05T11:43:22.496 INFO:teuthology.orchestra.run.smithi012.stderr: 77050K .......... .......... .......... .......... .......... 82% 76.4M 0s 2023-10-05T11:43:22.496 INFO:teuthology.orchestra.run.smithi012.stderr: 77100K .......... .......... .......... .......... .......... 83% 93.1M 0s 2023-10-05T11:43:22.496 INFO:teuthology.orchestra.run.smithi012.stderr: 77150K .......... .......... .......... .......... .......... 83% 71.0M 0s 2023-10-05T11:43:22.496 INFO:teuthology.orchestra.run.smithi012.stderr: 77200K .......... .......... .......... .......... .......... 83% 102M 0s 2023-10-05T11:43:22.496 INFO:teuthology.orchestra.run.smithi012.stderr: 77250K .......... .......... .......... .......... .......... 83% 131M 0s 2023-10-05T11:43:22.496 INFO:teuthology.orchestra.run.smithi012.stderr: 77300K .......... .......... .......... .......... .......... 83% 63.2M 0s 2023-10-05T11:43:22.496 INFO:teuthology.orchestra.run.smithi012.stderr: 77350K .......... .......... .......... .......... .......... 83% 125M 0s 2023-10-05T11:43:22.496 INFO:teuthology.orchestra.run.smithi012.stderr: 77400K .......... .......... .......... .......... .......... 83% 79.0M 0s 2023-10-05T11:43:22.496 INFO:teuthology.orchestra.run.smithi012.stderr: 77450K .......... .......... .......... .......... .......... 83% 58.2M 0s 2023-10-05T11:43:22.497 INFO:teuthology.orchestra.run.smithi012.stderr: 77500K .......... .......... .......... .......... .......... 83% 50.4M 0s 2023-10-05T11:43:22.497 INFO:teuthology.orchestra.run.smithi012.stderr: 77550K .......... .......... .......... .......... .......... 83% 81.5M 0s 2023-10-05T11:43:22.497 INFO:teuthology.orchestra.run.smithi012.stderr: 77600K .......... .......... .......... .......... .......... 83% 85.8M 0s 2023-10-05T11:43:22.497 INFO:teuthology.orchestra.run.smithi012.stderr: 77650K .......... .......... .......... .......... .......... 83% 65.4M 0s 2023-10-05T11:43:22.497 INFO:teuthology.orchestra.run.smithi012.stderr: 77700K .......... .......... .......... .......... .......... 83% 82.5M 0s 2023-10-05T11:43:22.497 INFO:teuthology.orchestra.run.smithi012.stderr: 77750K .......... .......... .......... .......... .......... 83% 151M 0s 2023-10-05T11:43:22.497 INFO:teuthology.orchestra.run.smithi012.stderr: 77800K .......... .......... .......... .......... .......... 83% 116M 0s 2023-10-05T11:43:22.497 INFO:teuthology.orchestra.run.smithi012.stderr: 77850K .......... .......... .......... .......... .......... 83% 79.4M 0s 2023-10-05T11:43:22.497 INFO:teuthology.orchestra.run.smithi012.stderr: 77900K .......... .......... .......... .......... .......... 83% 78.7M 0s 2023-10-05T11:43:22.497 INFO:teuthology.orchestra.run.smithi012.stderr: 77950K .......... .......... .......... .......... .......... 83% 70.0M 0s 2023-10-05T11:43:22.497 INFO:teuthology.orchestra.run.smithi012.stderr: 78000K .......... .......... .......... .......... .......... 84% 73.4M 0s 2023-10-05T11:43:22.497 INFO:teuthology.orchestra.run.smithi012.stderr: 78050K .......... .......... .......... .......... .......... 84% 135M 0s 2023-10-05T11:43:22.497 INFO:teuthology.orchestra.run.smithi012.stderr: 78100K .......... .......... .......... .......... .......... 84% 118M 0s 2023-10-05T11:43:22.498 INFO:teuthology.orchestra.run.smithi012.stderr: 78150K .......... .......... .......... .......... .......... 84% 109M 0s 2023-10-05T11:43:22.498 INFO:teuthology.orchestra.run.smithi012.stderr: 78200K .......... .......... .......... .......... .......... 84% 60.0M 0s 2023-10-05T11:43:22.498 INFO:teuthology.orchestra.run.smithi012.stderr: 78250K .......... .......... .......... .......... .......... 84% 120M 0s 2023-10-05T11:43:22.498 INFO:teuthology.orchestra.run.smithi012.stderr: 78300K .......... .......... .......... .......... .......... 84% 110M 0s 2023-10-05T11:43:22.498 INFO:teuthology.orchestra.run.smithi012.stderr: 78350K .......... .......... .......... .......... .......... 84% 90.5M 0s 2023-10-05T11:43:22.498 INFO:teuthology.orchestra.run.smithi012.stderr: 78400K .......... .......... .......... .......... .......... 84% 92.0M 0s 2023-10-05T11:43:22.498 INFO:teuthology.orchestra.run.smithi012.stderr: 78450K .......... .......... .......... .......... .......... 84% 107M 0s 2023-10-05T11:43:22.498 INFO:teuthology.orchestra.run.smithi012.stderr: 78500K .......... .......... .......... .......... .......... 84% 85.7M 0s 2023-10-05T11:43:22.498 INFO:teuthology.orchestra.run.smithi012.stderr: 78550K .......... .......... .......... .......... .......... 84% 113M 0s 2023-10-05T11:43:22.498 INFO:teuthology.orchestra.run.smithi012.stderr: 78600K .......... .......... .......... .......... .......... 84% 49.4M 0s 2023-10-05T11:43:22.498 INFO:teuthology.orchestra.run.smithi012.stderr: 78650K .......... .......... .......... .......... .......... 84% 80.6M 0s 2023-10-05T11:43:22.498 INFO:teuthology.orchestra.run.smithi012.stderr: 78700K .......... .......... .......... .......... .......... 84% 91.7M 0s 2023-10-05T11:43:22.499 INFO:teuthology.orchestra.run.smithi012.stderr: 78750K .......... .......... .......... .......... .......... 84% 62.2M 0s 2023-10-05T11:43:22.499 INFO:teuthology.orchestra.run.smithi012.stderr: 78800K .......... .......... .......... .......... .......... 84% 129M 0s 2023-10-05T11:43:22.499 INFO:teuthology.orchestra.run.smithi012.stderr: 78850K .......... .......... .......... .......... .......... 84% 50.8M 0s 2023-10-05T11:43:22.499 INFO:teuthology.orchestra.run.smithi012.stderr: 78900K .......... .......... .......... .......... .......... 84% 97.9M 0s 2023-10-05T11:43:22.499 INFO:teuthology.orchestra.run.smithi012.stderr: 78950K .......... .......... .......... .......... .......... 85% 104M 0s 2023-10-05T11:43:22.499 INFO:teuthology.orchestra.run.smithi012.stderr: 79000K .......... .......... .......... .......... .......... 85% 113M 0s 2023-10-05T11:43:22.499 INFO:teuthology.orchestra.run.smithi012.stderr: 79050K .......... .......... .......... .......... .......... 85% 98.2M 0s 2023-10-05T11:43:22.499 INFO:teuthology.orchestra.run.smithi012.stderr: 79100K .......... .......... .......... .......... .......... 85% 105M 0s 2023-10-05T11:43:22.499 INFO:teuthology.orchestra.run.smithi012.stderr: 79150K .......... .......... .......... .......... .......... 85% 66.3M 0s 2023-10-05T11:43:22.499 INFO:teuthology.orchestra.run.smithi012.stderr: 79200K .......... .......... .......... .......... .......... 85% 112M 0s 2023-10-05T11:43:22.499 INFO:teuthology.orchestra.run.smithi012.stderr: 79250K .......... .......... .......... .......... .......... 85% 118M 0s 2023-10-05T11:43:22.499 INFO:teuthology.orchestra.run.smithi012.stderr: 79300K .......... .......... .......... .......... .......... 85% 84.6M 0s 2023-10-05T11:43:22.500 INFO:teuthology.orchestra.run.smithi012.stderr: 79350K .......... .......... .......... .......... .......... 85% 55.5M 0s 2023-10-05T11:43:22.500 INFO:teuthology.orchestra.run.smithi012.stderr: 79400K .......... .......... .......... .......... .......... 85% 113M 0s 2023-10-05T11:43:22.500 INFO:teuthology.orchestra.run.smithi012.stderr: 79450K .......... .......... .......... .......... .......... 85% 118M 0s 2023-10-05T11:43:22.500 INFO:teuthology.orchestra.run.smithi012.stderr: 79500K .......... .......... .......... .......... .......... 85% 73.7M 0s 2023-10-05T11:43:22.500 INFO:teuthology.orchestra.run.smithi012.stderr: 79550K .......... .......... .......... .......... .......... 85% 42.3M 0s 2023-10-05T11:43:22.500 INFO:teuthology.orchestra.run.smithi012.stderr: 79600K .......... .......... .......... .......... .......... 85% 75.1M 0s 2023-10-05T11:43:22.500 INFO:teuthology.orchestra.run.smithi012.stderr: 79650K .......... .......... .......... .......... .......... 85% 95.3M 0s 2023-10-05T11:43:22.500 INFO:teuthology.orchestra.run.smithi012.stderr: 79700K .......... .......... .......... .......... .......... 85% 115M 0s 2023-10-05T11:43:22.500 INFO:teuthology.orchestra.run.smithi012.stderr: 79750K .......... .......... .......... .......... .......... 85% 70.4M 0s 2023-10-05T11:43:22.500 INFO:teuthology.orchestra.run.smithi012.stderr: 79800K .......... .......... .......... .......... .......... 85% 73.2M 0s 2023-10-05T11:43:22.500 INFO:teuthology.orchestra.run.smithi012.stderr: 79850K .......... .......... .......... .......... .......... 86% 77.2M 0s 2023-10-05T11:43:22.500 INFO:teuthology.orchestra.run.smithi012.stderr: 79900K .......... .......... .......... .......... .......... 86% 113M 0s 2023-10-05T11:43:22.500 INFO:teuthology.orchestra.run.smithi012.stderr: 79950K .......... .......... .......... .......... .......... 86% 69.5M 0s 2023-10-05T11:43:22.501 INFO:teuthology.orchestra.run.smithi012.stderr: 80000K .......... .......... .......... .......... .......... 86% 67.9M 0s 2023-10-05T11:43:22.501 INFO:teuthology.orchestra.run.smithi012.stderr: 80050K .......... .......... .......... .......... .......... 86% 109M 0s 2023-10-05T11:43:22.501 INFO:teuthology.orchestra.run.smithi012.stderr: 80100K .......... .......... .......... .......... .......... 86% 74.2M 0s 2023-10-05T11:43:22.501 INFO:teuthology.orchestra.run.smithi012.stderr: 80150K .......... .......... .......... .......... .......... 86% 113M 0s 2023-10-05T11:43:22.501 INFO:teuthology.orchestra.run.smithi012.stderr: 80200K .......... .......... .......... .......... .......... 86% 111M 0s 2023-10-05T11:43:22.501 INFO:teuthology.orchestra.run.smithi012.stderr: 80250K .......... .......... .......... .......... .......... 86% 97.8M 0s 2023-10-05T11:43:22.501 INFO:teuthology.orchestra.run.smithi012.stderr: 80300K .......... .......... .......... .......... .......... 86% 122M 0s 2023-10-05T11:43:22.501 INFO:teuthology.orchestra.run.smithi012.stderr: 80350K .......... .......... .......... .......... .......... 86% 71.5M 0s 2023-10-05T11:43:22.501 INFO:teuthology.orchestra.run.smithi012.stderr: 80400K .......... .......... .......... .......... .......... 86% 112M 0s 2023-10-05T11:43:22.501 INFO:teuthology.orchestra.run.smithi012.stderr: 80450K .......... .......... .......... .......... .......... 86% 100M 0s 2023-10-05T11:43:22.501 INFO:teuthology.orchestra.run.smithi012.stderr: 80500K .......... .......... .......... .......... .......... 86% 110M 0s 2023-10-05T11:43:22.502 INFO:teuthology.orchestra.run.smithi012.stderr: 80550K .......... .......... .......... .......... .......... 86% 93.8M 0s 2023-10-05T11:43:22.502 INFO:teuthology.orchestra.run.smithi012.stderr: 80600K .......... .......... .......... .......... .......... 86% 114M 0s 2023-10-05T11:43:22.502 INFO:teuthology.orchestra.run.smithi012.stderr: 80650K .......... .......... .......... .......... .......... 86% 54.1M 0s 2023-10-05T11:43:22.502 INFO:teuthology.orchestra.run.smithi012.stderr: 80700K .......... .......... .......... .......... .......... 86% 105M 0s 2023-10-05T11:43:22.502 INFO:teuthology.orchestra.run.smithi012.stderr: 80750K .......... .......... .......... .......... .......... 86% 57.8M 0s 2023-10-05T11:43:22.502 INFO:teuthology.orchestra.run.smithi012.stderr: 80800K .......... .......... .......... .......... .......... 87% 118M 0s 2023-10-05T11:43:22.502 INFO:teuthology.orchestra.run.smithi012.stderr: 80850K .......... .......... .......... .......... .......... 87% 121M 0s 2023-10-05T11:43:22.502 INFO:teuthology.orchestra.run.smithi012.stderr: 80900K .......... .......... .......... .......... .......... 87% 76.0M 0s 2023-10-05T11:43:22.502 INFO:teuthology.orchestra.run.smithi012.stderr: 80950K .......... .......... .......... .......... .......... 87% 62.6M 0s 2023-10-05T11:43:22.502 INFO:teuthology.orchestra.run.smithi012.stderr: 81000K .......... .......... .......... .......... .......... 87% 77.3M 0s 2023-10-05T11:43:22.502 INFO:teuthology.orchestra.run.smithi012.stderr: 81050K .......... .......... .......... .......... .......... 87% 111M 0s 2023-10-05T11:43:22.502 INFO:teuthology.orchestra.run.smithi012.stderr: 81100K .......... .......... .......... .......... .......... 87% 125M 0s 2023-10-05T11:43:22.503 INFO:teuthology.orchestra.run.smithi012.stderr: 81150K .......... .......... .......... .......... .......... 87% 70.0M 0s 2023-10-05T11:43:22.503 INFO:teuthology.orchestra.run.smithi012.stderr: 81200K .......... .......... .......... .......... .......... 87% 115M 0s 2023-10-05T11:43:22.503 INFO:teuthology.orchestra.run.smithi012.stderr: 81250K .......... .......... .......... .......... .......... 87% 77.6M 0s 2023-10-05T11:43:22.503 INFO:teuthology.orchestra.run.smithi012.stderr: 81300K .......... .......... .......... .......... .......... 87% 111M 0s 2023-10-05T11:43:22.503 INFO:teuthology.orchestra.run.smithi012.stderr: 81350K .......... .......... .......... .......... .......... 87% 109M 0s 2023-10-05T11:43:22.503 INFO:teuthology.orchestra.run.smithi012.stderr: 81400K .......... .......... .......... .......... .......... 87% 80.1M 0s 2023-10-05T11:43:22.503 INFO:teuthology.orchestra.run.smithi012.stderr: 81450K .......... .......... .......... .......... .......... 87% 63.3M 0s 2023-10-05T11:43:22.503 INFO:teuthology.orchestra.run.smithi012.stderr: 81500K .......... .......... .......... .......... .......... 87% 102M 0s 2023-10-05T11:43:22.503 INFO:teuthology.orchestra.run.smithi012.stderr: 81550K .......... .......... .......... .......... .......... 87% 61.6M 0s 2023-10-05T11:43:22.503 INFO:teuthology.orchestra.run.smithi012.stderr: 81600K .......... .......... .......... .......... .......... 87% 104M 0s 2023-10-05T11:43:22.503 INFO:teuthology.orchestra.run.smithi012.stderr: 81650K .......... .......... .......... .......... .......... 87% 48.5M 0s 2023-10-05T11:43:22.503 INFO:teuthology.orchestra.run.smithi012.stderr: 81700K .......... .......... .......... .......... .......... 87% 112M 0s 2023-10-05T11:43:22.504 INFO:teuthology.orchestra.run.smithi012.stderr: 81750K .......... .......... .......... .......... .......... 88% 45.6M 0s 2023-10-05T11:43:22.504 INFO:teuthology.orchestra.run.smithi012.stderr: 81800K .......... .......... .......... .......... .......... 88% 121M 0s 2023-10-05T11:43:22.504 INFO:teuthology.orchestra.run.smithi012.stderr: 81850K .......... .......... .......... .......... .......... 88% 64.0M 0s 2023-10-05T11:43:22.504 INFO:teuthology.orchestra.run.smithi012.stderr: 81900K .......... .......... .......... .......... .......... 88% 76.2M 0s 2023-10-05T11:43:22.504 INFO:teuthology.orchestra.run.smithi012.stderr: 81950K .......... .......... .......... .......... .......... 88% 86.6M 0s 2023-10-05T11:43:22.504 INFO:teuthology.orchestra.run.smithi012.stderr: 82000K .......... .......... .......... .......... .......... 88% 66.0M 0s 2023-10-05T11:43:22.504 INFO:teuthology.orchestra.run.smithi012.stderr: 82050K .......... .......... .......... .......... .......... 88% 123M 0s 2023-10-05T11:43:22.504 INFO:teuthology.orchestra.run.smithi012.stderr: 82100K .......... .......... .......... .......... .......... 88% 58.4M 0s 2023-10-05T11:43:22.504 INFO:teuthology.orchestra.run.smithi012.stderr: 82150K .......... .......... .......... .......... .......... 88% 93.4M 0s 2023-10-05T11:43:22.504 INFO:teuthology.orchestra.run.smithi012.stderr: 82200K .......... .......... .......... .......... .......... 88% 112M 0s 2023-10-05T11:43:22.504 INFO:teuthology.orchestra.run.smithi012.stderr: 82250K .......... .......... .......... .......... .......... 88% 109M 0s 2023-10-05T11:43:22.504 INFO:teuthology.orchestra.run.smithi012.stderr: 82300K .......... .......... .......... .......... .......... 88% 103M 0s 2023-10-05T11:43:22.505 INFO:teuthology.orchestra.run.smithi012.stderr: 82350K .......... .......... .......... .......... .......... 88% 90.3M 0s 2023-10-05T11:43:22.505 INFO:teuthology.orchestra.run.smithi012.stderr: 82400K .......... .......... .......... .......... .......... 88% 112M 0s 2023-10-05T11:43:22.505 INFO:teuthology.orchestra.run.smithi012.stderr: 82450K .......... .......... .......... .......... .......... 88% 71.0M 0s 2023-10-05T11:43:22.505 INFO:teuthology.orchestra.run.smithi012.stderr: 82500K .......... .......... .......... .......... .......... 88% 129M 0s 2023-10-05T11:43:22.505 INFO:teuthology.orchestra.run.smithi012.stderr: 82550K .......... .......... .......... .......... .......... 88% 55.2M 0s 2023-10-05T11:43:22.505 INFO:teuthology.orchestra.run.smithi012.stderr: 82600K .......... .......... .......... .......... .......... 88% 70.8M 0s 2023-10-05T11:43:22.505 INFO:teuthology.orchestra.run.smithi012.stderr: 82650K .......... .......... .......... .......... .......... 89% 87.3M 0s 2023-10-05T11:43:22.505 INFO:teuthology.orchestra.run.smithi012.stderr: 82700K .......... .......... .......... .......... .......... 89% 121M 0s 2023-10-05T11:43:22.505 INFO:teuthology.orchestra.run.smithi012.stderr: 82750K .......... .......... .......... .......... .......... 89% 74.8M 0s 2023-10-05T11:43:22.505 INFO:teuthology.orchestra.run.smithi012.stderr: 82800K .......... .......... .......... .......... .......... 89% 74.9M 0s 2023-10-05T11:43:22.505 INFO:teuthology.orchestra.run.smithi012.stderr: 82850K .......... .......... .......... .......... .......... 89% 79.0M 0s 2023-10-05T11:43:22.505 INFO:teuthology.orchestra.run.smithi012.stderr: 82900K .......... .......... .......... .......... .......... 89% 63.4M 0s 2023-10-05T11:43:22.506 INFO:teuthology.orchestra.run.smithi012.stderr: 82950K .......... .......... .......... .......... .......... 89% 115M 0s 2023-10-05T11:43:22.506 INFO:teuthology.orchestra.run.smithi012.stderr: 83000K .......... .......... .......... .......... .......... 89% 138M 0s 2023-10-05T11:43:22.506 INFO:teuthology.orchestra.run.smithi012.stderr: 83050K .......... .......... .......... .......... .......... 89% 80.3M 0s 2023-10-05T11:43:22.506 INFO:teuthology.orchestra.run.smithi012.stderr: 83100K .......... .......... .......... .......... .......... 89% 98.3M 0s 2023-10-05T11:43:22.506 INFO:teuthology.orchestra.run.smithi012.stderr: 83150K .......... .......... .......... .......... .......... 89% 79.4M 0s 2023-10-05T11:43:22.506 INFO:teuthology.orchestra.run.smithi012.stderr: 83200K .......... .......... .......... .......... .......... 89% 120M 0s 2023-10-05T11:43:22.506 INFO:teuthology.orchestra.run.smithi012.stderr: 83250K .......... .......... .......... .......... .......... 89% 77.3M 0s 2023-10-05T11:43:22.506 INFO:teuthology.orchestra.run.smithi012.stderr: 83300K .......... .......... .......... .......... .......... 89% 94.6M 0s 2023-10-05T11:43:22.506 INFO:teuthology.orchestra.run.smithi012.stderr: 83350K .......... .......... .......... .......... .......... 89% 83.8M 0s 2023-10-05T11:43:22.506 INFO:teuthology.orchestra.run.smithi012.stderr: 83400K .......... .......... .......... .......... .......... 89% 122M 0s 2023-10-05T11:43:22.506 INFO:teuthology.orchestra.run.smithi012.stderr: 83450K .......... .......... .......... .......... .......... 89% 90.4M 0s 2023-10-05T11:43:22.506 INFO:teuthology.orchestra.run.smithi012.stderr: 83500K .......... .......... .......... .......... .......... 89% 66.4M 0s 2023-10-05T11:43:22.507 INFO:teuthology.orchestra.run.smithi012.stderr: 83550K .......... .......... .......... .......... .......... 89% 63.0M 0s 2023-10-05T11:43:22.507 INFO:teuthology.orchestra.run.smithi012.stderr: 83600K .......... .......... .......... .......... .......... 90% 42.7M 0s 2023-10-05T11:43:22.507 INFO:teuthology.orchestra.run.smithi012.stderr: 83650K .......... .......... .......... .......... .......... 90% 128M 0s 2023-10-05T11:43:22.507 INFO:teuthology.orchestra.run.smithi012.stderr: 83700K .......... .......... .......... .......... .......... 90% 61.4M 0s 2023-10-05T11:43:22.507 INFO:teuthology.orchestra.run.smithi012.stderr: 83750K .......... .......... .......... .......... .......... 90% 67.9M 0s 2023-10-05T11:43:22.507 INFO:teuthology.orchestra.run.smithi012.stderr: 83800K .......... .......... .......... .......... .......... 90% 74.0M 0s 2023-10-05T11:43:22.507 INFO:teuthology.orchestra.run.smithi012.stderr: 83850K .......... .......... .......... .......... .......... 90% 118M 0s 2023-10-05T11:43:22.507 INFO:teuthology.orchestra.run.smithi012.stderr: 83900K .......... .......... .......... .......... .......... 90% 63.7M 0s 2023-10-05T11:43:22.507 INFO:teuthology.orchestra.run.smithi012.stderr: 83950K .......... .......... .......... .......... .......... 90% 92.3M 0s 2023-10-05T11:43:22.507 INFO:teuthology.orchestra.run.smithi012.stderr: 84000K .......... .......... .......... .......... .......... 90% 78.4M 0s 2023-10-05T11:43:22.507 INFO:teuthology.orchestra.run.smithi012.stderr: 84050K .......... .......... .......... .......... .......... 90% 60.1M 0s 2023-10-05T11:43:22.507 INFO:teuthology.orchestra.run.smithi012.stderr: 84100K .......... .......... .......... .......... .......... 90% 117M 0s 2023-10-05T11:43:22.508 INFO:teuthology.orchestra.run.smithi012.stderr: 84150K .......... .......... .......... .......... .......... 90% 84.3M 0s 2023-10-05T11:43:22.508 INFO:teuthology.orchestra.run.smithi012.stderr: 84200K .......... .......... .......... .......... .......... 90% 43.5M 0s 2023-10-05T11:43:22.508 INFO:teuthology.orchestra.run.smithi012.stderr: 84250K .......... .......... .......... .......... .......... 90% 75.3M 0s 2023-10-05T11:43:22.508 INFO:teuthology.orchestra.run.smithi012.stderr: 84300K .......... .......... .......... .......... .......... 90% 99.9M 0s 2023-10-05T11:43:22.508 INFO:teuthology.orchestra.run.smithi012.stderr: 84350K .......... .......... .......... .......... .......... 90% 83.1M 0s 2023-10-05T11:43:22.508 INFO:teuthology.orchestra.run.smithi012.stderr: 84400K .......... .......... .......... .......... .......... 90% 73.6M 0s 2023-10-05T11:43:22.508 INFO:teuthology.orchestra.run.smithi012.stderr: 84450K .......... .......... .......... .......... .......... 90% 64.2M 0s 2023-10-05T11:43:22.508 INFO:teuthology.orchestra.run.smithi012.stderr: 84500K .......... .......... .......... .......... .......... 91% 106M 0s 2023-10-05T11:43:22.508 INFO:teuthology.orchestra.run.smithi012.stderr: 84550K .......... .......... .......... .......... .......... 91% 114M 0s 2023-10-05T11:43:22.508 INFO:teuthology.orchestra.run.smithi012.stderr: 84600K .......... .......... .......... .......... .......... 91% 73.0M 0s 2023-10-05T11:43:22.508 INFO:teuthology.orchestra.run.smithi012.stderr: 84650K .......... .......... .......... .......... .......... 91% 5.34M 0s 2023-10-05T11:43:22.508 INFO:teuthology.orchestra.run.smithi012.stderr: 84700K .......... .......... .......... .......... .......... 91% 155M 0s 2023-10-05T11:43:22.508 INFO:teuthology.orchestra.run.smithi012.stderr: 84750K .......... .......... .......... .......... .......... 91% 52.4M 0s 2023-10-05T11:43:22.509 INFO:teuthology.orchestra.run.smithi012.stderr: 84800K .......... .......... .......... .......... .......... 91% 120M 0s 2023-10-05T11:43:22.509 INFO:teuthology.orchestra.run.smithi012.stderr: 84850K .......... .......... .......... .......... .......... 91% 49.3M 0s 2023-10-05T11:43:22.509 INFO:teuthology.orchestra.run.smithi012.stderr: 84900K .......... .......... .......... .......... .......... 91% 65.3M 0s 2023-10-05T11:43:22.509 INFO:teuthology.orchestra.run.smithi012.stderr: 84950K .......... .......... .......... .......... .......... 91% 45.6M 0s 2023-10-05T11:43:22.509 INFO:teuthology.orchestra.run.smithi012.stderr: 85000K .......... .......... .......... .......... .......... 91% 115M 0s 2023-10-05T11:43:22.509 INFO:teuthology.orchestra.run.smithi012.stderr: 85050K .......... .......... .......... .......... .......... 91% 66.3M 0s 2023-10-05T11:43:22.509 INFO:teuthology.orchestra.run.smithi012.stderr: 85100K .......... .......... .......... .......... .......... 91% 33.7M 0s 2023-10-05T11:43:22.509 INFO:teuthology.orchestra.run.smithi012.stderr: 85150K .......... .......... .......... .......... .......... 91% 14.2M 0s 2023-10-05T11:43:22.509 INFO:teuthology.orchestra.run.smithi012.stderr: 85200K .......... .......... .......... .......... .......... 91% 117M 0s 2023-10-05T11:43:22.509 INFO:teuthology.orchestra.run.smithi012.stderr: 85250K .......... .......... .......... .......... .......... 91% 192M 0s 2023-10-05T11:43:22.509 INFO:teuthology.orchestra.run.smithi012.stderr: 85300K .......... .......... .......... .......... .......... 91% 165M 0s 2023-10-05T11:43:22.509 INFO:teuthology.orchestra.run.smithi012.stderr: 85350K .......... .......... .......... .......... .......... 91% 204M 0s 2023-10-05T11:43:22.510 INFO:teuthology.orchestra.run.smithi012.stderr: 85400K .......... .......... .......... .......... .......... 91% 191M 0s 2023-10-05T11:43:22.510 INFO:teuthology.orchestra.run.smithi012.stderr: 85450K .......... .......... .......... .......... .......... 92% 212M 0s 2023-10-05T11:43:22.510 INFO:teuthology.orchestra.run.smithi012.stderr: 85500K .......... .......... .......... .......... .......... 92% 125M 0s 2023-10-05T11:43:22.510 INFO:teuthology.orchestra.run.smithi012.stderr: 85550K .......... .......... .......... .......... .......... 92% 65.3M 0s 2023-10-05T11:43:22.510 INFO:teuthology.orchestra.run.smithi012.stderr: 85600K .......... .......... .......... .......... .......... 92% 77.4M 0s 2023-10-05T11:43:22.510 INFO:teuthology.orchestra.run.smithi012.stderr: 85650K .......... .......... .......... .......... .......... 92% 70.0M 0s 2023-10-05T11:43:22.510 INFO:teuthology.orchestra.run.smithi012.stderr: 85700K .......... .......... .......... .......... .......... 92% 86.1M 0s 2023-10-05T11:43:22.510 INFO:teuthology.orchestra.run.smithi012.stderr: 85750K .......... .......... .......... .......... .......... 92% 117M 0s 2023-10-05T11:43:22.510 INFO:teuthology.orchestra.run.smithi012.stderr: 85800K .......... .......... .......... .......... .......... 92% 73.9M 0s 2023-10-05T11:43:22.510 INFO:teuthology.orchestra.run.smithi012.stderr: 85850K .......... .......... .......... .......... .......... 92% 62.0M 0s 2023-10-05T11:43:22.510 INFO:teuthology.orchestra.run.smithi012.stderr: 85900K .......... .......... .......... .......... .......... 92% 83.5M 0s 2023-10-05T11:43:22.510 INFO:teuthology.orchestra.run.smithi012.stderr: 85950K .......... .......... .......... .......... .......... 92% 47.1M 0s 2023-10-05T11:43:22.511 INFO:teuthology.orchestra.run.smithi012.stderr: 86000K .......... .......... .......... .......... .......... 92% 78.6M 0s 2023-10-05T11:43:22.511 INFO:teuthology.orchestra.run.smithi012.stderr: 86050K .......... .......... .......... .......... .......... 92% 90.6M 0s 2023-10-05T11:43:22.511 INFO:teuthology.orchestra.run.smithi012.stderr: 86100K .......... .......... .......... .......... .......... 92% 87.2M 0s 2023-10-05T11:43:22.511 INFO:teuthology.orchestra.run.smithi012.stderr: 86150K .......... .......... .......... .......... .......... 92% 38.8M 0s 2023-10-05T11:43:22.511 INFO:teuthology.orchestra.run.smithi012.stderr: 86200K .......... .......... .......... .......... .......... 92% 99.9M 0s 2023-10-05T11:43:22.511 INFO:teuthology.orchestra.run.smithi012.stderr: 86250K .......... .......... .......... .......... .......... 92% 48.9M 0s 2023-10-05T11:43:22.511 INFO:teuthology.orchestra.run.smithi012.stderr: 86300K .......... .......... .......... .......... .......... 92% 34.1M 0s 2023-10-05T11:43:22.511 INFO:teuthology.orchestra.run.smithi012.stderr: 86350K .......... .......... .......... .......... .......... 93% 35.6M 0s 2023-10-05T11:43:22.511 INFO:teuthology.orchestra.run.smithi012.stderr: 86400K .......... .......... .......... .......... .......... 93% 91.2M 0s 2023-10-05T11:43:22.511 INFO:teuthology.orchestra.run.smithi012.stderr: 86450K .......... .......... .......... .......... .......... 93% 106M 0s 2023-10-05T11:43:22.511 INFO:teuthology.orchestra.run.smithi012.stderr: 86500K .......... .......... .......... .......... .......... 93% 87.0M 0s 2023-10-05T11:43:22.511 INFO:teuthology.orchestra.run.smithi012.stderr: 86550K .......... .......... .......... .......... .......... 93% 107M 0s 2023-10-05T11:43:22.511 INFO:teuthology.orchestra.run.smithi012.stderr: 86600K .......... .......... .......... .......... .......... 93% 83.9M 0s 2023-10-05T11:43:22.512 INFO:teuthology.orchestra.run.smithi012.stderr: 86650K .......... .......... .......... .......... .......... 93% 118M 0s 2023-10-05T11:43:22.512 INFO:teuthology.orchestra.run.smithi012.stderr: 86700K .......... .......... .......... .......... .......... 93% 32.8M 0s 2023-10-05T11:43:22.512 INFO:teuthology.orchestra.run.smithi012.stderr: 86750K .......... .......... .......... .......... .......... 93% 64.3M 0s 2023-10-05T11:43:22.512 INFO:teuthology.orchestra.run.smithi012.stderr: 86800K .......... .......... .......... .......... .......... 93% 118M 0s 2023-10-05T11:43:22.512 INFO:teuthology.orchestra.run.smithi012.stderr: 86850K .......... .......... .......... .......... .......... 93% 85.2M 0s 2023-10-05T11:43:22.512 INFO:teuthology.orchestra.run.smithi012.stderr: 86900K .......... .......... .......... .......... .......... 93% 88.1M 0s 2023-10-05T11:43:22.512 INFO:teuthology.orchestra.run.smithi012.stderr: 86950K .......... .......... .......... .......... .......... 93% 122M 0s 2023-10-05T11:43:22.512 INFO:teuthology.orchestra.run.smithi012.stderr: 87000K .......... .......... .......... .......... .......... 93% 101M 0s 2023-10-05T11:43:22.512 INFO:teuthology.orchestra.run.smithi012.stderr: 87050K .......... .......... .......... .......... .......... 93% 134M 0s 2023-10-05T11:43:22.513 INFO:teuthology.orchestra.run.smithi012.stderr: 87100K .......... .......... .......... .......... .......... 93% 108M 0s 2023-10-05T11:43:22.513 INFO:teuthology.orchestra.run.smithi012.stderr: 87150K .......... .......... .......... .......... .......... 93% 70.5M 0s 2023-10-05T11:43:22.513 INFO:teuthology.orchestra.run.smithi012.stderr: 87200K .......... .......... .......... .......... .......... 93% 119M 0s 2023-10-05T11:43:22.513 INFO:teuthology.orchestra.run.smithi012.stderr: 87250K .......... .......... .......... .......... .......... 93% 114M 0s 2023-10-05T11:43:22.513 INFO:teuthology.orchestra.run.smithi012.stderr: 87300K .......... .......... .......... .......... .......... 94% 61.1M 0s 2023-10-05T11:43:22.513 INFO:teuthology.orchestra.run.smithi012.stderr: 87350K .......... .......... .......... .......... .......... 94% 106M 0s 2023-10-05T11:43:22.513 INFO:teuthology.orchestra.run.smithi012.stderr: 87400K .......... .......... .......... .......... .......... 94% 138M 0s 2023-10-05T11:43:22.513 INFO:teuthology.orchestra.run.smithi012.stderr: 87450K .......... .......... .......... .......... .......... 94% 85.2M 0s 2023-10-05T11:43:22.513 INFO:teuthology.orchestra.run.smithi012.stderr: 87500K .......... .......... .......... .......... .......... 94% 75.7M 0s 2023-10-05T11:43:22.513 INFO:teuthology.orchestra.run.smithi012.stderr: 87550K .......... .......... .......... .......... .......... 94% 55.9M 0s 2023-10-05T11:43:22.513 INFO:teuthology.orchestra.run.smithi012.stderr: 87600K .......... .......... .......... .......... .......... 94% 99.4M 0s 2023-10-05T11:43:22.514 INFO:teuthology.orchestra.run.smithi012.stderr: 87650K .......... .......... .......... .......... .......... 94% 69.3M 0s 2023-10-05T11:43:22.514 INFO:teuthology.orchestra.run.smithi012.stderr: 87700K .......... .......... .......... .......... .......... 94% 129M 0s 2023-10-05T11:43:22.514 INFO:teuthology.orchestra.run.smithi012.stderr: 87750K .......... .......... .......... .......... .......... 94% 70.7M 0s 2023-10-05T11:43:22.514 INFO:teuthology.orchestra.run.smithi012.stderr: 87800K .......... .......... .......... .......... .......... 94% 56.8M 0s 2023-10-05T11:43:22.514 INFO:teuthology.orchestra.run.smithi012.stderr: 87850K .......... .......... .......... .......... .......... 94% 97.7M 0s 2023-10-05T11:43:22.514 INFO:teuthology.orchestra.run.smithi012.stderr: 87900K .......... .......... .......... .......... .......... 94% 141M 0s 2023-10-05T11:43:22.514 INFO:teuthology.orchestra.run.smithi012.stderr: 87950K .......... .......... .......... .......... .......... 94% 47.0M 0s 2023-10-05T11:43:22.514 INFO:teuthology.orchestra.run.smithi012.stderr: 88000K .......... .......... .......... .......... .......... 94% 99.3M 0s 2023-10-05T11:43:22.514 INFO:teuthology.orchestra.run.smithi012.stderr: 88050K .......... .......... .......... .......... .......... 94% 83.2M 0s 2023-10-05T11:43:22.514 INFO:teuthology.orchestra.run.smithi012.stderr: 88100K .......... .......... .......... .......... .......... 94% 105M 0s 2023-10-05T11:43:22.514 INFO:teuthology.orchestra.run.smithi012.stderr: 88150K .......... .......... .......... .......... .......... 94% 189M 0s 2023-10-05T11:43:22.514 INFO:teuthology.orchestra.run.smithi012.stderr: 88200K .......... .......... .......... .......... .......... 94% 94.6M 0s 2023-10-05T11:43:22.515 INFO:teuthology.orchestra.run.smithi012.stderr: 88250K .......... .......... .......... .......... .......... 95% 37.7M 0s 2023-10-05T11:43:22.515 INFO:teuthology.orchestra.run.smithi012.stderr: 88300K .......... .......... .......... .......... .......... 95% 50.6M 0s 2023-10-05T11:43:22.515 INFO:teuthology.orchestra.run.smithi012.stderr: 88350K .......... .......... .......... .......... .......... 95% 87.4M 0s 2023-10-05T11:43:22.515 INFO:teuthology.orchestra.run.smithi012.stderr: 88400K .......... .......... .......... .......... .......... 95% 117M 0s 2023-10-05T11:43:22.515 INFO:teuthology.orchestra.run.smithi012.stderr: 88450K .......... .......... .......... .......... .......... 95% 73.9M 0s 2023-10-05T11:43:22.515 INFO:teuthology.orchestra.run.smithi012.stderr: 88500K .......... .......... .......... .......... .......... 95% 114M 0s 2023-10-05T11:43:22.515 INFO:teuthology.orchestra.run.smithi012.stderr: 88550K .......... .......... .......... .......... .......... 95% 73.0M 0s 2023-10-05T11:43:22.515 INFO:teuthology.orchestra.run.smithi012.stderr: 88600K .......... .......... .......... .......... .......... 95% 126M 0s 2023-10-05T11:43:22.515 INFO:teuthology.orchestra.run.smithi012.stderr: 88650K .......... .......... .......... .......... .......... 95% 77.9M 0s 2023-10-05T11:43:22.515 INFO:teuthology.orchestra.run.smithi012.stderr: 88700K .......... .......... .......... .......... .......... 95% 118M 0s 2023-10-05T11:43:22.515 INFO:teuthology.orchestra.run.smithi012.stderr: 88750K .......... .......... .......... .......... .......... 95% 66.5M 0s 2023-10-05T11:43:22.515 INFO:teuthology.orchestra.run.smithi012.stderr: 88800K .......... .......... .......... .......... .......... 95% 61.4M 0s 2023-10-05T11:43:22.515 INFO:teuthology.orchestra.run.smithi012.stderr: 88850K .......... .......... .......... .......... .......... 95% 118M 0s 2023-10-05T11:43:22.516 INFO:teuthology.orchestra.run.smithi012.stderr: 88900K .......... .......... .......... .......... .......... 95% 113M 0s 2023-10-05T11:43:22.516 INFO:teuthology.orchestra.run.smithi012.stderr: 88950K .......... .......... .......... .......... .......... 95% 111M 0s 2023-10-05T11:43:22.516 INFO:teuthology.orchestra.run.smithi012.stderr: 89000K .......... .......... .......... .......... .......... 95% 77.5M 0s 2023-10-05T11:43:22.516 INFO:teuthology.orchestra.run.smithi012.stderr: 89050K .......... .......... .......... .......... .......... 95% 87.1M 0s 2023-10-05T11:43:22.516 INFO:teuthology.orchestra.run.smithi012.stderr: 89100K .......... .......... .......... .......... .......... 95% 76.4M 0s 2023-10-05T11:43:22.516 INFO:teuthology.orchestra.run.smithi012.stderr: 89150K .......... .......... .......... .......... .......... 96% 78.4M 0s 2023-10-05T11:43:22.516 INFO:teuthology.orchestra.run.smithi012.stderr: 89200K .......... .......... .......... .......... .......... 96% 60.0M 0s 2023-10-05T11:43:22.516 INFO:teuthology.orchestra.run.smithi012.stderr: 89250K .......... .......... .......... .......... .......... 96% 75.0M 0s 2023-10-05T11:43:22.516 INFO:teuthology.orchestra.run.smithi012.stderr: 89300K .......... .......... .......... .......... .......... 96% 125M 0s 2023-10-05T11:43:22.516 INFO:teuthology.orchestra.run.smithi012.stderr: 89350K .......... .......... .......... .......... .......... 96% 55.9M 0s 2023-10-05T11:43:22.516 INFO:teuthology.orchestra.run.smithi012.stderr: 89400K .......... .......... .......... .......... .......... 96% 59.8M 0s 2023-10-05T11:43:22.516 INFO:teuthology.orchestra.run.smithi012.stderr: 89450K .......... .......... .......... .......... .......... 96% 54.9M 0s 2023-10-05T11:43:22.517 INFO:teuthology.orchestra.run.smithi012.stderr: 89500K .......... .......... .......... .......... .......... 96% 129M 0s 2023-10-05T11:43:22.517 INFO:teuthology.orchestra.run.smithi012.stderr: 89550K .......... .......... .......... .......... .......... 96% 50.8M 0s 2023-10-05T11:43:22.517 INFO:teuthology.orchestra.run.smithi012.stderr: 89600K .......... .......... .......... .......... .......... 96% 39.5M 0s 2023-10-05T11:43:22.517 INFO:teuthology.orchestra.run.smithi012.stderr: 89650K .......... .......... .......... .......... .......... 96% 72.5M 0s 2023-10-05T11:43:22.517 INFO:teuthology.orchestra.run.smithi012.stderr: 89700K .......... .......... .......... .......... .......... 96% 42.6M 0s 2023-10-05T11:43:22.517 INFO:teuthology.orchestra.run.smithi012.stderr: 89750K .......... .......... .......... .......... .......... 96% 111M 0s 2023-10-05T11:43:22.517 INFO:teuthology.orchestra.run.smithi012.stderr: 89800K .......... .......... .......... .......... .......... 96% 106M 0s 2023-10-05T11:43:22.517 INFO:teuthology.orchestra.run.smithi012.stderr: 89850K .......... .......... .......... .......... .......... 96% 48.7M 0s 2023-10-05T11:43:22.517 INFO:teuthology.orchestra.run.smithi012.stderr: 89900K .......... .......... .......... .......... .......... 96% 116M 0s 2023-10-05T11:43:22.517 INFO:teuthology.orchestra.run.smithi012.stderr: 89950K .......... .......... .......... .......... .......... 96% 63.6M 0s 2023-10-05T11:43:22.517 INFO:teuthology.orchestra.run.smithi012.stderr: 90000K .......... .......... .......... .......... .......... 96% 113M 0s 2023-10-05T11:43:22.517 INFO:teuthology.orchestra.run.smithi012.stderr: 90050K .......... .......... .......... .......... .......... 96% 125M 0s 2023-10-05T11:43:22.518 INFO:teuthology.orchestra.run.smithi012.stderr: 90100K .......... .......... .......... .......... .......... 97% 71.7M 0s 2023-10-05T11:43:22.518 INFO:teuthology.orchestra.run.smithi012.stderr: 90150K .......... .......... .......... .......... .......... 97% 84.4M 0s 2023-10-05T11:43:22.518 INFO:teuthology.orchestra.run.smithi012.stderr: 90200K .......... .......... .......... .......... .......... 97% 119M 0s 2023-10-05T11:43:22.518 INFO:teuthology.orchestra.run.smithi012.stderr: 90250K .......... .......... .......... .......... .......... 97% 79.4M 0s 2023-10-05T11:43:22.518 INFO:teuthology.orchestra.run.smithi012.stderr: 90300K .......... .......... .......... .......... .......... 97% 117M 0s 2023-10-05T11:43:22.518 INFO:teuthology.orchestra.run.smithi012.stderr: 90350K .......... .......... .......... .......... .......... 97% 52.9M 0s 2023-10-05T11:43:22.518 INFO:teuthology.orchestra.run.smithi012.stderr: 90400K .......... .......... .......... .......... .......... 97% 77.3M 0s 2023-10-05T11:43:22.518 INFO:teuthology.orchestra.run.smithi012.stderr: 90450K .......... .......... .......... .......... .......... 97% 112M 0s 2023-10-05T11:43:22.518 INFO:teuthology.orchestra.run.smithi012.stderr: 90500K .......... .......... .......... .......... .......... 97% 120M 0s 2023-10-05T11:43:22.518 INFO:teuthology.orchestra.run.smithi012.stderr: 90550K .......... .......... .......... .......... .......... 97% 52.2M 0s 2023-10-05T11:43:22.518 INFO:teuthology.orchestra.run.smithi012.stderr: 90600K .......... .......... .......... .......... .......... 97% 110M 0s 2023-10-05T11:43:22.518 INFO:teuthology.orchestra.run.smithi012.stderr: 90650K .......... .......... .......... .......... .......... 97% 99.4M 0s 2023-10-05T11:43:22.519 INFO:teuthology.orchestra.run.smithi012.stderr: 90700K .......... .......... .......... .......... .......... 97% 128M 0s 2023-10-05T11:43:22.519 INFO:teuthology.orchestra.run.smithi012.stderr: 90750K .......... .......... .......... .......... .......... 97% 52.5M 0s 2023-10-05T11:43:22.519 INFO:teuthology.orchestra.run.smithi012.stderr: 90800K .......... .......... .......... .......... .......... 97% 112M 0s 2023-10-05T11:43:22.519 INFO:teuthology.orchestra.run.smithi012.stderr: 90850K .......... .......... .......... .......... .......... 97% 42.3M 0s 2023-10-05T11:43:22.519 INFO:teuthology.orchestra.run.smithi012.stderr: 90900K .......... .......... .......... .......... .......... 97% 105M 0s 2023-10-05T11:43:22.519 INFO:teuthology.orchestra.run.smithi012.stderr: 90950K .......... .......... .......... .......... .......... 97% 107M 0s 2023-10-05T11:43:22.519 INFO:teuthology.orchestra.run.smithi012.stderr: 91000K .......... .......... .......... .......... .......... 98% 54.2M 0s 2023-10-05T11:43:22.519 INFO:teuthology.orchestra.run.smithi012.stderr: 91050K .......... .......... .......... .......... .......... 98% 71.7M 0s 2023-10-05T11:43:22.519 INFO:teuthology.orchestra.run.smithi012.stderr: 91100K .......... .......... .......... .......... .......... 98% 98.9M 0s 2023-10-05T11:43:22.519 INFO:teuthology.orchestra.run.smithi012.stderr: 91150K .......... .......... .......... .......... .......... 98% 43.9M 0s 2023-10-05T11:43:22.519 INFO:teuthology.orchestra.run.smithi012.stderr: 91200K .......... .......... .......... .......... .......... 98% 115M 0s 2023-10-05T11:43:22.519 INFO:teuthology.orchestra.run.smithi012.stderr: 91250K .......... .......... .......... .......... .......... 98% 79.8M 0s 2023-10-05T11:43:22.520 INFO:teuthology.orchestra.run.smithi012.stderr: 91300K .......... .......... .......... .......... .......... 98% 81.7M 0s 2023-10-05T11:43:22.520 INFO:teuthology.orchestra.run.smithi012.stderr: 91350K .......... .......... .......... .......... .......... 98% 106M 0s 2023-10-05T11:43:22.520 INFO:teuthology.orchestra.run.smithi012.stderr: 91400K .......... .......... .......... .......... .......... 98% 105M 0s 2023-10-05T11:43:22.520 INFO:teuthology.orchestra.run.smithi012.stderr: 91450K .......... .......... .......... .......... .......... 98% 52.9M 0s 2023-10-05T11:43:22.520 INFO:teuthology.orchestra.run.smithi012.stderr: 91500K .......... .......... .......... .......... .......... 98% 68.6M 0s 2023-10-05T11:43:22.520 INFO:teuthology.orchestra.run.smithi012.stderr: 91550K .......... .......... .......... .......... .......... 98% 75.7M 0s 2023-10-05T11:43:22.520 INFO:teuthology.orchestra.run.smithi012.stderr: 91600K .......... .......... .......... .......... .......... 98% 66.1M 0s 2023-10-05T11:43:22.520 INFO:teuthology.orchestra.run.smithi012.stderr: 91650K .......... .......... .......... .......... .......... 98% 91.3M 0s 2023-10-05T11:43:22.520 INFO:teuthology.orchestra.run.smithi012.stderr: 91700K .......... .......... .......... .......... .......... 98% 104M 0s 2023-10-05T11:43:22.520 INFO:teuthology.orchestra.run.smithi012.stderr: 91750K .......... .......... .......... .......... .......... 98% 112M 0s 2023-10-05T11:43:22.520 INFO:teuthology.orchestra.run.smithi012.stderr: 91800K .......... .......... .......... .......... .......... 98% 70.5M 0s 2023-10-05T11:43:22.520 INFO:teuthology.orchestra.run.smithi012.stderr: 91850K .......... .......... .......... .......... .......... 98% 94.5M 0s 2023-10-05T11:43:22.520 INFO:teuthology.orchestra.run.smithi012.stderr: 91900K .......... .......... .......... .......... .......... 98% 144M 0s 2023-10-05T11:43:22.521 INFO:teuthology.orchestra.run.smithi012.stderr: 91950K .......... .......... .......... .......... .......... 99% 69.8M 0s 2023-10-05T11:43:22.521 INFO:teuthology.orchestra.run.smithi012.stderr: 92000K .......... .......... .......... .......... .......... 99% 68.7M 0s 2023-10-05T11:43:22.521 INFO:teuthology.orchestra.run.smithi012.stderr: 92050K .......... .......... .......... .......... .......... 99% 136M 0s 2023-10-05T11:43:22.521 INFO:teuthology.orchestra.run.smithi012.stderr: 92100K .......... .......... .......... .......... .......... 99% 121M 0s 2023-10-05T11:43:22.521 INFO:teuthology.orchestra.run.smithi012.stderr: 92150K .......... .......... .......... .......... .......... 99% 68.0M 0s 2023-10-05T11:43:22.521 INFO:teuthology.orchestra.run.smithi012.stderr: 92200K .......... .......... .......... .......... .......... 99% 115M 0s 2023-10-05T11:43:22.521 INFO:teuthology.orchestra.run.smithi012.stderr: 92250K .......... .......... .......... .......... .......... 99% 63.2M 0s 2023-10-05T11:43:22.521 INFO:teuthology.orchestra.run.smithi012.stderr: 92300K .......... .......... .......... .......... .......... 99% 119M 0s 2023-10-05T11:43:22.521 INFO:teuthology.orchestra.run.smithi012.stderr: 92350K .......... .......... .......... .......... .......... 99% 59.3M 0s 2023-10-05T11:43:22.521 INFO:teuthology.orchestra.run.smithi012.stderr: 92400K .......... .......... .......... .......... .......... 99% 92.2M 0s 2023-10-05T11:43:22.521 INFO:teuthology.orchestra.run.smithi012.stderr: 92450K .......... .......... .......... .......... .......... 99% 80.1M 0s 2023-10-05T11:43:22.521 INFO:teuthology.orchestra.run.smithi012.stderr: 92500K .......... .......... .......... .......... .......... 99% 105M 0s 2023-10-05T11:43:22.522 INFO:teuthology.orchestra.run.smithi012.stderr: 92550K .......... .......... .......... .......... .......... 99% 98.2M 0s 2023-10-05T11:43:22.522 INFO:teuthology.orchestra.run.smithi012.stderr: 92600K .......... .......... .......... .......... .......... 99% 75.8M 0s 2023-10-05T11:43:22.522 INFO:teuthology.orchestra.run.smithi012.stderr: 92650K .......... .......... .......... .......... .......... 99% 66.4M 0s 2023-10-05T11:43:22.522 INFO:teuthology.orchestra.run.smithi012.stderr: 92700K .......... .......... .......... .......... .......... 99% 67.2M 0s 2023-10-05T11:43:22.522 INFO:teuthology.orchestra.run.smithi012.stderr: 92750K .......... .......... .......... .......... .......... 99% 46.9M 0s 2023-10-05T11:43:22.522 INFO:teuthology.orchestra.run.smithi012.stderr: 92800K .......... .......... .......... .......... .......... 99% 115M 0s 2023-10-05T11:43:22.522 INFO:teuthology.orchestra.run.smithi012.stderr: 92850K .......... .......... .......... .......... .......... 99% 58.3M 0s 2023-10-05T11:43:22.522 INFO:teuthology.orchestra.run.smithi012.stderr: 92900K 100% 134G=1.3s 2023-10-05T11:43:22.522 INFO:teuthology.orchestra.run.smithi012.stderr: 2023-10-05T11:43:22.522 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05 11:43:22 (72.3 MB/s) - ‘gradle-6.0.1-bin.zip’ saved [95129672/95129672] 2023-10-05T11:43:22.522 INFO:teuthology.orchestra.run.smithi012.stderr: 2023-10-05T11:43:22.529 INFO:teuthology.orchestra.run.smithi012.stdout:Archive: gradle-6.0.1-bin.zip 2023-10-05T11:43:22.529 INFO:teuthology.orchestra.run.smithi012.stdout: creating: /opt/gradle/gradle-6.0.1/ 2023-10-05T11:43:22.529 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/getting-started.html 2023-10-05T11:43:22.529 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/LICENSE 2023-10-05T11:43:22.529 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/NOTICE 2023-10-05T11:43:22.529 INFO:teuthology.orchestra.run.smithi012.stdout: creating: /opt/gradle/gradle-6.0.1/init.d/ 2023-10-05T11:43:22.529 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/init.d/readme.txt 2023-10-05T11:43:22.529 INFO:teuthology.orchestra.run.smithi012.stdout: creating: /opt/gradle/gradle-6.0.1/bin/ 2023-10-05T11:43:22.529 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/bin/gradle 2023-10-05T11:43:22.529 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/bin/gradle.bat 2023-10-05T11:43:22.530 INFO:teuthology.orchestra.run.smithi012.stdout: creating: /opt/gradle/gradle-6.0.1/lib/ 2023-10-05T11:43:22.530 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-api-metadata-6.0.1.jar 2023-10-05T11:43:22.530 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-launcher-6.0.1.jar 2023-10-05T11:43:22.530 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-runtime-api-info-6.0.1.jar 2023-10-05T11:43:22.530 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-kotlin-dsl-6.0.1.jar 2023-10-05T11:43:22.530 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-tooling-api-6.0.1.jar 2023-10-05T11:43:22.530 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-wrapper-6.0.1.jar 2023-10-05T11:43:22.530 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-installation-beacon-6.0.1.jar 2023-10-05T11:43:22.530 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-bootstrap-6.0.1.jar 2023-10-05T11:43:22.530 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-core-6.0.1.jar 2023-10-05T11:43:22.530 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-file-collections-6.0.1.jar 2023-10-05T11:43:22.531 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-model-groovy-6.0.1.jar 2023-10-05T11:43:22.531 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-execution-6.0.1.jar 2023-10-05T11:43:22.531 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-model-core-6.0.1.jar 2023-10-05T11:43:22.531 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-cache-packaging-6.0.1.jar 2023-10-05T11:43:22.531 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-cache-6.0.1.jar 2023-10-05T11:43:22.531 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-core-api-6.0.1.jar 2023-10-05T11:43:22.531 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-persistent-cache-6.0.1.jar 2023-10-05T11:43:22.531 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-worker-processes-6.0.1.jar 2023-10-05T11:43:22.531 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-logging-6.0.1.jar 2023-10-05T11:43:22.531 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-jvm-services-6.0.1.jar 2023-10-05T11:43:22.531 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-process-services-6.0.1.jar 2023-10-05T11:43:22.531 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-resources-6.0.1.jar 2023-10-05T11:43:22.532 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-messaging-6.0.1.jar 2023-10-05T11:43:22.532 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-native-6.0.1.jar 2023-10-05T11:43:22.532 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-base-services-groovy-6.0.1.jar 2023-10-05T11:43:22.532 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-base-services-6.0.1.jar 2023-10-05T11:43:22.532 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-option-6.0.1.jar 2023-10-05T11:43:22.532 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-cli-6.0.1.jar 2023-10-05T11:43:22.532 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-snapshots-6.0.1.jar 2023-10-05T11:43:22.532 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-files-6.0.1.jar 2023-10-05T11:43:22.532 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-kotlin-dsl-tooling-models-6.0.1.jar 2023-10-05T11:43:22.610 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-compiler-embeddable-1.3.50-patched-for-gradle-6.0.1.jar 2023-10-05T11:43:22.610 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-hashing-6.0.1.jar 2023-10-05T11:43:22.611 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-pineapple-6.0.1.jar 2023-10-05T11:43:22.611 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-docs-6.0.1.jar 2023-10-05T11:43:22.665 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/groovy-all-1.3-2.5.8.jar 2023-10-05T11:43:22.665 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jul-to-slf4j-1.7.28.jar 2023-10-05T11:43:22.665 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/log4j-over-slf4j-1.7.28.jar 2023-10-05T11:43:22.665 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jcl-over-slf4j-1.7.28.jar 2023-10-05T11:43:22.665 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/slf4j-api-1.7.28.jar 2023-10-05T11:43:22.682 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/guava-27.1-android.jar 2023-10-05T11:43:22.683 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-io-2.6.jar 2023-10-05T11:43:22.685 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-lang-2.6.jar 2023-10-05T11:43:22.686 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-commons-7.1.jar 2023-10-05T11:43:22.686 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-analysis-7.1.jar 2023-10-05T11:43:22.687 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-tree-7.1.jar 2023-10-05T11:43:22.687 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-7.1.jar 2023-10-05T11:43:22.702 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/ant-1.10.7.jar 2023-10-05T11:43:22.703 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-jdk8-1.3.50.jar 2023-10-05T11:43:22.703 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/javax.inject-1.jar 2023-10-05T11:43:22.703 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-common-1.3.50.jar 2023-10-05T11:43:22.704 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-jvm-1.3.50.jar 2023-10-05T11:43:22.705 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-jvm-host-embeddable-1.3.50.jar 2023-10-05T11:43:22.707 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-compiler-embeddable-1.3.50.jar 2023-10-05T11:43:22.709 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-compiler-impl-embeddable-1.3.50.jar 2023-10-05T11:43:22.710 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-sam-with-receiver-compiler-plugin-1.3.50.jar 2023-10-05T11:43:22.725 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlinx-metadata-jvm-0.1.0.jar 2023-10-05T11:43:22.729 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-compress-1.19.jar 2023-10-05T11:43:22.732 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/fastutil-8.3.0-min.jar 2023-10-05T11:43:22.734 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jansi-1.18.jar 2023-10-05T11:43:22.734 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jsr305-3.0.2.jar 2023-10-05T11:43:22.736 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kryo-2.24.0.jar 2023-10-05T11:43:22.737 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-0.18.jar 2023-10-05T11:43:22.738 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/objenesis-2.6.jar 2023-10-05T11:43:22.741 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/trove4j-1.0.20181211.jar 2023-10-05T11:43:22.743 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/xml-apis-1.4.01.jar 2023-10-05T11:43:22.761 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-reflect-1.3.50.jar 2023-10-05T11:43:22.762 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-jdk7-1.3.50.jar 2023-10-05T11:43:22.771 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-1.3.50.jar 2023-10-05T11:43:22.771 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/annotations-13.0.jar 2023-10-05T11:43:22.771 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/ant-launcher-1.10.7.jar 2023-10-05T11:43:22.771 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/minlog-1.2.jar 2023-10-05T11:43:22.771 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-script-runtime-1.3.50.jar 2023-10-05T11:43:22.779 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-daemon-embeddable-1.3.50.jar 2023-10-05T11:43:22.779 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/failureaccess-1.0.1.jar 2023-10-05T11:43:22.781 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-common-1.3.50.jar 2023-10-05T11:43:22.782 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-amd64-libcpp-0.18.jar 2023-10-05T11:43:22.782 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-amd64-libstdcpp-0.18.jar 2023-10-05T11:43:22.782 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-i386-libcpp-0.18.jar 2023-10-05T11:43:22.782 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-i386-libstdcpp-0.18.jar 2023-10-05T11:43:22.782 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-aarch64-0.18.jar 2023-10-05T11:43:22.782 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-0.18.jar 2023-10-05T11:43:22.782 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-0.18.jar 2023-10-05T11:43:22.782 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-osx-amd64-0.18.jar 2023-10-05T11:43:22.782 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-amd64-0.18.jar 2023-10-05T11:43:22.784 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-amd64-min-0.18.jar 2023-10-05T11:43:22.784 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-i386-0.18.jar 2023-10-05T11:43:22.784 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-i386-min-0.18.jar 2023-10-05T11:43:22.785 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-aarch64-ncurses5-0.18.jar 2023-10-05T11:43:22.785 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-ncurses5-0.18.jar 2023-10-05T11:43:22.785 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-ncurses6-0.18.jar 2023-10-05T11:43:22.785 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-ncurses5-0.18.jar 2023-10-05T11:43:22.785 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-ncurses6-0.18.jar 2023-10-05T11:43:22.785 INFO:teuthology.orchestra.run.smithi012.stdout: creating: /opt/gradle/gradle-6.0.1/lib/plugins/ 2023-10-05T11:43:22.785 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-antlr-6.0.1.jar 2023-10-05T11:43:22.786 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-code-quality-6.0.1.jar 2023-10-05T11:43:22.786 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-signing-6.0.1.jar 2023-10-05T11:43:22.786 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-tooling-native-6.0.1.jar 2023-10-05T11:43:22.787 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-native-6.0.1.jar 2023-10-05T11:43:22.788 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-native-6.0.1.jar 2023-10-05T11:43:22.790 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-native-6.0.1.jar 2023-10-05T11:43:22.792 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-kotlin-dsl-provider-plugins-6.0.1.jar 2023-10-05T11:43:22.792 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugin-development-6.0.1.jar 2023-10-05T11:43:22.794 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-maven-6.0.1.jar 2023-10-05T11:43:22.794 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-play-6.0.1.jar 2023-10-05T11:43:22.797 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-6.0.1.jar 2023-10-05T11:43:22.797 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-scala-6.0.1.jar 2023-10-05T11:43:22.797 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ear-6.0.1.jar 2023-10-05T11:43:22.799 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-play-6.0.1.jar 2023-10-05T11:43:22.800 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-javascript-6.0.1.jar 2023-10-05T11:43:22.800 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ivy-6.0.1.jar 2023-10-05T11:43:22.801 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-jacoco-6.0.1.jar 2023-10-05T11:43:22.803 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-init-6.0.1.jar 2023-10-05T11:43:22.803 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-kotlin-dsl-tooling-builders-6.0.1.jar 2023-10-05T11:43:22.805 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugins-6.0.1.jar 2023-10-05T11:43:22.806 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-test-kit-6.0.1.jar 2023-10-05T11:43:22.806 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-groovy-6.0.1.jar 2023-10-05T11:43:22.807 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-scala-6.0.1.jar 2023-10-05T11:43:22.807 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-junit-platform-6.0.1.jar 2023-10-05T11:43:22.808 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-tooling-api-builders-6.0.1.jar 2023-10-05T11:43:22.808 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-jvm-6.0.1.jar 2023-10-05T11:43:22.811 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-java-6.0.1.jar 2023-10-05T11:43:22.811 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-jvm-6.0.1.jar 2023-10-05T11:43:22.812 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-jvm-6.0.1.jar 2023-10-05T11:43:22.815 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-native-6.0.1.jar 2023-10-05T11:43:22.817 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-diagnostics-6.0.1.jar 2023-10-05T11:43:22.818 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-publish-6.0.1.jar 2023-10-05T11:43:22.819 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-base-6.0.1.jar 2023-10-05T11:43:22.820 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-base-6.0.1.jar 2023-10-05T11:43:22.821 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugin-use-6.0.1.jar 2023-10-05T11:43:22.827 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-instant-execution-6.0.1.jar 2023-10-05T11:43:22.827 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-version-control-6.0.1.jar 2023-10-05T11:43:22.842 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-dependency-management-6.0.1.jar 2023-10-05T11:43:22.842 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-composite-builds-6.0.1.jar 2023-10-05T11:43:22.843 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-reporting-6.0.1.jar 2023-10-05T11:43:22.843 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-s3-6.0.1.jar 2023-10-05T11:43:22.843 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-gcs-6.0.1.jar 2023-10-05T11:43:22.843 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-cache-http-6.0.1.jar 2023-10-05T11:43:22.844 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-http-6.0.1.jar 2023-10-05T11:43:22.844 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-sftp-6.0.1.jar 2023-10-05T11:43:22.845 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-profile-6.0.1.jar 2023-10-05T11:43:22.845 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-workers-6.0.1.jar 2023-10-05T11:43:22.863 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/org.eclipse.jgit-5.5.0.201909110433-r.jar 2023-10-05T11:43:22.864 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-http-3.0.0.jar 2023-10-05T11:43:22.864 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-http-shared-3.0.0.jar 2023-10-05T11:43:22.864 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-api-services-storage-v1-rev136-1.25.0.jar 2023-10-05T11:43:22.866 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-api-client-1.25.0.jar 2023-10-05T11:43:22.866 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/asm-util-7.1.jar 2023-10-05T11:43:22.875 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/ivy-2.3.0.jar 2023-10-05T11:43:22.876 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-compat-3.0.4.jar 2023-10-05T11:43:22.880 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-core-3.0.4.jar 2023-10-05T11:43:22.880 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/pmaven-common-0.8-20100325.jar 2023-10-05T11:43:22.881 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/pmaven-groovy-0.8-20100325.jar 2023-10-05T11:43:22.881 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-file-3.0.0.jar 2023-10-05T11:43:22.883 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-container-default-1.7.1.jar 2023-10-05T11:43:22.883 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-connector-wagon-1.13.1.jar 2023-10-05T11:43:22.885 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcpg-jdk15on-1.63.jar 2023-10-05T11:43:22.893 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/rhino-1.7.10.jar 2023-10-05T11:43:22.895 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gson-2.8.5.jar 2023-10-05T11:43:22.896 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/simple-4.1.21.jar 2023-10-05T11:43:22.896 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jatl-0.2.3.jar 2023-10-05T11:43:22.897 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-plugin-api-3.0.4.jar 2023-10-05T11:43:22.898 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-oauth-client-1.25.0.jar 2023-10-05T11:43:22.898 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-http-client-jackson2-1.25.0.jar 2023-10-05T11:43:22.900 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-http-client-1.25.0.jar 2023-10-05T11:43:22.904 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/testng-6.3.1.jar 2023-10-05T11:43:22.906 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/snakeyaml-1.17.jar 2023-10-05T11:43:22.907 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/dd-plist-1.21.jar 2023-10-05T11:43:22.908 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-4.12.jar 2023-10-05T11:43:22.911 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bsh-2.0b6.jar 2023-10-05T11:43:22.912 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-launcher-1.3.1.jar 2023-10-05T11:43:22.918 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-s3-1.11.633.jar 2023-10-05T11:43:22.922 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-kms-1.11.633.jar 2023-10-05T11:43:22.928 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-core-1.11.633.jar 2023-10-05T11:43:22.933 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/httpclient-4.5.10.jar 2023-10-05T11:43:22.936 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jcifs-1.3.17.jar 2023-10-05T11:43:22.937 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/nekohtml-1.9.22.jar 2023-10-05T11:43:22.946 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/xercesImpl-2.12.0.jar 2023-10-05T11:43:22.948 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jsch-0.1.55.jar 2023-10-05T11:43:22.955 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jaxb-impl-2.3.2.jar 2023-10-05T11:43:22.955 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jmespath-java-1.11.633.jar 2023-10-05T11:43:22.965 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-databind-2.9.10.jar 2023-10-05T11:43:22.966 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-core-2.9.10.jar 2023-10-05T11:43:22.967 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-annotations-2.9.10.jar 2023-10-05T11:43:22.971 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/joda-time-2.10.4.jar 2023-10-05T11:43:22.977 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcpkix-jdk15on-1.61.jar 2023-10-05T11:43:23.007 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcprov-jdk15on-1.63.jar 2023-10-05T11:43:23.009 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/commons-codec-1.13.jar 2023-10-05T11:43:23.009 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-aether-provider-3.0.4.jar 2023-10-05T11:43:23.010 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-impl-1.13.1.jar 2023-10-05T11:43:23.011 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-util-1.13.1.jar 2023-10-05T11:43:23.011 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-spi-1.13.1.jar 2023-10-05T11:43:23.012 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-api-1.13.1.jar 2023-10-05T11:43:23.012 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/hamcrest-core-1.3.jar 2023-10-05T11:43:23.015 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/httpcore-4.4.12.jar 2023-10-05T11:43:23.015 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jcommander-1.72.jar 2023-10-05T11:43:23.016 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jzlib-1.1.3.jar 2023-10-05T11:43:23.016 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-artifact-3.0.4.jar 2023-10-05T11:43:23.017 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-model-builder-3.0.4.jar 2023-10-05T11:43:23.021 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-model-3.0.4.jar 2023-10-05T11:43:23.021 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-repository-metadata-3.0.4.jar 2023-10-05T11:43:23.021 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-settings-builder-3.0.4.jar 2023-10-05T11:43:23.021 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-settings-3.0.4.jar 2023-10-05T11:43:23.021 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-sec-dispatcher-1.3.jar 2023-10-05T11:43:23.021 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-cipher-1.7.jar 2023-10-05T11:43:23.022 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-classworlds-2.5.1.jar 2023-10-05T11:43:23.022 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-component-annotations-1.5.5.jar 2023-10-05T11:43:23.022 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-interpolation-1.14.jar 2023-10-05T11:43:23.022 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-provider-api-3.0.0.jar 2023-10-05T11:43:23.022 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-utils-3.1.0.jar 2023-10-05T11:43:23.024 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/xbean-reflect-3.7.jar 2023-10-05T11:43:23.027 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/ion-java-1.0.2.jar 2023-10-05T11:43:23.028 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-engine-1.3.1.jar 2023-10-05T11:43:23.030 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-commons-1.3.1.jar 2023-10-05T11:43:23.030 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/apiguardian-api-1.0.0.jar 2023-10-05T11:43:23.030 INFO:teuthology.orchestra.run.smithi012.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/opentest4j-1.1.1.jar 2023-10-05T11:43:23.075 INFO:teuthology.orchestra.run.smithi012.stdout:export PATH=/opt/gradle/gradle-6.0.1/bin:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin 2023-10-05T11:43:23.406 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:43:23.406 INFO:teuthology.orchestra.run.smithi012.stdout:Welcome to Gradle 6.0.1! 2023-10-05T11:43:23.406 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:43:23.406 INFO:teuthology.orchestra.run.smithi012.stdout:Here are the highlights of this release: 2023-10-05T11:43:23.406 INFO:teuthology.orchestra.run.smithi012.stdout: - Substantial improvements in dependency management, including 2023-10-05T11:43:23.407 INFO:teuthology.orchestra.run.smithi012.stdout: - Publishing Gradle Module Metadata in addition to pom.xml 2023-10-05T11:43:23.407 INFO:teuthology.orchestra.run.smithi012.stdout: - Advanced control of transitive versions 2023-10-05T11:43:23.407 INFO:teuthology.orchestra.run.smithi012.stdout: - Support for optional features and dependencies 2023-10-05T11:43:23.407 INFO:teuthology.orchestra.run.smithi012.stdout: - Rules to tweak published metadata 2023-10-05T11:43:23.407 INFO:teuthology.orchestra.run.smithi012.stdout: - Support for Java 13 2023-10-05T11:43:23.407 INFO:teuthology.orchestra.run.smithi012.stdout: - Faster incremental Java and Groovy compilation 2023-10-05T11:43:23.407 INFO:teuthology.orchestra.run.smithi012.stdout: - New Zinc compiler for Scala 2023-10-05T11:43:23.407 INFO:teuthology.orchestra.run.smithi012.stdout: - VS2019 support 2023-10-05T11:43:23.408 INFO:teuthology.orchestra.run.smithi012.stdout: - Support for Gradle Enterprise plugin 3.0 2023-10-05T11:43:23.408 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:43:23.408 INFO:teuthology.orchestra.run.smithi012.stdout:For more details see https://docs.gradle.org/6.0.1/release-notes.html 2023-10-05T11:43:23.408 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:43:23.408 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:43:23.408 INFO:teuthology.orchestra.run.smithi012.stdout:------------------------------------------------------------ 2023-10-05T11:43:23.408 INFO:teuthology.orchestra.run.smithi012.stdout:Gradle 6.0.1 2023-10-05T11:43:23.408 INFO:teuthology.orchestra.run.smithi012.stdout:------------------------------------------------------------ 2023-10-05T11:43:23.408 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:43:23.408 INFO:teuthology.orchestra.run.smithi012.stdout:Build time: 2019-11-18 20:25:01 UTC 2023-10-05T11:43:23.408 INFO:teuthology.orchestra.run.smithi012.stdout:Revision: fad121066a68c4701acd362daf4287a7c309a0f5 2023-10-05T11:43:23.409 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:43:23.409 INFO:teuthology.orchestra.run.smithi012.stdout:Kotlin: 1.3.50 2023-10-05T11:43:23.409 INFO:teuthology.orchestra.run.smithi012.stdout:Groovy: 2.5.8 2023-10-05T11:43:23.409 INFO:teuthology.orchestra.run.smithi012.stdout:Ant: Apache Ant(TM) version 1.10.7 compiled on September 1 2019 2023-10-05T11:43:23.409 INFO:teuthology.orchestra.run.smithi012.stdout:JVM: 1.8.0_362 (Red Hat, Inc. 25.362-b08) 2023-10-05T11:43:23.409 INFO:teuthology.orchestra.run.smithi012.stdout:OS: Linux 5.14.0-372.el9.x86_64 amd64 2023-10-05T11:43:23.409 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:43:23.410 DEBUG:tasks.s3tests_java:S3 Tests Java: BEGIN 2023-10-05T11:43:23.410 DEBUG:tasks.s3tests_java:S3 Tests Java: Cluster config is: ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2023-10-05T11:43:23.410 DEBUG:tasks.s3tests_java:S3 Tests Java: Host is: ubuntu@smithi012.front.sepia.ceph.com 2023-10-05T11:43:23.410 DEBUG:tasks.s3tests_java:S3 Tests Java: Cluster config is: ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2023-10-05T11:43:23.410 DEBUG:tasks.s3tests_java:S3 Tests Java: Host is: ubuntu@smithi170.front.sepia.ceph.com 2023-10-05T11:43:23.411 INFO:tasks.s3tests_java:S3 Tests Java: Creating S3 users... 2023-10-05T11:43:23.707 DEBUG:tasks.s3tests_java:S3 Tests Java: s3tests_conf is {'bucket_prefix': 'test-', 's3main': {'access_key': None, 'access_secret': None, 'region': 'mexico', 'endpoint': None, 'port': None, 'display_name': None, 'email': None, 'is_secure': None, 'SSE': 'AES256', 's3dir': 'folder', 'dir': '../data'}} 2023-10-05T11:43:23.707 DEBUG:tasks.s3tests_java:S3 Tests Java: Creating user tester.client.0 2023-10-05T11:43:23.708 DEBUG:tasks.s3tests_java:S3 Tests Java: s3tests_conf[s3main] is {'access_key': 'ORHLXXSGJQRJHTMBEWIN', 'access_secret': '/25FSuYp8WVjXmO38an3vwxz0XrCFfy88T8cdNWNm84Xn9JLg5KgUw==', 'region': 'mexico', 'endpoint': 'smithi012.front.sepia.ceph.com:80', 'port': 80, 'display_name': 'Ms. tester.client.0', 'email': 'tester.client.0_test@test.test', 'is_secure': False, 'SSE': 'AES256', 's3dir': 'folder', 'dir': '../data', 'user_id': 'tester.client.0', 'host': 'smithi012.front.sepia.ceph.com'} 2023-10-05T11:43:23.708 DEBUG:tasks.s3tests_java:S3 Tests Java: Setion, User = s3main, tester.client.0 2023-10-05T11:43:23.708 INFO:tasks.s3tests_java:['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '-n', 'client.0', 'user', 'create', '--uid', 'tester.client.0', '--display-name', 'Ms. tester.client.0', '--access-key', 'ORHLXXSGJQRJHTMBEWIN', '--secret', '/25FSuYp8WVjXmO38an3vwxz0XrCFfy88T8cdNWNm84Xn9JLg5KgUw==', '--email', 'tester.client.0_test@test.test', '--cluster', 'ceph'] 2023-10-05T11:43:23.708 DEBUG:teuthology.orchestra.run.smithi012:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid tester.client.0 --display-name 'Ms. tester.client.0' --access-key ORHLXXSGJQRJHTMBEWIN --secret /25FSuYp8WVjXmO38an3vwxz0XrCFfy88T8cdNWNm84Xn9JLg5KgUw== --email tester.client.0_test@test.test --cluster ceph 2023-10-05T11:43:23.771 INFO:teuthology.orchestra.run.smithi012.stderr:ignoring --setuser ceph since I am not root 2023-10-05T11:43:23.771 INFO:teuthology.orchestra.run.smithi012.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T11:43:23.782 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:23.779+0000 7f01d9822880 20 rados->read ofs=0 len=0 2023-10-05T11:43:23.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:23.780+0000 7f01d9822880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:43:23.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:23.780+0000 7f01d9822880 20 realm 2023-10-05T11:43:23.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:23.780+0000 7f01d9822880 20 rados->read ofs=0 len=0 2023-10-05T11:43:23.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:23.781+0000 7f01d9822880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:43:23.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:23.781+0000 7f01d9822880 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T11:43:23.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:23.781+0000 7f01d9822880 20 rados->read ofs=0 len=0 2023-10-05T11:43:23.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:23.781+0000 7f01d9822880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:43:23.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:23.781+0000 7f01d9822880 20 rados->read ofs=0 len=0 2023-10-05T11:43:23.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:23.782+0000 7f01d9822880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:43:23.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:23.782+0000 7f01d9822880 20 rados->read ofs=0 len=0 2023-10-05T11:43:23.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:23.783+0000 7f01d9822880 20 rados_obj.operate() r=0 bl.length=1020 2023-10-05T11:43:23.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:23.783+0000 7f01d9822880 20 searching for the correct realm 2023-10-05T11:43:23.796 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:23.793+0000 7f01d65a4640 0 -- 172.21.15.12:0/2051182493 >> [v2:172.21.15.12:6824/2171933159,v1:172.21.15.12:6825/2171933159] conn(0x564f1205c800 msgr2=0x564f11ee3700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:43:23.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:23.794+0000 7f01d9822880 20 RGWRados::pool_iterate: got zone_info.dff27d1e-df33-400e-a68a-7ba586947c99 2023-10-05T11:43:23.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:23.794+0000 7f01d9822880 20 RGWRados::pool_iterate: got zonegroup_info.c78aa576-9d15-4e9d-b3c0-4af23a22062c 2023-10-05T11:43:23.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:23.794+0000 7f01d9822880 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T11:43:23.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:23.794+0000 7f01d9822880 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T11:43:23.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:23.794+0000 7f01d9822880 20 rados->read ofs=0 len=0 2023-10-05T11:43:23.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:23.794+0000 7f01d9822880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:43:23.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:23.794+0000 7f01d9822880 20 rados->read ofs=0 len=0 2023-10-05T11:43:23.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:23.794+0000 7f01d9822880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:43:23.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:23.794+0000 7f01d9822880 20 rados->read ofs=0 len=0 2023-10-05T11:43:23.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:23.795+0000 7f01d9822880 20 rados_obj.operate() r=0 bl.length=454 2023-10-05T11:43:23.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:23.795+0000 7f01d9822880 20 zone default found 2023-10-05T11:43:23.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:23.795+0000 7f01d9822880 4 Realm: () 2023-10-05T11:43:23.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:23.795+0000 7f01d9822880 4 ZoneGroup: default (c78aa576-9d15-4e9d-b3c0-4af23a22062c) 2023-10-05T11:43:23.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:23.795+0000 7f01d9822880 4 Zone: default (dff27d1e-df33-400e-a68a-7ba586947c99) 2023-10-05T11:43:23.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:23.795+0000 7f01d9822880 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T11:43:23.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:23.795+0000 7f01d9822880 20 zonegroup default 2023-10-05T11:43:23.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:23.795+0000 7f01d9822880 20 rados->read ofs=0 len=0 2023-10-05T11:43:23.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:23.795+0000 7f01d9822880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:43:23.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:23.795+0000 7f01d9822880 20 rados->read ofs=0 len=0 2023-10-05T11:43:23.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:23.795+0000 7f01d9822880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:43:23.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:23.795+0000 7f01d9822880 20 rados->read ofs=0 len=0 2023-10-05T11:43:23.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:23.795+0000 7f01d9822880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:43:23.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:23.795+0000 7f01d9822880 20 started sync module instance, tier type = 2023-10-05T11:43:23.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:23.795+0000 7f01d9822880 20 started zone id=dff27d1e-df33-400e-a68a-7ba586947c99 (name=default) with tier type = 2023-10-05T11:43:23.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:23.803+0000 7f01d65a4640 0 -- 172.21.15.12:0/2051182493 >> [v2:172.21.15.12:6824/2171933159,v1:172.21.15.12:6825/2171933159] conn(0x564f12084c00 msgr2=0x564f11f7c100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:43:23.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:23.805+0000 7f01d9822880 20 add_watcher() i=0 2023-10-05T11:43:23.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:23.805+0000 7f01d9822880 20 add_watcher() i=1 2023-10-05T11:43:23.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:23.805+0000 7f01d9822880 20 add_watcher() i=2 2023-10-05T11:43:23.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:23.805+0000 7f01d9822880 20 add_watcher() i=3 2023-10-05T11:43:23.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:23.805+0000 7f01d9822880 20 add_watcher() i=4 2023-10-05T11:43:23.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:23.805+0000 7f01d9822880 20 add_watcher() i=5 2023-10-05T11:43:23.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:23.805+0000 7f01d9822880 20 add_watcher() i=6 2023-10-05T11:43:23.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:23.806+0000 7f01d9822880 20 add_watcher() i=7 2023-10-05T11:43:23.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:23.806+0000 7f01d9822880 2 all 8 watchers are set, enabling cache 2023-10-05T11:43:23.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:23.808+0000 7f01bcd71640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:43:23.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:23.808+0000 7f01d9822880 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T11:43:23.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:23.808+0000 7f01d9822880 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T11:43:23.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:23.812+0000 7f01d9822880 5 note: GC not initialized 2023-10-05T11:43:23.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:23.813+0000 7f01b8568640 20 reqs_thread_entry: start 2023-10-05T11:43:23.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:23.813+0000 7f01d9822880 20 init_complete bucket index max shards: 11 2023-10-05T11:43:23.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:23.813+0000 7f01d9822880 20 Filter name: none 2023-10-05T11:43:23.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:23.813+0000 7f01b6564640 20 reqs_thread_entry: start 2023-10-05T11:43:23.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:23.813+0000 7f01d9822880 10 cache get: name=default.rgw.meta+users.uid+tester.client.0 : miss 2023-10-05T11:43:23.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:23.813+0000 7f01d9822880 20 rados->read ofs=0 len=0 2023-10-05T11:43:23.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:23.813+0000 7f01d9822880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:43:23.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:23.813+0000 7f01d9822880 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x0 2023-10-05T11:43:23.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:23.813+0000 7f01d9822880 10 adding default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2023-10-05T11:43:23.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:23.813+0000 7f01d9822880 10 cache get: name=default.rgw.meta+users.email+tester.client.0_test@test.test : miss 2023-10-05T11:43:23.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:23.813+0000 7f01d9822880 20 rados->read ofs=0 len=0 2023-10-05T11:43:23.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:23.814+0000 7f01d9822880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:43:23.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:23.814+0000 7f01d9822880 10 cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x0 2023-10-05T11:43:23.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:23.814+0000 7f01d9822880 10 adding default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2023-10-05T11:43:23.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:23.814+0000 7f01d9822880 10 cache get: name=default.rgw.meta+users.keys+ORHLXXSGJQRJHTMBEWIN : miss 2023-10-05T11:43:23.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:23.814+0000 7f01d9822880 20 rados->read ofs=0 len=0 2023-10-05T11:43:23.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:23.814+0000 7f01d9822880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:43:23.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:23.814+0000 7f01d9822880 10 cache put: name=default.rgw.meta+users.keys+ORHLXXSGJQRJHTMBEWIN info.flags=0x0 2023-10-05T11:43:23.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:23.814+0000 7f01d9822880 10 adding default.rgw.meta+users.keys+ORHLXXSGJQRJHTMBEWIN to cache LRU end 2023-10-05T11:43:23.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:23.814+0000 7f01d9822880 10 cache get: name=default.rgw.meta+users.keys+ORHLXXSGJQRJHTMBEWIN : hit (negative entry) 2023-10-05T11:43:23.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:23.814+0000 7f01d9822880 10 cache get: name=default.rgw.meta+users.keys+ORHLXXSGJQRJHTMBEWIN : hit (negative entry) 2023-10-05T11:43:23.820 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:23.815+0000 7f01d9822880 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x17 2023-10-05T11:43:23.820 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:23.815+0000 7f01d9822880 10 moving default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2023-10-05T11:43:23.820 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:23.815+0000 7f01d9822880 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.uid:tester.client.0, ofs0, ns] 2023-10-05T11:43:23.821 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:23.816+0000 7f01d0598640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1060856922182 cookie 94897604942848 notifier 7391 bl.length()=636 2023-10-05T11:43:23.821 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:23.816+0000 7f01d0598640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x17 2023-10-05T11:43:23.821 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:23.816+0000 7f01d0598640 10 rgw watcher librados: moving default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2023-10-05T11:43:23.822 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:23.818+0000 7f01d9822880 10 cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x7 2023-10-05T11:43:23.822 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:23.818+0000 7f01d9822880 10 moving default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2023-10-05T11:43:23.822 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:23.818+0000 7f01d9822880 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:tester.client.0_test@test.test, ofs0, ns] 2023-10-05T11:43:23.822 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:23.819+0000 7f01d0598640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1060856922186 cookie 94897604777984 notifier 7391 bl.length()=200 2023-10-05T11:43:23.822 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:23.819+0000 7f01d0598640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x7 2023-10-05T11:43:23.822 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:23.819+0000 7f01d0598640 10 rgw watcher librados: moving default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2023-10-05T11:43:23.824 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:23.821+0000 7f01d9822880 10 cache put: name=default.rgw.meta+users.keys+ORHLXXSGJQRJHTMBEWIN info.flags=0x7 2023-10-05T11:43:23.824 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:23.821+0000 7f01d9822880 10 moving default.rgw.meta+users.keys+ORHLXXSGJQRJHTMBEWIN to cache LRU end 2023-10-05T11:43:23.825 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:23.821+0000 7f01d9822880 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.keys:ORHLXXSGJQRJHTMBEWIN, ofs0, ns] 2023-10-05T11:43:23.825 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:23.822+0000 7f01d0598640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1060856922123 cookie 94897605009408 notifier 7391 bl.length()=189 2023-10-05T11:43:23.825 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:23.822+0000 7f01d0598640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+ORHLXXSGJQRJHTMBEWIN info.flags=0x7 2023-10-05T11:43:23.825 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:23.822+0000 7f01d0598640 10 rgw watcher librados: moving default.rgw.meta+users.keys+ORHLXXSGJQRJHTMBEWIN to cache LRU end 2023-10-05T11:43:23.826 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-10-05T11:43:23.826 INFO:teuthology.orchestra.run.smithi012.stdout: "user_id": "tester.client.0", 2023-10-05T11:43:23.826 INFO:teuthology.orchestra.run.smithi012.stdout: "display_name": "Ms. tester.client.0", 2023-10-05T11:43:23.826 INFO:teuthology.orchestra.run.smithi012.stdout: "email": "tester.client.0_test@test.test", 2023-10-05T11:43:23.826 INFO:teuthology.orchestra.run.smithi012.stdout: "suspended": 0, 2023-10-05T11:43:23.826 INFO:teuthology.orchestra.run.smithi012.stdout: "max_buckets": 1000, 2023-10-05T11:43:23.827 INFO:teuthology.orchestra.run.smithi012.stdout: "subusers": [], 2023-10-05T11:43:23.827 INFO:teuthology.orchestra.run.smithi012.stdout: "keys": [ 2023-10-05T11:43:23.827 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-05T11:43:23.828 INFO:teuthology.orchestra.run.smithi012.stdout: "user": "tester.client.0", 2023-10-05T11:43:23.828 INFO:teuthology.orchestra.run.smithi012.stdout: "access_key": "ORHLXXSGJQRJHTMBEWIN", 2023-10-05T11:43:23.828 INFO:teuthology.orchestra.run.smithi012.stdout: "secret_key": "/25FSuYp8WVjXmO38an3vwxz0XrCFfy88T8cdNWNm84Xn9JLg5KgUw==" 2023-10-05T11:43:23.828 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-05T11:43:23.828 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-10-05T11:43:23.828 INFO:teuthology.orchestra.run.smithi012.stdout: "swift_keys": [], 2023-10-05T11:43:23.828 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": [], 2023-10-05T11:43:23.828 INFO:teuthology.orchestra.run.smithi012.stdout: "op_mask": "read, write, delete", 2023-10-05T11:43:23.828 INFO:teuthology.orchestra.run.smithi012.stdout: "default_placement": "", 2023-10-05T11:43:23.828 INFO:teuthology.orchestra.run.smithi012.stdout: "default_storage_class": "", 2023-10-05T11:43:23.828 INFO:teuthology.orchestra.run.smithi012.stdout: "placement_tags": [], 2023-10-05T11:43:23.829 INFO:teuthology.orchestra.run.smithi012.stdout: "bucket_quota": { 2023-10-05T11:43:23.829 INFO:teuthology.orchestra.run.smithi012.stdout: "enabled": false, 2023-10-05T11:43:23.829 INFO:teuthology.orchestra.run.smithi012.stdout: "check_on_raw": false, 2023-10-05T11:43:23.829 INFO:teuthology.orchestra.run.smithi012.stdout: "max_size": -1, 2023-10-05T11:43:23.829 INFO:teuthology.orchestra.run.smithi012.stdout: "max_size_kb": 0, 2023-10-05T11:43:23.829 INFO:teuthology.orchestra.run.smithi012.stdout: "max_objects": -1 2023-10-05T11:43:23.829 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-05T11:43:23.829 INFO:teuthology.orchestra.run.smithi012.stdout: "user_quota": { 2023-10-05T11:43:23.829 INFO:teuthology.orchestra.run.smithi012.stdout: "enabled": false, 2023-10-05T11:43:23.829 INFO:teuthology.orchestra.run.smithi012.stdout: "check_on_raw": false, 2023-10-05T11:43:23.829 INFO:teuthology.orchestra.run.smithi012.stdout: "max_size": -1, 2023-10-05T11:43:23.829 INFO:teuthology.orchestra.run.smithi012.stdout: "max_size_kb": 0, 2023-10-05T11:43:23.829 INFO:teuthology.orchestra.run.smithi012.stdout: "max_objects": -1 2023-10-05T11:43:23.830 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-05T11:43:23.830 INFO:teuthology.orchestra.run.smithi012.stdout: "temp_url_keys": [], 2023-10-05T11:43:23.830 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "rgw", 2023-10-05T11:43:23.830 INFO:teuthology.orchestra.run.smithi012.stdout: "mfa_ids": [] 2023-10-05T11:43:23.830 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-10-05T11:43:23.830 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:43:23.831 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:23.823+0000 7f01bcd71640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:43:23.831 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:23.826+0000 7f01d9822880 20 remove_watcher() i=0 2023-10-05T11:43:23.831 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:23.826+0000 7f01d9822880 2 removed watcher, disabling cache 2023-10-05T11:43:23.831 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:23.827+0000 7f01d9822880 20 remove_watcher() i=1 2023-10-05T11:43:23.833 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:23.828+0000 7f01d9822880 20 remove_watcher() i=2 2023-10-05T11:43:23.833 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:23.829+0000 7f01d9822880 20 remove_watcher() i=3 2023-10-05T11:43:23.834 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:23.831+0000 7f01d9822880 20 remove_watcher() i=4 2023-10-05T11:43:23.835 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:23.832+0000 7f01d9822880 20 remove_watcher() i=5 2023-10-05T11:43:23.836 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:23.833+0000 7f01d9822880 20 remove_watcher() i=6 2023-10-05T11:43:23.837 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:23.833+0000 7f01d9822880 20 remove_watcher() i=7 2023-10-05T11:43:23.843 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-10-05T11:43:23.843 DEBUG:teuthology.orchestra.run.smithi012:> dd of=/home/ubuntu/cephtest/archive/s3-tests-java.client.0.conf 2023-10-05T11:43:23.873 INFO:tasks.s3tests_java:S3 Tests Java: Running tests... 2023-10-05T11:43:23.873 DEBUG:teuthology.orchestra.run.smithi012:> cp /home/ubuntu/cephtest/archive/s3-tests-java.client.0.conf /home/ubuntu/cephtest/s3-tests-java/config.properties 2023-10-05T11:43:23.939 DEBUG:teuthology.orchestra.run.smithi012:> radosgw-admin gc process --include-all 2023-10-05T11:43:24.031 INFO:teuthology.orchestra.run.smithi012.stderr:ignoring --setuser ceph since I am not root 2023-10-05T11:43:24.031 INFO:teuthology.orchestra.run.smithi012.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T11:43:24.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.039+0000 7fdf7352d880 20 rados->read ofs=0 len=0 2023-10-05T11:43:24.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.041+0000 7fdf7352d880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:43:24.045 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.041+0000 7fdf7352d880 20 realm 2023-10-05T11:43:24.045 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.041+0000 7fdf7352d880 20 rados->read ofs=0 len=0 2023-10-05T11:43:24.045 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.041+0000 7fdf7352d880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:43:24.045 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.041+0000 7fdf7352d880 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T11:43:24.045 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.041+0000 7fdf7352d880 20 rados->read ofs=0 len=0 2023-10-05T11:43:24.045 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.041+0000 7fdf7352d880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:43:24.045 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.041+0000 7fdf7352d880 20 rados->read ofs=0 len=0 2023-10-05T11:43:24.046 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.042+0000 7fdf7352d880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:43:24.046 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.042+0000 7fdf7352d880 20 rados->read ofs=0 len=0 2023-10-05T11:43:24.047 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.044+0000 7fdf7352d880 20 rados_obj.operate() r=0 bl.length=1020 2023-10-05T11:43:24.047 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.044+0000 7fdf7352d880 20 searching for the correct realm 2023-10-05T11:43:24.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.053+0000 7fdf7070e640 0 -- 172.21.15.12:0/1639988975 >> [v2:172.21.15.12:6824/2171933159,v1:172.21.15.12:6825/2171933159] conn(0x55d8eecd4400 msgr2=0x55d8eeb21700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:43:24.057 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.054+0000 7fdf7352d880 20 RGWRados::pool_iterate: got zone_info.dff27d1e-df33-400e-a68a-7ba586947c99 2023-10-05T11:43:24.057 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.054+0000 7fdf7352d880 20 RGWRados::pool_iterate: got zonegroup_info.c78aa576-9d15-4e9d-b3c0-4af23a22062c 2023-10-05T11:43:24.057 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.054+0000 7fdf7352d880 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T11:43:24.057 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.054+0000 7fdf7352d880 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T11:43:24.057 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.054+0000 7fdf7352d880 20 rados->read ofs=0 len=0 2023-10-05T11:43:24.058 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.054+0000 7fdf7352d880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:43:24.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.054+0000 7fdf7352d880 20 rados->read ofs=0 len=0 2023-10-05T11:43:24.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.055+0000 7fdf7352d880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:43:24.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.055+0000 7fdf7352d880 20 rados->read ofs=0 len=0 2023-10-05T11:43:24.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.055+0000 7fdf7352d880 20 rados_obj.operate() r=0 bl.length=454 2023-10-05T11:43:24.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.055+0000 7fdf7352d880 20 zone default found 2023-10-05T11:43:24.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.055+0000 7fdf7352d880 4 Realm: () 2023-10-05T11:43:24.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.055+0000 7fdf7352d880 4 ZoneGroup: default (c78aa576-9d15-4e9d-b3c0-4af23a22062c) 2023-10-05T11:43:24.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.055+0000 7fdf7352d880 4 Zone: default (dff27d1e-df33-400e-a68a-7ba586947c99) 2023-10-05T11:43:24.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.055+0000 7fdf7352d880 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T11:43:24.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.055+0000 7fdf7352d880 20 zonegroup default 2023-10-05T11:43:24.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.055+0000 7fdf7352d880 20 rados->read ofs=0 len=0 2023-10-05T11:43:24.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.055+0000 7fdf7352d880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:43:24.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.055+0000 7fdf7352d880 20 rados->read ofs=0 len=0 2023-10-05T11:43:24.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.055+0000 7fdf7352d880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:43:24.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.055+0000 7fdf7352d880 20 rados->read ofs=0 len=0 2023-10-05T11:43:24.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.056+0000 7fdf7352d880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:43:24.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.056+0000 7fdf7352d880 20 started sync module instance, tier type = 2023-10-05T11:43:24.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.056+0000 7fdf7352d880 20 started zone id=dff27d1e-df33-400e-a68a-7ba586947c99 (name=default) with tier type = 2023-10-05T11:43:24.067 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.064+0000 7fdf7070e640 0 -- 172.21.15.12:0/1639988975 >> [v2:172.21.15.12:6824/2171933159,v1:172.21.15.12:6825/2171933159] conn(0x55d8eeced000 msgr2=0x55d8eebe6100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:43:24.069 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.066+0000 7fdf7352d880 20 add_watcher() i=0 2023-10-05T11:43:24.069 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.066+0000 7fdf7352d880 20 add_watcher() i=1 2023-10-05T11:43:24.069 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.066+0000 7fdf7352d880 20 add_watcher() i=2 2023-10-05T11:43:24.069 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.066+0000 7fdf7352d880 20 add_watcher() i=3 2023-10-05T11:43:24.069 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.066+0000 7fdf7352d880 20 add_watcher() i=4 2023-10-05T11:43:24.069 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.066+0000 7fdf7352d880 20 add_watcher() i=5 2023-10-05T11:43:24.069 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.066+0000 7fdf7352d880 20 add_watcher() i=6 2023-10-05T11:43:24.070 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.066+0000 7fdf7352d880 20 add_watcher() i=7 2023-10-05T11:43:24.070 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.066+0000 7fdf7352d880 2 all 8 watchers are set, enabling cache 2023-10-05T11:43:24.071 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.068+0000 7fdf56edb640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:43:24.071 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.068+0000 7fdf7352d880 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T11:43:24.071 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.068+0000 7fdf7352d880 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T11:43:24.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.111+0000 7fdf526d2640 20 reqs_thread_entry: start 2023-10-05T11:43:24.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.111+0000 7fdf7352d880 20 init_complete bucket index max shards: 11 2023-10-05T11:43:24.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.111+0000 7fdf7352d880 20 Filter name: none 2023-10-05T11:43:24.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.111+0000 7fdf506ce640 20 reqs_thread_entry: start 2023-10-05T11:43:24.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.112+0000 7fdf7352d880 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2023-10-05T11:43:24.116 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.113+0000 7fdf7352d880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:43:24.117 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.114+0000 7fdf7352d880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:43:24.118 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.114+0000 7fdf7352d880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=13, truncated=0, next_marker='' 2023-10-05T11:43:24.118 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.114+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='_omDcfAmZ35MUqfvCZaF7uHioT5uqU7h', time=2023-10-05T13:38:52.908424+0000, chain.objs.size()=1 2023-10-05T11:43:24.118 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.114+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:dff27d1e-df33-400e-a68a-7ba586947c99.4604.15__shadow_.iZc5u3NKf4sSRVxP0DtdLz5jEIjKfCd_0 2023-10-05T11:43:24.119 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.114+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='_BXuNAKRqTCTFys94Onm8AcoRn9MEInJ', time=2023-10-05T13:38:52.949291+0000, chain.objs.size()=1 2023-10-05T11:43:24.119 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.114+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:dff27d1e-df33-400e-a68a-7ba586947c99.4604.15__shadow_.8xpthpdRKbjqvzR6lGIhdL6EoF818xP_0 2023-10-05T11:43:24.119 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.114+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.5153479672258178246', time=2023-10-05T13:38:52.977370+0000, chain.objs.size()=5 2023-10-05T11:43:24.119 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.114+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:dff27d1e-df33-400e-a68a-7ba586947c99.4604.13__multipart_foo-FROZEN.2~V6p4WepcN13yZmsFrTnpg2USDScYzGl.1 2023-10-05T11:43:24.119 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.114+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:dff27d1e-df33-400e-a68a-7ba586947c99.4604.13__shadow_foo-FROZEN.2~V6p4WepcN13yZmsFrTnpg2USDScYzGl.1_1 2023-10-05T11:43:24.119 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.114+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:dff27d1e-df33-400e-a68a-7ba586947c99.4604.13__multipart_foo-FROZEN.2~V6p4WepcN13yZmsFrTnpg2USDScYzGl.2 2023-10-05T11:43:24.119 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.114+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:dff27d1e-df33-400e-a68a-7ba586947c99.4604.13__shadow_foo-FROZEN.2~V6p4WepcN13yZmsFrTnpg2USDScYzGl.2_1 2023-10-05T11:43:24.119 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.114+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:dff27d1e-df33-400e-a68a-7ba586947c99.4604.13__multipart_foo-FROZEN.2~V6p4WepcN13yZmsFrTnpg2USDScYzGl.3 2023-10-05T11:43:24.119 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.114+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.11942677610827212047', time=2023-10-05T13:38:53.087444+0000, chain.objs.size()=1 2023-10-05T11:43:24.119 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.114+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.6__shadow_.1M_Xl721KoAkZttZTlfo17FEkkb82Zs_0 2023-10-05T11:43:24.119 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.114+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.18049727236000114204', time=2023-10-05T13:39:53.421343+0000, chain.objs.size()=1 2023-10-05T11:43:24.120 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.114+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.18__shadow_.FB_zBrjghE3f-5PtfSlC5npCOGOQehC_0 2023-10-05T11:43:24.120 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.115+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.2185885797508509739', time=2023-10-05T13:39:54.821211+0000, chain.objs.size()=1 2023-10-05T11:43:24.120 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.115+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.19__shadow_.9yjtt0P2r9J0B6FQTrEH3S8Y5o5Ifj1_0 2023-10-05T11:43:24.120 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.115+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.6032361902335985148', time=2023-10-05T13:39:55.966514+0000, chain.objs.size()=1 2023-10-05T11:43:24.120 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.115+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.20__shadow_.WR__9u_1-ENTkUB9QlAhKJ8Ej8mm-QU_0 2023-10-05T11:43:24.120 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.115+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.1774654018639388432', time=2023-10-05T13:40:26.533680+0000, chain.objs.size()=1 2023-10-05T11:43:24.120 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.115+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.20__shadow_.fkCmF8Msd9IlzzTeIlv-0nrpntxPEk__0 2023-10-05T11:43:24.121 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.116+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.6002881224422946847', time=2023-10-05T13:40:28.142221+0000, chain.objs.size()=1 2023-10-05T11:43:24.121 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.116+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.21__shadow_.i2tC_W1GJvCvQ5AoWdVF24vQ34RscIv_0 2023-10-05T11:43:24.121 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.117+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.5185949496854440720', time=2023-10-05T13:40:59.954525+0000, chain.objs.size()=1 2023-10-05T11:43:24.121 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.117+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.22__shadow_.pysmTU_x35WwvxkhNXAh7IdidnW7M-w_0 2023-10-05T11:43:24.121 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.118+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.502945233193537674', time=2023-10-05T13:40:59.961017+0000, chain.objs.size()=1 2023-10-05T11:43:24.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.118+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.22__shadow_.QrryZhqqf2-x5WIhggFm3dGC9P2ZEGF_0 2023-10-05T11:43:24.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.118+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.16913746475013447192', time=2023-10-05T13:41:01.538060+0000, chain.objs.size()=1 2023-10-05T11:43:24.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.118+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.23__shadow_.YPiXIX0Q6rrRB9mPfgwWYOmUzCWZKsf_0 2023-10-05T11:43:24.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.118+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.12048967608879837719', time=2023-10-05T13:41:34.868764+0000, chain.objs.size()=1 2023-10-05T11:43:24.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.118+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.25__shadow_.TtK9OZnlnhZum0r0mSiJlLf9Vtbjv6T_0 2023-10-05T11:43:24.125 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.121+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing entries, marker: 2023-10-05T11:43:24.128 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.124+0000 7fdf7352d880 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2023-10-05T11:43:24.129 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.126+0000 7fdf7352d880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:43:24.130 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.126+0000 7fdf7352d880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:43:24.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.127+0000 7fdf7352d880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=10, truncated=0, next_marker='' 2023-10-05T11:43:24.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.127+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.4504113079981601436', time=2023-10-05T13:39:54.779674+0000, chain.objs.size()=1 2023-10-05T11:43:24.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.127+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.19__shadow_.xKtoF48itR6-_a5F0412qmtWPb8rPuQ_0 2023-10-05T11:43:24.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.127+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.6053616053625708590', time=2023-10-05T13:40:26.534772+0000, chain.objs.size()=1 2023-10-05T11:43:24.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.127+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.20__shadow_.AGRQGWy5ujDOHVGx4_6XKntzkJnp6Ek_0 2023-10-05T11:43:24.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.127+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.15081005264229914403', time=2023-10-05T13:40:26.535513+0000, chain.objs.size()=1 2023-10-05T11:43:24.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.127+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.20__shadow_.bmNcfiG7pMPGHpeFOW1NJUerjd-XxEi_0 2023-10-05T11:43:24.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.127+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.9833384912375179374', time=2023-10-05T13:40:26.562869+0000, chain.objs.size()=1 2023-10-05T11:43:24.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.127+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.20__shadow_.QLS5HkyNpa4TcbJEu9-QMCGw0sp9jls_0 2023-10-05T11:43:24.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.127+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.7439161054931459944', time=2023-10-05T13:40:26.563392+0000, chain.objs.size()=1 2023-10-05T11:43:24.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.127+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.20__shadow_.FmRBxo8M5Ll68SHu_H20Rb67SlsENX5_0 2023-10-05T11:43:24.132 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.127+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.4220403627555225857', time=2023-10-05T13:40:28.192434+0000, chain.objs.size()=1 2023-10-05T11:43:24.132 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.127+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.21__shadow_._Cav2itCMpMk_DzaEqpyIV8Va3njbSn_0 2023-10-05T11:43:24.132 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.127+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.16716212339532921032', time=2023-10-05T13:40:28.193040+0000, chain.objs.size()=1 2023-10-05T11:43:24.132 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.127+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.21__shadow_.mNHgwur0egW4snQJ0vBjp07JsD2xNdV_0 2023-10-05T11:43:24.132 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.127+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.16390273020845866349', time=2023-10-05T13:41:03.098287+0000, chain.objs.size()=1 2023-10-05T11:43:24.132 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.127+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.24__shadow_.SO8gkTyLgYQgE7VKO9q3M5uGcBjh_7l_0 2023-10-05T11:43:24.132 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.127+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.3597628410247074923', time=2023-10-05T13:41:36.528996+0000, chain.objs.size()=1 2023-10-05T11:43:24.132 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.127+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.26__shadow_.DaVreVmTuqMj_zcY3L0dOv51EcC3J47_0 2023-10-05T11:43:24.132 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.127+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.4038960216897415608', time=2023-10-05T13:42:08.208685+0000, chain.objs.size()=1 2023-10-05T11:43:24.132 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.127+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.27__shadow_.SiRb8Lk9Ii1YqyKmRMIG0tWT2sVjR_F_0 2023-10-05T11:43:24.135 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.132+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing entries, marker: 2023-10-05T11:43:24.137 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.134+0000 7fdf7352d880 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2023-10-05T11:43:24.138 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.135+0000 7fdf7352d880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:43:24.139 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.136+0000 7fdf7352d880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:43:24.139 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.136+0000 7fdf7352d880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2023-10-05T11:43:24.140 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.136+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.13797328828128833096', time=2023-10-05T13:38:53.114531+0000, chain.objs.size()=1 2023-10-05T11:43:24.140 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.136+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.7__shadow_.TqGU928AjW-b0ctsiisCN-11dxrOkWG_0 2023-10-05T11:43:24.140 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.136+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.11080685289275736806', time=2023-10-05T13:39:53.423132+0000, chain.objs.size()=1 2023-10-05T11:43:24.140 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.136+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.18__shadow_.VNmK4ZHGKbLNaeSpKYjgbcoZ71MwRsu_0 2023-10-05T11:43:24.140 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.136+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.883369505289651506', time=2023-10-05T13:39:54.724665+0000, chain.objs.size()=1 2023-10-05T11:43:24.140 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.136+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.19__shadow_.Lnb_vKCs7xWnURV-_v9RGXycR2Zplzz_0 2023-10-05T11:43:24.140 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.136+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.13447084425733314341', time=2023-10-05T13:39:54.747998+0000, chain.objs.size()=1 2023-10-05T11:43:24.140 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.136+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.19__shadow_.OX_TMZDur496WpZj3h4kk4q0NucUVUX_0 2023-10-05T11:43:24.140 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.136+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.9678270409180362116', time=2023-10-05T13:40:26.513508+0000, chain.objs.size()=1 2023-10-05T11:43:24.140 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.136+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.20__shadow_.Vc5mx8KeAflto1QkJcnZnnJI5nD2vFI_0 2023-10-05T11:43:24.142 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.139+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing entries, marker: 2023-10-05T11:43:24.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.141+0000 7fdf7352d880 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2023-10-05T11:43:24.146 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.143+0000 7fdf7352d880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:43:24.146 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.143+0000 7fdf7352d880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:43:24.147 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.143+0000 7fdf7352d880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=10, truncated=0, next_marker='' 2023-10-05T11:43:24.147 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.143+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.7629049515416214585', time=2023-10-05T13:38:52.859505+0000, chain.objs.size()=1 2023-10-05T11:43:24.147 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.143+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.14__shadow_.GI4GSSKuf5EYhZ2Rl_eVZ8rQ9pvybAv_0 2023-10-05T11:43:24.148 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.143+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.18184949987962663880', time=2023-10-05T13:38:53.122781+0000, chain.objs.size()=1 2023-10-05T11:43:24.148 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.143+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.7__shadow_.MhLhwrg7ERryCuPu7U58GjSOAYxxuwG_0 2023-10-05T11:43:24.148 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.143+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.8653265636117582828', time=2023-10-05T13:39:54.730979+0000, chain.objs.size()=1 2023-10-05T11:43:24.148 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.143+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.19__shadow_.hL3t2hHDXIR2HtKn001rQVv9mutmuWX_0 2023-10-05T11:43:24.148 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.143+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.10760809620655652666', time=2023-10-05T13:40:28.159360+0000, chain.objs.size()=1 2023-10-05T11:43:24.148 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.143+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.21__shadow_.qzh9m_2VxHY6Zq9tzdL-3g23fNfQQF1_0 2023-10-05T11:43:24.148 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.143+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.10232440784585123199', time=2023-10-05T13:40:59.918176+0000, chain.objs.size()=1 2023-10-05T11:43:24.148 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.143+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.22__shadow_.E9zPlXWV0SOk8Ih2y25vjFRCXocHooW_0 2023-10-05T11:43:24.148 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.143+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.15045628104127685244', time=2023-10-05T13:40:59.965063+0000, chain.objs.size()=1 2023-10-05T11:43:24.148 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.143+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.22__shadow_.my8784gPWms7iv9sfYZxsQBtJ9loTny_0 2023-10-05T11:43:24.148 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.143+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.7964844220492798192', time=2023-10-05T13:41:01.520293+0000, chain.objs.size()=1 2023-10-05T11:43:24.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.143+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.23__shadow_.6N4r-8e581Fkx6NvQW9LupJQ7wXoyxz_0 2023-10-05T11:43:24.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.143+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.16082556916406478749', time=2023-10-05T13:41:01.559210+0000, chain.objs.size()=1 2023-10-05T11:43:24.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.143+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.23__shadow_.0u-pCmaPgVtLv5Or-Rz7S2INXlNohAN_0 2023-10-05T11:43:24.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.144+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.9393233945356495664', time=2023-10-05T13:41:03.084809+0000, chain.objs.size()=1 2023-10-05T11:43:24.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.144+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.24__shadow_.bPxaxXj4uH5tvCFyjcGjE_JTzWZwtIa_0 2023-10-05T11:43:24.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.144+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.6296894935931054669', time=2023-10-05T13:42:08.208677+0000, chain.objs.size()=1 2023-10-05T11:43:24.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.144+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.27__shadow_.tYV0MhwDup4Y7--ukJBdu4AA3r03Dl0_0 2023-10-05T11:43:24.151 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.148+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing entries, marker: 2023-10-05T11:43:24.153 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.150+0000 7fdf7352d880 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2023-10-05T11:43:24.155 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.152+0000 7fdf7352d880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:43:24.155 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.152+0000 7fdf7352d880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:43:24.156 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.153+0000 7fdf7352d880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=8, truncated=0, next_marker='' 2023-10-05T11:43:24.156 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.153+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.10056550591054060864', time=2023-10-05T13:39:54.778091+0000, chain.objs.size()=1 2023-10-05T11:43:24.156 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.153+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.19__shadow_.jSz5fM8PFL8uiMC_XdBhe6TM62HXaGT_0 2023-10-05T11:43:24.156 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.153+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.12950497769581459965', time=2023-10-05T13:41:01.520118+0000, chain.objs.size()=1 2023-10-05T11:43:24.157 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.153+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.23__shadow_.mPESQJsrjytY71Rc-sgdwmUIkXs0lYo_0 2023-10-05T11:43:24.157 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.153+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.16417459706562368807', time=2023-10-05T13:41:03.054235+0000, chain.objs.size()=1 2023-10-05T11:43:24.157 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.153+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.24__shadow_.EwPNDP2DCSPRNSNp7OV3-LkefTcUm1G_0 2023-10-05T11:43:24.157 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.153+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.8708072089671976960', time=2023-10-05T13:41:03.054787+0000, chain.objs.size()=1 2023-10-05T11:43:24.157 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.153+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.24__shadow_.j5R42ACTKriVsbkwehaIwLAB-qt5iSn_0 2023-10-05T11:43:24.157 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.153+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.10677456819390360985', time=2023-10-05T13:41:34.866833+0000, chain.objs.size()=1 2023-10-05T11:43:24.157 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.153+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.25__shadow_.GgkNHJ6YQ8gF3BDDTtZ4cHlgh-hhQYf_0 2023-10-05T11:43:24.157 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.153+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.2816694418871754501', time=2023-10-05T13:41:34.901716+0000, chain.objs.size()=1 2023-10-05T11:43:24.157 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.153+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.25__shadow_.SyTGlix2JUAFqMUirkobQa0wECrzy3u_0 2023-10-05T11:43:24.158 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.153+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.7680451637434770630', time=2023-10-05T13:41:36.466939+0000, chain.objs.size()=1 2023-10-05T11:43:24.158 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.153+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.26__shadow_.-gLgY6P6aeztHRZ7GjPv8R4cPwJKLMJ_0 2023-10-05T11:43:24.158 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.153+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.12842010279412637652', time=2023-10-05T13:42:08.898622+0000, chain.objs.size()=1 2023-10-05T11:43:24.158 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.153+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.16__shadow_.UmvcE2O7PG6IbptQHNI7B8B5dRZcXMh_0 2023-10-05T11:43:24.160 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.157+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing entries, marker: 2023-10-05T11:43:24.162 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.159+0000 7fdf7352d880 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2023-10-05T11:43:24.163 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.160+0000 7fdf7352d880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:43:24.164 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.161+0000 7fdf7352d880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:43:24.164 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.161+0000 7fdf7352d880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2023-10-05T11:43:24.164 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.161+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.955027549519794420', time=2023-10-05T13:38:53.118733+0000, chain.objs.size()=1 2023-10-05T11:43:24.164 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.161+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.7__shadow_.AZNPVUPGfCm1dVraYqltEoXRWf-Zmn6_0 2023-10-05T11:43:24.165 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.161+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.297503079766900609', time=2023-10-05T13:39:54.769160+0000, chain.objs.size()=1 2023-10-05T11:43:24.165 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.161+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.19__shadow_.GnKByqh91_qNxA-bihAbC84rKvViw3f_0 2023-10-05T11:43:24.165 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.161+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.10916104881111099387', time=2023-10-05T13:41:01.522276+0000, chain.objs.size()=1 2023-10-05T11:43:24.165 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.161+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.23__shadow_.13F17XB5fs5rKaOZjRyjD6Wq90vkBhR_0 2023-10-05T11:43:24.166 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.163+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing entries, marker: 2023-10-05T11:43:24.168 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.165+0000 7fdf7352d880 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2023-10-05T11:43:24.170 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.167+0000 7fdf7352d880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:43:24.170 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.167+0000 7fdf7352d880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:43:24.171 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.168+0000 7fdf7352d880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=13, truncated=0, next_marker='' 2023-10-05T11:43:24.171 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.168+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.3550742902591535562', time=2023-10-05T13:38:52.697477+0000, chain.objs.size()=1 2023-10-05T11:43:24.171 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.168+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.4__shadow_.tUwLMTUk6oeWdNE-FaDJR58xwGYih1D_0 2023-10-05T11:43:24.171 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.168+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.15847424263535009406', time=2023-10-05T13:38:52.711258+0000, chain.objs.size()=1 2023-10-05T11:43:24.171 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.168+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.4__shadow_.OiYGTOdInsNsv2GIS08Yq0WBHsEIt9d_0 2023-10-05T11:43:24.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.168+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.2297671732408300456', time=2023-10-05T13:39:54.726621+0000, chain.objs.size()=1 2023-10-05T11:43:24.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.168+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.19__shadow_.ewmz10CXSOu2P9SBZOZ-9nPzrXxJR_q_0 2023-10-05T11:43:24.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.168+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.18332779340685276518', time=2023-10-05T13:39:54.747334+0000, chain.objs.size()=1 2023-10-05T11:43:24.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.168+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.19__shadow_.THOvxDcc3vV-d3pzIKnNtZxa_fwABTS_0 2023-10-05T11:43:24.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.168+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.8747944831517786121', time=2023-10-05T13:39:54.814064+0000, chain.objs.size()=1 2023-10-05T11:43:24.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.168+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.19__shadow_.2qeJTrkYItoejFTllFtOfmLYDQ1sJj9_0 2023-10-05T11:43:24.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.168+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.10072659449370601907', time=2023-10-05T13:40:26.541769+0000, chain.objs.size()=1 2023-10-05T11:43:24.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.168+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.20__shadow_.IgFKV207nDfHMcE1tbOgDDjW0ejqf5a_0 2023-10-05T11:43:24.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.168+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.14630342845138275751', time=2023-10-05T13:41:01.579672+0000, chain.objs.size()=1 2023-10-05T11:43:24.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.168+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.23__shadow_.WXPcFWLOQsvIXntd6fNr10kcBkUiB3t_0 2023-10-05T11:43:24.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.168+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.839256420719103205', time=2023-10-05T13:41:01.580347+0000, chain.objs.size()=1 2023-10-05T11:43:24.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.168+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.23__shadow_.x0OfBJS76EB9Au3wZLnpkkXBucPevmI_0 2023-10-05T11:43:24.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.168+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.10188861723247256926', time=2023-10-05T13:41:03.098264+0000, chain.objs.size()=1 2023-10-05T11:43:24.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.168+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.24__shadow_.pCb8l3hehNGVdlB8Ln1J9hDNM8Qr7ue_0 2023-10-05T11:43:24.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.168+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.748245995765519513', time=2023-10-05T13:41:34.857313+0000, chain.objs.size()=1 2023-10-05T11:43:24.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.168+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.25__shadow_.fNIFbd9MrKETCws04VC40IYkTnMO3ON_0 2023-10-05T11:43:24.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.168+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.16723946463629850262', time=2023-10-05T13:41:34.919147+0000, chain.objs.size()=1 2023-10-05T11:43:24.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.168+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.25__shadow_.wd3G6C7s8QwQXhfClfyO5aK3JAkyZUx_0 2023-10-05T11:43:24.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.168+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.10541892464530718987', time=2023-10-05T13:42:08.206765+0000, chain.objs.size()=1 2023-10-05T11:43:24.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.168+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.27__shadow_.JxQVKQYZb3WXgbPBeKcdqALz82qDrtu_0 2023-10-05T11:43:24.175 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.171+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.16649821282831631121', time=2023-10-05T13:42:19.577080+0000, chain.objs.size()=1 2023-10-05T11:43:24.175 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.171+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.17__shadow:iZBlr6pyxhqSZT86QyRYWcW402G9t2M_.43csA_aCIELbBXfwKhrvkw7ZCfsUId5_0 2023-10-05T11:43:24.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.174+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing entries, marker: 2023-10-05T11:43:24.180 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.177+0000 7fdf7352d880 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2023-10-05T11:43:24.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.178+0000 7fdf7352d880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:43:24.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.178+0000 7fdf7352d880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:43:24.182 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.179+0000 7fdf7352d880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=9, truncated=0, next_marker='' 2023-10-05T11:43:24.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.179+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.882234029457563703', time=2023-10-05T13:39:52.980043+0000, chain.objs.size()=1 2023-10-05T11:43:24.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.179+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.18__shadow_.MH40ujL0ieCGLYd1A6_sHuSkXxWOkBo_0 2023-10-05T11:43:24.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.179+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.17451570285276507856', time=2023-10-05T13:39:53.385349+0000, chain.objs.size()=1 2023-10-05T11:43:24.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.179+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.18__shadow_._1ONMV1nfndzb2MBFwPRTKetwqr8y0F_0 2023-10-05T11:43:24.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.179+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.8397293119153814603', time=2023-10-05T13:40:26.513508+0000, chain.objs.size()=1 2023-10-05T11:43:24.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.179+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.20__shadow_.HC6TVlkb32Pw_mNmyp9GVPTVm24TFjF_0 2023-10-05T11:43:24.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.179+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.15559916879247268541', time=2023-10-05T13:40:28.224944+0000, chain.objs.size()=1 2023-10-05T11:43:24.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.179+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.21__shadow_.b9lINfv53425EqeZG9iEEMnlM-Q24ku_0 2023-10-05T11:43:24.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.179+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.1798658437251929333', time=2023-10-05T13:40:59.910994+0000, chain.objs.size()=1 2023-10-05T11:43:24.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.179+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.22__shadow_.iLpjcHy8Zccb5hMdztL34qVjQv0P4pr_0 2023-10-05T11:43:24.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.179+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.1761013961203774691', time=2023-10-05T13:41:03.083061+0000, chain.objs.size()=1 2023-10-05T11:43:24.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.179+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.24__shadow_.s-GldH5E7JG_SOvjfr--sdmMKE_rYu2_0 2023-10-05T11:43:24.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.179+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.7346796465584640841', time=2023-10-05T13:41:03.112331+0000, chain.objs.size()=1 2023-10-05T11:43:24.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.179+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.24__shadow_._ADSXUxHcZwfLraXpKddLi9wAzUvJHZ_0 2023-10-05T11:43:24.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.179+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.9757125859161700523', time=2023-10-05T13:41:34.833655+0000, chain.objs.size()=1 2023-10-05T11:43:24.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.179+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.25__shadow_.YmlBQ7Asn_4nNPWl38VEPGOXianEJ01_0 2023-10-05T11:43:24.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.179+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.2686433363626125283', time=2023-10-05T13:41:34.870502+0000, chain.objs.size()=1 2023-10-05T11:43:24.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.179+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.25__shadow_.GcrUJdWRgEPT8-NptpZIegjtMH8F3yy_0 2023-10-05T11:43:24.186 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.183+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing entries, marker: 2023-10-05T11:43:24.189 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.185+0000 7fdf7352d880 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2023-10-05T11:43:24.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.187+0000 7fdf7352d880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:43:24.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.187+0000 7fdf7352d880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:43:24.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.187+0000 7fdf7352d880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=9, truncated=0, next_marker='' 2023-10-05T11:43:24.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.187+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.9591234107762843707', time=2023-10-05T13:39:53.342243+0000, chain.objs.size()=1 2023-10-05T11:43:24.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.187+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.18__shadow_.OLRlkoHS1trYPEgVL1nqAX7y5_3NWXm_0 2023-10-05T11:43:24.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.187+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.1594228428706347475', time=2023-10-05T13:39:53.421085+0000, chain.objs.size()=1 2023-10-05T11:43:24.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.187+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.18__shadow_.DhCspSVDiaZfgOlZvlajb2jqOox9FJq_0 2023-10-05T11:43:24.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.187+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.17904069283263177451', time=2023-10-05T13:40:26.586828+0000, chain.objs.size()=1 2023-10-05T11:43:24.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.187+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.20__shadow_.NbTzR3mvmHxbT2bzhhAh8JdE2rWgHwK_0 2023-10-05T11:43:24.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.188+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.10048241956898409197', time=2023-10-05T13:40:28.220590+0000, chain.objs.size()=1 2023-10-05T11:43:24.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.188+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.21__shadow_._Zlsc_YmgIZfvKLvKO0-dHwjBe8eQjW_0 2023-10-05T11:43:24.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.188+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.11333767959977244384', time=2023-10-05T13:41:34.853030+0000, chain.objs.size()=1 2023-10-05T11:43:24.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.188+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.25__shadow_.Nq4l_gkrJg73U4jc1yKJidQpW-hGwui_0 2023-10-05T11:43:24.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.188+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.14365283454887141412', time=2023-10-05T13:41:36.498980+0000, chain.objs.size()=1 2023-10-05T11:43:24.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.188+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.26__shadow_.HhyFjosnE1BGWCad-T-KiuPI7PTN6Y9_0 2023-10-05T11:43:24.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.188+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.2025758907996062605', time=2023-10-05T13:41:36.524193+0000, chain.objs.size()=1 2023-10-05T11:43:24.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.188+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.26__shadow_.aFFpLWI6APDPR_eT80MFUgJ355lcItS_0 2023-10-05T11:43:24.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.188+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.13177836713808414334', time=2023-10-05T13:41:36.549575+0000, chain.objs.size()=1 2023-10-05T11:43:24.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.188+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.26__shadow_.iBzS3SVYk_-J2KeBHkonybS1yjHpRC2_0 2023-10-05T11:43:24.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.188+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.11127699165918371501', time=2023-10-05T13:42:08.178722+0000, chain.objs.size()=1 2023-10-05T11:43:24.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.188+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.27__shadow_.Wlfco3C6JMPTIbWiTXnhsHNLyQKL1x0_0 2023-10-05T11:43:24.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.191+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing entries, marker: 2023-10-05T11:43:24.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.194+0000 7fdf7352d880 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2023-10-05T11:43:24.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.195+0000 7fdf7352d880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:43:24.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.196+0000 7fdf7352d880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:43:24.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.196+0000 7fdf7352d880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=9, truncated=0, next_marker='' 2023-10-05T11:43:24.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.196+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.11967606977212414543', time=2023-10-05T13:38:52.693605+0000, chain.objs.size()=1 2023-10-05T11:43:24.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.196+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.4__shadow_.ZtO_o3mCzaIJMk5hcTUHrpvlSHr3G-n_0 2023-10-05T11:43:24.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.196+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.5847751018704817253', time=2023-10-05T13:38:52.846908+0000, chain.objs.size()=2 2023-10-05T11:43:24.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.196+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:dff27d1e-df33-400e-a68a-7ba586947c99.4604.14__shadow_.A01jg9hrnSBp5OelmISDJjqxFt9CZMV_0 2023-10-05T11:43:24.201 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.196+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:dff27d1e-df33-400e-a68a-7ba586947c99.4604.14__shadow_.A01jg9hrnSBp5OelmISDJjqxFt9CZMV_1 2023-10-05T11:43:24.201 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.196+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.7767681866733213557', time=2023-10-05T13:39:53.460836+0000, chain.objs.size()=1 2023-10-05T11:43:24.201 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.196+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.18__shadow_.pmHrGfSHl6tEkcjKv-q8xwUeyrWLwIJ_0 2023-10-05T11:43:24.201 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.196+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.16458854302521803143', time=2023-10-05T13:39:54.778550+0000, chain.objs.size()=1 2023-10-05T11:43:24.201 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.196+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.19__shadow_.zXaohRdEWoUcjtipUFGGvi5bpoqKaOo_0 2023-10-05T11:43:24.201 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.196+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.15066205949542196337', time=2023-10-05T13:40:26.592125+0000, chain.objs.size()=1 2023-10-05T11:43:24.201 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.196+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.20__shadow_.lS7a7mmjKFN0tYZ3RODqaDvsBF3UfZU_0 2023-10-05T11:43:24.201 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.196+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.14947552136393255230', time=2023-10-05T13:40:28.189289+0000, chain.objs.size()=1 2023-10-05T11:43:24.201 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.196+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.21__shadow_.4krkpQmNCcOdrrE0_bs2iYpbssosVYK_0 2023-10-05T11:43:24.201 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.196+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.3141041131895259471', time=2023-10-05T13:40:28.189873+0000, chain.objs.size()=1 2023-10-05T11:43:24.201 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.196+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.21__shadow_.vZrhbmj9ttXWqUl0LungEuJ65jKI9rl_0 2023-10-05T11:43:24.201 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.196+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.744519451114212853', time=2023-10-05T13:41:03.149816+0000, chain.objs.size()=1 2023-10-05T11:43:24.202 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.196+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.24__shadow_.Xc8LpgWsNodHSOdRBfcvjQJupaLG6WQ_0 2023-10-05T11:43:24.202 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.196+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.952561336376912983', time=2023-10-05T13:42:19.580934+0000, chain.objs.size()=1 2023-10-05T11:43:24.202 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.196+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.17__shadow:IwuWlhSEqUAWRUdg9zQZSakFG6aNNCu_.ejo2KuXAwatrx1FHey3inalipBFSHp5_0 2023-10-05T11:43:24.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.201+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing entries, marker: 2023-10-05T11:43:24.206 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.203+0000 7fdf7352d880 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2023-10-05T11:43:24.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.204+0000 7fdf7352d880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:43:24.208 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.205+0000 7fdf7352d880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:43:24.209 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.205+0000 7fdf7352d880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=11, truncated=0, next_marker='' 2023-10-05T11:43:24.209 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.205+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.13800752616018758557', time=2023-10-05T13:38:52.737016+0000, chain.objs.size()=7 2023-10-05T11:43:24.209 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.205+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.10__multipart_foo.2~uvmX3YFr7Dxk58f4C_akXxjzyfwDhJA.1 2023-10-05T11:43:24.209 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.205+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.10__shadow_foo.2~uvmX3YFr7Dxk58f4C_akXxjzyfwDhJA.1_1 2023-10-05T11:43:24.209 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.205+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.10__multipart_foo.2~uvmX3YFr7Dxk58f4C_akXxjzyfwDhJA.2 2023-10-05T11:43:24.209 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.205+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.10__shadow_foo.2~uvmX3YFr7Dxk58f4C_akXxjzyfwDhJA.2_1 2023-10-05T11:43:24.209 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.205+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.10__multipart_foo.2~uvmX3YFr7Dxk58f4C_akXxjzyfwDhJA.3 2023-10-05T11:43:24.209 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.205+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.10__shadow_foo.2~uvmX3YFr7Dxk58f4C_akXxjzyfwDhJA.3_1 2023-10-05T11:43:24.210 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.205+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.10__multipart_foo.2~uvmX3YFr7Dxk58f4C_akXxjzyfwDhJA.4 2023-10-05T11:43:24.210 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.205+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.13117393144579574484', time=2023-10-05T13:38:52.985766+0000, chain.objs.size()=5 2023-10-05T11:43:24.210 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.205+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:dff27d1e-df33-400e-a68a-7ba586947c99.4604.13__multipart_foo-LUKEWARM.2~kY3j8j6FspLSxuoYGP4duNql-7hikOx.1 2023-10-05T11:43:24.210 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.205+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:dff27d1e-df33-400e-a68a-7ba586947c99.4604.13__shadow_foo-LUKEWARM.2~kY3j8j6FspLSxuoYGP4duNql-7hikOx.1_1 2023-10-05T11:43:24.210 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.205+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:dff27d1e-df33-400e-a68a-7ba586947c99.4604.13__multipart_foo-LUKEWARM.2~kY3j8j6FspLSxuoYGP4duNql-7hikOx.2 2023-10-05T11:43:24.210 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.205+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:dff27d1e-df33-400e-a68a-7ba586947c99.4604.13__shadow_foo-LUKEWARM.2~kY3j8j6FspLSxuoYGP4duNql-7hikOx.2_1 2023-10-05T11:43:24.210 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.205+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:dff27d1e-df33-400e-a68a-7ba586947c99.4604.13__multipart_foo-LUKEWARM.2~kY3j8j6FspLSxuoYGP4duNql-7hikOx.3 2023-10-05T11:43:24.214 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.209+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.6796875927004121611', time=2023-10-05T13:39:53.451478+0000, chain.objs.size()=1 2023-10-05T11:43:24.214 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.209+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.18__shadow_.XXb_t2MN1phEgGu08MVrHiRVFtqhyE0_0 2023-10-05T11:43:24.214 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.209+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.4406305564836316399', time=2023-10-05T13:39:53.452904+0000, chain.objs.size()=1 2023-10-05T11:43:24.214 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.209+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.18__shadow_.Z7XOyuS1DpquwLP_ZHR1R4RF4vY5tAi_0 2023-10-05T11:43:24.214 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.209+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.5902203089586940066', time=2023-10-05T13:39:54.818040+0000, chain.objs.size()=1 2023-10-05T11:43:24.214 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.209+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.19__shadow_.5X5itwDf0xrLJvDcGfjo9tSE6I78dE3_0 2023-10-05T11:43:24.214 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.209+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.3569123541507427069', time=2023-10-05T13:40:59.929748+0000, chain.objs.size()=1 2023-10-05T11:43:24.214 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.209+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.22__shadow_.6Fz85Z35KPPBklnM9ny_LWL3pRTNE_t_0 2023-10-05T11:43:24.214 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.209+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.6009548405869744863', time=2023-10-05T13:41:01.547488+0000, chain.objs.size()=1 2023-10-05T11:43:24.214 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.209+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.23__shadow_.g9bbCHEuF4Gxd6s7WH1jwBmrH7BwEyo_0 2023-10-05T11:43:24.215 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.209+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.9776263150534736115', time=2023-10-05T13:41:36.481842+0000, chain.objs.size()=1 2023-10-05T11:43:24.215 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.209+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.26__shadow_.D3z74BrfxJZPQ5EW_kLCNu1MTWYbm1a_0 2023-10-05T11:43:24.215 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.209+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.1695301664970714908', time=2023-10-05T13:41:36.482385+0000, chain.objs.size()=1 2023-10-05T11:43:24.215 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.209+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.26__shadow_.WGAuFVo8dD5sIKliWrw5NR6ZW_E6m24_0 2023-10-05T11:43:24.215 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.211+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.5234948387623417718', time=2023-10-05T13:41:36.494582+0000, chain.objs.size()=1 2023-10-05T11:43:24.216 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.211+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.26__shadow_.MtY7B7Zfk-wTEFPapyNJ97H_t_Qd3fI_0 2023-10-05T11:43:24.216 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.211+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.2984263855607091178', time=2023-10-05T13:42:08.183426+0000, chain.objs.size()=1 2023-10-05T11:43:24.216 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.211+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.27__shadow_.C9V7-BdBDDYkXeXZixURjOW67lcg9Yt_0 2023-10-05T11:43:24.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.215+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing entries, marker: 2023-10-05T11:43:24.220 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.217+0000 7fdf7352d880 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2023-10-05T11:43:24.222 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.219+0000 7fdf7352d880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:43:24.222 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.219+0000 7fdf7352d880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:43:24.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.219+0000 7fdf7352d880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=7, truncated=0, next_marker='' 2023-10-05T11:43:24.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.219+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.11361452713326344291', time=2023-10-05T13:38:53.009564+0000, chain.objs.size()=3 2023-10-05T11:43:24.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.219+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:dff27d1e-df33-400e-a68a-7ba586947c99.4604.12__shadow_.QgdZ_zisY-cyd21PAF8bXKk2f7y3FMX_0 2023-10-05T11:43:24.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.219+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:dff27d1e-df33-400e-a68a-7ba586947c99.4604.12__shadow_.QgdZ_zisY-cyd21PAF8bXKk2f7y3FMX_1 2023-10-05T11:43:24.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.219+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:dff27d1e-df33-400e-a68a-7ba586947c99.4604.12__shadow_.QgdZ_zisY-cyd21PAF8bXKk2f7y3FMX_2 2023-10-05T11:43:24.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.219+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.16658723834007598986', time=2023-10-05T13:40:26.592550+0000, chain.objs.size()=1 2023-10-05T11:43:24.224 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.219+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.20__shadow_.F-Mu1D3Vgkpd_qWJ7iC36rmLKF-TUlA_0 2023-10-05T11:43:24.224 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.219+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.11349792185300915891', time=2023-10-05T13:40:59.870808+0000, chain.objs.size()=1 2023-10-05T11:43:24.224 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.219+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.22__shadow_.vsdMmtD1HKNKXLOh2v5b3ZAK4Rbp5bb_0 2023-10-05T11:43:24.224 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.219+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.2776786415068490274', time=2023-10-05T13:41:01.134529+0000, chain.objs.size()=1 2023-10-05T11:43:24.224 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.219+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.23__shadow_.GRo8_bh1xMZ0lv4loOm706ouPa7u5bR_0 2023-10-05T11:43:24.224 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.219+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.2290111489275566989', time=2023-10-05T13:42:08.208685+0000, chain.objs.size()=1 2023-10-05T11:43:24.224 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.219+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.27__shadow_.xLzp8GUsXLGCkm6diCU285NkFCBieg7_0 2023-10-05T11:43:24.224 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.219+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.5682475636443529556', time=2023-10-05T13:42:08.249978+0000, chain.objs.size()=1 2023-10-05T11:43:24.224 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.219+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.27__shadow_.Ceu4Ve4X_qYHe3o_mFiMDoQxMRGAe-X_0 2023-10-05T11:43:24.224 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.219+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.6295142448858779106', time=2023-10-05T13:42:08.877311+0000, chain.objs.size()=1 2023-10-05T11:43:24.224 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.219+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.16__shadow_.qgfr3FNtjySJ4x6oiyXwI9Uc1Cwt4QH_0 2023-10-05T11:43:24.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.224+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing entries, marker: 2023-10-05T11:43:24.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.226+0000 7fdf7352d880 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2023-10-05T11:43:24.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.228+0000 7fdf7352d880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:43:24.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.228+0000 7fdf7352d880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:43:24.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.229+0000 7fdf7352d880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2023-10-05T11:43:24.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.229+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.6874965642748883390', time=2023-10-05T13:38:52.684408+0000, chain.objs.size()=1 2023-10-05T11:43:24.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.229+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.4__shadow_.6BWJ8qcFRoqe2xtxHuwKsU7E3TERQxO_0 2023-10-05T11:43:24.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.229+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='_0n104TY1yh4AP_xxmeJ84OsYD1IxNxn', time=2023-10-05T13:38:52.920789+0000, chain.objs.size()=3 2023-10-05T11:43:24.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.229+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:dff27d1e-df33-400e-a68a-7ba586947c99.4604.15__shadow_.quqUyXe0lkpnBG5m5gY0_3v32wahitN_0 2023-10-05T11:43:24.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.229+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:dff27d1e-df33-400e-a68a-7ba586947c99.4604.15__shadow_.quqUyXe0lkpnBG5m5gY0_3v32wahitN_1 2023-10-05T11:43:24.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.229+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:dff27d1e-df33-400e-a68a-7ba586947c99.4604.15__shadow_.quqUyXe0lkpnBG5m5gY0_3v32wahitN_2 2023-10-05T11:43:24.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.229+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.12667656014713169454', time=2023-10-05T13:38:53.110419+0000, chain.objs.size()=1 2023-10-05T11:43:24.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.229+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.7__shadow_.9AWNjm5UDcrey9UY-iyLfMbpyg36Q6t_0 2023-10-05T11:43:24.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.229+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.5078128180653693502', time=2023-10-05T13:40:59.896153+0000, chain.objs.size()=1 2023-10-05T11:43:24.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.229+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.22__shadow_.mSo1paCYYhMkF9QZrpLPectz-omBMuf_0 2023-10-05T11:43:24.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.229+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.3521057363872766520', time=2023-10-05T13:41:03.057379+0000, chain.objs.size()=1 2023-10-05T11:43:24.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.229+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.24__shadow_.UPJguFSwSO9RujUHhnA4DDPM_E33ZS3_0 2023-10-05T11:43:24.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.229+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.17334092329558172764', time=2023-10-05T13:41:03.078483+0000, chain.objs.size()=1 2023-10-05T11:43:24.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.229+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.24__shadow_.g6dtWs98QGYMqTZLBuVjtq6hqYGjnL1_0 2023-10-05T11:43:24.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.233+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing entries, marker: 2023-10-05T11:43:24.238 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.235+0000 7fdf7352d880 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2023-10-05T11:43:24.239 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.236+0000 7fdf7352d880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:43:24.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.237+0000 7fdf7352d880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:43:24.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.237+0000 7fdf7352d880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=14, truncated=0, next_marker='' 2023-10-05T11:43:24.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.237+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.11083568931409205542', time=2023-10-05T13:38:52.689130+0000, chain.objs.size()=1 2023-10-05T11:43:24.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.237+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.4__shadow_.J1-I1ujmNKW79WpQ4tOrw1zx7vVmUiF_0 2023-10-05T11:43:24.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.237+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='_ZaloqTWiiNZfhWKTOROzncyDjjochVp', time=2023-10-05T13:38:52.863805+0000, chain.objs.size()=2 2023-10-05T11:43:24.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.237+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.14__shadow_.BCKTSxlLhFi9Uofx1pUj-Bwwu4lLHI6_0 2023-10-05T11:43:24.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.237+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.14__shadow_.BCKTSxlLhFi9Uofx1pUj-Bwwu4lLHI6_1 2023-10-05T11:43:24.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.237+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4604.14__shadow_.A01jg9hrnSBp5OelmISDJjqxFt9CZMV_1_caf3f594d83f21f6d6c11df66e14cc59', time=2023-10-05T13:38:52.884194+0000, chain.objs.size()=2 2023-10-05T11:43:24.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.237+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:dff27d1e-df33-400e-a68a-7ba586947c99.4604.14__shadow_.A01jg9hrnSBp5OelmISDJjqxFt9CZMV_0 2023-10-05T11:43:24.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.237+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:dff27d1e-df33-400e-a68a-7ba586947c99.4604.14__shadow_.A01jg9hrnSBp5OelmISDJjqxFt9CZMV_1 2023-10-05T11:43:24.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.237+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.18047668977075804624', time=2023-10-05T13:39:53.422051+0000, chain.objs.size()=1 2023-10-05T11:43:24.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.237+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.18__shadow_.n5OWNI12BRi3wQD7s18MiEncHuA_ysF_0 2023-10-05T11:43:24.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.237+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.9737785845893368572', time=2023-10-05T13:40:26.488837+0000, chain.objs.size()=1 2023-10-05T11:43:24.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.237+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.20__shadow_.WXdGDow7uwSQ8BRbBn8ZJrl4WMdUHJ-_0 2023-10-05T11:43:24.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.237+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.9238405596597057462', time=2023-10-05T13:40:26.533453+0000, chain.objs.size()=1 2023-10-05T11:43:24.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.237+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.20__shadow_.4CeGZpFcynVFzZwsQl0iiCYdPPvPhaF_0 2023-10-05T11:43:24.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.237+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.2326559831193821584', time=2023-10-05T13:40:26.533993+0000, chain.objs.size()=1 2023-10-05T11:43:24.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.237+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.20__shadow_.4G0738MS5BGMJW4a2yjfoR8cEeyjhiv_0 2023-10-05T11:43:24.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.237+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.14913454789923577716', time=2023-10-05T13:40:27.753194+0000, chain.objs.size()=1 2023-10-05T11:43:24.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.237+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.21__shadow_.KES-cKDeA44AhwoYrCqzPxFQKJJ3Oyp_0 2023-10-05T11:43:24.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.237+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.5099648737964630212', time=2023-10-05T13:40:28.142118+0000, chain.objs.size()=1 2023-10-05T11:43:24.243 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.237+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.21__shadow_._T2-PJ-Z9-TZlxaoYHOQ-FESyzSGCmm_0 2023-10-05T11:43:24.243 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.237+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.2517898069234480555', time=2023-10-05T13:40:59.929696+0000, chain.objs.size()=1 2023-10-05T11:43:24.243 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.237+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.22__shadow_.bBLqR460maHiFn7i_mR5l7Y6J8OJAn1_0 2023-10-05T11:43:24.244 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.241+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.4676122682211362063', time=2023-10-05T13:41:01.538034+0000, chain.objs.size()=1 2023-10-05T11:43:24.245 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.241+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.23__shadow_.SR4BBCjrlyjBvJnEH7nHglS5mwiDIiv_0 2023-10-05T11:43:24.245 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.241+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.6958011063684318563', time=2023-10-05T13:41:36.467474+0000, chain.objs.size()=1 2023-10-05T11:43:24.245 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.241+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.26__shadow_.GnxTjyaI2XAwddVnZWSdBRNbOl-4uGp_0 2023-10-05T11:43:24.245 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.241+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.6470143276552185603', time=2023-10-05T13:42:08.244851+0000, chain.objs.size()=1 2023-10-05T11:43:24.245 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.241+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.27__shadow_.Vq9rSU2_idMAQnz8414Ex3a73qbbZbN_0 2023-10-05T11:43:24.245 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.241+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.8114028927323897203', time=2023-10-05T13:42:08.893226+0000, chain.objs.size()=1 2023-10-05T11:43:24.245 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.241+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.16__shadow_.Lm5i22Ib4a5Ely0wlRXXgQcJP4cGwdb_0 2023-10-05T11:43:24.248 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.245+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing entries, marker: 2023-10-05T11:43:24.250 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.247+0000 7fdf7352d880 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2023-10-05T11:43:24.251 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.248+0000 7fdf7352d880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:43:24.252 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.249+0000 7fdf7352d880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:43:24.253 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.249+0000 7fdf7352d880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=16, truncated=0, next_marker='' 2023-10-05T11:43:24.253 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.249+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.3780724165736036439', time=2023-10-05T13:38:52.706194+0000, chain.objs.size()=1 2023-10-05T11:43:24.253 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.249+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.4__shadow_.H5yBsVyOqyIBlesXqQD-FuTbtJ9DNMf_0 2023-10-05T11:43:24.253 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.249+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.551383658556754855', time=2023-10-05T13:38:52.761198+0000, chain.objs.size()=4 2023-10-05T11:43:24.253 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.249+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.11__multipart_foo.2~G-Y1jaO2JdTJPeh4KEfiZMdVr-wiOQ3.1 2023-10-05T11:43:24.253 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.249+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.11__multipart_foo.2~G-Y1jaO2JdTJPeh4KEfiZMdVr-wiOQ3.2 2023-10-05T11:43:24.253 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.249+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.11__multipart_foo.2~G-Y1jaO2JdTJPeh4KEfiZMdVr-wiOQ3.3 2023-10-05T11:43:24.254 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.249+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.11__multipart_foo.2~G-Y1jaO2JdTJPeh4KEfiZMdVr-wiOQ3.4 2023-10-05T11:43:24.254 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.249+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.16875925354168030582', time=2023-10-05T13:39:53.357284+0000, chain.objs.size()=1 2023-10-05T11:43:24.254 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.249+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.18__shadow_.cEMDjeVj5cuoDzVAzgl4HPgZiZTUR5G_0 2023-10-05T11:43:24.254 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.249+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.3307913060483428136', time=2023-10-05T13:39:53.424037+0000, chain.objs.size()=1 2023-10-05T11:43:24.254 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.249+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.18__shadow_.ddMauUdXCLZa97UXz_zunk6Spqx-Wwu_0 2023-10-05T11:43:24.254 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.249+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.10627053839137617232', time=2023-10-05T13:40:28.175269+0000, chain.objs.size()=1 2023-10-05T11:43:24.254 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.249+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.21__shadow_.FgXJ-NNNdacnkIicMgY5Lc-AVRaEzk4_0 2023-10-05T11:43:24.254 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.249+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.10700557505387198672', time=2023-10-05T13:40:28.175797+0000, chain.objs.size()=1 2023-10-05T11:43:24.254 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.249+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.21__shadow_.ixTdOtd6gQYNn0xYJOaCqHluheZkXAU_0 2023-10-05T11:43:24.254 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.249+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.3883660979271129931', time=2023-10-05T13:41:01.547524+0000, chain.objs.size()=1 2023-10-05T11:43:24.254 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.249+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.23__shadow_.BfIiu62YzvWsIKREr-IK_TzVeToifkM_0 2023-10-05T11:43:24.254 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.249+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.17827535843916801984', time=2023-10-05T13:41:01.548343+0000, chain.objs.size()=1 2023-10-05T11:43:24.255 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.249+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.23__shadow_.bD0jIuhwATYA0-C3yzK7PINXHhX6w4j_0 2023-10-05T11:43:24.255 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.249+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.1578242748868290059', time=2023-10-05T13:41:03.151193+0000, chain.objs.size()=1 2023-10-05T11:43:24.255 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.249+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.24__shadow_.J4K4BdHm6N4a98a1jowzDnjtAShmrq2_0 2023-10-05T11:43:24.256 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.252+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.11157204329631574908', time=2023-10-05T13:41:36.093390+0000, chain.objs.size()=1 2023-10-05T11:43:24.256 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.252+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.26__shadow_.mbMFgHFw5baK8aexmAIiYgHKMoYP0wh_0 2023-10-05T11:43:24.256 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.253+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.1473722018456479692', time=2023-10-05T13:41:36.525885+0000, chain.objs.size()=1 2023-10-05T11:43:24.256 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.253+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.26__shadow_.3b4lt0trx9clQF3BNsM4sI2LNW4lnao_0 2023-10-05T11:43:24.257 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.254+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.6085147474211454165', time=2023-10-05T13:41:36.526616+0000, chain.objs.size()=1 2023-10-05T11:43:24.257 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.254+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.26__shadow_.gPXFPqromF8lpb0Q9YCPqXDQ-yEEOVY_0 2023-10-05T11:43:24.257 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.254+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.6654589043168506428', time=2023-10-05T13:41:36.556740+0000, chain.objs.size()=1 2023-10-05T11:43:24.258 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.254+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.26__shadow_.lXeeQvie_RivneH2fLFcEJFRGmKkXAL_0 2023-10-05T11:43:24.258 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.254+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.14910788303035933146', time=2023-10-05T13:42:08.183368+0000, chain.objs.size()=1 2023-10-05T11:43:24.258 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.254+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.27__shadow_.RbIf_cu6li6jTm9gYQjBVPwvVNOTGAm_0 2023-10-05T11:43:24.258 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.254+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.12650466512693607057', time=2023-10-05T13:42:08.209582+0000, chain.objs.size()=1 2023-10-05T11:43:24.258 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.254+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.27__shadow_.UlaCZwuVgAiIfWTF-7V8_gzZeNrMoZH_0 2023-10-05T11:43:24.258 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.254+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.13226867091229033218', time=2023-10-05T13:42:08.884903+0000, chain.objs.size()=1 2023-10-05T11:43:24.258 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.254+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.16__shadow_.U5LKScZkAu9xxtk0yO6fFrmp6zC3uQZ_0 2023-10-05T11:43:24.262 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.258+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing entries, marker: 2023-10-05T11:43:24.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.261+0000 7fdf7352d880 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2023-10-05T11:43:24.265 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.262+0000 7fdf7352d880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:43:24.265 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.262+0000 7fdf7352d880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:43:24.266 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.263+0000 7fdf7352d880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=9, truncated=0, next_marker='' 2023-10-05T11:43:24.267 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.263+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='_DiWw2L8RwfKYlUyIKD1ENDtorXgxaJ5', time=2023-10-05T13:38:52.838641+0000, chain.objs.size()=1 2023-10-05T11:43:24.267 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.263+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:dff27d1e-df33-400e-a68a-7ba586947c99.4604.14__shadow_.9XEY8ur8KKyfH6FShXE5bXwoo3r962d_0 2023-10-05T11:43:24.267 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.263+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4604.15__shadow_foo-FROZEN.2~eTH9zomvpT2_DCVGbxdz_khqGa_LaG5.1_1_d1f2fa2bf2d3cc802cf82541e54ea059', time=2023-10-05T13:38:52.953286+0000, chain.objs.size()=5 2023-10-05T11:43:24.267 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.263+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:dff27d1e-df33-400e-a68a-7ba586947c99.4604.15__multipart_foo-FROZEN.2~eTH9zomvpT2_DCVGbxdz_khqGa_LaG5.1 2023-10-05T11:43:24.267 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.263+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:dff27d1e-df33-400e-a68a-7ba586947c99.4604.15__shadow_foo-FROZEN.2~eTH9zomvpT2_DCVGbxdz_khqGa_LaG5.1_1 2023-10-05T11:43:24.267 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.263+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:dff27d1e-df33-400e-a68a-7ba586947c99.4604.15__multipart_foo-FROZEN.2~eTH9zomvpT2_DCVGbxdz_khqGa_LaG5.2 2023-10-05T11:43:24.267 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.263+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:dff27d1e-df33-400e-a68a-7ba586947c99.4604.15__shadow_foo-FROZEN.2~eTH9zomvpT2_DCVGbxdz_khqGa_LaG5.2_1 2023-10-05T11:43:24.267 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.263+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:dff27d1e-df33-400e-a68a-7ba586947c99.4604.15__multipart_foo-FROZEN.2~eTH9zomvpT2_DCVGbxdz_khqGa_LaG5.3 2023-10-05T11:43:24.267 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.263+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.14673467699392796647', time=2023-10-05T13:38:53.017851+0000, chain.objs.size()=3 2023-10-05T11:43:24.267 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.263+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:dff27d1e-df33-400e-a68a-7ba586947c99.4604.12__shadow_.sU0G5r4P8GbEFrjVlJ7FH8TVse7zBwf_0 2023-10-05T11:43:24.267 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.263+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:dff27d1e-df33-400e-a68a-7ba586947c99.4604.12__shadow_.sU0G5r4P8GbEFrjVlJ7FH8TVse7zBwf_1 2023-10-05T11:43:24.267 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.263+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:dff27d1e-df33-400e-a68a-7ba586947c99.4604.12__shadow_.sU0G5r4P8GbEFrjVlJ7FH8TVse7zBwf_2 2023-10-05T11:43:24.268 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.263+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.3847239526206064155', time=2023-10-05T13:40:26.564499+0000, chain.objs.size()=1 2023-10-05T11:43:24.268 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.263+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.20__shadow_.gVuWbqUQFz-euMWdXU5FqLD_y18RIY1_0 2023-10-05T11:43:24.268 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.263+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.5383276018433672199', time=2023-10-05T13:40:28.194462+0000, chain.objs.size()=1 2023-10-05T11:43:24.268 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.263+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.21__shadow_.msmGVtUUwMyOW_VWvKhmQDKO2Gj7nGo_0 2023-10-05T11:43:24.268 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.263+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.16818890027073336926', time=2023-10-05T13:40:28.210752+0000, chain.objs.size()=1 2023-10-05T11:43:24.268 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.263+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.21__shadow_.TpbsRyCf4RdQvC2alEbN-Zkf2k87P4V_0 2023-10-05T11:43:24.268 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.265+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.815039719539282801', time=2023-10-05T13:40:59.874955+0000, chain.objs.size()=1 2023-10-05T11:43:24.269 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.265+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.22__shadow_.93_68W1pQkmWu8ga7L-yjJYq13_H1jS_0 2023-10-05T11:43:24.269 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.265+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.12734523906710078003', time=2023-10-05T13:40:59.947238+0000, chain.objs.size()=1 2023-10-05T11:43:24.269 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.265+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.22__shadow_.44Hg2beImb7FWHX8aTV9cz6BqwzHDVY_0 2023-10-05T11:43:24.269 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.265+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.583879433548491381', time=2023-10-05T13:42:08.897926+0000, chain.objs.size()=1 2023-10-05T11:43:24.269 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.265+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.16__shadow_.3f1l6UBM28-JFgNTAlXNlC-nkNEuLdj_0 2023-10-05T11:43:24.271 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.268+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing entries, marker: 2023-10-05T11:43:24.274 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.271+0000 7fdf7352d880 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2023-10-05T11:43:24.275 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.272+0000 7fdf7352d880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:43:24.275 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.272+0000 7fdf7352d880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:43:24.276 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.273+0000 7fdf7352d880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2023-10-05T11:43:24.276 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.273+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.5274729912239985251', time=2023-10-05T13:40:28.129575+0000, chain.objs.size()=1 2023-10-05T11:43:24.276 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.273+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.21__shadow_.fWLnAzhtMSImt9awdiU85hloI5lL4yf_0 2023-10-05T11:43:24.277 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.273+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.5242008703388178244', time=2023-10-05T13:41:01.522880+0000, chain.objs.size()=1 2023-10-05T11:43:24.277 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.273+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.23__shadow_.3Tg9hkoeNa1qOjcsgDAlzhv05xcmBmy_0 2023-10-05T11:43:24.277 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.273+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.6990104364878622482', time=2023-10-05T13:41:34.437734+0000, chain.objs.size()=1 2023-10-05T11:43:24.277 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.273+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.25__shadow_.0QKPxM3IRuGAigjg7CPCILzL1nDvpKG_0 2023-10-05T11:43:24.277 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.273+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.7603478731448175984', time=2023-10-05T13:42:08.178376+0000, chain.objs.size()=1 2023-10-05T11:43:24.277 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.273+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.27__shadow_.IltJHaED-fQuemH6JdNuiWLqpVsYD13_0 2023-10-05T11:43:24.277 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.273+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.9638484976112970123', time=2023-10-05T13:42:08.875939+0000, chain.objs.size()=1 2023-10-05T11:43:24.277 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.273+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.16__shadow_.Sc8Ey8W5fqQepYcfW7QpODbjSGft_xh_0 2023-10-05T11:43:24.279 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.276+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing entries, marker: 2023-10-05T11:43:24.281 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.278+0000 7fdf7352d880 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2023-10-05T11:43:24.282 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.279+0000 7fdf7352d880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:43:24.283 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.280+0000 7fdf7352d880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:43:24.283 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.280+0000 7fdf7352d880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2023-10-05T11:43:24.284 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.280+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='_-j4Aoxt6p3zCfpEDUK6-wsKVzoI9xLW', time=2023-10-05T13:38:52.851125+0000, chain.objs.size()=2 2023-10-05T11:43:24.284 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.280+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:dff27d1e-df33-400e-a68a-7ba586947c99.4604.14__shadow_.w-0vcCicg4YWoMDAiJCyGv404RW_vxg_0 2023-10-05T11:43:24.284 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.280+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:dff27d1e-df33-400e-a68a-7ba586947c99.4604.14__shadow_.w-0vcCicg4YWoMDAiJCyGv404RW_vxg_1 2023-10-05T11:43:24.284 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.280+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.14207824362237615178', time=2023-10-05T13:41:34.866947+0000, chain.objs.size()=1 2023-10-05T11:43:24.284 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.280+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.25__shadow_.exAb4bfgoUgB9KCxXBh_KnNo_sdLtYa_0 2023-10-05T11:43:24.284 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.280+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.13757927786905042644', time=2023-10-05T13:41:34.868156+0000, chain.objs.size()=1 2023-10-05T11:43:24.284 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.280+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.25__shadow_.MXrGtYuRJt4uBOxVXkMm52C_OCqsSd2_0 2023-10-05T11:43:24.284 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.280+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.12065887045537414936', time=2023-10-05T13:41:34.923941+0000, chain.objs.size()=1 2023-10-05T11:43:24.284 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.280+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.25__shadow_.lHT9xLbeJ9stKFs-RuRb_EAyXeFhyGA_0 2023-10-05T11:43:24.284 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.280+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.9803262776076779555', time=2023-10-05T13:42:08.199090+0000, chain.objs.size()=1 2023-10-05T11:43:24.284 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.280+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.27__shadow_.a1eD6d9f7V_MToCtUFE4rVp2YOs4i-y_0 2023-10-05T11:43:24.285 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.280+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.12373850700944021658', time=2023-10-05T13:42:08.893173+0000, chain.objs.size()=1 2023-10-05T11:43:24.285 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.280+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.16__shadow_.24Wxg-ni0kXKZbN2HAwsqhuIF3SnkIU_0 2023-10-05T11:43:24.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.283+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing entries, marker: 2023-10-05T11:43:24.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.286+0000 7fdf7352d880 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2023-10-05T11:43:24.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.287+0000 7fdf7352d880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:43:24.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.287+0000 7fdf7352d880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:43:24.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.288+0000 7fdf7352d880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2023-10-05T11:43:24.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.288+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.4615129885446632945', time=2023-10-05T13:38:52.868006+0000, chain.objs.size()=2 2023-10-05T11:43:24.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.288+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:dff27d1e-df33-400e-a68a-7ba586947c99.4604.14__shadow_.HyTHayXxfVUkBdzTN6BAiFUTiwqOuzV_0 2023-10-05T11:43:24.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.288+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:dff27d1e-df33-400e-a68a-7ba586947c99.4604.14__shadow_.HyTHayXxfVUkBdzTN6BAiFUTiwqOuzV_1 2023-10-05T11:43:24.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.288+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.5380387900909259411', time=2023-10-05T13:39:54.747133+0000, chain.objs.size()=1 2023-10-05T11:43:24.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.288+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.19__shadow_.QJkkN38Sb7rYsvl0fwKxeUa9UFHq1Fh_0 2023-10-05T11:43:24.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.288+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.2284452743976541849', time=2023-10-05T13:39:54.747725+0000, chain.objs.size()=1 2023-10-05T11:43:24.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.288+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.19__shadow_.Wb5WaIdk3aYk0wsNAQW4nuIonIhB4SM_0 2023-10-05T11:43:24.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.288+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.8412487646939916877', time=2023-10-05T13:39:54.769002+0000, chain.objs.size()=1 2023-10-05T11:43:24.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.288+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.19__shadow_.UqRvAqjunfgsG14Q75U-05KJXFO0lH2_0 2023-10-05T11:43:24.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.288+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.6211751291087896392', time=2023-10-05T13:41:34.868770+0000, chain.objs.size()=1 2023-10-05T11:43:24.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.288+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.25__shadow_.mrT-QlfNcP2rhBzeQ1u8cy67Ig4iObj_0 2023-10-05T11:43:24.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.288+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.621796713021708778', time=2023-10-05T13:41:36.546291+0000, chain.objs.size()=1 2023-10-05T11:43:24.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.288+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.26__shadow_.bAu2MlKo9oyA7Bt4XJZvtKXOBPZzQXl_0 2023-10-05T11:43:24.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.290+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing entries, marker: 2023-10-05T11:43:24.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.293+0000 7fdf7352d880 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2023-10-05T11:43:24.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.294+0000 7fdf7352d880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:43:24.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.294+0000 7fdf7352d880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:43:24.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.295+0000 7fdf7352d880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2023-10-05T11:43:24.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.295+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.4000609754370304510', time=2023-10-05T13:38:52.916661+0000, chain.objs.size()=5 2023-10-05T11:43:24.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.295+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:dff27d1e-df33-400e-a68a-7ba586947c99.4604.15__multipart_foo-FROZEN.2~eTH9zomvpT2_DCVGbxdz_khqGa_LaG5.1 2023-10-05T11:43:24.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.295+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:dff27d1e-df33-400e-a68a-7ba586947c99.4604.15__shadow_foo-FROZEN.2~eTH9zomvpT2_DCVGbxdz_khqGa_LaG5.1_1 2023-10-05T11:43:24.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.295+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:dff27d1e-df33-400e-a68a-7ba586947c99.4604.15__multipart_foo-FROZEN.2~eTH9zomvpT2_DCVGbxdz_khqGa_LaG5.2 2023-10-05T11:43:24.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.295+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:dff27d1e-df33-400e-a68a-7ba586947c99.4604.15__shadow_foo-FROZEN.2~eTH9zomvpT2_DCVGbxdz_khqGa_LaG5.2_1 2023-10-05T11:43:24.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.295+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:dff27d1e-df33-400e-a68a-7ba586947c99.4604.15__multipart_foo-FROZEN.2~eTH9zomvpT2_DCVGbxdz_khqGa_LaG5.3 2023-10-05T11:43:24.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.295+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4604.15__multipart_foo-STANDARD.2~Z6dKpa83YGSvhC9lPlIewGuxHObiI7F.2_b40bfc20e170960e0e6ba6f0e697be91', time=2023-10-05T13:38:52.940992+0000, chain.objs.size()=3 2023-10-05T11:43:24.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.295+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.15__multipart_foo-STANDARD.2~Z6dKpa83YGSvhC9lPlIewGuxHObiI7F.1 2023-10-05T11:43:24.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.295+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.15__multipart_foo-STANDARD.2~Z6dKpa83YGSvhC9lPlIewGuxHObiI7F.2 2023-10-05T11:43:24.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.295+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.15__multipart_foo-STANDARD.2~Z6dKpa83YGSvhC9lPlIewGuxHObiI7F.3 2023-10-05T11:43:24.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.295+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.10462076441891704168', time=2023-10-05T13:39:53.387186+0000, chain.objs.size()=1 2023-10-05T11:43:24.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.295+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.18__shadow_.ELZjGwbBOBY83YVcIPRC1fp65xE45_h_0 2023-10-05T11:43:24.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.295+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.17076314838463540397', time=2023-10-05T13:40:59.909934+0000, chain.objs.size()=1 2023-10-05T11:43:24.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.295+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.22__shadow_.whWCrNraksHoleQVvf9HDw5KzCSpMFX_0 2023-10-05T11:43:24.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.295+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.12575165717132333090', time=2023-10-05T13:42:19.574601+0000, chain.objs.size()=1 2023-10-05T11:43:24.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.295+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.17__shadow:PYwFo6uxMwxtB2kyNJomv1-UveJugC5_.pRvdxwaGZ7aWIW81Qo_dF2EhXH-MxPM_0 2023-10-05T11:43:24.302 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.298+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing entries, marker: 2023-10-05T11:43:24.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.301+0000 7fdf7352d880 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2023-10-05T11:43:24.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.302+0000 7fdf7352d880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:43:24.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.302+0000 7fdf7352d880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:43:24.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.302+0000 7fdf7352d880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=8, truncated=0, next_marker='' 2023-10-05T11:43:24.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.302+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='_HQSma6SM2uypwga__GOdLEn7BDq_Rn2', time=2023-10-05T13:38:52.842718+0000, chain.objs.size()=2 2023-10-05T11:43:24.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.302+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.14__shadow_.zeE-ECM8IyFGpwrhLUFbbvzd3f0dUSR_0 2023-10-05T11:43:24.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.302+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.14__shadow_.zeE-ECM8IyFGpwrhLUFbbvzd3f0dUSR_1 2023-10-05T11:43:24.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.302+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='_6daq5jau7eCGJWPsHlUp_8_QRNUK0Xv', time=2023-10-05T13:38:52.932540+0000, chain.objs.size()=3 2023-10-05T11:43:24.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.302+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.15__shadow_.rE-HILhYOpAGk_gQTztX2cNkdgNjUf7_0 2023-10-05T11:43:24.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.302+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.15__shadow_.rE-HILhYOpAGk_gQTztX2cNkdgNjUf7_1 2023-10-05T11:43:24.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.302+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.15__shadow_.rE-HILhYOpAGk_gQTztX2cNkdgNjUf7_2 2023-10-05T11:43:24.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.302+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.17331514491489228034', time=2023-10-05T13:38:53.083002+0000, chain.objs.size()=1 2023-10-05T11:43:24.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.302+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.6__shadow_.cSyBCkpsHu2zw15yZdDB7QjC7HhmIx1_0 2023-10-05T11:43:24.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.303+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.6739810915010666136', time=2023-10-05T13:39:54.779608+0000, chain.objs.size()=1 2023-10-05T11:43:24.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.303+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.19__shadow_.vpPY_xmduUuEtmYnLsGyrsHnHfyRiSr_0 2023-10-05T11:43:24.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.303+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.9396210464737039391', time=2023-10-05T13:40:28.159378+0000, chain.objs.size()=1 2023-10-05T11:43:24.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.303+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.21__shadow_.3wLsjFZS4tRWVGj9-e71TIC6YKeNQcl_0 2023-10-05T11:43:24.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.303+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.6881405633680240371', time=2023-10-05T13:41:01.599983+0000, chain.objs.size()=1 2023-10-05T11:43:24.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.303+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.23__shadow_.IpITVs322cP6NOGnZUobHl6Sbq43kKH_0 2023-10-05T11:43:24.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.303+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.12368146544600417380', time=2023-10-05T13:41:03.107763+0000, chain.objs.size()=1 2023-10-05T11:43:24.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.303+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.24__shadow_.KaVPuaoVEn9ibctXanwFkctFmLI4_in_0 2023-10-05T11:43:24.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.303+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.5901227357723549121', time=2023-10-05T13:41:36.509246+0000, chain.objs.size()=1 2023-10-05T11:43:24.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.303+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.26__shadow_.yPbmyNxv6EA2G7s5pcb1-CTZ0t2-FKV_0 2023-10-05T11:43:24.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.309+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing entries, marker: 2023-10-05T11:43:24.314 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.311+0000 7fdf7352d880 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2023-10-05T11:43:24.315 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.312+0000 7fdf7352d880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:43:24.316 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.313+0000 7fdf7352d880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:43:24.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.314+0000 7fdf7352d880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2023-10-05T11:43:24.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.314+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.15717047954087568131', time=2023-10-05T13:39:53.420003+0000, chain.objs.size()=1 2023-10-05T11:43:24.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.314+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.18__shadow_.ky8-4cfZ17w6Q-OSvbFggLfQqNmdYey_0 2023-10-05T11:43:24.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.314+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.5946092636540317885', time=2023-10-05T13:41:01.538034+0000, chain.objs.size()=1 2023-10-05T11:43:24.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.314+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.23__shadow_.Qo3QEkzsgP2xoANBouPqNWFCPukHUpy_0 2023-10-05T11:43:24.318 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.314+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.1618466025065575569', time=2023-10-05T13:41:01.599612+0000, chain.objs.size()=1 2023-10-05T11:43:24.318 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.314+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.23__shadow_.oM9a8SM0SAgGPAeTiA5C6--bJHQomJ1_0 2023-10-05T11:43:24.318 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.314+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.4770410285198944906', time=2023-10-05T13:41:03.114659+0000, chain.objs.size()=1 2023-10-05T11:43:24.318 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.314+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.24__shadow_.UuHShDfNEPlKzTnqewW93--y5-WCmmc_0 2023-10-05T11:43:24.318 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.314+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.1779193695009786689', time=2023-10-05T13:41:34.832423+0000, chain.objs.size()=1 2023-10-05T11:43:24.318 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.314+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.25__shadow_.J8dftv8w-2Ao7DXjhFO0B1dsHUZY1hC_0 2023-10-05T11:43:24.318 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.314+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.15886959446227112856', time=2023-10-05T13:41:36.474180+0000, chain.objs.size()=1 2023-10-05T11:43:24.318 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.314+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.26__shadow_.-gjieAMLUPT4wE455r8GyWVwXhdOzlI_0 2023-10-05T11:43:24.320 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.317+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing entries, marker: 2023-10-05T11:43:24.322 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.319+0000 7fdf7352d880 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2023-10-05T11:43:24.323 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.320+0000 7fdf7352d880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:43:24.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.321+0000 7fdf7352d880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:43:24.325 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.321+0000 7fdf7352d880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2023-10-05T11:43:24.326 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.321+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.9076493676790453196', time=2023-10-05T13:38:52.680104+0000, chain.objs.size()=1 2023-10-05T11:43:24.326 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.321+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.4__shadow_.DK40kz-nN2pWp_fNPLsrvxkJUGeQMbf_0 2023-10-05T11:43:24.326 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.321+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.5904944730400437824', time=2023-10-05T13:40:59.909370+0000, chain.objs.size()=1 2023-10-05T11:43:24.326 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.321+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.22__shadow_.BepySvleX7ROxel7ODM-NF1WPFqOb34_0 2023-10-05T11:43:24.327 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.321+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.14418838362357446738', time=2023-10-05T13:40:59.910312+0000, chain.objs.size()=1 2023-10-05T11:43:24.327 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.321+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.22__shadow_.OggN4M8W9d6f3Ptugvj_9gf6pesgzF6_0 2023-10-05T11:43:24.327 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.321+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.3124850357173938743', time=2023-10-05T13:41:01.547546+0000, chain.objs.size()=1 2023-10-05T11:43:24.327 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.321+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.23__shadow_.9Gg9ntItGgrQ7DzdVyQez2ToFpIhPDy_0 2023-10-05T11:43:24.327 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.321+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.16372073738343230692', time=2023-10-05T13:41:34.869818+0000, chain.objs.size()=1 2023-10-05T11:43:24.327 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.321+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.25__shadow_.g8iOXp5M8x5e8bkV-BRQR7xY5beOMCI_0 2023-10-05T11:43:24.327 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.321+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.16820812100108902252', time=2023-10-05T13:42:08.209512+0000, chain.objs.size()=1 2023-10-05T11:43:24.327 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.321+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.27__shadow_.tWTzUUUvKYBEIkWu-rmr18YeC-Odqlh_0 2023-10-05T11:43:24.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.324+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing entries, marker: 2023-10-05T11:43:24.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.327+0000 7fdf7352d880 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2023-10-05T11:43:24.332 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.328+0000 7fdf7352d880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:43:24.334 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.329+0000 7fdf7352d880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:43:24.334 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.329+0000 7fdf7352d880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=8, truncated=0, next_marker='' 2023-10-05T11:43:24.334 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.329+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.9172761051855772569', time=2023-10-05T13:38:52.788709+0000, chain.objs.size()=4 2023-10-05T11:43:24.334 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.329+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.9__multipart_foo.2~Lkl9yRqzDBNexhelDrW8L6l2EAL2Iud.1 2023-10-05T11:43:24.334 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.329+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.9__multipart_foo.2~Lkl9yRqzDBNexhelDrW8L6l2EAL2Iud.2 2023-10-05T11:43:24.334 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.329+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.9__multipart_foo.2~Lkl9yRqzDBNexhelDrW8L6l2EAL2Iud.3 2023-10-05T11:43:24.334 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.329+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.9__multipart_foo.2~Lkl9yRqzDBNexhelDrW8L6l2EAL2Iud.4 2023-10-05T11:43:24.335 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.329+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4604.14__shadow_.HyTHayXxfVUkBdzTN6BAiFUTiwqOuzV_1_6423ab5c67962c460ecfbf63d8917aea', time=2023-10-05T13:38:52.875919+0000, chain.objs.size()=2 2023-10-05T11:43:24.335 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.329+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:dff27d1e-df33-400e-a68a-7ba586947c99.4604.14__shadow_.HyTHayXxfVUkBdzTN6BAiFUTiwqOuzV_0 2023-10-05T11:43:24.335 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.329+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:dff27d1e-df33-400e-a68a-7ba586947c99.4604.14__shadow_.HyTHayXxfVUkBdzTN6BAiFUTiwqOuzV_1 2023-10-05T11:43:24.335 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.329+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.17557920844989408581', time=2023-10-05T13:38:52.928468+0000, chain.objs.size()=3 2023-10-05T11:43:24.335 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.329+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.15__multipart_foo-STANDARD.2~Z6dKpa83YGSvhC9lPlIewGuxHObiI7F.1 2023-10-05T11:43:24.335 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.329+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.15__multipart_foo-STANDARD.2~Z6dKpa83YGSvhC9lPlIewGuxHObiI7F.2 2023-10-05T11:43:24.335 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.329+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.15__multipart_foo-STANDARD.2~Z6dKpa83YGSvhC9lPlIewGuxHObiI7F.3 2023-10-05T11:43:24.335 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.329+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.15590107211570053828', time=2023-10-05T13:39:53.375135+0000, chain.objs.size()=1 2023-10-05T11:43:24.335 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.329+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.18__shadow_.k-S8ZYbhgQBLpMIWmGf-gjLVSMF5TQ4_0 2023-10-05T11:43:24.335 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.329+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.6835199528595566585', time=2023-10-05T13:39:53.418199+0000, chain.objs.size()=1 2023-10-05T11:43:24.335 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.329+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.18__shadow_.9eWUwpeAg3tDvjzfFsk8TfkeJRHVKTJ_0 2023-10-05T11:43:24.335 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.329+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.15734271498284311484', time=2023-10-05T13:41:01.538362+0000, chain.objs.size()=1 2023-10-05T11:43:24.336 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.329+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.23__shadow_.NyWqDOh3TJHgWLdOmQG5FkPW-0_Lvpt_0 2023-10-05T11:43:24.336 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.333+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.5913319279934993873', time=2023-10-05T13:41:03.079101+0000, chain.objs.size()=1 2023-10-05T11:43:24.336 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.333+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.24__shadow_.BPsFSYiW4jnfS8V82HJG7TyvWpF0o5V_0 2023-10-05T11:43:24.336 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.333+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.9696984490491624545', time=2023-10-05T13:42:08.179227+0000, chain.objs.size()=1 2023-10-05T11:43:24.336 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.333+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.27__shadow_.T9zC6k_St1ljzMpPDfrRbDj54uC-QTO_0 2023-10-05T11:43:24.339 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.336+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing entries, marker: 2023-10-05T11:43:24.341 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.338+0000 7fdf7352d880 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2023-10-05T11:43:24.343 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.340+0000 7fdf7352d880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:43:24.343 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.340+0000 7fdf7352d880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:43:24.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.341+0000 7fdf7352d880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=8, truncated=0, next_marker='' 2023-10-05T11:43:24.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.341+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.1958357894716679094', time=2023-10-05T13:38:52.981736+0000, chain.objs.size()=3 2023-10-05T11:43:24.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.341+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.13__multipart_foo-STANDARD.2~laFwYJkJ7VQDQWgNvvI__y8FvtejLg2.1 2023-10-05T11:43:24.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.341+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.13__multipart_foo-STANDARD.2~laFwYJkJ7VQDQWgNvvI__y8FvtejLg2.2 2023-10-05T11:43:24.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.341+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.13__multipart_foo-STANDARD.2~laFwYJkJ7VQDQWgNvvI__y8FvtejLg2.3 2023-10-05T11:43:24.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.341+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.4350710849765593669', time=2023-10-05T13:39:54.746759+0000, chain.objs.size()=1 2023-10-05T11:43:24.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.341+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.19__shadow_.L7ztaJkNEaYh2gOyaeZgj3YGkmtyXtO_0 2023-10-05T11:43:24.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.341+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.17403464164133404701', time=2023-10-05T13:39:54.778556+0000, chain.objs.size()=1 2023-10-05T11:43:24.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.341+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.19__shadow_.83P8GUl5mYd2hvh9i1M5XL4zEFYA9Ey_0 2023-10-05T11:43:24.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.341+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.2135680827535051657', time=2023-10-05T13:41:01.555977+0000, chain.objs.size()=1 2023-10-05T11:43:24.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.341+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.23__shadow_.bPiVKZYiozjwUw1t-zcxyvkEiCkqOgx_0 2023-10-05T11:43:24.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.341+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.15233034305346173632', time=2023-10-05T13:41:03.143781+0000, chain.objs.size()=1 2023-10-05T11:43:24.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.341+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.24__shadow_.d9kwSpDCeBFWfX0r8VGWmU6q2y4BDUB_0 2023-10-05T11:43:24.346 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.341+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.16365321878806070433', time=2023-10-05T13:41:34.875637+0000, chain.objs.size()=1 2023-10-05T11:43:24.346 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.341+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.25__shadow_.4ZuPVi-mfBCJosh67insrT2b1MyqmRg_0 2023-10-05T11:43:24.346 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.341+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.5809289740859330449', time=2023-10-05T13:42:08.206281+0000, chain.objs.size()=1 2023-10-05T11:43:24.346 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.341+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.27__shadow_.iI5fUZK9tYjHpziZANSoWlv5HTWYMnz_0 2023-10-05T11:43:24.346 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.341+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.15936652759185106905', time=2023-10-05T13:42:08.892997+0000, chain.objs.size()=1 2023-10-05T11:43:24.346 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.341+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.16__shadow_.35kL5oncgVdj1owljdXSu9DPrGLYKBZ_0 2023-10-05T11:43:24.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.345+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing entries, marker: 2023-10-05T11:43:24.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.347+0000 7fdf7352d880 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2023-10-05T11:43:24.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.349+0000 7fdf7352d880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:43:24.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.349+0000 7fdf7352d880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:43:24.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.350+0000 7fdf7352d880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2023-10-05T11:43:24.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.350+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.12847283017947720595', time=2023-10-05T13:38:52.675900+0000, chain.objs.size()=1 2023-10-05T11:43:24.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.350+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.4__shadow_.koOM-cdaEP_onJg81A8iG5uYCZ5UHVd_0 2023-10-05T11:43:24.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.350+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.8318324459391095395', time=2023-10-05T13:39:53.421345+0000, chain.objs.size()=1 2023-10-05T11:43:24.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.350+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.18__shadow_.P7eLxM1QOAzA7BEuTu5_p7WdR8rXgDD_0 2023-10-05T11:43:24.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.350+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.5809035414528165306', time=2023-10-05T13:39:54.811469+0000, chain.objs.size()=1 2023-10-05T11:43:24.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.350+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.19__shadow_.0ux1bHsThYajV9mLgATga7Bks0qeT-p_0 2023-10-05T11:43:24.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.350+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.509064993152344201', time=2023-10-05T13:40:26.550043+0000, chain.objs.size()=1 2023-10-05T11:43:24.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.350+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.20__shadow_.--_2NSSwJtN429jyKzP_XXo77Odz1po_0 2023-10-05T11:43:24.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.350+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.10222036615192298778', time=2023-10-05T13:40:28.150347+0000, chain.objs.size()=1 2023-10-05T11:43:24.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.350+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.21__shadow_.w3LHo7IlrwEi8gxXd3OOYzv-dxbK4hr_0 2023-10-05T11:43:24.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.350+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.18283462003516608703', time=2023-10-05T13:42:08.241260+0000, chain.objs.size()=1 2023-10-05T11:43:24.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.350+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.27__shadow_.AUtU-CKnaTRyC1y_D3YZLOj9T6DArfL_0 2023-10-05T11:43:24.356 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.353+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing entries, marker: 2023-10-05T11:43:24.358 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.355+0000 7fdf7352d880 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2023-10-05T11:43:24.359 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.356+0000 7fdf7352d880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:43:24.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.357+0000 7fdf7352d880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:43:24.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.357+0000 7fdf7352d880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=9, truncated=0, next_marker='' 2023-10-05T11:43:24.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.357+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.8729090374544412441', time=2023-10-05T13:38:52.814964+0000, chain.objs.size()=7 2023-10-05T11:43:24.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.357+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.8__multipart_foo.2~2WTdJ1yYcOXbi5kFG_iIZ8SepiY-z1j.1 2023-10-05T11:43:24.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.357+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.8__shadow_foo.2~2WTdJ1yYcOXbi5kFG_iIZ8SepiY-z1j.1_1 2023-10-05T11:43:24.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.357+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.8__multipart_foo.2~2WTdJ1yYcOXbi5kFG_iIZ8SepiY-z1j.2 2023-10-05T11:43:24.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.357+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.8__shadow_foo.2~2WTdJ1yYcOXbi5kFG_iIZ8SepiY-z1j.2_1 2023-10-05T11:43:24.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.357+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.8__multipart_foo.2~2WTdJ1yYcOXbi5kFG_iIZ8SepiY-z1j.3 2023-10-05T11:43:24.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.357+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.8__shadow_foo.2~2WTdJ1yYcOXbi5kFG_iIZ8SepiY-z1j.3_1 2023-10-05T11:43:24.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.357+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.8__multipart_foo.2~2WTdJ1yYcOXbi5kFG_iIZ8SepiY-z1j.4 2023-10-05T11:43:24.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.357+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.12024535468307055096', time=2023-10-05T13:38:52.936852+0000, chain.objs.size()=5 2023-10-05T11:43:24.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.357+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:dff27d1e-df33-400e-a68a-7ba586947c99.4604.15__multipart_foo-LUKEWARM.2~YLmts8n3fu7wg5fqcOFoiJoJ0cwqF0e.1 2023-10-05T11:43:24.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.357+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:dff27d1e-df33-400e-a68a-7ba586947c99.4604.15__shadow_foo-LUKEWARM.2~YLmts8n3fu7wg5fqcOFoiJoJ0cwqF0e.1_1 2023-10-05T11:43:24.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.357+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:dff27d1e-df33-400e-a68a-7ba586947c99.4604.15__multipart_foo-LUKEWARM.2~YLmts8n3fu7wg5fqcOFoiJoJ0cwqF0e.2 2023-10-05T11:43:24.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.357+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:dff27d1e-df33-400e-a68a-7ba586947c99.4604.15__shadow_foo-LUKEWARM.2~YLmts8n3fu7wg5fqcOFoiJoJ0cwqF0e.2_1 2023-10-05T11:43:24.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.357+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:dff27d1e-df33-400e-a68a-7ba586947c99.4604.15__multipart_foo-LUKEWARM.2~YLmts8n3fu7wg5fqcOFoiJoJ0cwqF0e.3 2023-10-05T11:43:24.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.360+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4604.15__shadow_foo-LUKEWARM.2~YLmts8n3fu7wg5fqcOFoiJoJ0cwqF0e.1_1_9649c73d0337f7a97a31faa8f7cdead5', time=2023-10-05T13:38:52.944882+0000, chain.objs.size()=5 2023-10-05T11:43:24.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.360+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:dff27d1e-df33-400e-a68a-7ba586947c99.4604.15__multipart_foo-LUKEWARM.2~YLmts8n3fu7wg5fqcOFoiJoJ0cwqF0e.1 2023-10-05T11:43:24.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.361+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:dff27d1e-df33-400e-a68a-7ba586947c99.4604.15__shadow_foo-LUKEWARM.2~YLmts8n3fu7wg5fqcOFoiJoJ0cwqF0e.1_1 2023-10-05T11:43:24.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.361+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:dff27d1e-df33-400e-a68a-7ba586947c99.4604.15__multipart_foo-LUKEWARM.2~YLmts8n3fu7wg5fqcOFoiJoJ0cwqF0e.2 2023-10-05T11:43:24.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.361+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:dff27d1e-df33-400e-a68a-7ba586947c99.4604.15__shadow_foo-LUKEWARM.2~YLmts8n3fu7wg5fqcOFoiJoJ0cwqF0e.2_1 2023-10-05T11:43:24.365 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.361+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:dff27d1e-df33-400e-a68a-7ba586947c99.4604.15__multipart_foo-LUKEWARM.2~YLmts8n3fu7wg5fqcOFoiJoJ0cwqF0e.3 2023-10-05T11:43:24.365 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.361+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.5227784691186849772', time=2023-10-05T13:38:53.075047+0000, chain.objs.size()=1 2023-10-05T11:43:24.365 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.361+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.6__shadow_.zOdJDCiRyiqJe7M7cBTRa2bqKCzA1gZ_0 2023-10-05T11:43:24.366 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.362+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.10472093754110390198', time=2023-10-05T13:39:54.768430+0000, chain.objs.size()=1 2023-10-05T11:43:24.366 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.362+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.19__shadow_.FQZQ5G4Q9wXU90dbh_HrSAHw9rTUa6B_0 2023-10-05T11:43:24.366 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.362+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.16899383452960278771', time=2023-10-05T13:40:59.909374+0000, chain.objs.size()=1 2023-10-05T11:43:24.366 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.362+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.22__shadow_.J0utKnkKEsMuSYgzF5DDTtU4xgbkY81_0 2023-10-05T11:43:24.366 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.362+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.3885451951699040513', time=2023-10-05T13:41:34.869720+0000, chain.objs.size()=1 2023-10-05T11:43:24.366 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.362+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.25__shadow_.sl16t426d9LNseESb78GF8t2HK34sAC_0 2023-10-05T11:43:24.366 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.362+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.8291776996511966076', time=2023-10-05T13:41:34.890725+0000, chain.objs.size()=1 2023-10-05T11:43:24.366 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.362+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.25__shadow_.Zh_cLbpfcnxc8EDww74dQDuTwLK6QrM_0 2023-10-05T11:43:24.366 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.362+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.9189193736060639194', time=2023-10-05T13:41:34.924683+0000, chain.objs.size()=1 2023-10-05T11:43:24.366 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.362+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.25__shadow_.4iFwMbkAR39cDoKktwg64mYaIgk-91M_0 2023-10-05T11:43:24.369 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.366+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing entries, marker: 2023-10-05T11:43:24.371 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.368+0000 7fdf7352d880 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2023-10-05T11:43:24.373 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.370+0000 7fdf7352d880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:43:24.373 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.370+0000 7fdf7352d880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:43:24.375 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.370+0000 7fdf7352d880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=9, truncated=0, next_marker='' 2023-10-05T11:43:24.375 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.370+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4604.14__shadow_.GI4GSSKuf5EYhZ2Rl_eVZ8rQ9pvybAv_1_d085f501e0d8b997692cb3c2b8961949', time=2023-10-05T13:38:52.871934+0000, chain.objs.size()=1 2023-10-05T11:43:24.375 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.370+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.14__shadow_.GI4GSSKuf5EYhZ2Rl_eVZ8rQ9pvybAv_0 2023-10-05T11:43:24.375 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.370+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.5894538664764713404', time=2023-10-05T13:38:53.079175+0000, chain.objs.size()=1 2023-10-05T11:43:24.375 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.370+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.6__shadow_.4Er4u8AHde644sIewOYPU1SRhV54344_0 2023-10-05T11:43:24.375 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.370+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.1892758116769854246', time=2023-10-05T13:40:26.519316+0000, chain.objs.size()=1 2023-10-05T11:43:24.376 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.370+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.20__shadow_.rSPhwqQCp305SoEEo4XYMdP2ZOyK76o_0 2023-10-05T11:43:24.376 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.370+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.12989346482278690211', time=2023-10-05T13:40:26.565540+0000, chain.objs.size()=1 2023-10-05T11:43:24.376 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.370+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.20__shadow_.hxZSfvMAnAkqjDeb0g0wcir40KY-dpg_0 2023-10-05T11:43:24.376 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.370+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.16050092359628827484', time=2023-10-05T13:40:29.358208+0000, chain.objs.size()=1 2023-10-05T11:43:24.376 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.370+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.22__shadow_.zsRG9khF1_M9xY7-mMmvusM4WhrUX89_0 2023-10-05T11:43:24.376 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.371+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.16453308983901721363', time=2023-10-05T13:41:03.145472+0000, chain.objs.size()=1 2023-10-05T11:43:24.376 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.371+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.24__shadow_.57SWgcMhPP108F8UdKH06KRBDEoRuke_0 2023-10-05T11:43:24.376 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.371+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.7593853310144673371', time=2023-10-05T13:41:36.494118+0000, chain.objs.size()=1 2023-10-05T11:43:24.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.371+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.26__shadow_.jIvamQzCWbvBAMubwskkG4lgXlFTHYT_0 2023-10-05T11:43:24.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.371+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.2355642025365268952', time=2023-10-05T13:41:36.494740+0000, chain.objs.size()=1 2023-10-05T11:43:24.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.371+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.26__shadow_.zqqOfz7gdoU_eb7EJ2IYDKgp6iHKAnb_0 2023-10-05T11:43:24.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.371+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.8841037659743255666', time=2023-10-05T13:42:07.776792+0000, chain.objs.size()=1 2023-10-05T11:43:24.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.371+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.27__shadow_.bEIrfvb2PNaMC1kWlBzIJ9K0Bus6it6_0 2023-10-05T11:43:24.378 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.375+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing entries, marker: 2023-10-05T11:43:24.380 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.377+0000 7fdf7352d880 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2023-10-05T11:43:24.382 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.379+0000 7fdf7352d880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:43:24.383 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.379+0000 7fdf7352d880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:43:24.384 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.380+0000 7fdf7352d880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=7, truncated=0, next_marker='' 2023-10-05T11:43:24.384 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.380+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.3585161418491478297', time=2023-10-05T13:38:52.702038+0000, chain.objs.size()=1 2023-10-05T11:43:24.384 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.380+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.4__shadow_.Xzwm3crQQ_Hk9h9xNDbVk-KgBzjkpzv_0 2023-10-05T11:43:24.384 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.380+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.1029702361583987993', time=2023-10-05T13:39:53.375658+0000, chain.objs.size()=1 2023-10-05T11:43:24.384 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.380+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.18__shadow_.E5f2LW5qDzF1u7bpo3DsHnS3PUkeWdv_0 2023-10-05T11:43:24.384 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.380+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.15893503769172977936', time=2023-10-05T13:40:28.157368+0000, chain.objs.size()=1 2023-10-05T11:43:24.384 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.380+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.21__shadow_.SqJ3C5ihfrgOgVJkf1zKzlOSGixrAmn_0 2023-10-05T11:43:24.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.380+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.247878486823402560', time=2023-10-05T13:40:59.894979+0000, chain.objs.size()=1 2023-10-05T11:43:24.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.380+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.22__shadow_.7VoMYQDd2G-fqE6Bdd5w4FYK0MnT-lV_0 2023-10-05T11:43:24.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.380+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.7255589361802069144', time=2023-10-05T13:40:59.895522+0000, chain.objs.size()=1 2023-10-05T11:43:24.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.380+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.22__shadow_.n0w7bi0LPcVSzh4M98pdBHDmcUwvKnD_0 2023-10-05T11:43:24.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.380+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.2568556337898575589', time=2023-10-05T13:41:36.497615+0000, chain.objs.size()=1 2023-10-05T11:43:24.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.380+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.26__shadow_.QLCorph_7b2g7BdXnuxZPHvzCTHRoIj_0 2023-10-05T11:43:24.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.380+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.16624091517257539671', time=2023-10-05T13:42:08.178332+0000, chain.objs.size()=1 2023-10-05T11:43:24.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.380+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.27__shadow_.4n_y4_Ojex9IAcx8R-6lzcPEHwef5GC_0 2023-10-05T11:43:24.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.383+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing entries, marker: 2023-10-05T11:43:24.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.385+0000 7fdf7352d880 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2023-10-05T11:43:24.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.386+0000 7fdf7352d880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:43:24.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.387+0000 7fdf7352d880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:43:24.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.387+0000 7fdf7352d880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2023-10-05T11:43:24.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.387+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.13681675811853073687', time=2023-10-05T13:41:03.083822+0000, chain.objs.size()=1 2023-10-05T11:43:24.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.387+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.24__shadow_.riSGmPdlim60m92q0JjRxmj0D4D4yFm_0 2023-10-05T11:43:24.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.387+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.17090628796573842321', time=2023-10-05T13:41:03.084470+0000, chain.objs.size()=1 2023-10-05T11:43:24.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.387+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.24__shadow_.48D3eAzg_PkLLNL65KPwJ1P8kvjnC4e_0 2023-10-05T11:43:24.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.387+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.4550312918659970174', time=2023-10-05T13:41:36.494063+0000, chain.objs.size()=1 2023-10-05T11:43:24.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.387+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.26__shadow_.gyqP1lRWbMWcKKCTB15ZVdkYihKH-El_0 2023-10-05T11:43:24.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.389+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing entries, marker: 2023-10-05T11:43:24.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.391+0000 7fdf7352d880 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2023-10-05T11:43:24.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.393+0000 7fdf7352d880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:43:24.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.393+0000 7fdf7352d880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:43:24.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.394+0000 7fdf7352d880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=14, truncated=0, next_marker='' 2023-10-05T11:43:24.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.394+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='_zWVjy7Rak0ddjwUsdfq3FDXdRddGvCM', time=2023-10-05T13:38:52.912658+0000, chain.objs.size()=3 2023-10-05T11:43:24.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.394+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.15__shadow_.aacmbLLysPQ497cbvWkpYQEqtSWSywH_0 2023-10-05T11:43:24.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.394+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.15__shadow_.aacmbLLysPQ497cbvWkpYQEqtSWSywH_1 2023-10-05T11:43:24.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.394+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.15__shadow_.aacmbLLysPQ497cbvWkpYQEqtSWSywH_2 2023-10-05T11:43:24.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.394+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='_bUPuo0nOspwRkS7uhU6Sh13wG1oyv5E', time=2023-10-05T13:38:52.924752+0000, chain.objs.size()=3 2023-10-05T11:43:24.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.394+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:dff27d1e-df33-400e-a68a-7ba586947c99.4604.15__shadow_.x84OyxPid3E8XTidfAxZhxyH4oqTYSR_0 2023-10-05T11:43:24.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.394+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:dff27d1e-df33-400e-a68a-7ba586947c99.4604.15__shadow_.x84OyxPid3E8XTidfAxZhxyH4oqTYSR_1 2023-10-05T11:43:24.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.394+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:dff27d1e-df33-400e-a68a-7ba586947c99.4604.15__shadow_.x84OyxPid3E8XTidfAxZhxyH4oqTYSR_2 2023-10-05T11:43:24.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.394+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.13165101542196247068', time=2023-10-05T13:38:53.013682+0000, chain.objs.size()=1 2023-10-05T11:43:24.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.394+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.12__shadow_.OC4Luwmy2-uNv_aelh0xYvg_pdJciZg_0 2023-10-05T11:43:24.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.394+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.65461326445119485', time=2023-10-05T13:39:53.385716+0000, chain.objs.size()=1 2023-10-05T11:43:24.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.394+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.18__shadow_.ffi1pM33WUTBGW593p5_tjwRG6OEmnQ_0 2023-10-05T11:43:24.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.394+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.2654391909535241337', time=2023-10-05T13:39:53.417376+0000, chain.objs.size()=1 2023-10-05T11:43:24.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.394+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.18__shadow_.jyyMRP3ltpAHexXj092-CdJgcknCW9c_0 2023-10-05T11:43:24.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.394+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.3349042135191835840', time=2023-10-05T13:40:26.541826+0000, chain.objs.size()=1 2023-10-05T11:43:24.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.394+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.20__shadow_.vq9Iu5fN4Ra5yyuC2ccAfEe-n6SG3c3_0 2023-10-05T11:43:24.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.394+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.14234527074366993226', time=2023-10-05T13:40:28.189448+0000, chain.objs.size()=1 2023-10-05T11:43:24.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.394+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.21__shadow_.CzJxSwH_ONd-cWkhMF0R1qq-RTa3AO8_0 2023-10-05T11:43:24.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.394+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.10783067700489698137', time=2023-10-05T13:40:59.930170+0000, chain.objs.size()=1 2023-10-05T11:43:24.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.394+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.22__shadow_.YPV-fGlm91b48t9xaq2rohHFrYylhWQ_0 2023-10-05T11:43:24.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.399+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.14777022211368222859', time=2023-10-05T13:41:01.595336+0000, chain.objs.size()=1 2023-10-05T11:43:24.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.399+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.23__shadow_.Gafxk3py7SgnWihbTz7S2HsjRm1MlsX_0 2023-10-05T11:43:24.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.399+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.18352837600512651102', time=2023-10-05T13:41:03.098264+0000, chain.objs.size()=1 2023-10-05T11:43:24.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.399+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.24__shadow_.jLmtB2mg1XqkAY1W-XOTlqh47GtlFOA_0 2023-10-05T11:43:24.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.399+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.758193177061928728', time=2023-10-05T13:41:03.107713+0000, chain.objs.size()=1 2023-10-05T11:43:24.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.399+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.24__shadow_.ZnvmQe5GWx091HDX26HoLHNPstqNPpH_0 2023-10-05T11:43:24.403 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.399+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.15014800367900410509', time=2023-10-05T13:41:34.892284+0000, chain.objs.size()=1 2023-10-05T11:43:24.403 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.399+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.25__shadow_.I5cLIcFd6U97UcxlFyOnt-92gMaBJzG_0 2023-10-05T11:43:24.404 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.401+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.15420463940089605156', time=2023-10-05T13:42:08.160361+0000, chain.objs.size()=1 2023-10-05T11:43:24.404 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.401+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.27__shadow_.PFybY6EkwGjoK58xxk4OqnfLYKitySU_0 2023-10-05T11:43:24.404 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.401+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.8619683988259205087', time=2023-10-05T13:42:08.178187+0000, chain.objs.size()=1 2023-10-05T11:43:24.404 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.401+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.27__shadow_.LHuyjhr3PYFCeCRp8mjpQIbHBge5FEd_0 2023-10-05T11:43:24.406 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.403+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing entries, marker: 2023-10-05T11:43:24.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.406+0000 7fdf7352d880 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2023-10-05T11:43:24.410 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.407+0000 7fdf7352d880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:43:24.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.407+0000 7fdf7352d880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:43:24.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.408+0000 7fdf7352d880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2023-10-05T11:43:24.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.408+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='_k8x9CeOeN49Akmu-Sxt9nge5HUNWveh', time=2023-10-05T13:38:52.855146+0000, chain.objs.size()=2 2023-10-05T11:43:24.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.408+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:dff27d1e-df33-400e-a68a-7ba586947c99.4604.14__shadow_.GU4sVdNGzLYSCcY_JuxWSV6D5zpltGY_0 2023-10-05T11:43:24.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.408+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:dff27d1e-df33-400e-a68a-7ba586947c99.4604.14__shadow_.GU4sVdNGzLYSCcY_JuxWSV6D5zpltGY_1 2023-10-05T11:43:24.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.408+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='_NuyELYtsflu2FhWFXnU3geAk6v97wm7', time=2023-10-05T13:38:52.879830+0000, chain.objs.size()=1 2023-10-05T11:43:24.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.408+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:dff27d1e-df33-400e-a68a-7ba586947c99.4604.14__shadow_.jlY4YeqRkB8slVYN8tQ4WN9-0lMH8bh_0 2023-10-05T11:43:24.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.408+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.2715558018176546173', time=2023-10-05T13:40:28.123197+0000, chain.objs.size()=1 2023-10-05T11:43:24.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.408+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.21__shadow_.tvIiMk1TlXY7RbRWLdqgcbHDIbQ5JU__0 2023-10-05T11:43:24.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.408+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.12125222566809952699', time=2023-10-05T13:40:59.918126+0000, chain.objs.size()=1 2023-10-05T11:43:24.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.408+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.22__shadow_.s7HK7beHZJBMLAxsLX5Smy-iolqdm8G_0 2023-10-05T11:43:24.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.408+0000 7fdf7352d880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.11164430683688876841', time=2023-10-05T13:42:15.729266+0000, chain.objs.size()=1 2023-10-05T11:43:24.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.408+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.17__shadow:Kyya09HSaL2O.BOy7oKK9hnp90gxo2h_.51Rq4GKYjcX1ppmPV06bhKWPZi2BdiX_0 2023-10-05T11:43:24.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.410+0000 7fdf7352d880 5 garbage collection: RGWGC::process removing entries, marker: 2023-10-05T11:43:24.416 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.413+0000 7fdf56edb640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:43:24.419 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.416+0000 7fdf7352d880 20 remove_watcher() i=0 2023-10-05T11:43:24.419 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.416+0000 7fdf7352d880 2 removed watcher, disabling cache 2023-10-05T11:43:24.420 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.417+0000 7fdf7352d880 20 remove_watcher() i=1 2023-10-05T11:43:24.421 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.418+0000 7fdf7352d880 20 remove_watcher() i=2 2023-10-05T11:43:24.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.419+0000 7fdf7352d880 20 remove_watcher() i=3 2023-10-05T11:43:24.423 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.420+0000 7fdf7352d880 20 remove_watcher() i=4 2023-10-05T11:43:24.424 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.421+0000 7fdf7352d880 20 remove_watcher() i=5 2023-10-05T11:43:24.425 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.422+0000 7fdf7352d880 20 remove_watcher() i=6 2023-10-05T11:43:24.426 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.423+0000 7fdf7352d880 20 remove_watcher() i=7 2023-10-05T11:43:24.431 DEBUG:teuthology.orchestra.run.smithi012:> radosgw-admin gc process --include-all 2023-10-05T11:43:24.482 INFO:teuthology.orchestra.run.smithi012.stderr:ignoring --setuser ceph since I am not root 2023-10-05T11:43:24.482 INFO:teuthology.orchestra.run.smithi012.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T11:43:24.494 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.491+0000 7f2ad4fa2880 20 rados->read ofs=0 len=0 2023-10-05T11:43:24.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.492+0000 7f2ad4fa2880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:43:24.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.492+0000 7f2ad4fa2880 20 realm 2023-10-05T11:43:24.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.492+0000 7f2ad4fa2880 20 rados->read ofs=0 len=0 2023-10-05T11:43:24.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.493+0000 7f2ad4fa2880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:43:24.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.493+0000 7f2ad4fa2880 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T11:43:24.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.493+0000 7f2ad4fa2880 20 rados->read ofs=0 len=0 2023-10-05T11:43:24.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.493+0000 7f2ad4fa2880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:43:24.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.493+0000 7f2ad4fa2880 20 rados->read ofs=0 len=0 2023-10-05T11:43:24.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.494+0000 7f2ad4fa2880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:43:24.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.494+0000 7f2ad4fa2880 20 rados->read ofs=0 len=0 2023-10-05T11:43:24.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.494+0000 7f2ad4fa2880 20 rados_obj.operate() r=0 bl.length=1020 2023-10-05T11:43:24.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.494+0000 7f2ad4fa2880 20 searching for the correct realm 2023-10-05T11:43:24.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.504+0000 7f2ad374d640 0 -- 172.21.15.12:0/2274786754 >> [v2:172.21.15.170:6814/3150808418,v1:172.21.15.170:6816/3150808418] conn(0x55c729b39000 msgr2=0x55c729a7ac00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:43:24.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.505+0000 7f2ad4fa2880 20 RGWRados::pool_iterate: got zone_info.dff27d1e-df33-400e-a68a-7ba586947c99 2023-10-05T11:43:24.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.505+0000 7f2ad4fa2880 20 RGWRados::pool_iterate: got zonegroup_info.c78aa576-9d15-4e9d-b3c0-4af23a22062c 2023-10-05T11:43:24.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.505+0000 7f2ad4fa2880 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T11:43:24.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.505+0000 7f2ad4fa2880 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T11:43:24.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.505+0000 7f2ad4fa2880 20 rados->read ofs=0 len=0 2023-10-05T11:43:24.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.505+0000 7f2ad4fa2880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:43:24.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.505+0000 7f2ad4fa2880 20 rados->read ofs=0 len=0 2023-10-05T11:43:24.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.506+0000 7f2ad4fa2880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:43:24.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.506+0000 7f2ad4fa2880 20 rados->read ofs=0 len=0 2023-10-05T11:43:24.511 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.506+0000 7f2ad4fa2880 20 rados_obj.operate() r=0 bl.length=454 2023-10-05T11:43:24.511 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.506+0000 7f2ad4fa2880 20 zone default found 2023-10-05T11:43:24.511 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.506+0000 7f2ad4fa2880 4 Realm: () 2023-10-05T11:43:24.511 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.506+0000 7f2ad4fa2880 4 ZoneGroup: default (c78aa576-9d15-4e9d-b3c0-4af23a22062c) 2023-10-05T11:43:24.511 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.506+0000 7f2ad4fa2880 4 Zone: default (dff27d1e-df33-400e-a68a-7ba586947c99) 2023-10-05T11:43:24.511 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.506+0000 7f2ad4fa2880 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T11:43:24.511 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.506+0000 7f2ad4fa2880 20 zonegroup default 2023-10-05T11:43:24.511 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.506+0000 7f2ad4fa2880 20 rados->read ofs=0 len=0 2023-10-05T11:43:24.511 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.506+0000 7f2ad4fa2880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:43:24.511 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.506+0000 7f2ad4fa2880 20 rados->read ofs=0 len=0 2023-10-05T11:43:24.511 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.507+0000 7f2ad4fa2880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:43:24.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.507+0000 7f2ad4fa2880 20 rados->read ofs=0 len=0 2023-10-05T11:43:24.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.507+0000 7f2ad4fa2880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:43:24.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.507+0000 7f2ad4fa2880 20 started sync module instance, tier type = 2023-10-05T11:43:24.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.507+0000 7f2ad4fa2880 20 started zone id=dff27d1e-df33-400e-a68a-7ba586947c99 (name=default) with tier type = 2023-10-05T11:43:24.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.514+0000 7f2ad3f4e640 0 -- 172.21.15.12:0/2274786754 >> [v2:172.21.15.12:6824/2171933159,v1:172.21.15.12:6825/2171933159] conn(0x55c729b39800 msgr2=0x55c729a7b700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:43:24.520 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.517+0000 7f2ad4fa2880 20 add_watcher() i=0 2023-10-05T11:43:24.520 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.517+0000 7f2ad4fa2880 20 add_watcher() i=1 2023-10-05T11:43:24.520 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.517+0000 7f2ad4fa2880 20 add_watcher() i=2 2023-10-05T11:43:24.520 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.517+0000 7f2ad4fa2880 20 add_watcher() i=3 2023-10-05T11:43:24.520 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.517+0000 7f2ad4fa2880 20 add_watcher() i=4 2023-10-05T11:43:24.520 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.517+0000 7f2ad4fa2880 20 add_watcher() i=5 2023-10-05T11:43:24.520 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.517+0000 7f2ad4fa2880 20 add_watcher() i=6 2023-10-05T11:43:24.521 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.517+0000 7f2ad4fa2880 20 add_watcher() i=7 2023-10-05T11:43:24.521 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.517+0000 7f2ad4fa2880 2 all 8 watchers are set, enabling cache 2023-10-05T11:43:24.522 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.519+0000 7f2aba71b640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:43:24.522 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.519+0000 7f2ad4fa2880 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T11:43:24.522 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.519+0000 7f2ad4fa2880 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T11:43:24.563 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.559+0000 7f2ab5f12640 20 reqs_thread_entry: start 2023-10-05T11:43:24.563 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.559+0000 7f2ad4fa2880 20 init_complete bucket index max shards: 11 2023-10-05T11:43:24.563 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.560+0000 7f2ad4fa2880 20 Filter name: none 2023-10-05T11:43:24.564 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.560+0000 7f2ab3f0e640 20 reqs_thread_entry: start 2023-10-05T11:43:24.564 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.560+0000 7f2ad4fa2880 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2023-10-05T11:43:24.564 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.561+0000 7f2ad4fa2880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:43:24.565 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.562+0000 7f2ad4fa2880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:43:24.565 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.562+0000 7f2ad4fa2880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:43:24.566 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.563+0000 7f2ad4fa2880 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2023-10-05T11:43:24.567 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.564+0000 7f2ad4fa2880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:43:24.568 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.564+0000 7f2ad4fa2880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:43:24.568 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.565+0000 7f2ad4fa2880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:43:24.569 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.566+0000 7f2ad4fa2880 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2023-10-05T11:43:24.570 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.567+0000 7f2ad4fa2880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:43:24.570 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.567+0000 7f2ad4fa2880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:43:24.571 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.567+0000 7f2ad4fa2880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:43:24.571 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.568+0000 7f2ad4fa2880 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2023-10-05T11:43:24.573 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.570+0000 7f2ad4fa2880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:43:24.573 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.570+0000 7f2ad4fa2880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:43:24.574 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.571+0000 7f2ad4fa2880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:43:24.575 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.572+0000 7f2ad4fa2880 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2023-10-05T11:43:24.576 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.573+0000 7f2ad4fa2880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:43:24.577 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.573+0000 7f2ad4fa2880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:43:24.577 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.573+0000 7f2ad4fa2880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:43:24.577 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.574+0000 7f2ad4fa2880 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2023-10-05T11:43:24.579 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.576+0000 7f2ad4fa2880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:43:24.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.576+0000 7f2ad4fa2880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:43:24.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.577+0000 7f2ad4fa2880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:43:24.581 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.578+0000 7f2ad4fa2880 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2023-10-05T11:43:24.582 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.579+0000 7f2ad4fa2880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:43:24.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.579+0000 7f2ad4fa2880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:43:24.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.580+0000 7f2ad4fa2880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:43:24.584 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.581+0000 7f2ad4fa2880 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2023-10-05T11:43:24.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.582+0000 7f2ad4fa2880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:43:24.586 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.583+0000 7f2ad4fa2880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:43:24.586 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.583+0000 7f2ad4fa2880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:43:24.587 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.584+0000 7f2ad4fa2880 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2023-10-05T11:43:24.588 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.585+0000 7f2ad4fa2880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:43:24.589 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.586+0000 7f2ad4fa2880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:43:24.589 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.586+0000 7f2ad4fa2880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:43:24.590 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.587+0000 7f2ad4fa2880 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2023-10-05T11:43:24.591 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.588+0000 7f2ad4fa2880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:43:24.592 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.589+0000 7f2ad4fa2880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:43:24.592 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.589+0000 7f2ad4fa2880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:43:24.593 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.590+0000 7f2ad4fa2880 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2023-10-05T11:43:24.594 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.591+0000 7f2ad4fa2880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:43:24.595 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.591+0000 7f2ad4fa2880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:43:24.595 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.592+0000 7f2ad4fa2880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:43:24.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.592+0000 7f2ad4fa2880 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2023-10-05T11:43:24.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.594+0000 7f2ad4fa2880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:43:24.598 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.594+0000 7f2ad4fa2880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:43:24.598 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.595+0000 7f2ad4fa2880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:43:24.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.596+0000 7f2ad4fa2880 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2023-10-05T11:43:24.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.597+0000 7f2ad4fa2880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:43:24.601 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.598+0000 7f2ad4fa2880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:43:24.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.598+0000 7f2ad4fa2880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:43:24.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.600+0000 7f2ad4fa2880 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2023-10-05T11:43:24.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.601+0000 7f2ad4fa2880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:43:24.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.601+0000 7f2ad4fa2880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:43:24.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.602+0000 7f2ad4fa2880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:43:24.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.603+0000 7f2ad4fa2880 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2023-10-05T11:43:24.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.604+0000 7f2ad4fa2880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:43:24.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.605+0000 7f2ad4fa2880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:43:24.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.605+0000 7f2ad4fa2880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:43:24.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.606+0000 7f2ad4fa2880 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2023-10-05T11:43:24.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.607+0000 7f2ad4fa2880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:43:24.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.607+0000 7f2ad4fa2880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:43:24.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.608+0000 7f2ad4fa2880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:43:24.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.608+0000 7f2ad4fa2880 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2023-10-05T11:43:24.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.610+0000 7f2ad4fa2880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:43:24.614 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.610+0000 7f2ad4fa2880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:43:24.614 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.611+0000 7f2ad4fa2880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:43:24.615 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.612+0000 7f2ad4fa2880 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2023-10-05T11:43:24.616 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.613+0000 7f2ad4fa2880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:43:24.616 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.613+0000 7f2ad4fa2880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:43:24.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.613+0000 7f2ad4fa2880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:43:24.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.614+0000 7f2ad4fa2880 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2023-10-05T11:43:24.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.616+0000 7f2ad4fa2880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:43:24.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.616+0000 7f2ad4fa2880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:43:24.620 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.616+0000 7f2ad4fa2880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:43:24.620 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.617+0000 7f2ad4fa2880 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2023-10-05T11:43:24.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.618+0000 7f2ad4fa2880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:43:24.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.619+0000 7f2ad4fa2880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:43:24.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.619+0000 7f2ad4fa2880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:43:24.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.620+0000 7f2ad4fa2880 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2023-10-05T11:43:24.624 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.621+0000 7f2ad4fa2880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:43:24.625 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.622+0000 7f2ad4fa2880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:43:24.625 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.622+0000 7f2ad4fa2880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:43:24.626 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.623+0000 7f2ad4fa2880 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2023-10-05T11:43:24.627 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.624+0000 7f2ad4fa2880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:43:24.628 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.624+0000 7f2ad4fa2880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:43:24.628 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.625+0000 7f2ad4fa2880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:43:24.629 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.626+0000 7f2ad4fa2880 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2023-10-05T11:43:24.630 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.627+0000 7f2ad4fa2880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:43:24.630 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.627+0000 7f2ad4fa2880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:43:24.631 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.628+0000 7f2ad4fa2880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:43:24.632 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.629+0000 7f2ad4fa2880 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2023-10-05T11:43:24.633 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.630+0000 7f2ad4fa2880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:43:24.634 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.630+0000 7f2ad4fa2880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:43:24.634 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.631+0000 7f2ad4fa2880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:43:24.635 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.632+0000 7f2ad4fa2880 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2023-10-05T11:43:24.636 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.633+0000 7f2ad4fa2880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:43:24.637 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.633+0000 7f2ad4fa2880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:43:24.637 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.634+0000 7f2ad4fa2880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:43:24.637 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.634+0000 7f2ad4fa2880 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2023-10-05T11:43:24.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.636+0000 7f2ad4fa2880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:43:24.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.636+0000 7f2ad4fa2880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:43:24.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.636+0000 7f2ad4fa2880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:43:24.640 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.637+0000 7f2ad4fa2880 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2023-10-05T11:43:24.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.638+0000 7f2ad4fa2880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:43:24.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.639+0000 7f2ad4fa2880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:43:24.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.639+0000 7f2ad4fa2880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:43:24.643 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.640+0000 7f2ad4fa2880 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2023-10-05T11:43:24.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.642+0000 7f2ad4fa2880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:43:24.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.642+0000 7f2ad4fa2880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:43:24.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.642+0000 7f2ad4fa2880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:43:24.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.643+0000 7f2ad4fa2880 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2023-10-05T11:43:24.648 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.645+0000 7f2ad4fa2880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:43:24.648 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.645+0000 7f2ad4fa2880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:43:24.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.645+0000 7f2ad4fa2880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:43:24.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.646+0000 7f2ad4fa2880 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2023-10-05T11:43:24.651 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.648+0000 7f2ad4fa2880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:43:24.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.648+0000 7f2ad4fa2880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:43:24.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.648+0000 7f2ad4fa2880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:43:24.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.649+0000 7f2ad4fa2880 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2023-10-05T11:43:24.653 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.650+0000 7f2ad4fa2880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:43:24.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.651+0000 7f2ad4fa2880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:43:24.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.651+0000 7f2ad4fa2880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:43:24.655 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.652+0000 7f2ad4fa2880 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2023-10-05T11:43:24.657 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.653+0000 7f2ad4fa2880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:43:24.657 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.654+0000 7f2ad4fa2880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:43:24.657 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.654+0000 7f2ad4fa2880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:43:24.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.656+0000 7f2aba71b640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:43:24.661 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.658+0000 7f2ad4fa2880 20 remove_watcher() i=0 2023-10-05T11:43:24.661 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.658+0000 7f2ad4fa2880 2 removed watcher, disabling cache 2023-10-05T11:43:24.662 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.659+0000 7f2ad4fa2880 20 remove_watcher() i=1 2023-10-05T11:43:24.663 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.660+0000 7f2ad4fa2880 20 remove_watcher() i=2 2023-10-05T11:43:24.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.661+0000 7f2ad4fa2880 20 remove_watcher() i=3 2023-10-05T11:43:24.665 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.662+0000 7f2ad4fa2880 20 remove_watcher() i=4 2023-10-05T11:43:24.666 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.663+0000 7f2ad4fa2880 20 remove_watcher() i=5 2023-10-05T11:43:24.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.664+0000 7f2ad4fa2880 20 remove_watcher() i=6 2023-10-05T11:43:24.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:43:24.665+0000 7f2ad4fa2880 20 remove_watcher() i=7 2023-10-05T11:43:24.673 DEBUG:teuthology.orchestra.run.smithi012:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests AWS4Test 2023-10-05T11:43:25.149 INFO:teuthology.orchestra.run.smithi012.stdout:Starting a Gradle Daemon (subsequent builds will be faster) 2023-10-05T11:43:28.950 INFO:teuthology.orchestra.run.smithi012.stdout:> Task :clean UP-TO-DATE 2023-10-05T11:43:49.249 INFO:teuthology.orchestra.run.smithi012.stdout:> Task :compileJava 2023-10-05T11:43:49.249 INFO:teuthology.orchestra.run.smithi012.stdout:> Task :processResources 2023-10-05T11:43:49.249 INFO:teuthology.orchestra.run.smithi012.stdout:> Task :classes 2023-10-05T11:43:49.849 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:43:49.849 INFO:teuthology.orchestra.run.smithi012.stdout:> Task :compileTestJava 2023-10-05T11:43:49.849 INFO:teuthology.orchestra.run.smithi012.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2023-10-05T11:43:49.850 INFO:teuthology.orchestra.run.smithi012.stderr:Note: Recompile with -Xlint:deprecation for details. 2023-10-05T11:43:49.853 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:43:49.853 INFO:teuthology.orchestra.run.smithi012.stdout:> Task :processTestResources NO-SOURCE 2023-10-05T11:43:49.854 INFO:teuthology.orchestra.run.smithi012.stdout:> Task :testClasses 2023-10-05T11:43:55.949 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:43:55.949 INFO:teuthology.orchestra.run.smithi012.stdout:> Task :test 2023-10-05T11:43:55.949 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:43:55.949 INFO:teuthology.orchestra.run.smithi012.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadLLAPIAWS4 STARTED 2023-10-05T11:44:00.249 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:44:00.249 INFO:teuthology.orchestra.run.smithi012.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadLLAPIAWS4 PASSED 2023-10-05T11:44:00.649 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:44:00.649 INFO:teuthology.orchestra.run.smithi012.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadNotFoundLLAPIAWS4 STARTED 2023-10-05T11:44:00.749 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:44:00.749 INFO:teuthology.orchestra.run.smithi012.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadNotFoundLLAPIAWS4 PASSED 2023-10-05T11:44:01.048 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:44:01.049 INFO:teuthology.orchestra.run.smithi012.stdout:suite > AWS4 tests > AWS4Test.testDownloadHLAPIAWS4 STARTED 2023-10-05T11:44:05.949 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:44:05.949 INFO:teuthology.orchestra.run.smithi012.stdout:suite > AWS4 tests > AWS4Test.testDownloadHLAPIAWS4 PASSED 2023-10-05T11:44:06.349 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:44:06.349 INFO:teuthology.orchestra.run.smithi012.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoBucketHLAPIAWS4 STARTED 2023-10-05T11:44:06.349 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:44:06.349 INFO:teuthology.orchestra.run.smithi012.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoBucketHLAPIAWS4 PASSED 2023-10-05T11:44:06.448 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:44:06.449 INFO:teuthology.orchestra.run.smithi012.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoKeyHLAPIAWS4 STARTED 2023-10-05T11:44:06.549 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:44:06.549 INFO:teuthology.orchestra.run.smithi012.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoKeyHLAPIAWS4 PASSED 2023-10-05T11:44:06.949 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:44:06.949 INFO:teuthology.orchestra.run.smithi012.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyHLAPIAWS4 STARTED 2023-10-05T11:44:11.249 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:44:11.249 INFO:teuthology.orchestra.run.smithi012.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyHLAPIAWS4 PASSED 2023-10-05T11:44:11.948 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:44:11.949 INFO:teuthology.orchestra.run.smithi012.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 STARTED 2023-10-05T11:45:04.249 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:45:04.249 INFO:teuthology.orchestra.run.smithi012.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 PASSED 2023-10-05T11:45:04.848 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:45:04.849 INFO:teuthology.orchestra.run.smithi012.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCBucketHLAPIAWS4 STARTED 2023-10-05T11:45:04.949 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:45:04.949 INFO:teuthology.orchestra.run.smithi012.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCBucketHLAPIAWS4 PASSED 2023-10-05T11:45:05.348 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:45:05.462 INFO:teuthology.orchestra.run.smithi012.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCKeyHLAPIAWS4 STARTED 2023-10-05T11:45:05.462 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:45:05.463 INFO:teuthology.orchestra.run.smithi012.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCKeyHLAPIAWS4 PASSED 2023-10-05T11:45:06.049 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:45:06.049 INFO:teuthology.orchestra.run.smithi012.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadHLAPIAWS4 STARTED 2023-10-05T11:45:10.349 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:45:10.349 INFO:teuthology.orchestra.run.smithi012.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadHLAPIAWS4 PASSED 2023-10-05T11:45:10.749 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:45:10.749 INFO:teuthology.orchestra.run.smithi012.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadNoBucketHLAPIAWS4 STARTED 2023-10-05T11:45:10.749 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:45:10.749 INFO:teuthology.orchestra.run.smithi012.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadNoBucketHLAPIAWS4 PASSED 2023-10-05T11:45:10.848 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:45:10.849 INFO:teuthology.orchestra.run.smithi012.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadWithPauseHLAPIAWS4 STARTED 2023-10-05T11:45:25.749 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:45:25.749 INFO:teuthology.orchestra.run.smithi012.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadWithPauseHLAPIAWS4 PASSED 2023-10-05T11:45:26.048 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:45:26.049 INFO:teuthology.orchestra.run.smithi012.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadHLAPIAWS4 STARTED 2023-10-05T11:45:33.449 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:45:33.449 INFO:teuthology.orchestra.run.smithi012.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadHLAPIAWS4 PASSED 2023-10-05T11:45:33.948 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:45:33.949 INFO:teuthology.orchestra.run.smithi012.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadIncorrectMissingPartLLAPIAWS4 STARTED 2023-10-05T11:45:35.948 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:45:35.949 INFO:teuthology.orchestra.run.smithi012.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadIncorrectMissingPartLLAPIAWS4 PASSED 2023-10-05T11:45:36.248 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:45:36.249 INFO:teuthology.orchestra.run.smithi012.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadMultipleSizesLLAPIAWS4 STARTED 2023-10-05T11:46:45.449 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:46:45.449 INFO:teuthology.orchestra.run.smithi012.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadMultipleSizesLLAPIAWS4 PASSED 2023-10-05T11:46:45.848 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:46:45.849 INFO:teuthology.orchestra.run.smithi012.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadOverwriteExistingObjectLLAPIAWS4 STARTED 2023-10-05T11:47:00.148 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:47:00.149 INFO:teuthology.orchestra.run.smithi012.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadOverwriteExistingObjectLLAPIAWS4 PASSED 2023-10-05T11:47:00.548 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:47:00.548 INFO:teuthology.orchestra.run.smithi012.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadSmallLLAPIAWS4 STARTED 2023-10-05T11:47:04.748 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:47:04.749 INFO:teuthology.orchestra.run.smithi012.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadSmallLLAPIAWS4 PASSED 2023-10-05T11:47:05.148 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:47:05.149 INFO:teuthology.orchestra.run.smithi012.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadWithPauseAWS4 STARTED 2023-10-05T11:47:06.449 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:47:06.449 INFO:teuthology.orchestra.run.smithi012.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadWithPauseAWS4 PASSED 2023-10-05T11:47:11.048 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:47:11.049 INFO:teuthology.orchestra.run.smithi012.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateAfterToday4AWS4 STARTED 2023-10-05T11:47:11.149 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:47:11.149 INFO:teuthology.orchestra.run.smithi012.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateAfterToday4AWS4 PASSED 2023-10-05T11:47:11.948 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:47:11.949 INFO:teuthology.orchestra.run.smithi012.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeEpochAWS4 STARTED 2023-10-05T11:47:12.049 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:47:12.049 INFO:teuthology.orchestra.run.smithi012.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeEpochAWS4 PASSED 2023-10-05T11:47:12.348 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:47:12.348 INFO:teuthology.orchestra.run.smithi012.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeToday4AWS4 STARTED 2023-10-05T11:47:12.449 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:47:12.449 INFO:teuthology.orchestra.run.smithi012.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeToday4AWS4 PASSED 2023-10-05T11:47:12.848 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:47:12.849 INFO:teuthology.orchestra.run.smithi012.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateEmptyAWS4 STARTED 2023-10-05T11:47:12.948 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:47:12.949 INFO:teuthology.orchestra.run.smithi012.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateEmptyAWS4 PASSED 2023-10-05T11:47:13.349 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:47:13.349 INFO:teuthology.orchestra.run.smithi012.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateInvalidAWS4 STARTED 2023-10-05T11:47:13.448 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:47:13.449 INFO:teuthology.orchestra.run.smithi012.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateInvalidAWS4 PASSED 2023-10-05T11:47:13.849 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:47:13.849 INFO:teuthology.orchestra.run.smithi012.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateNoneAWS4 STARTED 2023-10-05T11:47:13.849 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:47:13.850 INFO:teuthology.orchestra.run.smithi012.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateNoneAWS4 PASSED 2023-10-05T11:47:14.250 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:47:14.251 INFO:teuthology.orchestra.run.smithi012.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadMd5InvalidGarbageAWS4 STARTED 2023-10-05T11:47:14.348 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:47:14.349 INFO:teuthology.orchestra.run.smithi012.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadMd5InvalidGarbageAWS4 PASSED 2023-10-05T11:47:14.748 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:47:14.749 INFO:teuthology.orchestra.run.smithi012.stdout:suite > AWS4 tests > AWS4Test.testUploadFileHLAPIBigFileAWS4 STARTED 2023-10-05T11:47:23.248 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:47:23.248 INFO:teuthology.orchestra.run.smithi012.stdout:suite > AWS4 tests > AWS4Test.testUploadFileHLAPIBigFileAWS4 PASSED 2023-10-05T11:47:23.648 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:47:23.649 INFO:teuthology.orchestra.run.smithi012.stdout:---------------------------------------------------------------------- 2023-10-05T11:47:23.649 INFO:teuthology.orchestra.run.smithi012.stdout:| Results: SUCCESS (26 tests, 26 successes, 0 failures, 0 skipped) | 2023-10-05T11:47:23.649 INFO:teuthology.orchestra.run.smithi012.stdout:---------------------------------------------------------------------- 2023-10-05T11:47:23.687 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:47:23.687 INFO:teuthology.orchestra.run.smithi012.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2023-10-05T11:47:23.687 INFO:teuthology.orchestra.run.smithi012.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2023-10-05T11:47:23.687 INFO:teuthology.orchestra.run.smithi012.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2023-10-05T11:47:23.687 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:47:23.687 INFO:teuthology.orchestra.run.smithi012.stdout:BUILD SUCCESSFUL in 3m 58s 2023-10-05T11:47:23.687 INFO:teuthology.orchestra.run.smithi012.stdout:5 actionable tasks: 4 executed, 1 up-to-date 2023-10-05T11:47:24.003 DEBUG:teuthology.orchestra.run.smithi012:> radosgw-admin gc process --include-all 2023-10-05T11:47:24.054 INFO:teuthology.orchestra.run.smithi012.stderr:ignoring --setuser ceph since I am not root 2023-10-05T11:47:24.055 INFO:teuthology.orchestra.run.smithi012.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T11:47:24.067 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.064+0000 7fcec8533880 20 rados->read ofs=0 len=0 2023-10-05T11:47:24.069 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.065+0000 7fcec8533880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:47:24.069 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.065+0000 7fcec8533880 20 realm 2023-10-05T11:47:24.069 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.065+0000 7fcec8533880 20 rados->read ofs=0 len=0 2023-10-05T11:47:24.069 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.066+0000 7fcec8533880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:47:24.069 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.066+0000 7fcec8533880 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T11:47:24.069 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.066+0000 7fcec8533880 20 rados->read ofs=0 len=0 2023-10-05T11:47:24.070 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.066+0000 7fcec8533880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:47:24.070 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.066+0000 7fcec8533880 20 rados->read ofs=0 len=0 2023-10-05T11:47:24.070 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.067+0000 7fcec8533880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:47:24.070 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.067+0000 7fcec8533880 20 rados->read ofs=0 len=0 2023-10-05T11:47:24.071 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.068+0000 7fcec8533880 20 rados_obj.operate() r=0 bl.length=1020 2023-10-05T11:47:24.071 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.068+0000 7fcec8533880 20 searching for the correct realm 2023-10-05T11:47:24.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.079+0000 7fcec562f640 0 -- 172.21.15.12:0/1271105767 >> [v2:172.21.15.12:6824/2171933159,v1:172.21.15.12:6825/2171933159] conn(0x562857645c00 msgr2=0x56285757b700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:47:24.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.080+0000 7fcec8533880 20 RGWRados::pool_iterate: got zone_info.dff27d1e-df33-400e-a68a-7ba586947c99 2023-10-05T11:47:24.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.080+0000 7fcec8533880 20 RGWRados::pool_iterate: got zonegroup_info.c78aa576-9d15-4e9d-b3c0-4af23a22062c 2023-10-05T11:47:24.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.080+0000 7fcec8533880 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T11:47:24.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.080+0000 7fcec8533880 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T11:47:24.084 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.080+0000 7fcec8533880 20 rados->read ofs=0 len=0 2023-10-05T11:47:24.084 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.080+0000 7fcec8533880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:47:24.084 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.080+0000 7fcec8533880 20 rados->read ofs=0 len=0 2023-10-05T11:47:24.085 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.081+0000 7fcec8533880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:47:24.085 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.081+0000 7fcec8533880 20 rados->read ofs=0 len=0 2023-10-05T11:47:24.085 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.081+0000 7fcec8533880 20 rados_obj.operate() r=0 bl.length=454 2023-10-05T11:47:24.085 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.081+0000 7fcec8533880 20 zone default found 2023-10-05T11:47:24.085 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.081+0000 7fcec8533880 4 Realm: () 2023-10-05T11:47:24.085 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.081+0000 7fcec8533880 4 ZoneGroup: default (c78aa576-9d15-4e9d-b3c0-4af23a22062c) 2023-10-05T11:47:24.085 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.081+0000 7fcec8533880 4 Zone: default (dff27d1e-df33-400e-a68a-7ba586947c99) 2023-10-05T11:47:24.086 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.081+0000 7fcec8533880 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T11:47:24.086 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.081+0000 7fcec8533880 20 zonegroup default 2023-10-05T11:47:24.086 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.081+0000 7fcec8533880 20 rados->read ofs=0 len=0 2023-10-05T11:47:24.086 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.081+0000 7fcec8533880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:47:24.086 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.081+0000 7fcec8533880 20 rados->read ofs=0 len=0 2023-10-05T11:47:24.086 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.081+0000 7fcec8533880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:47:24.086 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.081+0000 7fcec8533880 20 rados->read ofs=0 len=0 2023-10-05T11:47:24.086 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.082+0000 7fcec8533880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:47:24.086 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.082+0000 7fcec8533880 20 started sync module instance, tier type = 2023-10-05T11:47:24.086 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.082+0000 7fcec8533880 20 started zone id=dff27d1e-df33-400e-a68a-7ba586947c99 (name=default) with tier type = 2023-10-05T11:47:24.093 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.090+0000 7fcec562f640 0 -- 172.21.15.12:0/1271105767 >> [v2:172.21.15.12:6824/2171933159,v1:172.21.15.12:6825/2171933159] conn(0x562857730c00 msgr2=0x562857634100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-10-05T11:47:24.096 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.092+0000 7fcec8533880 20 add_watcher() i=0 2023-10-05T11:47:24.096 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.092+0000 7fcec8533880 20 add_watcher() i=1 2023-10-05T11:47:24.096 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.092+0000 7fcec8533880 20 add_watcher() i=2 2023-10-05T11:47:24.096 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.092+0000 7fcec8533880 20 add_watcher() i=3 2023-10-05T11:47:24.096 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.092+0000 7fcec8533880 20 add_watcher() i=4 2023-10-05T11:47:24.096 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.092+0000 7fcec8533880 20 add_watcher() i=5 2023-10-05T11:47:24.096 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.092+0000 7fcec8533880 20 add_watcher() i=6 2023-10-05T11:47:24.097 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.093+0000 7fcec8533880 20 add_watcher() i=7 2023-10-05T11:47:24.097 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.093+0000 7fcec8533880 2 all 8 watchers are set, enabling cache 2023-10-05T11:47:24.098 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.095+0000 7fceabdfc640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:47:24.099 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.095+0000 7fcec8533880 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T11:47:24.099 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.095+0000 7fcec8533880 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T11:47:24.143 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.139+0000 7fcea75f3640 20 reqs_thread_entry: start 2023-10-05T11:47:24.143 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.139+0000 7fcec8533880 20 init_complete bucket index max shards: 11 2023-10-05T11:47:24.143 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.139+0000 7fcec8533880 20 Filter name: none 2023-10-05T11:47:24.143 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.139+0000 7fcea55ef640 20 reqs_thread_entry: start 2023-10-05T11:47:24.143 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.139+0000 7fcec8533880 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2023-10-05T11:47:24.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.141+0000 7fcec8533880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.141+0000 7fcec8533880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:24.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.141+0000 7fcec8533880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2023-10-05T11:47:24.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.141+0000 7fcec8533880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.15682540619716389769', time=2023-10-05T13:45:52.725515+0000, chain.objs.size()=21 2023-10-05T11:47:24.146 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.141+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.43__multipart_key1.2~nNy0sKEqosycKBwmJ9iqh6uBBZ763RS.1 2023-10-05T11:47:24.146 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.141+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.43__shadow_key1.2~nNy0sKEqosycKBwmJ9iqh6uBBZ763RS.1_1 2023-10-05T11:47:24.146 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.141+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.43__multipart_key1.2~nNy0sKEqosycKBwmJ9iqh6uBBZ763RS.2 2023-10-05T11:47:24.146 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.141+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.43__shadow_key1.2~nNy0sKEqosycKBwmJ9iqh6uBBZ763RS.2_1 2023-10-05T11:47:24.146 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.141+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.43__multipart_key1.2~nNy0sKEqosycKBwmJ9iqh6uBBZ763RS.3 2023-10-05T11:47:24.146 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.142+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.43__shadow_key1.2~nNy0sKEqosycKBwmJ9iqh6uBBZ763RS.3_1 2023-10-05T11:47:24.146 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.142+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.43__multipart_key1.2~nNy0sKEqosycKBwmJ9iqh6uBBZ763RS.4 2023-10-05T11:47:24.146 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.142+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.43__shadow_key1.2~nNy0sKEqosycKBwmJ9iqh6uBBZ763RS.4_1 2023-10-05T11:47:24.146 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.142+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.43__multipart_key1.2~nNy0sKEqosycKBwmJ9iqh6uBBZ763RS.5 2023-10-05T11:47:24.146 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.142+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.43__shadow_key1.2~nNy0sKEqosycKBwmJ9iqh6uBBZ763RS.5_1 2023-10-05T11:47:24.146 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.142+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.43__multipart_key1.2~nNy0sKEqosycKBwmJ9iqh6uBBZ763RS.6 2023-10-05T11:47:24.146 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.142+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.43__shadow_key1.2~nNy0sKEqosycKBwmJ9iqh6uBBZ763RS.6_1 2023-10-05T11:47:24.147 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.144+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.43__multipart_key1.2~nNy0sKEqosycKBwmJ9iqh6uBBZ763RS.7 2023-10-05T11:47:24.148 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.145+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.43__shadow_key1.2~nNy0sKEqosycKBwmJ9iqh6uBBZ763RS.7_1 2023-10-05T11:47:24.151 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.148+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.43__multipart_key1.2~nNy0sKEqosycKBwmJ9iqh6uBBZ763RS.8 2023-10-05T11:47:24.151 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.148+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.43__shadow_key1.2~nNy0sKEqosycKBwmJ9iqh6uBBZ763RS.8_1 2023-10-05T11:47:24.151 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.148+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.43__multipart_key1.2~nNy0sKEqosycKBwmJ9iqh6uBBZ763RS.9 2023-10-05T11:47:24.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.148+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.43__shadow_key1.2~nNy0sKEqosycKBwmJ9iqh6uBBZ763RS.9_1 2023-10-05T11:47:24.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.148+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.43__multipart_key1.2~nNy0sKEqosycKBwmJ9iqh6uBBZ763RS.10 2023-10-05T11:47:24.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.148+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.43__shadow_key1.2~nNy0sKEqosycKBwmJ9iqh6uBBZ763RS.10_1 2023-10-05T11:47:24.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.149+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.43__multipart_key1.2~nNy0sKEqosycKBwmJ9iqh6uBBZ763RS.11 2023-10-05T11:47:24.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.149+0000 7fcec8533880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.1253130733255799514', time=2023-10-05T13:47:11.451649+0000, chain.objs.size()=1 2023-10-05T11:47:24.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.149+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.47__shadow_.NaHBkGIP8E4SLNFdpJuk5HaQO2TgtjY_0 2023-10-05T11:47:24.157 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.154+0000 7fcec8533880 5 garbage collection: RGWGC::process removing entries, marker: 2023-10-05T11:47:24.160 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.157+0000 7fcec8533880 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2023-10-05T11:47:24.161 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.158+0000 7fcec8533880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.162 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.159+0000 7fcec8533880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:24.163 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.159+0000 7fcec8533880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2023-10-05T11:47:24.163 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.159+0000 7fcec8533880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.3745117994037982101', time=2023-10-05T13:44:51.933820+0000, chain.objs.size()=7 2023-10-05T11:47:24.163 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.159+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.35__multipart_key1.2~8vYMKNYmQZNoz0DlaGshl4HWzS5u6lb.1 2023-10-05T11:47:24.163 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.159+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.35__shadow_key1.2~8vYMKNYmQZNoz0DlaGshl4HWzS5u6lb.1_1 2023-10-05T11:47:24.163 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.160+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.35__shadow_key1.2~8vYMKNYmQZNoz0DlaGshl4HWzS5u6lb.1_2 2023-10-05T11:47:24.163 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.160+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.35__multipart_key1.2~8vYMKNYmQZNoz0DlaGshl4HWzS5u6lb.2 2023-10-05T11:47:24.163 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.160+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.35__shadow_key1.2~8vYMKNYmQZNoz0DlaGshl4HWzS5u6lb.2_1 2023-10-05T11:47:24.164 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.160+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.35__shadow_key1.2~8vYMKNYmQZNoz0DlaGshl4HWzS5u6lb.2_2 2023-10-05T11:47:24.164 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.160+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.35__multipart_key1.2~8vYMKNYmQZNoz0DlaGshl4HWzS5u6lb.3 2023-10-05T11:47:24.166 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.163+0000 7fcec8533880 5 garbage collection: RGWGC::process removing entries, marker: 2023-10-05T11:47:24.169 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.166+0000 7fcec8533880 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2023-10-05T11:47:24.171 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.168+0000 7fcec8533880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.171 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.168+0000 7fcec8533880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:24.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.168+0000 7fcec8533880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2023-10-05T11:47:24.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.168+0000 7fcec8533880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.4428940649112405091', time=2023-10-05T13:44:32.219470+0000, chain.objs.size()=9 2023-10-05T11:47:24.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.168+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.35__multipart_key1.2~05Z6qRgUXYSWn8t7fKNb7HXfeynun_C.1 2023-10-05T11:47:24.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.168+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.35__shadow_key1.2~05Z6qRgUXYSWn8t7fKNb7HXfeynun_C.1_1 2023-10-05T11:47:24.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.168+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.35__multipart_key1.2~05Z6qRgUXYSWn8t7fKNb7HXfeynun_C.2 2023-10-05T11:47:24.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.168+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.35__shadow_key1.2~05Z6qRgUXYSWn8t7fKNb7HXfeynun_C.2_1 2023-10-05T11:47:24.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.168+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.35__multipart_key1.2~05Z6qRgUXYSWn8t7fKNb7HXfeynun_C.3 2023-10-05T11:47:24.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.168+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.35__shadow_key1.2~05Z6qRgUXYSWn8t7fKNb7HXfeynun_C.3_1 2023-10-05T11:47:24.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.168+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.35__multipart_key1.2~05Z6qRgUXYSWn8t7fKNb7HXfeynun_C.4 2023-10-05T11:47:24.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.168+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.35__shadow_key1.2~05Z6qRgUXYSWn8t7fKNb7HXfeynun_C.4_1 2023-10-05T11:47:24.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.168+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.35__multipart_key1.2~05Z6qRgUXYSWn8t7fKNb7HXfeynun_C.5 2023-10-05T11:47:24.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.173+0000 7fcec8533880 5 garbage collection: RGWGC::process removing entries, marker: 2023-10-05T11:47:24.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.176+0000 7fcec8533880 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2023-10-05T11:47:24.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.178+0000 7fcec8533880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.178+0000 7fcec8533880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:24.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.178+0000 7fcec8533880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2023-10-05T11:47:24.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.178+0000 7fcec8533880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.1505023540528729805', time=2023-10-05T13:45:33.659624+0000, chain.objs.size()=1 2023-10-05T11:47:24.182 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.178+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.41__shadow_.TwmzY5lEr7Vg5uYRkc_m40HkzR1s1Rz_0 2023-10-05T11:47:24.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.180+0000 7fcec8533880 5 garbage collection: RGWGC::process removing entries, marker: 2023-10-05T11:47:24.185 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.182+0000 7fcec8533880 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2023-10-05T11:47:24.186 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.183+0000 7fcec8533880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.187 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.184+0000 7fcec8533880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:24.187 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.184+0000 7fcec8533880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.185+0000 7fcec8533880 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2023-10-05T11:47:24.189 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.186+0000 7fcec8533880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.189 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.186+0000 7fcec8533880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:24.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.187+0000 7fcec8533880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.188+0000 7fcec8533880 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2023-10-05T11:47:24.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.189+0000 7fcec8533880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.190+0000 7fcec8533880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:24.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.190+0000 7fcec8533880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2023-10-05T11:47:24.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.190+0000 7fcec8533880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.2262757579846273068', time=2023-10-05T13:45:04.578617+0000, chain.objs.size()=7 2023-10-05T11:47:24.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.190+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.35__multipart_key1.2~XV3y_c4gjuN33239Y_u6KE8_GjD9id9.1 2023-10-05T11:47:24.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.190+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.35__shadow_key1.2~XV3y_c4gjuN33239Y_u6KE8_GjD9id9.1_1 2023-10-05T11:47:24.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.190+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.35__shadow_key1.2~XV3y_c4gjuN33239Y_u6KE8_GjD9id9.1_2 2023-10-05T11:47:24.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.190+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.35__multipart_key1.2~XV3y_c4gjuN33239Y_u6KE8_GjD9id9.2 2023-10-05T11:47:24.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.190+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.35__shadow_key1.2~XV3y_c4gjuN33239Y_u6KE8_GjD9id9.2_1 2023-10-05T11:47:24.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.190+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.35__shadow_key1.2~XV3y_c4gjuN33239Y_u6KE8_GjD9id9.2_2 2023-10-05T11:47:24.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.190+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.35__multipart_key1.2~XV3y_c4gjuN33239Y_u6KE8_GjD9id9.3 2023-10-05T11:47:24.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.190+0000 7fcec8533880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.10034740842742104556', time=2023-10-05T13:45:33.540433+0000, chain.objs.size()=9 2023-10-05T11:47:24.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.190+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.41__multipart_file.mpg.2~f8KjKrC0Lb4ZZqHnHlzWjummR42bwzG.1 2023-10-05T11:47:24.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.190+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.41__shadow_file.mpg.2~f8KjKrC0Lb4ZZqHnHlzWjummR42bwzG.1_1 2023-10-05T11:47:24.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.190+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.41__multipart_file.mpg.2~f8KjKrC0Lb4ZZqHnHlzWjummR42bwzG.2 2023-10-05T11:47:24.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.190+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.41__shadow_file.mpg.2~f8KjKrC0Lb4ZZqHnHlzWjummR42bwzG.2_1 2023-10-05T11:47:24.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.190+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.41__multipart_file.mpg.2~f8KjKrC0Lb4ZZqHnHlzWjummR42bwzG.3 2023-10-05T11:47:24.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.194+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.41__shadow_file.mpg.2~f8KjKrC0Lb4ZZqHnHlzWjummR42bwzG.3_1 2023-10-05T11:47:24.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.196+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.41__multipart_file.mpg.2~f8KjKrC0Lb4ZZqHnHlzWjummR42bwzG.4 2023-10-05T11:47:24.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.196+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.41__shadow_file.mpg.2~f8KjKrC0Lb4ZZqHnHlzWjummR42bwzG.4_1 2023-10-05T11:47:24.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.196+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.41__multipart_file.mpg.2~f8KjKrC0Lb4ZZqHnHlzWjummR42bwzG.5 2023-10-05T11:47:24.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.196+0000 7fcec8533880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.7056014750848501503', time=2023-10-05T13:47:04.825290+0000, chain.objs.size()=9 2023-10-05T11:47:24.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.196+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.45__multipart_key1.2~AlO1F3psgCpChKVW0eXq5qh7ii9yrm_.1 2023-10-05T11:47:24.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.196+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.45__shadow_key1.2~AlO1F3psgCpChKVW0eXq5qh7ii9yrm_.1_1 2023-10-05T11:47:24.201 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.196+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.45__multipart_key1.2~AlO1F3psgCpChKVW0eXq5qh7ii9yrm_.2 2023-10-05T11:47:24.201 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.196+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.45__shadow_key1.2~AlO1F3psgCpChKVW0eXq5qh7ii9yrm_.2_1 2023-10-05T11:47:24.201 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.196+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.45__multipart_key1.2~AlO1F3psgCpChKVW0eXq5qh7ii9yrm_.3 2023-10-05T11:47:24.201 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.196+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.45__shadow_key1.2~AlO1F3psgCpChKVW0eXq5qh7ii9yrm_.3_1 2023-10-05T11:47:24.201 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.196+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.45__multipart_key1.2~AlO1F3psgCpChKVW0eXq5qh7ii9yrm_.4 2023-10-05T11:47:24.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.200+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.45__shadow_key1.2~AlO1F3psgCpChKVW0eXq5qh7ii9yrm_.4_1 2023-10-05T11:47:24.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.202+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.45__multipart_key1.2~AlO1F3psgCpChKVW0eXq5qh7ii9yrm_.5 2023-10-05T11:47:24.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.204+0000 7fcec8533880 5 garbage collection: RGWGC::process removing entries, marker: 2023-10-05T11:47:24.210 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.207+0000 7fcec8533880 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2023-10-05T11:47:24.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.208+0000 7fcec8533880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.209+0000 7fcec8533880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:24.213 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.209+0000 7fcec8533880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2023-10-05T11:47:24.213 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.209+0000 7fcec8533880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.12545348699845812770', time=2023-10-05T13:46:21.686337+0000, chain.objs.size()=21 2023-10-05T11:47:24.213 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.209+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.43__multipart_key1.2~KHb1lMHsMJNqjHO5O5Wa1MSnNAbA45L.1 2023-10-05T11:47:24.213 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.209+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.43__shadow_key1.2~KHb1lMHsMJNqjHO5O5Wa1MSnNAbA45L.1_1 2023-10-05T11:47:24.213 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.209+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.43__multipart_key1.2~KHb1lMHsMJNqjHO5O5Wa1MSnNAbA45L.2 2023-10-05T11:47:24.213 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.209+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.43__shadow_key1.2~KHb1lMHsMJNqjHO5O5Wa1MSnNAbA45L.2_1 2023-10-05T11:47:24.213 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.209+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.43__multipart_key1.2~KHb1lMHsMJNqjHO5O5Wa1MSnNAbA45L.3 2023-10-05T11:47:24.213 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.209+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.43__shadow_key1.2~KHb1lMHsMJNqjHO5O5Wa1MSnNAbA45L.3_1 2023-10-05T11:47:24.213 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.209+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.43__multipart_key1.2~KHb1lMHsMJNqjHO5O5Wa1MSnNAbA45L.4 2023-10-05T11:47:24.213 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.209+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.43__shadow_key1.2~KHb1lMHsMJNqjHO5O5Wa1MSnNAbA45L.4_1 2023-10-05T11:47:24.214 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.209+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.43__multipart_key1.2~KHb1lMHsMJNqjHO5O5Wa1MSnNAbA45L.5 2023-10-05T11:47:24.214 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.209+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.43__shadow_key1.2~KHb1lMHsMJNqjHO5O5Wa1MSnNAbA45L.5_1 2023-10-05T11:47:24.214 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.209+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.43__multipart_key1.2~KHb1lMHsMJNqjHO5O5Wa1MSnNAbA45L.6 2023-10-05T11:47:24.214 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.209+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.43__shadow_key1.2~KHb1lMHsMJNqjHO5O5Wa1MSnNAbA45L.6_1 2023-10-05T11:47:24.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.214+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.43__multipart_key1.2~KHb1lMHsMJNqjHO5O5Wa1MSnNAbA45L.7 2023-10-05T11:47:24.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.214+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.43__shadow_key1.2~KHb1lMHsMJNqjHO5O5Wa1MSnNAbA45L.7_1 2023-10-05T11:47:24.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.216+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.43__multipart_key1.2~KHb1lMHsMJNqjHO5O5Wa1MSnNAbA45L.8 2023-10-05T11:47:24.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.216+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.43__shadow_key1.2~KHb1lMHsMJNqjHO5O5Wa1MSnNAbA45L.8_1 2023-10-05T11:47:24.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.216+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.43__multipart_key1.2~KHb1lMHsMJNqjHO5O5Wa1MSnNAbA45L.9 2023-10-05T11:47:24.220 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.216+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.43__shadow_key1.2~KHb1lMHsMJNqjHO5O5Wa1MSnNAbA45L.9_1 2023-10-05T11:47:24.220 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.216+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.43__multipart_key1.2~KHb1lMHsMJNqjHO5O5Wa1MSnNAbA45L.10 2023-10-05T11:47:24.221 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.216+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.43__shadow_key1.2~KHb1lMHsMJNqjHO5O5Wa1MSnNAbA45L.10_1 2023-10-05T11:47:24.221 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.216+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.43__multipart_key1.2~KHb1lMHsMJNqjHO5O5Wa1MSnNAbA45L.11 2023-10-05T11:47:24.221 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.216+0000 7fcec8533880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.16799461732208882598', time=2023-10-05T13:46:37.193554+0000, chain.objs.size()=16 2023-10-05T11:47:24.221 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.216+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.43__multipart_key1.2~JAwQ_FxfuWuRyC5xpKm-z87DUN_9Mb-.1 2023-10-05T11:47:24.221 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.216+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.43__shadow_key1.2~JAwQ_FxfuWuRyC5xpKm-z87DUN_9Mb-.1_1 2023-10-05T11:47:24.222 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.217+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.43__shadow_key1.2~JAwQ_FxfuWuRyC5xpKm-z87DUN_9Mb-.1_2 2023-10-05T11:47:24.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.219+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.43__multipart_key1.2~JAwQ_FxfuWuRyC5xpKm-z87DUN_9Mb-.2 2023-10-05T11:47:24.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.219+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.43__shadow_key1.2~JAwQ_FxfuWuRyC5xpKm-z87DUN_9Mb-.2_1 2023-10-05T11:47:24.226 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.222+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.43__shadow_key1.2~JAwQ_FxfuWuRyC5xpKm-z87DUN_9Mb-.2_2 2023-10-05T11:47:24.226 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.222+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.43__multipart_key1.2~JAwQ_FxfuWuRyC5xpKm-z87DUN_9Mb-.3 2023-10-05T11:47:24.226 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.222+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.43__shadow_key1.2~JAwQ_FxfuWuRyC5xpKm-z87DUN_9Mb-.3_1 2023-10-05T11:47:24.226 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.222+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.43__shadow_key1.2~JAwQ_FxfuWuRyC5xpKm-z87DUN_9Mb-.3_2 2023-10-05T11:47:24.226 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.222+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.43__multipart_key1.2~JAwQ_FxfuWuRyC5xpKm-z87DUN_9Mb-.4 2023-10-05T11:47:24.226 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.222+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.43__shadow_key1.2~JAwQ_FxfuWuRyC5xpKm-z87DUN_9Mb-.4_1 2023-10-05T11:47:24.226 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.222+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.43__shadow_key1.2~JAwQ_FxfuWuRyC5xpKm-z87DUN_9Mb-.4_2 2023-10-05T11:47:24.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.222+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.43__multipart_key1.2~JAwQ_FxfuWuRyC5xpKm-z87DUN_9Mb-.5 2023-10-05T11:47:24.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.222+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.43__shadow_key1.2~JAwQ_FxfuWuRyC5xpKm-z87DUN_9Mb-.5_1 2023-10-05T11:47:24.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.225+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.43__shadow_key1.2~JAwQ_FxfuWuRyC5xpKm-z87DUN_9Mb-.5_2 2023-10-05T11:47:24.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.225+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.43__multipart_key1.2~JAwQ_FxfuWuRyC5xpKm-z87DUN_9Mb-.6 2023-10-05T11:47:24.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.226+0000 7fcec8533880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.9208227698301878238', time=2023-10-05T13:47:13.036306+0000, chain.objs.size()=1 2023-10-05T11:47:24.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.226+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.50__shadow_.eJTcTq6QGebIGgxWqmOM_LkowRslFMe_0 2023-10-05T11:47:24.234 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.231+0000 7fcec8533880 5 garbage collection: RGWGC::process removing entries, marker: 2023-10-05T11:47:24.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.234+0000 7fcec8533880 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2023-10-05T11:47:24.238 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.235+0000 7fcec8533880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.238 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.235+0000 7fcec8533880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:24.239 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.236+0000 7fcec8533880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.239 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.236+0000 7fcec8533880 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2023-10-05T11:47:24.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.238+0000 7fcec8533880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.238+0000 7fcec8533880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:24.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.238+0000 7fcec8533880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2023-10-05T11:47:24.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.238+0000 7fcec8533880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.9447714255869558621', time=2023-10-05T13:46:45.592019+0000, chain.objs.size()=16 2023-10-05T11:47:24.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.238+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.43__multipart_key1.2~JN6dtWDr-w52QNjIP5_FZHKVRGAXKXG.1 2023-10-05T11:47:24.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.238+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.43__shadow_key1.2~JN6dtWDr-w52QNjIP5_FZHKVRGAXKXG.1_1 2023-10-05T11:47:24.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.238+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.43__shadow_key1.2~JN6dtWDr-w52QNjIP5_FZHKVRGAXKXG.1_2 2023-10-05T11:47:24.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.238+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.43__multipart_key1.2~JN6dtWDr-w52QNjIP5_FZHKVRGAXKXG.2 2023-10-05T11:47:24.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.238+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.43__shadow_key1.2~JN6dtWDr-w52QNjIP5_FZHKVRGAXKXG.2_1 2023-10-05T11:47:24.243 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.238+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.43__shadow_key1.2~JN6dtWDr-w52QNjIP5_FZHKVRGAXKXG.2_2 2023-10-05T11:47:24.243 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.238+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.43__multipart_key1.2~JN6dtWDr-w52QNjIP5_FZHKVRGAXKXG.3 2023-10-05T11:47:24.243 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.238+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.43__shadow_key1.2~JN6dtWDr-w52QNjIP5_FZHKVRGAXKXG.3_1 2023-10-05T11:47:24.243 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.238+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.43__shadow_key1.2~JN6dtWDr-w52QNjIP5_FZHKVRGAXKXG.3_2 2023-10-05T11:47:24.243 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.238+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.43__multipart_key1.2~JN6dtWDr-w52QNjIP5_FZHKVRGAXKXG.4 2023-10-05T11:47:24.243 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.238+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.43__shadow_key1.2~JN6dtWDr-w52QNjIP5_FZHKVRGAXKXG.4_1 2023-10-05T11:47:24.243 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.239+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.43__shadow_key1.2~JN6dtWDr-w52QNjIP5_FZHKVRGAXKXG.4_2 2023-10-05T11:47:24.246 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.243+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.43__multipart_key1.2~JN6dtWDr-w52QNjIP5_FZHKVRGAXKXG.5 2023-10-05T11:47:24.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.243+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.43__shadow_key1.2~JN6dtWDr-w52QNjIP5_FZHKVRGAXKXG.5_1 2023-10-05T11:47:24.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.243+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.43__shadow_key1.2~JN6dtWDr-w52QNjIP5_FZHKVRGAXKXG.5_2 2023-10-05T11:47:24.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.243+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.43__multipart_key1.2~JN6dtWDr-w52QNjIP5_FZHKVRGAXKXG.6 2023-10-05T11:47:24.251 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.248+0000 7fcec8533880 5 garbage collection: RGWGC::process removing entries, marker: 2023-10-05T11:47:24.253 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.250+0000 7fcec8533880 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2023-10-05T11:47:24.255 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.252+0000 7fcec8533880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.255 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.252+0000 7fcec8533880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:24.255 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.252+0000 7fcec8533880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2023-10-05T11:47:24.256 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.252+0000 7fcec8533880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.17574393174200138039', time=2023-10-05T13:45:33.630177+0000, chain.objs.size()=1 2023-10-05T11:47:24.256 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.252+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.41__shadow_.0JKDfNsQl6h8AmmzeYszOow_-wloP5F_0 2023-10-05T11:47:24.257 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.254+0000 7fcec8533880 5 garbage collection: RGWGC::process removing entries, marker: 2023-10-05T11:47:24.259 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.256+0000 7fcec8533880 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2023-10-05T11:47:24.260 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.257+0000 7fcec8533880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.260 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.257+0000 7fcec8533880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:24.261 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.258+0000 7fcec8533880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2023-10-05T11:47:24.261 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.258+0000 7fcec8533880 20 garbage collection: RGWGC::process iterating over entry tag='2~yF8RSjVrWWEleQLUIB0wffwwqz7hrn_', time=2023-10-05T13:45:36.113889+0000, chain.objs.size()=5 2023-10-05T11:47:24.261 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.258+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.42__multipart_key1.2~yF8RSjVrWWEleQLUIB0wffwwqz7hrn_.7 2023-10-05T11:47:24.261 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.258+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.42__shadow_key1.2~yF8RSjVrWWEleQLUIB0wffwwqz7hrn_.7_1 2023-10-05T11:47:24.262 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.258+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.42__multipart_key1.2~yF8RSjVrWWEleQLUIB0wffwwqz7hrn_.10 2023-10-05T11:47:24.262 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.258+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.42__shadow_key1.2~yF8RSjVrWWEleQLUIB0wffwwqz7hrn_.10_1 2023-10-05T11:47:24.262 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.258+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.42__multipart_key1.2~yF8RSjVrWWEleQLUIB0wffwwqz7hrn_.13 2023-10-05T11:47:24.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.261+0000 7fcec8533880 5 garbage collection: RGWGC::process removing entries, marker: 2023-10-05T11:47:24.267 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.263+0000 7fcec8533880 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2023-10-05T11:47:24.268 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.265+0000 7fcec8533880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.268 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.265+0000 7fcec8533880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:24.268 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.265+0000 7fcec8533880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.269 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.266+0000 7fcec8533880 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2023-10-05T11:47:24.270 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.267+0000 7fcec8533880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.271 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.268+0000 7fcec8533880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:24.271 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.268+0000 7fcec8533880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2023-10-05T11:47:24.272 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.268+0000 7fcec8533880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.3353951273982686382', time=2023-10-05T13:47:12.565273+0000, chain.objs.size()=1 2023-10-05T11:47:24.272 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.268+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.49__shadow_.-ZnwxL-3VLA7KcbXuyaZHip8xtkmrky_0 2023-10-05T11:47:24.272 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.269+0000 7fcec8533880 5 garbage collection: RGWGC::process removing entries, marker: 2023-10-05T11:47:24.274 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.271+0000 7fcec8533880 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2023-10-05T11:47:24.276 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.273+0000 7fcec8533880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.276 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.273+0000 7fcec8533880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:24.278 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.273+0000 7fcec8533880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2023-10-05T11:47:24.278 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.273+0000 7fcec8533880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.10523756477456451858', time=2023-10-05T13:46:58.693958+0000, chain.objs.size()=1 2023-10-05T11:47:24.278 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.273+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.44__shadow_.bwR8TNcaKOUs6fR1Z_sOE77fP1J17Fk_0 2023-10-05T11:47:24.278 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.274+0000 7fcec8533880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.8165815939406159885', time=2023-10-05T13:47:23.332155+0000, chain.objs.size()=21 2023-10-05T11:47:24.278 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.274+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.54__multipart_key1.2~nekhZPT7JMi6bWvjKbWB2i-R3ivpJiA.1 2023-10-05T11:47:24.278 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.274+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.54__shadow_key1.2~nekhZPT7JMi6bWvjKbWB2i-R3ivpJiA.1_1 2023-10-05T11:47:24.279 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.274+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.54__multipart_key1.2~nekhZPT7JMi6bWvjKbWB2i-R3ivpJiA.2 2023-10-05T11:47:24.279 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.274+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.54__shadow_key1.2~nekhZPT7JMi6bWvjKbWB2i-R3ivpJiA.2_1 2023-10-05T11:47:24.279 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.274+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.54__multipart_key1.2~nekhZPT7JMi6bWvjKbWB2i-R3ivpJiA.3 2023-10-05T11:47:24.279 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.274+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.54__shadow_key1.2~nekhZPT7JMi6bWvjKbWB2i-R3ivpJiA.3_1 2023-10-05T11:47:24.279 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.274+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.54__multipart_key1.2~nekhZPT7JMi6bWvjKbWB2i-R3ivpJiA.4 2023-10-05T11:47:24.280 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.274+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.54__shadow_key1.2~nekhZPT7JMi6bWvjKbWB2i-R3ivpJiA.4_1 2023-10-05T11:47:24.280 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.274+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.54__multipart_key1.2~nekhZPT7JMi6bWvjKbWB2i-R3ivpJiA.5 2023-10-05T11:47:24.280 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.274+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.54__shadow_key1.2~nekhZPT7JMi6bWvjKbWB2i-R3ivpJiA.5_1 2023-10-05T11:47:24.280 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.274+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.54__multipart_key1.2~nekhZPT7JMi6bWvjKbWB2i-R3ivpJiA.6 2023-10-05T11:47:24.281 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.277+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.54__shadow_key1.2~nekhZPT7JMi6bWvjKbWB2i-R3ivpJiA.6_1 2023-10-05T11:47:24.282 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.278+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.54__multipart_key1.2~nekhZPT7JMi6bWvjKbWB2i-R3ivpJiA.7 2023-10-05T11:47:24.282 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.278+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.54__shadow_key1.2~nekhZPT7JMi6bWvjKbWB2i-R3ivpJiA.7_1 2023-10-05T11:47:24.282 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.278+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.54__multipart_key1.2~nekhZPT7JMi6bWvjKbWB2i-R3ivpJiA.8 2023-10-05T11:47:24.282 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.278+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.54__shadow_key1.2~nekhZPT7JMi6bWvjKbWB2i-R3ivpJiA.8_1 2023-10-05T11:47:24.283 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.278+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.54__multipart_key1.2~nekhZPT7JMi6bWvjKbWB2i-R3ivpJiA.9 2023-10-05T11:47:24.283 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.278+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.54__shadow_key1.2~nekhZPT7JMi6bWvjKbWB2i-R3ivpJiA.9_1 2023-10-05T11:47:24.283 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.278+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.54__multipart_key1.2~nekhZPT7JMi6bWvjKbWB2i-R3ivpJiA.10 2023-10-05T11:47:24.284 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.280+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.54__shadow_key1.2~nekhZPT7JMi6bWvjKbWB2i-R3ivpJiA.10_1 2023-10-05T11:47:24.284 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.280+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.54__multipart_key1.2~nekhZPT7JMi6bWvjKbWB2i-R3ivpJiA.11 2023-10-05T11:47:24.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.285+0000 7fcec8533880 5 garbage collection: RGWGC::process removing entries, marker: 2023-10-05T11:47:24.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.287+0000 7fcec8533880 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2023-10-05T11:47:24.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.288+0000 7fcec8533880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.289+0000 7fcec8533880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:24.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.289+0000 7fcec8533880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2023-10-05T11:47:24.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.289+0000 7fcec8533880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.4816383618414517116', time=2023-10-05T13:46:29.417138+0000, chain.objs.size()=19 2023-10-05T11:47:24.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.289+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.43__multipart_key1.2~MR_M8qtDQD1c_FcyZB5j_smZ_x8dxNf.1 2023-10-05T11:47:24.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.289+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.43__shadow_key1.2~MR_M8qtDQD1c_FcyZB5j_smZ_x8dxNf.1_1 2023-10-05T11:47:24.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.289+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.43__multipart_key1.2~MR_M8qtDQD1c_FcyZB5j_smZ_x8dxNf.2 2023-10-05T11:47:24.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.289+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.43__shadow_key1.2~MR_M8qtDQD1c_FcyZB5j_smZ_x8dxNf.2_1 2023-10-05T11:47:24.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.289+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.43__multipart_key1.2~MR_M8qtDQD1c_FcyZB5j_smZ_x8dxNf.3 2023-10-05T11:47:24.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.289+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.43__shadow_key1.2~MR_M8qtDQD1c_FcyZB5j_smZ_x8dxNf.3_1 2023-10-05T11:47:24.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.289+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.43__multipart_key1.2~MR_M8qtDQD1c_FcyZB5j_smZ_x8dxNf.4 2023-10-05T11:47:24.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.289+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.43__shadow_key1.2~MR_M8qtDQD1c_FcyZB5j_smZ_x8dxNf.4_1 2023-10-05T11:47:24.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.289+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.43__multipart_key1.2~MR_M8qtDQD1c_FcyZB5j_smZ_x8dxNf.5 2023-10-05T11:47:24.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.289+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.43__shadow_key1.2~MR_M8qtDQD1c_FcyZB5j_smZ_x8dxNf.5_1 2023-10-05T11:47:24.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.289+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.43__multipart_key1.2~MR_M8qtDQD1c_FcyZB5j_smZ_x8dxNf.6 2023-10-05T11:47:24.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.289+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.43__shadow_key1.2~MR_M8qtDQD1c_FcyZB5j_smZ_x8dxNf.6_1 2023-10-05T11:47:24.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.293+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.43__multipart_key1.2~MR_M8qtDQD1c_FcyZB5j_smZ_x8dxNf.7 2023-10-05T11:47:24.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.293+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.43__shadow_key1.2~MR_M8qtDQD1c_FcyZB5j_smZ_x8dxNf.7_1 2023-10-05T11:47:24.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.296+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.43__multipart_key1.2~MR_M8qtDQD1c_FcyZB5j_smZ_x8dxNf.8 2023-10-05T11:47:24.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.296+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.43__shadow_key1.2~MR_M8qtDQD1c_FcyZB5j_smZ_x8dxNf.8_1 2023-10-05T11:47:24.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.296+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.43__multipart_key1.2~MR_M8qtDQD1c_FcyZB5j_smZ_x8dxNf.9 2023-10-05T11:47:24.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.296+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.43__shadow_key1.2~MR_M8qtDQD1c_FcyZB5j_smZ_x8dxNf.9_1 2023-10-05T11:47:24.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.296+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.43__multipart_key1.2~MR_M8qtDQD1c_FcyZB5j_smZ_x8dxNf.10 2023-10-05T11:47:24.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.300+0000 7fcec8533880 5 garbage collection: RGWGC::process removing entries, marker: 2023-10-05T11:47:24.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.303+0000 7fcec8533880 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2023-10-05T11:47:24.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.304+0000 7fcec8533880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.305+0000 7fcec8533880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:24.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.305+0000 7fcec8533880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.306+0000 7fcec8533880 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2023-10-05T11:47:24.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.307+0000 7fcec8533880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.308+0000 7fcec8533880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:24.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.308+0000 7fcec8533880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.309+0000 7fcec8533880 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2023-10-05T11:47:24.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.310+0000 7fcec8533880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.314 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.311+0000 7fcec8533880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:24.314 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.311+0000 7fcec8533880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.315 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.312+0000 7fcec8533880 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2023-10-05T11:47:24.316 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.313+0000 7fcec8533880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.314+0000 7fcec8533880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:24.318 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.314+0000 7fcec8533880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2023-10-05T11:47:24.318 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.314+0000 7fcec8533880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.10863717178792074939', time=2023-10-05T13:45:04.092610+0000, chain.objs.size()=7 2023-10-05T11:47:24.318 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.314+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.35__multipart_key1.2~XVj27QfXZOMO9QDVBPkSMEZCKasOUxh.1 2023-10-05T11:47:24.318 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.314+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.35__shadow_key1.2~XVj27QfXZOMO9QDVBPkSMEZCKasOUxh.1_1 2023-10-05T11:47:24.318 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.314+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.35__shadow_key1.2~XVj27QfXZOMO9QDVBPkSMEZCKasOUxh.1_2 2023-10-05T11:47:24.319 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.314+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.35__multipart_key1.2~XVj27QfXZOMO9QDVBPkSMEZCKasOUxh.2 2023-10-05T11:47:24.319 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.314+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.35__shadow_key1.2~XVj27QfXZOMO9QDVBPkSMEZCKasOUxh.2_1 2023-10-05T11:47:24.319 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.314+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.35__shadow_key1.2~XVj27QfXZOMO9QDVBPkSMEZCKasOUxh.2_2 2023-10-05T11:47:24.319 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.314+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.35__multipart_key1.2~XVj27QfXZOMO9QDVBPkSMEZCKasOUxh.3 2023-10-05T11:47:24.319 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.314+0000 7fcec8533880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.751339012750671196', time=2023-10-05T13:47:12.095173+0000, chain.objs.size()=1 2023-10-05T11:47:24.319 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.314+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.48__shadow_.5F_PhID27F06HH2SqQ29Cj7L2MnRl1h_0 2023-10-05T11:47:24.321 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.317+0000 7fcec8533880 5 garbage collection: RGWGC::process removing entries, marker: 2023-10-05T11:47:24.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.321+0000 7fcec8533880 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2023-10-05T11:47:24.326 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.323+0000 7fcec8533880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.327 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.323+0000 7fcec8533880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:24.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.323+0000 7fcec8533880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2023-10-05T11:47:24.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.324+0000 7fcec8533880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.17444408010485239796', time=2023-10-05T13:44:11.677058+0000, chain.objs.size()=9 2023-10-05T11:47:24.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.324+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.32__multipart_key1.2~jXbb34mIDLjrBCn40CK_LHgAQF_MDRr.1 2023-10-05T11:47:24.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.324+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.32__shadow_key1.2~jXbb34mIDLjrBCn40CK_LHgAQF_MDRr.1_1 2023-10-05T11:47:24.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.324+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.32__multipart_key1.2~jXbb34mIDLjrBCn40CK_LHgAQF_MDRr.2 2023-10-05T11:47:24.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.324+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.32__shadow_key1.2~jXbb34mIDLjrBCn40CK_LHgAQF_MDRr.2_1 2023-10-05T11:47:24.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.324+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.32__multipart_key1.2~jXbb34mIDLjrBCn40CK_LHgAQF_MDRr.3 2023-10-05T11:47:24.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.324+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.32__shadow_key1.2~jXbb34mIDLjrBCn40CK_LHgAQF_MDRr.3_1 2023-10-05T11:47:24.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.324+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.32__multipart_key1.2~jXbb34mIDLjrBCn40CK_LHgAQF_MDRr.4 2023-10-05T11:47:24.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.324+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.32__shadow_key1.2~jXbb34mIDLjrBCn40CK_LHgAQF_MDRr.4_1 2023-10-05T11:47:24.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.324+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.32__multipart_key1.2~jXbb34mIDLjrBCn40CK_LHgAQF_MDRr.5 2023-10-05T11:47:24.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.324+0000 7fcec8533880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.13248327664557299926', time=2023-10-05T13:44:48.290596+0000, chain.objs.size()=9 2023-10-05T11:47:24.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.324+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.35__multipart_key1.2~jQWUWCItACwaz4b54shs0EwYuR8NAzp.1 2023-10-05T11:47:24.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.324+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.35__shadow_key1.2~jQWUWCItACwaz4b54shs0EwYuR8NAzp.1_1 2023-10-05T11:47:24.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.324+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.35__multipart_key1.2~jQWUWCItACwaz4b54shs0EwYuR8NAzp.2 2023-10-05T11:47:24.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.326+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.35__shadow_key1.2~jQWUWCItACwaz4b54shs0EwYuR8NAzp.2_1 2023-10-05T11:47:24.332 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.328+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.35__multipart_key1.2~jQWUWCItACwaz4b54shs0EwYuR8NAzp.3 2023-10-05T11:47:24.332 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.328+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.35__shadow_key1.2~jQWUWCItACwaz4b54shs0EwYuR8NAzp.3_1 2023-10-05T11:47:24.332 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.328+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.35__multipart_key1.2~jQWUWCItACwaz4b54shs0EwYuR8NAzp.4 2023-10-05T11:47:24.332 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.328+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.35__shadow_key1.2~jQWUWCItACwaz4b54shs0EwYuR8NAzp.4_1 2023-10-05T11:47:24.332 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.328+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.35__multipart_key1.2~jQWUWCItACwaz4b54shs0EwYuR8NAzp.5 2023-10-05T11:47:24.332 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.328+0000 7fcec8533880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.8490984464345570672', time=2023-10-05T13:45:10.398195+0000, chain.objs.size()=9 2023-10-05T11:47:24.332 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.328+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.39__multipart_key1.2~SXmbMtVX7Ouv-d0KbjD3uKNTd4PCfhG.1 2023-10-05T11:47:24.333 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.328+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.39__shadow_key1.2~SXmbMtVX7Ouv-d0KbjD3uKNTd4PCfhG.1_1 2023-10-05T11:47:24.333 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.328+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.39__multipart_key1.2~SXmbMtVX7Ouv-d0KbjD3uKNTd4PCfhG.2 2023-10-05T11:47:24.333 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.328+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.39__shadow_key1.2~SXmbMtVX7Ouv-d0KbjD3uKNTd4PCfhG.2_1 2023-10-05T11:47:24.333 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.328+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.39__multipart_key1.2~SXmbMtVX7Ouv-d0KbjD3uKNTd4PCfhG.3 2023-10-05T11:47:24.334 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.331+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.39__shadow_key1.2~SXmbMtVX7Ouv-d0KbjD3uKNTd4PCfhG.3_1 2023-10-05T11:47:24.335 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.332+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.39__multipart_key1.2~SXmbMtVX7Ouv-d0KbjD3uKNTd4PCfhG.4 2023-10-05T11:47:24.336 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.333+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.39__shadow_key1.2~SXmbMtVX7Ouv-d0KbjD3uKNTd4PCfhG.4_1 2023-10-05T11:47:24.339 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.336+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.39__multipart_key1.2~SXmbMtVX7Ouv-d0KbjD3uKNTd4PCfhG.5 2023-10-05T11:47:24.340 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.336+0000 7fcec8533880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.13932158452215955234', time=2023-10-05T13:47:00.242513+0000, chain.objs.size()=9 2023-10-05T11:47:24.340 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.336+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.44__multipart_key1.2~lpIA_gGbR7tEmq2Lf-fY-6NNEJlyPk0.1 2023-10-05T11:47:24.340 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.336+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.44__shadow_key1.2~lpIA_gGbR7tEmq2Lf-fY-6NNEJlyPk0.1_1 2023-10-05T11:47:24.340 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.336+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.44__multipart_key1.2~lpIA_gGbR7tEmq2Lf-fY-6NNEJlyPk0.2 2023-10-05T11:47:24.340 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.336+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.44__shadow_key1.2~lpIA_gGbR7tEmq2Lf-fY-6NNEJlyPk0.2_1 2023-10-05T11:47:24.340 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.336+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.44__multipart_key1.2~lpIA_gGbR7tEmq2Lf-fY-6NNEJlyPk0.3 2023-10-05T11:47:24.340 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.336+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.44__shadow_key1.2~lpIA_gGbR7tEmq2Lf-fY-6NNEJlyPk0.3_1 2023-10-05T11:47:24.340 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.336+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.44__multipart_key1.2~lpIA_gGbR7tEmq2Lf-fY-6NNEJlyPk0.4 2023-10-05T11:47:24.340 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.336+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.44__shadow_key1.2~lpIA_gGbR7tEmq2Lf-fY-6NNEJlyPk0.4_1 2023-10-05T11:47:24.340 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.336+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.44__multipart_key1.2~lpIA_gGbR7tEmq2Lf-fY-6NNEJlyPk0.5 2023-10-05T11:47:24.346 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.343+0000 7fcec8533880 5 garbage collection: RGWGC::process removing entries, marker: 2023-10-05T11:47:24.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.345+0000 7fcec8533880 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2023-10-05T11:47:24.350 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.347+0000 7fcec8533880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.347+0000 7fcec8533880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:24.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.348+0000 7fcec8533880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2023-10-05T11:47:24.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.348+0000 7fcec8533880 20 garbage collection: RGWGC::process iterating over entry tag='2~iJ9Xatj-iwege1pkgQRr4zYbhjhrkIc', time=2023-10-05T13:44:00.171621+0000, chain.objs.size()=9 2023-10-05T11:47:24.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.348+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.28__multipart_key1.2~iJ9Xatj-iwege1pkgQRr4zYbhjhrkIc.1 2023-10-05T11:47:24.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.348+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.28__shadow_key1.2~iJ9Xatj-iwege1pkgQRr4zYbhjhrkIc.1_1 2023-10-05T11:47:24.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.348+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.28__multipart_key1.2~iJ9Xatj-iwege1pkgQRr4zYbhjhrkIc.2 2023-10-05T11:47:24.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.348+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.28__shadow_key1.2~iJ9Xatj-iwege1pkgQRr4zYbhjhrkIc.2_1 2023-10-05T11:47:24.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.348+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.28__multipart_key1.2~iJ9Xatj-iwege1pkgQRr4zYbhjhrkIc.3 2023-10-05T11:47:24.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.348+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.28__shadow_key1.2~iJ9Xatj-iwege1pkgQRr4zYbhjhrkIc.3_1 2023-10-05T11:47:24.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.348+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.28__multipart_key1.2~iJ9Xatj-iwege1pkgQRr4zYbhjhrkIc.4 2023-10-05T11:47:24.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.348+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.28__shadow_key1.2~iJ9Xatj-iwege1pkgQRr4zYbhjhrkIc.4_1 2023-10-05T11:47:24.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.348+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.28__multipart_key1.2~iJ9Xatj-iwege1pkgQRr4zYbhjhrkIc.5 2023-10-05T11:47:24.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.351+0000 7fcec8533880 5 garbage collection: RGWGC::process removing entries, marker: 2023-10-05T11:47:24.358 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.354+0000 7fcec8533880 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2023-10-05T11:47:24.359 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.356+0000 7fcec8533880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.359 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.356+0000 7fcec8533880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:24.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.357+0000 7fcec8533880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2023-10-05T11:47:24.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.357+0000 7fcec8533880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.18331971760254872732', time=2023-10-05T13:46:45.386345+0000, chain.objs.size()=16 2023-10-05T11:47:24.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.357+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.43__multipart_key1.2~4K2XBl0KLF0WEIZnnQbCzE8LOyN8EEW.1 2023-10-05T11:47:24.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.357+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.43__shadow_key1.2~4K2XBl0KLF0WEIZnnQbCzE8LOyN8EEW.1_1 2023-10-05T11:47:24.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.357+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.43__shadow_key1.2~4K2XBl0KLF0WEIZnnQbCzE8LOyN8EEW.1_2 2023-10-05T11:47:24.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.357+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.43__multipart_key1.2~4K2XBl0KLF0WEIZnnQbCzE8LOyN8EEW.2 2023-10-05T11:47:24.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.357+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.43__shadow_key1.2~4K2XBl0KLF0WEIZnnQbCzE8LOyN8EEW.2_1 2023-10-05T11:47:24.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.357+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.43__shadow_key1.2~4K2XBl0KLF0WEIZnnQbCzE8LOyN8EEW.2_2 2023-10-05T11:47:24.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.357+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.43__multipart_key1.2~4K2XBl0KLF0WEIZnnQbCzE8LOyN8EEW.3 2023-10-05T11:47:24.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.357+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.43__shadow_key1.2~4K2XBl0KLF0WEIZnnQbCzE8LOyN8EEW.3_1 2023-10-05T11:47:24.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.357+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.43__shadow_key1.2~4K2XBl0KLF0WEIZnnQbCzE8LOyN8EEW.3_2 2023-10-05T11:47:24.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.357+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.43__multipart_key1.2~4K2XBl0KLF0WEIZnnQbCzE8LOyN8EEW.4 2023-10-05T11:47:24.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.357+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.43__shadow_key1.2~4K2XBl0KLF0WEIZnnQbCzE8LOyN8EEW.4_1 2023-10-05T11:47:24.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.357+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.43__shadow_key1.2~4K2XBl0KLF0WEIZnnQbCzE8LOyN8EEW.4_2 2023-10-05T11:47:24.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.361+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.43__multipart_key1.2~4K2XBl0KLF0WEIZnnQbCzE8LOyN8EEW.5 2023-10-05T11:47:24.365 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.361+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.43__shadow_key1.2~4K2XBl0KLF0WEIZnnQbCzE8LOyN8EEW.5_1 2023-10-05T11:47:24.365 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.361+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.43__shadow_key1.2~4K2XBl0KLF0WEIZnnQbCzE8LOyN8EEW.5_2 2023-10-05T11:47:24.365 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.361+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.43__multipart_key1.2~4K2XBl0KLF0WEIZnnQbCzE8LOyN8EEW.6 2023-10-05T11:47:24.369 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.366+0000 7fcec8533880 5 garbage collection: RGWGC::process removing entries, marker: 2023-10-05T11:47:24.371 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.368+0000 7fcec8533880 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2023-10-05T11:47:24.372 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.369+0000 7fcec8533880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.373 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.370+0000 7fcec8533880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:24.373 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.370+0000 7fcec8533880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.374 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.371+0000 7fcec8533880 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2023-10-05T11:47:24.375 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.372+0000 7fcec8533880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.375 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.372+0000 7fcec8533880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:24.376 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.373+0000 7fcec8533880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2023-10-05T11:47:24.376 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.373+0000 7fcec8533880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.14640544447255853235', time=2023-10-05T13:44:06.051295+0000, chain.objs.size()=9 2023-10-05T11:47:24.376 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.373+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.30__multipart_key1.2~VCjewCj2wSsLHUDNVNfu1sng6bGYzEi.1 2023-10-05T11:47:24.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.373+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.30__shadow_key1.2~VCjewCj2wSsLHUDNVNfu1sng6bGYzEi.1_1 2023-10-05T11:47:24.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.373+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.30__multipart_key1.2~VCjewCj2wSsLHUDNVNfu1sng6bGYzEi.2 2023-10-05T11:47:24.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.373+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.30__shadow_key1.2~VCjewCj2wSsLHUDNVNfu1sng6bGYzEi.2_1 2023-10-05T11:47:24.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.373+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.30__multipart_key1.2~VCjewCj2wSsLHUDNVNfu1sng6bGYzEi.3 2023-10-05T11:47:24.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.373+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.30__shadow_key1.2~VCjewCj2wSsLHUDNVNfu1sng6bGYzEi.3_1 2023-10-05T11:47:24.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.373+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.30__multipart_key1.2~VCjewCj2wSsLHUDNVNfu1sng6bGYzEi.4 2023-10-05T11:47:24.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.373+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.30__shadow_key1.2~VCjewCj2wSsLHUDNVNfu1sng6bGYzEi.4_1 2023-10-05T11:47:24.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.373+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.30__multipart_key1.2~VCjewCj2wSsLHUDNVNfu1sng6bGYzEi.5 2023-10-05T11:47:24.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.373+0000 7fcec8533880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.6448521065159805685', time=2023-10-05T13:45:25.769686+0000, chain.objs.size()=9 2023-10-05T11:47:24.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.373+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.40__multipart_key1.2~-6w8gG-I-J02tixG9y1awa-1BQUKPsK.1 2023-10-05T11:47:24.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.373+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.40__shadow_key1.2~-6w8gG-I-J02tixG9y1awa-1BQUKPsK.1_1 2023-10-05T11:47:24.378 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.373+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.40__multipart_key1.2~-6w8gG-I-J02tixG9y1awa-1BQUKPsK.2 2023-10-05T11:47:24.381 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.378+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.40__shadow_key1.2~-6w8gG-I-J02tixG9y1awa-1BQUKPsK.2_1 2023-10-05T11:47:24.381 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.378+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.40__multipart_key1.2~-6w8gG-I-J02tixG9y1awa-1BQUKPsK.3 2023-10-05T11:47:24.381 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.378+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.40__shadow_key1.2~-6w8gG-I-J02tixG9y1awa-1BQUKPsK.3_1 2023-10-05T11:47:24.381 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.378+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.40__multipart_key1.2~-6w8gG-I-J02tixG9y1awa-1BQUKPsK.4 2023-10-05T11:47:24.381 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.378+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.40__shadow_key1.2~-6w8gG-I-J02tixG9y1awa-1BQUKPsK.4_1 2023-10-05T11:47:24.382 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.378+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.40__multipart_key1.2~-6w8gG-I-J02tixG9y1awa-1BQUKPsK.5 2023-10-05T11:47:24.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.383+0000 7fcec8533880 5 garbage collection: RGWGC::process removing entries, marker: 2023-10-05T11:47:24.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.386+0000 7fcec8533880 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2023-10-05T11:47:24.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.387+0000 7fcec8533880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.388+0000 7fcec8533880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:24.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.388+0000 7fcec8533880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2023-10-05T11:47:24.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.388+0000 7fcec8533880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.3412074919947020414', time=2023-10-05T13:47:13.506984+0000, chain.objs.size()=1 2023-10-05T11:47:24.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.388+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.51__shadow_._Lw_XvQLioQt-_Hx1uIhkZNIzzSJW3o_0 2023-10-05T11:47:24.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.389+0000 7fcec8533880 5 garbage collection: RGWGC::process removing entries, marker: 2023-10-05T11:47:24.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.391+0000 7fcec8533880 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2023-10-05T11:47:24.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.393+0000 7fcec8533880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.393+0000 7fcec8533880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:24.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.393+0000 7fcec8533880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2023-10-05T11:47:24.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.393+0000 7fcec8533880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4604.32__shadow_key1.2~jXbb34mIDLjrBCn40CK_LHgAQF_MDRr.1_1_9841aa1be5af90059221c80d5b0a80b8', time=2023-10-05T13:44:11.392959+0000, chain.objs.size()=9 2023-10-05T11:47:24.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.393+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.32__multipart_key1.2~jXbb34mIDLjrBCn40CK_LHgAQF_MDRr.1 2023-10-05T11:47:24.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.393+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.32__shadow_key1.2~jXbb34mIDLjrBCn40CK_LHgAQF_MDRr.1_1 2023-10-05T11:47:24.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.393+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.32__multipart_key1.2~jXbb34mIDLjrBCn40CK_LHgAQF_MDRr.2 2023-10-05T11:47:24.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.393+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.32__shadow_key1.2~jXbb34mIDLjrBCn40CK_LHgAQF_MDRr.2_1 2023-10-05T11:47:24.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.393+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.32__multipart_key1.2~jXbb34mIDLjrBCn40CK_LHgAQF_MDRr.3 2023-10-05T11:47:24.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.393+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.32__shadow_key1.2~jXbb34mIDLjrBCn40CK_LHgAQF_MDRr.3_1 2023-10-05T11:47:24.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.393+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.32__multipart_key1.2~jXbb34mIDLjrBCn40CK_LHgAQF_MDRr.4 2023-10-05T11:47:24.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.393+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.32__shadow_key1.2~jXbb34mIDLjrBCn40CK_LHgAQF_MDRr.4_1 2023-10-05T11:47:24.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.393+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.32__multipart_key1.2~jXbb34mIDLjrBCn40CK_LHgAQF_MDRr.5 2023-10-05T11:47:24.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.396+0000 7fcec8533880 5 garbage collection: RGWGC::process removing entries, marker: 2023-10-05T11:47:24.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.398+0000 7fcec8533880 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2023-10-05T11:47:24.403 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.400+0000 7fcec8533880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.403 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.400+0000 7fcec8533880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:24.404 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.401+0000 7fcec8533880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2023-10-05T11:47:24.404 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.401+0000 7fcec8533880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.10940788474659441039', time=2023-10-05T13:45:04.296608+0000, chain.objs.size()=6 2023-10-05T11:47:24.404 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.401+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.34__shadow_.xq9dZCqoC0KBq23FK4zYNoeN2uNNJEj_0 2023-10-05T11:47:24.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.401+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.34__shadow_.xq9dZCqoC0KBq23FK4zYNoeN2uNNJEj_1 2023-10-05T11:47:24.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.401+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.34__shadow_.xq9dZCqoC0KBq23FK4zYNoeN2uNNJEj_2 2023-10-05T11:47:24.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.401+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.34__shadow_.xq9dZCqoC0KBq23FK4zYNoeN2uNNJEj_3 2023-10-05T11:47:24.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.401+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.34__shadow_.xq9dZCqoC0KBq23FK4zYNoeN2uNNJEj_4 2023-10-05T11:47:24.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.401+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.34__shadow_.xq9dZCqoC0KBq23FK4zYNoeN2uNNJEj_5 2023-10-05T11:47:24.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.401+0000 7fcec8533880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.12386073934218182354', time=2023-10-05T13:45:33.568399+0000, chain.objs.size()=1 2023-10-05T11:47:24.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.401+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.41__shadow_.cXXmk-IlCQOXMFu4FIzN4AW_4zCUGTq_0 2023-10-05T11:47:24.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.405+0000 7fcec8533880 5 garbage collection: RGWGC::process removing entries, marker: 2023-10-05T11:47:24.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.408+0000 7fcec8533880 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2023-10-05T11:47:24.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.409+0000 7fcec8533880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.410+0000 7fcec8533880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:24.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.410+0000 7fcec8533880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2023-10-05T11:47:24.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.410+0000 7fcec8533880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.4575521765049143802', time=2023-10-05T13:45:33.600587+0000, chain.objs.size()=9 2023-10-05T11:47:24.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.410+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.41__multipart_file2.mpg.2~CvKOMpOVqf_OIozqF7NrE4tDko0stmc.1 2023-10-05T11:47:24.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.410+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.41__shadow_file2.mpg.2~CvKOMpOVqf_OIozqF7NrE4tDko0stmc.1_1 2023-10-05T11:47:24.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.410+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.41__multipart_file2.mpg.2~CvKOMpOVqf_OIozqF7NrE4tDko0stmc.2 2023-10-05T11:47:24.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.410+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.41__shadow_file2.mpg.2~CvKOMpOVqf_OIozqF7NrE4tDko0stmc.2_1 2023-10-05T11:47:24.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.410+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.41__multipart_file2.mpg.2~CvKOMpOVqf_OIozqF7NrE4tDko0stmc.3 2023-10-05T11:47:24.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.410+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.41__shadow_file2.mpg.2~CvKOMpOVqf_OIozqF7NrE4tDko0stmc.3_1 2023-10-05T11:47:24.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.410+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.41__multipart_file2.mpg.2~CvKOMpOVqf_OIozqF7NrE4tDko0stmc.4 2023-10-05T11:47:24.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.410+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.41__shadow_file2.mpg.2~CvKOMpOVqf_OIozqF7NrE4tDko0stmc.4_1 2023-10-05T11:47:24.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.410+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.41__multipart_file2.mpg.2~CvKOMpOVqf_OIozqF7NrE4tDko0stmc.5 2023-10-05T11:47:24.417 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.414+0000 7fcec8533880 5 garbage collection: RGWGC::process removing entries, marker: 2023-10-05T11:47:24.420 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.417+0000 7fcec8533880 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2023-10-05T11:47:24.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.419+0000 7fcec8533880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.419+0000 7fcec8533880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:24.423 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.419+0000 7fcec8533880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=8, truncated=0, next_marker='' 2023-10-05T11:47:24.423 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.419+0000 7fcec8533880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.838805653931483534', time=2023-10-05T13:44:36.040366+0000, chain.objs.size()=9 2023-10-05T11:47:24.423 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.420+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.35__multipart_key1.2~IqvL5kVp_WpUWF5liuwVwZHAd_O-6Q0.1 2023-10-05T11:47:24.423 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.420+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.35__shadow_key1.2~IqvL5kVp_WpUWF5liuwVwZHAd_O-6Q0.1_1 2023-10-05T11:47:24.424 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.420+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.35__multipart_key1.2~IqvL5kVp_WpUWF5liuwVwZHAd_O-6Q0.2 2023-10-05T11:47:24.424 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.420+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.35__shadow_key1.2~IqvL5kVp_WpUWF5liuwVwZHAd_O-6Q0.2_1 2023-10-05T11:47:24.424 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.420+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.35__multipart_key1.2~IqvL5kVp_WpUWF5liuwVwZHAd_O-6Q0.3 2023-10-05T11:47:24.424 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.420+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.35__shadow_key1.2~IqvL5kVp_WpUWF5liuwVwZHAd_O-6Q0.3_1 2023-10-05T11:47:24.424 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.420+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.35__multipart_key1.2~IqvL5kVp_WpUWF5liuwVwZHAd_O-6Q0.4 2023-10-05T11:47:24.424 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.420+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.35__shadow_key1.2~IqvL5kVp_WpUWF5liuwVwZHAd_O-6Q0.4_1 2023-10-05T11:47:24.424 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.420+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.35__multipart_key1.2~IqvL5kVp_WpUWF5liuwVwZHAd_O-6Q0.5 2023-10-05T11:47:24.424 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.420+0000 7fcec8533880 20 garbage collection: RGWGC::process iterating over entry tag='2~heXwk_Aj5Ovn22Tv5QgkmI1odoLUuqf', time=2023-10-05T13:47:09.811742+0000, chain.objs.size()=1 2023-10-05T11:47:24.425 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.420+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.46__multipart_key1.2~heXwk_Aj5Ovn22Tv5QgkmI1odoLUuqf.16 2023-10-05T11:47:24.425 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.420+0000 7fcec8533880 20 garbage collection: RGWGC::process iterating over entry tag='2~heXwk_Aj5Ovn22Tv5QgkmI1odoLUuqf', time=2023-10-05T13:47:09.838345+0000, chain.objs.size()=1 2023-10-05T11:47:24.425 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.420+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.46__multipart_key1.2~heXwk_Aj5Ovn22Tv5QgkmI1odoLUuqf.17 2023-10-05T11:47:24.425 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.420+0000 7fcec8533880 20 garbage collection: RGWGC::process iterating over entry tag='2~heXwk_Aj5Ovn22Tv5QgkmI1odoLUuqf', time=2023-10-05T13:47:09.894744+0000, chain.objs.size()=1 2023-10-05T11:47:24.425 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.420+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.46__multipart_key1.2~heXwk_Aj5Ovn22Tv5QgkmI1odoLUuqf.18 2023-10-05T11:47:24.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.424+0000 7fcec8533880 20 garbage collection: RGWGC::process iterating over entry tag='2~heXwk_Aj5Ovn22Tv5QgkmI1odoLUuqf', time=2023-10-05T13:47:09.909860+0000, chain.objs.size()=1 2023-10-05T11:47:24.430 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.424+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.46__multipart_key1.2~heXwk_Aj5Ovn22Tv5QgkmI1odoLUuqf.19 2023-10-05T11:47:24.430 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.424+0000 7fcec8533880 20 garbage collection: RGWGC::process iterating over entry tag='2~heXwk_Aj5Ovn22Tv5QgkmI1odoLUuqf', time=2023-10-05T13:47:10.082167+0000, chain.objs.size()=1 2023-10-05T11:47:24.430 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.424+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.46__multipart_key1.2~heXwk_Aj5Ovn22Tv5QgkmI1odoLUuqf.20 2023-10-05T11:47:24.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.425+0000 7fcec8533880 20 garbage collection: RGWGC::process iterating over entry tag='2~heXwk_Aj5Ovn22Tv5QgkmI1odoLUuqf', time=2023-10-05T13:47:10.145256+0000, chain.objs.size()=45 2023-10-05T11:47:24.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.425+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.46__multipart_key1.2~heXwk_Aj5Ovn22Tv5QgkmI1odoLUuqf.1 2023-10-05T11:47:24.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.425+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.46__multipart_key1.2~heXwk_Aj5Ovn22Tv5QgkmI1odoLUuqf.2 2023-10-05T11:47:24.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.425+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.46__multipart_key1.2~heXwk_Aj5Ovn22Tv5QgkmI1odoLUuqf.3 2023-10-05T11:47:24.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.425+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.46__multipart_key1.2~heXwk_Aj5Ovn22Tv5QgkmI1odoLUuqf.4 2023-10-05T11:47:24.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.425+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.46__multipart_key1.2~heXwk_Aj5Ovn22Tv5QgkmI1odoLUuqf.5 2023-10-05T11:47:24.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.425+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.46__multipart_key1.2~heXwk_Aj5Ovn22Tv5QgkmI1odoLUuqf.6 2023-10-05T11:47:24.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.425+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.46__multipart_key1.2~heXwk_Aj5Ovn22Tv5QgkmI1odoLUuqf.7 2023-10-05T11:47:24.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.425+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.46__multipart_key1.2~heXwk_Aj5Ovn22Tv5QgkmI1odoLUuqf.8 2023-10-05T11:47:24.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.425+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.46__multipart_key1.2~heXwk_Aj5Ovn22Tv5QgkmI1odoLUuqf.9 2023-10-05T11:47:24.434 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.430+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.46__multipart_key1.2~heXwk_Aj5Ovn22Tv5QgkmI1odoLUuqf.10 2023-10-05T11:47:24.434 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.430+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.46__multipart_key1.2~heXwk_Aj5Ovn22Tv5QgkmI1odoLUuqf.11 2023-10-05T11:47:24.434 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.430+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.46__multipart_key1.2~heXwk_Aj5Ovn22Tv5QgkmI1odoLUuqf.12 2023-10-05T11:47:24.434 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.430+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.46__multipart_key1.2~heXwk_Aj5Ovn22Tv5QgkmI1odoLUuqf.13 2023-10-05T11:47:24.435 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.431+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.46__multipart_key1.2~heXwk_Aj5Ovn22Tv5QgkmI1odoLUuqf.14 2023-10-05T11:47:24.435 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.431+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.46__multipart_key1.2~heXwk_Aj5Ovn22Tv5QgkmI1odoLUuqf.15 2023-10-05T11:47:24.435 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.431+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.46__multipart_key1.noC-ViB9rB8vsOnfLw78GuMvc2WtmDFh.16 2023-10-05T11:47:24.435 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.431+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.46__multipart_key1.l6MVGSdY9lecRm3srZwSjnVf8rAH96wD.17 2023-10-05T11:47:24.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.431+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.46__multipart_key1.ABnNU092A0QvovltQHdCKz0vOQifmoJg.18 2023-10-05T11:47:24.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.431+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.46__multipart_key1.S7cD_68HwJ7JYbGWID3MZfcoHLeDxXf3.19 2023-10-05T11:47:24.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.431+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.46__multipart_key1.TSLvVkFMhSkd2r_4loSzH-9C24Y8CnvE.20 2023-10-05T11:47:24.438 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.435+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.46__multipart_key1.2~heXwk_Aj5Ovn22Tv5QgkmI1odoLUuqf.21 2023-10-05T11:47:24.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.436+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.46__multipart_key1.2~heXwk_Aj5Ovn22Tv5QgkmI1odoLUuqf.22 2023-10-05T11:47:24.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.436+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.46__multipart_key1.2~heXwk_Aj5Ovn22Tv5QgkmI1odoLUuqf.23 2023-10-05T11:47:24.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.436+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.46__multipart_key1.2~heXwk_Aj5Ovn22Tv5QgkmI1odoLUuqf.24 2023-10-05T11:47:24.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.436+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.46__multipart_key1.2~heXwk_Aj5Ovn22Tv5QgkmI1odoLUuqf.25 2023-10-05T11:47:24.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.436+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.46__multipart_key1.2~heXwk_Aj5Ovn22Tv5QgkmI1odoLUuqf.26 2023-10-05T11:47:24.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.436+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.46__multipart_key1.2~heXwk_Aj5Ovn22Tv5QgkmI1odoLUuqf.27 2023-10-05T11:47:24.441 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.437+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.46__multipart_key1.2~heXwk_Aj5Ovn22Tv5QgkmI1odoLUuqf.28 2023-10-05T11:47:24.441 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.437+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.46__multipart_key1.2~heXwk_Aj5Ovn22Tv5QgkmI1odoLUuqf.29 2023-10-05T11:47:24.442 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.437+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.46__multipart_key1.2~heXwk_Aj5Ovn22Tv5QgkmI1odoLUuqf.30 2023-10-05T11:47:24.442 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.437+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.46__multipart_key1.2~heXwk_Aj5Ovn22Tv5QgkmI1odoLUuqf.31 2023-10-05T11:47:24.442 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.439+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.46__multipart_key1.2~heXwk_Aj5Ovn22Tv5QgkmI1odoLUuqf.32 2023-10-05T11:47:24.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.439+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.46__multipart_key1.2~heXwk_Aj5Ovn22Tv5QgkmI1odoLUuqf.33 2023-10-05T11:47:24.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.441+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.46__multipart_key1.2~heXwk_Aj5Ovn22Tv5QgkmI1odoLUuqf.34 2023-10-05T11:47:24.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.441+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.46__multipart_key1.2~heXwk_Aj5Ovn22Tv5QgkmI1odoLUuqf.35 2023-10-05T11:47:24.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.442+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.46__multipart_key1.2~heXwk_Aj5Ovn22Tv5QgkmI1odoLUuqf.36 2023-10-05T11:47:24.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.442+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.46__multipart_key1.2~heXwk_Aj5Ovn22Tv5QgkmI1odoLUuqf.37 2023-10-05T11:47:24.447 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.444+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.46__multipart_key1.2~heXwk_Aj5Ovn22Tv5QgkmI1odoLUuqf.38 2023-10-05T11:47:24.447 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.444+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.46__multipart_key1.2~heXwk_Aj5Ovn22Tv5QgkmI1odoLUuqf.39 2023-10-05T11:47:24.447 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.444+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.46__multipart_key1.2~heXwk_Aj5Ovn22Tv5QgkmI1odoLUuqf.40 2023-10-05T11:47:24.448 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.444+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.46__multipart_key1.2~heXwk_Aj5Ovn22Tv5QgkmI1odoLUuqf.41 2023-10-05T11:47:24.448 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.444+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.46__multipart_key1.2~heXwk_Aj5Ovn22Tv5QgkmI1odoLUuqf.42 2023-10-05T11:47:24.448 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.444+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.46__multipart_key1.2~heXwk_Aj5Ovn22Tv5QgkmI1odoLUuqf.43 2023-10-05T11:47:24.448 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.444+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.46__multipart_key1.2~heXwk_Aj5Ovn22Tv5QgkmI1odoLUuqf.44 2023-10-05T11:47:24.448 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.444+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.46__multipart_key1.2~heXwk_Aj5Ovn22Tv5QgkmI1odoLUuqf.45 2023-10-05T11:47:24.448 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.444+0000 7fcec8533880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.2283052225786028433', time=2023-10-05T13:47:13.980066+0000, chain.objs.size()=1 2023-10-05T11:47:24.448 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.444+0000 7fcec8533880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.52__shadow_.2wWa_ipaJ9BuF45TncaEWETTHAbFy4b_0 2023-10-05T11:47:24.453 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.450+0000 7fcec8533880 5 garbage collection: RGWGC::process removing entries, marker: 2023-10-05T11:47:24.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.452+0000 7fcec8533880 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2023-10-05T11:47:24.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.453+0000 7fcec8533880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.457 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.454+0000 7fcec8533880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:24.457 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.454+0000 7fcec8533880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.458 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.455+0000 7fcec8533880 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2023-10-05T11:47:24.459 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.456+0000 7fcec8533880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.459 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.457+0000 7fcec8533880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:24.460 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.457+0000 7fcec8533880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.461 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.458+0000 7fceabdfc640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:47:24.464 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.461+0000 7fcec8533880 20 remove_watcher() i=0 2023-10-05T11:47:24.465 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.461+0000 7fcec8533880 2 removed watcher, disabling cache 2023-10-05T11:47:24.466 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.463+0000 7fcec8533880 20 remove_watcher() i=1 2023-10-05T11:47:24.467 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.464+0000 7fcec8533880 20 remove_watcher() i=2 2023-10-05T11:47:24.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.465+0000 7fcec8533880 20 remove_watcher() i=3 2023-10-05T11:47:24.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.466+0000 7fcec8533880 20 remove_watcher() i=4 2023-10-05T11:47:24.470 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.467+0000 7fcec8533880 20 remove_watcher() i=5 2023-10-05T11:47:24.471 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.468+0000 7fcec8533880 20 remove_watcher() i=6 2023-10-05T11:47:24.472 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.469+0000 7fcec8533880 20 remove_watcher() i=7 2023-10-05T11:47:24.477 DEBUG:teuthology.orchestra.run.smithi012:> radosgw-admin gc process --include-all 2023-10-05T11:47:24.528 INFO:teuthology.orchestra.run.smithi012.stderr:ignoring --setuser ceph since I am not root 2023-10-05T11:47:24.529 INFO:teuthology.orchestra.run.smithi012.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T11:47:24.541 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.538+0000 7ff699d35880 20 rados->read ofs=0 len=0 2023-10-05T11:47:24.543 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.539+0000 7ff699d35880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:47:24.543 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.539+0000 7ff699d35880 20 realm 2023-10-05T11:47:24.543 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.539+0000 7ff699d35880 20 rados->read ofs=0 len=0 2023-10-05T11:47:24.543 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.539+0000 7ff699d35880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:47:24.544 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.539+0000 7ff699d35880 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T11:47:24.544 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.539+0000 7ff699d35880 20 rados->read ofs=0 len=0 2023-10-05T11:47:24.544 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.540+0000 7ff699d35880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:47:24.544 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.540+0000 7ff699d35880 20 rados->read ofs=0 len=0 2023-10-05T11:47:24.545 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.540+0000 7ff699d35880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:47:24.545 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.541+0000 7ff699d35880 20 rados->read ofs=0 len=0 2023-10-05T11:47:24.545 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.541+0000 7ff699d35880 20 rados_obj.operate() r=0 bl.length=1020 2023-10-05T11:47:24.545 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.541+0000 7ff699d35880 20 searching for the correct realm 2023-10-05T11:47:24.553 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.550+0000 7ff696f1c640 0 -- 172.21.15.12:0/567240470 >> [v2:172.21.15.12:6824/2171933159,v1:172.21.15.12:6825/2171933159] conn(0x562f5fe76400 msgr2=0x562f5fcc7700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:47:24.557 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.552+0000 7ff699d35880 20 RGWRados::pool_iterate: got zone_info.dff27d1e-df33-400e-a68a-7ba586947c99 2023-10-05T11:47:24.557 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.552+0000 7ff699d35880 20 RGWRados::pool_iterate: got zonegroup_info.c78aa576-9d15-4e9d-b3c0-4af23a22062c 2023-10-05T11:47:24.557 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.552+0000 7ff699d35880 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T11:47:24.557 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.552+0000 7ff699d35880 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T11:47:24.557 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.552+0000 7ff699d35880 20 rados->read ofs=0 len=0 2023-10-05T11:47:24.557 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.552+0000 7ff699d35880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:47:24.558 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.552+0000 7ff699d35880 20 rados->read ofs=0 len=0 2023-10-05T11:47:24.558 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.552+0000 7ff699d35880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:47:24.558 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.552+0000 7ff699d35880 20 rados->read ofs=0 len=0 2023-10-05T11:47:24.558 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.552+0000 7ff699d35880 20 rados_obj.operate() r=0 bl.length=454 2023-10-05T11:47:24.558 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.552+0000 7ff699d35880 20 zone default found 2023-10-05T11:47:24.558 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.552+0000 7ff699d35880 4 Realm: () 2023-10-05T11:47:24.558 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.552+0000 7ff699d35880 4 ZoneGroup: default (c78aa576-9d15-4e9d-b3c0-4af23a22062c) 2023-10-05T11:47:24.559 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.552+0000 7ff699d35880 4 Zone: default (dff27d1e-df33-400e-a68a-7ba586947c99) 2023-10-05T11:47:24.559 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.552+0000 7ff699d35880 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T11:47:24.559 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.552+0000 7ff699d35880 20 zonegroup default 2023-10-05T11:47:24.559 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.552+0000 7ff699d35880 20 rados->read ofs=0 len=0 2023-10-05T11:47:24.559 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.553+0000 7ff699d35880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:47:24.559 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.553+0000 7ff699d35880 20 rados->read ofs=0 len=0 2023-10-05T11:47:24.559 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.553+0000 7ff699d35880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:47:24.560 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.553+0000 7ff699d35880 20 rados->read ofs=0 len=0 2023-10-05T11:47:24.560 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.553+0000 7ff699d35880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:47:24.560 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.553+0000 7ff699d35880 20 started sync module instance, tier type = 2023-10-05T11:47:24.560 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.553+0000 7ff699d35880 20 started zone id=dff27d1e-df33-400e-a68a-7ba586947c99 (name=default) with tier type = 2023-10-05T11:47:24.561 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.558+0000 7ff696f1c640 0 -- 172.21.15.12:0/567240470 >> [v2:172.21.15.170:6800/4137726411,v1:172.21.15.170:6801/4137726411] conn(0x562f5fe77c00 msgr2=0x562f5fd87600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-10-05T11:47:24.566 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.563+0000 7ff699d35880 20 add_watcher() i=0 2023-10-05T11:47:24.566 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.563+0000 7ff699d35880 20 add_watcher() i=1 2023-10-05T11:47:24.566 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.563+0000 7ff699d35880 20 add_watcher() i=2 2023-10-05T11:47:24.567 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.563+0000 7ff699d35880 20 add_watcher() i=3 2023-10-05T11:47:24.567 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.563+0000 7ff699d35880 20 add_watcher() i=4 2023-10-05T11:47:24.567 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.563+0000 7ff699d35880 20 add_watcher() i=5 2023-10-05T11:47:24.567 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.563+0000 7ff699d35880 20 add_watcher() i=6 2023-10-05T11:47:24.568 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.564+0000 7ff699d35880 20 add_watcher() i=7 2023-10-05T11:47:24.568 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.564+0000 7ff699d35880 2 all 8 watchers are set, enabling cache 2023-10-05T11:47:24.569 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.565+0000 7ff67d6e9640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:47:24.569 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.565+0000 7ff699d35880 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T11:47:24.569 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.565+0000 7ff699d35880 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T11:47:24.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.608+0000 7ff678ee0640 20 reqs_thread_entry: start 2023-10-05T11:47:24.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.608+0000 7ff699d35880 20 init_complete bucket index max shards: 11 2023-10-05T11:47:24.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.608+0000 7ff699d35880 20 Filter name: none 2023-10-05T11:47:24.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.608+0000 7ff676edc640 20 reqs_thread_entry: start 2023-10-05T11:47:24.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.608+0000 7ff699d35880 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2023-10-05T11:47:24.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.610+0000 7ff699d35880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.610+0000 7ff699d35880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:24.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.610+0000 7ff699d35880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.614 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.611+0000 7ff699d35880 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2023-10-05T11:47:24.616 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.613+0000 7ff699d35880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.616 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.613+0000 7ff699d35880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:24.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.614+0000 7ff699d35880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.615+0000 7ff699d35880 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2023-10-05T11:47:24.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.616+0000 7ff699d35880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.616+0000 7ff699d35880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:24.620 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.617+0000 7ff699d35880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.620 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.617+0000 7ff699d35880 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2023-10-05T11:47:24.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.619+0000 7ff699d35880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.619+0000 7ff699d35880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:24.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.619+0000 7ff699d35880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.620+0000 7ff699d35880 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2023-10-05T11:47:24.625 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.622+0000 7ff699d35880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.626 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.622+0000 7ff699d35880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:24.626 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.623+0000 7ff699d35880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.627 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.624+0000 7ff699d35880 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2023-10-05T11:47:24.628 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.625+0000 7ff699d35880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.628 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.625+0000 7ff699d35880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:24.629 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.625+0000 7ff699d35880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.629 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.626+0000 7ff699d35880 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2023-10-05T11:47:24.631 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.628+0000 7ff699d35880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.632 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.628+0000 7ff699d35880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:24.632 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.629+0000 7ff699d35880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.633 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.630+0000 7ff699d35880 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2023-10-05T11:47:24.634 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.631+0000 7ff699d35880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.634 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.631+0000 7ff699d35880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:24.635 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.631+0000 7ff699d35880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.635 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.632+0000 7ff699d35880 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2023-10-05T11:47:24.637 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.634+0000 7ff699d35880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.637 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.634+0000 7ff699d35880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:24.638 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.634+0000 7ff699d35880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.638 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.635+0000 7ff699d35880 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2023-10-05T11:47:24.640 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.637+0000 7ff699d35880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.641 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.638+0000 7ff699d35880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:24.641 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.638+0000 7ff699d35880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.639+0000 7ff699d35880 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2023-10-05T11:47:24.643 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.640+0000 7ff699d35880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.641+0000 7ff699d35880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:24.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.641+0000 7ff699d35880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.642+0000 7ff699d35880 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2023-10-05T11:47:24.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.643+0000 7ff699d35880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.647 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.644+0000 7ff699d35880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:24.647 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.644+0000 7ff699d35880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.648 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.645+0000 7ff699d35880 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2023-10-05T11:47:24.650 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.647+0000 7ff699d35880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.651 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.648+0000 7ff699d35880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:24.651 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.648+0000 7ff699d35880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.649+0000 7ff699d35880 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2023-10-05T11:47:24.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.651+0000 7ff699d35880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.651+0000 7ff699d35880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:24.655 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.652+0000 7ff699d35880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.656 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.653+0000 7ff699d35880 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2023-10-05T11:47:24.657 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.654+0000 7ff699d35880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.657 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.654+0000 7ff699d35880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:24.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.655+0000 7ff699d35880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.656+0000 7ff699d35880 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2023-10-05T11:47:24.660 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.657+0000 7ff699d35880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.661 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.658+0000 7ff699d35880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:24.661 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.658+0000 7ff699d35880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.662 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.659+0000 7ff699d35880 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2023-10-05T11:47:24.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.661+0000 7ff699d35880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.661+0000 7ff699d35880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:24.665 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.662+0000 7ff699d35880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.666 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.663+0000 7ff699d35880 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2023-10-05T11:47:24.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.664+0000 7ff699d35880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.664+0000 7ff699d35880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:24.668 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.664+0000 7ff699d35880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.668 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.665+0000 7ff699d35880 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2023-10-05T11:47:24.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.667+0000 7ff699d35880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.667+0000 7ff699d35880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:24.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.667+0000 7ff699d35880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.668+0000 7ff699d35880 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2023-10-05T11:47:24.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.670+0000 7ff699d35880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.670+0000 7ff699d35880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:24.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.671+0000 7ff699d35880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.672+0000 7ff699d35880 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2023-10-05T11:47:24.676 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.673+0000 7ff699d35880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.674+0000 7ff699d35880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:24.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.674+0000 7ff699d35880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.675+0000 7ff699d35880 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2023-10-05T11:47:24.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.676+0000 7ff699d35880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.676+0000 7ff699d35880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:24.680 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.677+0000 7ff699d35880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.680 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.677+0000 7ff699d35880 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2023-10-05T11:47:24.682 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.679+0000 7ff699d35880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.682 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.679+0000 7ff699d35880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:24.683 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.680+0000 7ff699d35880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.681+0000 7ff699d35880 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2023-10-05T11:47:24.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.682+0000 7ff699d35880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.686 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.682+0000 7ff699d35880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:24.686 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.683+0000 7ff699d35880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.684+0000 7ff699d35880 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2023-10-05T11:47:24.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.685+0000 7ff699d35880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.686+0000 7ff699d35880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:24.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.686+0000 7ff699d35880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.690 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.687+0000 7ff699d35880 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2023-10-05T11:47:24.691 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.688+0000 7ff699d35880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.689+0000 7ff699d35880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:24.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.689+0000 7ff699d35880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.695 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.692+0000 7ff699d35880 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2023-10-05T11:47:24.696 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.693+0000 7ff699d35880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.696 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.693+0000 7ff699d35880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:24.697 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.694+0000 7ff699d35880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.697 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.694+0000 7ff699d35880 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2023-10-05T11:47:24.699 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.696+0000 7ff699d35880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.700 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.696+0000 7ff699d35880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:24.700 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.697+0000 7ff699d35880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.701 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.698+0000 7ff699d35880 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2023-10-05T11:47:24.702 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.699+0000 7ff699d35880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.702 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.699+0000 7ff699d35880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:24.703 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.700+0000 7ff699d35880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.704 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.701+0000 7ff699d35880 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2023-10-05T11:47:24.705 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.702+0000 7ff699d35880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.705 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.702+0000 7ff699d35880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:24.705 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.702+0000 7ff699d35880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.710 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.703+0000 7ff699d35880 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2023-10-05T11:47:24.710 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.704+0000 7ff699d35880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.710 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.705+0000 7ff699d35880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:24.710 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.705+0000 7ff699d35880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.710 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.706+0000 7ff699d35880 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2023-10-05T11:47:24.711 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.708+0000 7ff699d35880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.711 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.708+0000 7ff699d35880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:24.711 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.709+0000 7ff699d35880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.710+0000 7ff67d6e9640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:47:24.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.712+0000 7ff699d35880 20 remove_watcher() i=0 2023-10-05T11:47:24.716 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.712+0000 7ff699d35880 2 removed watcher, disabling cache 2023-10-05T11:47:24.716 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.713+0000 7ff699d35880 20 remove_watcher() i=1 2023-10-05T11:47:24.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.714+0000 7ff699d35880 20 remove_watcher() i=2 2023-10-05T11:47:24.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.715+0000 7ff699d35880 20 remove_watcher() i=3 2023-10-05T11:47:24.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.716+0000 7ff699d35880 20 remove_watcher() i=4 2023-10-05T11:47:24.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.717+0000 7ff699d35880 20 remove_watcher() i=5 2023-10-05T11:47:24.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.718+0000 7ff699d35880 20 remove_watcher() i=6 2023-10-05T11:47:24.722 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.719+0000 7ff699d35880 20 remove_watcher() i=7 2023-10-05T11:47:24.728 DEBUG:teuthology.orchestra.run.smithi012:> radosgw-admin gc process --include-all 2023-10-05T11:47:24.778 INFO:teuthology.orchestra.run.smithi012.stderr:ignoring --setuser ceph since I am not root 2023-10-05T11:47:24.778 INFO:teuthology.orchestra.run.smithi012.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T11:47:24.791 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.788+0000 7ff60f28b880 20 rados->read ofs=0 len=0 2023-10-05T11:47:24.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.790+0000 7ff60f28b880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:47:24.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.790+0000 7ff60f28b880 20 realm 2023-10-05T11:47:24.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.790+0000 7ff60f28b880 20 rados->read ofs=0 len=0 2023-10-05T11:47:24.794 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.790+0000 7ff60f28b880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:47:24.794 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.790+0000 7ff60f28b880 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T11:47:24.794 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.790+0000 7ff60f28b880 20 rados->read ofs=0 len=0 2023-10-05T11:47:24.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.790+0000 7ff60f28b880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:47:24.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.790+0000 7ff60f28b880 20 rados->read ofs=0 len=0 2023-10-05T11:47:24.796 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.791+0000 7ff60f28b880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:47:24.796 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.791+0000 7ff60f28b880 20 rados->read ofs=0 len=0 2023-10-05T11:47:24.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.792+0000 7ff60f28b880 20 rados_obj.operate() r=0 bl.length=1020 2023-10-05T11:47:24.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.792+0000 7ff60f28b880 20 searching for the correct realm 2023-10-05T11:47:24.803 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.800+0000 7ff60da36640 0 -- 172.21.15.12:0/3389857480 >> [v2:172.21.15.12:6800/732466381,v1:172.21.15.12:6801/732466381] conn(0x559939827c00 msgr2=0x559939748b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:47:24.805 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.802+0000 7ff60f28b880 20 RGWRados::pool_iterate: got zone_info.dff27d1e-df33-400e-a68a-7ba586947c99 2023-10-05T11:47:24.805 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.802+0000 7ff60f28b880 20 RGWRados::pool_iterate: got zonegroup_info.c78aa576-9d15-4e9d-b3c0-4af23a22062c 2023-10-05T11:47:24.805 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.802+0000 7ff60f28b880 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T11:47:24.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.802+0000 7ff60f28b880 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T11:47:24.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.802+0000 7ff60f28b880 20 rados->read ofs=0 len=0 2023-10-05T11:47:24.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.802+0000 7ff60f28b880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:47:24.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.802+0000 7ff60f28b880 20 rados->read ofs=0 len=0 2023-10-05T11:47:24.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.802+0000 7ff60f28b880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:47:24.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.802+0000 7ff60f28b880 20 rados->read ofs=0 len=0 2023-10-05T11:47:24.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.803+0000 7ff60f28b880 20 rados_obj.operate() r=0 bl.length=454 2023-10-05T11:47:24.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.803+0000 7ff60f28b880 20 zone default found 2023-10-05T11:47:24.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.803+0000 7ff60f28b880 4 Realm: () 2023-10-05T11:47:24.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.803+0000 7ff60f28b880 4 ZoneGroup: default (c78aa576-9d15-4e9d-b3c0-4af23a22062c) 2023-10-05T11:47:24.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.803+0000 7ff60f28b880 4 Zone: default (dff27d1e-df33-400e-a68a-7ba586947c99) 2023-10-05T11:47:24.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.803+0000 7ff60f28b880 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T11:47:24.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.803+0000 7ff60f28b880 20 zonegroup default 2023-10-05T11:47:24.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.803+0000 7ff60f28b880 20 rados->read ofs=0 len=0 2023-10-05T11:47:24.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.803+0000 7ff60f28b880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:47:24.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.803+0000 7ff60f28b880 20 rados->read ofs=0 len=0 2023-10-05T11:47:24.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.803+0000 7ff60f28b880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:47:24.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.803+0000 7ff60f28b880 20 rados->read ofs=0 len=0 2023-10-05T11:47:24.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.804+0000 7ff60f28b880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:47:24.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.804+0000 7ff60f28b880 20 started sync module instance, tier type = 2023-10-05T11:47:24.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.804+0000 7ff60f28b880 20 started zone id=dff27d1e-df33-400e-a68a-7ba586947c99 (name=default) with tier type = 2023-10-05T11:47:24.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.809+0000 7ff60da36640 0 -- 172.21.15.12:0/3389857480 >> [v2:172.21.15.12:6800/732466381,v1:172.21.15.12:6801/732466381] conn(0x559939851800 msgr2=0x55993974a100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:47:24.815 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.812+0000 7ff60f28b880 20 add_watcher() i=0 2023-10-05T11:47:24.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.812+0000 7ff60f28b880 20 add_watcher() i=1 2023-10-05T11:47:24.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.812+0000 7ff60f28b880 20 add_watcher() i=2 2023-10-05T11:47:24.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.812+0000 7ff60f28b880 20 add_watcher() i=3 2023-10-05T11:47:24.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.812+0000 7ff60f28b880 20 add_watcher() i=4 2023-10-05T11:47:24.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.812+0000 7ff60f28b880 20 add_watcher() i=5 2023-10-05T11:47:24.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.812+0000 7ff60f28b880 20 add_watcher() i=6 2023-10-05T11:47:24.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.813+0000 7ff60f28b880 20 add_watcher() i=7 2023-10-05T11:47:24.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.813+0000 7ff60f28b880 2 all 8 watchers are set, enabling cache 2023-10-05T11:47:24.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.815+0000 7ff5f4a04640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:47:24.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.815+0000 7ff60f28b880 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T11:47:24.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.815+0000 7ff60f28b880 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T11:47:24.861 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.857+0000 7ff5f01fb640 20 reqs_thread_entry: start 2023-10-05T11:47:24.861 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.857+0000 7ff60f28b880 20 init_complete bucket index max shards: 11 2023-10-05T11:47:24.861 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.857+0000 7ff60f28b880 20 Filter name: none 2023-10-05T11:47:24.861 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.857+0000 7ff5ee1f7640 20 reqs_thread_entry: start 2023-10-05T11:47:24.861 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.857+0000 7ff60f28b880 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2023-10-05T11:47:24.861 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.858+0000 7ff60f28b880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.862 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.859+0000 7ff60f28b880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:24.862 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.859+0000 7ff60f28b880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.863 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.860+0000 7ff60f28b880 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2023-10-05T11:47:24.864 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.861+0000 7ff60f28b880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.865 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.862+0000 7ff60f28b880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:24.865 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.862+0000 7ff60f28b880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.863+0000 7ff60f28b880 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2023-10-05T11:47:24.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.864+0000 7ff60f28b880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.868 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.865+0000 7ff60f28b880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:24.868 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.865+0000 7ff60f28b880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.869 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.866+0000 7ff60f28b880 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2023-10-05T11:47:24.870 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.867+0000 7ff60f28b880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.871 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.868+0000 7ff60f28b880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:24.871 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.868+0000 7ff60f28b880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.872 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.869+0000 7ff60f28b880 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2023-10-05T11:47:24.873 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.870+0000 7ff60f28b880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.874 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.871+0000 7ff60f28b880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:24.874 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.871+0000 7ff60f28b880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.875 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.872+0000 7ff60f28b880 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2023-10-05T11:47:24.876 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.873+0000 7ff60f28b880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.874+0000 7ff60f28b880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:24.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.874+0000 7ff60f28b880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.878 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.875+0000 7ff60f28b880 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2023-10-05T11:47:24.879 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.876+0000 7ff60f28b880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.879 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.876+0000 7ff60f28b880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:24.880 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.877+0000 7ff60f28b880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.880 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.877+0000 7ff60f28b880 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2023-10-05T11:47:24.882 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.879+0000 7ff60f28b880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.882 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.879+0000 7ff60f28b880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:24.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.880+0000 7ff60f28b880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.880+0000 7ff60f28b880 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2023-10-05T11:47:24.885 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.882+0000 7ff60f28b880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.885 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.882+0000 7ff60f28b880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:24.885 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.882+0000 7ff60f28b880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.883+0000 7ff60f28b880 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2023-10-05T11:47:24.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.884+0000 7ff60f28b880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.885+0000 7ff60f28b880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:24.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.885+0000 7ff60f28b880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.889 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.886+0000 7ff60f28b880 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2023-10-05T11:47:24.892 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.889+0000 7ff60f28b880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.892 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.889+0000 7ff60f28b880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:24.892 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.889+0000 7ff60f28b880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.893 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.890+0000 7ff60f28b880 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2023-10-05T11:47:24.895 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.892+0000 7ff60f28b880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.895 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.892+0000 7ff60f28b880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:24.896 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.892+0000 7ff60f28b880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.896 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.893+0000 7ff60f28b880 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2023-10-05T11:47:24.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.895+0000 7ff60f28b880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.895+0000 7ff60f28b880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:24.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.896+0000 7ff60f28b880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.900 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.897+0000 7ff60f28b880 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2023-10-05T11:47:24.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.898+0000 7ff60f28b880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.899+0000 7ff60f28b880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:24.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.899+0000 7ff60f28b880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.900+0000 7ff60f28b880 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2023-10-05T11:47:24.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.901+0000 7ff60f28b880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.902+0000 7ff60f28b880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:24.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.902+0000 7ff60f28b880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.903+0000 7ff60f28b880 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2023-10-05T11:47:24.908 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.904+0000 7ff60f28b880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.908 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.905+0000 7ff60f28b880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:24.908 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.905+0000 7ff60f28b880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.909 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.906+0000 7ff60f28b880 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2023-10-05T11:47:24.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.907+0000 7ff60f28b880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.908+0000 7ff60f28b880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:24.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.908+0000 7ff60f28b880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.909+0000 7ff60f28b880 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2023-10-05T11:47:24.914 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.911+0000 7ff60f28b880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.914 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.911+0000 7ff60f28b880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:24.914 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.911+0000 7ff60f28b880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.915 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.912+0000 7ff60f28b880 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2023-10-05T11:47:24.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.914+0000 7ff60f28b880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.914+0000 7ff60f28b880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:24.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.915+0000 7ff60f28b880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.916+0000 7ff60f28b880 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2023-10-05T11:47:24.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.917+0000 7ff60f28b880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.917+0000 7ff60f28b880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:24.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.917+0000 7ff60f28b880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.918+0000 7ff60f28b880 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2023-10-05T11:47:24.923 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.920+0000 7ff60f28b880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.923 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.920+0000 7ff60f28b880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:24.923 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.920+0000 7ff60f28b880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.921+0000 7ff60f28b880 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2023-10-05T11:47:24.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.922+0000 7ff60f28b880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.923+0000 7ff60f28b880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:24.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.923+0000 7ff60f28b880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.924+0000 7ff60f28b880 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2023-10-05T11:47:24.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.926+0000 7ff60f28b880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.926+0000 7ff60f28b880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:24.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.927+0000 7ff60f28b880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.927+0000 7ff60f28b880 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2023-10-05T11:47:24.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.929+0000 7ff60f28b880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.929+0000 7ff60f28b880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:24.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.929+0000 7ff60f28b880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.930+0000 7ff60f28b880 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2023-10-05T11:47:24.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.931+0000 7ff60f28b880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.935 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.932+0000 7ff60f28b880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:24.935 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.932+0000 7ff60f28b880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.936 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.933+0000 7ff60f28b880 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2023-10-05T11:47:24.937 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.934+0000 7ff60f28b880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.935+0000 7ff60f28b880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:24.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.935+0000 7ff60f28b880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.939 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.936+0000 7ff60f28b880 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2023-10-05T11:47:24.941 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.937+0000 7ff60f28b880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.941 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.938+0000 7ff60f28b880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:24.941 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.938+0000 7ff60f28b880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.942 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.939+0000 7ff60f28b880 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2023-10-05T11:47:24.944 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.941+0000 7ff60f28b880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.944 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.941+0000 7ff60f28b880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:24.944 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.941+0000 7ff60f28b880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.946 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.942+0000 7ff60f28b880 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2023-10-05T11:47:24.946 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.943+0000 7ff60f28b880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.947 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.944+0000 7ff60f28b880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:24.947 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.944+0000 7ff60f28b880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.948 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.945+0000 7ff60f28b880 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2023-10-05T11:47:24.950 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.946+0000 7ff60f28b880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.950 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.947+0000 7ff60f28b880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:24.950 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.947+0000 7ff60f28b880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.951 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.948+0000 7ff60f28b880 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2023-10-05T11:47:24.953 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.950+0000 7ff60f28b880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.953 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.950+0000 7ff60f28b880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:24.954 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.951+0000 7ff60f28b880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.955 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.952+0000 7ff60f28b880 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2023-10-05T11:47:24.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.953+0000 7ff60f28b880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.953+0000 7ff60f28b880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:24.957 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.953+0000 7ff60f28b880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:24.958 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.955+0000 7ff5f4a04640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:47:24.960 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.957+0000 7ff60f28b880 20 remove_watcher() i=0 2023-10-05T11:47:24.961 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.957+0000 7ff60f28b880 2 removed watcher, disabling cache 2023-10-05T11:47:24.962 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.959+0000 7ff60f28b880 20 remove_watcher() i=1 2023-10-05T11:47:24.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.960+0000 7ff60f28b880 20 remove_watcher() i=2 2023-10-05T11:47:24.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.961+0000 7ff60f28b880 20 remove_watcher() i=3 2023-10-05T11:47:24.965 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.962+0000 7ff60f28b880 20 remove_watcher() i=4 2023-10-05T11:47:24.966 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.963+0000 7ff60f28b880 20 remove_watcher() i=5 2023-10-05T11:47:24.967 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.964+0000 7ff60f28b880 20 remove_watcher() i=6 2023-10-05T11:47:24.968 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:24.965+0000 7ff60f28b880 20 remove_watcher() i=7 2023-10-05T11:47:24.973 DEBUG:teuthology.orchestra.run.smithi012:> radosgw-admin gc process --include-all 2023-10-05T11:47:25.024 INFO:teuthology.orchestra.run.smithi012.stderr:ignoring --setuser ceph since I am not root 2023-10-05T11:47:25.025 INFO:teuthology.orchestra.run.smithi012.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T11:47:25.038 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.034+0000 7f51ed22e880 20 rados->read ofs=0 len=0 2023-10-05T11:47:25.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.036+0000 7f51ed22e880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:47:25.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.036+0000 7f51ed22e880 20 realm 2023-10-05T11:47:25.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.036+0000 7f51ed22e880 20 rados->read ofs=0 len=0 2023-10-05T11:47:25.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.036+0000 7f51ed22e880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:47:25.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.036+0000 7f51ed22e880 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T11:47:25.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.036+0000 7f51ed22e880 20 rados->read ofs=0 len=0 2023-10-05T11:47:25.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.036+0000 7f51ed22e880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:47:25.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.036+0000 7f51ed22e880 20 rados->read ofs=0 len=0 2023-10-05T11:47:25.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.037+0000 7f51ed22e880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:47:25.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.037+0000 7f51ed22e880 20 rados->read ofs=0 len=0 2023-10-05T11:47:25.041 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.038+0000 7f51ed22e880 20 rados_obj.operate() r=0 bl.length=1020 2023-10-05T11:47:25.041 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.038+0000 7f51ed22e880 20 searching for the correct realm 2023-10-05T11:47:25.050 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.047+0000 7f51e9398640 0 -- 172.21.15.12:0/2877781243 >> [v2:172.21.15.170:6814/3150808418,v1:172.21.15.170:6816/3150808418] conn(0x55762b02ac00 msgr2=0x55762a382c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:47:25.051 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.048+0000 7f51ed22e880 20 RGWRados::pool_iterate: got zone_info.dff27d1e-df33-400e-a68a-7ba586947c99 2023-10-05T11:47:25.052 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.048+0000 7f51ed22e880 20 RGWRados::pool_iterate: got zonegroup_info.c78aa576-9d15-4e9d-b3c0-4af23a22062c 2023-10-05T11:47:25.052 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.048+0000 7f51ed22e880 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T11:47:25.052 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.048+0000 7f51ed22e880 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T11:47:25.052 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.048+0000 7f51ed22e880 20 rados->read ofs=0 len=0 2023-10-05T11:47:25.052 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.048+0000 7f51ed22e880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:47:25.052 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.048+0000 7f51ed22e880 20 rados->read ofs=0 len=0 2023-10-05T11:47:25.052 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.049+0000 7f51ed22e880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:47:25.052 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.049+0000 7f51ed22e880 20 rados->read ofs=0 len=0 2023-10-05T11:47:25.053 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.049+0000 7f51ed22e880 20 rados_obj.operate() r=0 bl.length=454 2023-10-05T11:47:25.054 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.049+0000 7f51ed22e880 20 zone default found 2023-10-05T11:47:25.054 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.049+0000 7f51ed22e880 4 Realm: () 2023-10-05T11:47:25.054 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.049+0000 7f51ed22e880 4 ZoneGroup: default (c78aa576-9d15-4e9d-b3c0-4af23a22062c) 2023-10-05T11:47:25.054 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.049+0000 7f51ed22e880 4 Zone: default (dff27d1e-df33-400e-a68a-7ba586947c99) 2023-10-05T11:47:25.054 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.049+0000 7f51ed22e880 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T11:47:25.054 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.049+0000 7f51ed22e880 20 zonegroup default 2023-10-05T11:47:25.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.049+0000 7f51ed22e880 20 rados->read ofs=0 len=0 2023-10-05T11:47:25.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.049+0000 7f51ed22e880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:47:25.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.049+0000 7f51ed22e880 20 rados->read ofs=0 len=0 2023-10-05T11:47:25.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.049+0000 7f51ed22e880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:47:25.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.049+0000 7f51ed22e880 20 rados->read ofs=0 len=0 2023-10-05T11:47:25.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.050+0000 7f51ed22e880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:47:25.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.050+0000 7f51ed22e880 20 started sync module instance, tier type = 2023-10-05T11:47:25.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.050+0000 7f51ed22e880 20 started zone id=dff27d1e-df33-400e-a68a-7ba586947c99 (name=default) with tier type = 2023-10-05T11:47:25.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.055+0000 7f51e9b99640 0 -- 172.21.15.12:0/2877781243 >> [v2:172.21.15.170:6800/4137726411,v1:172.21.15.170:6801/4137726411] conn(0x55762a53ac00 msgr2=0x55762a447600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:47:25.062 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.059+0000 7f51ed22e880 20 add_watcher() i=0 2023-10-05T11:47:25.062 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.059+0000 7f51ed22e880 20 add_watcher() i=1 2023-10-05T11:47:25.062 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.059+0000 7f51ed22e880 20 add_watcher() i=2 2023-10-05T11:47:25.062 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.059+0000 7f51ed22e880 20 add_watcher() i=3 2023-10-05T11:47:25.063 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.059+0000 7f51ed22e880 20 add_watcher() i=4 2023-10-05T11:47:25.063 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.059+0000 7f51ed22e880 20 add_watcher() i=5 2023-10-05T11:47:25.063 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.059+0000 7f51ed22e880 20 add_watcher() i=6 2023-10-05T11:47:25.063 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.060+0000 7f51ed22e880 20 add_watcher() i=7 2023-10-05T11:47:25.063 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.060+0000 7f51ed22e880 2 all 8 watchers are set, enabling cache 2023-10-05T11:47:25.065 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.062+0000 7f51d0366640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:47:25.065 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.062+0000 7f51ed22e880 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T11:47:25.065 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.062+0000 7f51ed22e880 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T11:47:25.107 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.103+0000 7f51cbb5d640 20 reqs_thread_entry: start 2023-10-05T11:47:25.107 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.103+0000 7f51ed22e880 20 init_complete bucket index max shards: 11 2023-10-05T11:47:25.107 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.103+0000 7f51ed22e880 20 Filter name: none 2023-10-05T11:47:25.107 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.103+0000 7f51c9b59640 20 reqs_thread_entry: start 2023-10-05T11:47:25.107 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.103+0000 7f51ed22e880 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2023-10-05T11:47:25.108 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.104+0000 7f51ed22e880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:25.108 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.105+0000 7f51ed22e880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:25.108 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.105+0000 7f51ed22e880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:25.109 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.106+0000 7f51ed22e880 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2023-10-05T11:47:25.110 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.107+0000 7f51ed22e880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:25.111 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.108+0000 7f51ed22e880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:25.111 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.108+0000 7f51ed22e880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:25.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.109+0000 7f51ed22e880 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2023-10-05T11:47:25.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.110+0000 7f51ed22e880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:25.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.111+0000 7f51ed22e880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:25.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.111+0000 7f51ed22e880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:25.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.112+0000 7f51ed22e880 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2023-10-05T11:47:25.116 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.113+0000 7f51ed22e880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:25.117 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.113+0000 7f51ed22e880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:25.117 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.114+0000 7f51ed22e880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:25.118 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.115+0000 7f51ed22e880 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2023-10-05T11:47:25.119 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.116+0000 7f51ed22e880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:25.121 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.116+0000 7f51ed22e880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:25.121 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.117+0000 7f51ed22e880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:25.121 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.117+0000 7f51ed22e880 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2023-10-05T11:47:25.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.119+0000 7f51ed22e880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:25.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.119+0000 7f51ed22e880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:25.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.119+0000 7f51ed22e880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:25.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.120+0000 7f51ed22e880 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2023-10-05T11:47:25.124 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.121+0000 7f51ed22e880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:25.125 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.122+0000 7f51ed22e880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:25.125 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.122+0000 7f51ed22e880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:25.126 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.123+0000 7f51ed22e880 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2023-10-05T11:47:25.127 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.124+0000 7f51ed22e880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:25.129 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.125+0000 7f51ed22e880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:25.129 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.125+0000 7f51ed22e880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:25.129 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.126+0000 7f51ed22e880 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2023-10-05T11:47:25.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.128+0000 7f51ed22e880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:25.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.128+0000 7f51ed22e880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:25.132 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.128+0000 7f51ed22e880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:25.133 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.129+0000 7f51ed22e880 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2023-10-05T11:47:25.134 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.131+0000 7f51ed22e880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:25.134 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.131+0000 7f51ed22e880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:25.135 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.131+0000 7f51ed22e880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:25.135 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.132+0000 7f51ed22e880 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2023-10-05T11:47:25.136 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.133+0000 7f51ed22e880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:25.137 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.134+0000 7f51ed22e880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:25.137 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.134+0000 7f51ed22e880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:25.138 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.135+0000 7f51ed22e880 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2023-10-05T11:47:25.139 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.136+0000 7f51ed22e880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:25.140 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.137+0000 7f51ed22e880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:25.140 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.137+0000 7f51ed22e880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:25.141 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.138+0000 7f51ed22e880 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2023-10-05T11:47:25.142 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.139+0000 7f51ed22e880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:25.143 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.140+0000 7f51ed22e880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:25.143 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.140+0000 7f51ed22e880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:25.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.141+0000 7f51ed22e880 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2023-10-05T11:47:25.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.142+0000 7f51ed22e880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:25.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.142+0000 7f51ed22e880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:25.146 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.143+0000 7f51ed22e880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:25.146 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.143+0000 7f51ed22e880 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2023-10-05T11:47:25.148 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.145+0000 7f51ed22e880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:25.148 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.145+0000 7f51ed22e880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:25.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.146+0000 7f51ed22e880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:25.150 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.147+0000 7f51ed22e880 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2023-10-05T11:47:25.151 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.148+0000 7f51ed22e880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:25.151 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.148+0000 7f51ed22e880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:25.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.149+0000 7f51ed22e880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:25.153 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.150+0000 7f51ed22e880 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2023-10-05T11:47:25.154 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.151+0000 7f51ed22e880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:25.155 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.151+0000 7f51ed22e880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:25.155 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.151+0000 7f51ed22e880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:25.155 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.152+0000 7f51ed22e880 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2023-10-05T11:47:25.157 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.154+0000 7f51ed22e880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:25.158 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.155+0000 7f51ed22e880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:25.158 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.155+0000 7f51ed22e880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:25.159 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.156+0000 7f51ed22e880 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2023-10-05T11:47:25.160 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.157+0000 7f51ed22e880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:25.161 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.158+0000 7f51ed22e880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:25.161 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.158+0000 7f51ed22e880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:25.162 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.159+0000 7f51ed22e880 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2023-10-05T11:47:25.164 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.160+0000 7f51ed22e880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:25.164 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.161+0000 7f51ed22e880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:25.164 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.161+0000 7f51ed22e880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:25.165 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.162+0000 7f51ed22e880 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2023-10-05T11:47:25.166 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.163+0000 7f51ed22e880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:25.166 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.163+0000 7f51ed22e880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:25.167 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.164+0000 7f51ed22e880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:25.168 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.165+0000 7f51ed22e880 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2023-10-05T11:47:25.169 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.166+0000 7f51ed22e880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:25.169 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.166+0000 7f51ed22e880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:25.170 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.167+0000 7f51ed22e880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:25.171 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.168+0000 7f51ed22e880 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2023-10-05T11:47:25.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.169+0000 7f51ed22e880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:25.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.169+0000 7f51ed22e880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:25.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.170+0000 7f51ed22e880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:25.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.171+0000 7f51ed22e880 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2023-10-05T11:47:25.175 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.172+0000 7f51ed22e880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:25.175 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.172+0000 7f51ed22e880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:25.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.173+0000 7f51ed22e880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:25.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.173+0000 7f51ed22e880 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2023-10-05T11:47:25.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.175+0000 7f51ed22e880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:25.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.175+0000 7f51ed22e880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:25.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.175+0000 7f51ed22e880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:25.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.176+0000 7f51ed22e880 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2023-10-05T11:47:25.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.178+0000 7f51ed22e880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:25.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.178+0000 7f51ed22e880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:25.182 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.179+0000 7f51ed22e880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:25.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.180+0000 7f51ed22e880 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2023-10-05T11:47:25.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.181+0000 7f51ed22e880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:25.185 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.182+0000 7f51ed22e880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:25.185 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.182+0000 7f51ed22e880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:25.186 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.183+0000 7f51ed22e880 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2023-10-05T11:47:25.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.185+0000 7f51ed22e880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:25.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.185+0000 7f51ed22e880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:25.189 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.186+0000 7f51ed22e880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:25.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.187+0000 7f51ed22e880 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2023-10-05T11:47:25.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.188+0000 7f51ed22e880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:25.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.189+0000 7f51ed22e880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:25.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.189+0000 7f51ed22e880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:25.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.190+0000 7f51ed22e880 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2023-10-05T11:47:25.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.191+0000 7f51ed22e880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:25.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.192+0000 7f51ed22e880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:25.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.192+0000 7f51ed22e880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:25.196 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.193+0000 7f51ed22e880 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2023-10-05T11:47:25.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.194+0000 7f51ed22e880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:25.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.194+0000 7f51ed22e880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:25.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.194+0000 7f51ed22e880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:25.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.195+0000 7f51ed22e880 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2023-10-05T11:47:25.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.197+0000 7f51ed22e880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:25.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.197+0000 7f51ed22e880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:25.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.197+0000 7f51ed22e880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:25.202 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.199+0000 7f51d0366640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:47:25.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.201+0000 7f51ed22e880 20 remove_watcher() i=0 2023-10-05T11:47:25.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.201+0000 7f51ed22e880 2 removed watcher, disabling cache 2023-10-05T11:47:25.206 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.203+0000 7f51ed22e880 20 remove_watcher() i=1 2023-10-05T11:47:25.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.204+0000 7f51ed22e880 20 remove_watcher() i=2 2023-10-05T11:47:25.208 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.205+0000 7f51ed22e880 20 remove_watcher() i=3 2023-10-05T11:47:25.209 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.206+0000 7f51ed22e880 20 remove_watcher() i=4 2023-10-05T11:47:25.210 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.207+0000 7f51ed22e880 20 remove_watcher() i=5 2023-10-05T11:47:25.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.208+0000 7f51ed22e880 20 remove_watcher() i=6 2023-10-05T11:47:25.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:25.209+0000 7f51ed22e880 20 remove_watcher() i=7 2023-10-05T11:47:25.218 DEBUG:teuthology.orchestra.run.smithi012:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests BucketTest 2023-10-05T11:47:25.813 INFO:teuthology.orchestra.run.smithi012.stdout:> Task :clean 2023-10-05T11:47:26.411 INFO:teuthology.orchestra.run.smithi012.stdout:> Task :compileJava 2023-10-05T11:47:26.411 INFO:teuthology.orchestra.run.smithi012.stdout:> Task :processResources 2023-10-05T11:47:26.411 INFO:teuthology.orchestra.run.smithi012.stdout:> Task :classes 2023-10-05T11:47:26.711 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:47:26.711 INFO:teuthology.orchestra.run.smithi012.stdout:> Task :compileTestJava 2023-10-05T11:47:26.712 INFO:teuthology.orchestra.run.smithi012.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2023-10-05T11:47:26.712 INFO:teuthology.orchestra.run.smithi012.stderr:Note: Recompile with -Xlint:deprecation for details. 2023-10-05T11:47:26.712 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:47:26.712 INFO:teuthology.orchestra.run.smithi012.stdout:> Task :processTestResources NO-SOURCE 2023-10-05T11:47:26.713 INFO:teuthology.orchestra.run.smithi012.stdout:> Task :testClasses 2023-10-05T11:47:28.712 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:47:28.712 INFO:teuthology.orchestra.run.smithi012.stdout:> Task :test 2023-10-05T11:47:28.712 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:47:28.712 INFO:teuthology.orchestra.run.smithi012.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectEmpty STARTED 2023-10-05T11:47:28.712 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:47:28.712 INFO:teuthology.orchestra.run.smithi012.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectEmpty PASSED 2023-10-05T11:47:28.712 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:47:28.712 INFO:teuthology.orchestra.run.smithi012.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectMismatch STARTED 2023-10-05T11:47:28.712 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:47:28.713 INFO:teuthology.orchestra.run.smithi012.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectMismatch PASSED 2023-10-05T11:47:29.010 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:47:29.011 INFO:teuthology.orchestra.run.smithi012.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectUnreadable STARTED 2023-10-05T11:47:29.110 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:47:29.111 INFO:teuthology.orchestra.run.smithi012.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectUnreadable PASSED 2023-10-05T11:47:29.410 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:47:29.410 INFO:teuthology.orchestra.run.smithi012.stdout:suite > Bucket tests > BucketTest.testBucketCreateReadDelete STARTED 2023-10-05T11:47:29.610 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:47:29.611 INFO:teuthology.orchestra.run.smithi012.stdout:suite > Bucket tests > BucketTest.testBucketCreateReadDelete PASSED 2023-10-05T11:47:29.710 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:47:29.711 INFO:teuthology.orchestra.run.smithi012.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNonEmpty STARTED 2023-10-05T11:47:29.910 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:47:29.910 INFO:teuthology.orchestra.run.smithi012.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNonEmpty PASSED 2023-10-05T11:47:30.210 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:47:30.211 INFO:teuthology.orchestra.run.smithi012.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNotExist STARTED 2023-10-05T11:47:30.310 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:47:30.310 INFO:teuthology.orchestra.run.smithi012.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNotExist PASSED 2023-10-05T11:47:30.410 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:47:30.410 INFO:teuthology.orchestra.run.smithi012.stdout:suite > Bucket tests > BucketTest.testBucketListDistinct STARTED 2023-10-05T11:47:30.510 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:47:30.511 INFO:teuthology.orchestra.run.smithi012.stdout:suite > Bucket tests > BucketTest.testBucketListDistinct PASSED 2023-10-05T11:47:31.111 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:47:31.111 INFO:teuthology.orchestra.run.smithi012.stdout:suite > Bucket tests > BucketTest.testBucketListEmpty STARTED 2023-10-05T11:47:31.210 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:47:31.211 INFO:teuthology.orchestra.run.smithi012.stdout:suite > Bucket tests > BucketTest.testBucketListEmpty PASSED 2023-10-05T11:47:31.611 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:47:31.611 INFO:teuthology.orchestra.run.smithi012.stdout:suite > Bucket tests > BucketTest.testBucketNotExist STARTED 2023-10-05T11:47:31.611 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:47:31.611 INFO:teuthology.orchestra.run.smithi012.stdout:suite > Bucket tests > BucketTest.testBucketNotExist PASSED 2023-10-05T11:47:31.733 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:47:31.733 INFO:teuthology.orchestra.run.smithi012.stdout:-------------------------------------------------------------------- 2023-10-05T11:47:31.733 INFO:teuthology.orchestra.run.smithi012.stdout:| Results: SUCCESS (9 tests, 9 successes, 0 failures, 0 skipped) | 2023-10-05T11:47:31.733 INFO:teuthology.orchestra.run.smithi012.stdout:-------------------------------------------------------------------- 2023-10-05T11:47:31.733 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:47:31.733 INFO:teuthology.orchestra.run.smithi012.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2023-10-05T11:47:31.733 INFO:teuthology.orchestra.run.smithi012.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2023-10-05T11:47:31.733 INFO:teuthology.orchestra.run.smithi012.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2023-10-05T11:47:31.734 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:47:31.734 INFO:teuthology.orchestra.run.smithi012.stdout:BUILD SUCCESSFUL in 6s 2023-10-05T11:47:31.734 INFO:teuthology.orchestra.run.smithi012.stdout:5 actionable tasks: 5 executed 2023-10-05T11:47:31.746 DEBUG:teuthology.orchestra.run.smithi012:> radosgw-admin gc process --include-all 2023-10-05T11:47:31.797 INFO:teuthology.orchestra.run.smithi012.stderr:ignoring --setuser ceph since I am not root 2023-10-05T11:47:31.797 INFO:teuthology.orchestra.run.smithi012.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T11:47:31.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.807+0000 7fdec911f880 20 rados->read ofs=0 len=0 2023-10-05T11:47:31.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.809+0000 7fdec911f880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:47:31.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.809+0000 7fdec911f880 20 realm 2023-10-05T11:47:31.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.809+0000 7fdec911f880 20 rados->read ofs=0 len=0 2023-10-05T11:47:31.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.809+0000 7fdec911f880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:47:31.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.809+0000 7fdec911f880 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T11:47:31.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.809+0000 7fdec911f880 20 rados->read ofs=0 len=0 2023-10-05T11:47:31.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.809+0000 7fdec911f880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:47:31.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.809+0000 7fdec911f880 20 rados->read ofs=0 len=0 2023-10-05T11:47:31.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.810+0000 7fdec911f880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:47:31.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.810+0000 7fdec911f880 20 rados->read ofs=0 len=0 2023-10-05T11:47:31.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.811+0000 7fdec911f880 20 rados_obj.operate() r=0 bl.length=1020 2023-10-05T11:47:31.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.811+0000 7fdec911f880 20 searching for the correct realm 2023-10-05T11:47:31.825 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.822+0000 7fdec59be640 0 -- 172.21.15.12:0/661741772 >> [v2:172.21.15.170:6814/3150808418,v1:172.21.15.170:6816/3150808418] conn(0x55bd175d9400 msgr2=0x55bd1753f180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:47:31.827 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.824+0000 7fdec911f880 20 RGWRados::pool_iterate: got zone_info.dff27d1e-df33-400e-a68a-7ba586947c99 2023-10-05T11:47:31.827 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.824+0000 7fdec911f880 20 RGWRados::pool_iterate: got zonegroup_info.c78aa576-9d15-4e9d-b3c0-4af23a22062c 2023-10-05T11:47:31.827 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.824+0000 7fdec911f880 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T11:47:31.827 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.824+0000 7fdec911f880 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T11:47:31.827 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.824+0000 7fdec911f880 20 rados->read ofs=0 len=0 2023-10-05T11:47:31.827 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.824+0000 7fdec911f880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:47:31.827 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.824+0000 7fdec911f880 20 rados->read ofs=0 len=0 2023-10-05T11:47:31.829 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.824+0000 7fdec911f880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:47:31.829 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.824+0000 7fdec911f880 20 rados->read ofs=0 len=0 2023-10-05T11:47:31.829 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.824+0000 7fdec911f880 20 rados_obj.operate() r=0 bl.length=454 2023-10-05T11:47:31.829 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.824+0000 7fdec911f880 20 zone default found 2023-10-05T11:47:31.829 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.824+0000 7fdec911f880 4 Realm: () 2023-10-05T11:47:31.829 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.824+0000 7fdec911f880 4 ZoneGroup: default (c78aa576-9d15-4e9d-b3c0-4af23a22062c) 2023-10-05T11:47:31.829 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.824+0000 7fdec911f880 4 Zone: default (dff27d1e-df33-400e-a68a-7ba586947c99) 2023-10-05T11:47:31.829 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.824+0000 7fdec911f880 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T11:47:31.829 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.824+0000 7fdec911f880 20 zonegroup default 2023-10-05T11:47:31.829 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.824+0000 7fdec911f880 20 rados->read ofs=0 len=0 2023-10-05T11:47:31.829 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.825+0000 7fdec911f880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:47:31.830 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.825+0000 7fdec911f880 20 rados->read ofs=0 len=0 2023-10-05T11:47:31.830 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.825+0000 7fdec911f880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:47:31.830 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.825+0000 7fdec911f880 20 rados->read ofs=0 len=0 2023-10-05T11:47:31.830 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.825+0000 7fdec911f880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:47:31.830 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.825+0000 7fdec911f880 20 started sync module instance, tier type = 2023-10-05T11:47:31.830 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.825+0000 7fdec911f880 20 started zone id=dff27d1e-df33-400e-a68a-7ba586947c99 (name=default) with tier type = 2023-10-05T11:47:31.835 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.832+0000 7fdec61bf640 0 -- 172.21.15.12:0/661741772 >> [v2:172.21.15.12:6824/2171933159,v1:172.21.15.12:6825/2171933159] conn(0x55bd175ff400 msgr2=0x55bd176d8580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:47:31.840 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.836+0000 7fdec911f880 20 add_watcher() i=0 2023-10-05T11:47:31.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.836+0000 7fdec911f880 20 add_watcher() i=1 2023-10-05T11:47:31.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.836+0000 7fdec911f880 20 add_watcher() i=2 2023-10-05T11:47:31.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.836+0000 7fdec911f880 20 add_watcher() i=3 2023-10-05T11:47:31.842 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.836+0000 7fdec911f880 20 add_watcher() i=4 2023-10-05T11:47:31.842 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.836+0000 7fdec911f880 20 add_watcher() i=5 2023-10-05T11:47:31.842 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.836+0000 7fdec911f880 20 add_watcher() i=6 2023-10-05T11:47:31.842 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.837+0000 7fdec911f880 20 add_watcher() i=7 2023-10-05T11:47:31.842 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.837+0000 7fdec911f880 2 all 8 watchers are set, enabling cache 2023-10-05T11:47:31.843 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.838+0000 7fdeac98c640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:47:31.843 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.839+0000 7fdec911f880 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T11:47:31.843 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.839+0000 7fdec911f880 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T11:47:31.887 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.883+0000 7fdea8183640 20 reqs_thread_entry: start 2023-10-05T11:47:31.887 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.883+0000 7fdec911f880 20 init_complete bucket index max shards: 11 2023-10-05T11:47:31.887 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.883+0000 7fdec911f880 20 Filter name: none 2023-10-05T11:47:31.887 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.883+0000 7fdea617f640 20 reqs_thread_entry: start 2023-10-05T11:47:31.887 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.883+0000 7fdec911f880 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2023-10-05T11:47:31.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.885+0000 7fdec911f880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:31.889 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.885+0000 7fdec911f880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:31.889 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.886+0000 7fdec911f880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:31.890 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.887+0000 7fdec911f880 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2023-10-05T11:47:31.891 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.888+0000 7fdec911f880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:31.891 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.888+0000 7fdec911f880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:31.892 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.889+0000 7fdec911f880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:31.893 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.890+0000 7fdec911f880 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2023-10-05T11:47:31.894 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.891+0000 7fdec911f880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:31.894 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.891+0000 7fdec911f880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:31.895 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.892+0000 7fdec911f880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:31.896 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.893+0000 7fdec911f880 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2023-10-05T11:47:31.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.894+0000 7fdec911f880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:31.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.894+0000 7fdec911f880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:31.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.895+0000 7fdec911f880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:31.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.896+0000 7fdec911f880 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2023-10-05T11:47:31.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.898+0000 7fdec911f880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:31.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.898+0000 7fdec911f880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:31.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.898+0000 7fdec911f880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:31.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.899+0000 7fdec911f880 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2023-10-05T11:47:31.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.901+0000 7fdec911f880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:31.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.901+0000 7fdec911f880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:31.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.902+0000 7fdec911f880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:31.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.903+0000 7fdec911f880 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2023-10-05T11:47:31.907 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.904+0000 7fdec911f880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:31.908 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.905+0000 7fdec911f880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:31.908 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.905+0000 7fdec911f880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:31.909 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.906+0000 7fdec911f880 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2023-10-05T11:47:31.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.907+0000 7fdec911f880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:31.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.907+0000 7fdec911f880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:31.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.908+0000 7fdec911f880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:31.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.909+0000 7fdec911f880 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2023-10-05T11:47:31.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.910+0000 7fdec911f880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:31.914 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.910+0000 7fdec911f880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:31.914 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.911+0000 7fdec911f880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:31.915 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.912+0000 7fdec911f880 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2023-10-05T11:47:31.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.913+0000 7fdec911f880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:31.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.914+0000 7fdec911f880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:31.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.914+0000 7fdec911f880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:31.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.915+0000 7fdec911f880 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2023-10-05T11:47:31.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.916+0000 7fdec911f880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:31.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.917+0000 7fdec911f880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:31.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.917+0000 7fdec911f880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:31.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.918+0000 7fdec911f880 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2023-10-05T11:47:31.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.919+0000 7fdec911f880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:31.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.919+0000 7fdec911f880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:31.923 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.920+0000 7fdec911f880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:31.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.921+0000 7fdec911f880 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2023-10-05T11:47:31.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.922+0000 7fdec911f880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:31.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.922+0000 7fdec911f880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:31.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.923+0000 7fdec911f880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:31.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.924+0000 7fdec911f880 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2023-10-05T11:47:31.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.925+0000 7fdec911f880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:31.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.925+0000 7fdec911f880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:31.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.926+0000 7fdec911f880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:31.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.927+0000 7fdec911f880 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2023-10-05T11:47:31.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.928+0000 7fdec911f880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:31.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.928+0000 7fdec911f880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:31.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.928+0000 7fdec911f880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:31.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.929+0000 7fdec911f880 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2023-10-05T11:47:31.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.931+0000 7fdec911f880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:31.935 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.932+0000 7fdec911f880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:31.935 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.932+0000 7fdec911f880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:31.936 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.933+0000 7fdec911f880 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2023-10-05T11:47:31.937 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.934+0000 7fdec911f880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:31.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.935+0000 7fdec911f880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:31.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.935+0000 7fdec911f880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:31.939 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.936+0000 7fdec911f880 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2023-10-05T11:47:31.940 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.937+0000 7fdec911f880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:31.940 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.937+0000 7fdec911f880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:31.941 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.938+0000 7fdec911f880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:31.942 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.939+0000 7fdec911f880 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2023-10-05T11:47:31.943 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.940+0000 7fdec911f880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:31.944 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.941+0000 7fdec911f880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:31.944 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.941+0000 7fdec911f880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:31.945 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.942+0000 7fdec911f880 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2023-10-05T11:47:31.946 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.943+0000 7fdec911f880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:31.947 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.944+0000 7fdec911f880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:31.947 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.944+0000 7fdec911f880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:31.948 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.945+0000 7fdec911f880 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2023-10-05T11:47:31.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.946+0000 7fdec911f880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:31.950 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.947+0000 7fdec911f880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:31.950 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.947+0000 7fdec911f880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:31.951 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.948+0000 7fdec911f880 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2023-10-05T11:47:31.952 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.949+0000 7fdec911f880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:31.953 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.950+0000 7fdec911f880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:31.953 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.950+0000 7fdec911f880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:31.954 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.951+0000 7fdec911f880 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2023-10-05T11:47:31.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.952+0000 7fdec911f880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:31.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.953+0000 7fdec911f880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:31.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.953+0000 7fdec911f880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:31.957 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.954+0000 7fdec911f880 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2023-10-05T11:47:31.958 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.955+0000 7fdec911f880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:31.959 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.956+0000 7fdec911f880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:31.959 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.956+0000 7fdec911f880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2023-10-05T11:47:31.959 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.956+0000 7fdec911f880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.3365597821780148946', time=2023-10-05T13:47:30.859268+0000, chain.objs.size()=1 2023-10-05T11:47:31.959 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.956+0000 7fdec911f880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.60__shadow_.ssGqHoO34nSVA0-MHg8jYgIXtG2c6Ex_0 2023-10-05T11:47:31.960 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.957+0000 7fdec911f880 5 garbage collection: RGWGC::process removing entries, marker: 2023-10-05T11:47:31.962 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.959+0000 7fdec911f880 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2023-10-05T11:47:31.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.961+0000 7fdec911f880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:31.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.961+0000 7fdec911f880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:31.965 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.962+0000 7fdec911f880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:31.966 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.963+0000 7fdec911f880 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2023-10-05T11:47:31.967 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.964+0000 7fdec911f880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:31.968 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.965+0000 7fdec911f880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:31.968 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.965+0000 7fdec911f880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:31.969 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.966+0000 7fdec911f880 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2023-10-05T11:47:31.970 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.967+0000 7fdec911f880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:31.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.967+0000 7fdec911f880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:31.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.968+0000 7fdec911f880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2023-10-05T11:47:31.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.968+0000 7fdec911f880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.4614512275053818798', time=2023-10-05T13:47:29.943301+0000, chain.objs.size()=1 2023-10-05T11:47:31.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.968+0000 7fdec911f880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.59__shadow_.Eg-uM0djlCGqd0ZgtpUFygZiMSBjKIk_0 2023-10-05T11:47:31.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.969+0000 7fdec911f880 5 garbage collection: RGWGC::process removing entries, marker: 2023-10-05T11:47:31.974 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.971+0000 7fdec911f880 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2023-10-05T11:47:31.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.972+0000 7fdec911f880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:31.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.973+0000 7fdec911f880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:31.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.973+0000 7fdec911f880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:31.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.974+0000 7fdec911f880 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2023-10-05T11:47:31.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.975+0000 7fdec911f880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:31.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.975+0000 7fdec911f880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:31.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.975+0000 7fdec911f880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:31.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.976+0000 7fdec911f880 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2023-10-05T11:47:31.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.978+0000 7fdec911f880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:31.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.978+0000 7fdec911f880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:31.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.978+0000 7fdec911f880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:31.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.979+0000 7fdec911f880 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2023-10-05T11:47:31.984 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.981+0000 7fdec911f880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:31.984 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.981+0000 7fdec911f880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:31.984 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.981+0000 7fdec911f880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:31.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.982+0000 7fdec911f880 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2023-10-05T11:47:31.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.984+0000 7fdec911f880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:31.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.984+0000 7fdec911f880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:31.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.984+0000 7fdec911f880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:31.989 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.986+0000 7fdeac98c640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:47:31.991 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.988+0000 7fdec911f880 20 remove_watcher() i=0 2023-10-05T11:47:31.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.988+0000 7fdec911f880 2 removed watcher, disabling cache 2023-10-05T11:47:31.993 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.990+0000 7fdec911f880 20 remove_watcher() i=1 2023-10-05T11:47:31.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.991+0000 7fdec911f880 20 remove_watcher() i=2 2023-10-05T11:47:31.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.991+0000 7fdec911f880 20 remove_watcher() i=3 2023-10-05T11:47:31.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.992+0000 7fdec911f880 20 remove_watcher() i=4 2023-10-05T11:47:31.996 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.993+0000 7fdec911f880 20 remove_watcher() i=5 2023-10-05T11:47:31.997 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.994+0000 7fdec911f880 20 remove_watcher() i=6 2023-10-05T11:47:31.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:31.995+0000 7fdec911f880 20 remove_watcher() i=7 2023-10-05T11:47:32.004 DEBUG:teuthology.orchestra.run.smithi012:> radosgw-admin gc process --include-all 2023-10-05T11:47:32.054 INFO:teuthology.orchestra.run.smithi012.stderr:ignoring --setuser ceph since I am not root 2023-10-05T11:47:32.054 INFO:teuthology.orchestra.run.smithi012.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T11:47:32.067 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.064+0000 7f0bdeb27880 20 rados->read ofs=0 len=0 2023-10-05T11:47:32.069 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.065+0000 7f0bdeb27880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:47:32.069 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.065+0000 7f0bdeb27880 20 realm 2023-10-05T11:47:32.069 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.065+0000 7f0bdeb27880 20 rados->read ofs=0 len=0 2023-10-05T11:47:32.069 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.065+0000 7f0bdeb27880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:47:32.069 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.065+0000 7f0bdeb27880 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T11:47:32.069 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.065+0000 7f0bdeb27880 20 rados->read ofs=0 len=0 2023-10-05T11:47:32.069 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.066+0000 7f0bdeb27880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:47:32.069 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.066+0000 7f0bdeb27880 20 rados->read ofs=0 len=0 2023-10-05T11:47:32.070 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.066+0000 7f0bdeb27880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:47:32.070 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.067+0000 7f0bdeb27880 20 rados->read ofs=0 len=0 2023-10-05T11:47:32.070 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.067+0000 7f0bdeb27880 20 rados_obj.operate() r=0 bl.length=1020 2023-10-05T11:47:32.070 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.067+0000 7f0bdeb27880 20 searching for the correct realm 2023-10-05T11:47:32.080 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.077+0000 7f0bdb56b640 0 -- 172.21.15.12:0/1497778894 >> [v2:172.21.15.170:6814/3150808418,v1:172.21.15.170:6816/3150808418] conn(0x563bdaa53c00 msgr2=0x563bd9e68c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:47:32.081 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.078+0000 7f0bdeb27880 20 RGWRados::pool_iterate: got zone_info.dff27d1e-df33-400e-a68a-7ba586947c99 2023-10-05T11:47:32.081 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.078+0000 7f0bdeb27880 20 RGWRados::pool_iterate: got zonegroup_info.c78aa576-9d15-4e9d-b3c0-4af23a22062c 2023-10-05T11:47:32.081 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.078+0000 7f0bdeb27880 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T11:47:32.081 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.078+0000 7f0bdeb27880 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T11:47:32.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.078+0000 7f0bdeb27880 20 rados->read ofs=0 len=0 2023-10-05T11:47:32.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.078+0000 7f0bdeb27880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:47:32.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.078+0000 7f0bdeb27880 20 rados->read ofs=0 len=0 2023-10-05T11:47:32.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.078+0000 7f0bdeb27880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:47:32.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.078+0000 7f0bdeb27880 20 rados->read ofs=0 len=0 2023-10-05T11:47:32.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.078+0000 7f0bdeb27880 20 rados_obj.operate() r=0 bl.length=454 2023-10-05T11:47:32.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.078+0000 7f0bdeb27880 20 zone default found 2023-10-05T11:47:32.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.078+0000 7f0bdeb27880 4 Realm: () 2023-10-05T11:47:32.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.078+0000 7f0bdeb27880 4 ZoneGroup: default (c78aa576-9d15-4e9d-b3c0-4af23a22062c) 2023-10-05T11:47:32.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.078+0000 7f0bdeb27880 4 Zone: default (dff27d1e-df33-400e-a68a-7ba586947c99) 2023-10-05T11:47:32.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.078+0000 7f0bdeb27880 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T11:47:32.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.078+0000 7f0bdeb27880 20 zonegroup default 2023-10-05T11:47:32.084 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.078+0000 7f0bdeb27880 20 rados->read ofs=0 len=0 2023-10-05T11:47:32.084 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.079+0000 7f0bdeb27880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:47:32.084 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.079+0000 7f0bdeb27880 20 rados->read ofs=0 len=0 2023-10-05T11:47:32.084 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.079+0000 7f0bdeb27880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:47:32.084 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.079+0000 7f0bdeb27880 20 rados->read ofs=0 len=0 2023-10-05T11:47:32.084 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.079+0000 7f0bdeb27880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:47:32.084 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.079+0000 7f0bdeb27880 20 started sync module instance, tier type = 2023-10-05T11:47:32.084 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.079+0000 7f0bdeb27880 20 started zone id=dff27d1e-df33-400e-a68a-7ba586947c99 (name=default) with tier type = 2023-10-05T11:47:32.089 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.085+0000 7f0bdbd6c640 0 -- 172.21.15.12:0/1497778894 >> [v2:172.21.15.12:6824/2171933159,v1:172.21.15.12:6825/2171933159] conn(0x563bd9ff8800 msgr2=0x563bd9e69700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:47:32.091 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.088+0000 7f0bdeb27880 20 add_watcher() i=0 2023-10-05T11:47:32.091 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.088+0000 7f0bdeb27880 20 add_watcher() i=1 2023-10-05T11:47:32.092 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.088+0000 7f0bdeb27880 20 add_watcher() i=2 2023-10-05T11:47:32.092 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.088+0000 7f0bdeb27880 20 add_watcher() i=3 2023-10-05T11:47:32.092 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.088+0000 7f0bdeb27880 20 add_watcher() i=4 2023-10-05T11:47:32.092 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.088+0000 7f0bdeb27880 20 add_watcher() i=5 2023-10-05T11:47:32.092 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.088+0000 7f0bdeb27880 20 add_watcher() i=6 2023-10-05T11:47:32.092 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.089+0000 7f0bdeb27880 20 add_watcher() i=7 2023-10-05T11:47:32.092 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.089+0000 7f0bdeb27880 2 all 8 watchers are set, enabling cache 2023-10-05T11:47:32.094 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.090+0000 7f0bc2539640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:47:32.094 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.091+0000 7f0bdeb27880 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T11:47:32.094 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.091+0000 7f0bdeb27880 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T11:47:32.138 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.135+0000 7f0bbdd30640 20 reqs_thread_entry: start 2023-10-05T11:47:32.139 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.135+0000 7f0bdeb27880 20 init_complete bucket index max shards: 11 2023-10-05T11:47:32.139 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.135+0000 7f0bdeb27880 20 Filter name: none 2023-10-05T11:47:32.139 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.135+0000 7f0bbbd2c640 20 reqs_thread_entry: start 2023-10-05T11:47:32.139 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.135+0000 7f0bdeb27880 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2023-10-05T11:47:32.140 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.137+0000 7f0bdeb27880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.140 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.137+0000 7f0bdeb27880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:32.140 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.137+0000 7f0bdeb27880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.141 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.138+0000 7f0bdeb27880 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2023-10-05T11:47:32.143 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.139+0000 7f0bdeb27880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.143 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.140+0000 7f0bdeb27880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:32.143 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.140+0000 7f0bdeb27880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.141+0000 7f0bdeb27880 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2023-10-05T11:47:32.146 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.143+0000 7f0bdeb27880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.146 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.143+0000 7f0bdeb27880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:32.147 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.144+0000 7f0bdeb27880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.148 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.145+0000 7f0bdeb27880 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2023-10-05T11:47:32.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.146+0000 7f0bdeb27880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.150 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.147+0000 7f0bdeb27880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:32.150 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.147+0000 7f0bdeb27880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.151 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.148+0000 7f0bdeb27880 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2023-10-05T11:47:32.153 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.149+0000 7f0bdeb27880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.153 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.150+0000 7f0bdeb27880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:32.154 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.150+0000 7f0bdeb27880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.154 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.151+0000 7f0bdeb27880 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2023-10-05T11:47:32.156 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.152+0000 7f0bdeb27880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.156 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.153+0000 7f0bdeb27880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:32.157 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.154+0000 7f0bdeb27880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.158 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.155+0000 7f0bdeb27880 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2023-10-05T11:47:32.159 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.156+0000 7f0bdeb27880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.159 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.156+0000 7f0bdeb27880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:32.160 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.157+0000 7f0bdeb27880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.161 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.157+0000 7f0bdeb27880 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2023-10-05T11:47:32.162 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.159+0000 7f0bdeb27880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.162 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.159+0000 7f0bdeb27880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:32.162 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.159+0000 7f0bdeb27880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.163 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.160+0000 7f0bdeb27880 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2023-10-05T11:47:32.165 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.162+0000 7f0bdeb27880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.165 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.162+0000 7f0bdeb27880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:32.165 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.162+0000 7f0bdeb27880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.166 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.163+0000 7f0bdeb27880 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2023-10-05T11:47:32.167 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.164+0000 7f0bdeb27880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.168 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.165+0000 7f0bdeb27880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:32.168 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.165+0000 7f0bdeb27880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.169 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.166+0000 7f0bdeb27880 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2023-10-05T11:47:32.171 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.167+0000 7f0bdeb27880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.171 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.168+0000 7f0bdeb27880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:32.171 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.168+0000 7f0bdeb27880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.169+0000 7f0bdeb27880 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2023-10-05T11:47:32.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.170+0000 7f0bdeb27880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.171+0000 7f0bdeb27880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:32.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.171+0000 7f0bdeb27880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.175 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.172+0000 7f0bdeb27880 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2023-10-05T11:47:32.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.173+0000 7f0bdeb27880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.174+0000 7f0bdeb27880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:32.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.174+0000 7f0bdeb27880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.175+0000 7f0bdeb27880 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2023-10-05T11:47:32.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.176+0000 7f0bdeb27880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.177+0000 7f0bdeb27880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:32.180 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.177+0000 7f0bdeb27880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.178+0000 7f0bdeb27880 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2023-10-05T11:47:32.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.180+0000 7f0bdeb27880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.180+0000 7f0bdeb27880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:32.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.180+0000 7f0bdeb27880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.185 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.182+0000 7f0bdeb27880 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2023-10-05T11:47:32.186 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.183+0000 7f0bdeb27880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.186 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.183+0000 7f0bdeb27880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:32.187 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.183+0000 7f0bdeb27880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.187 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.184+0000 7f0bdeb27880 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2023-10-05T11:47:32.189 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.186+0000 7f0bdeb27880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.189 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.186+0000 7f0bdeb27880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:32.189 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.186+0000 7f0bdeb27880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.187+0000 7f0bdeb27880 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2023-10-05T11:47:32.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.188+0000 7f0bdeb27880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.189+0000 7f0bdeb27880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:32.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.189+0000 7f0bdeb27880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.190+0000 7f0bdeb27880 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2023-10-05T11:47:32.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.192+0000 7f0bdeb27880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.196 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.193+0000 7f0bdeb27880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:32.196 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.193+0000 7f0bdeb27880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.194+0000 7f0bdeb27880 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2023-10-05T11:47:32.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.195+0000 7f0bdeb27880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.196+0000 7f0bdeb27880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:32.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.196+0000 7f0bdeb27880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.197+0000 7f0bdeb27880 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2023-10-05T11:47:32.202 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.199+0000 7f0bdeb27880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.202 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.199+0000 7f0bdeb27880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:32.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.200+0000 7f0bdeb27880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.201+0000 7f0bdeb27880 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2023-10-05T11:47:32.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.202+0000 7f0bdeb27880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.202+0000 7f0bdeb27880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:32.206 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.202+0000 7f0bdeb27880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.206 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.203+0000 7f0bdeb27880 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2023-10-05T11:47:32.208 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.205+0000 7f0bdeb27880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.208 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.205+0000 7f0bdeb27880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:32.208 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.205+0000 7f0bdeb27880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.209 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.206+0000 7f0bdeb27880 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2023-10-05T11:47:32.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.208+0000 7f0bdeb27880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.208+0000 7f0bdeb27880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:32.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.208+0000 7f0bdeb27880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.209+0000 7f0bdeb27880 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2023-10-05T11:47:32.214 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.211+0000 7f0bdeb27880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.215 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.211+0000 7f0bdeb27880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:32.215 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.211+0000 7f0bdeb27880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.216 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.212+0000 7f0bdeb27880 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2023-10-05T11:47:32.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.214+0000 7f0bdeb27880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.214+0000 7f0bdeb27880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:32.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.214+0000 7f0bdeb27880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.215+0000 7f0bdeb27880 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2023-10-05T11:47:32.220 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.217+0000 7f0bdeb27880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.221 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.218+0000 7f0bdeb27880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:32.221 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.218+0000 7f0bdeb27880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.222 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.219+0000 7f0bdeb27880 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2023-10-05T11:47:32.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.220+0000 7f0bdeb27880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.224 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.221+0000 7f0bdeb27880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:32.225 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.221+0000 7f0bdeb27880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.225 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.222+0000 7f0bdeb27880 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2023-10-05T11:47:32.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.224+0000 7f0bdeb27880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.224+0000 7f0bdeb27880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:32.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.224+0000 7f0bdeb27880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.225+0000 7f0bdeb27880 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2023-10-05T11:47:32.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.226+0000 7f0bdeb27880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.227+0000 7f0bdeb27880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:32.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.227+0000 7f0bdeb27880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.228+0000 7f0bdeb27880 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2023-10-05T11:47:32.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.229+0000 7f0bdeb27880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.230+0000 7f0bdeb27880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:32.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.230+0000 7f0bdeb27880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.234 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.231+0000 7f0bdeb27880 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2023-10-05T11:47:32.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.232+0000 7f0bdeb27880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.233+0000 7f0bdeb27880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:32.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.233+0000 7f0bdeb27880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.234+0000 7f0bc2539640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:47:32.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.237+0000 7f0bdeb27880 20 remove_watcher() i=0 2023-10-05T11:47:32.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.237+0000 7f0bdeb27880 2 removed watcher, disabling cache 2023-10-05T11:47:32.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.238+0000 7f0bdeb27880 20 remove_watcher() i=1 2023-10-05T11:47:32.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.239+0000 7f0bdeb27880 20 remove_watcher() i=2 2023-10-05T11:47:32.243 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.240+0000 7f0bdeb27880 20 remove_watcher() i=3 2023-10-05T11:47:32.245 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.242+0000 7f0bdeb27880 20 remove_watcher() i=4 2023-10-05T11:47:32.246 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.243+0000 7f0bdeb27880 20 remove_watcher() i=5 2023-10-05T11:47:32.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.244+0000 7f0bdeb27880 20 remove_watcher() i=6 2023-10-05T11:47:32.248 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.245+0000 7f0bdeb27880 20 remove_watcher() i=7 2023-10-05T11:47:32.253 DEBUG:teuthology.orchestra.run.smithi012:> radosgw-admin gc process --include-all 2023-10-05T11:47:32.303 INFO:teuthology.orchestra.run.smithi012.stderr:ignoring --setuser ceph since I am not root 2023-10-05T11:47:32.303 INFO:teuthology.orchestra.run.smithi012.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T11:47:32.316 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.313+0000 7fe51260f880 20 rados->read ofs=0 len=0 2023-10-05T11:47:32.318 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.315+0000 7fe51260f880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:47:32.318 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.315+0000 7fe51260f880 20 realm 2023-10-05T11:47:32.318 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.315+0000 7fe51260f880 20 rados->read ofs=0 len=0 2023-10-05T11:47:32.318 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.315+0000 7fe51260f880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:47:32.319 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.315+0000 7fe51260f880 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T11:47:32.319 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.315+0000 7fe51260f880 20 rados->read ofs=0 len=0 2023-10-05T11:47:32.319 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.315+0000 7fe51260f880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:47:32.319 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.315+0000 7fe51260f880 20 rados->read ofs=0 len=0 2023-10-05T11:47:32.319 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.316+0000 7fe51260f880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:47:32.319 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.316+0000 7fe51260f880 20 rados->read ofs=0 len=0 2023-10-05T11:47:32.320 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.317+0000 7fe51260f880 20 rados_obj.operate() r=0 bl.length=1020 2023-10-05T11:47:32.320 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.317+0000 7fe51260f880 20 searching for the correct realm 2023-10-05T11:47:32.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.326+0000 7fe50eada640 0 -- 172.21.15.12:0/987283080 >> [v2:172.21.15.170:6814/3150808418,v1:172.21.15.170:6816/3150808418] conn(0x5650c5619800 msgr2=0x5650c4a2b180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:47:32.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.327+0000 7fe51260f880 20 RGWRados::pool_iterate: got zone_info.dff27d1e-df33-400e-a68a-7ba586947c99 2023-10-05T11:47:32.331 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.327+0000 7fe51260f880 20 RGWRados::pool_iterate: got zonegroup_info.c78aa576-9d15-4e9d-b3c0-4af23a22062c 2023-10-05T11:47:32.331 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.327+0000 7fe51260f880 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T11:47:32.331 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.327+0000 7fe51260f880 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T11:47:32.331 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.327+0000 7fe51260f880 20 rados->read ofs=0 len=0 2023-10-05T11:47:32.331 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.327+0000 7fe51260f880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:47:32.331 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.327+0000 7fe51260f880 20 rados->read ofs=0 len=0 2023-10-05T11:47:32.333 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.328+0000 7fe51260f880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:47:32.333 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.328+0000 7fe51260f880 20 rados->read ofs=0 len=0 2023-10-05T11:47:32.333 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.328+0000 7fe51260f880 20 rados_obj.operate() r=0 bl.length=454 2023-10-05T11:47:32.333 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.328+0000 7fe51260f880 20 zone default found 2023-10-05T11:47:32.334 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.328+0000 7fe51260f880 4 Realm: () 2023-10-05T11:47:32.334 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.328+0000 7fe51260f880 4 ZoneGroup: default (c78aa576-9d15-4e9d-b3c0-4af23a22062c) 2023-10-05T11:47:32.334 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.328+0000 7fe51260f880 4 Zone: default (dff27d1e-df33-400e-a68a-7ba586947c99) 2023-10-05T11:47:32.334 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.328+0000 7fe51260f880 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T11:47:32.334 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.328+0000 7fe51260f880 20 zonegroup default 2023-10-05T11:47:32.334 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.328+0000 7fe51260f880 20 rados->read ofs=0 len=0 2023-10-05T11:47:32.334 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.328+0000 7fe51260f880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:47:32.334 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.328+0000 7fe51260f880 20 rados->read ofs=0 len=0 2023-10-05T11:47:32.334 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.329+0000 7fe51260f880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:47:32.334 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.329+0000 7fe51260f880 20 rados->read ofs=0 len=0 2023-10-05T11:47:32.335 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.329+0000 7fe51260f880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:47:32.335 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.329+0000 7fe51260f880 20 started sync module instance, tier type = 2023-10-05T11:47:32.335 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.329+0000 7fe51260f880 20 started zone id=dff27d1e-df33-400e-a68a-7ba586947c99 (name=default) with tier type = 2023-10-05T11:47:32.338 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.335+0000 7fe50f2db640 0 -- 172.21.15.12:0/987283080 >> [v2:172.21.15.12:6824/2171933159,v1:172.21.15.12:6825/2171933159] conn(0x5650c4be4000 msgr2=0x5650c4bc2580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:47:32.341 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.338+0000 7fe51260f880 20 add_watcher() i=0 2023-10-05T11:47:32.341 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.338+0000 7fe51260f880 20 add_watcher() i=1 2023-10-05T11:47:32.341 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.338+0000 7fe51260f880 20 add_watcher() i=2 2023-10-05T11:47:32.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.338+0000 7fe51260f880 20 add_watcher() i=3 2023-10-05T11:47:32.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.338+0000 7fe51260f880 20 add_watcher() i=4 2023-10-05T11:47:32.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.338+0000 7fe51260f880 20 add_watcher() i=5 2023-10-05T11:47:32.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.338+0000 7fe51260f880 20 add_watcher() i=6 2023-10-05T11:47:32.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.339+0000 7fe51260f880 20 add_watcher() i=7 2023-10-05T11:47:32.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.339+0000 7fe51260f880 2 all 8 watchers are set, enabling cache 2023-10-05T11:47:32.343 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.340+0000 7fe4f5aa8640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:47:32.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.340+0000 7fe51260f880 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T11:47:32.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.340+0000 7fe51260f880 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T11:47:32.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.381+0000 7fe4f129f640 20 reqs_thread_entry: start 2023-10-05T11:47:32.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.381+0000 7fe51260f880 20 init_complete bucket index max shards: 11 2023-10-05T11:47:32.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.381+0000 7fe51260f880 20 Filter name: none 2023-10-05T11:47:32.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.382+0000 7fe4ef29b640 20 reqs_thread_entry: start 2023-10-05T11:47:32.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.382+0000 7fe51260f880 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2023-10-05T11:47:32.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.383+0000 7fe51260f880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.384+0000 7fe51260f880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:32.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.384+0000 7fe51260f880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.385+0000 7fe51260f880 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2023-10-05T11:47:32.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.386+0000 7fe51260f880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.386+0000 7fe51260f880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:32.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.386+0000 7fe51260f880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.388+0000 7fe51260f880 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2023-10-05T11:47:32.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.389+0000 7fe51260f880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.390+0000 7fe51260f880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:32.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.390+0000 7fe51260f880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.391+0000 7fe51260f880 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2023-10-05T11:47:32.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.392+0000 7fe51260f880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.392+0000 7fe51260f880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:32.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.393+0000 7fe51260f880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.394+0000 7fe51260f880 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2023-10-05T11:47:32.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.395+0000 7fe51260f880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.395+0000 7fe51260f880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:32.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.396+0000 7fe51260f880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.397+0000 7fe51260f880 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2023-10-05T11:47:32.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.398+0000 7fe51260f880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.399+0000 7fe51260f880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:32.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.399+0000 7fe51260f880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.403 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.400+0000 7fe51260f880 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2023-10-05T11:47:32.404 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.401+0000 7fe51260f880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.402+0000 7fe51260f880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:32.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.402+0000 7fe51260f880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.406 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.403+0000 7fe51260f880 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2023-10-05T11:47:32.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.404+0000 7fe51260f880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.405+0000 7fe51260f880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:32.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.405+0000 7fe51260f880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.406+0000 7fe51260f880 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2023-10-05T11:47:32.410 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.407+0000 7fe51260f880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.408+0000 7fe51260f880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:32.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.408+0000 7fe51260f880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.409+0000 7fe51260f880 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2023-10-05T11:47:32.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.410+0000 7fe51260f880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.410+0000 7fe51260f880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:32.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.411+0000 7fe51260f880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.411+0000 7fe51260f880 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2023-10-05T11:47:32.416 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.413+0000 7fe51260f880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.416 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.413+0000 7fe51260f880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:32.417 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.413+0000 7fe51260f880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.417 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.414+0000 7fe51260f880 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2023-10-05T11:47:32.419 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.416+0000 7fe51260f880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.419 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.416+0000 7fe51260f880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:32.419 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.416+0000 7fe51260f880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.420 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.417+0000 7fe51260f880 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2023-10-05T11:47:32.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.419+0000 7fe51260f880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.419+0000 7fe51260f880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:32.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.419+0000 7fe51260f880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.423 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.420+0000 7fe51260f880 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2023-10-05T11:47:32.425 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.422+0000 7fe51260f880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.425 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.422+0000 7fe51260f880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:32.425 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.422+0000 7fe51260f880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.423+0000 7fe51260f880 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2023-10-05T11:47:32.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.425+0000 7fe51260f880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.425+0000 7fe51260f880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:32.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.426+0000 7fe51260f880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.430 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.427+0000 7fe51260f880 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2023-10-05T11:47:32.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.428+0000 7fe51260f880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.429+0000 7fe51260f880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:32.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.429+0000 7fe51260f880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.434 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.431+0000 7fe51260f880 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2023-10-05T11:47:32.435 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.432+0000 7fe51260f880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.435 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.432+0000 7fe51260f880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:32.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.433+0000 7fe51260f880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.437 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.433+0000 7fe51260f880 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2023-10-05T11:47:32.438 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.434+0000 7fe51260f880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.438 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.435+0000 7fe51260f880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:32.438 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.435+0000 7fe51260f880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.439 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.436+0000 7fe51260f880 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2023-10-05T11:47:32.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.437+0000 7fe51260f880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.441 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.438+0000 7fe51260f880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:32.441 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.438+0000 7fe51260f880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.442 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.439+0000 7fe51260f880 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2023-10-05T11:47:32.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.440+0000 7fe51260f880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.441+0000 7fe51260f880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:32.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.441+0000 7fe51260f880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.442+0000 7fe51260f880 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2023-10-05T11:47:32.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.443+0000 7fe51260f880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.447 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.444+0000 7fe51260f880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:32.447 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.444+0000 7fe51260f880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.448 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.445+0000 7fe51260f880 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2023-10-05T11:47:32.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.446+0000 7fe51260f880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.446+0000 7fe51260f880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:32.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.447+0000 7fe51260f880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.448+0000 7fe51260f880 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2023-10-05T11:47:32.452 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.449+0000 7fe51260f880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.452 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.449+0000 7fe51260f880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:32.453 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.450+0000 7fe51260f880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.451+0000 7fe51260f880 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2023-10-05T11:47:32.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.452+0000 7fe51260f880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.452+0000 7fe51260f880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:32.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.452+0000 7fe51260f880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.453+0000 7fe51260f880 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2023-10-05T11:47:32.458 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.455+0000 7fe51260f880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.458 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.455+0000 7fe51260f880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:32.459 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.456+0000 7fe51260f880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.460 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.457+0000 7fe51260f880 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2023-10-05T11:47:32.461 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.458+0000 7fe51260f880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.461 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.458+0000 7fe51260f880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:32.462 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.458+0000 7fe51260f880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.462 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.459+0000 7fe51260f880 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2023-10-05T11:47:32.464 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.461+0000 7fe51260f880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.464 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.461+0000 7fe51260f880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:32.464 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.461+0000 7fe51260f880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.465 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.462+0000 7fe51260f880 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2023-10-05T11:47:32.466 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.463+0000 7fe51260f880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.467 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.464+0000 7fe51260f880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:32.467 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.464+0000 7fe51260f880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.465+0000 7fe51260f880 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2023-10-05T11:47:32.470 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.467+0000 7fe51260f880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.470 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.467+0000 7fe51260f880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:32.470 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.467+0000 7fe51260f880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.471 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.468+0000 7fe51260f880 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2023-10-05T11:47:32.472 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.469+0000 7fe51260f880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.473 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.470+0000 7fe51260f880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:32.473 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.470+0000 7fe51260f880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.474 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.471+0000 7fe51260f880 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2023-10-05T11:47:32.475 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.472+0000 7fe51260f880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.476 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.473+0000 7fe51260f880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:32.476 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.473+0000 7fe51260f880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.477 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.474+0000 7fe51260f880 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2023-10-05T11:47:32.478 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.475+0000 7fe51260f880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.479 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.476+0000 7fe51260f880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:32.479 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.476+0000 7fe51260f880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.480 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.477+0000 7fe4f5aa8640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:47:32.483 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.480+0000 7fe51260f880 20 remove_watcher() i=0 2023-10-05T11:47:32.483 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.480+0000 7fe51260f880 2 removed watcher, disabling cache 2023-10-05T11:47:32.484 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.481+0000 7fe51260f880 20 remove_watcher() i=1 2023-10-05T11:47:32.485 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.482+0000 7fe51260f880 20 remove_watcher() i=2 2023-10-05T11:47:32.486 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.483+0000 7fe51260f880 20 remove_watcher() i=3 2023-10-05T11:47:32.487 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.484+0000 7fe51260f880 20 remove_watcher() i=4 2023-10-05T11:47:32.488 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.485+0000 7fe51260f880 20 remove_watcher() i=5 2023-10-05T11:47:32.489 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.486+0000 7fe51260f880 20 remove_watcher() i=6 2023-10-05T11:47:32.490 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.487+0000 7fe51260f880 20 remove_watcher() i=7 2023-10-05T11:47:32.495 DEBUG:teuthology.orchestra.run.smithi012:> radosgw-admin gc process --include-all 2023-10-05T11:47:32.547 INFO:teuthology.orchestra.run.smithi012.stderr:ignoring --setuser ceph since I am not root 2023-10-05T11:47:32.548 INFO:teuthology.orchestra.run.smithi012.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T11:47:32.561 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.558+0000 7f31b9136880 20 rados->read ofs=0 len=0 2023-10-05T11:47:32.563 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.559+0000 7f31b9136880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:47:32.563 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.559+0000 7f31b9136880 20 realm 2023-10-05T11:47:32.563 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.559+0000 7f31b9136880 20 rados->read ofs=0 len=0 2023-10-05T11:47:32.563 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.559+0000 7f31b9136880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:47:32.563 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.559+0000 7f31b9136880 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T11:47:32.563 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.559+0000 7f31b9136880 20 rados->read ofs=0 len=0 2023-10-05T11:47:32.563 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.560+0000 7f31b9136880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:47:32.563 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.560+0000 7f31b9136880 20 rados->read ofs=0 len=0 2023-10-05T11:47:32.564 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.560+0000 7f31b9136880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:47:32.564 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.560+0000 7f31b9136880 20 rados->read ofs=0 len=0 2023-10-05T11:47:32.564 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.561+0000 7f31b9136880 20 rados_obj.operate() r=0 bl.length=1020 2023-10-05T11:47:32.564 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.561+0000 7f31b9136880 20 searching for the correct realm 2023-10-05T11:47:32.574 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.571+0000 7f31b5ae8640 0 -- 172.21.15.12:0/2806200816 >> [v2:172.21.15.170:6814/3150808418,v1:172.21.15.170:6816/3150808418] conn(0x55d813a35000 msgr2=0x55d813979180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-10-05T11:47:32.575 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.572+0000 7f31b9136880 20 RGWRados::pool_iterate: got zone_info.dff27d1e-df33-400e-a68a-7ba586947c99 2023-10-05T11:47:32.575 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.572+0000 7f31b9136880 20 RGWRados::pool_iterate: got zonegroup_info.c78aa576-9d15-4e9d-b3c0-4af23a22062c 2023-10-05T11:47:32.575 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.572+0000 7f31b9136880 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T11:47:32.575 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.572+0000 7f31b9136880 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T11:47:32.575 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.572+0000 7f31b9136880 20 rados->read ofs=0 len=0 2023-10-05T11:47:32.576 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.572+0000 7f31b9136880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:47:32.576 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.572+0000 7f31b9136880 20 rados->read ofs=0 len=0 2023-10-05T11:47:32.576 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.572+0000 7f31b9136880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:47:32.576 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.572+0000 7f31b9136880 20 rados->read ofs=0 len=0 2023-10-05T11:47:32.577 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.572+0000 7f31b9136880 20 rados_obj.operate() r=0 bl.length=454 2023-10-05T11:47:32.577 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.572+0000 7f31b9136880 20 zone default found 2023-10-05T11:47:32.577 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.572+0000 7f31b9136880 4 Realm: () 2023-10-05T11:47:32.577 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.572+0000 7f31b9136880 4 ZoneGroup: default (c78aa576-9d15-4e9d-b3c0-4af23a22062c) 2023-10-05T11:47:32.577 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.572+0000 7f31b9136880 4 Zone: default (dff27d1e-df33-400e-a68a-7ba586947c99) 2023-10-05T11:47:32.577 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.572+0000 7f31b9136880 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T11:47:32.578 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.572+0000 7f31b9136880 20 zonegroup default 2023-10-05T11:47:32.578 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.572+0000 7f31b9136880 20 rados->read ofs=0 len=0 2023-10-05T11:47:32.578 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.573+0000 7f31b9136880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:47:32.578 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.573+0000 7f31b9136880 20 rados->read ofs=0 len=0 2023-10-05T11:47:32.578 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.573+0000 7f31b9136880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:47:32.578 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.573+0000 7f31b9136880 20 rados->read ofs=0 len=0 2023-10-05T11:47:32.578 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.573+0000 7f31b9136880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:47:32.578 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.573+0000 7f31b9136880 20 started sync module instance, tier type = 2023-10-05T11:47:32.578 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.573+0000 7f31b9136880 20 started zone id=dff27d1e-df33-400e-a68a-7ba586947c99 (name=default) with tier type = 2023-10-05T11:47:32.584 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.581+0000 7f31b62e9640 0 -- 172.21.15.12:0/2806200816 >> [v2:172.21.15.12:6824/2171933159,v1:172.21.15.12:6825/2171933159] conn(0x55d813b3c000 msgr2=0x55d813b18580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:47:32.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.582+0000 7f31b9136880 20 add_watcher() i=0 2023-10-05T11:47:32.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.582+0000 7f31b9136880 20 add_watcher() i=1 2023-10-05T11:47:32.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.582+0000 7f31b9136880 20 add_watcher() i=2 2023-10-05T11:47:32.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.582+0000 7f31b9136880 20 add_watcher() i=3 2023-10-05T11:47:32.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.582+0000 7f31b9136880 20 add_watcher() i=4 2023-10-05T11:47:32.586 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.582+0000 7f31b9136880 20 add_watcher() i=5 2023-10-05T11:47:32.586 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.582+0000 7f31b9136880 20 add_watcher() i=6 2023-10-05T11:47:32.586 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.583+0000 7f31b9136880 20 add_watcher() i=7 2023-10-05T11:47:32.586 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.583+0000 7f31b9136880 2 all 8 watchers are set, enabling cache 2023-10-05T11:47:32.587 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.584+0000 7f319cab6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:47:32.588 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.585+0000 7f31b9136880 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T11:47:32.588 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.585+0000 7f31b9136880 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T11:47:32.629 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.626+0000 7f31982ad640 20 reqs_thread_entry: start 2023-10-05T11:47:32.630 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.626+0000 7f31b9136880 20 init_complete bucket index max shards: 11 2023-10-05T11:47:32.630 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.626+0000 7f31b9136880 20 Filter name: none 2023-10-05T11:47:32.630 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.626+0000 7f31962a9640 20 reqs_thread_entry: start 2023-10-05T11:47:32.630 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.626+0000 7f31b9136880 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2023-10-05T11:47:32.630 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.627+0000 7f31b9136880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.631 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.628+0000 7f31b9136880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:32.631 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.628+0000 7f31b9136880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.632 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.629+0000 7f31b9136880 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2023-10-05T11:47:32.633 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.630+0000 7f31b9136880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.634 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.631+0000 7f31b9136880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:32.634 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.631+0000 7f31b9136880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.635 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.632+0000 7f31b9136880 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2023-10-05T11:47:32.636 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.633+0000 7f31b9136880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.637 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.634+0000 7f31b9136880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:32.637 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.634+0000 7f31b9136880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.638 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.635+0000 7f31b9136880 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2023-10-05T11:47:32.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.636+0000 7f31b9136880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.640 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.637+0000 7f31b9136880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:32.640 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.637+0000 7f31b9136880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.641 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.638+0000 7f31b9136880 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2023-10-05T11:47:32.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.639+0000 7f31b9136880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.643 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.640+0000 7f31b9136880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:32.643 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.640+0000 7f31b9136880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.641+0000 7f31b9136880 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2023-10-05T11:47:32.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.642+0000 7f31b9136880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.643+0000 7f31b9136880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:32.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.643+0000 7f31b9136880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.647 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.644+0000 7f31b9136880 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2023-10-05T11:47:32.648 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.645+0000 7f31b9136880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.646+0000 7f31b9136880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:32.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.646+0000 7f31b9136880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.650 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.647+0000 7f31b9136880 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2023-10-05T11:47:32.651 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.648+0000 7f31b9136880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.651 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.648+0000 7f31b9136880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:32.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.649+0000 7f31b9136880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.649+0000 7f31b9136880 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2023-10-05T11:47:32.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.651+0000 7f31b9136880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.651+0000 7f31b9136880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:32.655 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.651+0000 7f31b9136880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.656 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.653+0000 7f31b9136880 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2023-10-05T11:47:32.657 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.654+0000 7f31b9136880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.657 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.654+0000 7f31b9136880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:32.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.655+0000 7f31b9136880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.656+0000 7f31b9136880 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2023-10-05T11:47:32.660 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.657+0000 7f31b9136880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.660 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.657+0000 7f31b9136880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:32.661 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.658+0000 7f31b9136880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.662 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.659+0000 7f31b9136880 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2023-10-05T11:47:32.663 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.660+0000 7f31b9136880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.661+0000 7f31b9136880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:32.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.661+0000 7f31b9136880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.665 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.662+0000 7f31b9136880 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2023-10-05T11:47:32.666 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.663+0000 7f31b9136880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.666 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.663+0000 7f31b9136880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:32.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.664+0000 7f31b9136880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.668 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.665+0000 7f31b9136880 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2023-10-05T11:47:32.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.666+0000 7f31b9136880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.667+0000 7f31b9136880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:32.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.667+0000 7f31b9136880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.668+0000 7f31b9136880 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2023-10-05T11:47:32.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.670+0000 7f31b9136880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.670+0000 7f31b9136880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:32.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.671+0000 7f31b9136880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.672+0000 7f31b9136880 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2023-10-05T11:47:32.676 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.673+0000 7f31b9136880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.676 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.673+0000 7f31b9136880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:32.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.674+0000 7f31b9136880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.675+0000 7f31b9136880 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2023-10-05T11:47:32.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.676+0000 7f31b9136880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.676+0000 7f31b9136880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:32.680 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.677+0000 7f31b9136880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.680 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.677+0000 7f31b9136880 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2023-10-05T11:47:32.682 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.679+0000 7f31b9136880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.682 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.679+0000 7f31b9136880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:32.683 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.680+0000 7f31b9136880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.681+0000 7f31b9136880 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2023-10-05T11:47:32.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.682+0000 7f31b9136880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.686 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.683+0000 7f31b9136880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:32.686 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.683+0000 7f31b9136880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.684+0000 7f31b9136880 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2023-10-05T11:47:32.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.685+0000 7f31b9136880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.685+0000 7f31b9136880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:32.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.686+0000 7f31b9136880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.690 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.687+0000 7f31b9136880 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2023-10-05T11:47:32.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.688+0000 7f31b9136880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.689+0000 7f31b9136880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:32.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.689+0000 7f31b9136880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.693 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.690+0000 7f31b9136880 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2023-10-05T11:47:32.697 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.692+0000 7f31b9136880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.697 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.692+0000 7f31b9136880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:32.698 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.692+0000 7f31b9136880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.698 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.693+0000 7f31b9136880 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2023-10-05T11:47:32.698 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.695+0000 7f31b9136880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.698 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.695+0000 7f31b9136880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:32.699 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.695+0000 7f31b9136880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.699 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.696+0000 7f31b9136880 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2023-10-05T11:47:32.701 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.698+0000 7f31b9136880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.702 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.698+0000 7f31b9136880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:32.702 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.698+0000 7f31b9136880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.702 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.699+0000 7f31b9136880 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2023-10-05T11:47:32.704 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.701+0000 7f31b9136880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.704 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.701+0000 7f31b9136880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:32.704 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.701+0000 7f31b9136880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.705 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.702+0000 7f31b9136880 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2023-10-05T11:47:32.706 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.703+0000 7f31b9136880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.707 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.704+0000 7f31b9136880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:32.707 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.704+0000 7f31b9136880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.708 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.705+0000 7f31b9136880 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2023-10-05T11:47:32.710 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.707+0000 7f31b9136880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.710 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.707+0000 7f31b9136880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:32.711 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.707+0000 7f31b9136880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.711 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.708+0000 7f31b9136880 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2023-10-05T11:47:32.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.710+0000 7f31b9136880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.710+0000 7f31b9136880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:32.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.710+0000 7f31b9136880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.711+0000 7f31b9136880 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2023-10-05T11:47:32.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.712+0000 7f31b9136880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.716 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.713+0000 7f31b9136880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:32.716 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.713+0000 7f31b9136880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.717 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.714+0000 7f31b9136880 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2023-10-05T11:47:32.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.715+0000 7f31b9136880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.716+0000 7f31b9136880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:32.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.716+0000 7f31b9136880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.717+0000 7f31b9136880 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2023-10-05T11:47:32.722 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.719+0000 7f31b9136880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.722 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.719+0000 7f31b9136880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:32.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.719+0000 7f31b9136880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.720+0000 7f31b9136880 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2023-10-05T11:47:32.725 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.722+0000 7f31b9136880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.725 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.722+0000 7f31b9136880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:47:32.726 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.723+0000 7f31b9136880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:47:32.727 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.724+0000 7f319cab6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:47:32.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.726+0000 7f31b9136880 20 remove_watcher() i=0 2023-10-05T11:47:32.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.726+0000 7f31b9136880 2 removed watcher, disabling cache 2023-10-05T11:47:32.730 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.727+0000 7f31b9136880 20 remove_watcher() i=1 2023-10-05T11:47:32.731 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.728+0000 7f31b9136880 20 remove_watcher() i=2 2023-10-05T11:47:32.732 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.729+0000 7f31b9136880 20 remove_watcher() i=3 2023-10-05T11:47:32.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.730+0000 7f31b9136880 20 remove_watcher() i=4 2023-10-05T11:47:32.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.731+0000 7f31b9136880 20 remove_watcher() i=5 2023-10-05T11:47:32.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.732+0000 7f31b9136880 20 remove_watcher() i=6 2023-10-05T11:47:32.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:47:32.733+0000 7f31b9136880 20 remove_watcher() i=7 2023-10-05T11:47:32.742 DEBUG:teuthology.orchestra.run.smithi012:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests ObjectTest 2023-10-05T11:47:33.323 INFO:teuthology.orchestra.run.smithi012.stdout:> Task :clean 2023-10-05T11:47:33.921 INFO:teuthology.orchestra.run.smithi012.stdout:> Task :compileJava 2023-10-05T11:47:33.921 INFO:teuthology.orchestra.run.smithi012.stdout:> Task :processResources 2023-10-05T11:47:33.921 INFO:teuthology.orchestra.run.smithi012.stdout:> Task :classes 2023-10-05T11:47:34.221 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:47:34.221 INFO:teuthology.orchestra.run.smithi012.stdout:> Task :compileTestJava 2023-10-05T11:47:34.221 INFO:teuthology.orchestra.run.smithi012.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2023-10-05T11:47:34.221 INFO:teuthology.orchestra.run.smithi012.stderr:Note: Recompile with -Xlint:deprecation for details. 2023-10-05T11:47:34.222 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:47:34.223 INFO:teuthology.orchestra.run.smithi012.stdout:> Task :processTestResources NO-SOURCE 2023-10-05T11:47:34.223 INFO:teuthology.orchestra.run.smithi012.stdout:> Task :testClasses 2023-10-05T11:47:36.221 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:47:36.221 INFO:teuthology.orchestra.run.smithi012.stdout:> Task :test 2023-10-05T11:47:36.221 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:47:36.221 INFO:teuthology.orchestra.run.smithi012.stdout:suite > Object tests > ObjectTest.TestObjectCopyKeyNotFound STARTED 2023-10-05T11:47:36.221 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:47:36.221 INFO:teuthology.orchestra.run.smithi012.stdout:suite > Object tests > ObjectTest.TestObjectCopyKeyNotFound PASSED 2023-10-05T11:47:36.520 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:47:36.520 INFO:teuthology.orchestra.run.smithi012.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadExpectNone STARTED 2023-10-05T11:47:36.621 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:47:36.621 INFO:teuthology.orchestra.run.smithi012.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadExpectNone PASSED 2023-10-05T11:47:36.920 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:47:36.920 INFO:teuthology.orchestra.run.smithi012.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadMd5Empty STARTED 2023-10-05T11:47:37.020 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:47:37.020 INFO:teuthology.orchestra.run.smithi012.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadMd5Empty PASSED 2023-10-05T11:47:37.420 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:47:37.420 INFO:teuthology.orchestra.run.smithi012.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadLLAPI STARTED 2023-10-05T11:47:39.520 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:47:39.520 INFO:teuthology.orchestra.run.smithi012.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadLLAPI PASSED 2023-10-05T11:47:39.920 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:47:39.920 INFO:teuthology.orchestra.run.smithi012.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadNotFoundLLAPI STARTED 2023-10-05T11:47:40.020 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:47:40.020 INFO:teuthology.orchestra.run.smithi012.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadNotFoundLLAPI PASSED 2023-10-05T11:47:40.320 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:47:40.320 INFO:teuthology.orchestra.run.smithi012.stdout:suite > Object tests > ObjectTest.testDownloadHLAPI STARTED 2023-10-05T11:47:40.520 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:47:40.520 INFO:teuthology.orchestra.run.smithi012.stdout:suite > Object tests > ObjectTest.testDownloadHLAPI PASSED 2023-10-05T11:47:40.820 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:47:40.820 INFO:teuthology.orchestra.run.smithi012.stdout:suite > Object tests > ObjectTest.testDownloadNoBucketHLAPI STARTED 2023-10-05T11:47:40.920 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:47:40.920 INFO:teuthology.orchestra.run.smithi012.stdout:suite > Object tests > ObjectTest.testDownloadNoBucketHLAPI PASSED 2023-10-05T11:47:41.020 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:47:41.020 INFO:teuthology.orchestra.run.smithi012.stdout:suite > Object tests > ObjectTest.testDownloadNoKeyHLAPI STARTED 2023-10-05T11:47:41.020 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:47:41.021 INFO:teuthology.orchestra.run.smithi012.stdout:suite > Object tests > ObjectTest.testDownloadNoKeyHLAPI PASSED 2023-10-05T11:47:41.420 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:47:41.420 INFO:teuthology.orchestra.run.smithi012.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1MB STARTED 2023-10-05T11:47:43.120 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:47:43.120 INFO:teuthology.orchestra.run.smithi012.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1MB PASSED 2023-10-05T11:47:43.520 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:47:43.520 INFO:teuthology.orchestra.run.smithi012.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1b STARTED 2023-10-05T11:47:43.620 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:47:43.620 INFO:teuthology.orchestra.run.smithi012.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1b PASSED 2023-10-05T11:47:43.920 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:47:43.920 INFO:teuthology.orchestra.run.smithi012.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1kb STARTED 2023-10-05T11:47:44.020 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:47:44.020 INFO:teuthology.orchestra.run.smithi012.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1kb PASSED 2023-10-05T11:47:44.420 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:47:44.420 INFO:teuthology.orchestra.run.smithi012.stdout:suite > Object tests > ObjectTest.testEncryptionKeyNoSSEC STARTED 2023-10-05T11:47:44.520 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:47:44.520 INFO:teuthology.orchestra.run.smithi012.stdout:suite > Object tests > ObjectTest.testEncryptionKeyNoSSEC PASSED 2023-10-05T11:47:44.820 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:47:44.820 INFO:teuthology.orchestra.run.smithi012.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECInvalidMd5 STARTED 2023-10-05T11:47:44.920 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:47:44.920 INFO:teuthology.orchestra.run.smithi012.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECInvalidMd5 PASSED 2023-10-05T11:47:45.220 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:47:45.220 INFO:teuthology.orchestra.run.smithi012.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoKey STARTED 2023-10-05T11:47:45.320 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:47:45.320 INFO:teuthology.orchestra.run.smithi012.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoKey PASSED 2023-10-05T11:47:45.720 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:47:45.720 INFO:teuthology.orchestra.run.smithi012.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoMd5 STARTED 2023-10-05T11:47:45.720 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:47:45.721 INFO:teuthology.orchestra.run.smithi012.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoMd5 PASSED 2023-10-05T11:47:46.120 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:47:46.120 INFO:teuthology.orchestra.run.smithi012.stdout:suite > Object tests > ObjectTest.testMultiObjectDelete STARTED 2023-10-05T11:47:46.320 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:47:46.320 INFO:teuthology.orchestra.run.smithi012.stdout:suite > Object tests > ObjectTest.testMultiObjectDelete PASSED 2023-10-05T11:47:46.621 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:47:46.621 INFO:teuthology.orchestra.run.smithi012.stdout:suite > Object tests > ObjectTest.testMultipartCopyHLAPIA STARTED 2023-10-05T11:47:49.520 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:47:49.520 INFO:teuthology.orchestra.run.smithi012.stdout:suite > Object tests > ObjectTest.testMultipartCopyHLAPIA PASSED 2023-10-05T11:47:50.220 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:47:50.220 INFO:teuthology.orchestra.run.smithi012.stdout:suite > Object tests > ObjectTest.testMultipartCopyMultipleSizesLLAPI STARTED 2023-10-05T11:48:20.920 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:48:20.921 INFO:teuthology.orchestra.run.smithi012.stdout:suite > Object tests > ObjectTest.testMultipartCopyMultipleSizesLLAPI PASSED 2023-10-05T11:48:21.520 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:48:21.520 INFO:teuthology.orchestra.run.smithi012.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCBucketHLAPI STARTED 2023-10-05T11:48:21.620 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:48:21.620 INFO:teuthology.orchestra.run.smithi012.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCBucketHLAPI PASSED 2023-10-05T11:48:21.920 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:48:21.920 INFO:teuthology.orchestra.run.smithi012.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCKeyHLAPI STARTED 2023-10-05T11:48:22.020 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:48:22.020 INFO:teuthology.orchestra.run.smithi012.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCKeyHLAPI PASSED 2023-10-05T11:48:22.620 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:48:22.620 INFO:teuthology.orchestra.run.smithi012.stdout:suite > Object tests > ObjectTest.testMultipartDownloadHLAPI STARTED 2023-10-05T11:48:24.720 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:48:24.720 INFO:teuthology.orchestra.run.smithi012.stdout:suite > Object tests > ObjectTest.testMultipartDownloadHLAPI PASSED 2023-10-05T11:48:25.020 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:48:25.020 INFO:teuthology.orchestra.run.smithi012.stdout:suite > Object tests > ObjectTest.testMultipartDownloadNoBucketHLAPI STARTED 2023-10-05T11:48:25.120 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:48:25.120 INFO:teuthology.orchestra.run.smithi012.stdout:suite > Object tests > ObjectTest.testMultipartDownloadNoBucketHLAPI PASSED 2023-10-05T11:48:25.220 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:48:25.220 INFO:teuthology.orchestra.run.smithi012.stdout:suite > Object tests > ObjectTest.testMultipartDownloadWithPauseHLAPI STARTED 2023-10-05T11:48:28.620 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:48:28.620 INFO:teuthology.orchestra.run.smithi012.stdout:suite > Object tests > ObjectTest.testMultipartDownloadWithPauseHLAPI PASSED 2023-10-05T11:48:28.920 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:48:28.920 INFO:teuthology.orchestra.run.smithi012.stdout:suite > Object tests > ObjectTest.testMultipartUploadHLAPIAWS4 STARTED 2023-10-05T11:48:33.520 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:48:33.520 INFO:teuthology.orchestra.run.smithi012.stdout:suite > Object tests > ObjectTest.testMultipartUploadHLAPIAWS4 PASSED 2023-10-05T11:48:34.020 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:48:34.020 INFO:teuthology.orchestra.run.smithi012.stdout:suite > Object tests > ObjectTest.testMultipartUploadIncorrectMissingPartLLAPI STARTED 2023-10-05T11:48:36.420 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:48:36.420 INFO:teuthology.orchestra.run.smithi012.stdout:suite > Object tests > ObjectTest.testMultipartUploadIncorrectMissingPartLLAPI PASSED 2023-10-05T11:48:36.820 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:48:36.820 INFO:teuthology.orchestra.run.smithi012.stdout:suite > Object tests > ObjectTest.testMultipartUploadMultipleSizesLLAPI STARTED 2023-10-05T11:48:48.820 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:48:48.820 INFO:teuthology.orchestra.run.smithi012.stdout:suite > Object tests > ObjectTest.testMultipartUploadMultipleSizesLLAPI PASSED 2023-10-05T11:48:49.120 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:48:49.120 INFO:teuthology.orchestra.run.smithi012.stdout:suite > Object tests > ObjectTest.testMultipartUploadOverwriteExistingObjectLLAPI STARTED 2023-10-05T11:48:52.220 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:48:52.220 INFO:teuthology.orchestra.run.smithi012.stdout:suite > Object tests > ObjectTest.testMultipartUploadOverwriteExistingObjectLLAPI PASSED 2023-10-05T11:48:52.520 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:48:52.520 INFO:teuthology.orchestra.run.smithi012.stdout:suite > Object tests > ObjectTest.testMultipartUploadSmallLLAPI STARTED 2023-10-05T11:48:54.720 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:48:54.720 INFO:teuthology.orchestra.run.smithi012.stdout:suite > Object tests > ObjectTest.testMultipartUploadSmallLLAPI PASSED 2023-10-05T11:48:55.120 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:48:55.120 INFO:teuthology.orchestra.run.smithi012.stdout:suite > Object tests > ObjectTest.testMultipartUploadWithPause STARTED 2023-10-05T11:48:57.120 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:48:57.120 INFO:teuthology.orchestra.run.smithi012.stdout:suite > Object tests > ObjectTest.testMultipartUploadWithPause PASSED 2023-10-05T11:49:08.920 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:49:08.920 INFO:teuthology.orchestra.run.smithi012.stdout:suite > Object tests > ObjectTest.testObjectCopyBucketNotFound STARTED 2023-10-05T11:49:09.020 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:49:09.020 INFO:teuthology.orchestra.run.smithi012.stdout:suite > Object tests > ObjectTest.testObjectCopyBucketNotFound PASSED 2023-10-05T11:49:09.120 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:49:09.120 INFO:teuthology.orchestra.run.smithi012.stdout:suite > Object tests > ObjectTest.testObjectCreateBadExpectMismatch STARTED 2023-10-05T11:49:09.320 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:49:09.320 INFO:teuthology.orchestra.run.smithi012.stdout:suite > Object tests > ObjectTest.testObjectCreateBadExpectMismatch PASSED 2023-10-05T11:49:10.520 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:49:10.520 INFO:teuthology.orchestra.run.smithi012.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5InvalidShort STARTED 2023-10-05T11:49:10.620 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:49:10.620 INFO:teuthology.orchestra.run.smithi012.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5InvalidShort PASSED 2023-10-05T11:49:11.020 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:49:11.020 INFO:teuthology.orchestra.run.smithi012.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Ivalid STARTED 2023-10-05T11:49:11.120 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:49:11.120 INFO:teuthology.orchestra.run.smithi012.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Ivalid PASSED 2023-10-05T11:49:11.420 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:49:11.420 INFO:teuthology.orchestra.run.smithi012.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5None STARTED 2023-10-05T11:49:11.520 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:49:11.520 INFO:teuthology.orchestra.run.smithi012.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5None PASSED 2023-10-05T11:49:11.820 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:49:11.820 INFO:teuthology.orchestra.run.smithi012.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Unreadable STARTED 2023-10-05T11:49:11.920 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:49:11.920 INFO:teuthology.orchestra.run.smithi012.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Unreadable PASSED 2023-10-05T11:49:12.320 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:49:12.320 INFO:teuthology.orchestra.run.smithi012.stdout:suite > Object tests > ObjectTest.testObjectHeadZeroBytes STARTED 2023-10-05T11:49:12.420 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:49:12.420 INFO:teuthology.orchestra.run.smithi012.stdout:suite > Object tests > ObjectTest.testObjectHeadZeroBytes PASSED 2023-10-05T11:49:12.720 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:49:12.720 INFO:teuthology.orchestra.run.smithi012.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterDot STARTED 2023-10-05T11:49:12.920 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:49:12.920 INFO:teuthology.orchestra.run.smithi012.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterDot PASSED 2023-10-05T11:49:13.420 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:49:13.420 INFO:teuthology.orchestra.run.smithi012.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterNotExist STARTED 2023-10-05T11:49:13.620 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:49:13.620 INFO:teuthology.orchestra.run.smithi012.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterNotExist PASSED 2023-10-05T11:49:14.020 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:49:14.020 INFO:teuthology.orchestra.run.smithi012.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterPercentage STARTED 2023-10-05T11:49:14.220 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:49:14.220 INFO:teuthology.orchestra.run.smithi012.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterPercentage PASSED 2023-10-05T11:49:14.620 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:49:14.620 INFO:teuthology.orchestra.run.smithi012.stdout:suite > Object tests > ObjectTest.testObjectListMarkerAfterList STARTED 2023-10-05T11:49:14.820 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:49:14.820 INFO:teuthology.orchestra.run.smithi012.stdout:suite > Object tests > ObjectTest.testObjectListMarkerAfterList PASSED 2023-10-05T11:49:15.220 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:49:15.220 INFO:teuthology.orchestra.run.smithi012.stdout:suite > Object tests > ObjectTest.testObjectListMarkerBeforeList STARTED 2023-10-05T11:49:15.420 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:49:15.420 INFO:teuthology.orchestra.run.smithi012.stdout:suite > Object tests > ObjectTest.testObjectListMarkerBeforeList PASSED 2023-10-05T11:49:15.920 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:49:15.920 INFO:teuthology.orchestra.run.smithi012.stdout:suite > Object tests > ObjectTest.testObjectListMarkerNotInList STARTED 2023-10-05T11:49:16.120 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:49:16.120 INFO:teuthology.orchestra.run.smithi012.stdout:suite > Object tests > ObjectTest.testObjectListMarkerNotInList PASSED 2023-10-05T11:49:16.520 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:49:16.520 INFO:teuthology.orchestra.run.smithi012.stdout:suite > Object tests > ObjectTest.testObjectListMarkerUnreadable STARTED 2023-10-05T11:49:16.720 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:49:16.720 INFO:teuthology.orchestra.run.smithi012.stdout:suite > Object tests > ObjectTest.testObjectListMarkerUnreadable PASSED 2023-10-05T11:49:17.120 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:49:17.120 INFO:teuthology.orchestra.run.smithi012.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNegative STARTED 2023-10-05T11:49:17.320 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:49:17.320 INFO:teuthology.orchestra.run.smithi012.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNegative PASSED 2023-10-05T11:49:17.820 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:49:17.820 INFO:teuthology.orchestra.run.smithi012.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNone STARTED 2023-10-05T11:49:18.020 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:49:18.020 INFO:teuthology.orchestra.run.smithi012.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNone PASSED 2023-10-05T11:49:18.421 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:49:18.421 INFO:teuthology.orchestra.run.smithi012.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysOne STARTED 2023-10-05T11:49:18.620 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:49:18.620 INFO:teuthology.orchestra.run.smithi012.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysOne PASSED 2023-10-05T11:49:19.020 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:49:19.020 INFO:teuthology.orchestra.run.smithi012.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysZero STARTED 2023-10-05T11:49:19.221 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:49:19.221 INFO:teuthology.orchestra.run.smithi012.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysZero PASSED 2023-10-05T11:49:19.720 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:49:19.720 INFO:teuthology.orchestra.run.smithi012.stdout:suite > Object tests > ObjectTest.testObjectListPrefixAlt STARTED 2023-10-05T11:49:19.920 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:49:19.920 INFO:teuthology.orchestra.run.smithi012.stdout:suite > Object tests > ObjectTest.testObjectListPrefixAlt PASSED 2023-10-05T11:49:20.320 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:49:20.320 INFO:teuthology.orchestra.run.smithi012.stdout:suite > Object tests > ObjectTest.testObjectListPrefixBasic STARTED 2023-10-05T11:49:20.420 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:49:20.420 INFO:teuthology.orchestra.run.smithi012.stdout:suite > Object tests > ObjectTest.testObjectListPrefixBasic PASSED 2023-10-05T11:49:20.820 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:49:20.820 INFO:teuthology.orchestra.run.smithi012.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterAlt STARTED 2023-10-05T11:49:21.020 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:49:21.020 INFO:teuthology.orchestra.run.smithi012.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterAlt PASSED 2023-10-05T11:49:21.520 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:49:21.520 INFO:teuthology.orchestra.run.smithi012.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterBasic STARTED 2023-10-05T11:49:21.720 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:49:21.720 INFO:teuthology.orchestra.run.smithi012.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterBasic PASSED 2023-10-05T11:49:22.120 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:49:22.120 INFO:teuthology.orchestra.run.smithi012.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterDelimiterNotExist STARTED 2023-10-05T11:49:22.320 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:49:22.320 INFO:teuthology.orchestra.run.smithi012.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterDelimiterNotExist PASSED 2023-10-05T11:49:22.721 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:49:22.721 INFO:teuthology.orchestra.run.smithi012.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixDelimiterNotExist STARTED 2023-10-05T11:49:22.920 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:49:22.920 INFO:teuthology.orchestra.run.smithi012.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixDelimiterNotExist PASSED 2023-10-05T11:49:23.420 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:49:23.420 INFO:teuthology.orchestra.run.smithi012.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixNotExist STARTED 2023-10-05T11:49:23.620 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:49:23.620 INFO:teuthology.orchestra.run.smithi012.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixNotExist PASSED 2023-10-05T11:49:24.020 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:49:24.020 INFO:teuthology.orchestra.run.smithi012.stdout:suite > Object tests > ObjectTest.testObjectListPrefixEmpty STARTED 2023-10-05T11:49:24.220 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:49:24.220 INFO:teuthology.orchestra.run.smithi012.stdout:suite > Object tests > ObjectTest.testObjectListPrefixEmpty PASSED 2023-10-05T11:49:24.620 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:49:24.620 INFO:teuthology.orchestra.run.smithi012.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNone STARTED 2023-10-05T11:49:24.820 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:49:24.820 INFO:teuthology.orchestra.run.smithi012.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNone PASSED 2023-10-05T11:49:25.220 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:49:25.220 INFO:teuthology.orchestra.run.smithi012.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNotExist STARTED 2023-10-05T11:49:25.420 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:49:25.420 INFO:teuthology.orchestra.run.smithi012.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNotExist PASSED 2023-10-05T11:49:25.820 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:49:25.820 INFO:teuthology.orchestra.run.smithi012.stdout:suite > Object tests > ObjectTest.testObjectListPrefixUnreadable STARTED 2023-10-05T11:49:25.920 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:49:25.920 INFO:teuthology.orchestra.run.smithi012.stdout:suite > Object tests > ObjectTest.testObjectListPrefixUnreadable PASSED 2023-10-05T11:49:26.320 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:49:26.320 INFO:teuthology.orchestra.run.smithi012.stdout:suite > Object tests > ObjectTest.testObjectReadFromNonExistantBucket STARTED 2023-10-05T11:49:26.420 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:49:26.420 INFO:teuthology.orchestra.run.smithi012.stdout:suite > Object tests > ObjectTest.testObjectReadFromNonExistantBucket PASSED 2023-10-05T11:49:26.821 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:49:26.821 INFO:teuthology.orchestra.run.smithi012.stdout:suite > Object tests > ObjectTest.testObjectReadNotExist STARTED 2023-10-05T11:49:26.920 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:49:26.920 INFO:teuthology.orchestra.run.smithi012.stdout:suite > Object tests > ObjectTest.testObjectReadNotExist PASSED 2023-10-05T11:49:27.220 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:49:27.220 INFO:teuthology.orchestra.run.smithi012.stdout:suite > Object tests > ObjectTest.testObjectWriteCacheControl STARTED 2023-10-05T11:49:27.320 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:49:27.320 INFO:teuthology.orchestra.run.smithi012.stdout:suite > Object tests > ObjectTest.testObjectWriteCacheControl PASSED 2023-10-05T11:49:27.620 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:49:27.620 INFO:teuthology.orchestra.run.smithi012.stdout:suite > Object tests > ObjectTest.testObjectWriteCheckEtag STARTED 2023-10-05T11:49:27.720 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:49:27.720 INFO:teuthology.orchestra.run.smithi012.stdout:suite > Object tests > ObjectTest.testObjectWriteCheckEtag PASSED 2023-10-05T11:49:28.020 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:49:28.020 INFO:teuthology.orchestra.run.smithi012.stdout:suite > Object tests > ObjectTest.testObjectWriteReadUpdateReadDelete STARTED 2023-10-05T11:49:28.320 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:49:28.320 INFO:teuthology.orchestra.run.smithi012.stdout:suite > Object tests > ObjectTest.testObjectWriteReadUpdateReadDelete PASSED 2023-10-05T11:49:28.720 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:49:28.720 INFO:teuthology.orchestra.run.smithi012.stdout:suite > Object tests > ObjectTest.testObjectWriteToNonExistantBucket STARTED 2023-10-05T11:49:28.720 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:49:28.720 INFO:teuthology.orchestra.run.smithi012.stdout:suite > Object tests > ObjectTest.testObjectWriteToNonExistantBucket PASSED 2023-10-05T11:49:28.820 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:49:28.820 INFO:teuthology.orchestra.run.smithi012.stdout:suite > Object tests > ObjectTest.testRangedSkipLeadingBytesResponseCode STARTED 2023-10-05T11:49:28.920 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:49:28.920 INFO:teuthology.orchestra.run.smithi012.stdout:suite > Object tests > ObjectTest.testRangedSkipLeadingBytesResponseCode PASSED 2023-10-05T11:49:29.320 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:49:29.320 INFO:teuthology.orchestra.run.smithi012.stdout:suite > Object tests > ObjectTest.testRangedrequestResponseCode STARTED 2023-10-05T11:49:29.420 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:49:29.420 INFO:teuthology.orchestra.run.smithi012.stdout:suite > Object tests > ObjectTest.testRangedrequestResponseCode PASSED 2023-10-05T11:49:29.820 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:49:29.820 INFO:teuthology.orchestra.run.smithi012.stdout:suite > Object tests > ObjectTest.testSSEKMSNoKey STARTED 2023-10-05T11:49:29.920 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:49:29.920 INFO:teuthology.orchestra.run.smithi012.stdout:suite > Object tests > ObjectTest.testSSEKMSNoKey PASSED 2023-10-05T11:49:30.220 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:49:30.220 INFO:teuthology.orchestra.run.smithi012.stdout:suite > Object tests > ObjectTest.testSSEKMSNotDeclared STARTED 2023-10-05T11:49:30.320 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:49:30.320 INFO:teuthology.orchestra.run.smithi012.stdout:suite > Object tests > ObjectTest.testSSEKMSNotDeclared PASSED 2023-10-05T11:49:30.722 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:49:30.722 INFO:teuthology.orchestra.run.smithi012.stdout:suite > Object tests > ObjectTest.testUploadFileHLAPIBigFile STARTED 2023-10-05T11:49:32.920 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:49:32.920 INFO:teuthology.orchestra.run.smithi012.stdout:suite > Object tests > ObjectTest.testUploadFileHLAPIBigFile PASSED 2023-10-05T11:49:33.520 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:49:33.520 INFO:teuthology.orchestra.run.smithi012.stdout:suite > Object tests > ObjectTest.testUploadFileList STARTED 2023-10-05T11:49:35.620 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:49:35.620 INFO:teuthology.orchestra.run.smithi012.stdout:suite > Object tests > ObjectTest.testUploadFileList PASSED 2023-10-05T11:49:35.996 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:49:35.997 INFO:teuthology.orchestra.run.smithi012.stdout:---------------------------------------------------------------------- 2023-10-05T11:49:35.997 INFO:teuthology.orchestra.run.smithi012.stdout:| Results: SUCCESS (70 tests, 70 successes, 0 failures, 0 skipped) | 2023-10-05T11:49:35.997 INFO:teuthology.orchestra.run.smithi012.stdout:---------------------------------------------------------------------- 2023-10-05T11:49:35.997 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:49:35.997 INFO:teuthology.orchestra.run.smithi012.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2023-10-05T11:49:35.997 INFO:teuthology.orchestra.run.smithi012.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2023-10-05T11:49:35.997 INFO:teuthology.orchestra.run.smithi012.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2023-10-05T11:49:35.997 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:49:35.997 INFO:teuthology.orchestra.run.smithi012.stdout:BUILD SUCCESSFUL in 2m 3s 2023-10-05T11:49:35.997 INFO:teuthology.orchestra.run.smithi012.stdout:5 actionable tasks: 5 executed 2023-10-05T11:49:36.001 DEBUG:teuthology.orchestra.run.smithi012:> radosgw-admin gc process --include-all 2023-10-05T11:49:36.053 INFO:teuthology.orchestra.run.smithi012.stderr:ignoring --setuser ceph since I am not root 2023-10-05T11:49:36.053 INFO:teuthology.orchestra.run.smithi012.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T11:49:36.065 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.063+0000 7fcae6f29880 20 rados->read ofs=0 len=0 2023-10-05T11:49:36.066 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.064+0000 7fcae6f29880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:49:36.067 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.064+0000 7fcae6f29880 20 realm 2023-10-05T11:49:36.067 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.064+0000 7fcae6f29880 20 rados->read ofs=0 len=0 2023-10-05T11:49:36.067 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.064+0000 7fcae6f29880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:49:36.067 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.064+0000 7fcae6f29880 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T11:49:36.067 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.064+0000 7fcae6f29880 20 rados->read ofs=0 len=0 2023-10-05T11:49:36.067 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.065+0000 7fcae6f29880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:49:36.067 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.065+0000 7fcae6f29880 20 rados->read ofs=0 len=0 2023-10-05T11:49:36.068 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.065+0000 7fcae6f29880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:49:36.068 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.065+0000 7fcae6f29880 20 rados->read ofs=0 len=0 2023-10-05T11:49:36.068 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.066+0000 7fcae6f29880 20 rados_obj.operate() r=0 bl.length=1020 2023-10-05T11:49:36.068 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.066+0000 7fcae6f29880 20 searching for the correct realm 2023-10-05T11:49:36.077 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.075+0000 7fcae4001640 0 -- 172.21.15.12:0/3132129297 >> [v2:172.21.15.12:6824/2171933159,v1:172.21.15.12:6825/2171933159] conn(0x55a42c2ce400 msgr2=0x55a42c287700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:49:36.079 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.077+0000 7fcae6f29880 20 RGWRados::pool_iterate: got zone_info.dff27d1e-df33-400e-a68a-7ba586947c99 2023-10-05T11:49:36.079 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.077+0000 7fcae6f29880 20 RGWRados::pool_iterate: got zonegroup_info.c78aa576-9d15-4e9d-b3c0-4af23a22062c 2023-10-05T11:49:36.079 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.077+0000 7fcae6f29880 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T11:49:36.080 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.077+0000 7fcae6f29880 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T11:49:36.080 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.077+0000 7fcae6f29880 20 rados->read ofs=0 len=0 2023-10-05T11:49:36.080 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.077+0000 7fcae6f29880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:49:36.080 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.077+0000 7fcae6f29880 20 rados->read ofs=0 len=0 2023-10-05T11:49:36.081 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.078+0000 7fcae6f29880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:49:36.081 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.078+0000 7fcae6f29880 20 rados->read ofs=0 len=0 2023-10-05T11:49:36.081 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.078+0000 7fcae6f29880 20 rados_obj.operate() r=0 bl.length=454 2023-10-05T11:49:36.081 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.078+0000 7fcae6f29880 20 zone default found 2023-10-05T11:49:36.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.078+0000 7fcae6f29880 4 Realm: () 2023-10-05T11:49:36.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.078+0000 7fcae6f29880 4 ZoneGroup: default (c78aa576-9d15-4e9d-b3c0-4af23a22062c) 2023-10-05T11:49:36.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.078+0000 7fcae6f29880 4 Zone: default (dff27d1e-df33-400e-a68a-7ba586947c99) 2023-10-05T11:49:36.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.078+0000 7fcae6f29880 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T11:49:36.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.078+0000 7fcae6f29880 20 zonegroup default 2023-10-05T11:49:36.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.078+0000 7fcae6f29880 20 rados->read ofs=0 len=0 2023-10-05T11:49:36.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.078+0000 7fcae6f29880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:49:36.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.078+0000 7fcae6f29880 20 rados->read ofs=0 len=0 2023-10-05T11:49:36.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.078+0000 7fcae6f29880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:49:36.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.078+0000 7fcae6f29880 20 rados->read ofs=0 len=0 2023-10-05T11:49:36.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.079+0000 7fcae6f29880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:49:36.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.079+0000 7fcae6f29880 20 started sync module instance, tier type = 2023-10-05T11:49:36.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.079+0000 7fcae6f29880 20 started zone id=dff27d1e-df33-400e-a68a-7ba586947c99 (name=default) with tier type = 2023-10-05T11:49:36.085 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.083+0000 7fcae3800640 0 -- 172.21.15.12:0/3132129297 >> [v2:172.21.15.12:6800/732466381,v1:172.21.15.12:6801/732466381] conn(0x55a42c40ac00 msgr2=0x55a42c34ab00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:49:36.090 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.088+0000 7fcae6f29880 20 add_watcher() i=0 2023-10-05T11:49:36.090 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.088+0000 7fcae6f29880 20 add_watcher() i=1 2023-10-05T11:49:36.090 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.088+0000 7fcae6f29880 20 add_watcher() i=2 2023-10-05T11:49:36.090 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.088+0000 7fcae6f29880 20 add_watcher() i=3 2023-10-05T11:49:36.090 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.088+0000 7fcae6f29880 20 add_watcher() i=4 2023-10-05T11:49:36.091 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.088+0000 7fcae6f29880 20 add_watcher() i=5 2023-10-05T11:49:36.091 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.088+0000 7fcae6f29880 20 add_watcher() i=6 2023-10-05T11:49:36.091 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.089+0000 7fcae6f29880 20 add_watcher() i=7 2023-10-05T11:49:36.091 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.089+0000 7fcae6f29880 2 all 8 watchers are set, enabling cache 2023-10-05T11:49:36.093 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.090+0000 7fcaca7ce640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:49:36.093 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.091+0000 7fcae6f29880 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T11:49:36.093 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.091+0000 7fcae6f29880 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T11:49:36.340 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.338+0000 7fcac5fc5640 20 reqs_thread_entry: start 2023-10-05T11:49:36.340 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.338+0000 7fcae6f29880 20 init_complete bucket index max shards: 11 2023-10-05T11:49:36.341 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.338+0000 7fcae6f29880 20 Filter name: none 2023-10-05T11:49:36.341 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.338+0000 7fcac3fc1640 20 reqs_thread_entry: start 2023-10-05T11:49:36.341 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.338+0000 7fcae6f29880 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2023-10-05T11:49:36.341 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.339+0000 7fcae6f29880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:49:36.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.340+0000 7fcae6f29880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:49:36.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.340+0000 7fcae6f29880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2023-10-05T11:49:36.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.340+0000 7fcae6f29880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.5568533175146200432', time=2023-10-05T13:49:16.219182+0000, chain.objs.size()=1 2023-10-05T11:49:36.343 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.340+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.105__shadow_.BtoQm2s79POkflDpUiXXwMZIovWKBSG_0 2023-10-05T11:49:36.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.342+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing entries, marker: 2023-10-05T11:49:36.346 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.344+0000 7fcae6f29880 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2023-10-05T11:49:36.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.345+0000 7fcae6f29880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:49:36.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.346+0000 7fcae6f29880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:49:36.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.346+0000 7fcae6f29880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2023-10-05T11:49:36.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.346+0000 7fcae6f29880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.8732686353315677154', time=2023-10-05T13:47:40.572641+0000, chain.objs.size()=1 2023-10-05T11:49:36.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.346+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.69__shadow_.jWQFDCehqz_Hhk6FnXq-TGBazCyPCJL_0 2023-10-05T11:49:36.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.347+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing entries, marker: 2023-10-05T11:49:36.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.349+0000 7fcae6f29880 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2023-10-05T11:49:36.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.351+0000 7fcae6f29880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:49:36.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.351+0000 7fcae6f29880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:49:36.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.351+0000 7fcae6f29880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2023-10-05T11:49:36.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.351+0000 7fcae6f29880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.3284537545968600515', time=2023-10-05T13:49:14.319466+0000, chain.objs.size()=1 2023-10-05T11:49:36.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.351+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.102__shadow_.-u14F0dHSwQWmm_r1l1MXsnDuMsqc-W_0 2023-10-05T11:49:36.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.351+0000 7fcae6f29880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.2386343552990920877', time=2023-10-05T13:49:21.159711+0000, chain.objs.size()=1 2023-10-05T11:49:36.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.351+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.113__shadow_.oTDJYqlPevAQ21bdWZ5uJAOTznl5EM5_0 2023-10-05T11:49:36.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.353+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing entries, marker: 2023-10-05T11:49:36.358 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.356+0000 7fcae6f29880 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2023-10-05T11:49:36.359 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.357+0000 7fcae6f29880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:49:36.359 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.357+0000 7fcae6f29880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:49:36.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.358+0000 7fcae6f29880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2023-10-05T11:49:36.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.358+0000 7fcae6f29880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.1491049688507704462', time=2023-10-05T13:49:13.060958+0000, chain.objs.size()=1 2023-10-05T11:49:36.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.358+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.100__shadow_.xFadX9hfO32rECQOuMeqzVQGoaf6FmM_0 2023-10-05T11:49:36.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.358+0000 7fcae6f29880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.8124446282369503044', time=2023-10-05T13:49:21.834311+0000, chain.objs.size()=1 2023-10-05T11:49:36.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.358+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.114__shadow_.mQna126a0J_0DtA2RYg4KkdqPRNO7pI_0 2023-10-05T11:49:36.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.358+0000 7fcae6f29880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.16820723444847701053', time=2023-10-05T13:49:23.051767+0000, chain.objs.size()=1 2023-10-05T11:49:36.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.358+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.116__shadow_.GMGtGxxlYgO1sbW4kPc05-A0w6m8GOM_0 2023-10-05T11:49:36.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.360+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing entries, marker: 2023-10-05T11:49:36.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.362+0000 7fcae6f29880 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2023-10-05T11:49:36.365 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.363+0000 7fcae6f29880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:49:36.366 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.364+0000 7fcae6f29880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:49:36.367 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.364+0000 7fcae6f29880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2023-10-05T11:49:36.367 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.364+0000 7fcae6f29880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.4542260457685856424', time=2023-10-05T13:48:08.176993+0000, chain.objs.size()=9 2023-10-05T11:49:36.367 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.364+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.82__multipart_key1.2~nOKu7GwEblZQ0CPFL-DlUKkAIzLNtUZ.1 2023-10-05T11:49:36.367 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.364+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.82__shadow_key1.2~nOKu7GwEblZQ0CPFL-DlUKkAIzLNtUZ.1_1 2023-10-05T11:49:36.367 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.364+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.82__multipart_key1.2~nOKu7GwEblZQ0CPFL-DlUKkAIzLNtUZ.2 2023-10-05T11:49:36.367 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.364+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.82__shadow_key1.2~nOKu7GwEblZQ0CPFL-DlUKkAIzLNtUZ.2_1 2023-10-05T11:49:36.367 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.364+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.82__multipart_key1.2~nOKu7GwEblZQ0CPFL-DlUKkAIzLNtUZ.3 2023-10-05T11:49:36.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.364+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.82__shadow_key1.2~nOKu7GwEblZQ0CPFL-DlUKkAIzLNtUZ.3_1 2023-10-05T11:49:36.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.364+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.82__multipart_key1.2~nOKu7GwEblZQ0CPFL-DlUKkAIzLNtUZ.4 2023-10-05T11:49:36.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.364+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.82__shadow_key1.2~nOKu7GwEblZQ0CPFL-DlUKkAIzLNtUZ.4_1 2023-10-05T11:49:36.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.364+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.82__multipart_key1.2~nOKu7GwEblZQ0CPFL-DlUKkAIzLNtUZ.5 2023-10-05T11:49:36.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.364+0000 7fcae6f29880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.7773040642726445492', time=2023-10-05T13:48:33.666355+0000, chain.objs.size()=1 2023-10-05T11:49:36.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.364+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.88__shadow_.tsQUH7OsYFiBsy0f79Nbj9zoEp9EFwC_0 2023-10-05T11:49:36.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.364+0000 7fcae6f29880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.15375905429565080601', time=2023-10-05T13:48:44.780797+0000, chain.objs.size()=9 2023-10-05T11:49:36.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.364+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.90__multipart_key1.2~aPelfXCsZk1tDHlwDPHLMjalWtkxjOS.1 2023-10-05T11:49:36.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.364+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.90__shadow_key1.2~aPelfXCsZk1tDHlwDPHLMjalWtkxjOS.1_1 2023-10-05T11:49:36.370 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.368+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.90__multipart_key1.2~aPelfXCsZk1tDHlwDPHLMjalWtkxjOS.2 2023-10-05T11:49:36.374 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.371+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.90__shadow_key1.2~aPelfXCsZk1tDHlwDPHLMjalWtkxjOS.2_1 2023-10-05T11:49:36.374 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.371+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.90__multipart_key1.2~aPelfXCsZk1tDHlwDPHLMjalWtkxjOS.3 2023-10-05T11:49:36.374 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.371+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.90__shadow_key1.2~aPelfXCsZk1tDHlwDPHLMjalWtkxjOS.3_1 2023-10-05T11:49:36.375 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.371+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.90__multipart_key1.2~aPelfXCsZk1tDHlwDPHLMjalWtkxjOS.4 2023-10-05T11:49:36.375 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.371+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.90__shadow_key1.2~aPelfXCsZk1tDHlwDPHLMjalWtkxjOS.4_1 2023-10-05T11:49:36.375 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.371+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.90__multipart_key1.2~aPelfXCsZk1tDHlwDPHLMjalWtkxjOS.5 2023-10-05T11:49:36.375 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.371+0000 7fcae6f29880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.17259707490185146875', time=2023-10-05T13:49:17.488240+0000, chain.objs.size()=1 2023-10-05T11:49:36.375 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.371+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.107__shadow_.H05bLKTr7Pl_zlm3t3t79FfRujFn_BK_0 2023-10-05T11:49:36.375 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.371+0000 7fcae6f29880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.18225482160625125716', time=2023-10-05T13:49:18.772450+0000, chain.objs.size()=1 2023-10-05T11:49:36.375 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.371+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.109__shadow_.nlDtUd3qcRNwxNpRFksVF-o-RkB6uyA_0 2023-10-05T11:49:36.379 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.376+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing entries, marker: 2023-10-05T11:49:36.381 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.379+0000 7fcae6f29880 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2023-10-05T11:49:36.382 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.380+0000 7fcae6f29880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:49:36.383 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.381+0000 7fcae6f29880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:49:36.384 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.381+0000 7fcae6f29880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2023-10-05T11:49:36.384 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.381+0000 7fcae6f29880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.16388012883993972051', time=2023-10-05T13:48:17.871539+0000, chain.objs.size()=7 2023-10-05T11:49:36.384 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.381+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.82__multipart_key1.2~J97L1Sp4byt7DmAL0_f673_PjQH3r0X.1 2023-10-05T11:49:36.384 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.381+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.82__shadow_key1.2~J97L1Sp4byt7DmAL0_f673_PjQH3r0X.1_1 2023-10-05T11:49:36.384 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.381+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.82__shadow_key1.2~J97L1Sp4byt7DmAL0_f673_PjQH3r0X.1_2 2023-10-05T11:49:36.384 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.381+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.82__multipart_key1.2~J97L1Sp4byt7DmAL0_f673_PjQH3r0X.2 2023-10-05T11:49:36.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.381+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.82__shadow_key1.2~J97L1Sp4byt7DmAL0_f673_PjQH3r0X.2_1 2023-10-05T11:49:36.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.381+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.82__shadow_key1.2~J97L1Sp4byt7DmAL0_f673_PjQH3r0X.2_2 2023-10-05T11:49:36.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.381+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.82__multipart_key1.2~J97L1Sp4byt7DmAL0_f673_PjQH3r0X.3 2023-10-05T11:49:36.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.381+0000 7fcae6f29880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.5889579794158372288', time=2023-10-05T13:49:14.974579+0000, chain.objs.size()=1 2023-10-05T11:49:36.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.381+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.103__shadow_.OiMTxnsCDZZbLWTRKjKjB2QW7qbGfGn_0 2023-10-05T11:49:36.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.381+0000 7fcae6f29880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.6229551709741360935', time=2023-10-05T13:49:19.366068+0000, chain.objs.size()=1 2023-10-05T11:49:36.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.381+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.110__shadow_.ztlo9Ldo_FXz-rlsH1YQHRZmrZ6oXS4_0 2023-10-05T11:49:36.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.382+0000 7fcae6f29880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.13153364807969743510', time=2023-10-05T13:49:20.573902+0000, chain.objs.size()=1 2023-10-05T11:49:36.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.382+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.112__shadow_.k5qQ9kX5zitjnHwmfSkGN8kAZ2CH3Sn_0 2023-10-05T11:49:36.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.387+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing entries, marker: 2023-10-05T11:49:36.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.389+0000 7fcae6f29880 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2023-10-05T11:49:36.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.390+0000 7fcae6f29880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:49:36.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.390+0000 7fcae6f29880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:49:36.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.391+0000 7fcae6f29880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2023-10-05T11:49:36.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.391+0000 7fcae6f29880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.14624892826145796752', time=2023-10-05T13:48:52.234131+0000, chain.objs.size()=9 2023-10-05T11:49:36.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.391+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.91__multipart_key1.2~tgrpeffl_NXVe5gS8WLkK4DzcG8_sYG.1 2023-10-05T11:49:36.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.391+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.91__shadow_key1.2~tgrpeffl_NXVe5gS8WLkK4DzcG8_sYG.1_1 2023-10-05T11:49:36.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.391+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.91__multipart_key1.2~tgrpeffl_NXVe5gS8WLkK4DzcG8_sYG.2 2023-10-05T11:49:36.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.391+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.91__shadow_key1.2~tgrpeffl_NXVe5gS8WLkK4DzcG8_sYG.2_1 2023-10-05T11:49:36.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.391+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.91__multipart_key1.2~tgrpeffl_NXVe5gS8WLkK4DzcG8_sYG.3 2023-10-05T11:49:36.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.391+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.91__shadow_key1.2~tgrpeffl_NXVe5gS8WLkK4DzcG8_sYG.3_1 2023-10-05T11:49:36.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.391+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.91__multipart_key1.2~tgrpeffl_NXVe5gS8WLkK4DzcG8_sYG.4 2023-10-05T11:49:36.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.391+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.91__shadow_key1.2~tgrpeffl_NXVe5gS8WLkK4DzcG8_sYG.4_1 2023-10-05T11:49:36.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.391+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.91__multipart_key1.2~tgrpeffl_NXVe5gS8WLkK4DzcG8_sYG.5 2023-10-05T11:49:36.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.391+0000 7fcae6f29880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.10252421959883737348', time=2023-10-05T13:49:16.242215+0000, chain.objs.size()=1 2023-10-05T11:49:36.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.391+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.105__shadow_.GYiJ6naGdSGl7mwVg7R-HJVp-kIUOEF_0 2023-10-05T11:49:36.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.391+0000 7fcae6f29880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.3609023363333948560', time=2023-10-05T13:49:25.467920+0000, chain.objs.size()=1 2023-10-05T11:49:36.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.391+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.120__shadow_.VUVao629FvuwY1BD8RejBLr8GhIAENs_0 2023-10-05T11:49:36.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.397+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing entries, marker: 2023-10-05T11:49:36.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.399+0000 7fcae6f29880 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2023-10-05T11:49:36.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.400+0000 7fcae6f29880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:49:36.404 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.400+0000 7fcae6f29880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:49:36.404 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.401+0000 7fcae6f29880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2023-10-05T11:49:36.404 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.401+0000 7fcae6f29880 20 garbage collection: RGWGC::process iterating over entry tag='2~VXIeUdf0K08MNFCkQ4g278ECMwXr9kB', time=2023-10-05T13:47:39.481758+0000, chain.objs.size()=9 2023-10-05T11:49:36.404 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.401+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.67__multipart_key1.2~VXIeUdf0K08MNFCkQ4g278ECMwXr9kB.1 2023-10-05T11:49:36.404 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.401+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.67__shadow_key1.2~VXIeUdf0K08MNFCkQ4g278ECMwXr9kB.1_1 2023-10-05T11:49:36.404 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.401+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.67__multipart_key1.2~VXIeUdf0K08MNFCkQ4g278ECMwXr9kB.2 2023-10-05T11:49:36.404 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.401+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.67__shadow_key1.2~VXIeUdf0K08MNFCkQ4g278ECMwXr9kB.2_1 2023-10-05T11:49:36.404 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.401+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.67__multipart_key1.2~VXIeUdf0K08MNFCkQ4g278ECMwXr9kB.3 2023-10-05T11:49:36.404 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.401+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.67__shadow_key1.2~VXIeUdf0K08MNFCkQ4g278ECMwXr9kB.3_1 2023-10-05T11:49:36.404 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.401+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.67__multipart_key1.2~VXIeUdf0K08MNFCkQ4g278ECMwXr9kB.4 2023-10-05T11:49:36.404 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.401+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.67__shadow_key1.2~VXIeUdf0K08MNFCkQ4g278ECMwXr9kB.4_1 2023-10-05T11:49:36.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.401+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.67__multipart_key1.2~VXIeUdf0K08MNFCkQ4g278ECMwXr9kB.5 2023-10-05T11:49:36.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.401+0000 7fcae6f29880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.13245845149738479766', time=2023-10-05T13:47:46.141423+0000, chain.objs.size()=1 2023-10-05T11:49:36.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.401+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.78__shadow_.YSIhnU-prPHH9SBgM6p0il56GbXcmyH_0 2023-10-05T11:49:36.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.401+0000 7fcae6f29880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.432429609811947565', time=2023-10-05T13:49:13.083817+0000, chain.objs.size()=1 2023-10-05T11:49:36.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.401+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.100__shadow_.-371UojaxnFqDWaTmf13DsaE4QQC72Q_0 2023-10-05T11:49:36.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.401+0000 7fcae6f29880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.12796921641221252811', time=2023-10-05T13:49:24.863181+0000, chain.objs.size()=1 2023-10-05T11:49:36.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.401+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.119__shadow_.fPdt6UG_gnuxBgGj6n0TmtM0tneQBFM_0 2023-10-05T11:49:36.410 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.408+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing entries, marker: 2023-10-05T11:49:36.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.410+0000 7fcae6f29880 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2023-10-05T11:49:36.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.411+0000 7fcae6f29880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:49:36.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.412+0000 7fcae6f29880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:49:36.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.412+0000 7fcae6f29880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2023-10-05T11:49:36.415 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.412+0000 7fcae6f29880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.17178675314417025949', time=2023-10-05T13:49:14.342821+0000, chain.objs.size()=1 2023-10-05T11:49:36.415 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.412+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.102__shadow_.Le9EVXX_TETJihAGzoCAXlE_K8H6qwp_0 2023-10-05T11:49:36.415 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.412+0000 7fcae6f29880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.14991680313596987215', time=2023-10-05T13:49:14.951400+0000, chain.objs.size()=1 2023-10-05T11:49:36.415 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.412+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.103__shadow_.wJvT7yXCfJR845OT7D4G4h_H8kiszQ3_0 2023-10-05T11:49:36.415 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.412+0000 7fcae6f29880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.17564369696507651446', time=2023-10-05T13:49:17.440483+0000, chain.objs.size()=1 2023-10-05T11:49:36.415 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.412+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.107__shadow_.G0XXmNYQKaHtykQnbZ9uhEiPrtNQFYF_0 2023-10-05T11:49:36.415 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.412+0000 7fcae6f29880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.567568929234414544', time=2023-10-05T13:49:21.788055+0000, chain.objs.size()=1 2023-10-05T11:49:36.415 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.412+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.114__shadow_.V5eiESnFlT1soSJG-ogDIjcgN2Opfc9_0 2023-10-05T11:49:36.415 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.412+0000 7fcae6f29880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.6860759615863848793', time=2023-10-05T13:49:21.810830+0000, chain.objs.size()=1 2023-10-05T11:49:36.415 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.412+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.114__shadow_.1dkgAPGCfn1IET3kb_LGt4kIw8thQYd_0 2023-10-05T11:49:36.417 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.415+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing entries, marker: 2023-10-05T11:49:36.419 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.417+0000 7fcae6f29880 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2023-10-05T11:49:36.421 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.419+0000 7fcae6f29880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:49:36.421 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.419+0000 7fcae6f29880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:49:36.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.420+0000 7fcae6f29880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2023-10-05T11:49:36.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.420+0000 7fcae6f29880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.9478400510471988810', time=2023-10-05T13:49:15.602536+0000, chain.objs.size()=1 2023-10-05T11:49:36.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.420+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.104__shadow_.4ukeryed8wSRwkJFftgaJmigdwavu-T_0 2023-10-05T11:49:36.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.420+0000 7fcae6f29880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.17188378513891935316', time=2023-10-05T13:49:18.146747+0000, chain.objs.size()=1 2023-10-05T11:49:36.423 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.420+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.108__shadow_.vDkOFhRbod2j9JF85FNyLgsaXXDoBGt_0 2023-10-05T11:49:36.423 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.420+0000 7fcae6f29880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.14962397244380633068', time=2023-10-05T13:49:21.207584+0000, chain.objs.size()=1 2023-10-05T11:49:36.423 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.420+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.113__shadow_.NZNGs3lKI2eK5jN2t_OQZlo_CyoC0mK_0 2023-10-05T11:49:36.423 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.420+0000 7fcae6f29880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.11988076846304131990', time=2023-10-05T13:49:27.757079+0000, chain.objs.size()=1 2023-10-05T11:49:36.423 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.420+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.125__shadow_.3g3RoAlZv6J0JBN-7dcIdeWMqwDvBcN_0 2023-10-05T11:49:36.423 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.420+0000 7fcae6f29880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.15454173042099868447', time=2023-10-05T13:49:28.145826+0000, chain.objs.size()=1 2023-10-05T11:49:36.423 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.420+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.126__shadow_.FG6KueYFtr5dA8wgiTT40GLQGYs5zc1_0 2023-10-05T11:49:36.424 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.422+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing entries, marker: 2023-10-05T11:49:36.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.425+0000 7fcae6f29880 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2023-10-05T11:49:36.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.426+0000 7fcae6f29880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:49:36.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.426+0000 7fcae6f29880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:49:36.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.426+0000 7fcae6f29880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2023-10-05T11:49:36.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.426+0000 7fcae6f29880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.4848510225193363418', time=2023-10-05T13:48:24.770750+0000, chain.objs.size()=9 2023-10-05T11:49:36.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.426+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.86__multipart_key1.2~1BXjc0F_cr9LdOT0My4NeVKvx3_KvWw.1 2023-10-05T11:49:36.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.426+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.86__shadow_key1.2~1BXjc0F_cr9LdOT0My4NeVKvx3_KvWw.1_1 2023-10-05T11:49:36.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.426+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.86__multipart_key1.2~1BXjc0F_cr9LdOT0My4NeVKvx3_KvWw.2 2023-10-05T11:49:36.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.426+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.86__shadow_key1.2~1BXjc0F_cr9LdOT0My4NeVKvx3_KvWw.2_1 2023-10-05T11:49:36.430 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.426+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.86__multipart_key1.2~1BXjc0F_cr9LdOT0My4NeVKvx3_KvWw.3 2023-10-05T11:49:36.430 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.426+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.86__shadow_key1.2~1BXjc0F_cr9LdOT0My4NeVKvx3_KvWw.3_1 2023-10-05T11:49:36.430 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.426+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.86__multipart_key1.2~1BXjc0F_cr9LdOT0My4NeVKvx3_KvWw.4 2023-10-05T11:49:36.430 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.426+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.86__shadow_key1.2~1BXjc0F_cr9LdOT0My4NeVKvx3_KvWw.4_1 2023-10-05T11:49:36.430 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.426+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.86__multipart_key1.2~1BXjc0F_cr9LdOT0My4NeVKvx3_KvWw.5 2023-10-05T11:49:36.430 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.426+0000 7fcae6f29880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.13737481767953356215', time=2023-10-05T13:49:21.765029+0000, chain.objs.size()=1 2023-10-05T11:49:36.430 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.426+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.114__shadow_.TQgJ1uDWJYO0clmDIrm0JOufEZTqk8o_0 2023-10-05T11:49:36.434 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.432+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing entries, marker: 2023-10-05T11:49:36.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.434+0000 7fcae6f29880 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2023-10-05T11:49:36.438 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.436+0000 7fcae6f29880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:49:36.438 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.436+0000 7fcae6f29880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:49:36.439 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.437+0000 7fcae6f29880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2023-10-05T11:49:36.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.437+0000 7fcae6f29880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.5209142465240761529', time=2023-10-05T13:48:20.971371+0000, chain.objs.size()=6 2023-10-05T11:49:36.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.437+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.81__shadow_.42MwlIjHTlXcMB4z1gHexBLWNRCCxp9_0 2023-10-05T11:49:36.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.437+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.81__shadow_.42MwlIjHTlXcMB4z1gHexBLWNRCCxp9_1 2023-10-05T11:49:36.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.437+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.81__shadow_.42MwlIjHTlXcMB4z1gHexBLWNRCCxp9_2 2023-10-05T11:49:36.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.437+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.81__shadow_.42MwlIjHTlXcMB4z1gHexBLWNRCCxp9_3 2023-10-05T11:49:36.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.437+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.81__shadow_.42MwlIjHTlXcMB4z1gHexBLWNRCCxp9_4 2023-10-05T11:49:36.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.437+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.81__shadow_.42MwlIjHTlXcMB4z1gHexBLWNRCCxp9_5 2023-10-05T11:49:36.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.437+0000 7fcae6f29880 20 garbage collection: RGWGC::process iterating over entry tag='2~YlZ3K6qTZgDOvSQlnt4Y7BCd1RHVgnz', time=2023-10-05T13:48:36.626816+0000, chain.objs.size()=9 2023-10-05T11:49:36.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.437+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.89__multipart_key1.2~YlZ3K6qTZgDOvSQlnt4Y7BCd1RHVgnz.7 2023-10-05T11:49:36.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.437+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.89__shadow_key1.2~YlZ3K6qTZgDOvSQlnt4Y7BCd1RHVgnz.7_1 2023-10-05T11:49:36.441 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.437+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.89__multipart_key1.2~YlZ3K6qTZgDOvSQlnt4Y7BCd1RHVgnz.8 2023-10-05T11:49:36.441 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.437+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.89__shadow_key1.2~YlZ3K6qTZgDOvSQlnt4Y7BCd1RHVgnz.8_1 2023-10-05T11:49:36.441 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.437+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.89__multipart_key1.2~YlZ3K6qTZgDOvSQlnt4Y7BCd1RHVgnz.9 2023-10-05T11:49:36.441 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.437+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.89__shadow_key1.2~YlZ3K6qTZgDOvSQlnt4Y7BCd1RHVgnz.9_1 2023-10-05T11:49:36.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.441+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.89__multipart_key1.2~YlZ3K6qTZgDOvSQlnt4Y7BCd1RHVgnz.10 2023-10-05T11:49:36.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.441+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.89__shadow_key1.2~YlZ3K6qTZgDOvSQlnt4Y7BCd1RHVgnz.10_1 2023-10-05T11:49:36.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.441+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.89__multipart_key1.2~YlZ3K6qTZgDOvSQlnt4Y7BCd1RHVgnz.11 2023-10-05T11:49:36.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.441+0000 7fcae6f29880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.16095279125705928513', time=2023-10-05T13:49:13.666155+0000, chain.objs.size()=1 2023-10-05T11:49:36.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.441+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.101__shadow_.S4cv7de2BtZW71j1fz8f0pFBZU-Pm3v_0 2023-10-05T11:49:36.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.441+0000 7fcae6f29880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.15242918747416831646', time=2023-10-05T13:49:18.726521+0000, chain.objs.size()=1 2023-10-05T11:49:36.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.441+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.109__shadow_.iBaRMMKK1TJoT-vHIKUNETsUV63oerV_0 2023-10-05T11:49:36.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.441+0000 7fcae6f29880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.1599698166047969114', time=2023-10-05T13:49:22.417026+0000, chain.objs.size()=1 2023-10-05T11:49:36.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.441+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.115__shadow_.Z548SdVxlT6WB52ddKnzh8cMavC1lr2_0 2023-10-05T11:49:36.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.448+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing entries, marker: 2023-10-05T11:49:36.452 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.450+0000 7fcae6f29880 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2023-10-05T11:49:36.453 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.451+0000 7fcae6f29880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:49:36.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.452+0000 7fcae6f29880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:49:36.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.452+0000 7fcae6f29880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2023-10-05T11:49:36.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.452+0000 7fcae6f29880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.17229477772704053568', time=2023-10-05T13:47:36.668188+0000, chain.objs.size()=1 2023-10-05T11:49:36.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.452+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.65__shadow_.VVf6Hgsm-2tiw5N9e-925M5uKoDbp2B_0 2023-10-05T11:49:36.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.452+0000 7fcae6f29880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.3934513141456159041', time=2023-10-05T13:49:21.135492+0000, chain.objs.size()=1 2023-10-05T11:49:36.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.452+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.113__shadow_.z1Onb091OjKileNqM-hC19TyqlMdOdy_0 2023-10-05T11:49:36.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.452+0000 7fcae6f29880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.7932622447231360389', time=2023-10-05T13:49:22.440132+0000, chain.objs.size()=1 2023-10-05T11:49:36.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.452+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.115__shadow_.dk15xGD_rDNjOvpveF3lWPfEOcSl5kc_0 2023-10-05T11:49:36.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.452+0000 7fcae6f29880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.7174788703762802048', time=2023-10-05T13:49:23.074468+0000, chain.objs.size()=1 2023-10-05T11:49:36.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.452+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.116__shadow_.gD5hoLjW3c-hmEL7bRdZZZeLUg8ZVnh_0 2023-10-05T11:49:36.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.452+0000 7fcae6f29880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.10958646785630117556', time=2023-10-05T13:49:23.717591+0000, chain.objs.size()=1 2023-10-05T11:49:36.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.452+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.117__shadow_.08865OgiTosN_mYA59j74-ribgKkTHK_0 2023-10-05T11:49:36.457 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.455+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing entries, marker: 2023-10-05T11:49:36.461 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.457+0000 7fcae6f29880 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2023-10-05T11:49:36.462 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.459+0000 7fcae6f29880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:49:36.462 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.459+0000 7fcae6f29880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:49:36.462 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.459+0000 7fcae6f29880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2023-10-05T11:49:36.462 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.459+0000 7fcae6f29880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.18019960654909233042', time=2023-10-05T13:48:33.614188+0000, chain.objs.size()=1 2023-10-05T11:49:36.462 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.459+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.88__shadow_.9SSlnhdKyuG9oMu-uQKpgMOFkApGxUV_0 2023-10-05T11:49:36.462 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.459+0000 7fcae6f29880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.2895682053948476417', time=2023-10-05T13:49:26.083555+0000, chain.objs.size()=1 2023-10-05T11:49:36.462 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.459+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.121__shadow_.GPLG8ghCNMZI958kuH_AhtFIuH1uG53_0 2023-10-05T11:49:36.463 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.461+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing entries, marker: 2023-10-05T11:49:36.465 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.463+0000 7fcae6f29880 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2023-10-05T11:49:36.467 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.465+0000 7fcae6f29880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:49:36.467 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.465+0000 7fcae6f29880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:49:36.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.465+0000 7fcae6f29880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2023-10-05T11:49:36.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.465+0000 7fcae6f29880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.16267577137246527039', time=2023-10-05T13:48:46.821663+0000, chain.objs.size()=7 2023-10-05T11:49:36.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.465+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.90__multipart_key1.2~weTVE2ldc1oOsrvMQuZND15tgBTHVcb.1 2023-10-05T11:49:36.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.465+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.90__shadow_key1.2~weTVE2ldc1oOsrvMQuZND15tgBTHVcb.1_1 2023-10-05T11:49:36.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.465+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.90__shadow_key1.2~weTVE2ldc1oOsrvMQuZND15tgBTHVcb.1_2 2023-10-05T11:49:36.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.465+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.90__multipart_key1.2~weTVE2ldc1oOsrvMQuZND15tgBTHVcb.2 2023-10-05T11:49:36.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.465+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.90__shadow_key1.2~weTVE2ldc1oOsrvMQuZND15tgBTHVcb.2_1 2023-10-05T11:49:36.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.465+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.90__shadow_key1.2~weTVE2ldc1oOsrvMQuZND15tgBTHVcb.2_2 2023-10-05T11:49:36.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.465+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.90__multipart_key1.2~weTVE2ldc1oOsrvMQuZND15tgBTHVcb.3 2023-10-05T11:49:36.470 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.466+0000 7fcae6f29880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.9637586565003406249', time=2023-10-05T13:49:23.741538+0000, chain.objs.size()=1 2023-10-05T11:49:36.470 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.466+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.117__shadow_.jO2Xl-9SA7Y7NpKXNaBCdZ93XaEeQdO_0 2023-10-05T11:49:36.470 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.466+0000 7fcae6f29880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.2333654023778211379', time=2023-10-05T13:49:35.699145+0000, chain.objs.size()=9 2023-10-05T11:49:36.470 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.466+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.132__multipart_key1/data/file.mpg.2~MZ5DGqN1o_dRRzI_8c5vkCgTAYz7E0f.1 2023-10-05T11:49:36.470 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.466+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.132__shadow_key1/data/file.mpg.2~MZ5DGqN1o_dRRzI_8c5vkCgTAYz7E0f.1_1 2023-10-05T11:49:36.471 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.466+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.132__multipart_key1/data/file.mpg.2~MZ5DGqN1o_dRRzI_8c5vkCgTAYz7E0f.2 2023-10-05T11:49:36.471 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.466+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.132__shadow_key1/data/file.mpg.2~MZ5DGqN1o_dRRzI_8c5vkCgTAYz7E0f.2_1 2023-10-05T11:49:36.472 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.469+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.132__multipart_key1/data/file.mpg.2~MZ5DGqN1o_dRRzI_8c5vkCgTAYz7E0f.3 2023-10-05T11:49:36.472 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.469+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.132__shadow_key1/data/file.mpg.2~MZ5DGqN1o_dRRzI_8c5vkCgTAYz7E0f.3_1 2023-10-05T11:49:36.472 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.469+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.132__multipart_key1/data/file.mpg.2~MZ5DGqN1o_dRRzI_8c5vkCgTAYz7E0f.4 2023-10-05T11:49:36.473 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.470+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.132__shadow_key1/data/file.mpg.2~MZ5DGqN1o_dRRzI_8c5vkCgTAYz7E0f.4_1 2023-10-05T11:49:36.473 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.470+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.132__multipart_key1/data/file.mpg.2~MZ5DGqN1o_dRRzI_8c5vkCgTAYz7E0f.5 2023-10-05T11:49:36.477 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.475+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing entries, marker: 2023-10-05T11:49:36.480 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.477+0000 7fcae6f29880 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2023-10-05T11:49:36.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.479+0000 7fcae6f29880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:49:36.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.479+0000 7fcae6f29880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:49:36.482 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.480+0000 7fcae6f29880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2023-10-05T11:49:36.482 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.480+0000 7fcae6f29880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.18265027593336874529', time=2023-10-05T13:47:44.086478+0000, chain.objs.size()=1 2023-10-05T11:49:36.483 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.480+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.73__shadow_.XpunBW0pxlZSQGd_Rdge8h8Rpwpd1H__0 2023-10-05T11:49:36.483 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.480+0000 7fcae6f29880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.10798810077116398853', time=2023-10-05T13:49:09.771605+0000, chain.objs.size()=1 2023-10-05T11:49:36.483 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.480+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.94__shadow_.Txw7TKtoCQphEgIDI-hG8vGogw4yvFJ_0 2023-10-05T11:49:36.483 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.480+0000 7fcae6f29880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.14294487535451408031', time=2023-10-05T13:49:18.099921+0000, chain.objs.size()=1 2023-10-05T11:49:36.483 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.480+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.108__shadow_.XOgOquP1JnpnfMjVv5JYdYQ-bjsa5dA_0 2023-10-05T11:49:36.483 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.480+0000 7fcae6f29880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.5263069371329554133', time=2023-10-05T13:49:18.749110+0000, chain.objs.size()=1 2023-10-05T11:49:36.483 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.480+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.109__shadow_.MSXgYW1Ped2N_DDSxz-arQixch-lYfI_0 2023-10-05T11:49:36.483 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.480+0000 7fcae6f29880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.4658800801821375387', time=2023-10-05T13:49:23.693542+0000, chain.objs.size()=1 2023-10-05T11:49:36.483 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.480+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.117__shadow_.bfNPN9oaLQG62p1HaJf-nzJ2kPOgQS0_0 2023-10-05T11:49:36.485 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.483+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing entries, marker: 2023-10-05T11:49:36.487 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.485+0000 7fcae6f29880 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2023-10-05T11:49:36.488 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.486+0000 7fcae6f29880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:49:36.490 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.486+0000 7fcae6f29880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:49:36.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.487+0000 7fcae6f29880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=8, truncated=0, next_marker='' 2023-10-05T11:49:36.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.487+0000 7fcae6f29880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.4554567102025112093', time=2023-10-05T13:49:13.713114+0000, chain.objs.size()=1 2023-10-05T11:49:36.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.487+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.101__shadow_._mv7AJ9CLbobRc8x9CnIoP1BLZYhz5Q_0 2023-10-05T11:49:36.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.487+0000 7fcae6f29880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.7063306386772057377', time=2023-10-05T13:49:17.464261+0000, chain.objs.size()=1 2023-10-05T11:49:36.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.487+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.107__shadow_.5PX5_55opCFkPgLBqg9ZrJbBDlYvBE0_0 2023-10-05T11:49:36.492 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.487+0000 7fcae6f29880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.1418304519418156234', time=2023-10-05T13:49:19.389572+0000, chain.objs.size()=1 2023-10-05T11:49:36.492 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.487+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.110__shadow_.yfCbtDlYpB85PoX9tN8Volh_8XiFh5-_0 2023-10-05T11:49:36.492 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.487+0000 7fcae6f29880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.9698344974978693135', time=2023-10-05T13:49:19.412832+0000, chain.objs.size()=1 2023-10-05T11:49:36.492 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.487+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.110__shadow_.qSBlhTSG8N2GK_Cqw2Ye4wHmvLwPApx_0 2023-10-05T11:49:36.492 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.487+0000 7fcae6f29880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.7873046388728066196', time=2023-10-05T13:49:20.526751+0000, chain.objs.size()=1 2023-10-05T11:49:36.492 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.487+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.112__shadow_.a2f5VM8n6hIIPhXly4EnpaYIDA-Wf6s_0 2023-10-05T11:49:36.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.487+0000 7fcae6f29880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.14166165228582361684', time=2023-10-05T13:49:23.666553+0000, chain.objs.size()=1 2023-10-05T11:49:36.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.487+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.117__shadow_.QH7ihEhxAL_nHVVzNMyOPDZ7fR9H8Oq_0 2023-10-05T11:49:36.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.487+0000 7fcae6f29880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.7721550964966903378', time=2023-10-05T13:49:25.491292+0000, chain.objs.size()=1 2023-10-05T11:49:36.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.487+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.120__shadow_.q266k3FO3ZGp00R_fXU7uuBQrdDLYdR_0 2023-10-05T11:49:36.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.487+0000 7fcae6f29880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.17945650666664513274', time=2023-10-05T13:49:27.339079+0000, chain.objs.size()=1 2023-10-05T11:49:36.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.487+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.124__shadow_.9YfWonPtH-LBCSmadUE-BQiP1qUqEty_0 2023-10-05T11:49:36.494 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.491+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing entries, marker: 2023-10-05T11:49:36.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.494+0000 7fcae6f29880 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2023-10-05T11:49:36.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.495+0000 7fcae6f29880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:49:36.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.495+0000 7fcae6f29880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:49:36.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.496+0000 7fcae6f29880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=7, truncated=0, next_marker='' 2023-10-05T11:49:36.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.496+0000 7fcae6f29880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.11298131598717821772', time=2023-10-05T13:49:14.271936+0000, chain.objs.size()=1 2023-10-05T11:49:36.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.496+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.102__shadow_.VNMfnProm3s0Teb6_riI5S_mF6eP7Vp_0 2023-10-05T11:49:36.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.496+0000 7fcae6f29880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.2075771032428841287', time=2023-10-05T13:49:15.555916+0000, chain.objs.size()=1 2023-10-05T11:49:36.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.496+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.104__shadow_.xQboyDc1kp1ZIlHm5nbseeVf6fWa6zd_0 2023-10-05T11:49:36.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.496+0000 7fcae6f29880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.5166133986183289156', time=2023-10-05T13:49:16.171790+0000, chain.objs.size()=1 2023-10-05T11:49:36.500 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.496+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.105__shadow_.MkuypNbHt7Q89gcgXe6tfI9BpXq5vWt_0 2023-10-05T11:49:36.500 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.496+0000 7fcae6f29880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.4777023525729364468', time=2023-10-05T13:49:18.123161+0000, chain.objs.size()=1 2023-10-05T11:49:36.500 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.496+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.108__shadow_.PCL58lYDY1U5qn5RUD6LSHF2vXmfrRf_0 2023-10-05T11:49:36.500 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.496+0000 7fcae6f29880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.10508298537264750992', time=2023-10-05T13:49:19.971538+0000, chain.objs.size()=1 2023-10-05T11:49:36.500 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.496+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.111__shadow_.GYpbpSt2JlIXWISoQLVhAo8_rXEYGVM_0 2023-10-05T11:49:36.500 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.496+0000 7fcae6f29880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.16427988463193974023', time=2023-10-05T13:49:19.995515+0000, chain.objs.size()=1 2023-10-05T11:49:36.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.496+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.111__shadow_.pjrJQ3Pdh1cPQMbmmmfqKhff07OKcXt_0 2023-10-05T11:49:36.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.496+0000 7fcae6f29880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.10582040322659578784', time=2023-10-05T13:49:24.322353+0000, chain.objs.size()=1 2023-10-05T11:49:36.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.496+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.118__shadow_.Th4LEFKh4p-0JkcSsBNxQ7pIeVIEDbw_0 2023-10-05T11:49:36.502 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.500+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing entries, marker: 2023-10-05T11:49:36.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.502+0000 7fcae6f29880 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2023-10-05T11:49:36.505 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.503+0000 7fcae6f29880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:49:36.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.504+0000 7fcae6f29880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:49:36.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.504+0000 7fcae6f29880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2023-10-05T11:49:36.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.504+0000 7fcae6f29880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.15241608628257904071', time=2023-10-05T13:48:48.667708+0000, chain.objs.size()=7 2023-10-05T11:49:36.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.504+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.90__multipart_key1.2~OeJ8skhmXAJiVBR_pr6Pw6fxQbPvL2_.1 2023-10-05T11:49:36.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.504+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.90__shadow_key1.2~OeJ8skhmXAJiVBR_pr6Pw6fxQbPvL2_.1_1 2023-10-05T11:49:36.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.504+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.90__shadow_key1.2~OeJ8skhmXAJiVBR_pr6Pw6fxQbPvL2_.1_2 2023-10-05T11:49:36.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.504+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.90__multipart_key1.2~OeJ8skhmXAJiVBR_pr6Pw6fxQbPvL2_.2 2023-10-05T11:49:36.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.504+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.90__shadow_key1.2~OeJ8skhmXAJiVBR_pr6Pw6fxQbPvL2_.2_1 2023-10-05T11:49:36.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.504+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.90__shadow_key1.2~OeJ8skhmXAJiVBR_pr6Pw6fxQbPvL2_.2_2 2023-10-05T11:49:36.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.504+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.90__multipart_key1.2~OeJ8skhmXAJiVBR_pr6Pw6fxQbPvL2_.3 2023-10-05T11:49:36.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.504+0000 7fcae6f29880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.6674715842620338960', time=2023-10-05T13:49:14.928375+0000, chain.objs.size()=1 2023-10-05T11:49:36.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.504+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.103__shadow_.6eZGmVVdLIdspd_QDPVLEj5oHnuvUZQ_0 2023-10-05T11:49:36.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.504+0000 7fcae6f29880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.9184305380779172786', time=2023-10-05T13:49:19.343061+0000, chain.objs.size()=1 2023-10-05T11:49:36.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.504+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.110__shadow_.KdfBIEpfGZs6sL5E24OoVVh3TAOqGOS_0 2023-10-05T11:49:36.511 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.509+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing entries, marker: 2023-10-05T11:49:36.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.511+0000 7fcae6f29880 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2023-10-05T11:49:36.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.513+0000 7fcae6f29880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:49:36.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.513+0000 7fcae6f29880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:49:36.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.513+0000 7fcae6f29880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=10, truncated=0, next_marker='' 2023-10-05T11:49:36.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.513+0000 7fcae6f29880 20 garbage collection: RGWGC::process iterating over entry tag='2~zSWtkBdvjPP4SCV6Tuzr504WTuSAUkv', time=2023-10-05T13:49:06.687824+0000, chain.objs.size()=1 2023-10-05T11:49:36.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.513+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.93__multipart_key1.2~zSWtkBdvjPP4SCV6Tuzr504WTuSAUkv.14 2023-10-05T11:49:36.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.513+0000 7fcae6f29880 20 garbage collection: RGWGC::process iterating over entry tag='2~zSWtkBdvjPP4SCV6Tuzr504WTuSAUkv', time=2023-10-05T13:49:06.835054+0000, chain.objs.size()=1 2023-10-05T11:49:36.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.513+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.93__multipart_key1.2~zSWtkBdvjPP4SCV6Tuzr504WTuSAUkv.15 2023-10-05T11:49:36.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.513+0000 7fcae6f29880 20 garbage collection: RGWGC::process iterating over entry tag='2~zSWtkBdvjPP4SCV6Tuzr504WTuSAUkv', time=2023-10-05T13:49:06.882164+0000, chain.objs.size()=1 2023-10-05T11:49:36.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.513+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.93__multipart_key1.2~zSWtkBdvjPP4SCV6Tuzr504WTuSAUkv.16 2023-10-05T11:49:36.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.513+0000 7fcae6f29880 20 garbage collection: RGWGC::process iterating over entry tag='2~zSWtkBdvjPP4SCV6Tuzr504WTuSAUkv', time=2023-10-05T13:49:07.139631+0000, chain.objs.size()=1 2023-10-05T11:49:36.519 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.513+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.93__multipart_key1.2~zSWtkBdvjPP4SCV6Tuzr504WTuSAUkv.17 2023-10-05T11:49:36.519 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.513+0000 7fcae6f29880 20 garbage collection: RGWGC::process iterating over entry tag='2~zSWtkBdvjPP4SCV6Tuzr504WTuSAUkv', time=2023-10-05T13:49:07.154864+0000, chain.objs.size()=1 2023-10-05T11:49:36.519 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.513+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.93__multipart_key1.2~zSWtkBdvjPP4SCV6Tuzr504WTuSAUkv.18 2023-10-05T11:49:36.519 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.513+0000 7fcae6f29880 20 garbage collection: RGWGC::process iterating over entry tag='2~zSWtkBdvjPP4SCV6Tuzr504WTuSAUkv', time=2023-10-05T13:49:07.402079+0000, chain.objs.size()=1 2023-10-05T11:49:36.519 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.513+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.93__multipart_key1.2~zSWtkBdvjPP4SCV6Tuzr504WTuSAUkv.19 2023-10-05T11:49:36.519 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.513+0000 7fcae6f29880 20 garbage collection: RGWGC::process iterating over entry tag='2~zSWtkBdvjPP4SCV6Tuzr504WTuSAUkv', time=2023-10-05T13:49:07.643115+0000, chain.objs.size()=1 2023-10-05T11:49:36.519 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.513+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.93__multipart_key1.2~zSWtkBdvjPP4SCV6Tuzr504WTuSAUkv.20 2023-10-05T11:49:36.520 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.514+0000 7fcae6f29880 20 garbage collection: RGWGC::process iterating over entry tag='2~zSWtkBdvjPP4SCV6Tuzr504WTuSAUkv', time=2023-10-05T13:49:07.850251+0000, chain.objs.size()=64 2023-10-05T11:49:36.520 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.514+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.93__multipart_key1.2~zSWtkBdvjPP4SCV6Tuzr504WTuSAUkv.1 2023-10-05T11:49:36.521 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.514+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.93__multipart_key1.2~zSWtkBdvjPP4SCV6Tuzr504WTuSAUkv.2 2023-10-05T11:49:36.521 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.514+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.93__multipart_key1.2~zSWtkBdvjPP4SCV6Tuzr504WTuSAUkv.3 2023-10-05T11:49:36.521 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.514+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.93__multipart_key1.2~zSWtkBdvjPP4SCV6Tuzr504WTuSAUkv.4 2023-10-05T11:49:36.521 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.514+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.93__multipart_key1.2~zSWtkBdvjPP4SCV6Tuzr504WTuSAUkv.5 2023-10-05T11:49:36.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.517+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.93__multipart_key1.2~zSWtkBdvjPP4SCV6Tuzr504WTuSAUkv.6 2023-10-05T11:49:36.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.517+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.93__multipart_key1.2~zSWtkBdvjPP4SCV6Tuzr504WTuSAUkv.7 2023-10-05T11:49:36.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.517+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.93__multipart_key1.2~zSWtkBdvjPP4SCV6Tuzr504WTuSAUkv.8 2023-10-05T11:49:36.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.517+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.93__multipart_key1.2~zSWtkBdvjPP4SCV6Tuzr504WTuSAUkv.9 2023-10-05T11:49:36.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.517+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.93__multipart_key1.2~zSWtkBdvjPP4SCV6Tuzr504WTuSAUkv.10 2023-10-05T11:49:36.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.517+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.93__multipart_key1.2~zSWtkBdvjPP4SCV6Tuzr504WTuSAUkv.11 2023-10-05T11:49:36.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.518+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.93__multipart_key1.2~zSWtkBdvjPP4SCV6Tuzr504WTuSAUkv.12 2023-10-05T11:49:36.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.518+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.93__multipart_key1.2~zSWtkBdvjPP4SCV6Tuzr504WTuSAUkv.13 2023-10-05T11:49:36.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.518+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.93__multipart_key1.joHhWxkZ0v6WQgs92BREa9iSICIZ8Hau.14 2023-10-05T11:49:36.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.518+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.93__multipart_key1.fM1J4eiytatBIN3LTI1z165VMeIDD349.15 2023-10-05T11:49:36.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.518+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.93__multipart_key1.swaw_vfOHDTIGZEmEtPIKE4ICNpFOilc.16 2023-10-05T11:49:36.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.522+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.93__multipart_key1.FfVpdMBO-7iBGRXSn47psoCdU3caNrRl.17 2023-10-05T11:49:36.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.522+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.93__multipart_key1.bNwczWLxVkfkXTgEsyg5hhOl2P67LI-S.18 2023-10-05T11:49:36.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.522+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.93__multipart_key1.jvBxWlz7JIkxEJPWqHu7y_HFyXy6cyaB.19 2023-10-05T11:49:36.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.523+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.93__multipart_key1.CclCJaUTUU6g9D751uDfC5rdNkLWSCeL.20 2023-10-05T11:49:36.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.523+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.93__multipart_key1.2~zSWtkBdvjPP4SCV6Tuzr504WTuSAUkv.21 2023-10-05T11:49:36.527 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.523+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.93__multipart_key1.2~zSWtkBdvjPP4SCV6Tuzr504WTuSAUkv.22 2023-10-05T11:49:36.527 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.523+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.93__multipart_key1.2~zSWtkBdvjPP4SCV6Tuzr504WTuSAUkv.23 2023-10-05T11:49:36.527 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.523+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.93__multipart_key1.2~zSWtkBdvjPP4SCV6Tuzr504WTuSAUkv.24 2023-10-05T11:49:36.527 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.523+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.93__multipart_key1.2~zSWtkBdvjPP4SCV6Tuzr504WTuSAUkv.25 2023-10-05T11:49:36.527 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.523+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.93__multipart_key1.2~zSWtkBdvjPP4SCV6Tuzr504WTuSAUkv.26 2023-10-05T11:49:36.527 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.523+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.93__multipart_key1.2~zSWtkBdvjPP4SCV6Tuzr504WTuSAUkv.27 2023-10-05T11:49:36.529 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.527+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.93__multipart_key1.2~zSWtkBdvjPP4SCV6Tuzr504WTuSAUkv.28 2023-10-05T11:49:36.529 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.527+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.93__multipart_key1.2~zSWtkBdvjPP4SCV6Tuzr504WTuSAUkv.29 2023-10-05T11:49:36.531 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.528+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.93__multipart_key1.2~zSWtkBdvjPP4SCV6Tuzr504WTuSAUkv.30 2023-10-05T11:49:36.531 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.528+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.93__multipart_key1.2~zSWtkBdvjPP4SCV6Tuzr504WTuSAUkv.31 2023-10-05T11:49:36.531 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.528+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.93__multipart_key1.2~zSWtkBdvjPP4SCV6Tuzr504WTuSAUkv.32 2023-10-05T11:49:36.531 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.528+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.93__multipart_key1.2~zSWtkBdvjPP4SCV6Tuzr504WTuSAUkv.33 2023-10-05T11:49:36.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.529+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.93__multipart_key1.2~zSWtkBdvjPP4SCV6Tuzr504WTuSAUkv.34 2023-10-05T11:49:36.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.529+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.93__multipart_key1.2~zSWtkBdvjPP4SCV6Tuzr504WTuSAUkv.35 2023-10-05T11:49:36.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.529+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.93__multipart_key1.2~zSWtkBdvjPP4SCV6Tuzr504WTuSAUkv.36 2023-10-05T11:49:36.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.529+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.93__multipart_key1.2~zSWtkBdvjPP4SCV6Tuzr504WTuSAUkv.37 2023-10-05T11:49:36.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.530+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.93__multipart_key1.2~zSWtkBdvjPP4SCV6Tuzr504WTuSAUkv.38 2023-10-05T11:49:36.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.530+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.93__multipart_key1.2~zSWtkBdvjPP4SCV6Tuzr504WTuSAUkv.39 2023-10-05T11:49:36.534 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.532+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.93__multipart_key1.2~zSWtkBdvjPP4SCV6Tuzr504WTuSAUkv.40 2023-10-05T11:49:36.537 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.534+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.93__multipart_key1.2~zSWtkBdvjPP4SCV6Tuzr504WTuSAUkv.41 2023-10-05T11:49:36.537 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.535+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.93__multipart_key1.2~zSWtkBdvjPP4SCV6Tuzr504WTuSAUkv.42 2023-10-05T11:49:36.537 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.535+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.93__multipart_key1.2~zSWtkBdvjPP4SCV6Tuzr504WTuSAUkv.43 2023-10-05T11:49:36.538 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.535+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.93__multipart_key1.2~zSWtkBdvjPP4SCV6Tuzr504WTuSAUkv.44 2023-10-05T11:49:36.538 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.535+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.93__multipart_key1.2~zSWtkBdvjPP4SCV6Tuzr504WTuSAUkv.45 2023-10-05T11:49:36.538 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.535+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.93__multipart_key1.2~zSWtkBdvjPP4SCV6Tuzr504WTuSAUkv.46 2023-10-05T11:49:36.538 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.535+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.93__multipart_key1.2~zSWtkBdvjPP4SCV6Tuzr504WTuSAUkv.47 2023-10-05T11:49:36.538 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.535+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.93__multipart_key1.2~zSWtkBdvjPP4SCV6Tuzr504WTuSAUkv.48 2023-10-05T11:49:36.538 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.535+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.93__multipart_key1.2~zSWtkBdvjPP4SCV6Tuzr504WTuSAUkv.49 2023-10-05T11:49:36.538 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.535+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.93__multipart_key1.2~zSWtkBdvjPP4SCV6Tuzr504WTuSAUkv.50 2023-10-05T11:49:36.538 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.535+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.93__multipart_key1.2~zSWtkBdvjPP4SCV6Tuzr504WTuSAUkv.51 2023-10-05T11:49:36.542 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.539+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.93__multipart_key1.2~zSWtkBdvjPP4SCV6Tuzr504WTuSAUkv.52 2023-10-05T11:49:36.542 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.539+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.93__multipart_key1.2~zSWtkBdvjPP4SCV6Tuzr504WTuSAUkv.53 2023-10-05T11:49:36.542 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.539+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.93__multipart_key1.2~zSWtkBdvjPP4SCV6Tuzr504WTuSAUkv.54 2023-10-05T11:49:36.542 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.539+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.93__multipart_key1.2~zSWtkBdvjPP4SCV6Tuzr504WTuSAUkv.55 2023-10-05T11:49:36.542 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.540+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.93__multipart_key1.2~zSWtkBdvjPP4SCV6Tuzr504WTuSAUkv.56 2023-10-05T11:49:36.542 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.540+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.93__multipart_key1.2~zSWtkBdvjPP4SCV6Tuzr504WTuSAUkv.57 2023-10-05T11:49:36.542 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.540+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.93__multipart_key1.2~zSWtkBdvjPP4SCV6Tuzr504WTuSAUkv.58 2023-10-05T11:49:36.544 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.542+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.93__multipart_key1.2~zSWtkBdvjPP4SCV6Tuzr504WTuSAUkv.59 2023-10-05T11:49:36.545 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.542+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.93__multipart_key1.2~zSWtkBdvjPP4SCV6Tuzr504WTuSAUkv.60 2023-10-05T11:49:36.545 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.542+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.93__multipart_key1.2~zSWtkBdvjPP4SCV6Tuzr504WTuSAUkv.61 2023-10-05T11:49:36.545 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.542+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.93__multipart_key1.2~zSWtkBdvjPP4SCV6Tuzr504WTuSAUkv.63 2023-10-05T11:49:36.545 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.543+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.93__multipart_key1.2~zSWtkBdvjPP4SCV6Tuzr504WTuSAUkv.64 2023-10-05T11:49:36.546 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.544+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.93__multipart_key1.2~zSWtkBdvjPP4SCV6Tuzr504WTuSAUkv.65 2023-10-05T11:49:36.547 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.544+0000 7fcae6f29880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.16832977086728259423', time=2023-10-05T13:49:13.642954+0000, chain.objs.size()=1 2023-10-05T11:49:36.547 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.544+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.101__shadow_.Ml2NBMD7G1kAEc6qdHsz229ztotcS0E_0 2023-10-05T11:49:36.547 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.544+0000 7fcae6f29880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.15355728095132571267', time=2023-10-05T13:49:22.393969+0000, chain.objs.size()=1 2023-10-05T11:49:36.547 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.544+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.115__shadow_.z4JMHoQ84jn2ya-oz31UK0PHVDF79Tv_0 2023-10-05T11:49:36.551 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.549+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing entries, marker: 2023-10-05T11:49:36.553 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.551+0000 7fcae6f29880 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2023-10-05T11:49:36.554 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.552+0000 7fcae6f29880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:49:36.555 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.553+0000 7fcae6f29880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:49:36.555 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.553+0000 7fcae6f29880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2023-10-05T11:49:36.556 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.553+0000 7fcae6f29880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.14663176993186423287', time=2023-10-05T13:49:13.037752+0000, chain.objs.size()=1 2023-10-05T11:49:36.556 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.553+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.100__shadow_.vYIaIgypQt9xeSLQRZHBE-2wyqsiTs6_0 2023-10-05T11:49:36.556 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.553+0000 7fcae6f29880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.17435399059251810787', time=2023-10-05T13:49:15.579489+0000, chain.objs.size()=1 2023-10-05T11:49:36.556 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.553+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.104__shadow_.ain4gQ3Q3_8KgLxF0gn-r_UTRzGulWw_0 2023-10-05T11:49:36.556 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.553+0000 7fcae6f29880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.6828967475838072688', time=2023-10-05T13:49:16.850026+0000, chain.objs.size()=1 2023-10-05T11:49:36.556 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.553+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.106__shadow_._VWCO_GLN0fbG1cC337O9KMHa-SVMs5_0 2023-10-05T11:49:36.556 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.553+0000 7fcae6f29880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.1655534814224742724', time=2023-10-05T13:49:23.028023+0000, chain.objs.size()=1 2023-10-05T11:49:36.556 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.553+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.116__shadow_.4fJoOC__JFJjY7qMF620NKNNT5PlzAO_0 2023-10-05T11:49:36.558 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.556+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing entries, marker: 2023-10-05T11:49:36.560 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.558+0000 7fcae6f29880 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2023-10-05T11:49:36.561 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.559+0000 7fcae6f29880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:49:36.561 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.559+0000 7fcae6f29880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:49:36.562 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.560+0000 7fcae6f29880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2023-10-05T11:49:36.563 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.560+0000 7fcae6f29880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.4353436594780738321', time=2023-10-05T13:48:54.798907+0000, chain.objs.size()=9 2023-10-05T11:49:36.563 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.560+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.92__multipart_key1.2~t6fJlb0HBFUasYesKmstaQSFD0PFL-L.1 2023-10-05T11:49:36.563 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.560+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.92__shadow_key1.2~t6fJlb0HBFUasYesKmstaQSFD0PFL-L.1_1 2023-10-05T11:49:36.563 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.560+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.92__multipart_key1.2~t6fJlb0HBFUasYesKmstaQSFD0PFL-L.2 2023-10-05T11:49:36.563 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.560+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.92__shadow_key1.2~t6fJlb0HBFUasYesKmstaQSFD0PFL-L.2_1 2023-10-05T11:49:36.563 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.560+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.92__multipart_key1.2~t6fJlb0HBFUasYesKmstaQSFD0PFL-L.3 2023-10-05T11:49:36.563 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.560+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.92__shadow_key1.2~t6fJlb0HBFUasYesKmstaQSFD0PFL-L.3_1 2023-10-05T11:49:36.563 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.560+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.92__multipart_key1.2~t6fJlb0HBFUasYesKmstaQSFD0PFL-L.4 2023-10-05T11:49:36.563 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.560+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.92__shadow_key1.2~t6fJlb0HBFUasYesKmstaQSFD0PFL-L.4_1 2023-10-05T11:49:36.563 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.560+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.92__multipart_key1.2~t6fJlb0HBFUasYesKmstaQSFD0PFL-L.5 2023-10-05T11:49:36.563 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.560+0000 7fcae6f29880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.13537604516203415031', time=2023-10-05T13:49:16.802709+0000, chain.objs.size()=1 2023-10-05T11:49:36.564 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.560+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.106__shadow_.nBW0VovXBeJliMWbfH6_xdald3Xinjx_0 2023-10-05T11:49:36.564 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.560+0000 7fcae6f29880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.8003127635908249371', time=2023-10-05T13:49:19.948642+0000, chain.objs.size()=1 2023-10-05T11:49:36.564 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.560+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.111__shadow_.eLkvoC5YPp3DooNyMeouUgVcv6OJ_pi_0 2023-10-05T11:49:36.564 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.560+0000 7fcae6f29880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.8224949565571109306', time=2023-10-05T13:49:24.911548+0000, chain.objs.size()=1 2023-10-05T11:49:36.564 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.560+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.119__shadow_.r_IliaT07t4Z5M8VIxt7ZhN43DGsAeU_0 2023-10-05T11:49:36.570 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.568+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing entries, marker: 2023-10-05T11:49:36.572 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.570+0000 7fcae6f29880 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2023-10-05T11:49:36.573 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.571+0000 7fcae6f29880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:49:36.573 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.571+0000 7fcae6f29880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:49:36.574 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.572+0000 7fcae6f29880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2023-10-05T11:49:36.574 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.572+0000 7fcae6f29880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.16867861797059076181', time=2023-10-05T13:48:33.642256+0000, chain.objs.size()=9 2023-10-05T11:49:36.575 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.572+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.88__multipart_file2.mpg.2~LaptpYlAR5fTFTGeuKscCM7T-XRDlXq.1 2023-10-05T11:49:36.575 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.572+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.88__shadow_file2.mpg.2~LaptpYlAR5fTFTGeuKscCM7T-XRDlXq.1_1 2023-10-05T11:49:36.575 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.572+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.88__multipart_file2.mpg.2~LaptpYlAR5fTFTGeuKscCM7T-XRDlXq.2 2023-10-05T11:49:36.575 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.572+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.88__shadow_file2.mpg.2~LaptpYlAR5fTFTGeuKscCM7T-XRDlXq.2_1 2023-10-05T11:49:36.575 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.572+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.88__multipart_file2.mpg.2~LaptpYlAR5fTFTGeuKscCM7T-XRDlXq.3 2023-10-05T11:49:36.575 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.572+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.88__shadow_file2.mpg.2~LaptpYlAR5fTFTGeuKscCM7T-XRDlXq.3_1 2023-10-05T11:49:36.575 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.572+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.88__multipart_file2.mpg.2~LaptpYlAR5fTFTGeuKscCM7T-XRDlXq.4 2023-10-05T11:49:36.575 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.572+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.88__shadow_file2.mpg.2~LaptpYlAR5fTFTGeuKscCM7T-XRDlXq.4_1 2023-10-05T11:49:36.575 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.572+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.88__multipart_file2.mpg.2~LaptpYlAR5fTFTGeuKscCM7T-XRDlXq.5 2023-10-05T11:49:36.575 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.572+0000 7fcae6f29880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.4188938191068399160', time=2023-10-05T13:49:13.014231+0000, chain.objs.size()=1 2023-10-05T11:49:36.575 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.572+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.100__shadow_.hTIqpBov1jOZWGXCmXZUfOCOMiOA55-_0 2023-10-05T11:49:36.576 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.572+0000 7fcae6f29880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.10351256497793232782', time=2023-10-05T13:49:13.689813+0000, chain.objs.size()=1 2023-10-05T11:49:36.576 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.572+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.101__shadow_.xSXsTc2R21Vd7aKwlRytAkFNIgXLIro_0 2023-10-05T11:49:36.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.578+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing entries, marker: 2023-10-05T11:49:36.582 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.580+0000 7fcae6f29880 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2023-10-05T11:49:36.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.581+0000 7fcae6f29880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:49:36.584 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.582+0000 7fcae6f29880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:49:36.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.582+0000 7fcae6f29880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2023-10-05T11:49:36.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.582+0000 7fcae6f29880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.11617811411001591406', time=2023-10-05T13:48:20.786430+0000, chain.objs.size()=7 2023-10-05T11:49:36.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.582+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.82__multipart_key1.2~HGk9lkp9k9YvuN38S7VCm_lQSM8J4DR.1 2023-10-05T11:49:36.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.582+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.82__shadow_key1.2~HGk9lkp9k9YvuN38S7VCm_lQSM8J4DR.1_1 2023-10-05T11:49:36.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.582+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.82__shadow_key1.2~HGk9lkp9k9YvuN38S7VCm_lQSM8J4DR.1_2 2023-10-05T11:49:36.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.582+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.82__multipart_key1.2~HGk9lkp9k9YvuN38S7VCm_lQSM8J4DR.2 2023-10-05T11:49:36.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.582+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.82__shadow_key1.2~HGk9lkp9k9YvuN38S7VCm_lQSM8J4DR.2_1 2023-10-05T11:49:36.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.582+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.82__shadow_key1.2~HGk9lkp9k9YvuN38S7VCm_lQSM8J4DR.2_2 2023-10-05T11:49:36.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.582+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.82__multipart_key1.2~HGk9lkp9k9YvuN38S7VCm_lQSM8J4DR.3 2023-10-05T11:49:36.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.582+0000 7fcae6f29880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.4411006675258268025', time=2023-10-05T13:49:16.825868+0000, chain.objs.size()=1 2023-10-05T11:49:36.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.582+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.106__shadow_.kbBJ40wice5TeJFtMbTVxtAMXdmgtVg_0 2023-10-05T11:49:36.586 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.582+0000 7fcae6f29880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.17925714739200460641', time=2023-10-05T13:49:16.874811+0000, chain.objs.size()=1 2023-10-05T11:49:36.586 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.582+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.106__shadow_.2s5ewzyo_1Zg16uUPGT2pQ2cp1EeMS8_0 2023-10-05T11:49:36.586 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.582+0000 7fcae6f29880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.14798295256366931795', time=2023-10-05T13:49:17.513451+0000, chain.objs.size()=1 2023-10-05T11:49:36.586 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.582+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.107__shadow_.L5bSayki7GEmlQeUM9HmodmI9chV6HT_0 2023-10-05T11:49:36.586 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.582+0000 7fcae6f29880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.4254339159865769821', time=2023-10-05T13:49:25.445412+0000, chain.objs.size()=1 2023-10-05T11:49:36.586 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.582+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.120__shadow_.8Ml8vwYvCbjDAWk31sReYey7h06VWR3_0 2023-10-05T11:49:36.589 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.587+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing entries, marker: 2023-10-05T11:49:36.592 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.590+0000 7fcae6f29880 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2023-10-05T11:49:36.594 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.592+0000 7fcae6f29880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:49:36.594 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.592+0000 7fcae6f29880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:49:36.595 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.593+0000 7fcae6f29880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2023-10-05T11:49:36.595 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.593+0000 7fcae6f29880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.3682748610827787799', time=2023-10-05T13:47:43.652994+0000, chain.objs.size()=1 2023-10-05T11:49:36.595 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.593+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.72__shadow_.7EfzMWh8Y92XgkQ9MBqCTHoGcTGDHyE_0 2023-10-05T11:49:36.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.593+0000 7fcae6f29880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.2393237199098023620', time=2023-10-05T13:47:49.624289+0000, chain.objs.size()=9 2023-10-05T11:49:36.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.593+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.79__multipart_key1.2~Pp9AFkXIzwswParqGCTfvHi1hdI7ydJ.1 2023-10-05T11:49:36.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.593+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.79__shadow_key1.2~Pp9AFkXIzwswParqGCTfvHi1hdI7ydJ.1_1 2023-10-05T11:49:36.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.593+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.79__multipart_key1.2~Pp9AFkXIzwswParqGCTfvHi1hdI7ydJ.2 2023-10-05T11:49:36.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.593+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.79__shadow_key1.2~Pp9AFkXIzwswParqGCTfvHi1hdI7ydJ.2_1 2023-10-05T11:49:36.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.593+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.79__multipart_key1.2~Pp9AFkXIzwswParqGCTfvHi1hdI7ydJ.3 2023-10-05T11:49:36.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.593+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.79__shadow_key1.2~Pp9AFkXIzwswParqGCTfvHi1hdI7ydJ.3_1 2023-10-05T11:49:36.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.593+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.79__multipart_key1.2~Pp9AFkXIzwswParqGCTfvHi1hdI7ydJ.4 2023-10-05T11:49:36.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.593+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.79__shadow_key1.2~Pp9AFkXIzwswParqGCTfvHi1hdI7ydJ.4_1 2023-10-05T11:49:36.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.593+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.79__multipart_key1.2~Pp9AFkXIzwswParqGCTfvHi1hdI7ydJ.5 2023-10-05T11:49:36.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.593+0000 7fcae6f29880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4604.79__shadow_key1.2~Pp9AFkXIzwswParqGCTfvHi1hdI7ydJ.1_1_e5315e18345eb6c90a210c66f3c04667', time=2023-10-05T13:47:49.895609+0000, chain.objs.size()=9 2023-10-05T11:49:36.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.593+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.79__multipart_key1.2~Pp9AFkXIzwswParqGCTfvHi1hdI7ydJ.1 2023-10-05T11:49:36.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.593+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.79__shadow_key1.2~Pp9AFkXIzwswParqGCTfvHi1hdI7ydJ.1_1 2023-10-05T11:49:36.598 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.596+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.79__multipart_key1.2~Pp9AFkXIzwswParqGCTfvHi1hdI7ydJ.2 2023-10-05T11:49:36.598 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.596+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.79__shadow_key1.2~Pp9AFkXIzwswParqGCTfvHi1hdI7ydJ.2_1 2023-10-05T11:49:36.598 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.596+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.79__multipart_key1.2~Pp9AFkXIzwswParqGCTfvHi1hdI7ydJ.3 2023-10-05T11:49:36.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.596+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.79__shadow_key1.2~Pp9AFkXIzwswParqGCTfvHi1hdI7ydJ.3_1 2023-10-05T11:49:36.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.597+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.79__multipart_key1.2~Pp9AFkXIzwswParqGCTfvHi1hdI7ydJ.4 2023-10-05T11:49:36.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.597+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.79__shadow_key1.2~Pp9AFkXIzwswParqGCTfvHi1hdI7ydJ.4_1 2023-10-05T11:49:36.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.597+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.79__multipart_key1.2~Pp9AFkXIzwswParqGCTfvHi1hdI7ydJ.5 2023-10-05T11:49:36.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.597+0000 7fcae6f29880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.705330913650265369', time=2023-10-05T13:48:28.670234+0000, chain.objs.size()=9 2023-10-05T11:49:36.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.597+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.87__multipart_key1.2~XJazZ_PSON_PMUofc0a7qoS-FalU03Q.1 2023-10-05T11:49:36.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.597+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.87__shadow_key1.2~XJazZ_PSON_PMUofc0a7qoS-FalU03Q.1_1 2023-10-05T11:49:36.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.597+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.87__multipart_key1.2~XJazZ_PSON_PMUofc0a7qoS-FalU03Q.2 2023-10-05T11:49:36.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.598+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.87__shadow_key1.2~XJazZ_PSON_PMUofc0a7qoS-FalU03Q.2_1 2023-10-05T11:49:36.601 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.599+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.87__multipart_key1.2~XJazZ_PSON_PMUofc0a7qoS-FalU03Q.3 2023-10-05T11:49:36.601 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.599+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.87__shadow_key1.2~XJazZ_PSON_PMUofc0a7qoS-FalU03Q.3_1 2023-10-05T11:49:36.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.601+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.87__multipart_key1.2~XJazZ_PSON_PMUofc0a7qoS-FalU03Q.4 2023-10-05T11:49:36.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.601+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.87__shadow_key1.2~XJazZ_PSON_PMUofc0a7qoS-FalU03Q.4_1 2023-10-05T11:49:36.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.601+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.87__multipart_key1.2~XJazZ_PSON_PMUofc0a7qoS-FalU03Q.5 2023-10-05T11:49:36.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.601+0000 7fcae6f29880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.7819369213319469315', time=2023-10-05T13:48:40.824272+0000, chain.objs.size()=9 2023-10-05T11:49:36.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.601+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.90__multipart_key1.2~6xHyVqRJITx74_yq6HIbXXhlN11pKy6.1 2023-10-05T11:49:36.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.601+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.90__shadow_key1.2~6xHyVqRJITx74_yq6HIbXXhlN11pKy6.1_1 2023-10-05T11:49:36.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.601+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.90__multipart_key1.2~6xHyVqRJITx74_yq6HIbXXhlN11pKy6.2 2023-10-05T11:49:36.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.602+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.90__shadow_key1.2~6xHyVqRJITx74_yq6HIbXXhlN11pKy6.2_1 2023-10-05T11:49:36.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.602+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.90__multipart_key1.2~6xHyVqRJITx74_yq6HIbXXhlN11pKy6.3 2023-10-05T11:49:36.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.602+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.90__shadow_key1.2~6xHyVqRJITx74_yq6HIbXXhlN11pKy6.3_1 2023-10-05T11:49:36.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.602+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.90__multipart_key1.2~6xHyVqRJITx74_yq6HIbXXhlN11pKy6.4 2023-10-05T11:49:36.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.605+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.90__shadow_key1.2~6xHyVqRJITx74_yq6HIbXXhlN11pKy6.4_1 2023-10-05T11:49:36.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.607+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.90__multipart_key1.2~6xHyVqRJITx74_yq6HIbXXhlN11pKy6.5 2023-10-05T11:49:36.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.611+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing entries, marker: 2023-10-05T11:49:36.615 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.613+0000 7fcae6f29880 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2023-10-05T11:49:36.616 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.614+0000 7fcae6f29880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:49:36.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.615+0000 7fcae6f29880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:49:36.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.615+0000 7fcae6f29880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2023-10-05T11:49:36.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.615+0000 7fcae6f29880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.15437539540832640886', time=2023-10-05T13:48:33.590944+0000, chain.objs.size()=9 2023-10-05T11:49:36.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.615+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.88__multipart_file.mpg.2~GewrR6qMWbH_VTmu43eaylDwTmwOZNY.1 2023-10-05T11:49:36.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.615+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.88__shadow_file.mpg.2~GewrR6qMWbH_VTmu43eaylDwTmwOZNY.1_1 2023-10-05T11:49:36.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.615+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.88__multipart_file.mpg.2~GewrR6qMWbH_VTmu43eaylDwTmwOZNY.2 2023-10-05T11:49:36.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.615+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.88__shadow_file.mpg.2~GewrR6qMWbH_VTmu43eaylDwTmwOZNY.2_1 2023-10-05T11:49:36.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.615+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.88__multipart_file.mpg.2~GewrR6qMWbH_VTmu43eaylDwTmwOZNY.3 2023-10-05T11:49:36.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.615+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.88__shadow_file.mpg.2~GewrR6qMWbH_VTmu43eaylDwTmwOZNY.3_1 2023-10-05T11:49:36.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.615+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.88__multipart_file.mpg.2~GewrR6qMWbH_VTmu43eaylDwTmwOZNY.4 2023-10-05T11:49:36.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.615+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.88__shadow_file.mpg.2~GewrR6qMWbH_VTmu43eaylDwTmwOZNY.4_1 2023-10-05T11:49:36.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.615+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.88__multipart_file.mpg.2~GewrR6qMWbH_VTmu43eaylDwTmwOZNY.5 2023-10-05T11:49:36.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.615+0000 7fcae6f29880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.18284922325299754069', time=2023-10-05T13:48:51.117947+0000, chain.objs.size()=1 2023-10-05T11:49:36.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.615+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.91__shadow_.0CSy5q627Bx-tNp8zZIFiaC6fuyq3hc_0 2023-10-05T11:49:36.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.615+0000 7fcae6f29880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.15191021063898706803', time=2023-10-05T13:49:18.076272+0000, chain.objs.size()=1 2023-10-05T11:49:36.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.615+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.108__shadow_.UQoUUSV6tZI12ZIvDU0cap3czY-1LYc_0 2023-10-05T11:49:36.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.615+0000 7fcae6f29880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.11278993716782144799', time=2023-10-05T13:49:29.495348+0000, chain.objs.size()=1 2023-10-05T11:49:36.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.615+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.128__shadow_.5TRS7qQl4PjWbrQwaowvA0TWxLrWRH-_0 2023-10-05T11:49:36.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.621+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing entries, marker: 2023-10-05T11:49:36.626 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.624+0000 7fcae6f29880 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2023-10-05T11:49:36.627 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.625+0000 7fcae6f29880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:49:36.627 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.626+0000 7fcae6f29880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:49:36.628 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.626+0000 7fcae6f29880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2023-10-05T11:49:36.628 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.626+0000 7fcae6f29880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.2384133697714633121', time=2023-10-05T13:48:11.967389+0000, chain.objs.size()=9 2023-10-05T11:49:36.628 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.626+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.82__multipart_key1.2~-wY6j4bOzo3aMKj5K9bky2FK0eaaYQh.1 2023-10-05T11:49:36.628 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.626+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.82__shadow_key1.2~-wY6j4bOzo3aMKj5K9bky2FK0eaaYQh.1_1 2023-10-05T11:49:36.629 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.626+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.82__multipart_key1.2~-wY6j4bOzo3aMKj5K9bky2FK0eaaYQh.2 2023-10-05T11:49:36.629 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.626+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.82__shadow_key1.2~-wY6j4bOzo3aMKj5K9bky2FK0eaaYQh.2_1 2023-10-05T11:49:36.629 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.626+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.82__multipart_key1.2~-wY6j4bOzo3aMKj5K9bky2FK0eaaYQh.3 2023-10-05T11:49:36.629 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.626+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.82__shadow_key1.2~-wY6j4bOzo3aMKj5K9bky2FK0eaaYQh.3_1 2023-10-05T11:49:36.629 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.626+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.82__multipart_key1.2~-wY6j4bOzo3aMKj5K9bky2FK0eaaYQh.4 2023-10-05T11:49:36.629 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.626+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.82__shadow_key1.2~-wY6j4bOzo3aMKj5K9bky2FK0eaaYQh.4_1 2023-10-05T11:49:36.629 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.626+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.82__multipart_key1.2~-wY6j4bOzo3aMKj5K9bky2FK0eaaYQh.5 2023-10-05T11:49:36.629 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.626+0000 7fcae6f29880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.4985917985851959640', time=2023-10-05T13:49:24.275364+0000, chain.objs.size()=1 2023-10-05T11:49:36.629 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.626+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.118__shadow_.fJLuSFSVF0M6mwL4x_QwxLZTE8LJVNs_0 2023-10-05T11:49:36.633 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.630+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing entries, marker: 2023-10-05T11:49:36.635 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.633+0000 7fcae6f29880 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2023-10-05T11:49:36.636 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.634+0000 7fcae6f29880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:49:36.637 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.635+0000 7fcae6f29880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:49:36.637 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.635+0000 7fcae6f29880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2023-10-05T11:49:36.637 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.635+0000 7fcae6f29880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.5245197067245925868', time=2023-10-05T13:49:26.031993+0000, chain.objs.size()=1 2023-10-05T11:49:36.637 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.635+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.121__shadow_.WtvsLzhe-aN4yUBbSHC0x1ZuvdIuwgH_0 2023-10-05T11:49:36.637 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.635+0000 7fcae6f29880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.18296288851923131345', time=2023-10-05T13:49:26.061207+0000, chain.objs.size()=1 2023-10-05T11:49:36.638 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.635+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.121__shadow_.DJqrnGTQ7QShMj04RAgcVyAGgsT7Q-M_0 2023-10-05T11:49:36.638 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.635+0000 7fcae6f29880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.1016967477736881429', time=2023-10-05T13:49:35.723039+0000, chain.objs.size()=1 2023-10-05T11:49:36.638 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.635+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.132__shadow_.7uf1PUr2DiptxPxmduuerHIyYoxS2NW_0 2023-10-05T11:49:36.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.637+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing entries, marker: 2023-10-05T11:49:36.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.640+0000 7fcae6f29880 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2023-10-05T11:49:36.643 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.641+0000 7fcae6f29880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:49:36.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.642+0000 7fcae6f29880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:49:36.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.642+0000 7fcae6f29880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2023-10-05T11:49:36.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.642+0000 7fcae6f29880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.16695727818045595960', time=2023-10-05T13:47:43.203949+0000, chain.objs.size()=3 2023-10-05T11:49:36.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.642+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.71__shadow_.a1ey_JtHd8cjJqt4X4SvZx3bFzSPVni_0 2023-10-05T11:49:36.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.642+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.71__shadow_.a1ey_JtHd8cjJqt4X4SvZx3bFzSPVni_1 2023-10-05T11:49:36.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.642+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.71__shadow_.a1ey_JtHd8cjJqt4X4SvZx3bFzSPVni_2 2023-10-05T11:49:36.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.642+0000 7fcae6f29880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.14963464036705732572', time=2023-10-05T13:49:18.702258+0000, chain.objs.size()=1 2023-10-05T11:49:36.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.642+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.109__shadow_.HdNfanZmgxTmYh8V3IhqF_ryF9WRQDE_0 2023-10-05T11:49:36.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.642+0000 7fcae6f29880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.11549542010816460608', time=2023-10-05T13:49:24.298998+0000, chain.objs.size()=1 2023-10-05T11:49:36.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.642+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.118__shadow_.4zmckAwYfmwcRMzZUGxjenYNPwEuwDo_0 2023-10-05T11:49:36.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.642+0000 7fcae6f29880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.580347098100668582', time=2023-10-05T13:49:33.004521+0000, chain.objs.size()=9 2023-10-05T11:49:36.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.642+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.131__multipart_key1.2~ibbSw9-tq86oVhkn1XZLNf_A4Pt1LRR.1 2023-10-05T11:49:36.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.642+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.131__shadow_key1.2~ibbSw9-tq86oVhkn1XZLNf_A4Pt1LRR.1_1 2023-10-05T11:49:36.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.642+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.131__multipart_key1.2~ibbSw9-tq86oVhkn1XZLNf_A4Pt1LRR.2 2023-10-05T11:49:36.647 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.642+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.131__shadow_key1.2~ibbSw9-tq86oVhkn1XZLNf_A4Pt1LRR.2_1 2023-10-05T11:49:36.647 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.642+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.131__multipart_key1.2~ibbSw9-tq86oVhkn1XZLNf_A4Pt1LRR.3 2023-10-05T11:49:36.647 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.642+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.131__shadow_key1.2~ibbSw9-tq86oVhkn1XZLNf_A4Pt1LRR.3_1 2023-10-05T11:49:36.647 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.642+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.131__multipart_key1.2~ibbSw9-tq86oVhkn1XZLNf_A4Pt1LRR.4 2023-10-05T11:49:36.648 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.646+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.131__shadow_key1.2~ibbSw9-tq86oVhkn1XZLNf_A4Pt1LRR.4_1 2023-10-05T11:49:36.651 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.649+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.131__multipart_key1.2~ibbSw9-tq86oVhkn1XZLNf_A4Pt1LRR.5 2023-10-05T11:49:36.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.651+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing entries, marker: 2023-10-05T11:49:36.656 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.653+0000 7fcae6f29880 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2023-10-05T11:49:36.657 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.655+0000 7fcae6f29880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:49:36.657 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.655+0000 7fcae6f29880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:49:36.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.656+0000 7fcae6f29880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2023-10-05T11:49:36.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.656+0000 7fcae6f29880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.18248243219425304647', time=2023-10-05T13:48:14.924222+0000, chain.objs.size()=9 2023-10-05T11:49:36.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.656+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.82__multipart_key1.2~cV_T1eFq0XYJUZFKoy6UJY1N02N7sGe.1 2023-10-05T11:49:36.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.656+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.82__shadow_key1.2~cV_T1eFq0XYJUZFKoy6UJY1N02N7sGe.1_1 2023-10-05T11:49:36.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.656+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.82__multipart_key1.2~cV_T1eFq0XYJUZFKoy6UJY1N02N7sGe.2 2023-10-05T11:49:36.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.656+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.82__shadow_key1.2~cV_T1eFq0XYJUZFKoy6UJY1N02N7sGe.2_1 2023-10-05T11:49:36.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.656+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.82__multipart_key1.2~cV_T1eFq0XYJUZFKoy6UJY1N02N7sGe.3 2023-10-05T11:49:36.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.656+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.82__shadow_key1.2~cV_T1eFq0XYJUZFKoy6UJY1N02N7sGe.3_1 2023-10-05T11:49:36.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.656+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.82__multipart_key1.2~cV_T1eFq0XYJUZFKoy6UJY1N02N7sGe.4 2023-10-05T11:49:36.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.656+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.82__shadow_key1.2~cV_T1eFq0XYJUZFKoy6UJY1N02N7sGe.4_1 2023-10-05T11:49:36.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.656+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.82__multipart_key1.2~cV_T1eFq0XYJUZFKoy6UJY1N02N7sGe.5 2023-10-05T11:49:36.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.656+0000 7fcae6f29880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.7220757144972325518', time=2023-10-05T13:48:33.690295+0000, chain.objs.size()=1 2023-10-05T11:49:36.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.656+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.88__shadow_.pU3Xx9ZESCcWCVgq6-dKgcNGzK9hupS_0 2023-10-05T11:49:36.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.656+0000 7fcae6f29880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.50172952889204305', time=2023-10-05T13:49:24.888891+0000, chain.objs.size()=1 2023-10-05T11:49:36.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.656+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.119__shadow_.fzSNt4eHgNaCm-ylSBLWEXbmr7YpAHF_0 2023-10-05T11:49:36.666 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.662+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing entries, marker: 2023-10-05T11:49:36.666 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.664+0000 7fcae6f29880 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2023-10-05T11:49:36.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.665+0000 7fcae6f29880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:49:36.668 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.666+0000 7fcae6f29880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:49:36.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.666+0000 7fcae6f29880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=8, truncated=0, next_marker='' 2023-10-05T11:49:36.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.666+0000 7fcae6f29880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.11930823906546034485', time=2023-10-05T13:48:21.243083+0000, chain.objs.size()=7 2023-10-05T11:49:36.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.666+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.82__multipart_key1.2~psyXH0Fra0ogzE4I9qyqJYx4_d94vS6.1 2023-10-05T11:49:36.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.666+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.82__shadow_key1.2~psyXH0Fra0ogzE4I9qyqJYx4_d94vS6.1_1 2023-10-05T11:49:36.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.666+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.82__shadow_key1.2~psyXH0Fra0ogzE4I9qyqJYx4_d94vS6.1_2 2023-10-05T11:49:36.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.666+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.82__multipart_key1.2~psyXH0Fra0ogzE4I9qyqJYx4_d94vS6.2 2023-10-05T11:49:36.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.666+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.82__shadow_key1.2~psyXH0Fra0ogzE4I9qyqJYx4_d94vS6.2_1 2023-10-05T11:49:36.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.666+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.82__shadow_key1.2~psyXH0Fra0ogzE4I9qyqJYx4_d94vS6.2_2 2023-10-05T11:49:36.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.666+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.82__multipart_key1.2~psyXH0Fra0ogzE4I9qyqJYx4_d94vS6.3 2023-10-05T11:49:36.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.666+0000 7fcae6f29880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.14846606646340834955', time=2023-10-05T13:48:48.852836+0000, chain.objs.size()=7 2023-10-05T11:49:36.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.666+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.90__multipart_key1.2~PIcbAUXFvW1ZCKEW07Jzww8cGTCIGm-.1 2023-10-05T11:49:36.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.666+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.90__shadow_key1.2~PIcbAUXFvW1ZCKEW07Jzww8cGTCIGm-.1_1 2023-10-05T11:49:36.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.666+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.90__shadow_key1.2~PIcbAUXFvW1ZCKEW07Jzww8cGTCIGm-.1_2 2023-10-05T11:49:36.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.666+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.90__multipart_key1.2~PIcbAUXFvW1ZCKEW07Jzww8cGTCIGm-.2 2023-10-05T11:49:36.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.666+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.90__shadow_key1.2~PIcbAUXFvW1ZCKEW07Jzww8cGTCIGm-.2_1 2023-10-05T11:49:36.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.670+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.90__shadow_key1.2~PIcbAUXFvW1ZCKEW07Jzww8cGTCIGm-.2_2 2023-10-05T11:49:36.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.671+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.90__multipart_key1.2~PIcbAUXFvW1ZCKEW07Jzww8cGTCIGm-.3 2023-10-05T11:49:36.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.671+0000 7fcae6f29880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.2482337920618634460', time=2023-10-05T13:49:14.295474+0000, chain.objs.size()=1 2023-10-05T11:49:36.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.671+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.102__shadow_.UkGA5aw8q3LWChnuBRWQYrUW5QMARFi_0 2023-10-05T11:49:36.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.671+0000 7fcae6f29880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.3123908106990110521', time=2023-10-05T13:49:14.905101+0000, chain.objs.size()=1 2023-10-05T11:49:36.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.671+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.103__shadow_.DI_pqxmiIBJAHdx8xoPrU694x5H60rk_0 2023-10-05T11:49:36.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.671+0000 7fcae6f29880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.6314088509611475954', time=2023-10-05T13:49:15.531963+0000, chain.objs.size()=1 2023-10-05T11:49:36.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.671+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.104__shadow_.MSmrGl19qU2a5PP7fC-_pd35s3PWHbB_0 2023-10-05T11:49:36.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.671+0000 7fcae6f29880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.8330711843304882505', time=2023-10-05T13:49:21.183749+0000, chain.objs.size()=1 2023-10-05T11:49:36.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.671+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.113__shadow_.4fkzN9ep6FSSFPNIRR-pQwZKEuFLCZN_0 2023-10-05T11:49:36.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.671+0000 7fcae6f29880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.9722841834772627819', time=2023-10-05T13:49:22.463552+0000, chain.objs.size()=1 2023-10-05T11:49:36.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.671+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.115__shadow_.2PTFuyEOxVbgZlcYK_1BiR22y7cvrXe_0 2023-10-05T11:49:36.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.671+0000 7fcae6f29880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.3194731172979070275', time=2023-10-05T13:49:28.228388+0000, chain.objs.size()=1 2023-10-05T11:49:36.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.671+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.126__shadow_.CReRXgz-aYpP72oL08Ri3CToJPRYUQF_0 2023-10-05T11:49:36.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.677+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing entries, marker: 2023-10-05T11:49:36.682 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.680+0000 7fcae6f29880 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2023-10-05T11:49:36.683 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.681+0000 7fcae6f29880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:49:36.683 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.681+0000 7fcae6f29880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:49:36.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.682+0000 7fcae6f29880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2023-10-05T11:49:36.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.682+0000 7fcae6f29880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.3705942165481732277', time=2023-10-05T13:48:42.930491+0000, chain.objs.size()=9 2023-10-05T11:49:36.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.682+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.90__multipart_key1.2~HUMXZtItZupv5knsm5gBdInuWX8VWkv.1 2023-10-05T11:49:36.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.682+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.90__shadow_key1.2~HUMXZtItZupv5knsm5gBdInuWX8VWkv.1_1 2023-10-05T11:49:36.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.682+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.90__multipart_key1.2~HUMXZtItZupv5knsm5gBdInuWX8VWkv.2 2023-10-05T11:49:36.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.682+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.90__shadow_key1.2~HUMXZtItZupv5knsm5gBdInuWX8VWkv.2_1 2023-10-05T11:49:36.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.682+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.90__multipart_key1.2~HUMXZtItZupv5knsm5gBdInuWX8VWkv.3 2023-10-05T11:49:36.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.682+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.90__shadow_key1.2~HUMXZtItZupv5knsm5gBdInuWX8VWkv.3_1 2023-10-05T11:49:36.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.682+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.90__multipart_key1.2~HUMXZtItZupv5knsm5gBdInuWX8VWkv.4 2023-10-05T11:49:36.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.682+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.90__shadow_key1.2~HUMXZtItZupv5knsm5gBdInuWX8VWkv.4_1 2023-10-05T11:49:36.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.682+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.90__multipart_key1.2~HUMXZtItZupv5knsm5gBdInuWX8VWkv.5 2023-10-05T11:49:36.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.682+0000 7fcae6f29880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.1891424791721014747', time=2023-10-05T13:49:16.196870+0000, chain.objs.size()=1 2023-10-05T11:49:36.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.682+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.105__shadow_.kxLyAfM4l4_WqKtPoORVp7tzOC-DDAe_0 2023-10-05T11:49:36.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.682+0000 7fcae6f29880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.3467088119812526215', time=2023-10-05T13:49:20.550598+0000, chain.objs.size()=1 2023-10-05T11:49:36.686 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.682+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.112__shadow_.nArfp3s4exZkgUXQtRWo8FocQfrOdMb_0 2023-10-05T11:49:36.686 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.682+0000 7fcae6f29880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.16956384776532799625', time=2023-10-05T13:49:23.098871+0000, chain.objs.size()=1 2023-10-05T11:49:36.686 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.682+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.116__shadow_.iQedT2nRgLfzTrk334Tk-fPK5HcL32s_0 2023-10-05T11:49:36.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.687+0000 7fcae6f29880 20 garbage collection: RGWGC::process iterating over entry tag='dff27d1e-df33-400e-a68a-7ba586947c99.4543.11913305317262036656', time=2023-10-05T13:49:29.011578+0000, chain.objs.size()=1 2023-10-05T11:49:36.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.687+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dff27d1e-df33-400e-a68a-7ba586947c99.4604.127__shadow_.xnEnEipA6Ac2AJdVqICUIyfype8bOXS_0 2023-10-05T11:49:36.691 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.689+0000 7fcae6f29880 5 garbage collection: RGWGC::process removing entries, marker: 2023-10-05T11:49:36.694 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.692+0000 7fcaca7ce640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:49:36.696 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.694+0000 7fcae6f29880 20 remove_watcher() i=0 2023-10-05T11:49:36.696 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.694+0000 7fcae6f29880 2 removed watcher, disabling cache 2023-10-05T11:49:36.697 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.695+0000 7fcae6f29880 20 remove_watcher() i=1 2023-10-05T11:49:36.698 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.696+0000 7fcae6f29880 20 remove_watcher() i=2 2023-10-05T11:49:36.699 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.697+0000 7fcae6f29880 20 remove_watcher() i=3 2023-10-05T11:49:36.700 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.698+0000 7fcae6f29880 20 remove_watcher() i=4 2023-10-05T11:49:36.701 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.699+0000 7fcae6f29880 20 remove_watcher() i=5 2023-10-05T11:49:36.702 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.700+0000 7fcae6f29880 20 remove_watcher() i=6 2023-10-05T11:49:36.702 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.700+0000 7fcae6f29880 20 remove_watcher() i=7 2023-10-05T11:49:36.708 DEBUG:teuthology.orchestra.run.smithi012:> radosgw-admin gc process --include-all 2023-10-05T11:49:36.758 INFO:teuthology.orchestra.run.smithi012.stderr:ignoring --setuser ceph since I am not root 2023-10-05T11:49:36.758 INFO:teuthology.orchestra.run.smithi012.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T11:49:36.771 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.769+0000 7f2f94736880 20 rados->read ofs=0 len=0 2023-10-05T11:49:36.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.770+0000 7f2f94736880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:49:36.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.770+0000 7f2f94736880 20 realm 2023-10-05T11:49:36.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.770+0000 7f2f94736880 20 rados->read ofs=0 len=0 2023-10-05T11:49:36.773 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.770+0000 7f2f94736880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:49:36.773 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.770+0000 7f2f94736880 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T11:49:36.773 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.770+0000 7f2f94736880 20 rados->read ofs=0 len=0 2023-10-05T11:49:36.773 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.770+0000 7f2f94736880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:49:36.773 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.770+0000 7f2f94736880 20 rados->read ofs=0 len=0 2023-10-05T11:49:36.773 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.771+0000 7f2f94736880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:49:36.773 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.771+0000 7f2f94736880 20 rados->read ofs=0 len=0 2023-10-05T11:49:36.774 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.772+0000 7f2f94736880 20 rados_obj.operate() r=0 bl.length=1020 2023-10-05T11:49:36.774 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.772+0000 7f2f94736880 20 searching for the correct realm 2023-10-05T11:49:36.783 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.781+0000 7f2f9113f640 0 -- 172.21.15.12:0/4216349877 >> [v2:172.21.15.12:6800/732466381,v1:172.21.15.12:6801/732466381] conn(0x556367fcf800 msgr2=0x556367eeeb00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:49:36.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.782+0000 7f2f94736880 20 RGWRados::pool_iterate: got zone_info.dff27d1e-df33-400e-a68a-7ba586947c99 2023-10-05T11:49:36.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.782+0000 7f2f94736880 20 RGWRados::pool_iterate: got zonegroup_info.c78aa576-9d15-4e9d-b3c0-4af23a22062c 2023-10-05T11:49:36.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.782+0000 7f2f94736880 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T11:49:36.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.782+0000 7f2f94736880 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T11:49:36.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.782+0000 7f2f94736880 20 rados->read ofs=0 len=0 2023-10-05T11:49:36.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.783+0000 7f2f94736880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:49:36.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.783+0000 7f2f94736880 20 rados->read ofs=0 len=0 2023-10-05T11:49:36.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.783+0000 7f2f94736880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:49:36.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.783+0000 7f2f94736880 20 rados->read ofs=0 len=0 2023-10-05T11:49:36.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.783+0000 7f2f94736880 20 rados_obj.operate() r=0 bl.length=454 2023-10-05T11:49:36.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.783+0000 7f2f94736880 20 zone default found 2023-10-05T11:49:36.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.783+0000 7f2f94736880 4 Realm: () 2023-10-05T11:49:36.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.783+0000 7f2f94736880 4 ZoneGroup: default (c78aa576-9d15-4e9d-b3c0-4af23a22062c) 2023-10-05T11:49:36.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.783+0000 7f2f94736880 4 Zone: default (dff27d1e-df33-400e-a68a-7ba586947c99) 2023-10-05T11:49:36.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.783+0000 7f2f94736880 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T11:49:36.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.783+0000 7f2f94736880 20 zonegroup default 2023-10-05T11:49:36.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.783+0000 7f2f94736880 20 rados->read ofs=0 len=0 2023-10-05T11:49:36.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.784+0000 7f2f94736880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:49:36.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.784+0000 7f2f94736880 20 rados->read ofs=0 len=0 2023-10-05T11:49:36.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.784+0000 7f2f94736880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:49:36.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.784+0000 7f2f94736880 20 rados->read ofs=0 len=0 2023-10-05T11:49:36.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.784+0000 7f2f94736880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:49:36.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.784+0000 7f2f94736880 20 started sync module instance, tier type = 2023-10-05T11:49:36.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.784+0000 7f2f94736880 20 started zone id=dff27d1e-df33-400e-a68a-7ba586947c99 (name=default) with tier type = 2023-10-05T11:49:36.791 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.789+0000 7f2f9113f640 0 -- 172.21.15.12:0/4216349877 >> [v2:172.21.15.12:6800/732466381,v1:172.21.15.12:6801/732466381] conn(0x556367fef000 msgr2=0x556367ef0100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:49:36.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.793+0000 7f2f94736880 20 add_watcher() i=0 2023-10-05T11:49:36.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.793+0000 7f2f94736880 20 add_watcher() i=1 2023-10-05T11:49:36.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.793+0000 7f2f94736880 20 add_watcher() i=2 2023-10-05T11:49:36.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.793+0000 7f2f94736880 20 add_watcher() i=3 2023-10-05T11:49:36.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.793+0000 7f2f94736880 20 add_watcher() i=4 2023-10-05T11:49:36.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.793+0000 7f2f94736880 20 add_watcher() i=5 2023-10-05T11:49:36.796 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.793+0000 7f2f94736880 20 add_watcher() i=6 2023-10-05T11:49:36.796 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.794+0000 7f2f94736880 20 add_watcher() i=7 2023-10-05T11:49:36.796 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.794+0000 7f2f94736880 2 all 8 watchers are set, enabling cache 2023-10-05T11:49:36.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.795+0000 7f2f7810d640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:49:36.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.795+0000 7f2f94736880 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T11:49:36.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.795+0000 7f2f94736880 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T11:49:36.837 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.835+0000 7f2f73904640 20 reqs_thread_entry: start 2023-10-05T11:49:36.838 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.835+0000 7f2f94736880 20 init_complete bucket index max shards: 11 2023-10-05T11:49:36.838 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.835+0000 7f2f94736880 20 Filter name: none 2023-10-05T11:49:36.838 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.835+0000 7f2f71900640 20 reqs_thread_entry: start 2023-10-05T11:49:36.838 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.835+0000 7f2f94736880 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2023-10-05T11:49:36.838 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.836+0000 7f2f94736880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:49:36.839 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.837+0000 7f2f94736880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:49:36.839 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.837+0000 7f2f94736880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:49:36.840 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.838+0000 7f2f94736880 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2023-10-05T11:49:36.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.839+0000 7f2f94736880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:49:36.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.839+0000 7f2f94736880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:49:36.842 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.840+0000 7f2f94736880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:49:36.843 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.841+0000 7f2f94736880 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2023-10-05T11:49:36.844 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.842+0000 7f2f94736880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:49:36.845 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.843+0000 7f2f94736880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:49:36.845 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.843+0000 7f2f94736880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:49:36.846 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.844+0000 7f2f94736880 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2023-10-05T11:49:36.847 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.845+0000 7f2f94736880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:49:36.848 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.846+0000 7f2f94736880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:49:36.848 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.846+0000 7f2f94736880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:49:36.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.847+0000 7f2f94736880 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2023-10-05T11:49:36.850 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.848+0000 7f2f94736880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:49:36.851 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.848+0000 7f2f94736880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:49:36.851 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.849+0000 7f2f94736880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:49:36.851 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.849+0000 7f2f94736880 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2023-10-05T11:49:36.853 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.851+0000 7f2f94736880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:49:36.854 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.851+0000 7f2f94736880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:49:36.854 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.852+0000 7f2f94736880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:49:36.855 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.853+0000 7f2f94736880 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2023-10-05T11:49:36.856 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.854+0000 7f2f94736880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:49:36.856 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.854+0000 7f2f94736880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:49:36.857 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.854+0000 7f2f94736880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:49:36.858 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.856+0000 7f2f94736880 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2023-10-05T11:49:36.859 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.857+0000 7f2f94736880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:49:36.860 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.857+0000 7f2f94736880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:49:36.860 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.857+0000 7f2f94736880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:49:36.860 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.858+0000 7f2f94736880 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2023-10-05T11:49:36.862 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.860+0000 7f2f94736880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:49:36.862 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.860+0000 7f2f94736880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:49:36.862 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.860+0000 7f2f94736880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:49:36.863 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.861+0000 7f2f94736880 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2023-10-05T11:49:36.865 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.863+0000 7f2f94736880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:49:36.865 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.863+0000 7f2f94736880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:49:36.865 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.863+0000 7f2f94736880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:49:36.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.864+0000 7f2f94736880 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2023-10-05T11:49:36.870 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.865+0000 7f2f94736880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:49:36.870 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.866+0000 7f2f94736880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:49:36.870 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.866+0000 7f2f94736880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:49:36.870 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.867+0000 7f2f94736880 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2023-10-05T11:49:36.871 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.868+0000 7f2f94736880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:49:36.871 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.868+0000 7f2f94736880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:49:36.871 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.869+0000 7f2f94736880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:49:36.872 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.870+0000 7f2f94736880 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2023-10-05T11:49:36.873 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.871+0000 7f2f94736880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:49:36.874 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.872+0000 7f2f94736880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:49:36.874 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.872+0000 7f2f94736880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:49:36.876 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.874+0000 7f2f94736880 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2023-10-05T11:49:36.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.875+0000 7f2f94736880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:49:36.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.875+0000 7f2f94736880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:49:36.878 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.875+0000 7f2f94736880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:49:36.878 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.876+0000 7f2f94736880 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2023-10-05T11:49:36.880 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.878+0000 7f2f94736880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:49:36.880 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.878+0000 7f2f94736880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:49:36.881 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.879+0000 7f2f94736880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:49:36.882 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.880+0000 7f2f94736880 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2023-10-05T11:49:36.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.881+0000 7f2f94736880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:49:36.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.881+0000 7f2f94736880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:49:36.884 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.882+0000 7f2f94736880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:49:36.885 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.883+0000 7f2f94736880 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2023-10-05T11:49:36.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.884+0000 7f2f94736880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:49:36.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.884+0000 7f2f94736880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:49:36.887 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.885+0000 7f2f94736880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:49:36.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.886+0000 7f2f94736880 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2023-10-05T11:49:36.889 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.887+0000 7f2f94736880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:49:36.890 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.888+0000 7f2f94736880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:49:36.890 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.888+0000 7f2f94736880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:49:36.891 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.889+0000 7f2f94736880 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2023-10-05T11:49:36.892 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.890+0000 7f2f94736880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:49:36.893 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.890+0000 7f2f94736880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:49:36.893 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.891+0000 7f2f94736880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:49:36.893 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.891+0000 7f2f94736880 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2023-10-05T11:49:36.895 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.893+0000 7f2f94736880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:49:36.895 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.893+0000 7f2f94736880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:49:36.896 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.894+0000 7f2f94736880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:49:36.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.895+0000 7f2f94736880 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2023-10-05T11:49:36.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.896+0000 7f2f94736880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:49:36.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.896+0000 7f2f94736880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:49:36.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.897+0000 7f2f94736880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:49:36.900 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.898+0000 7f2f94736880 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2023-10-05T11:49:36.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.899+0000 7f2f94736880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:49:36.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.899+0000 7f2f94736880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:49:36.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.899+0000 7f2f94736880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:49:36.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.900+0000 7f2f94736880 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2023-10-05T11:49:36.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.902+0000 7f2f94736880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:49:36.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.902+0000 7f2f94736880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:49:36.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.902+0000 7f2f94736880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:49:36.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.903+0000 7f2f94736880 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2023-10-05T11:49:36.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.904+0000 7f2f94736880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:49:36.907 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.905+0000 7f2f94736880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:49:36.907 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.905+0000 7f2f94736880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:49:36.908 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.906+0000 7f2f94736880 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2023-10-05T11:49:36.909 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.907+0000 7f2f94736880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:49:36.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.908+0000 7f2f94736880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:49:36.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.908+0000 7f2f94736880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:49:36.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.909+0000 7f2f94736880 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2023-10-05T11:49:36.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.910+0000 7f2f94736880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:49:36.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.911+0000 7f2f94736880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:49:36.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.911+0000 7f2f94736880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:49:36.914 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.912+0000 7f2f94736880 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2023-10-05T11:49:36.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.914+0000 7f2f94736880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:49:36.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.914+0000 7f2f94736880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:49:36.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.914+0000 7f2f94736880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:49:36.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.915+0000 7f2f94736880 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2023-10-05T11:49:36.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.916+0000 7f2f94736880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:49:36.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.917+0000 7f2f94736880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:49:36.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.917+0000 7f2f94736880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:49:36.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.919+0000 7f2f94736880 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2023-10-05T11:49:36.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.920+0000 7f2f94736880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:49:36.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.920+0000 7f2f94736880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:49:36.923 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.920+0000 7f2f94736880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:49:36.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.922+0000 7f2f94736880 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2023-10-05T11:49:36.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.923+0000 7f2f94736880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:49:36.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.923+0000 7f2f94736880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:49:36.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.924+0000 7f2f94736880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:49:36.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.925+0000 7f2f94736880 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2023-10-05T11:49:36.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.926+0000 7f2f94736880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:49:36.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.926+0000 7f2f94736880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:49:36.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.927+0000 7f2f94736880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:49:36.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.928+0000 7f2f94736880 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2023-10-05T11:49:36.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.929+0000 7f2f94736880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:49:36.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.929+0000 7f2f94736880 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-10-05T11:49:36.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.930+0000 7f2f94736880 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-10-05T11:49:36.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.931+0000 7f2f7810d640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:49:36.935 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.933+0000 7f2f94736880 20 remove_watcher() i=0 2023-10-05T11:49:36.936 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.933+0000 7f2f94736880 2 removed watcher, disabling cache 2023-10-05T11:49:36.937 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.935+0000 7f2f94736880 20 remove_watcher() i=1 2023-10-05T11:49:36.937 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.936+0000 7f2f94736880 20 remove_watcher() i=2 2023-10-05T11:49:36.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.936+0000 7f2f94736880 20 remove_watcher() i=3 2023-10-05T11:49:36.939 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.937+0000 7f2f94736880 20 remove_watcher() i=4 2023-10-05T11:49:36.940 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.938+0000 7f2f94736880 20 remove_watcher() i=5 2023-10-05T11:49:36.941 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.939+0000 7f2f94736880 20 remove_watcher() i=6 2023-10-05T11:49:36.942 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:36.940+0000 7f2f94736880 20 remove_watcher() i=7 2023-10-05T11:49:36.947 INFO:teuthology.run_tasks:Running task s3tests... 2023-10-05T11:49:36.963 DEBUG:tasks.s3tests:s3tests config is {'client.0': {'rgw_server': 'client.0', 'force-branch': 'ceph-master', 'slow_backend': True, 'storage classes': 'LUKEWARM, FROZEN'}} 2023-10-05T11:49:36.963 INFO:tasks.s3tests:Downloading s3-tests... 2023-10-05T11:49:36.963 INFO:tasks.s3tests:Using branch 'ceph-master' for s3tests 2023-10-05T11:49:36.963 DEBUG:teuthology.orchestra.run.smithi012:> git clone -b ceph-master https://git.ceph.com/s3-tests.git /home/ubuntu/cephtest/s3-tests-client.0 2023-10-05T11:49:36.991 INFO:teuthology.orchestra.run.smithi012.stderr:Cloning into '/home/ubuntu/cephtest/s3-tests-client.0'... 2023-10-05T11:49:37.641 INFO:tasks.s3tests:Creating rgw users... 2023-10-05T11:49:37.641 DEBUG:tasks.s3tests:Creating user foo.client.0 on client.0 2023-10-05T11:49:37.642 DEBUG:teuthology.orchestra.run.smithi012:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid foo.client.0 --display-name 'Mr. foo.client.0' --email foo.client.0+test@test.test --caps 'user-policy=*' --access-key XGALBBKCGPJXBQDNBQJM --secret GsujILqwm7WQW7BH+fopFjSzBl+uh8MRwsbD/ZVTXs+ukFPGYRSzWg== --cluster ceph 2023-10-05T11:49:37.746 INFO:teuthology.orchestra.run.smithi012.stderr:ignoring --setuser ceph since I am not root 2023-10-05T11:49:37.747 INFO:teuthology.orchestra.run.smithi012.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T11:49:37.757 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:37.755+0000 7f126b326880 20 rados->read ofs=0 len=0 2023-10-05T11:49:37.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:37.757+0000 7f126b326880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:49:37.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:37.757+0000 7f126b326880 20 realm 2023-10-05T11:49:37.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:37.757+0000 7f126b326880 20 rados->read ofs=0 len=0 2023-10-05T11:49:37.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:37.757+0000 7f126b326880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:49:37.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:37.757+0000 7f126b326880 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T11:49:37.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:37.757+0000 7f126b326880 20 rados->read ofs=0 len=0 2023-10-05T11:49:37.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:37.757+0000 7f126b326880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:49:37.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:37.757+0000 7f126b326880 20 rados->read ofs=0 len=0 2023-10-05T11:49:37.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:37.758+0000 7f126b326880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:49:37.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:37.758+0000 7f126b326880 20 rados->read ofs=0 len=0 2023-10-05T11:49:37.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:37.759+0000 7f126b326880 20 rados_obj.operate() r=0 bl.length=1020 2023-10-05T11:49:37.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:37.759+0000 7f126b326880 20 searching for the correct realm 2023-10-05T11:49:37.771 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:37.768+0000 7f12683d9640 0 -- 172.21.15.12:0/2945619372 >> [v2:172.21.15.12:6813/3341239609,v1:172.21.15.12:6815/3341239609] conn(0x561d67f32000 msgr2=0x561d67e29600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:49:37.773 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:37.771+0000 7f126b326880 20 RGWRados::pool_iterate: got zone_info.dff27d1e-df33-400e-a68a-7ba586947c99 2023-10-05T11:49:37.773 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:37.771+0000 7f126b326880 20 RGWRados::pool_iterate: got zonegroup_info.c78aa576-9d15-4e9d-b3c0-4af23a22062c 2023-10-05T11:49:37.773 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:37.771+0000 7f126b326880 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T11:49:37.774 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:37.771+0000 7f126b326880 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T11:49:37.774 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:37.771+0000 7f126b326880 20 rados->read ofs=0 len=0 2023-10-05T11:49:37.774 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:37.771+0000 7f126b326880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:49:37.774 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:37.771+0000 7f126b326880 20 rados->read ofs=0 len=0 2023-10-05T11:49:37.775 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:37.771+0000 7f126b326880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:49:37.775 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:37.771+0000 7f126b326880 20 rados->read ofs=0 len=0 2023-10-05T11:49:37.775 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:37.772+0000 7f126b326880 20 rados_obj.operate() r=0 bl.length=454 2023-10-05T11:49:37.776 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:37.772+0000 7f126b326880 20 zone default found 2023-10-05T11:49:37.776 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:37.772+0000 7f126b326880 4 Realm: () 2023-10-05T11:49:37.776 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:37.772+0000 7f126b326880 4 ZoneGroup: default (c78aa576-9d15-4e9d-b3c0-4af23a22062c) 2023-10-05T11:49:37.776 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:37.772+0000 7f126b326880 4 Zone: default (dff27d1e-df33-400e-a68a-7ba586947c99) 2023-10-05T11:49:37.776 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:37.772+0000 7f126b326880 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T11:49:37.776 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:37.772+0000 7f126b326880 20 zonegroup default 2023-10-05T11:49:37.776 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:37.772+0000 7f126b326880 20 rados->read ofs=0 len=0 2023-10-05T11:49:37.776 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:37.772+0000 7f126b326880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:49:37.776 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:37.772+0000 7f126b326880 20 rados->read ofs=0 len=0 2023-10-05T11:49:37.776 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:37.773+0000 7f126b326880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:49:37.777 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:37.773+0000 7f126b326880 20 rados->read ofs=0 len=0 2023-10-05T11:49:37.777 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:37.773+0000 7f126b326880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:49:37.777 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:37.773+0000 7f126b326880 20 started sync module instance, tier type = 2023-10-05T11:49:37.777 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:37.773+0000 7f126b326880 20 started zone id=dff27d1e-df33-400e-a68a-7ba586947c99 (name=default) with tier type = 2023-10-05T11:49:37.778 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:37.776+0000 7f1267bd8640 0 -- 172.21.15.12:0/2945619372 >> [v2:172.21.15.12:6800/732466381,v1:172.21.15.12:6801/732466381] conn(0x561d67f18400 msgr2=0x561d67e28b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-10-05T11:49:37.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:37.984+0000 7f126b326880 20 add_watcher() i=0 2023-10-05T11:49:37.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:37.984+0000 7f126b326880 20 add_watcher() i=1 2023-10-05T11:49:37.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:37.984+0000 7f126b326880 20 add_watcher() i=2 2023-10-05T11:49:37.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:37.984+0000 7f126b326880 20 add_watcher() i=3 2023-10-05T11:49:37.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:37.984+0000 7f126b326880 20 add_watcher() i=4 2023-10-05T11:49:37.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:37.984+0000 7f126b326880 20 add_watcher() i=5 2023-10-05T11:49:37.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:37.984+0000 7f126b326880 20 add_watcher() i=6 2023-10-05T11:49:37.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:37.985+0000 7f126b326880 20 add_watcher() i=7 2023-10-05T11:49:37.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:37.985+0000 7f126b326880 2 all 8 watchers are set, enabling cache 2023-10-05T11:49:37.989 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:37.986+0000 7f124eba6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:49:37.989 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:37.986+0000 7f126b326880 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T11:49:37.989 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:37.986+0000 7f126b326880 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T11:49:37.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:37.991+0000 7f126b326880 5 note: GC not initialized 2023-10-05T11:49:37.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:37.992+0000 7f124a39d640 20 reqs_thread_entry: start 2023-10-05T11:49:37.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:37.992+0000 7f126b326880 20 init_complete bucket index max shards: 11 2023-10-05T11:49:37.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:37.992+0000 7f126b326880 20 Filter name: none 2023-10-05T11:49:37.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:37.992+0000 7f1248399640 20 reqs_thread_entry: start 2023-10-05T11:49:37.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:37.992+0000 7f126b326880 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : miss 2023-10-05T11:49:37.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:37.992+0000 7f126b326880 20 rados->read ofs=0 len=0 2023-10-05T11:49:37.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:37.992+0000 7f126b326880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:49:37.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:37.992+0000 7f126b326880 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x0 2023-10-05T11:49:37.996 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:37.992+0000 7f126b326880 10 adding default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2023-10-05T11:49:37.996 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:37.992+0000 7f126b326880 10 cache get: name=default.rgw.meta+users.email+foo.client.0+test@test.test : miss 2023-10-05T11:49:37.996 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:37.992+0000 7f126b326880 20 rados->read ofs=0 len=0 2023-10-05T11:49:37.997 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:37.993+0000 7f126b326880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:49:37.997 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:37.993+0000 7f126b326880 10 cache put: name=default.rgw.meta+users.email+foo.client.0+test@test.test info.flags=0x0 2023-10-05T11:49:37.997 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:37.993+0000 7f126b326880 10 adding default.rgw.meta+users.email+foo.client.0+test@test.test to cache LRU end 2023-10-05T11:49:37.997 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:37.993+0000 7f126b326880 10 cache get: name=default.rgw.meta+users.keys+XGALBBKCGPJXBQDNBQJM : miss 2023-10-05T11:49:37.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:37.993+0000 7f126b326880 20 rados->read ofs=0 len=0 2023-10-05T11:49:37.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:37.993+0000 7f126b326880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:49:37.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:37.993+0000 7f126b326880 10 cache put: name=default.rgw.meta+users.keys+XGALBBKCGPJXBQDNBQJM info.flags=0x0 2023-10-05T11:49:37.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:37.993+0000 7f126b326880 10 adding default.rgw.meta+users.keys+XGALBBKCGPJXBQDNBQJM to cache LRU end 2023-10-05T11:49:37.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:37.993+0000 7f126b326880 10 cache get: name=default.rgw.meta+users.keys+XGALBBKCGPJXBQDNBQJM : hit (negative entry) 2023-10-05T11:49:37.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:37.993+0000 7f126b326880 10 cache get: name=default.rgw.meta+users.keys+XGALBBKCGPJXBQDNBQJM : hit (negative entry) 2023-10-05T11:49:37.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:37.994+0000 7f126b326880 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2023-10-05T11:49:37.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:37.994+0000 7f126b326880 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2023-10-05T11:49:37.999 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:37.994+0000 7f126b326880 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.uid:foo.client.0, ofs0, ns] 2023-10-05T11:49:37.999 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:37.995+0000 7f12623cd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1060856922318 cookie 94684297927680 notifier 7240 bl.length()=640 2023-10-05T11:49:37.999 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:37.995+0000 7f12623cd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2023-10-05T11:49:37.999 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:37.995+0000 7f12623cd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2023-10-05T11:49:38.000 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:37.998+0000 7f126b326880 10 cache put: name=default.rgw.meta+users.email+foo.client.0+test@test.test info.flags=0x7 2023-10-05T11:49:38.000 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:37.998+0000 7f126b326880 10 moving default.rgw.meta+users.email+foo.client.0+test@test.test to cache LRU end 2023-10-05T11:49:38.000 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:37.998+0000 7f126b326880 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.email:foo.client.0+test@test.test, ofs0, ns] 2023-10-05T11:49:38.000 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:37.998+0000 7f12623cd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1060856922303 cookie 94684298034176 notifier 7240 bl.length()=194 2023-10-05T11:49:38.000 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:37.998+0000 7f12623cd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foo.client.0+test@test.test info.flags=0x7 2023-10-05T11:49:38.000 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:37.998+0000 7f12623cd640 10 rgw watcher librados: moving default.rgw.meta+users.email+foo.client.0+test@test.test to cache LRU end 2023-10-05T11:49:38.003 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:38.001+0000 7f126b326880 10 cache put: name=default.rgw.meta+users.keys+XGALBBKCGPJXBQDNBQJM info.flags=0x7 2023-10-05T11:49:38.003 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:38.001+0000 7f126b326880 10 moving default.rgw.meta+users.keys+XGALBBKCGPJXBQDNBQJM to cache LRU end 2023-10-05T11:49:38.003 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:38.001+0000 7f126b326880 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:XGALBBKCGPJXBQDNBQJM, ofs0, ns] 2023-10-05T11:49:38.004 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:38.001+0000 7f12623cd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1060856922244 cookie 94684298030080 notifier 7240 bl.length()=186 2023-10-05T11:49:38.004 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:38.001+0000 7f12623cd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+XGALBBKCGPJXBQDNBQJM info.flags=0x7 2023-10-05T11:49:38.004 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:38.001+0000 7f12623cd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+XGALBBKCGPJXBQDNBQJM to cache LRU end 2023-10-05T11:49:38.005 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-10-05T11:49:38.005 INFO:teuthology.orchestra.run.smithi012.stdout: "user_id": "foo.client.0", 2023-10-05T11:49:38.005 INFO:teuthology.orchestra.run.smithi012.stdout: "display_name": "Mr. foo.client.0", 2023-10-05T11:49:38.005 INFO:teuthology.orchestra.run.smithi012.stdout: "email": "foo.client.0+test@test.test", 2023-10-05T11:49:38.005 INFO:teuthology.orchestra.run.smithi012.stdout: "suspended": 0, 2023-10-05T11:49:38.005 INFO:teuthology.orchestra.run.smithi012.stdout: "max_buckets": 1000, 2023-10-05T11:49:38.005 INFO:teuthology.orchestra.run.smithi012.stdout: "subusers": [], 2023-10-05T11:49:38.006 INFO:teuthology.orchestra.run.smithi012.stdout: "keys": [ 2023-10-05T11:49:38.006 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-05T11:49:38.006 INFO:teuthology.orchestra.run.smithi012.stdout: "user": "foo.client.0", 2023-10-05T11:49:38.006 INFO:teuthology.orchestra.run.smithi012.stdout: "access_key": "XGALBBKCGPJXBQDNBQJM", 2023-10-05T11:49:38.006 INFO:teuthology.orchestra.run.smithi012.stdout: "secret_key": "GsujILqwm7WQW7BH+fopFjSzBl+uh8MRwsbD/ZVTXs+ukFPGYRSzWg==" 2023-10-05T11:49:38.006 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-05T11:49:38.006 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-10-05T11:49:38.006 INFO:teuthology.orchestra.run.smithi012.stdout: "swift_keys": [], 2023-10-05T11:49:38.006 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": [ 2023-10-05T11:49:38.007 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-05T11:49:38.007 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "user-policy", 2023-10-05T11:49:38.007 INFO:teuthology.orchestra.run.smithi012.stdout: "perm": "*" 2023-10-05T11:49:38.007 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-05T11:49:38.007 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-10-05T11:49:38.007 INFO:teuthology.orchestra.run.smithi012.stdout: "op_mask": "read, write, delete", 2023-10-05T11:49:38.007 INFO:teuthology.orchestra.run.smithi012.stdout: "default_placement": "", 2023-10-05T11:49:38.007 INFO:teuthology.orchestra.run.smithi012.stdout: "default_storage_class": "", 2023-10-05T11:49:38.007 INFO:teuthology.orchestra.run.smithi012.stdout: "placement_tags": [], 2023-10-05T11:49:38.007 INFO:teuthology.orchestra.run.smithi012.stdout: "bucket_quota": { 2023-10-05T11:49:38.007 INFO:teuthology.orchestra.run.smithi012.stdout: "enabled": false, 2023-10-05T11:49:38.007 INFO:teuthology.orchestra.run.smithi012.stdout: "check_on_raw": false, 2023-10-05T11:49:38.008 INFO:teuthology.orchestra.run.smithi012.stdout: "max_size": -1, 2023-10-05T11:49:38.008 INFO:teuthology.orchestra.run.smithi012.stdout: "max_size_kb": 0, 2023-10-05T11:49:38.008 INFO:teuthology.orchestra.run.smithi012.stdout: "max_objects": -1 2023-10-05T11:49:38.008 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-05T11:49:38.008 INFO:teuthology.orchestra.run.smithi012.stdout: "user_quota": { 2023-10-05T11:49:38.008 INFO:teuthology.orchestra.run.smithi012.stdout: "enabled": false, 2023-10-05T11:49:38.008 INFO:teuthology.orchestra.run.smithi012.stdout: "check_on_raw": false, 2023-10-05T11:49:38.008 INFO:teuthology.orchestra.run.smithi012.stdout: "max_size": -1, 2023-10-05T11:49:38.008 INFO:teuthology.orchestra.run.smithi012.stdout: "max_size_kb": 0, 2023-10-05T11:49:38.008 INFO:teuthology.orchestra.run.smithi012.stdout: "max_objects": -1 2023-10-05T11:49:38.009 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-05T11:49:38.009 INFO:teuthology.orchestra.run.smithi012.stdout: "temp_url_keys": [], 2023-10-05T11:49:38.009 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "rgw", 2023-10-05T11:49:38.009 INFO:teuthology.orchestra.run.smithi012.stdout: "mfa_ids": [] 2023-10-05T11:49:38.009 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-10-05T11:49:38.009 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:49:38.010 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:38.003+0000 7f124eba6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:49:38.010 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:38.006+0000 7f126b326880 20 remove_watcher() i=0 2023-10-05T11:49:38.010 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:38.006+0000 7f126b326880 2 removed watcher, disabling cache 2023-10-05T11:49:38.010 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:38.007+0000 7f126b326880 20 remove_watcher() i=1 2023-10-05T11:49:38.010 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:38.008+0000 7f126b326880 20 remove_watcher() i=2 2023-10-05T11:49:38.011 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:38.009+0000 7f126b326880 20 remove_watcher() i=3 2023-10-05T11:49:38.012 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:38.010+0000 7f126b326880 20 remove_watcher() i=4 2023-10-05T11:49:38.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:38.011+0000 7f126b326880 20 remove_watcher() i=5 2023-10-05T11:49:38.014 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:38.012+0000 7f126b326880 20 remove_watcher() i=6 2023-10-05T11:49:38.015 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:38.013+0000 7f126b326880 20 remove_watcher() i=7 2023-10-05T11:49:38.021 DEBUG:teuthology.orchestra.run.smithi012:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid foo.client.0 --totp-serial 0992185482 --totp-seed 2U3LUCTFO2QK5GGZOBKJWI5U7BCRKQ5ML57XGDP4QF2FWPHP6VFDMIQQ6K3DIVOM --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2023-10-05T11:49:38.086 INFO:teuthology.orchestra.run.smithi012.stderr:ignoring --setuser ceph since I am not root 2023-10-05T11:49:38.086 INFO:teuthology.orchestra.run.smithi012.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T11:49:38.097 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:38.095+0000 7fc6f0729880 20 rados->read ofs=0 len=0 2023-10-05T11:49:38.101 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:38.096+0000 7fc6f0729880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:49:38.102 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:38.096+0000 7fc6f0729880 20 realm 2023-10-05T11:49:38.102 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:38.096+0000 7fc6f0729880 20 rados->read ofs=0 len=0 2023-10-05T11:49:38.102 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:38.096+0000 7fc6f0729880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:49:38.102 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:38.096+0000 7fc6f0729880 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T11:49:38.102 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:38.096+0000 7fc6f0729880 20 rados->read ofs=0 len=0 2023-10-05T11:49:38.102 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:38.097+0000 7fc6f0729880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:49:38.102 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:38.097+0000 7fc6f0729880 20 rados->read ofs=0 len=0 2023-10-05T11:49:38.103 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:38.098+0000 7fc6f0729880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:49:38.103 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:38.098+0000 7fc6f0729880 20 rados->read ofs=0 len=0 2023-10-05T11:49:38.103 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:38.098+0000 7fc6f0729880 20 rados_obj.operate() r=0 bl.length=1020 2023-10-05T11:49:38.103 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:38.099+0000 7fc6f0729880 20 searching for the correct realm 2023-10-05T11:49:38.110 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:38.108+0000 7fc6ed000640 0 -- 172.21.15.12:0/1174500537 >> [v2:172.21.15.12:6800/732466381,v1:172.21.15.12:6801/732466381] conn(0x556979bc0800 msgr2=0x556979bc6b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-10-05T11:49:38.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:38.110+0000 7fc6f0729880 20 RGWRados::pool_iterate: got zone_info.dff27d1e-df33-400e-a68a-7ba586947c99 2023-10-05T11:49:38.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:38.110+0000 7fc6f0729880 20 RGWRados::pool_iterate: got zonegroup_info.c78aa576-9d15-4e9d-b3c0-4af23a22062c 2023-10-05T11:49:38.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:38.110+0000 7fc6f0729880 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T11:49:38.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:38.110+0000 7fc6f0729880 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T11:49:38.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:38.110+0000 7fc6f0729880 20 rados->read ofs=0 len=0 2023-10-05T11:49:38.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:38.110+0000 7fc6f0729880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:49:38.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:38.110+0000 7fc6f0729880 20 rados->read ofs=0 len=0 2023-10-05T11:49:38.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:38.111+0000 7fc6f0729880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:49:38.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:38.111+0000 7fc6f0729880 20 rados->read ofs=0 len=0 2023-10-05T11:49:38.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:38.111+0000 7fc6f0729880 20 rados_obj.operate() r=0 bl.length=454 2023-10-05T11:49:38.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:38.111+0000 7fc6f0729880 20 zone default found 2023-10-05T11:49:38.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:38.111+0000 7fc6f0729880 4 Realm: () 2023-10-05T11:49:38.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:38.111+0000 7fc6f0729880 4 ZoneGroup: default (c78aa576-9d15-4e9d-b3c0-4af23a22062c) 2023-10-05T11:49:38.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:38.111+0000 7fc6f0729880 4 Zone: default (dff27d1e-df33-400e-a68a-7ba586947c99) 2023-10-05T11:49:38.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:38.111+0000 7fc6f0729880 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T11:49:38.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:38.111+0000 7fc6f0729880 20 zonegroup default 2023-10-05T11:49:38.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:38.111+0000 7fc6f0729880 20 rados->read ofs=0 len=0 2023-10-05T11:49:38.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:38.111+0000 7fc6f0729880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:49:38.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:38.111+0000 7fc6f0729880 20 rados->read ofs=0 len=0 2023-10-05T11:49:38.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:38.112+0000 7fc6f0729880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:49:38.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:38.112+0000 7fc6f0729880 20 rados->read ofs=0 len=0 2023-10-05T11:49:38.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:38.112+0000 7fc6f0729880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:49:38.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:38.112+0000 7fc6f0729880 20 started sync module instance, tier type = 2023-10-05T11:49:38.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:38.112+0000 7fc6f0729880 20 started zone id=dff27d1e-df33-400e-a68a-7ba586947c99 (name=default) with tier type = 2023-10-05T11:49:38.119 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:38.117+0000 7fc6ec7ff640 0 -- 172.21.15.12:0/1174500537 >> [v2:172.21.15.170:6824/75773779,v1:172.21.15.170:6825/75773779] conn(0x556979cc8000 msgr2=0x556979b37180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:49:38.124 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:38.122+0000 7fc6f0729880 20 add_watcher() i=0 2023-10-05T11:49:38.124 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:38.122+0000 7fc6f0729880 20 add_watcher() i=1 2023-10-05T11:49:38.124 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:38.122+0000 7fc6f0729880 20 add_watcher() i=2 2023-10-05T11:49:38.124 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:38.122+0000 7fc6f0729880 20 add_watcher() i=3 2023-10-05T11:49:38.124 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:38.122+0000 7fc6f0729880 20 add_watcher() i=4 2023-10-05T11:49:38.124 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:38.122+0000 7fc6f0729880 20 add_watcher() i=5 2023-10-05T11:49:38.124 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:38.122+0000 7fc6f0729880 20 add_watcher() i=6 2023-10-05T11:49:38.125 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:38.123+0000 7fc6f0729880 20 add_watcher() i=7 2023-10-05T11:49:38.125 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:38.123+0000 7fc6f0729880 2 all 8 watchers are set, enabling cache 2023-10-05T11:49:38.126 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:38.124+0000 7fc6d3fce640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:49:38.126 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:38.124+0000 7fc6f0729880 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T11:49:38.127 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:38.124+0000 7fc6f0729880 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T11:49:38.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:38.129+0000 7fc6f0729880 5 note: GC not initialized 2023-10-05T11:49:38.132 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:38.129+0000 7fc6cf7c5640 20 reqs_thread_entry: start 2023-10-05T11:49:38.132 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:38.129+0000 7fc6f0729880 20 init_complete bucket index max shards: 11 2023-10-05T11:49:38.132 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:38.129+0000 7fc6f0729880 20 Filter name: none 2023-10-05T11:49:38.132 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:38.129+0000 7fc6cd7c1640 20 reqs_thread_entry: start 2023-10-05T11:49:38.132 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:38.129+0000 7fc6f0729880 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : miss 2023-10-05T11:49:38.132 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:38.129+0000 7fc6f0729880 20 rados->read ofs=0 len=0 2023-10-05T11:49:38.132 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:38.130+0000 7fc6f0729880 20 rados_obj.operate() r=0 bl.length=455 2023-10-05T11:49:38.133 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:38.130+0000 7fc6f0729880 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x13 2023-10-05T11:49:38.133 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:38.130+0000 7fc6f0729880 10 adding default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2023-10-05T11:49:38.133 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:38.130+0000 7fc6f0729880 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T11:49:39.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:39.922+0000 7fc6f0729880 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2023-10-05T11:49:39.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:39.922+0000 7fc6f0729880 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2023-10-05T11:49:39.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:39.922+0000 7fc6f0729880 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.uid:foo.client.0, ofs0, ns] 2023-10-05T11:49:39.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:39.922+0000 7fc6e6ff4640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1069446856911 cookie 93911503374336 notifier 8127 bl.length()=654 2023-10-05T11:49:39.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:39.922+0000 7fc6e6ff4640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2023-10-05T11:49:39.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:39.922+0000 7fc6e6ff4640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2023-10-05T11:49:39.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:39.925+0000 7fc6d3fce640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:49:39.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:39.928+0000 7fc6f0729880 20 remove_watcher() i=0 2023-10-05T11:49:39.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:39.928+0000 7fc6f0729880 2 removed watcher, disabling cache 2023-10-05T11:49:39.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:39.929+0000 7fc6f0729880 20 remove_watcher() i=1 2023-10-05T11:49:39.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:39.931+0000 7fc6f0729880 20 remove_watcher() i=2 2023-10-05T11:49:39.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:39.932+0000 7fc6f0729880 20 remove_watcher() i=3 2023-10-05T11:49:39.935 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:39.933+0000 7fc6f0729880 20 remove_watcher() i=4 2023-10-05T11:49:39.936 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:39.934+0000 7fc6f0729880 20 remove_watcher() i=5 2023-10-05T11:49:39.937 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:39.935+0000 7fc6f0729880 20 remove_watcher() i=6 2023-10-05T11:49:39.939 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:39.936+0000 7fc6f0729880 20 remove_watcher() i=7 2023-10-05T11:49:39.944 DEBUG:tasks.s3tests:Creating user bar.client.0 on client.0 2023-10-05T11:49:39.945 DEBUG:teuthology.orchestra.run.smithi012:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid bar.client.0 --display-name 'Mr. bar.client.0' --email bar.client.0+test@test.test --caps 'user-policy=*' --access-key FPLQFRSEXLOMLWRHXDMQ --secret p9Rc7XZR8Tq1cb6AJWNHxx+xaJk3UclsRDDT13wmKFhSV/NR9l3KOQ== --cluster ceph 2023-10-05T11:49:40.013 INFO:teuthology.orchestra.run.smithi012.stderr:ignoring --setuser ceph since I am not root 2023-10-05T11:49:40.013 INFO:teuthology.orchestra.run.smithi012.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T11:49:40.024 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.022+0000 7f44a3c12880 20 rados->read ofs=0 len=0 2023-10-05T11:49:40.026 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.023+0000 7f44a3c12880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:49:40.026 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.023+0000 7f44a3c12880 20 realm 2023-10-05T11:49:40.027 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.023+0000 7f44a3c12880 20 rados->read ofs=0 len=0 2023-10-05T11:49:40.027 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.024+0000 7f44a3c12880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:49:40.027 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.024+0000 7f44a3c12880 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T11:49:40.027 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.024+0000 7f44a3c12880 20 rados->read ofs=0 len=0 2023-10-05T11:49:40.027 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.024+0000 7f44a3c12880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:49:40.027 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.024+0000 7f44a3c12880 20 rados->read ofs=0 len=0 2023-10-05T11:49:40.028 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.025+0000 7f44a3c12880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:49:40.028 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.025+0000 7f44a3c12880 20 rados->read ofs=0 len=0 2023-10-05T11:49:40.028 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.026+0000 7f44a3c12880 20 rados_obj.operate() r=0 bl.length=1020 2023-10-05T11:49:40.028 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.026+0000 7f44a3c12880 20 searching for the correct realm 2023-10-05T11:49:40.038 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.035+0000 7f44a00ae640 0 -- 172.21.15.12:0/602526455 >> [v2:172.21.15.170:6814/3150808418,v1:172.21.15.170:6816/3150808418] conn(0x55aa7d6bd800 msgr2=0x55aa7cae2c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:49:40.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.037+0000 7f44a3c12880 20 RGWRados::pool_iterate: got zone_info.dff27d1e-df33-400e-a68a-7ba586947c99 2023-10-05T11:49:40.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.037+0000 7f44a3c12880 20 RGWRados::pool_iterate: got zonegroup_info.c78aa576-9d15-4e9d-b3c0-4af23a22062c 2023-10-05T11:49:40.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.037+0000 7f44a3c12880 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T11:49:40.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.037+0000 7f44a3c12880 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T11:49:40.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.037+0000 7f44a3c12880 20 rados->read ofs=0 len=0 2023-10-05T11:49:40.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.037+0000 7f44a3c12880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:49:40.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.037+0000 7f44a3c12880 20 rados->read ofs=0 len=0 2023-10-05T11:49:40.041 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.038+0000 7f44a3c12880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:49:40.041 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.038+0000 7f44a3c12880 20 rados->read ofs=0 len=0 2023-10-05T11:49:40.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.038+0000 7f44a3c12880 20 rados_obj.operate() r=0 bl.length=454 2023-10-05T11:49:40.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.038+0000 7f44a3c12880 20 zone default found 2023-10-05T11:49:40.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.038+0000 7f44a3c12880 4 Realm: () 2023-10-05T11:49:40.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.038+0000 7f44a3c12880 4 ZoneGroup: default (c78aa576-9d15-4e9d-b3c0-4af23a22062c) 2023-10-05T11:49:40.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.038+0000 7f44a3c12880 4 Zone: default (dff27d1e-df33-400e-a68a-7ba586947c99) 2023-10-05T11:49:40.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.038+0000 7f44a3c12880 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T11:49:40.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.038+0000 7f44a3c12880 20 zonegroup default 2023-10-05T11:49:40.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.038+0000 7f44a3c12880 20 rados->read ofs=0 len=0 2023-10-05T11:49:40.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.038+0000 7f44a3c12880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:49:40.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.038+0000 7f44a3c12880 20 rados->read ofs=0 len=0 2023-10-05T11:49:40.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.038+0000 7f44a3c12880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:49:40.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.038+0000 7f44a3c12880 20 rados->read ofs=0 len=0 2023-10-05T11:49:40.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.039+0000 7f44a3c12880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:49:40.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.039+0000 7f44a3c12880 20 started sync module instance, tier type = 2023-10-05T11:49:40.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.039+0000 7f44a3c12880 20 started zone id=dff27d1e-df33-400e-a68a-7ba586947c99 (name=default) with tier type = 2023-10-05T11:49:40.047 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.045+0000 7f44a08af640 0 -- 172.21.15.12:0/602526455 >> [v2:172.21.15.170:6800/4137726411,v1:172.21.15.170:6801/4137726411] conn(0x55aa7cb83c00 msgr2=0x55aa7cb71600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:49:40.050 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.048+0000 7f44a3c12880 20 add_watcher() i=0 2023-10-05T11:49:40.050 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.048+0000 7f44a3c12880 20 add_watcher() i=1 2023-10-05T11:49:40.050 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.048+0000 7f44a3c12880 20 add_watcher() i=2 2023-10-05T11:49:40.051 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.048+0000 7f44a3c12880 20 add_watcher() i=3 2023-10-05T11:49:40.051 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.048+0000 7f44a3c12880 20 add_watcher() i=4 2023-10-05T11:49:40.051 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.048+0000 7f44a3c12880 20 add_watcher() i=5 2023-10-05T11:49:40.051 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.048+0000 7f44a3c12880 20 add_watcher() i=6 2023-10-05T11:49:40.051 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.049+0000 7f44a3c12880 20 add_watcher() i=7 2023-10-05T11:49:40.051 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.049+0000 7f44a3c12880 2 all 8 watchers are set, enabling cache 2023-10-05T11:49:40.053 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.050+0000 7f448707c640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:49:40.053 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.051+0000 7f44a3c12880 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T11:49:40.053 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.051+0000 7f44a3c12880 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T11:49:40.058 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.055+0000 7f44a3c12880 5 note: GC not initialized 2023-10-05T11:49:40.058 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.055+0000 7f4482873640 20 reqs_thread_entry: start 2023-10-05T11:49:40.058 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.055+0000 7f44a3c12880 20 init_complete bucket index max shards: 11 2023-10-05T11:49:40.058 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.055+0000 7f44a3c12880 20 Filter name: none 2023-10-05T11:49:40.058 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.056+0000 7f448086f640 20 reqs_thread_entry: start 2023-10-05T11:49:40.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.056+0000 7f44a3c12880 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : miss 2023-10-05T11:49:40.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.056+0000 7f44a3c12880 20 rados->read ofs=0 len=0 2023-10-05T11:49:40.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.056+0000 7f44a3c12880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:49:40.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.056+0000 7f44a3c12880 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x0 2023-10-05T11:49:40.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.056+0000 7f44a3c12880 10 adding default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2023-10-05T11:49:40.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.056+0000 7f44a3c12880 10 cache get: name=default.rgw.meta+users.email+bar.client.0+test@test.test : miss 2023-10-05T11:49:40.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.056+0000 7f44a3c12880 20 rados->read ofs=0 len=0 2023-10-05T11:49:40.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.056+0000 7f44a3c12880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:49:40.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.056+0000 7f44a3c12880 10 cache put: name=default.rgw.meta+users.email+bar.client.0+test@test.test info.flags=0x0 2023-10-05T11:49:40.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.056+0000 7f44a3c12880 10 adding default.rgw.meta+users.email+bar.client.0+test@test.test to cache LRU end 2023-10-05T11:49:40.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.056+0000 7f44a3c12880 10 cache get: name=default.rgw.meta+users.keys+FPLQFRSEXLOMLWRHXDMQ : miss 2023-10-05T11:49:40.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.056+0000 7f44a3c12880 20 rados->read ofs=0 len=0 2023-10-05T11:49:40.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.057+0000 7f44a3c12880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:49:40.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.057+0000 7f44a3c12880 10 cache put: name=default.rgw.meta+users.keys+FPLQFRSEXLOMLWRHXDMQ info.flags=0x0 2023-10-05T11:49:40.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.057+0000 7f44a3c12880 10 adding default.rgw.meta+users.keys+FPLQFRSEXLOMLWRHXDMQ to cache LRU end 2023-10-05T11:49:40.062 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.057+0000 7f44a3c12880 10 cache get: name=default.rgw.meta+users.keys+FPLQFRSEXLOMLWRHXDMQ : hit (negative entry) 2023-10-05T11:49:40.062 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.057+0000 7f44a3c12880 10 cache get: name=default.rgw.meta+users.keys+FPLQFRSEXLOMLWRHXDMQ : hit (negative entry) 2023-10-05T11:49:40.062 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.058+0000 7f44a3c12880 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2023-10-05T11:49:40.062 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.058+0000 7f44a3c12880 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2023-10-05T11:49:40.062 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.058+0000 7f44a3c12880 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:bar.client.0, ofs0, ns] 2023-10-05T11:49:40.063 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.058+0000 7f449a8a3640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1069446856826 cookie 94190726049792 notifier 7685 bl.length()=640 2023-10-05T11:49:40.063 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.058+0000 7f449a8a3640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2023-10-05T11:49:40.063 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.058+0000 7f449a8a3640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2023-10-05T11:49:40.064 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.062+0000 7f44a3c12880 10 cache put: name=default.rgw.meta+users.email+bar.client.0+test@test.test info.flags=0x7 2023-10-05T11:49:40.064 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.062+0000 7f44a3c12880 10 moving default.rgw.meta+users.email+bar.client.0+test@test.test to cache LRU end 2023-10-05T11:49:40.064 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.062+0000 7f44a3c12880 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.email:bar.client.0+test@test.test, ofs0, ns] 2023-10-05T11:49:40.064 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.062+0000 7f449a8a3640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1069446856827 cookie 94190726049792 notifier 7685 bl.length()=194 2023-10-05T11:49:40.065 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.062+0000 7f449a8a3640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+bar.client.0+test@test.test info.flags=0x7 2023-10-05T11:49:40.065 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.062+0000 7f449a8a3640 10 rgw watcher librados: moving default.rgw.meta+users.email+bar.client.0+test@test.test to cache LRU end 2023-10-05T11:49:40.067 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.065+0000 7f44a3c12880 10 cache put: name=default.rgw.meta+users.keys+FPLQFRSEXLOMLWRHXDMQ info.flags=0x7 2023-10-05T11:49:40.067 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.065+0000 7f44a3c12880 10 moving default.rgw.meta+users.keys+FPLQFRSEXLOMLWRHXDMQ to cache LRU end 2023-10-05T11:49:40.067 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.065+0000 7f44a3c12880 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.keys:FPLQFRSEXLOMLWRHXDMQ, ofs0, ns] 2023-10-05T11:49:40.068 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.065+0000 7f449a8a3640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1069446856912 cookie 94190726048768 notifier 7685 bl.length()=186 2023-10-05T11:49:40.068 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.065+0000 7f449a8a3640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+FPLQFRSEXLOMLWRHXDMQ info.flags=0x7 2023-10-05T11:49:40.068 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.065+0000 7f449a8a3640 10 rgw watcher librados: moving default.rgw.meta+users.keys+FPLQFRSEXLOMLWRHXDMQ to cache LRU end 2023-10-05T11:49:40.069 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-10-05T11:49:40.069 INFO:teuthology.orchestra.run.smithi012.stdout: "user_id": "bar.client.0", 2023-10-05T11:49:40.069 INFO:teuthology.orchestra.run.smithi012.stdout: "display_name": "Mr. bar.client.0", 2023-10-05T11:49:40.069 INFO:teuthology.orchestra.run.smithi012.stdout: "email": "bar.client.0+test@test.test", 2023-10-05T11:49:40.069 INFO:teuthology.orchestra.run.smithi012.stdout: "suspended": 0, 2023-10-05T11:49:40.069 INFO:teuthology.orchestra.run.smithi012.stdout: "max_buckets": 1000, 2023-10-05T11:49:40.069 INFO:teuthology.orchestra.run.smithi012.stdout: "subusers": [], 2023-10-05T11:49:40.069 INFO:teuthology.orchestra.run.smithi012.stdout: "keys": [ 2023-10-05T11:49:40.070 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-05T11:49:40.070 INFO:teuthology.orchestra.run.smithi012.stdout: "user": "bar.client.0", 2023-10-05T11:49:40.070 INFO:teuthology.orchestra.run.smithi012.stdout: "access_key": "FPLQFRSEXLOMLWRHXDMQ", 2023-10-05T11:49:40.070 INFO:teuthology.orchestra.run.smithi012.stdout: "secret_key": "p9Rc7XZR8Tq1cb6AJWNHxx+xaJk3UclsRDDT13wmKFhSV/NR9l3KOQ==" 2023-10-05T11:49:40.070 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-05T11:49:40.070 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-10-05T11:49:40.070 INFO:teuthology.orchestra.run.smithi012.stdout: "swift_keys": [], 2023-10-05T11:49:40.070 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": [ 2023-10-05T11:49:40.071 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-05T11:49:40.071 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "user-policy", 2023-10-05T11:49:40.071 INFO:teuthology.orchestra.run.smithi012.stdout: "perm": "*" 2023-10-05T11:49:40.071 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-05T11:49:40.071 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-10-05T11:49:40.072 INFO:teuthology.orchestra.run.smithi012.stdout: "op_mask": "read, write, delete", 2023-10-05T11:49:40.072 INFO:teuthology.orchestra.run.smithi012.stdout: "default_placement": "", 2023-10-05T11:49:40.072 INFO:teuthology.orchestra.run.smithi012.stdout: "default_storage_class": "", 2023-10-05T11:49:40.072 INFO:teuthology.orchestra.run.smithi012.stdout: "placement_tags": [], 2023-10-05T11:49:40.072 INFO:teuthology.orchestra.run.smithi012.stdout: "bucket_quota": { 2023-10-05T11:49:40.072 INFO:teuthology.orchestra.run.smithi012.stdout: "enabled": false, 2023-10-05T11:49:40.072 INFO:teuthology.orchestra.run.smithi012.stdout: "check_on_raw": false, 2023-10-05T11:49:40.072 INFO:teuthology.orchestra.run.smithi012.stdout: "max_size": -1, 2023-10-05T11:49:40.072 INFO:teuthology.orchestra.run.smithi012.stdout: "max_size_kb": 0, 2023-10-05T11:49:40.072 INFO:teuthology.orchestra.run.smithi012.stdout: "max_objects": -1 2023-10-05T11:49:40.072 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-05T11:49:40.073 INFO:teuthology.orchestra.run.smithi012.stdout: "user_quota": { 2023-10-05T11:49:40.073 INFO:teuthology.orchestra.run.smithi012.stdout: "enabled": false, 2023-10-05T11:49:40.073 INFO:teuthology.orchestra.run.smithi012.stdout: "check_on_raw": false, 2023-10-05T11:49:40.073 INFO:teuthology.orchestra.run.smithi012.stdout: "max_size": -1, 2023-10-05T11:49:40.073 INFO:teuthology.orchestra.run.smithi012.stdout: "max_size_kb": 0, 2023-10-05T11:49:40.073 INFO:teuthology.orchestra.run.smithi012.stdout: "max_objects": -1 2023-10-05T11:49:40.073 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-05T11:49:40.073 INFO:teuthology.orchestra.run.smithi012.stdout: "temp_url_keys": [], 2023-10-05T11:49:40.073 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "rgw", 2023-10-05T11:49:40.073 INFO:teuthology.orchestra.run.smithi012.stdout: "mfa_ids": [] 2023-10-05T11:49:40.073 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-10-05T11:49:40.074 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:49:40.074 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.067+0000 7f448707c640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:49:40.074 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.069+0000 7f44a3c12880 20 remove_watcher() i=0 2023-10-05T11:49:40.075 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.069+0000 7f44a3c12880 2 removed watcher, disabling cache 2023-10-05T11:49:40.075 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.071+0000 7f44a3c12880 20 remove_watcher() i=1 2023-10-05T11:49:40.075 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.072+0000 7f44a3c12880 20 remove_watcher() i=2 2023-10-05T11:49:40.075 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.073+0000 7f44a3c12880 20 remove_watcher() i=3 2023-10-05T11:49:40.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.074+0000 7f44a3c12880 20 remove_watcher() i=4 2023-10-05T11:49:40.077 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.075+0000 7f44a3c12880 20 remove_watcher() i=5 2023-10-05T11:49:40.078 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.076+0000 7f44a3c12880 20 remove_watcher() i=6 2023-10-05T11:49:40.079 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.077+0000 7f44a3c12880 20 remove_watcher() i=7 2023-10-05T11:49:40.084 DEBUG:teuthology.orchestra.run.smithi012:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid bar.client.0 --totp-serial 6514650888 --totp-seed MGUXZEQ6WU43MARIGX3NH4UYSDHB2DUN4BYNQKS36PJENMUJVXS53HITQGMR7MXJ --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2023-10-05T11:49:40.150 INFO:teuthology.orchestra.run.smithi012.stderr:ignoring --setuser ceph since I am not root 2023-10-05T11:49:40.150 INFO:teuthology.orchestra.run.smithi012.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T11:49:40.159 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.157+0000 7fdfa8329880 20 rados->read ofs=0 len=0 2023-10-05T11:49:40.160 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.158+0000 7fdfa8329880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:49:40.160 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.158+0000 7fdfa8329880 20 realm 2023-10-05T11:49:40.160 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.158+0000 7fdfa8329880 20 rados->read ofs=0 len=0 2023-10-05T11:49:40.160 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.158+0000 7fdfa8329880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:49:40.161 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.158+0000 7fdfa8329880 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T11:49:40.161 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.158+0000 7fdfa8329880 20 rados->read ofs=0 len=0 2023-10-05T11:49:40.161 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.158+0000 7fdfa8329880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:49:40.161 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.158+0000 7fdfa8329880 20 rados->read ofs=0 len=0 2023-10-05T11:49:40.161 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.159+0000 7fdfa8329880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:49:40.161 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.159+0000 7fdfa8329880 20 rados->read ofs=0 len=0 2023-10-05T11:49:40.162 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.160+0000 7fdfa8329880 20 rados_obj.operate() r=0 bl.length=1020 2023-10-05T11:49:40.162 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.160+0000 7fdfa8329880 20 searching for the correct realm 2023-10-05T11:49:40.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.169+0000 7fdfa4ca0640 0 -- 172.21.15.12:0/3848641175 >> [v2:172.21.15.170:6814/3150808418,v1:172.21.15.170:6816/3150808418] conn(0x56231199a000 msgr2=0x562311821180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:49:40.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.171+0000 7fdfa8329880 20 RGWRados::pool_iterate: got zone_info.dff27d1e-df33-400e-a68a-7ba586947c99 2023-10-05T11:49:40.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.171+0000 7fdfa8329880 20 RGWRados::pool_iterate: got zonegroup_info.c78aa576-9d15-4e9d-b3c0-4af23a22062c 2023-10-05T11:49:40.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.171+0000 7fdfa8329880 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T11:49:40.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.171+0000 7fdfa8329880 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T11:49:40.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.171+0000 7fdfa8329880 20 rados->read ofs=0 len=0 2023-10-05T11:49:40.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.171+0000 7fdfa8329880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:49:40.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.171+0000 7fdfa8329880 20 rados->read ofs=0 len=0 2023-10-05T11:49:40.175 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.171+0000 7fdfa8329880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:49:40.175 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.171+0000 7fdfa8329880 20 rados->read ofs=0 len=0 2023-10-05T11:49:40.175 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.172+0000 7fdfa8329880 20 rados_obj.operate() r=0 bl.length=454 2023-10-05T11:49:40.175 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.172+0000 7fdfa8329880 20 zone default found 2023-10-05T11:49:40.175 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.172+0000 7fdfa8329880 4 Realm: () 2023-10-05T11:49:40.175 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.172+0000 7fdfa8329880 4 ZoneGroup: default (c78aa576-9d15-4e9d-b3c0-4af23a22062c) 2023-10-05T11:49:40.175 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.172+0000 7fdfa8329880 4 Zone: default (dff27d1e-df33-400e-a68a-7ba586947c99) 2023-10-05T11:49:40.175 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.172+0000 7fdfa8329880 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T11:49:40.175 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.172+0000 7fdfa8329880 20 zonegroup default 2023-10-05T11:49:40.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.172+0000 7fdfa8329880 20 rados->read ofs=0 len=0 2023-10-05T11:49:40.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.172+0000 7fdfa8329880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:49:40.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.172+0000 7fdfa8329880 20 rados->read ofs=0 len=0 2023-10-05T11:49:40.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.172+0000 7fdfa8329880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:49:40.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.172+0000 7fdfa8329880 20 rados->read ofs=0 len=0 2023-10-05T11:49:40.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.173+0000 7fdfa8329880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:49:40.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.173+0000 7fdfa8329880 20 started sync module instance, tier type = 2023-10-05T11:49:40.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.173+0000 7fdfa8329880 20 started zone id=dff27d1e-df33-400e-a68a-7ba586947c99 (name=default) with tier type = 2023-10-05T11:49:40.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.178+0000 7fdfa54a1640 0 -- 172.21.15.12:0/3848641175 >> [v2:172.21.15.170:6800/4137726411,v1:172.21.15.170:6801/4137726411] conn(0x56231199b800 msgr2=0x5623118bb700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:49:40.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.182+0000 7fdfa8329880 20 add_watcher() i=0 2023-10-05T11:49:40.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.182+0000 7fdfa8329880 20 add_watcher() i=1 2023-10-05T11:49:40.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.182+0000 7fdfa8329880 20 add_watcher() i=2 2023-10-05T11:49:40.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.182+0000 7fdfa8329880 20 add_watcher() i=3 2023-10-05T11:49:40.185 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.182+0000 7fdfa8329880 20 add_watcher() i=4 2023-10-05T11:49:40.185 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.182+0000 7fdfa8329880 20 add_watcher() i=5 2023-10-05T11:49:40.185 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.182+0000 7fdfa8329880 20 add_watcher() i=6 2023-10-05T11:49:40.185 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.183+0000 7fdfa8329880 20 add_watcher() i=7 2023-10-05T11:49:40.185 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.183+0000 7fdfa8329880 2 all 8 watchers are set, enabling cache 2023-10-05T11:49:40.187 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.185+0000 7fdf8bc6e640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:49:40.187 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.185+0000 7fdfa8329880 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T11:49:40.187 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.185+0000 7fdfa8329880 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T11:49:40.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.189+0000 7fdfa8329880 5 note: GC not initialized 2023-10-05T11:49:40.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.189+0000 7fdf87465640 20 reqs_thread_entry: start 2023-10-05T11:49:40.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.189+0000 7fdfa8329880 20 init_complete bucket index max shards: 11 2023-10-05T11:49:40.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.190+0000 7fdfa8329880 20 Filter name: none 2023-10-05T11:49:40.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.190+0000 7fdf85461640 20 reqs_thread_entry: start 2023-10-05T11:49:40.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.190+0000 7fdfa8329880 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : miss 2023-10-05T11:49:40.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.190+0000 7fdfa8329880 20 rados->read ofs=0 len=0 2023-10-05T11:49:40.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.190+0000 7fdfa8329880 20 rados_obj.operate() r=0 bl.length=455 2023-10-05T11:49:40.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.190+0000 7fdfa8329880 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x13 2023-10-05T11:49:40.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.190+0000 7fdfa8329880 10 adding default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2023-10-05T11:49:40.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.190+0000 7fdfa8329880 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T11:49:40.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.193+0000 7fdfa8329880 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2023-10-05T11:49:40.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.193+0000 7fdfa8329880 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2023-10-05T11:49:40.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.193+0000 7fdfa8329880 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:bar.client.0, ofs0, ns] 2023-10-05T11:49:40.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.193+0000 7fdf9f495640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1069446856828 cookie 94708619128832 notifier 7706 bl.length()=654 2023-10-05T11:49:40.196 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.193+0000 7fdf9f495640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2023-10-05T11:49:40.196 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.193+0000 7fdf9f495640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2023-10-05T11:49:40.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.195+0000 7fdf8bc6e640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:49:40.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.197+0000 7fdfa8329880 20 remove_watcher() i=0 2023-10-05T11:49:40.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.197+0000 7fdfa8329880 2 removed watcher, disabling cache 2023-10-05T11:49:40.201 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.199+0000 7fdfa8329880 20 remove_watcher() i=1 2023-10-05T11:49:40.202 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.200+0000 7fdfa8329880 20 remove_watcher() i=2 2023-10-05T11:49:40.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.201+0000 7fdfa8329880 20 remove_watcher() i=3 2023-10-05T11:49:40.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.202+0000 7fdfa8329880 20 remove_watcher() i=4 2023-10-05T11:49:40.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.203+0000 7fdfa8329880 20 remove_watcher() i=5 2023-10-05T11:49:40.206 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.204+0000 7fdfa8329880 20 remove_watcher() i=6 2023-10-05T11:49:40.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.205+0000 7fdfa8329880 20 remove_watcher() i=7 2023-10-05T11:49:40.212 DEBUG:tasks.s3tests:Creating user testx$tenanteduser.client.0 on client.0 2023-10-05T11:49:40.212 DEBUG:teuthology.orchestra.run.smithi012:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid 'testx$tenanteduser.client.0' --display-name 'Mr. testx$tenanteduser.client.0' --email 'testx$tenanteduser.client.0+test@test.test' --caps 'user-policy=*' --access-key YQKSQLGRICXPOAOYTESB --secret A4aLOhXEJXOk2oZSCcc76OidwWL4yqApb4vWkvFYE6AWgqcOlyhb8A== --cluster ceph 2023-10-05T11:49:40.276 INFO:teuthology.orchestra.run.smithi012.stderr:ignoring --setuser ceph since I am not root 2023-10-05T11:49:40.276 INFO:teuthology.orchestra.run.smithi012.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T11:49:40.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.285+0000 7ff6a1a0f880 20 rados->read ofs=0 len=0 2023-10-05T11:49:40.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.286+0000 7ff6a1a0f880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:49:40.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.286+0000 7ff6a1a0f880 20 realm 2023-10-05T11:49:40.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.286+0000 7ff6a1a0f880 20 rados->read ofs=0 len=0 2023-10-05T11:49:40.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.286+0000 7ff6a1a0f880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:49:40.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.286+0000 7ff6a1a0f880 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T11:49:40.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.286+0000 7ff6a1a0f880 20 rados->read ofs=0 len=0 2023-10-05T11:49:40.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.286+0000 7ff6a1a0f880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:49:40.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.286+0000 7ff6a1a0f880 20 rados->read ofs=0 len=0 2023-10-05T11:49:40.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.287+0000 7ff6a1a0f880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:49:40.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.287+0000 7ff6a1a0f880 20 rados->read ofs=0 len=0 2023-10-05T11:49:40.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.288+0000 7ff6a1a0f880 20 rados_obj.operate() r=0 bl.length=1020 2023-10-05T11:49:40.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.288+0000 7ff6a1a0f880 20 searching for the correct realm 2023-10-05T11:49:40.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.298+0000 7ff69e6db640 0 -- 172.21.15.12:0/4170082191 >> [v2:172.21.15.12:6824/2171933159,v1:172.21.15.12:6825/2171933159] conn(0x5563c598f400 msgr2=0x5563c5823700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:49:40.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.298+0000 7ff6a1a0f880 20 RGWRados::pool_iterate: got zone_info.dff27d1e-df33-400e-a68a-7ba586947c99 2023-10-05T11:49:40.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.298+0000 7ff6a1a0f880 20 RGWRados::pool_iterate: got zonegroup_info.c78aa576-9d15-4e9d-b3c0-4af23a22062c 2023-10-05T11:49:40.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.298+0000 7ff6a1a0f880 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T11:49:40.302 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.298+0000 7ff6a1a0f880 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T11:49:40.302 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.298+0000 7ff6a1a0f880 20 rados->read ofs=0 len=0 2023-10-05T11:49:40.302 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.299+0000 7ff6a1a0f880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:49:40.302 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.299+0000 7ff6a1a0f880 20 rados->read ofs=0 len=0 2023-10-05T11:49:40.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.299+0000 7ff6a1a0f880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:49:40.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.299+0000 7ff6a1a0f880 20 rados->read ofs=0 len=0 2023-10-05T11:49:40.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.299+0000 7ff6a1a0f880 20 rados_obj.operate() r=0 bl.length=454 2023-10-05T11:49:40.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.299+0000 7ff6a1a0f880 20 zone default found 2023-10-05T11:49:40.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.299+0000 7ff6a1a0f880 4 Realm: () 2023-10-05T11:49:40.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.299+0000 7ff6a1a0f880 4 ZoneGroup: default (c78aa576-9d15-4e9d-b3c0-4af23a22062c) 2023-10-05T11:49:40.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.299+0000 7ff6a1a0f880 4 Zone: default (dff27d1e-df33-400e-a68a-7ba586947c99) 2023-10-05T11:49:40.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.299+0000 7ff6a1a0f880 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T11:49:40.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.299+0000 7ff6a1a0f880 20 zonegroup default 2023-10-05T11:49:40.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.299+0000 7ff6a1a0f880 20 rados->read ofs=0 len=0 2023-10-05T11:49:40.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.299+0000 7ff6a1a0f880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:49:40.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.299+0000 7ff6a1a0f880 20 rados->read ofs=0 len=0 2023-10-05T11:49:40.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.300+0000 7ff6a1a0f880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:49:40.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.300+0000 7ff6a1a0f880 20 rados->read ofs=0 len=0 2023-10-05T11:49:40.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.300+0000 7ff6a1a0f880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:49:40.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.300+0000 7ff6a1a0f880 20 started sync module instance, tier type = 2023-10-05T11:49:40.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.300+0000 7ff6a1a0f880 20 started zone id=dff27d1e-df33-400e-a68a-7ba586947c99 (name=default) with tier type = 2023-10-05T11:49:40.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.305+0000 7ff69e6db640 0 -- 172.21.15.12:0/4170082191 >> [v2:172.21.15.170:6800/4137726411,v1:172.21.15.170:6801/4137726411] conn(0x5563c59bc000 msgr2=0x5563c58bb600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-10-05T11:49:40.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.310+0000 7ff6a1a0f880 20 add_watcher() i=0 2023-10-05T11:49:40.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.310+0000 7ff6a1a0f880 20 add_watcher() i=1 2023-10-05T11:49:40.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.310+0000 7ff6a1a0f880 20 add_watcher() i=2 2023-10-05T11:49:40.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.310+0000 7ff6a1a0f880 20 add_watcher() i=3 2023-10-05T11:49:40.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.310+0000 7ff6a1a0f880 20 add_watcher() i=4 2023-10-05T11:49:40.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.310+0000 7ff6a1a0f880 20 add_watcher() i=5 2023-10-05T11:49:40.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.310+0000 7ff6a1a0f880 20 add_watcher() i=6 2023-10-05T11:49:40.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.311+0000 7ff6a1a0f880 20 add_watcher() i=7 2023-10-05T11:49:40.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.311+0000 7ff6a1a0f880 2 all 8 watchers are set, enabling cache 2023-10-05T11:49:40.315 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.313+0000 7ff684ea8640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:49:40.315 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.313+0000 7ff6a1a0f880 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T11:49:40.315 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.313+0000 7ff6a1a0f880 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T11:49:40.320 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.317+0000 7ff6a1a0f880 5 note: GC not initialized 2023-10-05T11:49:40.320 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.318+0000 7ff68069f640 20 reqs_thread_entry: start 2023-10-05T11:49:40.320 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.318+0000 7ff6a1a0f880 20 init_complete bucket index max shards: 11 2023-10-05T11:49:40.320 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.318+0000 7ff6a1a0f880 20 Filter name: none 2023-10-05T11:49:40.321 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.318+0000 7ff67e69b640 20 reqs_thread_entry: start 2023-10-05T11:49:40.321 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.318+0000 7ff6a1a0f880 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 : miss 2023-10-05T11:49:40.321 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.318+0000 7ff6a1a0f880 20 rados->read ofs=0 len=0 2023-10-05T11:49:40.321 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.318+0000 7ff6a1a0f880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:49:40.321 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.318+0000 7ff6a1a0f880 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x0 2023-10-05T11:49:40.321 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.318+0000 7ff6a1a0f880 10 adding default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2023-10-05T11:49:40.321 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.318+0000 7ff6a1a0f880 10 cache get: name=default.rgw.meta+users.email+testx$tenanteduser.client.0+test@test.test : miss 2023-10-05T11:49:40.321 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.318+0000 7ff6a1a0f880 20 rados->read ofs=0 len=0 2023-10-05T11:49:40.322 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.318+0000 7ff6a1a0f880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:49:40.322 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.318+0000 7ff6a1a0f880 10 cache put: name=default.rgw.meta+users.email+testx$tenanteduser.client.0+test@test.test info.flags=0x0 2023-10-05T11:49:40.322 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.319+0000 7ff6a1a0f880 10 adding default.rgw.meta+users.email+testx$tenanteduser.client.0+test@test.test to cache LRU end 2023-10-05T11:49:40.322 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.319+0000 7ff6a1a0f880 10 cache get: name=default.rgw.meta+users.keys+YQKSQLGRICXPOAOYTESB : miss 2023-10-05T11:49:40.322 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.319+0000 7ff6a1a0f880 20 rados->read ofs=0 len=0 2023-10-05T11:49:40.322 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.319+0000 7ff6a1a0f880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:49:40.322 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.319+0000 7ff6a1a0f880 10 cache put: name=default.rgw.meta+users.keys+YQKSQLGRICXPOAOYTESB info.flags=0x0 2023-10-05T11:49:40.323 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.319+0000 7ff6a1a0f880 10 adding default.rgw.meta+users.keys+YQKSQLGRICXPOAOYTESB to cache LRU end 2023-10-05T11:49:40.323 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.319+0000 7ff6a1a0f880 10 cache get: name=default.rgw.meta+users.keys+YQKSQLGRICXPOAOYTESB : hit (negative entry) 2023-10-05T11:49:40.323 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.319+0000 7ff6a1a0f880 10 cache get: name=default.rgw.meta+users.keys+YQKSQLGRICXPOAOYTESB : hit (negative entry) 2023-10-05T11:49:40.323 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.320+0000 7ff6a1a0f880 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2023-10-05T11:49:40.323 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.320+0000 7ff6a1a0f880 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2023-10-05T11:49:40.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.320+0000 7ff6a1a0f880 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser.client.0, ofs0, ns] 2023-10-05T11:49:40.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.321+0000 7ff6986cf640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1069446856896 cookie 93887005508608 notifier 7727 bl.length()=714 2023-10-05T11:49:40.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.321+0000 7ff6986cf640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2023-10-05T11:49:40.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.321+0000 7ff6986cf640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2023-10-05T11:49:40.325 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.323+0000 7ff6a1a0f880 10 cache put: name=default.rgw.meta+users.email+testx$tenanteduser.client.0+test@test.test info.flags=0x7 2023-10-05T11:49:40.325 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.323+0000 7ff6a1a0f880 10 moving default.rgw.meta+users.email+testx$tenanteduser.client.0+test@test.test to cache LRU end 2023-10-05T11:49:40.326 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.323+0000 7ff6a1a0f880 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.email:testx$tenanteduser.client.0+test@test.test, ofs0, ns] 2023-10-05T11:49:40.326 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.324+0000 7ff697ece640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1069446856783 cookie 93887005510656 notifier 7727 bl.length()=224 2023-10-05T11:49:40.326 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.324+0000 7ff697ece640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+testx$tenanteduser.client.0+test@test.test info.flags=0x7 2023-10-05T11:49:40.326 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.324+0000 7ff697ece640 10 rgw watcher librados: moving default.rgw.meta+users.email+testx$tenanteduser.client.0+test@test.test to cache LRU end 2023-10-05T11:49:40.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.326+0000 7ff6a1a0f880 10 cache put: name=default.rgw.meta+users.keys+YQKSQLGRICXPOAOYTESB info.flags=0x7 2023-10-05T11:49:40.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.326+0000 7ff6a1a0f880 10 moving default.rgw.meta+users.keys+YQKSQLGRICXPOAOYTESB to cache LRU end 2023-10-05T11:49:40.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.326+0000 7ff6a1a0f880 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.keys:YQKSQLGRICXPOAOYTESB, ofs0, ns] 2023-10-05T11:49:40.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.326+0000 7ff697ece640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1069446856829 cookie 93887005260800 notifier 7727 bl.length()=201 2023-10-05T11:49:40.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.326+0000 7ff697ece640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+YQKSQLGRICXPOAOYTESB info.flags=0x7 2023-10-05T11:49:40.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.326+0000 7ff697ece640 10 rgw watcher librados: moving default.rgw.meta+users.keys+YQKSQLGRICXPOAOYTESB to cache LRU end 2023-10-05T11:49:40.330 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-10-05T11:49:40.330 INFO:teuthology.orchestra.run.smithi012.stdout: "user_id": "testx$tenanteduser.client.0", 2023-10-05T11:49:40.330 INFO:teuthology.orchestra.run.smithi012.stdout: "display_name": "Mr. testx$tenanteduser.client.0", 2023-10-05T11:49:40.330 INFO:teuthology.orchestra.run.smithi012.stdout: "email": "testx$tenanteduser.client.0+test@test.test", 2023-10-05T11:49:40.330 INFO:teuthology.orchestra.run.smithi012.stdout: "suspended": 0, 2023-10-05T11:49:40.330 INFO:teuthology.orchestra.run.smithi012.stdout: "max_buckets": 1000, 2023-10-05T11:49:40.330 INFO:teuthology.orchestra.run.smithi012.stdout: "subusers": [], 2023-10-05T11:49:40.331 INFO:teuthology.orchestra.run.smithi012.stdout: "keys": [ 2023-10-05T11:49:40.331 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-05T11:49:40.331 INFO:teuthology.orchestra.run.smithi012.stdout: "user": "testx$tenanteduser.client.0", 2023-10-05T11:49:40.331 INFO:teuthology.orchestra.run.smithi012.stdout: "access_key": "YQKSQLGRICXPOAOYTESB", 2023-10-05T11:49:40.331 INFO:teuthology.orchestra.run.smithi012.stdout: "secret_key": "A4aLOhXEJXOk2oZSCcc76OidwWL4yqApb4vWkvFYE6AWgqcOlyhb8A==" 2023-10-05T11:49:40.331 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-05T11:49:40.331 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-10-05T11:49:40.332 INFO:teuthology.orchestra.run.smithi012.stdout: "swift_keys": [], 2023-10-05T11:49:40.332 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": [ 2023-10-05T11:49:40.332 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-05T11:49:40.332 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "user-policy", 2023-10-05T11:49:40.332 INFO:teuthology.orchestra.run.smithi012.stdout: "perm": "*" 2023-10-05T11:49:40.332 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-05T11:49:40.333 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-10-05T11:49:40.333 INFO:teuthology.orchestra.run.smithi012.stdout: "op_mask": "read, write, delete", 2023-10-05T11:49:40.333 INFO:teuthology.orchestra.run.smithi012.stdout: "default_placement": "", 2023-10-05T11:49:40.333 INFO:teuthology.orchestra.run.smithi012.stdout: "default_storage_class": "", 2023-10-05T11:49:40.333 INFO:teuthology.orchestra.run.smithi012.stdout: "placement_tags": [], 2023-10-05T11:49:40.333 INFO:teuthology.orchestra.run.smithi012.stdout: "bucket_quota": { 2023-10-05T11:49:40.334 INFO:teuthology.orchestra.run.smithi012.stdout: "enabled": false, 2023-10-05T11:49:40.334 INFO:teuthology.orchestra.run.smithi012.stdout: "check_on_raw": false, 2023-10-05T11:49:40.334 INFO:teuthology.orchestra.run.smithi012.stdout: "max_size": -1, 2023-10-05T11:49:40.334 INFO:teuthology.orchestra.run.smithi012.stdout: "max_size_kb": 0, 2023-10-05T11:49:40.334 INFO:teuthology.orchestra.run.smithi012.stdout: "max_objects": -1 2023-10-05T11:49:40.334 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-05T11:49:40.335 INFO:teuthology.orchestra.run.smithi012.stdout: "user_quota": { 2023-10-05T11:49:40.335 INFO:teuthology.orchestra.run.smithi012.stdout: "enabled": false, 2023-10-05T11:49:40.335 INFO:teuthology.orchestra.run.smithi012.stdout: "check_on_raw": false, 2023-10-05T11:49:40.335 INFO:teuthology.orchestra.run.smithi012.stdout: "max_size": -1, 2023-10-05T11:49:40.335 INFO:teuthology.orchestra.run.smithi012.stdout: "max_size_kb": 0, 2023-10-05T11:49:40.335 INFO:teuthology.orchestra.run.smithi012.stdout: "max_objects": -1 2023-10-05T11:49:40.335 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-05T11:49:40.336 INFO:teuthology.orchestra.run.smithi012.stdout: "temp_url_keys": [], 2023-10-05T11:49:40.336 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "rgw", 2023-10-05T11:49:40.336 INFO:teuthology.orchestra.run.smithi012.stdout: "mfa_ids": [] 2023-10-05T11:49:40.336 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-10-05T11:49:40.336 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:49:40.338 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.328+0000 7ff684ea8640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:49:40.338 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.331+0000 7ff6a1a0f880 20 remove_watcher() i=0 2023-10-05T11:49:40.338 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.331+0000 7ff6a1a0f880 2 removed watcher, disabling cache 2023-10-05T11:49:40.338 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.332+0000 7ff6a1a0f880 20 remove_watcher() i=1 2023-10-05T11:49:40.338 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.333+0000 7ff6a1a0f880 20 remove_watcher() i=2 2023-10-05T11:49:40.338 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.334+0000 7ff6a1a0f880 20 remove_watcher() i=3 2023-10-05T11:49:40.339 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.335+0000 7ff6a1a0f880 20 remove_watcher() i=4 2023-10-05T11:49:40.339 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.336+0000 7ff6a1a0f880 20 remove_watcher() i=5 2023-10-05T11:49:40.339 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.337+0000 7ff6a1a0f880 20 remove_watcher() i=6 2023-10-05T11:49:40.340 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.338+0000 7ff6a1a0f880 20 remove_watcher() i=7 2023-10-05T11:49:40.345 DEBUG:teuthology.orchestra.run.smithi012:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid 'testx$tenanteduser.client.0' --totp-serial 7386444665 --totp-seed IFG5XRLGBWGRP7F7HB7HLPW5Q77LUVVWYSUQTAL4NPXGGPIZVALP3TGCC3D3FGNO --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2023-10-05T11:49:40.411 INFO:teuthology.orchestra.run.smithi012.stderr:ignoring --setuser ceph since I am not root 2023-10-05T11:49:40.411 INFO:teuthology.orchestra.run.smithi012.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T11:49:40.421 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.419+0000 7fb5c2f1a880 20 rados->read ofs=0 len=0 2023-10-05T11:49:40.423 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.420+0000 7fb5c2f1a880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:49:40.423 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.420+0000 7fb5c2f1a880 20 realm 2023-10-05T11:49:40.423 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.420+0000 7fb5c2f1a880 20 rados->read ofs=0 len=0 2023-10-05T11:49:40.423 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.420+0000 7fb5c2f1a880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:49:40.424 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.420+0000 7fb5c2f1a880 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T11:49:40.424 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.420+0000 7fb5c2f1a880 20 rados->read ofs=0 len=0 2023-10-05T11:49:40.424 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.421+0000 7fb5c2f1a880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:49:40.424 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.421+0000 7fb5c2f1a880 20 rados->read ofs=0 len=0 2023-10-05T11:49:40.425 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.421+0000 7fb5c2f1a880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:49:40.425 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.421+0000 7fb5c2f1a880 20 rados->read ofs=0 len=0 2023-10-05T11:49:40.426 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.422+0000 7fb5c2f1a880 20 rados_obj.operate() r=0 bl.length=1020 2023-10-05T11:49:40.426 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.422+0000 7fb5c2f1a880 20 searching for the correct realm 2023-10-05T11:49:40.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.432+0000 7fb5c16c5640 0 -- 172.21.15.12:0/499077367 >> [v2:172.21.15.170:6814/3150808418,v1:172.21.15.170:6816/3150808418] conn(0x559f93dd3800 msgr2=0x559f932e0c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:49:40.437 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.432+0000 7fb5c2f1a880 20 RGWRados::pool_iterate: got zone_info.dff27d1e-df33-400e-a68a-7ba586947c99 2023-10-05T11:49:40.437 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.432+0000 7fb5c2f1a880 20 RGWRados::pool_iterate: got zonegroup_info.c78aa576-9d15-4e9d-b3c0-4af23a22062c 2023-10-05T11:49:40.437 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.432+0000 7fb5c2f1a880 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T11:49:40.437 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.432+0000 7fb5c2f1a880 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T11:49:40.437 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.432+0000 7fb5c2f1a880 20 rados->read ofs=0 len=0 2023-10-05T11:49:40.437 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.433+0000 7fb5c2f1a880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:49:40.437 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.433+0000 7fb5c2f1a880 20 rados->read ofs=0 len=0 2023-10-05T11:49:40.438 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.433+0000 7fb5c2f1a880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:49:40.438 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.433+0000 7fb5c2f1a880 20 rados->read ofs=0 len=0 2023-10-05T11:49:40.438 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.433+0000 7fb5c2f1a880 20 rados_obj.operate() r=0 bl.length=454 2023-10-05T11:49:40.438 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.433+0000 7fb5c2f1a880 20 zone default found 2023-10-05T11:49:40.438 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.433+0000 7fb5c2f1a880 4 Realm: () 2023-10-05T11:49:40.438 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.433+0000 7fb5c2f1a880 4 ZoneGroup: default (c78aa576-9d15-4e9d-b3c0-4af23a22062c) 2023-10-05T11:49:40.438 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.433+0000 7fb5c2f1a880 4 Zone: default (dff27d1e-df33-400e-a68a-7ba586947c99) 2023-10-05T11:49:40.438 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.433+0000 7fb5c2f1a880 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T11:49:40.439 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.433+0000 7fb5c2f1a880 20 zonegroup default 2023-10-05T11:49:40.439 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.433+0000 7fb5c2f1a880 20 rados->read ofs=0 len=0 2023-10-05T11:49:40.439 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.433+0000 7fb5c2f1a880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:49:40.439 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.433+0000 7fb5c2f1a880 20 rados->read ofs=0 len=0 2023-10-05T11:49:40.439 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.434+0000 7fb5c2f1a880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:49:40.439 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.434+0000 7fb5c2f1a880 20 rados->read ofs=0 len=0 2023-10-05T11:49:40.439 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.434+0000 7fb5c2f1a880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:49:40.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.434+0000 7fb5c2f1a880 20 started sync module instance, tier type = 2023-10-05T11:49:40.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.434+0000 7fb5c2f1a880 20 started zone id=dff27d1e-df33-400e-a68a-7ba586947c99 (name=default) with tier type = 2023-10-05T11:49:40.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.442+0000 7fb5c1ec6640 0 -- 172.21.15.12:0/499077367 >> [v2:172.21.15.12:6824/2171933159,v1:172.21.15.12:6825/2171933159] conn(0x559f93ef4400 msgr2=0x559f932e1700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:49:40.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.443+0000 7fb5c2f1a880 20 add_watcher() i=0 2023-10-05T11:49:40.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.443+0000 7fb5c2f1a880 20 add_watcher() i=1 2023-10-05T11:49:40.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.443+0000 7fb5c2f1a880 20 add_watcher() i=2 2023-10-05T11:49:40.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.443+0000 7fb5c2f1a880 20 add_watcher() i=3 2023-10-05T11:49:40.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.443+0000 7fb5c2f1a880 20 add_watcher() i=4 2023-10-05T11:49:40.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.443+0000 7fb5c2f1a880 20 add_watcher() i=5 2023-10-05T11:49:40.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.443+0000 7fb5c2f1a880 20 add_watcher() i=6 2023-10-05T11:49:40.447 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.444+0000 7fb5c2f1a880 20 add_watcher() i=7 2023-10-05T11:49:40.447 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.444+0000 7fb5c2f1a880 2 all 8 watchers are set, enabling cache 2023-10-05T11:49:40.448 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.445+0000 7fb5a8693640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:49:40.448 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.445+0000 7fb5c2f1a880 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T11:49:40.448 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.445+0000 7fb5c2f1a880 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T11:49:40.453 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.450+0000 7fb5c2f1a880 5 note: GC not initialized 2023-10-05T11:49:40.453 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.450+0000 7fb5a3e8a640 20 reqs_thread_entry: start 2023-10-05T11:49:40.453 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.450+0000 7fb5c2f1a880 20 init_complete bucket index max shards: 11 2023-10-05T11:49:40.453 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.451+0000 7fb5c2f1a880 20 Filter name: none 2023-10-05T11:49:40.453 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.451+0000 7fb5a1e86640 20 reqs_thread_entry: start 2023-10-05T11:49:40.453 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.451+0000 7fb5c2f1a880 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 : miss 2023-10-05T11:49:40.453 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.451+0000 7fb5c2f1a880 20 rados->read ofs=0 len=0 2023-10-05T11:49:40.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.451+0000 7fb5c2f1a880 20 rados_obj.operate() r=0 bl.length=514 2023-10-05T11:49:40.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.451+0000 7fb5c2f1a880 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x13 2023-10-05T11:49:40.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.451+0000 7fb5c2f1a880 10 adding default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2023-10-05T11:49:40.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.451+0000 7fb5c2f1a880 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T11:49:40.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.454+0000 7fb5c2f1a880 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2023-10-05T11:49:40.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.454+0000 7fb5c2f1a880 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2023-10-05T11:49:40.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.454+0000 7fb5c2f1a880 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser.client.0, ofs0, ns] 2023-10-05T11:49:40.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.454+0000 7fb5bbeba640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1069446856897 cookie 94143859238912 notifier 7748 bl.length()=728 2023-10-05T11:49:40.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.454+0000 7fb5bbeba640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2023-10-05T11:49:40.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.454+0000 7fb5bbeba640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2023-10-05T11:49:40.458 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.456+0000 7fb5a8693640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:49:40.460 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.458+0000 7fb5c2f1a880 20 remove_watcher() i=0 2023-10-05T11:49:40.460 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.458+0000 7fb5c2f1a880 2 removed watcher, disabling cache 2023-10-05T11:49:40.462 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.460+0000 7fb5c2f1a880 20 remove_watcher() i=1 2023-10-05T11:49:40.463 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.461+0000 7fb5c2f1a880 20 remove_watcher() i=2 2023-10-05T11:49:40.464 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.462+0000 7fb5c2f1a880 20 remove_watcher() i=3 2023-10-05T11:49:40.465 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.463+0000 7fb5c2f1a880 20 remove_watcher() i=4 2023-10-05T11:49:40.466 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.464+0000 7fb5c2f1a880 20 remove_watcher() i=5 2023-10-05T11:49:40.467 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.465+0000 7fb5c2f1a880 20 remove_watcher() i=6 2023-10-05T11:49:40.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.466+0000 7fb5c2f1a880 20 remove_watcher() i=7 2023-10-05T11:49:40.473 DEBUG:tasks.s3tests:Creating user foobar.client.0 on client.0 2023-10-05T11:49:40.473 DEBUG:teuthology.orchestra.run.smithi012:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid foobar.client.0 --display-name 'Mr. foobar.client.0' --email foobar.client.0+test@test.test --caps 'user-policy=*' --access-key MPCGDVUSGPHZYYXGDQJZ --secret U+kFYxZFxRx9DV8cqAe63+YjQvNfhInINGRsfkj1zGeBTP/X7BMCGA== --cluster ceph 2023-10-05T11:49:40.537 INFO:teuthology.orchestra.run.smithi012.stderr:ignoring --setuser ceph since I am not root 2023-10-05T11:49:40.537 INFO:teuthology.orchestra.run.smithi012.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T11:49:40.548 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.546+0000 7fb36248b880 20 rados->read ofs=0 len=0 2023-10-05T11:49:40.550 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.548+0000 7fb36248b880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:49:40.550 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.548+0000 7fb36248b880 20 realm 2023-10-05T11:49:40.550 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.548+0000 7fb36248b880 20 rados->read ofs=0 len=0 2023-10-05T11:49:40.550 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.548+0000 7fb36248b880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:49:40.551 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.548+0000 7fb36248b880 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T11:49:40.551 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.548+0000 7fb36248b880 20 rados->read ofs=0 len=0 2023-10-05T11:49:40.551 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.548+0000 7fb36248b880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:49:40.551 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.548+0000 7fb36248b880 20 rados->read ofs=0 len=0 2023-10-05T11:49:40.551 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.549+0000 7fb36248b880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:49:40.551 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.549+0000 7fb36248b880 20 rados->read ofs=0 len=0 2023-10-05T11:49:40.552 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.550+0000 7fb36248b880 20 rados_obj.operate() r=0 bl.length=1020 2023-10-05T11:49:40.552 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.550+0000 7fb36248b880 20 searching for the correct realm 2023-10-05T11:49:40.559 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.557+0000 7fb360c36640 0 -- 172.21.15.12:0/3487038672 >> [v2:172.21.15.12:6808/396693578,v1:172.21.15.12:6809/396693578] conn(0x56070f61e400 msgr2=0x56070f517700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-10-05T11:49:40.562 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.560+0000 7fb36248b880 20 RGWRados::pool_iterate: got zone_info.dff27d1e-df33-400e-a68a-7ba586947c99 2023-10-05T11:49:40.562 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.560+0000 7fb36248b880 20 RGWRados::pool_iterate: got zonegroup_info.c78aa576-9d15-4e9d-b3c0-4af23a22062c 2023-10-05T11:49:40.563 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.560+0000 7fb36248b880 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T11:49:40.563 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.560+0000 7fb36248b880 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T11:49:40.563 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.560+0000 7fb36248b880 20 rados->read ofs=0 len=0 2023-10-05T11:49:40.563 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.560+0000 7fb36248b880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:49:40.563 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.560+0000 7fb36248b880 20 rados->read ofs=0 len=0 2023-10-05T11:49:40.564 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.561+0000 7fb36248b880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:49:40.564 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.561+0000 7fb36248b880 20 rados->read ofs=0 len=0 2023-10-05T11:49:40.564 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.561+0000 7fb36248b880 20 rados_obj.operate() r=0 bl.length=454 2023-10-05T11:49:40.564 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.561+0000 7fb36248b880 20 zone default found 2023-10-05T11:49:40.564 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.561+0000 7fb36248b880 4 Realm: () 2023-10-05T11:49:40.564 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.561+0000 7fb36248b880 4 ZoneGroup: default (c78aa576-9d15-4e9d-b3c0-4af23a22062c) 2023-10-05T11:49:40.564 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.561+0000 7fb36248b880 4 Zone: default (dff27d1e-df33-400e-a68a-7ba586947c99) 2023-10-05T11:49:40.564 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.561+0000 7fb36248b880 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T11:49:40.564 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.561+0000 7fb36248b880 20 zonegroup default 2023-10-05T11:49:40.565 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.561+0000 7fb36248b880 20 rados->read ofs=0 len=0 2023-10-05T11:49:40.565 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.561+0000 7fb36248b880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:49:40.565 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.562+0000 7fb36248b880 20 rados->read ofs=0 len=0 2023-10-05T11:49:40.565 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.562+0000 7fb36248b880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:49:40.565 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.562+0000 7fb36248b880 20 rados->read ofs=0 len=0 2023-10-05T11:49:40.565 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.562+0000 7fb36248b880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:49:40.566 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.562+0000 7fb36248b880 20 started sync module instance, tier type = 2023-10-05T11:49:40.566 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.562+0000 7fb36248b880 20 started zone id=dff27d1e-df33-400e-a68a-7ba586947c99 (name=default) with tier type = 2023-10-05T11:49:40.566 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.563+0000 7fb361437640 0 -- 172.21.15.12:0/3487038672 >> [v2:172.21.15.170:6800/4137726411,v1:172.21.15.170:6801/4137726411] conn(0x56070f61e000 msgr2=0x56070f517180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:49:40.573 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.571+0000 7fb36248b880 20 add_watcher() i=0 2023-10-05T11:49:40.573 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.571+0000 7fb36248b880 20 add_watcher() i=1 2023-10-05T11:49:40.573 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.571+0000 7fb36248b880 20 add_watcher() i=2 2023-10-05T11:49:40.573 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.571+0000 7fb36248b880 20 add_watcher() i=3 2023-10-05T11:49:40.574 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.571+0000 7fb36248b880 20 add_watcher() i=4 2023-10-05T11:49:40.574 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.571+0000 7fb36248b880 20 add_watcher() i=5 2023-10-05T11:49:40.574 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.571+0000 7fb36248b880 20 add_watcher() i=6 2023-10-05T11:49:40.574 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.572+0000 7fb36248b880 20 add_watcher() i=7 2023-10-05T11:49:40.574 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.572+0000 7fb36248b880 2 all 8 watchers are set, enabling cache 2023-10-05T11:49:40.575 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.573+0000 7fb347c04640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:49:40.576 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.573+0000 7fb36248b880 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T11:49:40.576 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.573+0000 7fb36248b880 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T11:49:40.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.578+0000 7fb36248b880 5 note: GC not initialized 2023-10-05T11:49:40.581 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.578+0000 7fb3433fb640 20 reqs_thread_entry: start 2023-10-05T11:49:40.581 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.578+0000 7fb36248b880 20 init_complete bucket index max shards: 11 2023-10-05T11:49:40.581 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.578+0000 7fb36248b880 20 Filter name: none 2023-10-05T11:49:40.581 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.578+0000 7fb3413f7640 20 reqs_thread_entry: start 2023-10-05T11:49:40.581 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.578+0000 7fb36248b880 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2023-10-05T11:49:40.581 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.578+0000 7fb36248b880 20 rados->read ofs=0 len=0 2023-10-05T11:49:40.581 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.579+0000 7fb36248b880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:49:40.582 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.579+0000 7fb36248b880 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x0 2023-10-05T11:49:40.582 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.579+0000 7fb36248b880 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2023-10-05T11:49:40.582 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.579+0000 7fb36248b880 10 cache get: name=default.rgw.meta+users.email+foobar.client.0+test@test.test : miss 2023-10-05T11:49:40.582 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.579+0000 7fb36248b880 20 rados->read ofs=0 len=0 2023-10-05T11:49:40.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.579+0000 7fb36248b880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:49:40.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.579+0000 7fb36248b880 10 cache put: name=default.rgw.meta+users.email+foobar.client.0+test@test.test info.flags=0x0 2023-10-05T11:49:40.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.579+0000 7fb36248b880 10 adding default.rgw.meta+users.email+foobar.client.0+test@test.test to cache LRU end 2023-10-05T11:49:40.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.579+0000 7fb36248b880 10 cache get: name=default.rgw.meta+users.keys+MPCGDVUSGPHZYYXGDQJZ : miss 2023-10-05T11:49:40.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.579+0000 7fb36248b880 20 rados->read ofs=0 len=0 2023-10-05T11:49:40.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.579+0000 7fb36248b880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:49:40.584 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.579+0000 7fb36248b880 10 cache put: name=default.rgw.meta+users.keys+MPCGDVUSGPHZYYXGDQJZ info.flags=0x0 2023-10-05T11:49:40.584 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.579+0000 7fb36248b880 10 adding default.rgw.meta+users.keys+MPCGDVUSGPHZYYXGDQJZ to cache LRU end 2023-10-05T11:49:40.584 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.579+0000 7fb36248b880 10 cache get: name=default.rgw.meta+users.keys+MPCGDVUSGPHZYYXGDQJZ : hit (negative entry) 2023-10-05T11:49:40.584 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.579+0000 7fb36248b880 10 cache get: name=default.rgw.meta+users.keys+MPCGDVUSGPHZYYXGDQJZ : hit (negative entry) 2023-10-05T11:49:40.584 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.581+0000 7fb36248b880 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2023-10-05T11:49:40.584 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.581+0000 7fb36248b880 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2023-10-05T11:49:40.584 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.581+0000 7fb36248b880 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2023-10-05T11:49:40.584 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.581+0000 7fb35b42b640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1069446856784 cookie 94588322915328 notifier 7766 bl.length()=655 2023-10-05T11:49:40.584 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.581+0000 7fb35b42b640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2023-10-05T11:49:40.584 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.581+0000 7fb35b42b640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2023-10-05T11:49:40.586 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.584+0000 7fb36248b880 10 cache put: name=default.rgw.meta+users.email+foobar.client.0+test@test.test info.flags=0x7 2023-10-05T11:49:40.586 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.584+0000 7fb36248b880 10 moving default.rgw.meta+users.email+foobar.client.0+test@test.test to cache LRU end 2023-10-05T11:49:40.586 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.584+0000 7fb36248b880 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.email:foobar.client.0+test@test.test, ofs0, ns] 2023-10-05T11:49:40.586 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.584+0000 7fb35b42b640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1069446856898 cookie 94588322839552 notifier 7766 bl.length()=200 2023-10-05T11:49:40.587 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.584+0000 7fb35b42b640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foobar.client.0+test@test.test info.flags=0x7 2023-10-05T11:49:40.587 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.584+0000 7fb35b42b640 10 rgw watcher librados: moving default.rgw.meta+users.email+foobar.client.0+test@test.test to cache LRU end 2023-10-05T11:49:40.589 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.587+0000 7fb36248b880 10 cache put: name=default.rgw.meta+users.keys+MPCGDVUSGPHZYYXGDQJZ info.flags=0x7 2023-10-05T11:49:40.589 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.587+0000 7fb36248b880 10 moving default.rgw.meta+users.keys+MPCGDVUSGPHZYYXGDQJZ to cache LRU end 2023-10-05T11:49:40.589 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.587+0000 7fb36248b880 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.keys:MPCGDVUSGPHZYYXGDQJZ, ofs0, ns] 2023-10-05T11:49:40.589 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.587+0000 7fb35ac2a640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1069446856913 cookie 94588322746368 notifier 7766 bl.length()=189 2023-10-05T11:49:40.590 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.587+0000 7fb35ac2a640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+MPCGDVUSGPHZYYXGDQJZ info.flags=0x7 2023-10-05T11:49:40.590 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.587+0000 7fb35ac2a640 10 rgw watcher librados: moving default.rgw.meta+users.keys+MPCGDVUSGPHZYYXGDQJZ to cache LRU end 2023-10-05T11:49:40.590 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-10-05T11:49:40.590 INFO:teuthology.orchestra.run.smithi012.stdout: "user_id": "foobar.client.0", 2023-10-05T11:49:40.591 INFO:teuthology.orchestra.run.smithi012.stdout: "display_name": "Mr. foobar.client.0", 2023-10-05T11:49:40.591 INFO:teuthology.orchestra.run.smithi012.stdout: "email": "foobar.client.0+test@test.test", 2023-10-05T11:49:40.591 INFO:teuthology.orchestra.run.smithi012.stdout: "suspended": 0, 2023-10-05T11:49:40.591 INFO:teuthology.orchestra.run.smithi012.stdout: "max_buckets": 1000, 2023-10-05T11:49:40.591 INFO:teuthology.orchestra.run.smithi012.stdout: "subusers": [], 2023-10-05T11:49:40.591 INFO:teuthology.orchestra.run.smithi012.stdout: "keys": [ 2023-10-05T11:49:40.591 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-05T11:49:40.591 INFO:teuthology.orchestra.run.smithi012.stdout: "user": "foobar.client.0", 2023-10-05T11:49:40.591 INFO:teuthology.orchestra.run.smithi012.stdout: "access_key": "MPCGDVUSGPHZYYXGDQJZ", 2023-10-05T11:49:40.591 INFO:teuthology.orchestra.run.smithi012.stdout: "secret_key": "U+kFYxZFxRx9DV8cqAe63+YjQvNfhInINGRsfkj1zGeBTP/X7BMCGA==" 2023-10-05T11:49:40.591 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-05T11:49:40.591 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-10-05T11:49:40.592 INFO:teuthology.orchestra.run.smithi012.stdout: "swift_keys": [], 2023-10-05T11:49:40.592 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": [ 2023-10-05T11:49:40.592 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-05T11:49:40.592 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "user-policy", 2023-10-05T11:49:40.592 INFO:teuthology.orchestra.run.smithi012.stdout: "perm": "*" 2023-10-05T11:49:40.592 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-05T11:49:40.592 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-10-05T11:49:40.592 INFO:teuthology.orchestra.run.smithi012.stdout: "op_mask": "read, write, delete", 2023-10-05T11:49:40.592 INFO:teuthology.orchestra.run.smithi012.stdout: "default_placement": "", 2023-10-05T11:49:40.592 INFO:teuthology.orchestra.run.smithi012.stdout: "default_storage_class": "", 2023-10-05T11:49:40.592 INFO:teuthology.orchestra.run.smithi012.stdout: "placement_tags": [], 2023-10-05T11:49:40.592 INFO:teuthology.orchestra.run.smithi012.stdout: "bucket_quota": { 2023-10-05T11:49:40.593 INFO:teuthology.orchestra.run.smithi012.stdout: "enabled": false, 2023-10-05T11:49:40.593 INFO:teuthology.orchestra.run.smithi012.stdout: "check_on_raw": false, 2023-10-05T11:49:40.593 INFO:teuthology.orchestra.run.smithi012.stdout: "max_size": -1, 2023-10-05T11:49:40.593 INFO:teuthology.orchestra.run.smithi012.stdout: "max_size_kb": 0, 2023-10-05T11:49:40.593 INFO:teuthology.orchestra.run.smithi012.stdout: "max_objects": -1 2023-10-05T11:49:40.593 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-05T11:49:40.593 INFO:teuthology.orchestra.run.smithi012.stdout: "user_quota": { 2023-10-05T11:49:40.593 INFO:teuthology.orchestra.run.smithi012.stdout: "enabled": false, 2023-10-05T11:49:40.593 INFO:teuthology.orchestra.run.smithi012.stdout: "check_on_raw": false, 2023-10-05T11:49:40.593 INFO:teuthology.orchestra.run.smithi012.stdout: "max_size": -1, 2023-10-05T11:49:40.593 INFO:teuthology.orchestra.run.smithi012.stdout: "max_size_kb": 0, 2023-10-05T11:49:40.593 INFO:teuthology.orchestra.run.smithi012.stdout: "max_objects": -1 2023-10-05T11:49:40.594 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-05T11:49:40.594 INFO:teuthology.orchestra.run.smithi012.stdout: "temp_url_keys": [], 2023-10-05T11:49:40.594 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "rgw", 2023-10-05T11:49:40.594 INFO:teuthology.orchestra.run.smithi012.stdout: "mfa_ids": [] 2023-10-05T11:49:40.594 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-10-05T11:49:40.594 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:49:40.595 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.589+0000 7fb347c04640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:49:40.595 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.591+0000 7fb36248b880 20 remove_watcher() i=0 2023-10-05T11:49:40.595 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.591+0000 7fb36248b880 2 removed watcher, disabling cache 2023-10-05T11:49:40.595 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.592+0000 7fb36248b880 20 remove_watcher() i=1 2023-10-05T11:49:40.595 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.593+0000 7fb36248b880 20 remove_watcher() i=2 2023-10-05T11:49:40.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.594+0000 7fb36248b880 20 remove_watcher() i=3 2023-10-05T11:49:40.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.595+0000 7fb36248b880 20 remove_watcher() i=4 2023-10-05T11:49:40.598 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.596+0000 7fb36248b880 20 remove_watcher() i=5 2023-10-05T11:49:40.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.597+0000 7fb36248b880 20 remove_watcher() i=6 2023-10-05T11:49:40.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.598+0000 7fb36248b880 20 remove_watcher() i=7 2023-10-05T11:49:40.605 DEBUG:teuthology.orchestra.run.smithi012:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid foobar.client.0 --totp-serial 4384343129 --totp-seed RRUXAKFZWHAVDJIVWCXDXLG5NFQJCE6OVRHBWQKV5PTGZ3PCWNA35J5JGWMD7CE6 --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2023-10-05T11:49:40.669 INFO:teuthology.orchestra.run.smithi012.stderr:ignoring --setuser ceph since I am not root 2023-10-05T11:49:40.669 INFO:teuthology.orchestra.run.smithi012.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T11:49:40.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.677+0000 7f703900a880 20 rados->read ofs=0 len=0 2023-10-05T11:49:40.680 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.678+0000 7f703900a880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:49:40.681 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.678+0000 7f703900a880 20 realm 2023-10-05T11:49:40.681 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.678+0000 7f703900a880 20 rados->read ofs=0 len=0 2023-10-05T11:49:40.681 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.678+0000 7f703900a880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:49:40.681 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.678+0000 7f703900a880 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T11:49:40.681 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.678+0000 7f703900a880 20 rados->read ofs=0 len=0 2023-10-05T11:49:40.681 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.679+0000 7f703900a880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:49:40.681 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.679+0000 7f703900a880 20 rados->read ofs=0 len=0 2023-10-05T11:49:40.682 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.680+0000 7f703900a880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:49:40.682 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.680+0000 7f703900a880 20 rados->read ofs=0 len=0 2023-10-05T11:49:40.683 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.681+0000 7f703900a880 20 rados_obj.operate() r=0 bl.length=1020 2023-10-05T11:49:40.683 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.681+0000 7f703900a880 20 searching for the correct realm 2023-10-05T11:49:40.691 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.689+0000 7f70377b5640 0 -- 172.21.15.12:0/1397742892 >> [v2:172.21.15.12:6800/732466381,v1:172.21.15.12:6801/732466381] conn(0x561b08111c00 msgr2=0x561b08112b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-10-05T11:49:40.694 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.691+0000 7f703900a880 20 RGWRados::pool_iterate: got zone_info.dff27d1e-df33-400e-a68a-7ba586947c99 2023-10-05T11:49:40.694 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.691+0000 7f703900a880 20 RGWRados::pool_iterate: got zonegroup_info.c78aa576-9d15-4e9d-b3c0-4af23a22062c 2023-10-05T11:49:40.694 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.691+0000 7f703900a880 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T11:49:40.694 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.691+0000 7f703900a880 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T11:49:40.694 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.691+0000 7f703900a880 20 rados->read ofs=0 len=0 2023-10-05T11:49:40.694 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.691+0000 7f703900a880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:49:40.694 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.691+0000 7f703900a880 20 rados->read ofs=0 len=0 2023-10-05T11:49:40.694 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.692+0000 7f703900a880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:49:40.695 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.692+0000 7f703900a880 20 rados->read ofs=0 len=0 2023-10-05T11:49:40.696 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.692+0000 7f703900a880 20 rados_obj.operate() r=0 bl.length=454 2023-10-05T11:49:40.696 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.692+0000 7f703900a880 20 zone default found 2023-10-05T11:49:40.696 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.692+0000 7f703900a880 4 Realm: () 2023-10-05T11:49:40.696 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.692+0000 7f703900a880 4 ZoneGroup: default (c78aa576-9d15-4e9d-b3c0-4af23a22062c) 2023-10-05T11:49:40.696 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.692+0000 7f703900a880 4 Zone: default (dff27d1e-df33-400e-a68a-7ba586947c99) 2023-10-05T11:49:40.696 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.692+0000 7f703900a880 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T11:49:40.696 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.692+0000 7f703900a880 20 zonegroup default 2023-10-05T11:49:40.696 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.692+0000 7f703900a880 20 rados->read ofs=0 len=0 2023-10-05T11:49:40.696 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.692+0000 7f703900a880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:49:40.697 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.692+0000 7f703900a880 20 rados->read ofs=0 len=0 2023-10-05T11:49:40.697 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.693+0000 7f703900a880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:49:40.697 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.693+0000 7f703900a880 20 rados->read ofs=0 len=0 2023-10-05T11:49:40.697 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.693+0000 7f703900a880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:49:40.697 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.693+0000 7f703900a880 20 started sync module instance, tier type = 2023-10-05T11:49:40.697 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.693+0000 7f703900a880 20 started zone id=dff27d1e-df33-400e-a68a-7ba586947c99 (name=default) with tier type = 2023-10-05T11:49:40.699 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.697+0000 7f7037fb6640 0 -- 172.21.15.12:0/1397742892 >> [v2:172.21.15.170:6800/4137726411,v1:172.21.15.170:6801/4137726411] conn(0x561b08208c00 msgr2=0x561b08113600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-10-05T11:49:40.704 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.702+0000 7f703900a880 20 add_watcher() i=0 2023-10-05T11:49:40.704 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.702+0000 7f703900a880 20 add_watcher() i=1 2023-10-05T11:49:40.705 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.702+0000 7f703900a880 20 add_watcher() i=2 2023-10-05T11:49:40.705 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.702+0000 7f703900a880 20 add_watcher() i=3 2023-10-05T11:49:40.705 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.702+0000 7f703900a880 20 add_watcher() i=4 2023-10-05T11:49:40.705 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.702+0000 7f703900a880 20 add_watcher() i=5 2023-10-05T11:49:40.705 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.702+0000 7f703900a880 20 add_watcher() i=6 2023-10-05T11:49:40.705 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.703+0000 7f703900a880 20 add_watcher() i=7 2023-10-05T11:49:40.705 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.703+0000 7f703900a880 2 all 8 watchers are set, enabling cache 2023-10-05T11:49:40.707 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.705+0000 7f701e783640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:49:40.707 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.705+0000 7f703900a880 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T11:49:40.707 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.705+0000 7f703900a880 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T11:49:40.712 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.709+0000 7f703900a880 5 note: GC not initialized 2023-10-05T11:49:40.712 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.709+0000 7f7019f7a640 20 reqs_thread_entry: start 2023-10-05T11:49:40.712 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.710+0000 7f703900a880 20 init_complete bucket index max shards: 11 2023-10-05T11:49:40.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.710+0000 7f703900a880 20 Filter name: none 2023-10-05T11:49:40.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.710+0000 7f7017f76640 20 reqs_thread_entry: start 2023-10-05T11:49:40.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.710+0000 7f703900a880 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2023-10-05T11:49:40.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.710+0000 7f703900a880 20 rados->read ofs=0 len=0 2023-10-05T11:49:40.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.710+0000 7f703900a880 20 rados_obj.operate() r=0 bl.length=467 2023-10-05T11:49:40.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.710+0000 7f703900a880 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x13 2023-10-05T11:49:40.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.710+0000 7f703900a880 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2023-10-05T11:49:40.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.710+0000 7f703900a880 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T11:49:40.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.713+0000 7f703900a880 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2023-10-05T11:49:40.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.713+0000 7f703900a880 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2023-10-05T11:49:40.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.713+0000 7f703900a880 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2023-10-05T11:49:40.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.713+0000 7f7031faa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1069446856785 cookie 94674100593664 notifier 7787 bl.length()=669 2023-10-05T11:49:40.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.713+0000 7f7031faa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2023-10-05T11:49:40.716 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.713+0000 7f7031faa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2023-10-05T11:49:40.717 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.715+0000 7f701e783640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:49:40.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.717+0000 7f703900a880 20 remove_watcher() i=0 2023-10-05T11:49:40.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.717+0000 7f703900a880 2 removed watcher, disabling cache 2023-10-05T11:49:40.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.718+0000 7f703900a880 20 remove_watcher() i=1 2023-10-05T11:49:40.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.719+0000 7f703900a880 20 remove_watcher() i=2 2023-10-05T11:49:40.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.721+0000 7f703900a880 20 remove_watcher() i=3 2023-10-05T11:49:40.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.722+0000 7f703900a880 20 remove_watcher() i=4 2023-10-05T11:49:40.725 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.722+0000 7f703900a880 20 remove_watcher() i=5 2023-10-05T11:49:40.725 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.723+0000 7f703900a880 20 remove_watcher() i=6 2023-10-05T11:49:40.726 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.724+0000 7f703900a880 20 remove_watcher() i=7 2023-10-05T11:49:40.732 DEBUG:teuthology.orchestra.run.smithi012:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 caps add --uid foobar.client.0 --caps 'roles=*' --cluster ceph 2023-10-05T11:49:40.788 INFO:teuthology.orchestra.run.smithi012.stderr:ignoring --setuser ceph since I am not root 2023-10-05T11:49:40.788 INFO:teuthology.orchestra.run.smithi012.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T11:49:40.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.796+0000 7fbc0a633880 20 rados->read ofs=0 len=0 2023-10-05T11:49:40.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.797+0000 7fbc0a633880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:49:40.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.798+0000 7fbc0a633880 20 realm 2023-10-05T11:49:40.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.798+0000 7fbc0a633880 20 rados->read ofs=0 len=0 2023-10-05T11:49:40.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.798+0000 7fbc0a633880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:49:40.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.798+0000 7fbc0a633880 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T11:49:40.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.798+0000 7fbc0a633880 20 rados->read ofs=0 len=0 2023-10-05T11:49:40.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.798+0000 7fbc0a633880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:49:40.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.798+0000 7fbc0a633880 20 rados->read ofs=0 len=0 2023-10-05T11:49:40.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.799+0000 7fbc0a633880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:49:40.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.799+0000 7fbc0a633880 20 rados->read ofs=0 len=0 2023-10-05T11:49:40.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.800+0000 7fbc0a633880 20 rados_obj.operate() r=0 bl.length=1020 2023-10-05T11:49:40.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.800+0000 7fbc0a633880 20 searching for the correct realm 2023-10-05T11:49:40.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.809+0000 7fbc095df640 0 -- 172.21.15.12:0/3799214605 >> [v2:172.21.15.12:6824/2171933159,v1:172.21.15.12:6825/2171933159] conn(0x55e4cde7e800 msgr2=0x55e4cdd05700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:49:40.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.810+0000 7fbc0a633880 20 RGWRados::pool_iterate: got zone_info.dff27d1e-df33-400e-a68a-7ba586947c99 2023-10-05T11:49:40.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.810+0000 7fbc0a633880 20 RGWRados::pool_iterate: got zonegroup_info.c78aa576-9d15-4e9d-b3c0-4af23a22062c 2023-10-05T11:49:40.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.810+0000 7fbc0a633880 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T11:49:40.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.810+0000 7fbc0a633880 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T11:49:40.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.810+0000 7fbc0a633880 20 rados->read ofs=0 len=0 2023-10-05T11:49:40.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.810+0000 7fbc0a633880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:49:40.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.810+0000 7fbc0a633880 20 rados->read ofs=0 len=0 2023-10-05T11:49:40.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.810+0000 7fbc0a633880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:49:40.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.810+0000 7fbc0a633880 20 rados->read ofs=0 len=0 2023-10-05T11:49:40.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.810+0000 7fbc0a633880 20 rados_obj.operate() r=0 bl.length=454 2023-10-05T11:49:40.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.810+0000 7fbc0a633880 20 zone default found 2023-10-05T11:49:40.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.810+0000 7fbc0a633880 4 Realm: () 2023-10-05T11:49:40.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.810+0000 7fbc0a633880 4 ZoneGroup: default (c78aa576-9d15-4e9d-b3c0-4af23a22062c) 2023-10-05T11:49:40.815 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.810+0000 7fbc0a633880 4 Zone: default (dff27d1e-df33-400e-a68a-7ba586947c99) 2023-10-05T11:49:40.815 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.810+0000 7fbc0a633880 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T11:49:40.815 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.810+0000 7fbc0a633880 20 zonegroup default 2023-10-05T11:49:40.815 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.810+0000 7fbc0a633880 20 rados->read ofs=0 len=0 2023-10-05T11:49:40.815 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.811+0000 7fbc0a633880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:49:40.815 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.811+0000 7fbc0a633880 20 rados->read ofs=0 len=0 2023-10-05T11:49:40.815 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.811+0000 7fbc0a633880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:49:40.815 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.811+0000 7fbc0a633880 20 rados->read ofs=0 len=0 2023-10-05T11:49:40.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.811+0000 7fbc0a633880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:49:40.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.811+0000 7fbc0a633880 20 started sync module instance, tier type = 2023-10-05T11:49:40.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.811+0000 7fbc0a633880 20 started zone id=dff27d1e-df33-400e-a68a-7ba586947c99 (name=default) with tier type = 2023-10-05T11:49:40.821 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.819+0000 7fbc095df640 0 -- 172.21.15.12:0/3799214605 >> [v2:172.21.15.12:6824/2171933159,v1:172.21.15.12:6825/2171933159] conn(0x55e4cdeab800 msgr2=0x55e4cdd92100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:49:40.823 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.820+0000 7fbc0a633880 20 add_watcher() i=0 2023-10-05T11:49:40.823 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.820+0000 7fbc0a633880 20 add_watcher() i=1 2023-10-05T11:49:40.823 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.820+0000 7fbc0a633880 20 add_watcher() i=2 2023-10-05T11:49:40.823 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.820+0000 7fbc0a633880 20 add_watcher() i=3 2023-10-05T11:49:40.823 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.820+0000 7fbc0a633880 20 add_watcher() i=4 2023-10-05T11:49:40.823 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.820+0000 7fbc0a633880 20 add_watcher() i=5 2023-10-05T11:49:40.823 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.820+0000 7fbc0a633880 20 add_watcher() i=6 2023-10-05T11:49:40.823 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.821+0000 7fbc0a633880 20 add_watcher() i=7 2023-10-05T11:49:40.824 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.821+0000 7fbc0a633880 2 all 8 watchers are set, enabling cache 2023-10-05T11:49:40.825 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.823+0000 7fbbefdac640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:49:40.825 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.823+0000 7fbc0a633880 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T11:49:40.825 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.823+0000 7fbc0a633880 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T11:49:40.830 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.827+0000 7fbc0a633880 5 note: GC not initialized 2023-10-05T11:49:40.830 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.827+0000 7fbbeb5a3640 20 reqs_thread_entry: start 2023-10-05T11:49:40.830 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.827+0000 7fbc0a633880 20 init_complete bucket index max shards: 11 2023-10-05T11:49:40.830 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.828+0000 7fbc0a633880 20 Filter name: none 2023-10-05T11:49:40.830 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.828+0000 7fbbe959f640 20 reqs_thread_entry: start 2023-10-05T11:49:40.830 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.828+0000 7fbc0a633880 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2023-10-05T11:49:40.830 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.828+0000 7fbc0a633880 20 rados->read ofs=0 len=0 2023-10-05T11:49:40.831 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.828+0000 7fbc0a633880 20 rados_obj.operate() r=0 bl.length=481 2023-10-05T11:49:40.831 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.828+0000 7fbc0a633880 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x13 2023-10-05T11:49:40.831 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.828+0000 7fbc0a633880 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2023-10-05T11:49:40.831 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.828+0000 7fbc0a633880 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T11:49:40.832 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.830+0000 7fbc0a633880 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2023-10-05T11:49:40.832 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.830+0000 7fbc0a633880 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2023-10-05T11:49:40.832 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.830+0000 7fbc0a633880 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2023-10-05T11:49:40.832 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.830+0000 7fbc035d3640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1069446856786 cookie 94441195711488 notifier 7808 bl.length()=682 2023-10-05T11:49:40.832 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.830+0000 7fbc035d3640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2023-10-05T11:49:40.833 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.830+0000 7fbc035d3640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2023-10-05T11:49:40.834 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-10-05T11:49:40.834 INFO:teuthology.orchestra.run.smithi012.stdout: "user_id": "foobar.client.0", 2023-10-05T11:49:40.834 INFO:teuthology.orchestra.run.smithi012.stdout: "display_name": "Mr. foobar.client.0", 2023-10-05T11:49:40.834 INFO:teuthology.orchestra.run.smithi012.stdout: "email": "foobar.client.0+test@test.test", 2023-10-05T11:49:40.834 INFO:teuthology.orchestra.run.smithi012.stdout: "suspended": 0, 2023-10-05T11:49:40.834 INFO:teuthology.orchestra.run.smithi012.stdout: "max_buckets": 1000, 2023-10-05T11:49:40.834 INFO:teuthology.orchestra.run.smithi012.stdout: "subusers": [], 2023-10-05T11:49:40.834 INFO:teuthology.orchestra.run.smithi012.stdout: "keys": [ 2023-10-05T11:49:40.834 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-05T11:49:40.835 INFO:teuthology.orchestra.run.smithi012.stdout: "user": "foobar.client.0", 2023-10-05T11:49:40.835 INFO:teuthology.orchestra.run.smithi012.stdout: "access_key": "MPCGDVUSGPHZYYXGDQJZ", 2023-10-05T11:49:40.835 INFO:teuthology.orchestra.run.smithi012.stdout: "secret_key": "U+kFYxZFxRx9DV8cqAe63+YjQvNfhInINGRsfkj1zGeBTP/X7BMCGA==" 2023-10-05T11:49:40.835 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-05T11:49:40.835 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-10-05T11:49:40.835 INFO:teuthology.orchestra.run.smithi012.stdout: "swift_keys": [], 2023-10-05T11:49:40.835 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": [ 2023-10-05T11:49:40.835 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-05T11:49:40.835 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "roles", 2023-10-05T11:49:40.835 INFO:teuthology.orchestra.run.smithi012.stdout: "perm": "*" 2023-10-05T11:49:40.835 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-05T11:49:40.836 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-05T11:49:40.836 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "user-policy", 2023-10-05T11:49:40.836 INFO:teuthology.orchestra.run.smithi012.stdout: "perm": "*" 2023-10-05T11:49:40.836 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-05T11:49:40.836 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-10-05T11:49:40.836 INFO:teuthology.orchestra.run.smithi012.stdout: "op_mask": "read, write, delete", 2023-10-05T11:49:40.836 INFO:teuthology.orchestra.run.smithi012.stdout: "default_placement": "", 2023-10-05T11:49:40.836 INFO:teuthology.orchestra.run.smithi012.stdout: "default_storage_class": "", 2023-10-05T11:49:40.836 INFO:teuthology.orchestra.run.smithi012.stdout: "placement_tags": [], 2023-10-05T11:49:40.836 INFO:teuthology.orchestra.run.smithi012.stdout: "bucket_quota": { 2023-10-05T11:49:40.836 INFO:teuthology.orchestra.run.smithi012.stdout: "enabled": false, 2023-10-05T11:49:40.837 INFO:teuthology.orchestra.run.smithi012.stdout: "check_on_raw": false, 2023-10-05T11:49:40.837 INFO:teuthology.orchestra.run.smithi012.stdout: "max_size": -1, 2023-10-05T11:49:40.837 INFO:teuthology.orchestra.run.smithi012.stdout: "max_size_kb": 0, 2023-10-05T11:49:40.837 INFO:teuthology.orchestra.run.smithi012.stdout: "max_objects": -1 2023-10-05T11:49:40.837 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-05T11:49:40.837 INFO:teuthology.orchestra.run.smithi012.stdout: "user_quota": { 2023-10-05T11:49:40.837 INFO:teuthology.orchestra.run.smithi012.stdout: "enabled": false, 2023-10-05T11:49:40.837 INFO:teuthology.orchestra.run.smithi012.stdout: "check_on_raw": false, 2023-10-05T11:49:40.837 INFO:teuthology.orchestra.run.smithi012.stdout: "max_size": -1, 2023-10-05T11:49:40.837 INFO:teuthology.orchestra.run.smithi012.stdout: "max_size_kb": 0, 2023-10-05T11:49:40.837 INFO:teuthology.orchestra.run.smithi012.stdout: "max_objects": -1 2023-10-05T11:49:40.838 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-05T11:49:40.838 INFO:teuthology.orchestra.run.smithi012.stdout: "temp_url_keys": [], 2023-10-05T11:49:40.838 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "rgw", 2023-10-05T11:49:40.838 INFO:teuthology.orchestra.run.smithi012.stdout: "mfa_ids": [ 2023-10-05T11:49:40.838 INFO:teuthology.orchestra.run.smithi012.stdout: "4384343129" 2023-10-05T11:49:40.838 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2023-10-05T11:49:40.838 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-10-05T11:49:40.838 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:49:40.839 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.832+0000 7fbbefdac640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:49:40.839 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.834+0000 7fbc0a633880 20 remove_watcher() i=0 2023-10-05T11:49:40.839 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.834+0000 7fbc0a633880 2 removed watcher, disabling cache 2023-10-05T11:49:40.839 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.836+0000 7fbc0a633880 20 remove_watcher() i=1 2023-10-05T11:49:40.839 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.837+0000 7fbc0a633880 20 remove_watcher() i=2 2023-10-05T11:49:40.840 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.838+0000 7fbc0a633880 20 remove_watcher() i=3 2023-10-05T11:49:40.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.839+0000 7fbc0a633880 20 remove_watcher() i=4 2023-10-05T11:49:40.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.839+0000 7fbc0a633880 20 remove_watcher() i=5 2023-10-05T11:49:40.842 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.840+0000 7fbc0a633880 20 remove_watcher() i=6 2023-10-05T11:49:40.843 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.841+0000 7fbc0a633880 20 remove_watcher() i=7 2023-10-05T11:49:40.848 DEBUG:teuthology.orchestra.run.smithi012:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 caps add --uid foobar.client.0 --caps 'oidc-provider=*' --cluster ceph 2023-10-05T11:49:40.904 INFO:teuthology.orchestra.run.smithi012.stderr:ignoring --setuser ceph since I am not root 2023-10-05T11:49:40.904 INFO:teuthology.orchestra.run.smithi012.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T11:49:40.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.923+0000 7f088e612880 20 rados->read ofs=0 len=0 2023-10-05T11:49:40.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.926+0000 7f088e612880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:49:40.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.926+0000 7f088e612880 20 realm 2023-10-05T11:49:40.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.926+0000 7f088e612880 20 rados->read ofs=0 len=0 2023-10-05T11:49:40.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.926+0000 7f088e612880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:49:40.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.926+0000 7f088e612880 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-10-05T11:49:40.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.926+0000 7f088e612880 20 rados->read ofs=0 len=0 2023-10-05T11:49:40.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.926+0000 7f088e612880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:49:40.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.926+0000 7f088e612880 20 rados->read ofs=0 len=0 2023-10-05T11:49:40.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.927+0000 7f088e612880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:49:40.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.927+0000 7f088e612880 20 rados->read ofs=0 len=0 2023-10-05T11:49:40.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.930+0000 7f088e612880 20 rados_obj.operate() r=0 bl.length=1020 2023-10-05T11:49:40.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.930+0000 7f088e612880 20 searching for the correct realm 2023-10-05T11:49:40.954 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.951+0000 7f088aaae640 0 -- 172.21.15.12:0/876011528 >> [v2:172.21.15.170:6814/3150808418,v1:172.21.15.170:6816/3150808418] conn(0x56210b075c00 msgr2=0x56210a47ac00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-10-05T11:49:40.954 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.951+0000 7f088e612880 20 RGWRados::pool_iterate: got zone_info.dff27d1e-df33-400e-a68a-7ba586947c99 2023-10-05T11:49:40.954 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.951+0000 7f088e612880 20 RGWRados::pool_iterate: got zonegroup_info.c78aa576-9d15-4e9d-b3c0-4af23a22062c 2023-10-05T11:49:40.954 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.951+0000 7f088e612880 20 RGWRados::pool_iterate: got zone_names.default 2023-10-05T11:49:40.954 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.951+0000 7f088e612880 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-10-05T11:49:40.954 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.951+0000 7f088e612880 20 rados->read ofs=0 len=0 2023-10-05T11:49:40.954 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.951+0000 7f088e612880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:49:40.954 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.951+0000 7f088e612880 20 rados->read ofs=0 len=0 2023-10-05T11:49:40.954 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.952+0000 7f088e612880 20 rados_obj.operate() r=0 bl.length=46 2023-10-05T11:49:40.955 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.952+0000 7f088e612880 20 rados->read ofs=0 len=0 2023-10-05T11:49:40.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.952+0000 7f088e612880 20 rados_obj.operate() r=0 bl.length=454 2023-10-05T11:49:40.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.952+0000 7f088e612880 20 zone default found 2023-10-05T11:49:40.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.952+0000 7f088e612880 4 Realm: () 2023-10-05T11:49:40.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.952+0000 7f088e612880 4 ZoneGroup: default (c78aa576-9d15-4e9d-b3c0-4af23a22062c) 2023-10-05T11:49:40.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.952+0000 7f088e612880 4 Zone: default (dff27d1e-df33-400e-a68a-7ba586947c99) 2023-10-05T11:49:40.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.952+0000 7f088e612880 10 cannot find current period zonegroup using local zonegroup configuration 2023-10-05T11:49:40.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.952+0000 7f088e612880 20 zonegroup default 2023-10-05T11:49:40.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.952+0000 7f088e612880 20 rados->read ofs=0 len=0 2023-10-05T11:49:40.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.952+0000 7f088e612880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:49:40.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.952+0000 7f088e612880 20 rados->read ofs=0 len=0 2023-10-05T11:49:40.957 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.952+0000 7f088e612880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:49:40.957 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.952+0000 7f088e612880 20 rados->read ofs=0 len=0 2023-10-05T11:49:40.957 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.953+0000 7f088e612880 20 rados_obj.operate() r=-2 bl.length=0 2023-10-05T11:49:40.957 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.953+0000 7f088e612880 20 started sync module instance, tier type = 2023-10-05T11:49:40.957 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.953+0000 7f088e612880 20 started zone id=dff27d1e-df33-400e-a68a-7ba586947c99 (name=default) with tier type = 2023-10-05T11:49:40.962 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.960+0000 7f088b2af640 0 -- 172.21.15.12:0/876011528 >> [v2:172.21.15.12:6824/2171933159,v1:172.21.15.12:6825/2171933159] conn(0x56210a5f1400 msgr2=0x56210a47b700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-10-05T11:49:40.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.961+0000 7f088e612880 20 add_watcher() i=0 2023-10-05T11:49:40.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.961+0000 7f088e612880 20 add_watcher() i=1 2023-10-05T11:49:40.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.961+0000 7f088e612880 20 add_watcher() i=2 2023-10-05T11:49:40.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.961+0000 7f088e612880 20 add_watcher() i=3 2023-10-05T11:49:40.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.961+0000 7f088e612880 20 add_watcher() i=4 2023-10-05T11:49:40.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.962+0000 7f088e612880 20 add_watcher() i=5 2023-10-05T11:49:40.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.962+0000 7f088e612880 20 add_watcher() i=6 2023-10-05T11:49:40.965 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.962+0000 7f088e612880 20 add_watcher() i=7 2023-10-05T11:49:40.965 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.962+0000 7f088e612880 2 all 8 watchers are set, enabling cache 2023-10-05T11:49:40.966 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.964+0000 7f0871a7c640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:49:40.966 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.964+0000 7f088e612880 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2023-10-05T11:49:40.966 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.964+0000 7f088e612880 20 check_secure_mon_conn(): mode 1 is insecure 2023-10-05T11:49:40.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.968+0000 7f088e612880 5 note: GC not initialized 2023-10-05T11:49:40.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.969+0000 7f086d273640 20 reqs_thread_entry: start 2023-10-05T11:49:40.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.969+0000 7f088e612880 20 init_complete bucket index max shards: 11 2023-10-05T11:49:40.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.969+0000 7f088e612880 20 Filter name: none 2023-10-05T11:49:40.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.969+0000 7f086b26f640 20 reqs_thread_entry: start 2023-10-05T11:49:40.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.969+0000 7f088e612880 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2023-10-05T11:49:40.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.969+0000 7f088e612880 20 rados->read ofs=0 len=0 2023-10-05T11:49:40.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.969+0000 7f088e612880 20 rados_obj.operate() r=0 bl.length=494 2023-10-05T11:49:40.973 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.969+0000 7f088e612880 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x13 2023-10-05T11:49:40.973 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.969+0000 7f088e612880 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2023-10-05T11:49:40.973 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.969+0000 7f088e612880 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-10-05T11:49:40.973 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.971+0000 7f088e612880 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2023-10-05T11:49:40.974 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.971+0000 7f088e612880 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2023-10-05T11:49:40.974 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.971+0000 7f088e612880 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2023-10-05T11:49:40.974 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.971+0000 7f08852a3640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824083 cookie 94699908099072 notifier 8286 bl.length()=703 2023-10-05T11:49:40.974 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.971+0000 7f08852a3640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2023-10-05T11:49:40.974 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.971+0000 7f08852a3640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2023-10-05T11:49:40.975 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-10-05T11:49:40.975 INFO:teuthology.orchestra.run.smithi012.stdout: "user_id": "foobar.client.0", 2023-10-05T11:49:40.975 INFO:teuthology.orchestra.run.smithi012.stdout: "display_name": "Mr. foobar.client.0", 2023-10-05T11:49:40.975 INFO:teuthology.orchestra.run.smithi012.stdout: "email": "foobar.client.0+test@test.test", 2023-10-05T11:49:40.975 INFO:teuthology.orchestra.run.smithi012.stdout: "suspended": 0, 2023-10-05T11:49:40.975 INFO:teuthology.orchestra.run.smithi012.stdout: "max_buckets": 1000, 2023-10-05T11:49:40.975 INFO:teuthology.orchestra.run.smithi012.stdout: "subusers": [], 2023-10-05T11:49:40.975 INFO:teuthology.orchestra.run.smithi012.stdout: "keys": [ 2023-10-05T11:49:40.975 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-05T11:49:40.975 INFO:teuthology.orchestra.run.smithi012.stdout: "user": "foobar.client.0", 2023-10-05T11:49:40.975 INFO:teuthology.orchestra.run.smithi012.stdout: "access_key": "MPCGDVUSGPHZYYXGDQJZ", 2023-10-05T11:49:40.976 INFO:teuthology.orchestra.run.smithi012.stdout: "secret_key": "U+kFYxZFxRx9DV8cqAe63+YjQvNfhInINGRsfkj1zGeBTP/X7BMCGA==" 2023-10-05T11:49:40.976 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-05T11:49:40.976 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-10-05T11:49:40.976 INFO:teuthology.orchestra.run.smithi012.stdout: "swift_keys": [], 2023-10-05T11:49:40.976 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": [ 2023-10-05T11:49:40.976 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-05T11:49:40.976 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "oidc-provider", 2023-10-05T11:49:40.976 INFO:teuthology.orchestra.run.smithi012.stdout: "perm": "*" 2023-10-05T11:49:40.976 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-05T11:49:40.976 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-05T11:49:40.976 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "roles", 2023-10-05T11:49:40.976 INFO:teuthology.orchestra.run.smithi012.stdout: "perm": "*" 2023-10-05T11:49:40.977 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-05T11:49:40.977 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-05T11:49:40.977 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "user-policy", 2023-10-05T11:49:40.977 INFO:teuthology.orchestra.run.smithi012.stdout: "perm": "*" 2023-10-05T11:49:40.977 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-05T11:49:40.977 INFO:teuthology.orchestra.run.smithi012.stdout: ], 2023-10-05T11:49:40.977 INFO:teuthology.orchestra.run.smithi012.stdout: "op_mask": "read, write, delete", 2023-10-05T11:49:40.977 INFO:teuthology.orchestra.run.smithi012.stdout: "default_placement": "", 2023-10-05T11:49:40.977 INFO:teuthology.orchestra.run.smithi012.stdout: "default_storage_class": "", 2023-10-05T11:49:40.977 INFO:teuthology.orchestra.run.smithi012.stdout: "placement_tags": [], 2023-10-05T11:49:40.977 INFO:teuthology.orchestra.run.smithi012.stdout: "bucket_quota": { 2023-10-05T11:49:40.977 INFO:teuthology.orchestra.run.smithi012.stdout: "enabled": false, 2023-10-05T11:49:40.978 INFO:teuthology.orchestra.run.smithi012.stdout: "check_on_raw": false, 2023-10-05T11:49:40.978 INFO:teuthology.orchestra.run.smithi012.stdout: "max_size": -1, 2023-10-05T11:49:40.978 INFO:teuthology.orchestra.run.smithi012.stdout: "max_size_kb": 0, 2023-10-05T11:49:40.978 INFO:teuthology.orchestra.run.smithi012.stdout: "max_objects": -1 2023-10-05T11:49:40.978 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-05T11:49:40.978 INFO:teuthology.orchestra.run.smithi012.stdout: "user_quota": { 2023-10-05T11:49:40.978 INFO:teuthology.orchestra.run.smithi012.stdout: "enabled": false, 2023-10-05T11:49:40.978 INFO:teuthology.orchestra.run.smithi012.stdout: "check_on_raw": false, 2023-10-05T11:49:40.978 INFO:teuthology.orchestra.run.smithi012.stdout: "max_size": -1, 2023-10-05T11:49:40.978 INFO:teuthology.orchestra.run.smithi012.stdout: "max_size_kb": 0, 2023-10-05T11:49:40.978 INFO:teuthology.orchestra.run.smithi012.stdout: "max_objects": -1 2023-10-05T11:49:40.978 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-05T11:49:40.979 INFO:teuthology.orchestra.run.smithi012.stdout: "temp_url_keys": [], 2023-10-05T11:49:40.979 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "rgw", 2023-10-05T11:49:40.979 INFO:teuthology.orchestra.run.smithi012.stdout: "mfa_ids": [ 2023-10-05T11:49:40.979 INFO:teuthology.orchestra.run.smithi012.stdout: "4384343129" 2023-10-05T11:49:40.979 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2023-10-05T11:49:40.979 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-10-05T11:49:40.979 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:49:40.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.973+0000 7f0871a7c640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-10-05T11:49:40.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.976+0000 7f088e612880 20 remove_watcher() i=0 2023-10-05T11:49:40.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.976+0000 7f088e612880 2 removed watcher, disabling cache 2023-10-05T11:49:40.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.977+0000 7f088e612880 20 remove_watcher() i=1 2023-10-05T11:49:40.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.978+0000 7f088e612880 20 remove_watcher() i=2 2023-10-05T11:49:40.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.979+0000 7f088e612880 20 remove_watcher() i=3 2023-10-05T11:49:40.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.980+0000 7f088e612880 20 remove_watcher() i=4 2023-10-05T11:49:40.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.981+0000 7f088e612880 20 remove_watcher() i=5 2023-10-05T11:49:40.984 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.982+0000 7f088e612880 20 remove_watcher() i=6 2023-10-05T11:49:40.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T11:49:40.983+0000 7f088e612880 20 remove_watcher() i=7 2023-10-05T11:49:40.990 INFO:tasks.s3tests:Configuring s3-tests... 2023-10-05T11:49:40.990 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-10-05T11:49:40.990 DEBUG:teuthology.orchestra.run.smithi012:> dd of=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf 2023-10-05T11:49:41.018 INFO:tasks.s3tests:Configuring boto... 2023-10-05T11:49:41.018 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-10-05T11:49:41.018 DEBUG:teuthology.orchestra.run.smithi012:> dd of=/home/ubuntu/cephtest/boto-client.0.cfg 2023-10-05T11:49:41.086 DEBUG:teuthology.orchestra.run.smithi012:s3 tests against rgw> source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/s3-tests-client.0 && S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto-client.0.cfg REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt tox -- -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3' 2023-10-05T11:49:41.259 INFO:teuthology.orchestra.run.smithi012.stdout:GLOB sdist-make: /home/ubuntu/cephtest/s3-tests-client.0/setup.py 2023-10-05T11:49:41.446 INFO:teuthology.orchestra.run.smithi012.stdout:py create: /home/ubuntu/cephtest/s3-tests-client.0/.tox/py 2023-10-05T11:49:41.721 INFO:teuthology.orchestra.run.smithi012.stdout:py installdeps: -rrequirements.txt 2023-10-05T11:50:49.263 INFO:teuthology.orchestra.run.smithi012.stdout:py inst: /home/ubuntu/cephtest/s3-tests-client.0/.tox/.tmp/package/1/s3tests-0.0.1.zip 2023-10-05T11:50:50.996 INFO:teuthology.orchestra.run.smithi012.stdout:py installed: boto==2.49.0,boto3==1.24.96,botocore==1.27.96,cachetools==5.3.1,certifi==2023.7.22,chardet==5.2.0,charset-normalizer==3.3.0,colorama==0.4.6,distlib==0.3.7,exceptiongroup==1.1.3,filelock==3.12.4,gevent==23.9.1,greenlet==3.0.0,httplib2==0.22.0,idna==3.4,iniconfig==2.0.0,isodate==0.6.1,jmespath==1.0.1,lxml==4.9.3,munch==4.0.0,packaging==23.2,platformdirs==3.11.0,pluggy==1.3.0,pyparsing==3.1.1,pyproject-api==1.6.1,pytest==7.4.2,python-dateutil==2.8.2,pytz==2023.3.post1,PyYAML==6.0.1,requests==2.31.0,s3tests @ file:///home/ubuntu/cephtest/s3-tests-client.0/.tox/.tmp/package/1/s3tests-0.0.1.zip#sha256=0753c033be3ca128cef21c37267edc0a882ac1960ab3adc28acaf8fa3b1dcbfe,s3transfer==0.6.2,six==1.16.0,tomli==2.0.1,tox==4.11.3,urllib3==1.26.17,virtualenv==20.24.5,zope.event==5.0,zope.interface==6.1 2023-10-05T11:50:50.996 INFO:teuthology.orchestra.run.smithi012.stdout:py run-test-pre: PYTHONHASHSEED='3601350854' 2023-10-05T11:50:50.996 INFO:teuthology.orchestra.run.smithi012.stdout:py run-test: commands[0] | pytest -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3' 2023-10-05T11:50:51.147 INFO:teuthology.orchestra.run.smithi012.stdout:============================= test session starts ============================== 2023-10-05T11:50:51.147 INFO:teuthology.orchestra.run.smithi012.stdout:platform linux -- Python 3.9.17, pytest-7.4.2, pluggy-1.3.0 -- /home/ubuntu/cephtest/s3-tests-client.0/.tox/py/bin/python 2023-10-05T11:50:51.148 INFO:teuthology.orchestra.run.smithi012.stdout:cachedir: .tox/py/.pytest_cache 2023-10-05T11:50:51.148 INFO:teuthology.orchestra.run.smithi012.stdout:rootdir: /home/ubuntu/cephtest/s3-tests-client.0 2023-10-05T11:50:51.148 INFO:teuthology.orchestra.run.smithi012.stdout:configfile: pytest.ini 2023-10-05T11:50:52.769 INFO:teuthology.orchestra.run.smithi012.stdout:collecting ... collected 784 items / 124 deselected / 660 selected 2023-10-05T11:50:52.769 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T11:50:53.121 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_none PASSED [ 0%] 2023-10-05T11:50:53.423 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_empty PASSED [ 0%] 2023-10-05T11:50:53.783 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests/functional/test_headers.py::test_object_create_date_and_amz_date PASSED [ 0%] 2023-10-05T11:50:54.142 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests/functional/test_headers.py::test_object_create_amz_date_and_no_date PASSED [ 0%] 2023-10-05T11:50:54.473 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_none PASSED [ 0%] 2023-10-05T11:50:54.758 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests/functional/test_headers.py::test_bucket_create_contentlength_none PASSED [ 0%] 2023-10-05T11:50:55.192 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests/functional/test_headers.py::test_object_acl_create_contentlength_none PASSED [ 1%] 2023-10-05T11:50:55.477 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_contentlength_none PASSED [ 1%] 2023-10-05T11:50:55.593 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_empty PASSED [ 1%] 2023-10-05T11:50:55.709 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_none PASSED [ 1%] 2023-10-05T11:50:56.011 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_mismatch_below_aws2 PASSED [ 1%] 2023-10-05T11:50:56.313 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_incorrect_aws2 PASSED [ 1%] 2023-10-05T11:50:56.606 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_invalid_aws2 PASSED [ 1%] 2023-10-05T11:50:56.905 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_none_aws2 PASSED [ 2%] 2023-10-05T11:50:57.019 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_invalid_aws2 PASSED [ 2%] 2023-10-05T11:50:57.139 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_none_aws2 PASSED [ 2%] 2023-10-05T11:50:57.209 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests/functional/test_headers.py::test_object_create_bad_md5_invalid_garbage_aws4 SKIPPED [ 2%] 2023-10-05T11:50:57.281 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_mismatch_below_aws4 SKIPPED [ 2%] 2023-10-05T11:50:57.352 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_incorrect_aws4 SKIPPED [ 2%] 2023-10-05T11:50:57.422 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_invalid_aws4 SKIPPED [ 3%] 2023-10-05T11:50:57.492 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests/functional/test_headers.py::test_object_create_bad_ua_empty_aws4 SKIPPED [ 3%] 2023-10-05T11:50:57.563 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests/functional/test_headers.py::test_object_create_bad_ua_none_aws4 SKIPPED [ 3%] 2023-10-05T11:50:57.635 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_invalid_aws4 SKIPPED [ 3%] 2023-10-05T11:50:57.705 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_invalid_aws4 SKIPPED [ 3%] 2023-10-05T11:50:57.777 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_empty_aws4 SKIPPED [ 3%] 2023-10-05T11:50:57.848 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_empty_aws4 SKIPPED [ 3%] 2023-10-05T11:50:57.920 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_none_aws4 SKIPPED [ 4%] 2023-10-05T11:50:57.992 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_none_aws4 SKIPPED [ 4%] 2023-10-05T11:50:58.064 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_before_today_aws4 SKIPPED [ 4%] 2023-10-05T11:50:58.135 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_before_today_aws4 SKIPPED [ 4%] 2023-10-05T11:50:58.208 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_after_today_aws4 SKIPPED [ 4%] 2023-10-05T11:50:58.278 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_after_today_aws4 SKIPPED [ 4%] 2023-10-05T11:50:58.349 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_before_epoch_aws4 SKIPPED [ 5%] 2023-10-05T11:50:58.421 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_before_epoch_aws4 SKIPPED [ 5%] 2023-10-05T11:50:58.493 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_after_end_aws4 SKIPPED [ 5%] 2023-10-05T11:50:58.564 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_after_end_aws4 SKIPPED [ 5%] 2023-10-05T11:50:58.636 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests/functional/test_headers.py::test_object_create_missing_signed_custom_header_aws4 SKIPPED [ 5%] 2023-10-05T11:50:58.708 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests/functional/test_headers.py::test_object_create_missing_signed_header_aws4 SKIPPED [ 5%] 2023-10-05T11:50:58.781 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_invalid_aws4 SKIPPED [ 5%] 2023-10-05T11:50:58.854 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_ua_empty_aws4 SKIPPED [ 6%] 2023-10-05T11:50:58.925 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_ua_none_aws4 SKIPPED [ 6%] 2023-10-05T11:50:58.997 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_invalid_aws4 SKIPPED [ 6%] 2023-10-05T11:50:59.070 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_invalid_aws4 SKIPPED [ 6%] 2023-10-05T11:50:59.141 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_empty_aws4 SKIPPED [ 6%] 2023-10-05T11:50:59.212 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_empty_aws4 SKIPPED [ 6%] 2023-10-05T11:50:59.285 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_none_aws4 SKIPPED [ 6%] 2023-10-05T11:50:59.358 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_none_aws4 SKIPPED [ 7%] 2023-10-05T11:50:59.427 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_before_today_aws4 SKIPPED [ 7%] 2023-10-05T11:50:59.499 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_before_today_aws4 SKIPPED [ 7%] 2023-10-05T11:50:59.571 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_after_today_aws4 SKIPPED [ 7%] 2023-10-05T11:50:59.643 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_after_today_aws4 SKIPPED [ 7%] 2023-10-05T11:50:59.714 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_before_epoch_aws4 SKIPPED [ 7%] 2023-10-05T11:50:59.787 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_before_epoch_aws4 SKIPPED [ 8%] 2023-10-05T11:51:00.324 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests/functional/test_s3.py::test_versioning_obj_read_not_exist_null PASSED [ 8%] 2023-10-05T11:51:03.615 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests/functional/test_s3.py::test_object_storage_class PASSED [ 8%] 2023-10-05T11:51:07.687 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests/functional/test_s3.py::test_object_storage_class_multipart PASSED [ 8%] 2023-10-05T11:51:12.146 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests/functional/test_s3.py::test_object_modify_storage_class PASSED [ 8%] 2023-10-05T11:51:18.492 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests/functional/test_s3.py::test_object_modify_storage_class_multipart PASSED [ 8%] 2023-10-05T11:51:21.060 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests/functional/test_s3.py::test_object_storage_class_copy PASSED [ 8%] 2023-10-05T11:51:23.331 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests/functional/test_s3.py::test_object_storage_class_copy_multipart PASSED [ 9%] 2023-10-05T11:51:24.075 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests/functional/test_s3.py::test_atomic_dual_conditional_write_1mb FAILED [ 9%] 2023-10-05T11:51:24.327 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests/functional/test_s3.py::test_atomic_write_bucket_gone PASSED [ 9%] 2023-10-05T11:51:24.788 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests/functional/test_s3.py::test_encryption_sse_c_multipart_invalid_chunks_1 PASSED [ 9%] 2023-10-05T11:51:25.300 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests/functional/test_s3.py::test_encryption_sse_c_multipart_invalid_chunks_2 PASSED [ 9%] 2023-10-05T11:51:26.070 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests/functional/test_s3.py::test_bucket_policy_set_condition_operator_end_with_IfExists PASSED [ 9%] 2023-10-05T11:51:26.533 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests/functional/test_s3.py::test_bucket_policy_put_obj_request_obj_tag PASSED [ 10%] 2023-10-05T11:51:26.866 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests/functional/test_s3_website.py::test_website_nonexistant_bucket_rgw SKIPPED [ 10%] 2023-10-05T11:51:26.867 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_public_index SKIPPED [ 10%] 2023-10-05T11:51:26.868 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_public_index SKIPPED [ 10%] 2023-10-05T11:51:26.868 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty SKIPPED [ 10%] 2023-10-05T11:51:26.869 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty SKIPPED [ 10%] 2023-10-05T11:51:26.871 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index SKIPPED [ 10%] 2023-10-05T11:51:26.872 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index SKIPPED [ 11%] 2023-10-05T11:51:26.873 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_missingerrordoc SKIPPED [ 11%] 2023-10-05T11:51:26.874 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_missingerrordoc SKIPPED [ 11%] 2023-10-05T11:51:26.875 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_missingerrordoc SKIPPED [ 11%] 2023-10-05T11:51:26.876 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_missingerrordoc SKIPPED [ 11%] 2023-10-05T11:51:26.877 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_blockederrordoc SKIPPED [ 11%] 2023-10-05T11:51:26.878 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_pubilc_errordoc SKIPPED [ 11%] 2023-10-05T11:51:26.879 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_blockederrordoc SKIPPED [ 12%] 2023-10-05T11:51:26.880 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_blockederrordoc SKIPPED [ 12%] 2023-10-05T11:51:26.881 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_blockederrordoc SKIPPED [ 12%] 2023-10-05T11:51:26.882 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_gooderrordoc SKIPPED [ 12%] 2023-10-05T11:51:26.882 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_gooderrordoc SKIPPED [ 12%] 2023-10-05T11:51:26.884 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_gooderrordoc SKIPPED [ 12%] 2023-10-05T11:51:26.884 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_gooderrordoc SKIPPED [ 13%] 2023-10-05T11:51:26.885 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_base SKIPPED [ 13%] 2023-10-05T11:51:26.887 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_path SKIPPED [ 13%] 2023-10-05T11:51:26.888 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_path_upgrade SKIPPED [ 13%] 2023-10-05T11:51:26.889 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_nonwebsite SKIPPED [ 13%] 2023-10-05T11:51:26.890 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_public_relative SKIPPED [ 13%] 2023-10-05T11:51:26.891 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_public_abs SKIPPED [ 13%] 2023-10-05T11:51:26.892 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_private_relative SKIPPED [ 14%] 2023-10-05T11:51:26.893 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_private_abs SKIPPED [ 14%] 2023-10-05T11:51:26.924 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests/functional/test_s3_website.py::test_routing_generator XFAIL [ 14%] 2023-10-05T11:51:26.935 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests/functional/test_utils.py::test_generate PASSED [ 14%] 2023-10-05T11:51:27.654 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_invalid_short PASSED [ 14%] 2023-10-05T11:51:35.925 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_bad PASSED [ 14%] 2023-10-05T11:51:36.324 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_empty PASSED [ 15%] 2023-10-05T11:51:36.793 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_none PASSED [ 15%] 2023-10-05T11:51:37.257 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_mismatch PASSED [ 15%] 2023-10-05T11:51:37.732 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_empty PASSED [ 15%] 2023-10-05T11:51:38.187 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_none PASSED [ 15%] 2023-10-05T11:51:38.532 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contentlength_negative PASSED [ 15%] 2023-10-05T11:51:39.028 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_invalid PASSED [ 15%] 2023-10-05T11:51:39.460 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_empty PASSED [ 16%] 2023-10-05T11:51:39.881 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_none PASSED [ 16%] 2023-10-05T11:51:40.237 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_put_bad_canned_acl PASSED [ 16%] 2023-10-05T11:51:40.574 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_expect_mismatch PASSED [ 16%] 2023-10-05T11:51:40.915 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_expect_empty PASSED [ 16%] 2023-10-05T11:51:41.030 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_contentlength_negative PASSED [ 16%] 2023-10-05T11:51:41.422 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_invalid_garbage_aws2 PASSED [ 16%] 2023-10-05T11:51:41.870 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_ua_empty_aws2 PASSED [ 17%] 2023-10-05T11:51:42.351 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_ua_none_aws2 PASSED [ 17%] 2023-10-05T11:51:42.710 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_invalid_aws2 PASSED [ 17%] 2023-10-05T11:51:43.062 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_empty_aws2 PASSED [ 17%] 2023-10-05T11:51:43.413 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_before_today_aws2 PASSED [ 17%] 2023-10-05T11:51:43.760 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_before_epoch_aws2 PASSED [ 17%] 2023-10-05T11:51:44.113 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_after_end_aws2 PASSED [ 18%] 2023-10-05T11:51:44.440 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_ua_empty_aws2 PASSED [ 18%] 2023-10-05T11:51:44.767 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_ua_none_aws2 PASSED [ 18%] 2023-10-05T11:51:44.893 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_invalid_aws2 PASSED [ 18%] 2023-10-05T11:51:45.047 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_empty_aws2 PASSED [ 18%] 2023-10-05T11:51:45.169 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_before_today_aws2 PASSED [ 18%] 2023-10-05T11:51:45.287 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_after_today_aws2 PASSED [ 18%] 2023-10-05T11:51:45.405 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_before_epoch_aws2 PASSED [ 19%] 2023-10-05T11:51:45.728 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy PASSED [ 19%] 2023-10-05T11:51:45.858 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy_invalid_user PASSED [ 19%] 2023-10-05T11:51:46.022 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy_parameter_limit PASSED [ 19%] 2023-10-05T11:51:46.322 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_iam.py::test_put_existing_user_policy PASSED [ 19%] 2023-10-05T11:51:46.603 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_iam.py::test_list_user_policy PASSED [ 19%] 2023-10-05T11:51:46.765 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_iam.py::test_list_user_policy_invalid_user PASSED [ 20%] 2023-10-05T11:51:47.048 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy PASSED [ 20%] 2023-10-05T11:51:47.323 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy_invalid_user PASSED [ 20%] 2023-10-05T11:51:47.754 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy_from_multiple_policies PASSED [ 20%] 2023-10-05T11:51:47.977 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy PASSED [ 20%] 2023-10-05T11:51:48.254 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_invalid_user PASSED [ 20%] 2023-10-05T11:51:48.526 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_invalid_policy_name PASSED [ 20%] 2023-10-05T11:51:49.093 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_from_multiple_policies PASSED [ 21%] 2023-10-05T11:51:49.569 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_iam.py::test_allow_bucket_actions_in_user_policy PASSED [ 21%] 2023-10-05T11:51:50.021 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_iam.py::test_deny_bucket_actions_in_user_policy PASSED [ 21%] 2023-10-05T11:51:50.518 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_iam.py::test_allow_object_actions_in_user_policy PASSED [ 21%] 2023-10-05T11:51:51.155 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_iam.py::test_deny_object_actions_in_user_policy PASSED [ 21%] 2023-10-05T11:51:52.307 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_iam.py::test_allow_multipart_actions_in_user_policy PASSED [ 21%] 2023-10-05T11:51:53.505 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_iam.py::test_deny_multipart_actions_in_user_policy PASSED [ 21%] 2023-10-05T11:51:54.115 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_iam.py::test_allow_tagging_actions_in_user_policy PASSED [ 22%] 2023-10-05T11:51:54.716 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_iam.py::test_deny_tagging_actions_in_user_policy PASSED [ 22%] 2023-10-05T11:51:55.227 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_iam.py::test_verify_conflicting_user_policy_statements PASSED [ 22%] 2023-10-05T11:51:55.842 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_iam.py::test_verify_conflicting_user_policies PASSED [ 22%] 2023-10-05T11:51:56.136 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_iam.py::test_verify_allow_iam_actions PASSED [ 22%] 2023-10-05T11:51:56.616 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_empty PASSED [ 22%] 2023-10-05T11:51:57.346 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_distinct PASSED [ 23%] 2023-10-05T11:51:57.929 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_many PASSED [ 23%] 2023-10-05T11:51:58.512 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_many PASSED [ 23%] 2023-10-05T11:51:59.143 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_basic_key_count PASSED [ 23%] 2023-10-05T11:51:59.699 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_basic PASSED [ 23%] 2023-10-05T11:52:00.256 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_basic PASSED [ 23%] 2023-10-05T11:52:01.024 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_encoding_basic PASSED [ 23%] 2023-10-05T11:52:01.582 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_encoding_basic PASSED [ 24%] 2023-10-05T11:52:02.408 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix PASSED [ 24%] 2023-10-05T11:52:03.247 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix PASSED [ 24%] 2023-10-05T11:52:03.706 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix_ends_with_delimiter PASSED [ 24%] 2023-10-05T11:52:04.157 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix_ends_with_delimiter PASSED [ 24%] 2023-10-05T11:52:04.710 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_alt PASSED [ 24%] 2023-10-05T11:52:05.275 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_alt PASSED [ 25%] 2023-10-05T11:52:06.130 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix_underscore PASSED [ 25%] 2023-10-05T11:52:06.946 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix_underscore PASSED [ 25%] 2023-10-05T11:52:07.504 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_percentage PASSED [ 25%] 2023-10-05T11:52:08.055 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_percentage PASSED [ 25%] 2023-10-05T11:52:08.602 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_whitespace PASSED [ 25%] 2023-10-05T11:52:09.158 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_whitespace PASSED [ 25%] 2023-10-05T11:52:09.742 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_dot PASSED [ 26%] 2023-10-05T11:52:10.297 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_dot PASSED [ 26%] 2023-10-05T11:52:10.844 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_unreadable PASSED [ 26%] 2023-10-05T11:52:11.398 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_unreadable PASSED [ 26%] 2023-10-05T11:52:11.958 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_empty PASSED [ 26%] 2023-10-05T11:52:12.718 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_empty PASSED [ 26%] 2023-10-05T11:52:13.316 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_none PASSED [ 26%] 2023-10-05T11:52:13.863 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_none PASSED [ 27%] 2023-10-05T11:52:14.380 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_notempty PASSED [ 27%] 2023-10-05T11:52:14.893 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_defaultempty PASSED [ 27%] 2023-10-05T11:52:15.421 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_empty PASSED [ 27%] 2023-10-05T11:52:15.981 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_not_exist PASSED [ 27%] 2023-10-05T11:52:16.534 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_not_exist PASSED [ 27%] 2023-10-05T11:52:58.701 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_not_skip_special PASSED [ 28%] 2023-10-05T11:52:59.348 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_basic PASSED [ 28%] 2023-10-05T11:53:00.018 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_basic PASSED [ 28%] 2023-10-05T11:53:00.545 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_alt PASSED [ 28%] 2023-10-05T11:53:01.060 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_alt PASSED [ 28%] 2023-10-05T11:53:01.584 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_empty PASSED [ 28%] 2023-10-05T11:53:02.109 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_empty PASSED [ 28%] 2023-10-05T11:53:02.635 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_none PASSED [ 29%] 2023-10-05T11:53:03.194 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_none PASSED [ 29%] 2023-10-05T11:53:03.720 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_not_exist PASSED [ 29%] 2023-10-05T11:53:04.232 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_not_exist PASSED [ 29%] 2023-10-05T11:53:04.748 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_unreadable PASSED [ 29%] 2023-10-05T11:53:05.260 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_unreadable PASSED [ 29%] 2023-10-05T11:53:05.816 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_basic PASSED [ 30%] 2023-10-05T11:53:06.365 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_basic PASSED [ 30%] 2023-10-05T11:53:06.954 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_alt PASSED [ 30%] 2023-10-05T11:53:07.496 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_alt PASSED [ 30%] 2023-10-05T11:53:08.049 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_prefix_not_exist PASSED [ 30%] 2023-10-05T11:53:08.599 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_prefix_not_exist PASSED [ 30%] 2023-10-05T11:53:09.151 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_delimiter_not_exist PASSED [ 30%] 2023-10-05T11:53:09.702 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_delimiter_not_exist PASSED [ 31%] 2023-10-05T11:53:10.247 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_prefix_delimiter_not_exist PASSED [ 31%] 2023-10-05T11:53:10.821 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_prefix_delimiter_not_exist PASSED [ 31%] 2023-10-05T11:53:11.432 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_one PASSED [ 31%] 2023-10-05T11:53:12.046 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_one PASSED [ 31%] 2023-10-05T11:53:12.605 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_zero PASSED [ 31%] 2023-10-05T11:53:13.152 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_zero PASSED [ 31%] 2023-10-05T11:53:13.703 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_none PASSED [ 32%] 2023-10-05T11:53:14.285 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_none PASSED [ 32%] 2023-10-05T11:53:14.439 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_account_usage PASSED [ 32%] 2023-10-05T11:53:14.885 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_head_bucket_usage PASSED [ 32%] 2023-10-05T11:53:16.578 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_unordered PASSED [ 32%] 2023-10-05T11:53:18.271 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_unordered PASSED [ 32%] 2023-10-05T11:53:18.853 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_invalid PASSED [ 33%] 2023-10-05T11:53:19.400 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_none PASSED [ 33%] 2023-10-05T11:53:19.948 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_empty PASSED [ 33%] 2023-10-05T11:53:20.495 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_continuationtoken_empty PASSED [ 33%] 2023-10-05T11:53:21.114 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_continuationtoken PASSED [ 33%] 2023-10-05T11:53:21.731 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_both_continuationtoken_startafter PASSED [ 33%] 2023-10-05T11:53:22.288 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_unreadable PASSED [ 33%] 2023-10-05T11:53:22.873 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_unreadable PASSED [ 34%] 2023-10-05T11:53:23.421 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_not_in_list PASSED [ 34%] 2023-10-05T11:53:23.974 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_not_in_list PASSED [ 34%] 2023-10-05T11:53:24.517 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_after_list PASSED [ 34%] 2023-10-05T11:53:25.069 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_after_list PASSED [ 34%] 2023-10-05T11:53:26.222 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_return_data FAILED [ 34%] 2023-10-05T11:53:27.517 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_return_data_versioning FAILED [ 35%] 2023-10-05T11:53:27.906 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_objects_anonymous PASSED [ 35%] 2023-10-05T11:53:28.332 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_objects_anonymous PASSED [ 35%] 2023-10-05T11:53:28.684 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_objects_anonymous_fail PASSED [ 35%] 2023-10-05T11:53:29.033 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_objects_anonymous_fail PASSED [ 35%] 2023-10-05T11:53:29.162 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_notexist PASSED [ 35%] 2023-10-05T11:53:29.289 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_notexist PASSED [ 35%] 2023-10-05T11:53:29.414 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_delete_notexist PASSED [ 36%] 2023-10-05T11:53:29.882 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_delete_nonempty PASSED [ 36%] 2023-10-05T11:53:31.332 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_concurrent_set_canned_acl PASSED [ 36%] 2023-10-05T11:53:31.495 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_to_nonexist_bucket PASSED [ 36%] 2023-10-05T11:53:31.947 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_with_chunked_transfer_encoding PASSED [ 36%] 2023-10-05T11:53:32.279 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_delete PASSED [ 36%] 2023-10-05T11:53:32.640 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_object_read_not_exist PASSED [ 36%] 2023-10-05T11:53:32.995 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_object_requestid_matches_header_on_error PASSED [ 37%] 2023-10-05T11:53:34.670 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_concurrent_multi_object_delete PASSED [ 37%] 2023-10-05T11:53:35.381 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_multi_object_delete PASSED [ 37%] 2023-10-05T11:53:36.076 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_multi_objectv2_delete PASSED [ 37%] 2023-10-05T11:54:18.462 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_multi_object_delete_key_limit PASSED [ 37%] 2023-10-05T11:55:00.816 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_multi_objectv2_delete_key_limit PASSED [ 37%] 2023-10-05T11:55:01.259 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_object_head_zero_bytes PASSED [ 38%] 2023-10-05T11:55:01.681 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_check_etag PASSED [ 38%] 2023-10-05T11:55:02.127 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_cache_control PASSED [ 38%] 2023-10-05T11:55:02.576 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_expires PASSED [ 38%] 2023-10-05T11:55:03.140 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_read_update_read_delete PASSED [ 38%] 2023-10-05T11:55:03.590 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_none_to_good PASSED [ 38%] 2023-10-05T11:55:04.039 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_none_to_empty PASSED [ 38%] 2023-10-05T11:55:04.598 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_overwrite_to_empty PASSED [ 39%] 2023-10-05T11:55:05.105 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_object_metadata_replaced_on_put PASSED [ 39%] 2023-10-05T11:55:05.597 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_file PASSED [ 39%] 2023-10-05T11:55:06.117 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_anonymous_request PASSED [ 39%] 2023-10-05T11:55:06.676 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_request PASSED [ 39%] 2023-10-05T11:55:07.171 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_no_content_type PASSED [ 39%] 2023-10-05T11:55:07.532 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_request_bad_access_key PASSED [ 40%] 2023-10-05T11:55:07.957 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_success_code PASSED [ 40%] 2023-10-05T11:55:08.377 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_invalid_success_code PASSED [ 40%] 2023-10-05T11:55:09.132 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_larger_than_chunk PASSED [ 40%] 2023-10-05T11:55:09.591 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_key_from_filename PASSED [ 40%] 2023-10-05T11:55:10.022 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_ignored_header PASSED [ 40%] 2023-10-05T11:55:10.455 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_case_insensitive_condition_fields PASSED [ 40%] 2023-10-05T11:55:10.914 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_escaped_field_values PASSED [ 41%] 2023-10-05T11:55:11.431 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_success_redirect_action PASSED [ 41%] 2023-10-05T11:55:11.787 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_signature PASSED [ 41%] 2023-10-05T11:55:12.145 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_access_key PASSED [ 41%] 2023-10-05T11:55:12.506 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_date_format PASSED [ 41%] 2023-10-05T11:55:12.894 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_no_key_specified PASSED [ 41%] 2023-10-05T11:55:13.243 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_signature PASSED [ 41%] 2023-10-05T11:55:13.602 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_policy_condition PASSED [ 42%] 2023-10-05T11:55:14.062 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_user_specified_header PASSED [ 42%] 2023-10-05T11:55:14.418 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_request_missing_policy_specified_field PASSED [ 42%] 2023-10-05T11:55:14.780 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_condition_is_case_sensitive PASSED [ 42%] 2023-10-05T11:55:15.143 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_expires_is_case_sensitive PASSED [ 42%] 2023-10-05T11:55:15.501 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_expired_policy PASSED [ 42%] 2023-10-05T11:55:15.866 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_request_field_value PASSED [ 43%] 2023-10-05T11:55:16.256 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_expires_condition PASSED [ 43%] 2023-10-05T11:55:16.612 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_conditions_list PASSED [ 43%] 2023-10-05T11:55:16.970 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_limit_exceeded PASSED [ 43%] 2023-10-05T11:55:17.333 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_content_length_argument PASSED [ 43%] 2023-10-05T11:55:17.692 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_content_length_argument PASSED [ 43%] 2023-10-05T11:55:18.060 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_below_minimum PASSED [ 43%] 2023-10-05T11:55:19.132 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_rgw_chunk_size_bug PASSED [ 44%] 2023-10-05T11:55:19.505 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_empty_conditions PASSED [ 44%] 2023-10-05T11:55:20.200 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmatch_good PASSED [ 44%] 2023-10-05T11:55:20.929 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmatch_failed FAILED [ 44%] 2023-10-05T11:55:21.645 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifnonematch_good FAILED [ 44%] 2023-10-05T11:55:22.134 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifnonematch_failed PASSED [ 44%] 2023-10-05T11:55:22.640 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmodifiedsince_good PASSED [ 45%] 2023-10-05T11:55:24.371 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmodifiedsince_failed FAILED [ 45%] 2023-10-05T11:55:25.098 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifunmodifiedsince_good FAILED [ 45%] 2023-10-05T11:55:25.591 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifunmodifiedsince_failed PASSED [ 45%] 2023-10-05T11:55:26.412 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_good FAILED [ 45%] 2023-10-05T11:55:27.068 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_failed PASSED [ 45%] 2023-10-05T11:55:27.656 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_overwrite_existed_good PASSED [ 45%] 2023-10-05T11:55:28.127 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_nonexisted_failed PASSED [ 46%] 2023-10-05T11:55:28.719 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_good PASSED [ 46%] 2023-10-05T11:55:29.338 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_failed PASSED [ 46%] 2023-10-05T11:55:29.825 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_nonexisted_good PASSED [ 46%] 2023-10-05T11:55:30.438 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_overwrite_existed_failed PASSED [ 46%] 2023-10-05T11:55:30.884 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get PASSED [ 46%] 2023-10-05T11:55:31.276 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_bucket_gone PASSED [ 46%] 2023-10-05T11:55:31.617 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_object_delete_key_bucket_gone PASSED [ 47%] 2023-10-05T11:55:32.023 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_object_gone PASSED [ 47%] 2023-10-05T11:55:32.392 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head PASSED [ 47%] 2023-10-05T11:55:32.523 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head_notexist PASSED [ 47%] 2023-10-05T11:55:33.081 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head_extended PASSED [ 47%] 2023-10-05T11:55:33.515 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_bucket_acl PASSED [ 47%] 2023-10-05T11:55:33.992 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_object_acl PASSED [ 48%] 2023-10-05T11:55:34.928 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_object_put_acl_mtime FAILED [ 48%] 2023-10-05T11:55:35.369 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated PASSED [ 48%] 2023-10-05T11:55:35.810 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_response_headers PASSED [ 48%] 2023-10-05T11:55:36.252 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_bucket_acl PASSED [ 48%] 2023-10-05T11:55:36.724 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_object_acl PASSED [ 48%] 2023-10-05T11:55:37.103 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_bucket_gone PASSED [ 48%] 2023-10-05T11:55:37.552 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_object_gone PASSED [ 49%] 2023-10-05T11:55:38.010 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_not_expired PASSED [ 49%] 2023-10-05T11:55:38.466 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_not_expired_tenant PASSED [ 49%] 2023-10-05T11:55:38.896 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_range_zero PASSED [ 49%] 2023-10-05T11:55:39.334 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_max_range PASSED [ 49%] 2023-10-05T11:55:39.764 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_positive_range PASSED [ 49%] 2023-10-05T11:55:40.204 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_object_anon_put PASSED [ 50%] 2023-10-05T11:55:40.706 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_object_anon_put_write_access PASSED [ 50%] 2023-10-05T11:55:41.124 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_object_put_authenticated PASSED [ 50%] 2023-10-05T11:55:41.565 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_put_authenticated_expired PASSED [ 50%] 2023-10-05T11:55:41.693 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_starts_nonalpha PASSED [ 50%] 2023-10-05T11:55:41.819 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_short_one PASSED [ 50%] 2023-10-05T11:55:41.948 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_short_two PASSED [ 50%] 2023-10-05T11:55:42.295 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_60 PASSED [ 51%] 2023-10-05T11:55:42.632 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_61 PASSED [ 51%] 2023-10-05T11:55:42.967 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_62 PASSED [ 51%] 2023-10-05T11:55:43.342 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_63 PASSED [ 51%] 2023-10-05T11:55:43.747 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_long_name PASSED [ 51%] 2023-10-05T11:55:43.875 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_ip PASSED [ 51%] 2023-10-05T11:55:44.002 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_underscore PASSED [ 51%] 2023-10-05T11:55:44.337 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_long PASSED [ 52%] 2023-10-05T11:55:44.465 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dash_at_end PASSED [ 52%] 2023-10-05T11:55:44.591 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dot_dot PASSED [ 52%] 2023-10-05T11:55:44.718 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dot_dash PASSED [ 52%] 2023-10-05T11:55:44.842 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dash_dot PASSED [ 52%] 2023-10-05T11:55:45.199 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_exists PASSED [ 52%] 2023-10-05T11:55:45.631 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_get_location PASSED [ 53%] 2023-10-05T11:55:45.989 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_exists_nonowner PASSED [ 53%] 2023-10-05T11:55:46.386 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_overwrite_acl PASSED [ 53%] 2023-10-05T11:55:46.783 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_new_acl PASSED [ 53%] 2023-10-05T11:55:47.141 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_default PASSED [ 53%] 2023-10-05T11:55:47.540 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_during_create PASSED [ 53%] 2023-10-05T11:55:48.002 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned PASSED [ 53%] 2023-10-05T11:55:48.393 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_publicreadwrite PASSED [ 54%] 2023-10-05T11:55:48.785 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_authenticatedread PASSED [ 54%] 2023-10-05T11:55:49.266 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_default PASSED [ 54%] 2023-10-05T11:55:49.784 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_during_create PASSED [ 54%] 2023-10-05T11:55:50.355 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned PASSED [ 54%] 2023-10-05T11:55:50.841 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_publicreadwrite PASSED [ 54%] 2023-10-05T11:55:51.325 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_authenticatedread PASSED [ 55%] 2023-10-05T11:55:51.904 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_bucketownerread PASSED [ 55%] 2023-10-05T11:55:52.473 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_bucketownerfullcontrol PASSED [ 55%] 2023-10-05T11:55:53.019 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_full_control_verify_owner PASSED [ 55%] 2023-10-05T11:55:53.540 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_full_control_verify_attributes PASSED [ 55%] 2023-10-05T11:55:53.952 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_private_to_private PASSED [ 55%] 2023-10-05T11:55:54.527 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl PASSED [ 55%] 2023-10-05T11:55:55.102 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_write PASSED [ 56%] 2023-10-05T11:55:55.676 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_writeacp PASSED [ 56%] 2023-10-05T11:55:56.254 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_read PASSED [ 56%] 2023-10-05T11:55:56.829 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_readacp PASSED [ 56%] 2023-10-05T11:55:57.452 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_fullcontrol PASSED [ 56%] 2023-10-05T11:55:58.023 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_read PASSED [ 56%] 2023-10-05T11:55:58.535 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_readacp PASSED [ 56%] 2023-10-05T11:55:59.116 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_write PASSED [ 57%] 2023-10-05T11:55:59.802 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_writeacp PASSED [ 57%] 2023-10-05T11:56:00.184 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_nonexist_user PASSED [ 57%] 2023-10-05T11:56:00.806 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_no_grants PASSED [ 57%] 2023-10-05T11:56:01.362 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_object_header_acl_grants PASSED [ 57%] 2023-10-05T11:56:01.872 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_header_acl_grants PASSED [ 57%] 2023-10-05T11:56:02.321 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_email PASSED [ 58%] 2023-10-05T11:56:02.708 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_email_not_exist PASSED [ 58%] 2023-10-05T11:56:03.290 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_revoke_all PASSED [ 58%] 2023-10-05T11:56:04.015 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_private PASSED [ 58%] 2023-10-05T11:56:04.742 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_private PASSED [ 58%] 2023-10-05T11:56:05.516 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_publicread PASSED [ 58%] 2023-10-05T11:56:06.260 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_publicread PASSED [ 58%] 2023-10-05T11:56:07.000 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_publicreadwrite PASSED [ 59%] 2023-10-05T11:56:07.750 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_publicreadwrite PASSED [ 59%] 2023-10-05T11:56:08.503 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_private PASSED [ 59%] 2023-10-05T11:56:09.304 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_publicread PASSED [ 59%] 2023-10-05T11:56:10.070 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_publicreadwrite PASSED [ 59%] 2023-10-05T11:56:10.831 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_private PASSED [ 59%] 2023-10-05T11:56:11.611 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_publicread PASSED [ 60%] 2023-10-05T11:56:12.391 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_publicreadwrite PASSED [ 60%] 2023-10-05T11:56:13.715 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_buckets_create_then_list PASSED [ 60%] 2023-10-05T11:56:15.059 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_buckets_list_ctime PASSED [ 60%] 2023-10-05T11:56:15.177 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_anonymous PASSED [ 60%] 2023-10-05T11:56:15.300 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_invalid_auth PASSED [ 60%] 2023-10-05T11:56:15.424 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_bad_auth PASSED [ 60%] 2023-10-05T11:56:15.798 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_starts_alpha PASSED [ 61%] 2023-10-05T11:56:16.171 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_starts_digit PASSED [ 61%] 2023-10-05T11:56:16.515 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_contains_period PASSED [ 61%] 2023-10-05T11:56:16.847 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_contains_hyphen PASSED [ 61%] 2023-10-05T11:56:17.387 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_not_overriding PASSED [ 61%] 2023-10-05T11:56:19.342 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_special_key_names PASSED [ 61%] 2023-10-05T11:56:19.982 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_special_prefix PASSED [ 61%] 2023-10-05T11:56:20.552 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_zero_size PASSED [ 62%] 2023-10-05T11:56:23.131 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_16m PASSED [ 62%] 2023-10-05T11:56:23.719 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_same_bucket PASSED [ 62%] 2023-10-05T11:56:24.308 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_verify_contenttype PASSED [ 62%] 2023-10-05T11:56:24.856 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_to_itself PASSED [ 62%] 2023-10-05T11:56:25.383 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_to_itself_with_metadata PASSED [ 62%] 2023-10-05T11:56:26.250 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_diff_bucket PASSED [ 63%] 2023-10-05T11:56:26.919 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_not_owned_bucket PASSED [ 63%] 2023-10-05T11:56:27.556 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_not_owned_object_bucket PASSED [ 63%] 2023-10-05T11:56:28.192 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_canned_acl PASSED [ 63%] 2023-10-05T11:56:29.314 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_retaining_metadata PASSED [ 63%] 2023-10-05T11:56:30.433 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_replacing_metadata PASSED [ 63%] 2023-10-05T11:56:30.785 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_bucket_not_found PASSED [ 63%] 2023-10-05T11:56:31.159 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_key_not_found PASSED [ 64%] 2023-10-05T11:56:33.046 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioned_bucket PASSED [ 64%] 2023-10-05T11:56:33.701 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioned_url_encoding PASSED [ 64%] 2023-10-05T11:56:42.051 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioning_multipart_upload PASSED [ 64%] 2023-10-05T11:56:42.490 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_empty PASSED [ 64%] 2023-10-05T11:56:43.052 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_small PASSED [ 64%] 2023-10-05T11:56:44.944 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_small PASSED [ 65%] 2023-10-05T11:56:45.493 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_invalid_range PASSED [ 65%] 2023-10-05T11:56:46.534 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_without_range PASSED [ 65%] 2023-10-05T11:57:52.245 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_special_names FAILED [ 65%] 2023-10-05T11:57:59.329 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload PASSED [ 65%] 2023-10-05T11:58:11.470 INFO:tasks.rgw.client.0.smithi012.stdout:2023-10-05T11:58:11.464+0000 7e4de640 -1 Decompression failed with exit code -1 2023-10-05T11:58:12.433 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_versioned FAILED [ 65%] 2023-10-05T11:59:04.660 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_resend_part PASSED [ 65%] 2023-10-05T11:59:11.824 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_multiple_sizes PASSED [ 66%] 2023-10-05T11:59:15.361 INFO:tasks.rgw.client.0.smithi012.stdout:2023-10-05T11:59:15.358+0000 99d15640 -1 Decompression failed with exit code -1 2023-10-05T11:59:16.352 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_multiple_sizes FAILED [ 66%] 2023-10-05T11:59:17.179 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_size_too_small PASSED [ 66%] 2023-10-05T11:59:20.252 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_contents PASSED [ 66%] 2023-10-05T11:59:23.158 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_overwrite_existing_object PASSED [ 66%] 2023-10-05T11:59:25.683 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_abort_multipart_upload PASSED [ 66%] 2023-10-05T11:59:26.187 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_abort_multipart_upload_not_found PASSED [ 66%] 2023-10-05T11:59:29.337 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_list_multipart_upload PASSED [ 67%] 2023-10-05T11:59:29.944 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_list_multipart_upload_owner PASSED [ 67%] 2023-10-05T11:59:30.437 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_missing_part PASSED [ 67%] 2023-10-05T11:59:30.939 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_incorrect_etag PASSED [ 67%] 2023-10-05T11:59:31.327 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_100_continue PASSED [ 67%] 2023-10-05T11:59:31.923 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_set_cors PASSED [ 67%] 2023-10-05T11:59:35.803 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_cors_origin_response PASSED [ 68%] 2023-10-05T11:59:39.250 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_cors_origin_wildcard PASSED [ 68%] 2023-10-05T11:59:42.668 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_cors_header_option PASSED [ 68%] 2023-10-05T11:59:43.145 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_get_object PASSED [ 68%] 2023-10-05T11:59:43.615 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_get_object_tenant PASSED [ 68%] 2023-10-05T11:59:44.119 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_set_bucket_tagging PASSED [ 68%] 2023-10-05T11:59:44.949 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_1mb PASSED [ 68%] 2023-10-05T12:04:47.465 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_4mb FAILED [ 69%] 2023-10-05T12:05:11.782 INFO:tasks.rgw.client.0.smithi012.stdout:terminate called after throwing an instance of 'ceph::buffer::v15_2_0::end_of_buffer' 2023-10-05T12:05:11.784 INFO:tasks.rgw.client.0.smithi012.stdout: what(): End of buffer [buffer:2] 2023-10-05T12:05:11.787 INFO:tasks.rgw.client.0.smithi012.stdout:*** Caught signal (Aborted) ** 2023-10-05T12:05:11.787 INFO:tasks.rgw.client.0.smithi012.stdout: in thread bbd59640 thread_name:memcheck-amd64- 2023-10-05T12:05:11.809 INFO:tasks.rgw.client.0.smithi012.stdout: ceph version 18.0.0-6543-g38321be8 (38321be854743c0d616618a9ea8aa0b1d4dbc0bf) reef (dev) 2023-10-05T12:05:11.809 INFO:tasks.rgw.client.0.smithi012.stdout: 1: /lib64/libc.so.6(+0x54db0) [0x7928db0] 2023-10-05T12:05:11.809 INFO:tasks.rgw.client.0.smithi012.stdout: 2: /lib64/libc.so.6(+0xa154c) [0x797554c] 2023-10-05T12:05:11.809 INFO:tasks.rgw.client.0.smithi012.stdout: 3: raise() 2023-10-05T12:05:11.810 INFO:tasks.rgw.client.0.smithi012.stdout: 4: abort() 2023-10-05T12:05:11.810 INFO:tasks.rgw.client.0.smithi012.stdout: 5: /lib64/libstdc++.so.6(+0xa1a01) [0x7656a01] 2023-10-05T12:05:11.810 INFO:tasks.rgw.client.0.smithi012.stdout: 6: /lib64/libstdc++.so.6(+0xad37c) [0x766237c] 2023-10-05T12:05:11.810 INFO:tasks.rgw.client.0.smithi012.stdout: 7: /lib64/libstdc++.so.6(+0xac349) [0x7661349] 2023-10-05T12:05:11.810 INFO:tasks.rgw.client.0.smithi012.stdout: 8: __gxx_personality_v0() 2023-10-05T12:05:11.810 INFO:tasks.rgw.client.0.smithi012.stdout: 9: /lib64/libgcc_s.so.1(+0x112a4) [0x78ca2a4] 2023-10-05T12:05:11.810 INFO:tasks.rgw.client.0.smithi012.stdout: 10: _Unwind_Resume() 2023-10-05T12:05:11.811 INFO:tasks.rgw.client.0.smithi012.stdout: 11: radosgw(+0x3326e7) [0x43a6e7] 2023-10-05T12:05:11.811 INFO:tasks.rgw.client.0.smithi012.stdout: 12: radosgw(+0x428270) [0x530270] 2023-10-05T12:05:11.811 INFO:tasks.rgw.client.0.smithi012.stdout: 13: /lib64/libstdc++.so.6(+0xdb924) [0x7690924] 2023-10-05T12:05:11.811 INFO:tasks.rgw.client.0.smithi012.stdout: 14: /lib64/libc.so.6(+0x9f802) [0x7973802] 2023-10-05T12:05:11.811 INFO:tasks.rgw.client.0.smithi012.stdout: 15: clone() 2023-10-05T12:05:11.832 INFO:tasks.rgw.client.0.smithi012.stdout:2023-10-05T12:05:11.828+0000 bbd59640 -1 *** Caught signal (Aborted) ** 2023-10-05T12:05:11.832 INFO:tasks.rgw.client.0.smithi012.stdout: in thread bbd59640 thread_name:memcheck-amd64- 2023-10-05T12:05:11.833 INFO:tasks.rgw.client.0.smithi012.stdout: 2023-10-05T12:05:11.833 INFO:tasks.rgw.client.0.smithi012.stdout: ceph version 18.0.0-6543-g38321be8 (38321be854743c0d616618a9ea8aa0b1d4dbc0bf) reef (dev) 2023-10-05T12:05:11.833 INFO:tasks.rgw.client.0.smithi012.stdout: 1: /lib64/libc.so.6(+0x54db0) [0x7928db0] 2023-10-05T12:05:11.833 INFO:tasks.rgw.client.0.smithi012.stdout: 2: /lib64/libc.so.6(+0xa154c) [0x797554c] 2023-10-05T12:05:11.833 INFO:tasks.rgw.client.0.smithi012.stdout: 3: raise() 2023-10-05T12:05:11.833 INFO:tasks.rgw.client.0.smithi012.stdout: 4: abort() 2023-10-05T12:05:11.833 INFO:tasks.rgw.client.0.smithi012.stdout: 5: /lib64/libstdc++.so.6(+0xa1a01) [0x7656a01] 2023-10-05T12:05:11.834 INFO:tasks.rgw.client.0.smithi012.stdout: 6: /lib64/libstdc++.so.6(+0xad37c) [0x766237c] 2023-10-05T12:05:11.834 INFO:tasks.rgw.client.0.smithi012.stdout: 7: /lib64/libstdc++.so.6(+0xac349) [0x7661349] 2023-10-05T12:05:11.834 INFO:tasks.rgw.client.0.smithi012.stdout: 8: __gxx_personality_v0() 2023-10-05T12:05:11.834 INFO:tasks.rgw.client.0.smithi012.stdout: 9: /lib64/libgcc_s.so.1(+0x112a4) [0x78ca2a4] 2023-10-05T12:05:11.834 INFO:tasks.rgw.client.0.smithi012.stdout: 10: _Unwind_Resume() 2023-10-05T12:05:11.834 INFO:tasks.rgw.client.0.smithi012.stdout: 11: radosgw(+0x3326e7) [0x43a6e7] 2023-10-05T12:05:11.835 INFO:tasks.rgw.client.0.smithi012.stdout: 12: radosgw(+0x428270) [0x530270] 2023-10-05T12:05:11.835 INFO:tasks.rgw.client.0.smithi012.stdout: 13: /lib64/libstdc++.so.6(+0xdb924) [0x7690924] 2023-10-05T12:05:11.835 INFO:tasks.rgw.client.0.smithi012.stdout: 14: /lib64/libc.so.6(+0x9f802) [0x7973802] 2023-10-05T12:05:11.835 INFO:tasks.rgw.client.0.smithi012.stdout: 15: clone() 2023-10-05T12:05:11.835 INFO:tasks.rgw.client.0.smithi012.stdout: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-10-05T12:05:11.835 INFO:tasks.rgw.client.0.smithi012.stdout: 2023-10-05T12:05:12.193 INFO:tasks.rgw.client.0.smithi012.stdout: 0> 2023-10-05T12:05:11.828+0000 bbd59640 -1 *** Caught signal (Aborted) ** 2023-10-05T12:05:12.194 INFO:tasks.rgw.client.0.smithi012.stdout: in thread bbd59640 thread_name:memcheck-amd64- 2023-10-05T12:05:12.194 INFO:tasks.rgw.client.0.smithi012.stdout: 2023-10-05T12:05:12.194 INFO:tasks.rgw.client.0.smithi012.stdout: ceph version 18.0.0-6543-g38321be8 (38321be854743c0d616618a9ea8aa0b1d4dbc0bf) reef (dev) 2023-10-05T12:05:12.194 INFO:tasks.rgw.client.0.smithi012.stdout: 1: /lib64/libc.so.6(+0x54db0) [0x7928db0] 2023-10-05T12:05:12.194 INFO:tasks.rgw.client.0.smithi012.stdout: 2: /lib64/libc.so.6(+0xa154c) [0x797554c] 2023-10-05T12:05:12.194 INFO:tasks.rgw.client.0.smithi012.stdout: 3: raise() 2023-10-05T12:05:12.194 INFO:tasks.rgw.client.0.smithi012.stdout: 4: abort() 2023-10-05T12:05:12.194 INFO:tasks.rgw.client.0.smithi012.stdout: 5: /lib64/libstdc++.so.6(+0xa1a01) [0x7656a01] 2023-10-05T12:05:12.194 INFO:tasks.rgw.client.0.smithi012.stdout: 6: /lib64/libstdc++.so.6(+0xad37c) [0x766237c] 2023-10-05T12:05:12.194 INFO:tasks.rgw.client.0.smithi012.stdout: 7: /lib64/libstdc++.so.6(+0xac349) [0x7661349] 2023-10-05T12:05:12.195 INFO:tasks.rgw.client.0.smithi012.stdout: 8: __gxx_personality_v0() 2023-10-05T12:05:12.195 INFO:tasks.rgw.client.0.smithi012.stdout: 9: /lib64/libgcc_s.so.1(+0x112a4) [0x78ca2a4] 2023-10-05T12:05:12.195 INFO:tasks.rgw.client.0.smithi012.stdout: 10: _Unwind_Resume() 2023-10-05T12:05:12.195 INFO:tasks.rgw.client.0.smithi012.stdout: 11: radosgw(+0x3326e7) [0x43a6e7] 2023-10-05T12:05:12.195 INFO:tasks.rgw.client.0.smithi012.stdout: 12: radosgw(+0x428270) [0x530270] 2023-10-05T12:05:12.195 INFO:tasks.rgw.client.0.smithi012.stdout: 13: /lib64/libstdc++.so.6(+0xdb924) [0x7690924] 2023-10-05T12:05:12.195 INFO:tasks.rgw.client.0.smithi012.stdout: 14: /lib64/libc.so.6(+0x9f802) [0x7973802] 2023-10-05T12:05:12.195 INFO:tasks.rgw.client.0.smithi012.stdout: 15: clone() 2023-10-05T12:05:12.195 INFO:tasks.rgw.client.0.smithi012.stdout: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-10-05T12:05:12.195 INFO:tasks.rgw.client.0.smithi012.stdout: 2023-10-05T12:05:12.577 INFO:tasks.rgw.client.0.smithi012.stdout: -15> 2023-10-05T12:05:11.828+0000 bbd59640 -1 *** Caught signal (Aborted) ** 2023-10-05T12:05:12.577 INFO:tasks.rgw.client.0.smithi012.stdout: in thread bbd59640 thread_name:memcheck-amd64- 2023-10-05T12:05:12.577 INFO:tasks.rgw.client.0.smithi012.stdout: 2023-10-05T12:05:12.577 INFO:tasks.rgw.client.0.smithi012.stdout: ceph version 18.0.0-6543-g38321be8 (38321be854743c0d616618a9ea8aa0b1d4dbc0bf) reef (dev) 2023-10-05T12:05:12.578 INFO:tasks.rgw.client.0.smithi012.stdout: 1: /lib64/libc.so.6(+0x54db0) [0x7928db0] 2023-10-05T12:05:12.578 INFO:tasks.rgw.client.0.smithi012.stdout: 2: /lib64/libc.so.6(+0xa154c) [0x797554c] 2023-10-05T12:05:12.578 INFO:tasks.rgw.client.0.smithi012.stdout: 3: raise() 2023-10-05T12:05:12.578 INFO:tasks.rgw.client.0.smithi012.stdout: 4: abort() 2023-10-05T12:05:12.578 INFO:tasks.rgw.client.0.smithi012.stdout: 5: /lib64/libstdc++.so.6(+0xa1a01) [0x7656a01] 2023-10-05T12:05:12.578 INFO:tasks.rgw.client.0.smithi012.stdout: 6: /lib64/libstdc++.so.6(+0xad37c) [0x766237c] 2023-10-05T12:05:12.578 INFO:tasks.rgw.client.0.smithi012.stdout: 7: /lib64/libstdc++.so.6(+0xac349) [0x7661349] 2023-10-05T12:05:12.578 INFO:tasks.rgw.client.0.smithi012.stdout: 8: __gxx_personality_v0() 2023-10-05T12:05:12.578 INFO:tasks.rgw.client.0.smithi012.stdout: 9: /lib64/libgcc_s.so.1(+0x112a4) [0x78ca2a4] 2023-10-05T12:05:12.578 INFO:tasks.rgw.client.0.smithi012.stdout: 10: _Unwind_Resume() 2023-10-05T12:05:12.579 INFO:tasks.rgw.client.0.smithi012.stdout: 11: radosgw(+0x3326e7) [0x43a6e7] 2023-10-05T12:05:12.579 INFO:tasks.rgw.client.0.smithi012.stdout: 12: radosgw(+0x428270) [0x530270] 2023-10-05T12:05:12.579 INFO:tasks.rgw.client.0.smithi012.stdout: 13: /lib64/libstdc++.so.6(+0xdb924) [0x7690924] 2023-10-05T12:05:12.579 INFO:tasks.rgw.client.0.smithi012.stdout: 14: /lib64/libc.so.6(+0x9f802) [0x7973802] 2023-10-05T12:05:12.579 INFO:tasks.rgw.client.0.smithi012.stdout: 15: clone() 2023-10-05T12:05:12.579 INFO:tasks.rgw.client.0.smithi012.stdout: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-10-05T12:05:12.579 INFO:tasks.rgw.client.0.smithi012.stdout: 2023-10-05T12:05:34.550 INFO:tasks.rgw.client.0.smithi012.stdout:terminate called recursively 2023-10-05T12:05:45.848 INFO:tasks.rgw.client.0.smithi012.stderr:==00:00:36:58.147 91894== could not unlink /tmp/vgdb-pipe-from-vgdb-to-91894-by-root-on-??? 2023-10-05T12:05:45.848 INFO:tasks.rgw.client.0.smithi012.stderr:==00:00:36:58.147 91894== could not unlink /tmp/vgdb-pipe-to-vgdb-from-91894-by-root-on-??? 2023-10-05T12:05:45.848 INFO:tasks.rgw.client.0.smithi012.stderr:==00:00:36:58.147 91894== could not unlink /tmp/vgdb-pipe-shared-mem-vgdb-91894-by-root-on-??? 2023-10-05T12:05:46.090 INFO:tasks.rgw.client.0.smithi012.stderr:daemon-helper: command crashed with signal 6 2023-10-05T12:05:47.194 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~0s 2023-10-05T12:05:53.505 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~6s 2023-10-05T12:05:57.577 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_8mb FAILED [ 69%] 2023-10-05T12:05:57.577 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_8mb ERROR [ 69%] 2023-10-05T12:05:59.842 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~13s 2023-10-05T12:06:06.152 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~19s 2023-10-05T12:06:07.203 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_1mb FAILED [ 69%] 2023-10-05T12:06:07.203 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_1mb ERROR [ 69%] 2023-10-05T12:06:12.462 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~25s 2023-10-05T12:06:18.770 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~32s 2023-10-05T12:06:19.777 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_4mb FAILED [ 69%] 2023-10-05T12:06:19.778 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_4mb ERROR [ 69%] 2023-10-05T12:06:25.080 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~38s 2023-10-05T12:06:31.390 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~44s 2023-10-05T12:06:36.046 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_8mb FAILED [ 69%] 2023-10-05T12:06:36.047 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_8mb ERROR [ 69%] 2023-10-05T12:06:37.699 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~51s 2023-10-05T12:06:44.008 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~57s 2023-10-05T12:06:50.318 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~63s 2023-10-05T12:06:53.381 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_1mb FAILED [ 69%] 2023-10-05T12:06:54.193 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_1mb ERROR [ 69%] 2023-10-05T12:06:56.627 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~69s 2023-10-05T12:07:02.935 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~76s 2023-10-05T12:07:09.245 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~82s 2023-10-05T12:07:12.601 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_4mb FAILED [ 70%] 2023-10-05T12:07:12.601 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_4mb ERROR [ 70%] 2023-10-05T12:07:15.555 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~88s 2023-10-05T12:07:21.865 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~95s 2023-10-05T12:07:26.971 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_8mb FAILED [ 70%] 2023-10-05T12:07:26.971 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_8mb ERROR [ 70%] 2023-10-05T12:07:28.175 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~101s 2023-10-05T12:07:34.484 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~107s 2023-10-05T12:07:40.793 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~114s 2023-10-05T12:07:43.810 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_conditional_write_1mb FAILED [ 70%] 2023-10-05T12:07:43.810 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_conditional_write_1mb ERROR [ 70%] 2023-10-05T12:07:47.102 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~120s 2023-10-05T12:07:53.410 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~126s 2023-10-05T12:07:55.672 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_multipart_upload_write FAILED [ 70%] 2023-10-05T12:07:55.673 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_multipart_upload_write ERROR [ 70%] 2023-10-05T12:07:59.720 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~133s 2023-10-05T12:08:06.027 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~139s 2023-10-05T12:08:10.481 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_resend_first_finishes_last FAILED [ 70%] 2023-10-05T12:08:10.481 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_resend_first_finishes_last ERROR [ 70%] 2023-10-05T12:08:12.336 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~145s 2023-10-05T12:08:18.646 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~151s 2023-10-05T12:08:24.815 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_response_code FAILED [ 70%] 2023-10-05T12:08:24.815 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_response_code ERROR [ 70%] 2023-10-05T12:08:24.955 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~158s 2023-10-05T12:08:31.264 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~164s 2023-10-05T12:08:37.574 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~170s 2023-10-05T12:08:43.883 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~177s 2023-10-05T12:08:47.092 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_big_request_response_code FAILED [ 70%] 2023-10-05T12:08:47.395 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_big_request_response_code ERROR [ 70%] 2023-10-05T12:08:50.190 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~183s 2023-10-05T12:08:56.499 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~189s 2023-10-05T12:09:02.806 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~196s 2023-10-05T12:09:04.062 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_skip_leading_bytes_response_code FAILED [ 71%] 2023-10-05T12:09:04.062 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_skip_leading_bytes_response_code ERROR [ 71%] 2023-10-05T12:09:09.114 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~202s 2023-10-05T12:09:15.423 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~208s 2023-10-05T12:09:17.944 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_return_trailing_bytes_response_code FAILED [ 71%] 2023-10-05T12:09:17.944 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_return_trailing_bytes_response_code ERROR [ 71%] 2023-10-05T12:09:21.733 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~215s 2023-10-05T12:09:28.042 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~221s 2023-10-05T12:09:33.390 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_invalid_range FAILED [ 71%] 2023-10-05T12:09:33.390 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_invalid_range ERROR [ 71%] 2023-10-05T12:09:34.392 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~227s 2023-10-05T12:09:40.702 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~234s 2023-10-05T12:09:47.012 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~240s 2023-10-05T12:09:51.135 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_empty_object FAILED [ 71%] 2023-10-05T12:09:51.135 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_empty_object ERROR [ 71%] 2023-10-05T12:09:53.321 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~246s 2023-10-05T12:09:59.630 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~252s 2023-10-05T12:10:03.528 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_create_suspend FAILED [ 71%] 2023-10-05T12:10:03.528 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_create_suspend ERROR [ 71%] 2023-10-05T12:10:05.940 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~259s 2023-10-05T12:10:12.250 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~265s 2023-10-05T12:10:18.558 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~271s 2023-10-05T12:10:22.493 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_read_remove FAILED [ 71%] 2023-10-05T12:10:22.493 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_read_remove ERROR [ 71%] 2023-10-05T12:10:24.866 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~278s 2023-10-05T12:10:31.174 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~284s 2023-10-05T12:10:37.485 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~290s 2023-10-05T12:10:40.623 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_read_remove_head FAILED [ 71%] 2023-10-05T12:10:40.624 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_read_remove_head ERROR [ 71%] 2023-10-05T12:10:43.794 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~297s 2023-10-05T12:10:50.102 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~303s 2023-10-05T12:10:50.103 INFO:tasks.daemonwatchdog.daemon_watchdog:BARK! unmounting mounts and killing all daemons 2023-10-05T12:10:51.412 INFO:tasks.ceph.osd.0:Sent signal 15 2023-10-05T12:10:51.481 INFO:tasks.ceph.osd.1:Sent signal 15 2023-10-05T12:10:51.482 INFO:tasks.ceph.osd.2:Sent signal 15 2023-10-05T12:10:51.482 INFO:tasks.ceph.osd.3:Sent signal 15 2023-10-05T12:10:51.482 INFO:tasks.ceph.osd.4:Sent signal 15 2023-10-05T12:10:51.482 INFO:tasks.ceph.osd.5:Sent signal 15 2023-10-05T12:10:51.482 INFO:tasks.ceph.osd.6:Sent signal 15 2023-10-05T12:10:51.483 INFO:tasks.ceph.osd.7:Sent signal 15 2023-10-05T12:10:51.483 INFO:tasks.ceph.mon.a:Sent signal 15 2023-10-05T12:10:51.483 INFO:tasks.ceph.mon.c:Sent signal 15 2023-10-05T12:10:51.483 INFO:tasks.ceph.mon.b:Sent signal 15 2023-10-05T12:10:51.484 INFO:tasks.ceph.mgr.y:Sent signal 15 2023-10-05T12:10:51.484 INFO:tasks.ceph.mgr.x:Sent signal 15 2023-10-05T12:10:51.484 INFO:tasks.ceph.osd.4.smithi170.stderr:2023-10-05T12:10:51.481+0000 7f3fa1e0b640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 83207) UID: 0 2023-10-05T12:10:51.485 INFO:tasks.ceph.osd.4.smithi170.stderr:2023-10-05T12:10:51.481+0000 7f3fa1e0b640 -1 osd.4 250 *** Got signal Terminated *** 2023-10-05T12:10:51.485 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-10-05T12:10:51.410+0000 7f2a830f3640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 83219) UID: 0 2023-10-05T12:10:51.485 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-10-05T12:10:51.410+0000 7f2a830f3640 -1 osd.0 250 *** Got signal Terminated *** 2023-10-05T12:10:51.485 INFO:tasks.ceph.osd.5.smithi170.stderr:2023-10-05T12:10:51.482+0000 7f8dc4c83640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 83209) UID: 0 2023-10-05T12:10:51.485 INFO:tasks.ceph.osd.5.smithi170.stderr:2023-10-05T12:10:51.482+0000 7f8dc4c83640 -1 osd.5 250 *** Got signal Terminated *** 2023-10-05T12:10:51.486 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-10-05T12:10:51.480+0000 7f5b3ccea640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 83222) UID: 0 2023-10-05T12:10:51.486 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-10-05T12:10:51.480+0000 7f5b3ccea640 -1 osd.1 250 *** Got signal Terminated *** 2023-10-05T12:10:51.486 INFO:tasks.ceph.osd.6.smithi170.stderr:2023-10-05T12:10:51.482+0000 7f4ae90f3640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 83208) UID: 0 2023-10-05T12:10:51.486 INFO:tasks.ceph.osd.6.smithi170.stderr:2023-10-05T12:10:51.482+0000 7f4ae90f3640 -1 osd.6 250 *** Got signal Terminated *** 2023-10-05T12:10:51.486 INFO:tasks.ceph.osd.2.smithi012.stderr:2023-10-05T12:10:51.480+0000 7f87bd71d640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 83223) UID: 0 2023-10-05T12:10:51.487 INFO:tasks.ceph.osd.2.smithi012.stderr:2023-10-05T12:10:51.480+0000 7f87bd71d640 -1 osd.2 250 *** Got signal Terminated *** 2023-10-05T12:10:51.487 INFO:tasks.ceph.osd.7.smithi170.stderr:2023-10-05T12:10:51.482+0000 7ff797481640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 83213) UID: 0 2023-10-05T12:10:51.487 INFO:tasks.ceph.osd.7.smithi170.stderr:2023-10-05T12:10:51.482+0000 7ff797481640 -1 osd.7 250 *** Got signal Terminated *** 2023-10-05T12:10:51.487 INFO:tasks.ceph.osd.3.smithi012.stderr:2023-10-05T12:10:51.480+0000 7f0b87d56640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 83226) UID: 0 2023-10-05T12:10:51.487 INFO:tasks.ceph.osd.3.smithi012.stderr:2023-10-05T12:10:51.480+0000 7f0b87d56640 -1 osd.3 250 *** Got signal Terminated *** 2023-10-05T12:10:51.488 INFO:tasks.ceph.mon.b.smithi170.stderr:2023-10-05T12:10:51.482+0000 7fe9fa104640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i b (PID: 82679) UID: 0 2023-10-05T12:10:51.488 INFO:tasks.ceph.mon.b.smithi170.stderr:2023-10-05T12:10:51.482+0000 7fe9fa104640 -1 mon.b@1(peon) e1 *** Got Signal Terminated *** 2023-10-05T12:10:51.488 INFO:tasks.ceph.mon.a.smithi012.stderr:2023-10-05T12:10:51.481+0000 7f49fd1d2640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i a (PID: 82914) UID: 0 2023-10-05T12:10:51.488 INFO:tasks.ceph.mon.a.smithi012.stderr:2023-10-05T12:10:51.481+0000 7f49fd1d2640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2023-10-05T12:10:51.488 INFO:tasks.ceph.mgr.x.smithi170.stderr:2023-10-05T12:10:51.482+0000 7fb91e4db640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mgr -f --cluster ceph -i x (PID: 82681) UID: 0 2023-10-05T12:10:51.489 INFO:tasks.ceph.mon.c.smithi012.stderr:2023-10-05T12:10:51.482+0000 7f6fb43dd640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i c (PID: 82916) UID: 0 2023-10-05T12:10:51.489 INFO:tasks.ceph.mon.c.smithi012.stderr:2023-10-05T12:10:51.482+0000 7f6fb43dd640 -1 mon.c@2(peon) e1 *** Got Signal Terminated *** 2023-10-05T12:10:51.685 INFO:tasks.ceph.mgr.y.smithi012.stderr:daemon-helper: command crashed with signal 15 2023-10-05T12:10:52.458 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_removal FAILED [ 72%] 2023-10-05T12:10:52.458 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_removal ERROR [ 72%] 2023-10-05T12:11:14.594 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_overwrite FAILED [ 72%] 2023-10-05T12:11:14.594 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_overwrite ERROR [ 72%] 2023-10-05T12:11:31.225 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_overwrite_suspended FAILED [ 72%] 2023-10-05T12:11:31.225 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_overwrite_suspended ERROR [ 72%] 2023-10-05T12:11:49.818 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_suspend_versions FAILED [ 72%] 2023-10-05T12:11:49.818 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_suspend_versions ERROR [ 72%] 2023-10-05T12:11:58.461 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_versions_remove_all FAILED [ 72%] 2023-10-05T12:11:58.480 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_versions_remove_all ERROR [ 72%] 2023-10-05T12:12:14.766 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_versions_remove_special_names FAILED [ 72%] 2023-10-05T12:12:14.767 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_versions_remove_special_names ERROR [ 72%] 2023-10-05T12:12:26.259 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_overwrite_multipart FAILED [ 73%] 2023-10-05T12:12:26.260 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_overwrite_multipart ERROR [ 73%] 2023-10-05T12:12:43.028 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_list_marker FAILED [ 73%] 2023-10-05T12:12:43.029 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_list_marker ERROR [ 73%] 2023-10-05T12:13:01.919 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_copy_obj_version FAILED [ 73%] 2023-10-05T12:13:01.920 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_copy_obj_version ERROR [ 73%] 2023-10-05T12:13:21.261 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete FAILED [ 73%] 2023-10-05T12:13:21.262 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete ERROR [ 73%] 2023-10-05T12:13:36.817 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete_with_marker FAILED [ 73%] 2023-10-05T12:13:36.818 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete_with_marker ERROR [ 73%] 2023-10-05T12:13:48.104 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete_with_marker_create FAILED [ 73%] 2023-10-05T12:13:48.104 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete_with_marker_create ERROR [ 73%] 2023-10-05T12:14:01.149 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_object_acl FAILED [ 73%] 2023-10-05T12:14:01.149 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_object_acl ERROR [ 73%] 2023-10-05T12:14:20.740 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_object_acl_no_version_specified FAILED [ 74%] 2023-10-05T12:14:20.740 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_object_acl_no_version_specified ERROR [ 74%] 2023-10-05T12:14:34.313 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_concurrent_object_create_and_remove FAILED [ 74%] 2023-10-05T12:14:34.313 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_concurrent_object_create_and_remove ERROR [ 74%] 2023-10-05T12:14:44.243 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set FAILED [ 74%] 2023-10-05T12:14:44.243 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set ERROR [ 74%] 2023-10-05T12:15:04.387 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_get FAILED [ 74%] 2023-10-05T12:15:04.387 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_get ERROR [ 74%] 2023-10-05T12:15:20.813 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_get_no_id FAILED [ 74%] 2023-10-05T12:15:20.813 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_get_no_id ERROR [ 74%] 2023-10-05T12:15:35.157 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_id_too_long FAILED [ 74%] 2023-10-05T12:15:35.158 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_id_too_long ERROR [ 74%] 2023-10-05T12:15:50.183 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_same_id FAILED [ 75%] 2023-10-05T12:15:50.183 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_same_id ERROR [ 75%] 2023-10-05T12:16:00.201 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_invalid_status FAILED [ 75%] 2023-10-05T12:16:00.201 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_invalid_status ERROR [ 75%] 2023-10-05T12:16:15.843 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_date FAILED [ 75%] 2023-10-05T12:16:15.843 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_date ERROR [ 75%] 2023-10-05T12:16:32.305 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_invalid_date FAILED [ 75%] 2023-10-05T12:16:32.305 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_invalid_date ERROR [ 75%] 2023-10-05T12:16:48.773 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_noncurrent FAILED [ 75%] 2023-10-05T12:16:48.774 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_noncurrent ERROR [ 75%] 2023-10-05T12:16:57.226 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_deletemarker FAILED [ 75%] 2023-10-05T12:16:57.226 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_deletemarker ERROR [ 75%] 2023-10-05T12:17:13.819 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_filter FAILED [ 75%] 2023-10-05T12:17:13.820 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_filter ERROR [ 75%] 2023-10-05T12:17:23.876 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_empty_filter FAILED [ 76%] 2023-10-05T12:17:23.877 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_empty_filter ERROR [ 76%] 2023-10-05T12:17:34.628 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_multipart FAILED [ 76%] 2023-10-05T12:17:34.628 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_multipart ERROR [ 76%] 2023-10-05T12:17:48.457 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_transition_set_invalid_date FAILED [ 76%] 2023-10-05T12:17:48.457 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_transition_set_invalid_date ERROR [ 76%] 2023-10-05T12:18:10.970 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1b FAILED [ 76%] 2023-10-05T12:18:10.970 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1b ERROR [ 76%] 2023-10-05T12:18:18.299 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1kb FAILED [ 76%] 2023-10-05T12:18:18.299 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1kb ERROR [ 76%] 2023-10-05T12:18:38.982 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1MB FAILED [ 76%] 2023-10-05T12:18:38.982 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1MB ERROR [ 76%] 2023-10-05T12:18:55.750 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_13b FAILED [ 76%] 2023-10-05T12:18:55.750 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_13b ERROR [ 76%] 2023-10-05T12:19:13.392 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_method_head FAILED [ 77%] 2023-10-05T12:19:13.392 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_method_head ERROR [ 77%] 2023-10-05T12:19:30.305 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_present FAILED [ 77%] 2023-10-05T12:19:30.305 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_present ERROR [ 77%] 2023-10-05T12:19:54.120 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_other_key FAILED [ 77%] 2023-10-05T12:19:54.120 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_other_key ERROR [ 77%] 2023-10-05T12:20:15.797 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_invalid_md5 FAILED [ 77%] 2023-10-05T12:20:15.797 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_invalid_md5 ERROR [ 77%] 2023-10-05T12:20:30.186 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_no_md5 FAILED [ 77%] 2023-10-05T12:20:30.186 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_no_md5 ERROR [ 77%] 2023-10-05T12:20:40.416 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_no_key FAILED [ 77%] 2023-10-05T12:20:40.417 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_no_key ERROR [ 77%] 2023-10-05T12:21:01.636 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_key_no_sse_c FAILED [ 78%] 2023-10-05T12:21:01.636 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_key_no_sse_c ERROR [ 78%] 2023-10-05T12:21:13.913 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_multipart_upload FAILED [ 78%] 2023-10-05T12:21:13.914 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_multipart_upload ERROR [ 78%] 2023-10-05T12:21:31.909 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_unaligned_multipart_upload FAILED [ 78%] 2023-10-05T12:21:31.909 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_unaligned_multipart_upload ERROR [ 78%] 2023-10-05T12:21:46.140 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_multipart_bad_download FAILED [ 78%] 2023-10-05T12:21:46.141 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_multipart_bad_download ERROR [ 78%] 2023-10-05T12:21:57.545 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_post_object_authenticated_request FAILED [ 78%] 2023-10-05T12:21:57.545 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_post_object_authenticated_request ERROR [ 78%] 2023-10-05T12:22:12.536 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_method_head FAILED [ 78%] 2023-10-05T12:22:12.536 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_method_head ERROR [ 78%] 2023-10-05T12:22:29.995 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_present FAILED [ 78%] 2023-10-05T12:22:29.997 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_present ERROR [ 78%] 2023-10-05T12:22:41.649 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_no_key FAILED [ 79%] 2023-10-05T12:22:41.650 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_no_key ERROR [ 79%] 2023-10-05T12:22:58.799 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_not_declared FAILED [ 79%] 2023-10-05T12:22:58.799 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_not_declared ERROR [ 79%] 2023-10-05T12:23:16.255 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_upload FAILED [ 79%] 2023-10-05T12:23:16.256 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_upload ERROR [ 79%] 2023-10-05T12:23:29.347 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_invalid_chunks_1 FAILED [ 79%] 2023-10-05T12:23:29.348 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_invalid_chunks_1 ERROR [ 79%] 2023-10-05T12:23:38.442 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_invalid_chunks_2 FAILED [ 79%] 2023-10-05T12:23:38.442 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_invalid_chunks_2 ERROR [ 79%] 2023-10-05T12:23:57.383 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_post_object_authenticated_request FAILED [ 79%] 2023-10-05T12:23:57.383 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_post_object_authenticated_request ERROR [ 79%] 2023-10-05T12:24:12.760 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1b FAILED [ 80%] 2023-10-05T12:24:12.760 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1b ERROR [ 80%] 2023-10-05T12:24:19.314 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1kb FAILED [ 80%] 2023-10-05T12:24:19.314 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1kb ERROR [ 80%] 2023-10-05T12:24:36.452 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1MB FAILED [ 80%] 2023-10-05T12:24:36.453 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1MB ERROR [ 80%] 2023-10-05T12:24:51.590 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_13b FAILED [ 80%] 2023-10-05T12:24:51.590 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_13b ERROR [ 80%] 2023-10-05T12:25:08.194 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_read_declare FAILED [ 80%] 2023-10-05T12:25:08.194 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_read_declare ERROR [ 80%] 2023-10-05T12:25:27.212 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy FAILED [ 80%] 2023-10-05T12:25:27.212 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy ERROR [ 80%] 2023-10-05T12:25:46.415 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy FAILED [ 80%] 2023-10-05T12:25:46.416 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy ERROR [ 80%] 2023-10-05T12:26:05.601 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_acl FAILED [ 81%] 2023-10-05T12:26:05.602 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_acl ERROR [ 81%] 2023-10-05T12:26:23.463 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy_acl FAILED [ 81%] 2023-10-05T12:26:23.463 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy_acl ERROR [ 81%] 2023-10-05T12:26:40.927 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_another_bucket FAILED [ 81%] 2023-10-05T12:26:40.927 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_another_bucket ERROR [ 81%] 2023-10-05T12:26:52.703 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy_another_bucket FAILED [ 81%] 2023-10-05T12:26:52.703 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy_another_bucket ERROR [ 81%] 2023-10-05T12:27:05.964 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_get_obj_tagging FAILED [ 81%] 2023-10-05T12:27:05.964 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_get_obj_tagging ERROR [ 81%] 2023-10-05T12:27:20.336 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_get_obj_head_tagging FAILED [ 81%] 2023-10-05T12:27:20.336 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_get_obj_head_tagging ERROR [ 81%] 2023-10-05T12:27:34.274 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_put_max_tags FAILED [ 81%] 2023-10-05T12:27:34.274 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_put_max_tags ERROR [ 81%] 2023-10-05T12:27:41.057 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_tags FAILED [ 82%] 2023-10-05T12:27:41.058 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_tags ERROR [ 82%] 2023-10-05T12:27:49.348 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_put_max_kvsize_tags FAILED [ 82%] 2023-10-05T12:27:49.349 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_put_max_kvsize_tags ERROR [ 82%] 2023-10-05T12:28:06.920 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_key_tags FAILED [ 82%] 2023-10-05T12:28:06.921 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_key_tags ERROR [ 82%] 2023-10-05T12:28:19.552 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_val_tags FAILED [ 82%] 2023-10-05T12:28:19.552 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_val_tags ERROR [ 82%] 2023-10-05T12:28:34.672 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_put_modify_tags FAILED [ 82%] 2023-10-05T12:28:34.672 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_put_modify_tags ERROR [ 82%] 2023-10-05T12:28:45.750 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_put_delete_tags FAILED [ 82%] 2023-10-05T12:28:45.751 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_put_delete_tags ERROR [ 82%] 2023-10-05T12:29:03.760 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_tags_anonymous_request FAILED [ 83%] 2023-10-05T12:29:03.760 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_tags_anonymous_request ERROR [ 83%] 2023-10-05T12:29:16.759 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_tags_authenticated_request FAILED [ 83%] 2023-10-05T12:29:16.759 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_tags_authenticated_request ERROR [ 83%] 2023-10-05T12:29:36.700 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_with_tags FAILED [ 83%] 2023-10-05T12:29:36.700 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_with_tags ERROR [ 83%] 2023-10-05T12:29:44.673 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_get_tags_acl_public FAILED [ 83%] 2023-10-05T12:29:44.674 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_get_tags_acl_public ERROR [ 83%] 2023-10-05T12:29:59.936 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_put_tags_acl_public FAILED [ 83%] 2023-10-05T12:29:59.937 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_put_tags_acl_public ERROR [ 83%] 2023-10-05T12:30:08.753 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_delete_tags_obj_public FAILED [ 83%] 2023-10-05T12:30:08.753 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_delete_tags_obj_public ERROR [ 83%] 2023-10-05T12:30:23.397 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_atomic_upload_return_version_id FAILED [ 83%] 2023-10-05T12:30:23.397 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_atomic_upload_return_version_id ERROR [ 83%] 2023-10-05T12:30:37.958 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_multipart_upload_return_version_id FAILED [ 84%] 2023-10-05T12:30:37.958 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_multipart_upload_return_version_id ERROR [ 84%] 2023-10-05T12:31:00.992 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_existing_tag FAILED [ 84%] 2023-10-05T12:31:00.992 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_existing_tag ERROR [ 84%] 2023-10-05T12:31:14.137 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_tagging_existing_tag FAILED [ 84%] 2023-10-05T12:31:14.137 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_tagging_existing_tag ERROR [ 84%] 2023-10-05T12:31:27.202 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_tagging_existing_tag FAILED [ 84%] 2023-10-05T12:31:27.202 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_tagging_existing_tag ERROR [ 84%] 2023-10-05T12:31:41.514 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_copy_source FAILED [ 84%] 2023-10-05T12:31:41.514 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_copy_source ERROR [ 84%] 2023-10-05T12:31:56.806 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_copy_source_meta FAILED [ 84%] 2023-10-05T12:31:56.806 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_copy_source_meta ERROR [ 84%] 2023-10-05T12:32:13.096 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_acl FAILED [ 85%] 2023-10-05T12:32:13.096 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_acl ERROR [ 85%] 2023-10-05T12:32:36.727 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_grant FAILED [ 85%] 2023-10-05T12:32:36.727 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_grant ERROR [ 85%] 2023-10-05T12:32:48.512 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_c_s3 FAILED [ 85%] 2023-10-05T12:32:48.512 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_c_s3 ERROR [ 85%] 2023-10-05T12:33:07.661 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_c_kms FAILED [ 85%] 2023-10-05T12:33:07.661 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_c_kms ERROR [ 85%] 2023-10-05T12:33:26.021 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_s3_kms FAILED [ 85%] 2023-10-05T12:33:26.021 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_s3_kms ERROR [ 85%] 2023-10-05T12:33:41.699 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_bad_enc_kms FAILED [ 85%] 2023-10-05T12:33:41.699 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_bad_enc_kms ERROR [ 85%] 2023-10-05T12:34:01.439 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_kms_noenc FAILED [ 85%] 2023-10-05T12:34:01.439 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_kms_noenc ERROR [ 85%] 2023-10-05T12:34:18.215 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_kms_s3 FAILED [ 86%] 2023-10-05T12:34:18.216 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_kms_s3 ERROR [ 86%] 2023-10-05T12:34:28.687 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_acl_existing_tag FAILED [ 86%] 2023-10-05T12:34:28.688 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_acl_existing_tag ERROR [ 86%] 2023-10-05T12:34:46.370 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock FAILED [ 86%] 2023-10-05T12:34:46.371 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock ERROR [ 86%] 2023-10-05T12:34:55.850 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_bucket FAILED [ 86%] 2023-10-05T12:34:55.850 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_bucket ERROR [ 86%] 2023-10-05T12:35:06.406 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_with_days_and_years FAILED [ 86%] 2023-10-05T12:35:06.406 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_with_days_and_years ERROR [ 86%] 2023-10-05T12:35:20.404 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_days FAILED [ 86%] 2023-10-05T12:35:20.404 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_days ERROR [ 86%] 2023-10-05T12:35:34.687 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_years FAILED [ 86%] 2023-10-05T12:35:34.687 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_years ERROR [ 86%] 2023-10-05T12:35:51.591 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_mode FAILED [ 87%] 2023-10-05T12:35:51.591 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_mode ERROR [ 87%] 2023-10-05T12:36:07.263 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_status FAILED [ 87%] 2023-10-05T12:36:07.263 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_status ERROR [ 87%] 2023-10-05T12:36:22.434 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_suspend_versioning FAILED [ 87%] 2023-10-05T12:36:22.435 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_suspend_versioning ERROR [ 87%] 2023-10-05T12:36:44.163 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_lock FAILED [ 87%] 2023-10-05T12:36:44.164 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_lock ERROR [ 87%] 2023-10-05T12:36:56.013 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_lock_invalid_bucket FAILED [ 87%] 2023-10-05T12:36:56.013 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_lock_invalid_bucket ERROR [ 87%] 2023-10-05T12:37:10.778 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention FAILED [ 87%] 2023-10-05T12:37:10.779 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention ERROR [ 87%] 2023-10-05T12:37:23.644 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_invalid_bucket FAILED [ 88%] 2023-10-05T12:37:23.644 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_invalid_bucket ERROR [ 88%] 2023-10-05T12:37:41.468 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_invalid_mode FAILED [ 88%] 2023-10-05T12:37:41.468 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_invalid_mode ERROR [ 88%] 2023-10-05T12:37:52.771 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention FAILED [ 88%] 2023-10-05T12:37:52.771 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention ERROR [ 88%] 2023-10-05T12:38:07.782 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention_iso8601 FAILED [ 88%] 2023-10-05T12:38:07.783 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention_iso8601 ERROR [ 88%] 2023-10-05T12:38:21.016 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention_invalid_bucket FAILED [ 88%] 2023-10-05T12:38:21.016 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention_invalid_bucket ERROR [ 88%] 2023-10-05T12:38:40.590 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_versionid FAILED [ 88%] 2023-10-05T12:38:40.590 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_versionid ERROR [ 88%] 2023-10-05T12:38:52.070 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_override_default_retention FAILED [ 88%] 2023-10-05T12:38:52.070 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_override_default_retention ERROR [ 88%] 2023-10-05T12:39:07.707 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_increase_period FAILED [ 89%] 2023-10-05T12:39:07.707 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_increase_period ERROR [ 89%] 2023-10-05T12:39:25.118 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_shorten_period FAILED [ 89%] 2023-10-05T12:39:25.118 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_shorten_period ERROR [ 89%] 2023-10-05T12:39:42.395 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_shorten_period_bypass FAILED [ 89%] 2023-10-05T12:39:42.395 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_shorten_period_bypass ERROR [ 89%] 2023-10-05T12:39:57.962 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_retention FAILED [ 89%] 2023-10-05T12:39:57.963 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_retention ERROR [ 89%] 2023-10-05T12:40:15.026 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_retention_and_marker FAILED [ 89%] 2023-10-05T12:40:15.026 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_retention_and_marker ERROR [ 89%] 2023-10-05T12:40:30.155 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_multi_delete_object_with_retention FAILED [ 89%] 2023-10-05T12:40:30.155 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_multi_delete_object_with_retention ERROR [ 89%] 2023-10-05T12:40:47.862 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold FAILED [ 90%] 2023-10-05T12:40:47.862 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold ERROR [ 90%] 2023-10-05T12:41:10.446 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold_invalid_bucket FAILED [ 90%] 2023-10-05T12:41:10.446 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold_invalid_bucket ERROR [ 90%] 2023-10-05T12:41:18.414 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold_invalid_status FAILED [ 90%] 2023-10-05T12:41:18.414 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold_invalid_status ERROR [ 90%] 2023-10-05T12:41:28.983 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_legal_hold FAILED [ 90%] 2023-10-05T12:41:28.984 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_legal_hold ERROR [ 90%] 2023-10-05T12:41:49.756 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_legal_hold_invalid_bucket FAILED [ 90%] 2023-10-05T12:41:49.757 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_legal_hold_invalid_bucket ERROR [ 90%] 2023-10-05T12:42:10.299 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_legal_hold_on FAILED [ 90%] 2023-10-05T12:42:10.299 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_legal_hold_on ERROR [ 90%] 2023-10-05T12:42:25.014 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_legal_hold_off FAILED [ 90%] 2023-10-05T12:42:25.014 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_legal_hold_off ERROR [ 90%] 2023-10-05T12:42:41.792 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_metadata FAILED [ 91%] 2023-10-05T12:42:41.792 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_metadata ERROR [ 91%] 2023-10-05T12:42:59.532 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_uploading_obj FAILED [ 91%] 2023-10-05T12:42:59.533 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_uploading_obj ERROR [ 91%] 2023-10-05T12:43:17.710 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_governance_with_bypass FAILED [ 91%] 2023-10-05T12:43:17.710 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_governance_with_bypass ERROR [ 91%] 2023-10-05T12:43:27.208 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_governance_without_bypass FAILED [ 91%] 2023-10-05T12:43:27.209 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_governance_without_bypass ERROR [ 91%] 2023-10-05T12:43:45.023 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_compliance FAILED [ 91%] 2023-10-05T12:43:45.024 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_compliance ERROR [ 91%] 2023-10-05T12:43:59.947 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_copy_object_ifmatch_good FAILED [ 91%] 2023-10-05T12:43:59.947 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_copy_object_ifmatch_good ERROR [ 91%] 2023-10-05T12:44:12.913 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_copy_object_ifnonematch_failed FAILED [ 91%] 2023-10-05T12:44:12.913 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_copy_object_ifnonematch_failed ERROR [ 91%] 2023-10-05T12:44:32.118 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_get_bucket_policy_status FAILED [ 92%] 2023-10-05T12:44:32.118 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_get_bucket_policy_status ERROR [ 92%] 2023-10-05T12:44:45.264 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_get_public_acl_bucket_policy_status FAILED [ 92%] 2023-10-05T12:44:45.264 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_get_public_acl_bucket_policy_status ERROR [ 92%] 2023-10-05T12:45:02.300 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_get_authpublic_acl_bucket_policy_status FAILED [ 92%] 2023-10-05T12:45:02.300 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_get_authpublic_acl_bucket_policy_status ERROR [ 92%] 2023-10-05T12:45:15.403 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_get_publicpolicy_acl_bucket_policy_status FAILED [ 92%] 2023-10-05T12:45:15.404 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_get_publicpolicy_acl_bucket_policy_status ERROR [ 92%] 2023-10-05T12:45:26.722 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_get_nonpublicpolicy_acl_bucket_policy_status FAILED [ 92%] 2023-10-05T12:45:26.722 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_get_nonpublicpolicy_acl_bucket_policy_status ERROR [ 92%] 2023-10-05T12:45:44.104 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_get_nonpublicpolicy_deny_bucket_policy_status FAILED [ 92%] 2023-10-05T12:45:44.106 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_get_nonpublicpolicy_deny_bucket_policy_status ERROR [ 92%] 2023-10-05T12:46:02.781 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_get_default_public_block FAILED [ 93%] 2023-10-05T12:46:02.782 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_get_default_public_block ERROR [ 93%] 2023-10-05T12:46:14.604 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_put_public_block FAILED [ 93%] 2023-10-05T12:46:14.604 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_put_public_block ERROR [ 93%] 2023-10-05T12:46:25.177 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_put_bucket_acls FAILED [ 93%] 2023-10-05T12:46:25.178 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_put_bucket_acls ERROR [ 93%] 2023-10-05T12:46:40.984 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_object_canned_acls FAILED [ 93%] 2023-10-05T12:46:40.984 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_object_canned_acls ERROR [ 93%] 2023-10-05T12:46:56.115 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_policy FAILED [ 93%] 2023-10-05T12:46:56.115 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_policy ERROR [ 93%] 2023-10-05T12:47:11.909 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_ignore_public_acls FAILED [ 93%] 2023-10-05T12:47:11.910 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_ignore_public_acls ERROR [ 93%] 2023-10-05T12:47:29.346 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_on_a_bucket_with_policy FAILED [ 93%] 2023-10-05T12:47:29.347 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_on_a_bucket_with_policy ERROR [ 93%] 2023-10-05T12:47:45.752 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_put_bucket_encryption_kms FAILED [ 94%] 2023-10-05T12:47:45.753 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_put_bucket_encryption_kms ERROR [ 94%] 2023-10-05T12:48:01.564 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_get_bucket_encryption_kms FAILED [ 94%] 2023-10-05T12:48:01.564 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_get_bucket_encryption_kms ERROR [ 94%] 2023-10-05T12:48:13.909 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_delete_bucket_encryption_kms FAILED [ 94%] 2023-10-05T12:48:13.909 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_delete_bucket_encryption_kms ERROR [ 94%] 2023-10-05T12:48:33.772 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_default_post_object_authenticated_request FAILED [ 94%] 2023-10-05T12:48:33.772 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_default_post_object_authenticated_request ERROR [ 94%] 2023-10-05T12:48:49.259 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_torrent FAILED [ 94%] 2023-10-05T12:48:49.260 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_torrent ERROR [ 94%] 2023-10-05T12:49:00.410 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3select.py::test_generate_where_clause ERROR [ 94%] 2023-10-05T12:49:00.588 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3select.py::test_generate_projection ERROR [ 95%] 2023-10-05T12:49:00.841 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3select.py::test_count_operation ERROR [ 95%] 2023-10-05T12:49:01.029 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3select.py::test_count_json_operation ERROR [ 95%] 2023-10-05T12:49:01.274 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3select.py::test_json_column_sum_min_max ERROR [ 95%] 2023-10-05T12:49:01.538 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3select.py::test_json_nullif_expressions ERROR [ 95%] 2023-10-05T12:49:01.720 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3select.py::test_column_sum_min_max ERROR [ 95%] 2023-10-05T12:49:01.969 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3select.py::test_nullif_expressions ERROR [ 95%] 2023-10-05T12:49:02.147 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3select.py::test_nulliftrue_expressions ERROR [ 96%] 2023-10-05T12:49:02.393 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3select.py::test_is_not_null_expressions ERROR [ 96%] 2023-10-05T12:49:02.650 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3select.py::test_lowerupper_expressions ERROR [ 96%] 2023-10-05T12:49:02.833 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3select.py::test_in_expressions ERROR [ 96%] 2023-10-05T12:49:03.082 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3select.py::test_true_false_in_expressions ERROR [ 96%] 2023-10-05T12:49:03.339 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3select.py::test_like_expressions ERROR [ 96%] 2023-10-05T12:49:03.522 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3select.py::test_truefalselike_expressions ERROR [ 96%] 2023-10-05T12:49:03.775 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3select.py::test_complex_expressions ERROR [ 97%] 2023-10-05T12:49:03.961 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3select.py::test_alias ERROR [ 97%] 2023-10-05T12:49:04.207 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3select.py::test_alias_cyclic_refernce ERROR [ 97%] 2023-10-05T12:49:04.464 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3select.py::test_datetime ERROR [ 97%] 2023-10-05T12:49:04.642 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3select.py::test_true_false_datetime ERROR [ 97%] 2023-10-05T12:49:04.892 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3select.py::test_csv_parser ERROR [ 97%] 2023-10-05T12:49:05.074 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3select.py::test_csv_definition ERROR [ 98%] 2023-10-05T12:49:05.321 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3select.py::test_schema_definition ERROR [ 98%] 2023-10-05T12:49:05.577 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3select.py::test_when_then_else_expressions ERROR [ 98%] 2023-10-05T12:49:05.757 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3select.py::test_coalesce_expressions ERROR [ 98%] 2023-10-05T12:49:06.009 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3select.py::test_cast_expressions ERROR [ 98%] 2023-10-05T12:49:06.271 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3select.py::test_version ERROR [ 98%] 2023-10-05T12:49:06.455 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3select.py::test_trim_expressions ERROR [ 98%] 2023-10-05T12:49:06.707 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3select.py::test_truefalse_trim_expressions ERROR [ 99%] 2023-10-05T12:49:06.889 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3select.py::test_escape_expressions ERROR [ 99%] 2023-10-05T12:49:07.136 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3select.py::test_case_value_expressions ERROR [ 99%] 2023-10-05T12:49:07.400 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3select.py::test_bool_cast_expressions ERROR [ 99%] 2023-10-05T12:49:07.582 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3select.py::test_progress_expressions ERROR [ 99%] 2023-10-05T12:49:07.834 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3select.py::test_output_serial_expressions ERROR [ 99%] 2023-10-05T12:49:07.855 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_utils.py::test_generate PASSED [100%] 2023-10-05T12:49:07.855 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:07.855 INFO:teuthology.orchestra.run.smithi012.stdout:==================================== ERRORS ==================================== 2023-10-05T12:49:07.855 INFO:teuthology.orchestra.run.smithi012.stdout:__________________ ERROR at teardown of test_atomic_read_8mb ___________________ 2023-10-05T12:49:07.855 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:07.856 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:07.856 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:07.856 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:07.856 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:07.856 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:07.856 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:07.856 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:07.856 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:07.856 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:07.856 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:07.856 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:07.857 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:07.857 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:07.857 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:07.857 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:07.857 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:07.857 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:07.857 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:07.857 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:07.857 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:07.857 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:07.857 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:07.858 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:07.858 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:07.858 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:07.858 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:07.858 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:07.858 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:07.858 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:07.858 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:07.858 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:07.858 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:07.858 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:07.859 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:07.859 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:07.859 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:07.859 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:07.859 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:07.859 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:07.859 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:07.859 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:07.859 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:07.859 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:07.859 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:07.860 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:07.860 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:07.860 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:07.860 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:07.860 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:07.860 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:07.860 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:07.860 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:07.860 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:07.860 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:07.860 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:07.860 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:07.861 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:07.861 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:07.861 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:07.861 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:07.861 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:07.861 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:07.861 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:07.861 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:07.861 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:07.861 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:07.861 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:07.862 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:07.862 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:07.862 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:07.862 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:07.862 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:07.862 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:07.862 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:07.862 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:07.862 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:07.862 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:07.862 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:07.862 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:07.863 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:07.863 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:07.863 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:07.863 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:07.863 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:07.863 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:07.863 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:07.863 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:07.863 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:07.863 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:07.863 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:07.863 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:07.864 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:07.864 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:07.864 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:07.864 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:07.864 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:07.864 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:07.864 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:07.864 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:07.864 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:07.864 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:07.864 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:07.864 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:07.865 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:07.865 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:07.865 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:07.865 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:07.865 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:07.865 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:07.865 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:07.865 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:07.865 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:07.865 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:07.865 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:07.865 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:07.866 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:07.866 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:07.866 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:07.866 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:07.866 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:07.866 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:07.866 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:07.866 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:07.866 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:07.866 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:07.867 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:07.867 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:07.867 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:07.867 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:07.867 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:07.867 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:07.867 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:07.867 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:07.867 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:07.867 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:07.867 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:07.867 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:07.867 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:07.868 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:07.868 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:07.868 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:07.868 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:07.868 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:07.868 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:07.868 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:07.868 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:07.868 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:07.868 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:07.868 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:07.869 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:07.869 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:07.869 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:07.869 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:07.869 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:07.869 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:07.869 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:07.869 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:07.869 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:07.869 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:07.869 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:07.869 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:07.870 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:07.870 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:07.870 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:07.870 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:07.870 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:07.870 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:07.870 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:07.870 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:07.870 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:07.870 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:07.870 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:07.871 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:07.871 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:07.871 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:07.871 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:07.871 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:07.871 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:07.871 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:07.876 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:07.876 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:07.876 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:07.876 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:07.876 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:07.876 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:07.877 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:07.877 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:07.877 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:07.877 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:07.877 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:07.877 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:07.877 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:07.877 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:07.877 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:07.877 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:07.877 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:07.877 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:07.878 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:07.878 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:07.878 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:07.878 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:07.878 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:07.878 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:07.878 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:07.878 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:07.878 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:07.878 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:07.878 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:07.879 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:07.879 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:07.879 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:07.879 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:07.879 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:07.879 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:07.879 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:07.879 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:07.879 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:07.879 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:07.879 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:07.879 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:07.879 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:07.880 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:07.880 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:07.880 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:07.880 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:07.880 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:07.880 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:07.880 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:07.880 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:07.880 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:07.880 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:07.880 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:07.880 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:07.881 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:07.881 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:07.881 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:07.881 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:07.881 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:07.881 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:07.881 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:07.881 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:07.881 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:07.881 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:07.881 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:07.881 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:07.882 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:07.882 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:07.882 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:07.882 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:07.882 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:07.882 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:07.882 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:07.882 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:07.882 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:07.882 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:07.882 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:07.882 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:07.883 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:07.883 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:07.883 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:07.883 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:07.883 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:07.883 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:07.883 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:07.883 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:07.883 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:07.883 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:07.883 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:07.883 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:07.884 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:07.884 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:07.884 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:07.884 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:07.884 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:07.884 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:07.884 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:07.884 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:07.884 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:07.884 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:07.884 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:07.884 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:07.885 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:07.885 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:07.885 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:07.885 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:07.885 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:07.885 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:07.885 INFO:teuthology.orchestra.run.smithi012.stdout:__________________ ERROR at teardown of test_atomic_write_1mb __________________ 2023-10-05T12:49:07.885 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:07.885 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:07.885 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:07.885 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:07.885 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:07.886 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:07.886 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:07.886 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:07.886 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:07.886 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:07.886 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:07.886 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:07.886 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:07.886 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:07.886 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:07.886 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:07.887 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:07.887 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:07.887 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:07.887 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:07.887 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:07.887 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:07.887 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:07.887 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:07.887 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:07.887 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:07.887 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:07.888 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:07.888 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:07.888 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:07.888 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:07.888 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:07.888 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:07.888 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:07.888 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:07.888 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:07.888 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:07.888 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:07.888 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:07.889 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:07.889 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:07.889 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:07.889 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:07.889 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:07.889 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:07.889 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:07.889 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:07.889 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:07.889 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:07.889 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:07.890 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:07.890 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:07.890 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:07.890 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:07.890 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:07.890 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:07.890 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:07.890 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:07.890 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:07.890 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:07.890 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:07.890 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:07.891 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:07.891 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:07.891 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:07.891 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:07.891 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:07.891 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:07.891 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:07.891 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:07.891 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:07.891 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:07.891 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:07.892 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:07.892 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:07.892 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:07.892 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:07.892 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:07.892 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:07.892 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:07.892 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:07.892 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:07.892 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:07.892 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:07.892 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:07.893 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:07.893 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:07.893 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:07.893 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:07.893 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:07.893 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:07.893 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:07.893 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:07.893 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:07.893 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:07.893 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:07.893 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:07.894 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:07.894 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:07.894 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:07.894 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:07.894 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:07.894 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:07.894 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:07.894 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:07.894 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:07.894 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:07.894 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:07.894 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:07.895 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:07.895 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:07.895 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:07.895 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:07.895 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:07.895 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:07.895 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:07.895 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:07.895 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:07.895 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:07.895 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:07.895 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:07.896 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:07.896 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:07.896 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:07.896 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:07.896 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:07.896 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:07.896 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:07.896 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:07.896 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:07.896 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:07.896 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:07.897 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:07.897 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:07.897 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:07.897 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:07.897 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:07.897 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:07.897 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:07.897 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:07.897 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:07.897 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:07.897 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:07.897 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:07.898 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:07.898 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:07.898 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:07.898 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:07.898 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:07.898 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:07.898 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:07.898 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:07.898 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:07.898 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:07.898 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:07.898 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:07.899 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:07.899 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:07.899 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:07.899 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:07.899 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:07.899 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:07.899 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:07.899 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:07.899 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:07.899 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:07.899 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:07.899 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:07.900 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:07.900 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:07.900 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:07.900 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:07.900 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:07.900 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:07.900 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:07.900 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:07.900 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:07.900 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:07.900 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:07.901 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:07.901 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:07.901 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:07.901 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:07.901 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:07.901 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:07.901 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:07.901 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:07.901 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:07.901 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:07.901 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:07.901 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:07.902 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:07.902 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:07.902 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:07.902 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:07.902 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:07.902 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:07.902 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:07.902 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:07.902 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:07.902 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:07.902 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:07.903 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:07.903 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:07.903 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:07.903 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:07.903 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:07.903 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:07.903 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:07.903 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:07.903 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:07.903 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:07.903 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:07.903 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:07.903 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:07.904 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:07.904 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:07.904 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:07.904 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:07.904 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:07.904 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:07.904 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:07.904 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:07.904 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:07.904 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:07.904 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:07.904 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:07.905 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:07.905 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:07.905 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:07.905 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:07.905 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:07.905 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:07.905 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:07.905 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:07.905 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:07.905 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:07.905 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:07.906 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:07.906 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:07.906 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:07.906 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:07.906 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:07.906 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:07.906 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:07.906 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:07.906 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:07.906 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:07.906 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:07.907 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:07.907 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:07.907 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:07.907 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:07.907 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:07.907 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:07.907 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:07.907 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:07.907 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:07.907 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:07.907 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:07.907 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:07.908 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:07.908 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:07.908 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:07.908 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:07.908 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:07.908 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:07.908 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:07.908 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:07.908 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:07.908 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:07.908 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:07.908 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:07.909 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:07.909 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:07.909 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:07.909 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:07.909 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:07.909 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:07.909 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:07.909 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:07.909 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:07.909 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:07.909 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:07.909 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:07.910 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:07.910 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:07.910 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:07.910 INFO:teuthology.orchestra.run.smithi012.stdout:__________________ ERROR at teardown of test_atomic_write_4mb __________________ 2023-10-05T12:49:07.910 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:07.910 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:07.910 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:07.910 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:07.910 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:07.910 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:07.910 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:07.910 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:07.911 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:07.911 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:07.911 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:07.911 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:07.911 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:07.911 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:07.911 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:07.911 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:07.911 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:07.911 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:07.911 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:07.911 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:07.912 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:07.912 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:07.912 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:07.912 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:07.912 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:07.912 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:07.912 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:07.912 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:07.912 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:07.912 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:07.912 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:07.912 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:07.913 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:07.913 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:07.913 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:07.913 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:07.913 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:07.913 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:07.913 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:07.913 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:07.913 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:07.913 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:07.913 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:07.913 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:07.914 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:07.914 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:07.914 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:07.914 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:07.914 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:07.914 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:07.914 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:07.914 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:07.914 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:07.914 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:07.914 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:07.914 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:07.915 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:07.915 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:07.915 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:07.915 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:07.915 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:07.915 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:07.915 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:07.915 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:07.915 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:07.915 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:07.915 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:07.915 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:07.916 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:07.916 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:07.916 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:07.916 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:07.916 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:07.916 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:07.916 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:07.916 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:07.916 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:07.916 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:07.916 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:07.916 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:07.917 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:07.917 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:07.917 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:07.917 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:07.917 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:07.917 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:07.917 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:07.917 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:07.917 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:07.917 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:07.917 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:07.917 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:07.918 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:07.918 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:07.918 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:07.918 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:07.918 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:07.918 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:07.918 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:07.918 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:07.918 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:07.918 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:07.918 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.174 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:08.174 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:08.174 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:08.174 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:08.174 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:08.174 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:08.174 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:08.175 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:08.175 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:08.175 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:08.175 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:08.175 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:08.175 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.175 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:08.175 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:08.175 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:08.175 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:08.175 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:08.176 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:08.176 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:08.176 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:08.176 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:08.176 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:08.176 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:08.176 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:08.176 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:08.176 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:08.176 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:08.176 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:08.177 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:08.177 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:08.177 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:08.177 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:08.177 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:08.177 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:08.177 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:08.177 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:08.177 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:08.177 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:08.177 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:08.177 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:08.178 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:08.178 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:08.178 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:08.178 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.178 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:08.178 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.178 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:08.178 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:08.178 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.178 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:08.178 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:08.179 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:08.179 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:08.179 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:08.179 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.179 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:08.179 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:08.179 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.179 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:08.179 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:08.179 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:08.179 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:08.179 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.180 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:08.180 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:08.180 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:08.180 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:08.180 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:08.180 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:08.180 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.180 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:08.180 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:08.180 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:08.180 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:08.180 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:08.181 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.181 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:08.181 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.181 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:08.181 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.181 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:08.181 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.181 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:08.181 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:08.181 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:08.181 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:08.181 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.182 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:08.182 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:08.182 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:08.182 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:08.182 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:08.182 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:08.182 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:08.182 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:08.182 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:08.182 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:08.182 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:08.183 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:08.183 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:08.183 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:08.183 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:08.183 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:08.183 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:08.183 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:08.183 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:08.183 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:08.183 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:08.183 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:08.183 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:08.184 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:08.184 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:08.184 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:08.184 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:08.184 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:08.184 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:08.184 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:08.184 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:08.184 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:08.184 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:08.184 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:08.184 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:08.185 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:08.185 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:08.185 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:08.185 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:08.185 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:08.185 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:08.185 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:08.185 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:08.185 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.185 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:08.185 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:08.185 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.186 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:08.186 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:08.186 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:08.186 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:08.186 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:08.186 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:08.186 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:08.186 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:08.186 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:08.186 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:08.186 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:08.186 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:08.187 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:08.187 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:08.187 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:08.187 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.187 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:08.187 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:08.187 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:08.187 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:08.187 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:08.187 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:08.187 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:08.187 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:08.188 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:08.188 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:08.188 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:08.188 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:08.188 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.188 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:08.188 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:08.188 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:08.188 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:08.188 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:08.188 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:08.188 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.189 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:08.189 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:08.189 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:08.189 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:08.189 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:08.189 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.189 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:08.189 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:08.189 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:08.189 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:08.189 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:08.189 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:08.190 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.190 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:08.190 INFO:teuthology.orchestra.run.smithi012.stdout:__________________ ERROR at teardown of test_atomic_write_8mb __________________ 2023-10-05T12:49:08.190 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.190 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:08.190 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.190 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:08.190 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:08.190 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.190 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:08.190 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:08.191 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:08.191 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:08.191 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:08.191 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.191 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:08.191 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:08.191 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.191 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:08.191 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:08.191 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:08.191 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:08.191 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.192 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:08.192 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:08.192 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:08.192 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:08.192 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:08.192 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.192 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:08.192 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:08.192 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.192 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:08.192 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:08.192 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:08.193 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:08.193 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:08.193 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:08.193 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:08.193 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.193 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:08.193 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:08.193 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:08.193 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:08.193 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:08.193 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:08.193 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:08.194 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:08.194 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:08.194 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.194 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:08.194 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:08.194 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:08.194 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:08.194 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.194 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:08.194 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:08.194 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:08.195 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:08.195 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.195 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:08.195 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:08.195 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:08.195 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:08.195 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:08.195 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:08.195 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.195 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:08.195 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:08.195 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:08.195 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:08.196 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:08.196 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.196 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:08.196 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:08.196 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.196 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:08.196 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:08.196 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:08.196 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:08.196 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:08.196 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:08.196 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.197 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:08.197 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.197 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:08.197 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.197 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:08.197 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:08.197 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.197 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:08.197 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:08.197 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:08.197 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:08.197 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:08.198 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:08.198 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:08.198 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:08.198 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:08.198 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:08.198 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:08.198 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:08.198 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:08.198 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:08.198 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:08.198 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.198 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:08.199 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:08.199 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:08.199 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:08.199 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:08.199 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:08.199 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:08.199 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:08.199 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:08.199 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:08.199 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:08.199 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:08.200 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.200 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:08.200 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:08.200 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:08.200 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:08.200 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:08.200 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:08.200 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:08.200 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:08.200 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:08.200 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:08.200 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:08.200 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:08.201 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:08.201 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:08.201 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:08.201 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:08.201 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:08.201 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:08.201 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:08.201 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:08.201 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:08.201 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:08.201 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:08.201 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:08.202 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:08.202 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:08.202 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:08.202 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:08.202 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:08.202 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:08.202 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:08.202 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.202 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:08.202 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.202 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:08.203 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:08.203 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.203 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:08.203 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:08.203 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:08.203 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:08.203 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:08.203 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.203 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:08.203 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:08.203 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.203 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:08.203 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:08.204 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:08.204 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:08.204 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.204 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:08.204 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:08.204 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:08.204 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:08.204 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:08.204 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:08.204 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.204 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:08.204 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:08.205 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:08.205 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:08.205 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:08.205 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.205 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:08.205 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.205 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:08.205 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.205 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:08.205 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.205 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:08.205 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:08.206 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:08.206 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:08.206 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.206 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:08.206 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:08.206 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:08.206 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:08.206 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:08.206 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:08.206 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:08.206 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:08.207 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:08.207 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:08.207 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:08.207 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:08.207 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:08.207 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:08.207 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:08.207 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:08.207 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:08.207 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:08.207 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:08.207 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:08.208 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:08.208 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:08.208 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:08.208 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:08.208 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:08.208 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:08.208 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:08.208 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:08.208 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:08.208 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:08.208 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:08.209 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:08.209 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:08.209 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:08.209 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:08.209 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:08.209 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:08.209 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:08.209 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:08.209 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:08.209 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:08.209 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:08.209 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:08.210 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.210 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:08.210 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:08.210 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.210 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:08.210 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:08.210 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:08.210 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:08.210 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:08.210 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:08.210 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:08.211 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:08.211 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:08.211 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:08.211 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:08.211 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:08.211 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:08.211 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:08.211 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:08.211 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.211 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:08.211 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:08.211 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:08.211 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:08.212 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:08.212 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:08.212 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:08.212 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:08.212 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:08.212 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:08.212 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:08.212 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:08.212 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.212 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:08.212 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:08.212 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:08.213 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:08.213 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:08.213 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:08.213 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.213 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:08.213 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:08.213 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:08.213 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:08.213 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:08.213 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.213 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:08.213 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:08.214 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:08.214 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:08.214 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:08.214 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:08.214 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.214 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:08.214 INFO:teuthology.orchestra.run.smithi012.stdout:_______________ ERROR at teardown of test_atomic_dual_write_1mb ________________ 2023-10-05T12:49:08.214 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.214 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:08.214 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.214 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:08.215 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:08.215 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.215 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:08.215 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:08.215 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:08.215 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:08.215 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:08.215 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.215 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:08.215 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:08.215 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.216 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:08.216 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:08.216 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:08.216 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:08.216 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.216 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:08.216 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:08.216 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:08.216 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:08.216 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:08.216 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.216 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:08.217 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:08.217 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.217 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:08.217 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:08.217 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:08.217 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:08.217 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:08.217 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:08.217 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:08.217 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.217 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:08.217 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:08.218 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:08.218 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:08.218 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:08.218 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:08.218 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:08.218 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:08.218 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:08.218 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.218 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:08.218 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:08.218 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:08.219 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:08.219 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.219 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:08.219 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:08.219 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:08.219 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:08.219 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.219 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:08.219 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:08.219 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:08.219 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:08.219 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:08.219 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:08.220 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.220 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:08.220 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:08.220 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:08.220 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:08.220 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:08.220 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.220 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:08.220 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:08.220 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.220 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:08.220 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:08.221 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:08.221 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:08.221 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:08.221 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:08.221 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.221 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:08.221 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.221 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:08.221 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.221 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:08.221 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:08.221 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.222 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:08.222 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:08.222 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:08.222 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:08.222 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:08.222 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:08.222 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:08.222 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:08.222 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:08.222 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:08.222 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:08.223 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:08.223 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:08.223 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:08.223 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:08.223 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.223 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:08.223 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:08.223 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:08.223 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:08.223 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:08.223 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:08.223 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:08.224 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:08.224 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:08.224 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:08.224 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:08.224 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:08.224 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.224 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:08.224 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:08.224 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:08.224 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:08.224 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:08.224 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:08.224 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:08.225 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:08.225 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:08.225 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:08.225 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:08.225 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:08.225 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:08.225 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:08.225 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:08.225 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:08.225 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:08.225 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:08.226 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:08.226 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:08.226 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:08.226 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:08.226 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:08.226 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:08.226 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:08.226 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:08.226 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:08.226 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:08.226 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:08.226 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:08.227 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:08.227 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.227 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:08.227 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.227 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:08.227 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:08.227 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.227 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:08.227 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:08.227 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:08.227 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:08.227 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:08.228 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.228 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:08.228 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:08.228 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.228 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:08.228 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:08.228 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:08.228 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:08.228 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.228 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:08.228 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:08.228 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:08.229 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:08.229 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:08.229 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:08.229 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.229 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:08.229 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:08.229 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:08.229 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:08.229 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:08.229 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.229 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:08.229 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.230 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:08.230 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.230 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:08.230 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.230 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:08.230 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:08.230 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:08.230 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:08.230 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.230 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:08.230 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:08.231 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:08.231 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:08.231 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:08.231 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:08.231 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:08.231 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:08.231 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:08.231 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:08.231 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:08.231 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:08.231 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:08.231 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:08.232 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:08.232 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:08.232 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:08.232 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:08.232 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:08.232 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:08.232 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:08.232 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:08.232 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:08.232 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:08.232 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:08.232 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:08.233 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:08.233 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:08.233 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:08.233 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:08.233 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:08.233 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:08.233 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:08.233 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:08.233 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:08.233 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:08.233 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:08.233 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:08.234 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:08.234 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:08.234 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:08.234 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:08.234 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:08.234 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.234 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:08.234 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:08.234 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.234 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:08.234 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:08.235 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:08.235 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:08.235 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:08.235 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:08.235 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:08.235 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:08.235 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:08.235 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:08.235 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:08.235 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:08.235 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:08.235 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:08.236 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:08.236 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.236 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:08.236 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:08.236 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:08.236 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:08.236 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:08.236 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:08.236 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:08.236 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:08.236 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:08.236 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:08.237 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:08.237 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:08.237 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.237 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:08.237 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:08.237 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:08.237 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:08.237 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:08.237 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:08.237 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.237 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:08.237 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:08.238 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:08.238 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:08.238 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:08.238 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.238 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:08.238 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:08.238 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:08.238 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:08.238 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:08.238 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:08.238 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.238 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:08.239 INFO:teuthology.orchestra.run.smithi012.stdout:_______________ ERROR at teardown of test_atomic_dual_write_4mb ________________ 2023-10-05T12:49:08.239 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.239 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:08.239 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.239 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:08.239 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:08.239 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.239 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:08.239 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:08.239 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:08.239 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:08.240 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:08.240 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.240 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:08.240 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:08.240 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.240 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:08.240 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:08.240 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:08.240 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:08.240 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.240 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:08.240 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:08.241 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:08.241 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:08.241 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:08.241 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.241 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:08.241 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:08.241 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.241 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:08.241 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:08.241 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:08.241 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:08.241 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:08.242 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:08.242 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:08.242 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.242 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:08.242 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:08.242 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:08.242 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:08.242 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:08.242 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:08.242 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:08.242 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:08.242 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:08.243 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.243 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:08.243 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:08.243 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:08.243 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:08.243 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.243 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:08.243 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:08.243 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:08.243 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:08.243 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.243 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:08.244 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:08.244 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:08.244 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:08.244 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:08.244 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:08.244 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.244 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:08.244 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:08.244 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:08.244 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:08.244 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:08.244 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.245 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:08.245 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:08.245 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.245 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:08.245 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:08.245 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:08.245 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:08.245 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:08.245 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:08.245 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.245 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:08.245 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.245 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:08.246 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.246 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:08.246 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:08.246 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.246 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:08.246 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:08.246 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:08.246 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:08.246 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:08.246 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:08.246 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:08.247 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:08.247 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:08.247 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:08.247 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:08.247 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:08.247 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:08.247 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:08.247 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:08.247 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.247 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:08.247 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:08.247 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:08.248 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:08.248 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:08.248 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:08.248 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:08.248 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:08.248 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:08.248 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:08.248 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:08.248 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:08.248 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.248 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:08.249 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:08.249 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:08.249 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:08.249 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:08.249 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:08.249 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:08.249 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:08.249 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:08.249 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:08.249 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:08.249 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:08.249 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:08.250 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:08.250 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:08.250 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:08.250 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:08.250 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:08.250 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:08.250 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:08.250 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:08.250 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:08.250 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:08.250 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:08.251 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:08.251 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:08.251 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:08.251 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:08.251 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:08.251 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:08.251 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:08.251 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.251 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:08.251 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.251 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:08.251 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:08.252 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.252 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:08.252 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:08.252 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:08.252 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:08.252 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:08.252 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.252 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:08.252 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:08.252 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.252 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:08.252 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:08.252 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:08.253 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:08.253 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.253 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:08.253 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:08.253 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:08.253 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:08.253 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:08.253 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:08.253 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.253 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:08.253 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:08.253 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:08.254 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:08.254 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:08.254 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.254 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:08.254 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.254 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:08.254 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.254 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:08.254 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.254 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:08.254 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:08.254 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:08.255 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:08.255 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.255 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:08.255 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:08.255 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:08.255 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:08.255 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:08.255 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:08.255 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:08.255 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:08.255 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:08.255 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:08.256 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:08.256 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:08.256 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:08.256 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:08.256 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:08.256 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:08.256 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:08.256 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:08.256 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:08.256 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:08.256 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:08.257 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:08.257 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:08.257 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:08.257 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:08.257 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:08.257 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:08.257 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:08.257 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:08.257 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:08.257 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:08.257 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:08.257 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:08.258 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:08.258 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:08.258 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:08.258 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:08.258 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:08.258 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:08.258 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:08.258 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:08.258 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:08.258 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:08.258 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.259 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:08.259 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:08.259 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.259 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:08.259 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:08.259 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:08.259 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:08.259 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:08.259 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:08.259 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:08.259 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:08.259 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:08.260 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:08.260 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:08.260 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:08.260 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:08.260 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:08.260 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:08.260 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.260 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:08.260 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:08.260 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:08.260 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:08.260 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:08.261 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:08.261 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:08.261 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:08.261 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:08.261 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:08.261 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:08.261 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:08.261 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.261 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:08.261 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:08.261 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:08.261 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:08.262 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:08.262 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:08.262 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.262 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:08.262 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:08.262 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:08.262 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:08.262 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:08.262 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.262 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:08.262 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:08.262 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:08.263 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:08.263 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:08.263 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:08.263 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.263 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:08.263 INFO:teuthology.orchestra.run.smithi012.stdout:_______________ ERROR at teardown of test_atomic_dual_write_8mb ________________ 2023-10-05T12:49:08.263 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.263 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:08.263 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.263 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:08.263 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:08.264 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.264 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:08.264 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:08.264 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:08.264 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:08.264 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:08.264 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.264 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:08.264 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:08.264 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.264 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:08.265 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:08.265 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:08.265 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:08.265 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.265 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:08.265 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:08.265 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:08.265 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:08.265 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:08.265 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.265 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:08.265 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:08.266 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.266 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:08.266 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:08.266 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:08.266 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:08.266 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:08.266 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:08.266 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:08.266 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.266 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:08.266 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:08.266 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:08.267 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:08.267 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:08.267 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:08.267 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:08.267 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:08.267 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:08.267 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.267 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:08.267 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:08.267 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:08.267 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:08.268 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.268 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:08.268 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:08.268 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:08.268 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:08.268 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.268 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:08.268 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:08.268 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:08.268 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:08.268 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:08.268 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:08.269 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.269 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:08.269 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:08.269 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:08.269 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:08.269 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:08.269 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.269 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:08.269 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:08.269 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.269 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:08.269 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:08.270 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:08.270 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:08.270 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:08.270 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:08.270 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.270 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:08.270 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.270 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:08.270 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.270 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:08.270 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:08.271 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.271 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:08.271 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:08.271 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:08.271 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:08.271 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:08.271 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:08.271 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:08.271 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:08.271 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:08.271 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:08.271 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:08.272 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:08.272 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:08.272 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:08.272 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:08.272 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.272 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:08.272 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:08.272 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:08.272 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:08.272 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:08.272 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:08.272 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:08.272 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:08.273 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:08.273 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:08.273 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:08.273 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:08.273 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.273 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:08.273 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:08.273 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:08.273 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:08.273 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:08.273 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:08.273 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:08.274 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:08.274 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:08.274 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:08.274 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:08.274 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:08.274 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:08.274 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:08.274 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:08.274 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:08.274 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:08.274 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:08.274 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:08.275 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:08.275 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:08.275 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:08.275 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:08.275 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:08.275 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:08.275 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:08.275 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:08.275 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:08.275 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:08.275 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:08.276 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:08.276 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.276 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:08.276 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.276 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:08.276 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:08.276 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.276 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:08.276 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:08.276 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:08.276 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:08.276 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:08.277 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.277 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:08.277 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:08.277 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.277 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:08.277 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:08.277 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:08.277 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:08.277 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.277 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:08.277 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:08.277 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:08.278 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:08.278 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:08.278 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:08.278 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.278 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:08.278 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:08.278 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:08.278 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:08.278 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:08.278 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.278 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:08.278 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.279 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:08.279 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.279 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:08.279 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.279 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:08.279 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:08.279 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:08.279 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:08.279 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.279 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:08.279 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:08.279 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:08.280 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:08.280 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:08.280 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:08.280 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:08.280 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:08.280 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:08.280 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:08.280 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:08.280 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:08.280 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:08.280 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:08.280 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:08.281 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:08.281 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:08.281 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:08.281 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:08.281 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:08.281 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:08.281 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:08.281 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:08.281 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:08.281 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:08.281 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:08.281 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:08.282 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:08.282 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:08.282 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:08.282 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:08.282 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:08.282 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:08.282 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:08.282 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:08.282 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:08.282 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:08.282 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:08.283 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:08.283 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:08.283 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:08.283 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:08.283 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:08.283 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.283 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:08.283 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:08.283 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.283 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:08.283 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:08.283 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:08.283 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:08.284 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:08.284 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:08.284 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:08.284 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:08.284 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:08.284 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:08.284 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:08.284 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:08.284 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:08.284 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:08.284 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:08.284 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.285 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:08.285 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:08.285 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:08.285 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:08.285 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:08.285 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:08.285 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:08.285 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:08.285 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:08.285 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:08.285 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:08.285 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:08.286 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.286 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:08.286 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:08.286 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:08.286 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:08.286 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:08.286 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:08.286 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.286 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:08.286 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:08.286 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:08.286 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:08.287 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:08.287 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.287 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:08.287 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:08.287 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:08.287 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:08.287 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:08.287 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:08.287 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.287 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:08.287 INFO:teuthology.orchestra.run.smithi012.stdout:____________ ERROR at teardown of test_atomic_conditional_write_1mb ____________ 2023-10-05T12:49:08.287 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.288 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:08.288 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.288 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:08.288 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:08.288 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.288 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:08.288 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:08.288 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:08.288 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:08.288 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:08.288 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.289 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:08.289 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:08.289 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.289 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:08.289 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:08.289 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:08.289 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:08.289 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.289 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:08.289 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:08.289 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:08.289 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:08.290 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:08.290 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.290 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:08.290 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:08.290 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.290 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:08.290 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:08.290 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:08.290 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:08.290 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:08.290 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:08.290 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:08.291 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.291 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:08.291 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:08.291 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:08.291 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:08.291 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:08.291 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:08.291 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:08.291 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:08.291 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:08.291 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.291 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:08.292 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:08.292 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:08.292 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:08.292 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.292 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:08.292 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:08.292 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:08.292 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:08.292 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.292 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:08.292 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:08.292 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:08.293 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:08.293 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:08.293 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:08.322 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.322 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:08.322 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:08.323 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:08.323 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:08.323 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:08.323 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.323 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:08.323 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:08.323 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.323 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:08.323 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:08.323 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:08.323 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:08.324 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:08.324 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:08.324 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.324 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:08.324 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.324 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:08.324 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.324 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:08.324 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:08.324 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.324 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:08.324 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:08.325 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:08.325 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:08.325 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:08.325 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:08.325 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:08.325 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:08.325 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:08.325 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:08.325 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:08.325 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:08.325 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:08.326 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:08.326 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:08.326 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.326 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:08.326 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:08.326 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:08.326 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:08.326 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:08.326 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:08.326 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:08.326 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:08.326 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:08.327 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:08.327 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:08.327 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:08.327 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.327 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:08.327 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:08.327 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:08.327 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:08.327 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:08.327 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:08.327 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:08.327 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:08.328 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:08.328 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:08.328 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:08.328 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:08.328 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:08.328 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:08.328 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:08.328 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:08.328 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:08.328 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:08.328 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:08.328 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:08.329 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:08.329 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:08.329 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:08.329 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:08.329 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:08.329 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:08.329 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:08.329 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:08.329 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:08.329 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:08.329 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:08.329 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.330 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:08.330 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.330 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:08.330 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:08.330 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.330 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:08.330 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:08.330 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:08.330 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:08.330 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:08.330 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.330 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:08.331 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:08.331 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.331 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:08.331 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:08.331 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:08.331 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:08.331 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.331 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:08.331 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:08.331 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:08.331 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:08.331 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:08.332 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:08.332 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.332 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:08.332 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:08.332 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:08.332 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:08.332 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:08.332 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.332 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:08.332 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.332 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:08.332 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.333 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:08.333 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.333 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:08.333 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:08.333 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:08.333 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:08.333 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.333 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:08.333 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:08.333 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:08.333 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:08.333 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:08.334 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:08.334 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:08.334 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:08.334 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:08.334 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:08.334 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:08.334 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:08.334 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:08.334 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:08.334 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:08.334 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:08.334 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:08.335 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:08.335 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:08.335 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:08.335 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:08.335 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:08.335 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:08.335 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:08.335 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:08.335 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:08.335 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:08.335 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:08.335 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:08.336 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:08.336 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:08.336 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:08.336 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:08.336 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:08.336 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:08.336 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:08.336 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:08.336 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:08.336 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:08.336 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:08.336 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:08.337 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:08.337 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:08.337 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.337 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:08.337 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:08.337 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.337 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:08.337 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:08.337 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:08.337 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:08.337 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:08.337 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:08.338 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:08.338 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:08.338 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:08.338 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:08.338 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:08.338 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:08.338 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:08.338 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:08.338 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:08.338 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.338 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:08.339 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:08.339 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:08.339 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:08.339 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:08.339 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:08.339 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:08.339 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:08.339 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:08.339 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:08.339 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:08.339 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:08.339 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.339 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:08.340 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:08.340 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:08.340 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:08.340 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:08.340 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:08.340 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.340 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:08.340 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:08.340 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:08.340 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:08.340 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:08.340 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.341 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:08.341 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:08.341 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:08.341 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:08.341 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:08.341 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:08.341 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.341 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:08.341 INFO:teuthology.orchestra.run.smithi012.stdout:___________ ERROR at teardown of test_atomic_multipart_upload_write ____________ 2023-10-05T12:49:08.341 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.341 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:08.341 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.342 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:08.342 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:08.342 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.342 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:08.342 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:08.342 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:08.342 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:08.342 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:08.342 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.342 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:08.342 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:08.342 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.343 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:08.343 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:08.343 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:08.343 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:08.343 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.343 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:08.343 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:08.343 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:08.343 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:08.343 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:08.343 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.343 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:08.344 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:08.344 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.344 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:08.344 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:08.344 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:08.344 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:08.344 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:08.344 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:08.344 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:08.344 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.344 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:08.344 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:08.345 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:08.345 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:08.345 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:08.345 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:08.345 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:08.345 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:08.345 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:08.345 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.345 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:08.345 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:08.345 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:08.345 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:08.346 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.346 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:08.346 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:08.346 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:08.346 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:08.346 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.346 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:08.346 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:08.346 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:08.346 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:08.346 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:08.346 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:08.347 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.347 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:08.347 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:08.347 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:08.347 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:08.347 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:08.347 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.347 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:08.347 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:08.347 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.347 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:08.347 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:08.348 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:08.348 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:08.348 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:08.348 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:08.348 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.348 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:08.348 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.348 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:08.348 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.348 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:08.348 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:08.348 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.349 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:08.349 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:08.349 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:08.349 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:08.349 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:08.349 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:08.349 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:08.349 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:08.349 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:08.349 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:08.349 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:08.349 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:08.350 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:08.350 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:08.350 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:08.350 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.350 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:08.350 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:08.350 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:08.350 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:08.350 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:08.350 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:08.350 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:08.350 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:08.351 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:08.351 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:08.351 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:08.351 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:08.351 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.351 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:08.351 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:08.351 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:08.351 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:08.351 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:08.351 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:08.351 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:08.352 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:08.352 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:08.352 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:08.352 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:08.352 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:08.352 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:08.352 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:08.352 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:08.352 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:08.352 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:08.352 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:08.352 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:08.353 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:08.353 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:08.353 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:08.353 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:08.353 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:08.353 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:08.353 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:08.353 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:08.353 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:08.353 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:08.353 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:08.353 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:08.354 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.354 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:08.354 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.354 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:08.354 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:08.354 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.354 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:08.354 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:08.354 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:08.354 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:08.354 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:08.355 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.355 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:08.355 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:08.355 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.355 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:08.355 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:08.355 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:08.355 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:08.355 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.355 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:08.355 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:08.355 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:08.356 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:08.356 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:08.356 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:08.356 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.356 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:08.356 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:08.356 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:08.356 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:08.356 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:08.356 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.356 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:08.356 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.357 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:08.357 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.357 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:08.357 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.357 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:08.357 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:08.357 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:08.357 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:08.357 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.357 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:08.357 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:08.357 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:08.358 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:08.358 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:08.358 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:08.358 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:08.358 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:08.358 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:08.358 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:08.358 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:08.358 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:08.358 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:08.358 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:08.358 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:08.359 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:08.359 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:08.359 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:08.359 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:08.359 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:08.359 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:08.359 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:08.359 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:08.359 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:08.359 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:08.359 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:08.359 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:08.360 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:08.360 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:08.360 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:08.360 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:08.360 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:08.360 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:08.360 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:08.360 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:08.360 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:08.360 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:08.360 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:08.360 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:08.361 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:08.361 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:08.361 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:08.361 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:08.361 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.361 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:08.361 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:08.361 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.361 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:08.361 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:08.361 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:08.361 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:08.362 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:08.362 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:08.362 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:08.362 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:08.362 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:08.362 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:08.362 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:08.362 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:08.362 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:08.362 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:08.362 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:08.362 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.363 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:08.363 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:08.363 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:08.363 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:08.363 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:08.363 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:08.363 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:08.363 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:08.363 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:08.363 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:08.363 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:08.363 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:08.364 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.364 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:08.364 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:08.364 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:08.364 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:08.364 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:08.364 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:08.364 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.364 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:08.364 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:08.364 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:08.364 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:08.365 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:08.365 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.365 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:08.365 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:08.365 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:08.365 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:08.365 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:08.365 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:08.365 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.365 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:08.365 INFO:teuthology.orchestra.run.smithi012.stdout:________ ERROR at teardown of test_multipart_resend_first_finishes_last ________ 2023-10-05T12:49:08.365 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.365 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:08.366 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.366 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:08.366 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:08.366 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.366 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:08.366 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:08.366 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:08.366 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:08.366 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:08.366 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.366 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:08.367 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:08.367 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.367 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:08.367 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:08.367 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:08.367 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:08.367 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.367 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:08.367 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:08.367 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:08.367 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:08.367 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:08.368 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.368 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:08.368 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:08.368 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.368 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:08.368 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:08.368 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:08.368 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:08.368 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:08.368 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:08.368 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:08.368 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.369 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:08.369 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:08.369 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:08.369 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:08.369 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:08.369 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:08.369 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:08.369 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:08.369 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:08.369 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.369 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:08.369 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:08.370 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:08.370 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:08.370 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.370 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:08.370 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:08.370 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:08.370 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:08.370 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.370 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:08.370 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:08.370 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:08.370 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:08.371 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:08.371 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:08.371 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.371 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:08.371 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:08.371 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:08.371 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:08.371 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:08.371 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.371 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:08.371 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:08.372 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.372 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:08.372 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:08.372 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:08.372 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:08.372 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:08.372 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:08.372 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.372 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:08.372 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.372 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:08.372 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.373 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:08.373 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:08.373 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.373 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:08.373 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:08.373 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:08.373 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:08.373 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:08.373 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:08.373 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:08.373 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:08.373 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:08.374 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:08.374 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:08.374 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:08.374 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:08.374 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:08.374 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:08.374 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.374 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:08.374 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:08.374 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:08.374 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:08.374 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:08.375 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:08.375 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:08.375 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:08.375 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:08.375 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:08.375 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:08.375 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:08.375 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.375 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:08.375 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:08.375 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:08.375 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:08.375 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:08.376 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:08.376 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:08.376 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:08.376 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:08.376 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:08.376 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:08.376 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:08.376 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:08.376 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:08.376 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:08.376 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:08.376 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:08.377 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:08.377 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:08.377 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:08.377 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:08.377 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:08.377 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:08.377 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:08.377 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:08.377 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:08.377 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:08.377 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:08.377 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:08.378 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:08.378 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:08.378 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.378 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:08.378 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.378 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:08.378 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:08.378 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.378 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:08.378 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:08.378 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:08.378 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:08.379 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:08.379 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.379 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:08.379 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:08.379 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.379 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:08.379 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:08.379 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:08.379 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:08.379 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.379 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:08.379 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:08.380 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:08.380 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:08.380 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:08.380 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:08.380 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.380 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:08.380 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:08.380 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:08.380 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:08.380 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:08.380 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.380 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:08.381 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.381 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:08.381 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.381 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:08.381 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.381 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:08.381 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:08.381 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:08.381 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:08.381 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.382 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:08.382 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:08.382 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:08.382 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:08.382 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:08.382 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:08.382 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:08.382 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:08.382 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:08.382 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:08.383 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:08.383 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:08.383 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:08.383 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:08.383 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:08.383 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:08.383 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:08.383 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:08.383 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:08.383 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:08.383 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:08.383 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:08.384 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:08.384 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:08.384 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:08.384 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:08.384 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:08.384 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:08.384 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:08.384 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:08.384 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:08.384 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:08.384 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:08.384 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:08.385 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:08.385 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:08.385 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:08.385 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:08.385 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:08.385 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:08.385 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:08.385 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:08.385 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:08.385 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.385 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:08.385 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:08.386 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.386 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:08.386 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:08.386 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:08.386 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:08.386 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:08.386 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:08.386 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:08.386 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:08.386 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:08.386 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:08.386 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:08.387 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:08.387 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:08.387 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:08.387 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:08.387 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.387 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:08.387 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:08.387 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:08.387 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:08.387 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:08.387 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:08.387 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:08.388 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:08.388 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:08.388 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:08.388 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:08.388 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:08.388 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.388 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:08.388 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:08.388 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:08.388 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:08.388 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:08.388 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:08.389 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.389 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:08.389 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:08.389 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:08.389 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:08.389 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:08.389 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.389 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:08.389 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:08.389 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:08.389 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:08.389 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:08.390 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:08.390 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.390 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:08.390 INFO:teuthology.orchestra.run.smithi012.stdout:____________ ERROR at teardown of test_ranged_request_response_code ____________ 2023-10-05T12:49:08.390 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.390 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:08.390 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.390 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:08.390 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:08.390 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.390 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:08.390 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:08.391 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:08.391 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:08.391 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:08.391 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.391 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:08.391 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:08.391 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.391 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:08.391 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:08.391 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:08.391 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:08.391 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.392 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:08.392 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:08.392 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:08.392 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:08.392 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:08.392 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.392 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:08.392 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:08.392 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.392 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:08.392 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:08.392 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:08.393 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:08.393 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:08.393 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:08.393 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:08.393 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.393 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:08.393 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:08.393 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:08.393 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:08.393 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:08.393 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:08.393 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:08.394 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:08.394 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:08.394 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.394 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:08.394 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:08.394 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:08.394 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:08.394 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.394 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:08.394 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:08.394 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:08.394 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:08.395 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.395 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:08.395 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:08.395 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:08.395 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:08.395 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:08.395 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:08.395 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.395 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:08.395 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:08.395 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:08.395 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:08.396 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:08.396 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.396 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:08.396 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:08.396 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.396 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:08.396 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:08.396 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:08.396 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:08.396 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:08.396 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:08.397 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.397 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:08.397 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.397 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:08.397 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.397 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:08.397 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:08.397 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.397 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:08.397 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:08.397 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:08.397 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:08.398 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:08.398 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:08.398 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:08.398 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:08.398 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:08.398 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:08.398 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:08.398 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:08.398 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:08.398 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:08.398 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:08.399 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.399 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:08.399 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:08.399 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:08.399 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:08.399 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:08.399 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:08.399 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:08.399 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:08.399 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:08.399 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:08.399 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:08.400 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:08.400 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.400 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:08.400 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:08.400 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:08.400 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:08.400 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:08.400 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:08.400 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:08.400 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:08.400 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:08.400 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:08.401 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:08.401 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:08.401 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:08.401 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:08.401 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:08.401 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:08.401 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:08.401 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:08.401 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:08.401 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:08.401 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:08.401 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:08.402 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:08.402 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:08.402 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:08.402 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:08.402 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:08.402 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:08.402 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:08.402 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:08.402 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:08.402 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.402 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:08.402 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.403 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:08.403 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:08.403 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.403 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:08.403 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:08.403 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:08.403 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:08.403 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:08.403 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.403 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:08.403 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:08.403 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.404 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:08.404 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:08.404 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:08.404 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:08.404 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.404 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:08.404 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:08.404 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:08.404 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:08.404 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:08.404 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:08.404 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.405 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:08.405 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:08.405 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:08.405 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:08.405 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:08.405 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.405 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:08.405 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.405 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:08.405 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.405 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:08.405 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.406 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:08.406 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:08.406 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:08.406 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:08.406 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.406 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:08.406 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:08.406 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:08.406 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:08.406 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:08.406 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:08.407 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:08.407 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:08.407 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:08.407 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:08.407 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:08.407 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:08.407 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:08.407 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:08.407 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:08.407 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:08.407 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:08.407 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:08.408 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:08.408 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:08.408 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:08.408 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:08.408 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:08.408 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:08.408 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:08.408 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:08.408 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:08.408 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:08.408 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:08.408 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:08.409 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:08.409 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:08.409 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:08.409 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:08.409 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:08.409 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:08.409 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:08.409 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:08.409 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:08.409 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:08.409 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:08.409 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:08.409 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:08.410 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.410 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:08.410 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:08.410 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.410 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:08.410 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:08.410 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:08.410 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:08.410 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:08.410 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:08.410 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:08.411 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:08.411 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:08.411 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:08.411 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:08.411 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:08.411 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:08.411 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:08.411 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:08.411 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.411 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:08.411 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:08.411 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:08.412 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:08.412 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:08.412 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:08.412 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:08.412 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:08.412 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:08.412 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:08.412 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:08.412 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:08.412 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.412 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:08.412 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:08.413 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:08.413 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:08.413 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:08.413 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:08.413 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.413 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:08.413 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:08.413 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:08.413 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:08.413 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:08.413 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.413 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:08.413 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:08.414 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:08.414 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:08.414 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:08.414 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:08.414 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.414 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:08.414 INFO:teuthology.orchestra.run.smithi012.stdout:__________ ERROR at teardown of test_ranged_big_request_response_code __________ 2023-10-05T12:49:08.414 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.414 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:08.414 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.414 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:08.415 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:08.415 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.415 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:08.415 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:08.415 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:08.415 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:08.415 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:08.415 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.415 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:08.415 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:08.415 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.415 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:08.416 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:08.416 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:08.416 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:08.416 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.416 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:08.416 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:08.416 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:08.416 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:08.416 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:08.416 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.416 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:08.416 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:08.417 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.417 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:08.417 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:08.417 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:08.417 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:08.417 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:08.417 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:08.417 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:08.417 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.417 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:08.417 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:08.417 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:08.417 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:08.418 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:08.418 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:08.418 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:08.418 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:08.418 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:08.418 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.418 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:08.418 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:08.418 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:08.418 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:08.418 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.419 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:08.419 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:08.419 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:08.419 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:08.419 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.419 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:08.419 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:08.419 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:08.419 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:08.419 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:08.419 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:08.419 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.419 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:08.420 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:08.420 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:08.420 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:08.420 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:08.420 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.420 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:08.420 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:08.420 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.420 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:08.420 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:08.420 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:08.420 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:08.421 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:08.421 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:08.421 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.421 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:08.421 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.421 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:08.421 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.421 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:08.421 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:08.421 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.421 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:08.421 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:08.422 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:08.422 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:08.422 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:08.422 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:08.422 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:08.422 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:08.422 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:08.422 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:08.422 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:08.422 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:08.422 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:08.422 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:08.423 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:08.423 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.423 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:08.423 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:08.423 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:08.423 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:08.423 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:08.423 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:08.423 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:08.423 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:08.423 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:08.423 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:08.424 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:08.424 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:08.424 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.424 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:08.424 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:08.424 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:08.424 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:08.424 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:08.424 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:08.424 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:08.424 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:08.424 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:08.425 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:08.425 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:08.425 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:08.425 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:08.425 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:08.425 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:08.425 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:08.425 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:08.425 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:08.425 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:08.425 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:08.426 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:08.426 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:08.426 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:08.426 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:08.426 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:08.426 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:08.426 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:08.426 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:08.426 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:08.426 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:08.426 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:08.427 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.427 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:08.427 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.427 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:08.427 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:08.427 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.427 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:08.427 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:08.427 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:08.427 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:08.427 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:08.427 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.428 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:08.428 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:08.428 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.428 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:08.428 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:08.428 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:08.428 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:08.428 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.428 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:08.428 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:08.428 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:08.429 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:08.429 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:08.429 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:08.429 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.429 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:08.429 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:08.429 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:08.429 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:08.429 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:08.429 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.429 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:08.429 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.430 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:08.430 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.430 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:08.430 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.430 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:08.430 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:08.430 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:08.430 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:08.430 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.430 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:08.430 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:08.430 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:08.431 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:08.431 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:08.431 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:08.431 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:08.431 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:08.431 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:08.431 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:08.431 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:08.431 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:08.431 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:08.431 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:08.431 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:08.432 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:08.432 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:08.432 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:08.432 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:08.432 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:08.432 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:08.432 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:08.432 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:08.432 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:08.432 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:08.432 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:08.432 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:08.433 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:08.433 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:08.433 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:08.433 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:08.433 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:08.433 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:08.433 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:08.433 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:08.433 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:08.433 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:08.433 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:08.433 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:08.434 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:08.434 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:08.434 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:08.434 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:08.434 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.434 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:08.434 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:08.434 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.434 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:08.434 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:08.434 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:08.435 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:08.435 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:08.435 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:08.435 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:08.435 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:08.435 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:08.435 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:08.435 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:08.435 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:08.435 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:08.435 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:08.435 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:08.435 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.436 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:08.436 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:08.436 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:08.436 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:08.436 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:08.436 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:08.436 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:08.436 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:08.436 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:08.436 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:08.436 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:08.436 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:08.437 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.437 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:08.437 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:08.437 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:08.437 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:08.437 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:08.437 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:08.437 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.437 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:08.437 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:08.437 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:08.437 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:08.438 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:08.438 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.438 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:08.438 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:08.438 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:08.438 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:08.438 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:08.438 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:08.438 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.438 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:08.438 INFO:teuthology.orchestra.run.smithi012.stdout:__ ERROR at teardown of test_ranged_request_skip_leading_bytes_response_code ___ 2023-10-05T12:49:08.438 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.439 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:08.439 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.439 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:08.439 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:08.439 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.439 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:08.439 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:08.439 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:08.439 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:08.439 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:08.439 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.439 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:08.440 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:08.440 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.440 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:08.440 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:08.440 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:08.440 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:08.440 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.440 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:08.440 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:08.440 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:08.440 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:08.440 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:08.441 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.441 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:08.441 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:08.441 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.441 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:08.441 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:08.441 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:08.441 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:08.441 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:08.441 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:08.441 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:08.441 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.441 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:08.442 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:08.442 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:08.442 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:08.442 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:08.442 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:08.442 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:08.442 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:08.442 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:08.442 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.442 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:08.443 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:08.443 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:08.443 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:08.443 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.443 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:08.443 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:08.443 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:08.443 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:08.443 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.443 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:08.443 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:08.443 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:08.444 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:08.444 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:08.444 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:08.444 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.444 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:08.444 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:08.444 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:08.444 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:08.444 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:08.444 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.444 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:08.444 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:08.445 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.445 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:08.445 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:08.445 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:08.445 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:08.445 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:08.445 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:08.445 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.445 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:08.445 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.445 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:08.445 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.446 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:08.446 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:08.446 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.446 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:08.446 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:08.446 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:08.446 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:08.446 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:08.446 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:08.446 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:08.446 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:08.446 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:08.447 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:08.447 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:08.447 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:08.447 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:08.447 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:08.447 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:08.447 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.447 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:08.447 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:08.447 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:08.447 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:08.447 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:08.448 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:08.448 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:08.448 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:08.448 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:08.448 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:08.448 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:08.448 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:08.448 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.448 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:08.448 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:08.448 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:08.449 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:08.449 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:08.449 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:08.449 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:08.449 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:08.449 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:08.449 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:08.449 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:08.449 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:08.449 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:08.449 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:08.449 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:08.450 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:08.450 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:08.450 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:08.450 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:08.450 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:08.450 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:08.450 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:08.450 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:08.450 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:08.450 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:08.450 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:08.451 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:08.451 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:08.451 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:08.451 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:08.451 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:08.451 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.451 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:08.451 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.451 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:08.451 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:08.451 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.451 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:08.452 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:08.452 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:08.452 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:08.452 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:08.452 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.452 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:08.452 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:08.452 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.452 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:08.452 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:08.452 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:08.452 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:08.452 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.453 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:08.453 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:08.453 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:08.453 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:08.453 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:08.453 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:08.453 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.453 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:08.453 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:08.453 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:08.453 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:08.453 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:08.454 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.454 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:08.454 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.454 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:08.454 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.454 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:08.454 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.454 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:08.454 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:08.454 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:08.454 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:08.454 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.455 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:08.455 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:08.455 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:08.455 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:08.455 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:08.455 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:08.455 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:08.455 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:08.455 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:08.455 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:08.455 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:08.455 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:08.456 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:08.456 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:08.456 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:08.456 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:08.456 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:08.456 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:08.456 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:08.456 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:08.456 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:08.456 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:08.456 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:08.456 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:08.457 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:08.457 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:08.457 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:08.457 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:08.457 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:08.457 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:08.457 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:08.457 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:08.457 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:08.457 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:08.457 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:08.457 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:08.458 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:08.458 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:08.458 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:08.458 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:08.458 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:08.458 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:08.458 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:08.458 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.458 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:08.458 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:08.458 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.459 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:08.459 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:08.459 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:08.459 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:08.459 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:08.459 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:08.459 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:08.459 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:08.459 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:08.459 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:08.459 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:08.459 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:08.460 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:08.460 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:08.460 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:08.460 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.460 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:08.460 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:08.460 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:08.460 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:08.460 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:08.460 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:08.460 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:08.460 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:08.461 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:08.461 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:08.461 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:08.461 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:08.461 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.461 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:08.461 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:08.461 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:08.461 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:08.461 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:08.461 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:08.461 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.462 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:08.462 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:08.462 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:08.462 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:08.462 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:08.462 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.462 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:08.462 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:08.462 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:08.462 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:08.462 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:08.463 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:08.463 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.463 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:08.463 INFO:teuthology.orchestra.run.smithi012.stdout:_ ERROR at teardown of test_ranged_request_return_trailing_bytes_response_code _ 2023-10-05T12:49:08.463 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.463 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:08.463 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.463 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:08.463 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:08.463 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.463 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:08.463 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:08.464 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:08.464 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:08.464 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:08.464 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.464 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:08.464 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:08.464 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.464 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:08.464 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:08.464 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:08.464 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:08.465 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.465 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:08.465 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:08.465 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:08.465 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:08.465 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:08.465 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.465 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:08.465 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:08.465 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.465 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:08.465 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:08.465 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:08.466 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:08.466 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:08.466 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:08.466 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:08.466 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.466 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:08.466 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:08.466 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:08.466 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:08.466 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:08.466 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:08.467 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:08.467 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:08.467 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:08.467 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.467 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:08.467 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:08.467 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:08.467 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:08.467 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.467 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:08.467 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:08.467 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:08.467 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:08.468 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.468 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:08.468 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:08.468 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:08.468 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:08.468 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:08.468 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:08.468 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.468 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:08.468 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:08.468 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:08.468 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:08.469 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:08.469 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.469 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:08.469 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:08.469 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.469 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:08.469 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:08.469 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:08.469 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:08.469 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:08.469 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:08.469 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.470 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:08.470 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.470 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:08.470 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.470 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:08.470 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:08.470 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.470 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:08.470 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:08.470 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:08.470 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:08.471 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:08.471 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:08.471 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:08.471 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:08.471 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:08.471 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:08.471 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:08.471 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:08.471 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:08.471 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:08.471 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:08.471 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.472 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:08.472 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:08.472 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:08.472 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:08.472 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:08.472 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:08.472 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:08.472 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:08.472 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:08.472 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:08.472 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:08.472 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:08.473 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.473 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:08.473 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:08.473 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:08.473 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:08.473 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:08.473 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:08.473 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:08.473 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:08.473 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:08.473 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:08.473 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:08.474 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:08.474 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:08.474 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:08.474 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:08.474 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:08.474 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:08.474 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:08.474 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:08.474 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:08.474 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:08.474 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:08.475 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:08.475 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:08.475 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:08.475 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:08.475 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:08.475 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:08.475 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:08.475 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:08.475 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:08.475 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.475 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:08.475 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.476 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:08.476 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:08.476 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.476 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:08.476 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:08.476 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:08.476 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:08.476 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:08.476 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.476 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:08.476 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:08.476 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.477 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:08.477 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:08.477 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:08.477 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:08.477 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.477 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:08.477 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:08.477 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:08.477 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:08.477 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:08.477 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:08.477 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.478 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:08.478 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:08.478 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:08.478 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:08.478 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:08.478 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.478 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:08.478 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.478 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:08.478 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.478 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:08.478 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.479 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:08.479 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:08.479 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:08.479 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:08.479 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.479 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:08.479 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:08.479 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:08.479 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:08.479 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:08.479 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:08.479 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:08.480 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:08.480 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:08.480 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:08.480 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:08.480 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:08.480 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:08.480 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:08.480 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:08.480 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:08.480 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:08.480 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:08.481 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:08.481 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:08.481 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:08.481 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:08.481 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:08.481 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:08.481 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:08.481 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:08.481 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:08.481 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:08.481 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:08.481 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:08.482 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:08.482 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:08.482 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:08.482 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:08.482 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:08.482 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:08.482 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:08.482 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:08.482 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:08.482 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:08.482 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:08.482 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:08.483 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:08.483 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.483 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:08.483 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:08.483 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.483 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:08.483 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:08.483 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:08.483 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:08.483 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:08.483 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:08.484 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:08.484 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:08.484 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:08.484 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:08.484 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:08.484 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:08.484 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:08.484 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:08.484 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:08.484 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.484 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:08.484 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:08.485 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:08.485 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:08.485 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:08.485 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:08.485 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:08.485 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:08.485 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:08.485 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:08.485 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:08.485 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:08.485 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.485 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:08.486 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:08.486 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:08.486 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:08.486 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:08.486 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:08.486 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.486 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:08.486 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:08.486 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:08.486 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:08.486 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:08.487 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.487 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:08.487 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:08.487 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:08.487 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:08.487 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:08.487 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:08.487 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.487 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:08.487 INFO:teuthology.orchestra.run.smithi012.stdout:____________ ERROR at teardown of test_ranged_request_invalid_range ____________ 2023-10-05T12:49:08.487 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.487 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:08.488 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.488 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:08.488 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:08.488 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.488 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:08.488 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:08.488 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:08.488 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:08.488 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:08.488 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.488 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:08.488 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:08.489 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.489 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:08.489 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:08.489 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:08.489 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:08.489 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.489 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:08.489 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:08.489 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:08.489 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:08.489 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:08.489 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.490 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:08.490 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:08.490 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.490 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:08.490 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:08.490 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:08.490 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:08.490 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:08.490 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:08.490 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:08.490 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.490 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:08.491 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:08.491 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:08.491 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:08.491 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:08.491 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:08.491 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:08.491 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:08.491 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:08.491 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.491 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:08.491 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:08.491 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:08.492 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:08.492 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.492 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:08.492 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:08.492 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:08.492 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:08.492 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.492 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:08.492 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:08.492 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:08.492 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:08.492 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:08.493 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:08.493 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.493 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:08.493 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:08.493 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:08.493 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:08.493 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:08.493 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.493 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:08.493 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:08.493 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.493 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:08.494 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:08.494 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:08.494 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:08.494 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:08.494 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:08.494 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.494 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:08.494 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.494 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:08.494 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.494 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:08.495 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:08.495 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.495 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:08.495 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:08.495 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:08.495 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:08.495 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:08.495 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:08.495 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:08.495 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:08.495 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:08.495 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:08.496 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:08.496 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:08.496 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:08.496 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:08.496 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:08.496 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.496 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:08.496 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:08.496 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:08.496 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:08.496 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:08.496 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:08.497 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:08.497 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:08.497 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:08.497 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:08.497 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:08.497 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:08.497 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.497 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:08.497 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:08.497 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:08.497 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:08.497 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:08.498 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:08.498 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:08.498 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:08.498 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:08.498 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:08.498 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:08.498 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:08.498 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:08.498 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:08.498 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:08.498 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:08.499 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:08.499 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:08.499 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:08.499 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:08.499 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:08.499 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:08.499 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:08.499 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:08.499 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:08.499 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:08.499 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:08.500 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:08.500 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:08.500 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:08.500 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:08.500 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.500 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:08.500 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.500 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:08.500 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:08.500 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.500 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:08.500 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:08.501 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:08.501 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:08.501 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:08.501 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.501 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:08.501 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:08.501 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.501 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:08.501 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:08.501 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:08.501 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:08.501 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.502 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:08.502 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:08.502 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:08.502 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:08.502 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:08.502 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:08.502 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.502 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:08.502 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:08.502 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:08.502 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:08.502 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:08.503 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.503 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:08.503 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.503 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:08.503 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.503 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:08.503 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.503 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:08.503 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:08.503 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:08.503 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:08.503 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.504 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:08.504 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:08.504 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:08.504 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:08.504 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:08.504 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:08.504 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:08.504 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:08.504 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:08.504 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:08.504 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:08.504 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:08.505 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:08.505 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:08.505 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:08.505 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:08.505 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:08.505 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:08.505 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:08.505 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:08.505 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:08.505 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:08.505 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:08.505 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:08.506 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:08.506 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:08.506 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:08.506 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:08.506 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:08.506 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:08.506 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:08.506 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:08.506 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:08.506 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:08.506 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:08.506 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:08.507 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:08.507 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:08.507 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:08.507 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:08.507 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:08.507 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:08.507 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:08.507 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.507 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:08.507 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:08.507 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.507 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:08.508 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:08.508 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:08.508 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:08.508 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:08.508 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:08.508 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:08.508 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:08.508 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:08.508 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:08.508 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:08.508 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:08.508 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:08.509 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:08.509 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:08.509 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.509 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:08.509 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:08.509 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:08.509 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:08.509 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:08.509 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:08.509 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:08.509 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:08.509 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:08.510 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:08.510 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:08.510 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:08.510 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.510 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:08.510 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:08.510 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:08.510 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:08.510 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:08.510 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:08.510 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.510 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:08.511 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:08.511 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:08.511 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:08.511 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:08.511 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.511 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:08.511 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:08.511 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:08.511 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:08.511 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:08.511 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:08.511 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.512 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:08.512 INFO:teuthology.orchestra.run.smithi012.stdout:____________ ERROR at teardown of test_ranged_request_empty_object _____________ 2023-10-05T12:49:08.512 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.512 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:08.512 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.512 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:08.512 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:08.512 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.512 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:08.512 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:08.512 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:08.512 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:08.512 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:08.513 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.513 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:08.513 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:08.513 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.513 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:08.513 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:08.513 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:08.513 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:08.513 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.513 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:08.513 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:08.513 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:08.514 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:08.514 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:08.514 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.514 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:08.514 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:08.514 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.514 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:08.514 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:08.514 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:08.514 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:08.514 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:08.514 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:08.515 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:08.515 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.515 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:08.515 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:08.515 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:08.515 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:08.515 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:08.515 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:08.515 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:08.515 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:08.515 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:08.515 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.516 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:08.516 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:08.516 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:08.516 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:08.516 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.516 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:08.516 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:08.516 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:08.516 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:08.516 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.516 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:08.516 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:08.517 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:08.517 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:08.517 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:08.517 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:08.517 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.517 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:08.517 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:08.517 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:08.517 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:08.517 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:08.517 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.517 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:08.518 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:08.518 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.518 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:08.518 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:08.518 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:08.518 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:08.518 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:08.518 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:08.518 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.518 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:08.518 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.518 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:08.519 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.519 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:08.519 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:08.519 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.519 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:08.519 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:08.519 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:08.519 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:08.519 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:08.519 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:08.519 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:08.519 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:08.520 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:08.520 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:08.520 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:08.520 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:08.520 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:08.520 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:08.520 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:08.520 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.520 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:08.520 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:08.520 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:08.520 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:08.520 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:08.521 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:08.521 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:08.521 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:08.521 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:08.521 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:08.521 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:08.521 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:08.521 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.521 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:08.521 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:08.521 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:08.521 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:08.522 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:08.522 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:08.522 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:08.522 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:08.522 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:08.522 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:08.522 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:08.522 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:08.522 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:08.522 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:08.522 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:08.522 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:08.523 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:08.523 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:08.523 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:08.523 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:08.523 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:08.523 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:08.523 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:08.523 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:08.523 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:08.523 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:08.523 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:08.523 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:08.524 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:08.524 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:08.524 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:08.524 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.524 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:08.524 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.524 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:08.524 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:08.524 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.524 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:08.524 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:08.524 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:08.525 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:08.525 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:08.525 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.525 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:08.525 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:08.525 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.525 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:08.525 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:08.525 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:08.525 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:08.525 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.525 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:08.525 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:08.526 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:08.526 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:08.526 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:08.526 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:08.526 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.526 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:08.526 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:08.526 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:08.526 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:08.526 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:08.526 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.527 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:08.527 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.527 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:08.527 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.527 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:08.527 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.527 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:08.527 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:08.527 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:08.527 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:08.527 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.527 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:08.528 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:08.528 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:08.528 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:08.528 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:08.528 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:08.528 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:08.528 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:08.528 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:08.528 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:08.528 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:08.528 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:08.528 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:08.529 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:08.529 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:08.529 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:08.529 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:08.529 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:08.529 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:08.529 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:08.529 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:08.529 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:08.529 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:08.529 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:08.529 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:08.530 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:08.530 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:08.530 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:08.530 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:08.530 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:08.530 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:08.530 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:08.530 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:08.530 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:08.530 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:08.530 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:08.531 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:08.531 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:08.531 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:08.531 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:08.531 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:08.531 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:08.531 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:08.531 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.531 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:08.531 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:08.531 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.531 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:08.531 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:08.532 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:08.532 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:08.532 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:08.532 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:08.532 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:08.532 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:08.532 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:08.532 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:08.532 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:08.532 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:08.532 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:08.532 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:08.533 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:08.533 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.533 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:08.533 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:08.533 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:08.533 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:08.533 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:08.533 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:08.533 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:08.533 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:08.533 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:08.533 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:08.534 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:08.534 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:08.534 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.534 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:08.534 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:08.534 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:08.534 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:08.534 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:08.534 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:08.534 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.534 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:08.535 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:08.535 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:08.535 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:08.535 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:08.535 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.535 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:08.535 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:08.535 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:08.535 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:08.535 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:08.535 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:08.535 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.536 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:08.536 INFO:teuthology.orchestra.run.smithi012.stdout:__________ ERROR at teardown of test_versioning_bucket_create_suspend __________ 2023-10-05T12:49:08.536 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.536 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:08.536 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.536 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:08.536 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:08.536 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.536 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:08.536 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:08.536 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:08.536 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:08.537 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:08.537 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.537 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:08.537 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:08.537 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.537 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:08.537 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:08.537 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:08.537 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:08.537 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.537 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:08.537 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:08.538 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:08.538 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:08.538 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:08.538 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.538 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:08.538 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:08.538 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.538 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:08.538 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:08.538 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:08.538 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:08.539 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:08.539 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:08.539 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:08.539 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.539 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:08.539 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:08.539 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:08.539 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:08.539 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:08.539 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:08.539 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:08.541 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:08.541 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:08.541 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.541 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:08.541 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:08.541 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:08.541 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:08.541 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.542 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:08.542 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:08.542 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:08.542 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:08.542 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.542 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:08.542 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:08.542 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:08.542 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:08.542 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:08.542 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:08.542 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.543 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:08.543 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:08.543 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:08.543 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:08.543 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:08.543 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.543 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:08.543 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:08.543 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.543 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:08.543 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:08.543 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:08.544 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:08.544 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:08.544 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:08.544 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.544 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:08.544 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.544 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:08.544 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.544 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:08.544 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:08.544 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.544 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:08.545 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:08.545 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:08.545 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:08.545 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:08.545 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:08.545 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:08.545 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:08.545 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:08.545 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:08.545 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:08.545 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:08.545 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:08.546 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:08.546 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:08.546 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.546 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:08.546 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:08.546 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:08.546 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:08.546 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:08.546 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:08.546 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:08.546 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:08.547 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:08.547 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:08.547 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:08.547 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:08.547 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.547 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:08.547 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:08.547 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:08.547 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:08.547 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:08.547 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:08.547 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:08.548 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:08.548 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:08.548 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:08.548 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:08.548 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:08.548 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:08.548 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:08.548 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:08.548 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:08.548 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:08.548 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:08.548 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:08.549 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:08.549 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:08.549 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:08.549 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:08.549 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:08.549 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:08.549 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:08.549 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:08.549 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:08.549 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:08.549 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:08.550 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:08.550 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.550 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:08.550 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.550 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:08.550 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:08.550 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.550 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:08.550 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:08.550 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:08.550 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:08.550 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:08.551 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.551 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:08.551 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:08.551 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.551 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:08.551 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:08.551 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:08.551 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:08.551 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.551 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:08.551 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:08.551 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:08.552 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:08.552 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:08.552 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:08.552 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.552 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:08.552 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:08.552 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:08.552 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:08.552 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:08.552 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.552 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:08.552 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.553 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:08.553 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.553 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:08.553 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.553 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:08.553 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:08.553 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:08.553 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:08.553 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.553 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:08.553 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:08.553 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:08.554 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:08.554 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:08.554 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:08.554 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:08.554 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:08.554 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:08.554 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:08.554 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:08.554 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:08.554 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:08.554 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:08.554 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:08.555 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:08.555 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:08.555 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:08.555 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:08.555 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:08.555 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:08.555 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:08.555 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:08.555 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:08.555 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:08.555 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:08.555 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:08.556 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:08.556 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:08.556 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:08.556 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:08.556 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:08.556 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:08.556 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:08.556 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:08.556 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:08.556 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:08.556 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:08.556 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:08.556 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:08.557 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:08.557 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:08.557 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:08.557 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.557 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:08.557 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:08.557 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.557 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:08.557 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:08.557 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:08.557 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:08.558 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:08.558 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:08.558 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:08.558 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:08.558 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:08.558 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:08.558 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:08.558 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:08.558 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:08.558 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:08.558 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:08.558 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.559 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:08.559 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:08.559 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:08.559 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:08.559 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:08.559 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:08.559 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:08.559 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:08.559 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:08.559 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:08.559 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:08.560 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:08.560 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.560 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:08.560 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:08.560 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:08.560 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:08.560 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:08.560 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:08.560 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.560 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:08.560 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:08.560 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:08.561 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:08.561 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:08.561 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:08.561 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:08.561 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:08.561 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:09.250 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:09.250 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:09.250 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:09.250 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.250 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:09.250 INFO:teuthology.orchestra.run.smithi012.stdout:_________ ERROR at teardown of test_versioning_obj_create_read_remove __________ 2023-10-05T12:49:09.250 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.250 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:09.251 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.251 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:09.251 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:09.251 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.251 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:09.251 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:09.251 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:09.251 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:09.251 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:09.251 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.251 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:09.251 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:09.252 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.252 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:09.252 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:09.252 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:09.252 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:09.252 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.252 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:09.252 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:09.252 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:09.252 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:09.252 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:09.253 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.253 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:09.253 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:09.253 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.253 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:09.253 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:09.253 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:09.253 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:09.253 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:09.253 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:09.253 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:09.253 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.253 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:09.254 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:09.254 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:09.254 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:09.254 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:09.254 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:09.254 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:09.254 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:09.254 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:09.254 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.254 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:09.254 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:09.255 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:09.255 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:09.255 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.255 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:09.255 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:09.255 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:09.255 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:09.255 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.255 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:09.255 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:09.255 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:09.255 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:09.256 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:09.256 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:09.256 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.256 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:09.256 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:09.256 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:09.256 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:09.256 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:09.256 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.256 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:09.256 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:09.256 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.256 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:09.257 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:09.257 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:09.257 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:09.257 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:09.257 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:09.257 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.257 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:09.257 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.257 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:09.257 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.257 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:09.258 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:09.258 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.258 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:09.258 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:09.258 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:09.258 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:09.258 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:09.258 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:09.258 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:09.258 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:09.258 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:09.258 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:09.259 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:09.259 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:09.259 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:09.259 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:09.259 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:09.259 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.259 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:09.259 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:09.259 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:09.259 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:09.259 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:09.259 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:09.260 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:09.260 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:09.260 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:09.260 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:09.260 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:09.260 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:09.260 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.260 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:09.260 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:09.260 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:09.260 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:09.260 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:09.261 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:09.261 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:09.261 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:09.261 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:09.261 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:09.261 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:09.261 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:09.261 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:09.261 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:09.261 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:09.262 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:09.262 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:09.262 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:09.262 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:09.262 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:09.262 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:09.262 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:09.262 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:09.262 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:09.262 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:09.262 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:09.262 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:09.263 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:09.263 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:09.263 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:09.263 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:09.263 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.263 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:09.263 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.263 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:09.263 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:09.263 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.263 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:09.263 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:09.264 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:09.264 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:09.264 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:09.264 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.264 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:09.264 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:09.264 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.264 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:09.264 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:09.264 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:09.264 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:09.264 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.265 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:09.265 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:09.265 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:09.265 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:09.265 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:09.265 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:09.265 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.265 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:09.265 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:09.265 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:09.265 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:09.265 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:09.265 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.266 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:09.266 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.266 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:09.266 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.266 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:09.266 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.266 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:09.266 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:09.266 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:09.266 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:09.266 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.266 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:09.267 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:09.267 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:09.267 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:09.267 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:09.267 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:09.267 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:09.267 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:09.267 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:09.267 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:09.267 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:09.267 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:09.268 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:09.268 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:09.268 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:09.268 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:09.268 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:09.268 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:09.268 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:09.268 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:09.268 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:09.268 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:09.268 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:09.268 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:09.269 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:09.269 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:09.269 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:09.269 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:09.269 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:09.269 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:09.269 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:09.269 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:09.269 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:09.269 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:09.269 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:09.269 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:09.270 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:09.270 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:09.270 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:09.270 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:09.270 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:09.270 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:09.270 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:09.270 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.270 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:09.270 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:09.270 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.270 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:09.271 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:09.271 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:09.271 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:09.271 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:09.271 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:09.271 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:09.271 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:09.271 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:09.271 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:09.271 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:09.271 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:09.271 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:09.271 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:09.272 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:09.272 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.272 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:09.272 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:09.272 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:09.272 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:09.272 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:09.272 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:09.272 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:09.272 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:09.272 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:09.272 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:09.273 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:09.273 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:09.273 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.273 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:09.273 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:09.273 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:09.273 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:09.273 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:09.273 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:09.273 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.273 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:09.273 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:09.273 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:09.274 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:09.274 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:09.274 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.274 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:09.274 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:09.274 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:09.274 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:09.274 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:09.274 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:09.281 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.281 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:09.281 INFO:teuthology.orchestra.run.smithi012.stdout:_______ ERROR at teardown of test_versioning_obj_create_read_remove_head _______ 2023-10-05T12:49:09.281 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.281 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:09.282 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.282 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:09.282 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:09.282 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.282 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:09.282 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:09.282 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:09.282 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:09.282 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:09.282 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.282 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:09.282 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:09.283 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.283 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:09.283 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:09.283 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:09.283 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:09.283 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.283 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:09.283 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:09.283 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:09.283 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:09.283 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:09.283 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.284 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:09.284 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:09.284 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.284 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:09.284 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:09.284 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:09.284 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:09.284 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:09.284 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:09.284 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:09.284 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.284 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:09.284 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:09.285 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:09.285 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:09.285 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:09.285 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:09.285 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:09.285 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:09.285 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:09.285 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.285 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:09.285 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:09.285 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:09.285 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:09.286 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.286 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:09.286 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:09.286 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:09.286 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:09.286 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.286 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:09.286 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:09.286 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:09.286 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:09.286 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:09.287 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:09.287 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.287 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:09.287 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:09.287 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:09.287 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:09.287 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:09.287 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.287 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:09.287 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:09.287 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.287 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:09.288 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:09.288 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:09.288 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:09.288 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:09.288 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:09.288 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.288 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:09.288 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.288 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:09.288 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.288 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:09.289 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:09.289 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.289 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:09.289 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:09.289 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:09.289 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:09.289 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:09.289 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:09.289 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:09.289 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:09.289 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:09.289 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:09.289 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:09.290 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:09.290 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:09.290 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:09.290 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:09.290 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.290 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:09.290 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:09.290 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:09.290 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:09.290 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:09.290 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:09.291 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:09.291 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:09.291 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:09.291 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:09.291 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:09.291 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:09.291 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.291 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:09.291 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:09.291 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:09.291 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:09.291 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:09.291 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:09.292 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:09.292 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:09.292 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:09.292 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:09.292 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:09.292 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:09.292 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:09.292 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:09.292 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:09.292 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:09.292 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:09.292 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:09.292 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:09.293 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:09.293 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:09.293 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:09.293 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:09.293 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:09.293 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:09.293 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:09.293 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:09.293 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:09.293 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:09.293 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:09.293 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:09.293 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.294 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:09.294 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.294 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:09.294 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:09.294 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.294 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:09.294 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:09.294 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:09.294 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:09.294 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:09.294 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.294 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:09.295 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:09.295 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.295 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:09.295 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:09.295 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:09.295 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:09.295 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.295 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:09.295 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:09.295 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:09.295 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:09.295 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:09.295 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:09.296 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.296 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:09.296 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:09.296 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:09.296 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:09.296 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:09.296 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.296 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:09.296 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.296 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:09.296 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.296 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:09.296 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.297 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:09.297 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:09.297 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:09.297 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:09.297 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.297 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:09.297 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:09.297 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:09.297 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:09.297 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:09.297 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:09.298 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:09.298 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:09.298 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:09.298 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:09.298 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:09.298 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:09.298 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:09.298 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:09.298 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:09.298 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:09.298 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:09.298 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:09.299 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:09.299 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:09.299 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:09.299 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:09.299 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:09.299 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:09.299 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:09.299 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:09.299 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:09.299 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:09.299 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:09.299 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:09.300 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:09.300 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:09.300 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:09.300 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:09.300 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:09.300 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:09.300 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:09.300 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:09.300 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:09.300 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:09.300 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:09.300 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:09.300 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:09.301 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.301 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:09.301 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:09.301 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.301 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:09.301 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:09.301 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:09.301 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:09.301 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:09.301 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:09.301 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:09.301 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:09.302 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:09.302 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:09.302 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:09.302 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:09.302 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:09.302 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:09.302 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:09.302 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.302 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:09.302 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:09.302 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:09.303 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:09.303 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:09.303 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:09.303 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:09.303 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:09.303 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:09.303 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:09.303 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:09.303 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:09.303 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.303 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:09.303 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:09.304 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:09.304 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:09.304 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:09.304 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:09.304 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.304 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:09.304 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:09.304 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:09.304 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:09.304 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:09.304 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.304 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:09.305 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:09.305 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:09.305 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:09.305 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:09.305 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:09.305 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.305 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:09.305 INFO:teuthology.orchestra.run.smithi012.stdout:_____ ERROR at teardown of test_versioning_obj_plain_null_version_removal ______ 2023-10-05T12:49:09.305 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.305 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:09.305 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.305 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:09.306 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:09.306 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.306 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:09.306 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:09.306 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:09.306 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:09.306 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:09.306 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.306 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:09.306 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:09.306 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.307 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:09.307 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:09.307 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:09.307 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:09.307 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.307 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:09.307 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:09.307 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:09.307 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:09.307 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:09.307 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.307 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:09.308 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:09.308 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.308 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:09.308 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:09.308 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:09.308 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:09.308 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:09.308 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:09.308 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:09.308 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.308 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:09.308 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:09.309 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:09.309 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:09.309 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:09.309 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:09.309 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:09.309 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:09.309 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:09.309 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.309 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:09.309 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:09.309 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:09.309 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:09.309 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.310 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:09.310 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:09.310 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:09.310 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:09.310 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.310 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:09.310 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:09.310 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:09.310 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:09.310 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:09.310 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:09.310 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.311 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:09.311 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:09.311 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:09.311 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:09.311 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:09.311 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.311 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:09.311 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:09.311 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.311 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:09.311 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:09.311 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:09.312 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:09.312 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:09.312 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:09.312 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.312 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:09.312 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.312 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:09.312 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.312 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:09.312 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:09.312 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.312 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:09.312 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:09.313 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:09.313 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:09.313 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:09.313 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:09.313 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:09.313 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:09.313 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:09.313 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:09.313 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:09.313 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:09.313 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:09.313 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:09.314 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:09.314 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.314 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:09.314 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:09.314 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:09.314 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:09.314 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:09.314 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:09.314 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:09.314 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:09.314 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:09.315 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:09.315 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:09.315 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:09.315 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.315 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:09.315 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:09.315 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:09.315 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:09.315 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:09.315 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:09.315 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:09.315 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:09.315 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:09.316 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:09.316 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:09.316 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:09.316 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:09.316 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:09.316 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:09.316 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:09.316 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:09.316 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:09.316 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:09.316 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:09.317 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:09.317 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:09.317 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:09.317 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:09.317 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:09.317 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:09.317 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:09.317 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:09.317 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:09.317 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:09.317 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:09.317 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.317 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:09.318 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.318 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:09.318 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:09.318 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.318 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:09.318 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:09.318 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:09.318 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:09.318 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:09.318 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.318 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:09.318 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:09.319 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.319 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:09.319 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:09.319 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:09.319 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:09.319 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.319 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:09.319 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:09.319 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:09.319 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:09.319 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:09.319 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:09.320 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.320 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:09.320 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:09.320 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:09.320 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:09.320 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:09.320 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.320 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:09.320 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.320 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:09.320 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.320 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:09.321 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.321 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:09.321 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:09.321 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:09.321 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:09.321 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.321 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:09.321 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:09.321 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:09.321 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:09.321 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:09.321 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:09.321 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:09.322 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:09.322 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:09.322 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:09.322 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:09.322 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:09.322 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:09.322 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:09.322 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:09.322 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:09.322 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:09.322 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:09.323 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:09.323 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:09.323 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:09.323 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:09.323 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:09.323 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:09.323 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:09.323 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:09.323 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:09.323 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:09.323 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:09.323 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:09.323 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:09.324 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:09.324 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:09.324 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:09.324 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:09.324 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:09.324 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:09.324 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:09.324 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:09.324 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:09.324 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:09.324 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:09.324 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:09.325 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.325 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:09.325 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:09.325 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.325 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:09.325 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:09.325 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:09.325 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:09.325 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:09.325 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:09.325 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:09.325 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:09.326 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:09.326 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:09.326 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:09.326 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:09.326 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:09.326 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:09.326 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:09.326 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.326 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:09.326 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:09.326 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:09.326 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:09.327 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:09.327 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:09.327 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:09.327 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:09.327 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:09.327 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:09.327 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:09.327 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:09.327 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.327 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:09.327 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:09.328 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:09.328 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:09.328 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:09.328 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:09.328 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.328 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:09.328 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:09.328 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:09.328 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:09.328 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:09.328 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.328 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:09.329 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:09.329 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:09.329 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:09.329 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:09.329 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:09.329 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.329 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:09.329 INFO:teuthology.orchestra.run.smithi012.stdout:____ ERROR at teardown of test_versioning_obj_plain_null_version_overwrite _____ 2023-10-05T12:49:09.329 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.329 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:09.329 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.330 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:09.330 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:09.330 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.330 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:09.330 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:09.330 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:09.330 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:09.330 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:09.330 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.330 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:09.330 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:09.330 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.331 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:09.331 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:09.331 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:09.331 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:09.331 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.331 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:09.331 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:09.331 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:09.331 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:09.331 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:09.331 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.331 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:09.332 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:09.332 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.332 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:09.332 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:09.332 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:09.332 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:09.332 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:09.332 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:09.332 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:09.332 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.332 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:09.332 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:09.333 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:09.333 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:09.333 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:09.333 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:09.333 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:09.333 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:09.333 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:09.333 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.333 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:09.333 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:09.333 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:09.333 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:09.333 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.334 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:09.334 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:09.334 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:09.334 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:09.334 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.334 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:09.334 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:09.334 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:09.334 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:09.334 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:09.334 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:09.335 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.335 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:09.335 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:09.335 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:09.335 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:09.335 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:09.335 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.335 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:09.335 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:09.335 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.335 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:09.335 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:09.336 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:09.336 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:09.336 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:09.336 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:09.336 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.336 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:09.336 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.336 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:09.336 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.336 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:09.336 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:09.336 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.337 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:09.337 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:09.337 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:09.337 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:09.337 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:09.337 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:09.337 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:09.337 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:09.337 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:09.337 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:09.337 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:09.337 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:09.338 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:09.338 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:09.338 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:09.338 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.338 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:09.338 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:09.338 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:09.338 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:09.338 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:09.338 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:09.338 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:09.338 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:09.339 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:09.339 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:09.339 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:09.339 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:09.339 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.339 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:09.339 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:09.339 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:09.339 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:09.339 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:09.339 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:09.339 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:09.340 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:09.340 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:09.340 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:09.340 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:09.340 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:09.340 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:09.340 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:09.340 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:09.340 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:09.340 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:09.340 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:09.340 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:09.341 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:09.341 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:09.341 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:09.341 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:09.341 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:09.341 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:09.341 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:09.341 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:09.341 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:09.341 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:09.341 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:09.341 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:09.342 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.342 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:09.342 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.342 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:09.342 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:09.342 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.342 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:09.342 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:09.342 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:09.342 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:09.342 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:09.343 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.343 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:09.343 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:09.343 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.343 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:09.343 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:09.343 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:09.343 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:09.343 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.343 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:09.343 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:09.343 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:09.344 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:09.344 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:09.344 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:09.344 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.344 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:09.344 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:09.344 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:09.344 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:09.344 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:09.344 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.344 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:09.344 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.344 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:09.345 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.345 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:09.345 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.345 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:09.345 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:09.345 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:09.345 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:09.345 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.345 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:09.345 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:09.345 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:09.345 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:09.346 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:09.346 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:09.346 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:09.346 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:09.346 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:09.346 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:09.346 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:09.346 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:09.346 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:09.346 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:09.346 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:09.347 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:09.347 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:09.347 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:09.347 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:09.347 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:09.347 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:09.347 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:09.347 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:09.347 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:09.347 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:09.347 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:09.347 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:09.347 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:09.348 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:09.348 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:09.348 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:09.348 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:09.348 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:09.348 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:09.348 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:09.348 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:09.348 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:09.348 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:09.348 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:09.349 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:09.349 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:09.349 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:09.349 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:09.349 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.349 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:09.349 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:09.349 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.349 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:09.349 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:09.349 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:09.349 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:09.350 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:09.350 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:09.350 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:09.350 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:09.350 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:09.350 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:09.350 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:09.350 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:09.350 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:09.350 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:09.350 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:09.350 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.351 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:09.351 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:09.351 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:09.351 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:09.351 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:09.351 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:09.351 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:09.351 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:09.351 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:09.351 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:09.351 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:09.352 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:09.352 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.352 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:09.352 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:09.352 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:09.352 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:09.352 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:09.352 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:09.352 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.352 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:09.352 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:09.352 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:09.353 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:09.353 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:09.353 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.353 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:09.353 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:09.353 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:09.353 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:09.353 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:09.353 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:09.353 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.353 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:09.353 INFO:teuthology.orchestra.run.smithi012.stdout:_ ERROR at teardown of test_versioning_obj_plain_null_version_overwrite_suspended _ 2023-10-05T12:49:09.354 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.354 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:09.354 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.354 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:09.354 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:09.354 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.354 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:09.354 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:09.354 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:09.354 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:09.354 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:09.354 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.355 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:09.355 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:09.355 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.355 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:09.355 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:09.355 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:09.355 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:09.355 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.355 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:09.355 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:09.355 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:09.355 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:09.356 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:09.356 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.356 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:09.356 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:09.356 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.356 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:09.356 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:09.356 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:09.356 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:09.356 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:09.356 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:09.356 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:09.357 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.357 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:09.357 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:09.357 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:09.357 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:09.357 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:09.357 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:09.357 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:09.357 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:09.357 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:09.357 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.357 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:09.358 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:09.358 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:09.358 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:09.358 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.358 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:09.358 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:09.358 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:09.358 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:09.358 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.358 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:09.358 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:09.359 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:09.359 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:09.359 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:09.359 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:09.359 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.359 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:09.359 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:09.359 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:09.359 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:09.359 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:09.359 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.359 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:09.360 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:09.360 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.360 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:09.360 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:09.360 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:09.360 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:09.360 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:09.360 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:09.360 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.360 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:09.360 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.360 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:09.361 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.361 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:09.361 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:09.361 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.361 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:09.361 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:09.361 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:09.361 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:09.361 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:09.361 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:09.361 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:09.361 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:09.362 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:09.362 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:09.362 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:09.362 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:09.362 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:09.362 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:09.362 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:09.362 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.362 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:09.362 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:09.362 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:09.362 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:09.363 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:09.363 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:09.363 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:09.363 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:09.363 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:09.363 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:09.363 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:09.363 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:09.363 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.363 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:09.363 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:09.363 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:09.364 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:09.364 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:09.364 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:09.364 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:09.364 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:09.364 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:09.364 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:09.364 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:09.364 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:09.364 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:09.364 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:09.364 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:09.364 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:09.365 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:09.365 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:09.365 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:09.365 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:09.365 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:09.365 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:09.365 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:09.365 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:09.365 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:09.365 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:09.365 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:09.365 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:09.365 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:09.366 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:09.366 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:09.366 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.366 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:09.366 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.366 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:09.366 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:09.366 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.366 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:09.366 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:09.366 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:09.367 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:09.367 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:09.367 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.367 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:09.367 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:09.367 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.367 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:09.367 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:09.367 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:09.367 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:09.367 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.367 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:09.367 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:09.368 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:09.368 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:09.368 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:09.368 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:09.368 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.368 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:09.368 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:09.368 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:09.368 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:09.391 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:09.391 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.391 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:09.391 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.392 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:09.392 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.392 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:09.392 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.392 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:09.392 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:09.392 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:09.392 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:09.392 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.392 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:09.392 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:09.392 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:09.393 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:09.393 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:09.393 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:09.393 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:09.393 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:09.393 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:09.393 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:09.393 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:09.393 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:09.393 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:09.393 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:09.393 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:09.393 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:09.394 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:09.394 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:09.394 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:09.394 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:09.394 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:09.394 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:09.394 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:09.394 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:09.394 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:09.394 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:09.394 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:09.395 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:09.395 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:09.395 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:09.395 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:09.395 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:09.395 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:09.395 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:09.395 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:09.395 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:09.395 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:09.395 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:09.395 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:09.396 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:09.396 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:09.396 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:09.396 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:09.396 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.396 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:09.396 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:09.396 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.396 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:09.396 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:09.396 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:09.396 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:09.396 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:09.396 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:09.397 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:09.397 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:09.397 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:09.397 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:09.397 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:09.397 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:09.397 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:09.397 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:09.397 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:09.397 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.397 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:09.398 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:09.398 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:09.398 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:09.398 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:09.398 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:09.398 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:09.398 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:09.398 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:09.398 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:09.398 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:09.399 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:09.399 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.399 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:09.399 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:09.399 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:09.399 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:09.399 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:09.399 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:09.399 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.399 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:09.399 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:09.399 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:09.400 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:09.400 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:09.400 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.400 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:09.400 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:09.400 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:09.400 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:09.400 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:09.400 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:09.400 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.400 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:09.400 INFO:teuthology.orchestra.run.smithi012.stdout:__________ ERROR at teardown of test_versioning_obj_suspend_versions ___________ 2023-10-05T12:49:09.401 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.401 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:09.401 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.401 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:09.401 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:09.401 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.401 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:09.401 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:09.401 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:09.401 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:09.401 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:09.401 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.402 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:09.402 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:09.402 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.402 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:09.402 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:09.402 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:09.402 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:09.402 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.402 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:09.402 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:09.402 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:09.403 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:09.403 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:09.403 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.403 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:09.403 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:09.403 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.403 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:09.403 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:09.403 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:09.403 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:09.403 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:09.403 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:09.404 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:09.404 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.404 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:09.404 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:09.404 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:09.404 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:09.404 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:09.404 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:09.404 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:09.404 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:09.404 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:09.404 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.405 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:09.405 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:09.405 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:09.405 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:09.405 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.405 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:09.405 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:09.405 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:09.405 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:09.405 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.405 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:09.405 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:09.406 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:09.409 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:09.409 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:09.409 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:09.409 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.409 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:09.409 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:09.409 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:09.409 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:09.410 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:09.410 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.410 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:09.410 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:09.410 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.410 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:09.410 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:09.410 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:09.410 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:09.410 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:09.410 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:09.411 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.411 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:09.411 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.411 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:09.411 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.411 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:09.411 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:09.411 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.411 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:09.411 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:09.411 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:09.411 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:09.411 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:09.412 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:09.412 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:09.412 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:09.412 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:09.412 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:09.412 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:09.412 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:09.412 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:09.412 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:09.412 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:09.412 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.412 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:09.413 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:09.413 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:09.413 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:09.413 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:09.413 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:09.413 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:09.413 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:09.413 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:09.413 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:09.413 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:09.413 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:09.413 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.414 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:09.414 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:09.414 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:09.414 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:09.414 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:09.414 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:09.414 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:09.414 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:09.414 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:09.414 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:09.414 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:09.414 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:09.415 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:09.415 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:09.415 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:09.415 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:09.415 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:09.415 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:09.415 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:09.415 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:09.415 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:09.415 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:09.415 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:09.415 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:09.416 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:09.416 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:09.416 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:09.416 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:09.416 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:09.416 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:09.416 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:09.416 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.416 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:09.416 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.416 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:09.416 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:09.416 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.417 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:09.417 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:09.417 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:09.417 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:09.417 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:09.417 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.417 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:09.417 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:09.417 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.417 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:09.417 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:09.417 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:09.418 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:09.418 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.418 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:09.418 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:09.418 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:09.418 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:09.418 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:09.418 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:09.418 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.418 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:09.418 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:09.418 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:09.419 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:09.419 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:09.419 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.419 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:09.419 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.419 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:09.419 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.419 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:09.419 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.419 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:09.419 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:09.419 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:09.420 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:09.420 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.420 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:09.420 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:09.420 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:09.420 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:09.420 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:09.420 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:09.420 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:09.420 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:09.420 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:09.420 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:09.420 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:09.421 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:09.421 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:09.421 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:09.421 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:09.421 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:09.421 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:09.421 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:09.421 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:09.421 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:09.421 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:09.421 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:09.421 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:09.422 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:09.422 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:09.422 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:09.422 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:09.422 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:09.422 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:09.422 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:09.422 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:09.422 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:09.422 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:09.422 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:09.422 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:09.423 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:09.423 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:09.423 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:09.423 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:09.423 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:09.423 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:09.423 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:09.423 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:09.423 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.424 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:09.424 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:09.424 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.424 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:09.424 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:09.424 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:09.424 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:09.424 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:09.424 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:09.424 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:09.424 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:09.424 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:09.425 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:09.425 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:09.425 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:09.425 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:09.425 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:09.425 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:09.425 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.425 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:09.425 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:09.425 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:09.425 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:09.425 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:09.426 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:09.426 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:09.426 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:09.426 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:09.426 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:09.426 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:09.426 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:09.426 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.426 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:09.426 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:09.426 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:09.427 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:09.427 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:09.427 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:09.427 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.427 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:09.427 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:09.427 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:09.427 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:09.427 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:09.427 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.427 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:09.427 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:09.428 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:09.428 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:09.428 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:09.428 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:09.428 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.428 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:09.428 INFO:teuthology.orchestra.run.smithi012.stdout:_____ ERROR at teardown of test_versioning_obj_create_versions_remove_all ______ 2023-10-05T12:49:09.428 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.428 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:09.428 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.428 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:09.428 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:09.429 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.429 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:09.429 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:09.429 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:09.429 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:09.429 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:09.429 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.429 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:09.429 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:09.429 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.429 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:09.430 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:09.430 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:09.430 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:09.430 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.430 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:09.430 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:09.430 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:09.430 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:09.430 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:09.430 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.430 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:09.430 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:09.431 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.431 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:09.431 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:09.431 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:09.431 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:09.431 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:09.431 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:09.431 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:09.431 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.431 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:09.431 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:09.431 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:09.432 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:09.432 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:09.432 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:09.432 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:09.432 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:09.432 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:09.432 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.432 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:09.432 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:09.432 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:09.432 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:09.432 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.433 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:09.433 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:09.433 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:09.433 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:09.433 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.433 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:09.433 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:09.433 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:09.433 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:09.433 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:09.433 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:09.433 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.433 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:09.434 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:09.434 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:09.434 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:09.434 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:09.434 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.434 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:09.434 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:09.434 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.434 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:09.434 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:09.434 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:09.435 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:09.435 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:09.435 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:09.435 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.435 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:09.435 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.435 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:09.435 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.435 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:09.435 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:09.435 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.435 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:09.435 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:09.436 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:09.436 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:09.436 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:09.436 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:09.436 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:09.436 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:09.436 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:09.436 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:09.436 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:09.436 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:09.436 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:09.437 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:09.437 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:09.437 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.437 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:09.437 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:09.437 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:09.437 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:09.437 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:09.437 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:09.437 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:09.437 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:09.437 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:09.437 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:09.438 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:09.438 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:09.438 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.438 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:09.438 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:09.438 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:09.438 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:09.438 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:09.438 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:09.438 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:09.439 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:09.439 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:09.439 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:09.439 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:09.439 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:09.439 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:09.439 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:09.439 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:09.439 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:09.439 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:09.439 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:09.439 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:09.440 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:09.440 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:09.440 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:09.440 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:09.440 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:09.440 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:09.440 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:09.440 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:09.440 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:09.440 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:09.440 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:09.440 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:09.440 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.441 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:09.441 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.441 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:09.441 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:09.441 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.441 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:09.441 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:09.441 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:09.441 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:09.441 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:09.441 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.441 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:09.441 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:09.442 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.442 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:09.442 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:09.442 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:09.442 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:09.442 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.442 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:09.442 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:09.442 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:09.442 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:09.442 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:09.443 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:09.443 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.443 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:09.443 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:09.443 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:09.443 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:09.443 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:09.443 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.443 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:09.443 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.443 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:09.443 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.443 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:09.444 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.444 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:09.444 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:09.444 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:09.444 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:09.444 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.444 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:09.444 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:09.444 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:09.444 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:09.444 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:09.444 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:09.444 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:09.445 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:09.445 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:09.445 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:09.445 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:09.445 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:09.445 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:09.445 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:09.445 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:09.445 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:09.445 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:09.445 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:09.445 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:09.445 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:09.446 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:09.446 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:09.446 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:09.446 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:09.446 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:09.446 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:09.446 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:09.446 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:09.446 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:09.446 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:09.446 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:09.446 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:09.447 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:09.447 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:09.447 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:09.447 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:09.447 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:09.447 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:09.447 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:09.447 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:09.447 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:09.447 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:09.447 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:09.447 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.448 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:09.448 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:09.448 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.448 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:09.448 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:09.448 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:09.448 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:09.448 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:09.448 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:09.448 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:09.448 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:09.448 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:09.449 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:09.449 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:09.449 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:09.449 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:09.449 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:09.449 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:09.449 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.449 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:09.449 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:09.449 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:09.449 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:09.449 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:09.450 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:09.450 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:09.450 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:09.450 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:09.450 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:09.450 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:09.450 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:09.450 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.450 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:09.450 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:09.450 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:09.451 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:09.451 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:09.451 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:09.451 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.451 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:09.451 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:09.451 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:09.451 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:09.451 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:09.451 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.451 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:09.451 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:09.451 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:09.452 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:09.452 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:09.452 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:09.452 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.452 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:09.452 INFO:teuthology.orchestra.run.smithi012.stdout:_ ERROR at teardown of test_versioning_obj_create_versions_remove_special_names _ 2023-10-05T12:49:09.452 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.452 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:09.452 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.452 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:09.452 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:09.453 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.453 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:09.453 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:09.453 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:09.453 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:09.453 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:09.453 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.453 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:09.453 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:09.453 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.453 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:09.453 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:09.453 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:09.454 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:09.454 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.454 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:09.454 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:09.454 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:09.454 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:09.454 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:09.454 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.454 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:09.454 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:09.454 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.455 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:09.455 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:09.455 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:09.455 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:09.455 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:09.455 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:09.455 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:09.455 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.455 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:09.455 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:09.455 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:09.455 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:09.455 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:09.456 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:09.456 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:09.456 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:09.456 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:09.456 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.456 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:09.456 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:09.456 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:09.456 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:09.456 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.456 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:09.456 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:09.457 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:09.457 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:09.457 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.457 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:09.457 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:09.457 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:09.457 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:09.457 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:09.457 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:09.457 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.457 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:09.458 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:09.458 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:09.458 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:09.458 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:09.458 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.458 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:09.458 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:09.458 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.458 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:09.458 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:09.458 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:09.458 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:09.459 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:09.459 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:09.459 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.459 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:09.459 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.459 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:09.459 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.459 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:09.459 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:09.459 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.459 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:09.459 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:09.460 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:09.460 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:09.460 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:09.460 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:09.460 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:09.460 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:09.460 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:09.460 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:09.460 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:09.460 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:09.460 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:09.460 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:09.460 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:09.461 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.461 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:09.461 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:09.461 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:09.461 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:09.461 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:09.461 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:09.461 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:09.461 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:09.461 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:09.461 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:09.461 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:09.462 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:09.462 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.462 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:09.462 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:09.462 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:09.462 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:09.462 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:09.462 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:09.462 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:09.462 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:09.462 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:09.462 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:09.463 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:09.463 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:09.463 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:09.463 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:09.463 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:09.463 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:09.463 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:09.463 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:09.463 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:09.463 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:09.463 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:09.463 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:09.464 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:09.464 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:09.464 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:09.464 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:09.464 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:09.464 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:09.464 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:09.464 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:09.464 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:09.464 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.464 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:09.464 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.465 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:09.465 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:09.465 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.465 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:09.465 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:09.465 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:09.465 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:09.465 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:09.465 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.465 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:09.465 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:09.465 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.466 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:09.466 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:09.466 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:09.466 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:09.466 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.466 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:09.466 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:09.466 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:09.466 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:09.466 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:09.466 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:09.466 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.467 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:09.467 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:09.467 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:09.467 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:09.467 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:09.467 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.467 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:09.467 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.467 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:09.467 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.468 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:09.468 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.468 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:09.468 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:09.468 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:09.468 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:09.468 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.468 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:09.468 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:09.468 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:09.468 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:09.468 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:09.469 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:09.469 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:09.469 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:09.469 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:09.469 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:09.469 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:09.469 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:09.469 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:09.469 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:09.469 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:09.469 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:09.470 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:09.470 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:09.470 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:09.470 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:09.470 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:09.470 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:09.470 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:09.470 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:09.470 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:09.470 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:09.470 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:09.470 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:09.471 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:09.471 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:09.471 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:09.471 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:09.471 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:09.471 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:09.471 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:09.471 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:09.471 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:09.471 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:09.471 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:09.471 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:09.472 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:09.472 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:09.472 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:09.472 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.472 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:09.472 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:09.472 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.472 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:09.472 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:09.472 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:09.472 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:09.472 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:09.472 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:09.473 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:09.473 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:09.473 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:09.473 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:09.473 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:09.473 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:09.473 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:09.473 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:09.473 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:09.473 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.473 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:09.473 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:09.473 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:09.474 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:09.474 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:09.474 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:09.474 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:09.474 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:09.474 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:09.474 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:09.474 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:09.474 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:09.474 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.474 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:09.474 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:09.475 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:09.475 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:09.475 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:09.475 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:09.475 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.475 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:09.475 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:09.475 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:09.475 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:09.475 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:09.475 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.475 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:09.475 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:09.476 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:09.476 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:09.476 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:09.476 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:09.476 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.476 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:09.476 INFO:teuthology.orchestra.run.smithi012.stdout:_____ ERROR at teardown of test_versioning_obj_create_overwrite_multipart ______ 2023-10-05T12:49:09.476 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.476 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:09.476 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.476 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:09.476 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:09.477 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.477 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:09.477 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:09.477 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:09.477 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:09.477 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:09.477 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.477 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:09.477 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:09.477 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.477 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:09.477 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:09.477 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:09.478 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:09.478 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.478 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:09.478 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:09.478 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:09.478 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:09.478 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:09.478 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.478 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:09.478 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:09.478 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.479 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:09.479 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:09.479 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:09.479 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:09.479 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:09.479 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:09.479 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:09.479 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.479 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:09.479 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:09.479 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:09.479 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:09.479 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:09.480 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:09.480 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:09.480 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:09.480 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:09.480 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.480 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:09.480 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:09.480 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:09.480 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:09.480 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.480 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:09.480 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:09.480 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:09.481 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:09.481 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.481 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:09.481 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:09.481 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:09.481 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:09.481 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:09.481 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:09.482 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.482 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:09.482 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:09.482 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:09.482 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:09.482 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:09.482 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.482 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:09.482 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:09.482 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.482 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:09.482 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:09.483 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:09.483 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:09.483 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:09.483 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:09.483 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.483 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:09.483 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.483 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:09.483 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.483 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:09.483 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:09.484 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.484 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:09.484 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:09.484 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:09.484 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:09.484 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:09.484 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:09.484 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:09.484 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:09.484 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:09.484 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:09.485 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:09.485 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:09.485 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:09.485 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:09.485 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:09.485 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.485 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:09.485 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:09.485 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:09.485 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:09.485 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:09.485 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:09.486 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:09.486 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:09.486 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:09.486 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:09.486 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:09.486 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:09.486 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.486 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:09.486 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:09.486 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:09.486 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:09.486 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:09.487 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:09.487 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:09.487 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:09.487 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:09.487 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:09.487 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:09.487 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:09.487 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:09.487 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:09.487 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:09.487 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:09.488 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:09.488 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:09.488 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:09.488 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:09.488 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:09.488 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:09.488 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:09.488 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:09.488 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:09.488 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:09.488 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:09.488 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:09.489 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:09.489 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:09.489 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:09.489 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.489 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:09.489 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.489 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:09.489 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:09.489 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.489 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:09.489 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:09.489 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:09.490 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:09.490 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:09.490 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.490 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:09.490 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:09.490 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.490 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:09.490 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:09.490 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:09.490 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:09.490 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.490 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:09.491 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:09.491 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:09.491 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:09.491 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:09.491 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:09.491 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.491 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:09.491 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:09.491 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:09.491 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:09.491 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:09.492 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.492 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:09.492 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.492 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:09.492 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.492 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:09.492 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.492 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:09.492 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:09.492 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:09.492 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:09.492 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.493 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:09.493 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:09.493 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:09.493 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:09.493 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:09.493 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:09.493 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:09.493 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:09.493 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:09.493 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:09.493 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:09.493 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:09.494 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:09.494 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:09.494 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:09.494 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:09.494 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:09.494 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:09.494 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:09.494 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:09.494 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:09.494 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:09.494 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:09.494 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:09.495 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:09.495 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:09.495 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:09.495 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:09.495 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:09.495 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:09.495 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:09.495 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:09.495 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:09.495 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:09.495 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:09.495 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:09.496 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:09.496 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:09.496 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:09.496 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:09.496 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:09.496 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:09.496 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:09.496 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.496 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:09.496 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:09.496 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.497 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:09.497 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:09.497 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:09.497 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:09.497 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:09.497 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:09.497 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:09.497 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:09.497 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:09.497 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:09.497 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:09.497 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:09.498 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:09.498 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:09.498 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:09.498 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.498 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:09.498 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:09.498 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:09.498 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:09.498 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:09.498 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:09.498 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:09.499 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:09.499 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:09.499 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:09.499 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:09.499 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:09.499 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.499 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:09.499 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:09.499 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:09.499 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:09.499 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:09.499 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:09.500 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.500 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:09.500 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:09.500 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:09.500 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:09.500 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:09.500 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.500 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:09.500 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:09.500 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:09.500 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:09.500 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:09.501 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:09.501 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.501 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:09.501 INFO:teuthology.orchestra.run.smithi012.stdout:_____________ ERROR at teardown of test_versioning_obj_list_marker _____________ 2023-10-05T12:49:09.501 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.501 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:09.501 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.501 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:09.501 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:09.501 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.501 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:09.501 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:09.502 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:09.502 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:09.502 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:09.502 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.502 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:09.502 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:09.502 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.502 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:09.502 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:09.502 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:09.502 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:09.502 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.503 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:09.503 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:09.503 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:09.503 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:09.503 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:09.503 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.503 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:09.503 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:09.503 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.503 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:09.503 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:09.503 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:09.504 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:09.504 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:09.504 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:09.504 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:09.504 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.504 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:09.504 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:09.504 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:09.504 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:09.504 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:09.504 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:09.504 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:09.504 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:09.505 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:09.505 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.505 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:09.505 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:09.505 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:09.505 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:09.505 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.505 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:09.505 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:09.505 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:09.505 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:09.505 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.505 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:09.506 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:09.506 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:09.506 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:09.506 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:09.506 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:09.506 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.506 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:09.506 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:09.506 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:09.506 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:09.506 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:09.506 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.507 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:09.507 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:09.507 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.507 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:09.507 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:09.507 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:09.507 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:09.507 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:09.507 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:09.507 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.507 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:09.507 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.508 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:09.508 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.508 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:09.508 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:09.508 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.508 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:09.508 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:09.508 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:09.508 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:09.508 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:09.508 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:09.508 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:09.509 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:09.509 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:09.509 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:09.509 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:09.509 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:09.509 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:09.509 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:09.509 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:09.509 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.509 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:09.509 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:09.509 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:09.510 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:09.510 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:09.510 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:09.510 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:09.510 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:09.510 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:09.510 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:09.510 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:09.510 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:09.510 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.510 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:09.510 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:09.511 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:09.511 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:09.511 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:09.511 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:09.511 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:09.511 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:09.511 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:09.511 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:09.511 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:09.511 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:09.511 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:09.512 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:09.512 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:09.512 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:09.512 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:09.512 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:09.512 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:09.512 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:09.512 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:09.512 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:09.512 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:09.512 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:09.512 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:09.513 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:09.513 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:09.513 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:09.513 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:09.513 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:09.513 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:09.513 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.513 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:09.513 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.513 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:09.513 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:09.513 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.514 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:09.514 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:09.514 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:09.514 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:09.514 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:09.514 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.514 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:09.514 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:09.514 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.514 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:09.514 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:09.514 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:09.515 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:09.515 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.515 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:09.515 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:09.515 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:09.515 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:09.515 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:09.515 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:09.515 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.515 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:09.515 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:09.515 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:09.516 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:09.516 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:09.516 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.516 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:09.516 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.516 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:09.516 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.516 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:09.516 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.516 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:09.516 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:09.516 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:09.516 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:09.517 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.517 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:09.517 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:09.517 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:09.517 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:09.517 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:09.517 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:09.517 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:09.517 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:09.517 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:09.517 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:09.517 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:09.517 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:09.518 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:09.518 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:09.518 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:09.518 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:09.518 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:09.518 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:09.518 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:09.518 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:09.518 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:09.518 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:09.518 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:09.519 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:09.519 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:09.519 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:09.519 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:09.519 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:09.519 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:09.519 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:09.519 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:09.519 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:09.519 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:09.519 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:09.519 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:09.520 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:09.520 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:09.520 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:09.520 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:09.520 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:09.520 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:09.520 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:09.520 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:09.520 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.520 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:09.520 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:09.521 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.521 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:09.521 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:09.521 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:09.521 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:09.521 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:09.521 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:09.521 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:09.521 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:09.521 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:09.521 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:09.521 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:09.521 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:09.522 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:09.522 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:09.522 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:09.522 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.522 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:09.522 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:09.522 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:09.522 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:09.522 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:09.522 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:09.522 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:09.523 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:09.523 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:09.523 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:09.523 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:09.523 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:09.523 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.523 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:09.523 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:09.523 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:09.523 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:09.523 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:09.523 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:09.524 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.524 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:09.524 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:09.524 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:09.524 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:09.524 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:09.524 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.524 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:09.524 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:09.524 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:09.524 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:09.524 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:09.525 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:09.525 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.525 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:09.525 INFO:teuthology.orchestra.run.smithi012.stdout:____________ ERROR at teardown of test_versioning_copy_obj_version _____________ 2023-10-05T12:49:09.525 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.525 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:09.525 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.525 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:09.525 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:09.525 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.525 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:09.526 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:09.526 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:09.526 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:09.526 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:09.526 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.526 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:09.526 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:09.526 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.526 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:09.526 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:09.526 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:09.526 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:09.527 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.527 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:09.527 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:09.527 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:09.527 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:09.527 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:09.527 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.527 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:09.527 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:09.527 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.527 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:09.528 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:09.528 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:09.528 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:09.528 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:09.528 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:09.528 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:09.528 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.528 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:09.528 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:09.528 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:09.528 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:09.529 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:09.529 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:09.529 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:09.529 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:09.529 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:09.529 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.529 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:09.529 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:09.529 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:09.529 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:09.529 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.529 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:09.530 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:09.530 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:09.530 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:09.530 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.530 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:09.530 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:09.530 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:09.530 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:09.530 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:09.530 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:09.530 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.531 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:09.531 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:09.531 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:09.531 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:09.531 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:09.531 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.531 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:09.531 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:09.531 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.531 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:09.531 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:09.531 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:09.532 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:09.532 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:09.532 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:09.532 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.532 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:09.532 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.532 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:09.532 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.532 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:09.532 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:09.532 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.532 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:09.533 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:09.533 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:09.533 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:09.533 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:09.533 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:09.533 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:09.533 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:09.533 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:09.533 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:09.533 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:09.533 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:09.533 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:09.533 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:09.533 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:09.534 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.534 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:09.534 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:09.534 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:09.534 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:09.534 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:09.534 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:09.534 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:09.534 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:09.534 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:09.534 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:09.535 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:09.535 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:09.535 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.535 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:09.535 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:09.535 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:09.535 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:09.535 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:09.535 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:09.535 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:09.535 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:09.535 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:09.536 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:09.536 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:09.536 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:09.536 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:09.536 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:09.536 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:09.536 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:09.536 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:09.536 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:09.536 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:09.536 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:09.536 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:09.537 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:09.537 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:09.537 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:09.537 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:09.537 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:09.537 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:09.537 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:09.537 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:09.537 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:09.537 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:09.537 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.537 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:09.538 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.538 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:09.538 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:09.538 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.538 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:09.538 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:09.538 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:09.538 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:09.538 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:09.538 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.538 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:09.539 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:09.539 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.539 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:09.539 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:09.539 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:09.539 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:09.539 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.539 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:09.539 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:09.539 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:09.539 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:09.539 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:09.540 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:09.540 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.540 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:09.540 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:09.540 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:09.540 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:09.540 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:09.540 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.540 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:09.540 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.541 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:09.541 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.541 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:09.541 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.541 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:09.541 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:09.541 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:09.541 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:09.541 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.541 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:09.541 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:09.541 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:09.541 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:09.542 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:09.542 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:09.542 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:09.542 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:09.542 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:09.542 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:09.542 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:09.542 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:09.542 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:09.542 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:09.542 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:09.543 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:09.543 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:09.543 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:09.543 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:09.543 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:09.543 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:09.543 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:09.543 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:09.543 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:09.543 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:09.543 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:09.543 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:09.543 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:09.544 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:09.544 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:09.544 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:09.544 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:09.544 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:09.544 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:09.544 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:09.544 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:09.544 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:09.544 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:09.544 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:09.544 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:09.545 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:09.545 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:09.545 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:09.545 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.545 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:09.545 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:09.545 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.545 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:09.545 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:09.545 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:09.545 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:09.545 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:09.545 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:09.546 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:09.546 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:09.546 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:09.546 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:09.546 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:09.546 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:09.546 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:09.546 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:09.546 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:09.546 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.546 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:09.546 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:09.547 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:09.547 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:09.547 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:09.547 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:09.547 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:09.547 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:09.547 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:09.547 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:09.547 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:09.547 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:09.547 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.547 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:09.547 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:09.548 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:09.548 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:09.548 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:09.548 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:09.548 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.548 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:09.548 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:09.548 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:09.548 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:09.548 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:09.548 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.549 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:09.549 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:09.549 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:09.549 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:09.549 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:09.549 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:09.549 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.549 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:09.549 INFO:teuthology.orchestra.run.smithi012.stdout:___________ ERROR at teardown of test_versioning_multi_object_delete ___________ 2023-10-05T12:49:09.549 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.549 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:09.549 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.549 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:09.550 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:09.550 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.550 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:09.550 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:09.550 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:09.550 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:09.550 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:09.550 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.550 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:09.550 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:09.550 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.551 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:09.551 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:09.551 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:09.551 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:09.551 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.551 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:09.551 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:09.551 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:09.551 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:09.551 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:09.551 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.551 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:09.552 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:09.552 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.552 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:09.552 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:09.552 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:09.552 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:09.552 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:09.552 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:09.552 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:09.552 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.552 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:09.552 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:09.552 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:09.553 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:09.553 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:09.553 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:09.553 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:09.553 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:09.553 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:09.553 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.553 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:09.553 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:09.553 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:09.553 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:09.553 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.553 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:09.554 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:09.554 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:09.554 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:09.554 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.554 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:09.554 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:09.554 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:09.554 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:09.554 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:09.554 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:09.554 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.555 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:09.555 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:09.555 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:09.555 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:09.555 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:09.555 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.555 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:09.555 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:09.555 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.555 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:09.555 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:09.555 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:09.556 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:09.556 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:09.556 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:09.556 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.556 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:09.556 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.556 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:09.556 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.556 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:09.556 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:09.556 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.557 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:09.557 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:09.557 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:09.557 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:09.557 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:09.557 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:09.557 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:09.557 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:09.557 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:09.557 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:09.557 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:09.557 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:09.558 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:09.558 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:09.558 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:09.558 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.558 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:09.558 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:09.558 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:09.558 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:09.558 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:09.558 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:09.558 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:09.559 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:09.559 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:09.559 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:09.559 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:09.559 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:09.559 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.559 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:09.559 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:09.559 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:09.559 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:09.559 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:09.559 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:09.560 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:09.560 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:09.560 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:09.560 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:09.560 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:09.560 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:09.560 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:09.560 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:09.560 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:09.560 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:09.560 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:09.560 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:09.561 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:09.561 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:09.561 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:09.561 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:09.561 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:09.561 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:09.561 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:09.561 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:09.561 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:09.561 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:09.561 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:09.561 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:09.562 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:09.562 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.562 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:09.562 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.562 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:09.562 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:09.562 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.562 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:09.562 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:09.562 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:09.562 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:09.562 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:09.563 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.563 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:09.563 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:09.563 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.563 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:09.563 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:09.563 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:09.563 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:09.563 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.563 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:09.563 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:09.563 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:09.564 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:09.564 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:09.564 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:09.564 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.564 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:09.564 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:09.564 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:09.564 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:09.564 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:09.564 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.564 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:09.565 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.565 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:09.565 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.565 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:09.565 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.565 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:09.565 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:09.565 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:09.565 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:09.565 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.565 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:09.565 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:09.566 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:09.566 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:09.566 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:09.566 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:09.566 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:09.566 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:09.566 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:09.566 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:09.566 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:09.566 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:09.566 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:09.566 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:09.567 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:09.567 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:09.567 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:09.567 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:09.567 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:09.567 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:09.567 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:09.567 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:09.567 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:09.567 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:09.567 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:09.567 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:09.568 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:09.568 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:09.568 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:09.568 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:09.568 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:09.568 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:09.568 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:09.568 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:09.568 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:09.568 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:09.568 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:09.568 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:09.569 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:09.569 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:09.569 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:09.569 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:09.569 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:09.569 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.569 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:09.569 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:09.569 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.569 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:09.570 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:09.570 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:09.570 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:09.570 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:09.570 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:09.570 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:09.570 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:09.570 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:09.570 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:09.570 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:09.570 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:09.571 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:09.571 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:09.571 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:09.571 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.571 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:09.571 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:09.571 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:09.571 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:09.571 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:09.571 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:09.571 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:09.571 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:09.572 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:09.572 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:09.572 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:09.572 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:09.572 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.572 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:09.572 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:09.572 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:09.572 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:09.572 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:09.572 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:09.572 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.573 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:09.573 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:09.573 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:09.573 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:09.573 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:09.573 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.573 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:09.573 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:09.573 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:09.573 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:09.573 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:09.573 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:09.574 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.574 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:09.574 INFO:teuthology.orchestra.run.smithi012.stdout:_____ ERROR at teardown of test_versioning_multi_object_delete_with_marker _____ 2023-10-05T12:49:09.574 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.574 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:09.574 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.574 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:09.574 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:09.574 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.574 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:09.574 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:09.575 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:09.575 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:09.575 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:09.575 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.575 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:09.575 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:09.575 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.575 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:09.575 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:09.575 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:09.575 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:09.575 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.575 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:09.576 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:09.576 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:09.576 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:09.576 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:09.576 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.576 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:09.576 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:09.576 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.576 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:09.576 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:09.576 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:09.576 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:09.577 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:09.577 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:09.577 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:09.577 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.577 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:09.577 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:09.577 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:09.577 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:09.577 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:09.577 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:09.577 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:09.577 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:09.578 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:09.578 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.578 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:09.578 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:09.578 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:09.578 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:09.578 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.578 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:09.578 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:09.578 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:09.578 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:09.578 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.579 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:09.579 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:09.579 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:09.579 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:09.579 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:09.579 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:09.579 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.579 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:09.579 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:09.579 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:09.579 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:09.580 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:09.580 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.580 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:09.580 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:09.580 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.580 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:09.580 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:09.580 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:09.580 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:09.580 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:09.580 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:09.580 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.581 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:09.581 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.581 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:09.581 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.581 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:09.581 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:09.581 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.581 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:09.581 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:09.581 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:09.581 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:09.581 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:09.582 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:09.582 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:09.582 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:09.582 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:09.582 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:09.582 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:09.582 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:09.582 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:09.582 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:09.582 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:09.582 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.583 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:09.583 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:09.583 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:09.583 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:09.583 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:09.583 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:09.583 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:09.583 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:09.583 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:09.583 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:09.583 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:09.583 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:09.583 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.584 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:09.584 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:09.584 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:09.584 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:09.584 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:09.584 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:09.584 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:09.584 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:09.584 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:09.585 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:09.585 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:09.585 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:09.585 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:09.585 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:09.585 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:09.585 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:09.585 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:09.585 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:09.585 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:09.585 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:09.585 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:09.586 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:09.586 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:09.586 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:09.586 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:09.586 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:09.586 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:09.586 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:09.586 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:09.586 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:09.586 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:09.586 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.587 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:09.587 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.587 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:09.587 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:09.587 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.587 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:09.587 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:09.587 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:09.587 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:09.587 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:09.587 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.587 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:09.588 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:09.588 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.588 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:09.588 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:09.588 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:09.588 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:09.588 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.588 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:09.588 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:09.588 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:09.588 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:09.588 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:09.589 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:09.589 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.589 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:09.589 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:09.589 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:09.589 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:09.589 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:09.589 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.589 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:09.589 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.589 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:09.589 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.590 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:09.590 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.590 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:09.590 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:09.590 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:09.590 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:09.590 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.590 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:09.590 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:09.590 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:09.590 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:09.591 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:09.591 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:09.591 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:09.591 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:09.591 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:09.591 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:09.591 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:09.591 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:09.591 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:09.591 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:09.591 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:09.591 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:09.592 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:09.592 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:09.592 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:09.592 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:09.592 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:09.592 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:09.592 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:09.592 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:09.592 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:09.592 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:09.592 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:09.592 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:09.593 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:09.593 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:09.593 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:09.593 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:09.593 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:09.593 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:09.593 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:09.593 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:09.593 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:09.593 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:09.593 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:09.593 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:09.594 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:09.594 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:09.594 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:09.594 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.594 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:09.594 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:09.594 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.594 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:09.594 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:09.594 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:09.594 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:09.594 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:09.595 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:09.595 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:09.595 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:09.595 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:09.595 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:09.595 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:09.595 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:09.595 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:09.595 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:09.595 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:09.595 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.595 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:09.596 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:09.596 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:09.596 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:09.596 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:09.596 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:09.596 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:09.596 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:09.596 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:09.596 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:09.596 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:09.596 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:09.596 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.597 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:09.597 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:09.597 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:09.597 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:09.597 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:09.597 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:09.597 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.597 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:09.597 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:09.597 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:09.597 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:09.597 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:09.598 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.598 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:09.598 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:09.598 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:09.598 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:09.598 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:09.598 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:09.598 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.598 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:09.598 INFO:teuthology.orchestra.run.smithi012.stdout:_ ERROR at teardown of test_versioning_multi_object_delete_with_marker_create __ 2023-10-05T12:49:09.599 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.599 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:09.599 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.599 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:09.599 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:09.599 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.599 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:09.599 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:09.599 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:09.599 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:09.599 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:09.599 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.600 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:09.600 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:09.600 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.600 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:09.600 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:09.600 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:09.600 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:09.600 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.600 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:09.600 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:09.600 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:09.601 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:09.601 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:09.601 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.601 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:09.601 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:09.601 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.601 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:09.601 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:09.601 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:09.601 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:09.601 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:09.601 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:09.601 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:09.602 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.602 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:09.602 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:09.602 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:09.602 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:09.602 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:09.602 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:09.602 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:09.602 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:09.602 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:09.602 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.603 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:09.603 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:09.603 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:09.603 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:09.603 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.603 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:09.603 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:09.603 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:09.603 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:09.603 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.603 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:09.603 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:09.604 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:09.604 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:09.604 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:09.604 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:09.604 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.604 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:09.604 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:09.604 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:09.604 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:09.604 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:09.604 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.604 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:09.605 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:09.605 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.605 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:09.605 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:09.605 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:09.605 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:09.605 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:09.605 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:09.605 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.605 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:09.605 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.605 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:09.605 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.606 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:09.606 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:09.606 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.606 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:09.606 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:09.606 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:09.606 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:09.606 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:09.606 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:09.606 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:09.606 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:09.607 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:09.607 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:09.607 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:09.607 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:09.607 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:09.607 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:09.607 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:09.607 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.607 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:09.607 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:09.607 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:09.607 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:09.608 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:09.608 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:09.608 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:09.608 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:09.608 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:09.608 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:09.608 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:09.608 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:09.608 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.608 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:09.608 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:09.608 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:09.609 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:09.609 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:09.609 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:09.609 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:09.609 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:09.609 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:09.609 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:09.609 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:09.609 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:09.609 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:09.609 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:09.609 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:09.610 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:09.610 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:09.610 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:09.610 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:09.610 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:09.610 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:09.613 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:09.613 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:09.613 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:09.613 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:09.613 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:09.613 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:09.613 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:09.613 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:09.613 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:09.613 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:09.614 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.614 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:09.614 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.614 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:09.614 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:09.614 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.614 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:09.614 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:09.614 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:09.614 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:09.614 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:09.614 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.615 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:09.615 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:09.615 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.615 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:09.615 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:09.615 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:09.615 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:09.615 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.615 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:09.615 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:09.615 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:09.616 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:09.616 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:09.616 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:09.616 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.616 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:09.616 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:09.616 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:09.616 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:09.616 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:09.616 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.617 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:09.617 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.617 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:09.617 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.617 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:09.617 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.617 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:09.617 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:09.617 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:09.617 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:09.617 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.617 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:09.618 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:09.618 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:09.618 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:09.618 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:09.618 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:09.618 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:09.618 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:09.618 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:09.618 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:09.618 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:09.618 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:09.619 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:09.619 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:09.619 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:09.619 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:09.619 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:09.619 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:09.619 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:09.619 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:09.619 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:09.619 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:09.619 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:09.619 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:09.620 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:09.620 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:09.620 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:09.620 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:09.620 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:09.620 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:09.620 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:09.620 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:09.620 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:09.620 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:09.620 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:09.620 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:09.620 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:09.621 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:09.621 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:09.621 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:09.621 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:09.621 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:09.621 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:09.621 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.621 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:09.621 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:09.621 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.621 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:09.621 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:09.621 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:09.622 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:09.622 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:09.622 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:09.622 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:09.622 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:09.622 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:09.622 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:09.623 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:09.623 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:09.623 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:09.623 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:09.623 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:09.623 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.623 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:09.623 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:09.623 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:09.623 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:09.624 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:09.624 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:09.624 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:09.624 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:09.624 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:09.624 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:09.624 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:09.624 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:09.624 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.624 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:09.625 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:09.625 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:09.625 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:09.625 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:09.625 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:09.625 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.625 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:09.625 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:09.625 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:09.625 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:09.625 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:09.626 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.626 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:09.626 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:09.626 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:09.626 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:09.626 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:09.626 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:09.626 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.626 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:09.627 INFO:teuthology.orchestra.run.smithi012.stdout:________________ ERROR at teardown of test_versioned_object_acl ________________ 2023-10-05T12:49:09.627 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.627 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:09.627 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.627 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:09.627 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:09.627 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.627 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:09.627 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:09.627 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:09.627 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:09.628 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:09.628 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.628 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:09.628 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:09.628 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.628 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:09.628 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:09.628 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:09.628 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:09.628 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.629 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:09.629 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:09.629 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:09.629 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:09.629 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:09.629 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.629 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:09.629 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:09.629 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.629 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:09.629 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:09.630 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:09.630 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:09.630 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:09.630 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:09.630 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:09.630 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.630 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:09.630 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:09.630 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:09.630 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:09.631 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:09.631 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:09.631 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:09.631 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:09.631 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:09.631 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.631 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:09.631 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:09.631 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:09.631 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:09.632 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.632 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:09.632 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:09.632 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:09.632 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:09.632 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.632 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:09.632 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:09.632 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:09.632 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:09.632 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:09.633 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:09.633 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.633 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:09.633 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:09.633 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:09.633 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:09.633 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:09.634 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.634 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:09.634 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:09.634 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.634 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:09.634 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:09.634 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:09.634 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:09.634 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:09.634 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:09.635 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.635 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:09.635 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.635 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:09.635 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.635 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:09.635 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:09.635 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.635 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:09.635 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:09.636 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:09.636 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:09.636 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:09.636 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:09.636 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:09.636 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:09.636 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:09.636 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:09.636 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:09.636 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:09.637 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:09.637 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:09.637 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:09.637 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.637 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:09.637 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:09.637 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:09.637 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:09.637 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:09.637 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:09.638 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:09.638 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:09.638 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:09.638 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:09.638 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:09.638 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:09.638 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.638 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:09.638 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:09.638 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:09.639 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:09.639 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:09.639 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:09.639 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:09.639 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:09.639 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:09.639 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:09.639 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:09.639 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:09.639 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:09.640 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:09.640 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:09.640 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:09.640 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:09.640 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:09.640 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:09.640 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:09.640 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:09.640 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:09.640 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:09.641 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:09.641 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:09.641 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:09.641 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:09.641 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:09.641 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:09.641 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:09.641 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:09.641 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.641 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:09.642 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.642 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:09.642 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:09.642 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.642 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:09.642 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:09.642 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:09.642 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:09.642 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:09.642 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.643 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:09.643 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:09.643 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.643 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:09.643 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:09.643 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:09.643 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:09.643 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.643 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:09.643 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:09.643 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:09.644 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:09.644 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:09.644 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:09.644 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.644 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:09.644 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:09.644 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:09.644 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:09.644 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:09.644 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.645 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:09.645 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.645 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:09.645 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.645 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:09.645 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.645 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:09.645 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:09.645 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:09.646 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:09.646 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:09.646 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:09.646 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:09.646 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:09.646 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:09.646 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:09.646 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:09.646 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:09.646 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:09.647 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:09.647 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:09.647 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:09.647 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:09.647 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:09.647 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:09.647 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:09.647 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:09.647 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:09.647 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:09.648 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:09.648 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:09.648 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:09.648 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:09.648 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:09.648 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:09.648 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:09.648 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:09.648 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:09.648 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:09.649 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:09.649 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:10.235 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:10.235 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:10.235 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:10.235 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:10.235 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:10.235 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:10.236 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:10.236 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:10.236 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:10.236 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:10.236 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:10.236 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:10.236 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:10.237 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.237 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:10.237 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:10.237 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.237 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:10.237 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:10.237 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:10.237 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:10.237 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:10.237 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:10.238 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:10.238 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:10.238 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:10.238 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:10.238 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:10.238 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:10.238 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:10.238 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:10.238 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:10.239 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.239 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:10.239 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:10.239 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:10.239 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:10.239 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:10.239 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:10.239 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:10.239 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:10.239 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:10.240 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:10.240 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:10.240 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.240 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.240 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:10.240 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:10.240 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:10.240 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:10.240 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:10.240 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.241 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.241 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:10.241 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:10.241 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:10.241 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:10.241 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:10.241 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.241 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:10.241 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:10.241 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:10.241 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:10.242 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:10.242 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:10.242 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.242 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:10.242 INFO:teuthology.orchestra.run.smithi012.stdout:_____ ERROR at teardown of test_versioned_object_acl_no_version_specified ______ 2023-10-05T12:49:10.242 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.242 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:10.242 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.242 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:10.243 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:10.243 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.243 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:10.243 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:10.243 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:10.243 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:10.243 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:10.243 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.243 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:10.243 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:10.243 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.244 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:10.244 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:10.244 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:10.244 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.244 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.244 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:10.244 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:10.244 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:10.244 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:10.244 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:10.245 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.245 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:10.245 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:10.245 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.245 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:10.245 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:10.245 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:10.245 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:10.245 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:10.245 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:10.246 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:10.322 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.322 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:10.322 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:10.322 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:10.322 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:10.323 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:10.323 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:10.323 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:10.323 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:10.323 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:10.323 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.323 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:10.323 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:10.323 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:10.323 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:10.324 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.324 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:10.324 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:10.324 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:10.324 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:10.324 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.324 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:10.324 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:10.324 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:10.324 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:10.325 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:10.325 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.325 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.325 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:10.325 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:10.325 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:10.325 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:10.325 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:10.325 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.325 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:10.326 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:10.326 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.326 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:10.326 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:10.326 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:10.326 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:10.326 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:10.326 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:10.326 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.327 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:10.327 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.327 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:10.327 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.327 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:10.327 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:10.327 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.327 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:10.327 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:10.327 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:10.328 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:10.328 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:10.328 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:10.328 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:10.328 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:10.328 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:10.328 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:10.328 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:10.328 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:10.328 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:10.329 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:10.329 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:10.329 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.329 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:10.329 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:10.329 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:10.329 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:10.329 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:10.329 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:10.330 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:10.330 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:10.330 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:10.330 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:10.330 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:10.330 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.330 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.330 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:10.330 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:10.331 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:10.331 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:10.331 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:10.331 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:10.331 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:10.331 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:10.331 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:10.331 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:10.332 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:10.332 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:10.332 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:10.332 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:10.332 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:10.332 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:10.332 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:10.332 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:10.332 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:10.333 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:10.333 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:10.333 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:10.333 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:10.333 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:10.333 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:10.333 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:10.333 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:10.333 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:10.334 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:10.334 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:10.334 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:10.334 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.334 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:10.334 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.334 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:10.334 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:10.334 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.334 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:10.335 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:10.335 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:10.335 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:10.335 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:10.335 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.335 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:10.335 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:10.335 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.335 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:10.335 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:10.336 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:10.336 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.336 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.336 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:10.336 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:10.336 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:10.336 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:10.336 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:10.336 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.336 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.336 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:10.337 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:10.337 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:10.337 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.337 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:10.337 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.337 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:10.337 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.337 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:10.337 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.337 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:10.338 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.338 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:10.338 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:10.338 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:10.338 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:10.338 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.338 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:10.338 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:10.338 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:10.339 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:10.339 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:10.339 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:10.339 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:10.339 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:10.339 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:10.339 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:10.339 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:10.339 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:10.339 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:10.340 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:10.340 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:10.340 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:10.340 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:10.340 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:10.340 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:10.340 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:10.340 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:10.340 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:10.341 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:10.341 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:10.341 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:10.341 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:10.341 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:10.341 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:10.341 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:10.341 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:10.341 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:10.341 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:10.342 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:10.342 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:10.342 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:10.342 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:10.342 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:10.342 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:10.342 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:10.342 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:10.342 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:10.342 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:10.343 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:10.343 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.343 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:10.343 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:10.343 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.343 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:10.343 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:10.343 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:10.343 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:10.343 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:10.343 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:10.344 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:10.344 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:10.344 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:10.344 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:10.344 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:10.344 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:10.344 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:10.344 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:10.344 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:10.344 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.345 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:10.345 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:10.345 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:10.345 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:10.345 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:10.345 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:10.345 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:10.345 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:10.345 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:10.345 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:10.345 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:10.346 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.346 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.346 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:10.346 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:10.346 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:10.346 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:10.346 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:10.346 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.346 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.346 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:10.347 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:10.347 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:10.347 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:10.347 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:10.347 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.347 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:10.347 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:10.347 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:10.347 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:10.347 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:10.348 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:10.348 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.348 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:10.348 INFO:teuthology.orchestra.run.smithi012.stdout:___ ERROR at teardown of test_versioned_concurrent_object_create_and_remove ____ 2023-10-05T12:49:10.348 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.348 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:10.348 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.348 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:10.349 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:10.349 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.349 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:10.349 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:10.349 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:10.349 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:10.349 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:10.349 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.349 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:10.349 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:10.350 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.350 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:10.350 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:10.350 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:10.350 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.350 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.350 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:10.350 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:10.350 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:10.350 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:10.351 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:10.351 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.351 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:10.351 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:10.351 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.351 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:10.351 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:10.351 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:10.351 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:10.351 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:10.352 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:10.352 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:10.352 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.352 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:10.352 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:10.352 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:10.352 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:10.352 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:10.352 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:10.352 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:10.353 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:10.353 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:10.353 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.353 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:10.353 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:10.353 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:10.353 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:10.353 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.353 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:10.353 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:10.354 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:10.354 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:10.354 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.354 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:10.354 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:10.354 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:10.354 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:10.354 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:10.354 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.354 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.355 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:10.355 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:10.355 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:10.355 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:10.355 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:10.355 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.355 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:10.355 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:10.355 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.355 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:10.356 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:10.356 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:10.356 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:10.356 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:10.356 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:10.356 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.356 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:10.356 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.356 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:10.356 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.357 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:10.357 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:10.357 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.357 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:10.357 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:10.357 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:10.357 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:10.357 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:10.357 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:10.358 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:10.358 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:10.358 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:10.358 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:10.358 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:10.358 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:10.358 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:10.358 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:10.358 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:10.358 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.359 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:10.359 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:10.359 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:10.359 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:10.359 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:10.359 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:10.359 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:10.359 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:10.359 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:10.359 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:10.359 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:10.360 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.360 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.360 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:10.360 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:10.360 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:10.360 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:10.360 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:10.360 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:10.360 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:10.360 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:10.360 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:10.361 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:10.361 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:10.361 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:10.361 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:10.361 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:10.361 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:10.361 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:10.361 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:10.361 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:10.361 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:10.361 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:10.362 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:10.362 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:10.362 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:10.362 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:10.362 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:10.362 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:10.362 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:10.362 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:10.362 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:10.362 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:10.363 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:10.363 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.363 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:10.363 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.363 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:10.363 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:10.363 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.363 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:10.363 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:10.363 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:10.363 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:10.363 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:10.364 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.364 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:10.364 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:10.364 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.364 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:10.364 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:10.364 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:10.364 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.364 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.364 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:10.364 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:10.365 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:10.365 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:10.365 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:10.365 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.365 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.365 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:10.365 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:10.365 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:10.365 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.365 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:10.365 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.366 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:10.366 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.366 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:10.366 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.366 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:10.366 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.366 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:10.366 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:10.366 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:10.367 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:10.367 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.367 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:10.367 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:10.367 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:10.367 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:10.367 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:10.367 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:10.367 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:10.367 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:10.367 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:10.368 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:10.368 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:10.368 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:10.368 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:10.368 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:10.368 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:10.368 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:10.368 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:10.368 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:10.368 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:10.369 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:10.369 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:10.369 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:10.369 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:10.369 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:10.369 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:10.369 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:10.369 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:10.369 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:10.369 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:10.369 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:10.370 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:10.370 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:10.370 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:10.370 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:10.370 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:10.370 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:10.370 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:10.370 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:10.370 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:10.370 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:10.371 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:10.371 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:10.371 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:10.371 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.371 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:10.371 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:10.371 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.371 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:10.371 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:10.371 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:10.371 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:10.372 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:10.372 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:10.372 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:10.372 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:10.372 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:10.372 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:10.372 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:10.372 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:10.372 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:10.373 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:10.373 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:10.373 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.373 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:10.373 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:10.373 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:10.373 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:10.373 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:10.373 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:10.373 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:10.373 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:10.374 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:10.374 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:10.374 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:10.374 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.374 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.374 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:10.374 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:10.374 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:10.374 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:10.374 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:10.374 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.375 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.375 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:10.375 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:10.375 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:10.375 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:10.375 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:10.375 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.375 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:10.375 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:10.375 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:10.375 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:10.376 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:10.376 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:10.376 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.376 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:10.376 INFO:teuthology.orchestra.run.smithi012.stdout:___________________ ERROR at teardown of test_lifecycle_set ____________________ 2023-10-05T12:49:10.376 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.376 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:10.376 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.376 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:10.376 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:10.376 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.377 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:10.377 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:10.377 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:10.377 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:10.377 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:10.377 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.377 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:10.377 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:10.377 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.377 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:10.377 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:10.378 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:10.378 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.378 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.378 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:10.378 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:10.378 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:10.378 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:10.378 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:10.378 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.379 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:10.379 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:10.379 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.379 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:10.379 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:10.379 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:10.379 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:10.379 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:10.379 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:10.379 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:10.379 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.380 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:10.380 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:10.380 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:10.380 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:10.380 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:10.380 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:10.380 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:10.380 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:10.380 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:10.380 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.381 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:10.381 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:10.381 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:10.381 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:10.381 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.381 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:10.381 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:10.381 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:10.381 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:10.381 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.382 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:10.382 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:10.382 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:10.382 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:10.382 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:10.382 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.382 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.382 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:10.382 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:10.382 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:10.382 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:10.383 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:10.383 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.383 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:10.383 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:10.383 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.383 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:10.383 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:10.383 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:10.384 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:10.384 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:10.384 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:10.384 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.384 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:10.384 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.384 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:10.384 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.384 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:10.384 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:10.384 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.385 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:10.385 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:10.385 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:10.385 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:10.385 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:10.385 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:10.385 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:10.385 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:10.385 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:10.385 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:10.385 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:10.386 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:10.386 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:10.386 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:10.386 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:10.386 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.386 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:10.386 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:10.386 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:10.386 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:10.386 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:10.387 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:10.387 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:10.387 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:10.387 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:10.387 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:10.387 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:10.387 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.387 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.387 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:10.387 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:10.388 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:10.388 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:10.388 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:10.388 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:10.388 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:10.388 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:10.388 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:10.388 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:10.388 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:10.388 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:10.389 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:10.389 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:10.389 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:10.389 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:10.389 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:10.389 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:10.389 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:10.389 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:10.389 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:10.389 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:10.390 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:10.390 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:10.390 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:10.390 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:10.390 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:10.390 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:10.390 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:10.390 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:10.390 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:10.390 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.391 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:10.391 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.391 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:10.391 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:10.391 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.391 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:10.391 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:10.391 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:10.391 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:10.391 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:10.391 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.392 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:10.392 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:10.392 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.392 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:10.392 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:10.392 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:10.392 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.392 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.392 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:10.392 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:10.392 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:10.393 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:10.393 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:10.393 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.393 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.393 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:10.393 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:10.393 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:10.393 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.393 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:10.393 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.393 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:10.394 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.394 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:10.394 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.394 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:10.394 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.394 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:10.394 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:10.394 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:10.394 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:10.394 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.395 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:10.395 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:10.395 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:10.395 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:10.395 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:10.395 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:10.395 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:10.395 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:10.395 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:10.395 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:10.396 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:10.396 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:10.396 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:10.396 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:10.396 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:10.396 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:10.396 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:10.396 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:10.396 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:10.396 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:10.396 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:10.397 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:10.397 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:10.397 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:10.397 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:10.397 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:10.397 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:10.397 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:10.397 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:10.397 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:10.397 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:10.397 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:10.398 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:10.398 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:10.398 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:10.398 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:10.398 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:10.398 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:10.398 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:10.398 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:10.398 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:10.398 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:10.399 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:10.399 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.399 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:10.399 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:10.399 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.399 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:10.399 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:10.399 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:10.400 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:10.400 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:10.400 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:10.400 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:10.400 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:10.400 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:10.400 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:10.400 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:10.400 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:10.401 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:10.401 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:10.401 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:10.401 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.401 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:10.401 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:10.401 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:10.401 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:10.401 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:10.401 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:10.401 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:10.402 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:10.402 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:10.402 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:10.402 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:10.402 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.402 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.402 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:10.402 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:10.402 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:10.402 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:10.403 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:10.403 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.403 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.403 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:10.403 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:10.403 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:10.403 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:10.403 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:10.403 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.403 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:10.404 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:10.404 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:10.404 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:10.404 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:10.404 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:10.404 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.404 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:10.404 INFO:teuthology.orchestra.run.smithi012.stdout:___________________ ERROR at teardown of test_lifecycle_get ____________________ 2023-10-05T12:49:10.404 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.404 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:10.404 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.405 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:10.405 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:10.405 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.405 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:10.405 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:10.405 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:10.405 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:10.405 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:10.405 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.405 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:10.406 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:10.406 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.406 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:10.406 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:10.406 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:10.406 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.406 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.406 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:10.406 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:10.406 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:10.406 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:10.407 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:10.407 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.407 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:10.407 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:10.407 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.407 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:10.407 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:10.407 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:10.407 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:10.407 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:10.408 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:10.408 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:10.408 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.408 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:10.408 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:10.408 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:10.408 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:10.408 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:10.408 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:10.408 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:10.408 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:10.409 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:10.409 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.409 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:10.409 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:10.409 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:10.409 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:10.409 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.409 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:10.409 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:10.409 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:10.410 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:10.410 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.410 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:10.410 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:10.410 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:10.410 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:10.410 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:10.410 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.410 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.410 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:10.411 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:10.411 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:10.411 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:10.411 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:10.411 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.411 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:10.411 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:10.411 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.411 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:10.411 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:10.412 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:10.412 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:10.412 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:10.412 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:10.412 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.412 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:10.412 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.412 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:10.412 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.412 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:10.412 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:10.413 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.413 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:10.413 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:10.413 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:10.413 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:10.413 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:10.413 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:10.413 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:10.413 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:10.414 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:10.414 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:10.414 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:10.414 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:10.414 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:10.414 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:10.414 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:10.414 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.414 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:10.415 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:10.415 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:10.415 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:10.415 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:10.415 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:10.415 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:10.415 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:10.415 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:10.415 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:10.415 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:10.416 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.416 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.416 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:10.416 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:10.416 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:10.416 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:10.416 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:10.416 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:10.416 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:10.416 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:10.417 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:10.417 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:10.417 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:10.417 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:10.417 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:10.417 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:10.417 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:10.417 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:10.417 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:10.417 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:10.418 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:10.418 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:10.418 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:10.418 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:10.418 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:10.418 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:10.418 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:10.418 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:10.418 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:10.418 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:10.419 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:10.419 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:10.419 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:10.419 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.419 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:10.419 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.419 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:10.419 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:10.419 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.419 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:10.420 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:10.420 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:10.420 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:10.420 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:10.420 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.420 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:10.420 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:10.420 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.420 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:10.420 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:10.420 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:10.421 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.421 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.421 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:10.421 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:10.421 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:10.421 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:10.421 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:10.421 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.421 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.421 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:10.422 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:10.422 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:10.422 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.422 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:10.422 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.422 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:10.422 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.422 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:10.422 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.422 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:10.422 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.423 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:10.423 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:10.423 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:10.423 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:10.423 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.423 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:10.423 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:10.423 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:10.423 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:10.423 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:10.424 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:10.424 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:10.424 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:10.424 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:10.424 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:10.424 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:10.424 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:10.424 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:10.424 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:10.424 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:10.424 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:10.425 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:10.425 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:10.425 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:10.425 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:10.425 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:10.425 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:10.425 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:10.425 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:10.425 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:10.425 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:10.426 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:10.426 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:10.426 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:10.426 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:10.426 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:10.426 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:10.426 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:10.426 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:10.426 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:10.426 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:10.427 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:10.427 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:10.427 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:10.427 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:10.427 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:10.427 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:10.427 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:10.427 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.427 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:10.427 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:10.428 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.428 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:10.428 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:10.428 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:10.428 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:10.428 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:10.428 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:10.428 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:10.428 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:10.428 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:10.429 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:10.429 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:10.429 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:10.429 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:10.429 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:10.429 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:10.429 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.429 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:10.429 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:10.429 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:10.430 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:10.430 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:10.430 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:10.430 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:10.430 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:10.430 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:10.430 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:10.430 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:10.430 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.430 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.433 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:10.433 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:10.433 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:10.433 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:10.433 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:10.433 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.433 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.434 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:10.434 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:10.434 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:10.434 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:10.434 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:10.434 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.434 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:10.434 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:10.434 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:10.435 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:10.435 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:10.435 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:10.435 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.435 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:10.435 INFO:teuthology.orchestra.run.smithi012.stdout:________________ ERROR at teardown of test_lifecycle_get_no_id _________________ 2023-10-05T12:49:10.435 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.435 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:10.436 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.436 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:10.436 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:10.436 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.436 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:10.436 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:10.436 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:10.436 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:10.436 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:10.437 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.437 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:10.437 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:10.437 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.437 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:10.437 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:10.437 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:10.437 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.437 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.437 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:10.437 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:10.438 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:10.438 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:10.438 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:10.438 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.438 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:10.438 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:10.438 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.438 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:10.438 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:10.439 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:10.439 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:10.439 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:10.439 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:10.439 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:10.439 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.439 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:10.439 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:10.439 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:10.439 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:10.440 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:10.440 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:10.440 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:10.440 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:10.440 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:10.440 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.440 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:10.440 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:10.440 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:10.440 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:10.441 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.441 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:10.441 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:10.441 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:10.441 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:10.441 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.441 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:10.441 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:10.441 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:10.441 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:10.442 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:10.442 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.442 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.442 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:10.442 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:10.442 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:10.442 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:10.442 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:10.442 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.443 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:10.443 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:10.443 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.443 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:10.443 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:10.443 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:10.443 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:10.443 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:10.443 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:10.443 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.444 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:10.444 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.444 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:10.444 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.444 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:10.444 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:10.444 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.444 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:10.444 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:10.444 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:10.445 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:10.445 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:10.445 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:10.445 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:10.445 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:10.445 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:10.445 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:10.445 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:10.445 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:10.445 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:10.445 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:10.446 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:10.446 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.446 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:10.446 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:10.446 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:10.446 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:10.446 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:10.446 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:10.446 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:10.446 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:10.446 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:10.447 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:10.447 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:10.447 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.447 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.447 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:10.447 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:10.447 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:10.447 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:10.447 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:10.447 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:10.447 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:10.448 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:10.448 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:10.448 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:10.448 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:10.448 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:10.448 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:10.448 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:10.448 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:10.448 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:10.448 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:10.449 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:10.449 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:10.449 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:10.449 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:10.449 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:10.449 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:10.449 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:10.449 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:10.449 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:10.449 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:10.450 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:10.450 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:10.450 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:10.450 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:10.450 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.450 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:10.450 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.450 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:10.450 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:10.450 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.451 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:10.451 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:10.451 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:10.451 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:10.451 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:10.451 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.451 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:10.451 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:10.451 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.451 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:10.451 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:10.452 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:10.452 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.452 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.452 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:10.452 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:10.452 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:10.452 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:10.452 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:10.452 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.452 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.452 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:10.453 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:10.453 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:10.453 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.453 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:10.453 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.453 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:10.453 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.453 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:10.453 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.453 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:10.454 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.454 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:10.454 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:10.454 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:10.454 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:10.454 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.454 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:10.455 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:10.455 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:10.455 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:10.455 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:10.455 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:10.455 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:10.455 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:10.455 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:10.455 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:10.455 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:10.455 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:10.456 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:10.456 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:10.456 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:10.456 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:10.456 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:10.456 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:10.456 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:10.456 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:10.456 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:10.456 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:10.457 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:10.457 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:10.457 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:10.457 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:10.457 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:10.457 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:10.457 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:10.457 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:10.457 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:10.457 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:10.458 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:10.458 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:10.458 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:10.458 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:10.458 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:10.458 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:10.458 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:10.458 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:10.458 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:10.458 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:10.459 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:10.459 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.459 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:10.459 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:10.459 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.459 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:10.459 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:10.459 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:10.459 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:10.459 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:10.460 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:10.460 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:10.460 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:10.460 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:10.460 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:10.460 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:10.460 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:10.460 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:10.460 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:10.460 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:10.460 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.461 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:10.461 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:10.461 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:10.461 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:10.461 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:10.461 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:10.461 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:10.461 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:10.461 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:10.461 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:10.461 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:10.461 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.462 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.462 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:10.462 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:10.462 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:10.462 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:10.462 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:10.462 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.462 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.462 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:10.462 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:10.463 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:10.463 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:10.463 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:10.463 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.463 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:10.463 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:10.463 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:10.463 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:10.463 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:10.463 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:10.463 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.464 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:10.464 INFO:teuthology.orchestra.run.smithi012.stdout:_______________ ERROR at teardown of test_lifecycle_id_too_long ________________ 2023-10-05T12:49:10.464 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.464 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:10.464 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.464 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:10.464 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:10.464 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.464 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:10.464 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:10.464 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:10.465 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:10.465 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:10.465 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.465 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:10.465 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:10.465 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.465 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:10.465 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:10.465 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:10.465 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.465 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.466 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:10.466 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:10.466 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:10.466 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:10.466 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:10.466 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.466 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:10.466 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:10.466 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.466 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:10.467 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:10.467 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:10.467 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:10.467 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:10.467 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:10.467 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:10.467 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.467 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:10.467 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:10.467 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:10.468 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:10.468 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:10.468 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:10.468 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:10.468 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:10.468 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:10.468 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.468 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:10.468 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:10.468 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:10.469 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:10.469 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.469 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:10.469 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:10.469 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:10.469 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:10.469 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.469 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:10.469 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:10.469 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:10.469 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:10.470 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:10.470 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.470 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.470 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:10.470 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:10.470 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:10.470 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:10.470 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:10.470 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.471 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:10.471 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:10.471 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.471 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:10.471 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:10.471 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:10.471 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:10.471 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:10.471 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:10.471 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.472 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:10.472 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.472 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:10.472 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.472 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:10.472 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:10.472 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.472 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:10.472 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:10.472 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:10.473 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:10.473 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:10.473 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:10.473 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:10.473 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:10.473 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:10.473 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:10.473 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:10.473 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:10.473 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:10.474 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:10.474 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:10.474 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.474 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:10.474 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:10.474 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:10.474 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:10.474 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:10.474 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:10.474 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:10.475 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:10.475 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:10.475 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:10.475 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:10.475 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.475 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.475 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:10.475 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:10.475 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:10.475 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:10.476 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:10.476 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:10.476 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:10.476 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:10.476 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:10.476 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:10.476 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:10.476 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:10.476 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:10.476 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:10.477 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:10.477 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:10.477 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:10.477 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:10.477 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:10.477 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:10.477 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:10.477 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:10.477 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:10.477 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:10.477 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:10.478 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:10.478 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:10.478 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:10.478 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:10.478 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:10.478 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:10.478 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.478 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:10.478 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.478 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:10.479 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:10.479 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.479 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:10.479 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:10.479 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:10.479 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:10.479 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:10.479 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.479 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:10.479 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:10.480 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.480 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:10.480 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:10.480 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:10.480 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.480 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.480 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:10.480 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:10.480 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:10.480 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:10.481 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:10.481 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.481 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.481 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:10.481 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:10.481 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:10.481 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.481 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:10.481 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.481 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:10.482 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.482 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:10.482 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.482 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:10.482 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.482 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:10.482 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:10.482 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:10.482 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:10.482 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.482 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:10.483 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:10.483 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:10.483 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:10.483 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:10.483 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:10.483 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:10.483 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:10.483 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:10.483 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:10.483 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:10.484 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:10.484 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:10.484 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:10.484 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:10.484 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:10.484 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:10.484 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:10.484 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:10.484 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:10.484 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:10.484 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:10.485 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:10.485 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:10.485 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:10.485 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:10.485 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:10.485 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:10.485 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:10.485 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:10.485 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:10.485 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:10.486 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:10.486 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:10.486 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:10.486 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:10.486 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:10.486 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:10.486 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:10.486 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:10.486 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:10.486 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:10.487 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:10.487 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.487 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:10.487 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:10.487 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.487 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:10.487 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:10.487 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:10.487 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:10.488 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:10.488 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:10.488 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:10.488 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:10.488 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:10.488 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:10.488 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:10.488 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:10.488 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:10.489 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:10.489 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:10.489 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.489 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:10.489 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:10.489 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:10.489 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:10.489 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:10.489 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:10.489 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:10.490 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:10.490 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:10.490 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:10.490 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:10.490 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.490 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.490 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:10.490 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:10.490 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:10.490 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:10.491 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:10.491 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.491 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.491 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:10.491 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:10.491 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:10.491 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:10.491 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:10.491 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.491 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:10.491 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:10.492 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:10.492 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:10.492 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:10.492 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:10.492 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.492 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:10.492 INFO:teuthology.orchestra.run.smithi012.stdout:_________________ ERROR at teardown of test_lifecycle_same_id __________________ 2023-10-05T12:49:10.492 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.492 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:10.492 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.493 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:10.493 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:10.493 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.493 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:10.493 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:10.493 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:10.493 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:10.493 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:10.493 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.493 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:10.494 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:10.494 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.494 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:10.494 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:10.494 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:10.494 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.494 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.494 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:10.494 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:10.495 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:10.495 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:10.495 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:10.495 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.495 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:10.495 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:10.495 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.495 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:10.495 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:10.495 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:10.496 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:10.496 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:10.496 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:10.496 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:10.496 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.496 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:10.496 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:10.496 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:10.496 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:10.496 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:10.497 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:10.497 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:10.497 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:10.497 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:10.497 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.497 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:10.497 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:10.497 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:10.497 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:10.497 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.498 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:10.498 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:10.498 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:10.498 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:10.498 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.498 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:10.498 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:10.498 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:10.498 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:10.498 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:10.499 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.499 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.499 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:10.499 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:10.499 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:10.499 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:10.499 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:10.499 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.499 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:10.499 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:10.500 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.500 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:10.500 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:10.500 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:10.500 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:10.500 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:10.500 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:10.500 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.500 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:10.500 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.501 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:10.501 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.501 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:10.501 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:10.501 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.501 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:10.501 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:10.501 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:10.501 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:10.501 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:10.501 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:10.502 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:10.502 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:10.502 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:10.502 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:10.502 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:10.502 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:10.502 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:10.502 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:10.502 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:10.502 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.503 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:10.503 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:10.503 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:10.503 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:10.503 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:10.503 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:10.503 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:10.503 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:10.503 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:10.503 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:10.504 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:10.504 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.504 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.504 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:10.504 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:10.504 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:10.504 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:10.504 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:10.504 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:10.504 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:10.504 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:10.505 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:10.505 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:10.505 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:10.505 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:10.505 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:10.505 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:10.505 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:10.505 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:10.505 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:10.506 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:10.506 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:10.506 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:10.506 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:10.506 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:10.506 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:10.506 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:10.506 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:10.506 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:10.506 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:10.507 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:10.507 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:10.507 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:10.507 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:10.507 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.507 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:10.507 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.507 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:10.507 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:10.507 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.508 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:10.508 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:10.508 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:10.508 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:10.508 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:10.508 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.508 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:10.508 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:10.508 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.508 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:10.509 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:10.509 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:10.509 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.509 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.509 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:10.509 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:10.509 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:10.509 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:10.509 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:10.509 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.510 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.510 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:10.510 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:10.510 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:10.510 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.510 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:10.510 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.510 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:10.510 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.511 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:10.511 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.511 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:10.511 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.511 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:10.511 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:10.511 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:10.511 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:10.511 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.511 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:10.512 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:10.512 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:10.512 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:10.512 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:10.512 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:10.512 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:10.512 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:10.512 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:10.512 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:10.512 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:10.513 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:10.513 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:10.513 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:10.513 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:10.513 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:10.513 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:10.513 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:10.513 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:10.513 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:10.513 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:10.514 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:10.514 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:10.514 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:10.514 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:10.514 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:10.514 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:10.514 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:10.514 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:10.514 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:10.515 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:10.515 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:10.515 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:10.515 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:10.515 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:10.515 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:10.515 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:10.515 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:10.515 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:10.515 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:10.516 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:10.516 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:10.516 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:10.516 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.516 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:10.516 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:10.516 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.516 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:10.516 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:10.516 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:10.517 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:10.517 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:10.517 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:10.517 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:10.517 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:10.517 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:10.517 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:10.517 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:10.517 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:10.518 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:10.518 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:10.518 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:10.518 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.518 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:10.518 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:10.518 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:10.518 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:10.518 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:10.518 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:10.519 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:10.519 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:10.519 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:10.519 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:10.519 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:10.519 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.519 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.519 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:10.519 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:10.520 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:10.520 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:10.520 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:10.520 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.520 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.520 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:10.520 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:10.520 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:10.520 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:10.520 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:10.521 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.521 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:10.521 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:10.521 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:10.521 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:10.521 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:10.521 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:10.521 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.521 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:10.521 INFO:teuthology.orchestra.run.smithi012.stdout:______________ ERROR at teardown of test_lifecycle_invalid_status ______________ 2023-10-05T12:49:10.522 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.522 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:10.522 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.522 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:10.522 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:10.522 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.522 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:10.522 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:10.522 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:10.523 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:10.523 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:10.523 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.523 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:10.523 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:10.523 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.523 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:10.523 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:10.523 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:10.523 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.524 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.524 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:10.524 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:10.524 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:10.524 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:10.524 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:10.524 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.524 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:10.524 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:10.524 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.525 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:10.525 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:10.525 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:10.525 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:10.525 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:10.525 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:10.525 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:10.525 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.525 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:10.525 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:10.526 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:10.526 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:10.526 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:10.526 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:10.526 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:10.526 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:10.526 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:10.526 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.526 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:10.526 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:10.527 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:10.527 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:10.527 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.527 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:10.527 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:10.527 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:10.527 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:10.527 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.527 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:10.527 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:10.528 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:10.528 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:10.528 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:10.528 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.528 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.528 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:10.528 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:10.528 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:10.528 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:10.528 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:10.528 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.529 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:10.529 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:10.529 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.529 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:10.529 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:10.529 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:10.529 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:10.529 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:10.529 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:10.529 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.529 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:10.530 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.530 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:10.530 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.530 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:10.530 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:10.530 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.530 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:10.530 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:10.530 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:10.530 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:10.530 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:10.531 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:10.531 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:10.531 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:10.531 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:10.531 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:10.531 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:10.531 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:10.531 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:10.531 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:10.531 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:10.531 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.532 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:10.532 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:10.532 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:10.532 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:10.532 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:10.532 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:10.532 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:10.532 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:10.532 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:10.532 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:10.532 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:10.533 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.533 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.533 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:10.533 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:10.533 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:10.533 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:10.533 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:10.533 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:10.533 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:10.533 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:10.533 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:10.534 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:10.534 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:10.534 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:10.534 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:10.534 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:10.534 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:10.534 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:10.534 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:10.534 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:10.535 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:10.535 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:10.535 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:10.535 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:10.535 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:10.535 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:10.535 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:10.535 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:10.535 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:10.535 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:10.535 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:10.536 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:10.536 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:10.536 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.536 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:10.536 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.536 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:10.536 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:10.536 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.536 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:10.536 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:10.536 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:10.537 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:10.537 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:10.537 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.537 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:10.537 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:10.537 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.537 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:10.537 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:10.537 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:10.537 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.538 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.538 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:10.538 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:10.538 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:10.538 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:10.538 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:10.538 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.538 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.538 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:10.538 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:10.539 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:10.539 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.539 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:10.539 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.539 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:10.539 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.539 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:10.539 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.539 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:10.539 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.540 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:10.540 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:10.540 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:10.540 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:10.540 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.540 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:10.540 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:10.540 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:10.540 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:10.541 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:10.541 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:10.541 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:10.541 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:10.541 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:10.541 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:10.541 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:10.541 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:10.541 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:10.542 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:10.542 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:10.542 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:10.542 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:10.542 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:10.542 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:10.542 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:10.542 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:10.542 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:10.542 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:10.543 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:10.543 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:10.543 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:10.543 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:10.543 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:10.543 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:10.543 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:10.543 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:10.543 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:10.543 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:10.543 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:10.544 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:10.544 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:10.544 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:10.544 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:10.544 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:10.544 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:10.544 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:10.544 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:10.544 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:10.545 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.545 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:10.545 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:10.545 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.545 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:10.545 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:10.545 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:10.545 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:10.545 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:10.545 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:10.546 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:10.546 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:10.546 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:10.546 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:10.546 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:10.546 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:10.546 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:10.546 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:10.546 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:10.546 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.547 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:10.547 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:10.547 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:10.547 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:10.547 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:10.547 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:10.547 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:10.547 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:10.547 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:10.547 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:10.548 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:10.548 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.548 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.548 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:10.548 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:10.548 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:10.548 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:10.548 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:10.548 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.548 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.548 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:10.549 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:10.549 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:10.549 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:10.549 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:10.549 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.549 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:10.549 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:10.549 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:10.549 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:10.549 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:10.550 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:10.550 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.550 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:10.550 INFO:teuthology.orchestra.run.smithi012.stdout:_________________ ERROR at teardown of test_lifecycle_set_date _________________ 2023-10-05T12:49:10.550 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.550 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:10.550 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.550 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:10.550 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:10.551 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.551 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:10.551 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:10.551 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:10.551 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:10.551 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:10.551 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.551 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:10.551 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:10.551 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.552 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:10.552 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:10.552 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:10.552 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.552 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.552 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:10.552 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:10.552 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:10.552 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:10.552 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:10.553 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.553 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:10.553 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:10.553 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.553 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:10.553 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:10.553 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:10.553 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:10.553 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:10.553 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:10.554 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:10.554 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.554 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:10.554 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:10.554 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:10.554 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:10.554 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:10.554 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:10.554 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:10.554 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:10.555 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:10.555 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.555 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:10.555 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:10.555 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:10.555 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:10.555 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.555 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:10.555 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:10.555 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:10.556 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:10.556 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.556 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:10.556 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:10.556 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:10.556 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:10.556 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:10.556 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.556 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.556 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:10.556 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:10.557 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:10.557 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:10.557 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:10.557 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.557 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:10.557 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:10.557 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.557 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:10.557 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:10.558 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:10.558 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:10.558 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:10.558 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:10.558 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.558 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:10.558 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.558 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:10.558 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.558 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:10.559 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:10.559 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.559 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:10.559 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:10.559 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:10.559 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:10.559 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:10.559 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:10.559 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:10.559 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:10.560 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:10.560 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:10.560 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:10.560 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:10.560 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:10.560 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:10.560 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:10.560 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.560 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:10.560 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:10.560 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:10.561 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:10.561 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:10.561 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:10.561 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:10.561 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:10.561 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:10.561 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:10.561 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:10.561 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.561 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.561 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:10.562 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:10.562 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:10.562 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:10.562 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:10.562 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:10.562 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:10.562 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:10.562 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:10.562 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:10.562 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:10.563 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:10.563 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:10.563 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:10.563 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:10.563 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:10.563 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:10.563 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:10.563 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:10.563 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:10.564 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:10.564 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:10.564 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:10.564 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:10.564 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:10.564 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:10.564 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:10.564 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:10.564 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:10.564 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:10.564 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:10.565 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.565 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:10.565 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.565 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:10.565 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:10.565 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.565 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:10.565 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:10.565 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:10.565 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:10.565 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:10.566 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.566 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:10.566 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:10.566 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.566 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:10.566 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:10.566 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:10.566 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.566 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.566 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:10.567 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:10.567 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:10.567 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:10.567 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:10.567 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.567 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.567 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:10.567 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:10.567 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:10.567 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.568 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:10.568 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.568 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:10.568 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.568 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:10.568 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.568 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:10.568 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.568 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:10.568 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:10.569 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:10.569 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:10.569 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.569 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:10.569 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:10.569 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:10.569 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:10.569 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:10.569 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:10.569 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:10.570 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:10.570 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:10.570 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:10.570 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:10.570 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:10.570 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:10.570 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:10.570 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:10.570 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:10.570 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:10.571 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:10.571 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:10.571 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:10.571 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:10.571 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:10.571 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:10.571 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:10.571 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:10.571 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:10.571 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:10.571 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:10.572 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:10.572 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:10.572 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:10.572 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:10.572 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:10.572 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:10.572 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:10.572 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:10.572 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:10.572 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:10.573 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:10.573 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:10.573 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:10.573 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:10.573 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:10.573 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.573 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:10.574 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:10.574 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.574 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:10.574 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:10.574 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:10.574 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:10.574 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:10.574 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:10.574 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:10.574 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:10.575 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:10.575 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:10.575 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:10.575 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:10.575 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:10.575 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:10.575 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:10.575 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.575 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:10.575 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:10.576 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:10.576 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:10.576 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:10.576 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:10.576 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:10.576 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:10.576 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:10.576 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:10.576 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:10.576 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.577 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.577 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:10.577 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:10.577 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:10.577 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:10.577 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:10.577 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.577 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.577 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:10.577 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:10.578 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:10.578 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:10.578 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:10.578 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.578 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:10.578 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:10.578 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:10.578 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:10.578 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:10.578 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:10.579 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.579 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:10.579 INFO:teuthology.orchestra.run.smithi012.stdout:_____________ ERROR at teardown of test_lifecycle_set_invalid_date _____________ 2023-10-05T12:49:10.579 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.579 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:10.579 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.579 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:10.579 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:10.579 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.579 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:10.580 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:10.580 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:10.580 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:10.580 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:10.580 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.580 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:10.580 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:10.580 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.580 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:10.580 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:10.581 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:10.581 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.581 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.581 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:10.581 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:10.581 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:10.581 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:10.581 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:10.581 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.581 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:10.581 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:10.582 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.582 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:10.582 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:10.582 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:10.582 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:10.582 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:10.582 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:10.582 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:10.582 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.582 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:10.583 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:10.583 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:10.583 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:10.583 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:10.583 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:10.583 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:10.583 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:10.583 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:10.583 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.583 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:10.584 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:10.584 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:10.584 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:10.584 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.584 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:10.584 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:10.584 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:10.584 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:10.584 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.584 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:10.585 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:10.585 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:10.585 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:10.585 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:10.585 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.585 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.585 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:10.585 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:10.585 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:10.585 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:10.586 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:10.586 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.586 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:10.586 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:10.586 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.586 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:10.586 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:10.586 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:10.586 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:10.586 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:10.587 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:10.587 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.587 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:10.587 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.587 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:10.587 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.587 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:10.587 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:10.587 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.587 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:10.588 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:10.588 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:10.588 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:10.588 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:10.588 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:10.588 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:10.588 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:10.588 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:10.588 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:10.588 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:10.589 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:10.589 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:10.589 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:10.589 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:10.589 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.589 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:10.589 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:10.589 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:10.589 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:10.589 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:10.590 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:10.590 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:10.590 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:10.590 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:10.590 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:10.590 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:10.590 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.590 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.590 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:10.590 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:10.591 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:10.591 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:10.591 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:10.591 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:10.591 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:10.591 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:10.591 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:10.591 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:10.591 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:10.591 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:10.592 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:10.592 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:10.592 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:10.592 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:10.592 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:10.592 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:10.592 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:10.592 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:10.592 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:10.592 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:10.593 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:10.593 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:10.593 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:10.593 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:10.593 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:10.593 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:10.593 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:10.593 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:10.593 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:10.593 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.593 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:10.594 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.594 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:10.594 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:10.594 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.594 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:10.594 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:10.594 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:10.594 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:10.594 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:10.594 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.595 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:10.595 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:10.595 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.595 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:10.595 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:10.595 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:10.595 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.595 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.595 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:10.595 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:10.596 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:10.596 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:10.596 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:10.596 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.596 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.596 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:10.596 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:10.596 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:10.596 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.596 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:10.596 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.597 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:10.597 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.597 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:10.597 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.597 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:10.597 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.597 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:10.597 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:10.597 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:10.597 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:10.597 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.598 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:10.598 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:10.598 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:10.598 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:10.598 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:10.598 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:10.598 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:10.598 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:10.598 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:10.599 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:10.599 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:10.599 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:10.599 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:10.599 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:10.599 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:10.599 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:10.599 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:10.599 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:10.599 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:10.599 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:10.600 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:10.600 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:10.600 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:10.600 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:10.600 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:10.600 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:10.600 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:10.600 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:10.600 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:10.600 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:10.600 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:10.601 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:10.601 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:10.601 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:10.601 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:10.601 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:10.601 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:10.601 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:10.601 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:10.601 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:10.601 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:10.602 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:10.602 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:10.602 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.602 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:10.602 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:10.602 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.602 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:10.602 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:10.602 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:10.603 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:10.603 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:10.603 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:10.603 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:10.603 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:10.603 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:10.603 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:10.603 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:10.603 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:10.603 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:10.604 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:10.604 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:10.604 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.604 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:10.604 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:10.604 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:10.604 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:10.604 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:10.604 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:10.604 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:10.605 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:10.605 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:10.605 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:10.605 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:10.605 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.605 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.605 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:10.605 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:10.605 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:10.605 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:10.606 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:10.606 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.606 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.606 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:10.606 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:10.606 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:10.606 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:10.606 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:10.606 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.607 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:10.607 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:10.607 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:10.607 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:10.607 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:10.607 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:10.607 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.607 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:10.607 INFO:teuthology.orchestra.run.smithi012.stdout:______________ ERROR at teardown of test_lifecycle_set_noncurrent ______________ 2023-10-05T12:49:10.607 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.608 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:10.608 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.608 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:10.608 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:10.608 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.608 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:10.608 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:10.608 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:10.609 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:10.609 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:10.609 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.609 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:10.609 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:10.609 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.609 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:10.609 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:10.609 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:10.609 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.609 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.610 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:10.610 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:10.610 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:10.610 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:10.610 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:10.610 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.610 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:10.610 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:10.610 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.610 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:10.611 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:10.611 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:10.611 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:10.611 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:10.611 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:10.611 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:10.611 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.611 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:10.611 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:10.612 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:10.612 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:10.612 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:10.612 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:10.612 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:10.612 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:10.612 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:10.612 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.612 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:10.612 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:10.612 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:10.613 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:10.613 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.613 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:10.613 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:10.613 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:10.613 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:10.613 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.613 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:10.613 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:10.613 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:10.614 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:10.614 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:10.614 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.614 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.614 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:10.614 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:10.614 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:10.614 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:10.614 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:10.614 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.615 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:10.615 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:10.615 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.615 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:10.615 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:10.615 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:10.615 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:10.615 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:10.615 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:10.615 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.616 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:10.616 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.616 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:10.616 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.616 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:10.616 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:10.616 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.616 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:10.616 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:10.616 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:10.617 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:10.617 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:10.617 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:10.617 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:10.617 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:10.617 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:10.617 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:10.617 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:10.617 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:10.617 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:10.617 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:10.618 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:10.618 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.618 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:10.618 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:10.618 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:10.618 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:10.618 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:10.618 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:10.618 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:10.619 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:10.619 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:10.619 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:10.619 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:10.619 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.619 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.619 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:10.619 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:10.619 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:10.619 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:10.620 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:10.620 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:10.620 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:10.620 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:10.620 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:10.620 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:10.620 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:10.620 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:10.620 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:10.620 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:10.621 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:10.621 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:10.621 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:10.621 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:10.621 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:10.621 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:10.621 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:10.621 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:10.621 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:10.621 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:10.621 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:10.622 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:10.622 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:10.622 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:10.622 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:10.622 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:10.622 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:10.622 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.622 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:10.622 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.622 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:10.623 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:10.623 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.623 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:10.623 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:10.623 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:10.623 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:10.623 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:10.623 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.623 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:10.623 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:10.624 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.624 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:10.624 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:10.624 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:10.624 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.624 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.624 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:10.624 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:10.624 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:10.624 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:10.624 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:10.625 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.625 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.625 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:10.625 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:10.625 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:10.625 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.625 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:10.625 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.625 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:10.625 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.626 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:10.626 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.626 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:10.626 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.626 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:10.626 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:10.626 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:10.626 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:10.626 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.626 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:10.626 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:10.627 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:10.627 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:10.627 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:10.627 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:10.627 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:10.627 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:10.627 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:10.627 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:10.627 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:10.628 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:10.628 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:10.628 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:10.628 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:10.628 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:10.628 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:10.628 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:10.628 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:10.628 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:10.629 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:10.629 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:10.629 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:10.629 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:10.629 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:10.629 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:10.629 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:10.629 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:10.629 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:10.629 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:10.630 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:10.630 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:10.630 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:10.630 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:10.630 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:10.630 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:10.630 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:10.630 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:10.630 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:10.630 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:10.631 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:10.631 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:10.631 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:10.631 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.631 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:10.631 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:10.631 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.631 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:10.631 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:10.631 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:10.632 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:10.632 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:10.632 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:10.632 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:10.632 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:10.632 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:10.632 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:10.632 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:10.632 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:10.632 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:10.632 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:10.633 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:10.633 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.633 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:10.633 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:10.633 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:10.633 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:10.633 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:10.633 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:10.633 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:10.633 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:10.634 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:10.634 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:10.634 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:10.634 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.634 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.634 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:10.634 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:10.634 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:10.634 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:10.634 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:10.635 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.635 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.635 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:10.635 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:10.635 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:10.635 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:10.635 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:10.635 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.635 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:10.635 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:10.636 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:10.636 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:10.636 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:10.636 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:10.636 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.636 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:10.636 INFO:teuthology.orchestra.run.smithi012.stdout:_____________ ERROR at teardown of test_lifecycle_set_deletemarker _____________ 2023-10-05T12:49:10.636 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.636 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:10.636 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.636 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:10.637 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:10.637 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.637 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:10.637 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:10.637 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:10.637 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:10.637 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:10.637 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.637 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:10.637 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:10.638 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.638 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:10.638 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:10.638 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:10.638 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.638 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.638 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:10.638 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:10.638 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:10.638 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:10.639 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:10.639 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.639 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:10.639 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:10.639 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.639 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:10.639 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:10.639 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:10.639 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:10.639 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:10.640 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:10.640 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:10.640 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.640 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:10.640 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:10.640 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:10.640 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:10.640 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:10.640 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:10.640 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:10.640 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:10.641 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:10.641 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.641 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:10.641 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:10.641 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:10.641 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:10.641 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.641 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:10.641 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:10.641 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:10.642 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:10.642 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.642 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:10.642 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:10.642 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:10.642 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:10.642 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:10.642 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.642 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.642 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:10.643 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:10.643 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:10.643 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:10.643 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:10.643 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.643 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:10.643 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:10.643 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.643 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:10.643 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:10.644 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:10.644 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:10.644 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:10.644 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:10.644 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.644 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:10.644 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.644 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:10.644 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.644 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:10.645 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:10.645 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.645 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:10.645 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:10.645 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:10.645 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:10.645 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:10.645 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:10.645 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:10.645 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:10.646 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:10.646 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:10.646 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:10.646 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:10.646 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:10.646 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:10.646 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:10.646 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.646 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:10.646 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:10.647 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:10.647 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:10.647 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:10.647 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:10.647 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:10.647 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:10.647 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:10.647 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:10.647 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:10.647 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.648 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.648 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:10.648 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:10.648 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:10.648 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:10.648 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:10.648 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:10.648 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:10.648 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:10.648 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:10.649 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:10.649 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:10.649 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:10.649 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:10.649 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:10.649 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:10.649 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:10.649 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:10.649 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:10.649 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:10.650 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:10.650 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:10.650 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:10.650 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:10.650 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:10.650 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:10.650 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:10.650 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:10.650 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:10.650 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:10.651 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:10.651 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:10.651 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.651 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:10.651 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.651 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:10.651 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:10.651 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.651 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:10.651 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:10.651 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:10.652 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:10.652 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:10.652 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.652 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:10.652 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:10.652 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.652 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:10.652 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:10.652 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:10.653 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.653 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.653 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:10.653 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:10.653 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:10.653 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:10.653 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:10.653 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.653 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.653 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:10.653 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:10.654 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:10.654 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.654 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:10.654 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.654 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:10.654 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.654 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:10.654 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.655 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:10.655 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.655 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:10.655 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:10.655 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:10.655 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:10.655 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.655 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:10.655 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:10.655 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:10.655 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:10.656 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:10.656 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:10.656 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:10.656 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:10.656 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:10.656 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:10.656 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:10.656 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:10.656 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:10.656 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:10.657 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:10.657 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:10.657 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:10.657 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:10.657 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:10.657 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:10.657 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:10.657 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:10.657 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:10.657 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:10.657 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:10.658 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:10.658 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:10.658 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:10.658 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:10.658 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:10.658 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:10.658 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:10.658 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:10.658 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:10.658 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:10.659 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:10.659 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:10.659 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:10.659 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:10.659 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:10.659 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:10.659 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:10.659 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:10.659 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.659 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:10.660 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:10.660 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.660 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:10.660 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:10.660 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:10.660 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:10.660 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:10.660 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:10.660 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:10.661 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:10.661 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:10.661 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:10.661 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:10.661 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:10.661 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:10.661 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:10.661 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:10.661 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.661 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:10.661 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:10.662 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:10.662 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:10.662 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:10.662 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:10.662 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:10.662 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:10.662 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:10.662 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:10.662 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:10.662 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.662 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.663 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:10.663 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:10.663 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:10.663 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:10.663 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:10.663 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.663 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.663 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:10.663 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:10.663 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:10.664 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:10.664 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:10.664 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.664 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:10.664 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:10.664 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:10.664 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:10.664 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:10.664 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:10.664 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.665 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:10.665 INFO:teuthology.orchestra.run.smithi012.stdout:________________ ERROR at teardown of test_lifecycle_set_filter ________________ 2023-10-05T12:49:10.665 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.665 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:10.665 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.665 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:10.665 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:10.665 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.665 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:10.665 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:10.666 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:10.666 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:10.666 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:10.666 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.666 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:10.666 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:10.666 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.666 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:10.666 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:10.667 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:10.667 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.667 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.667 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:10.667 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:10.667 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:10.667 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:10.667 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:10.667 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.667 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:10.668 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:10.668 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.668 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:10.668 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:10.668 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:10.668 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:10.668 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:10.668 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:10.668 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:10.669 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.669 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:10.669 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:10.669 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:10.669 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:10.669 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:10.669 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:10.669 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:10.669 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:10.670 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:10.670 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.670 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:10.670 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:10.670 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:10.670 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:10.670 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.670 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:10.670 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:10.670 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:10.671 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:10.671 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.671 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:10.671 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:10.671 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:10.671 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:10.671 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:10.671 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.671 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.671 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:10.672 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:10.672 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:10.672 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:10.672 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:10.672 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.672 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:10.672 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:10.672 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.672 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:10.672 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:10.672 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:10.673 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:10.673 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:10.673 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:10.673 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.673 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:10.673 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.673 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:10.673 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.673 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:10.673 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:10.674 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.674 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:10.674 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:10.674 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:10.674 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:10.674 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:10.674 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:10.674 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:10.674 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:10.674 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:10.675 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:10.675 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:10.675 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:10.675 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:10.675 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:10.675 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:10.675 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.675 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:10.675 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:10.675 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:10.676 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:10.676 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:10.676 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:10.676 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:10.676 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:10.676 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:10.676 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:10.676 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:10.676 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.676 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.676 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:10.677 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:10.677 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:10.677 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:10.677 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:10.677 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:10.677 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:10.677 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:10.677 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:10.677 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:10.677 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:10.678 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:10.678 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:10.678 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:10.678 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:10.678 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:10.678 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:10.678 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:10.678 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:10.679 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:10.679 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:10.679 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:10.679 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:10.679 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:10.679 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:10.679 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:10.679 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:10.679 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:10.679 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:10.679 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:10.680 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:10.680 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.680 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:10.680 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.680 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:10.680 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:10.680 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.680 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:10.680 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:10.680 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:10.680 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:10.681 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:10.681 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.681 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:10.681 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:10.681 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.681 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:10.681 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:10.681 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:10.681 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.681 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.681 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:10.682 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:10.682 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:10.682 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:10.682 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:10.682 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.682 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.682 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:10.682 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:10.682 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:10.682 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.683 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:10.683 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.683 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:10.683 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.683 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:10.683 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.683 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:10.683 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.683 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:10.683 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:10.683 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:10.683 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:10.684 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.684 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:10.684 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:10.684 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:10.684 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:10.684 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:10.684 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:10.684 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:10.684 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:10.684 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:10.684 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:10.685 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:10.685 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:10.685 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:10.685 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:10.685 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:10.685 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:10.685 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:10.685 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:10.685 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:10.685 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:10.686 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:10.686 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:10.686 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:10.686 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:10.686 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:10.686 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:10.686 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:10.686 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:10.686 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:10.686 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:10.687 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:10.687 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:10.687 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:10.687 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:10.687 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:10.687 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:10.687 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:10.687 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:10.687 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:10.687 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:10.687 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:10.688 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:10.688 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:10.688 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.688 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:10.688 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:10.688 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.688 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:10.688 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:10.688 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:10.688 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:10.689 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:10.689 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:10.689 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:10.689 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:10.689 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:10.689 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:10.689 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:10.689 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:10.689 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:10.689 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:10.690 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:10.690 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.690 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:10.690 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:10.690 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:10.690 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:10.690 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:10.690 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:10.690 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:10.691 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:10.691 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:10.691 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:10.691 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:10.691 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.691 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.691 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:10.691 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:10.691 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:10.691 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:10.691 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:10.691 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.692 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.692 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:10.692 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:10.692 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:10.692 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:10.692 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:10.692 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.692 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:10.692 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:10.693 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:10.693 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:10.693 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:10.693 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:10.693 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.693 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:10.693 INFO:teuthology.orchestra.run.smithi012.stdout:_____________ ERROR at teardown of test_lifecycle_set_empty_filter _____________ 2023-10-05T12:49:10.693 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.693 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:10.693 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.694 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:10.694 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:10.694 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.694 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:10.694 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:10.694 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:10.694 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:10.694 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:10.694 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.694 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:10.695 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:10.695 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.695 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:10.695 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:10.695 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:10.695 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.695 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.695 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:10.695 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:10.695 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:10.696 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:10.696 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:10.696 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.696 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:10.696 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:10.696 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.696 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:10.696 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:10.696 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:10.696 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:10.697 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:10.697 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:10.697 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:10.697 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.697 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:10.697 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:10.697 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:10.697 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:10.697 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:10.697 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:10.698 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:10.698 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:10.698 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:10.698 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.698 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:10.698 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:10.698 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:10.698 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:10.698 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.698 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:10.699 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:10.699 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:10.699 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:10.699 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.699 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:10.699 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:10.699 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:10.699 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:10.699 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:10.699 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.700 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.700 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:10.700 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:10.700 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:10.700 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:10.700 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:10.700 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.700 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:10.700 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:10.700 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.701 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:10.701 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:10.701 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:10.701 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:10.701 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:10.701 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:10.701 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.701 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:10.701 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.701 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:10.702 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.702 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:10.702 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:10.702 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.702 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:10.702 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:10.702 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:10.702 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:10.702 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:10.702 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:10.702 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:10.703 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:10.703 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:10.703 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:10.703 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:10.703 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:10.703 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:10.703 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:10.703 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:10.703 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.703 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:10.704 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:10.704 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:10.704 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:10.704 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:10.704 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:10.704 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:10.704 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:10.704 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:10.704 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:10.704 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:10.704 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.705 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.705 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:10.705 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:10.705 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:10.705 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:10.705 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:10.705 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:10.705 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:10.705 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:10.705 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:10.705 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:10.706 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:10.706 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:10.706 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:10.706 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:10.706 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:10.706 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:10.706 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:10.706 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:10.706 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:10.706 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:10.706 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:10.707 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:10.707 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:10.707 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:10.707 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:10.707 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:10.707 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:10.707 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:10.707 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:10.707 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:10.707 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:10.707 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.708 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:10.708 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.708 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:10.708 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:10.708 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.708 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:10.708 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:10.708 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:10.708 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:10.708 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:10.709 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.709 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:10.709 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:10.709 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.709 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:10.709 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:10.709 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:10.709 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.709 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.709 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:10.709 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:10.709 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:10.710 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:10.710 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:10.710 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.710 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.710 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:10.710 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:10.710 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:10.710 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.710 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:10.710 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.711 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:10.711 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.711 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:10.711 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.711 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:10.711 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.711 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:10.711 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:10.711 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:10.711 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:10.711 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.712 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:10.712 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:10.712 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:10.712 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:10.712 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:10.712 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:10.712 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:10.712 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:10.712 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:10.713 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:10.713 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:10.713 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:10.713 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:10.713 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:10.713 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:10.713 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:10.713 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:10.713 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:10.713 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:10.713 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:10.714 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:10.714 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:10.714 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:10.714 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:10.714 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:10.714 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:10.714 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:10.714 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:10.714 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:10.714 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:10.715 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:10.715 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:10.715 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:10.715 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:10.715 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:10.715 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:10.715 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:10.715 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:10.715 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:10.715 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:10.715 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:10.715 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:10.716 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:10.716 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.716 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:10.716 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:10.716 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.716 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:10.716 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:10.716 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:10.716 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:10.716 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:10.716 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:10.717 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:10.717 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:10.717 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:10.717 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:10.717 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:10.717 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:10.717 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:10.717 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:10.717 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:10.717 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.717 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:10.718 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:10.718 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:10.718 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:10.718 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:10.718 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:10.718 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:10.718 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:10.718 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:10.718 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:10.718 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:10.719 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.719 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.719 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:10.719 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:10.719 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:10.719 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:10.719 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:10.719 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.719 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.719 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:10.719 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:10.720 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:10.720 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:10.720 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:10.720 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.720 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:10.720 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:10.720 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:10.720 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:10.720 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:10.720 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:10.721 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.721 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:10.721 INFO:teuthology.orchestra.run.smithi012.stdout:______________ ERROR at teardown of test_lifecycle_set_multipart _______________ 2023-10-05T12:49:10.721 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.721 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:10.721 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.721 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:10.721 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:10.721 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.721 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:10.721 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:10.722 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:10.722 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:10.722 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:10.722 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.722 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:10.722 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:10.722 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.722 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:10.722 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:10.722 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:10.723 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.723 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.723 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:10.723 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:10.723 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:10.723 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:10.723 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:10.723 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.723 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:10.723 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:10.723 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.724 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:10.724 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:10.724 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:10.724 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:10.724 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:10.724 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:10.724 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:10.724 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.724 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:10.724 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:10.724 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:10.725 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:10.725 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:10.725 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:10.725 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:10.725 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:10.725 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:10.725 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.725 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:10.725 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:10.725 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:10.725 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:10.726 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.726 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:10.726 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:10.726 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:10.726 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:10.726 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.726 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:10.726 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:10.726 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:10.726 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:10.726 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:10.727 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.727 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.727 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:10.727 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:10.727 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:10.727 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:10.727 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:10.727 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.727 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:10.727 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:10.727 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.728 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:10.728 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:10.728 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:10.728 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:10.728 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:10.728 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:10.728 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.728 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:10.728 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.729 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:10.729 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.729 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:10.729 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:10.729 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.729 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:10.729 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:10.729 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:10.729 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:10.729 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:10.730 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:10.730 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:10.730 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:10.730 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:10.730 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:10.730 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:10.730 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:10.730 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:10.730 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:10.730 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:10.731 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.731 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:10.731 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:10.731 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:10.731 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:10.731 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:10.731 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:10.731 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:10.731 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:10.731 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:10.731 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:10.732 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:10.732 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.732 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.732 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:10.732 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:10.732 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:10.732 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:10.732 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:10.732 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:10.732 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:10.732 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:10.733 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:10.733 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:10.733 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:10.733 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:10.733 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:10.733 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:10.733 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:10.733 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:10.733 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:10.733 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:10.734 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:10.734 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:10.734 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:10.734 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:10.734 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:10.734 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:10.734 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:10.734 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:10.734 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:10.734 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:10.734 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:10.735 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:10.735 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:10.735 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.735 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:10.735 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.735 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:10.735 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:10.735 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.735 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:10.735 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:10.735 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:10.736 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:10.736 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:10.736 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.736 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:10.736 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:10.736 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.736 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:10.736 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:10.736 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:10.736 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.736 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.737 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:10.737 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:10.737 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:10.737 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:10.737 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:10.737 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.737 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.737 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:10.737 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:10.737 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:10.737 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.738 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:10.738 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.738 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:10.738 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.738 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:10.738 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.738 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:10.738 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.738 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:10.739 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:10.739 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:10.739 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:10.739 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.739 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:10.739 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:10.739 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:10.739 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:10.739 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:10.739 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:10.740 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:10.740 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:10.740 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:10.740 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:10.740 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:10.740 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:10.740 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:10.740 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:10.740 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:10.740 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:10.740 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:10.740 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:10.741 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:10.741 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:10.741 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:10.741 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:10.741 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:10.741 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:10.741 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:10.741 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:10.741 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:10.741 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:10.742 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:10.742 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:10.742 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:10.742 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:10.742 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:10.742 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:10.742 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:10.742 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:10.742 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:10.743 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:10.743 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:10.743 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:10.743 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:10.743 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:10.743 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:10.743 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.743 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:10.743 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:10.743 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.743 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:10.743 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:10.744 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:10.744 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:10.744 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:10.744 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:10.744 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:10.744 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:10.744 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:10.744 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:10.745 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:10.745 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:10.745 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:10.745 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:10.745 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:10.745 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.745 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:10.745 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:10.745 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:10.745 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:10.745 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:10.746 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:10.746 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:10.746 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:10.746 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:10.746 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:10.746 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:10.746 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.746 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.746 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:10.746 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:10.747 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:10.747 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:10.747 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:10.747 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.747 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.747 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:10.747 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:10.747 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:10.747 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:10.747 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:10.747 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.747 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:10.748 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:10.748 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:10.748 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:10.748 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:10.748 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:10.748 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.748 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:10.748 INFO:teuthology.orchestra.run.smithi012.stdout:_______ ERROR at teardown of test_lifecycle_transition_set_invalid_date ________ 2023-10-05T12:49:10.748 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.748 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:10.749 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.749 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:10.749 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:10.749 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.749 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:10.749 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:10.749 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:10.749 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:10.749 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:10.749 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.750 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:10.750 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:10.750 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.750 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:10.750 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:10.750 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:10.750 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.750 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.750 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:10.750 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:10.751 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:10.751 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:10.751 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:10.751 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.751 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:10.751 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:10.751 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.751 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:10.751 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:10.751 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:10.751 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:10.752 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:10.752 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:10.752 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:10.752 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.752 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:10.752 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:10.752 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:10.752 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:10.752 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:10.752 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:10.752 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:10.753 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:10.753 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:10.753 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.753 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:10.753 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:10.753 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:10.753 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:10.753 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.753 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:10.753 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:10.753 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:10.754 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:10.754 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.754 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:10.754 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:10.754 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:10.754 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:10.754 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:10.754 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.754 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.754 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:10.755 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:10.755 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:10.755 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:10.755 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:10.755 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.755 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:10.755 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:10.755 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.755 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:10.755 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:10.755 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:10.755 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:10.756 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:10.756 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:10.756 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.756 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:10.756 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.756 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:10.756 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.756 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:10.756 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:10.756 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.757 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:10.757 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:10.757 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:10.757 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:10.757 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:10.757 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:10.757 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:10.757 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:10.757 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:10.757 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:10.757 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:10.758 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:10.758 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:10.758 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:10.758 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:10.758 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.758 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:10.758 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:10.758 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:10.758 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:10.759 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:10.759 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:10.759 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:10.759 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:10.759 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:10.759 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:10.759 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:10.759 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.759 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.759 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:10.759 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:10.760 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:10.760 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:10.760 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:10.760 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:10.760 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:10.760 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:10.760 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:10.760 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:10.760 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:10.760 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:10.760 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:10.761 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:10.761 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:10.761 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:10.761 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:10.761 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:10.761 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:10.761 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:10.761 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:10.761 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:10.762 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:10.762 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:10.762 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:10.762 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:10.762 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:10.762 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:10.762 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:10.762 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:10.762 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:10.762 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.762 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:10.763 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.763 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:10.763 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:10.763 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.763 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:10.763 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:10.763 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:10.763 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:10.763 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:10.763 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.763 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:10.764 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:10.764 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.764 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:10.764 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:10.764 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:10.764 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.764 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.764 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:10.764 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:10.764 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:10.764 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:10.765 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:10.765 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.765 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.765 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:10.765 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:10.765 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:10.765 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.765 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:10.765 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.765 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:10.765 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.765 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:10.766 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.766 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:10.766 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.766 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:10.766 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:10.766 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:10.766 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:10.766 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.766 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:10.766 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:10.767 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:10.767 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:10.767 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:10.767 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:10.767 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:10.767 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:10.767 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:10.767 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:10.767 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:10.767 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:10.767 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:10.767 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:10.768 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:10.768 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:10.768 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:10.768 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:10.768 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:10.768 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:10.768 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:10.768 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:10.768 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:10.768 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:10.769 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:10.769 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:10.769 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:10.769 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:10.769 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:10.769 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:10.769 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:10.769 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:10.769 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:10.769 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:10.769 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:10.770 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:10.770 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:10.770 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:10.770 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:10.770 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:10.770 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:10.770 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:10.770 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:10.770 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.770 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:10.771 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:10.771 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.771 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:10.771 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:10.771 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:10.771 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:10.771 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:10.771 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:10.771 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:10.771 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:10.771 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:10.772 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:10.772 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:10.772 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:10.772 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:10.772 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:10.772 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:10.772 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.772 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:10.772 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:10.772 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:10.772 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:10.773 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:10.773 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:10.773 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:10.773 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:10.773 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:10.773 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:10.773 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:10.773 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.773 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.773 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:10.774 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:10.774 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:10.774 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:10.774 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:10.774 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.774 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.774 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:10.774 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:10.774 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:10.774 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:10.774 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:10.775 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.775 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:10.775 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:10.775 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:10.775 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:10.775 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:10.775 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:10.775 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.775 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:10.775 INFO:teuthology.orchestra.run.smithi012.stdout:_______________ ERROR at teardown of test_encrypted_transfer_1b ________________ 2023-10-05T12:49:10.775 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.776 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:10.776 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.776 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:10.776 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:10.776 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.776 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:10.776 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:10.776 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:10.776 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:10.776 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:10.776 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.777 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:10.777 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:10.777 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.777 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:10.777 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:10.777 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:10.777 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.777 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.777 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:10.777 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:10.778 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:10.778 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:10.778 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:10.778 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.778 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:10.778 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:10.778 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.778 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:10.778 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:10.779 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:10.779 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:10.779 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:10.779 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:10.779 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:10.779 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.779 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:10.779 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:10.779 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:10.779 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:10.780 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:10.780 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:10.780 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:10.780 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:10.780 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:10.780 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.780 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:10.780 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:10.780 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:10.780 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:10.781 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.781 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:10.781 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:10.781 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:10.781 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:10.781 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.781 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:10.781 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:10.781 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:10.781 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:10.781 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:10.782 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.782 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.782 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:10.782 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:10.782 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:10.782 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:10.782 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:10.782 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.782 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:10.782 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:10.783 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.783 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:10.783 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:10.783 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:10.783 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:10.783 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:10.783 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:10.783 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.783 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:10.783 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.783 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:10.784 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.784 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:10.784 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:10.784 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.784 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:10.784 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:10.784 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:10.784 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:10.784 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:10.784 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:10.784 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:10.785 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:10.785 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:10.785 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:10.785 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:10.785 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:10.785 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:10.785 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:10.785 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:10.785 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.785 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:10.785 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:10.786 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:10.786 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:10.786 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:10.786 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:10.786 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:10.786 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:10.786 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:10.786 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:10.786 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:10.786 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.787 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.787 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:10.787 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:10.787 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:10.787 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:10.787 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:10.787 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:10.787 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:10.787 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:10.787 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:10.787 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:10.788 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:10.788 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:10.788 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:10.788 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:10.788 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:10.788 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:10.788 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:10.788 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:10.788 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:10.789 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:10.789 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:10.789 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:10.789 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:10.789 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:10.789 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:10.789 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:10.789 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:10.789 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:10.789 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:10.790 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:10.790 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:10.790 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.790 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:10.790 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.790 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:10.790 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:10.790 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.790 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:10.790 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:10.791 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:10.791 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:10.791 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:10.791 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.791 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:10.791 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:10.791 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.791 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:10.791 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:10.791 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:10.791 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.792 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.792 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:10.792 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:10.792 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:10.792 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:10.792 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:10.792 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.792 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.792 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:10.792 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:10.793 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:10.793 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.793 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:10.793 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.793 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:10.793 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.793 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:10.793 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.793 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:10.793 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.794 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:10.794 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:10.794 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:10.794 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:10.794 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.794 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:10.794 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:10.794 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:10.794 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:10.794 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:10.795 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:10.795 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:10.795 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:10.795 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:10.795 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:10.795 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:10.795 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:10.795 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:10.795 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:10.796 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:10.796 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:10.796 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:10.796 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:10.796 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:10.796 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:10.796 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:10.796 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:10.796 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:10.796 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:10.797 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:10.797 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:10.797 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:10.797 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:10.797 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:10.797 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:10.797 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:10.797 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:10.797 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:10.797 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:10.797 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:10.798 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:10.798 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:10.798 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:10.798 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:10.798 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:10.798 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:10.798 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:10.798 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:10.798 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.798 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:10.799 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:10.799 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.799 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:10.799 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:10.799 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:10.799 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:10.799 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:10.799 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:10.799 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:10.799 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:10.799 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:10.800 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:10.800 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:10.800 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:10.800 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:10.800 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:10.800 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:10.800 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.800 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:10.800 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:10.800 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:10.800 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:10.801 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:10.801 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:10.801 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:10.801 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:10.801 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:10.801 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:10.801 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:10.801 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.801 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.801 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:10.801 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:10.802 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:10.802 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:10.802 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:10.802 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.802 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.802 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:10.802 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:10.802 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:10.802 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:10.802 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:10.803 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.803 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:10.803 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:10.803 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:10.803 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:10.803 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:10.803 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:10.803 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.803 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:10.803 INFO:teuthology.orchestra.run.smithi012.stdout:_______________ ERROR at teardown of test_encrypted_transfer_1kb _______________ 2023-10-05T12:49:10.804 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.804 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:10.804 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.804 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:10.804 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:10.804 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.804 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:10.804 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:10.804 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:10.804 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:10.805 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:10.805 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.805 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:10.805 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:10.805 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.805 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:10.805 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:10.805 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:10.805 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.805 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.805 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:10.806 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:10.806 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:10.806 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:10.806 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:10.806 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.806 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:10.806 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:10.806 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.806 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:10.806 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:10.806 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:10.807 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:10.807 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:10.807 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:10.807 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:10.807 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.807 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:10.807 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:10.807 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:10.807 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:10.807 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:10.807 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:10.808 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:10.808 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:10.808 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:10.808 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.808 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:10.808 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:10.808 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:10.808 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:10.808 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.808 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:10.809 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:10.809 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:10.809 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:10.809 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.809 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:10.809 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:10.809 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:10.809 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:10.809 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:10.809 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.809 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.810 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:10.810 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:10.810 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:10.810 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:10.810 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:10.810 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.810 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:10.810 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:10.810 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.810 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:10.811 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:10.811 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:10.811 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:10.811 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:10.811 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:10.811 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.811 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:10.811 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.811 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:10.811 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.812 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:10.812 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:10.812 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.812 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:10.812 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:10.812 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:10.812 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:10.812 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:10.812 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:10.812 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:10.812 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:10.813 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:10.813 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:10.813 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:10.813 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:10.813 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:10.813 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:10.813 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:10.813 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.813 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:10.813 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:10.814 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:10.814 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:10.814 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:10.814 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:10.814 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:10.814 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:10.814 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:10.814 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:10.814 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:10.814 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.815 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.815 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:10.815 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:10.815 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:10.815 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:10.815 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:10.815 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:10.815 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:10.815 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:10.815 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:10.816 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:10.816 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:10.816 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:10.816 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:10.816 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:10.816 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:10.816 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:10.816 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:10.816 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:10.816 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:10.817 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:10.817 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:10.817 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:10.817 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:10.817 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:10.817 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:10.817 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:10.817 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:10.817 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:10.817 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:10.817 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:10.818 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:10.818 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.818 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:10.818 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.818 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:10.818 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:10.818 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.818 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:10.818 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:10.818 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:10.819 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:10.819 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:10.819 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.819 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:10.819 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:10.819 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.819 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:10.819 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:10.819 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:10.819 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.820 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.820 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:10.820 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:10.820 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:10.820 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:10.820 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:10.820 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.820 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.820 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:10.820 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:10.821 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:10.821 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.821 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:10.821 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.821 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:10.821 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.821 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:10.821 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.821 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:10.821 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.821 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:10.822 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:10.822 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:10.822 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:10.822 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.822 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:10.822 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:10.822 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:10.822 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:10.823 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:10.823 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:10.823 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:10.823 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:10.823 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:10.823 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:10.823 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:10.823 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:10.823 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:10.823 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:10.824 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:10.824 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:10.824 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:10.824 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:10.824 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:10.824 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:10.824 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:10.824 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:10.824 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:10.824 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:10.825 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:10.825 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:10.825 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:10.825 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:10.825 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:10.825 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:10.825 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:10.825 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:10.825 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:10.825 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:10.826 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:10.826 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:10.826 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:10.826 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:10.826 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:10.826 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:10.826 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:10.826 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:10.826 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:10.827 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.827 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:10.827 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:10.827 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.827 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:10.827 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:10.827 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:10.827 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:10.827 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:10.828 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:10.828 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:10.828 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:10.828 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:10.828 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:10.828 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:10.828 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:10.828 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:10.828 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:10.829 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:10.829 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.829 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:10.829 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:10.829 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:10.829 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:10.829 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:10.829 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:10.829 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:10.830 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:10.830 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:10.830 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:10.830 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:10.830 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.830 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.830 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:10.830 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:10.830 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:10.830 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:10.830 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:10.831 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.831 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.831 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:10.831 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:10.831 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:10.831 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:10.831 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:10.831 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.831 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:10.831 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:10.831 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:10.832 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:10.832 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:10.832 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:10.832 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.832 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:10.832 INFO:teuthology.orchestra.run.smithi012.stdout:_______________ ERROR at teardown of test_encrypted_transfer_1MB _______________ 2023-10-05T12:49:10.832 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.832 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:10.832 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.832 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:10.832 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:10.833 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.833 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:10.833 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:10.833 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:10.833 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:10.833 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:10.833 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.833 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:10.833 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:10.833 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.833 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:10.834 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:10.834 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:10.834 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.834 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.834 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:10.834 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:10.834 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:10.834 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:10.834 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:10.834 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.834 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:10.835 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:10.835 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.835 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:10.835 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:10.835 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:10.835 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:10.835 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:10.835 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:10.835 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:10.835 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.835 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:10.836 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:10.836 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:10.836 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:10.836 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:10.836 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:10.836 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:10.836 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:10.836 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:10.836 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.836 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:10.836 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:10.837 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:10.837 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:10.837 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.837 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:10.837 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:10.837 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:10.837 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:10.837 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.837 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:10.837 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:10.837 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:10.838 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:10.838 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:10.838 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.838 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.838 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:10.838 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:10.838 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:10.838 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:10.838 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:10.839 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.839 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:10.839 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:10.839 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.839 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:10.839 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:10.839 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:10.839 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:10.839 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:10.839 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:10.841 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.841 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:10.841 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.841 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:10.841 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.841 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:10.841 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:10.842 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.842 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:10.842 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:10.842 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:10.842 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:10.842 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:10.842 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:10.842 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:10.842 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:10.842 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:10.842 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:10.843 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:10.843 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:10.843 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:10.843 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:10.843 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:10.843 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.843 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:10.843 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:10.843 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:10.843 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:10.843 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:10.843 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:10.843 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:10.844 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:10.844 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:10.844 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:10.844 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:10.844 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.844 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.844 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:10.844 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:10.844 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:10.844 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:10.844 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:10.845 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:10.845 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:10.845 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:10.845 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:10.845 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:10.845 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:10.845 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:10.845 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:10.845 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:10.845 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:10.846 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:10.846 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:10.846 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:10.846 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:10.846 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:10.846 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:10.846 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:10.846 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:10.846 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:10.846 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:10.846 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:10.847 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:10.847 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:10.847 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:10.847 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:10.847 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:10.847 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.847 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:10.847 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.847 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:10.847 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:10.847 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.847 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:10.848 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:10.848 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:10.848 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:10.848 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:10.848 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.848 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:10.848 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:10.848 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.848 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:10.848 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:10.848 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:10.848 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.849 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.849 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:10.849 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:10.849 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:10.849 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:10.849 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:10.849 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.849 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.849 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:10.849 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:10.849 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:10.849 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.850 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:10.850 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.850 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:10.850 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.850 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:10.850 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.850 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:10.850 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.850 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:10.850 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:10.850 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:10.850 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:10.851 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.851 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:10.851 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:10.851 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:10.851 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:10.851 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:10.851 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:10.851 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:10.851 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:10.851 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:10.851 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:10.851 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:10.852 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:10.852 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:10.852 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:10.852 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:10.852 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:10.852 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:10.852 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:10.852 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:10.852 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:10.852 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:10.852 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:10.852 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:10.853 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:10.853 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:10.853 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:10.853 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:10.853 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:10.853 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:10.853 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:10.853 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:10.853 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:10.853 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:10.853 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:10.853 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:10.854 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:10.854 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:10.854 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:10.854 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:10.854 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:10.854 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:10.854 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:10.854 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:10.854 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.854 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:10.854 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:10.855 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.855 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:10.855 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:10.855 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:10.855 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:10.855 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:10.855 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:10.855 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:10.855 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:10.855 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:10.855 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:10.855 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:10.856 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:10.856 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:10.856 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:10.856 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:10.856 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.856 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:10.856 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:10.856 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:10.856 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:10.856 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:10.856 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:10.856 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:10.857 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:10.857 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:10.857 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:10.857 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:10.857 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.857 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.857 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:10.857 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:10.857 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:10.857 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:10.857 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:10.857 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.858 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.858 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:10.858 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:10.858 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:10.858 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:10.858 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:10.858 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.858 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:10.858 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:10.858 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:10.858 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:10.858 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:10.859 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:10.859 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.859 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:10.859 INFO:teuthology.orchestra.run.smithi012.stdout:_______________ ERROR at teardown of test_encrypted_transfer_13b _______________ 2023-10-05T12:49:10.859 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.859 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:10.859 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.859 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:10.859 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:10.859 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.859 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:10.859 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:10.860 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:10.860 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:10.860 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:10.860 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.860 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:10.860 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:10.860 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.860 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:10.860 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:10.860 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:10.860 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.860 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.861 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:10.861 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:10.861 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:10.861 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:10.861 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:10.861 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.861 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:10.861 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:10.861 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.861 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:10.861 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:10.861 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:10.862 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:10.862 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:10.862 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:10.862 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:10.862 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.862 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:10.862 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:10.862 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:10.862 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:10.862 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:10.862 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:10.863 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:10.863 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:10.863 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:10.863 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.863 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:10.863 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:10.863 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:10.863 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:10.863 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.863 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:10.863 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:10.863 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:10.863 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:10.864 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.864 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:10.864 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:10.864 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:10.864 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:10.864 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:10.864 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.864 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.864 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:10.864 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:10.864 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:10.865 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:10.865 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:10.865 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.865 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:10.865 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:10.865 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.865 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:10.865 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:10.865 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:10.865 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:10.865 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:10.865 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:10.866 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.866 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:10.866 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.866 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:10.866 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.866 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:10.866 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:10.866 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.866 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:10.866 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:10.866 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:10.866 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:10.867 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:10.867 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:10.867 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:10.867 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:10.867 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:10.867 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:10.867 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:10.867 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:10.867 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:10.867 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:10.867 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:10.867 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.868 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:10.868 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:10.868 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:10.868 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:10.868 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:10.868 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:10.868 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:10.868 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:10.868 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:10.868 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:10.868 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:10.869 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.869 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.869 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:10.869 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:10.869 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:10.869 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:10.869 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:10.869 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:10.869 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:10.869 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:10.869 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:10.869 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:10.869 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:10.870 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:10.870 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:10.870 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:10.870 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:10.870 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:10.870 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:10.870 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:10.870 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:10.870 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:10.870 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:10.870 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:10.870 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:10.871 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:10.871 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:10.871 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:10.871 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:10.871 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:10.871 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:10.871 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:10.871 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:10.871 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.871 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:10.871 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.871 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:10.871 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:10.872 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.872 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:10.872 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:10.872 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:10.872 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:10.872 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:10.872 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.872 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:10.872 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:10.872 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.872 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:10.872 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:10.872 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:10.873 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.873 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.873 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:10.873 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:10.873 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:10.873 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:10.873 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:10.873 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.873 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.873 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:10.873 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:10.873 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:10.873 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.874 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:10.874 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.874 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:10.874 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.874 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:10.874 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.874 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:10.874 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.874 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:10.874 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:10.874 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:10.874 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:10.875 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.875 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:10.875 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:10.875 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:10.875 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:10.875 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:10.875 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:10.875 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:10.875 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:10.875 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:10.875 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:10.875 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:10.876 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:10.876 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:10.876 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:10.876 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:10.876 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:10.876 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:10.876 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:10.876 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:10.876 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:10.876 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:10.876 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:10.876 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:10.877 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:10.877 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:10.877 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:10.877 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:10.877 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:10.877 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:10.877 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:10.877 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:10.877 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:10.877 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:10.877 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:10.877 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:10.878 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:10.878 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:10.878 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:10.878 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:10.878 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:10.878 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:10.878 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:10.878 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:10.878 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.878 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:10.878 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:10.878 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.879 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:10.879 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:10.879 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:10.879 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:10.879 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:10.879 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:10.879 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:10.879 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:10.879 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:10.879 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:10.879 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:10.879 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:10.880 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:10.880 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:10.880 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:10.880 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.880 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:10.880 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:10.880 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:10.880 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:10.880 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:10.880 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:10.880 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:10.880 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:10.880 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:10.881 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:10.881 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:10.881 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.881 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.881 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:10.881 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:10.881 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:10.881 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:10.881 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:10.881 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.881 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.881 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:10.882 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:10.882 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:10.882 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:10.882 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:10.882 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.882 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:10.882 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:10.882 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:10.882 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:10.882 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:10.882 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:10.882 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.883 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:10.883 INFO:teuthology.orchestra.run.smithi012.stdout:____________ ERROR at teardown of test_encryption_sse_c_method_head ____________ 2023-10-05T12:49:10.883 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.883 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:10.883 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.883 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:10.883 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:10.883 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.883 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:10.883 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:10.883 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:10.883 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:10.884 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:10.884 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.884 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:10.884 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:10.884 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.884 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:10.884 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:10.884 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:10.884 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.884 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.884 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:10.884 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:10.884 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:10.885 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:10.885 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:10.885 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.885 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:10.885 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:10.885 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.885 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:10.885 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:10.885 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:10.885 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:10.885 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:10.885 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:10.885 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:10.886 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.886 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:10.886 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:10.886 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:10.886 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:10.886 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:10.886 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:10.886 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:10.886 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:10.886 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:10.886 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.886 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:10.887 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:10.887 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:10.887 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:10.887 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.887 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:10.887 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:10.887 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:10.887 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:10.887 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.887 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:10.887 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:10.887 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:10.887 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:10.888 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:10.888 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.888 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.888 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:10.888 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:10.888 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:10.888 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:10.888 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:10.888 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.889 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:10.889 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:10.889 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.889 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:10.889 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:10.889 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:10.889 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:10.889 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:10.889 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:10.889 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.890 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:10.890 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.890 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:10.890 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.890 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:10.890 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:10.890 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.890 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:10.890 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:10.890 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:10.891 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:10.891 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:10.891 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:10.891 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:10.891 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:10.891 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:10.891 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:10.891 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:10.891 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:10.891 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:10.891 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:10.892 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:10.892 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.892 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:10.892 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:10.892 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:10.892 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:10.892 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:10.892 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:10.892 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:10.892 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:10.892 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:10.892 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:10.892 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:10.893 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.893 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.893 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:10.893 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:10.893 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:10.893 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:10.893 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:10.893 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:10.893 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:10.893 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:10.893 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:10.894 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:10.894 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:10.894 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:10.894 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:10.894 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:10.894 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:10.894 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:10.894 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:10.894 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:10.894 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:10.894 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:10.895 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:10.895 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:10.895 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:10.895 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:10.895 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:10.895 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:10.895 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:10.895 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:10.895 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:10.895 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:10.895 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:10.895 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.896 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:10.896 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.896 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:10.896 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:10.896 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.896 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:10.896 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:10.896 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:10.896 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:10.896 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:10.896 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.896 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:10.897 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:10.897 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.897 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:10.897 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:10.897 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:10.897 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.897 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.897 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:10.897 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:10.897 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:10.897 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:10.897 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:10.898 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.898 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.898 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:10.898 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:10.898 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:10.898 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.898 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:10.898 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.898 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:10.898 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.898 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:10.898 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.899 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:10.899 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.899 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:10.899 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:10.899 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:10.899 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:10.899 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.899 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:10.899 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:10.899 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:10.899 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:10.899 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:10.900 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:10.900 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:10.900 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:10.900 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:10.900 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:10.900 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:10.900 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:10.900 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:10.900 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:10.900 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:10.900 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:10.900 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:10.900 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:10.901 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:10.901 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:10.901 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:10.901 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:10.901 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:10.901 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:10.901 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:10.901 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:10.901 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:10.901 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:10.901 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:10.902 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:10.902 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:10.902 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:10.902 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:10.902 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:10.902 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:10.902 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:10.902 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:10.902 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:10.902 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:10.902 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:10.902 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:10.902 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:10.903 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:10.903 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.903 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:10.903 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:10.903 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.903 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:10.903 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:10.903 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:10.903 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:10.903 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:10.903 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:10.903 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:10.904 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:10.904 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:10.904 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:10.904 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:10.904 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:10.904 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:10.904 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:10.904 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:10.904 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.904 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:10.904 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:10.904 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:10.904 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:10.905 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:10.905 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:10.905 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:10.905 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:10.905 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:10.905 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:10.905 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:10.905 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.905 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.905 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:10.905 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:10.905 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:10.905 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:10.906 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:10.906 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.906 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.906 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:10.906 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:10.906 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:10.906 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:10.906 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:10.906 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.906 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:10.906 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:10.906 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:10.907 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:10.907 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:10.907 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:10.907 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.907 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:10.907 INFO:teuthology.orchestra.run.smithi012.stdout:______________ ERROR at teardown of test_encryption_sse_c_present ______________ 2023-10-05T12:49:10.907 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.907 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:10.907 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.907 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:10.907 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:10.907 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.907 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:10.908 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:10.908 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:10.908 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:10.908 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:10.908 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.908 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:10.908 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:10.908 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.908 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:10.908 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:10.908 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:10.908 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.909 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.909 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:10.909 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:10.909 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:10.909 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:10.909 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:10.909 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.909 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:10.909 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:10.909 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.909 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:10.909 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:10.910 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:10.910 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:10.910 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:10.910 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:10.910 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:10.910 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.910 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:10.910 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:10.910 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:10.910 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:10.910 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:10.910 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:10.910 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:10.911 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:10.911 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:10.911 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.911 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:10.911 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:10.911 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:10.911 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:10.911 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.911 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:10.911 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:10.911 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:10.911 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:10.911 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.912 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:10.912 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:10.912 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:10.912 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:10.912 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:10.912 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.912 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.912 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:10.912 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:10.912 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:10.912 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:10.912 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:10.913 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.913 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:10.913 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:10.913 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.913 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:10.913 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:10.913 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:10.913 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:10.913 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:10.913 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:10.913 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.913 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:10.913 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.914 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:10.914 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.914 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:10.914 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:10.914 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.914 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:10.914 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:10.914 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:10.914 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:10.914 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:10.914 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:10.914 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:10.915 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:10.915 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:10.915 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:10.915 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:10.915 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:10.915 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:10.915 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:10.915 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:10.915 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.915 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:10.915 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:10.915 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:10.916 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:10.916 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:10.916 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:10.916 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:10.916 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:10.916 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:10.916 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:10.916 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:10.916 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.916 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.916 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:10.916 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:10.917 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:10.917 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:10.917 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:10.917 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:10.917 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:10.917 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:10.917 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:10.917 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:10.917 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:10.917 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:10.917 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:10.917 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:10.917 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:10.918 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:10.918 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:10.918 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:10.918 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:10.918 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:10.918 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:10.918 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:10.918 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:10.918 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:10.918 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:10.919 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:10.919 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:10.919 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:10.919 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:10.919 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:10.919 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:10.919 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.919 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:10.919 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.919 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:10.919 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:10.919 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.920 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:10.920 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:10.920 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:10.920 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:10.920 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:10.920 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.920 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:10.920 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:10.920 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.920 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:10.920 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:10.920 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:10.920 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.921 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.921 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:10.921 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:10.921 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:10.921 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:10.921 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:10.921 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.921 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.921 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:10.921 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:10.921 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:10.921 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.921 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:10.922 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.922 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:10.922 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.922 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:10.922 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.922 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:10.922 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.922 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:10.922 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:10.922 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:10.922 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:10.922 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.922 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:10.923 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:10.923 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:10.923 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:10.923 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:10.923 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:10.923 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:10.923 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:10.923 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:10.923 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:10.923 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:10.923 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:10.923 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:10.923 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:10.924 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:10.924 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:10.924 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:10.924 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:10.924 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:10.924 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:10.924 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:10.924 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:10.924 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:10.924 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:10.924 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:10.924 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:10.925 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:10.925 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:10.925 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:10.925 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:10.925 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:10.925 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:10.925 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:10.925 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:10.925 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:10.925 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:10.925 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:10.925 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:10.925 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:10.926 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:10.926 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:10.926 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:10.926 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:10.926 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.926 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:10.926 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:10.926 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.926 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:10.926 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:10.926 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:10.926 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:10.927 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:10.927 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:10.927 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:10.927 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:10.927 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:10.927 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:10.927 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:10.927 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:10.927 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:10.927 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:10.927 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:10.927 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.928 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:10.928 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:10.928 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:10.928 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:10.928 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:10.928 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:10.928 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:10.928 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:10.928 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:10.928 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:10.928 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:10.929 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.929 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.929 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:10.929 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:10.929 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:10.929 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:10.929 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:10.929 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.929 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.929 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:10.929 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:10.929 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:10.930 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:10.930 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:10.930 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.930 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:10.930 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:10.930 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:10.930 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:10.930 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:10.930 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:10.930 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.930 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:10.930 INFO:teuthology.orchestra.run.smithi012.stdout:_____________ ERROR at teardown of test_encryption_sse_c_other_key _____________ 2023-10-05T12:49:10.931 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.931 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:10.931 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.931 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:10.931 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:10.931 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.931 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:10.931 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:10.931 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:10.931 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:10.931 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:10.931 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.931 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:10.932 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:10.932 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.932 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:10.932 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:10.932 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:10.932 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.932 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.932 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:10.932 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:10.932 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:10.933 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:10.933 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:10.933 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.933 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:10.933 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:10.933 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.933 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:10.933 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:10.933 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:10.933 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:10.933 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:10.933 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:10.934 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:10.934 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.934 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:10.934 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:10.934 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:10.934 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:10.934 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:10.934 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:10.934 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:10.934 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:10.935 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:10.935 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.935 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:10.935 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:10.935 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:10.935 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:10.935 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.935 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:10.935 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:10.935 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:10.935 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:10.935 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.935 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:10.936 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:10.936 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:10.936 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:10.936 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:10.936 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.936 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.936 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:10.936 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:10.936 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:10.936 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:10.936 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:10.936 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.937 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:10.937 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:10.937 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.937 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:10.937 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:10.937 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:10.937 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:10.937 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:10.937 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:10.937 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.937 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:10.937 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.938 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:10.938 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.938 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:10.938 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:10.938 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.938 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:10.938 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:10.938 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:10.938 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:10.938 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:10.938 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:10.939 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:10.939 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:10.939 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:10.939 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:10.939 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:10.939 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:10.939 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:10.939 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:10.939 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:10.939 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.939 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:10.939 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:10.939 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:10.940 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:10.940 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:10.940 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:10.940 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:10.940 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:10.940 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:10.940 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:10.940 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:10.940 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.940 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.940 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:10.941 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:10.941 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:10.941 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:10.941 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:10.941 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:10.941 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:10.941 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:10.941 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:10.941 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:10.941 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:10.941 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:10.941 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:10.941 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:10.941 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:10.942 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:10.942 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:10.942 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:10.942 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:10.942 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:10.942 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:10.942 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:10.942 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:10.942 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:10.942 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:10.942 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:10.942 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:10.943 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:10.943 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:10.943 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:10.943 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:10.943 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.943 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:10.943 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.943 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:10.943 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:10.943 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.943 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:10.943 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:10.943 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:10.944 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:10.944 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:10.944 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.944 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:10.944 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:10.944 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.944 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:10.944 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:10.944 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:10.944 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.944 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.944 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:10.944 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:10.945 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:10.945 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:10.945 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:10.945 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.945 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.945 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:10.945 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:10.945 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:10.945 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.945 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:10.945 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.945 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:10.946 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.946 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:10.946 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.946 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:10.946 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.946 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:10.946 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:10.946 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:10.946 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:10.946 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.946 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:10.946 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:10.947 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:10.947 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:10.947 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:10.947 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:10.947 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:10.947 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:10.947 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:10.947 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:10.947 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:10.947 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:10.947 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:10.948 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:10.948 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:10.948 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:10.948 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:10.948 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:10.948 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:10.948 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:10.948 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:10.948 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:10.948 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:10.948 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:10.948 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:10.949 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:10.949 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:10.949 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:10.949 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:10.949 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:10.949 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:10.949 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:10.949 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:10.949 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:10.949 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:10.949 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:10.950 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:10.950 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:10.950 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:10.950 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:10.950 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:10.950 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:10.950 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:10.950 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.950 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:10.950 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:10.950 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.950 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:10.951 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:10.951 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:10.951 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:10.951 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:10.951 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:10.951 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:10.951 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:10.951 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:10.951 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:10.951 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:10.951 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:10.951 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:10.952 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:10.952 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:10.952 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.952 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:10.952 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:10.952 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:10.952 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:10.952 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:10.952 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:10.952 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:10.952 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:10.952 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:10.953 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:10.953 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:10.953 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.953 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.953 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:10.953 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:10.953 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:10.953 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:10.953 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:10.953 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.953 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.953 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:10.954 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:10.954 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:10.954 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:10.954 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:10.954 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.954 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:10.954 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:10.954 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:10.954 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:10.954 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:10.954 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:10.954 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.955 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:10.955 INFO:teuthology.orchestra.run.smithi012.stdout:____________ ERROR at teardown of test_encryption_sse_c_invalid_md5 ____________ 2023-10-05T12:49:10.955 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.955 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:10.955 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.955 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:10.955 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:10.955 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.955 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:10.955 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:10.955 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:10.955 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:10.956 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:10.956 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.956 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:10.956 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:10.956 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.956 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:10.956 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:10.956 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:10.956 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.956 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.956 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:10.956 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:10.957 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:10.957 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:10.957 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:10.957 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.957 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:10.957 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:10.957 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.957 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:10.957 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:10.957 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:10.957 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:10.958 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:10.958 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:10.958 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:10.958 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.958 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:10.958 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:10.958 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:10.958 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:10.958 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:10.958 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:10.958 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:10.958 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:10.959 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:10.959 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.959 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:10.959 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:10.959 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:10.959 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:10.959 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.959 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:10.959 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:10.959 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:10.959 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:10.959 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.960 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:10.960 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:10.960 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:10.960 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:10.960 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:10.960 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.960 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.960 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:10.960 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:10.960 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:10.960 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:10.960 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:10.961 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.961 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:10.961 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:10.961 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.961 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:10.961 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:10.961 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:10.961 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:10.961 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:10.961 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:10.961 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.961 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:10.961 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.962 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:10.962 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.962 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:10.962 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:10.962 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.962 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:10.962 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:10.962 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:10.962 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:10.962 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:10.963 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:10.963 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:10.963 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:10.963 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:10.963 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:10.963 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:10.963 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:10.963 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:10.963 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:10.963 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:10.963 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.964 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:10.964 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:10.964 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:10.964 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:10.964 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:10.964 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:10.964 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:10.964 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:10.964 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:10.964 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:10.964 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:10.964 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.965 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.965 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:10.965 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:10.965 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:10.965 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:10.965 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:10.965 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:10.965 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:10.965 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:10.965 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:10.965 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:10.965 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:10.966 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:10.966 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:10.966 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:10.966 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:10.966 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:10.966 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:10.966 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:10.966 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:10.966 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:10.966 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:10.966 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:10.966 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:10.967 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:10.967 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:10.967 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:10.967 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:10.967 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:10.967 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:10.967 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:10.967 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:10.967 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.967 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:10.967 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.967 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:10.968 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:10.968 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.968 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:10.968 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:10.968 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:10.968 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:10.968 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:10.968 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.968 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:10.968 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:10.968 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.968 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:10.969 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:10.969 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:10.969 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.969 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.969 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:10.969 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:10.969 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:10.969 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:10.969 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:10.969 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.969 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.969 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:10.970 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:10.970 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:10.970 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.970 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:10.970 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.970 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:10.970 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.970 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:10.970 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.970 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:10.970 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.970 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:10.971 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:10.971 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:10.971 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:10.971 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.971 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:10.971 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:10.971 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:10.971 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:10.971 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:10.971 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:10.971 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:10.971 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:10.972 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:10.972 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:10.972 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:10.972 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:10.972 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:10.972 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:10.972 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:10.972 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:10.972 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:10.972 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:10.972 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:10.972 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:10.973 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:10.973 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:10.973 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:10.973 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:10.973 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:10.973 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:10.973 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:10.973 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:10.973 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:10.973 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:10.973 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:10.973 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:10.973 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:10.974 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:10.974 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:10.974 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:10.974 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:10.974 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:10.974 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:10.974 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:10.974 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:10.974 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:10.974 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:10.974 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.975 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:10.975 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:10.975 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.975 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:10.975 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:10.975 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:10.975 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:10.975 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:10.975 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:10.975 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:10.975 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:10.976 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:10.976 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:10.976 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:10.976 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:10.976 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:10.976 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:10.976 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:10.976 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.976 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:10.976 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:10.976 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:10.976 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:10.977 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:10.977 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:10.977 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:10.977 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:10.977 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:10.977 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:10.977 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:10.977 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.977 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.977 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:10.977 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:10.977 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:10.978 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:10.978 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:10.978 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.978 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.978 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:10.978 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:10.978 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:10.978 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:10.978 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:10.978 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.978 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:10.979 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:10.979 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:10.979 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:10.979 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:10.979 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:10.979 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.979 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:10.979 INFO:teuthology.orchestra.run.smithi012.stdout:______________ ERROR at teardown of test_encryption_sse_c_no_md5 _______________ 2023-10-05T12:49:10.979 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.979 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:10.979 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.979 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:10.980 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:10.980 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.980 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:10.980 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:10.980 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:10.980 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:10.980 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:10.980 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.980 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:10.980 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:10.980 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.980 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:10.981 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:10.981 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:10.981 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.981 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.981 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:10.981 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:10.981 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:10.981 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:10.981 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:10.981 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.981 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:10.981 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:10.982 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.982 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:10.982 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:10.982 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:10.982 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:10.982 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:10.982 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:10.982 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:10.982 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.982 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:10.982 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:10.982 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:10.983 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:10.983 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:10.983 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:10.983 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:10.983 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:10.983 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:10.983 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.983 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:10.983 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:10.983 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:10.983 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:10.983 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.984 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:10.984 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:10.984 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:10.984 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:10.984 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.984 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:10.984 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:10.984 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:10.984 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:10.984 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:10.984 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.984 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.984 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:10.985 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:10.985 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:10.985 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:10.985 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:10.985 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.985 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:10.985 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:10.985 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.985 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:10.985 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:10.985 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:10.985 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:10.986 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:10.986 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:10.986 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.986 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:10.986 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.986 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:10.986 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.986 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:10.986 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:10.986 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.986 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:10.986 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:10.987 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:10.987 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:10.987 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:10.987 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:10.987 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:10.987 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:10.987 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:10.987 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:10.987 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:10.987 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:10.987 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:10.987 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:10.988 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:10.988 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.988 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:10.988 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:10.988 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:10.988 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:10.988 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:10.988 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:10.988 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:10.988 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:10.988 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:10.988 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:10.989 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:10.989 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.989 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.989 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:10.989 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:10.989 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:10.989 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:10.989 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:10.989 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:10.989 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:10.989 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:10.989 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:10.990 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:10.990 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:10.990 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:10.990 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:10.990 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:10.990 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:10.990 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:10.990 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:10.991 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:10.991 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:10.991 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:10.991 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:10.991 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:10.991 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:10.991 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:10.991 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:10.991 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:10.991 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:10.991 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:10.992 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:10.992 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:10.992 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:10.992 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.992 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:10.992 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.992 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:10.992 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:10.992 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.992 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:10.992 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:10.992 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:10.993 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:10.993 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:10.993 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.993 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:10.993 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:10.993 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.993 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:10.993 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:10.993 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:10.993 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.994 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.994 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:10.994 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:10.994 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:10.994 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:10.994 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:10.994 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.994 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.994 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:10.994 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:10.994 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:10.995 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:10.995 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:10.995 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.995 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:10.995 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.995 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:10.995 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.995 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:10.995 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.995 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:10.995 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:10.996 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:10.996 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:10.996 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.996 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:10.996 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:10.996 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:10.996 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:10.996 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:10.996 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:10.996 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:10.996 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:10.996 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:10.996 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:10.997 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:10.997 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:10.997 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:10.997 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:10.997 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:10.997 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:10.997 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:10.997 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:10.997 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:10.997 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:10.997 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:10.997 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:10.998 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:10.998 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:10.998 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:10.998 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:10.998 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:10.998 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:10.998 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:10.998 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:10.998 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:10.998 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:10.998 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:10.999 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:10.999 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:10.999 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:10.999 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:10.999 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:10.999 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:10.999 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:10.999 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:10.999 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:10.999 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:10.999 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:10.999 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:11.000 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:11.000 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.000 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:11.000 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.000 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:11.000 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:11.000 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:11.000 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:11.000 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:11.000 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:11.000 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:11.000 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:11.001 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:11.001 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:11.001 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:11.001 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:11.001 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:11.001 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.001 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:11.001 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:11.001 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:11.001 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:11.001 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:11.001 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:11.001 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:11.002 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:11.002 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:11.002 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:11.002 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:11.002 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.002 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.002 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:11.002 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:11.002 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:11.002 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:11.002 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:11.003 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.003 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.003 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:11.003 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:11.003 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:11.003 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:11.003 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:11.003 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.003 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:11.003 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:11.003 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:11.004 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:11.004 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:11.004 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:11.004 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.004 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:11.004 INFO:teuthology.orchestra.run.smithi012.stdout:______________ ERROR at teardown of test_encryption_sse_c_no_key _______________ 2023-10-05T12:49:11.004 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.004 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:11.004 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.004 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:11.004 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:11.004 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.004 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:11.005 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:11.005 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:11.005 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:11.005 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:11.005 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.005 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:11.005 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:11.005 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.005 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.005 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:11.005 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:11.005 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.005 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.006 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:11.006 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.006 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:11.006 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:11.006 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.006 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.006 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:11.006 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:11.006 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.006 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:11.007 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:11.007 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:11.007 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:11.007 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:11.007 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:11.007 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:11.007 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.007 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:11.007 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:11.007 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:11.007 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:11.008 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:11.008 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:11.008 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:11.008 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:11.008 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:11.008 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.008 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:11.008 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:11.008 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:11.008 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:11.008 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.009 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:11.009 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:11.009 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:11.009 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:11.009 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.009 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.009 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:11.009 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:11.009 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:11.009 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:11.009 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.009 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.010 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:11.010 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:11.010 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:11.010 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.010 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:11.010 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.010 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:11.010 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:11.010 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.010 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:11.010 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:11.010 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:11.011 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:11.011 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:11.011 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:11.011 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.011 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:11.011 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.011 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:11.011 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.011 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:11.011 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:11.011 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.011 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:11.012 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.012 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:11.012 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:11.012 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:11.012 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:11.012 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:11.012 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:11.012 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:11.012 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:11.012 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:11.012 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:11.012 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:11.013 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:11.013 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:11.013 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.013 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:11.013 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:11.013 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:11.013 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:11.013 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:11.013 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:11.013 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:11.013 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:11.013 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:11.014 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:11.014 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:11.014 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.014 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.014 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:11.014 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.014 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:11.014 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:11.014 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:11.014 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:11.014 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:11.014 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:11.015 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:11.015 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:11.015 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:11.015 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:11.015 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:11.015 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:11.015 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:11.015 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:11.015 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:11.015 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:11.015 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:11.015 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:11.016 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:11.016 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:11.016 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:11.016 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:11.016 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:11.016 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:11.016 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:11.016 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:11.016 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:11.016 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:11.016 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.016 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.017 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:11.017 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.017 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:11.017 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:11.017 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.017 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:11.017 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:11.017 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:11.017 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:11.017 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:11.017 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.017 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:11.017 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:11.018 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.018 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.018 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:11.018 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:11.018 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.018 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.018 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:11.018 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:11.018 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:11.018 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:11.018 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:11.018 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.019 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.019 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:11.019 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:11.019 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:11.019 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.019 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:11.019 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.019 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:11.019 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.019 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:11.019 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.019 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:11.020 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.020 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:11.020 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:11.020 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:11.020 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:11.020 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.020 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:11.020 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.020 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:11.020 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:11.020 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:11.020 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:11.021 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:11.021 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:11.021 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:11.021 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:11.021 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:11.021 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:11.021 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:11.021 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:11.021 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:11.021 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:11.022 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:11.022 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:11.022 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:11.022 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:11.022 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:11.022 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:11.022 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:11.022 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:11.022 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:11.022 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:11.022 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:11.022 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:11.023 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:11.023 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:11.023 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:11.023 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:11.023 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:11.023 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:11.023 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:11.023 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:11.023 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:11.023 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:11.023 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:11.023 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:11.024 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:11.024 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:11.024 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.024 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.024 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:11.024 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:11.024 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.024 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:11.024 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.024 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:11.024 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:11.024 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:11.025 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:11.025 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:11.025 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:11.025 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:11.025 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:11.025 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:11.025 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:11.025 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:11.025 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:11.025 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:11.025 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.025 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:11.025 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:11.026 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:11.026 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:11.026 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:11.026 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:11.026 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:11.026 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:11.026 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:11.026 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:11.026 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:11.026 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.026 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.026 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:11.027 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:11.027 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:11.027 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:11.027 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:11.027 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.027 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.027 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:11.027 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:11.027 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:11.027 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:11.027 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:11.027 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.028 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:11.028 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:11.028 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:11.028 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:11.028 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:11.028 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:11.028 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.028 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:11.028 INFO:teuthology.orchestra.run.smithi012.stdout:______________ ERROR at teardown of test_encryption_key_no_sse_c _______________ 2023-10-05T12:49:11.028 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.028 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:11.028 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.029 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:11.029 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:11.029 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.029 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:11.029 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:11.029 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:11.029 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:11.029 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:11.029 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.029 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:11.029 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:11.029 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.030 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.030 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:11.030 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:11.030 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.030 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.030 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:11.030 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.030 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:11.030 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:11.030 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.030 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.030 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:11.031 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:11.031 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.031 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:11.031 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:11.031 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:11.031 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:11.031 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:11.031 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:11.031 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:11.031 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.031 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:11.031 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:11.032 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:11.032 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:11.032 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:11.032 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:11.032 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:11.032 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:11.032 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:11.032 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.032 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:11.032 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:11.032 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:11.032 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:11.032 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.033 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:11.033 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:11.033 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:11.033 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:11.033 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.033 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.033 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:11.033 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:11.033 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:11.033 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:11.033 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.033 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.033 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:11.034 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:11.034 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:11.034 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.034 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:11.034 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.034 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:11.034 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:11.034 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.034 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:11.034 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:11.034 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:11.034 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:11.035 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:11.035 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:11.035 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.035 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:11.035 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.035 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:11.035 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.035 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:11.035 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:11.035 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.036 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:11.036 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.036 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:11.036 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:11.036 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:11.036 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:11.036 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:11.036 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:11.036 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:11.036 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:11.036 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:11.036 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:11.037 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:11.037 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:11.037 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:11.037 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.037 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:11.037 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:11.037 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:11.037 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:11.037 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:11.037 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:11.037 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:11.037 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:11.038 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:11.038 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:11.038 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:11.038 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.038 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.038 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:11.038 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.038 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:11.038 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:11.038 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:11.038 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:11.038 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:11.039 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:11.039 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:11.039 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:11.039 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:11.039 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:11.039 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:11.039 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:11.039 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:11.039 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:11.039 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:11.039 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:11.040 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:11.040 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:11.040 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:11.040 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:11.040 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:11.040 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:11.040 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:11.040 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:11.040 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:11.040 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:11.040 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:11.040 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:11.041 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.041 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.041 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:11.041 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.041 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:11.041 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:11.041 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.041 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:11.041 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:11.041 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:11.041 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:11.041 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:11.042 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.042 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:11.042 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:11.042 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.042 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.042 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:11.042 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:11.042 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.042 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.042 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:11.042 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:11.043 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:11.043 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:11.043 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:11.043 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.045 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.045 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:11.045 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:11.045 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:11.045 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.045 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:11.045 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.045 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:11.045 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.045 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:11.046 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.046 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:11.046 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.046 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:11.046 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:11.046 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:11.046 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:11.046 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.046 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:11.046 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.046 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:11.046 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:11.047 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:11.047 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:11.047 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:11.047 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:11.047 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:11.047 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:11.047 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:11.047 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:11.047 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:11.047 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:11.047 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:11.047 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:11.048 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:11.048 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:11.048 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:11.048 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:11.048 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:11.048 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:11.048 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:11.048 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:11.048 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:11.048 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:11.048 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:11.048 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:11.049 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:11.049 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:11.049 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:11.049 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:11.049 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:11.049 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:11.049 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:11.049 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:11.049 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:11.049 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:11.049 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:11.050 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:11.050 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:11.050 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:11.050 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.050 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.050 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:11.050 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:11.050 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.050 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:11.050 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.050 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:11.050 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:11.051 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:11.051 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:11.051 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:11.051 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:11.051 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:11.051 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:11.051 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:11.051 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:11.051 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:11.051 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:11.051 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:11.052 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.052 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:11.052 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:11.052 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:11.052 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:11.052 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:11.052 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:11.052 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:11.052 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:11.052 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:11.052 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:11.052 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:11.053 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.053 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.053 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:11.053 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:11.053 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:11.053 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:11.053 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:11.053 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.053 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.053 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:11.053 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:11.054 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:11.054 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:11.054 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:11.054 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.054 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:11.054 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:11.054 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:11.054 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:11.054 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:11.054 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:11.054 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.054 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:11.055 INFO:teuthology.orchestra.run.smithi012.stdout:_________ ERROR at teardown of test_encryption_sse_c_multipart_upload __________ 2023-10-05T12:49:11.055 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.055 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:11.055 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.055 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:11.055 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:11.055 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.055 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:11.055 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:11.055 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:11.055 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:11.055 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:11.056 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.056 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:11.056 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:11.056 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.056 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.056 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:11.056 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:11.056 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.056 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.056 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:11.056 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.057 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:11.057 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:11.057 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.057 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.057 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:11.057 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:11.057 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.057 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:11.057 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:11.057 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:11.057 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:11.058 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:11.058 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:11.058 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:11.058 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.058 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:11.058 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:11.058 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:11.058 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:11.058 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:11.058 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:11.058 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:11.059 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:11.059 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:11.059 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.059 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:11.059 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:11.059 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:11.059 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:11.059 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.059 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:11.059 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:11.059 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:11.060 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:11.060 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.060 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.060 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:11.060 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:11.060 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:11.060 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:11.060 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.060 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.060 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:11.060 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:11.060 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:11.061 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.061 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:11.061 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.061 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:11.061 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:11.061 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.061 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:11.061 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:11.061 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:11.061 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:11.061 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:11.062 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:11.062 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.062 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:11.062 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.062 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:11.062 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.062 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:11.062 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:11.062 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.062 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:11.062 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.063 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:11.063 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:11.063 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:11.063 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:11.063 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:11.063 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:11.063 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:11.063 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:11.063 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:11.063 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:11.063 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:11.063 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:11.064 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:11.064 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.064 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:11.064 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:11.064 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:11.064 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:11.064 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:11.064 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:11.064 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:11.064 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:11.064 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:11.064 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:11.065 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:11.065 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.065 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.065 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:11.065 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.065 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:11.065 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:11.065 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:11.065 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:11.065 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:11.065 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:11.065 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:11.066 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:11.066 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:11.066 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:11.066 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:11.066 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:11.066 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:11.066 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:11.066 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:11.066 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:11.066 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:11.067 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:11.067 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:11.067 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:11.067 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:11.067 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:11.067 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:11.067 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:11.067 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:11.067 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:11.067 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:11.067 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:11.067 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.068 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.068 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:11.068 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.068 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:11.068 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:11.068 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.068 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:11.068 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:11.068 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:11.068 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:11.068 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:11.069 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.069 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:11.069 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:11.069 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.069 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.069 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:11.069 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:11.069 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.069 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.069 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:11.069 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:11.070 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:11.070 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:11.070 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:11.070 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.070 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.070 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:11.070 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:11.070 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:11.070 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.070 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:11.070 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.070 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:11.071 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.071 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:11.071 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.071 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:11.071 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.071 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:11.071 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:11.071 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:11.071 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:11.071 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.071 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:11.071 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.072 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:11.072 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:11.072 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:11.072 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:11.072 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:11.072 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:11.072 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:11.072 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:11.072 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:11.072 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:11.072 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:11.072 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:11.072 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:11.073 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:11.073 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:11.073 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:11.073 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:11.073 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:11.073 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:11.073 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:11.073 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:11.073 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:11.073 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:11.073 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:11.073 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:11.074 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:11.074 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:11.074 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:11.074 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:11.074 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:11.074 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:11.074 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:11.074 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:11.074 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:11.074 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:11.074 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:11.075 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:11.075 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:11.075 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:11.075 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:11.075 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.075 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.075 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:11.075 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:11.075 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.075 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:11.075 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.075 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:11.076 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:11.076 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:11.076 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:11.076 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:11.076 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:11.076 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:11.076 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:11.076 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:11.076 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:11.076 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:11.076 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:11.076 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:11.077 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.077 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:11.077 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:11.077 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:11.077 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:11.077 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:11.077 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:11.077 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:11.077 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:11.077 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:11.077 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:11.077 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:11.077 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.078 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.078 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:11.078 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:11.078 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:11.078 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:11.078 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:11.078 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.078 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.078 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:11.078 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:11.078 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:11.079 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:11.079 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:11.079 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.079 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:11.079 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:11.079 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:11.079 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:11.079 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:11.079 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:11.079 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.079 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:11.079 INFO:teuthology.orchestra.run.smithi012.stdout:____ ERROR at teardown of test_encryption_sse_c_unaligned_multipart_upload _____ 2023-10-05T12:49:11.079 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.080 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:11.080 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.080 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:11.080 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:11.080 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.080 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:11.080 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:11.080 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:11.080 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:11.080 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:11.080 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.080 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:11.081 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:11.081 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.081 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.081 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:11.081 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:11.081 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.081 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.081 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:11.081 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.081 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:11.082 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:11.082 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.082 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.082 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:11.082 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:11.082 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.082 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:11.082 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:11.082 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:11.082 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:11.082 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:11.082 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:11.083 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:11.083 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.083 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:11.083 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:11.083 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:11.083 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:11.083 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:11.083 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:11.083 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:11.083 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:11.083 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:11.083 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.084 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:11.084 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:11.084 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:11.084 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:11.084 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.084 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:11.084 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:11.084 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:11.084 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:11.084 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.084 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.084 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:11.085 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:11.085 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:11.085 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:11.085 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.085 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.085 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:11.085 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:11.085 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:11.085 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.085 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:11.085 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.085 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:11.086 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:11.086 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.086 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:11.086 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:11.086 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:11.086 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:11.086 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:11.086 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:11.086 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.086 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:11.087 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.087 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:11.087 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.087 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:11.087 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:11.087 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.087 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:11.087 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.087 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:11.087 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:11.087 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:11.087 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:11.088 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:11.088 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:11.088 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:11.088 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:11.088 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:11.088 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:11.088 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:11.088 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:11.088 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:11.088 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.088 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:11.088 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:11.089 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:11.089 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:11.089 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:11.089 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:11.089 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:11.089 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:11.089 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:11.089 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:11.089 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:11.089 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.089 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.090 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:11.090 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.090 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:11.090 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:11.090 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:11.090 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:11.090 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:11.090 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:11.090 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:11.090 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:11.090 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:11.090 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:11.091 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:11.091 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:11.091 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:11.091 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:11.091 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:11.091 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:11.091 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:11.091 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:11.091 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:11.091 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:11.091 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:11.091 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:11.092 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:11.092 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:11.092 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:11.092 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:11.092 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:11.092 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:11.092 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.092 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.092 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:11.092 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.092 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:11.093 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:11.093 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.093 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:11.093 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:11.093 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:11.093 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:11.093 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:11.093 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.093 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:11.093 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:11.093 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.093 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.093 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:11.093 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:11.094 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.094 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.094 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:11.094 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:11.094 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:11.094 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:11.094 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:11.094 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.094 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.094 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:11.094 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:11.095 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:11.095 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.095 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:11.095 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.095 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:11.095 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.095 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:11.095 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.095 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:11.095 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.095 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:11.095 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:11.096 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:11.096 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:11.096 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.096 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:11.096 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.096 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:11.096 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:11.096 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:11.096 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:11.096 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:11.096 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:11.096 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:11.096 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:11.097 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:11.097 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:11.097 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:11.097 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:11.097 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:11.097 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:11.097 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:11.097 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:11.097 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:11.097 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:11.097 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:11.097 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:11.098 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:11.098 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:11.098 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:11.098 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:11.098 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:11.098 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:11.098 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:11.098 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:11.098 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:11.098 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:11.098 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:11.099 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:11.099 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:11.099 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:11.099 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:11.099 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:11.099 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:11.099 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:11.099 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:11.099 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:11.099 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.099 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.099 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:11.100 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:11.100 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.100 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:11.100 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.100 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:11.100 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:11.100 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:11.100 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:11.100 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:11.100 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:11.100 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:11.100 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:11.100 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:11.101 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:11.101 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:11.101 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:11.101 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:11.101 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.101 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:11.101 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:11.101 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:11.101 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:11.101 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:11.101 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:11.102 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:11.102 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:11.102 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:11.102 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:11.102 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:11.102 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.102 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.102 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:11.102 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:11.103 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:11.103 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:11.103 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:11.103 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.103 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.103 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:11.103 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:11.103 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:11.104 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:11.104 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:11.104 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.104 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:11.104 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:11.104 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:11.104 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:11.104 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:11.104 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:11.104 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.104 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:11.104 INFO:teuthology.orchestra.run.smithi012.stdout:______ ERROR at teardown of test_encryption_sse_c_multipart_bad_download _______ 2023-10-05T12:49:11.105 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.105 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:11.105 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.105 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:11.105 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:11.105 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.105 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:11.105 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:11.105 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:11.105 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:11.105 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:11.106 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.106 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:11.106 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:11.106 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.106 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.106 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:11.106 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:11.106 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.106 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.106 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:11.106 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.106 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:11.107 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:11.107 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.107 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.107 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:11.107 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:11.107 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.107 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:11.107 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:11.107 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:11.107 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:11.107 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:11.107 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:11.108 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:11.108 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.108 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:11.108 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:11.108 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:11.108 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:11.108 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:11.108 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:11.108 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:11.108 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:11.108 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:11.109 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.109 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:11.109 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:11.109 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:11.109 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:11.109 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.109 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:11.109 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:11.109 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:11.109 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:11.109 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.109 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.110 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:11.110 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:11.110 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:11.110 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:11.110 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.110 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.110 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:11.110 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:11.110 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:11.110 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.110 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:11.111 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.111 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:11.111 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:11.111 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.111 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:11.111 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:11.111 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:11.111 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:11.111 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:11.111 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:11.111 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.111 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:11.112 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.112 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:11.112 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.112 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:11.112 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:11.112 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.112 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:11.112 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.112 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:11.112 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:11.113 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:11.113 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:11.113 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:11.113 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:11.113 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:11.113 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:11.113 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:11.113 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:11.113 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:11.113 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:11.113 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:11.113 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.114 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:11.114 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:11.114 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:11.114 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:11.114 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:11.114 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:11.114 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:11.114 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:11.114 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:11.114 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:11.114 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:11.115 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.115 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.115 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:11.115 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.115 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:11.115 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:11.115 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:11.115 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:11.115 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:11.115 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:11.115 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:11.115 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:11.116 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:11.116 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:11.116 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:11.116 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:11.116 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:11.116 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:11.116 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:11.116 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:11.116 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:11.116 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:11.116 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:11.116 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:11.117 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:11.117 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:11.117 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:11.117 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:11.117 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:11.117 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:11.117 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:11.117 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:11.117 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.117 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.117 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:11.117 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.118 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:11.118 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:11.118 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.118 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:11.118 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:11.118 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:11.118 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:11.118 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:11.118 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.118 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:11.118 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:11.119 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.119 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.119 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:11.119 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:11.119 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.119 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.119 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:11.119 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:11.119 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:11.119 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:11.119 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:11.119 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.120 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.120 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:11.120 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:11.120 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:11.120 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.120 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:11.120 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.120 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:11.120 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.120 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:11.120 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.120 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:11.120 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.120 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:11.121 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:11.121 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:11.121 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:11.121 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.121 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:11.121 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.121 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:11.121 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:11.121 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:11.121 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:11.121 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:11.121 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:11.121 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:11.122 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:11.122 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:11.122 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:11.122 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:11.122 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:11.122 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:11.122 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:11.122 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:11.122 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:11.122 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:11.122 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:11.122 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:11.123 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:11.123 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:11.123 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:11.123 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:11.123 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:11.123 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:11.123 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:11.123 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:11.123 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:11.123 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:11.123 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:11.123 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:11.123 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:11.124 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:11.124 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:11.124 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:11.124 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:11.124 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:11.124 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:11.124 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:11.124 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:11.124 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.124 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.124 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:11.124 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:11.124 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.125 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:11.125 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.125 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:11.125 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:11.125 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:11.125 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:11.125 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:11.125 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:11.125 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:11.125 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:11.126 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:11.126 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:11.126 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:11.126 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:11.126 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:11.126 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.126 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:11.126 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:11.126 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:11.126 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:11.126 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:11.127 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:11.127 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:11.127 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:11.127 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:11.127 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:11.127 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:11.127 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.127 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.127 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:11.127 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:11.127 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:11.127 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:11.128 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:11.128 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.128 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.128 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:11.128 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:11.128 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:11.128 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:11.128 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:11.128 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.128 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:11.128 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:11.129 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:11.129 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:11.129 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:11.129 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:11.129 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.129 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:11.129 INFO:teuthology.orchestra.run.smithi012.stdout:_ ERROR at teardown of test_encryption_sse_c_post_object_authenticated_request _ 2023-10-05T12:49:11.129 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.129 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:11.129 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.129 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:11.129 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:11.130 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.130 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:11.130 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:11.130 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:11.130 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:11.130 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:11.130 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.130 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:11.130 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:11.130 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.130 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.130 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:11.131 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:11.131 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.131 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.131 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:11.131 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.131 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:11.131 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:11.131 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.131 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.131 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:11.131 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:11.131 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.131 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:11.132 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:11.132 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:11.132 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:11.132 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:11.132 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:11.132 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:11.132 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.132 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:11.132 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:11.132 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:11.132 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:11.132 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:11.133 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:11.133 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:11.133 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:11.133 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:11.133 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.133 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:11.133 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:11.133 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:11.133 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:11.133 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.133 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:11.133 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:11.133 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:11.134 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:11.134 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.134 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.134 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:11.134 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:11.134 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:11.134 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:11.134 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.134 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.134 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:11.134 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:11.135 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:11.135 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.135 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:11.135 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.135 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:11.135 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:11.135 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.135 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:11.135 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:11.135 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:11.135 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:11.135 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:11.135 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:11.136 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.136 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:11.136 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.136 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:11.136 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.136 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:11.136 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:11.136 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.136 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:11.136 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.136 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:11.136 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:11.137 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:11.137 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:11.137 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:11.137 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:11.137 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:11.137 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:11.137 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:11.137 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:11.137 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:11.137 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:11.137 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:11.137 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.137 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:11.138 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:11.138 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:11.138 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:11.138 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:11.138 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:11.138 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:11.138 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:11.138 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:11.138 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:11.138 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:11.138 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.138 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.139 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:11.139 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.139 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:11.139 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:11.139 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:11.139 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:11.139 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:11.139 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:11.139 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:11.139 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:11.139 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:11.139 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:11.140 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:11.140 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:11.140 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:11.140 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:11.140 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:11.140 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:11.140 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:11.140 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:11.140 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:11.140 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:11.140 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:11.140 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:11.141 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:11.141 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:11.141 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:11.141 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:11.141 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:11.141 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:11.141 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.141 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.141 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:11.141 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.141 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:11.141 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:11.141 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.142 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:11.142 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:11.142 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:11.142 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:11.142 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:11.142 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.142 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:11.142 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:11.142 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.142 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.142 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:11.142 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:11.143 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.143 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.143 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:11.143 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:11.143 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:11.143 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:11.143 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:11.143 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.143 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.143 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:11.143 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:11.143 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:11.143 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.144 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:11.144 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.144 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:11.144 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.144 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:11.144 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.144 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:11.144 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.144 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:11.144 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:11.144 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:11.145 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:11.145 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.145 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:11.145 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.145 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:11.145 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:11.145 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:11.145 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:11.145 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:11.145 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:11.145 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:11.146 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:11.146 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:11.146 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:11.146 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:11.146 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:11.146 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:11.146 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:11.146 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:11.146 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:11.146 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:11.146 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:11.146 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:11.147 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:11.147 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:11.147 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:11.147 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:11.147 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:11.147 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:11.147 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:11.147 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:11.147 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:11.147 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:11.147 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:11.147 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:11.147 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:11.147 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:11.148 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:11.148 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:11.148 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:11.148 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:11.148 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:11.148 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:11.148 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:11.148 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.148 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.148 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:11.148 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:11.149 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.149 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:11.149 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.149 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:11.149 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:11.149 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:11.149 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:11.149 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:11.149 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:11.149 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:11.149 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:11.150 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:11.150 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:11.150 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:11.150 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:11.150 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:11.150 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.150 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:11.150 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:11.150 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:11.150 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:11.150 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:11.150 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:11.151 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:11.151 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:11.151 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:11.151 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:11.151 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:11.151 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.151 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.151 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:11.151 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:11.151 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:11.151 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:11.151 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:11.152 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.152 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.152 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:11.152 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:11.152 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:11.152 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:11.152 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:11.152 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.152 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:11.152 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:11.152 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:11.152 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:11.153 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:11.153 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:11.153 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.153 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:11.153 INFO:teuthology.orchestra.run.smithi012.stdout:________________ ERROR at teardown of test_sse_kms_method_head _________________ 2023-10-05T12:49:11.153 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.153 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:11.153 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.153 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:11.153 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:11.153 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.153 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:11.154 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:11.154 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:11.154 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:11.154 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:11.154 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.154 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:11.154 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:11.154 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.154 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.154 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:11.154 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:11.155 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.155 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.155 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:11.155 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.155 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:11.155 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:11.155 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.155 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.155 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:11.155 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:11.155 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.156 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:11.156 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:11.156 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:11.156 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:11.156 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:11.156 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:11.156 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:11.156 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.156 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:11.156 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:11.156 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:11.157 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:11.157 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:11.157 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:11.157 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:11.157 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:11.157 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:11.157 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.157 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:11.157 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:11.157 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:11.157 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:11.158 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.158 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:11.158 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:11.158 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:11.158 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:11.158 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.158 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.158 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:11.158 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:11.158 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:11.158 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:11.159 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.159 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.159 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:11.159 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:11.159 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:11.159 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.159 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:11.159 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.159 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:11.159 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:11.159 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.159 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:11.159 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:11.160 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:11.160 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:11.160 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:11.160 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:11.160 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.160 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:11.160 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.160 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:11.160 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.160 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:11.160 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:11.161 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.161 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:11.161 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.161 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:11.161 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:11.161 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:11.161 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:11.161 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:11.161 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:11.161 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:11.161 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:11.161 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:11.161 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:11.162 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:11.162 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:11.162 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:11.162 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.162 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:11.162 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:11.162 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:11.162 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:11.162 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:11.162 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:11.162 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:11.163 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:11.163 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:11.163 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:11.163 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:11.163 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.163 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.163 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:11.163 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.163 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:11.163 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:11.163 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:11.163 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:11.164 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:11.164 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:11.164 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:11.164 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:11.164 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:11.164 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:11.164 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:11.164 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:11.164 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:11.164 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:11.164 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:11.164 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:11.165 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:11.165 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:11.165 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:11.165 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:11.165 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:11.165 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:11.165 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:11.165 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:11.165 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:11.165 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:11.165 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:11.165 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:11.166 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.166 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.166 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:11.166 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.166 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:11.166 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:11.166 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.166 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:11.166 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:11.166 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:11.166 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:11.166 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:11.167 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.167 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:11.167 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:11.167 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.167 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.167 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:11.167 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:11.167 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.167 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.167 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:11.167 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:11.167 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:11.168 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:11.168 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:11.168 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.168 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.168 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:11.168 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:11.168 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:11.168 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.168 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:11.168 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.168 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:11.168 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.169 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:11.169 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.169 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:11.169 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.169 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:11.169 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:11.169 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:11.169 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:11.169 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.169 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:11.169 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.169 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:11.170 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:11.170 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:11.170 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:11.170 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:11.170 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:11.170 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:11.170 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:11.170 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:11.170 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:11.170 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:11.171 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:11.171 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:11.171 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:11.171 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:11.171 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:11.171 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:11.171 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:11.171 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:11.171 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:11.171 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:11.171 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:11.171 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:11.172 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:11.172 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:11.172 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:11.172 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:11.172 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:11.172 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:11.172 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:11.172 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:11.172 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:11.172 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:11.172 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:11.173 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:11.173 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:11.173 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:11.173 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:11.173 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:11.173 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:11.173 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.173 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.173 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:11.173 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:11.173 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.173 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:11.174 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.174 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:11.174 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:11.174 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:11.174 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:11.174 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:11.174 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:11.174 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:11.174 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:11.174 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:11.174 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:11.174 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:11.175 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:11.175 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:11.175 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.175 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:11.175 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:11.175 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:11.175 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:11.175 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:11.175 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:11.175 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:11.175 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:11.176 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:11.176 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:11.176 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:11.176 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.176 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.176 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:11.176 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:11.176 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:11.176 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:11.176 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:11.176 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.176 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.177 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:11.177 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:11.177 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:11.177 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:11.177 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:11.177 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.177 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:11.177 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:11.177 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:11.177 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:11.177 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:11.177 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:11.177 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.178 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:11.178 INFO:teuthology.orchestra.run.smithi012.stdout:__________________ ERROR at teardown of test_sse_kms_present ___________________ 2023-10-05T12:49:11.178 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.178 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:11.178 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.178 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:11.178 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:11.178 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.178 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:11.178 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:11.178 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:11.179 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:11.179 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:11.179 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.179 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:11.179 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:11.179 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.179 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.179 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:11.179 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:11.179 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.179 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.179 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:11.180 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.180 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:11.180 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:11.180 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.180 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.180 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:11.180 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:11.180 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.180 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:11.180 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:11.180 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:11.180 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:11.181 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:11.181 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:11.181 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:11.181 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.181 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:11.181 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:11.181 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:11.181 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:11.181 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:11.181 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:11.181 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:11.181 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:11.181 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:11.182 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.182 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:11.182 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:11.182 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:11.182 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:11.182 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.182 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:11.182 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:11.182 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:11.182 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:11.182 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.183 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.183 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:11.183 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:11.183 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:11.183 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:11.183 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.183 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.183 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:11.183 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:11.183 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:11.183 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.183 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:11.183 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.184 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:11.184 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:11.184 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.184 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:11.184 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:11.184 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:11.184 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:11.184 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:11.184 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:11.184 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.184 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:11.184 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.184 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:11.185 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.185 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:11.185 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:11.185 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.185 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:11.185 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.185 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:11.185 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:11.185 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:11.185 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:11.185 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:11.186 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:11.186 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:11.186 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:11.186 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:11.186 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:11.186 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:11.186 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:11.186 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:11.186 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.186 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:11.186 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:11.187 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:11.187 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:11.187 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:11.187 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:11.187 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:11.187 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:11.187 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:11.187 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:11.187 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:11.187 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.187 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.188 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:11.188 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.188 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:11.188 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:11.188 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:11.188 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:11.188 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:11.188 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:11.188 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:11.188 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:11.188 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:11.188 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:11.189 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:11.189 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:11.189 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:11.189 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:11.189 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:11.189 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:11.189 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:11.189 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:11.189 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:11.189 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:11.189 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:11.190 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:11.190 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:11.190 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:11.190 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:11.190 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:11.190 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:11.190 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:11.190 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.190 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.190 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:11.190 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.190 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:11.191 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:11.191 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.191 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:11.191 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:11.191 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:11.191 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:11.191 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:11.191 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.191 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:11.191 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:11.191 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.191 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.192 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:11.192 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:11.192 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.192 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.192 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:11.192 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:11.192 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:11.192 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:11.192 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:11.192 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.192 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.192 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:11.193 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:11.193 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:11.193 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.193 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:11.193 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.193 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:11.193 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.193 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:11.193 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.193 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:11.193 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.193 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:11.193 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:11.194 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:11.194 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:11.194 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.194 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:11.194 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.194 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:11.194 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:11.194 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:11.194 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:11.194 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:11.194 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:11.195 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:11.195 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:11.195 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:11.195 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:11.195 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:11.195 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:11.195 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:11.195 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:11.195 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:11.195 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:11.195 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:11.195 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:11.195 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:11.196 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:11.196 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:11.196 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:11.196 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:11.196 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:11.196 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:11.196 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:11.196 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:11.196 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:11.196 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:11.196 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:11.196 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:11.197 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:11.197 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:11.197 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:11.197 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:11.197 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:11.197 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:11.197 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:11.197 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:11.197 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:11.197 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.197 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.197 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:11.198 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:11.198 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.198 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:11.198 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.198 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:11.198 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:11.198 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:11.198 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:11.198 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:11.198 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:11.198 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:11.198 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:11.199 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:11.199 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:11.199 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:11.199 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:11.199 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:11.199 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.199 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:11.199 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:11.199 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:11.199 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:11.200 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:11.200 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:11.200 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:11.200 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:11.200 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:11.200 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:11.200 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:11.200 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.200 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.200 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:11.200 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:11.200 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:11.200 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:11.201 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:11.201 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.201 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.201 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:11.201 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:11.201 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:11.201 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:11.201 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:11.201 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.201 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:11.201 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:11.201 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:11.202 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:11.202 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:11.202 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:11.202 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.202 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:11.202 INFO:teuthology.orchestra.run.smithi012.stdout:___________________ ERROR at teardown of test_sse_kms_no_key ___________________ 2023-10-05T12:49:11.202 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.202 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:11.202 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.202 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:11.202 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:11.203 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.203 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:11.203 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:11.203 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:11.203 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:11.203 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:11.203 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.203 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:11.203 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:11.203 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.203 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.203 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:11.204 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:11.204 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.204 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.204 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:11.204 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.204 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:11.204 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:11.204 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.204 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.204 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:11.204 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:11.205 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.205 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:11.205 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:11.205 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:11.205 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:11.205 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:11.205 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:11.205 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:11.205 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.205 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:11.205 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:11.206 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:11.206 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:11.206 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:11.206 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:11.206 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:11.206 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:11.206 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:11.206 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.206 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:11.206 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:11.207 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:11.207 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:11.207 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.207 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:11.207 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:11.207 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:11.207 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:11.207 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.207 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.207 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:11.207 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:11.208 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:11.208 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:11.208 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.208 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.208 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:11.208 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:11.208 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:11.208 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.208 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:11.208 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.208 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:11.208 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:11.209 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.209 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:11.209 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:11.209 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:11.209 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:11.209 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:11.209 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:11.209 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.209 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:11.209 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.209 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:11.209 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.210 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:11.210 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:11.210 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.210 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:11.210 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.210 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:11.210 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:11.210 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:11.210 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:11.210 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:11.210 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:11.211 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:11.211 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:11.211 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:11.211 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:11.211 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:11.211 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:11.211 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:11.211 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.211 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:11.211 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:11.211 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:11.211 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:11.212 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:11.212 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:11.212 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:11.212 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:11.212 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:11.212 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:11.212 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:11.212 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.212 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.212 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:11.212 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.213 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:11.213 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:11.213 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:11.213 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:11.213 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:11.213 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:11.213 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:11.213 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:11.213 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:11.213 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:11.213 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:11.214 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:11.214 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:11.214 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:11.214 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:11.214 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:11.214 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:11.214 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:11.214 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:11.214 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:11.214 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:11.215 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:11.215 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:11.215 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:11.215 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:11.215 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:11.215 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:11.215 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:11.215 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.215 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.215 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:11.215 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.215 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:11.216 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:11.216 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.216 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:11.216 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:11.216 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:11.216 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:11.216 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:11.216 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.216 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:11.216 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:11.216 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.216 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.216 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:11.217 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:11.217 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.217 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.217 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:11.217 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:11.217 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:11.217 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:11.217 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:11.217 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.217 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.217 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:11.217 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:11.218 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:11.218 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.218 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:11.218 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.218 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:11.218 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.218 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:11.218 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.218 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:11.218 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.218 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:11.219 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:11.219 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:11.219 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:11.219 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.219 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:11.219 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.219 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:11.219 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:11.219 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:11.219 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:11.219 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:11.219 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:11.220 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:11.220 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:11.220 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:11.220 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:11.220 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:11.220 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:11.220 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:11.220 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:11.220 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:11.220 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:11.220 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:11.220 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:11.220 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:11.221 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:11.221 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:11.221 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:11.221 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:11.221 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:11.221 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:11.221 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:11.221 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:11.221 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:11.221 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:11.221 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:11.221 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:11.222 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:11.222 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:11.222 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:11.222 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:11.222 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:11.222 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:11.222 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:11.222 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:11.222 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:11.222 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.222 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.222 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:11.223 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:11.223 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.223 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:11.223 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.223 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:11.223 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:11.223 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:11.223 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:11.223 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:11.223 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:11.223 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:11.223 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:11.224 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:11.224 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:11.224 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:11.224 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:11.224 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:11.224 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.224 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:11.224 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:11.224 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:11.224 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:11.224 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:11.224 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:11.225 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:11.225 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:11.225 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:11.225 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:11.225 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:11.225 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.225 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.225 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:11.225 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:11.225 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:11.225 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:11.226 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:11.226 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.226 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.226 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:11.226 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:11.226 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:11.226 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:11.226 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:11.226 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.226 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:11.226 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:11.227 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:11.227 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:11.227 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:11.227 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:11.227 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.227 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:11.227 INFO:teuthology.orchestra.run.smithi012.stdout:________________ ERROR at teardown of test_sse_kms_not_declared ________________ 2023-10-05T12:49:11.227 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.227 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:11.227 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.227 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:11.227 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:11.228 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.228 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:11.228 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:11.228 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:11.228 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:11.228 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:11.228 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.228 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:11.228 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:11.228 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.228 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.228 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:11.229 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:11.229 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.229 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.229 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:11.229 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.229 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:11.229 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:11.229 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.229 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.229 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:11.229 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:11.230 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.230 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:11.230 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:11.230 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:11.230 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:11.230 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:11.230 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:11.230 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:11.230 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.230 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:11.230 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:11.230 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:11.231 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:11.231 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:11.231 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:11.231 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:11.231 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:11.231 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:11.231 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.231 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:11.231 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:11.231 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:11.231 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:11.231 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.232 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:11.232 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:11.232 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:11.232 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:11.232 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.232 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.232 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:11.232 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:11.232 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:11.232 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:11.232 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.232 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.232 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:11.233 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:11.233 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:11.233 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.233 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:11.233 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.233 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:11.233 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:11.233 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.233 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:11.233 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:11.233 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:11.233 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:11.233 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:11.233 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:11.234 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.234 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:11.234 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.234 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:11.234 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.234 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:11.234 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:11.234 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.234 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:11.234 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.234 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:11.234 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:11.235 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:11.235 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:11.235 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:11.235 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:11.235 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:11.235 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:11.235 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:11.235 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:11.235 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:11.235 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:11.235 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:11.235 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.236 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:11.236 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:11.236 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:11.236 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:11.236 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:11.236 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:11.236 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:11.236 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:11.236 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:11.236 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:11.236 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:11.237 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.237 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.237 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:11.237 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.237 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:11.237 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:11.237 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:11.237 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:11.237 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:11.237 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:11.237 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:11.238 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:11.238 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:11.238 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:11.238 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:11.238 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:11.238 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:11.238 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:11.238 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:11.238 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:11.238 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:11.238 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:11.239 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:11.239 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:11.239 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:11.239 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:11.239 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:11.239 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:11.239 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:11.239 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:11.239 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:11.239 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:11.239 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.239 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.240 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:11.240 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.240 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:11.240 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:11.240 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.240 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:11.240 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:11.240 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:11.240 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:11.240 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:11.240 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.241 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:11.241 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:11.241 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.241 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.241 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:11.241 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:11.241 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.241 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.241 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:11.241 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:11.241 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:11.241 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:11.242 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:11.242 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.242 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.242 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:11.242 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:11.242 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:11.242 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.242 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:11.242 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.242 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:11.242 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.242 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:11.243 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.243 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:11.243 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.243 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:11.243 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:11.243 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:11.243 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:11.243 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.243 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:11.243 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.243 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:11.244 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:11.244 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:11.244 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:11.244 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:11.244 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:11.244 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:11.244 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:11.244 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:11.244 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:11.244 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:11.244 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:11.244 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:11.245 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:11.245 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:11.245 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:11.245 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:11.245 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:11.245 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:11.245 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:11.245 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:11.245 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:11.245 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:11.245 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:11.245 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:11.246 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:11.246 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:11.246 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:11.246 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:11.246 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:11.246 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:11.246 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:11.246 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:11.246 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:11.246 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:11.246 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:11.247 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:11.247 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:11.247 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:11.247 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:11.247 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.247 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.247 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:11.247 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:11.247 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.247 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:11.247 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.249 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:11.249 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:11.249 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:11.249 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:11.249 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:11.249 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:11.249 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:11.249 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:11.249 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:11.250 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:11.250 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:11.250 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:11.250 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:11.250 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.250 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:11.250 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:11.250 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:11.250 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:11.250 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:11.250 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:11.251 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:11.251 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:11.251 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:11.251 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:11.251 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:11.251 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.251 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.251 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:11.251 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:11.251 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:11.251 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:11.251 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:11.251 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.252 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.252 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:11.252 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:11.252 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:11.252 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:11.252 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:11.252 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.252 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:11.252 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:11.252 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:11.252 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:11.252 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:11.253 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:11.253 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.253 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:11.253 INFO:teuthology.orchestra.run.smithi012.stdout:______________ ERROR at teardown of test_sse_kms_multipart_upload ______________ 2023-10-05T12:49:11.253 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.253 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:11.253 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.253 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:11.253 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:11.253 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.253 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:11.253 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:11.253 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:11.254 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:11.254 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:11.254 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.254 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:11.254 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:11.254 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.254 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.254 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:11.254 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:11.254 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.254 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.255 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:11.255 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.255 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:11.255 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:11.255 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.255 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.255 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:11.255 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:11.255 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.255 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:11.255 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:11.255 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:11.256 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:11.256 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:11.256 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:11.256 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:11.256 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.256 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:11.256 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:11.256 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:11.256 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:11.256 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:11.256 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:11.256 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:11.256 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:11.257 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:11.257 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.257 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:11.257 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:11.257 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:11.257 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:11.257 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.257 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:11.257 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:11.257 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:11.257 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:11.258 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.258 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.258 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:11.258 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:11.258 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:11.258 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:11.258 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.258 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.258 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:11.258 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:11.258 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:11.258 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.259 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:11.259 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.259 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:11.259 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:11.259 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.259 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:11.259 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:11.259 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:11.259 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:11.259 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:11.259 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:11.259 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.260 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:11.260 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.260 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:11.260 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.260 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:11.260 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:11.260 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.260 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:11.260 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.260 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:11.260 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:11.261 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:11.261 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:11.261 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:11.261 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:11.261 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:11.261 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:11.261 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:11.261 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:11.261 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:11.261 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:11.261 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:11.261 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.262 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:11.262 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:11.262 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:11.262 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:11.262 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:11.262 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:11.262 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:11.262 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:11.262 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:11.262 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:11.262 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:11.263 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.263 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.263 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:11.263 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.263 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:11.263 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:11.263 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:11.263 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:11.263 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:11.263 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:11.263 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:11.263 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:11.264 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:11.264 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:11.264 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:11.264 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:11.264 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:11.264 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:11.264 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:11.264 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:11.264 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:11.264 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:11.264 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:11.264 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:11.265 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:11.265 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:11.265 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:11.265 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:11.265 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:11.265 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:11.265 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:11.265 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:11.265 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.265 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.265 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:11.265 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.266 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:11.266 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:11.266 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.266 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:11.266 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:11.266 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:11.266 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:11.266 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:11.266 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.266 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:11.266 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:11.266 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.267 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.267 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:11.267 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:11.267 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.267 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.267 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:11.267 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:11.267 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:11.267 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:11.267 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:11.267 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.267 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.268 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:11.268 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:11.268 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:11.268 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.268 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:11.268 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.268 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:11.268 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.268 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:11.268 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.268 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:11.269 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.269 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:11.269 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:11.269 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:11.269 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:11.269 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.269 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:11.269 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.269 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:11.269 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:11.269 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:11.269 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:11.270 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:11.270 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:11.270 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:11.270 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:11.270 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:11.270 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:11.270 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:11.270 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:11.270 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:11.270 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:11.270 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:11.271 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:11.271 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:11.271 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:11.271 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:11.271 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:11.271 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:11.271 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:11.271 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:11.271 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:11.271 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:11.271 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:11.271 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:11.272 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:11.272 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:11.272 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:11.272 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:11.272 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:11.272 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:11.272 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:11.272 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:11.272 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:11.272 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:11.272 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:11.272 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:11.273 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:11.273 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.273 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.273 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:11.273 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:11.273 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.273 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:11.273 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.273 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:11.273 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:11.273 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:11.273 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:11.273 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:11.274 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:11.274 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:11.274 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:11.274 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:11.274 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:11.274 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:11.274 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:11.274 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:11.274 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.274 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:11.275 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:11.275 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:11.275 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:11.275 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:11.275 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:11.275 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:11.275 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:11.275 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:11.275 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:11.275 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:11.275 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.275 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.276 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:11.276 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:11.276 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:11.276 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:11.276 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:11.276 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.276 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.276 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:11.276 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:11.276 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:11.276 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:11.276 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:11.277 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.277 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:11.277 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:11.277 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:11.277 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:11.277 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:11.277 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:11.277 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.277 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:11.277 INFO:teuthology.orchestra.run.smithi012.stdout:_________ ERROR at teardown of test_sse_kms_multipart_invalid_chunks_1 _________ 2023-10-05T12:49:11.277 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.277 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:11.277 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.278 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:11.278 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:11.278 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.278 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:11.278 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:11.278 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:11.278 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:11.278 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:11.278 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.278 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:11.278 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:11.279 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.279 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.279 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:11.279 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:11.279 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.279 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.279 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:11.279 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.279 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:11.279 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:11.279 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.279 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.279 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:11.280 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:11.280 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.280 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:11.280 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:11.280 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:11.280 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:11.280 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:11.280 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:11.280 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:11.280 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.280 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:11.280 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:11.281 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:11.281 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:11.281 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:11.281 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:11.281 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:11.281 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:11.281 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:11.281 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.281 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:11.281 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:11.281 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:11.281 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:11.282 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.282 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:11.282 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:11.282 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:11.282 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:11.282 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.282 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.282 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:11.282 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:11.282 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:11.282 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:11.283 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.283 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.283 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:11.283 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:11.283 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:11.283 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.283 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:11.283 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.283 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:11.283 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:11.283 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.283 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:11.284 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:11.284 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:11.284 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:11.284 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:11.284 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:11.284 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.284 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:11.284 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.284 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:11.284 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.284 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:11.284 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:11.285 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.285 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:11.285 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.285 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:11.285 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:11.285 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:11.285 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:11.285 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:11.285 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:11.285 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:11.285 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:11.285 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:11.285 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:11.286 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:11.286 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:11.286 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:11.286 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.286 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:11.286 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:11.286 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:11.286 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:11.286 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:11.286 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:11.286 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:11.286 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:11.287 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:11.287 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:11.287 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:11.287 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.287 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.287 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:11.287 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.287 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:11.287 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:11.287 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:11.287 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:11.287 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:11.288 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:11.288 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:11.288 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:11.288 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:11.288 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:11.288 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:11.288 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:11.288 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:11.288 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:11.288 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:11.288 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:11.288 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:11.289 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:11.289 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:11.289 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:11.289 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:11.289 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:11.289 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:11.289 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:11.289 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:11.289 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:11.289 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:11.289 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:11.290 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.290 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.290 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:11.290 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.290 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:11.290 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:11.290 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.290 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:11.290 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:11.290 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:11.291 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:11.291 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:11.291 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.291 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:11.291 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:11.291 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.291 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.291 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:11.291 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:11.291 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.291 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.292 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:11.292 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:11.292 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:11.292 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:11.339 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:11.339 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.339 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.340 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:11.340 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:11.340 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:11.340 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.340 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:11.340 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.340 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:11.340 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.340 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:11.340 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.340 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:11.341 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.341 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:11.341 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:11.341 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:11.341 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:11.341 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.341 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:11.341 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.341 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:11.341 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:11.341 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:11.341 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:11.342 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:11.342 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:11.342 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:11.342 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:11.342 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:11.342 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:11.342 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:11.342 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:11.342 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:11.342 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:11.343 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:11.343 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:11.343 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:11.343 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:11.343 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:11.343 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:11.343 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:11.343 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:11.343 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:11.343 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:11.343 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:11.344 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:11.344 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:11.344 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:11.344 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:11.344 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:11.344 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:11.344 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:11.344 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:11.344 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:11.344 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:11.344 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:11.344 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:11.345 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:11.345 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:11.345 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:11.345 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.345 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.345 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:11.345 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:11.345 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.345 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:11.345 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.345 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:11.345 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:11.346 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:11.346 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:11.346 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:11.346 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:11.346 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:11.346 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:11.346 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:11.346 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:11.346 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:11.346 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:11.346 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:11.347 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.347 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:11.347 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:11.347 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:11.347 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:11.347 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:11.347 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:11.347 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:11.347 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:11.347 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:11.347 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:11.347 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:11.348 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.348 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.348 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:11.348 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:11.348 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:11.348 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:11.348 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:11.348 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.348 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.348 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:11.348 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:11.349 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:11.349 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:11.349 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:11.349 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.349 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:11.349 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:11.349 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:11.349 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:11.349 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:11.349 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:11.349 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.350 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:11.350 INFO:teuthology.orchestra.run.smithi012.stdout:_________ ERROR at teardown of test_sse_kms_multipart_invalid_chunks_2 _________ 2023-10-05T12:49:11.350 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.350 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:11.350 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.350 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:11.350 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:11.350 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.350 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:11.350 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:11.350 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:11.351 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:11.351 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:11.351 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.351 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:11.351 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:11.351 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.351 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.351 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:11.351 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:11.351 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.351 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.352 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:11.352 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.352 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:11.352 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:11.352 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.352 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.352 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:11.352 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:11.352 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.353 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:11.353 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:11.353 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:11.353 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:11.353 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:11.353 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:11.353 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:11.353 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.353 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:11.353 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:11.354 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:11.354 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:11.354 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:11.354 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:11.354 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:11.354 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:11.354 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:11.354 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.354 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:11.354 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:11.354 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:11.355 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:11.355 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.355 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:11.355 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:11.355 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:11.355 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:11.355 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.355 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.355 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:11.355 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:11.355 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:11.356 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:11.356 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.356 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.356 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:11.356 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:11.356 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:11.356 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.356 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:11.356 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.356 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:11.356 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:11.356 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.356 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:11.357 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:11.357 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:11.357 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:11.357 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:11.357 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:11.357 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.357 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:11.357 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.357 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:11.357 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.357 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:11.358 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:11.358 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.358 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:11.358 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.358 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:11.358 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:11.358 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:11.358 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:11.358 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:11.358 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:11.359 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:11.359 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:11.359 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:11.359 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:11.359 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:11.359 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:11.359 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:11.359 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.359 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:11.359 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:11.359 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:11.359 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:11.360 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:11.360 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:11.360 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:11.360 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:11.360 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:11.360 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:11.360 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:11.360 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.360 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.360 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:11.360 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.361 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:11.361 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:11.361 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:11.361 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:11.361 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:11.361 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:11.361 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:11.361 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:11.361 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:11.361 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:11.361 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:11.361 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:11.362 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:11.362 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:11.362 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:11.362 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:11.362 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:11.362 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:11.362 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:11.362 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:11.362 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:11.362 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:11.362 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:11.363 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:11.363 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:11.363 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:11.363 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:11.363 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:11.363 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.363 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.363 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:11.363 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.363 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:11.363 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:11.364 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.364 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:11.364 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:11.364 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:11.364 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:11.364 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:11.364 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.364 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:11.364 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:11.364 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.364 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.365 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:11.365 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:11.365 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.365 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.365 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:11.365 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:11.365 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:11.365 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:11.365 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:11.365 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.365 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.365 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:11.366 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:11.366 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:11.366 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.366 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:11.366 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.366 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:11.366 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.366 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:11.366 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.366 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:11.366 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.367 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:11.367 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:11.367 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:11.367 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:11.367 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.367 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:11.367 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.367 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:11.367 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:11.367 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:11.367 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:11.367 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:11.368 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:11.368 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:11.368 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:11.368 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:11.368 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:11.368 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:11.368 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:11.368 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:11.368 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:11.368 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:11.369 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:11.369 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:11.369 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:11.369 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:11.369 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:11.369 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:11.369 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:11.369 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:11.369 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:11.369 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:11.369 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:11.370 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:11.370 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:11.370 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:11.370 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:11.370 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:11.370 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:11.370 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:11.370 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:11.370 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:11.370 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:11.370 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:11.370 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:11.371 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:11.371 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:11.371 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.371 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.371 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:11.371 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:11.371 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.371 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:11.371 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.371 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:11.371 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:11.372 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:11.372 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:11.372 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:11.372 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:11.372 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:11.372 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:11.372 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:11.372 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:11.372 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:11.372 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:11.372 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:11.372 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.373 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:11.373 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:11.373 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:11.373 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:11.373 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:11.373 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:11.373 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:11.373 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:11.373 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:11.373 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:11.373 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:11.373 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.374 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.374 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:11.374 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:11.374 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:11.374 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:11.374 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:11.374 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.374 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.374 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:11.374 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:11.374 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:11.374 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:11.375 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:11.375 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.375 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:11.375 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:11.375 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:11.375 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:11.375 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:11.375 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:11.375 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.375 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:11.375 INFO:teuthology.orchestra.run.smithi012.stdout:_____ ERROR at teardown of test_sse_kms_post_object_authenticated_request ______ 2023-10-05T12:49:11.376 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.376 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:11.376 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.376 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:11.376 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:11.376 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.376 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:11.376 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:11.376 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:11.376 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:11.376 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:11.376 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.377 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:11.377 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:11.377 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.377 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.377 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:11.377 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:11.377 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.377 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.377 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:11.377 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.377 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:11.377 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:11.377 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.378 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.378 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:11.378 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:11.378 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.378 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:11.378 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:11.378 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:11.378 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:11.378 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:11.378 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:11.378 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:11.379 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.379 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:11.379 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:11.379 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:11.379 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:11.379 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:11.379 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:11.379 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:11.379 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:11.379 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:11.379 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.379 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:11.380 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:11.380 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:11.380 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:11.380 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.380 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:11.380 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:11.380 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:11.380 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:11.380 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.380 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.380 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:11.380 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:11.381 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:11.381 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:11.381 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.381 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.381 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:11.381 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:11.381 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:11.381 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.381 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:11.381 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.381 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:11.381 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:11.381 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.382 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:11.382 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:11.382 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:11.382 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:11.382 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:11.382 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:11.382 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.382 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:11.382 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.382 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:11.382 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.382 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:11.383 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:11.383 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.383 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:11.383 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.383 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:11.383 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:11.383 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:11.383 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:11.383 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:11.383 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:11.383 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:11.384 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:11.384 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:11.384 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:11.384 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:11.384 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:11.384 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:11.384 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.384 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:11.384 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:11.384 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:11.384 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:11.384 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:11.384 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:11.385 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:11.385 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:11.385 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:11.385 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:11.385 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:11.385 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.385 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.385 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:11.385 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.385 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:11.385 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:11.385 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:11.385 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:11.386 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:11.386 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:11.386 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:11.386 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:11.386 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:11.386 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:11.386 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:11.386 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:11.386 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:11.386 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:11.386 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:11.387 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:11.387 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:11.387 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:11.387 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:11.387 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:11.387 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:11.387 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:11.387 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:11.387 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:11.387 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:11.387 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:11.387 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:11.387 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:11.388 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.388 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.388 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:11.388 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.388 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:11.388 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:11.388 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.388 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:11.388 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:11.388 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:11.389 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:11.389 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:11.389 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.389 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:11.389 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:11.389 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.389 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.389 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:11.389 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:11.389 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.389 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.390 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:11.390 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:11.390 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:11.390 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:11.390 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:11.390 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.390 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.390 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:11.390 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:11.390 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:11.390 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.390 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:11.391 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.391 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:11.391 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.391 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:11.391 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.391 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:11.391 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.391 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:11.391 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:11.391 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:11.391 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:11.392 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.392 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:11.392 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.392 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:11.392 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:11.392 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:11.392 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:11.392 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:11.392 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:11.392 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:11.392 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:11.392 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:11.393 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:11.393 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:11.393 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:11.393 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:11.393 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:11.393 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:11.393 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:11.393 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:11.393 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:11.393 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:11.393 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:11.393 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:11.394 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:11.394 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:11.394 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:11.394 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:11.394 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:11.394 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:11.394 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:11.394 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:11.394 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:11.394 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:11.394 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:11.394 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:11.395 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:11.395 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:11.395 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:11.395 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:11.395 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:11.395 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:11.395 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:11.395 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.395 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.395 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:11.395 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:11.395 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.396 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:11.396 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.396 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:11.396 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:11.396 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:11.396 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:11.396 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:11.396 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:11.396 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:11.396 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:11.396 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:11.396 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:11.396 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:11.397 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:11.397 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:11.397 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.397 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:11.397 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:11.397 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:11.397 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:11.397 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:11.397 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:11.397 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:11.397 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:11.398 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:11.398 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:11.398 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:11.398 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.398 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.398 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:11.398 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:11.398 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:11.398 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:11.398 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:11.398 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.399 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.399 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:11.399 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:11.399 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:11.399 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:11.399 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:11.399 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.399 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:11.399 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:11.399 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:11.399 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:11.400 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:11.400 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:11.400 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.400 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:11.400 INFO:teuthology.orchestra.run.smithi012.stdout:________________ ERROR at teardown of test_sse_kms_transfer_1b _________________ 2023-10-05T12:49:11.400 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.400 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:11.400 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.400 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:11.400 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:11.400 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.400 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:11.401 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:11.401 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:11.401 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:11.401 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:11.401 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.401 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:11.401 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:11.401 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.401 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.401 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:11.401 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:11.401 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.402 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.402 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:11.402 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.402 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:11.402 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:11.402 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.402 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.402 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:11.402 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:11.402 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.402 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:11.403 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:11.403 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:11.403 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:11.403 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:11.403 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:11.403 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:11.403 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.403 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:11.403 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:11.403 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:11.403 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:11.403 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:11.403 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:11.404 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:11.404 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:11.404 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:11.404 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.404 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:11.404 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:11.404 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:11.404 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:11.404 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.404 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:11.404 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:11.404 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:11.404 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:11.405 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.405 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.405 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:11.405 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:11.405 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:11.405 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:11.405 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.405 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.405 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:11.405 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:11.405 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:11.405 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.406 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:11.406 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.406 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:11.406 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:11.406 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.406 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:11.406 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:11.406 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:11.406 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:11.406 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:11.406 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:11.406 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.407 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:11.407 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.407 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:11.407 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.407 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:11.407 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:11.407 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.407 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:11.407 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.407 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:11.407 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:11.407 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:11.407 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:11.408 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:11.408 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:11.408 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:11.408 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:11.408 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:11.408 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:11.408 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:11.408 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:11.408 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:11.408 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.408 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:11.408 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:11.409 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:11.409 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:11.409 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:11.409 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:11.409 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:11.409 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:11.409 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:11.409 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:11.409 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:11.409 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.409 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.409 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:11.410 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.410 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:11.410 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:11.410 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:11.410 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:11.410 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:11.410 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:11.410 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:11.410 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:11.410 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:11.410 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:11.410 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:11.410 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:11.411 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:11.411 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:11.411 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:11.411 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:11.411 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:11.411 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:11.411 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:11.411 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:11.411 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:11.411 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:11.411 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:11.412 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:11.412 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:11.412 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:11.412 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:11.412 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:11.412 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.412 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.412 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:11.412 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.412 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:11.412 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:11.412 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.413 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:11.413 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:11.413 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:11.413 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:11.413 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:11.413 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.413 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:11.413 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:11.413 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.413 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.413 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:11.413 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:11.414 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.414 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.414 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:11.414 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:11.414 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:11.414 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:11.414 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:11.414 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.414 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.414 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:11.414 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:11.415 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:11.415 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.415 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:11.415 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.415 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:11.415 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.415 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:11.415 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.415 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:11.415 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.415 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:11.415 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:11.416 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:11.416 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:11.416 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.416 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:11.416 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.416 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:11.416 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:11.416 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:11.416 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:11.416 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:11.416 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:11.416 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:11.417 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:11.417 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:11.417 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:11.417 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:11.417 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:11.417 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:11.417 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:11.417 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:11.417 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:11.417 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:11.417 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:11.418 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:11.418 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:11.418 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:11.418 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:11.418 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:11.418 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:11.418 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:11.418 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:11.418 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:11.418 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:11.418 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:11.419 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:11.419 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:11.419 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:11.419 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:11.419 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:11.419 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:11.419 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:11.419 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:11.419 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:11.419 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:11.419 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:11.420 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.420 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.420 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:11.420 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:11.420 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.420 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:11.420 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.420 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:11.420 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:11.420 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:11.420 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:11.420 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:11.421 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:11.421 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:11.421 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:11.421 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:11.421 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:11.421 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:11.421 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:11.421 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:11.421 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.421 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:11.421 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:11.422 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:11.422 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:11.422 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:11.422 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:11.422 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:11.422 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:11.422 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:11.422 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:11.422 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:11.422 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.422 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.422 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:11.423 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:11.423 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:11.423 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:11.423 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:11.423 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.423 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.423 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:11.423 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:11.423 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:11.423 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:11.423 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:11.423 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.424 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:11.424 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:11.424 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:11.424 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:11.424 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:11.424 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:11.424 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.424 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:11.424 INFO:teuthology.orchestra.run.smithi012.stdout:________________ ERROR at teardown of test_sse_kms_transfer_1kb ________________ 2023-10-05T12:49:11.424 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.424 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:11.424 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.424 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:11.425 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:11.425 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.425 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:11.425 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:11.425 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:11.425 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:11.425 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:11.425 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.425 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:11.425 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:11.425 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.425 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.426 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:11.426 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:11.426 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.426 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.426 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:11.426 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.426 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:11.426 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:11.426 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.426 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.426 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:11.426 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:11.427 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.427 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:11.427 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:11.427 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:11.427 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:11.427 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:11.427 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:11.427 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:11.428 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.428 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:11.428 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:11.428 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:11.428 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:11.428 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:11.428 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:11.428 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:11.428 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:11.428 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:11.428 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.429 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:11.429 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:11.429 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:11.429 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:11.429 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.429 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:11.429 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:11.429 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:11.429 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:11.429 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.429 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.430 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:11.430 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:11.430 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:11.430 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:11.430 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.430 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.430 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:11.430 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:11.430 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:11.430 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.430 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:11.431 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.431 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:11.431 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:11.431 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.431 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:11.431 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:11.431 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:11.431 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:11.431 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:11.431 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:11.431 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.432 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:11.432 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.432 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:11.432 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.432 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:11.432 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:11.432 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.432 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:11.432 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.432 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:11.432 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:11.433 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:11.433 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:11.433 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:11.433 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:11.433 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:11.433 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:11.433 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:11.433 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:11.433 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:11.433 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:11.433 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:11.434 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.434 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:11.434 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:11.434 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:11.434 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:11.434 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:11.434 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:11.434 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:11.434 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:11.434 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:11.434 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:11.435 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:11.435 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.435 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.435 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:11.435 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.435 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:11.435 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:11.435 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:11.435 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:11.435 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:11.435 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:11.435 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:11.436 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:11.436 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:11.436 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:11.436 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:11.436 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:11.436 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:11.436 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:11.436 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:11.436 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:11.436 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:11.436 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:11.437 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:11.437 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:11.437 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:11.437 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:11.437 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:11.437 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:11.437 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:11.437 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:11.437 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:11.437 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:11.437 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.437 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.438 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:11.438 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.438 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:11.438 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:11.438 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.438 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:11.438 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:11.438 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:11.438 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:11.438 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:11.438 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.439 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:11.439 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:11.439 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.439 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.439 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:11.439 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:11.439 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.439 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.439 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:11.439 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:11.439 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:11.439 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:11.440 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:11.440 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.440 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.440 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:11.440 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:11.440 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:11.440 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.440 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:11.440 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.440 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:11.440 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.440 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:11.441 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.441 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:11.441 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.441 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:11.441 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:11.441 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:11.441 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:11.441 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.441 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:11.441 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.441 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:11.441 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:11.442 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:11.442 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:11.442 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:11.442 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:11.442 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:11.442 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:11.442 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:11.442 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:11.442 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:11.442 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:11.442 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:11.442 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:11.443 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:11.443 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:11.443 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:11.443 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:11.443 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:11.443 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:11.443 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:11.443 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:11.443 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:11.443 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:11.444 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:11.444 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:11.444 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:11.444 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:11.444 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:11.444 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:11.444 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:11.444 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:11.444 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:11.444 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:11.444 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:11.444 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:11.444 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:11.445 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:11.445 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:11.445 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:11.445 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.445 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.445 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:11.445 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:11.445 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.445 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:11.445 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.445 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:11.445 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:11.446 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:11.446 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:11.446 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:11.446 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:11.446 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:11.446 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:11.446 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:11.446 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:11.446 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:11.446 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:11.447 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:11.447 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.447 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:11.447 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:11.447 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:11.447 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:11.447 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:11.447 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:11.447 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:11.447 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:11.447 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:11.447 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:11.448 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:11.448 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.448 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.448 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:11.448 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:11.448 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:11.448 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:11.448 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:11.448 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.448 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.448 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:11.449 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:11.449 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:11.449 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:11.449 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:11.449 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.449 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:11.449 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:11.449 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:11.449 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:11.449 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:11.449 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:11.450 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.450 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:11.450 INFO:teuthology.orchestra.run.smithi012.stdout:________________ ERROR at teardown of test_sse_kms_transfer_1MB ________________ 2023-10-05T12:49:11.450 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.450 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:11.450 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.450 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:11.450 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:11.450 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.450 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:11.450 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:11.451 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:11.451 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:11.451 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:11.451 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.451 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:11.451 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:11.451 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.451 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.451 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:11.451 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:11.451 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.452 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.452 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:11.452 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.452 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:11.452 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:11.452 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.452 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.452 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:11.452 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:11.452 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.453 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:11.453 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:11.453 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:11.453 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:11.453 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:11.453 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:11.453 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:11.453 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.453 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:11.453 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:11.453 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:11.454 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:11.454 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:11.454 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:11.454 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:11.454 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:11.454 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:11.454 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.454 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:11.454 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:11.454 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:11.454 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:11.454 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.457 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:11.457 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:11.457 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:11.457 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:11.457 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.457 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.457 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:11.457 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:11.457 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:11.457 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:11.458 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.458 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.458 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:11.458 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:11.458 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:11.458 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.458 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:11.458 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.458 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:11.458 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:11.458 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.459 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:11.459 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:11.459 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:11.459 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:11.459 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:11.459 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:11.459 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.459 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:11.459 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.459 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:11.459 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.460 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:11.460 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:11.460 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.460 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:11.460 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.460 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:11.460 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:11.460 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:11.460 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:11.460 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:11.460 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:11.461 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:11.461 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:11.461 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:11.461 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:11.461 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:11.461 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:11.461 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:11.461 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.461 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:11.461 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:11.461 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:11.462 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:11.462 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:11.462 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:11.462 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:11.462 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:11.462 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:11.462 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:11.462 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:11.462 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.462 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.462 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:11.463 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.463 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:11.463 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:11.463 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:11.463 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:11.463 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:11.463 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:11.463 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:11.463 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:11.463 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:11.463 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:11.463 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:11.464 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:11.464 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:11.464 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:11.464 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:11.464 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:11.464 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:11.464 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:11.464 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:11.464 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:11.464 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:11.464 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:11.464 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:11.465 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:11.465 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:11.465 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:11.465 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:11.465 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:11.465 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.465 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.465 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:11.465 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.465 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:11.465 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:11.465 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.466 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:11.466 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:11.466 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:11.466 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:11.466 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:11.466 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.466 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:11.466 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:11.466 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.466 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.466 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:11.466 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:11.467 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.467 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.467 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:11.467 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:11.467 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:11.467 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:11.467 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:11.467 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.467 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.467 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:11.467 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:11.467 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:11.468 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.468 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:11.468 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.468 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:11.468 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.468 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:11.468 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.468 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:11.468 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.468 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:11.468 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:11.469 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:11.469 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:11.469 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.469 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:11.469 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.469 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:11.469 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:11.469 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:11.469 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:11.469 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:11.469 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:11.469 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:11.470 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:11.470 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:11.470 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:11.470 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:11.470 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:11.470 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:11.470 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:11.470 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:11.470 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:11.470 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:11.470 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:11.470 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:11.471 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:11.471 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:11.471 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:11.471 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:11.471 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:11.471 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:11.471 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:11.471 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:11.471 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:11.471 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:11.471 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:11.472 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:11.472 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:11.472 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:11.472 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:11.472 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:11.472 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:11.472 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:11.472 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:11.472 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:11.472 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:11.472 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.472 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.473 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:11.473 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:11.473 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.473 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:11.473 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.473 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:11.473 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:11.473 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:11.473 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:11.473 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:11.473 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:11.473 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:11.474 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:11.474 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:11.474 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:11.474 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:11.474 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:11.474 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:11.474 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.474 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:11.474 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:11.474 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:11.475 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:11.475 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:11.475 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:11.475 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:11.475 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:11.475 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:11.475 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:11.475 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:11.475 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.475 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.475 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:11.476 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:11.476 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:11.476 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:11.476 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:11.476 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.476 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.476 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:11.476 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:11.476 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:11.476 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:11.476 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:11.476 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.477 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:11.477 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:11.477 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:11.477 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:11.477 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:11.477 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:11.477 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.477 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:11.477 INFO:teuthology.orchestra.run.smithi012.stdout:________________ ERROR at teardown of test_sse_kms_transfer_13b ________________ 2023-10-05T12:49:11.477 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.477 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:11.478 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.478 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:11.478 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:11.478 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.478 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:11.478 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:11.478 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:11.478 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:11.478 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:11.478 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.479 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:11.479 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:11.479 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.479 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.479 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:11.479 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:11.479 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.479 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.479 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:11.479 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.479 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:11.479 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:11.480 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.480 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.480 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:11.480 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:11.480 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.480 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:11.480 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:11.480 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:11.480 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:11.480 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:11.480 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:11.480 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:11.480 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.481 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:11.481 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:11.481 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:11.481 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:11.481 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:11.481 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:11.481 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:11.481 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:11.481 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:11.481 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.481 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:11.481 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:11.482 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:11.482 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:11.482 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.482 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:11.482 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:11.482 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:11.482 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:11.482 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.482 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.482 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:11.482 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:11.483 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:11.483 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:11.483 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.483 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.483 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:11.483 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:11.483 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:11.483 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.483 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:11.483 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.483 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:11.483 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:11.484 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.484 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:11.484 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:11.484 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:11.484 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:11.484 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:11.484 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:11.484 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.484 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:11.484 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.484 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:11.485 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.485 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:11.485 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:11.485 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.485 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:11.485 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.485 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:11.485 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:11.485 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:11.485 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:11.485 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:11.485 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:11.486 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:11.486 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:11.486 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:11.486 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:11.486 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:11.486 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:11.486 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:11.486 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.486 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:11.486 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:11.486 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:11.487 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:11.487 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:11.487 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:11.487 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:11.487 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:11.487 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:11.487 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:11.487 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:11.487 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.487 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.487 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:11.487 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.487 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:11.488 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:11.488 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:11.488 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:11.488 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:11.488 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:11.488 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:11.488 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:11.488 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:11.488 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:11.488 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:11.488 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:11.489 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:11.489 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:11.489 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:11.489 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:11.489 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:11.489 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:11.489 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:11.489 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:11.489 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:11.489 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:11.489 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:11.489 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:11.490 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:11.490 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:11.490 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:11.490 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:11.490 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.490 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.490 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:11.490 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.490 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:11.490 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:11.490 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.491 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:11.491 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:11.491 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:11.491 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:11.491 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:11.491 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.491 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:11.491 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:11.491 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.491 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.491 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:11.491 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:11.492 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.492 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.492 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:11.492 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:11.492 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:11.492 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:11.492 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:11.492 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.492 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.492 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:11.492 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:11.492 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:11.493 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.493 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:11.493 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.493 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:11.493 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.493 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:11.493 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.493 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:11.493 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.493 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:11.493 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:11.493 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:11.494 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:11.494 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.494 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:11.494 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.494 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:11.494 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:11.494 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:11.494 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:11.494 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:11.494 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:11.494 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:11.494 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:11.495 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:11.495 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:11.495 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:11.495 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:11.495 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:11.495 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:11.495 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:11.495 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:11.495 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:11.495 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:11.495 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:11.495 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:11.496 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:11.496 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:11.496 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:11.496 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:11.496 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:11.496 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:11.496 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:11.496 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:11.496 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:11.496 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:11.496 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:11.497 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:11.497 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:11.497 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:11.497 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:11.497 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:11.497 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:11.497 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:11.497 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:11.497 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:11.497 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.497 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.497 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:11.498 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:11.498 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.498 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:11.498 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.498 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:11.498 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:11.498 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:11.498 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:11.498 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:11.498 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:11.498 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:11.499 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:11.499 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:11.499 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:11.499 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:11.499 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:11.499 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:11.499 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.499 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:11.499 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:11.499 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:11.499 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:11.500 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:11.500 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:11.500 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:11.500 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:11.500 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:11.500 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:11.500 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:11.500 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.500 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.500 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:11.500 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:11.500 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:11.500 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:11.501 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:11.501 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.501 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.501 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:11.501 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:11.501 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:11.501 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:11.501 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:11.501 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.501 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:11.501 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:11.501 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:11.502 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:11.502 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:11.502 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:11.502 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.502 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:11.502 INFO:teuthology.orchestra.run.smithi012.stdout:________________ ERROR at teardown of test_sse_kms_read_declare ________________ 2023-10-05T12:49:11.502 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.502 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:11.502 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.502 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:11.502 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:11.502 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.503 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:11.503 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:11.503 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:11.503 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:11.503 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:11.503 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.503 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:11.503 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:11.503 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.503 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.503 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:11.503 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:11.503 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.504 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.504 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:11.504 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.504 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:11.504 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:11.504 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.504 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.504 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:11.504 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:11.504 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.504 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:11.504 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:11.504 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:11.505 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:11.505 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:11.505 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:11.505 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:11.505 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.505 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:11.505 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:11.505 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:11.505 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:11.505 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:11.505 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:11.505 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:11.506 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:11.506 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:11.506 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.506 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:11.506 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:11.506 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:11.506 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:11.506 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.506 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:11.506 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:11.506 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:11.507 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:11.507 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.507 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.507 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:11.507 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:11.507 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:11.507 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:11.507 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.507 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.507 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:11.507 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:11.507 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:11.507 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.508 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:11.508 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.508 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:11.508 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:11.508 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.508 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:11.508 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:11.508 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:11.508 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:11.508 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:11.508 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:11.508 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.509 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:11.509 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.509 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:11.509 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.509 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:11.509 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:11.509 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.509 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:11.509 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.509 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:11.509 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:11.509 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:11.509 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:11.510 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:11.510 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:11.510 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:11.510 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:11.510 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:11.510 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:11.510 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:11.510 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:11.510 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:11.510 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.510 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:11.511 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:11.511 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:11.511 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:11.511 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:11.511 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:11.511 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:11.511 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:11.511 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:11.511 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:11.511 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:11.511 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.511 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.511 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:11.512 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.512 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:11.512 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:11.512 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:11.512 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:11.512 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:11.512 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:11.512 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:11.512 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:11.512 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:11.512 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:11.512 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:11.512 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:11.513 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:11.513 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:11.513 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:11.513 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:11.513 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:11.513 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:11.513 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:11.513 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:11.513 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:11.513 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:11.513 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:11.513 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:11.513 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:11.514 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:11.514 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:11.514 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:11.514 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.514 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.514 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:11.514 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.514 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:11.514 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:11.514 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.514 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:11.514 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:11.515 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:11.515 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:11.515 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:11.515 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.515 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:11.515 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:11.515 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.515 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.515 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:11.515 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:11.515 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.516 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.516 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:11.516 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:11.516 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:11.516 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:11.516 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:11.516 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.516 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.516 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:11.516 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:11.516 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:11.516 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.517 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:11.517 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.517 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:11.517 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.517 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:11.517 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.517 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:11.517 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.517 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:11.517 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:11.517 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:11.518 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:11.518 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.518 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:11.518 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.518 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:11.518 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:11.518 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:11.518 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:11.518 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:11.518 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:11.518 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:11.519 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:11.519 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:11.519 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:11.519 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:11.519 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:11.519 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:11.519 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:11.519 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:11.519 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:11.519 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:11.520 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:11.520 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:11.520 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:11.520 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:11.520 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:11.520 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:11.520 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:11.520 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:11.520 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:11.520 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:11.520 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:11.521 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:11.521 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:11.521 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:11.521 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:11.521 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:11.521 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:11.521 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:11.521 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:11.521 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:11.521 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:11.522 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:11.522 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:11.522 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.522 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.522 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:11.522 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:11.522 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.522 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:11.522 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.522 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:11.522 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:11.523 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:11.523 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:11.523 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:11.523 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:11.523 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:11.523 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:11.523 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:11.523 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:11.523 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:11.523 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:11.523 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:11.523 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.524 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:11.524 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:11.524 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:11.524 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:11.524 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:11.524 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:11.524 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:11.524 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:11.524 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:11.524 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:11.524 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:11.525 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.525 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.525 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:11.525 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:11.525 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:11.525 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:11.525 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:11.525 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.525 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.525 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:11.525 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:11.526 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:11.526 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:11.526 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:11.526 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.526 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:11.526 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:11.526 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:11.526 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:11.526 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:11.526 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:11.526 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.527 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:11.527 INFO:teuthology.orchestra.run.smithi012.stdout:___________________ ERROR at teardown of test_bucket_policy ____________________ 2023-10-05T12:49:11.527 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.527 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:11.527 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.527 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:11.527 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:11.527 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.527 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:11.527 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:11.527 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:11.528 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:11.528 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:11.528 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.528 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:11.528 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:11.528 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.528 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.528 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:11.528 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:11.528 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.528 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.529 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:11.529 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.529 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:11.529 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:11.529 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.529 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.529 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:11.529 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:11.529 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.529 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:11.529 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:11.529 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:11.530 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:11.530 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:11.530 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:11.530 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:11.530 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.530 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:11.530 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:11.530 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:11.530 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:11.530 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:11.530 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:11.531 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:11.531 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:11.531 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:11.531 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.531 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:11.531 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:11.531 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:11.531 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:11.531 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.531 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:11.531 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:11.532 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:11.532 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:11.532 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.532 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.532 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:11.532 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:11.532 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:11.532 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:11.532 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.532 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.532 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:11.532 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:11.533 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:11.533 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.533 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:11.533 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.533 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:11.533 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:11.533 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.533 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:11.533 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:11.533 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:11.533 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:11.533 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:11.533 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:11.534 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.534 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:11.534 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.534 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:11.534 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.534 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:11.534 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:11.534 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.534 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:11.534 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.534 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:11.535 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:11.535 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:11.535 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:11.535 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:11.535 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:11.535 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:11.535 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:11.535 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:11.535 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:11.535 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:11.536 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:11.536 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:11.536 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.536 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:11.536 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:11.536 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:11.536 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:11.536 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:11.536 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:11.536 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:11.536 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:11.536 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:11.537 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:11.537 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:11.537 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.537 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.537 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:11.537 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.537 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:11.537 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:11.537 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:11.537 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:11.537 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:11.537 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:11.538 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:11.538 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:11.538 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:11.538 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:11.538 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:11.538 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:11.538 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:11.538 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:11.538 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:11.538 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:11.538 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:11.539 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:11.539 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:11.539 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:11.539 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:11.539 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:11.539 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:11.539 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:11.539 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:11.539 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:11.539 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:11.539 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:11.540 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.540 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.540 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:11.540 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.540 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:11.540 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:11.540 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.540 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:11.540 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:11.540 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:11.540 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:11.540 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:11.540 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.541 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:11.541 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:11.541 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.541 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.541 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:11.541 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:11.541 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.541 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.541 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:11.541 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:11.541 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:11.541 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:11.541 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:11.542 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.542 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.542 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:11.542 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:11.542 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:11.542 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.542 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:11.542 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.542 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:11.542 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.542 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:11.542 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.543 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:11.543 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.543 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:11.543 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:11.543 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:11.543 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:11.543 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.543 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:11.543 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.543 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:11.543 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:11.544 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:11.544 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:11.544 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:11.544 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:11.544 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:11.544 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:11.544 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:11.544 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:11.544 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:11.544 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:11.544 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:11.544 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:11.545 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:11.545 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:11.545 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:11.545 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:11.545 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:11.545 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:11.545 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:11.545 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:11.545 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:11.545 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:11.545 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:11.545 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:11.546 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:11.546 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:11.546 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:11.546 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:11.546 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:11.546 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:11.546 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:11.546 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:11.546 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:11.546 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:11.547 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:11.547 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:11.547 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:11.547 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:11.547 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.547 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.547 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:11.547 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:11.547 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.547 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:11.547 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.547 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:11.548 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:11.548 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:11.548 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:11.548 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:11.548 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:11.548 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:11.548 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:11.548 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:11.548 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:11.548 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:11.548 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:11.549 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:11.549 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.549 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:11.549 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:11.549 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:11.549 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:11.549 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:11.549 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:11.549 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:11.549 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:11.549 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:11.550 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:11.550 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:11.550 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.550 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.550 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:11.550 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:11.550 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:11.550 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:11.550 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:11.550 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.550 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.551 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:11.551 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:11.551 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:11.551 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:11.551 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:11.551 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.551 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:11.551 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:11.551 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:11.551 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:11.552 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:11.552 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:11.552 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.552 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:11.552 INFO:teuthology.orchestra.run.smithi012.stdout:__________________ ERROR at teardown of test_bucketv2_policy ___________________ 2023-10-05T12:49:11.552 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.552 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:11.552 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.552 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:11.552 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:11.552 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.552 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:11.552 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:11.553 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:11.553 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:11.553 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:11.553 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.553 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:11.553 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:11.553 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.553 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.553 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:11.553 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:11.553 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.553 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.554 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:11.554 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.554 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:11.554 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:11.554 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.554 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.554 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:11.554 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:11.554 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.554 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:11.555 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:11.555 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:11.555 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:11.555 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:11.555 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:11.555 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:11.555 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.555 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:11.555 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:11.555 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:11.555 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:11.555 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:11.556 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:11.556 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:11.556 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:11.556 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:11.556 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.556 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:11.556 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:11.556 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:11.556 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:11.556 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.556 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:11.556 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:11.556 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:11.557 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:11.557 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.557 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.557 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:11.557 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:11.557 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:11.557 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:11.557 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.557 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.557 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:11.557 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:11.557 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:11.558 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.558 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:11.558 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.558 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:11.558 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:11.558 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.558 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:11.558 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:11.558 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:11.558 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:11.559 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:11.559 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:11.559 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.559 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:11.559 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.559 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:11.559 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.559 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:11.559 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:11.559 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.559 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:11.559 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.559 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:11.560 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:11.560 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:11.560 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:11.560 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:11.560 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:11.560 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:11.560 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:11.560 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:11.560 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:11.560 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:11.560 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:11.560 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:11.561 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.561 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:11.561 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:11.561 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:11.561 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:11.561 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:11.561 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:11.561 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:11.561 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:11.561 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:11.561 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:11.561 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:11.561 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.562 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.562 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:11.562 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.562 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:11.562 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:11.562 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:11.562 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:11.562 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:11.562 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:11.562 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:11.562 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:11.563 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:11.563 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:11.563 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:11.563 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:11.563 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:11.563 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:11.563 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:11.563 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:11.563 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:11.563 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:11.563 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:11.563 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:11.564 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:11.564 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:11.564 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:11.564 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:11.564 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:11.564 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:11.564 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:11.564 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:11.564 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.564 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.564 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:11.564 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.565 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:11.565 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:11.565 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.565 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:11.565 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:11.565 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:11.565 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:11.565 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:11.565 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.565 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:11.565 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:11.565 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.565 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.566 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:11.566 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:11.566 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.566 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.566 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:11.566 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:11.566 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:11.566 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:11.566 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:11.566 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.566 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.566 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:11.567 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:11.567 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:11.567 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.567 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:11.567 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.567 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:11.567 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.567 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:11.567 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.567 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:11.567 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.567 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:11.568 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:11.568 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:11.568 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:11.568 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.568 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:11.568 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.568 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:11.568 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:11.568 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:11.568 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:11.568 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:11.568 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:11.569 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:11.569 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:11.569 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:11.569 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:11.569 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:11.569 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:11.569 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:11.569 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:11.569 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:11.569 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:11.569 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:11.569 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:11.570 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:11.570 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:11.570 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:11.570 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:11.570 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:11.570 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:11.570 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:11.570 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:11.570 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:11.570 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:11.570 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:11.571 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:11.571 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:11.571 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:11.571 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:11.571 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:11.571 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:11.571 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:11.571 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:11.571 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:11.571 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:11.571 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:11.571 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.572 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.572 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:11.572 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:11.572 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.572 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:11.572 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.572 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:11.572 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:11.572 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:11.572 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:11.572 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:11.572 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:11.572 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:11.573 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:11.573 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:11.573 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:11.573 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:11.573 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:11.573 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:11.573 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.573 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:11.573 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:11.573 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:11.573 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:11.573 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:11.574 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:11.574 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:11.574 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:11.574 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:11.574 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:11.574 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:11.574 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.574 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.574 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:11.574 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:11.574 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:11.575 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:11.575 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:11.575 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.575 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.575 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:11.575 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:11.575 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:11.575 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:11.575 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:11.575 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.575 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:11.575 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:11.575 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:11.576 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:11.576 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:11.576 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:11.576 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.576 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:11.576 INFO:teuthology.orchestra.run.smithi012.stdout:_________________ ERROR at teardown of test_bucket_policy_acl __________________ 2023-10-05T12:49:11.576 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.576 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:11.576 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.576 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:11.576 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:11.576 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.576 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:11.577 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:11.577 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:11.577 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:11.577 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:11.577 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.577 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:11.577 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:11.577 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.577 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.577 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:11.577 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:11.578 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.578 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.578 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:11.578 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.578 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:11.578 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:11.578 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.578 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.578 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:11.578 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:11.578 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.578 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:11.579 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:11.579 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:11.579 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:11.579 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:11.579 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:11.579 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:11.579 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.579 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:11.579 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:11.579 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:11.580 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:11.580 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:11.580 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:11.580 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:11.580 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:11.580 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:11.580 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.580 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:11.580 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:11.580 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:11.580 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:11.580 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.581 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:11.581 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:11.581 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:11.581 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:11.581 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.581 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.581 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:11.581 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:11.581 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:11.581 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:11.581 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.581 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.582 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:11.582 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:11.582 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:11.582 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.582 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:11.582 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.582 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:11.582 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:11.582 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.582 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:11.582 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:11.583 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:11.583 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:11.583 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:11.583 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:11.583 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.583 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:11.583 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.583 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:11.583 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.583 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:11.583 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:11.583 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.583 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:11.584 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.584 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:11.584 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:11.584 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:11.584 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:11.584 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:11.584 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:11.584 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:11.584 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:11.584 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:11.584 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:11.585 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:11.585 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:11.585 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:11.585 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.585 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:11.585 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:11.585 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:11.585 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:11.585 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:11.585 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:11.585 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:11.585 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:11.585 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:11.586 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:11.586 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:11.586 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.586 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.586 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:11.586 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.586 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:11.586 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:11.586 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:11.586 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:11.586 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:11.586 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:11.587 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:11.587 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:11.587 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:11.587 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:11.587 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:11.587 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:11.587 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:11.587 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:11.587 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:11.587 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:11.587 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:11.587 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:11.588 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:11.588 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:11.588 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:11.588 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:11.588 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:11.588 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:11.588 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:11.588 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:11.588 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:11.588 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:11.588 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.588 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.589 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:11.589 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.589 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:11.589 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:11.589 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.589 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:11.589 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:11.589 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:11.589 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:11.589 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:11.589 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.590 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:11.590 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:11.590 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.590 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.590 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:11.590 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:11.590 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.590 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.590 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:11.590 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:11.590 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:11.591 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:11.591 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:11.591 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.591 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.591 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:11.591 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:11.591 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:11.591 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.591 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:11.591 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.591 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:11.591 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.592 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:11.592 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.592 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:11.592 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.592 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:11.592 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:11.592 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:11.592 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:11.592 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.592 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:11.592 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.592 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:11.593 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:11.593 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:11.593 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:11.593 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:11.593 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:11.593 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:11.593 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:11.593 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:11.593 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:11.593 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:11.593 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:11.594 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:11.594 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:11.594 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:11.594 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:11.594 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:11.594 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:11.594 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:11.594 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:11.594 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:11.595 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:11.595 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:11.595 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:11.595 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:11.595 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:11.595 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:11.595 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:11.595 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:11.595 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:11.595 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:11.595 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:11.595 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:11.596 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:11.596 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:11.596 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:11.596 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:11.596 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:11.596 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:11.596 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:11.596 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.596 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.596 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:11.596 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:11.597 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.597 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:11.597 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.597 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:11.597 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:11.597 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:11.597 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:11.597 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:11.597 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:11.597 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:11.598 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:11.598 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:11.598 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:11.598 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:11.598 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:11.598 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:11.598 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.598 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:11.598 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:11.598 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:11.598 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:11.599 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:11.599 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:11.599 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:11.599 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:11.599 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:11.599 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:11.599 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:11.599 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.599 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.599 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:11.599 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:11.600 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:11.600 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:11.600 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:11.600 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.600 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.600 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:11.600 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:11.600 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:11.600 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:11.600 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:11.600 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.600 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:11.601 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:11.601 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:11.601 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:11.601 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:11.601 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:11.601 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.601 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:11.601 INFO:teuthology.orchestra.run.smithi012.stdout:________________ ERROR at teardown of test_bucketv2_policy_acl _________________ 2023-10-05T12:49:11.601 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.601 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:11.601 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.602 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:11.602 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:11.602 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.602 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:11.602 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:11.602 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:11.602 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:11.602 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:11.602 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.602 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:11.603 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:11.603 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.603 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.603 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:11.603 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:11.603 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.603 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.603 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:11.603 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.603 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:11.603 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:11.603 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.604 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.604 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:11.604 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:11.604 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.604 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:11.604 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:11.604 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:11.604 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:11.604 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:11.604 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:11.604 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:11.605 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.605 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:11.605 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:11.605 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:11.605 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:11.605 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:11.605 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:11.605 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:11.605 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:11.605 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:11.605 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.606 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:11.606 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:11.606 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:11.606 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:11.606 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.606 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:11.606 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:11.606 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:11.606 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:11.606 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.606 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.607 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:11.607 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:11.607 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:11.607 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:11.607 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.607 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.607 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:11.607 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:11.607 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:11.607 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.607 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:11.607 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.608 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:11.608 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:11.608 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.608 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:11.608 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:11.608 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:11.608 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:11.608 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:11.608 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:11.608 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.608 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:11.608 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.609 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:11.609 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.609 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:11.609 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:11.609 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.609 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:11.609 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.609 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:11.609 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:11.609 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:11.609 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:11.609 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:11.610 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:11.610 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:11.610 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:11.610 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:11.610 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:11.610 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:11.610 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:11.610 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:11.610 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.610 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:11.611 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:11.611 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:11.611 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:11.611 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:11.611 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:11.611 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:11.611 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:11.611 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:11.611 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:11.611 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:11.611 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.611 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.611 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:11.612 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.612 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:11.612 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:11.612 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:11.612 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:11.612 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:11.612 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:11.612 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:11.612 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:11.612 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:11.612 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:11.613 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:11.613 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:11.613 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:11.613 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:11.613 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:11.613 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:11.613 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:11.613 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:11.613 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:11.613 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:11.613 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:11.614 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:11.614 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:11.614 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:11.614 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:11.614 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:11.614 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:11.614 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:11.614 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.614 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.614 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:11.615 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.615 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:11.615 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:11.615 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.615 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:11.615 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:11.615 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:11.615 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:11.615 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:11.615 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.615 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:11.616 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:11.616 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.616 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.616 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:11.616 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:11.616 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.616 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.616 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:11.616 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:11.616 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:11.616 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:11.617 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:11.617 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.617 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.617 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:11.617 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:11.617 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:11.617 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.617 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:11.617 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.617 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:11.617 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.617 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:11.618 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.618 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:11.618 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.618 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:11.618 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:11.618 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:11.618 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:11.618 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.618 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:11.618 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.618 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:11.619 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:11.619 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:11.619 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:11.619 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:11.619 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:11.619 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:11.619 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:11.619 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:11.619 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:11.619 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:11.619 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:11.619 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:11.620 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:11.620 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:11.620 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:11.620 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:11.620 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:11.620 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:11.620 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:11.620 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:11.620 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:11.620 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:11.620 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:11.620 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:11.621 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:11.621 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:11.621 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:11.621 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:11.621 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:11.621 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:11.621 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:11.621 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:11.621 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:11.621 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:11.621 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:11.622 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:11.622 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:11.622 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:11.622 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:11.622 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.622 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.622 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:11.622 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:11.622 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.622 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:11.622 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.623 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:11.623 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:11.623 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:11.623 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:11.623 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:11.623 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:11.623 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:11.623 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:11.623 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:11.623 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:11.623 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:11.623 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:11.624 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:11.624 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.624 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:11.624 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:11.624 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:11.624 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:11.624 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:11.624 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:11.624 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:11.624 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:11.624 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:11.625 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:11.625 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:11.625 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.625 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.625 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:11.625 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:11.625 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:11.625 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:11.625 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:11.625 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.625 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.625 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:11.626 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:11.626 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:11.626 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:11.626 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:11.626 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.626 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:11.626 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:11.626 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:11.626 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:11.626 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:11.626 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:11.627 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.627 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:11.627 INFO:teuthology.orchestra.run.smithi012.stdout:____________ ERROR at teardown of test_bucket_policy_another_bucket ____________ 2023-10-05T12:49:11.627 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.627 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:11.627 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.627 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:11.627 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:11.627 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.627 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:11.627 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:11.628 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:11.628 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:11.628 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:11.628 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.628 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:11.628 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:11.628 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.628 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.628 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:11.628 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:11.628 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.628 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.629 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:11.629 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.629 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:11.629 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:11.629 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.629 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.629 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:11.629 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:11.629 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.629 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:11.629 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:11.629 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:11.630 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:11.630 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:11.630 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:11.630 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:11.630 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.630 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:11.630 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:11.630 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:11.630 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:11.630 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:11.630 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:11.631 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:11.631 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:11.631 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:11.631 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.631 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:11.631 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:11.631 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:11.631 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:11.631 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.631 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:11.631 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:11.631 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:11.632 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:11.632 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.632 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.632 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:11.632 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:11.632 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:11.632 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:11.632 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.632 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.632 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:11.632 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:11.633 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:11.633 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.633 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:11.633 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.633 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:11.633 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:11.633 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.633 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:11.633 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:11.633 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:11.633 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:11.633 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:11.634 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:11.634 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.634 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:11.634 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.634 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:11.634 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.634 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:11.634 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:11.634 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.635 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:11.635 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.635 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:11.635 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:11.635 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:11.635 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:11.635 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:11.635 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:11.635 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:11.635 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:11.635 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:11.636 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:11.636 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:11.636 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:11.636 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:11.636 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.636 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:11.636 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:11.636 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:11.636 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:11.636 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:11.636 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:11.636 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:11.637 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:11.637 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:11.637 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:11.637 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:11.637 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.637 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.637 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:11.637 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.637 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:11.637 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:11.637 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:11.637 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:11.638 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:11.638 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:11.638 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:11.638 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:11.638 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:11.638 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:11.638 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:11.638 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:11.638 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:11.638 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:11.638 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:11.638 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:11.639 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:11.639 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:11.639 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:11.639 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:11.639 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:11.639 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:11.639 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:11.639 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:11.639 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:11.639 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:11.639 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:11.639 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:11.640 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.640 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.640 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:11.640 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.640 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:11.640 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:11.640 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.640 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:11.640 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:11.640 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:11.641 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:11.641 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:11.641 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.641 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:11.641 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:11.641 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.641 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.641 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:11.641 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:11.641 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.641 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.641 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:11.642 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:11.642 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:11.642 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:11.642 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:11.642 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.642 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.642 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:11.642 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:11.642 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:11.642 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.642 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:11.643 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.643 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:11.643 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.643 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:11.643 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.643 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:11.643 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.643 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:11.643 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:11.643 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:11.644 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:11.644 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.644 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:11.644 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.644 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:11.644 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:11.644 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:11.644 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:11.644 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:11.644 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:11.644 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:11.644 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:11.645 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:11.645 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:11.645 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:11.645 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:11.645 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:11.645 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:11.645 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:11.645 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:11.645 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:11.645 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:11.645 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:11.646 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:11.646 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:11.646 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:11.646 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:11.646 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:11.646 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:11.646 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:11.646 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:11.646 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:11.646 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:11.646 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:11.646 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:11.647 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:11.647 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:11.647 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:11.647 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:11.647 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:11.647 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:11.647 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:11.647 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:11.647 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:11.647 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.647 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.648 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:11.648 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:11.648 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.648 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:11.648 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.648 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:11.648 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:11.648 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:11.648 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:11.648 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:11.648 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:11.648 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:11.649 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:11.649 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:11.649 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:11.649 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:11.649 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:11.649 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:11.649 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.649 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:11.649 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:11.649 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:11.649 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:11.650 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:11.650 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:11.650 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:11.650 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:11.650 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:11.650 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:11.650 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:11.650 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.650 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.650 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:11.650 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:11.650 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:11.651 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:11.651 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:11.651 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.651 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.651 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:11.651 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:11.651 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:11.651 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:11.651 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:11.651 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.651 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:11.652 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:11.652 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:11.652 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:11.652 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:11.652 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:11.652 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.652 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:11.652 INFO:teuthology.orchestra.run.smithi012.stdout:___________ ERROR at teardown of test_bucketv2_policy_another_bucket ___________ 2023-10-05T12:49:11.652 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.652 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:11.652 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.652 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:11.653 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:11.653 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.653 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:11.653 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:11.653 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:11.653 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:11.653 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:11.653 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.653 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:11.653 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:11.653 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.653 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.654 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:11.654 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:11.654 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.654 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.654 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:11.654 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.654 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:11.654 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:11.654 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.654 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.654 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:11.655 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:11.655 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.655 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:11.655 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:11.655 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:11.655 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:11.655 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:11.655 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:11.655 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:11.655 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.655 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:11.657 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:11.657 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:11.657 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:11.657 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:11.657 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:11.657 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:11.657 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:11.657 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:11.658 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.658 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:11.658 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:11.658 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:11.658 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:11.658 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.658 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:11.658 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:11.658 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:11.658 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:11.658 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.659 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.659 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:11.659 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:11.659 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:11.659 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:11.659 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.659 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.659 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:11.659 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:11.659 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:11.659 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.659 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:11.660 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.660 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:11.660 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:11.660 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.660 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:11.660 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:11.660 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:11.660 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:11.660 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:11.660 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:11.660 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.660 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:11.661 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.661 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:11.661 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.661 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:11.661 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:11.661 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.661 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:11.661 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.661 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:11.661 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:11.661 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:11.662 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:11.662 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:11.662 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:11.662 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:11.662 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:11.662 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:11.662 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:11.662 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:11.662 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:11.662 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:11.662 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.663 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:11.663 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:11.663 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:11.663 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:11.663 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:11.663 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:11.663 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:11.663 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:11.663 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:11.663 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:11.663 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:11.664 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.664 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.664 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:11.664 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.664 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:11.664 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:11.664 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:11.664 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:11.664 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:11.664 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:11.664 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:11.665 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:11.665 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:11.665 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:11.665 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:11.665 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:11.665 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:11.665 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:11.665 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:11.665 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:11.665 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:11.665 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:11.666 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:11.666 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:11.666 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:11.666 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:11.666 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:11.666 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:11.666 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:11.666 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:11.666 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:11.666 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:11.667 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.667 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.667 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:11.667 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.667 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:11.667 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:11.667 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.667 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:11.667 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:11.667 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:11.667 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:11.668 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:11.668 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.668 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:11.668 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:11.668 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.668 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.668 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:11.668 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:11.668 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.668 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.668 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:11.668 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:11.669 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:11.669 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:11.669 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:11.669 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.669 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.669 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:11.669 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:11.669 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:11.669 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.669 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:11.670 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.670 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:11.670 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.670 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:11.670 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.670 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:11.670 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.670 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:11.670 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:11.670 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:11.670 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:11.671 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.671 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:11.671 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.671 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:11.671 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:11.671 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:11.671 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:11.671 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:11.671 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:11.671 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:11.671 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:11.672 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:11.672 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:11.672 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:11.672 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:11.672 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:11.672 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:11.672 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:11.672 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:11.672 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:11.672 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:11.672 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:11.673 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:11.673 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:11.673 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:11.673 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:11.673 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:11.673 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:11.673 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:11.673 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:11.673 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:11.674 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:11.674 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:11.674 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:11.674 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:11.674 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:11.674 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:11.674 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:11.674 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:11.674 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:11.674 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:11.674 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:11.674 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:11.675 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.675 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.675 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:11.675 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:11.675 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.675 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:11.675 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.675 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:11.675 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:11.675 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:11.675 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:11.676 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:11.676 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:11.676 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:11.676 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:11.676 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:11.676 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:11.676 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:11.676 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:11.676 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:11.676 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.676 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:11.676 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:11.677 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:11.677 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:11.677 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:11.677 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:11.677 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:11.677 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:11.677 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:11.677 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:11.677 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:11.677 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.677 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.677 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:11.678 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:11.678 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:11.678 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:11.678 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:11.678 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.678 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.678 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:11.678 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:11.678 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:11.678 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:11.678 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:11.679 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.679 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:11.679 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:11.679 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:11.679 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:11.679 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:11.679 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:11.679 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.679 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:11.679 INFO:teuthology.orchestra.run.smithi012.stdout:__________________ ERROR at teardown of test_get_obj_tagging ___________________ 2023-10-05T12:49:11.679 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.679 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:11.680 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.680 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:11.680 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:11.680 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.680 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:11.680 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:11.680 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:11.680 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:11.680 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:11.680 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.680 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:11.680 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:11.681 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.681 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.681 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:11.681 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:11.681 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.681 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.681 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:11.681 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.681 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:11.681 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:11.681 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.681 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.682 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:11.682 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:11.682 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.682 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:11.682 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:11.682 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:11.682 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:11.682 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:11.682 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:11.682 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:11.682 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.682 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:11.683 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:11.683 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:11.683 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:11.683 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:11.683 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:11.683 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:11.683 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:11.683 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:11.683 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.683 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:11.683 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:11.683 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:11.684 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:11.684 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.684 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:11.684 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:11.684 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:11.684 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:11.684 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.684 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.684 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:11.684 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:11.684 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:11.684 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:11.684 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.685 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.685 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:11.685 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:11.685 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:11.685 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.685 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:11.685 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.685 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:11.685 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:11.685 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.685 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:11.686 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:11.686 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:11.686 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:11.686 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:11.686 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:11.686 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.686 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:11.686 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.686 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:11.686 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.686 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:11.687 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:11.687 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.687 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:11.687 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.687 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:11.687 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:11.687 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:11.687 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:11.687 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:11.687 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:11.687 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:11.688 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:11.688 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:11.688 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:11.688 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:11.688 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:11.688 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:11.688 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.688 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:11.688 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:11.688 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:11.689 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:11.689 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:11.689 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:11.689 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:11.689 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:11.689 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:11.689 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:11.689 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:11.689 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.689 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.689 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:11.690 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.690 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:11.690 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:11.690 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:11.690 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:11.690 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:11.690 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:11.690 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:11.690 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:11.690 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:11.690 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:11.691 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:11.691 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:11.691 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:11.691 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:11.691 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:11.691 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:11.691 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:11.691 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:11.691 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:11.691 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:11.691 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:11.691 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:11.692 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:11.692 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:11.692 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:11.692 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:11.692 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:11.692 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:11.692 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.692 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.692 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:11.692 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.692 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:11.692 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:11.692 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.693 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:11.693 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:11.693 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:11.693 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:11.693 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:11.693 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.693 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:11.693 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:11.693 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.693 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.693 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:11.693 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:11.694 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.694 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.694 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:11.694 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:11.694 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:11.694 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:11.694 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:11.694 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.694 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.694 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:11.694 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:11.694 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:11.695 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.695 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:11.695 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.695 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:11.695 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.695 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:11.695 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.695 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:11.695 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.695 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:11.695 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:11.695 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:11.696 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:11.696 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.696 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:11.696 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.696 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:11.696 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:11.696 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:11.696 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:11.696 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:11.696 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:11.696 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:11.696 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:11.697 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:11.697 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:11.697 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:11.697 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:11.697 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:11.697 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:11.697 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:11.697 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:11.697 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:11.697 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:11.697 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:11.698 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:11.698 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:11.698 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:11.698 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:11.698 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:11.698 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:11.698 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:11.698 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:11.698 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:11.698 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:11.698 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:11.699 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:11.699 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:11.699 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:11.699 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:11.699 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:11.699 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:11.699 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:11.699 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:11.699 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:11.699 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:11.699 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.699 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.700 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:11.700 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:11.700 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.700 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:11.700 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.700 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:11.700 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:11.700 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:11.700 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:11.700 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:11.700 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:11.700 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:11.701 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:11.701 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:11.701 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:11.701 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:11.701 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:11.701 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:11.701 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.701 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:11.701 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:11.701 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:11.701 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:11.701 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:11.701 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:11.702 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:11.702 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:11.702 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:11.702 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:11.702 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:11.702 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.702 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.702 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:11.702 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:11.702 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:11.702 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:11.703 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:11.703 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.703 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.703 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:11.703 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:11.703 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:11.703 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:11.703 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:11.703 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.703 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:11.703 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:11.703 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:11.704 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:11.704 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:11.704 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:11.704 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.704 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:11.704 INFO:teuthology.orchestra.run.smithi012.stdout:________________ ERROR at teardown of test_get_obj_head_tagging ________________ 2023-10-05T12:49:11.704 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.704 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:11.704 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.704 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:11.704 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:11.704 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.704 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:11.705 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:11.705 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:11.705 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:11.705 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:11.705 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.705 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:11.705 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:11.705 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.705 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.705 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:11.705 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:11.705 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.705 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.706 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:11.706 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.706 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:11.706 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:11.706 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.706 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.706 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:11.706 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:11.706 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.706 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:11.706 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:11.707 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:11.707 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:11.707 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:11.707 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:11.707 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:11.707 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.707 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:11.707 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:11.707 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:11.707 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:11.707 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:11.707 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:11.707 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:11.708 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:11.708 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:11.708 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.708 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:11.708 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:11.708 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:11.708 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:11.708 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.708 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:11.708 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:11.708 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:11.709 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:11.709 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.709 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.709 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:11.709 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:11.709 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:11.709 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:11.709 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.709 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.709 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:11.709 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:11.710 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:11.710 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.710 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:11.710 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.710 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:11.710 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:11.710 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.710 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:11.710 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:11.710 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:11.710 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:11.710 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:11.711 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:11.711 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.711 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:11.711 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.711 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:11.711 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.711 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:11.711 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:11.711 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.711 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:11.711 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.711 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:11.712 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:11.712 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:11.712 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:11.712 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:11.712 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:11.712 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:11.712 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:11.712 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:11.712 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:11.712 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:11.712 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:11.712 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:11.712 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.713 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:11.713 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:11.713 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:11.713 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:11.713 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:11.713 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:11.713 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:11.713 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:11.713 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:11.713 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:11.713 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:11.713 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.713 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.714 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:11.714 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.714 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:11.714 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:11.714 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:11.714 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:11.714 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:11.714 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:11.714 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:11.714 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:11.714 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:11.714 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:11.715 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:11.715 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:11.715 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:11.715 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:11.715 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:11.715 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:11.715 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:11.715 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:11.715 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:11.715 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:11.715 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:11.715 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:11.716 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:11.716 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:11.716 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:11.716 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:11.716 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:11.716 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:11.716 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.716 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.716 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:11.716 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.716 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:11.716 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:11.717 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.717 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:11.717 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:11.717 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:11.717 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:11.717 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:11.717 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.717 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:11.717 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:11.717 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.717 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.717 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:11.718 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:11.718 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.718 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.718 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:11.718 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:11.718 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:11.718 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:11.718 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:11.718 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.718 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.718 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:11.719 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:11.719 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:11.719 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.719 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:11.719 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.719 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:11.719 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.719 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:11.719 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.719 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:11.719 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.719 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:11.720 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:11.720 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:11.720 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:11.720 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.720 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:11.720 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.720 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:11.720 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:11.720 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:11.720 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:11.720 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:11.720 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:11.721 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:11.721 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:11.721 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:11.721 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:11.721 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:11.721 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:11.721 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:11.721 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:11.721 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:11.721 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:11.721 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:11.721 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:11.722 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:11.722 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:11.722 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:11.722 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:11.722 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:11.722 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:11.722 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:11.722 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:11.722 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:11.722 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:11.722 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:11.723 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:11.723 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:11.723 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:11.723 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:11.723 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:11.723 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:11.723 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:11.723 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:11.723 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:11.723 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:11.723 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:11.724 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.724 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.724 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:11.724 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:11.724 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.724 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:11.724 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.724 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:11.724 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:11.724 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:11.724 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:11.724 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:11.725 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:11.725 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:11.725 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:11.725 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:11.725 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:11.725 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:11.725 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:11.725 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:11.725 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.725 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:11.725 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:11.725 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:11.726 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:11.726 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:11.726 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:11.726 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:11.726 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:11.726 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:11.726 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:11.726 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:11.726 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.726 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.726 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:11.726 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:11.727 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:11.727 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:11.727 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:11.727 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.727 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.727 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:11.727 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:11.727 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:11.727 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:11.727 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:11.727 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.728 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:11.728 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:11.728 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:11.728 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:11.728 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:11.728 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:11.728 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.728 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:11.728 INFO:teuthology.orchestra.run.smithi012.stdout:____________________ ERROR at teardown of test_put_max_tags ____________________ 2023-10-05T12:49:11.728 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.728 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:11.728 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.729 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:11.729 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:11.729 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.729 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:11.729 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:11.729 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:11.729 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:11.729 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:11.729 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.729 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:11.729 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:11.729 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.730 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.730 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:11.730 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:11.730 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.730 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.730 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:11.730 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.730 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:11.730 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:11.730 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.730 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.731 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:11.731 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:11.731 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.731 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:11.731 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:11.731 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:11.731 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:11.731 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:11.731 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:11.731 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:11.731 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.731 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:11.732 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:11.732 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:11.732 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:11.732 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:11.732 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:11.732 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:11.732 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:11.732 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:11.732 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.732 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:11.732 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:11.733 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:11.733 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:11.733 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.733 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:11.733 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:11.733 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:11.733 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:11.733 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.733 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.733 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:11.733 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:11.733 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:11.734 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:11.734 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.734 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.734 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:11.734 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:11.734 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:11.734 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.734 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:11.734 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.734 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:11.734 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:11.735 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.735 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:11.735 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:11.735 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:11.735 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:11.735 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:11.735 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:11.735 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.735 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:11.735 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.735 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:11.735 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.736 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:11.736 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:11.736 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.736 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:11.736 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.736 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:11.736 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:11.736 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:11.736 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:11.736 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:11.736 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:11.736 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:11.737 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:11.737 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:11.737 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:11.737 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:11.737 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:11.737 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:11.737 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.737 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:11.737 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:11.737 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:11.737 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:11.737 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:11.738 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:11.738 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:11.738 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:11.738 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:11.738 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:11.738 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:11.738 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.738 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.738 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:11.738 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.738 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:11.739 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:11.739 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:11.739 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:11.739 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:11.739 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:11.739 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:11.739 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:11.739 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:11.739 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:11.739 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:11.739 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:11.739 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:11.740 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:11.740 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:11.740 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:11.740 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:11.740 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:11.740 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:11.740 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:11.740 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:11.740 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:11.740 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:11.740 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:11.741 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:11.741 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:11.741 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:11.741 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:11.741 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.741 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.741 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:11.741 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.741 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:11.741 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:11.741 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.741 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:11.742 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:11.742 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:11.742 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:11.742 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:11.742 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.742 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:11.742 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:11.742 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.742 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.742 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:11.742 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:11.742 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.743 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.743 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:11.743 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:11.743 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:11.743 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:11.743 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:11.743 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.743 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.743 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:11.743 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:11.743 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:11.744 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.744 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:11.744 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.744 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:11.744 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.744 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:11.744 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.744 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:11.744 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.744 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:11.744 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:11.744 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:11.745 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:11.745 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.745 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:11.745 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.745 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:11.745 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:11.745 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:11.745 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:11.745 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:11.745 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:11.745 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:11.745 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:11.746 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:11.746 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:11.746 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:11.746 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:11.746 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:11.746 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:11.746 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:11.746 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:11.746 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:11.746 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:11.746 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:11.747 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:11.747 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:11.747 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:11.747 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:11.747 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:11.747 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:11.747 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:11.747 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:11.747 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:11.747 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:11.747 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:11.748 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:11.748 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:11.748 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:11.748 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:11.748 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:11.748 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:11.748 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:11.748 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:11.748 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:11.748 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:11.748 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.749 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.749 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:11.749 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:11.749 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.749 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:11.749 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.749 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:11.749 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:11.749 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:11.749 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:11.749 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:11.750 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:11.750 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:11.750 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:11.750 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:11.750 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:11.750 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:11.750 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:11.750 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:11.750 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.750 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:11.750 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:11.750 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:11.751 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:11.751 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:11.751 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:11.751 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:11.751 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:11.751 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:11.751 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:11.751 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:11.751 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.751 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.751 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:11.752 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:11.752 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:11.752 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:11.752 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:11.752 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.752 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.752 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:11.752 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:11.752 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:11.752 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:11.752 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:11.752 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.753 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:11.753 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:11.753 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:11.753 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:11.753 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:11.753 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:11.753 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.753 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:11.753 INFO:teuthology.orchestra.run.smithi012.stdout:__________________ ERROR at teardown of test_put_excess_tags ___________________ 2023-10-05T12:49:11.753 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.753 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:11.753 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.754 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:11.754 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:11.754 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.754 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:11.754 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:11.754 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:11.754 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:11.754 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:11.754 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.754 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:11.754 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:11.754 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.755 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.755 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:11.755 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:11.755 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.755 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.755 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:11.755 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.755 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:11.755 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:11.755 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.755 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.755 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:11.756 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:11.756 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.756 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:11.756 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:11.756 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:11.756 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:11.756 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:11.756 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:11.756 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:11.756 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.756 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:11.756 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:11.757 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:11.757 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:11.757 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:11.757 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:11.757 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:11.757 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:11.757 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:11.757 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.757 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:11.757 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:11.757 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:11.757 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:11.758 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.758 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:11.758 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:11.758 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:11.758 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:11.758 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.758 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.758 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:11.758 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:11.758 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:11.758 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:11.759 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.759 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.759 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:11.759 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:11.759 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:11.759 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.759 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:11.759 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.759 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:11.759 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:11.759 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.759 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:11.760 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:11.760 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:11.760 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:11.760 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:11.760 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:11.760 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.760 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:11.760 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.760 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:11.760 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.760 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:11.760 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:11.761 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.761 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:11.761 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.761 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:11.761 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:11.761 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:11.761 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:11.761 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:11.761 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:11.761 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:11.761 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:11.762 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:11.762 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:11.762 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:11.762 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:11.762 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:11.762 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.762 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:11.762 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:11.762 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:11.762 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:11.762 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:11.762 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:11.763 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:11.763 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:11.763 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:11.763 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:11.763 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:11.763 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.763 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.763 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:11.763 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.763 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:11.763 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:11.763 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:11.764 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:11.764 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:11.764 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:11.764 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:11.764 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:11.764 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:11.764 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:11.764 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:11.764 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:11.764 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:11.764 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:11.765 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:11.765 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:11.765 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:11.765 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:11.765 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:11.765 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:11.765 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:11.765 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:11.765 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:11.765 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:11.765 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:11.765 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:11.766 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:11.766 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:11.766 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.766 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.766 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:11.766 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.766 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:11.766 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:11.766 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.766 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:11.766 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:11.766 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:11.767 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:11.767 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:11.767 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.767 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:11.767 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:11.767 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.767 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.767 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:11.767 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:11.767 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.767 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.767 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:11.768 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:11.768 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:11.768 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:11.768 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:11.768 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.768 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.768 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:11.768 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:11.768 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:11.768 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.768 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:11.768 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.769 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:11.769 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.769 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:11.769 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.769 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:11.769 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.769 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:11.769 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:11.769 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:11.769 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:11.769 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.769 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:11.769 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.770 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:11.770 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:11.770 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:11.770 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:11.770 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:11.770 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:11.770 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:11.770 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:11.770 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:11.770 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:11.770 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:11.770 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:11.771 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:11.771 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:11.771 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:11.771 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:11.771 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:11.771 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:11.771 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:11.771 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:11.771 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:11.771 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:11.771 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:11.771 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:11.771 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:11.772 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:11.772 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:11.772 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:11.772 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:11.772 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:11.772 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:11.772 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:11.772 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:11.772 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:11.772 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:11.772 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:11.772 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:11.773 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:11.773 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:11.773 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:11.773 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.773 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.773 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:11.773 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:11.773 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.773 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:11.773 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.773 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:11.773 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:11.773 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:11.774 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:11.774 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:11.774 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:11.774 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:11.774 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:11.774 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:11.774 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:11.774 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:11.774 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:11.774 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:11.774 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.774 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:11.775 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:11.775 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:11.775 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:11.775 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:11.775 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:11.775 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:11.775 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:11.775 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:11.775 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:11.775 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:11.775 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.775 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.776 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:11.776 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:11.776 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:11.776 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:11.776 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:11.776 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.776 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.776 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:11.776 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:11.776 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:11.776 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:11.776 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:11.776 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.777 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:11.777 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:11.777 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:11.777 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:11.777 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:11.777 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:11.777 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.777 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:11.777 INFO:teuthology.orchestra.run.smithi012.stdout:________________ ERROR at teardown of test_put_max_kvsize_tags _________________ 2023-10-05T12:49:11.777 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.777 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:11.777 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.778 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:11.778 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:11.778 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.778 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:11.778 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:11.778 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:11.778 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:11.778 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:11.778 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.778 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:11.778 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:11.778 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.779 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.779 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:11.779 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:11.779 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.779 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.779 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:11.779 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.779 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:11.779 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:11.779 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.779 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.779 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:11.780 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:11.780 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.780 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:11.780 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:11.780 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:11.780 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:11.780 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:11.780 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:11.780 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:11.780 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.780 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:11.781 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:11.781 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:11.781 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:11.781 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:11.781 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:11.781 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:11.781 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:11.781 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:11.781 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.781 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:11.781 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:11.781 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:11.782 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:11.782 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.782 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:11.782 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:11.782 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:11.782 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:11.782 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.782 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.782 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:11.782 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:11.782 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:11.783 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:11.783 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.783 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.783 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:11.783 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:11.783 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:11.783 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.783 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:11.783 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.783 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:11.783 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:11.783 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.784 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:11.784 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:11.784 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:11.784 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:11.784 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:11.784 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:11.784 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.784 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:11.784 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.784 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:11.784 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.784 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:11.784 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:11.784 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.785 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:11.785 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.785 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:11.785 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:11.785 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:11.785 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:11.785 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:11.785 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:11.785 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:11.785 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:11.785 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:11.786 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:11.786 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:11.786 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:11.786 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:11.786 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.786 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:11.786 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:11.786 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:11.786 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:11.786 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:11.786 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:11.786 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:11.787 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:11.787 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:11.787 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:11.787 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:11.787 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.787 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.787 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:11.787 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.787 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:11.787 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:11.787 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:11.787 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:11.787 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:11.788 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:11.788 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:11.788 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:11.788 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:11.788 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:11.788 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:11.788 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:11.788 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:11.788 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:11.788 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:11.788 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:11.789 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:11.789 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:11.789 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:11.789 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:11.789 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:11.789 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:11.789 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:11.789 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:11.789 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:11.789 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:11.789 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:11.790 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:11.790 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.790 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.790 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:11.790 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.790 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:11.790 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:11.790 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.790 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:11.790 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:11.791 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:11.791 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:11.791 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:11.791 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.791 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:11.791 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:11.791 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.791 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.791 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:11.791 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:11.791 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.791 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.792 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:11.792 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:11.792 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:11.792 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:11.792 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:11.792 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.792 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.792 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:11.792 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:11.792 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:11.792 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.792 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:11.793 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.793 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:11.793 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.793 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:11.793 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.793 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:11.793 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.793 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:11.793 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:11.793 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:11.793 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:11.794 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.794 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:11.794 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.794 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:11.794 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:11.794 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:11.794 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:11.794 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:11.794 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:11.794 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:11.794 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:11.794 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:11.795 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:11.795 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:11.795 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:11.795 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:11.795 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:11.795 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:11.795 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:11.795 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:11.795 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:11.795 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:11.795 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:11.795 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:11.796 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:11.796 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:11.796 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:11.796 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:11.796 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:11.796 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:11.796 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:11.796 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:11.796 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:11.796 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:11.796 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:11.796 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:11.797 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:11.797 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:11.797 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:11.797 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:11.797 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:11.797 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:11.797 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:11.797 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.797 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.797 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:11.797 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:11.797 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.798 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:11.798 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.798 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:11.798 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:11.798 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:11.798 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:11.798 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:11.798 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:11.798 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:11.798 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:11.798 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:11.798 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:11.799 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:11.799 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:11.799 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:11.799 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.799 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:11.799 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:11.799 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:11.799 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:11.799 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:11.799 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:11.799 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:11.800 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:11.800 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:11.800 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:11.800 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:11.800 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.800 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.800 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:11.800 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:11.800 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:11.800 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:11.800 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:11.800 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.801 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.801 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:11.801 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:11.801 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:11.801 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:11.801 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:11.801 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.801 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:11.801 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:11.801 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:11.801 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:11.801 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:11.802 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:11.802 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.802 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:11.802 INFO:teuthology.orchestra.run.smithi012.stdout:________________ ERROR at teardown of test_put_excess_key_tags _________________ 2023-10-05T12:49:11.802 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.802 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:11.802 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.802 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:11.802 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:11.802 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.802 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:11.803 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:11.803 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:11.803 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:11.803 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:11.803 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.803 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:11.803 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:11.803 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.803 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.803 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:11.803 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:11.803 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.804 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.804 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:11.804 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.804 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:11.804 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:11.804 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.804 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.804 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:11.804 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:11.804 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.804 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:11.804 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:11.805 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:11.805 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:11.805 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:11.805 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:11.805 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:11.805 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.805 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:11.805 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:11.805 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:11.805 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:11.805 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:11.806 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:11.806 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:11.806 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:11.806 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:11.806 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.806 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:11.806 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:11.806 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:11.806 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:11.806 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.806 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:11.807 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:11.807 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:11.807 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:11.807 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.807 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.807 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:11.807 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:11.807 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:11.807 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:11.807 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.807 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.807 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:11.808 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:11.808 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:11.808 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.808 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:11.808 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.808 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:11.808 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:11.808 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.808 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:11.808 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:11.808 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:11.809 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:11.809 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:11.809 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:11.809 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.809 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:11.809 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.809 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:11.809 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.809 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:11.809 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:11.809 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.809 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:11.810 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.810 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:11.810 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:11.810 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:11.810 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:11.810 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:11.810 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:11.810 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:11.810 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:11.810 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:11.810 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:11.811 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:11.811 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:11.811 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:11.811 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.811 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:11.811 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:11.811 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:11.811 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:11.811 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:11.811 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:11.811 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:11.811 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:11.812 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:11.812 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:11.812 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:11.812 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.812 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.812 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:11.812 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.812 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:11.812 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:11.812 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:11.812 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:11.812 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:11.813 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:11.813 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:11.813 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:11.813 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:11.813 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:11.813 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:11.813 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:11.813 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:11.813 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:11.813 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:11.813 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:11.813 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:11.814 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:11.814 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:11.814 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:11.814 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:11.814 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:11.814 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:11.814 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:11.814 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:11.814 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:11.814 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:11.814 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:11.815 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.815 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.815 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:11.815 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.815 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:11.815 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:11.815 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.815 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:11.815 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:11.815 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:11.815 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:11.815 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:11.816 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.816 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:11.816 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:11.816 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.816 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.816 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:11.816 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:11.816 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.816 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.816 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:11.816 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:11.816 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:11.817 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:11.817 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:11.817 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.817 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.817 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:11.817 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:11.817 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:11.817 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.817 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:11.817 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.817 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:11.818 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.818 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:11.818 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.818 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:11.818 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.818 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:11.818 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:11.818 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:11.818 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:11.818 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.818 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:11.818 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.819 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:11.819 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:11.819 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:11.819 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:11.819 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:11.819 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:11.819 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:11.819 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:11.819 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:11.819 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:11.819 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:11.820 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:11.820 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:11.820 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:11.820 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:11.820 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:11.820 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:11.820 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:11.820 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:11.820 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:11.820 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:11.820 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:11.821 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:11.821 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:11.821 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:11.821 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:11.821 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:11.821 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:11.821 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:11.821 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:11.821 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:11.822 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:11.822 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:11.822 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:11.822 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:11.822 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:11.822 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:11.822 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:11.822 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:11.822 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:11.822 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.822 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.822 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:11.823 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:11.823 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.823 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:11.823 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.823 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:11.823 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:11.823 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:11.823 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:11.823 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:11.823 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:11.823 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:11.824 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:11.824 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:11.824 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:11.824 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:11.824 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:11.824 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:11.824 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.824 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:11.824 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:11.824 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:11.824 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:11.824 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:11.825 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:11.825 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:11.825 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:11.825 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:11.825 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:11.825 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:11.825 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.825 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.825 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:11.825 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:11.825 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:11.826 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:11.826 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:11.826 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.826 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.826 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:11.826 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:11.826 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:11.826 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:11.826 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:11.826 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.826 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:11.826 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:11.827 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:11.827 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:11.827 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:11.827 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:11.827 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.827 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:11.827 INFO:teuthology.orchestra.run.smithi012.stdout:________________ ERROR at teardown of test_put_excess_val_tags _________________ 2023-10-05T12:49:11.827 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.827 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:11.827 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.827 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:11.827 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:11.828 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.828 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:11.828 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:11.828 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:11.828 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:11.828 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:11.828 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.828 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:11.828 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:11.828 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.828 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.829 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:11.829 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:11.829 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.829 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.829 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:11.829 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.829 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:11.829 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:11.829 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.829 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.829 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:11.829 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:11.830 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.830 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:11.830 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:11.830 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:11.830 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:11.830 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:11.830 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:11.830 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:11.830 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.830 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:11.830 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:11.830 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:11.831 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:11.831 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:11.831 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:11.831 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:11.831 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:11.831 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:11.831 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.831 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:11.831 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:11.831 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:11.831 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:11.832 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.832 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:11.832 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:11.832 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:11.832 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:11.832 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.832 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.832 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:11.832 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:11.832 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:11.832 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:11.832 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.833 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.833 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:11.833 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:11.833 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:11.833 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.833 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:11.833 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.833 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:11.833 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:11.833 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.833 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:11.833 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:11.834 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:11.834 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:11.834 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:11.834 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:11.834 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.834 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:11.834 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.834 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:11.834 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.834 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:11.834 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:11.835 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.835 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:11.835 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.835 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:11.835 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:11.835 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:11.835 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:11.835 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:11.835 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:11.835 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:11.835 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:11.835 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:11.836 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:11.836 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:11.836 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:11.836 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:11.836 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.836 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:11.836 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:11.836 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:11.836 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:11.836 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:11.836 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:11.837 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:11.837 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:11.837 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:11.837 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:11.837 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:11.837 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.837 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.837 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:11.837 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.837 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:11.837 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:11.837 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:11.838 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:11.838 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:11.838 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:11.838 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:11.838 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:11.838 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:11.838 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:11.838 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:11.838 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:11.838 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:11.838 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:11.839 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:11.839 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:11.839 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:11.839 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:11.839 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:11.839 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:11.839 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:11.839 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:11.839 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:11.839 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:11.839 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:11.839 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:11.840 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:11.840 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:11.840 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.840 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.840 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:11.840 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.840 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:11.840 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:11.840 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.840 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:11.840 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:11.841 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:11.841 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:11.841 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:11.841 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.841 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:11.841 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:11.841 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.841 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.841 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:11.841 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:11.841 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.841 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.842 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:11.842 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:11.842 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:11.842 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:11.842 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:11.842 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.842 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.842 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:11.842 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:11.842 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:11.842 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.843 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:11.843 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.843 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:11.843 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.843 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:11.843 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.843 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:11.843 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.843 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:11.843 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:11.843 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:11.843 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:11.844 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.844 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:11.844 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.844 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:11.844 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:11.844 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:11.844 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:11.844 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:11.844 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:11.844 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:11.844 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:11.844 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:11.845 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:11.845 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:11.845 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:11.845 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:11.845 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:11.845 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:11.845 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:11.845 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:11.845 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:11.845 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:11.845 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:11.846 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:11.846 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:11.846 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:11.846 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:11.846 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:11.846 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:11.846 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:11.846 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:11.846 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:11.846 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:11.846 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:11.846 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:11.847 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:11.847 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:11.847 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:11.847 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:11.847 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:11.847 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:11.847 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:11.847 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:11.847 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.847 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.847 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:11.848 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:11.848 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.848 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:11.848 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.848 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:11.848 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:11.848 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:11.848 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:11.848 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:11.848 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:11.848 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:11.848 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:11.849 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:11.849 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:11.849 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:11.849 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:11.849 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:11.849 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.849 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:11.849 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:11.849 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:11.849 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:11.849 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:11.849 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:11.850 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:11.850 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:11.850 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:11.850 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:11.850 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:11.850 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.850 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.850 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:11.850 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:11.850 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:11.851 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:11.851 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:11.851 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.851 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.851 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:11.851 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:11.851 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:11.851 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:11.851 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:11.851 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.851 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:11.851 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:11.852 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:11.852 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:11.852 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:11.852 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:11.852 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.852 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:11.852 INFO:teuthology.orchestra.run.smithi012.stdout:__________________ ERROR at teardown of test_put_modify_tags ___________________ 2023-10-05T12:49:11.852 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.852 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:11.852 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.852 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:11.853 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:11.853 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.853 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:11.853 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:11.853 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:11.853 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:11.853 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:11.853 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.853 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:11.853 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:11.853 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.854 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.854 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:11.854 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:11.854 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.854 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.854 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:11.854 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.854 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:11.854 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:11.854 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.854 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.854 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:11.855 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:11.855 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.855 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:11.855 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:11.855 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:11.855 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:11.855 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:11.855 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:11.855 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:11.855 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.855 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:11.856 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:11.856 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:11.856 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:11.856 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:11.856 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:11.856 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:11.856 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:11.856 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:11.856 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.856 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:11.856 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:11.856 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:11.857 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:11.857 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.857 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:11.857 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:11.857 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:11.857 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:11.857 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.857 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.857 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:11.857 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:11.857 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:11.857 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:11.858 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.858 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.858 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:11.858 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:11.858 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:11.858 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.858 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:11.858 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.858 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:11.858 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:11.858 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.859 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:11.859 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:11.859 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:11.859 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:11.859 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:11.859 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:11.859 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.859 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:11.859 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.861 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:11.861 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.861 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:11.861 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:11.861 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.861 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:11.861 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.861 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:11.862 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:11.862 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:11.862 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:11.862 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:11.862 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:11.862 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:11.862 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:11.862 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:11.862 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:11.862 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:11.862 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:11.863 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:11.863 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.863 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:11.863 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:11.863 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:11.863 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:11.863 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:11.863 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:11.863 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:11.863 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:11.863 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:11.863 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:11.864 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:11.864 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.864 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.864 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:11.864 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.864 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:11.864 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:11.864 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:11.864 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:11.864 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:11.864 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:11.864 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:11.865 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:11.865 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:11.865 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:11.865 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:11.865 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:11.865 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:11.865 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:11.865 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:11.865 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:11.865 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:11.865 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:11.865 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:11.865 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:11.866 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:11.866 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:11.866 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:11.866 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:11.866 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:11.866 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:11.866 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:11.866 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:11.866 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.866 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.866 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:11.867 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.867 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:11.867 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:11.867 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.867 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:11.867 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:11.867 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:11.867 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:11.867 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:11.867 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.867 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:11.868 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:11.868 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.868 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.868 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:11.868 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:11.868 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.868 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.868 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:11.868 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:11.868 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:11.868 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:11.868 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:11.869 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.869 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.869 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:11.869 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:11.869 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:11.869 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.869 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:11.869 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.869 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:11.869 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.869 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:11.869 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.870 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:11.870 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.870 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:11.870 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:11.870 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:11.870 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:11.870 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.870 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:11.870 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.870 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:11.870 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:11.871 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:11.871 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:11.871 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:11.871 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:11.871 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:11.871 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:11.871 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:11.871 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:11.871 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:11.871 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:11.871 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:11.871 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:11.872 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:11.872 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:11.872 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:11.872 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:11.872 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:11.872 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:11.872 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:11.872 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:11.872 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:11.872 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:11.872 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:11.873 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:11.873 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:11.873 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:11.873 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:11.873 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:11.873 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:11.873 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:11.873 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:11.873 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:11.873 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:11.873 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:11.873 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:11.874 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:11.874 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:11.874 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:11.874 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.874 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.874 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:11.874 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:11.874 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.874 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:11.874 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.874 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:11.875 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:11.875 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:11.875 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:11.875 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:11.875 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:11.875 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:11.875 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:11.875 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:11.875 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:11.875 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:11.875 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:11.875 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:11.876 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.876 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:11.876 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:11.876 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:11.876 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:11.876 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:11.876 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:11.876 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:11.876 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:11.876 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:11.876 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:11.876 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:11.877 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.877 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.877 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:11.877 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:11.877 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:11.877 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:11.877 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:11.877 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.877 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.877 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:11.877 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:11.878 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:11.878 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:11.878 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:11.878 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.878 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:11.878 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:11.878 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:11.878 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:11.878 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:11.878 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:11.878 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.879 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:11.879 INFO:teuthology.orchestra.run.smithi012.stdout:__________________ ERROR at teardown of test_put_delete_tags ___________________ 2023-10-05T12:49:11.879 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.879 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:11.879 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.879 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:11.879 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:11.879 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.879 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:11.879 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:11.879 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:11.879 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:11.880 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:11.880 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.880 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:11.880 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:11.880 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.880 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.880 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:11.880 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:11.880 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.880 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.880 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:11.880 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.881 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:11.881 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:11.881 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.881 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.881 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:11.881 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:11.881 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.881 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:11.881 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:11.881 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:11.881 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:11.881 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:11.881 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:11.882 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:11.882 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.882 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:11.882 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:11.882 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:11.882 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:11.882 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:11.882 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:11.882 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:11.882 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:11.883 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:11.883 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.883 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:11.883 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:11.883 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:11.883 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:11.883 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.883 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:11.883 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:11.883 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:11.883 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:11.883 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.884 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.884 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:11.884 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:11.884 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:11.884 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:11.884 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.884 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.884 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:11.884 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:11.884 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:11.884 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.884 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:11.885 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.885 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:11.885 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:11.885 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.885 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:11.885 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:11.885 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:11.885 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:11.885 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:11.885 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:11.885 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.886 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:11.886 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.886 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:11.886 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.886 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:11.886 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:11.886 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.886 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:11.886 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.886 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:11.886 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:11.887 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:11.887 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:11.887 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:11.887 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:11.887 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:11.887 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:11.887 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:11.887 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:11.887 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:11.887 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:11.887 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:11.887 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.888 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:11.888 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:11.888 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:11.888 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:11.888 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:11.888 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:11.888 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:11.888 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:11.888 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:11.888 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:11.888 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:11.889 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.889 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.889 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:11.889 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.889 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:11.889 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:11.889 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:11.889 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:11.889 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:11.889 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:11.889 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:11.889 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:11.890 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:11.890 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:11.890 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:11.890 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:11.890 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:11.890 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:11.890 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:11.890 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:11.890 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:11.890 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:11.890 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:11.890 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:11.891 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:11.891 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:11.891 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:11.891 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:11.891 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:11.891 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:11.891 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:11.891 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:11.891 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.891 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.891 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:11.891 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.892 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:11.892 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:11.892 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.892 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:11.892 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:11.892 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:11.892 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:11.892 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:11.892 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.892 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:11.892 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:11.892 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.893 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.893 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:11.893 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:11.893 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.893 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.893 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:11.893 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:11.893 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:11.893 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:11.893 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:11.893 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.894 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.894 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:11.894 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:11.894 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:11.894 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.894 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:11.894 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.894 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:11.894 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.894 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:11.894 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.895 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:11.895 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.895 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:11.895 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:11.895 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:11.895 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:11.895 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.895 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:11.895 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.895 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:11.895 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:11.896 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:11.896 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:11.896 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:11.896 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:11.896 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:11.896 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:11.896 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:11.896 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:11.896 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:11.896 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:11.896 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:11.896 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:11.897 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:11.897 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:11.897 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:11.897 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:11.897 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:11.897 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:11.897 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:11.897 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:11.897 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:11.897 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:11.898 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:11.898 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:11.898 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:11.898 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:11.898 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:11.898 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:11.898 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:11.898 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:11.898 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:11.898 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:11.898 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:11.899 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:11.899 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:11.899 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:11.899 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:11.899 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:11.899 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.899 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.899 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:11.899 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:11.899 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.899 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:11.899 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.900 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:11.900 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:11.900 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:11.900 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:11.900 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:11.900 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:11.900 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:11.900 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:11.900 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:11.900 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:11.900 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:11.900 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:11.900 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:11.901 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.901 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:11.901 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:11.901 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:11.901 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:11.901 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:11.901 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:11.901 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:11.901 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:11.901 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:11.901 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:11.901 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:11.902 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.902 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.902 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:11.902 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:11.902 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:11.902 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:11.902 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:11.902 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.902 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.902 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:11.902 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:11.903 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:11.903 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:11.903 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:11.903 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.903 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:11.903 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:11.903 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:11.903 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:11.903 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:11.903 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:11.903 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.903 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:11.903 INFO:teuthology.orchestra.run.smithi012.stdout:_________ ERROR at teardown of test_post_object_tags_anonymous_request _________ 2023-10-05T12:49:11.904 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.904 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:11.904 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.904 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:11.904 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:11.904 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.904 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:11.904 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:11.904 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:11.904 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:11.904 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:11.904 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.905 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:11.905 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:11.905 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.905 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.905 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:11.905 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:11.905 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.905 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.905 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:11.905 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.905 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:11.905 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:11.906 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.906 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.906 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:11.906 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:11.906 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.906 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:11.906 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:11.906 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:11.906 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:11.906 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:11.906 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:11.907 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:11.907 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.907 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:11.907 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:11.907 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:11.907 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:11.907 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:11.907 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:11.907 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:11.907 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:11.907 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:11.907 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.908 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:11.908 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:11.908 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:11.908 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:11.908 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.908 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:11.908 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:11.908 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:11.908 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:11.908 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.908 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.908 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:11.908 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:11.909 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:11.909 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:11.909 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.909 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.909 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:11.909 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:11.909 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:11.909 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.909 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:11.909 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.909 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:11.909 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:11.910 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.910 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:11.910 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:11.910 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:11.910 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:11.910 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:11.910 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:11.910 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.910 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:11.910 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.910 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:11.910 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.911 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:11.911 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:11.911 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.911 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:11.911 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.911 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:11.911 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:11.911 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:11.911 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:11.911 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:11.911 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:11.911 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:11.911 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:11.912 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:11.912 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:11.912 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:11.912 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:11.912 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:11.912 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.912 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:11.912 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:11.912 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:11.912 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:11.912 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:11.912 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:11.913 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:11.913 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:11.913 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:11.913 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:11.913 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:11.913 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.913 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.913 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:11.913 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.913 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:11.913 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:11.913 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:11.914 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:11.914 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:11.914 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:11.914 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:11.914 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:11.914 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:11.914 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:11.914 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:11.914 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:11.914 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:11.914 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:11.914 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:11.915 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:11.915 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:11.915 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:11.915 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:11.915 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:11.915 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:11.915 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:11.915 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:11.915 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:11.915 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:11.915 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:11.915 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:11.915 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:11.916 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.916 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.916 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:11.916 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.916 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:11.916 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:11.916 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.916 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:11.916 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:11.916 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:11.916 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:11.916 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:11.917 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.917 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:11.917 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:11.917 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.917 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.917 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:11.917 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:11.917 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.917 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.917 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:11.917 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:11.917 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:11.918 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:11.918 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:11.918 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.918 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.918 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:11.918 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:11.918 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:11.918 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.918 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:11.918 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.918 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:11.918 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.919 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:11.919 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.919 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:11.919 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.919 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:11.919 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:11.919 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:11.919 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:11.919 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.919 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:11.919 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.919 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:11.920 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:11.920 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:11.920 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:11.920 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:11.920 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:11.920 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:11.920 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:11.920 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:11.920 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:11.920 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:11.920 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:11.920 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:11.920 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:11.921 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:11.921 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:11.921 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:11.921 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:11.921 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:11.921 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:11.921 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:11.921 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:11.921 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:11.921 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:11.921 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:11.921 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:11.921 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:11.922 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:11.922 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:11.922 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:11.922 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:11.922 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:11.922 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:11.922 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:11.922 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:11.922 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:11.922 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:11.922 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:11.922 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:11.923 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:11.923 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.923 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.923 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:11.923 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:11.923 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.923 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:11.923 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.923 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:11.923 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:11.923 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:11.923 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:11.923 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:11.924 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:11.924 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:11.924 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:11.924 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:11.924 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:11.924 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:11.924 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:11.924 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:11.924 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.924 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:11.924 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:11.924 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:11.924 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:11.924 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:11.925 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:11.925 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:11.925 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:11.925 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:11.925 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:11.925 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:11.925 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.925 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.925 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:11.925 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:11.925 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:11.925 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:11.926 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:11.926 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.926 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.926 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:11.926 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:11.926 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:11.926 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:11.926 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:11.926 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.926 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:11.926 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:11.926 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:11.927 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:11.927 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:11.927 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:11.927 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.927 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:11.927 INFO:teuthology.orchestra.run.smithi012.stdout:_______ ERROR at teardown of test_post_object_tags_authenticated_request _______ 2023-10-05T12:49:11.927 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.927 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:11.927 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.927 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:11.927 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:11.927 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.928 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:11.928 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:11.928 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:11.928 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:11.928 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:11.928 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.928 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:11.928 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:11.928 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.928 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.928 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:11.928 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:11.928 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.929 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.929 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:11.929 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.929 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:11.929 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:11.929 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.929 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.929 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:11.929 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:11.929 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.929 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:11.929 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:11.930 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:11.930 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:11.930 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:11.930 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:11.930 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:11.930 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.930 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:11.930 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:11.930 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:11.930 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:11.930 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:11.930 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:11.931 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:11.931 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:11.931 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:11.931 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.931 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:11.931 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:11.931 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:11.931 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:11.931 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.931 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:11.931 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:11.931 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:11.931 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:11.931 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.932 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.932 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:11.932 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:11.932 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:11.932 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:11.932 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.932 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.932 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:11.932 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:11.932 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:11.932 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.932 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:11.933 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.933 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:11.933 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:11.933 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.933 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:11.933 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:11.933 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:11.933 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:11.933 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:11.933 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:11.933 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.933 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:11.934 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.934 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:11.934 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.934 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:11.934 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:11.934 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.934 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:11.934 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.934 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:11.934 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:11.934 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:11.934 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:11.935 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:11.935 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:11.935 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:11.935 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:11.935 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:11.935 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:11.935 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:11.935 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:11.935 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:11.935 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.935 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:11.936 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:11.936 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:11.936 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:11.936 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:11.936 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:11.936 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:11.936 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:11.936 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:11.936 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:11.936 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:11.936 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.936 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.936 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:11.937 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.937 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:11.937 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:11.937 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:11.937 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:11.937 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:11.937 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:11.937 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:11.937 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:11.937 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:11.937 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:11.937 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:11.938 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:11.938 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:11.938 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:11.938 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:11.938 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:11.938 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:11.938 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:11.938 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:11.938 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:11.938 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:11.938 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:11.939 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:11.939 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:11.939 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:11.939 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:11.939 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:11.939 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:11.939 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.939 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.939 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:11.939 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.939 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:11.939 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:11.939 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.940 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:11.940 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:11.940 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:11.940 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:11.940 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:11.940 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.940 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:11.940 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:11.940 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.940 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.940 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:11.941 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:11.941 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.941 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.941 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:11.941 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:11.941 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:11.941 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:11.941 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:11.941 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.941 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.941 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:11.941 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:11.942 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:11.942 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.942 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:11.942 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.942 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:11.942 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.942 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:11.942 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.942 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:11.942 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.942 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:11.943 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:11.943 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:11.943 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:11.943 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.943 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:11.943 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.943 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:11.943 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:11.943 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:11.943 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:11.943 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:11.943 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:11.944 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:11.944 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:11.944 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:11.944 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:11.944 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:11.944 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:11.944 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:11.944 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:11.944 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:11.944 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:11.944 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:11.945 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:11.945 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:11.945 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:11.945 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:11.945 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:11.945 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:11.945 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:11.945 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:11.945 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:11.945 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:11.945 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:11.945 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:11.946 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:11.946 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:11.946 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:11.946 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:11.946 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:11.946 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:11.946 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:11.946 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:11.946 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:11.946 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:11.946 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:11.946 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.947 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.947 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:11.947 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:11.947 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.947 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:11.947 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.947 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:11.947 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:11.947 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:11.947 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:11.947 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:11.947 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:11.948 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:11.948 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:11.948 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:11.948 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:11.948 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:11.948 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:11.948 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:11.948 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.948 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:11.948 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:11.948 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:11.948 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:11.949 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:11.949 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:11.949 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:11.949 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:11.949 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:11.949 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:11.949 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:11.949 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.949 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.949 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:11.949 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:11.950 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:11.950 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:11.950 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:11.950 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.950 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.950 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:11.950 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:11.950 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:11.950 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:11.950 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:11.950 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.950 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:11.951 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:11.951 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:11.951 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:11.951 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:11.951 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:11.951 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.951 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:11.951 INFO:teuthology.orchestra.run.smithi012.stdout:_________________ ERROR at teardown of test_put_obj_with_tags __________________ 2023-10-05T12:49:11.951 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.951 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:11.951 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.951 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:11.952 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:11.952 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.952 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:11.952 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:11.952 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:11.952 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:11.952 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:11.952 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.952 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:11.952 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:11.952 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.952 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.953 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:11.953 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:11.953 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.953 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.953 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:11.953 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.953 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:11.953 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:11.953 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.953 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.953 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:11.953 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:11.954 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.954 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:11.954 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:11.954 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:11.954 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:11.954 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:11.954 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:11.954 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:11.954 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.954 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:11.954 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:11.954 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:11.955 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:11.955 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:11.955 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:11.955 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:11.955 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:11.955 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:11.955 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.955 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:11.955 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:11.955 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:11.955 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:11.956 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.956 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:11.956 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:11.956 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:11.956 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:11.956 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.956 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.956 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:11.956 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:11.956 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:11.956 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:11.956 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.957 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.957 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:11.957 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:11.957 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:11.957 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.957 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:11.957 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.957 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:11.957 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:11.957 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.957 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:11.958 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:11.958 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:11.958 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:11.958 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:11.958 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:11.958 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.958 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:11.958 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.958 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:11.958 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.958 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:11.958 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:11.959 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.959 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:11.959 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.959 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:11.959 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:11.959 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:11.959 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:11.959 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:11.959 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:11.959 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:11.959 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:11.959 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:11.960 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:11.960 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:11.960 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:11.960 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:11.960 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.960 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:11.960 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:11.960 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:11.960 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:11.960 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:11.960 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:11.960 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:11.961 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:11.961 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:11.961 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:11.961 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:11.961 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.961 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.961 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:11.961 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.961 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:11.961 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:11.961 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:11.961 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:11.962 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:11.962 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:11.962 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:11.962 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:11.962 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:11.962 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:11.962 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:11.962 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:11.962 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:11.962 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:11.962 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:11.962 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:11.963 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:11.963 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:11.963 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:11.963 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:11.963 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:11.963 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:11.963 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:11.963 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:11.963 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:11.963 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:11.963 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:11.963 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:11.964 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.964 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.964 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:11.964 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.964 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:11.964 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:11.964 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.964 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:11.964 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:11.964 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:11.964 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:11.964 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:11.965 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.965 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:11.965 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:11.965 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.965 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.965 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:11.965 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:11.965 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.965 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.965 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:11.965 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:11.965 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:11.966 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:11.966 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:11.966 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.966 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.966 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:11.966 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:11.966 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:11.966 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.966 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:11.966 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.966 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:11.966 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.967 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:11.967 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.967 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:11.967 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.967 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:11.967 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:11.967 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:11.967 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:11.967 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.967 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:11.967 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.967 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:11.968 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:11.968 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:11.968 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:11.968 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:11.968 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:11.968 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:11.968 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:11.968 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:11.968 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:11.968 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:11.968 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:11.968 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:11.969 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:11.969 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:11.969 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:11.969 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:11.969 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:11.969 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:11.969 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:11.969 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:11.969 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:11.969 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:11.969 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:11.969 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:11.970 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:11.970 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:11.970 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:11.970 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:11.970 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:11.970 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:11.970 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:11.970 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:11.970 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:11.970 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:11.971 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:11.971 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:11.971 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:11.971 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:11.971 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:11.971 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.971 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.971 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:11.971 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:11.971 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.971 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:11.971 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.972 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:11.972 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:11.972 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:11.972 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:11.972 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:11.972 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:11.972 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:11.972 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:11.972 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:11.972 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:11.972 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:11.972 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:11.972 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:11.973 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.973 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:11.973 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:11.973 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:11.973 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:11.973 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:11.973 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:11.973 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:11.973 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:11.973 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:11.973 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:11.973 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:11.974 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.974 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.974 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:11.974 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:11.974 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:11.974 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:11.974 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:11.974 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.974 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.974 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:11.974 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:11.975 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:11.975 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:11.975 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:11.975 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.975 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:11.975 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:11.975 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:11.975 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:11.975 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:11.975 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:11.975 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.975 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:11.976 INFO:teuthology.orchestra.run.smithi012.stdout:________________ ERROR at teardown of test_get_tags_acl_public _________________ 2023-10-05T12:49:11.976 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.976 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:11.976 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.976 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:11.976 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:11.976 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.976 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:11.976 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:11.976 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:11.976 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:11.976 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:11.977 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.977 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:11.977 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:11.977 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.977 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.977 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:11.977 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:11.977 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.977 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.977 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:11.977 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.977 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:11.978 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:11.978 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.978 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.978 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:11.978 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:11.978 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.978 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:11.978 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:11.978 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:11.978 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:11.979 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:11.979 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:11.979 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:11.979 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.979 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:11.979 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:11.979 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:11.979 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:11.979 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:11.979 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:11.979 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:11.979 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:11.980 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:11.980 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.980 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:11.980 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:11.980 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:11.980 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:11.980 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.980 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:11.980 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:11.980 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:11.980 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:11.980 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.981 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.981 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:11.981 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:11.981 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:11.981 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:11.981 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.981 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.981 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:11.981 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:11.981 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:11.981 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.981 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:11.982 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.982 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:11.982 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:11.982 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.982 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:11.982 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:11.982 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:11.982 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:11.982 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:11.982 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:11.982 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.983 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:11.983 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.983 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:11.983 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.983 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:11.983 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:11.983 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.983 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:11.983 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.983 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:11.983 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:11.983 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:11.983 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:11.984 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:11.984 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:11.984 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:11.984 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:11.984 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:11.984 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:11.984 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:11.984 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:11.984 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:11.984 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.984 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:11.985 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:11.985 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:11.985 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:11.985 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:11.985 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:11.985 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:11.985 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:11.985 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:11.985 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:11.985 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:11.985 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.985 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.986 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:11.986 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.986 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:11.986 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:11.986 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:11.986 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:11.986 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:11.986 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:11.986 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:11.986 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:11.986 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:11.986 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:11.987 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:11.987 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:11.987 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:11.987 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:11.987 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:11.987 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:11.987 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:11.987 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:11.987 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:11.987 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:11.987 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:11.987 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:11.988 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:11.988 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:11.988 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:11.988 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:11.988 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:11.988 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:11.988 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.988 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.988 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:11.988 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.988 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:11.989 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:11.989 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.989 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:11.989 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:11.989 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:11.989 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:11.989 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:11.989 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.989 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:11.989 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:11.989 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.989 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.990 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:11.990 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:11.990 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.990 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.990 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:11.990 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:11.990 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:11.990 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:11.990 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:11.990 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.991 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.991 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:11.991 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:11.991 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:11.991 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.991 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:11.991 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.991 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:11.991 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.991 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:11.991 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.991 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:11.992 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.992 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:11.992 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:11.992 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:11.992 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:11.992 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.992 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:11.992 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.992 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:11.992 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:11.992 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:11.992 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:11.993 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:11.993 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:11.993 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:11.993 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:11.993 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:11.993 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:11.993 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:11.993 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:11.993 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:11.993 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:11.993 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:11.993 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:11.994 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:11.994 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:11.994 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:11.994 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:11.994 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:11.994 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:11.994 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:11.994 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:11.994 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:11.994 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:11.994 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:11.995 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:11.995 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:11.995 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:11.995 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:11.995 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:11.995 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:11.995 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:11.995 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:11.995 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:11.995 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:11.995 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:11.995 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:11.996 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:11.996 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:11.996 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.996 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:11.996 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:11.996 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.996 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:11.996 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:11.996 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:11.996 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:11.996 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:11.997 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:11.997 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:11.997 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:11.997 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:11.997 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:11.997 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:11.997 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:11.997 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:11.997 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:11.997 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:11.997 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.997 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:11.998 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:11.998 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:11.998 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:11.998 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:11.998 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:11.998 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:11.998 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:11.998 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:11.998 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:11.998 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:11.998 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.999 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.999 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:11.999 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:11.999 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:11.999 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:11.999 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:11.999 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:11.999 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:11.999 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:11.999 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:11.999 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:12.000 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:12.000 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:12.000 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.000 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:12.000 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:12.000 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:12.000 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:12.000 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:12.000 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:12.000 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.000 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:12.000 INFO:teuthology.orchestra.run.smithi012.stdout:________________ ERROR at teardown of test_put_tags_acl_public _________________ 2023-10-05T12:49:12.001 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.001 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:12.001 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.001 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:12.001 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:12.001 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.001 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:12.001 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:12.001 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:12.001 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:12.001 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:12.002 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.002 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:12.002 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:12.002 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.002 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.002 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:12.002 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:12.002 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.002 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.002 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:12.002 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.003 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:12.003 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:12.003 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.003 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.003 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:12.003 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:12.003 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.003 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:12.003 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:12.003 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:12.003 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:12.003 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:12.004 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:12.004 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:12.004 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.004 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:12.004 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:12.004 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:12.004 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:12.004 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:12.004 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:12.004 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:12.004 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:12.005 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:12.005 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.005 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:12.005 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:12.005 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:12.005 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:12.005 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.005 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:12.005 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:12.005 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:12.005 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:12.006 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.006 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.006 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:12.006 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:12.006 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:12.006 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:12.006 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.006 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.006 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:12.006 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:12.006 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:12.006 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.007 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:12.007 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.007 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:12.007 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:12.007 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.007 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:12.007 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:12.007 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:12.007 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:12.007 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:12.007 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:12.007 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.008 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:12.008 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.008 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:12.008 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.008 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:12.008 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:12.008 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.008 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:12.008 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.008 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:12.008 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:12.008 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:12.009 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:12.009 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:12.009 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:12.009 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:12.009 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:12.009 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:12.009 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:12.009 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:12.009 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:12.009 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:12.009 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.009 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:12.010 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:12.010 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:12.010 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:12.010 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:12.010 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:12.010 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:12.010 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:12.010 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:12.010 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:12.010 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:12.010 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.011 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.011 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:12.011 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.011 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:12.011 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:12.011 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:12.011 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:12.011 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:12.011 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:12.011 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:12.011 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:12.011 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:12.011 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:12.012 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:12.012 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:12.012 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:12.012 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:12.012 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:12.012 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:12.012 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:12.012 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:12.012 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:12.012 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:12.012 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:12.012 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:12.012 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:12.013 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:12.013 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:12.013 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:12.013 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:12.013 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:12.013 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.013 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.013 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:12.013 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.013 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:12.013 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:12.014 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.014 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:12.014 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:12.014 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:12.014 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:12.014 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:12.014 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.014 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:12.014 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:12.014 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.014 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.015 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:12.015 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:12.015 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.015 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.015 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:12.015 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:12.015 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:12.015 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:12.015 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:12.015 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.015 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.015 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:12.015 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:12.016 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:12.016 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.016 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:12.016 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.016 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:12.016 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.016 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:12.016 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.016 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:12.016 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.016 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:12.017 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:12.017 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:12.017 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:12.017 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.017 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:12.017 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.017 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:12.017 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:12.017 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:12.017 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:12.017 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:12.017 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:12.017 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:12.018 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:12.018 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:12.018 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:12.018 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:12.018 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:12.018 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:12.018 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:12.018 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:12.018 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:12.018 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:12.018 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:12.019 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:12.019 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:12.019 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:12.019 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:12.019 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:12.019 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:12.019 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:12.019 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:12.019 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:12.019 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:12.019 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:12.019 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:12.020 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:12.020 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:12.020 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:12.020 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:12.020 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:12.020 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:12.020 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:12.020 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:12.020 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:12.020 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:12.020 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.020 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.020 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:12.021 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:12.021 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.021 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:12.021 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.021 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:12.021 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:12.021 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:12.021 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:12.021 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:12.021 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:12.021 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:12.021 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:12.021 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:12.022 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:12.022 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:12.022 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:12.022 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:12.022 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.022 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:12.022 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:12.022 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:12.022 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:12.022 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:12.022 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:12.022 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:12.023 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:12.023 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:12.023 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:12.023 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:12.023 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.023 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.023 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:12.023 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:12.023 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:12.023 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:12.023 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:12.023 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.023 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.024 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:12.024 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:12.024 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:12.024 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:12.024 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:12.024 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.024 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:12.024 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:12.024 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:12.024 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:12.024 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:12.024 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:12.024 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.025 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:12.025 INFO:teuthology.orchestra.run.smithi012.stdout:_______________ ERROR at teardown of test_delete_tags_obj_public _______________ 2023-10-05T12:49:12.025 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.025 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:12.025 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.025 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:12.025 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:12.025 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.025 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:12.025 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:12.025 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:12.025 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:12.025 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:12.026 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.026 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:12.026 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:12.026 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.026 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.026 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:12.026 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:12.026 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.026 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.026 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:12.026 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.026 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:12.026 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:12.027 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.027 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.027 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:12.027 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:12.027 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.027 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:12.027 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:12.027 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:12.027 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:12.027 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:12.027 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:12.027 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:12.027 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.028 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:12.028 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:12.028 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:12.028 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:12.028 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:12.028 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:12.028 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:12.028 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:12.028 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:12.028 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.028 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:12.029 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:12.029 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:12.029 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:12.029 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.029 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:12.029 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:12.029 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:12.029 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:12.029 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.029 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.029 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:12.029 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:12.030 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:12.030 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:12.030 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.030 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.030 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:12.030 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:12.030 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:12.030 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.030 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:12.030 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.030 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:12.030 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:12.031 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.031 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:12.031 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:12.031 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:12.031 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:12.031 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:12.031 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:12.031 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.031 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:12.031 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.032 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:12.032 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.032 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:12.032 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:12.032 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.032 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:12.032 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.032 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:12.032 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:12.032 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:12.032 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:12.032 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:12.033 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:12.033 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:12.033 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:12.033 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:12.033 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:12.033 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:12.033 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:12.033 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:12.033 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.033 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:12.033 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:12.034 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:12.034 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:12.034 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:12.034 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:12.034 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:12.034 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:12.034 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:12.034 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:12.034 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:12.034 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.034 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.035 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:12.035 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.035 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:12.035 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:12.035 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:12.035 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:12.035 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:12.035 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:12.035 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:12.035 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:12.035 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:12.035 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:12.036 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:12.036 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:12.036 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:12.036 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:12.036 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:12.036 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:12.036 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:12.036 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:12.036 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:12.036 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:12.036 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:12.036 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:12.037 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:12.037 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:12.037 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:12.037 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:12.037 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:12.037 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:12.037 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.037 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.037 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:12.037 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.037 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:12.037 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:12.038 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.038 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:12.038 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:12.038 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:12.038 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:12.038 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:12.038 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.038 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:12.038 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:12.038 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.038 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.038 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:12.039 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:12.039 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.039 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.039 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:12.039 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:12.039 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:12.039 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:12.039 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:12.039 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.039 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.039 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:12.039 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:12.040 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:12.040 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.040 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:12.040 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.040 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:12.040 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.040 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:12.040 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.040 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:12.040 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.040 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:12.040 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:12.041 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:12.041 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:12.041 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.041 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:12.041 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.041 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:12.041 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:12.041 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:12.041 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:12.041 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:12.041 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:12.042 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:12.042 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:12.042 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:12.042 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:12.042 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:12.042 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:12.042 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:12.042 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:12.042 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:12.042 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:12.042 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:12.043 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:12.043 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:12.043 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:12.043 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:12.043 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:12.043 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:12.043 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:12.043 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:12.043 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:12.043 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:12.043 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:12.043 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:12.044 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:12.044 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:12.044 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:12.044 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:12.044 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:12.044 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:12.044 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:12.044 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:12.044 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:12.044 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:12.044 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:12.044 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.044 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.045 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:12.045 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:12.045 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.045 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:12.045 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.045 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:12.045 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:12.045 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:12.045 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:12.045 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:12.045 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:12.045 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:12.045 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:12.046 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:12.046 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:12.046 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:12.046 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:12.046 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:12.046 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.046 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:12.046 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:12.046 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:12.046 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:12.046 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:12.047 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:12.047 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:12.047 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:12.047 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:12.047 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:12.047 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:12.047 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.047 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.047 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:12.047 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:12.047 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:12.047 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:12.047 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:12.048 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.048 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.048 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:12.048 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:12.048 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:12.048 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:12.048 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:12.048 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.048 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:12.048 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:12.048 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:12.048 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:12.049 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:12.049 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:12.049 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.049 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:12.049 INFO:teuthology.orchestra.run.smithi012.stdout:_ ERROR at teardown of test_versioning_bucket_atomic_upload_return_version_id __ 2023-10-05T12:49:12.049 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.049 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:12.049 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.049 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:12.049 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:12.049 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.049 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:12.050 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:12.050 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:12.050 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:12.050 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:12.050 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.050 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:12.050 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:12.050 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.050 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.050 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:12.050 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:12.050 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.051 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.051 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:12.051 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.051 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:12.051 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:12.051 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.051 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.051 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:12.051 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:12.051 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.052 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:12.052 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:12.052 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:12.052 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:12.052 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:12.052 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:12.052 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:12.052 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.052 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:12.052 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:12.052 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:12.052 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:12.053 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:12.053 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:12.053 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:12.053 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:12.053 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:12.053 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.053 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:12.053 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:12.053 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:12.053 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:12.053 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.053 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:12.053 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:12.054 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:12.054 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:12.054 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.054 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.054 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:12.054 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:12.054 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:12.054 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:12.054 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.054 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.054 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:12.055 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:12.055 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:12.055 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.055 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:12.055 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.055 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:12.055 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:12.055 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.055 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:12.055 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:12.055 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:12.055 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:12.055 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:12.056 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:12.056 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.056 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:12.056 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.056 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:12.056 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.056 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:12.056 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:12.056 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.056 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:12.056 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.056 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:12.056 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:12.057 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:12.057 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:12.057 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:12.057 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:12.057 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:12.057 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:12.057 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:12.057 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:12.057 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:12.057 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:12.057 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:12.057 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.058 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:12.058 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:12.058 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:12.058 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:12.058 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:12.058 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:12.058 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:12.058 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:12.058 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:12.058 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:12.058 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:12.059 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.059 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.059 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:12.059 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.059 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:12.059 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:12.059 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:12.059 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:12.059 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:12.059 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:12.059 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:12.059 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:12.059 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:12.060 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:12.060 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:12.060 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:12.060 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:12.060 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:12.060 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:12.060 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:12.060 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:12.060 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:12.060 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:12.060 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:12.061 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:12.061 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:12.061 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:12.061 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:12.061 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:12.061 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:12.061 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:12.061 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:12.061 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.061 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.061 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:12.061 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.062 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:12.062 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:12.062 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.062 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:12.062 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:12.062 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:12.062 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:12.062 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:12.062 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.062 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:12.062 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:12.063 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.063 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.063 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:12.063 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:12.063 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.063 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.063 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:12.063 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:12.063 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:12.065 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:12.065 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:12.065 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.065 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.065 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:12.065 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:12.065 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:12.065 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.065 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:12.065 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.065 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:12.066 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.066 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:12.066 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.066 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:12.066 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.066 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:12.066 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:12.066 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:12.066 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:12.066 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.066 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:12.067 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.067 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:12.067 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:12.067 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:12.067 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:12.067 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:12.067 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:12.067 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:12.067 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:12.067 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:12.067 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:12.068 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:12.068 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:12.068 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:12.068 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:12.068 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:12.068 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:12.068 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:12.068 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:12.068 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:12.068 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:12.068 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:12.068 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:12.069 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:12.069 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:12.069 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:12.069 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:12.069 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:12.069 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:12.069 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:12.069 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:12.069 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:12.069 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:12.069 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:12.069 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:12.070 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:12.070 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:12.070 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:12.070 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:12.070 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:12.070 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:12.070 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.070 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.070 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:12.070 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:12.070 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.071 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:12.071 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.071 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:12.071 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:12.071 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:12.071 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:12.071 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:12.071 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:12.071 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:12.071 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:12.071 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:12.072 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:12.072 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:12.072 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:12.072 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:12.072 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.072 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:12.072 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:12.072 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:12.072 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:12.072 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:12.072 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:12.072 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:12.073 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:12.073 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:12.073 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:12.073 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:12.073 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.073 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.073 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:12.073 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:12.073 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:12.073 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:12.073 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:12.073 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.073 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.074 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:12.074 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:12.074 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:12.074 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:12.074 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:12.074 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.074 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:12.074 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:12.074 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:12.074 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:12.074 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:12.075 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:12.075 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.075 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:12.075 INFO:teuthology.orchestra.run.smithi012.stdout:_ ERROR at teardown of test_versioning_bucket_multipart_upload_return_version_id _ 2023-10-05T12:49:12.075 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.075 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:12.075 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.075 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:12.075 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:12.075 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.075 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:12.075 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:12.076 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:12.076 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:12.076 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:12.076 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.076 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:12.076 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:12.076 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.076 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.076 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:12.076 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:12.076 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.076 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.076 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:12.077 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.077 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:12.077 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:12.077 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.077 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.077 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:12.077 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:12.077 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.077 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:12.077 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:12.077 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:12.077 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:12.077 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:12.078 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:12.078 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:12.078 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.078 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:12.078 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:12.078 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:12.078 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:12.078 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:12.078 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:12.078 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:12.078 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:12.078 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:12.079 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.079 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:12.079 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:12.079 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:12.079 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:12.079 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.079 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:12.079 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:12.079 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:12.079 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:12.079 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.079 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.080 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:12.080 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:12.080 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:12.080 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:12.080 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.080 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.080 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:12.080 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:12.080 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:12.080 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.080 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:12.080 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.080 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:12.081 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:12.081 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.081 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:12.081 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:12.081 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:12.081 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:12.081 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:12.081 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:12.081 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.081 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:12.081 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.081 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:12.081 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.082 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:12.082 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:12.082 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.082 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:12.082 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.082 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:12.082 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:12.082 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:12.082 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:12.082 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:12.082 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:12.082 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:12.083 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:12.083 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:12.083 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:12.083 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:12.083 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:12.083 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:12.083 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.083 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:12.083 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:12.083 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:12.083 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:12.083 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:12.083 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:12.084 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:12.084 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:12.084 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:12.084 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:12.084 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:12.084 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.084 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.084 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:12.084 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.084 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:12.084 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:12.084 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:12.085 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:12.085 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:12.085 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:12.085 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:12.085 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:12.085 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:12.085 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:12.085 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:12.085 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:12.085 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:12.085 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:12.085 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:12.085 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:12.086 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:12.086 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:12.086 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:12.086 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:12.086 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:12.086 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:12.086 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:12.086 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:12.086 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:12.086 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:12.086 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:12.086 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:12.087 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.087 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.087 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:12.087 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.087 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:12.087 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:12.087 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.087 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:12.087 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:12.087 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:12.087 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:12.087 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:12.088 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.088 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:12.088 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:12.088 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.088 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.088 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:12.088 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:12.088 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.088 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.088 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:12.088 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:12.089 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:12.089 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:12.089 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:12.089 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.089 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.089 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:12.089 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:12.089 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:12.089 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.089 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:12.089 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.089 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:12.090 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.090 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:12.090 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.090 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:12.090 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.090 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:12.090 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:12.090 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:12.090 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:12.090 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.090 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:12.090 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.090 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:12.091 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:12.091 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:12.091 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:12.091 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:12.091 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:12.091 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:12.091 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:12.091 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:12.091 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:12.091 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:12.091 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:12.091 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:12.092 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:12.092 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:12.092 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:12.092 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:12.092 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:12.092 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:12.092 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:12.092 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:12.092 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:12.092 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:12.092 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:12.092 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:12.092 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:12.093 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:12.093 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:12.093 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:12.093 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:12.093 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:12.093 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:12.093 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:12.093 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:12.093 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:12.093 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:12.093 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:12.093 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:12.093 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:12.094 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:12.094 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.094 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.094 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:12.094 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:12.094 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.094 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:12.094 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.094 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:12.094 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:12.094 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:12.094 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:12.094 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:12.095 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:12.095 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:12.095 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:12.095 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:12.095 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:12.095 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:12.095 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:12.095 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:12.095 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.095 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:12.095 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:12.095 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:12.095 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:12.096 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:12.096 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:12.096 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:12.096 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:12.096 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:12.096 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:12.096 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:12.096 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.096 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.096 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:12.096 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:12.096 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:12.096 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:12.097 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:12.097 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.097 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.097 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:12.097 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:12.097 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:12.097 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:12.097 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:12.097 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.097 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:12.097 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:12.097 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:12.097 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:12.098 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:12.098 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:12.098 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.098 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:12.098 INFO:teuthology.orchestra.run.smithi012.stdout:_________ ERROR at teardown of test_bucket_policy_get_obj_existing_tag _________ 2023-10-05T12:49:12.098 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.098 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:12.098 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.098 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:12.098 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:12.098 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.098 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:12.099 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:12.099 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:12.099 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:12.099 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:12.099 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.099 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:12.099 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:12.099 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.099 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.099 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:12.099 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:12.100 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.100 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.100 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:12.100 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.100 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:12.100 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:12.100 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.100 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.100 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:12.100 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:12.100 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.100 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:12.101 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:12.101 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:12.101 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:12.101 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:12.101 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:12.101 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:12.101 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.101 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:12.101 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:12.101 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:12.101 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:12.101 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:12.102 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:12.102 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:12.102 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:12.102 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:12.102 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.102 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:12.102 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:12.102 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:12.102 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:12.102 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.103 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:12.103 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:12.103 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:12.103 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:12.103 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.103 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.103 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:12.103 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:12.103 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:12.103 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:12.103 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.104 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.104 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:12.104 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:12.104 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:12.104 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.104 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:12.104 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.104 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:12.104 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:12.104 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.104 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:12.104 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:12.105 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:12.105 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:12.105 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:12.105 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:12.105 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.105 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:12.105 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.105 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:12.105 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.105 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:12.105 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:12.105 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.106 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:12.106 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.106 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:12.106 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:12.106 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:12.106 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:12.106 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:12.106 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:12.106 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:12.106 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:12.106 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:12.107 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:12.107 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:12.107 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:12.107 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:12.107 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.107 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:12.107 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:12.107 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:12.107 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:12.107 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:12.107 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:12.107 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:12.108 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:12.108 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:12.108 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:12.108 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:12.108 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.108 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.108 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:12.108 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.108 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:12.108 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:12.109 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:12.109 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:12.109 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:12.109 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:12.109 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:12.109 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:12.109 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:12.109 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:12.109 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:12.109 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:12.109 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:12.109 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:12.110 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:12.110 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:12.110 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:12.110 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:12.110 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:12.110 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:12.110 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:12.110 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:12.110 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:12.110 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:12.110 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:12.110 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:12.111 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:12.111 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:12.111 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.111 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.111 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:12.111 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.111 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:12.111 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:12.111 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.111 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:12.111 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:12.111 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:12.112 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:12.112 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:12.112 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.112 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:12.112 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:12.112 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.112 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.112 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:12.112 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:12.112 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.112 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.113 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:12.113 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:12.113 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:12.113 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:12.113 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:12.113 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.113 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.113 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:12.113 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:12.113 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:12.113 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.113 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:12.113 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.114 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:12.114 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.114 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:12.114 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.114 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:12.114 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.114 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:12.114 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:12.114 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:12.114 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:12.114 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.114 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:12.115 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.115 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:12.115 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:12.115 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:12.115 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:12.115 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:12.115 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:12.115 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:12.115 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:12.115 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:12.115 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:12.115 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:12.115 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:12.116 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:12.116 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:12.116 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:12.116 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:12.116 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:12.116 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:12.116 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:12.116 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:12.116 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:12.116 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:12.116 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:12.116 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:12.117 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:12.117 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:12.117 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:12.117 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:12.117 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:12.117 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:12.117 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:12.117 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:12.117 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:12.117 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:12.117 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:12.118 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:12.118 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:12.118 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:12.118 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:12.118 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:12.118 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.118 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.118 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:12.118 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:12.118 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.119 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:12.119 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.119 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:12.119 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:12.119 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:12.119 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:12.119 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:12.119 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:12.119 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:12.119 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:12.119 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:12.119 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:12.120 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:12.120 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:12.120 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:12.120 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.120 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:12.120 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:12.120 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:12.120 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:12.120 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:12.120 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:12.120 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:12.121 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:12.121 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:12.121 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:12.121 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:12.121 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.121 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.121 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:12.121 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:12.121 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:12.121 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:12.121 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:12.121 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.122 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.122 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:12.122 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:12.122 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:12.122 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:12.122 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:12.122 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.122 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:12.122 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:12.122 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:12.122 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:12.123 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:12.123 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:12.123 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.123 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:12.123 INFO:teuthology.orchestra.run.smithi012.stdout:_____ ERROR at teardown of test_bucket_policy_get_obj_tagging_existing_tag _____ 2023-10-05T12:49:12.123 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.123 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:12.123 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.123 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:12.123 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:12.123 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.124 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:12.124 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:12.124 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:12.124 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:12.124 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:12.124 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.124 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:12.124 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:12.124 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.124 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.124 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:12.124 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:12.125 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.125 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.125 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:12.125 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.125 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:12.125 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:12.125 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.125 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.125 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:12.125 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:12.125 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.125 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:12.125 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:12.126 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:12.126 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:12.126 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:12.126 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:12.126 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:12.126 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.126 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:12.126 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:12.126 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:12.126 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:12.126 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:12.127 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:12.127 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:12.127 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:12.127 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:12.127 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.127 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:12.127 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:12.127 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:12.127 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:12.127 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.127 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:12.127 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:12.128 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:12.128 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:12.128 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.128 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.128 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:12.128 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:12.128 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:12.128 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:12.128 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.128 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.128 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:12.128 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:12.129 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:12.129 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.129 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:12.129 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.129 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:12.129 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:12.129 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.129 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:12.129 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:12.129 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:12.129 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:12.130 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:12.130 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:12.130 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.130 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:12.130 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.130 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:12.130 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.130 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:12.130 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:12.130 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.130 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:12.130 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.131 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:12.131 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:12.131 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:12.131 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:12.131 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:12.131 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:12.131 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:12.131 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:12.131 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:12.131 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:12.131 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:12.131 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:12.132 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:12.132 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.132 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:12.132 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:12.132 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:12.132 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:12.132 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:12.132 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:12.132 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:12.132 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:12.132 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:12.133 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:12.133 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:12.133 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.133 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.133 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:12.133 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.133 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:12.133 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:12.133 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:12.133 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:12.133 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:12.133 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:12.134 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:12.134 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:12.134 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:12.134 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:12.134 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:12.134 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:12.134 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:12.134 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:12.134 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:12.134 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:12.134 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:12.135 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:12.135 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:12.135 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:12.135 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:12.135 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:12.135 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:12.135 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:12.135 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:12.135 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:12.135 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:12.135 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:12.135 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.136 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.136 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:12.136 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.136 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:12.136 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:12.136 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.136 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:12.136 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:12.136 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:12.136 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:12.136 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:12.137 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.137 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:12.137 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:12.137 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.137 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.137 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:12.137 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:12.137 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.137 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.137 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:12.137 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:12.137 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:12.137 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:12.138 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:12.138 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.138 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.138 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:12.138 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:12.138 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:12.138 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.138 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:12.138 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.138 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:12.139 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.139 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:12.139 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.139 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:12.139 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.139 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:12.139 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:12.139 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:12.139 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:12.139 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.139 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:12.139 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.140 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:12.140 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:12.140 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:12.140 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:12.140 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:12.140 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:12.140 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:12.140 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:12.140 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:12.140 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:12.140 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:12.140 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:12.141 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:12.141 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:12.141 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:12.141 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:12.141 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:12.141 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:12.141 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:12.141 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:12.141 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:12.141 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:12.141 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:12.141 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:12.141 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:12.142 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:12.142 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:12.142 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:12.142 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:12.142 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:12.142 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:12.142 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:12.142 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:12.142 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:12.142 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:12.142 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:12.143 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:12.143 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:12.143 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:12.143 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:12.143 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.143 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.143 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:12.143 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:12.143 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.143 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:12.143 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.143 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:12.144 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:12.144 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:12.144 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:12.144 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:12.144 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:12.144 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:12.144 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:12.144 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:12.144 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:12.144 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:12.144 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:12.144 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:12.145 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.145 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:12.145 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:12.145 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:12.145 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:12.145 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:12.145 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:12.145 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:12.145 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:12.145 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:12.145 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:12.145 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:12.146 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.146 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.146 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:12.146 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:12.146 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:12.146 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:12.146 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:12.146 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.146 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.146 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:12.146 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:12.146 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:12.147 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:12.147 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:12.147 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.147 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:12.147 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:12.147 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:12.147 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:12.147 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:12.147 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:12.147 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.147 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:12.147 INFO:teuthology.orchestra.run.smithi012.stdout:_____ ERROR at teardown of test_bucket_policy_put_obj_tagging_existing_tag _____ 2023-10-05T12:49:12.148 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.148 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:12.148 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.148 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:12.148 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:12.148 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.148 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:12.148 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:12.148 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:12.148 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:12.148 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:12.149 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.149 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:12.149 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:12.149 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.149 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.149 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:12.149 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:12.149 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.149 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.149 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:12.149 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.149 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:12.150 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:12.150 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.150 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.150 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:12.150 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:12.150 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.150 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:12.150 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:12.150 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:12.150 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:12.150 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:12.150 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:12.151 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:12.151 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.151 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:12.151 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:12.151 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:12.151 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:12.151 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:12.151 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:12.151 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:12.151 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:12.151 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:12.151 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.152 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:12.152 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:12.152 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:12.152 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:12.152 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.152 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:12.152 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:12.152 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:12.152 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:12.152 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.152 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.152 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:12.153 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:12.153 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:12.153 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:12.153 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.153 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.153 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:12.153 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:12.153 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:12.153 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.153 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:12.153 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.154 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:12.154 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:12.154 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.154 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:12.154 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:12.154 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:12.154 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:12.154 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:12.154 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:12.154 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.154 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:12.155 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.155 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:12.155 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.155 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:12.155 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:12.155 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.155 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:12.155 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.155 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:12.155 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:12.155 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:12.155 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:12.156 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:12.156 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:12.156 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:12.156 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:12.156 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:12.156 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:12.156 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:12.156 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:12.156 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:12.156 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.156 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:12.156 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:12.156 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:12.157 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:12.157 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:12.157 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:12.157 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:12.157 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:12.157 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:12.157 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:12.157 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:12.157 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.157 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.157 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:12.157 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.158 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:12.158 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:12.158 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:12.158 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:12.158 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:12.158 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:12.158 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:12.158 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:12.158 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:12.158 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:12.158 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:12.159 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:12.159 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:12.159 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:12.159 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:12.159 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:12.159 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:12.159 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:12.159 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:12.159 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:12.159 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:12.159 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:12.159 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:12.159 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:12.160 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:12.160 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:12.160 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:12.160 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:12.160 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.160 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.160 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:12.160 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.160 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:12.160 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:12.160 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.160 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:12.160 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:12.161 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:12.161 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:12.161 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:12.161 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.161 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:12.161 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:12.161 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.161 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.161 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:12.161 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:12.161 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.161 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.162 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:12.162 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:12.162 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:12.162 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:12.162 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:12.162 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.162 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.162 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:12.162 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:12.162 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:12.162 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.163 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:12.163 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.163 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:12.163 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.163 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:12.163 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.163 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:12.163 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.163 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:12.163 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:12.163 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:12.163 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:12.163 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.164 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:12.164 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.164 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:12.164 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:12.164 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:12.164 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:12.164 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:12.164 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:12.164 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:12.164 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:12.164 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:12.164 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:12.164 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:12.165 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:12.165 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:12.165 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:12.165 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:12.165 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:12.165 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:12.165 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:12.165 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:12.165 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:12.165 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:12.165 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:12.165 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:12.165 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:12.166 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:12.166 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:12.166 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:12.166 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:12.166 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:12.166 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:12.166 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:12.166 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:12.166 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:12.166 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:12.166 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:12.166 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:12.167 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:12.167 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:12.167 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:12.167 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:12.167 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.167 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.167 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:12.167 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:12.167 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.167 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:12.167 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.167 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:12.167 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:12.168 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:12.168 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:12.168 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:12.168 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:12.168 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:12.168 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:12.168 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:12.168 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:12.168 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:12.168 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:12.168 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:12.169 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.169 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:12.169 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:12.169 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:12.169 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:12.169 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:12.169 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:12.169 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:12.169 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:12.169 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:12.169 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:12.169 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:12.169 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.170 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.170 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:12.170 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:12.170 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:12.170 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:12.170 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:12.170 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.170 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.170 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:12.170 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:12.171 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:12.171 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:12.171 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:12.171 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.171 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:12.171 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:12.171 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:12.171 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:12.171 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:12.171 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:12.171 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.171 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:12.171 INFO:teuthology.orchestra.run.smithi012.stdout:_________ ERROR at teardown of test_bucket_policy_put_obj_copy_source __________ 2023-10-05T12:49:12.172 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.172 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:12.172 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.172 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:12.172 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:12.172 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.172 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:12.172 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:12.172 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:12.172 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:12.172 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:12.172 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.173 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:12.173 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:12.173 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.173 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.173 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:12.173 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:12.173 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.173 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.173 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:12.173 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.173 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:12.173 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:12.173 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.174 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.174 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:12.174 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:12.174 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.174 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:12.174 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:12.174 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:12.174 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:12.174 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:12.174 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:12.174 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:12.174 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.175 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:12.175 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:12.175 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:12.175 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:12.175 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:12.175 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:12.175 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:12.175 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:12.175 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:12.175 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.175 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:12.175 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:12.176 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:12.176 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:12.176 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.176 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:12.176 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:12.176 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:12.176 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:12.176 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.176 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.176 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:12.176 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:12.176 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:12.177 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:12.177 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.177 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.177 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:12.177 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:12.177 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:12.177 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.177 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:12.177 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.177 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:12.177 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:12.177 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.177 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:12.178 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:12.178 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:12.178 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:12.178 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:12.178 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:12.178 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.178 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:12.178 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.178 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:12.178 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.178 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:12.178 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:12.178 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.179 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:12.179 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.179 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:12.179 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:12.179 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:12.179 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:12.179 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:12.179 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:12.179 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:12.179 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:12.179 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:12.180 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:12.180 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:12.180 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:12.180 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:12.180 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.180 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:12.180 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:12.180 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:12.180 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:12.180 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:12.180 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:12.180 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:12.180 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:12.181 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:12.181 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:12.181 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:12.181 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.181 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.181 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:12.181 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.181 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:12.181 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:12.181 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:12.181 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:12.181 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:12.181 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:12.182 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:12.182 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:12.182 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:12.182 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:12.182 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:12.182 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:12.182 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:12.182 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:12.182 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:12.182 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:12.182 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:12.182 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:12.183 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:12.183 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:12.183 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:12.183 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:12.183 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:12.183 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:12.183 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:12.183 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:12.183 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:12.183 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:12.183 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.183 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.183 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:12.184 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.184 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:12.184 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:12.184 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.184 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:12.184 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:12.184 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:12.184 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:12.184 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:12.184 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.184 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:12.184 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:12.185 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.185 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.185 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:12.185 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:12.185 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.185 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.185 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:12.185 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:12.185 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:12.185 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:12.185 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:12.185 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.185 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.186 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:12.186 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:12.186 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:12.186 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.186 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:12.186 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.186 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:12.186 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.186 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:12.186 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.186 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:12.187 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.187 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:12.187 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:12.187 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:12.187 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:12.187 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.187 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:12.187 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.187 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:12.187 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:12.187 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:12.187 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:12.187 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:12.188 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:12.188 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:12.188 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:12.188 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:12.188 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:12.188 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:12.188 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:12.188 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:12.188 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:12.188 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:12.188 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:12.188 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:12.188 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:12.189 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:12.189 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:12.189 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:12.189 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:12.189 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:12.189 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:12.189 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:12.189 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:12.189 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:12.189 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:12.189 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:12.190 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:12.190 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:12.190 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:12.190 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:12.190 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:12.190 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:12.190 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:12.190 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:12.190 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:12.191 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:12.191 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:12.191 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.191 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.191 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:12.191 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:12.191 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.191 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:12.191 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.191 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:12.191 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:12.191 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:12.192 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:12.192 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:12.192 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:12.192 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:12.192 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:12.192 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:12.192 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:12.192 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:12.192 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:12.192 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:12.192 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.192 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:12.192 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:12.193 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:12.193 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:12.193 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:12.193 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:12.193 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:12.193 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:12.193 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:12.193 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:12.193 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:12.193 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.193 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.193 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:12.194 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:12.194 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:12.194 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:12.194 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:12.194 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.194 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.194 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:12.194 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:12.194 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:12.194 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:12.195 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:12.195 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.195 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:12.195 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:12.195 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:12.195 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:12.195 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:12.195 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:12.195 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.195 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:12.195 INFO:teuthology.orchestra.run.smithi012.stdout:_______ ERROR at teardown of test_bucket_policy_put_obj_copy_source_meta _______ 2023-10-05T12:49:12.195 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.195 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:12.196 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.196 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:12.196 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:12.196 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.196 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:12.196 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:12.196 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:12.196 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:12.196 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:12.196 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.196 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:12.197 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:12.197 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.197 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.197 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:12.197 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:12.197 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.197 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.197 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:12.197 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.197 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:12.197 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:12.197 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.198 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.198 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:12.198 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:12.198 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.198 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:12.198 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:12.198 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:12.198 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:12.198 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:12.198 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:12.199 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:12.199 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.199 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:12.199 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:12.199 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:12.199 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:12.199 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:12.199 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:12.199 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:12.199 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:12.199 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:12.199 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.199 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:12.200 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:12.200 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:12.200 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:12.200 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.200 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:12.200 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:12.200 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:12.200 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:12.200 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.200 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.200 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:12.200 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:12.201 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:12.201 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:12.201 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.201 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.201 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:12.201 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:12.201 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:12.201 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.201 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:12.201 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.201 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:12.201 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:12.201 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.202 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:12.202 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:12.202 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:12.202 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:12.202 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:12.202 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:12.202 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.202 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:12.202 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.202 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:12.202 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.202 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:12.203 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:12.203 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.203 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:12.203 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.203 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:12.203 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:12.203 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:12.203 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:12.203 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:12.203 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:12.203 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:12.203 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:12.204 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:12.204 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:12.204 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:12.204 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:12.204 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:12.204 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.204 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:12.204 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:12.204 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:12.204 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:12.205 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:12.205 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:12.205 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:12.205 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:12.205 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:12.205 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:12.205 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:12.205 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.205 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.206 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:12.206 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.206 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:12.206 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:12.206 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:12.206 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:12.206 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:12.206 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:12.206 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:12.206 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:12.206 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:12.206 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:12.207 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:12.207 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:12.207 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:12.207 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:12.207 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:12.207 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:12.207 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:12.207 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:12.207 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:12.207 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:12.207 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:12.208 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:12.208 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:12.208 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:12.208 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:12.208 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:12.208 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:12.208 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:12.208 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.208 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.208 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:12.208 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.209 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:12.209 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:12.209 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.209 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:12.209 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:12.209 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:12.209 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:12.209 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:12.209 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.209 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:12.209 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:12.209 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.210 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.210 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:12.210 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:12.210 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.210 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.210 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:12.210 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:12.210 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:12.210 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:12.210 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:12.210 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.211 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.211 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:12.211 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:12.211 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:12.211 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.211 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:12.211 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.211 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:12.211 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.211 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:12.211 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.211 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:12.212 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.212 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:12.212 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:12.212 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:12.212 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:12.212 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.212 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:12.212 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.212 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:12.212 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:12.212 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:12.212 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:12.213 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:12.213 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:12.213 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:12.213 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:12.213 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:12.213 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:12.213 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:12.213 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:12.213 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:12.213 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:12.213 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:12.214 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:12.214 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:12.214 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:12.214 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:12.214 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:12.214 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:12.214 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:12.214 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:12.214 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:12.214 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:12.214 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:12.214 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:12.215 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:12.215 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:12.215 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:12.215 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:12.215 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:12.215 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:12.215 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:12.215 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:12.215 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:12.215 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:12.215 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:12.215 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:12.216 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:12.216 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.216 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.216 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:12.216 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:12.216 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.216 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:12.216 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.216 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:12.216 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:12.216 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:12.217 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:12.217 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:12.217 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:12.217 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:12.217 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:12.217 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:12.217 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:12.217 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:12.217 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:12.217 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:12.217 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.217 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:12.217 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:12.218 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:12.218 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:12.218 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:12.218 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:12.218 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:12.218 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:12.218 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:12.218 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:12.218 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:12.218 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.218 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.219 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:12.219 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:12.219 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:12.219 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:12.219 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:12.219 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.219 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.219 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:12.219 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:12.219 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:12.219 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:12.220 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:12.220 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.220 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:12.220 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:12.220 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:12.220 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:12.220 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:12.220 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:12.220 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.220 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:12.220 INFO:teuthology.orchestra.run.smithi012.stdout:_____________ ERROR at teardown of test_bucket_policy_put_obj_acl ______________ 2023-10-05T12:49:12.220 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.220 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:12.221 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.221 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:12.221 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:12.221 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.221 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:12.221 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:12.221 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:12.221 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:12.221 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:12.221 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.221 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:12.221 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:12.221 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.222 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.222 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:12.222 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:12.222 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.222 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.222 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:12.222 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.222 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:12.222 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:12.222 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.222 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.222 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:12.223 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:12.223 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.223 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:12.223 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:12.223 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:12.223 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:12.223 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:12.223 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:12.223 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:12.223 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.223 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:12.223 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:12.223 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:12.224 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:12.224 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:12.224 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:12.224 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:12.224 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:12.224 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:12.224 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.224 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:12.224 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:12.224 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:12.224 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:12.224 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.225 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:12.225 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:12.225 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:12.225 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:12.225 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.225 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.225 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:12.225 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:12.225 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:12.225 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:12.225 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.225 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.225 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:12.226 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:12.226 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:12.226 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.226 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:12.226 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.226 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:12.226 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:12.226 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.226 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:12.226 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:12.226 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:12.226 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:12.227 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:12.227 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:12.227 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.227 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:12.227 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.227 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:12.227 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.227 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:12.227 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:12.227 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.227 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:12.227 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.227 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:12.228 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:12.228 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:12.228 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:12.228 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:12.228 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:12.228 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:12.228 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:12.228 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:12.228 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:12.228 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:12.228 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:12.228 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:12.228 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.229 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:12.229 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:12.229 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:12.229 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:12.229 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:12.229 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:12.229 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:12.229 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:12.229 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:12.229 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:12.229 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:12.229 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.229 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.230 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:12.230 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.230 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:12.230 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:12.230 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:12.230 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:12.230 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:12.230 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:12.230 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:12.230 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:12.230 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:12.231 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:12.231 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:12.231 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:12.231 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:12.231 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:12.231 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:12.231 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:12.231 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:12.231 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:12.231 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:12.231 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:12.232 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:12.232 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:12.232 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:12.232 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:12.232 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:12.232 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:12.232 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:12.232 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:12.232 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.232 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.232 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:12.232 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.232 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:12.233 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:12.233 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.233 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:12.233 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:12.233 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:12.233 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:12.233 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:12.233 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.233 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:12.233 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:12.233 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.233 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.234 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:12.234 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:12.234 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.234 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.234 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:12.234 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:12.234 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:12.234 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:12.234 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:12.234 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.235 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.235 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:12.235 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:12.235 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:12.235 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.235 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:12.235 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.235 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:12.235 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.235 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:12.235 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.235 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:12.236 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.236 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:12.236 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:12.236 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:12.236 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:12.236 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.236 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:12.236 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.236 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:12.236 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:12.236 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:12.236 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:12.237 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:12.237 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:12.237 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:12.237 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:12.237 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:12.237 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:12.237 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:12.237 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:12.237 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:12.237 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:12.237 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:12.238 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:12.238 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:12.238 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:12.238 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:12.238 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:12.238 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:12.238 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:12.238 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:12.238 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:12.238 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:12.238 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:12.239 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:12.239 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:12.239 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:12.239 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:12.239 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:12.239 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:12.239 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:12.239 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:12.239 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:12.239 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:12.239 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:12.240 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:12.240 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:12.240 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:12.240 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.240 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.240 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:12.240 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:12.240 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.240 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:12.240 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.240 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:12.240 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:12.241 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:12.241 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:12.241 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:12.241 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:12.241 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:12.241 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:12.241 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:12.241 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:12.241 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:12.241 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:12.241 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:12.242 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.242 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:12.242 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:12.242 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:12.242 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:12.242 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:12.242 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:12.242 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:12.242 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:12.242 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:12.242 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:12.243 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:12.243 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.243 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.243 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:12.243 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:12.243 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:12.243 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:12.243 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:12.243 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.243 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.243 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:12.243 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:12.244 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:12.244 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:12.244 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:12.244 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.244 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:12.244 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:12.244 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:12.244 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:12.244 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:12.244 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:12.244 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.244 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:12.245 INFO:teuthology.orchestra.run.smithi012.stdout:____________ ERROR at teardown of test_bucket_policy_put_obj_grant _____________ 2023-10-05T12:49:12.245 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.245 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:12.245 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.245 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:12.245 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:12.245 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.245 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:12.245 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:12.245 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:12.245 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:12.245 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:12.245 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.246 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:12.246 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:12.246 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.246 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.246 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:12.246 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:12.246 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.246 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.246 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:12.246 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.246 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:12.246 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:12.247 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.247 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.247 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:12.247 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:12.247 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.247 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:12.247 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:12.247 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:12.247 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:12.247 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:12.247 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:12.247 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:12.248 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.248 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:12.248 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:12.248 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:12.248 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:12.248 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:12.248 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:12.248 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:12.248 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:12.248 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:12.248 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.248 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:12.249 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:12.249 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:12.249 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:12.249 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.249 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:12.249 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:12.249 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:12.249 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:12.249 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.249 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.250 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:12.250 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:12.250 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:12.250 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:12.250 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.250 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.250 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:12.250 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:12.250 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:12.250 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.250 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:12.250 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.251 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:12.251 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:12.251 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.251 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:12.251 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:12.251 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:12.251 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:12.251 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:12.251 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:12.251 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.251 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:12.252 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.252 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:12.252 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.252 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:12.252 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:12.252 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.252 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:12.252 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.252 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:12.252 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:12.252 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:12.253 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:12.253 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:12.253 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:12.253 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:12.253 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:12.253 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:12.253 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:12.253 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:12.253 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:12.253 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:12.253 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.253 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:12.254 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:12.254 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:12.254 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:12.254 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:12.254 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:12.254 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:12.254 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:12.254 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:12.254 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:12.254 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:12.254 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.255 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.255 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:12.255 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.255 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:12.255 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:12.255 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:12.255 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:12.255 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:12.255 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:12.255 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:12.255 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:12.255 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:12.256 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:12.256 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:12.256 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:12.256 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:12.256 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:12.256 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:12.256 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:12.256 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:12.256 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:12.256 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:12.256 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:12.257 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:12.257 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:12.257 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:12.257 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:12.257 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:12.257 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:12.257 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:12.257 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:12.257 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.257 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.257 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:12.257 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.258 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:12.258 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:12.258 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.258 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:12.258 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:12.258 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:12.258 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:12.258 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:12.258 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.258 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:12.258 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:12.259 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.259 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.259 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:12.259 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:12.259 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.259 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.259 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:12.259 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:12.259 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:12.259 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:12.259 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:12.260 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.260 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.260 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:12.260 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:12.260 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:12.260 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.260 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:12.260 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.260 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:12.260 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.260 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:12.261 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.261 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:12.261 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.261 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:12.261 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:12.261 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:12.261 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:12.261 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.261 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:12.261 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.261 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:12.262 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:12.262 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:12.262 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:12.262 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:12.262 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:12.262 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:12.262 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:12.262 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:12.262 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:12.262 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:12.262 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:12.263 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:12.263 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:12.263 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:12.263 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:12.263 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:12.263 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:12.263 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:12.263 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:12.263 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:12.263 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:12.263 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:12.263 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:12.264 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:12.264 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:12.264 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:12.264 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:12.264 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:12.264 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:12.264 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:12.264 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:12.264 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:12.264 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:12.265 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:12.265 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:12.265 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:12.265 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:12.265 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:12.265 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:12.265 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.265 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.265 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:12.265 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:12.265 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.266 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:12.266 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.266 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:12.266 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:12.266 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:12.266 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:12.266 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:12.266 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:12.266 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:12.266 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:12.266 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:12.267 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:12.267 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:12.267 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:12.269 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:12.270 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.270 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:12.270 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:12.270 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:12.270 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:12.270 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:12.270 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:12.270 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:12.270 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:12.270 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:12.270 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:12.271 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:12.271 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.271 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.271 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:12.271 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:12.271 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:12.271 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:12.271 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:12.271 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.271 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.271 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:12.271 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:12.271 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:12.272 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:12.272 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:12.272 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.272 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:12.272 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:12.272 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:12.272 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:12.272 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:12.272 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:12.272 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.272 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:12.272 INFO:teuthology.orchestra.run.smithi012.stdout:_____________ ERROR at teardown of test_put_obj_enc_conflict_c_s3 ______________ 2023-10-05T12:49:12.273 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.273 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:12.273 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.273 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:12.273 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:12.273 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.273 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:12.273 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:12.273 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:12.273 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:12.273 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:12.273 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.273 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:12.274 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:12.274 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.274 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.274 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:12.274 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:12.274 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.274 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.274 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:12.274 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.274 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:12.274 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:12.274 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.275 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.275 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:12.275 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:12.275 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.275 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:12.275 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:12.275 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:12.275 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:12.275 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:12.275 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:12.275 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:12.275 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.275 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:12.276 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:12.276 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:12.276 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:12.276 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:12.276 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:12.276 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:12.276 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:12.276 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:12.276 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.276 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:12.276 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:12.276 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:12.277 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:12.277 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.277 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:12.277 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:12.277 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:12.277 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:12.277 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.277 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.277 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:12.277 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:12.277 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:12.277 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:12.277 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.278 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.278 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:12.278 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:12.278 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:12.278 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.278 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:12.278 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.278 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:12.278 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:12.278 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.278 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:12.279 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:12.279 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:12.279 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:12.279 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:12.279 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:12.279 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.279 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:12.279 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.279 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:12.279 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.279 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:12.279 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:12.280 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.280 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:12.280 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.280 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:12.280 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:12.280 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:12.280 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:12.280 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:12.280 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:12.280 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:12.280 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:12.280 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:12.280 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:12.281 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:12.281 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:12.281 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:12.281 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.281 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:12.281 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:12.281 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:12.281 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:12.281 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:12.281 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:12.281 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:12.281 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:12.282 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:12.282 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:12.282 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:12.282 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.282 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.282 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:12.282 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.282 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:12.282 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:12.282 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:12.282 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:12.282 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:12.283 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:12.283 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:12.283 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:12.283 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:12.283 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:12.283 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:12.283 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:12.283 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:12.283 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:12.283 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:12.283 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:12.283 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:12.283 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:12.284 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:12.284 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:12.284 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:12.284 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:12.284 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:12.284 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:12.284 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:12.284 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:12.284 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:12.284 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:12.284 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.284 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.284 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:12.285 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.285 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:12.285 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:12.285 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.285 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:12.285 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:12.285 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:12.285 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:12.285 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:12.285 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.285 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:12.285 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:12.286 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.286 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.286 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:12.286 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:12.286 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.286 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.286 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:12.286 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:12.286 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:12.286 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:12.286 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:12.286 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.287 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.287 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:12.287 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:12.287 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:12.287 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.287 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:12.287 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.287 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:12.287 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.287 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:12.287 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.287 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:12.288 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.288 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:12.288 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:12.288 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:12.288 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:12.288 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.288 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:12.288 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.288 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:12.288 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:12.288 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:12.288 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:12.289 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:12.289 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:12.289 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:12.289 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:12.289 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:12.289 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:12.289 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:12.289 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:12.289 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:12.289 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:12.289 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:12.289 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:12.290 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:12.290 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:12.290 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:12.290 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:12.290 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:12.290 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:12.290 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:12.290 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:12.290 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:12.290 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:12.290 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:12.290 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:12.291 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:12.291 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:12.291 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:12.291 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:12.291 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:12.291 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:12.291 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:12.291 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:12.291 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:12.291 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:12.291 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:12.291 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:12.292 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.292 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.292 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:12.292 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:12.292 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.292 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:12.292 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.292 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:12.292 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:12.292 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:12.292 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:12.292 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:12.293 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:12.293 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:12.293 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:12.293 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:12.293 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:12.293 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:12.293 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:12.293 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:12.293 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.293 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:12.293 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:12.293 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:12.293 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:12.294 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:12.294 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:12.294 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:12.294 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:12.294 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:12.294 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:12.294 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:12.294 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.294 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.294 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:12.294 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:12.294 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:12.295 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:12.295 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:12.295 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.295 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.295 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:12.295 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:12.295 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:12.295 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:12.295 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:12.295 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.295 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:12.295 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:12.296 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:12.296 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:12.296 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:12.296 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:12.296 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.296 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:12.296 INFO:teuthology.orchestra.run.smithi012.stdout:_____________ ERROR at teardown of test_put_obj_enc_conflict_c_kms _____________ 2023-10-05T12:49:12.296 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.296 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:12.296 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.296 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:12.296 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:12.296 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.297 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:12.297 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:12.297 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:12.297 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:12.297 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:12.297 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.297 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:12.297 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:12.297 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.297 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.297 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:12.297 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:12.298 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.298 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.298 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:12.298 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.298 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:12.298 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:12.298 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.298 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.298 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:12.298 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:12.298 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.299 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:12.299 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:12.299 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:12.299 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:12.299 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:12.299 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:12.299 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:12.299 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.299 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:12.299 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:12.299 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:12.299 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:12.300 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:12.300 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:12.300 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:12.300 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:12.300 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:12.300 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.300 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:12.300 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:12.300 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:12.300 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:12.300 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.300 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:12.300 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:12.301 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:12.301 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:12.301 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.301 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.301 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:12.301 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:12.301 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:12.301 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:12.301 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.301 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.301 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:12.301 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:12.302 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:12.302 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.302 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:12.302 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.302 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:12.302 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:12.302 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.302 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:12.302 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:12.302 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:12.302 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:12.303 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:12.303 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:12.303 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.303 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:12.303 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.303 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:12.303 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.303 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:12.303 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:12.303 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.303 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:12.303 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.304 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:12.304 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:12.304 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:12.304 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:12.304 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:12.304 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:12.304 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:12.304 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:12.304 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:12.304 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:12.304 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:12.304 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:12.304 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:12.305 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.305 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:12.305 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:12.305 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:12.305 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:12.305 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:12.305 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:12.305 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:12.305 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:12.305 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:12.305 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:12.305 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:12.305 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.306 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.306 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:12.306 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.306 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:12.306 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:12.306 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:12.306 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:12.306 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:12.306 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:12.306 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:12.306 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:12.306 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:12.307 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:12.307 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:12.307 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:12.307 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:12.307 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:12.307 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:12.307 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:12.307 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:12.307 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:12.307 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:12.307 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:12.307 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:12.307 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:12.308 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:12.308 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:12.308 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:12.308 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:12.308 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:12.308 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:12.308 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.308 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.308 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:12.308 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.308 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:12.308 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:12.308 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.309 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:12.309 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:12.309 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:12.309 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:12.309 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:12.309 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.309 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:12.309 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:12.309 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.309 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.309 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:12.310 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:12.310 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.310 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.310 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:12.310 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:12.310 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:12.310 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:12.310 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:12.310 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.310 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.310 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:12.310 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:12.310 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:12.311 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.311 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:12.311 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.311 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:12.311 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.311 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:12.311 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.311 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:12.311 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.311 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:12.311 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:12.311 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:12.312 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:12.312 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.312 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:12.312 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.312 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:12.312 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:12.312 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:12.312 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:12.312 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:12.312 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:12.312 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:12.312 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:12.313 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:12.313 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:12.313 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:12.313 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:12.313 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:12.313 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:12.313 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:12.313 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:12.313 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:12.313 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:12.313 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:12.313 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:12.313 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:12.314 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:12.314 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:12.314 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:12.314 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:12.314 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:12.314 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:12.314 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:12.314 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:12.314 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:12.314 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:12.314 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:12.315 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:12.315 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:12.315 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:12.315 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:12.315 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:12.315 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:12.315 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:12.315 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:12.315 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.315 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.315 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:12.315 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:12.315 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.316 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:12.316 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.316 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:12.316 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:12.316 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:12.316 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:12.316 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:12.316 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:12.316 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:12.316 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:12.316 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:12.316 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:12.317 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:12.317 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:12.317 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:12.317 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.317 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:12.317 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:12.317 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:12.317 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:12.317 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:12.317 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:12.317 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:12.317 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:12.318 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:12.318 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:12.318 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:12.318 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.318 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.318 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:12.318 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:12.318 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:12.318 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:12.318 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:12.318 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.318 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.319 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:12.319 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:12.319 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:12.319 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:12.319 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:12.319 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.319 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:12.319 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:12.319 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:12.319 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:12.319 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:12.319 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:12.320 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.320 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:12.320 INFO:teuthology.orchestra.run.smithi012.stdout:____________ ERROR at teardown of test_put_obj_enc_conflict_s3_kms _____________ 2023-10-05T12:49:12.320 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.320 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:12.320 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.320 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:12.320 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:12.320 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.320 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:12.320 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:12.320 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:12.320 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:12.321 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:12.321 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.321 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:12.321 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:12.321 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.321 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.321 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:12.321 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:12.321 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.321 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.321 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:12.321 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.322 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:12.322 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:12.322 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.322 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.322 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:12.322 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:12.322 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.322 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:12.322 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:12.322 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:12.322 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:12.322 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:12.323 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:12.323 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:12.323 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.323 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:12.323 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:12.323 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:12.323 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:12.323 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:12.323 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:12.323 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:12.323 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:12.323 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:12.323 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.324 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:12.324 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:12.324 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:12.324 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:12.324 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.324 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:12.324 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:12.324 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:12.324 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:12.324 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.324 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.325 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:12.325 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:12.325 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:12.325 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:12.325 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.325 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.325 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:12.325 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:12.325 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:12.325 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.325 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:12.325 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.326 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:12.326 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:12.326 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.326 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:12.326 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:12.326 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:12.326 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:12.326 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:12.326 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:12.326 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.326 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:12.326 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.327 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:12.327 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.327 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:12.327 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:12.327 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.327 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:12.327 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.327 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:12.327 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:12.327 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:12.327 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:12.327 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:12.328 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:12.328 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:12.328 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:12.328 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:12.328 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:12.328 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:12.328 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:12.328 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:12.328 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.328 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:12.328 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:12.328 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:12.329 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:12.329 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:12.329 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:12.329 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:12.329 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:12.329 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:12.329 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:12.329 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:12.329 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.329 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.329 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:12.329 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.330 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:12.330 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:12.330 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:12.330 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:12.330 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:12.330 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:12.330 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:12.330 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:12.330 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:12.330 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:12.330 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:12.330 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:12.331 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:12.331 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:12.331 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:12.331 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:12.331 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:12.331 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:12.331 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:12.331 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:12.331 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:12.331 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:12.331 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:12.331 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:12.332 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:12.332 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:12.332 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:12.332 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:12.332 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.332 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.332 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:12.332 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.332 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:12.332 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:12.332 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.332 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:12.332 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:12.333 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:12.333 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:12.333 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:12.333 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.333 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:12.333 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:12.333 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.333 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.333 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:12.333 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:12.333 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.334 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.334 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:12.334 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:12.334 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:12.334 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:12.334 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:12.334 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.334 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.334 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:12.334 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:12.334 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:12.334 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.335 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:12.335 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.335 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:12.335 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.335 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:12.335 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.335 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:12.335 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.335 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:12.335 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:12.335 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:12.335 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:12.335 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.336 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:12.336 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.336 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:12.336 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:12.336 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:12.336 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:12.336 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:12.336 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:12.336 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:12.336 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:12.336 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:12.336 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:12.336 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:12.337 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:12.337 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:12.337 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:12.337 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:12.337 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:12.337 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:12.337 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:12.337 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:12.337 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:12.337 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:12.337 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:12.337 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:12.337 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:12.338 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:12.338 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:12.338 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:12.338 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:12.338 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:12.338 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:12.338 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:12.338 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:12.338 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:12.338 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:12.338 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:12.338 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:12.339 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:12.339 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:12.339 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:12.339 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:12.339 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.339 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.339 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:12.339 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:12.339 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.339 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:12.339 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.339 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:12.340 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:12.340 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:12.340 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:12.340 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:12.340 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:12.340 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:12.340 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:12.340 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:12.340 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:12.340 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:12.340 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:12.340 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:12.341 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.341 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:12.341 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:12.341 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:12.341 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:12.341 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:12.341 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:12.341 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:12.341 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:12.341 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:12.341 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:12.341 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:12.341 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.342 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.342 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:12.342 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:12.342 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:12.342 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:12.342 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:12.342 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.342 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.342 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:12.342 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:12.342 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:12.342 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:12.342 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:12.343 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.343 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:12.343 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:12.343 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:12.343 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:12.343 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:12.343 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:12.343 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.343 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:12.343 INFO:teuthology.orchestra.run.smithi012.stdout:__________ ERROR at teardown of test_put_obj_enc_conflict_bad_enc_kms __________ 2023-10-05T12:49:12.343 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.343 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:12.343 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.344 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:12.344 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:12.344 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.344 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:12.344 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:12.344 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:12.344 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:12.344 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:12.344 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.344 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:12.344 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:12.344 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.345 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.345 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:12.345 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:12.345 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.345 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.345 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:12.345 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.345 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:12.345 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:12.345 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.345 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.345 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:12.345 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:12.346 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.346 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:12.346 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:12.346 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:12.346 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:12.346 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:12.346 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:12.346 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:12.346 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.346 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:12.346 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:12.347 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:12.347 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:12.347 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:12.347 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:12.347 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:12.347 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:12.347 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:12.347 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.347 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:12.347 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:12.347 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:12.347 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:12.348 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.348 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:12.348 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:12.348 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:12.348 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:12.348 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.348 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.348 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:12.348 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:12.348 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:12.348 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:12.348 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.349 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.349 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:12.349 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:12.349 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:12.349 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.349 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:12.349 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.349 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:12.349 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:12.349 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.349 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:12.349 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:12.350 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:12.350 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:12.350 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:12.350 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:12.350 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.350 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:12.350 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.350 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:12.350 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.350 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:12.350 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:12.351 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.351 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:12.351 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.351 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:12.351 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:12.351 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:12.351 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:12.351 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:12.351 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:12.351 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:12.351 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:12.352 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:12.352 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:12.352 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:12.352 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:12.352 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:12.352 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.352 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:12.352 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:12.352 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:12.352 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:12.352 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:12.352 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:12.353 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:12.353 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:12.353 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:12.353 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:12.353 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:12.353 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.353 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.353 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:12.353 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.353 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:12.353 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:12.354 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:12.354 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:12.354 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:12.354 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:12.354 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:12.354 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:12.354 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:12.354 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:12.354 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:12.354 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:12.354 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:12.355 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:12.355 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:12.355 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:12.355 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:12.355 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:12.355 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:12.355 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:12.355 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:12.355 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:12.355 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:12.355 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:12.355 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:12.355 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:12.356 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:12.356 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:12.356 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.356 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.356 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:12.356 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.356 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:12.356 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:12.356 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.356 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:12.356 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:12.356 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:12.357 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:12.357 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:12.357 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.357 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:12.357 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:12.357 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.357 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.357 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:12.357 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:12.357 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.357 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.357 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:12.357 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:12.358 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:12.358 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:12.358 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:12.358 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.358 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.358 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:12.358 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:12.358 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:12.358 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.358 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:12.358 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.359 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:12.359 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.359 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:12.359 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.359 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:12.359 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.359 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:12.359 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:12.359 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:12.359 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:12.359 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.360 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:12.360 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.360 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:12.360 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:12.360 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:12.360 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:12.360 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:12.360 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:12.360 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:12.360 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:12.360 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:12.360 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:12.360 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:12.361 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:12.361 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:12.361 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:12.361 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:12.361 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:12.361 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:12.361 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:12.361 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:12.361 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:12.361 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:12.361 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:12.361 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:12.361 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:12.362 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:12.362 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:12.362 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:12.362 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:12.362 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:12.362 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:12.362 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:12.362 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:12.362 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:12.362 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:12.362 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:12.363 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:12.363 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:12.363 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:12.363 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:12.363 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:12.363 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.363 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.363 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:12.363 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:12.363 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.363 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:12.363 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.363 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:12.363 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:12.364 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:12.364 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:12.364 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:12.364 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:12.364 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:12.364 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:12.364 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:12.364 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:12.364 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:12.364 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:12.364 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:12.364 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.365 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:12.365 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:12.365 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:12.365 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:12.365 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:12.365 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:12.365 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:12.365 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:12.365 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:12.365 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:12.365 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:12.365 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.365 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.366 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:12.366 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:12.366 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:12.366 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:12.366 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:12.366 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.366 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.366 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:12.366 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:12.366 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:12.366 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:12.366 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:12.367 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.367 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:12.367 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:12.367 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:12.367 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:12.367 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:12.367 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:12.367 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.367 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:12.367 INFO:teuthology.orchestra.run.smithi012.stdout:__________ ERROR at teardown of test_bucket_policy_put_obj_kms_noenc ___________ 2023-10-05T12:49:12.367 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.368 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:12.368 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.368 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:12.368 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:12.368 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.368 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:12.368 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:12.368 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:12.368 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:12.368 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:12.368 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.368 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:12.369 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:12.369 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.369 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.369 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:12.369 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:12.369 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.369 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.369 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:12.369 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.369 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:12.369 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:12.369 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.370 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.370 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:12.370 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:12.370 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.370 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:12.370 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:12.370 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:12.370 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:12.370 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:12.370 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:12.370 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:12.370 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.371 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:12.371 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:12.371 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:12.371 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:12.371 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:12.371 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:12.371 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:12.371 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:12.371 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:12.371 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.371 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:12.371 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:12.371 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:12.372 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:12.372 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.372 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:12.372 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:12.372 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:12.372 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:12.372 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.372 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.372 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:12.372 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:12.372 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:12.372 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:12.373 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.373 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.373 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:12.373 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:12.373 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:12.373 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.373 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:12.373 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.373 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:12.373 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:12.373 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.373 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:12.373 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:12.374 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:12.374 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:12.374 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:12.374 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:12.374 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.374 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:12.374 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.374 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:12.374 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.374 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:12.375 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:12.375 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.375 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:12.375 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.375 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:12.375 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:12.375 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:12.375 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:12.375 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:12.375 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:12.375 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:12.375 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:12.376 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:12.376 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:12.376 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:12.376 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:12.376 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:12.376 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.376 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:12.376 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:12.376 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:12.376 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:12.376 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:12.376 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:12.376 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:12.377 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:12.377 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:12.377 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:12.377 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:12.377 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.377 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.377 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:12.377 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.377 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:12.377 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:12.377 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:12.378 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:12.378 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:12.378 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:12.378 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:12.378 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:12.378 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:12.378 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:12.378 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:12.378 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:12.378 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:12.378 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:12.379 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:12.379 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:12.379 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:12.379 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:12.379 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:12.379 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:12.379 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:12.379 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:12.379 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:12.379 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:12.379 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:12.379 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:12.380 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:12.380 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:12.380 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.380 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.380 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:12.380 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.380 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:12.380 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:12.380 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.380 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:12.380 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:12.381 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:12.381 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:12.381 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:12.381 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.381 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:12.381 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:12.381 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.381 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.381 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:12.381 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:12.381 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.381 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.382 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:12.382 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:12.382 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:12.382 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:12.382 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:12.382 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.382 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.382 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:12.382 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:12.382 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:12.382 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.383 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:12.383 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.383 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:12.383 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.383 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:12.383 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.383 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:12.383 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.383 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:12.383 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:12.383 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:12.384 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:12.384 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.384 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:12.384 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.384 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:12.384 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:12.384 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:12.384 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:12.384 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:12.384 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:12.384 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:12.384 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:12.385 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:12.385 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:12.385 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:12.385 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:12.385 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:12.385 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:12.385 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:12.385 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:12.385 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:12.385 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:12.385 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:12.385 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:12.386 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:12.386 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:12.386 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:12.386 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:12.386 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:12.386 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:12.386 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:12.386 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:12.386 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:12.386 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:12.387 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:12.387 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:12.387 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:12.387 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:12.387 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:12.387 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:12.387 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:12.387 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:12.387 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:12.387 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:12.387 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.387 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.388 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:12.388 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:12.388 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.388 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:12.388 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.388 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:12.388 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:12.388 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:12.388 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:12.388 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:12.388 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:12.388 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:12.389 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:12.389 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:12.389 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:12.389 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:12.389 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:12.389 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:12.389 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.389 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:12.389 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:12.389 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:12.389 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:12.389 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:12.390 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:12.390 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:12.390 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:12.390 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:12.390 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:12.390 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:12.390 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.390 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.390 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:12.390 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:12.390 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:12.391 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:12.391 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:12.391 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.391 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.391 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:12.391 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:12.391 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:12.391 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:12.391 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:12.391 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.391 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:12.392 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:12.392 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:12.392 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:12.392 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:12.392 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:12.392 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.392 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:12.392 INFO:teuthology.orchestra.run.smithi012.stdout:____________ ERROR at teardown of test_bucket_policy_put_obj_kms_s3 ____________ 2023-10-05T12:49:12.392 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.392 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:12.392 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.392 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:12.393 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:12.393 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.393 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:12.393 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:12.393 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:12.393 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:12.393 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:12.393 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.393 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:12.393 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:12.393 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.393 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.394 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:12.394 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:12.394 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.394 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.394 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:12.394 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.394 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:12.394 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:12.394 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.394 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.394 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:12.395 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:12.395 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.395 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:12.395 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:12.395 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:12.395 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:12.395 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:12.395 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:12.395 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:12.395 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.395 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:12.395 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:12.395 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:12.396 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:12.396 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:12.396 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:12.396 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:12.396 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:12.396 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:12.396 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.396 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:12.396 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:12.396 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:12.396 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:12.396 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.397 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:12.397 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:12.397 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:12.397 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:12.397 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.397 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.397 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:12.397 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:12.397 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:12.397 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:12.397 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.398 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.398 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:12.398 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:12.398 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:12.398 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.398 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:12.398 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.398 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:12.398 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:12.398 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.398 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:12.399 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:12.399 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:12.399 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:12.399 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:12.399 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:12.399 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.399 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:12.399 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.399 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:12.399 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.399 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:12.399 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:12.400 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.400 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:12.400 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.400 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:12.400 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:12.400 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:12.400 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:12.400 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:12.400 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:12.400 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:12.400 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:12.400 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:12.400 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:12.401 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:12.401 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:12.401 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:12.401 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.401 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:12.401 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:12.401 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:12.401 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:12.401 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:12.401 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:12.401 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:12.401 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:12.401 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:12.402 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:12.402 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:12.402 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.402 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.402 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:12.402 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.402 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:12.402 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:12.402 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:12.402 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:12.402 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:12.403 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:12.403 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:12.403 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:12.403 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:12.403 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:12.403 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:12.403 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:12.403 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:12.403 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:12.403 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:12.403 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:12.404 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:12.404 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:12.404 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:12.404 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:12.404 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:12.404 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:12.404 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:12.404 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:12.404 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:12.404 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:12.404 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:12.404 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:12.405 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.405 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.405 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:12.405 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.405 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:12.405 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:12.405 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.405 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:12.405 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:12.405 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:12.405 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:12.405 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:12.406 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.406 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:12.406 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:12.406 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.406 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.406 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:12.406 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:12.406 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.406 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.406 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:12.406 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:12.407 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:12.407 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:12.407 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:12.407 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.407 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.407 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:12.407 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:12.407 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:12.407 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.407 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:12.407 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.407 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:12.408 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.408 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:12.408 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.408 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:12.408 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.408 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:12.408 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:12.408 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:12.408 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:12.408 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.408 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:12.408 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.409 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:12.409 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:12.409 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:12.409 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:12.409 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:12.409 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:12.409 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:12.409 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:12.409 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:12.409 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:12.409 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:12.409 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:12.410 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:12.410 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:12.410 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:12.410 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:12.410 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:12.410 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:12.410 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:12.410 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:12.410 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:12.410 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:12.410 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:12.411 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:12.411 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:12.411 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:12.411 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:12.411 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:12.411 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:12.411 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:12.411 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:12.411 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:12.411 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:12.411 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:12.411 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:12.412 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:12.412 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:12.412 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:12.412 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:12.412 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:12.412 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.412 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.412 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:12.412 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:12.412 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.412 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:12.413 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.413 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:12.413 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:12.413 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:12.413 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:12.413 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:12.413 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:12.413 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:12.413 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:12.413 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:12.413 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:12.413 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:12.414 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:12.414 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:12.414 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.414 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:12.414 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:12.414 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:12.414 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:12.414 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:12.414 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:12.414 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:12.414 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:12.414 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:12.415 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:12.415 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:12.415 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.415 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.415 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:12.415 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:12.415 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:12.415 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:12.415 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:12.415 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.415 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.415 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:12.416 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:12.416 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:12.416 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:12.416 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:12.416 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.416 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:12.416 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:12.416 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:12.416 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:12.416 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:12.416 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:12.416 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.417 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:12.417 INFO:teuthology.orchestra.run.smithi012.stdout:_______ ERROR at teardown of test_bucket_policy_get_obj_acl_existing_tag _______ 2023-10-05T12:49:12.417 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.417 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:12.417 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.417 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:12.417 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:12.417 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.417 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:12.417 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:12.417 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:12.417 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:12.417 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:12.418 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.418 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:12.418 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:12.418 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.418 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.418 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:12.418 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:12.418 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.418 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.418 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:12.418 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.419 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:12.419 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:12.419 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.419 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.419 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:12.419 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:12.419 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.419 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:12.419 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:12.419 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:12.419 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:12.419 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:12.420 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:12.420 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:12.420 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.420 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:12.420 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:12.420 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:12.420 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:12.420 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:12.420 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:12.420 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:12.420 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:12.420 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:12.421 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.421 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:12.421 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:12.421 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:12.421 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:12.421 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.421 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:12.421 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:12.421 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:12.421 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:12.421 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.421 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.422 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:12.422 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:12.422 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:12.422 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:12.422 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.422 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.422 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:12.422 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:12.422 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:12.422 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.422 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:12.422 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.423 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:12.423 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:12.423 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.423 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:12.423 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:12.423 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:12.423 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:12.423 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:12.423 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:12.423 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.423 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:12.423 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.423 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:12.424 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.424 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:12.424 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:12.424 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.424 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:12.424 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.424 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:12.424 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:12.424 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:12.424 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:12.424 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:12.424 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:12.425 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:12.425 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:12.425 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:12.425 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:12.425 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:12.425 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:12.425 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:12.425 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.425 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:12.425 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:12.425 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:12.425 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:12.426 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:12.426 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:12.426 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:12.426 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:12.426 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:12.426 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:12.426 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:12.426 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.426 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.426 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:12.426 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.427 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:12.427 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:12.427 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:12.427 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:12.427 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:12.427 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:12.427 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:12.427 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:12.427 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:12.427 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:12.427 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:12.427 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:12.428 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:12.428 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:12.428 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:12.428 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:12.428 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:12.428 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:12.428 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:12.428 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:12.428 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:12.428 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:12.428 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:12.428 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:12.429 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:12.429 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:12.429 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:12.429 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:12.429 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.429 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.429 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:12.429 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.429 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:12.429 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:12.429 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.429 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:12.430 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:12.430 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:12.430 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:12.430 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:12.430 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.430 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:12.430 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:12.430 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.430 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.430 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:12.430 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:12.430 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.431 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.431 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:12.431 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:12.431 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:12.431 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:12.431 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:12.431 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.431 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.431 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:12.431 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:12.431 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:12.431 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.432 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:12.432 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.432 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:12.432 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.432 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:12.432 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.432 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:12.432 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.432 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:12.432 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:12.432 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:12.432 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:12.433 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.433 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:12.433 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.433 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:12.433 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:12.433 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:12.433 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:12.433 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:12.433 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:12.433 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:12.433 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:12.433 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:12.434 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:12.434 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:12.434 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:12.434 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:12.434 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:12.434 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:12.434 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:12.434 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:12.434 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:12.434 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:12.434 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:12.434 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:12.435 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:12.435 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:12.435 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:12.435 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:12.435 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:12.435 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:12.435 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:12.435 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:12.435 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:12.435 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:12.435 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:12.435 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:12.436 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:12.436 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:12.436 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:12.436 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:12.436 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:12.436 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:12.436 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:12.436 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.436 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.436 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:12.436 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:12.436 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.437 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:12.437 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.437 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:12.437 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:12.437 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:12.437 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:12.437 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:12.437 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:12.437 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:12.437 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:12.437 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:12.437 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:12.438 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:12.438 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:12.438 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:12.438 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.438 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:12.438 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:12.438 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:12.438 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:12.438 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:12.438 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:12.438 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:12.438 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:12.439 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:12.439 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:12.439 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:12.439 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.439 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.439 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:12.439 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:12.439 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:12.439 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:12.439 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:12.439 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.439 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.439 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:12.440 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:12.440 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:12.440 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:12.440 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:12.440 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.440 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:12.440 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:12.440 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:12.440 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:12.440 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:12.440 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:12.441 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.441 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:12.441 INFO:teuthology.orchestra.run.smithi012.stdout:______________ ERROR at teardown of test_object_lock_put_obj_lock ______________ 2023-10-05T12:49:12.441 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.441 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:12.441 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.441 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:12.441 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:12.441 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.441 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:12.441 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:12.441 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:12.442 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:12.442 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:12.442 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.442 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:12.442 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:12.442 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.442 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.442 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:12.442 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:12.442 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.442 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.442 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:12.443 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.443 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:12.443 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:12.443 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.443 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.443 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:12.443 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:12.443 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.443 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:12.443 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:12.443 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:12.443 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:12.444 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:12.444 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:12.444 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:12.444 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.444 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:12.444 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:12.444 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:12.444 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:12.444 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:12.444 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:12.444 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:12.444 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:12.445 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:12.445 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.445 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:12.445 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:12.445 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:12.445 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:12.445 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.445 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:12.445 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:12.445 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:12.445 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:12.445 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.446 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.446 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:12.446 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:12.446 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:12.446 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:12.446 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.446 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.446 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:12.446 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:12.446 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:12.446 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.446 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:12.447 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.447 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:12.447 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:12.447 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.447 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:12.447 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:12.447 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:12.447 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:12.447 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:12.447 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:12.447 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.447 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:12.448 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.448 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:12.448 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.448 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:12.448 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:12.448 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.448 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:12.448 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.448 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:12.448 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:12.448 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:12.448 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:12.449 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:12.449 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:12.449 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:12.449 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:12.449 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:12.449 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:12.449 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:12.449 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:12.449 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:12.449 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.449 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:12.449 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:12.450 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:12.450 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:12.450 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:12.450 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:12.450 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:12.450 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:12.450 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:12.450 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:12.450 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:12.450 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.450 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.450 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:12.451 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.451 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:12.451 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:12.451 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:12.451 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:12.451 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:12.451 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:12.451 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:12.451 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:12.451 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:12.451 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:12.451 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:12.452 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:12.452 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:12.452 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:12.452 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:12.452 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:12.452 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:12.452 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:12.452 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:12.452 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:12.452 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:12.452 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:12.452 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:12.453 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:12.453 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:12.453 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:12.453 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:12.453 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:12.453 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.453 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.453 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:12.453 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.453 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:12.453 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:12.453 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.454 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:12.454 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:12.454 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:12.454 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:12.454 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:12.454 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.454 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:12.454 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:12.454 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.454 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.454 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:12.454 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:12.455 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.455 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.455 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:12.455 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:12.455 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:12.455 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:12.455 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:12.455 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.455 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.455 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:12.455 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:12.455 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:12.456 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.456 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:12.456 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.456 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:12.456 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.456 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:12.456 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.456 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:12.456 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.456 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:12.456 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:12.456 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:12.457 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:12.457 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.457 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:12.457 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.457 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:12.457 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:12.457 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:12.457 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:12.457 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:12.457 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:12.457 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:12.457 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:12.458 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:12.458 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:12.458 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:12.458 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:12.458 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:12.458 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:12.458 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:12.458 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:12.458 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:12.458 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:12.458 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:12.459 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:12.459 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:12.459 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:12.459 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:12.459 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:12.459 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:12.459 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:12.459 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:12.459 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:12.459 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:12.459 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:12.460 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:12.460 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:12.460 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:12.460 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:12.460 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:12.460 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:12.460 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:12.460 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:12.460 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:12.460 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:12.460 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.460 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.460 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:12.461 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:12.461 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.461 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:12.461 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.461 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:12.461 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:12.461 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:12.461 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:12.461 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:12.461 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:12.461 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:12.461 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:12.462 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:12.462 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:12.462 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:12.462 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:12.462 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:12.462 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.462 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:12.462 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:12.462 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:12.462 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:12.462 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:12.462 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:12.462 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:12.463 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:12.463 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:12.463 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:12.463 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:12.463 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.463 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.463 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:12.463 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:12.463 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:12.463 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:12.463 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:12.463 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.464 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.464 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:12.464 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:12.464 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:12.464 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:12.464 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:12.464 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.464 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:12.464 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:12.464 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:12.464 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:12.464 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:12.465 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:12.465 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.465 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:12.465 INFO:teuthology.orchestra.run.smithi012.stdout:______ ERROR at teardown of test_object_lock_put_obj_lock_invalid_bucket _______ 2023-10-05T12:49:12.465 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.465 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:12.465 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.465 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:12.465 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:12.465 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.465 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:12.465 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:12.465 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:12.466 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:12.466 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:12.466 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.466 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:12.466 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:12.466 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.466 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.466 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:12.466 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:12.466 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.466 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.466 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:12.467 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.467 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:12.467 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:12.467 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.467 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.467 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:12.467 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:12.467 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.467 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:12.467 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:12.467 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:12.467 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:12.468 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:12.468 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:12.468 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:12.468 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.468 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:12.468 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:12.468 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:12.468 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:12.468 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:12.468 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:12.468 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:12.469 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:12.469 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:12.469 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.469 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:12.469 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:12.469 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:12.469 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:12.469 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.469 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:12.469 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:12.469 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:12.469 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:12.470 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.470 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.470 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:12.470 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:12.470 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:12.470 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:12.470 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.470 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.470 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:12.470 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:12.470 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:12.471 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.471 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:12.471 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.471 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:12.471 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:12.471 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.471 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:12.471 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:12.471 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:12.471 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:12.471 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:12.473 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:12.473 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.473 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:12.473 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.473 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:12.473 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.473 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:12.473 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:12.473 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.474 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:12.474 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.474 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:12.474 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:12.474 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:12.474 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:12.474 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:12.474 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:12.474 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:12.474 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:12.474 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:12.474 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:12.475 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:12.475 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:12.475 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:12.475 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.475 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:12.475 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:12.475 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:12.475 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:12.475 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:12.475 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:12.475 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:12.475 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:12.476 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:12.476 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:12.476 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:12.476 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.476 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.476 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:12.476 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.476 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:12.476 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:12.476 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:12.476 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:12.476 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:12.477 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:12.477 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:12.477 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:12.477 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:12.477 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:12.477 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:12.477 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:12.477 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:12.477 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:12.477 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:12.477 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:12.477 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:12.478 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:12.478 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:12.478 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:12.478 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:12.478 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:12.478 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:12.478 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:12.478 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:12.478 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:12.478 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:12.478 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:12.479 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.479 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.479 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:12.479 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.479 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:12.479 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:12.479 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.479 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:12.479 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:12.479 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:12.479 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:12.479 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:12.480 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.480 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:12.480 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:12.480 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.480 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.480 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:12.480 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:12.480 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.480 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.480 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:12.480 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:12.480 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:12.480 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:12.481 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:12.481 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.481 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.481 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:12.481 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:12.481 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:12.481 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.481 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:12.481 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.481 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:12.481 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.481 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:12.482 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.482 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:12.482 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.482 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:12.482 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:12.482 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:12.482 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:12.482 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.482 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:12.482 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.482 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:12.482 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:12.483 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:12.483 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:12.483 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:12.483 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:12.483 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:12.483 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:12.483 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:12.483 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:12.483 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:12.483 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:12.483 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:12.483 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:12.484 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:12.484 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:12.484 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:12.484 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:12.484 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:12.484 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:12.484 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:12.484 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:12.484 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:12.484 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:12.484 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:12.484 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:12.484 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:12.485 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:12.485 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:12.485 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:12.485 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:12.485 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:12.485 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:12.485 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:12.485 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:12.485 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:12.485 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:12.485 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:12.486 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:12.486 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:12.486 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.486 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.486 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:12.486 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:12.486 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.486 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:12.486 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.486 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:12.486 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:12.486 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:12.487 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:12.487 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:12.487 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:12.487 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:12.487 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:12.487 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:12.487 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:12.487 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:12.487 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:12.487 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:12.487 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.487 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:12.488 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:12.488 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:12.488 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:12.488 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:12.488 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:12.488 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:12.488 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:12.488 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:12.488 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:12.488 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:12.488 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.489 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.489 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:12.489 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:12.489 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:12.489 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:12.489 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:12.489 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.489 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.489 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:12.489 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:12.489 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:12.489 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:12.489 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:12.490 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.490 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:12.490 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:12.490 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:12.490 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:12.490 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:12.490 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:12.490 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.490 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:12.490 INFO:teuthology.orchestra.run.smithi012.stdout:____ ERROR at teardown of test_object_lock_put_obj_lock_with_days_and_years ____ 2023-10-05T12:49:12.490 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.491 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:12.491 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.491 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:12.491 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:12.491 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.491 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:12.491 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:12.491 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:12.491 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:12.491 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:12.491 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.491 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:12.491 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:12.492 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.492 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.492 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:12.492 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:12.492 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.492 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.492 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:12.492 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.492 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:12.492 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:12.492 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.492 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.493 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:12.493 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:12.493 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.493 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:12.493 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:12.493 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:12.493 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:12.493 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:12.493 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:12.493 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:12.493 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.493 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:12.494 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:12.494 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:12.494 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:12.494 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:12.494 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:12.494 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:12.494 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:12.494 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:12.494 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.494 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:12.494 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:12.494 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:12.495 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:12.495 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.495 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:12.495 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:12.495 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:12.495 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:12.495 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.495 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.495 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:12.495 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:12.495 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:12.495 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:12.496 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.496 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.496 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:12.496 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:12.496 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:12.496 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.496 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:12.496 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.496 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:12.496 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:12.496 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.496 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:12.496 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:12.497 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:12.497 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:12.497 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:12.497 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:12.497 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.497 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:12.497 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.497 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:12.497 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.497 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:12.497 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:12.497 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.498 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:12.498 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.498 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:12.498 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:12.498 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:12.498 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:12.498 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:12.498 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:12.498 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:12.498 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:12.498 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:12.499 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:12.499 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:12.499 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:12.499 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:12.499 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.499 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:12.499 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:12.499 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:12.499 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:12.499 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:12.499 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:12.499 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:12.500 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:12.500 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:12.500 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:12.500 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:12.500 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.500 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.500 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:12.500 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.500 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:12.500 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:12.500 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:12.500 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:12.501 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:12.501 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:12.501 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:12.501 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:12.501 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:12.501 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:12.501 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:12.501 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:12.501 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:12.501 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:12.501 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:12.501 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:12.502 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:12.502 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:12.502 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:12.502 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:12.502 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:12.502 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:12.502 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:12.502 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:12.502 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:12.502 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:12.502 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:12.502 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:12.503 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.503 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.503 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:12.503 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.503 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:12.503 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:12.503 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.503 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:12.503 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:12.503 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:12.503 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:12.504 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:12.504 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.504 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:12.504 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:12.504 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.504 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.504 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:12.504 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:12.504 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.504 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.504 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:12.504 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:12.504 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:12.505 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:12.505 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:12.505 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.505 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.505 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:12.505 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:12.505 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:12.505 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.505 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:12.505 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.505 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:12.506 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.506 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:12.506 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.506 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:12.506 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.506 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:12.506 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:12.506 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:12.506 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:12.506 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.506 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:12.506 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.507 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:12.507 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:12.507 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:12.507 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:12.507 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:12.507 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:12.507 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:12.507 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:12.507 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:12.507 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:12.507 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:12.507 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:12.507 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:12.508 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:12.508 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:12.508 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:12.508 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:12.508 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:12.508 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:12.508 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:12.508 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:12.508 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:12.508 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:12.508 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:12.509 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:12.509 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:12.509 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:12.509 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:12.509 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:12.509 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:12.509 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:12.509 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:12.509 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:12.509 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:12.509 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:12.509 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:12.510 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:12.510 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:12.510 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:12.510 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:12.510 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.510 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.510 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:12.510 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:12.510 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.510 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:12.510 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.511 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:12.511 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:12.511 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:12.511 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:12.511 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:12.511 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:12.511 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:12.511 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:12.511 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:12.511 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:12.511 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:12.511 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:12.512 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:12.512 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.512 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:12.512 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:12.512 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:12.512 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:12.512 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:12.512 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:12.512 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:12.512 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:12.512 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:12.512 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:12.513 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:12.513 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.513 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.513 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:12.513 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:12.513 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:12.513 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:12.513 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:12.513 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.513 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.513 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:12.513 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:12.514 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:12.514 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:12.514 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:12.514 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.514 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:12.514 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:12.514 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:12.514 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:12.514 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:12.514 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:12.514 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.514 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:12.515 INFO:teuthology.orchestra.run.smithi012.stdout:_______ ERROR at teardown of test_object_lock_put_obj_lock_invalid_days ________ 2023-10-05T12:49:12.515 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.515 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:12.515 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.515 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:12.515 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:12.515 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.515 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:12.515 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:12.515 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:12.515 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:12.515 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:12.516 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.516 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:12.516 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:12.516 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.516 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.516 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:12.516 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:12.516 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.516 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.516 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:12.516 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.516 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:12.517 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:12.517 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.517 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.517 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:12.517 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:12.517 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.517 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:12.517 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:12.517 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:12.517 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:12.517 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:12.517 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:12.518 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:12.518 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.518 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:12.518 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:12.518 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:12.518 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:12.518 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:12.518 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:12.518 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:12.518 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:12.518 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:12.519 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.519 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:12.519 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:12.519 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:12.519 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:12.519 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.519 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:12.519 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:12.519 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:12.519 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:12.519 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.519 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.520 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:12.520 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:12.520 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:12.520 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:12.520 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.520 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.520 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:12.520 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:12.520 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:12.520 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.520 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:12.520 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.521 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:12.521 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:12.521 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.521 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:12.521 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:12.521 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:12.521 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:12.521 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:12.521 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:12.521 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.521 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:12.521 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.522 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:12.522 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.522 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:12.522 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:12.522 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.522 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:12.522 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.522 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:12.522 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:12.522 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:12.522 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:12.522 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:12.523 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:12.523 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:12.523 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:12.523 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:12.523 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:12.523 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:12.523 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:12.523 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:12.523 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.523 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:12.523 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:12.523 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:12.524 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:12.524 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:12.524 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:12.524 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:12.524 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:12.524 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:12.524 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:12.524 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:12.524 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.524 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.524 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:12.524 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.525 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:12.525 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:12.525 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:12.525 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:12.525 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:12.525 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:12.525 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:12.525 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:12.525 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:12.525 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:12.525 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:12.526 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:12.526 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:12.526 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:12.526 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:12.526 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:12.526 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:12.526 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:12.526 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:12.526 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:12.526 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:12.526 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:12.526 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:12.527 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:12.527 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:12.527 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:12.527 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:12.527 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:12.527 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.527 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.527 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:12.527 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.527 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:12.527 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:12.527 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.528 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:12.528 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:12.528 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:12.528 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:12.528 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:12.528 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.528 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:12.528 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:12.528 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.528 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.528 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:12.528 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:12.529 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.529 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.529 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:12.529 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:12.529 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:12.529 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:12.529 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:12.529 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.529 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.529 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:12.529 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:12.529 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:12.530 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.530 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:12.530 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.530 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:12.530 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.530 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:12.530 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.530 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:12.530 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.530 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:12.531 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:12.531 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:12.531 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:12.531 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.531 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:12.531 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.531 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:12.531 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:12.531 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:12.531 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:12.531 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:12.531 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:12.532 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:12.532 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:12.532 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:12.532 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:12.532 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:12.532 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:12.532 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:12.532 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:12.532 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:12.532 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:12.532 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:12.532 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:12.533 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:12.533 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:12.533 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:12.533 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:12.533 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:12.533 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:12.533 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:12.533 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:12.533 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:12.533 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:12.533 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:12.533 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:12.534 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:12.534 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:12.534 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:12.534 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:12.534 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:12.534 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:12.534 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:12.534 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:12.534 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:12.534 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:12.534 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.535 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.535 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:12.535 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:12.535 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.535 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:12.535 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.535 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:12.535 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:12.535 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:12.535 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:12.535 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:12.535 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:12.536 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:12.536 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:12.536 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:12.536 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:12.536 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:12.536 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:12.536 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:12.536 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.536 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:12.536 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:12.536 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:12.536 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:12.537 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:12.537 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:12.537 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:12.537 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:12.537 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:12.537 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:12.537 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:12.537 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.537 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.537 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:12.537 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:12.537 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:12.538 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:12.538 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:12.538 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.538 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.538 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:12.538 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:12.538 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:12.538 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:12.538 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:12.538 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.538 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:12.539 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:12.539 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:12.539 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:12.539 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:12.539 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:12.539 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.539 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:12.539 INFO:teuthology.orchestra.run.smithi012.stdout:_______ ERROR at teardown of test_object_lock_put_obj_lock_invalid_years _______ 2023-10-05T12:49:12.539 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.539 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:12.539 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.540 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:12.540 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:12.540 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.540 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:12.540 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:12.540 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:12.540 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:12.540 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:12.540 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.540 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:12.540 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:12.540 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.541 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.541 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:12.541 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:12.541 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.541 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.541 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:12.541 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.541 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:12.541 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:12.541 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.541 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.541 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:12.542 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:12.542 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.542 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:12.542 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:12.542 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:12.542 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:12.542 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:12.542 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:12.542 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:12.542 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.542 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:12.542 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:12.543 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:12.543 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:12.543 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:12.543 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:12.543 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:12.543 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:12.543 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:12.543 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.543 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:12.543 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:12.543 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:12.543 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:12.544 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.544 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:12.544 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:12.544 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:12.544 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:12.544 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.544 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.544 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:12.544 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:12.544 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:12.544 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:12.544 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.545 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.545 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:12.545 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:12.545 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:12.545 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.545 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:12.545 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.545 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:12.545 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:12.545 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.545 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:12.546 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:12.546 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:12.546 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:12.546 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:12.546 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:12.546 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.546 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:12.546 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.546 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:12.546 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.546 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:12.547 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:12.547 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.547 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:12.547 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.547 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:12.547 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:12.547 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:12.547 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:12.547 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:12.547 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:12.547 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:12.548 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:12.548 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:12.548 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:12.548 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:12.548 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:12.548 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:12.548 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.548 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:12.548 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:12.548 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:12.548 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:12.548 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:12.549 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:12.549 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:12.549 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:12.549 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:12.549 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:12.549 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:12.549 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.549 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.549 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:12.549 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.549 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:12.549 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:12.550 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:12.550 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:12.550 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:12.550 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:12.550 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:12.550 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:12.550 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:12.550 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:12.550 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:12.550 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:12.550 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:12.550 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:12.551 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:12.551 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:12.551 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:12.551 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:12.551 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:12.551 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:12.551 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:12.551 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:12.551 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:12.551 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:12.551 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:12.551 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:12.552 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:12.552 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:12.552 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.552 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.552 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:12.552 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.552 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:12.552 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:12.552 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.552 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:12.552 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:12.552 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:12.553 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:12.553 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:12.553 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.553 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:12.553 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:12.553 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.553 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.553 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:12.553 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:12.553 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.553 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.553 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:12.554 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:12.554 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:12.554 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:12.554 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:12.554 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.554 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.554 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:12.554 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:12.554 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:12.554 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.554 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:12.554 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.555 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:12.555 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.555 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:12.555 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.555 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:12.555 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.555 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:12.555 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:12.555 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:12.555 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:12.555 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.555 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:12.556 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.556 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:12.556 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:12.556 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:12.556 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:12.556 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:12.556 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:12.556 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:12.556 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:12.556 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:12.556 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:12.556 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:12.556 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:12.557 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:12.557 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:12.557 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:12.557 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:12.557 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:12.557 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:12.557 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:12.557 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:12.557 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:12.557 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:12.557 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:12.557 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:12.557 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:12.558 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:12.558 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:12.558 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:12.558 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:12.558 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:12.558 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:12.558 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:12.558 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:12.558 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:12.558 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:12.558 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:12.559 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:12.559 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:12.559 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:12.559 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:12.559 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.559 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.559 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:12.559 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:12.559 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.559 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:12.559 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.560 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:12.560 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:12.560 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:12.560 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:12.560 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:12.560 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:12.560 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:12.560 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:12.560 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:12.560 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:12.560 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:12.560 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:12.561 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:12.561 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.561 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:12.561 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:12.561 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:12.561 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:12.561 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:12.561 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:12.561 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:12.561 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:12.561 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:12.561 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:12.561 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:12.562 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.562 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.562 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:12.562 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:12.562 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:12.562 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:12.562 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:12.562 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.562 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.562 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:12.562 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:12.563 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:12.563 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:12.563 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:12.563 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.563 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:12.563 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:12.563 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:12.563 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:12.563 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:12.563 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:12.563 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.563 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:12.564 INFO:teuthology.orchestra.run.smithi012.stdout:_______ ERROR at teardown of test_object_lock_put_obj_lock_invalid_mode ________ 2023-10-05T12:49:12.564 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.564 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:12.564 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.564 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:12.564 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:12.564 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.564 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:12.564 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:12.564 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:12.564 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:12.564 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:12.565 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.565 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:12.565 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:12.565 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.565 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.565 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:12.565 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:12.565 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.565 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.565 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:12.565 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.565 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:12.566 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:12.566 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.566 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.566 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:12.566 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:12.566 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.566 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:12.566 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:12.566 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:12.566 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:12.566 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:12.566 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:12.567 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:12.567 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.567 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:12.567 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:12.567 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:12.567 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:12.567 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:12.567 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:12.567 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:12.567 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:12.567 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:12.567 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.567 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:12.568 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:12.568 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:12.568 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:12.568 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.568 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:12.568 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:12.568 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:12.568 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:12.568 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.568 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.568 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:12.569 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:12.569 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:12.569 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:12.569 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.569 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.569 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:12.569 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:12.569 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:12.569 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.569 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:12.569 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.570 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:12.570 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:12.570 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.570 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:12.570 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:12.570 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:12.570 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:12.570 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:12.570 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:12.570 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.570 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:12.570 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.571 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:12.571 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.571 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:12.571 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:12.571 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.571 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:12.571 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.571 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:12.571 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:12.571 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:12.571 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:12.571 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:12.571 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:12.572 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:12.572 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:12.572 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:12.572 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:12.572 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:12.572 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:12.572 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:12.572 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.572 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:12.572 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:12.572 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:12.573 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:12.573 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:12.573 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:12.573 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:12.573 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:12.573 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:12.573 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:12.573 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:12.573 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.573 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.573 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:12.574 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.574 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:12.574 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:12.574 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:12.575 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:12.575 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:12.575 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:12.575 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:12.575 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:12.575 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:12.575 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:12.575 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:12.575 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:12.575 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:12.575 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:12.575 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:12.576 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:12.576 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:12.576 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:12.576 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:12.576 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:12.576 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:12.576 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:12.576 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:12.576 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:12.576 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:12.576 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:12.576 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:12.577 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:12.577 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.577 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.577 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:12.577 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.577 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:12.577 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:12.577 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.577 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:12.577 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:12.577 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:12.577 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:12.578 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:12.578 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.578 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:12.578 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:12.578 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.578 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.578 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:12.578 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:12.578 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.578 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.578 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:12.579 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:12.579 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:12.579 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:12.579 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:12.579 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.579 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.579 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:12.579 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:12.579 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:12.579 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.579 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:12.579 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.580 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:12.580 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.580 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:12.580 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.580 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:12.580 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.580 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:12.580 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:12.580 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:12.580 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:12.580 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.580 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:12.580 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.581 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:12.581 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:12.581 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:12.581 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:12.581 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:12.581 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:12.581 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:12.581 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:12.581 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:12.581 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:12.581 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:12.581 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:12.582 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:12.582 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:12.582 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:12.582 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:12.582 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:12.582 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:12.582 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:12.582 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:12.582 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:12.582 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:12.582 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:12.582 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:12.583 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:12.583 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:12.583 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:12.583 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:12.583 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:12.583 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:12.583 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:12.583 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:12.583 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:12.583 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:12.583 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:12.583 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:12.584 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:12.584 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:12.584 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:12.584 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:12.584 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.584 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.584 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:12.584 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:12.584 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.584 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:12.584 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.584 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:12.585 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:12.585 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:12.585 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:12.585 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:12.585 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:12.585 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:12.585 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:12.585 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:12.585 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:12.585 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:12.585 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:12.585 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:12.585 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.586 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:12.586 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:12.586 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:12.586 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:12.586 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:12.586 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:12.586 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:12.586 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:12.586 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:12.586 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:12.586 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:12.586 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.587 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.587 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:12.587 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:12.587 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:12.587 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:12.587 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:12.587 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.587 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.587 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:12.587 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:12.587 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:12.587 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:12.588 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:12.588 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.588 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:12.588 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:12.588 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:12.588 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:12.588 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:12.589 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:12.589 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.589 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:12.589 INFO:teuthology.orchestra.run.smithi012.stdout:______ ERROR at teardown of test_object_lock_put_obj_lock_invalid_status _______ 2023-10-05T12:49:12.589 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.589 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:12.589 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.589 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:12.590 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:12.590 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.590 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:12.590 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:12.590 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:12.590 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:12.590 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:12.590 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.590 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:12.590 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:12.590 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.591 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.591 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:12.591 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:12.591 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.591 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.591 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:12.591 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.591 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:12.591 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:12.591 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.591 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.591 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:12.592 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:12.592 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.592 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:12.592 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:12.592 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:12.592 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:12.592 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:12.592 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:12.592 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:12.592 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.592 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:12.592 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:12.593 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:12.593 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:12.593 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:12.593 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:12.593 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:12.593 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:12.593 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:12.593 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.593 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:12.593 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:12.593 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:12.593 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:12.594 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.594 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:12.594 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:12.594 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:12.594 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:12.594 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.594 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.594 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:12.594 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:12.594 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:12.594 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:12.595 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.595 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.595 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:12.595 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:12.595 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:12.595 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.595 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:12.595 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.595 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:12.595 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:12.595 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.595 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:12.596 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:12.596 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:12.596 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:12.596 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:12.596 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:12.596 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.596 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:12.596 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.596 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:12.596 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.596 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:12.596 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:12.597 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.597 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:12.597 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.597 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:12.597 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:12.597 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:12.597 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:12.597 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:12.597 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:12.597 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:12.597 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:12.597 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:12.598 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:12.598 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:12.598 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:12.598 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:12.598 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.598 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:12.598 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:12.598 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:12.598 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:12.598 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:12.598 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:12.598 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:12.599 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:12.599 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:12.599 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:12.599 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:12.599 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.599 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.599 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:12.599 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.599 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:12.599 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:12.599 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:12.600 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:12.600 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:12.600 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:12.600 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:12.600 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:12.600 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:12.600 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:12.600 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:12.600 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:12.600 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:12.600 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:12.600 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:12.601 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:12.601 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:12.601 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:12.601 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:12.601 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:12.601 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:12.601 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:12.601 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:12.601 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:12.601 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:12.601 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:12.601 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:12.601 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:12.602 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.602 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.602 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:12.602 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.602 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:12.602 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:12.602 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.602 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:12.602 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:12.602 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:12.602 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:12.602 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:12.603 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.603 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:12.603 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:12.603 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.603 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.603 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:12.603 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:12.603 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.603 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.603 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:12.603 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:12.603 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:12.603 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:12.604 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:12.604 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.604 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.604 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:12.604 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:12.604 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:12.604 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.604 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:12.604 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.604 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:12.604 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.605 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:12.605 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.605 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:12.605 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.605 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:12.605 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:12.605 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:12.605 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:12.605 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.605 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:12.605 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.606 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:12.606 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:12.606 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:12.606 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:12.606 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:12.606 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:12.606 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:12.606 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:12.606 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:12.606 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:12.606 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:12.607 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:12.607 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:12.607 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:12.607 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:12.607 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:12.607 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:12.607 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:12.607 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:12.607 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:12.607 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:12.607 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:12.607 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:12.608 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:12.608 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:12.608 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:12.608 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:12.608 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:12.608 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:12.608 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:12.608 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:12.608 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:12.608 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:12.608 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:12.608 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:12.609 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:12.609 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:12.609 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:12.609 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:12.609 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:12.609 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.609 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.609 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:12.609 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:12.609 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.609 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:12.610 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.610 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:12.610 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:12.610 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:12.610 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:12.610 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:12.610 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:12.610 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:12.610 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:12.610 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:12.610 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:12.610 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:12.611 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:12.611 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:12.611 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.611 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:12.611 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:12.611 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:12.611 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:12.611 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:12.611 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:12.611 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:12.611 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:12.611 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:12.612 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:12.612 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:12.612 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.612 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.612 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:12.612 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:12.612 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:12.612 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:12.612 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:12.612 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.612 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.612 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:12.612 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:12.613 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:12.613 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:12.613 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:12.613 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.613 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:12.613 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:12.613 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:12.613 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:12.613 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:12.613 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:12.613 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.613 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:12.613 INFO:teuthology.orchestra.run.smithi012.stdout:___________ ERROR at teardown of test_object_lock_suspend_versioning ___________ 2023-10-05T12:49:12.614 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.614 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:12.614 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.614 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:12.614 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:12.614 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.614 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:12.614 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:12.614 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:12.614 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:12.614 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:12.615 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.615 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:12.615 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:12.615 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.615 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.615 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:12.615 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:12.615 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.615 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.615 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:12.615 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.616 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:12.616 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:12.616 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.616 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.616 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:12.616 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:12.616 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.616 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:12.616 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:12.616 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:12.616 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:12.616 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:12.617 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:12.617 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:12.617 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.617 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:12.617 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:12.617 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:12.617 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:12.617 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:12.617 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:12.617 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:12.617 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:12.617 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:12.618 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.618 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:12.618 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:12.618 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:12.618 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:12.618 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.618 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:12.618 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:12.618 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:12.618 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:12.618 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.619 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.619 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:12.619 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:12.619 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:12.619 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:12.619 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.619 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.619 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:12.619 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:12.619 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:12.619 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.620 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:12.620 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.620 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:12.620 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:12.620 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.620 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:12.620 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:12.620 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:12.620 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:12.620 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:12.620 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:12.620 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.621 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:12.621 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.621 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:12.621 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.621 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:12.621 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:12.621 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.621 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:12.621 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.621 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:12.621 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:12.622 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:12.622 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:12.622 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:12.622 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:12.622 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:12.622 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:12.622 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:12.622 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:12.622 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:12.622 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:12.622 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:12.623 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.623 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:12.623 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:12.623 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:12.623 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:12.623 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:12.623 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:12.623 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:12.623 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:12.623 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:12.623 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:12.623 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:12.624 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.624 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.624 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:12.624 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.624 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:12.624 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:12.624 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:12.624 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:12.624 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:12.624 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:12.624 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:12.624 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:12.625 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:12.625 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:12.625 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:12.625 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:12.625 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:12.625 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:12.625 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:12.625 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:12.625 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:12.625 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:12.625 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:12.625 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:12.626 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:12.626 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:12.626 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:12.626 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:12.626 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:12.626 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:12.626 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:12.626 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:12.626 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.626 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.626 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:12.626 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.627 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:12.627 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:12.627 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.627 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:12.627 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:12.627 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:12.627 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:12.627 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:12.627 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.627 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:12.627 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:12.627 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.628 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.628 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:12.628 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:12.628 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.628 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.628 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:12.628 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:12.628 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:12.628 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:12.628 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:12.628 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.628 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.629 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:12.629 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:12.629 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:12.629 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.629 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:12.629 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.629 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:12.629 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.629 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:12.629 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.629 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:12.630 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.630 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:12.630 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:12.630 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:12.630 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:12.630 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.630 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:12.630 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.630 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:12.630 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:12.630 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:12.631 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:12.631 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:12.631 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:12.631 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:12.631 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:12.631 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:12.631 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:12.631 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:12.631 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:12.631 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:12.631 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:12.631 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:12.632 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:12.632 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:12.632 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:12.632 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:12.632 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:12.632 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:12.632 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:12.632 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:12.632 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:12.632 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:12.632 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:12.632 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:12.633 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:12.633 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:12.633 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:12.633 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:12.633 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:12.633 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:12.633 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:12.633 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:12.633 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:12.633 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:12.633 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:12.633 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:12.634 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:12.634 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.634 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.634 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:12.634 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:12.634 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.634 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:12.634 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.634 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:12.634 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:12.634 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:12.635 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:12.635 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:12.635 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:12.635 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:12.635 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:12.635 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:12.635 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:12.635 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:12.635 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:12.635 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:12.635 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.635 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:12.635 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:12.636 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:12.636 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:12.636 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:12.636 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:12.636 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:12.636 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:12.636 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:12.636 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:12.636 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:12.636 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.636 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.636 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:12.637 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:12.637 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:12.637 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:12.637 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:12.637 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.637 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.637 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:12.637 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:12.637 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:12.637 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:12.637 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:12.637 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.637 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:12.638 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:12.638 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:12.638 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:12.638 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:12.638 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:12.638 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.638 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:12.638 INFO:teuthology.orchestra.run.smithi012.stdout:______________ ERROR at teardown of test_object_lock_get_obj_lock ______________ 2023-10-05T12:49:12.638 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.638 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:12.638 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.638 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:12.639 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:12.639 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.639 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:12.639 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:12.639 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:12.639 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:12.639 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:12.639 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.639 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:12.639 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:12.639 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.639 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.640 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:12.640 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:12.640 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.640 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.640 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:12.640 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.640 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:12.640 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:12.640 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.640 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.640 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:12.640 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:12.640 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.641 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:12.641 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:12.641 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:12.641 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:12.641 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:12.641 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:12.641 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:12.641 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.641 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:12.641 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:12.641 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:12.642 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:12.642 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:12.642 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:12.651 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:12.651 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:12.651 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:12.651 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.651 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:12.651 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:12.651 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:12.651 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:12.651 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.651 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:12.652 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:12.652 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:12.652 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:12.652 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.652 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.652 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:12.652 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:12.652 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:12.652 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:12.652 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.652 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.653 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:12.653 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:12.653 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:12.653 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.653 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:12.653 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.653 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:12.653 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:12.653 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.653 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:12.653 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:12.653 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:12.654 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:12.654 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:12.654 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:12.654 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.654 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:12.654 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.654 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:12.654 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.654 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:12.654 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:12.654 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.655 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:12.655 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.655 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:12.655 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:12.655 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:12.655 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:12.655 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:12.655 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:12.655 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:12.655 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:12.656 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:12.656 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:12.656 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:12.656 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:12.656 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:12.656 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.656 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:12.656 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:12.656 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:12.656 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:12.656 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:12.656 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:12.657 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:12.657 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:12.657 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:12.657 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:12.657 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:12.657 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.657 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.657 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:12.657 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.657 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:12.657 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:12.658 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:12.658 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:12.658 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:12.658 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:12.658 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:12.658 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:12.658 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:12.658 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:12.658 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:12.658 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:12.658 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:12.659 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:12.659 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:12.659 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:12.659 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:12.659 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:12.659 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:12.659 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:12.659 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:12.659 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:12.659 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:12.659 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:12.660 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:12.660 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:12.660 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:12.660 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:12.660 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.660 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.660 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:12.660 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.660 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:12.660 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:12.660 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.660 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:12.661 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:12.661 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:12.661 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:12.661 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:12.661 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.661 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:12.661 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:12.661 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.661 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.661 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:12.661 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:12.662 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.662 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.662 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:12.662 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:12.662 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:12.662 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:12.662 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:12.662 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.662 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.662 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:12.662 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:12.662 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:12.663 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.663 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:12.663 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.663 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:12.663 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.663 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:12.663 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.663 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:12.663 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.663 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:12.663 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:12.663 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:12.664 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:12.664 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.664 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:12.664 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.664 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:12.664 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:12.664 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:12.664 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:12.664 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:12.664 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:12.664 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:12.665 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:12.665 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:12.665 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:12.665 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:12.665 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:12.665 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:12.665 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:12.665 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:12.665 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:12.665 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:12.665 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:12.665 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:12.666 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:12.666 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:12.666 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:12.666 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:12.666 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:12.666 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:12.666 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:12.666 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:12.666 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:12.666 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:12.666 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:12.667 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:12.667 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:12.667 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:12.667 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:12.667 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:12.667 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:12.667 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:12.667 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:12.667 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:12.667 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:12.667 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.667 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.668 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:12.668 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:12.668 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.668 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:12.668 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.668 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:12.668 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:12.668 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:12.668 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:12.668 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:12.668 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:12.669 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:12.669 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:12.669 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:12.669 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:12.669 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:12.669 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:12.669 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:12.669 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.669 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:12.669 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:12.669 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:12.670 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:12.670 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:12.670 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:12.670 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:12.670 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:12.670 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:12.670 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:12.670 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:12.670 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.670 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.670 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:12.671 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:12.671 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:12.671 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:12.671 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:12.671 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.671 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.671 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:12.671 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:12.671 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:12.671 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:12.671 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:12.672 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.672 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:12.672 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:12.672 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:12.672 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:12.672 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:12.672 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:12.672 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.672 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:12.672 INFO:teuthology.orchestra.run.smithi012.stdout:______ ERROR at teardown of test_object_lock_get_obj_lock_invalid_bucket _______ 2023-10-05T12:49:12.672 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.673 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:12.673 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.673 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:12.673 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:12.673 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.673 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:12.673 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:12.673 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:12.673 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:12.673 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:12.673 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.673 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:12.674 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:12.674 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.674 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.674 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:12.674 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:12.674 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.674 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.674 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:12.674 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.674 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:12.674 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:12.675 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.675 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.675 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:12.675 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:12.675 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.675 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:12.675 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:12.675 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:12.675 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:12.675 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:12.675 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:12.676 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:12.678 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.678 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:12.678 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:12.678 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:12.678 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:12.678 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:12.678 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:12.678 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:12.678 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:12.678 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:12.678 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.679 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:12.679 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:12.679 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:12.679 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:12.679 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.679 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:12.679 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:12.679 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:12.679 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:12.679 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.679 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.679 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:12.680 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:12.680 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:12.680 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:12.680 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.680 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.680 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:12.680 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:12.680 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:12.680 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.680 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:12.680 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.680 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:12.681 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:12.681 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.681 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:12.681 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:12.681 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:12.681 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:12.681 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:12.681 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:12.681 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.681 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:12.681 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.682 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:12.682 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.682 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:12.682 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:12.682 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.682 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:12.682 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.682 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:12.682 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:12.682 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:12.682 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:12.682 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:12.683 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:12.683 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:12.683 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:12.683 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:12.683 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:12.683 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:12.683 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:12.683 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:12.683 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.683 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:12.683 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:12.683 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:12.684 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:12.684 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:12.684 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:12.684 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:12.684 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:12.684 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:12.684 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:12.684 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:12.684 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.684 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.684 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:12.685 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.685 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:12.685 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:12.685 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:12.685 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:12.685 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:12.685 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:12.685 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:12.685 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:12.685 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:12.685 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:12.685 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:12.686 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:12.686 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:12.686 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:12.686 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:12.686 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:12.686 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:12.686 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:12.686 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:12.686 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:12.686 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:12.686 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:12.686 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:12.687 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:12.687 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:12.687 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:12.687 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:12.687 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:12.687 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.687 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.687 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:12.687 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.687 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:12.687 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:12.688 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.688 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:12.688 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:12.688 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:12.688 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:12.688 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:12.688 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.688 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:12.688 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:12.688 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.688 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.688 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:12.689 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:12.689 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.689 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.689 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:12.689 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:12.689 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:12.689 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:12.689 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:12.689 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.689 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.689 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:12.689 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:12.690 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:12.690 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.690 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:12.690 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.690 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:12.690 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.690 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:12.690 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.690 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:12.690 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.690 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:12.691 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:12.691 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:12.691 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:12.691 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.691 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:12.691 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.691 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:12.691 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:12.691 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:12.691 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:12.691 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:12.691 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:12.692 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:12.692 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:12.692 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:12.692 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:12.692 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:12.692 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:12.692 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:12.692 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:12.692 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:12.692 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:12.692 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:12.692 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:12.693 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:12.693 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:12.693 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:12.693 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:12.693 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:12.693 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:12.693 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:12.693 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:12.693 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:12.693 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:12.693 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:12.693 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:12.694 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:12.694 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:12.694 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:12.694 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:12.694 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:12.694 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:12.694 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:12.694 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:12.694 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:12.694 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:12.694 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.694 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.695 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:12.695 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:12.695 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.695 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:12.695 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.695 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:12.695 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:12.695 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:12.695 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:12.695 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:12.695 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:12.695 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:12.696 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:12.696 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:12.696 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:12.696 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:12.696 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:12.696 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:12.696 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.696 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:12.696 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:12.696 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:12.696 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:12.696 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:12.697 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:12.697 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:12.697 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:12.697 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:12.697 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:12.697 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:12.697 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.697 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.697 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:12.697 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:12.697 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:12.697 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:12.697 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:12.698 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.698 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.698 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:12.698 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:12.698 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:12.698 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:12.698 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:12.698 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.698 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:12.698 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:12.698 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:12.698 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:12.699 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:12.699 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:12.699 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.699 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:12.699 INFO:teuthology.orchestra.run.smithi012.stdout:___________ ERROR at teardown of test_object_lock_put_obj_retention ____________ 2023-10-05T12:49:12.699 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.699 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:12.699 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.699 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:12.699 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:12.699 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.699 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:12.700 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:12.700 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:12.700 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:12.700 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:12.700 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.700 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:12.700 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:12.700 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.700 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.700 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:12.700 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:12.701 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.701 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.701 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:12.701 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.701 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:12.701 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:12.701 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.701 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.701 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:12.701 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:12.701 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.701 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:12.701 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:12.702 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:12.702 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:12.702 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:12.702 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:12.702 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:12.702 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.702 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:12.702 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:12.702 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:12.702 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:12.702 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:12.702 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:12.702 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:12.703 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:12.703 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:12.703 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.703 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:12.703 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:12.703 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:12.703 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:12.703 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.703 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:12.703 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:12.703 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:12.704 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:12.704 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.704 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.704 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:12.704 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:12.704 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:12.704 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:12.704 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.704 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.704 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:12.704 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:12.704 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:12.705 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.705 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:12.705 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.705 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:12.705 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:12.705 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.705 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:12.705 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:12.705 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:12.705 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:12.705 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:12.705 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:12.705 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.706 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:12.706 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.706 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:12.706 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.706 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:12.706 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:12.706 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.706 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:12.706 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.706 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:12.706 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:12.706 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:12.706 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:12.707 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:12.707 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:12.707 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:12.707 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:12.707 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:12.707 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:12.707 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:12.707 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:12.707 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:12.707 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.707 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:12.707 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:12.708 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:12.708 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:12.708 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:12.708 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:12.708 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:12.708 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:12.708 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:12.708 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:12.708 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:12.708 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.708 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.708 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:12.708 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.709 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:12.709 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:12.709 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:12.709 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:12.709 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:12.709 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:12.709 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:12.709 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:12.709 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:12.709 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:12.709 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:12.709 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:12.710 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:12.710 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:12.710 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:12.710 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:12.710 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:12.710 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:12.710 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:12.710 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:12.710 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:12.710 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:12.710 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:12.710 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:12.710 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:12.711 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:12.711 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:12.711 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:12.711 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.711 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.711 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:12.711 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.711 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:12.711 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:12.711 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.711 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:12.711 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:12.711 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:12.712 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:12.712 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:12.712 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.712 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:12.712 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:12.712 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.712 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.712 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:12.712 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:12.712 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.712 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.712 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:12.712 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:12.712 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:12.713 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:12.713 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:12.713 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.713 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.713 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:12.713 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:12.713 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:12.713 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.713 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:12.713 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.713 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:12.713 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.714 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:12.714 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.714 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:12.714 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.714 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:12.714 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:12.714 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:12.714 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:12.714 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.714 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:12.714 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.714 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:12.714 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:12.715 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:12.715 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:12.715 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:12.715 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:12.715 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:12.715 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:12.715 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:12.715 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:12.715 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:12.715 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:12.715 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:12.715 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:12.715 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:12.716 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:12.716 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:12.716 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:12.716 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:12.716 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:12.716 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:12.716 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:12.716 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:12.716 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:12.716 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:12.716 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:12.716 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:12.717 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:12.717 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:12.717 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:12.717 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:12.717 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:12.717 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:12.717 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:12.717 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:12.717 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:12.717 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:12.717 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:12.718 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:12.718 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:12.718 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.718 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.718 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:12.718 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:12.718 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.718 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:12.718 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.718 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:12.718 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:12.719 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:12.719 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:12.719 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:12.719 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:12.719 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:12.719 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:12.719 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:12.719 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:12.719 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:12.719 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:12.719 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:12.719 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.720 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:12.720 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:12.720 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:12.720 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:12.720 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:12.720 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:12.720 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:12.720 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:12.720 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:12.720 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:12.720 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:12.720 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.720 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.721 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:12.721 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:12.721 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:12.721 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:12.721 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:12.721 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.721 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.721 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:12.721 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:12.721 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:12.721 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:12.721 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:12.721 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.722 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:12.722 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:12.722 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:12.723 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:12.723 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:12.723 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:12.723 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.723 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:12.723 INFO:teuthology.orchestra.run.smithi012.stdout:____ ERROR at teardown of test_object_lock_put_obj_retention_invalid_bucket ____ 2023-10-05T12:49:12.723 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.723 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:12.723 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.723 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:12.723 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:12.724 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.724 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:12.724 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:12.724 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:12.724 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:12.724 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:12.724 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.724 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:12.724 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:12.724 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.724 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.724 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:12.724 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:12.725 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.725 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.725 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:12.725 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.725 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:12.725 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:12.725 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.725 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.725 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:12.725 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:12.725 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.725 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:12.726 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:12.726 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:12.726 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:12.726 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:12.726 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:12.726 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:12.726 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.726 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:12.726 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:12.726 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:12.726 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:12.726 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:12.727 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:12.727 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:12.727 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:12.727 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:12.727 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.727 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:12.727 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:12.727 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:12.727 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:12.727 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.727 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:12.727 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:12.728 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:12.728 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:12.728 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.728 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.728 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:12.728 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:12.728 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:12.728 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:12.728 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.728 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.728 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:12.729 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:12.729 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:12.729 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.729 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:12.729 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.729 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:12.729 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:12.729 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.729 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:12.729 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:12.729 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:12.729 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:12.730 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:12.730 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:12.730 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.730 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:12.730 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.730 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:12.730 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.730 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:12.730 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:12.730 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.730 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:12.731 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.731 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:12.731 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:12.731 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:12.731 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:12.731 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:12.731 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:12.731 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:12.731 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:12.731 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:12.731 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:12.731 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:12.732 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:12.732 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:12.732 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.732 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:12.732 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:12.732 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:12.732 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:12.732 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:12.732 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:12.732 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:12.732 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:12.732 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:12.733 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:12.733 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:12.733 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.733 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.733 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:12.733 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.733 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:12.733 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:12.733 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:12.733 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:12.733 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:12.734 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:12.734 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:12.734 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:12.734 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:12.734 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:12.734 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:12.734 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:12.734 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:12.734 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:12.734 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:12.734 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:12.734 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:12.734 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:12.735 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:12.735 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:12.735 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:12.735 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:12.735 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:12.735 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:12.735 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:12.735 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:12.735 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:12.735 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:12.735 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.735 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.736 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:12.736 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.736 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:12.736 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:12.736 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.736 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:12.736 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:12.736 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:12.736 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:12.736 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:12.736 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.736 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:12.736 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:12.737 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.737 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.737 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:12.737 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:12.737 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.737 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.737 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:12.737 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:12.737 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:12.737 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:12.737 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:12.737 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.738 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.738 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:12.738 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:12.738 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:12.738 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.738 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:12.738 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.738 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:12.738 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.738 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:12.738 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.739 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:12.739 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.739 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:12.739 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:12.739 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:12.739 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:12.739 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.739 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:12.739 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.739 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:12.739 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:12.739 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:12.740 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:12.740 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:12.740 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:12.740 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:12.740 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:12.740 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:12.740 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:12.740 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:12.740 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:12.740 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:12.740 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:12.740 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:12.740 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:12.741 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:12.741 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:12.741 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:12.741 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:12.741 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:12.741 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:12.741 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:12.741 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:12.741 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:12.741 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:12.741 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:12.741 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:12.741 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:12.742 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:12.742 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:12.742 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:12.742 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:12.742 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:12.742 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:12.742 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:12.742 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:12.742 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:12.742 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:12.742 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:12.742 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.743 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.743 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:12.743 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:12.743 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.743 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:12.743 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.743 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:12.743 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:12.743 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:12.743 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:12.743 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:12.743 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:12.743 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:12.744 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:12.744 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:12.744 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:12.744 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:12.744 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:12.744 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:12.744 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.744 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:12.744 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:12.744 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:12.744 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:12.744 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:12.744 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:12.745 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:12.745 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:12.745 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:12.745 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:12.745 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:12.745 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.745 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.745 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:12.745 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:12.745 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:12.745 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:12.745 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:12.746 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.746 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.746 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:12.746 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:12.746 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:12.746 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:12.746 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:12.746 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.746 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:12.746 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:12.746 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:12.747 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:12.747 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:12.747 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:12.747 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.747 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:12.747 INFO:teuthology.orchestra.run.smithi012.stdout:_____ ERROR at teardown of test_object_lock_put_obj_retention_invalid_mode _____ 2023-10-05T12:49:12.747 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.747 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:12.747 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.747 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:12.747 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:12.747 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.748 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:12.748 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:12.748 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:12.748 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:12.748 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:12.748 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.748 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:12.748 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:12.748 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.748 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.748 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:12.748 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:12.749 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.749 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.749 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:12.749 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.749 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:12.749 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:12.749 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.749 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.749 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:12.749 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:12.749 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.750 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:12.750 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:12.750 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:12.750 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:12.750 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:12.750 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:12.750 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:12.750 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.750 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:12.750 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:12.750 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:12.750 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:12.751 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:12.751 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:12.751 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:12.751 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:12.751 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:12.751 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.751 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:12.751 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:12.751 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:12.751 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:12.751 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.751 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:12.752 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:12.752 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:12.752 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:12.752 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.752 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.752 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:12.752 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:12.752 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:12.752 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:12.752 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.752 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.752 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:12.753 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:12.753 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:12.753 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.753 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:12.753 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.753 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:12.753 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:12.753 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.753 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:12.753 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:12.753 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:12.753 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:12.754 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:12.754 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:12.754 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.754 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:12.754 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.754 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:12.754 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.754 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:12.754 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:12.754 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.754 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:12.754 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.755 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:12.755 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:12.755 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:12.755 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:12.755 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:12.755 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:12.755 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:12.755 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:12.755 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:12.755 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:12.755 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:12.755 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:12.756 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:12.756 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.756 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:12.756 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:12.756 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:12.756 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:12.756 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:12.756 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:12.756 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:12.756 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:12.756 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:12.756 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:12.757 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:12.757 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.757 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.757 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:12.757 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.757 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:12.757 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:12.757 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:12.757 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:12.757 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:12.757 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:12.757 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:12.758 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:12.758 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:12.758 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:12.758 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:12.758 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:12.758 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:12.758 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:12.758 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:12.758 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:12.758 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:12.758 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:12.759 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:12.759 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:12.759 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:12.759 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:12.759 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:12.759 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:12.759 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:12.759 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:12.759 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:12.759 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:12.759 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.760 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.760 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:12.760 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.760 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:12.760 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:12.760 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.760 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:12.760 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:12.760 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:12.760 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:12.760 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:12.760 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.760 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:12.761 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:12.761 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.761 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.761 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:12.761 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:12.761 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.761 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.761 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:12.761 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:12.761 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:12.761 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:12.761 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:12.761 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.762 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.762 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:12.762 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:12.762 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:12.762 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.762 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:12.762 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.762 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:12.762 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.762 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:12.762 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.763 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:12.763 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.763 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:12.763 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:12.763 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:12.763 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:12.763 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.763 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:12.763 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.763 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:12.763 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:12.763 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:12.764 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:12.764 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:12.764 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:12.764 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:12.764 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:12.764 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:12.764 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:12.764 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:12.764 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:12.764 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:12.764 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:12.764 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:12.765 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:12.765 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:12.765 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:12.765 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:12.765 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:12.765 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:12.765 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:12.765 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:12.765 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:12.765 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:12.765 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:12.765 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:12.766 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:12.766 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:12.766 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:12.766 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:12.766 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:12.766 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:12.766 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:12.766 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:12.766 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:12.766 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:12.766 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:12.766 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:12.767 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:12.767 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.767 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.767 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:12.767 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:12.767 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.767 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:12.767 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.767 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:12.767 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:12.767 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:12.767 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:12.767 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:12.768 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:12.768 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:12.768 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:12.768 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:12.768 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:12.768 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:12.768 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:12.768 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:12.768 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.768 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:12.768 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:12.768 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:12.769 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:12.769 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:12.769 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:12.769 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:12.769 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:12.769 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:12.769 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:12.769 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:12.769 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.769 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.769 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:12.769 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:12.769 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:12.770 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:12.770 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:12.770 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.770 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.770 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:12.770 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:12.770 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:12.770 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:12.770 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:12.770 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.770 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:12.770 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:12.771 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:12.771 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:12.771 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:12.771 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:12.771 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.771 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:12.771 INFO:teuthology.orchestra.run.smithi012.stdout:___________ ERROR at teardown of test_object_lock_get_obj_retention ____________ 2023-10-05T12:49:12.771 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.771 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:12.771 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.771 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:12.771 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:12.771 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.772 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:12.772 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:12.772 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:12.772 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:12.772 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:12.772 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.772 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:12.772 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:12.772 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.772 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.772 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:12.772 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:12.773 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.773 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.773 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:12.773 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.773 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:12.773 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:12.773 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.773 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.773 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:12.773 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:12.773 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.773 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:12.773 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:12.774 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:12.774 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:12.774 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:12.774 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:12.774 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:12.774 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.774 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:12.774 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:12.774 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:12.774 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:12.774 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:12.774 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:12.775 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:12.775 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:12.775 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:12.775 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.775 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:12.775 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:12.775 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:12.775 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:12.775 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.775 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:12.775 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:12.776 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:12.776 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:12.776 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.776 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.776 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:12.776 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:12.776 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:12.776 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:12.776 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.776 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.776 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:12.776 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:12.777 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:12.777 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.777 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:12.777 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.777 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:12.777 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:12.777 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.777 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:12.777 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:12.777 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:12.777 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:12.778 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:12.778 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:12.778 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.778 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:12.778 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.778 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:12.778 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.778 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:12.778 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:12.778 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.778 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:12.779 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.779 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:12.779 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:12.779 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:12.779 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:12.779 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:12.779 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:12.779 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:12.779 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:12.779 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:12.779 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:12.779 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:12.780 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:12.780 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:12.780 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.780 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:12.780 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:12.780 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:12.780 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:12.780 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:12.780 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:12.780 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:12.780 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:12.780 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:12.781 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:12.781 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:12.781 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.781 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.781 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:12.781 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.781 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:12.781 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:12.781 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:12.781 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:12.781 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:12.781 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:12.782 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:12.782 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:12.782 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:12.782 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:12.782 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:12.782 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:12.782 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:12.782 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:12.782 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:12.782 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:12.782 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:12.782 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:12.783 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:12.783 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:12.783 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:12.783 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:12.783 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:12.783 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:12.783 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:12.783 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:12.783 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:12.783 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:12.783 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.783 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.784 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:12.784 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.784 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:12.784 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:12.784 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.784 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:12.784 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:12.784 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:12.784 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:12.784 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:12.784 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.784 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:12.785 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:12.785 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.785 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.785 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:12.785 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:12.785 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.785 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.785 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:12.785 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:12.785 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:12.785 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:12.785 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:12.786 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.786 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.786 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:12.786 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:12.786 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:12.786 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.786 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:12.786 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.786 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:12.786 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.786 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:12.786 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.787 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:12.787 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.787 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:12.787 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:12.787 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:12.787 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:12.787 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.787 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:12.787 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.787 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:12.787 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:12.787 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:12.788 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:12.788 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:12.788 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:12.788 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:12.788 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:12.788 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:12.788 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:12.788 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:12.805 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:12.805 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:12.805 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:12.805 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:12.805 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:12.805 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:12.805 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:12.805 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:12.806 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:12.806 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:12.806 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:12.806 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:12.806 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:12.806 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:12.806 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:12.806 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:12.806 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:12.806 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:12.806 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:12.806 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:12.807 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:12.807 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:12.807 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:12.807 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:12.807 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:12.807 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:12.807 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:12.807 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:12.807 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:12.807 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.807 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.808 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:12.808 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:12.808 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.808 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:12.808 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.808 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:12.808 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:12.808 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:12.808 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:12.808 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:12.808 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:12.809 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:12.809 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:12.809 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:12.809 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:12.809 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:12.809 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:12.809 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:12.809 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.809 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:12.809 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:12.809 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:12.809 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:12.810 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:12.810 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:12.810 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:12.810 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:12.810 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:12.810 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:12.810 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:12.810 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.810 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.810 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:12.810 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:12.810 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:12.811 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:12.811 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:12.811 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.811 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.811 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:12.811 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:12.811 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:12.811 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:12.811 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:12.811 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.811 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:12.811 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:12.812 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:12.812 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:12.812 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:12.812 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:12.812 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.812 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:12.812 INFO:teuthology.orchestra.run.smithi012.stdout:_______ ERROR at teardown of test_object_lock_get_obj_retention_iso8601 ________ 2023-10-05T12:49:12.812 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.812 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:12.812 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.812 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:12.812 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:12.813 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.813 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:12.813 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:12.813 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:12.813 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:12.813 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:12.813 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.813 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:12.813 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:12.813 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.813 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.813 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:12.814 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:12.814 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.814 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.814 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:12.814 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.814 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:12.814 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:12.814 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.814 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.814 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:12.814 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:12.815 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.815 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:12.815 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:12.815 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:12.815 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:12.815 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:12.815 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:12.815 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:12.815 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.815 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:12.815 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:12.815 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:12.815 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:12.816 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:12.816 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:12.816 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:12.816 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:12.816 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:12.816 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.816 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:12.816 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:12.816 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:12.816 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:12.816 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.817 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:12.817 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:12.817 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:12.817 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:12.817 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.817 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.817 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:12.817 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:12.817 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:12.817 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:12.817 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.817 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.817 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:12.818 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:12.818 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:12.818 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.818 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:12.818 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.818 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:12.818 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:12.818 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.818 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:12.818 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:12.818 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:12.818 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:12.819 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:12.819 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:12.819 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.819 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:12.819 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.819 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:12.819 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.819 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:12.819 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:12.819 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.819 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:12.819 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.820 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:12.820 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:12.820 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:12.820 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:12.820 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:12.820 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:12.820 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:12.820 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:12.820 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:12.820 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:12.820 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:12.820 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:12.820 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:12.821 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.821 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:12.821 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:12.821 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:12.821 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:12.821 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:12.821 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:12.821 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:12.821 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:12.821 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:12.821 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:12.822 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:12.822 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.822 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.822 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:12.822 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.822 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:12.822 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:12.822 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:12.822 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:12.822 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:12.822 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:12.823 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:12.823 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:12.823 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:12.823 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:12.823 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:12.823 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:12.823 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:12.823 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:12.823 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:12.823 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:12.823 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:12.823 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:12.823 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:12.824 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:12.824 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:12.824 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:12.824 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:12.824 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:12.824 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:12.824 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:12.824 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:12.824 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:12.824 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.824 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.824 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:12.824 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.825 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:12.825 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:12.825 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.825 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:12.825 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:12.825 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:12.825 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:12.825 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:12.825 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.825 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:12.825 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:12.825 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.825 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.826 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:12.826 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:12.826 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.826 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.826 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:12.826 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:12.826 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:12.826 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:12.826 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:12.826 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.826 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.826 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:12.827 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:12.827 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:12.827 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.827 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:12.827 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.827 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:12.827 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.827 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:12.827 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.827 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:12.827 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.827 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:12.828 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:12.828 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:12.828 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:12.828 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.828 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:12.828 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.828 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:12.828 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:12.828 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:12.828 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:12.828 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:12.828 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:12.828 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:12.829 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:12.829 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:12.829 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:12.829 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:12.829 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:12.829 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:12.829 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:12.829 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:12.829 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:12.829 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:12.829 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:12.829 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:12.829 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:12.830 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:12.830 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:12.830 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:12.830 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:12.830 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:12.830 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:12.830 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:12.830 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:12.830 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:12.830 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:12.830 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:12.830 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:12.831 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:12.831 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:12.831 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:12.831 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:12.831 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:12.831 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:12.831 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:12.831 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:12.831 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.831 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.831 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:12.831 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:12.832 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.832 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:12.832 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.832 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:12.832 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:12.832 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:12.832 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:12.832 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:12.832 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:12.832 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:12.832 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:12.832 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:12.832 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:12.833 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:12.833 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:12.833 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:12.833 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.833 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:12.833 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:12.833 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:12.833 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:12.833 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:12.833 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:12.833 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:12.833 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:12.833 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:12.834 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:12.834 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:12.834 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.834 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.834 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:12.834 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:12.834 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:12.834 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:12.834 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:12.834 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.834 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.834 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:12.834 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:12.835 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:12.835 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:12.835 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:12.835 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.835 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:12.835 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:12.835 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:12.835 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:12.835 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:12.835 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:12.835 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.835 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:12.836 INFO:teuthology.orchestra.run.smithi012.stdout:____ ERROR at teardown of test_object_lock_get_obj_retention_invalid_bucket ____ 2023-10-05T12:49:12.836 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.836 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:12.836 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.836 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:12.836 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:12.836 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.836 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:12.836 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:12.836 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:12.836 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:12.836 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:12.836 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.837 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:12.837 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:12.837 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.837 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.837 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:12.837 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:12.837 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.837 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.837 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:12.837 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.837 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:12.837 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:12.838 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.838 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.838 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:12.838 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:12.838 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.838 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:12.838 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:12.838 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:12.838 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:12.838 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:12.838 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:12.839 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:12.839 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.839 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:12.839 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:12.839 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:12.839 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:12.839 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:12.839 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:12.839 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:12.839 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:12.839 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:12.839 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.839 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:12.840 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:12.840 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:12.840 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:12.840 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.840 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:12.840 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:12.840 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:12.840 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:12.840 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.840 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.840 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:12.840 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:12.840 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:12.841 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:12.841 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.841 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.841 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:12.841 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:12.841 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:12.841 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.841 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:12.841 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.841 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:12.841 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:12.841 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.842 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:12.842 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:12.842 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:12.842 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:12.842 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:12.842 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:12.842 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.842 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:12.842 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.842 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:12.842 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.842 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:12.843 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:12.843 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.843 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:12.843 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.843 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:12.843 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:12.843 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:12.843 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:12.843 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:12.843 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:12.843 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:12.843 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:12.844 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:12.844 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:12.844 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:12.844 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:12.844 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:12.844 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.844 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:12.844 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:12.844 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:12.844 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:12.844 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:12.844 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:12.845 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:12.845 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:12.845 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:12.845 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:12.845 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:12.845 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.845 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.845 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:12.845 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.845 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:12.845 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:12.846 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:12.846 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:12.846 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:12.846 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:12.846 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:12.846 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:12.846 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:12.846 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:12.846 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:12.846 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:12.846 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:12.846 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:12.846 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:12.847 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:12.847 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:12.847 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:12.847 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:12.847 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:12.847 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:12.847 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:12.847 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:12.847 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:12.847 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:12.847 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:12.847 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:12.848 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:12.848 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.848 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.848 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:12.848 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.848 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:12.848 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:12.848 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.848 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:12.848 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:12.848 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:12.848 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:12.849 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:12.849 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.849 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:12.849 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:12.849 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.849 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.849 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:12.849 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:12.849 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.849 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.849 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:12.849 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:12.850 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:12.850 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:12.850 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:12.850 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.850 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.850 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:12.850 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:12.850 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:12.850 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.850 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:12.850 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.850 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:12.850 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.851 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:12.851 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.851 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:12.851 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.851 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:12.851 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:12.851 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:12.851 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:12.851 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.851 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:12.851 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.852 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:12.852 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:12.852 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:12.852 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:12.852 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:12.852 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:12.852 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:12.852 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:12.852 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:12.852 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:12.852 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:12.852 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:12.853 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:12.853 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:12.853 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:12.853 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:12.853 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:12.853 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:12.853 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:12.853 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:12.853 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:12.853 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:12.853 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:12.853 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:12.853 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:12.854 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:12.854 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:12.854 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:12.854 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:12.854 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:12.854 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:12.854 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:12.854 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:12.854 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:12.854 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:12.854 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:12.854 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:12.855 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:12.855 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:12.855 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:12.855 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.855 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.855 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:12.855 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:12.855 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.855 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:12.855 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.855 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:12.855 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:12.856 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:12.856 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:12.856 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:12.856 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:12.856 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:12.856 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:12.856 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:12.856 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:12.856 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:12.856 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:12.856 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:12.856 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.856 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:12.857 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:12.857 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:12.857 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:12.857 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:12.857 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:12.857 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:12.857 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:12.857 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:12.857 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:12.857 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:12.857 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.857 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.858 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:12.858 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:12.858 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:12.858 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:12.858 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:12.858 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.858 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.858 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:12.858 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:12.858 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:12.858 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:12.858 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:12.859 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.859 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:12.859 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:12.859 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:12.859 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:12.859 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:12.859 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:12.859 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.859 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:12.859 INFO:teuthology.orchestra.run.smithi012.stdout:______ ERROR at teardown of test_object_lock_put_obj_retention_versionid _______ 2023-10-05T12:49:12.859 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.859 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:12.860 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.860 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:12.860 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:12.860 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.860 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:12.860 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:12.860 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:12.860 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:12.860 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:12.860 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.860 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:12.860 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:12.860 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.861 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.861 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:12.861 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:12.861 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.861 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.861 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:12.861 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.861 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:12.861 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:12.861 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.861 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.861 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:12.862 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:12.862 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.862 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:12.862 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:12.862 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:12.862 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:12.862 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:12.862 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:12.862 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:12.862 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.862 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:12.862 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:12.863 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:12.863 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:12.863 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:12.863 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:12.863 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:12.863 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:12.863 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:12.863 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.863 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:12.863 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:12.863 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:12.863 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:12.863 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.864 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:12.864 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:12.864 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:12.864 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:12.864 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.864 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.864 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:12.864 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:12.864 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:12.864 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:12.864 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.864 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.864 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:12.865 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:12.865 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:12.865 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.865 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:12.865 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.865 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:12.865 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:12.865 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.865 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:12.865 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:12.865 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:12.865 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:12.865 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:12.866 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:12.866 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.866 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:12.866 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.866 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:12.866 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.866 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:12.866 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:12.866 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.866 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:12.866 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.866 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:12.866 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:12.867 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:12.867 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:12.867 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:12.867 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:12.867 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:12.867 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:12.867 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:12.867 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:12.867 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:12.867 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:12.867 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:12.867 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.868 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:12.868 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:12.868 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:12.868 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:12.868 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:12.868 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:12.868 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:12.868 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:12.868 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:12.868 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:12.868 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:12.868 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.869 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.869 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:12.869 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.869 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:12.869 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:12.869 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:12.869 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:12.869 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:12.869 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:12.869 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:12.869 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:12.869 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:12.870 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:12.870 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:12.870 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:12.870 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:12.870 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:12.870 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:12.870 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:12.870 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:12.870 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:12.870 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:12.870 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:12.870 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:12.870 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:12.871 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:12.877 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:12.877 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:12.877 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:12.877 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:12.877 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:12.877 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.877 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.877 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:12.878 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.878 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:12.878 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:12.878 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.878 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:12.878 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:12.878 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:12.878 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:12.878 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:12.878 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.878 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:12.879 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:12.879 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.879 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.879 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:12.879 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:12.879 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.879 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.879 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:12.879 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:12.879 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:12.879 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:12.879 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:12.879 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.880 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.880 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:12.881 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:12.881 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:12.881 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.881 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:12.881 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.881 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:12.881 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.881 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:12.881 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.881 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:12.882 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.882 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:12.882 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:12.882 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:12.882 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:12.882 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.882 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:12.882 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.882 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:12.882 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:12.882 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:12.882 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:12.883 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:12.883 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:12.883 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:12.883 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:12.883 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:12.883 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:12.883 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:12.883 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:12.883 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:12.883 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:12.883 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:12.883 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:12.883 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:12.884 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:12.884 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:12.884 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:12.884 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:12.884 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:12.884 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:12.884 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:12.884 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:12.884 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:12.884 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:12.884 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:12.884 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:12.884 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:12.885 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:12.885 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:12.885 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:12.885 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:12.885 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:12.885 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:12.885 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:12.885 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:12.885 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:12.885 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:12.885 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.885 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.885 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:12.886 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:12.886 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.886 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:12.886 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.886 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:12.886 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:12.886 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:12.886 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:12.886 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:12.886 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:12.887 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:12.887 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:12.887 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:12.887 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:12.887 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:12.887 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:12.887 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:12.887 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.887 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:12.887 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:12.887 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:12.888 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:12.888 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:12.888 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:12.888 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:12.888 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:12.888 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:12.888 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:12.888 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:12.888 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.888 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.888 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:12.889 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:12.889 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:12.889 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:12.889 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:12.889 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.889 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.889 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:12.889 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:12.889 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:12.889 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:12.889 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:12.889 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.890 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:12.890 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:12.890 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:12.890 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:12.890 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:12.890 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:12.890 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.890 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:12.890 INFO:teuthology.orchestra.run.smithi012.stdout:_ ERROR at teardown of test_object_lock_put_obj_retention_override_default_retention _ 2023-10-05T12:49:12.890 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.890 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:12.890 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.891 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:12.891 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:12.891 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.891 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:12.891 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:12.891 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:12.891 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:12.891 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:12.891 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.891 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:12.891 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:12.891 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.892 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.892 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:12.892 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:12.892 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.892 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.892 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:12.892 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.892 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:12.892 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:12.892 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.892 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.892 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:12.893 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:12.893 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.893 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:12.893 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:12.893 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:12.893 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:12.893 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:12.893 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:12.893 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:12.893 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.893 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:12.893 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:12.893 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:12.894 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:12.894 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:12.894 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:12.894 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:12.894 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:12.894 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:12.894 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.894 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:12.894 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:12.894 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:12.894 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:12.894 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.895 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:12.895 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:12.895 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:12.895 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:12.895 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.895 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.895 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:12.895 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:12.895 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:12.895 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:12.895 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.895 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.896 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:12.896 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:12.896 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:12.896 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.896 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:12.896 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.896 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:12.896 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:12.896 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.896 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:12.896 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:12.896 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:12.896 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:12.897 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:12.897 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:12.897 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.897 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:12.897 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.897 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:12.897 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.897 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:12.897 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:12.897 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.897 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:12.897 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.898 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:12.898 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:12.898 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:12.898 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:12.898 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:12.898 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:12.898 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:12.898 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:12.898 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:12.898 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:12.898 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:12.899 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:12.899 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:12.899 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.899 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:12.899 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:12.899 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:12.899 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:12.899 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:12.899 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:12.899 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:12.899 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:12.899 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:12.900 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:12.900 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:12.900 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.900 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.900 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:12.900 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.900 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:12.900 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:12.900 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:12.900 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:12.900 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:12.900 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:12.901 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:12.901 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:12.901 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:12.901 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:12.901 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:12.901 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:12.901 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:12.901 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:12.901 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:12.901 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:12.901 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:12.901 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:12.902 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:12.902 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:12.902 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:12.902 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:12.902 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:12.902 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:12.902 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:12.902 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:12.902 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:12.902 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:12.902 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.903 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.903 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:12.903 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.903 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:12.903 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:12.903 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.903 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:12.903 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:12.903 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:12.903 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:12.903 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:12.903 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.904 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:12.904 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:12.904 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.904 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.904 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:12.904 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:12.904 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.904 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.904 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:12.904 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:12.904 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:12.904 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:12.904 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:12.905 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.905 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.905 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:12.905 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:12.905 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:12.905 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.905 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:12.905 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.905 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:12.905 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.905 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:12.905 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.906 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:12.906 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.906 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:12.906 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:12.906 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:12.906 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:12.906 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.906 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:12.906 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.906 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:12.906 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:12.907 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:12.907 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:12.907 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:12.907 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:12.907 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:12.907 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:12.907 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:12.907 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:12.907 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:12.907 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:12.907 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:12.907 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:12.908 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:12.908 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:12.908 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:12.908 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:12.908 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:12.908 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:12.908 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:12.908 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:12.908 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:12.908 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:12.908 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:12.909 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:12.909 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:12.909 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:12.909 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:12.909 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:12.909 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:12.909 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:12.909 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:12.909 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:12.909 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:12.909 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:12.909 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:12.910 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:12.910 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:12.910 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:12.910 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.910 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.910 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:12.910 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:12.910 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.910 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:12.910 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.910 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:12.910 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:12.911 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:12.911 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:12.911 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:12.911 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:12.911 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:12.911 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:12.911 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:12.911 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:12.911 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:12.911 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:12.911 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:12.911 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.912 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:12.912 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:12.912 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:12.912 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:12.912 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:12.912 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:12.912 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:12.912 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:12.912 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:12.912 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:12.912 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:12.912 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.913 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.913 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:12.913 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:12.913 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:12.913 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:12.913 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:12.913 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.913 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.913 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:12.913 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:12.913 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:12.913 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:12.914 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:12.914 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.914 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:12.914 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:12.914 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:12.914 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:12.914 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:12.914 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:12.914 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.914 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:12.914 INFO:teuthology.orchestra.run.smithi012.stdout:___ ERROR at teardown of test_object_lock_put_obj_retention_increase_period ____ 2023-10-05T12:49:12.914 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.915 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:12.915 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.915 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:12.915 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:12.915 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.915 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:12.915 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:12.915 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:12.915 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:12.915 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:12.915 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.915 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:12.916 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:12.916 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.916 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.916 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:12.916 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:12.916 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.916 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.916 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:12.916 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.916 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:12.916 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:12.916 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.917 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.917 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:12.917 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:12.917 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.917 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:12.917 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:12.917 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:12.917 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:12.917 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:12.917 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:12.917 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:12.917 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.918 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:12.918 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:12.918 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:12.918 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:12.918 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:12.918 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:12.918 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:12.918 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:12.918 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:12.918 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.918 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:12.919 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:12.919 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:12.919 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:12.919 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.919 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:12.919 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:12.919 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:12.919 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:12.919 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.919 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.919 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:12.920 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:12.920 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:12.920 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:12.920 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.920 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.920 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:12.920 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:12.920 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:12.920 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.920 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:12.920 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.920 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:12.920 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:12.921 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.921 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:12.921 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:12.921 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:12.921 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:12.921 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:12.921 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:12.921 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.921 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:12.921 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.921 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:12.921 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.922 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:12.922 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:12.922 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.922 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:12.922 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.922 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:12.922 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:12.922 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:12.922 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:12.922 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:12.922 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:12.922 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:12.923 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:12.923 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:12.923 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:12.923 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:12.923 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:12.923 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:12.923 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.923 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:12.923 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:12.923 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:12.923 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:12.923 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:12.923 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:12.924 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:12.924 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:12.924 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:12.924 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:12.924 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:12.924 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.924 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.924 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:12.924 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.924 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:12.924 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:12.924 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:12.925 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:12.925 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:12.925 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:12.925 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:12.925 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:12.925 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:12.925 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:12.925 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:12.925 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:12.925 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:12.925 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:12.925 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:12.925 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:12.926 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:12.926 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:12.926 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:12.926 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:12.926 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:12.926 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:12.926 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:12.926 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:12.926 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:12.926 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:12.926 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:12.927 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:12.927 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.927 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.927 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:12.927 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.927 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:12.927 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:12.927 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.927 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:12.927 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:12.927 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:12.927 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:12.928 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:12.928 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.928 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:12.928 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:12.928 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.928 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.928 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:12.928 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:12.928 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.928 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.928 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:12.928 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:12.929 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:12.929 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:12.929 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:12.929 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.929 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.929 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:12.929 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:12.929 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:12.929 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.929 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:12.929 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.929 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:12.930 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.930 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:12.930 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.930 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:12.930 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.930 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:12.930 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:12.930 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:12.930 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:12.930 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.930 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:12.931 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.931 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:12.931 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:12.931 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:12.931 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:12.931 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:12.931 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:12.931 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:12.931 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:12.931 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:12.931 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:12.931 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:12.931 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:12.932 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:12.932 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:12.932 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:12.932 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:12.932 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:12.932 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:12.932 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:12.932 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:12.932 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:12.932 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:12.932 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:12.932 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:12.932 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:12.933 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:12.933 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:12.933 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:12.933 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:12.933 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:12.933 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:12.933 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:12.933 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:12.933 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:12.933 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:12.933 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:12.933 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:12.934 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:12.934 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:12.934 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:12.934 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.934 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.934 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:12.934 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:12.934 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.934 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:12.934 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.934 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:12.934 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:12.935 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:12.935 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:12.935 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:12.935 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:12.935 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:12.935 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:12.935 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:12.935 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:12.935 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:12.935 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:12.935 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:12.935 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.935 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:12.936 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:12.936 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:12.936 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:12.936 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:12.936 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:12.936 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:12.936 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:12.936 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:12.936 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:12.936 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:12.936 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.936 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.936 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:12.937 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:12.937 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:12.937 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:12.937 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:12.937 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.937 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.937 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:12.937 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:12.937 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:12.937 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:12.937 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:12.937 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.937 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:12.938 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:12.938 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:12.938 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:12.938 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:12.938 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:12.938 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.938 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:12.938 INFO:teuthology.orchestra.run.smithi012.stdout:____ ERROR at teardown of test_object_lock_put_obj_retention_shorten_period ____ 2023-10-05T12:49:12.938 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.938 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:12.938 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.938 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:12.939 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:12.939 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.939 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:12.939 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:12.939 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:12.939 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:12.939 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:12.939 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.939 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:12.939 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:12.939 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.939 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.939 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:12.940 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:12.940 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.940 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.940 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:12.940 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.940 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:12.940 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:12.940 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.940 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.940 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:12.940 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:12.940 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.940 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:12.941 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:12.941 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:12.941 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:12.941 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:12.941 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:12.941 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:12.941 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.941 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:12.941 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:12.941 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:12.941 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:12.941 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:12.941 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:12.942 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:12.942 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:12.942 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:12.942 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.942 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:12.942 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:12.942 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:12.942 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:12.942 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.942 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:12.942 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:12.942 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:12.942 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:12.943 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.943 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.943 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:12.943 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:12.943 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:12.943 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:12.943 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.943 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.943 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:12.943 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:12.943 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:12.943 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.943 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:12.944 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.944 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:12.944 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:12.944 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.944 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:12.944 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:12.944 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:12.944 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:12.944 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:12.944 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:12.944 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.944 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:12.944 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.945 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:12.956 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.956 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:12.956 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:12.957 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.957 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:12.957 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.957 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:12.957 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:12.957 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:12.957 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:12.957 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:12.957 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:12.957 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:12.957 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:12.957 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:12.958 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:12.958 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:12.958 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:12.958 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:12.958 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.958 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:12.958 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:12.958 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:12.958 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:12.958 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:12.958 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:12.959 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:12.959 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:12.959 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:12.959 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:12.959 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:12.959 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.959 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.959 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:12.959 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.959 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:12.959 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:12.959 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:12.960 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:12.960 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:12.960 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:12.960 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:12.960 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:12.960 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:12.960 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:12.960 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:12.960 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:12.960 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:12.960 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:12.961 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:12.961 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:12.961 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:12.961 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:12.961 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:12.961 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:12.961 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:12.961 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:12.961 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:12.961 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:12.961 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:12.961 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:12.962 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:12.962 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:12.962 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.962 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.962 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:12.962 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.962 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:12.962 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:12.962 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.962 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:12.962 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:12.963 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:12.963 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:12.963 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:12.963 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.963 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:12.963 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:12.963 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.963 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.963 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:12.963 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:12.963 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.963 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.964 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:12.964 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:12.964 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:12.964 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:12.964 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:12.964 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.964 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.964 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:12.964 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:12.964 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:12.964 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.964 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:12.965 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.965 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:12.965 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.965 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:12.965 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.965 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:12.965 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.965 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:12.965 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:12.965 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:12.965 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:12.965 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.965 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:12.966 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.966 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:12.966 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:12.966 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:12.966 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:12.966 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:12.966 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:12.966 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:12.966 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:12.966 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:12.966 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:12.966 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:12.967 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:12.967 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:12.967 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:12.967 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:12.967 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:12.967 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:12.967 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:12.967 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:12.967 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:12.967 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:12.967 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:12.967 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:12.968 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:12.968 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:12.968 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:12.968 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:12.968 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:12.968 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:12.968 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:12.968 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:12.968 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:12.968 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:12.968 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:12.968 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:12.969 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:12.969 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:12.969 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:12.969 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:12.969 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:12.969 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.969 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.969 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:12.969 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:12.969 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.969 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:12.969 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.970 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:12.970 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:12.970 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:12.970 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:12.970 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:12.970 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:12.970 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:12.970 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:12.970 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:12.970 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:12.970 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:12.971 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:12.971 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:12.971 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.971 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:12.971 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:12.971 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:12.971 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:12.971 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:12.971 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:12.971 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:12.971 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:12.971 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:12.972 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:12.972 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:12.972 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.972 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.972 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:12.972 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:12.972 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:12.972 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:12.972 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:12.972 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.972 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.972 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:12.972 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:12.973 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:12.973 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:12.973 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:12.973 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.973 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:12.973 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:12.973 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:12.973 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:12.973 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:12.973 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:12.973 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.973 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:12.974 INFO:teuthology.orchestra.run.smithi012.stdout:_ ERROR at teardown of test_object_lock_put_obj_retention_shorten_period_bypass _ 2023-10-05T12:49:12.974 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.974 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:12.974 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.974 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:12.974 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:12.974 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.974 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:12.974 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:12.974 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:12.974 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:12.974 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:12.975 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.975 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:12.975 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:12.975 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.975 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.975 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:12.975 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:12.975 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.975 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.975 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:12.975 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.975 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:12.976 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:12.976 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.976 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.976 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:12.976 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:12.976 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.976 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:12.976 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:12.976 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:12.976 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:12.976 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:12.976 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:12.976 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:12.977 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.977 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:12.977 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:12.977 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:12.977 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:12.977 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:12.977 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:12.977 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:12.977 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:12.977 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:12.977 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.977 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:12.978 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:12.978 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:12.978 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:12.978 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.978 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:12.978 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:12.978 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:12.978 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:12.978 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.978 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.978 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:12.978 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:12.979 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:12.979 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:12.979 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.979 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.979 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:12.979 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:12.979 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:12.979 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.979 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:12.979 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.979 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:12.979 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:12.979 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.980 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:12.980 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:12.980 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:12.980 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:12.980 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:12.980 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:12.980 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.980 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:12.980 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.980 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:12.980 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.980 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:12.981 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:12.981 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.981 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:12.981 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.981 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:12.981 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:12.981 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:12.981 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:12.981 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:12.981 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:12.981 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:12.981 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:12.982 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:12.982 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:12.982 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:12.982 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:12.982 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:12.982 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.982 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:12.982 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:12.982 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:12.982 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:12.982 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:12.982 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:12.983 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:12.983 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:12.983 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:12.983 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:12.983 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:12.983 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.983 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.983 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:12.983 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.983 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:12.983 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:12.983 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:12.984 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:12.984 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:12.984 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:12.984 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:12.984 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:12.984 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:12.984 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:12.984 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:12.984 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:12.984 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:12.984 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:12.985 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:12.985 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:12.985 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:12.985 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:12.985 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:12.985 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:12.985 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:12.985 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:12.985 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:12.985 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:12.985 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:12.985 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:12.985 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:12.986 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:12.986 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.986 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.986 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:12.986 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.986 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:12.986 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:12.986 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.986 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:12.986 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:12.986 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:12.986 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:12.987 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:12.987 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.987 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:12.987 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:12.987 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.987 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.987 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:12.987 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:12.987 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.987 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.987 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:12.987 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:12.987 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:12.988 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:12.988 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:12.988 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.988 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.988 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:12.988 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:12.988 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:12.988 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.988 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:12.988 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.988 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:12.988 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.988 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:12.989 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.989 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:12.989 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.989 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:12.989 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:12.989 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:12.989 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:12.989 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.989 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:12.989 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.989 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:12.989 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:12.990 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:12.990 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:12.990 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:12.990 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:12.990 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:12.990 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:12.990 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:12.990 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:12.990 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:12.990 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:12.990 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:12.990 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:12.990 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:12.991 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:12.991 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:12.991 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:12.991 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:12.991 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:12.991 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:12.991 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:12.991 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:12.991 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:12.991 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:12.991 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:12.991 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:12.991 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:12.992 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:12.992 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:12.992 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:12.992 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:12.992 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:12.992 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:12.992 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:12.992 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:12.992 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:12.992 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:12.992 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:12.992 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:12.992 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.993 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.993 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:12.993 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:12.993 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.993 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:12.993 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.993 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:12.993 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:12.993 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:12.993 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:12.993 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:12.993 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:12.993 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:12.993 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:12.994 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:12.994 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:12.994 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:12.994 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:12.994 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:12.994 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.994 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:12.994 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:12.994 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:12.994 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:12.994 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:12.994 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:12.995 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:12.995 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:12.995 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:12.995 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:12.995 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:12.995 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.995 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.995 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:12.995 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:12.995 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:12.995 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:12.995 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:12.995 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.996 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.996 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:12.996 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:12.996 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:12.996 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:12.996 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:12.996 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.996 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:12.996 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:12.996 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:12.996 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:12.996 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:12.996 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:12.997 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.997 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:12.997 INFO:teuthology.orchestra.run.smithi012.stdout:______ ERROR at teardown of test_object_lock_delete_object_with_retention ______ 2023-10-05T12:49:12.997 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.997 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:12.997 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.997 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:12.997 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:12.997 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.997 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:12.997 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:12.997 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:12.998 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:12.998 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:12.998 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.998 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:12.998 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:12.998 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.998 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:12.998 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:12.998 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:12.998 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:12.998 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.998 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:12.998 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.999 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:12.999 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:12.999 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:12.999 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.999 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:12.999 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:12.999 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:12.999 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:12.999 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:12.999 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:12.999 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:12.999 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:13.000 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:13.000 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:13.000 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.000 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:13.000 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:13.000 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:13.000 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:13.000 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:13.000 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:13.000 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:13.000 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:13.000 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:13.000 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.001 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:13.001 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:13.001 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:13.001 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:13.001 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.001 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:13.001 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:13.001 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:13.001 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:13.001 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.001 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.001 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:13.001 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:13.002 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:13.002 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:13.002 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.002 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.002 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:13.002 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:13.002 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:13.002 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.002 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:13.002 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.002 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:13.002 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:13.002 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.003 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:13.003 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:13.003 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:13.003 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:13.003 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:13.003 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:13.003 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.003 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:13.003 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.003 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:13.003 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.003 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:13.003 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:13.004 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.004 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:13.004 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.004 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:13.004 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:13.004 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:13.004 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:13.004 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:13.004 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:13.004 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:13.004 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:13.004 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:13.004 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:13.005 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:13.005 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:13.005 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:13.005 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.005 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:13.005 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:13.005 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:13.005 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:13.005 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:13.005 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:13.005 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:13.005 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:13.005 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:13.006 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:13.006 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:13.006 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.006 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.006 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:13.006 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.006 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:13.006 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:13.006 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:13.006 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:13.006 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:13.006 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:13.006 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:13.007 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:13.007 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:13.007 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:13.007 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:13.007 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:13.007 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:13.007 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:13.007 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:13.007 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:13.007 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:13.007 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:13.007 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:13.007 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:13.008 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:13.008 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:13.008 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:13.008 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:13.008 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:13.008 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:13.008 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:13.008 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:13.008 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.008 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.008 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:13.008 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.008 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:13.009 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:13.009 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.009 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:13.009 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:13.009 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:13.009 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:13.009 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:13.009 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.009 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:13.009 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:13.009 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.009 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.010 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:13.010 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:13.010 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.010 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.010 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:13.010 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:13.010 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:13.010 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:13.010 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:13.010 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.010 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.010 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:13.010 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:13.011 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:13.011 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.011 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:13.011 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.011 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:13.011 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.011 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:13.011 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.011 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:13.011 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.011 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:13.011 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:13.011 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:13.012 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:13.012 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.012 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:13.012 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.012 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:13.012 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:13.012 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:13.012 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:13.012 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:13.013 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:13.013 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:13.013 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:13.013 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:13.013 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:13.013 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:13.013 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:13.013 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:13.013 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:13.013 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:13.013 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:13.014 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:13.014 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:13.014 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:13.014 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:13.014 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:13.014 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:13.014 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:13.014 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:13.014 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:13.014 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:13.014 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:13.015 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:13.015 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:13.015 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:13.015 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:13.015 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:13.015 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:13.015 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:13.015 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:13.015 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:13.015 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:13.015 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:13.015 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:13.016 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:13.016 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.016 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.016 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:13.016 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:13.016 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.016 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:13.016 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.016 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:13.016 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:13.016 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:13.017 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:13.017 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:13.017 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:13.017 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:13.017 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:13.017 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:13.017 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:13.017 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:13.017 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:13.017 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:13.017 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.017 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:13.018 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:13.018 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:13.018 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:13.018 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:13.018 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:13.018 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:13.018 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:13.018 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:13.018 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:13.018 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:13.018 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.019 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.019 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:13.019 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:13.019 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:13.019 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:13.019 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:13.019 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.019 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.019 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:13.019 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:13.031 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:13.031 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:13.031 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:13.031 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.031 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:13.031 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:13.031 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:13.031 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:13.032 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:13.032 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:13.032 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.032 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:13.032 INFO:teuthology.orchestra.run.smithi012.stdout:_ ERROR at teardown of test_object_lock_delete_object_with_retention_and_marker _ 2023-10-05T12:49:13.032 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.032 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:13.032 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.032 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:13.032 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:13.032 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.033 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:13.033 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:13.033 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:13.033 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:13.033 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:13.033 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.033 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:13.033 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:13.033 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.033 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.033 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:13.033 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:13.034 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.034 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.034 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:13.034 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.034 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:13.034 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:13.034 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.034 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.034 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:13.034 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:13.034 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.034 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:13.035 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:13.035 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:13.035 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:13.035 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:13.035 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:13.035 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:13.035 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.035 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:13.035 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:13.035 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:13.035 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:13.035 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:13.035 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:13.036 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:13.036 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:13.036 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:13.036 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.036 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:13.036 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:13.036 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:13.036 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:13.036 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.036 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:13.036 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:13.036 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:13.037 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:13.037 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.037 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.037 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:13.037 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:13.037 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:13.037 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:13.037 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.037 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.037 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:13.037 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:13.038 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:13.038 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.038 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:13.038 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.038 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:13.038 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:13.038 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.038 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:13.038 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:13.038 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:13.038 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:13.038 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:13.039 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:13.039 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.039 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:13.039 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.039 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:13.039 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.039 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:13.039 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:13.039 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.039 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:13.039 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.039 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:13.040 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:13.040 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:13.040 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:13.040 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:13.040 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:13.040 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:13.040 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:13.040 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:13.040 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:13.040 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:13.040 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:13.040 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:13.041 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.041 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:13.041 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:13.041 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:13.041 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:13.041 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:13.041 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:13.041 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:13.041 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:13.041 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:13.041 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:13.041 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:13.042 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.042 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.042 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:13.042 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.042 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:13.042 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:13.042 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:13.042 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:13.042 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:13.042 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:13.042 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:13.043 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:13.043 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:13.043 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:13.043 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:13.043 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:13.043 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:13.043 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:13.043 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:13.043 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:13.043 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:13.043 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:13.043 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:13.043 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:13.044 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:13.044 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:13.044 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:13.044 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:13.044 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:13.044 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:13.044 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:13.044 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:13.044 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.044 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.044 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:13.044 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.044 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:13.045 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:13.045 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.045 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:13.045 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:13.045 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:13.045 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:13.045 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:13.045 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.045 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:13.045 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:13.045 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.045 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.046 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:13.046 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:13.046 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.046 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.046 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:13.046 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:13.046 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:13.046 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:13.046 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:13.046 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.046 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.046 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:13.046 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:13.047 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:13.047 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.047 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:13.047 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.047 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:13.047 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.047 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:13.047 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.047 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:13.047 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.047 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:13.047 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:13.048 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:13.048 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:13.048 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.048 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:13.048 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.048 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:13.048 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:13.048 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:13.048 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:13.048 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:13.048 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:13.048 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:13.049 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:13.049 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:13.049 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:13.049 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:13.049 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:13.049 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:13.049 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:13.049 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:13.049 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:13.049 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:13.049 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:13.049 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:13.049 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:13.050 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:13.050 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:13.050 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:13.050 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:13.050 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:13.050 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:13.050 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:13.050 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:13.050 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:13.050 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:13.050 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:13.050 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:13.050 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:13.051 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:13.051 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:13.051 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:13.051 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:13.051 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:13.051 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:13.051 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:13.051 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.051 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.051 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:13.051 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:13.051 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.052 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:13.052 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.052 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:13.052 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:13.052 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:13.052 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:13.052 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:13.052 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:13.052 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:13.052 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:13.052 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:13.052 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:13.053 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:13.053 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:13.053 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:13.053 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.053 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:13.053 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:13.053 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:13.053 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:13.053 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:13.053 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:13.053 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:13.053 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:13.054 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:13.054 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:13.054 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:13.054 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.054 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.054 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:13.054 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:13.054 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:13.054 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:13.054 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:13.054 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.054 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.055 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:13.055 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:13.055 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:13.055 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:13.055 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:13.055 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.055 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:13.055 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:13.055 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:13.055 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:13.055 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:13.055 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:13.055 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.056 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:13.056 INFO:teuthology.orchestra.run.smithi012.stdout:___ ERROR at teardown of test_object_lock_multi_delete_object_with_retention ___ 2023-10-05T12:49:13.056 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.056 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:13.056 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.056 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:13.056 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:13.056 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.056 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:13.056 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:13.056 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:13.056 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:13.057 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:13.057 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.057 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:13.057 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:13.057 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.057 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.057 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:13.057 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:13.057 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.057 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.057 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:13.058 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.058 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:13.058 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:13.058 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.058 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.058 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:13.058 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:13.058 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.058 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:13.058 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:13.058 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:13.059 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:13.059 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:13.059 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:13.059 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:13.059 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.059 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:13.059 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:13.059 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:13.059 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:13.059 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:13.059 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:13.059 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:13.060 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:13.060 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:13.060 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.060 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:13.060 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:13.060 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:13.060 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:13.060 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.060 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:13.060 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:13.060 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:13.060 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:13.061 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.061 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.061 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:13.061 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:13.061 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:13.061 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:13.061 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.061 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.061 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:13.061 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:13.061 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:13.061 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.061 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:13.062 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.062 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:13.062 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:13.062 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.062 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:13.062 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:13.062 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:13.062 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:13.062 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:13.062 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:13.062 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.062 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:13.063 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.063 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:13.063 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.063 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:13.063 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:13.063 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.063 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:13.063 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.063 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:13.063 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:13.063 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:13.063 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:13.063 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:13.064 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:13.064 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:13.064 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:13.064 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:13.064 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:13.064 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:13.064 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:13.064 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:13.064 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.064 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:13.064 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:13.064 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:13.064 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:13.064 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:13.065 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:13.065 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:13.065 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:13.065 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:13.065 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:13.065 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:13.065 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.065 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.065 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:13.065 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.065 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:13.065 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:13.066 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:13.066 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:13.066 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:13.066 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:13.066 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:13.066 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:13.066 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:13.066 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:13.066 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:13.066 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:13.066 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:13.066 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:13.067 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:13.067 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:13.067 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:13.067 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:13.067 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:13.067 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:13.067 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:13.067 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:13.067 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:13.067 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:13.067 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:13.067 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:13.067 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:13.068 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:13.068 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.068 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.068 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:13.068 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.068 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:13.068 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:13.068 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.068 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:13.068 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:13.068 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:13.069 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:13.069 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:13.069 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.069 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:13.069 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:13.069 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.069 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.069 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:13.069 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:13.069 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.069 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.069 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:13.070 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:13.070 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:13.070 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:13.070 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:13.070 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.070 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.070 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:13.070 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:13.070 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:13.070 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.070 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:13.070 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.071 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:13.071 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.071 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:13.071 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.071 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:13.071 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.071 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:13.071 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:13.071 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:13.071 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:13.071 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.071 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:13.072 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.072 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:13.072 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:13.072 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:13.072 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:13.072 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:13.072 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:13.072 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:13.072 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:13.072 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:13.072 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:13.072 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:13.072 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:13.073 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:13.073 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:13.073 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:13.073 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:13.073 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:13.073 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:13.073 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:13.073 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:13.073 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:13.073 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:13.073 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:13.073 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:13.074 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:13.074 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:13.074 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:13.074 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:13.074 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:13.074 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:13.074 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:13.074 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:13.074 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:13.074 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:13.074 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:13.074 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:13.075 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:13.075 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:13.075 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:13.075 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:13.075 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.075 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.075 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:13.075 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:13.075 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.075 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:13.075 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.075 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:13.076 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:13.076 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:13.076 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:13.076 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:13.076 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:13.076 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:13.076 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:13.076 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:13.076 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:13.076 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:13.076 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:13.076 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:13.076 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.077 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:13.077 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:13.077 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:13.077 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:13.077 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:13.077 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:13.077 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:13.077 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:13.077 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:13.077 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:13.077 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:13.077 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.077 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.078 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:13.078 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:13.078 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:13.078 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:13.078 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:13.078 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.078 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.078 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:13.078 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:13.078 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:13.078 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:13.078 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:13.079 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.079 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:13.079 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:13.079 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:13.079 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:13.079 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:13.079 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:13.079 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.079 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:13.079 INFO:teuthology.orchestra.run.smithi012.stdout:_____________ ERROR at teardown of test_object_lock_put_legal_hold _____________ 2023-10-05T12:49:13.079 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.079 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:13.080 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.080 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:13.080 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:13.080 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.080 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:13.080 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:13.080 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:13.080 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:13.080 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:13.080 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.080 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:13.080 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:13.081 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.081 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.081 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:13.081 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:13.081 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.081 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.081 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:13.081 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.081 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:13.081 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:13.081 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.081 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.081 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:13.082 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:13.082 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.082 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:13.082 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:13.082 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:13.082 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:13.082 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:13.082 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:13.082 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:13.082 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.082 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:13.082 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:13.082 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:13.083 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:13.083 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:13.083 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:13.083 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:13.083 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:13.083 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:13.083 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.083 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:13.083 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:13.083 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:13.083 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:13.083 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.084 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:13.084 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:13.084 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:13.084 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:13.084 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.084 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.084 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:13.084 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:13.084 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:13.084 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:13.084 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.084 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.084 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:13.085 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:13.085 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:13.085 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.085 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:13.085 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.085 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:13.085 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:13.085 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.085 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:13.085 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:13.085 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:13.085 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:13.085 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:13.086 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:13.086 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.086 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:13.086 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.086 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:13.086 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.086 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:13.086 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:13.086 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.086 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:13.086 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.086 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:13.087 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:13.087 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:13.087 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:13.087 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:13.087 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:13.087 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:13.087 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:13.087 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:13.087 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:13.087 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:13.087 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:13.087 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:13.088 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.088 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:13.088 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:13.088 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:13.088 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:13.088 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:13.088 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:13.088 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:13.088 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:13.088 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:13.088 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:13.089 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:13.089 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.089 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.089 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:13.089 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.089 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:13.089 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:13.089 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:13.089 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:13.089 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:13.089 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:13.089 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:13.090 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:13.090 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:13.090 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:13.090 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:13.090 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:13.090 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:13.090 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:13.090 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:13.090 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:13.090 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:13.090 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:13.090 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:13.090 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:13.091 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:13.091 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:13.091 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:13.091 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:13.091 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:13.091 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:13.091 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:13.091 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:13.091 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.091 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.091 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:13.091 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.092 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:13.092 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:13.092 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.092 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:13.092 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:13.092 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:13.092 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:13.092 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:13.092 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.092 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:13.092 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:13.092 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.092 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.093 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:13.093 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:13.093 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.093 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.093 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:13.093 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:13.093 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:13.093 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:13.093 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:13.093 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.093 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.093 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:13.093 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:13.093 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:13.094 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.094 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:13.094 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.094 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:13.094 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.094 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:13.094 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.094 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:13.094 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.094 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:13.094 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:13.094 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:13.095 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:13.095 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.095 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:13.095 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.095 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:13.095 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:13.095 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:13.095 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:13.095 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:13.095 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:13.096 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:13.096 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:13.096 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:13.096 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:13.096 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:13.096 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:13.096 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:13.096 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:13.096 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:13.096 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:13.096 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:13.096 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:13.096 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:13.097 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:13.097 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:13.097 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:13.097 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:13.097 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:13.097 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:13.097 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:13.097 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:13.097 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:13.097 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:13.097 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:13.097 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:13.097 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:13.098 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:13.098 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:13.098 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:13.098 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:13.098 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:13.098 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:13.098 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:13.098 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:13.098 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.098 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.098 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:13.099 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:13.099 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.099 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:13.099 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.099 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:13.099 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:13.099 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:13.099 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:13.099 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:13.099 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:13.099 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:13.099 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:13.100 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:13.100 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:13.100 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:13.100 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:13.100 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:13.100 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.100 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:13.100 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:13.113 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:13.113 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:13.113 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:13.113 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:13.113 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:13.113 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:13.113 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:13.114 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:13.114 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:13.114 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.114 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.114 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:13.114 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:13.114 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:13.114 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:13.114 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:13.114 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.114 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.114 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:13.115 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:13.115 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:13.115 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:13.115 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:13.115 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.115 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:13.115 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:13.115 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:13.115 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:13.115 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:13.115 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:13.115 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.116 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:13.116 INFO:teuthology.orchestra.run.smithi012.stdout:_____ ERROR at teardown of test_object_lock_put_legal_hold_invalid_bucket ______ 2023-10-05T12:49:13.116 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.116 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:13.116 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.116 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:13.116 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:13.116 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.116 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:13.116 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:13.116 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:13.116 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:13.116 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:13.117 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.117 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:13.117 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:13.117 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.117 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.117 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:13.117 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:13.117 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.117 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.117 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:13.117 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.117 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:13.118 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:13.118 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.118 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.118 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:13.118 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:13.118 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.118 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:13.118 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:13.118 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:13.118 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:13.118 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:13.119 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:13.119 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:13.119 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.119 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:13.119 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:13.119 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:13.119 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:13.119 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:13.119 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:13.119 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:13.119 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:13.119 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:13.120 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.120 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:13.120 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:13.120 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:13.120 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:13.120 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.120 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:13.120 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:13.120 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:13.120 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:13.120 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.120 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.121 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:13.121 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:13.121 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:13.121 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:13.121 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.121 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.121 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:13.121 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:13.121 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:13.121 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.121 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:13.121 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.122 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:13.122 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:13.122 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.122 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:13.122 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:13.122 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:13.122 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:13.122 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:13.122 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:13.122 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.122 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:13.122 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.123 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:13.123 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.123 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:13.123 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:13.123 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.123 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:13.123 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.123 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:13.123 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:13.123 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:13.123 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:13.123 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:13.124 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:13.124 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:13.124 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:13.124 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:13.124 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:13.124 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:13.124 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:13.124 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:13.124 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.124 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:13.124 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:13.124 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:13.125 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:13.125 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:13.125 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:13.125 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:13.125 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:13.125 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:13.125 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:13.125 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:13.125 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.125 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.125 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:13.125 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.126 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:13.126 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:13.126 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:13.126 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:13.126 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:13.126 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:13.126 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:13.126 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:13.126 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:13.126 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:13.126 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:13.126 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:13.126 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:13.127 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:13.127 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:13.127 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:13.127 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:13.127 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:13.127 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:13.127 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:13.127 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:13.127 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:13.127 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:13.127 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:13.127 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:13.127 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:13.128 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:13.128 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:13.128 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.128 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.128 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:13.128 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.128 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:13.128 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:13.128 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.128 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:13.128 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:13.128 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:13.129 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:13.129 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:13.129 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.129 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:13.129 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:13.129 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.129 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.129 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:13.129 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:13.129 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.129 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.130 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:13.130 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:13.130 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:13.130 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:13.130 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:13.130 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.130 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.130 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:13.130 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:13.130 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:13.130 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.130 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:13.131 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.131 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:13.131 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.131 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:13.131 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.131 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:13.131 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.131 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:13.131 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:13.131 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:13.131 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:13.131 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.131 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:13.131 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.132 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:13.132 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:13.132 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:13.132 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:13.132 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:13.132 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:13.132 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:13.132 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:13.132 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:13.132 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:13.132 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:13.132 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:13.132 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:13.133 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:13.133 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:13.133 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:13.133 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:13.133 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:13.133 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:13.133 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:13.133 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:13.133 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:13.133 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:13.133 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:13.133 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:13.133 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:13.134 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:13.134 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:13.134 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:13.134 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:13.134 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:13.134 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:13.134 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:13.134 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:13.134 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:13.134 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:13.134 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:13.134 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:13.134 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:13.135 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:13.135 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.135 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.135 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:13.135 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:13.135 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.135 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:13.135 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.135 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:13.135 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:13.135 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:13.135 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:13.136 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:13.136 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:13.136 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:13.136 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:13.136 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:13.136 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:13.136 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:13.136 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:13.136 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:13.136 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.136 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:13.136 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:13.136 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:13.137 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:13.137 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:13.137 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:13.137 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:13.137 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:13.137 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:13.137 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:13.137 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:13.137 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.137 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.137 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:13.138 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:13.138 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:13.138 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:13.138 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:13.138 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.138 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.138 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:13.138 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:13.138 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:13.138 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:13.138 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:13.138 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.139 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:13.139 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:13.139 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:13.139 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:13.139 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:13.139 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:13.139 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.139 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:13.139 INFO:teuthology.orchestra.run.smithi012.stdout:_____ ERROR at teardown of test_object_lock_put_legal_hold_invalid_status ______ 2023-10-05T12:49:13.139 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.139 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:13.139 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.140 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:13.140 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:13.140 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.140 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:13.140 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:13.140 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:13.140 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:13.140 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:13.140 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.140 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:13.140 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:13.140 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.140 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.141 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:13.141 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:13.141 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.141 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.141 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:13.141 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.141 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:13.141 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:13.141 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.141 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.141 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:13.141 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:13.141 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.142 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:13.142 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:13.142 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:13.142 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:13.142 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:13.142 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:13.142 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:13.142 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.142 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:13.142 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:13.142 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:13.142 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:13.143 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:13.143 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:13.143 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:13.143 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:13.143 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:13.143 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.143 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:13.143 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:13.143 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:13.143 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:13.143 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.143 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:13.144 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:13.144 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:13.144 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:13.144 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.144 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.144 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:13.144 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:13.144 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:13.144 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:13.144 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.144 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.144 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:13.145 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:13.145 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:13.145 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.145 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:13.145 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.145 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:13.145 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:13.145 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.145 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:13.145 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:13.145 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:13.145 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:13.145 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:13.146 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:13.146 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.146 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:13.146 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.146 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:13.146 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.146 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:13.146 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:13.146 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.146 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:13.146 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.146 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:13.147 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:13.147 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:13.147 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:13.147 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:13.147 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:13.147 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:13.147 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:13.147 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:13.147 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:13.147 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:13.147 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:13.147 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:13.147 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.148 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:13.148 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:13.148 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:13.148 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:13.148 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:13.148 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:13.148 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:13.148 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:13.148 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:13.148 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:13.148 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:13.148 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.149 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.149 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:13.149 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.149 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:13.149 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:13.149 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:13.149 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:13.149 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:13.149 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:13.149 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:13.149 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:13.149 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:13.150 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:13.150 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:13.150 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:13.150 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:13.150 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:13.150 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:13.150 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:13.150 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:13.150 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:13.150 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:13.150 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:13.151 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:13.151 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:13.151 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:13.151 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:13.151 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:13.151 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:13.151 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:13.151 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:13.151 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.151 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.151 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:13.151 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.151 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:13.152 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:13.152 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.152 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:13.152 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:13.152 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:13.152 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:13.152 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:13.152 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.152 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:13.152 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:13.152 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.152 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.152 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:13.153 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:13.153 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.153 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.153 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:13.153 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:13.153 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:13.153 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:13.153 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:13.153 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.153 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.153 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:13.153 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:13.154 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:13.154 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.154 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:13.154 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.154 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:13.154 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.154 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:13.154 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.154 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:13.154 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.154 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:13.154 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:13.155 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:13.155 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:13.155 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.155 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:13.155 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.155 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:13.155 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:13.155 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:13.155 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:13.155 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:13.155 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:13.155 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:13.155 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:13.156 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:13.156 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:13.156 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:13.156 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:13.156 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:13.156 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:13.156 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:13.156 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:13.156 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:13.156 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:13.156 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:13.156 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:13.156 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:13.156 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:13.157 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:13.157 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:13.157 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:13.157 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:13.157 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:13.157 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:13.157 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:13.157 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:13.157 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:13.157 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:13.157 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:13.157 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:13.157 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:13.158 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:13.158 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:13.158 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:13.158 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:13.158 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:13.158 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.158 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.158 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:13.158 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:13.158 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.158 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:13.159 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.159 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:13.159 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:13.159 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:13.159 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:13.159 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:13.159 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:13.159 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:13.159 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:13.159 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:13.159 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:13.160 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:13.160 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:13.160 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:13.160 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.160 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:13.160 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:13.160 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:13.160 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:13.160 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:13.160 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:13.160 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:13.160 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:13.161 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:13.161 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:13.161 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:13.161 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.161 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.161 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:13.161 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:13.161 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:13.161 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:13.161 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:13.161 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.161 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.161 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:13.161 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:13.162 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:13.162 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:13.162 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:13.162 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.162 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:13.162 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:13.162 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:13.162 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:13.162 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:13.162 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:13.162 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.163 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:13.163 INFO:teuthology.orchestra.run.smithi012.stdout:_____________ ERROR at teardown of test_object_lock_get_legal_hold _____________ 2023-10-05T12:49:13.163 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.163 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:13.163 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.163 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:13.163 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:13.163 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.163 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:13.163 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:13.163 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:13.163 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:13.163 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:13.164 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.164 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:13.164 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:13.164 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.164 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.164 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:13.164 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:13.164 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.164 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.164 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:13.164 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.164 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:13.164 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:13.165 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.165 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.165 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:13.165 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:13.165 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.165 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:13.165 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:13.165 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:13.165 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:13.165 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:13.165 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:13.166 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:13.166 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.166 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:13.166 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:13.166 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:13.166 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:13.166 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:13.166 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:13.166 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:13.166 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:13.166 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:13.166 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.167 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:13.167 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:13.167 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:13.167 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:13.167 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.167 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:13.167 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:13.167 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:13.167 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:13.167 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.167 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.167 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:13.167 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:13.168 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:13.168 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:13.168 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.168 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.168 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:13.168 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:13.168 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:13.168 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.168 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:13.168 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.168 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:13.168 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:13.169 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.169 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:13.169 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:13.169 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:13.169 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:13.169 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:13.169 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:13.169 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.169 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:13.169 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.169 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:13.169 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.170 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:13.170 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:13.170 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.170 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:13.170 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.170 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:13.170 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:13.170 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:13.170 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:13.170 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:13.170 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:13.170 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:13.170 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:13.171 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:13.171 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:13.171 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:13.171 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:13.171 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:13.171 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.171 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:13.171 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:13.171 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:13.171 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:13.171 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:13.171 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:13.172 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:13.172 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:13.172 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:13.172 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:13.172 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:13.172 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.172 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.172 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:13.172 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.172 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:13.172 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:13.172 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:13.172 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:13.172 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:13.173 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:13.173 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:13.173 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:13.173 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:13.173 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:13.173 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:13.173 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:13.173 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:13.173 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:13.173 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:13.173 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:13.173 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:13.173 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:13.174 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:13.174 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:13.174 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:13.174 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:13.174 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:13.174 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:13.174 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:13.174 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:13.174 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:13.174 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:13.174 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.174 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.175 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:13.175 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.175 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:13.175 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:13.175 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.175 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:13.175 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:13.175 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:13.175 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:13.175 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:13.175 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.175 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:13.176 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:13.176 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.176 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.176 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:13.176 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:13.176 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.176 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.176 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:13.176 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:13.176 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:13.176 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:13.176 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:13.177 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.177 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.177 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:13.177 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:13.177 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:13.177 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.177 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:13.177 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.177 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:13.177 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.177 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:13.178 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.178 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:13.178 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.178 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:13.178 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:13.178 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:13.178 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:13.178 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.178 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:13.178 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.178 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:13.179 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:13.179 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:13.179 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:13.179 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:13.179 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:13.179 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:13.179 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:13.179 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:13.179 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:13.179 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:13.186 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:13.186 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:13.186 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:13.186 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:13.187 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:13.187 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:13.187 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:13.187 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:13.187 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:13.187 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:13.187 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:13.187 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:13.187 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:13.187 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:13.187 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:13.187 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:13.187 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:13.188 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:13.188 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:13.188 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:13.188 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:13.188 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:13.188 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:13.188 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:13.188 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:13.188 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:13.188 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:13.188 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:13.189 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:13.189 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.189 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.189 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:13.189 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:13.189 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.189 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:13.189 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.189 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:13.189 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:13.189 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:13.190 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:13.190 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:13.190 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:13.190 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:13.190 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:13.190 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:13.190 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:13.190 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:13.190 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:13.190 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:13.190 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.191 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:13.191 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:13.191 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:13.191 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:13.191 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:13.191 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:13.191 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:13.191 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:13.191 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:13.191 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:13.191 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:13.191 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.191 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.192 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:13.192 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:13.192 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:13.192 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:13.192 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:13.192 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.192 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.192 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:13.192 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:13.192 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:13.192 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:13.192 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:13.193 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.193 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:13.193 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:13.193 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:13.193 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:13.193 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:13.193 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:13.193 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.193 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:13.193 INFO:teuthology.orchestra.run.smithi012.stdout:_____ ERROR at teardown of test_object_lock_get_legal_hold_invalid_bucket ______ 2023-10-05T12:49:13.193 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.193 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:13.193 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.194 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:13.194 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:13.194 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.194 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:13.194 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:13.194 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:13.194 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:13.194 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:13.194 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.194 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:13.194 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:13.194 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.194 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.195 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:13.195 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:13.195 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.195 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.195 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:13.195 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.195 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:13.195 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:13.195 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.195 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.195 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:13.195 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:13.196 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.196 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:13.196 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:13.196 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:13.196 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:13.196 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:13.196 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:13.196 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:13.196 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.196 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:13.196 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:13.197 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:13.197 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:13.197 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:13.197 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:13.197 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:13.197 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:13.197 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:13.197 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.197 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:13.197 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:13.197 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:13.197 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:13.198 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.198 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:13.198 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:13.198 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:13.198 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:13.198 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.198 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.198 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:13.198 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:13.198 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:13.198 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:13.199 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.199 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.199 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:13.199 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:13.199 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:13.199 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.199 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:13.199 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.199 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:13.199 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:13.199 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.199 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:13.200 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:13.200 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:13.200 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:13.200 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:13.200 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:13.200 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.200 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:13.200 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.200 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:13.200 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.200 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:13.200 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:13.201 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.201 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:13.201 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.201 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:13.201 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:13.201 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:13.201 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:13.201 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:13.201 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:13.201 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:13.201 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:13.201 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:13.202 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:13.202 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:13.202 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:13.202 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:13.202 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.202 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:13.202 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:13.202 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:13.202 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:13.202 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:13.202 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:13.203 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:13.203 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:13.203 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:13.203 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:13.203 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:13.203 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.203 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.203 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:13.203 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.203 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:13.203 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:13.203 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:13.204 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:13.204 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:13.204 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:13.204 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:13.204 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:13.204 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:13.204 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:13.204 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:13.204 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:13.204 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:13.204 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:13.204 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:13.205 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:13.205 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:13.205 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:13.205 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:13.205 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:13.205 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:13.205 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:13.205 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:13.205 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:13.205 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:13.205 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:13.205 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:13.206 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:13.206 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.206 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.206 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:13.206 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.206 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:13.206 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:13.206 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.206 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:13.206 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:13.206 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:13.206 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:13.207 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:13.207 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.207 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:13.207 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:13.207 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.207 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.207 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:13.207 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:13.207 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.207 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.207 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:13.207 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:13.208 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:13.208 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:13.208 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:13.208 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.208 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.208 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:13.208 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:13.208 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:13.208 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.208 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:13.208 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.209 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:13.209 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.209 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:13.209 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.209 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:13.209 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.209 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:13.209 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:13.209 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:13.209 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:13.209 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.209 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:13.210 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.210 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:13.210 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:13.210 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:13.210 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:13.210 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:13.210 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:13.210 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:13.210 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:13.210 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:13.210 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:13.211 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:13.211 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:13.211 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:13.211 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:13.211 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:13.211 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:13.211 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:13.211 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:13.211 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:13.211 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:13.211 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:13.211 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:13.211 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:13.212 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:13.212 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:13.212 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:13.212 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:13.212 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:13.212 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:13.212 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:13.212 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:13.212 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:13.212 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:13.212 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:13.212 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:13.213 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:13.213 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:13.213 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:13.213 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:13.213 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:13.213 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.213 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.213 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:13.213 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:13.213 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.213 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:13.213 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.214 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:13.214 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:13.214 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:13.214 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:13.214 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:13.214 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:13.214 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:13.214 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:13.214 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:13.214 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:13.214 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:13.215 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:13.215 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:13.215 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.215 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:13.215 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:13.215 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:13.215 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:13.215 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:13.215 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:13.215 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:13.215 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:13.215 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:13.215 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:13.216 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:13.216 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.216 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.216 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:13.216 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:13.216 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:13.216 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:13.216 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:13.216 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.216 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.216 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:13.217 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:13.217 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:13.217 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:13.217 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:13.217 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.217 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:13.217 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:13.217 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:13.217 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:13.217 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:13.217 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:13.217 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.218 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:13.218 INFO:teuthology.orchestra.run.smithi012.stdout:____ ERROR at teardown of test_object_lock_delete_object_with_legal_hold_on ____ 2023-10-05T12:49:13.218 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.218 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:13.218 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.218 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:13.218 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:13.218 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.218 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:13.218 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:13.218 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:13.219 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:13.219 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:13.219 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.219 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:13.219 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:13.219 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.219 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.219 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:13.219 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:13.219 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.219 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.219 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:13.220 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.220 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:13.220 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:13.220 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.220 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.220 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:13.220 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:13.220 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.220 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:13.220 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:13.220 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:13.220 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:13.221 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:13.221 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:13.221 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:13.221 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.221 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:13.221 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:13.221 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:13.221 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:13.221 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:13.221 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:13.221 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:13.221 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:13.222 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:13.222 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.222 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:13.222 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:13.222 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:13.222 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:13.222 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.222 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:13.222 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:13.222 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:13.222 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:13.222 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.223 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.223 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:13.223 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:13.223 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:13.223 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:13.223 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.223 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.223 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:13.223 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:13.223 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:13.223 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.223 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:13.224 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.224 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:13.224 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:13.224 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.224 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:13.224 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:13.224 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:13.224 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:13.224 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:13.224 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:13.224 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.224 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:13.225 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.225 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:13.225 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.225 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:13.225 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:13.225 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.225 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:13.225 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.225 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:13.225 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:13.225 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:13.225 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:13.225 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:13.226 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:13.226 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:13.226 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:13.226 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:13.226 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:13.226 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:13.226 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:13.226 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:13.226 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.226 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:13.226 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:13.227 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:13.227 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:13.227 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:13.227 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:13.227 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:13.227 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:13.227 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:13.227 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:13.227 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:13.227 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.227 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.227 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:13.227 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.228 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:13.228 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:13.228 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:13.228 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:13.228 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:13.228 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:13.228 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:13.228 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:13.228 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:13.228 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:13.228 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:13.229 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:13.229 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:13.229 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:13.229 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:13.229 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:13.229 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:13.229 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:13.229 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:13.229 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:13.229 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:13.229 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:13.229 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:13.229 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:13.230 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:13.230 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:13.230 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:13.230 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:13.230 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.230 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.230 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:13.230 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.230 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:13.230 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:13.230 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.230 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:13.231 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:13.231 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:13.231 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:13.231 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:13.231 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.231 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:13.231 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:13.231 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.231 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.231 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:13.231 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:13.231 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.232 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.232 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:13.232 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:13.232 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:13.232 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:13.232 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:13.232 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.232 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.232 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:13.232 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:13.232 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:13.232 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.233 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:13.233 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.233 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:13.233 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.233 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:13.233 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.233 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:13.233 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.233 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:13.233 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:13.233 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:13.233 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:13.233 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.234 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:13.234 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.234 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:13.234 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:13.234 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:13.234 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:13.234 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:13.234 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:13.234 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:13.234 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:13.234 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:13.234 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:13.235 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:13.235 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:13.235 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:13.235 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:13.235 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:13.235 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:13.235 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:13.235 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:13.235 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:13.235 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:13.235 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:13.235 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:13.235 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:13.236 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:13.236 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:13.236 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:13.236 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:13.236 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:13.236 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:13.236 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:13.236 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:13.236 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:13.236 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:13.236 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:13.236 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:13.236 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:13.237 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:13.237 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:13.237 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:13.237 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:13.237 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.237 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.237 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:13.237 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:13.237 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.237 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:13.237 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.238 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:13.238 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:13.238 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:13.238 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:13.238 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:13.238 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:13.238 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:13.238 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:13.238 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:13.238 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:13.238 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:13.238 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:13.239 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:13.239 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.239 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:13.239 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:13.239 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:13.239 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:13.239 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:13.239 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:13.239 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:13.239 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:13.239 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:13.239 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:13.240 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:13.240 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.240 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.240 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:13.240 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:13.240 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:13.240 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:13.240 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:13.240 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.240 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.240 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:13.240 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:13.240 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:13.241 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:13.241 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:13.241 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.241 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:13.241 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:13.241 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:13.241 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:13.241 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:13.241 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:13.241 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.241 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:13.241 INFO:teuthology.orchestra.run.smithi012.stdout:___ ERROR at teardown of test_object_lock_delete_object_with_legal_hold_off ____ 2023-10-05T12:49:13.242 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.242 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:13.242 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.242 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:13.242 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:13.242 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.242 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:13.242 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:13.242 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:13.242 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:13.242 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:13.242 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.242 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:13.243 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:13.243 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.243 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.243 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:13.243 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:13.243 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.243 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.243 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:13.243 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.243 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:13.243 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:13.243 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.243 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.244 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:13.244 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:13.244 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.244 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:13.244 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:13.244 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:13.244 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:13.244 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:13.244 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:13.244 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:13.244 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.244 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:13.244 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:13.245 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:13.245 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:13.245 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:13.245 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:13.245 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:13.245 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:13.245 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:13.245 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.245 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:13.245 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:13.245 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:13.245 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:13.245 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.246 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:13.246 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:13.246 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:13.246 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:13.246 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.246 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.246 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:13.246 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:13.246 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:13.246 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:13.246 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.246 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.246 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:13.247 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:13.247 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:13.247 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.247 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:13.247 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.247 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:13.247 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:13.247 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.247 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:13.247 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:13.247 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:13.247 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:13.247 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:13.248 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:13.248 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.248 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:13.248 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.248 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:13.248 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.248 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:13.248 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:13.248 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.248 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:13.248 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.248 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:13.248 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:13.249 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:13.249 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:13.249 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:13.249 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:13.249 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:13.249 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:13.249 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:13.249 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:13.249 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:13.249 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:13.249 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:13.249 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.250 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:13.250 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:13.250 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:13.250 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:13.250 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:13.250 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:13.250 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:13.250 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:13.250 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:13.250 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:13.250 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:13.250 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.251 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.251 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:13.251 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.251 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:13.251 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:13.263 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:13.263 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:13.263 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:13.264 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:13.264 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:13.264 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:13.264 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:13.264 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:13.264 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:13.264 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:13.264 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:13.264 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:13.264 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:13.264 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:13.264 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:13.265 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:13.265 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:13.265 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:13.265 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:13.265 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:13.265 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:13.265 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:13.265 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:13.265 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:13.265 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:13.265 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:13.265 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.265 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.266 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:13.266 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.266 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:13.266 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:13.266 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.266 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:13.266 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:13.266 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:13.266 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:13.266 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:13.266 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.266 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:13.267 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:13.267 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.267 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.267 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:13.267 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:13.267 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.267 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.267 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:13.267 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:13.267 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:13.267 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:13.267 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:13.268 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.268 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.268 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:13.268 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:13.268 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:13.268 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.268 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:13.268 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.268 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:13.268 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.268 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:13.268 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.269 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:13.269 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.269 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:13.269 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:13.269 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:13.269 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:13.269 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.269 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:13.269 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.269 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:13.269 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:13.270 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:13.270 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:13.270 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:13.270 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:13.270 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:13.270 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:13.270 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:13.270 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:13.270 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:13.270 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:13.270 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:13.270 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:13.271 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:13.271 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:13.271 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:13.271 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:13.271 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:13.271 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:13.271 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:13.271 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:13.271 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:13.271 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:13.271 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:13.272 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:13.272 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:13.272 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:13.272 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:13.272 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:13.272 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:13.272 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:13.272 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:13.272 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:13.272 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:13.272 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:13.272 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:13.273 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:13.273 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:13.273 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:13.273 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.273 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.273 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:13.273 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:13.273 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.273 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:13.273 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.273 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:13.273 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:13.273 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:13.274 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:13.274 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:13.274 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:13.274 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:13.274 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:13.274 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:13.274 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:13.274 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:13.274 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:13.274 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:13.274 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.275 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:13.275 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:13.275 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:13.275 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:13.275 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:13.275 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:13.275 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:13.275 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:13.275 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:13.275 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:13.275 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:13.275 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.275 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.276 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:13.276 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:13.276 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:13.276 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:13.276 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:13.276 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.276 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.276 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:13.276 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:13.276 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:13.276 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:13.276 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:13.277 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.277 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:13.277 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:13.277 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:13.277 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:13.277 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:13.277 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:13.277 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.277 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:13.277 INFO:teuthology.orchestra.run.smithi012.stdout:____________ ERROR at teardown of test_object_lock_get_obj_metadata ____________ 2023-10-05T12:49:13.277 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.277 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:13.278 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.278 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:13.278 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:13.278 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.278 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:13.278 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:13.278 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:13.278 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:13.278 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:13.278 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.278 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:13.279 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:13.279 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.279 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.279 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:13.279 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:13.279 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.279 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.279 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:13.279 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.279 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:13.279 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:13.279 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.280 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.280 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:13.280 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:13.280 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.280 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:13.280 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:13.280 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:13.280 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:13.280 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:13.280 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:13.280 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:13.280 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.280 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:13.281 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:13.281 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:13.281 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:13.281 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:13.281 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:13.281 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:13.281 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:13.281 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:13.281 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.281 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:13.281 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:13.281 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:13.282 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:13.282 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.282 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:13.282 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:13.282 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:13.282 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:13.282 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.282 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.282 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:13.282 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:13.282 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:13.283 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:13.283 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.283 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.283 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:13.283 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:13.283 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:13.283 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.283 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:13.283 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.283 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:13.283 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:13.284 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.284 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:13.284 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:13.284 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:13.284 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:13.284 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:13.284 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:13.284 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.284 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:13.284 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.284 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:13.285 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.285 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:13.285 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:13.285 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.285 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:13.285 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.285 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:13.285 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:13.285 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:13.285 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:13.285 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:13.285 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:13.286 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:13.286 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:13.286 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:13.286 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:13.286 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:13.286 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:13.286 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:13.286 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.286 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:13.286 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:13.286 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:13.287 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:13.287 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:13.287 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:13.289 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:13.289 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:13.289 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:13.289 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:13.289 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:13.289 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.289 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.289 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:13.289 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.289 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:13.290 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:13.290 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:13.290 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:13.290 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:13.290 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:13.290 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:13.290 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:13.290 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:13.290 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:13.290 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:13.290 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:13.291 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:13.291 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:13.291 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:13.291 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:13.291 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:13.291 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:13.291 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:13.291 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:13.291 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:13.291 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:13.291 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:13.291 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:13.292 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:13.292 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:13.292 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:13.292 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:13.292 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.292 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.292 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:13.292 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.292 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:13.292 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:13.292 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.292 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:13.293 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:13.293 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:13.293 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:13.293 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:13.293 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.293 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:13.293 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:13.293 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.293 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.293 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:13.293 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:13.293 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.294 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.294 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:13.294 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:13.294 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:13.294 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:13.294 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:13.294 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.294 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.294 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:13.294 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:13.294 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:13.294 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.295 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:13.295 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.295 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:13.295 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.295 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:13.295 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.295 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:13.295 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.295 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:13.295 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:13.295 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:13.295 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:13.296 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.296 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:13.296 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.296 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:13.296 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:13.296 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:13.296 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:13.296 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:13.296 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:13.296 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:13.296 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:13.296 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:13.296 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:13.297 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:13.297 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:13.297 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:13.297 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:13.297 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:13.297 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:13.297 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:13.297 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:13.297 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:13.297 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:13.297 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:13.297 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:13.298 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:13.298 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:13.298 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:13.298 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:13.298 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:13.298 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:13.298 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:13.298 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:13.298 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:13.298 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:13.298 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:13.299 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:13.299 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:13.299 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:13.299 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:13.299 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:13.299 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:13.299 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:13.299 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.299 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.299 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:13.299 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:13.299 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.300 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:13.300 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.300 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:13.300 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:13.300 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:13.300 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:13.300 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:13.300 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:13.300 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:13.300 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:13.300 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:13.300 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:13.301 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:13.301 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:13.301 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:13.301 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.301 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:13.301 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:13.301 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:13.301 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:13.301 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:13.301 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:13.301 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:13.301 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:13.302 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:13.302 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:13.302 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:13.302 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.302 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.302 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:13.302 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:13.302 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:13.302 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:13.302 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:13.302 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.303 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.303 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:13.303 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:13.303 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:13.303 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:13.303 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:13.303 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.303 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:13.303 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:13.303 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:13.303 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:13.303 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:13.304 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:13.304 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.304 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:13.304 INFO:teuthology.orchestra.run.smithi012.stdout:_____________ ERROR at teardown of test_object_lock_uploading_obj ______________ 2023-10-05T12:49:13.304 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.304 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:13.304 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.304 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:13.304 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:13.304 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.304 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:13.304 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:13.305 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:13.305 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:13.305 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:13.305 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.305 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:13.305 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:13.305 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.305 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.305 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:13.305 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:13.305 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.305 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.305 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:13.306 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.306 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:13.306 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:13.306 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.306 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.306 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:13.306 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:13.306 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.306 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:13.306 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:13.306 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:13.307 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:13.307 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:13.307 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:13.307 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:13.307 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.307 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:13.307 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:13.307 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:13.307 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:13.307 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:13.307 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:13.307 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:13.308 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:13.308 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:13.308 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.308 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:13.308 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:13.308 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:13.308 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:13.308 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.308 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:13.308 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:13.308 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:13.308 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:13.309 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.309 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.309 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:13.309 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:13.309 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:13.309 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:13.309 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.309 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.309 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:13.309 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:13.309 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:13.309 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.310 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:13.310 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.310 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:13.310 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:13.310 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.310 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:13.310 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:13.310 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:13.310 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:13.310 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:13.310 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:13.310 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.311 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:13.311 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.311 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:13.311 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.311 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:13.311 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:13.311 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.311 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:13.311 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.311 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:13.311 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:13.311 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:13.312 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:13.312 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:13.312 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:13.312 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:13.312 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:13.312 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:13.312 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:13.312 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:13.312 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:13.312 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:13.313 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.313 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:13.313 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:13.313 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:13.313 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:13.313 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:13.313 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:13.313 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:13.313 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:13.313 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:13.313 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:13.314 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:13.314 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.314 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.314 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:13.314 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.314 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:13.314 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:13.314 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:13.314 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:13.314 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:13.314 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:13.314 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:13.315 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:13.315 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:13.315 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:13.315 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:13.315 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:13.315 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:13.315 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:13.315 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:13.315 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:13.315 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:13.315 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:13.315 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:13.316 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:13.316 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:13.316 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:13.316 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:13.316 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:13.316 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:13.316 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:13.316 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:13.316 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:13.316 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.316 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.316 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:13.317 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.317 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:13.317 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:13.317 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.317 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:13.317 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:13.317 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:13.317 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:13.317 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:13.317 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.317 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:13.317 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:13.318 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.318 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.318 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:13.318 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:13.318 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.318 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.318 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:13.318 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:13.318 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:13.318 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:13.318 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:13.318 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.319 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.319 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:13.319 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:13.319 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:13.319 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.319 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:13.319 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.319 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:13.319 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.319 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:13.319 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.320 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:13.320 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.320 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:13.320 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:13.320 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:13.320 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:13.320 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.320 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:13.320 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.320 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:13.320 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:13.320 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:13.321 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:13.321 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:13.321 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:13.321 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:13.321 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:13.321 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:13.321 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:13.321 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:13.321 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:13.321 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:13.321 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:13.321 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:13.321 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:13.322 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:13.322 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:13.322 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:13.322 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:13.322 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:13.322 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:13.322 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:13.322 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:13.322 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:13.322 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:13.322 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:13.322 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:13.323 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:13.323 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:13.323 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:13.323 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:13.323 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:13.323 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:13.323 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:13.323 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:13.323 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:13.323 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:13.323 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:13.323 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:13.323 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.324 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.324 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:13.324 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:13.324 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.324 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:13.324 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.324 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:13.324 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:13.324 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:13.324 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:13.324 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:13.324 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:13.325 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:13.325 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:13.325 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:13.325 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:13.325 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:13.325 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:13.325 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:13.325 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.325 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:13.325 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:13.325 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:13.325 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:13.326 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:13.326 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:13.326 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:13.326 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:13.326 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:13.326 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:13.326 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:13.326 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.326 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.326 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:13.326 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:13.326 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:13.326 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:13.327 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:13.327 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.327 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.327 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:13.327 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:13.327 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:13.327 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:13.327 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:13.327 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.327 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:13.327 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:13.327 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:13.327 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:13.328 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:13.328 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:13.328 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.328 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:13.328 INFO:teuthology.orchestra.run.smithi012.stdout:_ ERROR at teardown of test_object_lock_changing_mode_from_governance_with_bypass _ 2023-10-05T12:49:13.328 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.328 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:13.328 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.328 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:13.328 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:13.328 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.328 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:13.328 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:13.329 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:13.329 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:13.329 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:13.329 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.329 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:13.329 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:13.329 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.329 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.329 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:13.329 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:13.329 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.329 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.330 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:13.330 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.330 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:13.330 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:13.330 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.330 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.330 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:13.330 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:13.330 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.330 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:13.330 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:13.330 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:13.330 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:13.331 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:13.331 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:13.331 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:13.331 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.331 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:13.331 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:13.331 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:13.331 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:13.331 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:13.331 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:13.331 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:13.331 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:13.331 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:13.332 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.332 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:13.332 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:13.332 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:13.332 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:13.336 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.336 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:13.337 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:13.337 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:13.337 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:13.337 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.337 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.337 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:13.337 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:13.337 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:13.337 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:13.337 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.337 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.338 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:13.338 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:13.338 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:13.338 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.338 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:13.338 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.338 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:13.338 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:13.338 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.338 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:13.338 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:13.338 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:13.339 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:13.339 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:13.339 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:13.339 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.339 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:13.339 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.339 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:13.339 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.339 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:13.339 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:13.339 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.340 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:13.340 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.340 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:13.340 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:13.340 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:13.340 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:13.340 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:13.340 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:13.340 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:13.340 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:13.340 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:13.340 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:13.341 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:13.341 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:13.341 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:13.341 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.341 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:13.341 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:13.341 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:13.341 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:13.341 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:13.341 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:13.341 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:13.341 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:13.342 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:13.342 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:13.342 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:13.342 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.342 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.342 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:13.342 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.342 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:13.342 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:13.342 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:13.342 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:13.342 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:13.343 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:13.343 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:13.343 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:13.343 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:13.343 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:13.343 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:13.343 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:13.343 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:13.343 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:13.343 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:13.343 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:13.343 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:13.343 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:13.344 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:13.344 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:13.344 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:13.344 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:13.344 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:13.344 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:13.344 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:13.344 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:13.344 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:13.344 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:13.344 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.345 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.345 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:13.345 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.345 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:13.345 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:13.345 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.345 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:13.345 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:13.345 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:13.345 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:13.345 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:13.345 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.345 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:13.346 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:13.346 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.346 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.346 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:13.346 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:13.346 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.346 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.346 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:13.346 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:13.346 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:13.346 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:13.346 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:13.346 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.347 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.347 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:13.347 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:13.347 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:13.347 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.347 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:13.347 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.347 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:13.347 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.347 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:13.347 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.347 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:13.347 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.348 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:13.348 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:13.348 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:13.348 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:13.348 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.348 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:13.348 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.348 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:13.348 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:13.348 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:13.348 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:13.348 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:13.348 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:13.349 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:13.349 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:13.349 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:13.349 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:13.349 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:13.349 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:13.349 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:13.349 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:13.349 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:13.349 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:13.349 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:13.350 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:13.350 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:13.350 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:13.350 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:13.350 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:13.350 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:13.350 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:13.350 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:13.350 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:13.350 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:13.350 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:13.351 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:13.351 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:13.351 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:13.351 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:13.351 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:13.351 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:13.351 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:13.351 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:13.351 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:13.351 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:13.351 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:13.351 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:13.352 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.352 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.352 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:13.352 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:13.352 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.352 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:13.352 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.352 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:13.352 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:13.352 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:13.352 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:13.353 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:13.353 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:13.353 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:13.353 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:13.353 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:13.353 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:13.353 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:13.353 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:13.353 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:13.353 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.353 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:13.353 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:13.354 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:13.354 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:13.354 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:13.354 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:13.354 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:13.354 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:13.354 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:13.354 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:13.354 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:13.354 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.354 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.354 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:13.355 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:13.355 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:13.355 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:13.355 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:13.355 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.355 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.355 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:13.355 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:13.355 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:13.355 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:13.355 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:13.355 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.356 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:13.356 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:13.356 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:13.356 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:13.356 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:13.356 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:13.356 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.356 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:13.356 INFO:teuthology.orchestra.run.smithi012.stdout:_ ERROR at teardown of test_object_lock_changing_mode_from_governance_without_bypass _ 2023-10-05T12:49:13.356 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.356 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:13.356 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.357 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:13.357 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:13.357 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.357 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:13.357 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:13.357 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:13.357 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:13.357 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:13.357 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.357 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:13.357 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:13.357 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.358 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.358 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:13.358 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:13.358 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.358 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.358 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:13.358 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.358 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:13.358 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:13.358 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.358 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.359 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:13.359 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:13.359 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.359 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:13.359 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:13.359 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:13.359 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:13.359 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:13.359 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:13.359 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:13.359 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.359 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:13.360 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:13.360 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:13.360 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:13.360 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:13.360 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:13.360 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:13.360 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:13.360 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:13.360 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.360 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:13.360 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:13.360 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:13.360 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:13.361 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.361 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:13.361 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:13.361 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:13.361 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:13.361 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.361 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.361 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:13.361 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:13.361 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:13.361 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:13.361 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.362 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.362 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:13.362 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:13.362 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:13.362 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.362 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:13.362 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.362 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:13.362 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:13.362 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.362 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:13.362 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:13.363 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:13.363 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:13.363 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:13.363 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:13.363 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.363 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:13.363 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.363 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:13.363 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.363 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:13.363 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:13.363 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.363 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:13.364 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.364 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:13.364 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:13.364 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:13.364 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:13.364 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:13.364 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:13.364 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:13.364 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:13.364 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:13.364 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:13.364 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:13.365 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:13.365 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:13.365 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.365 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:13.365 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:13.365 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:13.365 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:13.365 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:13.365 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:13.365 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:13.365 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:13.365 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:13.366 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:13.366 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:13.366 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.366 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.366 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:13.366 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.366 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:13.366 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:13.366 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:13.366 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:13.366 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:13.367 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:13.367 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:13.367 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:13.367 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:13.367 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:13.367 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:13.367 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:13.367 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:13.367 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:13.367 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:13.367 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:13.367 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:13.367 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:13.368 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:13.368 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:13.368 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:13.368 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:13.368 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:13.368 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:13.368 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:13.368 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:13.368 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:13.368 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:13.368 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.368 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.369 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:13.369 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.369 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:13.369 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:13.369 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.369 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:13.369 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:13.369 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:13.369 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:13.369 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:13.369 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.370 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:13.370 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:13.370 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.370 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.370 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:13.370 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:13.370 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.370 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.370 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:13.370 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:13.370 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:13.370 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:13.371 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:13.371 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.371 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.371 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:13.371 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:13.371 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:13.371 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.371 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:13.371 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.371 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:13.371 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.371 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:13.372 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.372 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:13.372 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.372 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:13.372 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:13.372 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:13.372 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:13.372 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.372 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:13.372 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.372 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:13.372 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:13.373 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:13.373 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:13.373 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:13.373 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:13.373 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:13.373 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:13.373 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:13.373 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:13.373 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:13.373 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:13.373 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:13.373 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:13.373 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:13.374 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:13.374 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:13.374 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:13.374 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:13.374 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:13.374 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:13.374 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:13.374 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:13.374 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:13.374 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:13.374 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:13.374 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:13.375 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:13.375 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:13.375 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:13.375 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:13.375 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:13.375 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:13.375 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:13.375 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:13.375 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:13.375 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:13.375 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:13.375 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:13.376 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:13.376 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.376 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.376 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:13.376 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:13.376 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.376 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:13.376 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.376 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:13.376 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:13.376 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:13.376 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:13.377 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:13.377 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:13.377 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:13.377 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:13.377 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:13.377 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:13.377 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:13.377 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:13.377 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:13.377 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.377 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:13.377 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:13.378 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:13.378 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:13.378 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:13.378 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:13.378 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:13.378 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:13.378 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:13.378 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:13.378 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:13.378 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.378 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.379 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:13.379 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:13.379 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:13.379 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:13.379 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:13.379 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.379 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.379 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:13.379 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:13.379 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:13.379 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:13.379 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:13.380 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.380 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:13.380 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:13.380 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:13.380 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:13.380 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:13.380 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:13.380 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.380 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:13.380 INFO:teuthology.orchestra.run.smithi012.stdout:_____ ERROR at teardown of test_object_lock_changing_mode_from_compliance ______ 2023-10-05T12:49:13.380 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.380 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:13.381 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.381 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:13.381 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:13.381 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.381 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:13.381 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:13.381 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:13.381 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:13.381 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:13.381 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.381 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:13.381 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:13.382 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.382 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.382 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:13.382 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:13.382 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.382 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.382 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:13.382 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.382 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:13.382 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:13.382 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.382 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.383 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:13.383 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:13.383 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.383 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:13.383 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:13.383 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:13.383 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:13.383 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:13.383 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:13.383 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:13.383 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.383 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:13.384 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:13.384 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:13.384 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:13.384 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:13.384 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:13.384 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:13.384 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:13.384 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:13.384 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.384 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:13.384 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:13.384 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:13.385 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:13.385 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.385 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:13.385 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:13.385 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:13.385 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:13.385 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.385 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.385 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:13.385 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:13.385 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:13.385 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:13.386 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.386 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.386 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:13.386 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:13.386 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:13.386 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.386 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:13.386 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.386 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:13.386 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:13.386 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.386 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:13.386 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:13.387 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:13.387 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:13.387 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:13.387 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:13.387 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.387 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:13.387 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.387 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:13.387 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.387 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:13.387 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:13.387 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.388 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:13.388 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.388 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:13.388 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:13.388 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:13.388 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:13.388 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:13.388 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:13.388 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:13.388 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:13.388 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:13.389 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:13.389 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:13.389 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:13.389 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:13.389 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.389 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:13.389 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:13.389 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:13.389 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:13.389 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:13.389 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:13.389 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:13.390 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:13.390 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:13.390 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:13.390 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:13.390 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.390 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.390 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:13.390 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.390 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:13.390 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:13.390 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:13.390 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:13.391 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:13.391 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:13.391 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:13.391 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:13.391 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:13.391 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:13.391 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:13.391 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:13.391 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:13.391 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:13.391 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:13.392 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:13.392 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:13.392 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:13.392 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:13.392 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:13.392 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:13.392 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:13.392 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:13.392 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:13.392 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:13.392 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:13.392 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:13.392 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:13.393 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.393 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.393 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:13.393 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.393 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:13.393 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:13.393 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.393 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:13.393 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:13.393 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:13.393 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:13.393 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:13.393 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.394 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:13.394 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:13.394 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.394 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.394 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:13.394 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:13.394 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.394 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.394 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:13.394 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:13.394 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:13.394 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:13.395 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:13.395 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.395 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.395 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:13.395 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:13.395 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:13.395 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.395 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:13.395 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.395 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:13.395 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.395 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:13.396 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.396 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:13.396 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.396 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:13.396 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:13.396 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:13.396 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:13.396 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.396 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:13.396 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.396 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:13.396 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:13.397 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:13.397 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:13.397 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:13.397 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:13.397 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:13.397 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:13.397 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:13.417 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:13.418 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:13.418 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:13.418 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:13.418 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:13.418 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:13.418 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:13.418 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:13.418 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:13.418 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:13.418 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:13.418 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:13.418 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:13.419 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:13.419 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:13.419 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:13.419 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:13.419 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:13.419 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:13.419 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:13.419 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:13.419 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:13.419 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:13.419 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:13.420 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:13.420 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:13.420 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:13.420 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:13.420 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:13.420 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:13.420 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:13.420 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.420 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.420 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:13.420 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:13.421 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.421 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:13.421 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.421 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:13.421 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:13.421 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:13.421 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:13.421 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:13.421 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:13.421 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:13.421 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:13.422 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:13.422 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:13.422 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:13.422 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:13.422 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:13.422 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.422 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:13.422 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:13.422 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:13.422 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:13.422 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:13.422 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:13.423 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:13.423 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:13.423 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:13.423 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:13.423 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:13.423 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.423 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.423 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:13.423 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:13.423 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:13.423 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:13.423 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:13.424 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.424 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.424 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:13.424 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:13.424 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:13.424 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:13.424 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:13.424 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.424 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:13.424 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:13.424 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:13.424 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:13.424 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:13.425 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:13.425 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.425 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:13.425 INFO:teuthology.orchestra.run.smithi012.stdout:______________ ERROR at teardown of test_copy_object_ifmatch_good ______________ 2023-10-05T12:49:13.425 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.425 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:13.425 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.425 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:13.425 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:13.425 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.425 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:13.425 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:13.426 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:13.426 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:13.426 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:13.426 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.426 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:13.426 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:13.426 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.426 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.426 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:13.426 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:13.426 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.427 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.427 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:13.427 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.427 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:13.427 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:13.427 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.427 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.427 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:13.427 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:13.427 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.427 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:13.428 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:13.428 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:13.428 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:13.428 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:13.428 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:13.428 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:13.428 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.428 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:13.428 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:13.428 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:13.428 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:13.429 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:13.429 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:13.429 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:13.429 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:13.429 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:13.429 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.429 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:13.429 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:13.429 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:13.429 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:13.429 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.430 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:13.430 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:13.430 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:13.430 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:13.430 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.430 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.430 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:13.430 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:13.430 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:13.430 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:13.430 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.430 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.431 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:13.431 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:13.431 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:13.431 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.431 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:13.431 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.431 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:13.431 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:13.431 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.431 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:13.431 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:13.431 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:13.432 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:13.432 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:13.432 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:13.432 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.432 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:13.432 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.432 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:13.432 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.432 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:13.432 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:13.432 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.433 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:13.433 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.433 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:13.433 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:13.433 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:13.433 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:13.433 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:13.433 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:13.433 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:13.433 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:13.433 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:13.433 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:13.433 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:13.434 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:13.434 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:13.434 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.434 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:13.434 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:13.434 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:13.434 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:13.434 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:13.434 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:13.434 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:13.434 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:13.434 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:13.434 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:13.435 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:13.435 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.435 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.435 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:13.435 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.435 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:13.435 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:13.435 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:13.435 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:13.435 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:13.435 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:13.435 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:13.436 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:13.436 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:13.436 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:13.436 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:13.436 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:13.436 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:13.436 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:13.436 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:13.436 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:13.436 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:13.436 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:13.436 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:13.436 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:13.437 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:13.437 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:13.437 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:13.437 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:13.437 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:13.437 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:13.437 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:13.437 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:13.437 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.437 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.437 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:13.438 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.438 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:13.438 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:13.438 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.438 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:13.438 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:13.438 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:13.438 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:13.438 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:13.438 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.438 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:13.439 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:13.439 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.439 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.439 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:13.439 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:13.439 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.439 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.439 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:13.439 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:13.439 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:13.439 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:13.439 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:13.439 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.440 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.440 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:13.440 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:13.440 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:13.440 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.440 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:13.440 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.440 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:13.440 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.440 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:13.440 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.440 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:13.440 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.441 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:13.441 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:13.441 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:13.441 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:13.441 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.441 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:13.441 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.441 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:13.441 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:13.441 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:13.441 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:13.441 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:13.442 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:13.442 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:13.442 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:13.442 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:13.442 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:13.442 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:13.442 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:13.442 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:13.442 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:13.442 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:13.442 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:13.442 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:13.443 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:13.443 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:13.443 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:13.443 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:13.443 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:13.443 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:13.443 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:13.443 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:13.443 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:13.443 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:13.443 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:13.443 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:13.444 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:13.444 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:13.444 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:13.444 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:13.444 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:13.444 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:13.444 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:13.444 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:13.444 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:13.444 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:13.444 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:13.444 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.445 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.445 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:13.445 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:13.445 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.445 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:13.445 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.445 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:13.445 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:13.445 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:13.445 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:13.445 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:13.446 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:13.446 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:13.446 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:13.446 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:13.446 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:13.446 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:13.446 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:13.446 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:13.446 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.446 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:13.447 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:13.447 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:13.447 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:13.447 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:13.447 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:13.447 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:13.447 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:13.447 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:13.447 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:13.447 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:13.447 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.448 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.448 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:13.448 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:13.448 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:13.448 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:13.448 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:13.448 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.448 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.448 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:13.448 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:13.449 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:13.449 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:13.449 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:13.449 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.449 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:13.449 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:13.449 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:13.449 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:13.449 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:13.449 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:13.449 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.450 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:13.450 INFO:teuthology.orchestra.run.smithi012.stdout:___________ ERROR at teardown of test_copy_object_ifnonematch_failed ___________ 2023-10-05T12:49:13.450 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.450 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:13.450 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.450 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:13.450 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:13.450 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.450 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:13.450 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:13.450 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:13.450 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:13.451 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:13.451 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.451 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:13.451 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:13.451 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.451 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.451 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:13.451 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:13.451 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.451 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.451 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:13.451 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.452 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:13.452 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:13.452 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.452 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.452 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:13.452 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:13.452 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.452 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:13.452 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:13.452 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:13.452 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:13.452 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:13.453 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:13.453 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:13.453 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.453 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:13.453 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:13.453 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:13.453 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:13.453 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:13.453 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:13.453 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:13.453 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:13.453 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:13.454 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.454 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:13.454 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:13.454 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:13.454 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:13.454 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.454 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:13.454 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:13.454 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:13.454 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:13.454 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.454 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.454 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:13.455 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:13.455 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:13.455 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:13.455 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.455 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.455 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:13.455 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:13.455 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:13.455 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.455 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:13.455 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.455 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:13.456 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:13.456 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.456 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:13.456 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:13.456 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:13.456 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:13.456 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:13.456 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:13.456 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.456 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:13.456 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.456 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:13.456 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.457 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:13.457 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:13.457 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.457 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:13.457 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.457 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:13.457 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:13.457 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:13.457 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:13.458 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:13.458 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:13.458 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:13.458 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:13.458 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:13.458 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:13.458 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:13.458 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:13.458 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:13.458 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.459 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:13.459 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:13.459 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:13.459 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:13.459 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:13.459 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:13.459 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:13.459 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:13.459 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:13.459 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:13.459 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:13.460 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.460 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.460 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:13.460 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.460 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:13.460 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:13.460 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:13.460 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:13.460 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:13.460 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:13.460 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:13.460 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:13.461 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:13.461 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:13.461 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:13.461 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:13.461 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:13.461 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:13.461 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:13.461 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:13.461 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:13.461 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:13.461 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:13.461 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:13.462 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:13.462 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:13.462 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:13.462 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:13.462 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:13.462 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:13.462 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:13.462 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:13.462 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.462 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.462 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:13.462 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.463 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:13.463 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:13.463 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.463 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:13.463 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:13.463 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:13.463 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:13.463 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:13.463 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.463 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:13.463 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:13.463 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.463 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.464 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:13.464 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:13.464 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.464 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.464 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:13.464 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:13.464 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:13.464 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:13.464 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:13.464 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.464 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.465 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:13.465 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:13.465 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:13.465 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.465 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:13.465 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.465 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:13.465 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.465 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:13.465 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.465 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:13.465 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.465 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:13.466 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:13.466 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:13.466 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:13.466 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.466 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:13.466 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.466 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:13.466 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:13.466 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:13.466 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:13.467 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:13.467 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:13.467 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:13.467 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:13.467 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:13.467 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:13.467 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:13.467 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:13.467 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:13.467 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:13.467 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:13.467 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:13.467 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:13.468 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:13.468 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:13.468 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:13.468 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:13.468 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:13.468 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:13.468 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:13.468 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:13.468 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:13.468 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:13.468 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:13.469 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:13.469 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:13.469 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:13.469 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:13.469 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:13.469 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:13.469 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:13.469 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:13.469 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:13.469 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:13.469 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:13.469 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:13.470 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.470 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.470 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:13.470 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:13.470 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.470 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:13.470 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.470 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:13.470 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:13.470 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:13.470 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:13.470 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:13.471 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:13.471 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:13.471 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:13.471 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:13.471 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:13.471 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:13.471 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:13.471 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:13.471 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.471 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:13.471 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:13.471 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:13.472 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:13.472 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:13.472 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:13.472 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:13.472 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:13.472 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:13.472 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:13.472 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:13.472 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.472 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.472 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:13.472 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:13.472 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:13.473 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:13.473 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:13.473 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.473 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.473 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:13.473 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:13.473 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:13.473 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:13.473 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:13.473 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.473 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:13.473 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:13.473 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:13.474 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:13.474 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:13.474 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:13.474 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.474 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:13.474 INFO:teuthology.orchestra.run.smithi012.stdout:______________ ERROR at teardown of test_get_bucket_policy_status ______________ 2023-10-05T12:49:13.474 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.474 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:13.474 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.474 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:13.474 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:13.474 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.475 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:13.475 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:13.475 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:13.475 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:13.475 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:13.475 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.475 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:13.475 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:13.475 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.475 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.475 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:13.476 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:13.476 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.476 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.476 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:13.476 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.476 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:13.476 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:13.476 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.476 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.476 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:13.476 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:13.476 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.476 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:13.477 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:13.477 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:13.477 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:13.477 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:13.477 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:13.477 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:13.477 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.477 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:13.477 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:13.477 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:13.477 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:13.477 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:13.478 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:13.478 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:13.478 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:13.478 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:13.478 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.478 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:13.478 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:13.478 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:13.478 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:13.478 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.478 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:13.478 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:13.479 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:13.479 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:13.479 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.479 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.479 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:13.479 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:13.479 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:13.479 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:13.479 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.479 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.479 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:13.479 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:13.479 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:13.480 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.480 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:13.480 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.480 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:13.480 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:13.480 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.480 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:13.480 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:13.480 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:13.480 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:13.480 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:13.480 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:13.480 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.481 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:13.481 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.481 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:13.481 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.481 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:13.481 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:13.481 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.481 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:13.481 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.481 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:13.481 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:13.481 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:13.481 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:13.482 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:13.482 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:13.482 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:13.482 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:13.482 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:13.482 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:13.482 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:13.482 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:13.482 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:13.482 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.482 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:13.482 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:13.482 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:13.483 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:13.483 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:13.483 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:13.483 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:13.483 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:13.483 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:13.483 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:13.483 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:13.483 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.483 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.483 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:13.483 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.483 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:13.484 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:13.484 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:13.484 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:13.484 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:13.484 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:13.484 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:13.484 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:13.484 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:13.484 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:13.484 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:13.484 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:13.484 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:13.484 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:13.485 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:13.485 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:13.485 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:13.485 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:13.485 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:13.485 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:13.485 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:13.485 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:13.485 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:13.485 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:13.485 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:13.485 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:13.485 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:13.486 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:13.486 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.486 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.486 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:13.486 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.486 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:13.486 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:13.486 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.486 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:13.486 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:13.486 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:13.486 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:13.487 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:13.487 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.487 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:13.487 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:13.487 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.487 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.487 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:13.487 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:13.487 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.487 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.487 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:13.487 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:13.488 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:13.488 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:13.488 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:13.488 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.488 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.488 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:13.488 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:13.488 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:13.488 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.488 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:13.490 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.490 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:13.490 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.490 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:13.491 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.491 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:13.491 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.491 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:13.491 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:13.491 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:13.491 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:13.491 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.491 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:13.491 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.491 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:13.491 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:13.493 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:13.493 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:13.493 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:13.493 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:13.493 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:13.493 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:13.493 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:13.494 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:13.494 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:13.494 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:13.494 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:13.494 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:13.494 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:13.494 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:13.494 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:13.494 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:13.494 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:13.494 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:13.495 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:13.495 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:13.495 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:13.495 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:13.495 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:13.495 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:13.495 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:13.495 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:13.495 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:13.495 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:13.495 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:13.495 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:13.495 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:13.495 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:13.496 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:13.496 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:13.496 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:13.496 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:13.496 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:13.496 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:13.496 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.496 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.496 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:13.496 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:13.496 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.496 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:13.496 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.497 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:13.497 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:13.497 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:13.497 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:13.497 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:13.497 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:13.497 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:13.497 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:13.497 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:13.497 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:13.497 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:13.497 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:13.498 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:13.498 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.498 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:13.498 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:13.498 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:13.498 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:13.498 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:13.498 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:13.498 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:13.498 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:13.498 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:13.498 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:13.499 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:13.499 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.499 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.499 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:13.499 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:13.499 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:13.499 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:13.499 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:13.499 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.499 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.499 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:13.499 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:13.500 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:13.500 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:13.500 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:13.500 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.500 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:13.500 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:13.500 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:13.500 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:13.500 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:13.500 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:13.500 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.500 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:13.501 INFO:teuthology.orchestra.run.smithi012.stdout:________ ERROR at teardown of test_get_public_acl_bucket_policy_status _________ 2023-10-05T12:49:13.501 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.501 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:13.501 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.501 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:13.501 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:13.501 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.501 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:13.501 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:13.501 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:13.501 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:13.501 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:13.501 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.502 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:13.502 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:13.502 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.502 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.502 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:13.502 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:13.502 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.502 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.502 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:13.502 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.503 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:13.503 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:13.503 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.503 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.503 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:13.503 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:13.503 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.503 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:13.503 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:13.503 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:13.503 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:13.503 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:13.504 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:13.504 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:13.504 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.504 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:13.504 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:13.504 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:13.504 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:13.504 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:13.504 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:13.504 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:13.504 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:13.504 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:13.505 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.505 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:13.505 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:13.505 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:13.505 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:13.505 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.505 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:13.505 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:13.505 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:13.505 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:13.505 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.506 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.506 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:13.506 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:13.506 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:13.506 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:13.506 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.506 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.506 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:13.506 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:13.506 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:13.506 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.506 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:13.507 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.507 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:13.507 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:13.507 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.507 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:13.507 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:13.507 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:13.507 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:13.507 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:13.507 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:13.507 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.507 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:13.508 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.508 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:13.508 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.508 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:13.508 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:13.508 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.508 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:13.508 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.508 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:13.508 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:13.508 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:13.508 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:13.509 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:13.509 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:13.509 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:13.509 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:13.509 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:13.509 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:13.509 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:13.509 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:13.509 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:13.509 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.509 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:13.510 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:13.510 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:13.510 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:13.510 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:13.510 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:13.510 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:13.510 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:13.510 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:13.510 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:13.510 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:13.510 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.510 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.511 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:13.511 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.511 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:13.511 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:13.511 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:13.511 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:13.511 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:13.511 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:13.511 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:13.511 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:13.511 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:13.511 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:13.511 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:13.512 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:13.512 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:13.512 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:13.512 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:13.512 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:13.512 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:13.512 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:13.512 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:13.512 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:13.512 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:13.512 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:13.512 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:13.513 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:13.513 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:13.513 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:13.513 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:13.513 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:13.513 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.513 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.513 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:13.513 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.513 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:13.513 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:13.513 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.514 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:13.514 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:13.514 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:13.514 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:13.514 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:13.514 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.514 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:13.514 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:13.514 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.514 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.514 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:13.515 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:13.515 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.515 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.515 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:13.515 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:13.515 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:13.515 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:13.515 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:13.515 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.515 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.515 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:13.515 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:13.516 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:13.516 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.516 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:13.516 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.516 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:13.516 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.516 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:13.516 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.516 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:13.516 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.516 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:13.516 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:13.516 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:13.517 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:13.517 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.517 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:13.517 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.517 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:13.517 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:13.517 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:13.517 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:13.517 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:13.517 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:13.517 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:13.517 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:13.518 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:13.518 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:13.518 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:13.518 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:13.518 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:13.518 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:13.518 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:13.518 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:13.518 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:13.518 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:13.519 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:13.519 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:13.519 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:13.519 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:13.519 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:13.519 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:13.519 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:13.519 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:13.519 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:13.519 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:13.519 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:13.520 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:13.520 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:13.520 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:13.520 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:13.520 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:13.520 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:13.520 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:13.520 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:13.520 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:13.520 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:13.520 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:13.520 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.521 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.521 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:13.521 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:13.521 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.521 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:13.521 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.521 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:13.521 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:13.521 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:13.521 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:13.521 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:13.521 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:13.522 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:13.522 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:13.522 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:13.522 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:13.522 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:13.522 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:13.522 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:13.522 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.522 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:13.522 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:13.522 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:13.523 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:13.523 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:13.523 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:13.523 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:13.523 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:13.523 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:13.523 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:13.523 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:13.523 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.523 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.523 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:13.523 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:13.524 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:13.524 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:13.524 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:13.524 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.524 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.524 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:13.524 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:13.524 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:13.524 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:13.524 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:13.524 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.525 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:13.525 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:13.525 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:13.525 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:13.525 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:13.525 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:13.525 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.525 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:13.525 INFO:teuthology.orchestra.run.smithi012.stdout:______ ERROR at teardown of test_get_authpublic_acl_bucket_policy_status _______ 2023-10-05T12:49:13.525 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.525 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:13.525 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.526 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:13.526 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:13.526 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.526 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:13.526 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:13.526 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:13.526 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:13.526 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:13.526 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.526 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:13.526 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:13.526 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.526 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.527 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:13.527 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:13.527 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.527 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.527 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:13.527 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.527 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:13.527 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:13.527 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.527 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.527 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:13.527 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:13.528 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.528 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:13.528 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:13.528 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:13.528 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:13.528 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:13.528 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:13.528 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:13.528 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.528 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:13.528 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:13.528 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:13.528 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:13.529 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:13.529 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:13.529 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:13.529 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:13.529 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:13.529 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.529 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:13.529 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:13.529 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:13.529 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:13.529 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.529 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:13.529 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:13.530 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:13.530 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:13.530 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.530 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.530 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:13.530 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:13.530 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:13.530 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:13.530 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.530 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.530 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:13.530 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:13.531 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:13.531 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.531 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:13.531 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.531 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:13.531 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:13.531 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.531 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:13.531 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:13.531 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:13.531 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:13.531 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:13.531 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:13.532 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.532 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:13.532 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.532 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:13.532 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.532 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:13.532 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:13.532 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.532 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:13.532 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.532 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:13.532 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:13.532 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:13.533 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:13.533 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:13.533 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:13.533 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:13.533 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:13.533 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:13.533 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:13.533 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:13.533 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:13.533 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:13.533 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.533 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:13.534 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:13.534 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:13.534 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:13.534 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:13.534 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:13.534 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:13.534 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:13.534 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:13.534 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:13.534 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:13.534 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.535 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.535 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:13.535 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.535 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:13.535 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:13.535 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:13.535 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:13.535 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:13.535 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:13.535 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:13.535 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:13.535 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:13.536 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:13.536 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:13.536 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:13.536 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:13.536 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:13.536 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:13.536 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:13.536 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:13.536 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:13.536 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:13.536 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:13.536 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:13.536 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:13.537 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:13.537 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:13.537 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:13.537 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:13.537 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:13.537 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:13.537 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.537 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.537 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:13.537 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.537 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:13.537 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:13.537 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.538 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:13.538 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:13.538 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:13.538 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:13.538 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:13.538 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.538 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:13.538 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:13.538 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.538 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.538 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:13.539 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:13.539 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.539 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.539 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:13.539 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:13.539 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:13.539 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:13.539 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:13.539 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.539 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.539 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:13.539 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:13.539 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:13.540 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.540 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:13.540 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.540 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:13.540 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.540 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:13.540 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.540 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:13.540 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.540 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:13.540 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:13.540 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:13.541 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:13.541 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.541 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:13.541 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.541 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:13.541 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:13.541 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:13.541 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:13.541 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:13.541 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:13.541 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:13.541 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:13.541 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:13.542 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:13.542 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:13.542 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:13.542 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:13.542 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:13.542 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:13.542 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:13.542 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:13.542 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:13.542 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:13.542 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:13.542 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:13.542 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:13.543 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:13.543 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:13.543 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:13.543 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:13.543 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:13.543 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:13.543 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:13.543 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:13.543 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:13.543 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:13.543 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:13.543 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:13.543 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:13.544 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:13.544 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:13.544 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:13.544 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:13.544 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:13.544 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.544 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.544 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:13.544 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:13.544 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.544 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:13.544 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.544 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:13.545 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:13.545 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:13.545 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:13.545 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:13.545 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:13.545 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:13.545 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:13.545 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:13.545 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:13.545 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:13.545 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:13.545 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:13.546 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.546 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:13.546 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:13.546 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:13.546 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:13.546 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:13.546 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:13.546 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:13.546 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:13.546 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:13.546 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:13.546 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:13.547 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.547 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.547 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:13.547 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:13.547 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:13.547 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:13.547 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:13.547 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.547 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.547 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:13.547 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:13.547 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:13.547 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:13.548 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:13.548 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.548 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:13.548 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:13.548 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:13.548 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:13.548 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:13.548 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:13.548 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.548 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:13.548 INFO:teuthology.orchestra.run.smithi012.stdout:_____ ERROR at teardown of test_get_publicpolicy_acl_bucket_policy_status ______ 2023-10-05T12:49:13.549 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.549 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:13.549 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.549 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:13.549 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:13.549 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.549 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:13.549 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:13.549 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:13.549 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:13.549 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:13.550 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.550 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:13.550 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:13.550 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.550 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.550 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:13.550 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:13.550 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.550 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.550 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:13.550 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.550 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:13.551 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:13.551 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.551 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.551 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:13.551 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:13.551 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.551 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:13.551 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:13.551 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:13.551 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:13.551 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:13.551 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:13.552 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:13.552 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.552 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:13.552 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:13.552 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:13.552 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:13.552 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:13.552 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:13.552 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:13.552 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:13.552 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:13.552 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.552 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:13.553 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:13.553 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:13.553 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:13.553 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.553 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:13.553 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:13.553 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:13.553 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:13.553 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.553 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.553 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:13.554 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:13.554 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:13.554 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:13.554 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.554 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.554 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:13.554 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:13.554 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:13.554 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.554 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:13.554 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.554 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:13.555 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:13.555 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.555 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:13.555 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:13.555 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:13.555 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:13.555 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:13.555 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:13.555 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.555 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:13.555 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.555 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:13.555 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.556 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:13.556 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:13.556 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.556 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:13.556 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.556 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:13.556 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:13.556 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:13.556 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:13.556 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:13.556 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:13.556 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:13.556 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:13.557 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:13.557 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:13.557 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:13.557 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:13.557 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:13.557 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.557 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:13.557 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:13.557 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:13.557 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:13.557 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:13.557 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:13.558 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:13.558 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:13.558 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:13.558 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:13.558 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:13.558 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.558 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.558 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:13.558 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.558 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:13.558 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:13.558 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:13.559 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:13.559 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:13.559 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:13.559 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:13.559 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:13.572 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:13.572 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:13.572 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:13.572 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:13.572 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:13.572 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:13.572 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:13.572 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:13.572 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:13.572 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:13.572 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:13.573 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:13.573 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:13.573 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:13.573 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:13.573 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:13.573 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:13.573 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:13.573 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:13.573 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:13.573 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.573 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.573 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:13.574 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.574 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:13.574 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:13.574 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.574 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:13.574 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:13.574 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:13.574 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:13.574 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:13.574 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.574 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:13.574 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:13.575 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.575 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.575 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:13.575 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:13.575 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.575 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.575 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:13.575 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:13.575 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:13.575 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:13.575 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:13.576 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.576 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.576 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:13.576 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:13.576 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:13.576 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.576 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:13.576 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.576 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:13.576 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.576 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:13.577 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.577 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:13.577 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.577 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:13.577 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:13.577 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:13.577 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:13.577 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.577 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:13.577 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.577 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:13.577 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:13.578 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:13.578 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:13.578 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:13.578 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:13.578 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:13.578 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:13.578 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:13.578 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:13.578 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:13.578 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:13.578 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:13.579 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:13.579 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:13.579 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:13.579 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:13.579 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:13.579 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:13.579 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:13.579 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:13.579 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:13.579 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:13.579 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:13.579 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:13.580 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:13.580 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:13.580 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:13.580 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:13.580 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:13.580 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:13.580 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:13.580 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:13.580 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:13.580 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:13.580 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:13.580 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:13.580 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:13.581 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:13.581 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:13.581 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.581 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.581 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:13.581 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:13.581 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.581 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:13.581 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.581 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:13.581 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:13.582 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:13.582 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:13.582 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:13.582 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:13.582 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:13.582 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:13.582 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:13.582 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:13.582 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:13.582 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:13.582 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:13.582 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.583 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:13.583 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:13.583 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:13.583 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:13.583 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:13.583 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:13.583 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:13.583 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:13.583 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:13.583 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:13.583 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:13.583 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.584 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.584 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:13.584 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:13.584 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:13.584 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:13.584 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:13.584 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.584 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.584 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:13.584 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:13.584 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:13.584 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:13.585 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:13.585 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.585 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:13.585 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:13.585 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:13.585 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:13.585 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:13.585 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:13.585 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.585 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:13.585 INFO:teuthology.orchestra.run.smithi012.stdout:____ ERROR at teardown of test_get_nonpublicpolicy_acl_bucket_policy_status ____ 2023-10-05T12:49:13.585 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.586 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:13.586 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.586 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:13.586 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:13.586 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.586 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:13.586 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:13.586 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:13.586 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:13.586 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:13.586 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.587 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:13.587 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:13.587 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.587 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.587 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:13.587 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:13.587 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.587 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.587 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:13.587 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.587 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:13.587 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:13.587 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.588 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.588 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:13.588 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:13.588 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.588 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:13.588 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:13.588 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:13.588 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:13.588 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:13.588 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:13.588 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:13.589 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.589 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:13.589 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:13.589 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:13.589 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:13.589 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:13.589 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:13.589 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:13.589 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:13.589 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:13.589 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.589 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:13.589 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:13.590 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:13.590 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:13.590 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.590 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:13.590 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:13.590 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:13.590 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:13.590 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.590 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.590 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:13.590 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:13.591 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:13.591 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:13.591 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.591 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.591 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:13.591 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:13.591 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:13.591 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.591 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:13.591 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.591 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:13.591 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:13.591 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.592 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:13.592 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:13.592 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:13.592 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:13.592 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:13.592 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:13.592 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.592 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:13.592 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.592 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:13.592 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.592 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:13.592 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:13.593 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.593 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:13.593 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.593 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:13.593 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:13.593 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:13.593 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:13.593 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:13.593 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:13.593 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:13.593 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:13.593 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:13.593 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:13.594 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:13.594 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:13.594 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:13.594 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.594 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:13.594 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:13.594 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:13.594 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:13.594 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:13.594 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:13.594 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:13.594 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:13.595 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:13.595 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:13.595 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:13.595 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.595 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.595 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:13.595 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.595 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:13.595 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:13.595 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:13.595 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:13.595 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:13.595 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:13.596 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:13.596 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:13.596 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:13.596 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:13.596 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:13.596 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:13.596 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:13.596 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:13.596 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:13.596 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:13.596 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:13.596 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:13.596 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:13.597 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:13.597 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:13.597 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:13.597 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:13.597 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:13.597 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:13.597 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:13.597 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:13.597 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:13.597 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.597 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.597 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:13.597 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.598 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:13.598 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:13.598 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.598 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:13.598 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:13.598 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:13.598 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:13.598 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:13.598 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.598 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:13.598 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:13.599 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.599 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.599 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:13.599 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:13.599 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.599 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.599 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:13.599 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:13.599 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:13.599 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:13.599 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:13.599 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.600 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.600 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:13.600 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:13.600 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:13.600 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.600 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:13.600 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.600 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:13.600 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.600 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:13.600 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.600 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:13.600 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.601 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:13.601 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:13.601 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:13.601 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:13.601 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.601 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:13.601 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.601 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:13.601 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:13.601 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:13.601 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:13.601 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:13.602 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:13.602 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:13.602 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:13.602 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:13.602 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:13.602 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:13.602 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:13.602 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:13.602 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:13.602 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:13.602 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:13.602 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:13.603 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:13.603 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:13.603 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:13.603 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:13.603 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:13.603 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:13.603 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:13.603 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:13.603 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:13.603 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:13.603 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:13.604 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:13.604 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:13.604 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:13.604 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:13.604 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:13.604 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:13.604 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:13.604 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:13.604 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:13.604 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:13.604 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:13.604 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:13.604 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.605 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.605 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:13.605 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:13.605 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.605 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:13.605 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.605 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:13.605 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:13.605 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:13.605 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:13.605 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:13.605 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:13.605 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:13.606 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:13.606 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:13.606 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:13.606 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:13.606 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:13.606 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:13.606 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.606 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:13.606 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:13.606 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:13.606 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:13.606 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:13.607 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:13.607 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:13.607 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:13.607 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:13.607 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:13.607 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:13.607 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.607 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.607 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:13.607 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:13.607 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:13.607 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:13.607 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:13.608 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.608 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.608 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:13.608 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:13.608 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:13.608 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:13.608 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:13.608 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.608 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:13.608 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:13.608 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:13.608 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:13.609 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:13.609 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:13.609 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.609 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:13.609 INFO:teuthology.orchestra.run.smithi012.stdout:___ ERROR at teardown of test_get_nonpublicpolicy_deny_bucket_policy_status ____ 2023-10-05T12:49:13.609 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.609 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:13.609 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.609 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:13.609 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:13.609 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.609 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:13.610 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:13.610 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:13.610 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:13.610 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:13.610 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.610 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:13.610 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:13.610 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.610 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.610 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:13.610 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:13.610 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.611 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.611 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:13.611 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.611 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:13.611 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:13.611 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.611 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.611 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:13.611 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:13.611 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.611 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:13.611 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:13.612 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:13.612 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:13.612 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:13.612 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:13.612 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:13.612 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.612 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:13.612 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:13.612 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:13.612 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:13.612 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:13.613 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:13.613 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:13.613 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:13.613 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:13.613 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.613 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:13.613 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:13.613 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:13.613 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:13.613 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.613 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:13.613 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:13.613 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:13.614 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:13.614 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.614 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.614 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:13.614 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:13.614 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:13.614 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:13.614 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.614 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.614 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:13.614 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:13.614 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:13.614 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.615 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:13.615 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.615 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:13.615 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:13.615 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.615 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:13.615 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:13.615 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:13.615 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:13.615 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:13.615 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:13.615 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.615 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:13.616 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.616 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:13.616 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.616 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:13.616 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:13.616 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.616 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:13.616 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.616 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:13.616 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:13.616 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:13.617 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:13.617 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:13.617 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:13.617 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:13.617 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:13.617 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:13.617 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:13.617 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:13.617 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:13.617 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:13.617 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.617 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:13.618 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:13.618 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:13.618 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:13.618 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:13.618 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:13.618 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:13.618 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:13.618 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:13.618 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:13.618 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:13.618 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.619 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.619 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:13.619 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.619 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:13.619 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:13.619 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:13.619 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:13.619 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:13.619 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:13.619 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:13.619 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:13.619 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:13.620 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:13.620 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:13.620 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:13.620 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:13.620 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:13.620 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:13.620 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:13.620 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:13.620 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:13.620 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:13.620 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:13.620 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:13.621 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:13.621 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:13.621 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:13.621 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:13.621 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:13.621 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:13.621 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:13.621 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.621 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.621 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:13.621 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.621 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:13.622 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:13.622 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.622 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:13.622 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:13.622 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:13.622 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:13.622 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:13.622 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.622 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:13.622 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:13.622 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.622 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.623 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:13.623 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:13.623 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.623 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.623 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:13.623 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:13.623 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:13.623 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:13.623 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:13.623 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.623 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.623 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:13.623 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:13.624 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:13.624 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.624 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:13.624 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.624 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:13.624 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.624 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:13.624 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.624 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:13.624 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.624 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:13.624 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:13.624 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:13.625 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:13.625 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.625 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:13.625 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.625 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:13.625 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:13.625 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:13.625 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:13.625 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:13.625 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:13.625 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:13.625 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:13.625 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:13.626 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:13.626 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:13.626 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:13.626 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:13.626 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:13.626 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:13.626 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:13.626 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:13.626 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:13.626 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:13.626 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:13.626 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:13.627 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:13.627 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:13.627 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:13.627 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:13.627 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:13.627 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:13.627 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:13.627 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:13.627 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:13.627 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:13.627 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:13.627 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:13.627 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:13.628 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:13.628 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:13.628 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:13.628 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:13.628 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:13.628 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:13.628 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.628 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.628 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:13.628 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:13.628 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.629 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:13.629 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.629 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:13.629 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:13.629 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:13.629 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:13.629 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:13.629 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:13.629 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:13.629 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:13.629 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:13.629 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:13.630 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:13.630 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:13.630 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:13.630 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.630 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:13.630 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:13.630 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:13.630 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:13.630 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:13.630 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:13.630 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:13.630 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:13.631 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:13.631 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:13.631 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:13.631 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.631 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.631 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:13.631 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:13.631 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:13.631 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:13.631 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:13.631 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.631 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.631 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:13.632 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:13.632 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:13.632 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:13.632 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:13.632 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.632 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:13.632 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:13.632 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:13.632 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:13.632 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:13.632 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:13.632 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.632 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:13.633 INFO:teuthology.orchestra.run.smithi012.stdout:______________ ERROR at teardown of test_get_default_public_block ______________ 2023-10-05T12:49:13.633 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.633 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:13.633 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.633 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:13.633 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:13.633 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.633 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:13.633 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:13.633 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:13.633 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:13.633 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:13.633 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.633 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:13.634 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:13.634 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.634 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.634 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:13.634 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:13.634 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.634 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.634 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:13.634 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.634 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:13.634 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:13.634 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.635 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.635 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:13.635 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:13.635 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.635 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:13.635 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:13.635 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:13.635 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:13.635 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:13.635 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:13.635 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:13.635 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.635 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:13.635 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:13.636 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:13.636 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:13.636 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:13.636 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:13.636 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:13.636 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:13.636 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:13.636 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.636 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:13.636 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:13.636 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:13.636 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:13.636 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.637 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:13.637 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:13.637 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:13.637 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:13.637 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.637 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.637 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:13.637 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:13.637 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:13.637 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:13.637 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.637 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.637 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:13.638 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:13.638 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:13.638 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.638 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:13.638 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.638 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:13.638 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:13.638 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.638 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:13.638 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:13.638 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:13.638 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:13.638 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:13.639 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:13.639 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.639 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:13.639 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.639 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:13.639 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.639 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:13.639 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:13.639 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.639 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:13.639 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.639 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:13.640 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:13.640 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:13.640 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:13.640 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:13.640 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:13.640 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:13.640 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:13.640 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:13.640 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:13.640 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:13.640 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:13.640 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:13.640 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.641 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:13.641 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:13.641 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:13.641 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:13.641 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:13.641 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:13.641 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:13.641 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:13.641 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:13.641 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:13.641 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:13.641 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.642 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.642 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:13.642 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.642 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:13.642 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:13.642 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:13.642 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:13.642 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:13.644 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:13.644 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:13.644 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:13.644 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:13.644 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:13.644 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:13.644 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:13.644 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:13.644 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:13.644 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:13.644 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:13.644 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:13.645 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:13.645 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:13.645 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:13.645 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:13.645 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:13.645 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:13.645 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:13.645 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:13.645 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:13.645 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:13.645 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:13.645 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.646 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.646 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:13.646 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.646 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:13.646 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:13.646 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.646 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:13.646 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:13.646 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:13.646 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:13.646 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:13.646 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.646 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:13.647 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:13.647 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.647 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.647 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:13.647 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:13.647 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.647 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.647 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:13.647 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:13.647 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:13.647 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:13.647 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:13.648 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.648 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.648 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:13.648 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:13.648 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:13.648 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.648 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:13.648 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.648 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:13.648 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.648 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:13.649 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.649 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:13.649 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.649 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:13.649 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:13.649 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:13.649 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:13.649 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.649 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:13.649 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.649 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:13.649 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:13.649 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:13.650 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:13.650 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:13.650 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:13.650 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:13.650 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:13.650 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:13.650 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:13.650 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:13.650 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:13.650 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:13.650 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:13.650 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:13.651 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:13.651 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:13.651 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:13.651 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:13.651 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:13.651 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:13.651 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:13.651 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:13.651 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:13.651 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:13.651 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:13.651 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:13.652 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:13.652 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:13.652 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:13.652 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:13.652 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:13.652 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:13.652 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:13.652 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:13.652 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:13.652 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:13.652 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:13.652 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:13.652 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:13.653 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.653 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.653 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:13.653 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:13.653 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.653 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:13.653 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.653 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:13.653 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:13.653 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:13.653 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:13.654 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:13.654 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:13.654 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:13.654 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:13.654 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:13.654 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:13.654 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:13.654 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:13.654 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:13.654 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.654 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:13.655 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:13.655 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:13.655 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:13.655 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:13.655 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:13.655 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:13.655 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:13.655 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:13.655 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:13.655 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:13.655 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.655 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.656 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:13.656 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:13.656 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:13.656 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:13.656 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:13.656 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.656 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.656 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:13.656 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:13.656 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:13.656 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:13.656 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:13.656 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.657 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:13.657 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:13.657 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:13.657 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:13.657 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:13.657 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:13.657 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.657 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:13.657 INFO:teuthology.orchestra.run.smithi012.stdout:__________________ ERROR at teardown of test_put_public_block __________________ 2023-10-05T12:49:13.657 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.657 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:13.657 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.658 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:13.658 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:13.658 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.658 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:13.658 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:13.658 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:13.658 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:13.658 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:13.658 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.658 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:13.658 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:13.659 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.659 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.659 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:13.659 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:13.659 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.659 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.659 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:13.659 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.659 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:13.659 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:13.659 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.660 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.660 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:13.660 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:13.660 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.660 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:13.660 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:13.660 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:13.660 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:13.660 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:13.660 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:13.660 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:13.660 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.661 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:13.661 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:13.661 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:13.661 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:13.661 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:13.661 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:13.661 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:13.661 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:13.661 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:13.661 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.661 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:13.662 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:13.662 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:13.662 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:13.662 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.662 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:13.662 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:13.662 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:13.662 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:13.662 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.662 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.662 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:13.662 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:13.662 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:13.663 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:13.663 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.663 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.663 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:13.663 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:13.663 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:13.663 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.663 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:13.663 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.663 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:13.663 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:13.663 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.664 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:13.664 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:13.664 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:13.664 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:13.664 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:13.664 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:13.664 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.664 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:13.664 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.664 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:13.664 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.664 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:13.664 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:13.665 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.665 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:13.665 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.665 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:13.665 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:13.665 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:13.665 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:13.665 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:13.665 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:13.665 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:13.665 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:13.665 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:13.666 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:13.666 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:13.666 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:13.666 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:13.666 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.666 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:13.666 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:13.666 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:13.666 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:13.666 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:13.666 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:13.666 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:13.667 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:13.667 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:13.667 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:13.667 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:13.667 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.667 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.667 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:13.667 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.667 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:13.667 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:13.667 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:13.667 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:13.668 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:13.668 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:13.668 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:13.668 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:13.668 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:13.668 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:13.668 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:13.668 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:13.668 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:13.668 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:13.668 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:13.668 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:13.669 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:13.669 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:13.669 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:13.669 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:13.669 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:13.669 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:13.669 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:13.669 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:13.669 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:13.669 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:13.669 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:13.670 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:13.670 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.670 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.670 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:13.670 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.670 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:13.670 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:13.670 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.670 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:13.670 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:13.670 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:13.671 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:13.671 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:13.671 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.671 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:13.671 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:13.671 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.671 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.671 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:13.671 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:13.671 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.671 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.671 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:13.672 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:13.672 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:13.672 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:13.672 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:13.672 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.672 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.672 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:13.672 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:13.672 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:13.672 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.672 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:13.672 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.673 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:13.673 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.673 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:13.673 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.673 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:13.673 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.673 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:13.673 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:13.673 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:13.673 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:13.673 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.674 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:13.674 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.674 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:13.674 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:13.674 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:13.674 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:13.674 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:13.674 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:13.674 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:13.674 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:13.674 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:13.674 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:13.675 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:13.675 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:13.675 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:13.675 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:13.675 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:13.675 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:13.675 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:13.675 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:13.675 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:13.675 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:13.675 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:13.676 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:13.676 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:13.676 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:13.676 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:13.676 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:13.676 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:13.676 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:13.676 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:13.676 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:13.676 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:13.676 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:13.677 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:13.677 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:13.677 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:13.677 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:13.677 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:13.677 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:13.677 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:13.677 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:13.677 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.677 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.677 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:13.677 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:13.678 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.678 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:13.678 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.678 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:13.678 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:13.678 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:13.678 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:13.678 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:13.678 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:13.678 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:13.679 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:13.679 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:13.679 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:13.679 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:13.679 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:13.679 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:13.679 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.679 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:13.679 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:13.679 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:13.679 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:13.679 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:13.680 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:13.680 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:13.680 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:13.680 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:13.680 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:13.680 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:13.680 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.680 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.680 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:13.680 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:13.680 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:13.680 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:13.680 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:13.681 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.681 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.681 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:13.681 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:13.681 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:13.681 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:13.681 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:13.681 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.681 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:13.681 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:13.681 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:13.681 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:13.681 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:13.682 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:13.682 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.682 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:13.682 INFO:teuthology.orchestra.run.smithi012.stdout:____________ ERROR at teardown of test_block_public_put_bucket_acls ____________ 2023-10-05T12:49:13.682 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.682 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:13.682 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.682 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:13.682 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:13.682 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.682 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:13.682 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:13.683 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:13.683 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:13.683 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:13.683 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.683 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:13.683 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:13.683 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.683 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.683 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:13.683 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:13.683 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.683 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.683 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:13.684 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.684 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:13.684 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:13.684 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.684 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.684 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:13.684 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:13.684 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.684 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:13.684 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:13.684 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:13.684 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:13.684 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:13.685 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:13.685 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:13.685 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.685 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:13.685 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:13.685 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:13.685 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:13.685 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:13.685 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:13.685 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:13.685 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:13.685 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:13.685 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.686 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:13.686 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:13.686 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:13.686 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:13.686 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.686 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:13.686 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:13.686 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:13.686 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:13.686 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.686 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.686 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:13.687 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:13.687 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:13.687 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:13.687 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.687 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.687 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:13.687 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:13.687 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:13.687 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.687 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:13.687 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.687 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:13.687 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:13.688 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.688 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:13.688 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:13.688 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:13.688 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:13.688 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:13.688 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:13.688 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.688 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:13.688 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.688 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:13.689 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.689 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:13.689 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:13.689 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.689 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:13.689 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.689 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:13.689 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:13.689 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:13.689 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:13.689 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:13.689 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:13.690 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:13.690 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:13.690 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:13.690 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:13.690 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:13.690 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:13.690 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:13.690 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.690 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:13.690 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:13.690 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:13.690 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:13.691 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:13.691 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:13.691 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:13.691 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:13.691 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:13.691 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:13.691 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:13.691 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.691 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.691 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:13.691 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.691 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:13.691 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:13.692 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:13.692 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:13.692 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:13.692 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:13.692 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:13.692 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:13.692 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:13.692 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:13.692 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:13.692 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:13.692 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:13.692 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:13.692 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:13.693 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:13.693 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:13.693 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:13.693 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:13.693 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:13.693 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:13.693 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:13.693 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:13.693 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:13.693 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:13.693 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:13.693 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:13.694 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:13.694 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.694 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.694 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:13.694 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.694 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:13.694 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:13.694 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.694 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:13.694 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:13.694 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:13.695 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:13.695 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:13.695 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.695 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:13.695 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:13.695 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.695 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.695 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:13.695 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:13.695 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.695 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.695 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:13.695 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:13.697 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:13.697 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:13.697 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:13.697 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.697 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.697 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:13.697 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:13.697 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:13.697 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.697 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:13.698 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.698 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:13.698 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.698 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:13.698 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.698 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:13.698 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.698 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:13.698 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:13.698 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:13.698 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:13.699 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.699 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:13.699 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.699 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:13.699 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:13.699 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:13.699 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:13.699 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:13.699 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:13.699 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:13.699 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:13.700 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:13.700 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:13.700 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:13.700 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:13.700 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:13.700 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:13.700 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:13.700 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:13.700 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:13.700 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:13.700 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:13.700 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:13.701 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:13.701 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:13.701 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:13.701 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:13.701 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:13.701 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:13.701 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:13.701 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:13.701 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:13.701 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:13.701 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:13.701 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:13.701 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:13.702 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:13.702 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:13.702 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:13.702 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:13.702 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:13.702 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:13.702 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:13.702 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.702 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.702 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:13.702 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:13.702 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.703 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:13.703 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.703 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:13.703 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:13.703 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:13.703 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:13.703 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:13.703 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:13.703 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:13.703 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:13.703 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:13.703 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:13.704 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:13.704 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:13.704 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:13.704 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.704 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:13.704 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:13.704 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:13.704 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:13.704 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:13.704 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:13.704 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:13.704 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:13.705 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:13.705 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:13.705 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:13.705 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.705 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.705 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:13.705 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:13.705 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:13.705 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:13.705 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:13.705 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.705 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.705 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:13.706 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:13.706 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:13.706 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:13.706 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:13.706 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.706 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:13.706 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:13.706 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:13.706 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:13.706 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:13.706 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:13.707 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.707 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:13.707 INFO:teuthology.orchestra.run.smithi012.stdout:__________ ERROR at teardown of test_block_public_object_canned_acls ___________ 2023-10-05T12:49:13.707 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.707 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:13.707 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.707 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:13.707 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:13.707 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.707 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:13.707 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:13.707 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:13.708 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:13.708 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:13.708 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.708 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:13.708 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:13.708 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.708 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.708 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:13.708 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:13.708 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.708 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.708 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:13.709 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.709 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:13.709 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:13.709 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.709 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.709 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:13.709 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:13.709 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.709 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:13.709 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:13.709 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:13.709 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:13.710 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:13.710 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:13.710 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:13.710 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.710 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:13.710 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:13.710 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:13.710 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:13.710 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:13.710 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:13.710 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:13.710 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:13.711 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:13.711 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.711 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:13.711 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:13.711 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:13.711 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:13.711 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.711 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:13.711 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:13.711 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:13.711 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:13.711 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.712 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.712 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:13.712 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:13.712 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:13.712 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:13.712 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.712 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.712 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:13.712 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:13.712 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:13.712 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.712 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:13.712 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.713 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:13.713 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:13.713 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.713 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:13.713 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:13.713 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:13.713 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:13.713 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:13.713 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:13.713 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.713 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:13.713 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.713 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:13.714 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.714 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:13.714 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:13.714 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.714 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:13.714 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.714 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:13.714 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:13.714 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:13.714 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:13.714 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:13.714 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:13.715 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:13.715 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:13.715 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:13.715 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:13.715 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:13.715 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:13.715 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:13.715 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.715 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:13.715 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:13.715 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:13.716 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:13.716 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:13.716 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:13.716 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:13.716 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:13.716 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:13.716 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:13.716 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:13.716 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.716 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.716 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:13.716 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.717 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:13.717 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:13.717 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:13.717 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:13.717 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:13.717 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:13.717 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:13.717 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:13.717 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:13.717 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:13.717 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:13.717 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:13.717 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:13.718 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:13.718 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:13.718 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:13.718 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:13.718 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:13.718 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:13.718 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:13.718 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:13.718 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:13.718 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:13.718 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:13.719 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:13.719 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:13.719 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:13.719 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:13.719 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.719 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.719 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:13.719 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.719 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:13.719 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:13.719 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.719 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:13.719 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:13.720 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:13.720 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:13.720 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:13.720 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.720 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:13.720 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:13.720 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.720 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.720 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:13.720 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:13.720 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.720 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.720 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:13.721 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:13.721 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:13.721 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:13.721 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:13.721 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.721 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.721 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:13.721 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:13.721 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:13.721 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.721 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:13.721 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.721 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:13.722 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.722 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:13.722 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.722 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:13.722 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.722 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:13.722 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:13.722 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:13.722 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:13.722 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.722 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:13.722 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.722 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:13.723 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:13.723 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:13.723 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:13.723 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:13.723 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:13.723 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:13.723 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:13.723 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:13.723 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:13.723 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:13.723 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:13.723 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:13.723 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:13.724 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:13.724 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:13.724 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:13.724 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:13.724 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:13.724 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:13.724 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:13.724 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:13.724 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:13.724 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:13.724 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:13.724 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:13.724 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:13.725 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:13.725 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:13.725 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:13.725 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:13.725 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:13.725 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:13.725 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:13.725 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:13.725 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:13.725 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:13.725 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:13.725 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:13.725 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:13.725 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.726 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.726 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:13.726 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:13.726 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.726 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:13.726 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.726 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:13.726 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:13.726 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:13.726 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:13.726 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:13.726 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:13.726 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:13.727 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:13.727 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:13.727 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:13.727 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:13.727 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:13.727 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:13.727 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.727 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:13.727 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:13.727 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:13.727 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:13.728 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:13.728 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:13.728 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:13.728 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:13.728 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:13.728 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:13.728 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:13.728 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.728 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.728 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:13.728 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:13.728 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:13.728 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:13.729 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:13.729 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.729 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.729 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:13.729 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:13.729 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:13.729 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:13.729 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:13.729 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.729 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:13.729 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:13.729 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:13.729 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:13.730 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:13.730 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:13.730 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.730 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:13.730 INFO:teuthology.orchestra.run.smithi012.stdout:________________ ERROR at teardown of test_block_public_policy _________________ 2023-10-05T12:49:13.730 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.730 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:13.730 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.730 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:13.730 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:13.730 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.730 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:13.731 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:13.731 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:13.731 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:13.731 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:13.731 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.731 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:13.731 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:13.731 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.731 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.731 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:13.731 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:13.731 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.731 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.732 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:13.732 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.732 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:13.732 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:13.732 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.732 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.732 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:13.732 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:13.732 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.732 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:13.732 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:13.733 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:13.733 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:13.733 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:13.733 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:13.733 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:13.733 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.733 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:13.733 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:13.733 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:13.733 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:13.733 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:13.733 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:13.733 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:13.734 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:13.734 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:13.734 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.734 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:13.734 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:13.734 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:13.734 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:13.734 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.734 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:13.734 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:13.734 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:13.735 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:13.735 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.735 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.735 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:13.735 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:13.735 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:13.735 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:13.735 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.735 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.735 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:13.735 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:13.735 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:13.735 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.736 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:13.736 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.736 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:13.736 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:13.736 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.736 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:13.736 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:13.736 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:13.736 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:13.736 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:13.736 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:13.736 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.736 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:13.737 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.737 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:13.737 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.737 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:13.737 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:13.737 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.737 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:13.737 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.737 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:13.737 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:13.737 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:13.738 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:13.738 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:13.738 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:13.738 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:13.738 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:13.738 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:13.738 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:13.738 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:13.738 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:13.738 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:13.738 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.738 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:13.739 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:13.739 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:13.739 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:13.739 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:13.739 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:13.739 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:13.739 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:13.739 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:13.739 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:13.739 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:13.739 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.739 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.740 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:13.740 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.740 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:13.740 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:13.740 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:13.740 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:13.740 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:13.740 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:13.740 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:13.740 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:13.740 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:13.740 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:13.740 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:13.741 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:13.741 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:13.741 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:13.741 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:13.741 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:13.741 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:13.741 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:13.741 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:13.741 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:13.741 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:13.741 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:13.741 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:13.742 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:13.742 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:13.742 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:13.742 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:13.742 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:13.742 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.742 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.742 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:13.742 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.742 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:13.742 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:13.742 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.743 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:13.743 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:13.743 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:13.743 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:13.743 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:13.743 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.743 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:13.743 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:13.743 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.743 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.743 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:13.743 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:13.743 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.744 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.744 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:13.744 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:13.744 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:13.744 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:13.744 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:13.744 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.744 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.744 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:13.744 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:13.744 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:13.744 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.744 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:13.745 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.745 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:13.745 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.745 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:13.745 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.745 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:13.745 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.745 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:13.745 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:13.745 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:13.745 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:13.745 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.745 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:13.746 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.746 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:13.746 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:13.746 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:13.746 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:13.746 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:13.746 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:13.746 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:13.746 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:13.746 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:13.746 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:13.746 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:13.746 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:13.747 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:13.747 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:13.747 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:13.747 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:13.747 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:13.747 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:13.747 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:13.747 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:13.747 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:13.747 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:13.747 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:13.747 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:13.748 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:13.748 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:13.748 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:13.748 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:13.748 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:13.748 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:13.748 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:13.748 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:13.748 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:13.748 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:13.748 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:13.748 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:13.748 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:13.749 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:13.749 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:13.749 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:13.749 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.749 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.749 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:13.749 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:13.749 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.749 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:13.749 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.749 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:13.749 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:13.749 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:13.750 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:13.750 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:13.750 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:13.750 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:13.750 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:13.750 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:13.750 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:13.750 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:13.750 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:13.750 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:13.750 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.750 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:13.751 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:13.751 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:13.751 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:13.751 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:13.751 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:13.751 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:13.751 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:13.751 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:13.751 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:13.751 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:13.751 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.751 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.751 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:13.752 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:13.752 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:13.752 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:13.752 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:13.752 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.752 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.752 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:13.752 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:13.752 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:13.752 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:13.752 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:13.752 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.753 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:13.753 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:13.753 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:13.753 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:13.753 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:13.753 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:13.753 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.753 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:13.753 INFO:teuthology.orchestra.run.smithi012.stdout:_________________ ERROR at teardown of test_ignore_public_acls _________________ 2023-10-05T12:49:13.753 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.753 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:13.753 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.753 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:13.754 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:13.754 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.754 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:13.754 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:13.754 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:13.754 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:13.754 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:13.754 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.754 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:13.754 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:13.754 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.755 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.755 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:13.755 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:13.755 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.755 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.755 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:13.755 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.755 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:13.755 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:13.755 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.755 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.755 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:13.755 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:13.756 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.756 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:13.756 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:13.756 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:13.756 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:13.756 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:13.756 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:13.756 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:13.756 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.756 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:13.756 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:13.756 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:13.757 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:13.757 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:13.757 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:13.757 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:13.757 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:13.757 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:13.757 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.757 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:13.757 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:13.757 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:13.757 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:13.757 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.758 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:13.758 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:13.758 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:13.758 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:13.758 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.758 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.758 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:13.758 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:13.758 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:13.758 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:13.758 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.758 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.759 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:13.759 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:13.759 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:13.759 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.759 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:13.759 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.759 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:13.759 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:13.759 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.759 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:13.759 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:13.760 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:13.760 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:13.760 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:13.760 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:13.760 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.760 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:13.760 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.760 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:13.760 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.760 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:13.760 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:13.761 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.761 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:13.761 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.761 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:13.761 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:13.761 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:13.761 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:13.761 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:13.761 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:13.761 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:13.761 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:13.761 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:13.761 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:13.762 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:13.762 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:13.762 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:13.762 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.762 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:13.762 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:13.762 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:13.762 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:13.762 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:13.762 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:13.762 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:13.763 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:13.763 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:13.763 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:13.763 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:13.763 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.763 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.763 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:13.763 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.763 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:13.763 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:13.763 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:13.763 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:13.763 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:13.764 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:13.764 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:13.764 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:13.764 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:13.764 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:13.764 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:13.764 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:13.764 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:13.764 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:13.764 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:13.764 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:13.764 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:13.765 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:13.765 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:13.765 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:13.765 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:13.765 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:13.765 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:13.765 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:13.765 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:13.765 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:13.765 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:13.765 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:13.765 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.766 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.766 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:13.766 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.766 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:13.766 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:13.766 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.766 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:13.766 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:13.766 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:13.766 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:13.766 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:13.766 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.766 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:13.767 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:13.767 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.767 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.767 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:13.767 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:13.767 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.767 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.767 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:13.767 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:13.767 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:13.767 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:13.767 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:13.767 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.768 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.768 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:13.768 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:13.768 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:13.768 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.768 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:13.768 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.768 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:13.768 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.768 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:13.768 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.769 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:13.769 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.769 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:13.769 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:13.769 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:13.769 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:13.769 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.769 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:13.769 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.769 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:13.769 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:13.769 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:13.770 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:13.770 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:13.770 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:13.770 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:13.770 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:13.770 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:13.770 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:13.770 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:13.770 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:13.770 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:13.770 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:13.770 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:13.771 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:13.771 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:13.771 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:13.771 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:13.771 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:13.771 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:13.771 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:13.771 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:13.771 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:13.771 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:13.771 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:13.771 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:13.771 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:13.772 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:13.772 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:13.772 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:13.772 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:13.772 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:13.772 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:13.772 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:13.772 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:13.772 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:13.772 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:13.772 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:13.772 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:13.772 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.773 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.773 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:13.773 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:13.773 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.773 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:13.773 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.773 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:13.773 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:13.773 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:13.773 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:13.773 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:13.773 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:13.773 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:13.773 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:13.774 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:13.774 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:13.774 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:13.774 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:13.774 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:13.774 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.774 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:13.774 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:13.774 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:13.774 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:13.774 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:13.775 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:13.775 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:13.775 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:13.775 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:13.775 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:13.775 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:13.775 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.775 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.775 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:13.775 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:13.775 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:13.775 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:13.776 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:13.776 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.776 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.776 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:13.776 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:13.776 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:13.776 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:13.776 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:13.776 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.776 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:13.776 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:13.776 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:13.776 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:13.777 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:13.777 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:13.777 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.777 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:13.777 INFO:teuthology.orchestra.run.smithi012.stdout:______ ERROR at teardown of test_multipart_upload_on_a_bucket_with_policy ______ 2023-10-05T12:49:13.777 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.777 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:13.777 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.777 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:13.777 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:13.777 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.777 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:13.778 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:13.778 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:13.778 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:13.778 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:13.778 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.778 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:13.778 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:13.778 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.778 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.778 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:13.778 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:13.779 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.779 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.779 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:13.779 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.779 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:13.779 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:13.779 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.779 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.779 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:13.779 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:13.779 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.779 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:13.779 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:13.780 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:13.780 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:13.780 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:13.780 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:13.780 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:13.780 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.780 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:13.780 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:13.780 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:13.780 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:13.780 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:13.780 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:13.780 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:13.781 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:13.781 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:13.781 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.781 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:13.781 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:13.781 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:13.781 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:13.781 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.781 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:13.781 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:13.781 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:13.781 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:13.781 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.782 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.782 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:13.782 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:13.782 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:13.782 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:13.782 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.782 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.782 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:13.782 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:13.782 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:13.782 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.782 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:13.782 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.783 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:13.783 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:13.783 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.783 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:13.783 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:13.783 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:13.783 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:13.783 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:13.783 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:13.783 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.783 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:13.783 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.784 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:13.784 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.784 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:13.784 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:13.784 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.784 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:13.784 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.784 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:13.784 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:13.784 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:13.784 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:13.784 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:13.784 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:13.785 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:13.785 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:13.785 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:13.785 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:13.785 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:13.785 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:13.785 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:13.785 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.785 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:13.785 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:13.785 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:13.785 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:13.785 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:13.786 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:13.786 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:13.786 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:13.786 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:13.786 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:13.786 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:13.786 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.786 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.786 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:13.786 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.786 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:13.786 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:13.787 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:13.787 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:13.787 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:13.787 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:13.787 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:13.787 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:13.787 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:13.787 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:13.787 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:13.787 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:13.787 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:13.787 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:13.787 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:13.788 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:13.788 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:13.788 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:13.788 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:13.788 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:13.788 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:13.788 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:13.788 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:13.788 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:13.788 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:13.788 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:13.788 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:13.789 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:13.789 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.789 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.789 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:13.789 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.789 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:13.789 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:13.789 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.789 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:13.789 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:13.789 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:13.789 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:13.790 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:13.790 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.790 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:13.790 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:13.790 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.790 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.790 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:13.790 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:13.790 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.790 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.790 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:13.790 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:13.790 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:13.791 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:13.791 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:13.791 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.791 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.791 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:13.791 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:13.791 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:13.791 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.791 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:13.791 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.791 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:13.791 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.792 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:13.792 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.792 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:13.792 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.792 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:13.792 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:13.792 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:13.792 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:13.792 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.792 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:13.792 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.793 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:13.793 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:13.793 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:13.793 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:13.793 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:13.793 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:13.793 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:13.793 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:13.793 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:13.793 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:13.793 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:13.793 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:13.793 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:13.794 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:13.794 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:13.794 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:13.794 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:13.794 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:13.794 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:13.794 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:13.794 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:13.794 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:13.794 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:13.794 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:13.795 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:13.795 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:13.795 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:13.795 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:13.795 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:13.795 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:13.795 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:13.795 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:13.795 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:13.795 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:13.795 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:13.795 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:13.796 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:13.796 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:13.796 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:13.796 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:13.796 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.796 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.796 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:13.796 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:13.796 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.796 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:13.796 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.796 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:13.797 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:13.797 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:13.797 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:13.797 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:13.797 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:13.797 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:13.797 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:13.797 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:13.797 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:13.797 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:13.797 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:13.797 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:13.798 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.798 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:13.798 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:13.798 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:13.798 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:13.798 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:13.798 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:13.798 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:13.798 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:13.798 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:13.798 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:13.799 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:13.799 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.799 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.799 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:13.799 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:13.799 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:13.799 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:13.799 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:13.799 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.799 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.799 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:13.799 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:13.800 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:13.800 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:13.800 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:13.800 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.800 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:13.800 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:13.800 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:13.800 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:13.800 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:13.800 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:13.800 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.800 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:13.801 INFO:teuthology.orchestra.run.smithi012.stdout:_____________ ERROR at teardown of test_put_bucket_encryption_kms ______________ 2023-10-05T12:49:13.801 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.801 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:13.801 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.801 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:13.801 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:13.801 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.801 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:13.801 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:13.801 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:13.801 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:13.802 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:13.802 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.802 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:13.802 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:13.802 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.802 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.802 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:13.802 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:13.802 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.802 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.802 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:13.803 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.803 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:13.803 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:13.803 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.803 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.803 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:13.803 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:13.803 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.803 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:13.803 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:13.803 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:13.803 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:13.803 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:13.804 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:13.804 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:13.804 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.804 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:13.804 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:13.804 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:13.804 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:13.804 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:13.804 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:13.804 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:13.804 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:13.804 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:13.804 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.832 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:13.832 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:13.832 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:13.833 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:13.833 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.833 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:13.833 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:13.833 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:13.833 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:13.833 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.833 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.833 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:13.833 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:13.833 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:13.834 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:13.834 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.834 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.834 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:13.834 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:13.834 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:13.834 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.834 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:13.834 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.834 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:13.835 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:13.835 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.835 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:13.835 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:13.835 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:13.835 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:13.835 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:13.835 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:13.835 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.835 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:13.835 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.835 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:13.835 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.836 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:13.836 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:13.836 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.836 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:13.836 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.836 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:13.836 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:13.836 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:13.836 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:13.836 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:13.836 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:13.836 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:13.837 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:13.837 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:13.837 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:13.837 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:13.837 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:13.837 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:13.837 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.837 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:13.837 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:13.837 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:13.837 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:13.837 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:13.838 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:13.838 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:13.838 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:13.838 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:13.838 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:13.838 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:13.838 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.838 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.838 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:13.838 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.838 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:13.839 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:13.839 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:13.839 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:13.839 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:13.839 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:13.839 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:13.839 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:13.839 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:13.839 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:13.839 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:13.839 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:13.839 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:13.839 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:13.840 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:13.840 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:13.840 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:13.840 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:13.840 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:13.840 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:13.840 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:13.840 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:13.840 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:13.840 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:13.840 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:13.840 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:13.841 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:13.841 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:13.841 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.841 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.841 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:13.841 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.841 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:13.841 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:13.841 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.841 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:13.841 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:13.841 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:13.841 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:13.842 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:13.842 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.842 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:13.842 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:13.842 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.842 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.842 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:13.842 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:13.842 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.842 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.842 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:13.842 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:13.843 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:13.843 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:13.843 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:13.843 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.843 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.843 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:13.843 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:13.843 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:13.843 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.843 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:13.843 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.843 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:13.843 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.844 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:13.844 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.844 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:13.844 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.844 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:13.844 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:13.844 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:13.844 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:13.844 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.844 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:13.844 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.844 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:13.844 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:13.845 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:13.845 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:13.845 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:13.845 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:13.845 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:13.845 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:13.845 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:13.845 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:13.845 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:13.845 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:13.845 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:13.845 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:13.845 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:13.846 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:13.846 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:13.846 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:13.846 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:13.846 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:13.846 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:13.846 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:13.846 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:13.846 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:13.846 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:13.846 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:13.846 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:13.847 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:13.847 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:13.847 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:13.847 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:13.847 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:13.847 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:13.847 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:13.847 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:13.847 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:13.847 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:13.847 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:13.848 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:13.848 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:13.848 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.848 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.848 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:13.848 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:13.848 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.848 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:13.848 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.848 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:13.848 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:13.848 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:13.848 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:13.849 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:13.849 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:13.849 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:13.849 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:13.849 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:13.849 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:13.849 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:13.849 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:13.849 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:13.849 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.849 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:13.849 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:13.850 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:13.850 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:13.850 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:13.850 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:13.850 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:13.850 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:13.850 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:13.850 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:13.850 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:13.850 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.850 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.850 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:13.850 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:13.851 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:13.851 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:13.851 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:13.851 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.851 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.851 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:13.851 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:13.851 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:13.851 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:13.851 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:13.851 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.851 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:13.852 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:13.852 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:13.852 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:13.852 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:13.852 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:13.852 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.852 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:13.852 INFO:teuthology.orchestra.run.smithi012.stdout:_____________ ERROR at teardown of test_get_bucket_encryption_kms ______________ 2023-10-05T12:49:13.852 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.852 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:13.852 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.852 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:13.853 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:13.853 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.853 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:13.853 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:13.853 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:13.853 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:13.853 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:13.853 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.853 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:13.853 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:13.853 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.853 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.854 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:13.854 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:13.854 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.854 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.854 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:13.854 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.854 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:13.854 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:13.854 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.854 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.854 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:13.854 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:13.855 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.855 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:13.855 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:13.855 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:13.855 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:13.855 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:13.855 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:13.855 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:13.855 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.855 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:13.855 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:13.855 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:13.856 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:13.856 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:13.856 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:13.856 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:13.856 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:13.856 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:13.856 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.856 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:13.856 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:13.856 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:13.856 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:13.856 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.856 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:13.857 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:13.857 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:13.857 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:13.857 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.857 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.857 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:13.857 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:13.857 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:13.857 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:13.857 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.857 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.858 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:13.858 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:13.858 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:13.858 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.858 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:13.858 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.858 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:13.858 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:13.858 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.858 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:13.858 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:13.858 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:13.859 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:13.859 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:13.859 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:13.859 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.859 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:13.859 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.859 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:13.859 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.859 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:13.859 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:13.859 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.860 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:13.860 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.860 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:13.860 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:13.860 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:13.860 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:13.860 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:13.860 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:13.860 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:13.860 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:13.860 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:13.860 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:13.861 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:13.861 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:13.861 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:13.861 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.861 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:13.861 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:13.861 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:13.861 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:13.861 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:13.861 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:13.862 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:13.862 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:13.862 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:13.862 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:13.862 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:13.862 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.862 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.862 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:13.862 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.862 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:13.863 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:13.863 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:13.863 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:13.863 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:13.863 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:13.863 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:13.863 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:13.863 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:13.863 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:13.863 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:13.863 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:13.863 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:13.863 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:13.864 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:13.864 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:13.864 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:13.864 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:13.864 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:13.864 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:13.864 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:13.864 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:13.864 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:13.864 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:13.864 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:13.865 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:13.865 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:13.865 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:13.865 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.865 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.865 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:13.865 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.865 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:13.865 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:13.865 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.865 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:13.865 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:13.866 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:13.866 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:13.866 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:13.866 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.866 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:13.866 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:13.866 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.866 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.866 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:13.866 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:13.866 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.866 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.867 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:13.867 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:13.867 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:13.867 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:13.867 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:13.867 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.867 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.867 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:13.867 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:13.867 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:13.867 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.867 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:13.868 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.868 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:13.868 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.868 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:13.868 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.868 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:13.868 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.868 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:13.868 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:13.868 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:13.868 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:13.869 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.869 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:13.869 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.869 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:13.869 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:13.869 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:13.869 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:13.869 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:13.869 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:13.869 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:13.869 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:13.870 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:13.870 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:13.870 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:13.870 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:13.870 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:13.870 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:13.870 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:13.870 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:13.870 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:13.870 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:13.870 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:13.870 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:13.871 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:13.871 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:13.871 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:13.871 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:13.871 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:13.871 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:13.871 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:13.871 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:13.871 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:13.871 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:13.871 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:13.871 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:13.872 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:13.872 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:13.872 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:13.872 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:13.872 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:13.872 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:13.872 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:13.872 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:13.872 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.872 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.872 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:13.872 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:13.873 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.873 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:13.873 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.873 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:13.873 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:13.873 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:13.873 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:13.873 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:13.873 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:13.873 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:13.873 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:13.873 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:13.874 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:13.874 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:13.874 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:13.874 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:13.874 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.874 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:13.874 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:13.874 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:13.874 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:13.874 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:13.874 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:13.874 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:13.875 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:13.875 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:13.875 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:13.875 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:13.875 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.875 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.875 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:13.875 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:13.875 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:13.875 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:13.875 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:13.875 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.876 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.876 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:13.876 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:13.876 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:13.876 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:13.876 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:13.876 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.876 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:13.877 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:13.877 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:13.877 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:13.877 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:13.877 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:13.877 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.877 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:13.877 INFO:teuthology.orchestra.run.smithi012.stdout:____________ ERROR at teardown of test_delete_bucket_encryption_kms ____________ 2023-10-05T12:49:13.877 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.877 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:13.877 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.877 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:13.878 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:13.878 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.878 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:13.878 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:13.878 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:13.878 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:13.878 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:13.878 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.878 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:13.878 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:13.879 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.879 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.879 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:13.879 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:13.879 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.879 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.879 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:13.879 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.879 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:13.879 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:13.879 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.880 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.880 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:13.880 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:13.880 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.880 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:13.880 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:13.880 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:13.880 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:13.880 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:13.880 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:13.880 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:13.880 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.881 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:13.881 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:13.881 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:13.881 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:13.881 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:13.881 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:13.881 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:13.881 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:13.881 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:13.881 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.881 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:13.881 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:13.882 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:13.882 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:13.882 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.882 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:13.882 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:13.882 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:13.882 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:13.882 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.882 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.882 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:13.883 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:13.883 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:13.883 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:13.883 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.883 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.883 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:13.883 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:13.883 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:13.883 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.883 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:13.883 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.883 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:13.884 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:13.884 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.884 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:13.884 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:13.884 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:13.884 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:13.884 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:13.884 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:13.884 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.884 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:13.884 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.884 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:13.885 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.885 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:13.885 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:13.885 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.885 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:13.885 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.885 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:13.885 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:13.885 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:13.885 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:13.885 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:13.885 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:13.885 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:13.886 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:13.886 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:13.886 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:13.886 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:13.886 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:13.886 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:13.886 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.886 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:13.886 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:13.886 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:13.886 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:13.887 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:13.887 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:13.887 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:13.887 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:13.887 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:13.887 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:13.887 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:13.887 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.887 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.887 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:13.887 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.887 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:13.887 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:13.888 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:13.888 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:13.888 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:13.888 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:13.888 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:13.888 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:13.888 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:13.888 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:13.888 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:13.888 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:13.888 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:13.889 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:13.889 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:13.889 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:13.889 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:13.889 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:13.889 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:13.889 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:13.889 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:13.889 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:13.889 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:13.889 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:13.889 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:13.890 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:13.890 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:13.890 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:13.890 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.890 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.890 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:13.890 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.890 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:13.890 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:13.890 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.890 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:13.890 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:13.891 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:13.891 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:13.891 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:13.891 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.891 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:13.891 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:13.891 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.891 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.891 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:13.891 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:13.891 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.891 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.892 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:13.892 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:13.892 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:13.892 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:13.892 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:13.892 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.892 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.892 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:13.892 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:13.892 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:13.892 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.893 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:13.893 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.893 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:13.893 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.893 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:13.893 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.893 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:13.893 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.893 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:13.893 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:13.893 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:13.893 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:13.893 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.894 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:13.894 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.894 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:13.894 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:13.894 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:13.894 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:13.894 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:13.894 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:13.894 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:13.894 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:13.894 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:13.895 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:13.895 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:13.895 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:13.895 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:13.895 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:13.895 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:13.895 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:13.895 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:13.895 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:13.895 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:13.895 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:13.895 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:13.896 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:13.896 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:13.896 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:13.896 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:13.896 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:13.896 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:13.896 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:13.896 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:13.896 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:13.896 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:13.896 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:13.897 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:13.897 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:13.897 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:13.897 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:13.897 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:13.897 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:13.897 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:13.897 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:13.897 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.897 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.897 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:13.897 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:13.897 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.898 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:13.898 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.898 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:13.898 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:13.898 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:13.898 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:13.898 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:13.898 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:13.898 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:13.898 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:13.899 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:13.899 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:13.899 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:13.899 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:13.899 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:13.899 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.899 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:13.899 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:13.899 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:13.899 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:13.899 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:13.899 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:13.900 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:13.900 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:13.900 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:13.900 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:13.900 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:13.900 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.900 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.900 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:13.900 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:13.900 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:13.900 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:13.900 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:13.900 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.901 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.901 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:13.901 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:13.901 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:13.901 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:13.901 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:13.901 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.901 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:13.901 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:13.901 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:13.901 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:13.901 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:13.901 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:13.902 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.902 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:13.902 INFO:teuthology.orchestra.run.smithi012.stdout:_ ERROR at teardown of test_sse_kms_default_post_object_authenticated_request __ 2023-10-05T12:49:13.902 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.902 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:13.902 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.902 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:13.902 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:13.902 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.902 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:13.902 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:13.902 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:13.903 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:13.903 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:13.903 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.903 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:13.903 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:13.903 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.903 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.903 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:13.903 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:13.903 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.903 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.903 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:13.903 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.904 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:13.904 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:13.904 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.904 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.904 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:13.904 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:13.904 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.904 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:13.904 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:13.904 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:13.904 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:13.904 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:13.904 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:13.905 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:13.905 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.905 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:13.905 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:13.905 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:13.905 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:13.905 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:13.905 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:13.905 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:13.905 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:13.905 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:13.905 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.905 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:13.906 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:13.906 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:13.906 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:13.906 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.906 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:13.906 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:13.906 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:13.906 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:13.906 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.907 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.907 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:13.907 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:13.907 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:13.907 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:13.907 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.907 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.907 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:13.907 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:13.907 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:13.907 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.907 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:13.907 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.908 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:13.908 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:13.908 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.908 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:13.908 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:13.908 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:13.908 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:13.908 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:13.908 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:13.908 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.908 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:13.908 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.908 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:13.909 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.909 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:13.909 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:13.909 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.909 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:13.909 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.909 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:13.909 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:13.909 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:13.909 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:13.909 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:13.909 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:13.910 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:13.910 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:13.910 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:13.910 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:13.910 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:13.910 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:13.910 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:13.910 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.910 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:13.910 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:13.910 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:13.910 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:13.911 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:13.911 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:13.911 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:13.911 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:13.911 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:13.911 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:13.911 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:13.911 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.911 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.911 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:13.911 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.911 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:13.912 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:13.912 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:13.912 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:13.912 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:13.912 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:13.912 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:13.912 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:13.912 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:13.912 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:13.912 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:13.912 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:13.912 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:13.912 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:13.913 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:13.913 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:13.913 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:13.913 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:13.913 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:13.913 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:13.913 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:13.913 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:13.913 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:13.913 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:13.913 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:13.913 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:13.913 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:13.914 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:13.914 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.914 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.914 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:13.914 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.914 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:13.914 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:13.914 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.914 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:13.914 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:13.914 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:13.914 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:13.915 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:13.915 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.915 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:13.915 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:13.915 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.915 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.915 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:13.915 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:13.915 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.915 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.915 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:13.915 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:13.915 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:13.916 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:13.916 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:13.916 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.916 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.916 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:13.916 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:13.916 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:13.916 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.916 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:13.916 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.916 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:13.916 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.916 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:13.917 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.917 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:13.917 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.917 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:13.917 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:13.917 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:13.917 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:13.917 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.917 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:13.917 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.917 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:13.917 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:13.917 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:13.918 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:13.918 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:13.918 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:13.918 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:13.918 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:13.918 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:13.918 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:13.918 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:13.918 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:13.918 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:13.918 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:13.918 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:13.919 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:13.919 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:13.919 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:13.919 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:13.919 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:13.919 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:13.919 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:13.919 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:13.919 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:13.919 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:13.919 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:13.919 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:13.919 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:13.920 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:13.920 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:13.920 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:13.920 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:13.920 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:13.920 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:13.920 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:13.920 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:13.920 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:13.920 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:13.921 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:13.921 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:13.921 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.921 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.921 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:13.921 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:13.921 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.921 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:13.921 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.921 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:13.921 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:13.921 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:13.921 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:13.922 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:13.922 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:13.922 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:13.922 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:13.922 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:13.922 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:13.922 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:13.922 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:13.922 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:13.922 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.922 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:13.922 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:13.923 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:13.923 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:13.923 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:13.923 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:13.923 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:13.923 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:13.923 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:13.923 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:13.923 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:13.923 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.923 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.923 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:13.923 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:13.924 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:13.924 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:13.924 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:13.924 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.924 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.924 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:13.924 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:13.924 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:13.924 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:13.924 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:13.924 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.924 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:13.925 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:13.925 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:13.925 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:13.925 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:13.925 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:13.925 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.925 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:13.925 INFO:teuthology.orchestra.run.smithi012.stdout:_________________ ERROR at teardown of test_get_object_torrent _________________ 2023-10-05T12:49:13.925 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.925 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:13.925 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.925 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:13.925 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:13.926 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.926 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:13.926 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:13.926 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:13.926 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:13.926 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:13.926 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.926 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:13.926 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:13.926 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.926 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.926 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:13.927 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:13.927 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.927 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.927 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:13.927 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.927 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:13.927 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:13.927 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.927 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.927 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:13.927 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:13.927 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.927 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:13.928 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:13.928 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:13.928 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:13.928 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:13.928 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:13.928 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:13.928 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.928 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:13.928 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:13.928 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:13.928 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:13.928 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:13.928 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:13.929 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:13.929 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:13.929 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:13.929 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.929 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:13.929 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:13.929 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:13.929 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:13.929 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.929 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:13.929 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:13.929 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:13.929 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:13.930 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.930 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.930 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:13.930 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:13.930 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:13.930 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:13.930 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.930 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.930 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:13.930 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:13.930 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:13.930 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.930 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:13.931 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.931 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:13.931 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:13.931 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.931 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:13.931 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:13.931 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:13.931 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:13.931 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:13.931 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:13.931 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.931 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:13.931 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.932 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:13.932 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.932 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:13.932 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:13.932 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.932 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:13.932 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.932 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:13.932 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:13.932 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:13.932 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:13.932 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:13.932 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:13.933 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:13.933 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:13.933 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:13.933 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:13.933 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:13.933 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:13.933 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:13.933 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.933 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:13.933 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:13.933 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:13.933 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:13.933 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:13.934 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:13.934 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:13.934 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:13.934 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:13.934 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:13.934 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:13.934 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.934 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.934 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:13.934 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.935 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:13.935 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:13.935 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:13.935 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:13.935 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:13.935 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:13.935 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:13.935 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:13.935 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:13.935 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:13.935 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:13.935 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:13.936 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:13.936 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:13.936 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:13.936 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:13.936 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:13.936 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:13.936 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:13.936 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:13.936 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:13.936 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:13.936 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:13.936 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:13.937 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:13.937 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:13.937 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:13.937 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:13.937 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.937 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.937 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:13.937 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.937 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:13.937 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:13.937 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.938 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:13.938 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:13.938 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:13.938 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:13.938 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:13.938 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.938 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:13.938 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:13.938 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.938 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.938 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:13.939 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:13.939 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.939 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.939 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:13.939 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:13.939 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:13.939 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:13.939 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:13.939 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.939 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.939 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:13.939 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:13.940 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:13.940 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.940 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:13.940 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.940 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:13.940 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.940 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:13.940 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.940 INFO:teuthology.orchestra.run.smithi012.stdout:configfile = 2023-10-05T12:49:13.940 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.940 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(autouse=True) 2023-10-05T12:49:13.940 INFO:teuthology.orchestra.run.smithi012.stdout: def setup_teardown(configfile): 2023-10-05T12:49:13.940 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:13.941 INFO:teuthology.orchestra.run.smithi012.stdout:> teardown() 2023-10-05T12:49:13.941 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.941 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:315: 2023-10-05T12:49:13.941 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.941 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-10-05T12:49:13.941 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:13.941 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:13.941 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:13.941 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:13.941 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:13.941 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:13.941 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:13.941 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:13.941 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:13.942 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:13.942 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:13.942 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:13.942 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:13.942 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:13.942 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:13.942 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:13.942 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:13.942 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:13.942 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:13.942 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:13.942 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:13.943 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:13.943 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:13.943 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:13.943 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:13.943 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:13.943 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:13.943 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:13.943 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:13.943 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:13.943 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:13.943 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:13.943 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:13.943 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:13.944 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:13.944 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:13.944 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:13.944 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:13.944 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:13.944 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.944 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.944 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:13.944 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:13.944 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.944 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:13.944 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.944 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:13.945 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:13.945 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:13.945 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:13.945 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:13.945 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:13.945 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:13.945 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:13.945 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:13.945 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:13.945 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:13.945 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:13.945 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:13.945 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.946 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:13.946 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:13.946 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:13.946 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:13.946 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:13.946 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:13.946 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:13.946 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:13.946 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:13.946 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:13.946 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:13.946 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.947 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.947 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:13.947 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:13.947 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:13.947 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:13.947 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:13.947 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.947 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.947 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:13.947 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:13.947 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:13.947 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:13.948 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:13.948 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.948 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:13.948 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:13.948 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:13.948 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:13.948 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:13.948 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:13.948 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.948 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:13.948 INFO:teuthology.orchestra.run.smithi012.stdout:_________________ ERROR at setup of test_generate_where_clause _________________ 2023-10-05T12:49:13.949 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.949 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:13.949 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.949 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:13.949 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:13.949 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.949 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:13.949 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:13.949 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:13.949 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:13.949 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:13.949 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.949 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:13.950 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:13.950 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.950 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.950 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:13.950 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:13.950 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.950 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.950 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:13.950 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.950 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:13.950 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:13.950 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.951 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.951 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:13.951 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:13.951 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.951 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:13.951 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:13.951 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:13.951 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:13.951 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:13.951 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:13.951 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:13.951 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.952 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:13.952 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:13.952 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:13.952 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:13.952 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:13.952 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:13.952 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:13.952 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:13.952 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:13.952 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.952 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:13.952 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:13.953 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:13.953 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:13.953 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.953 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:13.953 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:13.953 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:13.953 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:13.953 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.953 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.953 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:13.953 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:13.953 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:13.954 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:13.954 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.954 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.954 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:13.954 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:13.954 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:13.954 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.954 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:13.954 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.954 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:13.954 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:13.954 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.955 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:13.955 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:13.955 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:13.955 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:13.955 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:13.955 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:13.955 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.955 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:13.955 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.955 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:13.955 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.955 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:13.956 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:13.956 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.956 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:13.956 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.956 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:13.956 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:13.956 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:13.956 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:13.956 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:13.956 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:13.956 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:13.956 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:13.957 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:13.957 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:13.957 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:13.957 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:13.957 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:13.957 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.957 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:13.957 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:13.957 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:13.957 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:13.958 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:13.958 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:13.958 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:13.958 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:13.958 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:13.958 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:13.958 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:13.958 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.958 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.958 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:13.958 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.959 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:13.959 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:13.959 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:13.959 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:13.959 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:13.959 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:13.959 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:13.959 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:13.959 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:13.959 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:13.959 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:13.960 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:13.960 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:13.960 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:13.960 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:13.960 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:13.960 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:13.960 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:13.960 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:13.960 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:13.960 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:13.960 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:13.960 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:13.961 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:13.961 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:13.961 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:13.961 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:13.961 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:13.961 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.961 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.961 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:13.961 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.961 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:13.961 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:13.962 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.962 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:13.962 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:13.962 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:13.962 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:13.962 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:13.962 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.962 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:13.962 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:13.962 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.962 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.962 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:13.963 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:13.963 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.963 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.963 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:13.963 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:13.963 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:13.963 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:13.963 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:13.963 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.964 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.964 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:13.964 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:13.964 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:13.964 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.964 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:13.964 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.964 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:13.964 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.964 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:13.964 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.965 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(scope="package") 2023-10-05T12:49:13.965 INFO:teuthology.orchestra.run.smithi012.stdout: def configfile(): 2023-10-05T12:49:13.965 INFO:teuthology.orchestra.run.smithi012.stdout:> setup() 2023-10-05T12:49:13.965 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.965 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:309: 2023-10-05T12:49:13.965 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.965 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:272: in setup 2023-10-05T12:49:13.965 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:13.965 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:13.965 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:13.965 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:13.965 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:13.966 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:13.966 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:13.966 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:13.966 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:13.966 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:13.966 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:13.966 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:13.966 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:13.966 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:13.966 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:13.967 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:13.967 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:13.967 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:13.967 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:13.967 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:13.967 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:13.967 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:13.967 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:13.967 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:13.967 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:13.967 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:13.967 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:13.968 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:13.968 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:13.968 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:13.968 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:13.968 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:13.968 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:13.968 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:13.968 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:13.968 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:13.968 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:13.968 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:13.969 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:13.969 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.969 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.969 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:13.969 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:13.969 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.969 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:13.969 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.969 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:13.969 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:13.969 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:13.969 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:13.970 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:13.970 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:13.970 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:13.970 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:13.970 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:13.970 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:13.970 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:13.970 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:13.970 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:13.970 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.970 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:13.971 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:13.971 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:13.971 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:13.971 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:13.971 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:13.971 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:13.971 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:13.971 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:13.971 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:13.971 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:13.971 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.971 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.971 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:13.972 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:13.972 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:13.972 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:13.972 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:13.972 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.972 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.972 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:13.972 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:13.972 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:13.972 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:13.972 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:13.972 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.973 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:13.973 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:13.973 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:13.973 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:13.973 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:13.973 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:13.973 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.973 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:13.973 INFO:teuthology.orchestra.run.smithi012.stdout:__________________ ERROR at setup of test_generate_projection __________________ 2023-10-05T12:49:13.973 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.973 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:13.974 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.974 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:13.974 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:13.974 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.974 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:13.974 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:13.974 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:13.974 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:13.974 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:13.974 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.974 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:13.974 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:13.975 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.975 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.975 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:13.975 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:13.975 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.975 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.975 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:13.975 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.975 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:13.975 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:13.975 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.975 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.976 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:13.976 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:13.976 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.976 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:13.976 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:13.976 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:13.976 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:13.976 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:13.976 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:13.976 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:13.976 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.976 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:13.977 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:13.977 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:13.977 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:13.977 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:13.977 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:13.977 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:13.977 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:13.977 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:13.977 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.977 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:13.977 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:13.977 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:13.977 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:13.978 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.978 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:13.978 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:13.978 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:13.978 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:13.978 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.978 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.978 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:13.978 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:13.978 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:13.979 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:13.979 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.979 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.979 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:13.979 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:13.979 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:13.979 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.979 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:13.979 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.979 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:13.979 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:13.980 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.980 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:13.980 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:13.980 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:13.980 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:13.980 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:13.980 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:13.980 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.980 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:13.980 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.980 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:13.980 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.980 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:13.981 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:13.981 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.981 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:13.981 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.981 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:13.981 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:13.981 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:13.981 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:13.981 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:13.981 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:13.981 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:13.981 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:13.981 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:13.982 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:13.982 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:13.982 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:13.982 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:13.982 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.982 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:13.982 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:13.982 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:13.982 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:13.982 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:13.982 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:13.982 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:13.983 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:13.983 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:13.983 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:13.983 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:13.983 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.983 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.983 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:13.983 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.983 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:13.983 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:13.983 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:13.983 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:13.983 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:13.984 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:13.984 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:13.984 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:13.984 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:13.984 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:13.984 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:13.984 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:13.984 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:13.984 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:13.984 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:13.984 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:13.984 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:13.984 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:13.985 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:13.985 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:13.985 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:13.985 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:13.985 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:13.985 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:13.985 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:13.985 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:13.985 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:13.985 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:13.985 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.985 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.985 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:13.986 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.986 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:13.986 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:13.986 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.986 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:13.986 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:13.986 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:13.986 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:13.986 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:13.986 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.986 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:13.986 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:13.987 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.987 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.987 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:13.987 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:13.987 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.987 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.987 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:13.987 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:13.987 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:13.987 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:13.987 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:13.987 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.987 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.988 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:13.988 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:13.988 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:13.988 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.988 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:13.988 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.988 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:13.988 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.988 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:13.988 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.988 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(scope="package") 2023-10-05T12:49:13.988 INFO:teuthology.orchestra.run.smithi012.stdout: def configfile(): 2023-10-05T12:49:13.989 INFO:teuthology.orchestra.run.smithi012.stdout:> setup() 2023-10-05T12:49:13.989 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.989 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:309: 2023-10-05T12:49:13.989 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.989 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:272: in setup 2023-10-05T12:49:13.989 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:13.989 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:13.989 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:13.989 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:13.989 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:13.989 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:13.989 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:13.989 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:13.990 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:13.990 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:13.990 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:13.990 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:13.990 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:13.990 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:13.990 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:13.990 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:13.990 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:13.990 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:13.990 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:13.990 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:13.991 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:13.991 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:13.991 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:13.991 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:13.991 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:13.991 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:13.991 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:13.991 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:13.991 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:13.991 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:13.991 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:13.991 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:13.992 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:13.992 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:13.992 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:13.992 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:13.992 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:13.992 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:13.992 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:13.992 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.992 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.992 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:13.993 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:13.993 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.993 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:13.993 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.993 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:13.993 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:13.993 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:13.993 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:13.993 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:13.993 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:13.993 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:13.993 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:13.994 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:13.994 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:13.994 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:13.994 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:13.994 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:13.994 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.994 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:13.994 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:13.994 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:13.994 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:13.994 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:13.995 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:13.995 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:13.995 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:13.995 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:13.995 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:13.995 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:13.995 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.995 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.995 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:13.995 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:13.995 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:13.995 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:13.995 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:13.996 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.996 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.996 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:13.996 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:13.996 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:13.996 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:13.996 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:13.996 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.996 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:13.996 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:13.996 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:13.996 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:13.996 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:13.997 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:13.997 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.997 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:13.997 INFO:teuthology.orchestra.run.smithi012.stdout:____________________ ERROR at setup of test_count_operation ____________________ 2023-10-05T12:49:13.997 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.997 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:13.997 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.997 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:13.997 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:13.997 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.997 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:13.997 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:13.998 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:13.998 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:13.998 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:13.998 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.998 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:13.998 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:13.998 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.998 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:13.998 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:13.998 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:13.999 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:13.999 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.999 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:13.999 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.999 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:13.999 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:13.999 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:13.999 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.999 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:13.999 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:13.999 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:13.999 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:13.999 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:14.000 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:14.000 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:14.000 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:14.000 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:14.000 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:14.000 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.000 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:14.000 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:14.000 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:14.000 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:14.000 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:14.000 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:14.001 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:14.001 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:14.001 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:14.001 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.001 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:14.001 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:14.001 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:14.001 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:14.001 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.001 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:14.001 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:14.001 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:14.001 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:14.002 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.002 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.002 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:14.002 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:14.002 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:14.002 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:14.002 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.002 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.002 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:14.002 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:14.003 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:14.003 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.003 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:14.003 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.003 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:14.003 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:14.003 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.003 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:14.003 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:14.003 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:14.003 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:14.003 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:14.003 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:14.003 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.004 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:14.004 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.004 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:14.004 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.004 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:14.004 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:14.004 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.004 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:14.004 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.004 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:14.004 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:14.004 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:14.005 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:14.005 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:14.005 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:14.005 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:14.005 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:14.005 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:14.005 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:14.005 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:14.005 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:14.005 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:14.005 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.005 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:14.005 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:14.006 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:14.006 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:14.006 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:14.006 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:14.006 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:14.006 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:14.006 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:14.006 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:14.006 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:14.006 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.006 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.007 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:14.007 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.007 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:14.007 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:14.007 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:14.007 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:14.007 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:14.007 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:14.007 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:14.007 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:14.007 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:14.007 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:14.008 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:14.008 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:14.008 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:14.008 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:14.008 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:14.008 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:14.008 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:14.008 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:14.008 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:14.008 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:14.008 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:14.008 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:14.009 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:14.009 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:14.009 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:14.009 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:14.009 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:14.009 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:14.009 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.009 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.009 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:14.009 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.009 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:14.009 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:14.010 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.010 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:14.010 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:14.010 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:14.010 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:14.010 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:14.010 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.010 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:14.010 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:14.010 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.010 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.010 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:14.011 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:14.011 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.011 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.011 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:14.011 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:14.011 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:14.011 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:14.011 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:14.011 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.011 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.011 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:14.012 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:14.012 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:14.012 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.012 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:14.012 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.012 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:14.012 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.012 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:14.012 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.012 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(scope="package") 2023-10-05T12:49:14.012 INFO:teuthology.orchestra.run.smithi012.stdout: def configfile(): 2023-10-05T12:49:14.012 INFO:teuthology.orchestra.run.smithi012.stdout:> setup() 2023-10-05T12:49:14.013 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.013 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:309: 2023-10-05T12:49:14.013 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.013 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:272: in setup 2023-10-05T12:49:14.013 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:14.013 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:14.013 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:14.013 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:14.013 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:14.013 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:14.013 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:14.013 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:14.013 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:14.014 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:14.014 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:14.014 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:14.014 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:14.014 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:14.014 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:14.014 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:14.014 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:14.014 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:14.014 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:14.014 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:14.014 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:14.015 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:14.015 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:14.015 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:14.015 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:14.015 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:14.015 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:14.015 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:14.015 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:14.015 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:14.015 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:14.015 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:14.015 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:14.016 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:14.016 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:14.016 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:14.016 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:14.016 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:14.016 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:14.016 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.016 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.016 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:14.016 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:14.016 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.017 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:14.017 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.017 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:14.017 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:14.017 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:14.017 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:14.017 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:14.017 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:14.017 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:14.017 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:14.017 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:14.017 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:14.018 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:14.018 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:14.018 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:14.018 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.018 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:14.018 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:14.018 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:14.018 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:14.018 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:14.018 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:14.019 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:14.019 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:14.019 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:14.019 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:14.019 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:14.019 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.019 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.019 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:14.019 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:14.019 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:14.019 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:14.019 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:14.019 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.020 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.020 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:14.020 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:14.020 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:14.020 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:14.020 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:14.020 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.020 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:14.020 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:14.020 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:14.020 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:14.020 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:14.021 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:14.021 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.021 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:14.021 INFO:teuthology.orchestra.run.smithi012.stdout:_________________ ERROR at setup of test_count_json_operation __________________ 2023-10-05T12:49:14.021 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.021 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:14.021 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.021 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:14.021 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:14.021 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.021 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:14.021 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:14.022 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:14.022 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:14.022 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:14.022 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.022 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:14.022 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:14.022 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.022 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.022 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:14.022 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:14.022 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.022 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.023 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:14.023 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.023 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:14.023 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:14.023 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.023 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.023 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:14.023 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:14.023 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.023 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:14.023 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:14.023 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:14.023 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:14.024 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:14.024 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:14.024 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:14.024 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.024 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:14.024 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:14.024 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:14.024 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:14.024 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:14.024 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:14.024 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:14.024 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:14.024 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:14.025 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.025 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:14.025 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:14.025 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:14.025 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:14.025 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.025 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:14.025 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:14.025 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:14.025 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:14.025 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.026 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.026 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:14.026 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:14.026 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:14.026 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:14.026 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.026 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.026 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:14.026 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:14.026 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:14.026 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.027 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:14.027 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.027 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:14.027 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:14.027 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.027 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:14.027 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:14.027 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:14.027 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:14.027 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:14.027 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:14.027 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.028 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:14.028 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.028 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:14.028 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.028 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:14.028 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:14.028 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.028 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:14.028 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.028 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:14.028 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:14.029 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:14.029 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:14.029 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:14.029 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:14.029 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:14.029 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:14.029 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:14.029 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:14.029 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:14.029 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:14.029 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:14.030 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.030 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:14.030 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:14.030 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:14.030 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:14.030 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:14.030 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:14.030 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:14.030 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:14.030 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:14.030 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:14.031 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:14.031 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.031 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.031 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:14.031 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.031 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:14.031 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:14.031 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:14.031 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:14.031 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:14.031 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:14.031 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:14.032 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:14.032 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:14.032 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:14.032 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:14.032 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:14.032 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:14.032 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:14.032 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:14.032 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:14.032 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:14.032 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:14.032 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:14.033 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:14.033 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:14.033 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:14.033 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:14.033 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:14.033 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:14.033 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:14.033 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:14.033 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:14.033 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.033 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.033 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:14.034 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.034 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:14.034 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:14.034 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.034 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:14.034 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:14.034 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:14.034 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:14.034 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:14.034 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.034 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:14.035 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:14.035 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.035 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.035 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:14.035 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:14.035 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.035 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.035 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:14.035 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:14.035 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:14.035 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:14.035 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:14.035 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.036 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.036 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:14.036 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:14.036 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:14.036 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.036 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:14.036 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.036 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:14.036 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.036 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:14.037 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.037 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(scope="package") 2023-10-05T12:49:14.037 INFO:teuthology.orchestra.run.smithi012.stdout: def configfile(): 2023-10-05T12:49:14.037 INFO:teuthology.orchestra.run.smithi012.stdout:> setup() 2023-10-05T12:49:14.037 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.037 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:309: 2023-10-05T12:49:14.037 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.037 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:272: in setup 2023-10-05T12:49:14.037 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:14.037 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:14.037 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:14.038 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:14.038 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:14.038 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:14.038 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:14.038 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:14.038 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:14.038 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:14.038 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:14.038 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:14.038 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:14.038 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:14.039 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:14.039 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:14.039 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:14.039 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:14.039 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:14.039 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:14.039 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:14.039 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:14.039 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:14.039 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:14.039 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:14.039 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:14.040 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:14.040 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:14.040 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:14.040 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:14.040 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:14.040 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:14.040 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:14.040 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:14.040 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:14.040 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:14.040 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:14.040 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:14.041 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:14.041 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.041 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.041 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:14.041 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:14.041 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.041 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:14.041 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.041 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:14.041 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:14.041 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:14.041 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:14.041 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:14.042 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:14.042 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:14.042 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:14.042 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:14.042 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:14.042 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:14.042 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:14.042 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:14.042 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.042 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:14.042 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:14.042 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:14.043 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:14.043 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:14.043 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:14.043 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:14.043 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:14.043 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:14.043 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:14.043 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:14.043 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.043 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.043 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:14.043 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:14.044 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:14.044 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:14.044 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:14.044 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.044 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.044 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:14.044 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:14.044 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:14.044 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:14.044 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:14.044 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.044 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:14.044 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:14.045 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:14.045 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:14.045 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:14.045 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:14.045 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.045 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:14.045 INFO:teuthology.orchestra.run.smithi012.stdout:________________ ERROR at setup of test_json_column_sum_min_max ________________ 2023-10-05T12:49:14.045 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.045 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:14.045 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.045 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:14.046 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:14.046 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.046 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:14.046 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:14.046 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:14.046 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:14.046 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:14.046 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.046 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:14.046 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:14.046 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.046 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.047 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:14.047 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:14.047 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.047 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.047 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:14.047 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.047 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:14.047 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:14.047 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.047 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.047 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:14.048 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:14.048 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.048 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:14.048 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:14.048 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:14.048 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:14.048 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:14.048 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:14.048 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:14.048 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.048 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:14.049 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:14.049 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:14.049 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:14.049 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:14.049 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:14.049 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:14.049 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:14.049 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:14.049 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.049 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:14.049 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:14.049 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:14.050 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:14.050 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.050 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:14.050 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:14.050 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:14.050 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:14.050 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.050 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.050 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:14.050 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:14.050 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:14.051 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:14.051 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.051 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.051 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:14.051 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:14.051 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:14.051 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.051 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:14.051 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.051 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:14.052 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:14.052 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.052 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:14.052 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:14.052 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:14.052 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:14.052 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:14.052 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:14.052 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.052 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:14.052 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.053 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:14.053 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.053 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:14.053 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:14.053 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.053 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:14.053 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.053 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:14.053 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:14.053 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:14.053 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:14.054 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:14.054 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:14.054 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:14.054 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:14.054 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:14.054 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:14.054 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:14.054 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:14.054 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:14.054 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.054 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:14.055 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:14.055 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:14.055 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:14.055 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:14.055 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:14.055 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:14.055 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:14.055 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:14.055 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:14.055 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:14.055 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.055 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.056 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:14.056 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.056 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:14.056 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:14.056 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:14.056 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:14.056 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:14.056 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:14.056 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:14.056 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:14.056 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:14.056 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:14.056 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:14.057 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:14.057 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:14.057 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:14.057 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:14.057 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:14.057 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:14.057 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:14.057 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:14.057 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:14.057 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:14.057 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:14.057 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:14.057 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:14.058 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:14.058 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:14.058 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:14.058 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:14.058 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.058 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.058 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:14.058 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.058 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:14.059 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:14.059 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.059 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:14.059 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:14.059 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:14.059 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:14.059 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:14.059 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.059 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:14.059 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:14.059 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.059 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.060 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:14.060 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:14.060 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.060 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.060 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:14.060 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:14.060 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:14.060 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:14.060 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:14.060 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.060 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.060 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:14.061 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:14.061 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:14.061 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.061 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:14.061 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.061 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:14.061 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.061 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:14.061 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.061 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(scope="package") 2023-10-05T12:49:14.061 INFO:teuthology.orchestra.run.smithi012.stdout: def configfile(): 2023-10-05T12:49:14.062 INFO:teuthology.orchestra.run.smithi012.stdout:> setup() 2023-10-05T12:49:14.062 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.062 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:309: 2023-10-05T12:49:14.062 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.062 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:272: in setup 2023-10-05T12:49:14.062 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:14.062 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:14.062 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:14.062 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:14.062 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:14.062 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:14.063 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:14.063 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:14.063 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:14.063 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:14.063 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:14.063 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:14.063 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:14.063 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:14.063 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:14.063 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:14.063 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:14.064 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:14.064 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:14.064 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:14.064 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:14.064 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:14.064 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:14.064 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:14.064 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:14.064 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:14.064 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:14.064 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:14.064 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:14.064 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:14.065 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:14.065 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:14.065 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:14.065 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:14.065 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:14.065 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:14.065 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:14.065 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:14.065 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:14.065 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.066 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.066 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:14.066 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:14.066 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.066 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:14.066 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.066 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:14.066 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:14.066 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:14.066 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:14.066 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:14.067 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:14.067 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:14.067 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:14.067 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:14.067 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:14.067 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:14.067 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:14.067 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:14.067 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.067 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:14.067 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:14.067 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:14.068 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:14.068 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:14.068 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:14.068 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:14.068 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:14.068 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:14.068 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:14.068 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:14.068 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.068 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.068 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:14.068 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:14.069 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:14.069 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:14.069 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:14.069 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.069 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.069 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:14.069 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:14.069 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:14.069 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:14.069 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:14.069 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.070 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:14.070 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:14.070 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:14.070 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:14.070 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:14.070 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:14.070 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.070 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:14.070 INFO:teuthology.orchestra.run.smithi012.stdout:________________ ERROR at setup of test_json_nullif_expressions ________________ 2023-10-05T12:49:14.070 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.070 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:14.071 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.071 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:14.071 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:14.071 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.071 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:14.071 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:14.071 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:14.071 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:14.071 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:14.071 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.071 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:14.071 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:14.071 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.072 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.072 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:14.072 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:14.072 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.072 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.072 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:14.072 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.072 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:14.072 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:14.072 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.072 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.072 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:14.073 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:14.073 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.073 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:14.073 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:14.073 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:14.073 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:14.073 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:14.073 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:14.073 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:14.073 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.073 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:14.073 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:14.073 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:14.074 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:14.074 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:14.074 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:14.074 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:14.074 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:14.074 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:14.074 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.074 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:14.074 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:14.074 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:14.074 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:14.074 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.074 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:14.075 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:14.075 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:14.075 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:14.075 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.075 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.075 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:14.075 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:14.075 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:14.075 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:14.075 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.075 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.075 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:14.076 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:14.076 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:14.076 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.076 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:14.076 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.076 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:14.076 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:14.076 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.076 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:14.076 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:14.076 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:14.076 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:14.077 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:14.077 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:14.077 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.077 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:14.077 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.077 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:14.077 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.077 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:14.077 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:14.077 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.077 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:14.077 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.077 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:14.078 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:14.078 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:14.078 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:14.078 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:14.078 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:14.078 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:14.078 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:14.078 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:14.078 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:14.078 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:14.078 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:14.079 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:14.079 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.079 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:14.079 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:14.079 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:14.079 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:14.079 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:14.079 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:14.079 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:14.079 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:14.079 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:14.080 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:14.080 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:14.080 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.080 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.080 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:14.080 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.080 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:14.080 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:14.080 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:14.080 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:14.080 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:14.080 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:14.081 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:14.081 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:14.081 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:14.081 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:14.081 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:14.081 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:14.081 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:14.081 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:14.081 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:14.081 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:14.081 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:14.081 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:14.081 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:14.082 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:14.082 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:14.082 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:14.082 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:14.082 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:14.082 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:14.082 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:14.082 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:14.082 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:14.082 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.082 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.082 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:14.083 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.083 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:14.083 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:14.083 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.083 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:14.083 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:14.083 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:14.083 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:14.083 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:14.083 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.083 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:14.083 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:14.083 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.084 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.084 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:14.084 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:14.084 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.084 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.084 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:14.084 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:14.084 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:14.084 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:14.084 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:14.084 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.084 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.084 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:14.085 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:14.085 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:14.085 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.085 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:14.085 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.085 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:14.085 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.085 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:14.085 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.085 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(scope="package") 2023-10-05T12:49:14.085 INFO:teuthology.orchestra.run.smithi012.stdout: def configfile(): 2023-10-05T12:49:14.085 INFO:teuthology.orchestra.run.smithi012.stdout:> setup() 2023-10-05T12:49:14.085 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.086 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:309: 2023-10-05T12:49:14.086 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.086 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:272: in setup 2023-10-05T12:49:14.086 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:14.086 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:14.086 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:14.086 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:14.086 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:14.086 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:14.086 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:14.086 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:14.086 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:14.087 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:14.087 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:14.087 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:14.087 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:14.087 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:14.087 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:14.087 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:14.087 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:14.087 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:14.087 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:14.087 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:14.088 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:14.088 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:14.088 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:14.088 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:14.088 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:14.088 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:14.088 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:14.088 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:14.088 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:14.088 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:14.088 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:14.089 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:14.089 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:14.089 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:14.089 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:14.089 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:14.089 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:14.089 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:14.089 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:14.089 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.089 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.089 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:14.089 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:14.090 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.090 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:14.090 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.090 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:14.090 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:14.090 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:14.090 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:14.090 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:14.090 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:14.090 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:14.090 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:14.090 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:14.090 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:14.091 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:14.091 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:14.091 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:14.091 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.091 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:14.091 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:14.091 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:14.091 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:14.091 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:14.091 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:14.091 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:14.091 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:14.092 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:14.092 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:14.092 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:14.092 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.092 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.092 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:14.092 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:14.092 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:14.092 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:14.092 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:14.092 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.092 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.093 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:14.093 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:14.093 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:14.093 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:14.093 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:14.093 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.093 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:14.093 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:14.093 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:14.093 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:14.093 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:14.093 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:14.093 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.094 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:14.094 INFO:teuthology.orchestra.run.smithi012.stdout:__________________ ERROR at setup of test_column_sum_min_max ___________________ 2023-10-05T12:49:14.094 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.094 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:14.094 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.094 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:14.094 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:14.094 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.094 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:14.094 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:14.094 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:14.095 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:14.095 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:14.095 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.095 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:14.095 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:14.095 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.095 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.095 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:14.095 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:14.095 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.095 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.096 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:14.096 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.096 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:14.096 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:14.096 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.096 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.096 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:14.096 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:14.096 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.096 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:14.096 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:14.096 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:14.096 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:14.097 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:14.097 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:14.097 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:14.097 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.097 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:14.097 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:14.097 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:14.097 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:14.097 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:14.097 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:14.097 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:14.097 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:14.097 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:14.098 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.098 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:14.098 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:14.098 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:14.098 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:14.098 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.098 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:14.098 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:14.098 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:14.098 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:14.098 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.099 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.099 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:14.099 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:14.099 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:14.099 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:14.099 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.099 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.099 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:14.099 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:14.099 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:14.099 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.100 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:14.100 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.100 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:14.100 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:14.100 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.100 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:14.100 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:14.100 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:14.100 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:14.100 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:14.100 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:14.100 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.100 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:14.101 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.101 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:14.101 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.101 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:14.101 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:14.101 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.101 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:14.101 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.101 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:14.101 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:14.101 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:14.101 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:14.101 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:14.101 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:14.102 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:14.102 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:14.102 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:14.102 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:14.102 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:14.102 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:14.102 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:14.102 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.102 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:14.102 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:14.102 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:14.105 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:14.105 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:14.105 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:14.106 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:14.106 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:14.106 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:14.106 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:14.106 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:14.106 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.106 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.106 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:14.106 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.106 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:14.106 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:14.106 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:14.107 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:14.107 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:14.107 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:14.107 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:14.107 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:14.107 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:14.107 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:14.107 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:14.107 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:14.107 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:14.107 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:14.108 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:14.108 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:14.108 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:14.108 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:14.108 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:14.108 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:14.108 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:14.108 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:14.108 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:14.108 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:14.108 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:14.108 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:14.109 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:14.109 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:14.109 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.109 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.109 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:14.109 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.109 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:14.109 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:14.109 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.109 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:14.109 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:14.109 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:14.110 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:14.110 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:14.110 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.110 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:14.110 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:14.110 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.110 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.110 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:14.110 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:14.110 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.110 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.111 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:14.111 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:14.111 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:14.111 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:14.111 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:14.111 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.111 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.111 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:14.111 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:14.111 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:14.111 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.111 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:14.111 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.112 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:14.112 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.112 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:14.112 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.112 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(scope="package") 2023-10-05T12:49:14.112 INFO:teuthology.orchestra.run.smithi012.stdout: def configfile(): 2023-10-05T12:49:14.112 INFO:teuthology.orchestra.run.smithi012.stdout:> setup() 2023-10-05T12:49:14.112 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.112 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:309: 2023-10-05T12:49:14.113 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.113 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:272: in setup 2023-10-05T12:49:14.113 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:14.113 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:14.113 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:14.113 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:14.113 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:14.113 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:14.113 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:14.113 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:14.113 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:14.114 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:14.114 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:14.114 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:14.114 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:14.114 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:14.114 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:14.114 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:14.114 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:14.114 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:14.114 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:14.114 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:14.114 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:14.114 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:14.115 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:14.115 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:14.115 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:14.115 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:14.115 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:14.115 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:14.115 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:14.115 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:14.115 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:14.115 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:14.115 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:14.116 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:14.116 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:14.116 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:14.116 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:14.116 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:14.116 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:14.116 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.116 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.116 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:14.116 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:14.116 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.116 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:14.117 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.117 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:14.117 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:14.117 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:14.117 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:14.117 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:14.117 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:14.117 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:14.117 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:14.117 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:14.117 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:14.117 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:14.117 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:14.118 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:14.118 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.118 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:14.118 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:14.118 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:14.118 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:14.118 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:14.118 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:14.118 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:14.118 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:14.118 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:14.119 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:14.119 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:14.119 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.119 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.119 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:14.119 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:14.119 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:14.119 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:14.119 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:14.119 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.119 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.119 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:14.120 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:14.120 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:14.120 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:14.120 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:14.120 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.120 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:14.120 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:14.120 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:14.120 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:14.120 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:14.120 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:14.120 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.121 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:14.121 INFO:teuthology.orchestra.run.smithi012.stdout:__________________ ERROR at setup of test_nullif_expressions ___________________ 2023-10-05T12:49:14.121 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.121 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:14.121 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.121 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:14.121 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:14.121 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.121 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:14.121 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:14.121 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:14.121 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:14.122 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:14.122 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.122 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:14.122 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:14.122 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.122 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.122 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:14.122 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:14.122 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.122 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.122 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:14.122 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.123 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:14.123 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:14.123 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.123 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.123 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:14.123 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:14.123 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.123 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:14.123 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:14.123 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:14.123 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:14.123 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:14.123 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:14.124 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:14.124 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.124 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:14.124 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:14.124 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:14.124 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:14.124 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:14.124 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:14.124 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:14.124 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:14.124 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:14.124 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.125 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:14.125 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:14.125 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:14.125 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:14.125 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.125 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:14.125 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:14.125 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:14.125 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:14.125 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.125 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.125 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:14.125 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:14.126 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:14.126 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:14.126 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.126 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.126 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:14.126 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:14.126 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:14.126 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.126 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:14.126 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.126 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:14.127 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:14.127 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.127 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:14.127 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:14.127 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:14.127 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:14.127 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:14.127 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:14.127 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.127 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:14.127 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.127 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:14.127 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.128 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:14.128 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:14.128 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.128 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:14.128 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.128 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:14.128 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:14.128 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:14.128 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:14.128 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:14.128 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:14.129 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:14.129 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:14.129 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:14.129 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:14.129 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:14.129 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:14.129 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:14.129 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.129 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:14.129 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:14.129 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:14.129 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:14.130 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:14.130 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:14.130 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:14.130 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:14.130 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:14.130 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:14.130 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:14.130 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.130 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.130 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:14.130 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.130 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:14.131 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:14.131 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:14.131 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:14.131 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:14.131 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:14.131 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:14.131 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:14.131 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:14.131 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:14.131 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:14.131 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:14.131 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:14.132 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:14.132 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:14.132 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:14.132 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:14.132 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:14.132 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:14.132 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:14.132 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:14.132 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:14.132 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:14.132 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:14.132 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:14.133 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:14.133 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:14.133 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:14.133 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.133 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.133 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:14.133 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.133 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:14.133 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:14.133 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.133 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:14.133 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:14.133 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:14.134 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:14.134 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:14.134 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.134 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:14.134 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:14.134 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.134 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.134 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:14.134 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:14.134 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.134 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.134 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:14.134 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:14.135 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:14.135 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:14.135 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:14.135 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.135 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.135 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:14.135 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:14.135 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:14.135 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.135 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:14.135 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.135 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:14.135 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.136 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:14.136 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.136 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(scope="package") 2023-10-05T12:49:14.136 INFO:teuthology.orchestra.run.smithi012.stdout: def configfile(): 2023-10-05T12:49:14.136 INFO:teuthology.orchestra.run.smithi012.stdout:> setup() 2023-10-05T12:49:14.136 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.136 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:309: 2023-10-05T12:49:14.136 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.136 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:272: in setup 2023-10-05T12:49:14.136 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:14.136 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:14.136 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:14.136 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:14.137 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:14.137 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:14.137 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:14.137 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:14.137 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:14.137 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:14.137 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:14.137 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:14.137 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:14.137 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:14.137 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:14.137 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:14.137 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:14.138 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:14.138 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:14.138 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:14.138 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:14.138 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:14.138 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:14.138 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:14.138 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:14.138 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:14.138 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:14.138 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:14.139 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:14.139 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:14.139 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:14.139 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:14.139 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:14.139 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:14.139 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:14.139 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:14.139 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:14.139 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:14.139 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:14.140 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.140 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.140 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:14.140 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:14.140 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.140 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:14.140 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.140 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:14.140 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:14.140 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:14.140 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:14.140 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:14.141 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:14.141 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:14.141 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:14.141 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:14.141 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:14.141 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:14.141 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:14.141 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:14.141 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.141 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:14.141 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:14.141 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:14.142 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:14.142 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:14.142 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:14.142 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:14.142 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:14.142 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:14.142 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:14.142 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:14.142 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.142 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.142 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:14.143 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:14.143 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:14.143 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:14.143 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:14.143 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.143 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.143 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:14.143 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:14.143 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:14.143 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:14.143 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:14.143 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.143 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:14.144 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:14.144 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:14.144 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:14.144 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:14.144 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:14.144 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.144 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:14.144 INFO:teuthology.orchestra.run.smithi012.stdout:________________ ERROR at setup of test_nulliftrue_expressions _________________ 2023-10-05T12:49:14.144 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.144 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:14.144 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.144 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:14.144 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:14.145 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.145 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:14.145 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:14.145 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:14.145 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:14.145 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:14.145 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.145 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:14.145 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:14.145 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.145 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.146 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:14.146 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:14.146 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.146 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.146 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:14.146 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.146 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:14.146 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:14.146 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.146 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.146 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:14.146 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:14.147 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.147 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:14.147 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:14.147 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:14.147 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:14.147 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:14.147 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:14.147 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:14.147 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.147 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:14.147 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:14.147 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:14.148 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:14.148 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:14.148 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:14.148 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:14.148 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:14.148 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:14.148 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.148 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:14.148 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:14.148 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:14.148 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:14.149 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.149 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:14.149 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:14.149 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:14.149 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:14.149 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.149 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.149 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:14.149 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:14.149 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:14.149 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:14.149 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.150 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.150 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:14.150 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:14.150 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:14.150 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.150 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:14.150 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.150 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:14.150 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:14.150 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.150 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:14.151 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:14.151 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:14.151 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:14.151 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:14.151 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:14.151 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.151 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:14.151 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.151 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:14.151 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.151 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:14.151 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:14.152 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.152 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:14.152 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.152 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:14.152 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:14.152 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:14.152 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:14.152 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:14.152 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:14.152 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:14.152 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:14.152 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:14.152 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:14.153 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:14.153 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:14.153 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:14.153 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.153 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:14.153 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:14.153 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:14.153 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:14.153 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:14.153 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:14.153 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:14.153 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:14.154 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:14.154 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:14.154 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:14.154 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.154 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.154 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:14.154 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.154 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:14.154 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:14.154 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:14.154 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:14.154 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:14.155 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:14.155 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:14.155 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:14.155 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:14.155 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:14.155 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:14.155 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:14.155 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:14.155 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:14.155 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:14.155 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:14.156 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:14.156 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:14.156 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:14.156 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:14.156 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:14.156 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:14.156 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:14.156 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:14.156 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:14.156 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:14.156 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:14.156 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:14.157 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.157 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.157 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:14.157 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.157 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:14.157 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:14.157 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.157 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:14.157 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:14.157 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:14.157 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:14.157 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:14.157 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.158 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:14.158 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:14.158 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.158 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.158 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:14.158 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:14.158 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.158 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.158 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:14.158 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:14.158 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:14.159 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:14.159 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:14.159 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.159 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.159 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:14.159 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:14.159 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:14.159 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.159 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:14.159 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.159 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:14.159 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.160 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:14.160 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.160 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(scope="package") 2023-10-05T12:49:14.160 INFO:teuthology.orchestra.run.smithi012.stdout: def configfile(): 2023-10-05T12:49:14.160 INFO:teuthology.orchestra.run.smithi012.stdout:> setup() 2023-10-05T12:49:14.160 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.160 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:309: 2023-10-05T12:49:14.160 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.160 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:272: in setup 2023-10-05T12:49:14.160 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:14.160 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:14.160 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:14.161 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:14.161 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:14.161 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:14.161 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:14.161 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:14.161 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:14.161 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:14.161 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:14.161 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:14.161 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:14.161 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:14.161 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:14.162 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:14.162 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:14.162 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:14.162 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:14.162 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:14.162 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:14.162 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:14.162 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:14.162 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:14.162 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:14.162 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:14.162 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:14.163 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:14.163 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:14.163 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:14.163 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:14.163 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:14.163 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:14.163 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:14.163 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:14.163 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:14.163 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:14.163 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:14.163 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:14.164 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.164 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.164 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:14.164 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:14.164 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.164 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:14.164 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.164 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:14.164 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:14.164 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:14.164 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:14.165 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:14.165 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:14.165 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:14.165 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:14.165 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:14.165 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:14.165 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:14.165 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:14.165 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:14.165 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.165 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:14.165 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:14.165 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:14.166 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:14.166 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:14.166 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:14.166 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:14.166 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:14.166 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:14.166 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:14.166 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:14.166 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.166 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.166 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:14.166 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:14.167 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:14.167 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:14.167 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:14.167 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.167 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.167 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:14.167 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:14.167 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:14.167 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:14.167 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:14.167 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.167 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:14.168 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:14.168 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:14.168 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:14.168 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:14.168 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:14.168 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.168 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:14.168 INFO:teuthology.orchestra.run.smithi012.stdout:________________ ERROR at setup of test_is_not_null_expressions ________________ 2023-10-05T12:49:14.168 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.168 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:14.168 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.168 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:14.169 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:14.169 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.169 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:14.169 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:14.169 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:14.169 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:14.169 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:14.169 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.169 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:14.169 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:14.170 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.170 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.170 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:14.170 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:14.170 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.170 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.170 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:14.170 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.170 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:14.170 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:14.170 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.171 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.171 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:14.171 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:14.171 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.171 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:14.171 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:14.171 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:14.171 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:14.171 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:14.171 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:14.171 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:14.171 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.172 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:14.172 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:14.172 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:14.172 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:14.172 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:14.172 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:14.172 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:14.172 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:14.172 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:14.172 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.172 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:14.172 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:14.172 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:14.173 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:14.173 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.173 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:14.173 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:14.173 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:14.173 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:14.173 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.173 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.173 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:14.173 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:14.173 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:14.173 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:14.173 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.174 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.174 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:14.174 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:14.174 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:14.174 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.174 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:14.174 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.174 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:14.174 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:14.174 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.174 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:14.174 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:14.175 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:14.175 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:14.175 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:14.175 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:14.175 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.175 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:14.175 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.175 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:14.175 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.175 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:14.175 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:14.175 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.176 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:14.176 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.176 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:14.176 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:14.176 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:14.176 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:14.176 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:14.176 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:14.176 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:14.176 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:14.176 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:14.176 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:14.176 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:14.177 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:14.177 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:14.177 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.177 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:14.177 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:14.177 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:14.177 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:14.177 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:14.177 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:14.177 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:14.177 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:14.177 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:14.178 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:14.178 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:14.178 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.178 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.178 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:14.178 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.178 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:14.178 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:14.178 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:14.178 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:14.178 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:14.178 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:14.179 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:14.179 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:14.179 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:14.179 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:14.179 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:14.179 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:14.179 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:14.179 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:14.179 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:14.179 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:14.179 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:14.179 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:14.180 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:14.180 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:14.180 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:14.180 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:14.180 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:14.180 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:14.180 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:14.180 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:14.180 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:14.180 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:14.180 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.180 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.180 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:14.181 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.181 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:14.181 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:14.181 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.181 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:14.181 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:14.181 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:14.181 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:14.181 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:14.181 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.181 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:14.182 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:14.182 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.182 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.182 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:14.182 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:14.182 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.182 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.182 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:14.182 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:14.182 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:14.182 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:14.182 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:14.183 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.183 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.183 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:14.183 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:14.183 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:14.183 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.183 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:14.183 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.183 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:14.183 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.183 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:14.183 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.184 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(scope="package") 2023-10-05T12:49:14.184 INFO:teuthology.orchestra.run.smithi012.stdout: def configfile(): 2023-10-05T12:49:14.184 INFO:teuthology.orchestra.run.smithi012.stdout:> setup() 2023-10-05T12:49:14.184 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.184 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:309: 2023-10-05T12:49:14.184 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.184 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:272: in setup 2023-10-05T12:49:14.184 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:14.184 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:14.184 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:14.184 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:14.185 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:14.185 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:14.185 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:14.185 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:14.185 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:14.185 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:14.185 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:14.185 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:14.185 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:14.185 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:14.185 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:14.185 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:14.186 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:14.186 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:14.186 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:14.186 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:14.186 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:14.186 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:14.186 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:14.186 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:14.186 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:14.186 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:14.186 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:14.187 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:14.187 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:14.187 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:14.187 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:14.187 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:14.187 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:14.187 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:14.187 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:14.187 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:14.187 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:14.187 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:14.187 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:14.188 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.188 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.188 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:14.188 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:14.188 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.188 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:14.188 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.188 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:14.188 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:14.188 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:14.188 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:14.189 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:14.189 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:14.189 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:14.189 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:14.189 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:14.189 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:14.189 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:14.189 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:14.189 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:14.189 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.189 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:14.190 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:14.190 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:14.190 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:14.190 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:14.190 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:14.190 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:14.190 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:14.190 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:14.190 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:14.190 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:14.190 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.191 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.191 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:14.191 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:14.191 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:14.191 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:14.191 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:14.191 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.191 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.191 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:14.191 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:14.191 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:14.191 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:14.192 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:14.192 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.192 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:14.192 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:14.192 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:14.192 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:14.192 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:14.192 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:14.192 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.192 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:14.192 INFO:teuthology.orchestra.run.smithi012.stdout:________________ ERROR at setup of test_lowerupper_expressions _________________ 2023-10-05T12:49:14.192 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.193 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:14.193 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.193 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:14.193 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:14.193 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.193 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:14.193 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:14.193 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:14.193 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:14.193 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:14.193 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.193 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:14.194 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:14.194 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.194 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.194 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:14.194 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:14.194 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.194 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.194 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:14.194 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.194 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:14.194 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:14.194 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.195 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.195 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:14.195 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:14.195 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.195 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:14.195 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:14.195 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:14.195 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:14.195 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:14.195 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:14.195 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:14.195 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.196 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:14.196 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:14.196 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:14.196 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:14.196 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:14.196 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:14.196 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:14.196 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:14.196 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:14.196 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.196 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:14.196 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:14.197 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:14.197 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:14.197 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.197 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:14.197 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:14.197 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:14.197 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:14.197 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.197 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.197 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:14.197 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:14.197 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:14.197 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:14.198 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.198 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.198 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:14.198 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:14.198 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:14.198 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.198 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:14.198 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.198 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:14.198 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:14.198 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.198 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:14.199 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:14.199 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:14.199 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:14.199 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:14.199 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:14.199 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.199 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:14.199 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.199 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:14.199 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.200 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:14.200 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:14.200 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.200 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:14.200 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.200 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:14.200 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:14.200 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:14.200 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:14.200 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:14.200 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:14.201 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:14.201 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:14.201 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:14.201 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:14.201 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:14.201 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:14.201 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:14.201 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.201 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:14.201 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:14.201 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:14.201 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:14.202 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:14.202 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:14.202 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:14.202 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:14.202 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:14.202 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:14.202 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:14.202 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.202 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.202 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:14.203 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.203 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:14.203 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:14.203 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:14.203 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:14.203 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:14.203 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:14.203 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:14.203 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:14.203 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:14.203 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:14.203 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:14.204 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:14.204 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:14.204 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:14.204 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:14.204 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:14.204 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:14.204 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:14.204 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:14.204 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:14.204 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:14.204 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:14.204 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:14.204 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:14.205 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:14.205 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:14.205 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:14.205 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:14.205 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.205 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.205 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:14.205 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.205 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:14.205 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:14.205 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.205 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:14.206 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:14.206 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:14.206 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:14.206 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:14.206 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.206 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:14.206 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:14.206 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.206 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.206 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:14.206 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:14.206 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.207 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.207 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:14.207 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:14.207 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:14.207 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:14.207 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:14.207 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.207 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.207 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:14.207 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:14.207 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:14.207 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.208 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:14.208 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.208 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:14.208 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.208 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:14.208 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.208 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(scope="package") 2023-10-05T12:49:14.208 INFO:teuthology.orchestra.run.smithi012.stdout: def configfile(): 2023-10-05T12:49:14.208 INFO:teuthology.orchestra.run.smithi012.stdout:> setup() 2023-10-05T12:49:14.208 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.208 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:309: 2023-10-05T12:49:14.208 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.209 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:272: in setup 2023-10-05T12:49:14.209 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:14.209 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:14.209 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:14.209 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:14.209 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:14.209 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:14.209 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:14.209 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:14.209 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:14.209 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:14.209 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:14.210 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:14.210 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:14.210 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:14.210 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:14.210 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:14.210 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:14.210 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:14.210 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:14.210 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:14.210 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:14.210 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:14.210 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:14.211 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:14.211 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:14.211 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:14.211 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:14.211 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:14.211 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:14.211 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:14.211 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:14.211 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:14.211 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:14.211 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:14.211 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:14.212 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:14.212 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:14.212 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:14.212 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:14.212 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.212 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.212 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:14.212 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:14.212 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.212 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:14.212 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.213 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:14.213 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:14.213 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:14.213 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:14.213 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:14.213 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:14.213 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:14.213 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:14.213 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:14.213 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:14.213 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:14.213 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:14.214 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:14.214 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.214 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:14.214 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:14.214 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:14.214 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:14.214 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:14.214 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:14.214 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:14.214 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:14.214 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:14.215 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:14.215 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:14.215 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.215 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.215 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:14.215 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:14.215 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:14.215 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:14.215 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:14.215 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.215 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.215 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:14.216 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:14.216 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:14.216 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:14.216 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:14.216 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.216 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:14.216 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:14.216 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:14.216 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:14.216 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:14.216 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:14.216 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.216 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:14.217 INFO:teuthology.orchestra.run.smithi012.stdout:____________________ ERROR at setup of test_in_expressions _____________________ 2023-10-05T12:49:14.217 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.217 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:14.217 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.217 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:14.217 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:14.217 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.217 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:14.217 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:14.217 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:14.217 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:14.217 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:14.218 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.218 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:14.218 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:14.218 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.218 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.218 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:14.218 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:14.218 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.218 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.218 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:14.218 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.219 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:14.219 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:14.219 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.219 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.219 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:14.219 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:14.219 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.219 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:14.219 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:14.219 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:14.219 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:14.220 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:14.220 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:14.220 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:14.220 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.220 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:14.220 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:14.220 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:14.220 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:14.220 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:14.220 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:14.220 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:14.220 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:14.220 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:14.221 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.221 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:14.221 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:14.221 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:14.221 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:14.221 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.221 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:14.221 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:14.221 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:14.221 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:14.221 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.221 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.222 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:14.222 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:14.222 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:14.222 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:14.222 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.222 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.222 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:14.222 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:14.222 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:14.222 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.222 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:14.222 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.223 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:14.223 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:14.223 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.223 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:14.223 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:14.223 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:14.223 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:14.223 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:14.223 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:14.223 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.223 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:14.223 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.224 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:14.224 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.224 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:14.224 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:14.224 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.224 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:14.224 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.224 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:14.224 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:14.224 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:14.224 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:14.224 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:14.225 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:14.225 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:14.225 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:14.225 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:14.225 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:14.225 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:14.225 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:14.225 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:14.225 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.225 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:14.225 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:14.225 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:14.226 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:14.226 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:14.226 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:14.226 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:14.226 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:14.226 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:14.226 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:14.226 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:14.226 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.226 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.226 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:14.226 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.227 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:14.227 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:14.227 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:14.227 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:14.227 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:14.227 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:14.227 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:14.227 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:14.227 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:14.227 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:14.227 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:14.228 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:14.228 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:14.228 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:14.228 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:14.228 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:14.228 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:14.228 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:14.228 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:14.228 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:14.228 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:14.228 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:14.228 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:14.229 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:14.229 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:14.229 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:14.229 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:14.229 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:14.229 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.229 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.229 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:14.229 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.229 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:14.229 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:14.229 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.230 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:14.230 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:14.230 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:14.230 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:14.230 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:14.230 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.230 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:14.230 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:14.230 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.230 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.230 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:14.230 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:14.231 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.231 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.231 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:14.231 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:14.231 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:14.231 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:14.231 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:14.231 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.231 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.231 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:14.231 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:14.231 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:14.231 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.232 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:14.232 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.232 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:14.232 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.232 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:14.232 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.232 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(scope="package") 2023-10-05T12:49:14.232 INFO:teuthology.orchestra.run.smithi012.stdout: def configfile(): 2023-10-05T12:49:14.232 INFO:teuthology.orchestra.run.smithi012.stdout:> setup() 2023-10-05T12:49:14.232 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.232 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:309: 2023-10-05T12:49:14.232 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.233 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:272: in setup 2023-10-05T12:49:14.233 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:14.233 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:14.233 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:14.233 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:14.233 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:14.233 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:14.233 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:14.233 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:14.233 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:14.233 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:14.233 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:14.233 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:14.234 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:14.234 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:14.234 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:14.234 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:14.234 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:14.234 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:14.234 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:14.234 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:14.234 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:14.234 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:14.234 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:14.234 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:14.235 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:14.235 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:14.235 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:14.235 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:14.235 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:14.235 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:14.235 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:14.235 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:14.235 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:14.235 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:14.235 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:14.235 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:14.235 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:14.236 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:14.236 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:14.236 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.236 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.236 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:14.236 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:14.236 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.236 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:14.236 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.236 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:14.236 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:14.236 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:14.236 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:14.237 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:14.237 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:14.237 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:14.237 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:14.237 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:14.237 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:14.237 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:14.237 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:14.237 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:14.237 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.237 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:14.237 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:14.237 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:14.238 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:14.238 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:14.238 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:14.238 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:14.238 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:14.238 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:14.238 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:14.238 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:14.238 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.238 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.238 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:14.238 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:14.239 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:14.239 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:14.239 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:14.239 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.239 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.239 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:14.239 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:14.239 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:14.239 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:14.239 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:14.239 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.239 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:14.239 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:14.240 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:14.240 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:14.240 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:14.240 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:14.240 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.240 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:14.240 INFO:teuthology.orchestra.run.smithi012.stdout:_______________ ERROR at setup of test_true_false_in_expressions _______________ 2023-10-05T12:49:14.240 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.240 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:14.240 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.240 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:14.240 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:14.240 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.241 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:14.241 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:14.241 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:14.241 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:14.241 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:14.241 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.241 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:14.241 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:14.241 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.241 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.241 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:14.241 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:14.242 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.242 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.242 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:14.242 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.242 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:14.242 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:14.242 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.242 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.242 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:14.242 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:14.242 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.243 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:14.243 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:14.243 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:14.243 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:14.243 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:14.243 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:14.243 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:14.243 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.243 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:14.243 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:14.243 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:14.243 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:14.243 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:14.244 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:14.244 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:14.244 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:14.244 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:14.244 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.244 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:14.244 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:14.244 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:14.244 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:14.244 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.244 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:14.244 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:14.244 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:14.245 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:14.245 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.245 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.245 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:14.245 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:14.245 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:14.245 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:14.245 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.245 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.245 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:14.245 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:14.245 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:14.245 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.246 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:14.246 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.246 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:14.246 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:14.246 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.246 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:14.246 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:14.246 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:14.246 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:14.246 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:14.246 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:14.246 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.247 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:14.247 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.247 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:14.247 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.247 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:14.247 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:14.247 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.247 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:14.247 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.247 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:14.247 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:14.247 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:14.247 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:14.248 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:14.248 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:14.248 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:14.248 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:14.248 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:14.248 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:14.248 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:14.248 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:14.248 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:14.248 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.248 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:14.248 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:14.249 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:14.249 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:14.249 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:14.249 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:14.249 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:14.249 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:14.249 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:14.249 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:14.249 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:14.249 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.249 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.249 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:14.249 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.250 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:14.250 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:14.250 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:14.250 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:14.250 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:14.250 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:14.250 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:14.250 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:14.250 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:14.250 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:14.250 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:14.250 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:14.251 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:14.251 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:14.251 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:14.251 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:14.251 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:14.251 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:14.251 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:14.251 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:14.251 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:14.251 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:14.251 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:14.251 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:14.251 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:14.252 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:14.252 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:14.252 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:14.252 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.252 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.252 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:14.252 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.252 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:14.252 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:14.252 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.252 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:14.252 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:14.252 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:14.253 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:14.253 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:14.253 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.253 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:14.253 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:14.253 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.253 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.253 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:14.253 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:14.253 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.253 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.253 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:14.254 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:14.254 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:14.254 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:14.254 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:14.254 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.254 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.254 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:14.254 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:14.254 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:14.254 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.254 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:14.254 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.254 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:14.255 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.255 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:14.255 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.255 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(scope="package") 2023-10-05T12:49:14.255 INFO:teuthology.orchestra.run.smithi012.stdout: def configfile(): 2023-10-05T12:49:14.255 INFO:teuthology.orchestra.run.smithi012.stdout:> setup() 2023-10-05T12:49:14.255 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.255 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:309: 2023-10-05T12:49:14.255 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.255 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:272: in setup 2023-10-05T12:49:14.255 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:14.255 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:14.255 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:14.255 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:14.256 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:14.256 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:14.256 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:14.256 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:14.256 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:14.256 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:14.256 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:14.257 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:14.257 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:14.257 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:14.257 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:14.257 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:14.257 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:14.257 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:14.257 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:14.257 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:14.257 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:14.257 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:14.257 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:14.258 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:14.258 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:14.258 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:14.258 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:14.258 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:14.258 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:14.258 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:14.258 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:14.258 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:14.258 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:14.259 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:14.259 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:14.259 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:14.259 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:14.259 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:14.259 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:14.259 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.259 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.259 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:14.259 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:14.259 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.260 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:14.260 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.260 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:14.260 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:14.260 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:14.260 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:14.260 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:14.260 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:14.260 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:14.260 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:14.260 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:14.260 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:14.261 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:14.261 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:14.261 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:14.261 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.261 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:14.261 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:14.261 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:14.261 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:14.261 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:14.261 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:14.261 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:14.261 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:14.262 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:14.262 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:14.262 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:14.262 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.262 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.262 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:14.262 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:14.262 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:14.262 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:14.262 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:14.262 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.262 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.263 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:14.263 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:14.263 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:14.263 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:14.263 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:14.263 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.263 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:14.263 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:14.263 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:14.263 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:14.263 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:14.263 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:14.264 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.264 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:14.264 INFO:teuthology.orchestra.run.smithi012.stdout:___________________ ERROR at setup of test_like_expressions ____________________ 2023-10-05T12:49:14.264 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.264 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:14.264 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.264 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:14.264 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:14.264 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.264 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:14.264 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:14.264 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:14.265 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:14.265 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:14.265 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.265 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:14.265 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:14.265 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.265 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.265 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:14.265 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:14.265 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.265 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.265 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:14.266 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.266 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:14.266 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:14.266 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.266 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.266 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:14.266 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:14.266 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.266 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:14.266 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:14.266 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:14.267 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:14.267 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:14.267 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:14.267 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:14.267 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.267 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:14.267 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:14.267 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:14.267 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:14.267 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:14.267 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:14.268 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:14.268 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:14.268 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:14.268 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.268 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:14.268 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:14.268 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:14.268 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:14.268 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.268 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:14.268 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:14.269 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:14.269 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:14.269 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.269 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.269 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:14.269 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:14.269 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:14.269 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:14.269 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.269 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.269 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:14.269 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:14.270 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:14.270 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.270 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:14.270 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.270 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:14.270 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:14.270 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.270 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:14.270 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:14.270 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:14.270 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:14.271 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:14.271 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:14.271 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.271 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:14.271 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.271 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:14.271 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.271 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:14.271 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:14.271 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.271 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:14.272 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.272 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:14.272 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:14.272 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:14.272 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:14.272 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:14.272 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:14.272 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:14.272 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:14.272 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:14.272 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:14.272 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:14.272 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:14.273 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:14.273 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.273 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:14.273 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:14.273 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:14.273 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:14.273 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:14.273 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:14.273 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:14.273 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:14.273 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:14.273 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:14.274 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:14.274 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.274 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.274 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:14.274 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.274 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:14.274 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:14.274 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:14.274 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:14.274 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:14.274 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:14.275 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:14.275 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:14.275 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:14.275 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:14.275 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:14.275 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:14.275 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:14.275 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:14.275 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:14.275 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:14.275 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:14.275 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:14.276 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:14.276 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:14.276 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:14.276 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:14.276 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:14.276 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:14.276 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:14.276 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:14.276 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:14.276 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:14.276 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.276 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.276 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:14.277 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.277 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:14.277 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:14.277 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.277 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:14.277 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:14.277 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:14.277 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:14.277 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:14.277 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.277 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:14.277 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:14.278 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.278 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.278 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:14.278 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:14.278 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.278 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.278 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:14.278 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:14.278 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:14.278 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:14.278 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:14.279 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.279 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.279 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:14.279 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:14.279 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:14.279 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.279 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:14.279 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.279 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:14.279 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.279 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:14.279 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.279 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(scope="package") 2023-10-05T12:49:14.280 INFO:teuthology.orchestra.run.smithi012.stdout: def configfile(): 2023-10-05T12:49:14.280 INFO:teuthology.orchestra.run.smithi012.stdout:> setup() 2023-10-05T12:49:14.280 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.280 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:309: 2023-10-05T12:49:14.280 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.280 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:272: in setup 2023-10-05T12:49:14.280 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:14.280 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:14.280 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:14.280 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:14.280 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:14.280 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:14.281 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:14.281 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:14.281 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:14.281 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:14.281 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:14.281 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:14.281 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:14.281 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:14.281 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:14.281 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:14.281 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:14.281 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:14.281 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:14.282 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:14.282 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:14.282 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:14.282 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:14.282 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:14.282 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:14.282 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:14.282 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:14.282 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:14.282 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:14.282 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:14.282 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:14.283 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:14.283 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:14.283 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:14.283 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:14.283 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:14.283 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:14.283 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:14.283 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:14.283 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.283 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.283 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:14.283 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:14.284 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.284 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:14.284 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.284 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:14.284 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:14.284 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:14.284 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:14.284 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:14.284 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:14.284 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:14.284 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:14.285 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:14.285 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:14.285 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:14.285 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:14.285 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:14.285 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.285 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:14.285 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:14.285 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:14.285 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:14.285 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:14.285 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:14.286 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:14.286 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:14.286 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:14.286 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:14.286 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:14.286 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.286 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.286 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:14.286 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:14.286 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:14.286 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:14.286 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:14.287 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.287 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.287 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:14.287 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:14.287 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:14.287 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:14.287 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:14.287 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.287 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:14.287 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:14.287 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:14.287 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:14.288 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:14.288 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:14.288 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.288 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:14.288 INFO:teuthology.orchestra.run.smithi012.stdout:_______________ ERROR at setup of test_truefalselike_expressions _______________ 2023-10-05T12:49:14.288 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.288 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:14.288 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.288 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:14.288 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:14.288 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.288 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:14.289 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:14.289 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:14.289 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:14.289 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:14.289 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.289 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:14.289 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:14.289 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.289 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.289 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:14.289 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:14.289 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.290 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.290 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:14.290 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.290 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:14.290 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:14.290 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.290 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.290 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:14.290 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:14.290 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.290 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:14.290 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:14.291 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:14.291 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:14.291 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:14.291 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:14.291 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:14.291 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.291 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:14.291 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:14.291 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:14.291 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:14.291 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:14.291 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:14.291 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:14.292 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:14.292 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:14.292 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.292 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:14.292 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:14.292 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:14.292 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:14.292 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.292 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:14.292 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:14.292 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:14.292 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:14.293 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.293 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.293 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:14.293 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:14.293 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:14.293 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:14.293 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.293 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.293 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:14.293 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:14.293 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:14.294 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.294 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:14.294 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.294 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:14.294 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:14.294 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.294 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:14.294 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:14.294 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:14.294 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:14.294 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:14.294 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:14.295 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.295 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:14.295 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.295 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:14.295 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.295 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:14.295 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:14.295 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.295 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:14.295 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.295 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:14.295 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:14.295 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:14.296 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:14.296 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:14.296 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:14.296 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:14.296 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:14.296 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:14.296 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:14.296 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:14.296 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:14.296 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:14.296 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.296 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:14.296 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:14.297 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:14.297 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:14.297 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:14.297 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:14.297 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:14.297 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:14.297 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:14.297 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:14.297 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:14.297 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.297 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.297 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:14.298 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.298 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:14.298 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:14.298 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:14.298 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:14.298 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:14.298 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:14.298 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:14.298 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:14.298 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:14.298 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:14.298 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:14.299 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:14.299 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:14.299 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:14.299 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:14.299 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:14.299 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:14.299 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:14.299 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:14.299 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:14.299 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:14.300 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:14.300 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:14.300 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:14.300 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:14.300 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:14.300 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:14.300 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:14.300 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.300 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.300 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:14.300 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.300 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:14.300 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:14.301 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.301 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:14.301 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:14.301 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:14.301 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:14.301 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:14.301 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.301 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:14.301 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:14.301 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.301 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.301 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:14.301 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:14.302 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.302 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.302 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:14.302 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:14.302 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:14.302 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:14.302 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:14.302 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.302 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.302 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:14.302 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:14.303 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:14.303 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.303 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:14.303 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.303 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:14.303 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.303 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:14.303 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.303 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(scope="package") 2023-10-05T12:49:14.303 INFO:teuthology.orchestra.run.smithi012.stdout: def configfile(): 2023-10-05T12:49:14.303 INFO:teuthology.orchestra.run.smithi012.stdout:> setup() 2023-10-05T12:49:14.303 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.303 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:309: 2023-10-05T12:49:14.304 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.304 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:272: in setup 2023-10-05T12:49:14.304 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:14.304 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:14.304 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:14.304 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:14.304 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:14.304 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:14.304 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:14.304 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:14.304 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:14.304 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:14.305 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:14.305 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:14.305 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:14.305 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:14.305 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:14.305 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:14.305 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:14.305 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:14.305 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:14.305 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:14.305 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:14.305 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:14.305 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:14.305 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:14.306 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:14.306 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:14.306 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:14.306 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:14.306 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:14.306 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:14.306 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:14.306 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:14.306 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:14.306 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:14.306 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:14.306 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:14.307 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:14.307 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:14.307 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:14.307 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.307 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.307 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:14.307 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:14.307 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.307 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:14.307 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.307 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:14.307 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:14.308 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:14.308 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:14.308 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:14.308 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:14.308 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:14.308 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:14.308 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:14.308 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:14.308 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:14.308 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:14.308 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:14.308 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.309 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:14.309 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:14.309 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:14.309 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:14.309 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:14.309 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:14.309 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:14.309 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:14.309 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:14.309 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:14.309 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:14.309 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.309 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.310 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:14.310 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:14.310 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:14.310 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:14.310 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:14.310 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.310 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.310 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:14.310 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:14.310 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:14.310 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:14.310 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:14.310 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.311 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:14.311 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:14.311 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:14.311 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:14.311 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:14.311 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:14.311 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.311 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:14.311 INFO:teuthology.orchestra.run.smithi012.stdout:__________________ ERROR at setup of test_complex_expressions __________________ 2023-10-05T12:49:14.311 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.311 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:14.311 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.312 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:14.312 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:14.312 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.312 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:14.312 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:14.312 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:14.312 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:14.312 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:14.312 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.312 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:14.312 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:14.312 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.313 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.313 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:14.313 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:14.313 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.313 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.313 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:14.313 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.313 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:14.313 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:14.313 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.313 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.313 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:14.314 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:14.314 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.314 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:14.314 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:14.314 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:14.314 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:14.314 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:14.314 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:14.314 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:14.314 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.314 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:14.314 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:14.315 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:14.315 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:14.315 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:14.315 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:14.315 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:14.315 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:14.315 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:14.315 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.315 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:14.315 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:14.315 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:14.315 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:14.315 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.316 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:14.316 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:14.316 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:14.316 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:14.316 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.316 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.316 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:14.316 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:14.316 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:14.316 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:14.316 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.316 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.316 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:14.317 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:14.317 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:14.317 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.317 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:14.317 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.317 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:14.317 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:14.317 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.317 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:14.317 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:14.317 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:14.317 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:14.318 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:14.318 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:14.318 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.318 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:14.318 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.318 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:14.318 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.318 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:14.318 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:14.318 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.318 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:14.319 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.319 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:14.319 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:14.319 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:14.319 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:14.319 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:14.319 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:14.319 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:14.319 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:14.319 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:14.319 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:14.319 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:14.320 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:14.320 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:14.320 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.320 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:14.320 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:14.320 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:14.320 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:14.320 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:14.320 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:14.320 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:14.320 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:14.320 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:14.320 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:14.320 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:14.321 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.321 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.321 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:14.321 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.321 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:14.321 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:14.321 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:14.321 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:14.321 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:14.321 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:14.321 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:14.321 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:14.322 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:14.322 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:14.322 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:14.322 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:14.322 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:14.322 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:14.322 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:14.322 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:14.322 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:14.322 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:14.322 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:14.322 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:14.323 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:14.323 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:14.323 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:14.323 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:14.323 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:14.323 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:14.323 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:14.323 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:14.323 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.323 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.323 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:14.323 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.324 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:14.324 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:14.324 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.324 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:14.324 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:14.324 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:14.324 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:14.324 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:14.324 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.324 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:14.324 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:14.324 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.325 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.325 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:14.325 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:14.325 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.325 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.325 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:14.325 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:14.325 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:14.325 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:14.325 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:14.325 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.325 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.326 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:14.326 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:14.326 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:14.326 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.326 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:14.326 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.326 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:14.326 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.326 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:14.326 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.326 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(scope="package") 2023-10-05T12:49:14.326 INFO:teuthology.orchestra.run.smithi012.stdout: def configfile(): 2023-10-05T12:49:14.327 INFO:teuthology.orchestra.run.smithi012.stdout:> setup() 2023-10-05T12:49:14.327 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.327 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:309: 2023-10-05T12:49:14.327 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.327 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:272: in setup 2023-10-05T12:49:14.327 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:14.327 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:14.327 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:14.327 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:14.327 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:14.327 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:14.327 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:14.328 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:14.328 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:14.328 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:14.328 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:14.328 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:14.328 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:14.328 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:14.328 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:14.328 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:14.328 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:14.329 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:14.329 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:14.329 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:14.329 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:14.329 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:14.329 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:14.329 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:14.329 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:14.329 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:14.329 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:14.329 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:14.330 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:14.330 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:14.330 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:14.330 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:14.330 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:14.330 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:14.330 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:14.330 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:14.330 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:14.330 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:14.330 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:14.330 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.330 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.331 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:14.331 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:14.331 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.331 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:14.331 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.331 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:14.331 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:14.331 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:14.331 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:14.331 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:14.331 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:14.331 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:14.331 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:14.332 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:14.332 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:14.332 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:14.332 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:14.332 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:14.332 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.332 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:14.332 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:14.332 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:14.332 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:14.332 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:14.332 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:14.332 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:14.333 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:14.333 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:14.333 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:14.333 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:14.333 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.333 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.333 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:14.333 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:14.333 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:14.333 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:14.333 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:14.333 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.333 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.334 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:14.334 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:14.334 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:14.334 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:14.334 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:14.334 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.334 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:14.334 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:14.334 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:14.334 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:14.334 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:14.334 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:14.335 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.335 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:14.335 INFO:teuthology.orchestra.run.smithi012.stdout:_________________________ ERROR at setup of test_alias _________________________ 2023-10-05T12:49:14.335 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.335 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:14.335 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.335 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:14.335 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:14.335 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.335 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:14.335 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:14.335 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:14.335 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:14.336 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:14.336 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.336 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:14.343 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:14.343 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.343 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.344 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:14.344 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:14.344 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.344 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.344 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:14.344 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.344 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:14.344 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:14.344 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.344 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.344 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:14.344 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:14.345 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.345 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:14.345 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:14.345 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:14.345 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:14.345 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:14.345 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:14.345 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:14.345 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.345 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:14.345 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:14.346 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:14.346 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:14.346 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:14.346 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:14.346 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:14.346 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:14.346 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:14.346 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.346 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:14.346 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:14.346 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:14.346 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:14.347 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.347 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:14.347 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:14.347 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:14.347 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:14.347 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.347 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.347 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:14.347 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:14.347 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:14.347 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:14.347 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.348 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.348 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:14.348 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:14.348 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:14.348 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.348 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:14.348 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.348 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:14.348 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:14.348 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.348 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:14.348 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:14.349 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:14.349 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:14.349 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:14.349 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:14.349 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.349 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:14.349 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.349 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:14.349 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.349 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:14.350 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:14.350 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.350 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:14.350 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.350 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:14.350 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:14.350 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:14.350 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:14.350 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:14.350 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:14.350 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:14.351 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:14.351 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:14.351 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:14.351 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:14.351 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:14.351 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:14.351 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.351 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:14.351 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:14.351 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:14.351 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:14.352 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:14.352 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:14.352 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:14.352 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:14.352 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:14.352 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:14.352 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:14.352 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.352 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.352 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:14.352 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.352 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:14.353 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:14.353 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:14.353 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:14.353 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:14.353 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:14.353 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:14.353 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:14.353 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:14.353 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:14.353 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:14.353 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:14.353 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:14.354 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:14.354 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:14.354 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:14.354 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:14.354 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:14.354 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:14.354 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:14.354 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:14.354 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:14.354 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:14.354 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:14.354 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:14.355 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:14.355 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:14.355 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:14.355 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.355 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.355 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:14.355 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.355 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:14.355 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:14.355 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.355 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:14.355 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:14.355 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:14.356 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:14.356 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:14.356 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.356 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:14.356 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:14.356 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.356 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.356 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:14.356 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:14.356 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.356 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.357 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:14.357 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:14.357 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:14.357 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:14.357 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:14.357 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.357 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.357 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:14.357 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:14.357 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:14.357 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.357 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:14.358 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.358 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:14.358 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.358 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:14.358 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.358 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(scope="package") 2023-10-05T12:49:14.358 INFO:teuthology.orchestra.run.smithi012.stdout: def configfile(): 2023-10-05T12:49:14.358 INFO:teuthology.orchestra.run.smithi012.stdout:> setup() 2023-10-05T12:49:14.358 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.358 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:309: 2023-10-05T12:49:14.358 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.358 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:272: in setup 2023-10-05T12:49:14.359 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:14.359 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:14.359 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:14.359 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:14.359 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:14.359 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:14.359 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:14.359 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:14.359 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:14.359 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:14.359 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:14.359 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:14.359 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:14.360 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:14.360 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:14.360 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:14.360 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:14.360 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:14.360 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:14.360 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:14.360 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:14.360 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:14.360 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:14.360 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:14.360 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:14.360 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:14.361 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:14.361 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:14.361 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:14.361 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:14.361 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:14.361 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:14.361 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:14.361 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:14.361 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:14.361 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:14.361 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:14.361 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:14.362 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:14.362 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.362 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.362 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:14.362 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:14.362 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.362 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:14.362 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.362 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:14.362 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:14.362 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:14.362 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:14.363 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:14.363 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:14.363 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:14.363 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:14.363 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:14.363 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:14.363 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:14.363 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:14.363 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:14.363 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.363 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:14.364 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:14.364 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:14.364 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:14.364 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:14.364 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:14.364 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:14.364 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:14.364 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:14.364 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:14.364 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:14.364 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.364 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.365 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:14.365 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:14.365 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:14.365 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:14.365 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:14.365 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.365 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.365 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:14.365 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:14.365 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:14.365 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:14.365 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:14.365 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.366 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:14.366 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:14.366 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:14.366 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:14.366 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:14.366 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:14.366 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.366 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:14.366 INFO:teuthology.orchestra.run.smithi012.stdout:_________________ ERROR at setup of test_alias_cyclic_refernce _________________ 2023-10-05T12:49:14.366 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.366 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:14.366 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.367 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:14.367 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:14.367 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.367 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:14.367 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:14.367 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:14.367 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:14.367 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:14.367 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.367 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:14.367 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:14.367 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.367 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.367 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:14.368 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:14.368 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.368 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.368 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:14.368 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.368 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:14.368 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:14.368 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.368 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.368 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:14.368 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:14.369 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.369 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:14.369 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:14.369 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:14.369 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:14.369 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:14.369 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:14.369 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:14.369 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.369 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:14.369 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:14.369 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:14.369 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:14.370 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:14.370 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:14.370 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:14.370 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:14.370 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:14.370 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.370 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:14.370 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:14.370 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:14.370 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:14.370 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.370 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:14.371 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:14.371 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:14.371 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:14.371 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.371 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.371 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:14.371 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:14.371 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:14.371 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:14.371 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.371 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.371 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:14.372 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:14.372 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:14.372 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.372 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:14.372 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.372 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:14.372 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:14.372 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.372 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:14.372 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:14.372 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:14.372 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:14.372 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:14.373 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:14.373 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.373 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:14.373 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.373 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:14.373 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.373 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:14.373 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:14.373 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.373 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:14.373 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.373 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:14.374 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:14.374 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:14.374 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:14.374 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:14.374 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:14.374 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:14.374 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:14.374 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:14.374 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:14.374 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:14.374 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:14.374 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:14.375 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.375 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:14.375 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:14.375 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:14.375 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:14.375 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:14.375 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:14.375 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:14.375 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:14.375 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:14.375 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:14.375 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:14.376 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.376 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.376 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:14.376 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.376 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:14.376 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:14.376 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:14.376 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:14.376 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:14.376 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:14.376 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:14.376 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:14.376 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:14.377 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:14.377 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:14.377 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:14.377 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:14.377 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:14.377 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:14.377 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:14.377 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:14.377 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:14.377 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:14.377 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:14.378 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:14.378 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:14.378 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:14.378 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:14.378 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:14.378 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:14.378 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:14.378 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:14.378 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.378 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.378 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:14.378 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.379 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:14.379 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:14.379 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.379 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:14.379 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:14.379 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:14.379 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:14.379 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:14.379 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.379 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:14.379 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:14.380 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.380 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.380 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:14.380 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:14.380 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.380 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.380 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:14.380 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:14.380 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:14.380 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:14.380 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:14.380 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.380 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.381 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:14.381 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:14.381 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:14.381 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.381 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:14.381 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.381 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:14.381 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.381 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:14.381 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.381 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(scope="package") 2023-10-05T12:49:14.381 INFO:teuthology.orchestra.run.smithi012.stdout: def configfile(): 2023-10-05T12:49:14.381 INFO:teuthology.orchestra.run.smithi012.stdout:> setup() 2023-10-05T12:49:14.382 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.382 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:309: 2023-10-05T12:49:14.382 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.382 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:272: in setup 2023-10-05T12:49:14.382 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:14.382 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:14.382 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:14.382 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:14.382 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:14.382 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:14.382 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:14.382 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:14.383 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:14.383 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:14.383 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:14.383 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:14.383 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:14.383 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:14.383 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:14.383 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:14.383 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:14.383 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:14.383 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:14.383 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:14.384 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:14.384 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:14.384 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:14.384 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:14.384 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:14.384 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:14.384 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:14.384 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:14.384 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:14.384 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:14.384 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:14.384 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:14.384 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:14.385 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:14.385 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:14.385 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:14.385 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:14.385 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:14.385 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:14.385 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.385 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.385 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:14.385 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:14.385 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.385 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:14.386 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.386 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:14.386 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:14.386 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:14.386 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:14.386 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:14.386 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:14.386 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:14.386 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:14.386 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:14.386 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:14.386 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:14.387 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:14.387 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:14.387 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.387 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:14.387 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:14.387 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:14.387 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:14.387 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:14.387 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:14.387 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:14.387 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:14.388 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:14.388 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:14.388 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:14.388 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.388 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.388 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:14.388 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:14.388 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:14.388 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:14.388 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:14.388 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.388 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.389 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:14.389 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:14.389 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:14.389 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:14.389 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:14.389 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.389 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:14.389 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:14.389 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:14.389 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:14.389 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:14.389 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:14.390 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.390 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:14.390 INFO:teuthology.orchestra.run.smithi012.stdout:_______________________ ERROR at setup of test_datetime ________________________ 2023-10-05T12:49:14.390 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.390 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:14.390 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.390 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:14.390 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:14.390 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.390 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:14.390 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:14.390 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:14.391 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:14.391 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:14.391 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.391 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:14.391 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:14.391 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.391 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.391 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:14.391 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:14.391 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.391 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.391 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:14.391 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.392 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:14.392 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:14.392 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.392 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.392 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:14.392 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:14.392 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.392 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:14.392 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:14.392 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:14.392 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:14.393 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:14.393 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:14.393 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:14.393 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.393 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:14.393 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:14.393 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:14.393 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:14.393 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:14.393 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:14.393 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:14.393 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:14.393 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:14.394 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.394 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:14.394 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:14.394 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:14.394 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:14.394 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.394 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:14.394 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:14.394 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:14.394 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:14.394 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.394 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.395 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:14.395 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:14.395 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:14.395 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:14.395 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.395 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.395 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:14.395 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:14.395 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:14.395 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.395 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:14.395 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.395 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:14.396 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:14.396 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.396 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:14.396 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:14.396 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:14.396 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:14.396 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:14.396 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:14.396 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.396 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:14.396 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.396 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:14.397 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.397 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:14.397 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:14.397 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.397 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:14.397 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.397 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:14.397 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:14.397 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:14.397 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:14.397 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:14.397 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:14.397 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:14.398 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:14.398 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:14.398 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:14.398 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:14.398 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:14.398 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:14.398 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.398 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:14.398 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:14.398 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:14.398 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:14.398 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:14.399 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:14.399 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:14.399 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:14.399 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:14.399 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:14.399 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:14.399 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.399 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.399 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:14.399 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.399 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:14.399 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:14.399 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:14.400 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:14.400 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:14.400 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:14.400 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:14.400 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:14.400 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:14.400 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:14.400 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:14.400 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:14.400 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:14.400 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:14.400 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:14.400 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:14.401 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:14.401 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:14.401 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:14.401 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:14.401 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:14.401 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:14.401 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:14.401 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:14.401 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:14.401 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:14.401 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:14.401 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:14.401 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.402 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.402 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:14.402 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.402 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:14.402 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:14.402 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.402 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:14.402 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:14.402 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:14.402 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:14.402 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:14.403 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.403 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:14.403 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:14.403 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.403 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.403 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:14.403 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:14.403 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.403 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.403 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:14.403 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:14.404 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:14.404 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:14.404 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:14.404 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.404 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.404 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:14.404 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:14.404 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:14.404 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.404 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:14.404 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.404 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:14.404 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.405 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:14.405 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.405 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(scope="package") 2023-10-05T12:49:14.405 INFO:teuthology.orchestra.run.smithi012.stdout: def configfile(): 2023-10-05T12:49:14.405 INFO:teuthology.orchestra.run.smithi012.stdout:> setup() 2023-10-05T12:49:14.405 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.405 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:309: 2023-10-05T12:49:14.405 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.405 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:272: in setup 2023-10-05T12:49:14.405 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:14.405 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:14.405 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:14.406 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:14.406 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:14.406 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:14.406 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:14.406 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:14.406 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:14.406 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:14.406 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:14.406 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:14.406 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:14.407 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:14.407 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:14.407 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:14.407 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:14.407 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:14.407 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:14.407 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:14.407 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:14.407 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:14.407 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:14.407 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:14.408 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:14.408 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:14.408 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:14.408 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:14.408 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:14.408 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:14.408 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:14.408 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:14.408 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:14.408 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:14.408 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:14.408 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:14.409 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:14.409 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:14.409 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:14.409 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.409 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.409 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:14.409 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:14.409 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.409 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:14.409 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.409 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:14.409 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:14.410 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:14.410 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:14.410 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:14.410 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:14.410 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:14.410 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:14.410 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:14.410 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:14.410 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:14.410 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:14.412 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:14.412 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.412 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:14.413 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:14.413 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:14.413 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:14.413 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:14.413 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:14.413 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:14.413 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:14.413 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:14.413 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:14.413 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:14.413 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.413 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.414 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:14.414 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:14.414 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:14.414 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:14.414 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:14.414 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.414 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.414 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:14.414 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:14.414 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:14.414 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:14.414 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:14.414 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.415 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:14.415 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:14.415 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:14.415 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:14.415 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:14.415 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:14.415 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.415 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:14.415 INFO:teuthology.orchestra.run.smithi012.stdout:__________________ ERROR at setup of test_true_false_datetime __________________ 2023-10-05T12:49:14.415 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.415 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:14.415 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.415 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:14.416 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:14.416 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.416 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:14.416 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:14.416 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:14.416 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:14.416 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:14.416 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.416 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:14.416 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:14.416 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.416 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.416 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:14.417 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:14.417 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.417 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.417 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:14.417 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.417 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:14.417 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:14.417 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.417 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.417 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:14.417 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:14.417 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.418 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:14.418 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:14.418 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:14.418 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:14.418 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:14.418 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:14.418 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:14.418 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.418 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:14.418 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:14.418 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:14.418 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:14.419 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:14.419 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:14.419 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:14.419 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:14.419 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:14.419 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.419 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:14.419 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:14.419 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:14.419 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:14.419 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.419 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:14.420 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:14.420 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:14.420 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:14.420 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.420 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.420 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:14.420 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:14.420 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:14.420 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:14.420 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.420 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.420 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:14.421 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:14.421 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:14.421 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.421 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:14.421 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.421 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:14.421 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:14.421 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.421 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:14.421 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:14.421 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:14.421 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:14.422 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:14.422 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:14.422 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.422 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:14.422 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.422 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:14.422 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.422 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:14.422 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:14.422 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.422 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:14.422 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.423 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:14.423 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:14.423 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:14.423 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:14.423 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:14.423 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:14.423 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:14.423 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:14.423 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:14.423 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:14.423 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:14.424 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:14.424 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:14.424 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.424 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:14.424 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:14.424 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:14.424 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:14.424 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:14.424 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:14.424 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:14.424 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:14.424 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:14.424 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:14.425 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:14.425 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.425 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.425 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:14.425 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.425 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:14.425 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:14.425 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:14.425 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:14.425 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:14.425 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:14.425 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:14.426 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:14.426 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:14.426 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:14.426 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:14.426 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:14.426 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:14.426 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:14.426 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:14.426 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:14.426 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:14.426 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:14.427 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:14.427 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:14.427 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:14.427 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:14.427 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:14.427 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:14.427 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:14.427 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:14.427 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:14.427 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:14.427 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.427 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.427 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:14.428 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.428 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:14.428 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:14.428 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.428 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:14.428 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:14.428 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:14.428 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:14.428 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:14.428 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.428 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:14.429 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:14.429 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.429 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.429 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:14.429 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:14.429 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.429 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.429 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:14.429 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:14.429 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:14.429 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:14.429 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:14.430 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.430 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.430 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:14.430 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:14.430 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:14.430 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.430 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:14.430 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.430 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:14.430 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.430 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:14.431 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.431 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(scope="package") 2023-10-05T12:49:14.431 INFO:teuthology.orchestra.run.smithi012.stdout: def configfile(): 2023-10-05T12:49:14.431 INFO:teuthology.orchestra.run.smithi012.stdout:> setup() 2023-10-05T12:49:14.431 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.431 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:309: 2023-10-05T12:49:14.431 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.431 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:272: in setup 2023-10-05T12:49:14.431 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:14.431 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:14.431 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:14.431 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:14.432 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:14.432 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:14.432 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:14.432 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:14.432 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:14.432 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:14.432 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:14.432 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:14.432 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:14.432 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:14.432 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:14.432 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:14.433 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:14.433 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:14.433 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:14.433 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:14.433 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:14.433 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:14.433 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:14.433 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:14.433 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:14.433 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:14.433 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:14.433 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:14.434 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:14.434 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:14.434 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:14.434 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:14.434 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:14.434 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:14.434 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:14.434 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:14.434 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:14.434 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:14.434 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:14.434 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.435 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.435 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:14.435 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:14.435 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.435 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:14.435 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.435 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:14.435 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:14.435 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:14.435 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:14.435 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:14.435 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:14.435 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:14.436 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:14.436 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:14.436 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:14.436 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:14.436 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:14.436 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:14.436 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.436 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:14.436 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:14.436 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:14.436 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:14.437 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:14.437 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:14.437 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:14.437 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:14.437 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:14.437 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:14.437 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:14.437 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.437 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.437 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:14.437 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:14.437 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:14.438 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:14.438 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:14.438 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.438 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.438 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:14.438 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:14.438 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:14.438 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:14.438 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:14.438 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.438 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:14.439 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:14.439 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:14.439 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:14.439 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:14.439 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:14.439 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.439 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:14.439 INFO:teuthology.orchestra.run.smithi012.stdout:______________________ ERROR at setup of test_csv_parser _______________________ 2023-10-05T12:49:14.439 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.439 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:14.439 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.439 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:14.440 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:14.440 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.440 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:14.440 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:14.440 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:14.440 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:14.440 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:14.440 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.440 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:14.440 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:14.440 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.440 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.441 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:14.441 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:14.441 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.441 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.441 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:14.441 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.441 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:14.441 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:14.441 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.441 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.441 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:14.441 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:14.442 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.442 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:14.442 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:14.442 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:14.442 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:14.442 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:14.442 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:14.442 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:14.442 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.442 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:14.442 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:14.442 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:14.443 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:14.443 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:14.443 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:14.443 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:14.443 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:14.443 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:14.443 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.443 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:14.443 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:14.443 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:14.443 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:14.443 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.443 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:14.444 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:14.444 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:14.444 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:14.444 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.444 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.444 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:14.444 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:14.444 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:14.444 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:14.444 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.444 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.444 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:14.445 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:14.445 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:14.445 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.445 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:14.445 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.445 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:14.445 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:14.445 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.445 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:14.445 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:14.445 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:14.445 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:14.445 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:14.446 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:14.446 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.446 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:14.446 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.446 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:14.446 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.446 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:14.446 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:14.446 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.446 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:14.446 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.446 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:14.447 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:14.447 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:14.447 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:14.447 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:14.447 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:14.447 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:14.447 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:14.447 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:14.447 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:14.447 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:14.447 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:14.448 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:14.448 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.448 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:14.448 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:14.448 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:14.448 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:14.448 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:14.448 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:14.448 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:14.448 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:14.448 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:14.449 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:14.449 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:14.449 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.449 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.449 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:14.449 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.449 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:14.449 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:14.449 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:14.449 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:14.449 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:14.449 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:14.450 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:14.450 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:14.450 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:14.450 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:14.450 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:14.450 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:14.450 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:14.450 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:14.450 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:14.450 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:14.450 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:14.451 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:14.451 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:14.451 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:14.451 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:14.451 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:14.451 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:14.451 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:14.451 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:14.451 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:14.451 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:14.451 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:14.452 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.452 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.452 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:14.452 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.452 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:14.452 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:14.452 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.452 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:14.452 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:14.452 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:14.452 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:14.452 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:14.453 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.453 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:14.453 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:14.453 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.453 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.453 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:14.453 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:14.453 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.453 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.453 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:14.453 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:14.453 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:14.454 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:14.454 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:14.454 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.454 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.454 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:14.454 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:14.454 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:14.454 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.454 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:14.454 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.454 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:14.455 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.455 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:14.455 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.455 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(scope="package") 2023-10-05T12:49:14.455 INFO:teuthology.orchestra.run.smithi012.stdout: def configfile(): 2023-10-05T12:49:14.455 INFO:teuthology.orchestra.run.smithi012.stdout:> setup() 2023-10-05T12:49:14.455 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.455 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:309: 2023-10-05T12:49:14.455 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.455 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:272: in setup 2023-10-05T12:49:14.455 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:14.455 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:14.456 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:14.456 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:14.456 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:14.456 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:14.456 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:14.456 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:14.456 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:14.456 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:14.456 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:14.456 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:14.456 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:14.456 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:14.457 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:14.457 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:14.457 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:14.457 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:14.457 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:14.457 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:14.457 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:14.457 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:14.457 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:14.457 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:14.457 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:14.457 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:14.457 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:14.458 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:14.458 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:14.458 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:14.458 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:14.458 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:14.458 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:14.458 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:14.458 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:14.458 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:14.458 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:14.458 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:14.459 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:14.459 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.459 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.459 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:14.459 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:14.459 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.459 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:14.459 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.459 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:14.459 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:14.459 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:14.459 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:14.460 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:14.460 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:14.460 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:14.460 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:14.460 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:14.460 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:14.460 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:14.460 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:14.460 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:14.460 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.460 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:14.460 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:14.461 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:14.461 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:14.461 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:14.461 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:14.461 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:14.461 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:14.461 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:14.461 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:14.461 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:14.461 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.461 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.461 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:14.462 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:14.462 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:14.462 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:14.462 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:14.462 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.462 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.462 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:14.462 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:14.462 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:14.462 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:14.462 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:14.462 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.463 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:14.463 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:14.463 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:14.463 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:14.463 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:14.463 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:14.463 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.463 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:14.463 INFO:teuthology.orchestra.run.smithi012.stdout:____________________ ERROR at setup of test_csv_definition _____________________ 2023-10-05T12:49:14.463 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.463 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:14.463 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.463 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:14.464 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:14.464 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.464 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:14.464 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:14.464 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:14.464 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:14.464 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:14.464 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.464 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:14.464 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:14.464 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.464 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.464 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:14.465 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:14.465 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.465 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.465 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:14.465 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.465 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:14.465 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:14.465 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.465 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.465 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:14.465 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:14.465 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.465 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:14.466 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:14.466 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:14.466 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:14.466 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:14.466 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:14.466 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:14.466 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.466 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:14.466 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:14.466 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:14.466 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:14.467 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:14.467 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:14.467 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:14.467 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:14.467 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:14.467 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.467 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:14.467 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:14.467 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:14.467 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:14.467 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.467 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:14.468 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:14.468 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:14.468 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:14.468 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.468 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.468 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:14.468 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:14.468 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:14.468 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:14.468 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.468 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.469 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:14.469 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:14.469 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:14.469 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.469 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:14.469 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.469 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:14.469 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:14.469 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.469 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:14.469 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:14.469 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:14.470 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:14.470 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:14.470 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:14.470 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.470 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:14.470 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.470 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:14.470 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.470 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:14.470 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:14.470 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.470 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:14.471 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.471 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:14.471 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:14.471 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:14.471 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:14.471 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:14.471 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:14.471 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:14.471 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:14.471 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:14.471 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:14.471 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:14.472 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:14.472 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:14.472 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.472 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:14.472 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:14.472 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:14.472 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:14.472 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:14.472 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:14.472 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:14.472 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:14.472 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:14.472 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:14.473 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:14.473 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.473 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.473 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:14.473 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.473 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:14.473 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:14.473 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:14.473 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:14.473 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:14.473 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:14.473 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:14.473 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:14.474 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:14.474 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:14.474 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:14.474 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:14.474 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:14.474 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:14.474 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:14.474 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:14.474 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:14.474 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:14.474 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:14.475 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:14.475 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:14.475 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:14.475 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:14.475 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:14.475 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:14.475 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:14.475 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:14.475 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:14.475 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.475 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.475 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:14.476 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.476 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:14.476 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:14.476 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.476 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:14.476 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:14.476 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:14.476 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:14.476 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:14.476 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.476 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:14.476 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:14.476 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.477 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.477 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:14.477 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:14.477 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.477 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.477 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:14.477 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:14.477 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:14.477 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:14.477 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:14.477 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.477 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.478 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:14.478 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:14.478 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:14.478 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.478 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:14.478 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.478 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:14.478 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.478 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:14.478 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.478 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(scope="package") 2023-10-05T12:49:14.478 INFO:teuthology.orchestra.run.smithi012.stdout: def configfile(): 2023-10-05T12:49:14.479 INFO:teuthology.orchestra.run.smithi012.stdout:> setup() 2023-10-05T12:49:14.479 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.479 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:309: 2023-10-05T12:49:14.479 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.479 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:272: in setup 2023-10-05T12:49:14.479 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:14.479 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:14.479 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:14.479 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:14.479 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:14.479 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:14.479 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:14.480 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:14.480 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:14.480 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:14.480 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:14.480 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:14.480 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:14.480 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:14.480 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:14.480 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:14.480 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:14.480 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:14.480 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:14.481 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:14.481 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:14.481 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:14.481 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:14.481 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:14.481 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:14.481 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:14.481 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:14.481 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:14.481 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:14.481 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:14.482 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:14.482 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:14.482 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:14.482 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:14.482 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:14.482 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:14.482 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:14.482 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:14.482 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:14.482 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.482 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.482 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:14.483 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:14.483 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.483 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:14.483 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.483 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:14.483 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:14.483 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:14.483 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:14.483 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:14.483 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:14.483 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:14.483 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:14.484 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:14.484 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:14.484 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:14.484 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:14.484 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:14.484 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.484 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:14.484 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:14.484 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:14.484 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:14.484 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:14.484 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:14.484 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:14.485 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:14.485 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:14.485 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:14.485 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:14.485 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.485 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.485 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:14.485 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:14.485 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:14.485 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:14.485 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:14.486 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.486 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.486 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:14.486 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:14.486 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:14.486 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:14.486 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:14.486 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.486 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:14.486 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:14.486 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:14.486 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:14.487 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:14.487 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:14.487 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.487 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:14.487 INFO:teuthology.orchestra.run.smithi012.stdout:___________________ ERROR at setup of test_schema_definition ___________________ 2023-10-05T12:49:14.487 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.487 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:14.487 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.487 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:14.487 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:14.487 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.487 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:14.488 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:14.488 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:14.488 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:14.488 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:14.488 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.488 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:14.488 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:14.488 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.488 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.488 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:14.488 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:14.488 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.489 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.489 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:14.489 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.489 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:14.489 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:14.489 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.489 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.489 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:14.489 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:14.489 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.489 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:14.489 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:14.490 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:14.490 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:14.490 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:14.490 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:14.490 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:14.490 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.490 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:14.490 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:14.490 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:14.490 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:14.490 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:14.491 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:14.491 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:14.491 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:14.491 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:14.491 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.491 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:14.491 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:14.491 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:14.491 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:14.491 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.491 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:14.491 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:14.492 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:14.492 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:14.492 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.492 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.492 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:14.492 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:14.492 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:14.492 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:14.492 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.492 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.492 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:14.492 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:14.493 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:14.493 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.493 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:14.493 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.493 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:14.493 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:14.493 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.493 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:14.493 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:14.493 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:14.493 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:14.493 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:14.494 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:14.494 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.494 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:14.494 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.494 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:14.494 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.494 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:14.494 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:14.494 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.494 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:14.494 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.494 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:14.494 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:14.495 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:14.495 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:14.495 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:14.495 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:14.495 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:14.495 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:14.495 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:14.495 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:14.495 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:14.495 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:14.495 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:14.496 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.496 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:14.496 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:14.496 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:14.496 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:14.496 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:14.496 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:14.496 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:14.496 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:14.496 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:14.496 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:14.496 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:14.497 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.497 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.497 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:14.497 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.497 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:14.497 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:14.497 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:14.497 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:14.497 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:14.497 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:14.497 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:14.497 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:14.498 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:14.498 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:14.498 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:14.498 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:14.498 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:14.498 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:14.498 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:14.498 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:14.498 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:14.498 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:14.498 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:14.498 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:14.499 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:14.499 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:14.499 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:14.499 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:14.499 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:14.499 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:14.499 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:14.499 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:14.499 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.499 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.499 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:14.499 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.500 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:14.500 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:14.500 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.500 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:14.500 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:14.500 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:14.500 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:14.500 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:14.500 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.500 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:14.500 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:14.500 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.501 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.501 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:14.501 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:14.501 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.501 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.501 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:14.501 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:14.501 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:14.501 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:14.501 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:14.501 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.501 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.502 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:14.502 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:14.502 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:14.502 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.502 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:14.502 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.502 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:14.502 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.502 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:14.502 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.502 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(scope="package") 2023-10-05T12:49:14.502 INFO:teuthology.orchestra.run.smithi012.stdout: def configfile(): 2023-10-05T12:49:14.503 INFO:teuthology.orchestra.run.smithi012.stdout:> setup() 2023-10-05T12:49:14.503 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.503 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:309: 2023-10-05T12:49:14.503 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.503 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:272: in setup 2023-10-05T12:49:14.503 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:14.503 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:14.503 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:14.503 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:14.503 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:14.503 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:14.503 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:14.504 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:14.504 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:14.504 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:14.504 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:14.504 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:14.504 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:14.504 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:14.504 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:14.504 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:14.504 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:14.504 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:14.504 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:14.505 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:14.505 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:14.505 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:14.505 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:14.505 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:14.505 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:14.505 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:14.505 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:14.505 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:14.505 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:14.505 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:14.505 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:14.506 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:14.506 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:14.506 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:14.506 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:14.506 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:14.506 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:14.506 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:14.506 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:14.506 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.506 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.506 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:14.506 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:14.507 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.507 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:14.507 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.507 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:14.507 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:14.507 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:14.507 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:14.507 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:14.507 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:14.507 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:14.507 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:14.507 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:14.508 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:14.508 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:14.508 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:14.508 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:14.508 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.508 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:14.508 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:14.508 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:14.508 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:14.508 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:14.508 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:14.508 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:14.509 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:14.509 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:14.509 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:14.509 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:14.509 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.509 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.509 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:14.509 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:14.509 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:14.509 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:14.509 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:14.510 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.510 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.510 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:14.510 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:14.510 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:14.510 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:14.510 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:14.510 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.510 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:14.510 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:14.510 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:14.511 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:14.511 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:14.511 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:14.511 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.511 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:14.511 INFO:teuthology.orchestra.run.smithi012.stdout:______________ ERROR at setup of test_when_then_else_expressions _______________ 2023-10-05T12:49:14.511 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.511 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:14.511 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.511 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:14.511 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:14.511 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.512 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:14.512 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:14.512 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:14.512 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:14.512 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:14.512 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.512 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:14.512 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:14.512 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.512 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.512 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:14.512 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:14.513 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.513 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.513 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:14.513 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.513 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:14.513 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:14.513 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.513 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.513 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:14.513 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:14.513 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.513 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:14.514 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:14.514 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:14.514 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:14.514 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:14.514 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:14.514 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:14.514 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.514 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:14.514 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:14.514 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:14.514 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:14.514 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:14.515 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:14.515 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:14.515 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:14.515 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:14.515 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.515 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:14.515 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:14.515 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:14.515 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:14.515 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.515 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:14.515 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:14.516 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:14.516 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:14.516 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.516 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.516 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:14.516 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:14.516 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:14.516 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:14.516 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.516 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.516 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:14.516 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:14.517 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:14.517 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.517 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:14.517 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.517 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:14.517 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:14.517 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.517 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:14.517 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:14.517 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:14.517 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:14.517 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:14.518 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:14.518 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.518 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:14.518 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.518 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:14.518 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.518 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:14.518 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:14.518 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.518 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:14.518 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.519 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:14.519 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:14.519 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:14.519 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:14.519 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:14.519 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:14.519 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:14.519 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:14.519 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:14.519 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:14.519 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:14.519 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:14.520 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:14.520 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.520 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:14.520 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:14.520 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:14.520 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:14.520 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:14.520 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:14.520 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:14.520 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:14.520 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:14.520 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:14.521 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:14.521 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.521 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.521 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:14.521 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.521 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:14.521 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:14.521 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:14.521 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:14.521 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:14.521 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:14.522 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:14.522 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:14.522 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:14.522 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:14.522 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:14.522 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:14.522 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:14.522 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:14.522 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:14.522 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:14.522 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:14.522 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:14.523 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:14.523 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:14.523 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:14.523 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:14.523 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:14.523 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:14.523 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:14.523 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:14.523 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:14.523 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:14.523 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.523 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.524 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:14.524 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.524 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:14.524 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:14.524 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.524 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:14.524 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:14.524 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:14.524 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:14.524 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:14.524 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.525 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:14.525 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:14.525 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.525 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.525 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:14.525 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:14.525 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.525 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.525 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:14.525 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:14.525 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:14.525 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:14.526 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:14.526 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.526 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.526 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:14.526 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:14.526 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:14.526 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.526 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:14.526 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.526 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:14.526 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.527 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:14.527 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.527 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(scope="package") 2023-10-05T12:49:14.527 INFO:teuthology.orchestra.run.smithi012.stdout: def configfile(): 2023-10-05T12:49:14.527 INFO:teuthology.orchestra.run.smithi012.stdout:> setup() 2023-10-05T12:49:14.527 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.527 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:309: 2023-10-05T12:49:14.527 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.527 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:272: in setup 2023-10-05T12:49:14.527 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:14.527 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:14.527 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:14.528 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:14.528 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:14.528 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:14.528 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:14.528 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:14.528 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:14.528 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:14.528 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:14.528 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:14.528 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:14.528 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:14.529 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:14.529 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:14.529 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:14.529 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:14.529 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:14.529 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:14.529 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:14.529 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:14.529 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:14.529 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:14.529 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:14.529 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:14.529 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:14.530 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:14.530 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:14.530 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:14.530 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:14.530 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:14.530 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:14.530 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:14.530 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:14.530 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:14.530 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:14.530 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:14.531 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:14.531 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.531 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.531 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:14.531 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:14.531 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.531 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:14.531 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.531 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:14.531 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:14.531 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:14.531 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:14.532 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:14.532 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:14.532 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:14.532 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:14.532 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:14.532 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:14.532 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:14.532 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:14.532 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:14.532 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.532 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:14.532 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:14.533 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:14.533 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:14.533 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:14.533 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:14.533 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:14.533 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:14.533 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:14.533 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:14.533 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:14.533 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.533 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.533 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:14.534 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:14.534 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:14.534 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:14.534 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:14.534 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.534 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.534 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:14.534 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:14.534 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:14.534 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:14.534 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:14.534 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.535 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:14.535 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:14.535 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:14.535 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:14.535 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:14.535 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:14.535 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.535 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:14.535 INFO:teuthology.orchestra.run.smithi012.stdout:_________________ ERROR at setup of test_coalesce_expressions __________________ 2023-10-05T12:49:14.535 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.535 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:14.535 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.536 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:14.536 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:14.536 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.536 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:14.536 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:14.536 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:14.536 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:14.536 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:14.536 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.536 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:14.536 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:14.537 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.537 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.537 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:14.537 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:14.537 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.537 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.537 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:14.537 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.537 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:14.537 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:14.537 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.537 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.538 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:14.538 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:14.538 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.538 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:14.538 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:14.538 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:14.538 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:14.538 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:14.538 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:14.538 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:14.538 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.538 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:14.539 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:14.539 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:14.539 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:14.539 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:14.539 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:14.539 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:14.539 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:14.539 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:14.539 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.539 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:14.540 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:14.540 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:14.540 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:14.540 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.540 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:14.540 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:14.540 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:14.540 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:14.540 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.540 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.540 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:14.540 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:14.540 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:14.541 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:14.541 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.541 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.541 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:14.541 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:14.541 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:14.541 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.541 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:14.541 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.541 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:14.541 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:14.542 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.542 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:14.542 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:14.542 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:14.542 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:14.542 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:14.542 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:14.542 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.542 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:14.542 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.542 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:14.543 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.543 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:14.543 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:14.543 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.543 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:14.543 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.543 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:14.543 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:14.543 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:14.543 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:14.543 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:14.543 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:14.544 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:14.544 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:14.544 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:14.544 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:14.544 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:14.544 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:14.544 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:14.544 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.544 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:14.544 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:14.544 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:14.544 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:14.545 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:14.545 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:14.545 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:14.545 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:14.545 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:14.545 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:14.545 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:14.545 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.545 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.545 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:14.545 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.545 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:14.546 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:14.546 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:14.546 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:14.546 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:14.546 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:14.546 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:14.546 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:14.546 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:14.546 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:14.546 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:14.546 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:14.546 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:14.547 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:14.547 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:14.547 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:14.547 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:14.547 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:14.547 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:14.547 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:14.547 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:14.547 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:14.547 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:14.547 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:14.548 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:14.548 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:14.548 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:14.548 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:14.548 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.548 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.548 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:14.548 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.548 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:14.548 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:14.548 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.549 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:14.549 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:14.549 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:14.549 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:14.549 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:14.549 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.549 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:14.549 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:14.549 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.549 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.549 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:14.549 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:14.549 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.550 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.550 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:14.550 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:14.550 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:14.550 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:14.550 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:14.550 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.550 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.550 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:14.550 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:14.550 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:14.551 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.551 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:14.551 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.551 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:14.551 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.551 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:14.551 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.551 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(scope="package") 2023-10-05T12:49:14.551 INFO:teuthology.orchestra.run.smithi012.stdout: def configfile(): 2023-10-05T12:49:14.551 INFO:teuthology.orchestra.run.smithi012.stdout:> setup() 2023-10-05T12:49:14.556 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.556 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:309: 2023-10-05T12:49:14.557 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.557 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:272: in setup 2023-10-05T12:49:14.557 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:14.557 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:14.557 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:14.557 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:14.557 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:14.557 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:14.557 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:14.557 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:14.557 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:14.557 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:14.558 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:14.558 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:14.558 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:14.558 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:14.558 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:14.558 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:14.558 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:14.558 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:14.558 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:14.558 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:14.558 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:14.558 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:14.559 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:14.559 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:14.559 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:14.559 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:14.559 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:14.559 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:14.559 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:14.559 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:14.559 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:14.559 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:14.560 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:14.560 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:14.560 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:14.560 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:14.560 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:14.560 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:14.560 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:14.560 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.560 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.560 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:14.560 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:14.560 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.561 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:14.561 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.561 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:14.561 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:14.561 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:14.561 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:14.561 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:14.561 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:14.561 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:14.561 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:14.561 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:14.561 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:14.562 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:14.562 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:14.562 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:14.562 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.562 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:14.562 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:14.562 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:14.562 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:14.562 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:14.562 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:14.562 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:14.562 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:14.563 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:14.563 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:14.563 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:14.563 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.563 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.563 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:14.563 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:14.563 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:14.563 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:14.563 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:14.563 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.563 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.564 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:14.564 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:14.564 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:14.564 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:14.564 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:14.564 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.564 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:14.564 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:14.564 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:14.564 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:14.564 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:14.564 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:14.565 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.565 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:14.565 INFO:teuthology.orchestra.run.smithi012.stdout:___________________ ERROR at setup of test_cast_expressions ____________________ 2023-10-05T12:49:14.565 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.565 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:14.565 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.565 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:14.565 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:14.565 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.565 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:14.565 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:14.565 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:14.566 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:14.566 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:14.566 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.566 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:14.566 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:14.566 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.566 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.566 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:14.566 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:14.566 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.566 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.566 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:14.567 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.567 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:14.567 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:14.567 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.567 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.567 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:14.567 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:14.567 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.567 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:14.567 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:14.567 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:14.568 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:14.568 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:14.568 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:14.568 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:14.568 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.568 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:14.568 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:14.568 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:14.568 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:14.568 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:14.568 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:14.568 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:14.569 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:14.569 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:14.569 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.569 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:14.569 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:14.569 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:14.569 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:14.569 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.569 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:14.569 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:14.569 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:14.569 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:14.570 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.570 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.570 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:14.570 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:14.570 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:14.570 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:14.570 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.570 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.570 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:14.570 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:14.570 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:14.571 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.571 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:14.571 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.571 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:14.571 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:14.571 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.571 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:14.571 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:14.571 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:14.571 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:14.571 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:14.571 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:14.572 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.572 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:14.572 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.572 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:14.572 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.572 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:14.572 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:14.572 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.572 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:14.572 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.572 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:14.572 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:14.573 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:14.573 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:14.573 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:14.573 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:14.573 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:14.573 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:14.573 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:14.573 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:14.573 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:14.573 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:14.573 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:14.574 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.574 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:14.574 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:14.574 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:14.574 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:14.574 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:14.574 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:14.574 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:14.574 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:14.574 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:14.574 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:14.575 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:14.575 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.575 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.575 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:14.575 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.575 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:14.575 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:14.575 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:14.575 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:14.575 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:14.575 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:14.575 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:14.576 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:14.576 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:14.576 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:14.576 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:14.576 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:14.576 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:14.576 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:14.576 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:14.576 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:14.576 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:14.576 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:14.576 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:14.577 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:14.577 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:14.577 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:14.577 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:14.577 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:14.577 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:14.577 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:14.577 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:14.577 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:14.577 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.577 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.577 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:14.578 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.578 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:14.578 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:14.578 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.578 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:14.578 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:14.578 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:14.578 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:14.578 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:14.578 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.578 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:14.578 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:14.579 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.579 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.579 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:14.579 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:14.579 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.579 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.579 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:14.579 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:14.579 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:14.579 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:14.579 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:14.579 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.580 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.580 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:14.580 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:14.580 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:14.580 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.580 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:14.580 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.580 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:14.580 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.580 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:14.580 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.580 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(scope="package") 2023-10-05T12:49:14.581 INFO:teuthology.orchestra.run.smithi012.stdout: def configfile(): 2023-10-05T12:49:14.581 INFO:teuthology.orchestra.run.smithi012.stdout:> setup() 2023-10-05T12:49:14.581 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.581 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:309: 2023-10-05T12:49:14.581 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.581 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:272: in setup 2023-10-05T12:49:14.581 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:14.581 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:14.581 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:14.581 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:14.581 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:14.581 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:14.582 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:14.582 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:14.582 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:14.582 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:14.582 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:14.582 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:14.582 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:14.582 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:14.582 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:14.582 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:14.582 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:14.582 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:14.583 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:14.583 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:14.583 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:14.583 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:14.583 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:14.583 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:14.583 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:14.583 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:14.583 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:14.583 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:14.583 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:14.583 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:14.584 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:14.584 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:14.584 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:14.584 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:14.584 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:14.584 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:14.584 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:14.584 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:14.584 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:14.584 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.584 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.584 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:14.585 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:14.585 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.585 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:14.585 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.585 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:14.585 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:14.585 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:14.585 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:14.585 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:14.585 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:14.585 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:14.585 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:14.586 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:14.586 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:14.586 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:14.586 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:14.586 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:14.586 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.586 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:14.586 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:14.586 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:14.586 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:14.586 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:14.586 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:14.587 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:14.587 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:14.587 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:14.587 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:14.587 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:14.587 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.587 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.587 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:14.587 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:14.587 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:14.587 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:14.591 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:14.591 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.591 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.591 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:14.591 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:14.591 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:14.592 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:14.592 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:14.592 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.592 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:14.592 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:14.592 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:14.592 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:14.592 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:14.592 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:14.592 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.592 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:14.592 INFO:teuthology.orchestra.run.smithi012.stdout:________________________ ERROR at setup of test_version ________________________ 2023-10-05T12:49:14.593 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.593 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:14.593 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.593 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:14.593 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:14.593 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.593 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:14.593 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:14.593 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:14.593 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:14.593 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:14.593 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.593 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:14.594 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:14.594 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.594 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.594 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:14.594 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:14.594 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.594 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.594 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:14.594 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.594 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:14.594 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:14.594 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.595 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.595 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:14.595 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:14.595 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.595 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:14.595 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:14.595 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:14.595 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:14.595 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:14.595 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:14.595 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:14.595 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.595 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:14.596 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:14.596 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:14.596 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:14.596 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:14.596 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:14.596 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:14.596 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:14.596 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:14.596 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.596 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:14.596 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:14.596 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:14.596 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:14.597 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.597 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:14.597 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:14.597 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:14.597 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:14.597 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.597 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.597 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:14.597 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:14.597 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:14.597 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:14.597 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.598 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.598 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:14.598 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:14.598 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:14.598 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.598 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:14.598 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.598 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:14.598 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:14.598 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.598 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:14.598 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:14.599 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:14.599 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:14.599 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:14.599 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:14.599 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.599 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:14.599 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.599 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:14.599 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.599 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:14.599 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:14.599 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.599 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:14.600 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.600 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:14.600 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:14.600 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:14.600 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:14.600 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:14.600 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:14.600 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:14.600 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:14.600 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:14.600 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:14.600 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:14.601 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:14.601 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:14.601 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.601 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:14.601 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:14.601 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:14.601 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:14.601 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:14.601 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:14.601 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:14.601 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:14.601 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:14.601 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:14.601 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:14.602 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.602 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.602 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:14.602 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.602 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:14.602 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:14.602 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:14.602 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:14.602 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:14.602 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:14.602 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:14.602 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:14.603 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:14.603 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:14.603 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:14.603 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:14.603 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:14.603 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:14.603 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:14.603 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:14.603 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:14.603 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:14.603 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:14.603 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:14.603 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:14.604 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:14.604 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:14.604 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:14.604 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:14.604 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:14.604 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:14.604 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:14.604 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.604 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.604 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:14.604 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.604 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:14.604 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:14.605 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.605 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:14.605 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:14.605 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:14.605 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:14.605 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:14.605 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.605 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:14.605 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:14.605 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.605 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.606 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:14.606 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:14.606 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.606 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.606 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:14.606 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:14.606 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:14.606 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:14.606 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:14.606 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.606 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.606 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:14.607 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:14.607 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:14.607 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.607 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:14.607 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.607 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:14.607 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.607 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:14.607 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.607 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(scope="package") 2023-10-05T12:49:14.607 INFO:teuthology.orchestra.run.smithi012.stdout: def configfile(): 2023-10-05T12:49:14.607 INFO:teuthology.orchestra.run.smithi012.stdout:> setup() 2023-10-05T12:49:14.607 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.608 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:309: 2023-10-05T12:49:14.608 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.608 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:272: in setup 2023-10-05T12:49:14.608 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:14.608 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:14.608 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:14.608 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:14.608 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:14.608 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:14.608 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:14.608 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:14.608 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:14.609 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:14.609 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:14.609 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:14.609 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:14.609 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:14.609 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:14.609 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:14.609 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:14.609 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:14.609 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:14.609 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:14.609 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:14.610 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:14.610 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:14.610 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:14.610 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:14.610 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:14.610 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:14.610 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:14.610 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:14.610 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:14.610 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:14.610 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:14.610 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:14.611 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:14.611 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:14.611 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:14.611 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:14.611 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:14.611 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:14.611 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.611 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.611 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:14.611 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:14.611 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.611 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:14.611 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.612 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:14.612 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:14.612 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:14.612 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:14.612 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:14.612 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:14.612 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:14.612 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:14.612 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:14.612 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:14.612 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:14.612 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:14.613 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:14.613 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.613 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:14.613 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:14.613 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:14.613 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:14.613 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:14.613 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:14.613 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:14.613 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:14.613 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:14.613 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:14.614 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:14.614 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.614 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.614 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:14.614 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:14.614 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:14.614 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:14.614 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:14.614 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.614 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.614 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:14.614 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:14.615 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:14.615 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:14.615 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:14.615 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.615 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:14.615 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:14.615 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:14.615 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:14.615 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:14.615 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:14.615 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.615 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:14.615 INFO:teuthology.orchestra.run.smithi012.stdout:___________________ ERROR at setup of test_trim_expressions ____________________ 2023-10-05T12:49:14.615 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.616 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:14.616 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.616 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:14.616 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:14.616 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.616 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:14.616 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:14.616 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:14.616 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:14.616 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:14.616 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.616 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:14.616 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:14.617 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.617 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.617 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:14.617 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:14.617 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.617 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.617 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:14.617 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.617 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:14.617 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:14.617 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.617 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.617 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:14.618 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:14.618 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.618 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:14.618 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:14.618 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:14.618 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:14.618 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:14.618 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:14.618 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:14.618 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.618 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:14.618 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:14.619 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:14.619 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:14.619 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:14.619 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:14.619 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:14.619 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:14.619 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:14.619 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.619 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:14.619 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:14.620 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:14.620 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:14.620 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.620 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:14.620 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:14.620 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:14.620 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:14.620 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.620 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.620 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:14.620 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:14.620 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:14.621 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:14.621 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.621 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.621 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:14.621 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:14.621 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:14.621 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.621 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:14.621 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.621 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:14.621 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:14.621 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.622 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:14.622 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:14.622 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:14.622 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:14.622 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:14.622 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:14.622 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.622 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:14.622 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.622 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:14.622 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.623 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:14.623 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:14.623 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.623 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:14.623 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.623 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:14.623 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:14.623 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:14.623 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:14.623 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:14.623 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:14.623 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:14.624 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:14.624 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:14.624 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:14.624 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:14.624 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:14.624 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:14.624 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.624 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:14.624 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:14.624 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:14.624 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:14.625 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:14.625 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:14.625 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:14.625 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:14.625 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:14.625 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:14.625 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:14.625 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.625 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.625 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:14.625 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.625 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:14.625 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:14.626 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:14.626 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:14.626 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:14.626 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:14.626 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:14.626 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:14.626 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:14.626 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:14.626 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:14.626 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:14.626 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:14.627 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:14.627 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:14.627 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:14.627 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:14.627 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:14.627 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:14.627 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:14.627 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:14.627 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:14.627 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:14.627 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:14.627 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:14.628 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:14.628 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:14.628 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:14.628 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.628 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.628 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:14.628 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.628 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:14.628 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:14.628 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.628 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:14.629 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:14.629 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:14.629 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:14.629 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:14.629 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.629 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:14.629 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:14.629 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.629 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.629 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:14.629 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:14.630 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.630 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.630 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:14.630 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:14.630 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:14.630 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:14.630 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:14.630 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.630 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.630 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:14.630 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:14.630 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:14.631 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.631 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:14.631 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.631 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:14.631 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.631 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:14.631 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.631 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(scope="package") 2023-10-05T12:49:14.631 INFO:teuthology.orchestra.run.smithi012.stdout: def configfile(): 2023-10-05T12:49:14.631 INFO:teuthology.orchestra.run.smithi012.stdout:> setup() 2023-10-05T12:49:14.631 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.631 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:309: 2023-10-05T12:49:14.631 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.632 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:272: in setup 2023-10-05T12:49:14.632 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:14.632 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:14.632 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:14.632 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:14.632 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:14.632 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:14.632 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:14.632 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:14.632 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:14.632 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:14.633 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:14.633 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:14.633 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:14.633 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:14.633 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:14.633 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:14.633 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:14.633 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:14.633 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:14.633 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:14.633 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:14.633 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:14.634 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:14.634 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:14.634 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:14.634 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:14.634 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:14.634 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:14.634 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:14.634 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:14.634 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:14.634 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:14.634 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:14.635 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:14.635 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:14.635 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:14.635 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:14.635 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:14.635 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:14.635 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.635 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.635 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:14.635 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:14.635 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.636 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:14.636 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.636 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:14.636 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:14.636 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:14.636 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:14.636 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:14.636 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:14.636 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:14.636 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:14.636 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:14.636 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:14.637 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:14.637 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:14.637 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:14.637 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.637 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:14.637 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:14.637 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:14.637 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:14.637 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:14.637 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:14.637 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:14.637 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:14.637 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:14.638 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:14.638 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:14.638 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.638 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.638 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:14.638 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:14.638 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:14.638 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:14.638 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:14.638 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.638 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.639 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:14.639 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:14.639 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:14.639 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:14.639 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:14.639 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.639 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:14.639 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:14.639 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:14.639 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:14.639 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:14.639 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:14.640 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.640 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:14.640 INFO:teuthology.orchestra.run.smithi012.stdout:______________ ERROR at setup of test_truefalse_trim_expressions _______________ 2023-10-05T12:49:14.640 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.640 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:14.640 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.640 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:14.640 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:14.640 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.640 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:14.640 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:14.640 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:14.641 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:14.641 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:14.641 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.641 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:14.641 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:14.641 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.641 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.641 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:14.641 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:14.641 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.641 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.641 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:14.641 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.642 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:14.642 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:14.642 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.642 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.642 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:14.642 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:14.642 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.642 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:14.642 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:14.642 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:14.642 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:14.642 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:14.643 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:14.643 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:14.643 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.643 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:14.643 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:14.643 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:14.643 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:14.643 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:14.643 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:14.643 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:14.643 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:14.643 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:14.644 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.644 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:14.644 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:14.644 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:14.644 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:14.644 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.644 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:14.644 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:14.644 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:14.644 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:14.644 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.644 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.644 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:14.645 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:14.645 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:14.645 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:14.645 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.645 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.645 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:14.645 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:14.645 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:14.645 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.645 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:14.645 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.645 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:14.645 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:14.646 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.646 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:14.646 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:14.646 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:14.646 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:14.646 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:14.646 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:14.646 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.646 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:14.646 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.646 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:14.646 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.647 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:14.647 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:14.647 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.647 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:14.647 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.647 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:14.647 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:14.647 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:14.647 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:14.647 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:14.647 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:14.647 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:14.647 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:14.648 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:14.648 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:14.648 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:14.648 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:14.648 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:14.648 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.648 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:14.648 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:14.648 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:14.648 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:14.648 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:14.649 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:14.649 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:14.649 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:14.649 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:14.649 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:14.649 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:14.649 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.649 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.649 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:14.655 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.655 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:14.655 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:14.655 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:14.655 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:14.655 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:14.655 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:14.655 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:14.656 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:14.656 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:14.656 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:14.656 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:14.656 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:14.656 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:14.656 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:14.656 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:14.656 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:14.656 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:14.656 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:14.657 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:14.657 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:14.657 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:14.657 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:14.657 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:14.657 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:14.657 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:14.657 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:14.657 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:14.657 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:14.657 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.658 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.658 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:14.658 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.658 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:14.658 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:14.658 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.658 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:14.658 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:14.658 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:14.658 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:14.658 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:14.659 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.659 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:14.659 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:14.659 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.659 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.659 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:14.659 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:14.659 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.659 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.659 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:14.659 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:14.660 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:14.660 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:14.660 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:14.660 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.660 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.660 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:14.660 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:14.660 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:14.660 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.660 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:14.660 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.660 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:14.661 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.661 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:14.661 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.661 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(scope="package") 2023-10-05T12:49:14.661 INFO:teuthology.orchestra.run.smithi012.stdout: def configfile(): 2023-10-05T12:49:14.661 INFO:teuthology.orchestra.run.smithi012.stdout:> setup() 2023-10-05T12:49:14.661 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.661 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:309: 2023-10-05T12:49:14.661 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.661 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:272: in setup 2023-10-05T12:49:14.661 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:14.662 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:14.662 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:14.662 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:14.662 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:14.662 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:14.662 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:14.662 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:14.662 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:14.662 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:14.662 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:14.662 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:14.663 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:14.663 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:14.663 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:14.663 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:14.663 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:14.663 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:14.663 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:14.663 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:14.663 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:14.663 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:14.663 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:14.663 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:14.664 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:14.664 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:14.664 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:14.664 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:14.664 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:14.664 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:14.664 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:14.664 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:14.664 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:14.664 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:14.664 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:14.664 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:14.665 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:14.665 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:14.665 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:14.665 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.665 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.665 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:14.665 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:14.665 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.665 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:14.665 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.665 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:14.665 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:14.666 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:14.666 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:14.666 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:14.666 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:14.666 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:14.666 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:14.666 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:14.666 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:14.666 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:14.666 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:14.666 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:14.666 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.667 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:14.667 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:14.667 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:14.667 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:14.667 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:14.667 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:14.667 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:14.667 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:14.667 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:14.667 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:14.667 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:14.668 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.668 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.668 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:14.668 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:14.668 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:14.668 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:14.668 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:14.668 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.668 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.668 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:14.668 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:14.668 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:14.669 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:14.669 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:14.669 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.669 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:14.669 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:14.669 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:14.669 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:14.669 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:14.669 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:14.670 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.670 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:14.670 INFO:teuthology.orchestra.run.smithi012.stdout:__________________ ERROR at setup of test_escape_expressions ___________________ 2023-10-05T12:49:14.670 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.670 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:14.670 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.670 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:14.670 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:14.670 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.670 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:14.670 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:14.671 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:14.671 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:14.671 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:14.671 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.671 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:14.671 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:14.671 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.671 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.671 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:14.671 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:14.671 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.671 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.671 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:14.672 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.672 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:14.672 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:14.672 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.672 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.672 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:14.672 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:14.672 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.672 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:14.672 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:14.672 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:14.673 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:14.673 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:14.673 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:14.673 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:14.673 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.673 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:14.673 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:14.673 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:14.673 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:14.673 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:14.673 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:14.673 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:14.674 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:14.674 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:14.674 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.674 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:14.674 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:14.674 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:14.674 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:14.674 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.674 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:14.674 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:14.674 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:14.674 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:14.675 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.675 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.675 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:14.675 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:14.675 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:14.675 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:14.675 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.675 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.675 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:14.675 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:14.675 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:14.675 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.676 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:14.676 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.676 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:14.676 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:14.676 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.676 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:14.676 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:14.676 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:14.676 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:14.676 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:14.676 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:14.676 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.677 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:14.677 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.677 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:14.677 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.677 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:14.677 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:14.677 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.677 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:14.677 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.677 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:14.677 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:14.677 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:14.678 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:14.678 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:14.678 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:14.678 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:14.678 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:14.678 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:14.678 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:14.678 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:14.678 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:14.678 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:14.678 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.678 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:14.679 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:14.679 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:14.679 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:14.679 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:14.679 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:14.679 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:14.679 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:14.679 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:14.679 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:14.679 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:14.679 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.679 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.680 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:14.680 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.680 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:14.680 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:14.680 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:14.680 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:14.680 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:14.680 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:14.680 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:14.680 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:14.680 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:14.681 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:14.681 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:14.681 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:14.681 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:14.681 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:14.681 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:14.681 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:14.681 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:14.681 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:14.681 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:14.681 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:14.681 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:14.682 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:14.682 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:14.682 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:14.682 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:14.682 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:14.682 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:14.682 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:14.682 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.682 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.682 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:14.682 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.683 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:14.683 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:14.683 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.683 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:14.683 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:14.683 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:14.683 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:14.683 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:14.683 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.683 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:14.683 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:14.683 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.684 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.684 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:14.684 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:14.684 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.684 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.684 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:14.684 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:14.684 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:14.684 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:14.684 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:14.685 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.685 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.685 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:14.685 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:14.685 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:14.685 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.685 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:14.685 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.685 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:14.685 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.685 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:14.685 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.686 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(scope="package") 2023-10-05T12:49:14.686 INFO:teuthology.orchestra.run.smithi012.stdout: def configfile(): 2023-10-05T12:49:14.686 INFO:teuthology.orchestra.run.smithi012.stdout:> setup() 2023-10-05T12:49:14.686 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.686 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:309: 2023-10-05T12:49:14.686 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.686 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:272: in setup 2023-10-05T12:49:14.686 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:14.686 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:14.686 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:14.686 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:14.687 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:14.687 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:14.687 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:14.687 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:14.687 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:14.687 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:14.687 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:14.687 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:14.687 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:14.687 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:14.687 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:14.688 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:14.688 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:14.688 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:14.688 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:14.688 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:14.688 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:14.688 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:14.688 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:14.688 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:14.688 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:14.688 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:14.689 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:14.689 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:14.689 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:14.689 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:14.689 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:14.689 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:14.689 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:14.689 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:14.689 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:14.689 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:14.689 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:14.689 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:14.690 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:14.690 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.690 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.690 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:14.690 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:14.690 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.690 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:14.690 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.690 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:14.690 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:14.690 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:14.691 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:14.691 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:14.691 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:14.691 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:14.691 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:14.691 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:14.691 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:14.691 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:14.691 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:14.691 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:14.691 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.691 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:14.692 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:14.692 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:14.692 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:14.692 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:14.692 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:14.692 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:14.692 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:14.692 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:14.692 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:14.692 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:14.692 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.692 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.693 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:14.693 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:14.693 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:14.693 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:14.693 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:14.693 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.693 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.693 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:14.693 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:14.693 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:14.693 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:14.694 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:14.694 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.694 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:14.694 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:14.694 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:14.694 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:14.694 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:14.694 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:14.694 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.694 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:14.694 INFO:teuthology.orchestra.run.smithi012.stdout:________________ ERROR at setup of test_case_value_expressions _________________ 2023-10-05T12:49:14.695 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.695 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:14.695 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.695 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:14.695 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:14.695 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.695 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:14.695 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:14.695 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:14.695 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:14.695 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:14.695 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.696 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:14.696 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:14.696 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.696 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.696 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:14.696 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:14.696 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.696 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.696 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:14.696 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.696 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:14.696 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:14.697 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.697 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.697 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:14.697 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:14.697 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.697 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:14.697 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:14.697 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:14.697 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:14.697 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:14.697 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:14.698 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:14.698 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.698 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:14.698 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:14.698 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:14.698 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:14.698 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:14.698 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:14.698 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:14.698 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:14.698 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:14.699 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.699 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:14.699 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:14.699 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:14.699 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:14.699 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.699 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:14.699 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:14.699 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:14.699 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:14.700 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.700 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.700 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:14.700 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:14.700 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:14.700 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:14.700 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.700 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.700 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:14.700 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:14.700 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:14.701 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.701 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:14.701 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.701 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:14.701 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:14.701 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.701 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:14.701 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:14.701 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:14.701 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:14.701 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:14.701 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:14.702 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.702 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:14.702 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.702 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:14.702 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.702 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:14.702 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:14.702 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.702 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:14.702 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.703 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:14.703 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:14.703 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:14.703 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:14.703 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:14.703 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:14.703 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:14.703 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:14.703 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:14.703 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:14.703 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:14.703 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:14.704 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:14.704 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.704 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:14.704 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:14.704 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:14.704 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:14.704 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:14.704 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:14.704 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:14.704 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:14.704 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:14.704 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:14.705 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:14.705 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.705 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.705 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:14.705 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.705 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:14.705 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:14.705 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:14.705 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:14.705 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:14.705 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:14.705 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:14.706 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:14.706 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:14.706 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:14.706 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:14.706 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:14.706 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:14.706 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:14.706 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:14.706 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:14.706 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:14.706 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:14.707 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:14.707 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:14.707 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:14.707 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:14.707 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:14.707 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:14.707 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:14.707 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:14.707 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:14.707 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:14.707 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.708 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.708 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:14.708 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.708 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:14.708 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:14.708 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.708 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:14.708 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:14.708 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:14.708 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:14.708 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:14.709 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.709 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:14.709 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:14.709 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.709 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.709 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:14.709 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:14.709 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.709 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.709 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:14.709 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:14.709 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:14.710 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:14.710 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:14.710 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.710 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.710 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:14.710 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:14.710 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:14.710 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.710 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:14.710 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.710 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:14.710 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.711 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:14.711 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.711 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(scope="package") 2023-10-05T12:49:14.711 INFO:teuthology.orchestra.run.smithi012.stdout: def configfile(): 2023-10-05T12:49:14.711 INFO:teuthology.orchestra.run.smithi012.stdout:> setup() 2023-10-05T12:49:14.711 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.711 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:309: 2023-10-05T12:49:14.711 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.711 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:272: in setup 2023-10-05T12:49:14.711 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:14.711 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:14.712 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:14.712 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:14.712 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:14.712 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:14.712 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:14.712 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:14.712 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:14.712 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:14.712 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:14.712 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:14.712 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:14.712 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:14.713 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:14.713 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:14.713 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:14.713 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:14.713 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:14.713 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:14.713 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:14.713 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:14.713 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:14.713 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:14.713 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:14.713 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:14.713 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:14.714 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:14.714 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:14.714 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:14.714 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:14.714 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:14.714 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:14.714 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:14.714 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:14.714 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:14.714 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:14.714 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:14.715 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:14.715 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.715 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.715 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:14.715 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:14.715 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.717 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:14.717 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.717 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:14.717 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:14.717 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:14.717 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:14.717 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:14.718 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:14.718 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:14.718 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:14.718 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:14.718 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:14.718 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:14.718 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:14.718 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:14.718 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.718 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:14.718 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:14.719 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:14.719 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:14.719 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:14.719 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:14.719 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:14.719 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:14.719 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:14.719 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:14.719 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:14.719 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.719 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.719 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:14.719 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:14.720 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:14.720 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:14.720 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:14.720 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.720 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.720 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:14.720 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:14.720 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:14.720 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:14.720 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:14.720 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.720 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:14.721 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:14.721 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:14.721 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:14.721 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:14.721 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:14.721 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.721 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:14.721 INFO:teuthology.orchestra.run.smithi012.stdout:_________________ ERROR at setup of test_bool_cast_expressions _________________ 2023-10-05T12:49:14.721 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.721 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:14.721 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.721 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:14.722 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:14.722 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.722 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:14.722 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:14.722 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:14.722 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:14.722 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:14.722 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.722 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:14.722 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:14.722 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.723 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.723 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:14.723 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:14.723 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.723 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.723 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:14.723 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.723 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:14.723 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:14.723 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.723 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.723 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:14.723 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:14.723 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.724 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:14.724 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:14.724 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:14.724 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:14.724 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:14.724 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:14.724 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:14.724 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.724 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:14.724 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:14.724 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:14.724 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:14.724 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:14.725 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:14.725 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:14.725 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:14.725 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:14.725 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.725 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:14.725 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:14.725 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:14.725 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:14.725 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.725 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:14.725 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:14.725 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:14.726 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:14.726 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.726 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.726 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:14.726 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:14.726 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:14.726 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:14.726 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.726 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.726 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:14.726 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:14.726 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:14.727 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.727 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:14.727 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.727 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:14.727 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:14.727 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.727 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:14.727 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:14.727 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:14.727 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:14.727 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:14.727 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:14.728 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.728 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:14.728 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.728 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:14.728 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.728 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:14.728 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:14.728 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.728 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:14.728 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.728 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:14.728 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:14.729 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:14.729 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:14.729 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:14.729 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:14.729 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:14.729 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:14.729 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:14.729 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:14.729 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:14.729 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:14.729 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:14.730 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.730 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:14.730 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:14.730 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:14.730 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:14.730 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:14.730 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:14.730 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:14.730 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:14.730 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:14.730 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:14.730 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:14.731 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.731 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.731 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:14.731 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.731 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:14.731 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:14.731 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:14.731 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:14.731 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:14.731 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:14.732 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:14.732 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:14.732 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:14.732 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:14.732 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:14.732 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:14.732 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:14.732 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:14.732 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:14.732 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:14.732 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:14.732 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:14.733 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:14.733 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:14.733 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:14.733 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:14.733 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:14.733 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:14.733 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:14.733 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:14.733 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:14.733 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:14.733 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.734 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.734 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:14.734 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.734 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:14.734 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:14.734 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.734 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:14.734 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:14.734 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:14.734 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:14.734 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:14.734 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.735 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:14.735 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:14.735 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.735 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.735 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:14.735 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:14.735 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.735 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.735 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:14.735 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:14.735 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:14.736 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:14.736 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:14.736 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.736 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.736 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:14.736 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:14.736 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:14.736 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.736 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:14.736 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.736 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:14.736 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.737 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:14.737 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.737 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(scope="package") 2023-10-05T12:49:14.737 INFO:teuthology.orchestra.run.smithi012.stdout: def configfile(): 2023-10-05T12:49:14.737 INFO:teuthology.orchestra.run.smithi012.stdout:> setup() 2023-10-05T12:49:14.737 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.737 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:309: 2023-10-05T12:49:14.737 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.737 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:272: in setup 2023-10-05T12:49:14.737 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:14.737 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:14.738 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:14.738 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:14.738 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:14.738 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:14.738 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:14.738 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:14.738 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:14.738 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:14.738 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:14.738 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:14.738 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:14.739 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:14.739 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:14.739 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:14.739 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:14.739 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:14.739 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:14.739 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:14.739 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:14.739 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:14.739 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:14.739 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:14.740 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:14.740 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:14.740 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:14.740 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:14.740 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:14.740 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:14.740 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:14.740 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:14.740 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:14.740 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:14.740 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:14.740 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:14.741 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:14.741 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:14.741 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:14.741 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.741 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.741 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:14.741 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:14.741 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.741 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:14.741 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.741 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:14.741 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:14.741 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:14.742 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:14.742 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:14.742 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:14.742 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:14.742 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:14.742 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:14.742 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:14.742 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:14.742 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:14.742 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:14.742 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.742 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:14.743 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:14.743 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:14.743 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:14.743 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:14.743 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:14.743 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:14.743 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:14.743 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:14.743 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:14.743 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:14.743 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.743 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.744 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:14.744 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:14.744 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:14.744 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:14.744 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:14.744 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.744 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.744 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:14.744 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:14.744 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:14.744 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:14.744 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:14.745 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.745 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:14.745 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:14.745 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:14.745 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:14.745 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:14.745 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:14.745 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.745 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:14.745 INFO:teuthology.orchestra.run.smithi012.stdout:_________________ ERROR at setup of test_progress_expressions __________________ 2023-10-05T12:49:14.745 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.746 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:14.746 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.746 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:14.746 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:14.746 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.746 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:14.746 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:14.746 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:14.746 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:14.746 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:14.746 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.746 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:14.747 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:14.747 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.747 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.747 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:14.747 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:14.747 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.747 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.747 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:14.747 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.747 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:14.747 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:14.747 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.748 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.748 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:14.748 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:14.748 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.748 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:14.748 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:14.748 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:14.748 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:14.748 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:14.748 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:14.748 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:14.748 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.749 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:14.749 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:14.749 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:14.749 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:14.749 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:14.749 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:14.749 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:14.749 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:14.749 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:14.749 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.749 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:14.749 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:14.750 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:14.750 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:14.750 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.750 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:14.750 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:14.750 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:14.750 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:14.750 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.750 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.750 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:14.750 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:14.751 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:14.751 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:14.751 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.751 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.751 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:14.751 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:14.751 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:14.751 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.751 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:14.751 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.751 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:14.751 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:14.751 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.752 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:14.752 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:14.752 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:14.752 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:14.752 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:14.752 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:14.752 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.752 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:14.752 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.752 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:14.752 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.752 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:14.752 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:14.753 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.753 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:14.753 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.753 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:14.753 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:14.753 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:14.753 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:14.753 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:14.753 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:14.753 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:14.753 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:14.753 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:14.754 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:14.754 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:14.754 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:14.754 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:14.754 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.754 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:14.754 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:14.754 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:14.754 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:14.754 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:14.754 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:14.754 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:14.755 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:14.755 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:14.755 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:14.755 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:14.755 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.755 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.755 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:14.755 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.755 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:14.755 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:14.755 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:14.755 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:14.756 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:14.756 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:14.756 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:14.756 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:14.756 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:14.756 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:14.756 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:14.756 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:14.756 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:14.756 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:14.756 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:14.756 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:14.757 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:14.757 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:14.757 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:14.757 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:14.757 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:14.757 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:14.757 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:14.757 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:14.757 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:14.757 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:14.757 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:14.758 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:14.758 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.758 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.758 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:14.758 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.758 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:14.758 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:14.758 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.758 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:14.758 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:14.758 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:14.758 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:14.759 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:14.759 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.759 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:14.759 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:14.759 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.759 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.759 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:14.759 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:14.759 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.759 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.759 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:14.759 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:14.760 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:14.760 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:14.760 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:14.760 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.760 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.760 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:14.760 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:14.760 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:14.760 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.760 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:14.760 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.760 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:14.761 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.761 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:14.761 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.761 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(scope="package") 2023-10-05T12:49:14.761 INFO:teuthology.orchestra.run.smithi012.stdout: def configfile(): 2023-10-05T12:49:14.761 INFO:teuthology.orchestra.run.smithi012.stdout:> setup() 2023-10-05T12:49:14.761 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.761 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:309: 2023-10-05T12:49:14.761 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.761 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:272: in setup 2023-10-05T12:49:14.761 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:14.761 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:14.762 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:14.762 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:14.762 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:14.762 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:14.762 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:14.762 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:14.762 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:14.762 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:14.762 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:14.762 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:14.762 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:14.762 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:14.763 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:14.763 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:14.763 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:14.763 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:14.763 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:14.763 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:14.763 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:14.763 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:14.763 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:14.763 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:14.763 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:14.763 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:14.764 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:14.764 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:14.764 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:14.764 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:14.764 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:14.764 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:14.764 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:14.764 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:14.764 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:14.764 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:14.764 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:14.764 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:14.764 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:14.765 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.765 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.765 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:14.765 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:14.765 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.765 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:14.765 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.765 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:14.765 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:14.765 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:14.765 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:14.765 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:14.766 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:14.766 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:14.766 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:14.766 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:14.766 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:14.766 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:14.766 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:14.766 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:14.766 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.766 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:14.766 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:14.766 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:14.767 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:14.767 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:14.767 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:14.767 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:14.767 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:14.767 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:14.767 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:14.767 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:14.767 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.767 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.767 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:14.767 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:14.768 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:14.768 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:14.768 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:14.768 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.768 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.768 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:14.768 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:14.768 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:14.768 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:14.768 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:14.768 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.768 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:14.769 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:14.769 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:14.769 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:14.769 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:14.769 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:14.769 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.769 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:14.769 INFO:teuthology.orchestra.run.smithi012.stdout:_______________ ERROR at setup of test_output_serial_expressions _______________ 2023-10-05T12:49:14.769 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.769 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:14.769 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.769 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:14.770 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:14.770 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.770 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:14.770 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:14.770 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:14.770 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:14.770 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:14.770 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.770 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:14.770 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:14.770 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.770 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.771 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:14.771 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:14.771 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.771 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.771 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:14.771 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.771 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:14.771 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:14.771 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.771 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.771 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:14.771 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:14.772 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.772 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:14.772 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:14.772 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:14.772 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:14.772 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:14.772 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:14.772 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:14.772 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.772 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:14.772 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:14.772 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:14.772 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:14.773 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:14.773 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:14.773 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:14.773 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:14.773 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:14.773 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.773 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:14.773 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:14.773 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:14.773 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:14.773 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.773 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:14.773 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:14.774 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:14.774 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:14.774 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.774 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.774 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:14.774 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:14.774 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:14.774 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:14.774 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.774 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.774 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:14.775 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:14.775 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:14.775 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.775 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:14.775 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.775 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:14.775 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:14.775 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.775 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:14.775 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:14.775 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:14.776 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:14.776 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:14.776 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:14.776 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.776 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:14.776 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.776 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:14.776 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.776 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:14.776 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:14.776 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.776 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:14.776 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.777 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:14.777 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:14.777 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:14.777 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:14.777 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:14.777 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:14.777 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:14.777 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:14.777 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:14.777 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:14.777 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:14.777 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:14.778 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:14.778 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.778 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:14.778 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:14.778 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:14.778 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:14.778 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:14.778 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:14.778 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:14.778 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:14.778 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:14.779 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:14.779 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:14.779 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.779 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.779 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:14.779 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.779 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:14.779 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:14.779 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:14.779 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:14.779 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:14.779 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:14.780 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:14.780 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:14.780 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:14.780 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:14.780 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:14.780 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:14.780 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:14.780 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:14.780 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:14.780 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:14.780 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:14.780 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:14.780 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:14.781 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:14.781 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:14.781 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:14.781 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:14.781 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:14.781 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:14.781 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:14.781 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:14.781 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:14.781 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.781 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.781 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:14.781 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.782 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:14.782 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:14.782 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.782 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:14.782 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:14.782 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:14.782 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:14.782 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:14.782 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.782 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:14.782 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:14.782 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.782 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.783 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:14.783 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:14.783 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.783 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.783 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:14.783 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:14.783 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:14.783 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:14.783 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:14.783 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.783 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.783 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:14.784 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:14.784 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:14.784 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.784 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:14.784 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.784 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:14.784 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.784 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:14.784 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.784 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.fixture(scope="package") 2023-10-05T12:49:14.784 INFO:teuthology.orchestra.run.smithi012.stdout: def configfile(): 2023-10-05T12:49:14.784 INFO:teuthology.orchestra.run.smithi012.stdout:> setup() 2023-10-05T12:49:14.784 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.785 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:309: 2023-10-05T12:49:14.785 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.785 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:272: in setup 2023-10-05T12:49:14.785 INFO:teuthology.orchestra.run.smithi012.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-10-05T12:49:14.785 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-10-05T12:49:14.785 INFO:teuthology.orchestra.run.smithi012.stdout: buckets = get_buckets_list(client, prefix) 2023-10-05T12:49:14.785 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-10-05T12:49:14.785 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_buckets() 2023-10-05T12:49:14.785 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:14.785 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:14.785 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:14.785 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:14.785 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:14.786 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:14.786 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:14.786 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:14.786 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:14.786 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:14.786 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:14.786 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:14.786 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:14.786 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:14.786 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:14.786 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:14.786 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:14.787 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:14.787 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:14.787 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:14.787 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:14.787 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:14.787 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:14.787 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:14.787 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:14.787 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:14.787 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:14.787 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:14.787 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:14.787 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:14.788 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:14.788 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:14.788 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:14.788 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:14.788 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.788 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.788 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:14.788 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:14.788 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.789 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:14.789 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.789 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:14.789 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:14.789 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:14.789 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:14.789 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:14.789 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:14.789 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:14.789 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:14.789 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:14.789 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:14.790 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:14.790 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:14.790 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:14.790 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.790 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:14.790 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:14.790 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:14.790 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:14.790 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:14.790 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:14.790 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:14.790 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:14.791 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:14.791 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:14.791 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:14.791 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.791 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.791 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:14.791 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:14.791 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:14.791 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:14.791 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:14.791 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.791 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.791 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:14.792 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:14.792 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:14.792 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:14.792 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:14.792 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.792 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:14.792 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:14.792 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:14.792 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:14.792 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:14.792 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/" 2023-10-05T12:49:14.793 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.793 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:14.793 INFO:teuthology.orchestra.run.smithi012.stdout:=================================== FAILURES =================================== 2023-10-05T12:49:14.793 INFO:teuthology.orchestra.run.smithi012.stdout:____________________ test_atomic_dual_conditional_write_1mb ____________________ 2023-10-05T12:49:14.793 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.793 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.fails_on_aws 2023-10-05T12:49:14.793 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.fails_on_dbstore 2023-10-05T12:49:14.793 INFO:teuthology.orchestra.run.smithi012.stdout: def test_atomic_dual_conditional_write_1mb(): 2023-10-05T12:49:14.793 INFO:teuthology.orchestra.run.smithi012.stdout:> _test_atomic_dual_conditional_write(1024*1024) 2023-10-05T12:49:14.793 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.793 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests/functional/test_s3.py:583: 2023-10-05T12:49:14.793 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.793 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests/functional/test_s3.py:578: in _test_atomic_dual_conditional_write 2023-10-05T12:49:14.794 INFO:teuthology.orchestra.run.smithi012.stdout: _verify_atomic_key_data(key, file_size, 'B') 2023-10-05T12:49:14.794 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests/functional/test_s3.py:542: in _verify_atomic_key_data 2023-10-05T12:49:14.794 INFO:teuthology.orchestra.run.smithi012.stdout: key.get_contents_to_file(fp_verify) 2023-10-05T12:49:14.794 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/boto/s3/key.py:1664: in get_contents_to_file 2023-10-05T12:49:14.794 INFO:teuthology.orchestra.run.smithi012.stdout: self.get_file(fp, headers, cb, num_cb, torrent=torrent, 2023-10-05T12:49:14.794 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/boto/s3/key.py:1493: in get_file 2023-10-05T12:49:14.794 INFO:teuthology.orchestra.run.smithi012.stdout: self._get_file_internal(fp, headers=headers, cb=cb, num_cb=num_cb, 2023-10-05T12:49:14.794 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/boto/s3/key.py:1552: in _get_file_internal 2023-10-05T12:49:14.794 INFO:teuthology.orchestra.run.smithi012.stdout: fp.write(bytes) 2023-10-05T12:49:14.794 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.794 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.794 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:14.795 INFO:teuthology.orchestra.run.smithi012.stdout:data = b'AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA...AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA' 2023-10-05T12:49:14.795 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.795 INFO:teuthology.orchestra.run.smithi012.stdout: def write(self, data): 2023-10-05T12:49:14.795 INFO:teuthology.orchestra.run.smithi012.stdout: size = len(data) 2023-10-05T12:49:14.795 INFO:teuthology.orchestra.run.smithi012.stdout: if self.char == None: 2023-10-05T12:49:14.795 INFO:teuthology.orchestra.run.smithi012.stdout: self.char = data[0] 2023-10-05T12:49:14.795 INFO:teuthology.orchestra.run.smithi012.stdout: self.size += size 2023-10-05T12:49:14.795 INFO:teuthology.orchestra.run.smithi012.stdout:> assert data.decode() == self.char*size 2023-10-05T12:49:14.795 INFO:teuthology.orchestra.run.smithi012.stdout:E AssertionError: assert 'AAAAAAAAAAAA...AAAAAAAAAAAAA' == 'BBBBBBBBBBBB...BBBBBBBBBBBBB' 2023-10-05T12:49:14.795 INFO:teuthology.orchestra.run.smithi012.stdout:E - BBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBB... 2023-10-05T12:49:14.795 INFO:teuthology.orchestra.run.smithi012.stdout:E 2023-10-05T12:49:14.795 INFO:teuthology.orchestra.run.smithi012.stdout:E ...Full output truncated (2 lines hidden), use '-vv' to show 2023-10-05T12:49:14.795 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.796 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests/functional/test_s3.py:535: AssertionError 2023-10-05T12:49:14.796 INFO:teuthology.orchestra.run.smithi012.stdout:--------------------------- Captured stdout teardown --------------------------- 2023-10-05T12:49:14.796 INFO:teuthology.orchestra.run.smithi012.stdout:Deleting buckets on main 2023-10-05T12:49:14.796 INFO:teuthology.orchestra.run.smithi012.stdout:Cleaning buckets from connection main prefix 'test-client.0-xk00v1boovshnnv-'. 2023-10-05T12:49:14.796 INFO:teuthology.orchestra.run.smithi012.stdout:prefix= test-client.0-xk00v1boovshnnv- 2023-10-05T12:49:14.796 INFO:teuthology.orchestra.run.smithi012.stdout:Cleaning bucket 2023-10-05T12:49:14.796 INFO:teuthology.orchestra.run.smithi012.stdout:Cleaning bucket key 2023-10-05T12:49:14.796 INFO:teuthology.orchestra.run.smithi012.stdout:Deleting buckets on alt 2023-10-05T12:49:14.796 INFO:teuthology.orchestra.run.smithi012.stdout:Cleaning buckets from connection alt prefix 'test-client.0-xk00v1boovshnnv-'. 2023-10-05T12:49:14.796 INFO:teuthology.orchestra.run.smithi012.stdout:Deleting buckets on tenant 2023-10-05T12:49:14.796 INFO:teuthology.orchestra.run.smithi012.stdout:Cleaning buckets from connection tenant prefix 'test-client.0-xk00v1boovshnnv-'. 2023-10-05T12:49:14.796 INFO:teuthology.orchestra.run.smithi012.stdout:Done with cleanup of test buckets. 2023-10-05T12:49:14.797 INFO:teuthology.orchestra.run.smithi012.stdout:_________________________ test_bucket_list_return_data _________________________ 2023-10-05T12:49:14.797 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.797 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.fails_on_dbstore 2023-10-05T12:49:14.797 INFO:teuthology.orchestra.run.smithi012.stdout: def test_bucket_list_return_data(): 2023-10-05T12:49:14.797 INFO:teuthology.orchestra.run.smithi012.stdout: key_names = ['bar', 'baz', 'foo'] 2023-10-05T12:49:14.797 INFO:teuthology.orchestra.run.smithi012.stdout: bucket_name = _create_objects(keys=key_names) 2023-10-05T12:49:14.797 INFO:teuthology.orchestra.run.smithi012.stdout: client = get_client() 2023-10-05T12:49:14.797 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.797 INFO:teuthology.orchestra.run.smithi012.stdout: data = {} 2023-10-05T12:49:14.797 INFO:teuthology.orchestra.run.smithi012.stdout: for key_name in key_names: 2023-10-05T12:49:14.797 INFO:teuthology.orchestra.run.smithi012.stdout: obj_response = client.head_object(Bucket=bucket_name, Key=key_name) 2023-10-05T12:49:14.797 INFO:teuthology.orchestra.run.smithi012.stdout: acl_response = client.get_object_acl(Bucket=bucket_name, Key=key_name) 2023-10-05T12:49:14.798 INFO:teuthology.orchestra.run.smithi012.stdout: data.update({ 2023-10-05T12:49:14.798 INFO:teuthology.orchestra.run.smithi012.stdout: key_name: { 2023-10-05T12:49:14.798 INFO:teuthology.orchestra.run.smithi012.stdout: 'DisplayName': acl_response['Owner']['DisplayName'], 2023-10-05T12:49:14.798 INFO:teuthology.orchestra.run.smithi012.stdout: 'ID': acl_response['Owner']['ID'], 2023-10-05T12:49:14.798 INFO:teuthology.orchestra.run.smithi012.stdout: 'ETag': obj_response['ETag'], 2023-10-05T12:49:14.798 INFO:teuthology.orchestra.run.smithi012.stdout: 'LastModified': obj_response['LastModified'], 2023-10-05T12:49:14.798 INFO:teuthology.orchestra.run.smithi012.stdout: 'ContentLength': obj_response['ContentLength'], 2023-10-05T12:49:14.798 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-05T12:49:14.798 INFO:teuthology.orchestra.run.smithi012.stdout: }) 2023-10-05T12:49:14.798 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.798 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_objects(Bucket=bucket_name) 2023-10-05T12:49:14.798 INFO:teuthology.orchestra.run.smithi012.stdout: objs_list = response['Contents'] 2023-10-05T12:49:14.799 INFO:teuthology.orchestra.run.smithi012.stdout: for obj in objs_list: 2023-10-05T12:49:14.799 INFO:teuthology.orchestra.run.smithi012.stdout: key_name = obj['Key'] 2023-10-05T12:49:14.799 INFO:teuthology.orchestra.run.smithi012.stdout: key_data = data[key_name] 2023-10-05T12:49:14.799 INFO:teuthology.orchestra.run.smithi012.stdout: assert obj['ETag'] == key_data['ETag'] 2023-10-05T12:49:14.799 INFO:teuthology.orchestra.run.smithi012.stdout: assert obj['Size'] == key_data['ContentLength'] 2023-10-05T12:49:14.799 INFO:teuthology.orchestra.run.smithi012.stdout: assert obj['Owner']['DisplayName'] == key_data['DisplayName'] 2023-10-05T12:49:14.799 INFO:teuthology.orchestra.run.smithi012.stdout: assert obj['Owner']['ID'] == key_data['ID'] 2023-10-05T12:49:14.799 INFO:teuthology.orchestra.run.smithi012.stdout:> _compare_dates(obj['LastModified'],key_data['LastModified']) 2023-10-05T12:49:14.799 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.799 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:1410: 2023-10-05T12:49:14.799 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.799 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.800 INFO:teuthology.orchestra.run.smithi012.stdout:datetime1 = datetime.datetime(2023, 10, 5, 11, 53, 25, tzinfo=tzlocal()) 2023-10-05T12:49:14.800 INFO:teuthology.orchestra.run.smithi012.stdout:datetime2 = datetime.datetime(1970, 1, 1, 0, 0, tzinfo=tzutc()) 2023-10-05T12:49:14.800 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.800 INFO:teuthology.orchestra.run.smithi012.stdout: def _compare_dates(datetime1, datetime2): 2023-10-05T12:49:14.800 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:14.800 INFO:teuthology.orchestra.run.smithi012.stdout: changes ms from datetime1 to 0, compares it to datetime2 2023-10-05T12:49:14.800 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:14.800 INFO:teuthology.orchestra.run.smithi012.stdout: # both times are in datetime format but datetime1 has 2023-10-05T12:49:14.800 INFO:teuthology.orchestra.run.smithi012.stdout: # microseconds and datetime2 does not 2023-10-05T12:49:14.800 INFO:teuthology.orchestra.run.smithi012.stdout: datetime1 = datetime1.replace(microsecond=0) 2023-10-05T12:49:14.800 INFO:teuthology.orchestra.run.smithi012.stdout:> assert datetime1 == datetime2 2023-10-05T12:49:14.800 INFO:teuthology.orchestra.run.smithi012.stdout:E assert datetime.datetime(2023, 10, 5, 11, 53, 25, tzinfo=tzlocal()) == datetime.datetime(1970, 1, 1, 0, 0, tzinfo=tzutc()) 2023-10-05T12:49:14.801 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.801 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:1379: AssertionError 2023-10-05T12:49:14.801 INFO:teuthology.orchestra.run.smithi012.stdout:--------------------------- Captured stdout teardown --------------------------- 2023-10-05T12:49:14.801 INFO:teuthology.orchestra.run.smithi012.stdout:Done with cleanup of buckets in tests. 2023-10-05T12:49:14.801 INFO:teuthology.orchestra.run.smithi012.stdout:Done with cleanup of buckets in tests. 2023-10-05T12:49:14.801 INFO:teuthology.orchestra.run.smithi012.stdout:Done with cleanup of buckets in tests. 2023-10-05T12:49:14.801 INFO:teuthology.orchestra.run.smithi012.stdout:___________________ test_bucket_list_return_data_versioning ____________________ 2023-10-05T12:49:14.801 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.801 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.fails_on_dbstore 2023-10-05T12:49:14.801 INFO:teuthology.orchestra.run.smithi012.stdout: def test_bucket_list_return_data_versioning(): 2023-10-05T12:49:14.801 INFO:teuthology.orchestra.run.smithi012.stdout: bucket_name = get_new_bucket() 2023-10-05T12:49:14.801 INFO:teuthology.orchestra.run.smithi012.stdout: check_configure_versioning_retry(bucket_name, "Enabled", "Enabled") 2023-10-05T12:49:14.802 INFO:teuthology.orchestra.run.smithi012.stdout: key_names = ['bar', 'baz', 'foo'] 2023-10-05T12:49:14.802 INFO:teuthology.orchestra.run.smithi012.stdout: bucket_name = _create_objects(bucket_name=bucket_name,keys=key_names) 2023-10-05T12:49:14.802 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.802 INFO:teuthology.orchestra.run.smithi012.stdout: client = get_client() 2023-10-05T12:49:14.802 INFO:teuthology.orchestra.run.smithi012.stdout: data = {} 2023-10-05T12:49:14.802 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.802 INFO:teuthology.orchestra.run.smithi012.stdout: for key_name in key_names: 2023-10-05T12:49:14.802 INFO:teuthology.orchestra.run.smithi012.stdout: obj_response = client.head_object(Bucket=bucket_name, Key=key_name) 2023-10-05T12:49:14.802 INFO:teuthology.orchestra.run.smithi012.stdout: acl_response = client.get_object_acl(Bucket=bucket_name, Key=key_name) 2023-10-05T12:49:14.802 INFO:teuthology.orchestra.run.smithi012.stdout: data.update({ 2023-10-05T12:49:14.802 INFO:teuthology.orchestra.run.smithi012.stdout: key_name: { 2023-10-05T12:49:14.802 INFO:teuthology.orchestra.run.smithi012.stdout: 'ID': acl_response['Owner']['ID'], 2023-10-05T12:49:14.803 INFO:teuthology.orchestra.run.smithi012.stdout: 'DisplayName': acl_response['Owner']['DisplayName'], 2023-10-05T12:49:14.803 INFO:teuthology.orchestra.run.smithi012.stdout: 'ETag': obj_response['ETag'], 2023-10-05T12:49:14.803 INFO:teuthology.orchestra.run.smithi012.stdout: 'LastModified': obj_response['LastModified'], 2023-10-05T12:49:14.803 INFO:teuthology.orchestra.run.smithi012.stdout: 'ContentLength': obj_response['ContentLength'], 2023-10-05T12:49:14.803 INFO:teuthology.orchestra.run.smithi012.stdout: 'VersionId': obj_response['VersionId'] 2023-10-05T12:49:14.803 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-05T12:49:14.803 INFO:teuthology.orchestra.run.smithi012.stdout: }) 2023-10-05T12:49:14.803 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.803 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_object_versions(Bucket=bucket_name) 2023-10-05T12:49:14.803 INFO:teuthology.orchestra.run.smithi012.stdout: objs_list = response['Versions'] 2023-10-05T12:49:14.803 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.803 INFO:teuthology.orchestra.run.smithi012.stdout: for obj in objs_list: 2023-10-05T12:49:14.804 INFO:teuthology.orchestra.run.smithi012.stdout: key_name = obj['Key'] 2023-10-05T12:49:14.804 INFO:teuthology.orchestra.run.smithi012.stdout: key_data = data[key_name] 2023-10-05T12:49:14.804 INFO:teuthology.orchestra.run.smithi012.stdout: assert obj['Owner']['DisplayName'] == key_data['DisplayName'] 2023-10-05T12:49:14.804 INFO:teuthology.orchestra.run.smithi012.stdout: assert obj['ETag'] == key_data['ETag'] 2023-10-05T12:49:14.804 INFO:teuthology.orchestra.run.smithi012.stdout: assert obj['Size'] == key_data['ContentLength'] 2023-10-05T12:49:14.804 INFO:teuthology.orchestra.run.smithi012.stdout: assert obj['Owner']['ID'] == key_data['ID'] 2023-10-05T12:49:14.804 INFO:teuthology.orchestra.run.smithi012.stdout: assert obj['VersionId'] == key_data['VersionId'] 2023-10-05T12:49:14.804 INFO:teuthology.orchestra.run.smithi012.stdout:> _compare_dates(obj['LastModified'],key_data['LastModified']) 2023-10-05T12:49:14.804 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.804 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:1448: 2023-10-05T12:49:14.804 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.804 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.804 INFO:teuthology.orchestra.run.smithi012.stdout:datetime1 = datetime.datetime(2023, 10, 5, 11, 53, 26, tzinfo=tzlocal()) 2023-10-05T12:49:14.805 INFO:teuthology.orchestra.run.smithi012.stdout:datetime2 = datetime.datetime(1970, 1, 1, 0, 0, tzinfo=tzutc()) 2023-10-05T12:49:14.805 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.805 INFO:teuthology.orchestra.run.smithi012.stdout: def _compare_dates(datetime1, datetime2): 2023-10-05T12:49:14.805 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:14.805 INFO:teuthology.orchestra.run.smithi012.stdout: changes ms from datetime1 to 0, compares it to datetime2 2023-10-05T12:49:14.805 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:14.805 INFO:teuthology.orchestra.run.smithi012.stdout: # both times are in datetime format but datetime1 has 2023-10-05T12:49:14.805 INFO:teuthology.orchestra.run.smithi012.stdout: # microseconds and datetime2 does not 2023-10-05T12:49:14.805 INFO:teuthology.orchestra.run.smithi012.stdout: datetime1 = datetime1.replace(microsecond=0) 2023-10-05T12:49:14.805 INFO:teuthology.orchestra.run.smithi012.stdout:> assert datetime1 == datetime2 2023-10-05T12:49:14.805 INFO:teuthology.orchestra.run.smithi012.stdout:E assert datetime.datetime(2023, 10, 5, 11, 53, 26, tzinfo=tzlocal()) == datetime.datetime(1970, 1, 1, 0, 0, tzinfo=tzutc()) 2023-10-05T12:49:14.805 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.806 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:1379: AssertionError 2023-10-05T12:49:14.806 INFO:teuthology.orchestra.run.smithi012.stdout:--------------------------- Captured stdout teardown --------------------------- 2023-10-05T12:49:14.806 INFO:teuthology.orchestra.run.smithi012.stdout:Done with cleanup of buckets in tests. 2023-10-05T12:49:14.806 INFO:teuthology.orchestra.run.smithi012.stdout:Done with cleanup of buckets in tests. 2023-10-05T12:49:14.806 INFO:teuthology.orchestra.run.smithi012.stdout:Done with cleanup of buckets in tests. 2023-10-05T12:49:14.806 INFO:teuthology.orchestra.run.smithi012.stdout:________________________ test_get_object_ifmatch_failed ________________________ 2023-10-05T12:49:14.806 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.806 INFO:teuthology.orchestra.run.smithi012.stdout: def test_get_object_ifmatch_failed(): 2023-10-05T12:49:14.806 INFO:teuthology.orchestra.run.smithi012.stdout: bucket_name = get_new_bucket() 2023-10-05T12:49:14.806 INFO:teuthology.orchestra.run.smithi012.stdout: client = get_client() 2023-10-05T12:49:14.806 INFO:teuthology.orchestra.run.smithi012.stdout: client.put_object(Bucket=bucket_name, Key='foo', Body='bar') 2023-10-05T12:49:14.806 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.807 INFO:teuthology.orchestra.run.smithi012.stdout:> e = assert_raises(ClientError, client.get_object, Bucket=bucket_name, Key='foo', IfMatch='"ABCORZ"') 2023-10-05T12:49:14.807 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.807 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:2958: 2023-10-05T12:49:14.807 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.807 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.807 INFO:teuthology.orchestra.run.smithi012.stdout:excClass = 2023-10-05T12:49:14.807 INFO:teuthology.orchestra.run.smithi012.stdout:callableObj = ._api_call of > 2023-10-05T12:49:14.807 INFO:teuthology.orchestra.run.smithi012.stdout:args = () 2023-10-05T12:49:14.807 INFO:teuthology.orchestra.run.smithi012.stdout:kwargs = {'Bucket': 'test-client.0-67n8q3qaqfhf9w0-183', 'IfMatch': '"ABCORZ"', 'Key': 'foo'} 2023-10-05T12:49:14.807 INFO:teuthology.orchestra.run.smithi012.stdout:excName = 'ClientError' 2023-10-05T12:49:14.807 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.807 INFO:teuthology.orchestra.run.smithi012.stdout: def assert_raises(excClass, callableObj, *args, **kwargs): 2023-10-05T12:49:14.807 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:14.807 INFO:teuthology.orchestra.run.smithi012.stdout: Like unittest.TestCase.assertRaises, but returns the exception. 2023-10-05T12:49:14.808 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:14.808 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.808 INFO:teuthology.orchestra.run.smithi012.stdout: callableObj(*args, **kwargs) 2023-10-05T12:49:14.808 INFO:teuthology.orchestra.run.smithi012.stdout: except excClass as e: 2023-10-05T12:49:14.808 INFO:teuthology.orchestra.run.smithi012.stdout: return e 2023-10-05T12:49:14.808 INFO:teuthology.orchestra.run.smithi012.stdout: else: 2023-10-05T12:49:14.808 INFO:teuthology.orchestra.run.smithi012.stdout: if hasattr(excClass, '__name__'): 2023-10-05T12:49:14.808 INFO:teuthology.orchestra.run.smithi012.stdout: excName = excClass.__name__ 2023-10-05T12:49:14.808 INFO:teuthology.orchestra.run.smithi012.stdout: else: 2023-10-05T12:49:14.808 INFO:teuthology.orchestra.run.smithi012.stdout: excName = str(excClass) 2023-10-05T12:49:14.808 INFO:teuthology.orchestra.run.smithi012.stdout:> raise AssertionError("%s not raised" % excName) 2023-10-05T12:49:14.809 INFO:teuthology.orchestra.run.smithi012.stdout:E AssertionError: ClientError not raised 2023-10-05T12:49:14.809 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.809 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/utils.py:19: AssertionError 2023-10-05T12:49:14.809 INFO:teuthology.orchestra.run.smithi012.stdout:--------------------------- Captured stdout teardown --------------------------- 2023-10-05T12:49:14.809 INFO:teuthology.orchestra.run.smithi012.stdout:Done with cleanup of buckets in tests. 2023-10-05T12:49:14.809 INFO:teuthology.orchestra.run.smithi012.stdout:Done with cleanup of buckets in tests. 2023-10-05T12:49:14.809 INFO:teuthology.orchestra.run.smithi012.stdout:Done with cleanup of buckets in tests. 2023-10-05T12:49:14.809 INFO:teuthology.orchestra.run.smithi012.stdout:_______________________ test_get_object_ifnonematch_good _______________________ 2023-10-05T12:49:14.809 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.809 INFO:teuthology.orchestra.run.smithi012.stdout: def test_get_object_ifnonematch_good(): 2023-10-05T12:49:14.809 INFO:teuthology.orchestra.run.smithi012.stdout: bucket_name = get_new_bucket() 2023-10-05T12:49:14.809 INFO:teuthology.orchestra.run.smithi012.stdout: client = get_client() 2023-10-05T12:49:14.810 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.put_object(Bucket=bucket_name, Key='foo', Body='bar') 2023-10-05T12:49:14.810 INFO:teuthology.orchestra.run.smithi012.stdout: etag = response['ETag'] 2023-10-05T12:49:14.810 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.810 INFO:teuthology.orchestra.run.smithi012.stdout:> e = assert_raises(ClientError, client.get_object, Bucket=bucket_name, Key='foo', IfNoneMatch=etag) 2023-10-05T12:49:14.810 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.810 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:2969: 2023-10-05T12:49:14.810 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.810 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.810 INFO:teuthology.orchestra.run.smithi012.stdout:excClass = 2023-10-05T12:49:14.810 INFO:teuthology.orchestra.run.smithi012.stdout:callableObj = ._api_call of > 2023-10-05T12:49:14.810 INFO:teuthology.orchestra.run.smithi012.stdout:args = () 2023-10-05T12:49:14.810 INFO:teuthology.orchestra.run.smithi012.stdout:kwargs = {'Bucket': 'test-client.0-67n8q3qaqfhf9w0-184', 'IfNoneMatch': '"37b51d194a7513e45b56f6524f2d51f2"', 'Key': 'foo'} 2023-10-05T12:49:14.811 INFO:teuthology.orchestra.run.smithi012.stdout:excName = 'ClientError' 2023-10-05T12:49:14.811 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.811 INFO:teuthology.orchestra.run.smithi012.stdout: def assert_raises(excClass, callableObj, *args, **kwargs): 2023-10-05T12:49:14.811 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:14.811 INFO:teuthology.orchestra.run.smithi012.stdout: Like unittest.TestCase.assertRaises, but returns the exception. 2023-10-05T12:49:14.811 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:14.811 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.811 INFO:teuthology.orchestra.run.smithi012.stdout: callableObj(*args, **kwargs) 2023-10-05T12:49:14.811 INFO:teuthology.orchestra.run.smithi012.stdout: except excClass as e: 2023-10-05T12:49:14.811 INFO:teuthology.orchestra.run.smithi012.stdout: return e 2023-10-05T12:49:14.811 INFO:teuthology.orchestra.run.smithi012.stdout: else: 2023-10-05T12:49:14.811 INFO:teuthology.orchestra.run.smithi012.stdout: if hasattr(excClass, '__name__'): 2023-10-05T12:49:14.812 INFO:teuthology.orchestra.run.smithi012.stdout: excName = excClass.__name__ 2023-10-05T12:49:14.812 INFO:teuthology.orchestra.run.smithi012.stdout: else: 2023-10-05T12:49:14.812 INFO:teuthology.orchestra.run.smithi012.stdout: excName = str(excClass) 2023-10-05T12:49:14.812 INFO:teuthology.orchestra.run.smithi012.stdout:> raise AssertionError("%s not raised" % excName) 2023-10-05T12:49:14.812 INFO:teuthology.orchestra.run.smithi012.stdout:E AssertionError: ClientError not raised 2023-10-05T12:49:14.812 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.812 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/utils.py:19: AssertionError 2023-10-05T12:49:14.812 INFO:teuthology.orchestra.run.smithi012.stdout:--------------------------- Captured stdout teardown --------------------------- 2023-10-05T12:49:14.812 INFO:teuthology.orchestra.run.smithi012.stdout:Done with cleanup of buckets in tests. 2023-10-05T12:49:14.812 INFO:teuthology.orchestra.run.smithi012.stdout:Done with cleanup of buckets in tests. 2023-10-05T12:49:14.812 INFO:teuthology.orchestra.run.smithi012.stdout:Done with cleanup of buckets in tests. 2023-10-05T12:49:14.812 INFO:teuthology.orchestra.run.smithi012.stdout:____________________ test_get_object_ifmodifiedsince_failed ____________________ 2023-10-05T12:49:14.812 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.813 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.fails_on_dbstore 2023-10-05T12:49:14.813 INFO:teuthology.orchestra.run.smithi012.stdout: def test_get_object_ifmodifiedsince_failed(): 2023-10-05T12:49:14.813 INFO:teuthology.orchestra.run.smithi012.stdout: bucket_name = get_new_bucket() 2023-10-05T12:49:14.813 INFO:teuthology.orchestra.run.smithi012.stdout: client = get_client() 2023-10-05T12:49:14.813 INFO:teuthology.orchestra.run.smithi012.stdout: client.put_object(Bucket=bucket_name, Key='foo', Body='bar') 2023-10-05T12:49:14.813 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.get_object(Bucket=bucket_name, Key='foo') 2023-10-05T12:49:14.813 INFO:teuthology.orchestra.run.smithi012.stdout: last_modified = str(response['LastModified']) 2023-10-05T12:49:14.813 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.813 INFO:teuthology.orchestra.run.smithi012.stdout: last_modified = last_modified.split('+')[0] 2023-10-05T12:49:14.813 INFO:teuthology.orchestra.run.smithi012.stdout: mtime = datetime.datetime.strptime(last_modified, '%Y-%m-%d %H:%M:%S') 2023-10-05T12:49:14.813 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.813 INFO:teuthology.orchestra.run.smithi012.stdout: after = mtime + datetime.timedelta(seconds=1) 2023-10-05T12:49:14.813 INFO:teuthology.orchestra.run.smithi012.stdout: after_str = time.strftime("%a, %d %b %Y %H:%M:%S GMT", after.timetuple()) 2023-10-05T12:49:14.814 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.814 INFO:teuthology.orchestra.run.smithi012.stdout: time.sleep(1) 2023-10-05T12:49:14.814 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.814 INFO:teuthology.orchestra.run.smithi012.stdout:> e = assert_raises(ClientError, client.get_object, Bucket=bucket_name, Key='foo', IfModifiedSince=after_str) 2023-10-05T12:49:14.814 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.814 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:3008: 2023-10-05T12:49:14.814 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.814 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.814 INFO:teuthology.orchestra.run.smithi012.stdout:excClass = 2023-10-05T12:49:14.814 INFO:teuthology.orchestra.run.smithi012.stdout:callableObj = ._api_call of > 2023-10-05T12:49:14.814 INFO:teuthology.orchestra.run.smithi012.stdout:args = () 2023-10-05T12:49:14.814 INFO:teuthology.orchestra.run.smithi012.stdout:kwargs = {'Bucket': 'test-client.0-67n8q3qaqfhf9w0-187', 'IfModifiedSince': 'Thu, 01 Jan 1970 00:00:01 GMT', 'Key': 'foo'} 2023-10-05T12:49:14.814 INFO:teuthology.orchestra.run.smithi012.stdout:excName = 'ClientError' 2023-10-05T12:49:14.815 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.815 INFO:teuthology.orchestra.run.smithi012.stdout: def assert_raises(excClass, callableObj, *args, **kwargs): 2023-10-05T12:49:14.815 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:14.815 INFO:teuthology.orchestra.run.smithi012.stdout: Like unittest.TestCase.assertRaises, but returns the exception. 2023-10-05T12:49:14.815 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:14.815 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.815 INFO:teuthology.orchestra.run.smithi012.stdout: callableObj(*args, **kwargs) 2023-10-05T12:49:14.815 INFO:teuthology.orchestra.run.smithi012.stdout: except excClass as e: 2023-10-05T12:49:14.815 INFO:teuthology.orchestra.run.smithi012.stdout: return e 2023-10-05T12:49:14.815 INFO:teuthology.orchestra.run.smithi012.stdout: else: 2023-10-05T12:49:14.815 INFO:teuthology.orchestra.run.smithi012.stdout: if hasattr(excClass, '__name__'): 2023-10-05T12:49:14.815 INFO:teuthology.orchestra.run.smithi012.stdout: excName = excClass.__name__ 2023-10-05T12:49:14.815 INFO:teuthology.orchestra.run.smithi012.stdout: else: 2023-10-05T12:49:14.816 INFO:teuthology.orchestra.run.smithi012.stdout: excName = str(excClass) 2023-10-05T12:49:14.816 INFO:teuthology.orchestra.run.smithi012.stdout:> raise AssertionError("%s not raised" % excName) 2023-10-05T12:49:14.816 INFO:teuthology.orchestra.run.smithi012.stdout:E AssertionError: ClientError not raised 2023-10-05T12:49:14.816 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.816 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/utils.py:19: AssertionError 2023-10-05T12:49:14.816 INFO:teuthology.orchestra.run.smithi012.stdout:--------------------------- Captured stdout teardown --------------------------- 2023-10-05T12:49:14.816 INFO:teuthology.orchestra.run.smithi012.stdout:Done with cleanup of buckets in tests. 2023-10-05T12:49:14.816 INFO:teuthology.orchestra.run.smithi012.stdout:Done with cleanup of buckets in tests. 2023-10-05T12:49:14.816 INFO:teuthology.orchestra.run.smithi012.stdout:Done with cleanup of buckets in tests. 2023-10-05T12:49:14.816 INFO:teuthology.orchestra.run.smithi012.stdout:____________________ test_get_object_ifunmodifiedsince_good ____________________ 2023-10-05T12:49:14.816 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.817 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.fails_on_dbstore 2023-10-05T12:49:14.817 INFO:teuthology.orchestra.run.smithi012.stdout: def test_get_object_ifunmodifiedsince_good(): 2023-10-05T12:49:14.817 INFO:teuthology.orchestra.run.smithi012.stdout: bucket_name = get_new_bucket() 2023-10-05T12:49:14.817 INFO:teuthology.orchestra.run.smithi012.stdout: client = get_client() 2023-10-05T12:49:14.817 INFO:teuthology.orchestra.run.smithi012.stdout: client.put_object(Bucket=bucket_name, Key='foo', Body='bar') 2023-10-05T12:49:14.817 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.817 INFO:teuthology.orchestra.run.smithi012.stdout:> e = assert_raises(ClientError, client.get_object, Bucket=bucket_name, Key='foo', IfUnmodifiedSince='Sat, 29 Oct 1994 19:43:31 GMT') 2023-10-05T12:49:14.817 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.817 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:3019: 2023-10-05T12:49:14.817 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.817 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.817 INFO:teuthology.orchestra.run.smithi012.stdout:excClass = 2023-10-05T12:49:14.818 INFO:teuthology.orchestra.run.smithi012.stdout:callableObj = ._api_call of > 2023-10-05T12:49:14.818 INFO:teuthology.orchestra.run.smithi012.stdout:args = () 2023-10-05T12:49:14.818 INFO:teuthology.orchestra.run.smithi012.stdout:kwargs = {'Bucket': 'test-client.0-67n8q3qaqfhf9w0-188', 'IfUnmodifiedSince': 'Sat, 29 Oct 1994 19:43:31 GMT', 'Key': 'foo'} 2023-10-05T12:49:14.818 INFO:teuthology.orchestra.run.smithi012.stdout:excName = 'ClientError' 2023-10-05T12:49:14.818 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.818 INFO:teuthology.orchestra.run.smithi012.stdout: def assert_raises(excClass, callableObj, *args, **kwargs): 2023-10-05T12:49:14.818 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:14.818 INFO:teuthology.orchestra.run.smithi012.stdout: Like unittest.TestCase.assertRaises, but returns the exception. 2023-10-05T12:49:14.818 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:14.818 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.819 INFO:teuthology.orchestra.run.smithi012.stdout: callableObj(*args, **kwargs) 2023-10-05T12:49:14.819 INFO:teuthology.orchestra.run.smithi012.stdout: except excClass as e: 2023-10-05T12:49:14.819 INFO:teuthology.orchestra.run.smithi012.stdout: return e 2023-10-05T12:49:14.819 INFO:teuthology.orchestra.run.smithi012.stdout: else: 2023-10-05T12:49:14.819 INFO:teuthology.orchestra.run.smithi012.stdout: if hasattr(excClass, '__name__'): 2023-10-05T12:49:14.819 INFO:teuthology.orchestra.run.smithi012.stdout: excName = excClass.__name__ 2023-10-05T12:49:14.819 INFO:teuthology.orchestra.run.smithi012.stdout: else: 2023-10-05T12:49:14.819 INFO:teuthology.orchestra.run.smithi012.stdout: excName = str(excClass) 2023-10-05T12:49:14.819 INFO:teuthology.orchestra.run.smithi012.stdout:> raise AssertionError("%s not raised" % excName) 2023-10-05T12:49:14.819 INFO:teuthology.orchestra.run.smithi012.stdout:E AssertionError: ClientError not raised 2023-10-05T12:49:14.819 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.819 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/utils.py:19: AssertionError 2023-10-05T12:49:14.819 INFO:teuthology.orchestra.run.smithi012.stdout:--------------------------- Captured stdout teardown --------------------------- 2023-10-05T12:49:14.820 INFO:teuthology.orchestra.run.smithi012.stdout:Done with cleanup of buckets in tests. 2023-10-05T12:49:14.820 INFO:teuthology.orchestra.run.smithi012.stdout:Done with cleanup of buckets in tests. 2023-10-05T12:49:14.820 INFO:teuthology.orchestra.run.smithi012.stdout:Done with cleanup of buckets in tests. 2023-10-05T12:49:14.820 INFO:teuthology.orchestra.run.smithi012.stdout:_________________________ test_put_object_ifmatch_good _________________________ 2023-10-05T12:49:14.820 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.820 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.fails_on_aws 2023-10-05T12:49:14.820 INFO:teuthology.orchestra.run.smithi012.stdout: def test_put_object_ifmatch_good(): 2023-10-05T12:49:14.820 INFO:teuthology.orchestra.run.smithi012.stdout: bucket_name = get_new_bucket() 2023-10-05T12:49:14.820 INFO:teuthology.orchestra.run.smithi012.stdout: client = get_client() 2023-10-05T12:49:14.820 INFO:teuthology.orchestra.run.smithi012.stdout: client.put_object(Bucket=bucket_name, Key='foo', Body='bar') 2023-10-05T12:49:14.820 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.820 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.get_object(Bucket=bucket_name, Key='foo') 2023-10-05T12:49:14.821 INFO:teuthology.orchestra.run.smithi012.stdout: body = _get_body(response) 2023-10-05T12:49:14.821 INFO:teuthology.orchestra.run.smithi012.stdout: assert body == 'bar' 2023-10-05T12:49:14.821 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.821 INFO:teuthology.orchestra.run.smithi012.stdout: etag = response['ETag'].replace('"', '') 2023-10-05T12:49:14.821 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.821 INFO:teuthology.orchestra.run.smithi012.stdout: # pass in custom header 'If-Match' before PutObject call 2023-10-05T12:49:14.821 INFO:teuthology.orchestra.run.smithi012.stdout: lf = (lambda **kwargs: kwargs['params']['headers'].update({'If-Match': etag})) 2023-10-05T12:49:14.821 INFO:teuthology.orchestra.run.smithi012.stdout: client.meta.events.register('before-call.s3.PutObject', lf) 2023-10-05T12:49:14.821 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.put_object(Bucket=bucket_name,Key='foo', Body='zar') 2023-10-05T12:49:14.821 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.821 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.get_object(Bucket=bucket_name, Key='foo') 2023-10-05T12:49:14.822 INFO:teuthology.orchestra.run.smithi012.stdout: body = _get_body(response) 2023-10-05T12:49:14.822 INFO:teuthology.orchestra.run.smithi012.stdout:> assert body == 'zar' 2023-10-05T12:49:14.822 INFO:teuthology.orchestra.run.smithi012.stdout:E AssertionError: assert 'bar' == 'zar' 2023-10-05T12:49:14.822 INFO:teuthology.orchestra.run.smithi012.stdout:E - zar 2023-10-05T12:49:14.822 INFO:teuthology.orchestra.run.smithi012.stdout:E + bar 2023-10-05T12:49:14.822 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.822 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:3053: AssertionError 2023-10-05T12:49:14.822 INFO:teuthology.orchestra.run.smithi012.stdout:--------------------------- Captured stdout teardown --------------------------- 2023-10-05T12:49:14.822 INFO:teuthology.orchestra.run.smithi012.stdout:Done with cleanup of buckets in tests. 2023-10-05T12:49:14.822 INFO:teuthology.orchestra.run.smithi012.stdout:Done with cleanup of buckets in tests. 2023-10-05T12:49:14.822 INFO:teuthology.orchestra.run.smithi012.stdout:Done with cleanup of buckets in tests. 2023-10-05T12:49:14.823 INFO:teuthology.orchestra.run.smithi012.stdout:__________________________ test_object_put_acl_mtime ___________________________ 2023-10-05T12:49:14.823 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.823 INFO:teuthology.orchestra.run.smithi012.stdout: def test_object_put_acl_mtime(): 2023-10-05T12:49:14.823 INFO:teuthology.orchestra.run.smithi012.stdout: key = 'foo' 2023-10-05T12:49:14.823 INFO:teuthology.orchestra.run.smithi012.stdout: bucket_name = get_new_bucket() 2023-10-05T12:49:14.823 INFO:teuthology.orchestra.run.smithi012.stdout: # Enable versioning 2023-10-05T12:49:14.823 INFO:teuthology.orchestra.run.smithi012.stdout: check_configure_versioning_retry(bucket_name, "Enabled", "Enabled") 2023-10-05T12:49:14.823 INFO:teuthology.orchestra.run.smithi012.stdout: client = get_client() 2023-10-05T12:49:14.823 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.823 INFO:teuthology.orchestra.run.smithi012.stdout: content = 'foooz' 2023-10-05T12:49:14.823 INFO:teuthology.orchestra.run.smithi012.stdout: client.put_object(Bucket=bucket_name, Key=key, Body=content) 2023-10-05T12:49:14.823 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.824 INFO:teuthology.orchestra.run.smithi012.stdout: obj_response = client.head_object(Bucket=bucket_name, Key=key) 2023-10-05T12:49:14.824 INFO:teuthology.orchestra.run.smithi012.stdout: create_mtime = obj_response['LastModified'] 2023-10-05T12:49:14.824 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.824 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_objects(Bucket=bucket_name) 2023-10-05T12:49:14.824 INFO:teuthology.orchestra.run.smithi012.stdout: obj_list = response['Contents'][0] 2023-10-05T12:49:14.824 INFO:teuthology.orchestra.run.smithi012.stdout:> _compare_dates(obj_list['LastModified'],create_mtime) 2023-10-05T12:49:14.824 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.824 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:3328: 2023-10-05T12:49:14.824 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.824 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.824 INFO:teuthology.orchestra.run.smithi012.stdout:datetime1 = datetime.datetime(2023, 10, 5, 11, 55, 34, tzinfo=tzlocal()) 2023-10-05T12:49:14.824 INFO:teuthology.orchestra.run.smithi012.stdout:datetime2 = datetime.datetime(1970, 1, 1, 0, 0, tzinfo=tzutc()) 2023-10-05T12:49:14.824 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.825 INFO:teuthology.orchestra.run.smithi012.stdout: def _compare_dates(datetime1, datetime2): 2023-10-05T12:49:14.825 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:14.825 INFO:teuthology.orchestra.run.smithi012.stdout: changes ms from datetime1 to 0, compares it to datetime2 2023-10-05T12:49:14.825 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:14.825 INFO:teuthology.orchestra.run.smithi012.stdout: # both times are in datetime format but datetime1 has 2023-10-05T12:49:14.825 INFO:teuthology.orchestra.run.smithi012.stdout: # microseconds and datetime2 does not 2023-10-05T12:49:14.825 INFO:teuthology.orchestra.run.smithi012.stdout: datetime1 = datetime1.replace(microsecond=0) 2023-10-05T12:49:14.825 INFO:teuthology.orchestra.run.smithi012.stdout:> assert datetime1 == datetime2 2023-10-05T12:49:14.825 INFO:teuthology.orchestra.run.smithi012.stdout:E assert datetime.datetime(2023, 10, 5, 11, 55, 34, tzinfo=tzlocal()) == datetime.datetime(1970, 1, 1, 0, 0, tzinfo=tzutc()) 2023-10-05T12:49:14.825 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.825 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:1379: AssertionError 2023-10-05T12:49:14.825 INFO:teuthology.orchestra.run.smithi012.stdout:--------------------------- Captured stdout teardown --------------------------- 2023-10-05T12:49:14.826 INFO:teuthology.orchestra.run.smithi012.stdout:Done with cleanup of buckets in tests. 2023-10-05T12:49:14.826 INFO:teuthology.orchestra.run.smithi012.stdout:Done with cleanup of buckets in tests. 2023-10-05T12:49:14.826 INFO:teuthology.orchestra.run.smithi012.stdout:Done with cleanup of buckets in tests. 2023-10-05T12:49:14.826 INFO:teuthology.orchestra.run.smithi012.stdout:______________________ test_multipart_copy_special_names _______________________ 2023-10-05T12:49:14.826 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.826 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:14.826 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.826 INFO:teuthology.orchestra.run.smithi012.stdout: @contextmanager 2023-10-05T12:49:14.826 INFO:teuthology.orchestra.run.smithi012.stdout: def _error_catcher(self): 2023-10-05T12:49:14.826 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:14.826 INFO:teuthology.orchestra.run.smithi012.stdout: Catch low-level python exceptions, instead re-raising urllib3 2023-10-05T12:49:14.826 INFO:teuthology.orchestra.run.smithi012.stdout: variants, so that low-level exceptions are not leaked in the 2023-10-05T12:49:14.827 INFO:teuthology.orchestra.run.smithi012.stdout: high-level api. 2023-10-05T12:49:14.827 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.827 INFO:teuthology.orchestra.run.smithi012.stdout: On exit, release the connection back to the pool. 2023-10-05T12:49:14.827 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:14.827 INFO:teuthology.orchestra.run.smithi012.stdout: clean_exit = False 2023-10-05T12:49:14.827 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.827 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.827 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.827 INFO:teuthology.orchestra.run.smithi012.stdout:> yield 2023-10-05T12:49:14.827 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.827 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/response.py:444: 2023-10-05T12:49:14.827 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.828 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/response.py:567: in read 2023-10-05T12:49:14.828 INFO:teuthology.orchestra.run.smithi012.stdout: data = self._fp_read(amt) if not fp_closed else b"" 2023-10-05T12:49:14.828 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/response.py:533: in _fp_read 2023-10-05T12:49:14.828 INFO:teuthology.orchestra.run.smithi012.stdout: return self._fp.read(amt) if amt is not None else self._fp.read() 2023-10-05T12:49:14.828 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:476: in read 2023-10-05T12:49:14.828 INFO:teuthology.orchestra.run.smithi012.stdout: s = self._safe_read(self.length) 2023-10-05T12:49:14.828 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:626: in _safe_read 2023-10-05T12:49:14.828 INFO:teuthology.orchestra.run.smithi012.stdout: chunk = self.fp.read(min(amt, MAXAMOUNT)) 2023-10-05T12:49:14.828 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.828 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.828 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:14.828 INFO:teuthology.orchestra.run.smithi012.stdout:b = 2023-10-05T12:49:14.829 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.829 INFO:teuthology.orchestra.run.smithi012.stdout: def readinto(self, b): 2023-10-05T12:49:14.829 INFO:teuthology.orchestra.run.smithi012.stdout: """Read up to len(b) bytes into the writable buffer *b* and return 2023-10-05T12:49:14.829 INFO:teuthology.orchestra.run.smithi012.stdout: the number of bytes read. If the socket is non-blocking and no bytes 2023-10-05T12:49:14.829 INFO:teuthology.orchestra.run.smithi012.stdout: are available, None is returned. 2023-10-05T12:49:14.829 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.829 INFO:teuthology.orchestra.run.smithi012.stdout: If *b* is non-empty, a 0 return value indicates that the connection 2023-10-05T12:49:14.829 INFO:teuthology.orchestra.run.smithi012.stdout: was shutdown at the other end. 2023-10-05T12:49:14.829 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:14.829 INFO:teuthology.orchestra.run.smithi012.stdout: self._checkClosed() 2023-10-05T12:49:14.829 INFO:teuthology.orchestra.run.smithi012.stdout: self._checkReadable() 2023-10-05T12:49:14.829 INFO:teuthology.orchestra.run.smithi012.stdout: if self._timeout_occurred: 2023-10-05T12:49:14.830 INFO:teuthology.orchestra.run.smithi012.stdout: raise OSError("cannot read from timed out object") 2023-10-05T12:49:14.830 INFO:teuthology.orchestra.run.smithi012.stdout: while True: 2023-10-05T12:49:14.830 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.830 INFO:teuthology.orchestra.run.smithi012.stdout:> return self._sock.recv_into(b) 2023-10-05T12:49:14.830 INFO:teuthology.orchestra.run.smithi012.stdout:E socket.timeout: timed out 2023-10-05T12:49:14.830 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.830 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/socket.py:704: timeout 2023-10-05T12:49:14.830 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.830 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:14.830 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.830 INFO:teuthology.orchestra.run.smithi012.stdout:self = , amt = None 2023-10-05T12:49:14.831 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.831 INFO:teuthology.orchestra.run.smithi012.stdout: def read(self, amt=None): 2023-10-05T12:49:14.831 INFO:teuthology.orchestra.run.smithi012.stdout: """Read at most amt bytes from the stream. 2023-10-05T12:49:14.831 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.831 INFO:teuthology.orchestra.run.smithi012.stdout: If the amt argument is omitted, read all data. 2023-10-05T12:49:14.831 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:14.831 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.831 INFO:teuthology.orchestra.run.smithi012.stdout:> chunk = self._raw_stream.read(amt) 2023-10-05T12:49:14.831 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.831 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/response.py:99: 2023-10-05T12:49:14.831 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.831 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/response.py:593: in read 2023-10-05T12:49:14.831 INFO:teuthology.orchestra.run.smithi012.stdout: raise IncompleteRead(self._fp_bytes_read, self.length_remaining) 2023-10-05T12:49:14.831 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/contextlib.py:137: in __exit__ 2023-10-05T12:49:14.832 INFO:teuthology.orchestra.run.smithi012.stdout: self.gen.throw(typ, value, traceback) 2023-10-05T12:49:14.832 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.832 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.832 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:14.832 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.832 INFO:teuthology.orchestra.run.smithi012.stdout: @contextmanager 2023-10-05T12:49:14.832 INFO:teuthology.orchestra.run.smithi012.stdout: def _error_catcher(self): 2023-10-05T12:49:14.832 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:14.832 INFO:teuthology.orchestra.run.smithi012.stdout: Catch low-level python exceptions, instead re-raising urllib3 2023-10-05T12:49:14.832 INFO:teuthology.orchestra.run.smithi012.stdout: variants, so that low-level exceptions are not leaked in the 2023-10-05T12:49:14.832 INFO:teuthology.orchestra.run.smithi012.stdout: high-level api. 2023-10-05T12:49:14.832 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.832 INFO:teuthology.orchestra.run.smithi012.stdout: On exit, release the connection back to the pool. 2023-10-05T12:49:14.833 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:14.833 INFO:teuthology.orchestra.run.smithi012.stdout: clean_exit = False 2023-10-05T12:49:14.833 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.833 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.833 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.833 INFO:teuthology.orchestra.run.smithi012.stdout: yield 2023-10-05T12:49:14.833 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.833 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:14.833 INFO:teuthology.orchestra.run.smithi012.stdout: # FIXME: Ideally we'd like to include the url in the ReadTimeoutError but 2023-10-05T12:49:14.833 INFO:teuthology.orchestra.run.smithi012.stdout: # there is yet no clean way to get at it from this context. 2023-10-05T12:49:14.833 INFO:teuthology.orchestra.run.smithi012.stdout:> raise ReadTimeoutError(self._pool, None, "Read timed out.") 2023-10-05T12:49:14.833 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.ReadTimeoutError: AWSHTTPConnectionPool(host='smithi012.front.sepia.ceph.com', port=80): Read timed out. 2023-10-05T12:49:14.834 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.834 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/response.py:449: ReadTimeoutError 2023-10-05T12:49:14.834 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.834 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:14.834 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.834 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.fails_on_dbstore 2023-10-05T12:49:14.834 INFO:teuthology.orchestra.run.smithi012.stdout: def test_multipart_copy_special_names(): 2023-10-05T12:49:14.834 INFO:teuthology.orchestra.run.smithi012.stdout: src_bucket_name = get_new_bucket() 2023-10-05T12:49:14.834 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.834 INFO:teuthology.orchestra.run.smithi012.stdout: dest_bucket_name = get_new_bucket() 2023-10-05T12:49:14.834 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.834 INFO:teuthology.orchestra.run.smithi012.stdout: dest_key = "mymultipart" 2023-10-05T12:49:14.835 INFO:teuthology.orchestra.run.smithi012.stdout: size = 1 2023-10-05T12:49:14.835 INFO:teuthology.orchestra.run.smithi012.stdout: client = get_client() 2023-10-05T12:49:14.835 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.835 INFO:teuthology.orchestra.run.smithi012.stdout: for src_key in (' ', '_', '__', '?versionId'): 2023-10-05T12:49:14.835 INFO:teuthology.orchestra.run.smithi012.stdout: _create_key_with_random_content(src_key, bucket_name=src_bucket_name) 2023-10-05T12:49:14.835 INFO:teuthology.orchestra.run.smithi012.stdout: (upload_id, parts) = _multipart_copy(src_bucket_name, src_key, dest_bucket_name, dest_key, size) 2023-10-05T12:49:14.835 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.complete_multipart_upload(Bucket=dest_bucket_name, Key=dest_key, UploadId=upload_id, MultipartUpload={'Parts': parts}) 2023-10-05T12:49:14.835 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.get_object(Bucket=dest_bucket_name, Key=dest_key) 2023-10-05T12:49:14.835 INFO:teuthology.orchestra.run.smithi012.stdout: assert size == response['ContentLength'] 2023-10-05T12:49:14.835 INFO:teuthology.orchestra.run.smithi012.stdout:> _check_key_content(src_key, src_bucket_name, dest_key, dest_bucket_name) 2023-10-05T12:49:14.835 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.836 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:5963: 2023-10-05T12:49:14.836 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.836 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:5844: in _check_key_content 2023-10-05T12:49:14.836 INFO:teuthology.orchestra.run.smithi012.stdout: dest_data = _get_body(response) 2023-10-05T12:49:14.836 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:1787: in _get_body 2023-10-05T12:49:14.836 INFO:teuthology.orchestra.run.smithi012.stdout: got = body.read() 2023-10-05T12:49:14.836 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.836 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.836 INFO:teuthology.orchestra.run.smithi012.stdout:self = , amt = None 2023-10-05T12:49:14.836 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.836 INFO:teuthology.orchestra.run.smithi012.stdout: def read(self, amt=None): 2023-10-05T12:49:14.837 INFO:teuthology.orchestra.run.smithi012.stdout: """Read at most amt bytes from the stream. 2023-10-05T12:49:14.837 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.837 INFO:teuthology.orchestra.run.smithi012.stdout: If the amt argument is omitted, read all data. 2023-10-05T12:49:14.837 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:14.837 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.837 INFO:teuthology.orchestra.run.smithi012.stdout: chunk = self._raw_stream.read(amt) 2023-10-05T12:49:14.837 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3ReadTimeoutError as e: 2023-10-05T12:49:14.837 INFO:teuthology.orchestra.run.smithi012.stdout: # TODO: the url will be None as urllib3 isn't setting it yet 2023-10-05T12:49:14.837 INFO:teuthology.orchestra.run.smithi012.stdout:> raise ReadTimeoutError(endpoint_url=e.url, error=e) 2023-10-05T12:49:14.837 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.ReadTimeoutError: Read timeout on endpoint URL: "None" 2023-10-05T12:49:14.837 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.837 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/response.py:102: ReadTimeoutError 2023-10-05T12:49:14.838 INFO:teuthology.orchestra.run.smithi012.stdout:--------------------------- Captured stdout teardown --------------------------- 2023-10-05T12:49:14.838 INFO:teuthology.orchestra.run.smithi012.stdout:Done with cleanup of buckets in tests. 2023-10-05T12:49:14.838 INFO:teuthology.orchestra.run.smithi012.stdout:Done with cleanup of buckets in tests. 2023-10-05T12:49:14.838 INFO:teuthology.orchestra.run.smithi012.stdout:Done with cleanup of buckets in tests. 2023-10-05T12:49:14.838 INFO:teuthology.orchestra.run.smithi012.stdout:________________________ test_multipart_copy_versioned _________________________ 2023-10-05T12:49:14.838 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.838 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.fails_on_dbstore 2023-10-05T12:49:14.838 INFO:teuthology.orchestra.run.smithi012.stdout: def test_multipart_copy_versioned(): 2023-10-05T12:49:14.838 INFO:teuthology.orchestra.run.smithi012.stdout: src_bucket_name = get_new_bucket() 2023-10-05T12:49:14.838 INFO:teuthology.orchestra.run.smithi012.stdout: dest_bucket_name = get_new_bucket() 2023-10-05T12:49:14.838 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.838 INFO:teuthology.orchestra.run.smithi012.stdout: dest_key = "mymultipart" 2023-10-05T12:49:14.839 INFO:teuthology.orchestra.run.smithi012.stdout: check_versioning(src_bucket_name, None) 2023-10-05T12:49:14.839 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.839 INFO:teuthology.orchestra.run.smithi012.stdout: src_key = 'foo' 2023-10-05T12:49:14.839 INFO:teuthology.orchestra.run.smithi012.stdout: check_configure_versioning_retry(src_bucket_name, "Enabled", "Enabled") 2023-10-05T12:49:14.839 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.839 INFO:teuthology.orchestra.run.smithi012.stdout: size = 15 * 1024 * 1024 2023-10-05T12:49:14.839 INFO:teuthology.orchestra.run.smithi012.stdout: _create_key_with_random_content(src_key, size=size, bucket_name=src_bucket_name) 2023-10-05T12:49:14.839 INFO:teuthology.orchestra.run.smithi012.stdout: _create_key_with_random_content(src_key, size=size, bucket_name=src_bucket_name) 2023-10-05T12:49:14.839 INFO:teuthology.orchestra.run.smithi012.stdout: _create_key_with_random_content(src_key, size=size, bucket_name=src_bucket_name) 2023-10-05T12:49:14.839 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.839 INFO:teuthology.orchestra.run.smithi012.stdout: version_id = [] 2023-10-05T12:49:14.839 INFO:teuthology.orchestra.run.smithi012.stdout: client = get_client() 2023-10-05T12:49:14.840 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.list_object_versions(Bucket=src_bucket_name) 2023-10-05T12:49:14.840 INFO:teuthology.orchestra.run.smithi012.stdout: for ver in response['Versions']: 2023-10-05T12:49:14.840 INFO:teuthology.orchestra.run.smithi012.stdout: version_id.append(ver['VersionId']) 2023-10-05T12:49:14.840 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.840 INFO:teuthology.orchestra.run.smithi012.stdout: for vid in version_id: 2023-10-05T12:49:14.840 INFO:teuthology.orchestra.run.smithi012.stdout: (upload_id, parts) = _multipart_copy(src_bucket_name, src_key, dest_bucket_name, dest_key, size, version_id=vid) 2023-10-05T12:49:14.840 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.complete_multipart_upload(Bucket=dest_bucket_name, Key=dest_key, UploadId=upload_id, MultipartUpload={'Parts': parts}) 2023-10-05T12:49:14.840 INFO:teuthology.orchestra.run.smithi012.stdout:> response = client.get_object(Bucket=dest_bucket_name, Key=dest_key) 2023-10-05T12:49:14.840 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.840 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:6064: 2023-10-05T12:49:14.840 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.840 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:14.840 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:14.841 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.841 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.841 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:14.841 INFO:teuthology.orchestra.run.smithi012.stdout:operation_name = 'GetObject' 2023-10-05T12:49:14.841 INFO:teuthology.orchestra.run.smithi012.stdout:api_params = {'Bucket': 'test-client.0-67n8q3qaqfhf9w0-332', 'Key': 'mymultipart'} 2023-10-05T12:49:14.841 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.841 INFO:teuthology.orchestra.run.smithi012.stdout: def _make_api_call(self, operation_name, api_params): 2023-10-05T12:49:14.841 INFO:teuthology.orchestra.run.smithi012.stdout: operation_model = self._service_model.operation_model(operation_name) 2023-10-05T12:49:14.841 INFO:teuthology.orchestra.run.smithi012.stdout: service_name = self._service_model.service_name 2023-10-05T12:49:14.841 INFO:teuthology.orchestra.run.smithi012.stdout: history_recorder.record( 2023-10-05T12:49:14.841 INFO:teuthology.orchestra.run.smithi012.stdout: 'API_CALL', 2023-10-05T12:49:14.841 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-05T12:49:14.841 INFO:teuthology.orchestra.run.smithi012.stdout: 'service': service_name, 2023-10-05T12:49:14.842 INFO:teuthology.orchestra.run.smithi012.stdout: 'operation': operation_name, 2023-10-05T12:49:14.842 INFO:teuthology.orchestra.run.smithi012.stdout: 'params': api_params, 2023-10-05T12:49:14.842 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-05T12:49:14.842 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.842 INFO:teuthology.orchestra.run.smithi012.stdout: if operation_model.deprecated: 2023-10-05T12:49:14.842 INFO:teuthology.orchestra.run.smithi012.stdout: logger.debug( 2023-10-05T12:49:14.842 INFO:teuthology.orchestra.run.smithi012.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2023-10-05T12:49:14.842 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.842 INFO:teuthology.orchestra.run.smithi012.stdout: request_context = { 2023-10-05T12:49:14.842 INFO:teuthology.orchestra.run.smithi012.stdout: 'client_region': self.meta.region_name, 2023-10-05T12:49:14.842 INFO:teuthology.orchestra.run.smithi012.stdout: 'client_config': self.meta.config, 2023-10-05T12:49:14.842 INFO:teuthology.orchestra.run.smithi012.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2023-10-05T12:49:14.842 INFO:teuthology.orchestra.run.smithi012.stdout: 'auth_type': operation_model.auth_type, 2023-10-05T12:49:14.843 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-05T12:49:14.843 INFO:teuthology.orchestra.run.smithi012.stdout: request_dict = self._convert_to_request_dict( 2023-10-05T12:49:14.843 INFO:teuthology.orchestra.run.smithi012.stdout: api_params, operation_model, context=request_context 2023-10-05T12:49:14.843 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.843 INFO:teuthology.orchestra.run.smithi012.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2023-10-05T12:49:14.843 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.843 INFO:teuthology.orchestra.run.smithi012.stdout: service_id = self._service_model.service_id.hyphenize() 2023-10-05T12:49:14.843 INFO:teuthology.orchestra.run.smithi012.stdout: handler, event_response = self.meta.events.emit_until_response( 2023-10-05T12:49:14.843 INFO:teuthology.orchestra.run.smithi012.stdout: 'before-call.{service_id}.{operation_name}'.format( 2023-10-05T12:49:14.843 INFO:teuthology.orchestra.run.smithi012.stdout: service_id=service_id, operation_name=operation_name 2023-10-05T12:49:14.843 INFO:teuthology.orchestra.run.smithi012.stdout: ), 2023-10-05T12:49:14.843 INFO:teuthology.orchestra.run.smithi012.stdout: model=operation_model, 2023-10-05T12:49:14.843 INFO:teuthology.orchestra.run.smithi012.stdout: params=request_dict, 2023-10-05T12:49:14.843 INFO:teuthology.orchestra.run.smithi012.stdout: request_signer=self._request_signer, 2023-10-05T12:49:14.844 INFO:teuthology.orchestra.run.smithi012.stdout: context=request_context, 2023-10-05T12:49:14.844 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.844 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.844 INFO:teuthology.orchestra.run.smithi012.stdout: if event_response is not None: 2023-10-05T12:49:14.844 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = event_response 2023-10-05T12:49:14.844 INFO:teuthology.orchestra.run.smithi012.stdout: else: 2023-10-05T12:49:14.844 INFO:teuthology.orchestra.run.smithi012.stdout: apply_request_checksum(request_dict) 2023-10-05T12:49:14.844 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:14.844 INFO:teuthology.orchestra.run.smithi012.stdout: operation_model, request_dict, request_context 2023-10-05T12:49:14.844 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.844 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.844 INFO:teuthology.orchestra.run.smithi012.stdout: self.meta.events.emit( 2023-10-05T12:49:14.845 INFO:teuthology.orchestra.run.smithi012.stdout: 'after-call.{service_id}.{operation_name}'.format( 2023-10-05T12:49:14.845 INFO:teuthology.orchestra.run.smithi012.stdout: service_id=service_id, operation_name=operation_name 2023-10-05T12:49:14.845 INFO:teuthology.orchestra.run.smithi012.stdout: ), 2023-10-05T12:49:14.845 INFO:teuthology.orchestra.run.smithi012.stdout: http_response=http, 2023-10-05T12:49:14.845 INFO:teuthology.orchestra.run.smithi012.stdout: parsed=parsed_response, 2023-10-05T12:49:14.845 INFO:teuthology.orchestra.run.smithi012.stdout: model=operation_model, 2023-10-05T12:49:14.845 INFO:teuthology.orchestra.run.smithi012.stdout: context=request_context, 2023-10-05T12:49:14.845 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.845 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.845 INFO:teuthology.orchestra.run.smithi012.stdout: if http.status_code >= 300: 2023-10-05T12:49:14.845 INFO:teuthology.orchestra.run.smithi012.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2023-10-05T12:49:14.845 INFO:teuthology.orchestra.run.smithi012.stdout: error_class = self.exceptions.from_code(error_code) 2023-10-05T12:49:14.845 INFO:teuthology.orchestra.run.smithi012.stdout:> raise error_class(parsed_response, operation_name) 2023-10-05T12:49:14.845 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.ClientError: An error occurred (AccessDenied) when calling the GetObject operation: None 2023-10-05T12:49:14.846 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.846 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:938: ClientError 2023-10-05T12:49:14.846 INFO:teuthology.orchestra.run.smithi012.stdout:--------------------------- Captured stdout teardown --------------------------- 2023-10-05T12:49:14.846 INFO:teuthology.orchestra.run.smithi012.stdout:Done with cleanup of buckets in tests. 2023-10-05T12:49:14.846 INFO:teuthology.orchestra.run.smithi012.stdout:Done with cleanup of buckets in tests. 2023-10-05T12:49:14.846 INFO:teuthology.orchestra.run.smithi012.stdout:Done with cleanup of buckets in tests. 2023-10-05T12:49:14.846 INFO:teuthology.orchestra.run.smithi012.stdout:______________________ test_multipart_copy_multiple_sizes ______________________ 2023-10-05T12:49:14.846 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.846 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.fails_on_dbstore 2023-10-05T12:49:14.846 INFO:teuthology.orchestra.run.smithi012.stdout: def test_multipart_copy_multiple_sizes(): 2023-10-05T12:49:14.846 INFO:teuthology.orchestra.run.smithi012.stdout: src_key = 'foo' 2023-10-05T12:49:14.846 INFO:teuthology.orchestra.run.smithi012.stdout: src_bucket_name = _create_key_with_random_content(src_key, 12*1024*1024) 2023-10-05T12:49:14.847 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.847 INFO:teuthology.orchestra.run.smithi012.stdout: dest_bucket_name = get_new_bucket() 2023-10-05T12:49:14.847 INFO:teuthology.orchestra.run.smithi012.stdout: dest_key="mymultipart" 2023-10-05T12:49:14.847 INFO:teuthology.orchestra.run.smithi012.stdout: client = get_client() 2023-10-05T12:49:14.847 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.847 INFO:teuthology.orchestra.run.smithi012.stdout: size = 5*1024*1024 2023-10-05T12:49:14.847 INFO:teuthology.orchestra.run.smithi012.stdout: (upload_id, parts) = _multipart_copy(src_bucket_name, src_key, dest_bucket_name, dest_key, size) 2023-10-05T12:49:14.847 INFO:teuthology.orchestra.run.smithi012.stdout: client.complete_multipart_upload(Bucket=dest_bucket_name, Key=dest_key, UploadId=upload_id, MultipartUpload={'Parts': parts}) 2023-10-05T12:49:14.847 INFO:teuthology.orchestra.run.smithi012.stdout: _check_key_content(src_key, src_bucket_name, dest_key, dest_bucket_name) 2023-10-05T12:49:14.847 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.847 INFO:teuthology.orchestra.run.smithi012.stdout: size = 5*1024*1024+100*1024 2023-10-05T12:49:14.847 INFO:teuthology.orchestra.run.smithi012.stdout: (upload_id, parts) = _multipart_copy(src_bucket_name, src_key, dest_bucket_name, dest_key, size) 2023-10-05T12:49:14.847 INFO:teuthology.orchestra.run.smithi012.stdout: client.complete_multipart_upload(Bucket=dest_bucket_name, Key=dest_key, UploadId=upload_id, MultipartUpload={'Parts': parts}) 2023-10-05T12:49:14.848 INFO:teuthology.orchestra.run.smithi012.stdout:> _check_key_content(src_key, src_bucket_name, dest_key, dest_bucket_name) 2023-10-05T12:49:14.848 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.848 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:6143: 2023-10-05T12:49:14.848 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.848 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:5842: in _check_key_content 2023-10-05T12:49:14.848 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.get_object(Bucket=dest_bucket_name, Key=dest_key) 2023-10-05T12:49:14.848 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:14.848 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:14.848 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.848 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.848 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:14.849 INFO:teuthology.orchestra.run.smithi012.stdout:operation_name = 'GetObject' 2023-10-05T12:49:14.849 INFO:teuthology.orchestra.run.smithi012.stdout:api_params = {'Bucket': 'test-client.0-67n8q3qaqfhf9w0-336', 'Key': 'mymultipart'} 2023-10-05T12:49:14.849 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.849 INFO:teuthology.orchestra.run.smithi012.stdout: def _make_api_call(self, operation_name, api_params): 2023-10-05T12:49:14.849 INFO:teuthology.orchestra.run.smithi012.stdout: operation_model = self._service_model.operation_model(operation_name) 2023-10-05T12:49:14.849 INFO:teuthology.orchestra.run.smithi012.stdout: service_name = self._service_model.service_name 2023-10-05T12:49:14.849 INFO:teuthology.orchestra.run.smithi012.stdout: history_recorder.record( 2023-10-05T12:49:14.849 INFO:teuthology.orchestra.run.smithi012.stdout: 'API_CALL', 2023-10-05T12:49:14.849 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-05T12:49:14.849 INFO:teuthology.orchestra.run.smithi012.stdout: 'service': service_name, 2023-10-05T12:49:14.849 INFO:teuthology.orchestra.run.smithi012.stdout: 'operation': operation_name, 2023-10-05T12:49:14.849 INFO:teuthology.orchestra.run.smithi012.stdout: 'params': api_params, 2023-10-05T12:49:14.850 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-05T12:49:14.850 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.850 INFO:teuthology.orchestra.run.smithi012.stdout: if operation_model.deprecated: 2023-10-05T12:49:14.850 INFO:teuthology.orchestra.run.smithi012.stdout: logger.debug( 2023-10-05T12:49:14.850 INFO:teuthology.orchestra.run.smithi012.stdout: 'Warning: %s.%s() is deprecated', service_name, operation_name 2023-10-05T12:49:14.850 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.850 INFO:teuthology.orchestra.run.smithi012.stdout: request_context = { 2023-10-05T12:49:14.850 INFO:teuthology.orchestra.run.smithi012.stdout: 'client_region': self.meta.region_name, 2023-10-05T12:49:14.850 INFO:teuthology.orchestra.run.smithi012.stdout: 'client_config': self.meta.config, 2023-10-05T12:49:14.850 INFO:teuthology.orchestra.run.smithi012.stdout: 'has_streaming_input': operation_model.has_streaming_input, 2023-10-05T12:49:14.850 INFO:teuthology.orchestra.run.smithi012.stdout: 'auth_type': operation_model.auth_type, 2023-10-05T12:49:14.850 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-05T12:49:14.851 INFO:teuthology.orchestra.run.smithi012.stdout: request_dict = self._convert_to_request_dict( 2023-10-05T12:49:14.851 INFO:teuthology.orchestra.run.smithi012.stdout: api_params, operation_model, context=request_context 2023-10-05T12:49:14.851 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.851 INFO:teuthology.orchestra.run.smithi012.stdout: resolve_checksum_context(request_dict, operation_model, api_params) 2023-10-05T12:49:14.851 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.851 INFO:teuthology.orchestra.run.smithi012.stdout: service_id = self._service_model.service_id.hyphenize() 2023-10-05T12:49:14.851 INFO:teuthology.orchestra.run.smithi012.stdout: handler, event_response = self.meta.events.emit_until_response( 2023-10-05T12:49:14.851 INFO:teuthology.orchestra.run.smithi012.stdout: 'before-call.{service_id}.{operation_name}'.format( 2023-10-05T12:49:14.851 INFO:teuthology.orchestra.run.smithi012.stdout: service_id=service_id, operation_name=operation_name 2023-10-05T12:49:14.851 INFO:teuthology.orchestra.run.smithi012.stdout: ), 2023-10-05T12:49:14.851 INFO:teuthology.orchestra.run.smithi012.stdout: model=operation_model, 2023-10-05T12:49:14.851 INFO:teuthology.orchestra.run.smithi012.stdout: params=request_dict, 2023-10-05T12:49:14.852 INFO:teuthology.orchestra.run.smithi012.stdout: request_signer=self._request_signer, 2023-10-05T12:49:14.852 INFO:teuthology.orchestra.run.smithi012.stdout: context=request_context, 2023-10-05T12:49:14.852 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.852 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.852 INFO:teuthology.orchestra.run.smithi012.stdout: if event_response is not None: 2023-10-05T12:49:14.852 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = event_response 2023-10-05T12:49:14.852 INFO:teuthology.orchestra.run.smithi012.stdout: else: 2023-10-05T12:49:14.852 INFO:teuthology.orchestra.run.smithi012.stdout: apply_request_checksum(request_dict) 2023-10-05T12:49:14.852 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:14.852 INFO:teuthology.orchestra.run.smithi012.stdout: operation_model, request_dict, request_context 2023-10-05T12:49:14.852 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.852 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.853 INFO:teuthology.orchestra.run.smithi012.stdout: self.meta.events.emit( 2023-10-05T12:49:14.853 INFO:teuthology.orchestra.run.smithi012.stdout: 'after-call.{service_id}.{operation_name}'.format( 2023-10-05T12:49:14.853 INFO:teuthology.orchestra.run.smithi012.stdout: service_id=service_id, operation_name=operation_name 2023-10-05T12:49:14.853 INFO:teuthology.orchestra.run.smithi012.stdout: ), 2023-10-05T12:49:14.853 INFO:teuthology.orchestra.run.smithi012.stdout: http_response=http, 2023-10-05T12:49:14.853 INFO:teuthology.orchestra.run.smithi012.stdout: parsed=parsed_response, 2023-10-05T12:49:14.853 INFO:teuthology.orchestra.run.smithi012.stdout: model=operation_model, 2023-10-05T12:49:14.853 INFO:teuthology.orchestra.run.smithi012.stdout: context=request_context, 2023-10-05T12:49:14.853 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.853 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.853 INFO:teuthology.orchestra.run.smithi012.stdout: if http.status_code >= 300: 2023-10-05T12:49:14.853 INFO:teuthology.orchestra.run.smithi012.stdout: error_code = parsed_response.get("Error", {}).get("Code") 2023-10-05T12:49:14.853 INFO:teuthology.orchestra.run.smithi012.stdout: error_class = self.exceptions.from_code(error_code) 2023-10-05T12:49:14.854 INFO:teuthology.orchestra.run.smithi012.stdout:> raise error_class(parsed_response, operation_name) 2023-10-05T12:49:14.854 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.ClientError: An error occurred (AccessDenied) when calling the GetObject operation: None 2023-10-05T12:49:14.854 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.854 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:938: ClientError 2023-10-05T12:49:14.854 INFO:teuthology.orchestra.run.smithi012.stdout:--------------------------- Captured stdout teardown --------------------------- 2023-10-05T12:49:14.854 INFO:teuthology.orchestra.run.smithi012.stdout:Done with cleanup of buckets in tests. 2023-10-05T12:49:14.854 INFO:teuthology.orchestra.run.smithi012.stdout:Done with cleanup of buckets in tests. 2023-10-05T12:49:14.854 INFO:teuthology.orchestra.run.smithi012.stdout:Done with cleanup of buckets in tests. 2023-10-05T12:49:14.854 INFO:teuthology.orchestra.run.smithi012.stdout:_____________________________ test_atomic_read_4mb _____________________________ 2023-10-05T12:49:14.854 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.854 INFO:teuthology.orchestra.run.smithi012.stdout: def test_atomic_read_4mb(): 2023-10-05T12:49:14.854 INFO:teuthology.orchestra.run.smithi012.stdout:> _test_atomic_read(1024*1024*4) 2023-10-05T12:49:14.855 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.855 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:6775: 2023-10-05T12:49:14.855 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.855 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:6769: in _test_atomic_read 2023-10-05T12:49:14.855 INFO:teuthology.orchestra.run.smithi012.stdout: _verify_atomic_key_data(bucket_name, 'testobj', file_size, 'B') 2023-10-05T12:49:14.855 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:6742: in _verify_atomic_key_data 2023-10-05T12:49:14.855 INFO:teuthology.orchestra.run.smithi012.stdout: client.download_fileobj(bucket_name, key, fp_verify) 2023-10-05T12:49:14.855 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/boto3/s3/inject.py:795: in download_fileobj 2023-10-05T12:49:14.855 INFO:teuthology.orchestra.run.smithi012.stdout: return future.result() 2023-10-05T12:49:14.855 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/s3transfer/futures.py:103: in result 2023-10-05T12:49:14.855 INFO:teuthology.orchestra.run.smithi012.stdout: return self._coordinator.result() 2023-10-05T12:49:14.855 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/s3transfer/futures.py:266: in result 2023-10-05T12:49:14.856 INFO:teuthology.orchestra.run.smithi012.stdout: raise self._exception 2023-10-05T12:49:14.856 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/s3transfer/tasks.py:139: in __call__ 2023-10-05T12:49:14.856 INFO:teuthology.orchestra.run.smithi012.stdout: return self._execute_main(kwargs) 2023-10-05T12:49:14.856 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/s3transfer/tasks.py:162: in _execute_main 2023-10-05T12:49:14.856 INFO:teuthology.orchestra.run.smithi012.stdout: return_value = self._main(**kwargs) 2023-10-05T12:49:14.856 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.856 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.856 INFO:teuthology.orchestra.run.smithi012.stdout:self = ImmediatelyWriteIOGetObjectTask(transfer_id=0, {'bucket': 'test-client.0-67n8q3qaqfhf9w0-355', 'key': 'testobj', 'extra_args': {}}) 2023-10-05T12:49:14.856 INFO:teuthology.orchestra.run.smithi012.stdout:client = 2023-10-05T12:49:14.856 INFO:teuthology.orchestra.run.smithi012.stdout:bucket = 'test-client.0-67n8q3qaqfhf9w0-355', key = 'testobj' 2023-10-05T12:49:14.856 INFO:teuthology.orchestra.run.smithi012.stdout:fileobj = 2023-10-05T12:49:14.856 INFO:teuthology.orchestra.run.smithi012.stdout:extra_args = {}, callbacks = [], max_attempts = 5 2023-10-05T12:49:14.856 INFO:teuthology.orchestra.run.smithi012.stdout:download_output_manager = 2023-10-05T12:49:14.857 INFO:teuthology.orchestra.run.smithi012.stdout:io_chunksize = 262144, start_index = 0, bandwidth_limiter = None 2023-10-05T12:49:14.857 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.857 INFO:teuthology.orchestra.run.smithi012.stdout: def _main( 2023-10-05T12:49:14.857 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:14.857 INFO:teuthology.orchestra.run.smithi012.stdout: client, 2023-10-05T12:49:14.857 INFO:teuthology.orchestra.run.smithi012.stdout: bucket, 2023-10-05T12:49:14.857 INFO:teuthology.orchestra.run.smithi012.stdout: key, 2023-10-05T12:49:14.857 INFO:teuthology.orchestra.run.smithi012.stdout: fileobj, 2023-10-05T12:49:14.857 INFO:teuthology.orchestra.run.smithi012.stdout: extra_args, 2023-10-05T12:49:14.857 INFO:teuthology.orchestra.run.smithi012.stdout: callbacks, 2023-10-05T12:49:14.857 INFO:teuthology.orchestra.run.smithi012.stdout: max_attempts, 2023-10-05T12:49:14.857 INFO:teuthology.orchestra.run.smithi012.stdout: download_output_manager, 2023-10-05T12:49:14.858 INFO:teuthology.orchestra.run.smithi012.stdout: io_chunksize, 2023-10-05T12:49:14.858 INFO:teuthology.orchestra.run.smithi012.stdout: start_index=0, 2023-10-05T12:49:14.858 INFO:teuthology.orchestra.run.smithi012.stdout: bandwidth_limiter=None, 2023-10-05T12:49:14.858 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:14.858 INFO:teuthology.orchestra.run.smithi012.stdout: """Downloads an object and places content into io queue 2023-10-05T12:49:14.858 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.858 INFO:teuthology.orchestra.run.smithi012.stdout: :param client: The client to use when calling GetObject 2023-10-05T12:49:14.858 INFO:teuthology.orchestra.run.smithi012.stdout: :param bucket: The bucket to download from 2023-10-05T12:49:14.858 INFO:teuthology.orchestra.run.smithi012.stdout: :param key: The key to download from 2023-10-05T12:49:14.858 INFO:teuthology.orchestra.run.smithi012.stdout: :param fileobj: The file handle to write content to 2023-10-05T12:49:14.858 INFO:teuthology.orchestra.run.smithi012.stdout: :param exta_args: Any extra arguments to include in GetObject request 2023-10-05T12:49:14.859 INFO:teuthology.orchestra.run.smithi012.stdout: :param callbacks: List of progress callbacks to invoke on download 2023-10-05T12:49:14.859 INFO:teuthology.orchestra.run.smithi012.stdout: :param max_attempts: The number of retries to do when downloading 2023-10-05T12:49:14.859 INFO:teuthology.orchestra.run.smithi012.stdout: :param download_output_manager: The download output manager associated 2023-10-05T12:49:14.859 INFO:teuthology.orchestra.run.smithi012.stdout: with the current download. 2023-10-05T12:49:14.859 INFO:teuthology.orchestra.run.smithi012.stdout: :param io_chunksize: The size of each io chunk to read from the 2023-10-05T12:49:14.859 INFO:teuthology.orchestra.run.smithi012.stdout: download stream and queue in the io queue. 2023-10-05T12:49:14.859 INFO:teuthology.orchestra.run.smithi012.stdout: :param start_index: The location in the file to start writing the 2023-10-05T12:49:14.859 INFO:teuthology.orchestra.run.smithi012.stdout: content of the key to. 2023-10-05T12:49:14.859 INFO:teuthology.orchestra.run.smithi012.stdout: :param bandwidth_limiter: The bandwidth limiter to use when throttling 2023-10-05T12:49:14.859 INFO:teuthology.orchestra.run.smithi012.stdout: the downloading of data in streams. 2023-10-05T12:49:14.859 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:14.859 INFO:teuthology.orchestra.run.smithi012.stdout: last_exception = None 2023-10-05T12:49:14.859 INFO:teuthology.orchestra.run.smithi012.stdout: for i in range(max_attempts): 2023-10-05T12:49:14.860 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.860 INFO:teuthology.orchestra.run.smithi012.stdout: current_index = start_index 2023-10-05T12:49:14.860 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.get_object( 2023-10-05T12:49:14.860 INFO:teuthology.orchestra.run.smithi012.stdout: Bucket=bucket, Key=key, **extra_args 2023-10-05T12:49:14.860 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.860 INFO:teuthology.orchestra.run.smithi012.stdout: streaming_body = StreamReaderProgress( 2023-10-05T12:49:14.860 INFO:teuthology.orchestra.run.smithi012.stdout: response['Body'], callbacks 2023-10-05T12:49:14.860 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.860 INFO:teuthology.orchestra.run.smithi012.stdout: if bandwidth_limiter: 2023-10-05T12:49:14.860 INFO:teuthology.orchestra.run.smithi012.stdout: streaming_body = ( 2023-10-05T12:49:14.860 INFO:teuthology.orchestra.run.smithi012.stdout: bandwidth_limiter.get_bandwith_limited_stream( 2023-10-05T12:49:14.860 INFO:teuthology.orchestra.run.smithi012.stdout: streaming_body, self._transfer_coordinator 2023-10-05T12:49:14.860 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.861 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.861 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.861 INFO:teuthology.orchestra.run.smithi012.stdout: chunks = DownloadChunkIterator(streaming_body, io_chunksize) 2023-10-05T12:49:14.861 INFO:teuthology.orchestra.run.smithi012.stdout: for chunk in chunks: 2023-10-05T12:49:14.861 INFO:teuthology.orchestra.run.smithi012.stdout: # If the transfer is done because of a cancellation 2023-10-05T12:49:14.861 INFO:teuthology.orchestra.run.smithi012.stdout: # or error somewhere else, stop trying to submit more 2023-10-05T12:49:14.861 INFO:teuthology.orchestra.run.smithi012.stdout: # data to be written and break out of the download. 2023-10-05T12:49:14.861 INFO:teuthology.orchestra.run.smithi012.stdout: if not self._transfer_coordinator.done(): 2023-10-05T12:49:14.861 INFO:teuthology.orchestra.run.smithi012.stdout: self._handle_io( 2023-10-05T12:49:14.861 INFO:teuthology.orchestra.run.smithi012.stdout: download_output_manager, 2023-10-05T12:49:14.861 INFO:teuthology.orchestra.run.smithi012.stdout: fileobj, 2023-10-05T12:49:14.861 INFO:teuthology.orchestra.run.smithi012.stdout: chunk, 2023-10-05T12:49:14.862 INFO:teuthology.orchestra.run.smithi012.stdout: current_index, 2023-10-05T12:49:14.862 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.862 INFO:teuthology.orchestra.run.smithi012.stdout: current_index += len(chunk) 2023-10-05T12:49:14.862 INFO:teuthology.orchestra.run.smithi012.stdout: else: 2023-10-05T12:49:14.862 INFO:teuthology.orchestra.run.smithi012.stdout: return 2023-10-05T12:49:14.862 INFO:teuthology.orchestra.run.smithi012.stdout: return 2023-10-05T12:49:14.862 INFO:teuthology.orchestra.run.smithi012.stdout: except S3_RETRYABLE_DOWNLOAD_ERRORS as e: 2023-10-05T12:49:14.862 INFO:teuthology.orchestra.run.smithi012.stdout: logger.debug( 2023-10-05T12:49:14.862 INFO:teuthology.orchestra.run.smithi012.stdout: "Retrying exception caught (%s), " 2023-10-05T12:49:14.862 INFO:teuthology.orchestra.run.smithi012.stdout: "retrying request, (attempt %s / %s)", 2023-10-05T12:49:14.862 INFO:teuthology.orchestra.run.smithi012.stdout: e, 2023-10-05T12:49:14.862 INFO:teuthology.orchestra.run.smithi012.stdout: i, 2023-10-05T12:49:14.863 INFO:teuthology.orchestra.run.smithi012.stdout: max_attempts, 2023-10-05T12:49:14.863 INFO:teuthology.orchestra.run.smithi012.stdout: exc_info=True, 2023-10-05T12:49:14.863 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.863 INFO:teuthology.orchestra.run.smithi012.stdout: last_exception = e 2023-10-05T12:49:14.863 INFO:teuthology.orchestra.run.smithi012.stdout: # Also invoke the progress callbacks to indicate that we 2023-10-05T12:49:14.863 INFO:teuthology.orchestra.run.smithi012.stdout: # are trying to download the stream again and all progress 2023-10-05T12:49:14.863 INFO:teuthology.orchestra.run.smithi012.stdout: # for this GetObject has been lost. 2023-10-05T12:49:14.863 INFO:teuthology.orchestra.run.smithi012.stdout: invoke_progress_callbacks( 2023-10-05T12:49:14.863 INFO:teuthology.orchestra.run.smithi012.stdout: callbacks, start_index - current_index 2023-10-05T12:49:14.863 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.863 INFO:teuthology.orchestra.run.smithi012.stdout: continue 2023-10-05T12:49:14.864 INFO:teuthology.orchestra.run.smithi012.stdout:> raise RetriesExceededError(last_exception) 2023-10-05T12:49:14.864 INFO:teuthology.orchestra.run.smithi012.stdout:E s3transfer.exceptions.RetriesExceededError: Max Retries Exceeded 2023-10-05T12:49:14.864 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.864 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/s3transfer/download.py:615: RetriesExceededError 2023-10-05T12:49:14.864 INFO:teuthology.orchestra.run.smithi012.stdout:--------------------------- Captured stdout teardown --------------------------- 2023-10-05T12:49:14.865 INFO:teuthology.orchestra.run.smithi012.stdout:Done with cleanup of buckets in tests. 2023-10-05T12:49:14.865 INFO:teuthology.orchestra.run.smithi012.stdout:Done with cleanup of buckets in tests. 2023-10-05T12:49:14.865 INFO:teuthology.orchestra.run.smithi012.stdout:Done with cleanup of buckets in tests. 2023-10-05T12:49:14.865 INFO:teuthology.orchestra.run.smithi012.stdout:_____________________________ test_atomic_read_8mb _____________________________ 2023-10-05T12:49:14.865 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.865 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:14.865 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.865 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:14.865 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:14.865 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.866 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:14.866 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:14.866 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:14.866 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:14.866 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:14.866 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.866 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:14.866 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:14.866 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.866 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.866 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:14.866 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:14.867 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.867 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.867 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:14.867 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.867 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:14.867 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:14.867 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.867 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.867 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:14.867 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:14.867 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.867 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:14.868 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:14.868 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:14.868 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:14.868 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:14.868 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:14.868 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:14.868 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.868 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:14.868 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:14.868 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:14.868 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:14.869 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:14.869 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:14.869 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:14.869 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:14.869 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:14.869 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.869 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:14.869 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:14.869 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:14.869 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:14.869 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.869 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:14.870 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:14.870 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:14.870 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:14.870 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.870 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.870 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:14.870 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:14.870 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:14.870 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:14.870 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.870 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.870 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:14.871 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:14.871 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:14.871 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.871 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:14.871 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.871 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:14.871 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:14.871 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.871 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:14.871 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:14.871 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:14.871 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:14.872 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:14.872 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:14.872 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.872 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:14.872 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.872 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:14.872 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.872 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:14.872 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:14.872 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.872 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:14.872 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.873 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:14.873 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:14.873 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:14.873 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:14.873 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:14.873 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:14.873 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:14.873 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:14.873 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:14.873 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:14.873 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:14.873 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:14.874 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:14.874 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.874 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:14.874 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:14.874 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:14.874 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:14.874 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:14.874 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:14.874 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:14.874 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:14.874 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:14.874 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:14.875 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:14.875 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.875 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.875 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:14.875 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.875 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:14.875 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:14.875 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:14.875 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:14.875 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:14.875 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:14.875 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:14.876 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:14.876 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:14.876 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:14.876 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:14.876 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:14.876 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:14.876 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:14.876 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:14.876 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:14.876 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:14.876 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:14.876 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:14.877 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:14.877 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:14.877 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:14.877 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:14.877 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:14.877 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:14.877 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:14.877 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:14.877 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:14.877 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.877 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.877 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:14.878 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.878 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:14.878 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:14.878 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.878 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:14.878 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:14.878 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:14.878 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:14.878 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:14.878 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.878 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:14.878 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:14.879 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.879 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.879 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:14.879 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:14.879 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.879 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.879 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:14.879 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:14.879 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:14.879 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:14.879 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:14.879 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.880 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.880 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:14.880 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:14.880 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:14.880 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.880 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:14.880 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.880 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:14.880 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.880 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:14.880 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.880 INFO:teuthology.orchestra.run.smithi012.stdout: def test_atomic_read_8mb(): 2023-10-05T12:49:14.880 INFO:teuthology.orchestra.run.smithi012.stdout:> _test_atomic_read(1024*1024*8) 2023-10-05T12:49:14.881 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.881 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:6778: 2023-10-05T12:49:14.881 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.881 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:6769: in _test_atomic_read 2023-10-05T12:49:14.881 INFO:teuthology.orchestra.run.smithi012.stdout: _verify_atomic_key_data(bucket_name, 'testobj', file_size, 'B') 2023-10-05T12:49:14.881 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:6742: in _verify_atomic_key_data 2023-10-05T12:49:14.881 INFO:teuthology.orchestra.run.smithi012.stdout: client.download_fileobj(bucket_name, key, fp_verify) 2023-10-05T12:49:14.881 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/boto3/s3/inject.py:795: in download_fileobj 2023-10-05T12:49:14.881 INFO:teuthology.orchestra.run.smithi012.stdout: return future.result() 2023-10-05T12:49:14.881 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/s3transfer/futures.py:103: in result 2023-10-05T12:49:14.881 INFO:teuthology.orchestra.run.smithi012.stdout: return self._coordinator.result() 2023-10-05T12:49:14.881 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/s3transfer/futures.py:266: in result 2023-10-05T12:49:14.881 INFO:teuthology.orchestra.run.smithi012.stdout: raise self._exception 2023-10-05T12:49:14.882 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/s3transfer/tasks.py:139: in __call__ 2023-10-05T12:49:14.882 INFO:teuthology.orchestra.run.smithi012.stdout: return self._execute_main(kwargs) 2023-10-05T12:49:14.882 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/s3transfer/tasks.py:162: in _execute_main 2023-10-05T12:49:14.882 INFO:teuthology.orchestra.run.smithi012.stdout: return_value = self._main(**kwargs) 2023-10-05T12:49:14.882 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/s3transfer/download.py:569: in _main 2023-10-05T12:49:14.882 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.get_object( 2023-10-05T12:49:14.882 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:14.882 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:14.882 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:14.882 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:14.882 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:14.883 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:14.883 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:14.883 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:14.883 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:14.883 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:14.883 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:14.883 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:14.883 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:14.883 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:14.883 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:14.883 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:14.884 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:14.884 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:14.884 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:14.884 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:14.884 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:14.884 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:14.884 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:14.884 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:14.884 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:14.884 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:14.884 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:14.884 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:14.884 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:14.885 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:14.885 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:14.885 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:14.885 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:14.885 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:14.885 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.885 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.885 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:14.885 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:14.885 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.885 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:14.885 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.885 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:14.886 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:14.886 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:14.886 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:14.886 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:14.886 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:14.886 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:14.886 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:14.886 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:14.886 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:14.886 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:14.886 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:14.886 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:14.887 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.887 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:14.887 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:14.887 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:14.887 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:14.887 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:14.887 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:14.887 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:14.887 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:14.887 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:14.887 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:14.887 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:14.888 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.888 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.888 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:14.888 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:14.888 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:14.888 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:14.888 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:14.888 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.888 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.888 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:14.888 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:14.888 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:14.888 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:14.889 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:14.889 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.889 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:14.889 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:14.889 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:14.889 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:14.889 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:14.889 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-356/testobj" 2023-10-05T12:49:14.889 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.889 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:14.889 INFO:teuthology.orchestra.run.smithi012.stdout:____________________________ test_atomic_write_1mb _____________________________ 2023-10-05T12:49:14.889 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.890 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:14.890 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.890 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:14.890 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:14.890 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.890 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:14.890 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:14.890 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:14.890 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:14.890 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:14.890 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.890 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:14.891 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:14.891 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.891 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.891 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:14.891 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:14.891 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.891 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.891 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:14.891 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.891 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:14.891 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:14.891 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.892 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.892 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:14.892 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:14.892 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.892 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:14.892 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:14.892 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:14.892 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:14.892 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:14.892 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:14.892 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:14.892 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.892 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:14.893 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:14.893 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:14.893 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:14.893 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:14.893 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:14.893 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:14.893 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:14.893 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:14.893 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.893 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:14.894 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:14.894 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:14.894 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:14.894 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.894 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:14.894 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:14.894 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:14.894 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:14.894 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.894 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.894 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:14.894 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:14.895 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:14.895 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:14.895 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.895 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.895 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:14.895 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:14.895 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:14.895 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.895 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:14.895 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.895 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:14.895 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:14.895 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.896 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:14.896 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:14.896 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:14.896 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:14.896 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:14.896 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:14.896 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.896 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:14.896 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.896 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:14.896 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.896 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:14.896 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:14.897 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.897 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:14.897 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.897 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:14.897 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:14.897 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:14.897 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:14.897 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:14.897 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:14.897 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:14.897 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:14.897 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:14.898 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:14.898 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:14.898 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:14.898 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:14.898 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.898 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:14.898 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:14.898 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:14.898 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:14.898 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:14.898 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:14.899 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:14.899 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:14.899 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:14.899 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:14.899 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:14.899 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.899 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.899 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:14.899 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.899 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:14.899 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:14.899 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:14.900 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:14.900 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:14.900 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:14.900 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:14.900 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:14.900 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:14.900 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:14.900 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:14.900 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:14.900 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:14.900 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:14.900 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:14.901 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:14.901 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:14.901 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:14.901 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:14.901 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:14.901 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:14.901 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:14.901 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:14.901 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:14.901 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:14.901 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:14.901 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:14.902 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:14.902 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.902 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.902 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:14.902 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.902 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:14.902 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:14.902 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.902 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:14.902 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:14.902 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:14.903 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:14.903 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:14.903 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.903 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:14.903 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:14.903 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.903 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.903 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:14.903 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:14.903 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.903 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.903 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:14.903 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:14.904 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:14.904 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:14.904 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:14.904 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.904 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.904 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:14.904 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:14.904 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:14.904 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.904 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:14.904 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.904 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:14.904 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.905 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:14.905 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.905 INFO:teuthology.orchestra.run.smithi012.stdout: def test_atomic_write_1mb(): 2023-10-05T12:49:14.905 INFO:teuthology.orchestra.run.smithi012.stdout:> _test_atomic_write(1024*1024) 2023-10-05T12:49:14.905 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.905 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:6813: 2023-10-05T12:49:14.905 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.905 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:6788: in _test_atomic_write 2023-10-05T12:49:14.905 INFO:teuthology.orchestra.run.smithi012.stdout: bucket_name = get_new_bucket() 2023-10-05T12:49:14.905 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-10-05T12:49:14.905 INFO:teuthology.orchestra.run.smithi012.stdout: client.create_bucket(Bucket=name) 2023-10-05T12:49:14.905 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:14.905 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:14.906 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:14.906 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:14.906 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:14.906 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:14.906 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:14.906 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:14.906 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:14.906 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:14.906 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:14.906 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:14.906 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:14.906 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:14.907 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:14.907 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:14.907 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:14.907 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:14.907 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:14.907 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:14.907 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:14.907 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:14.907 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:14.907 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:14.907 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:14.907 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:14.908 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:14.908 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:14.908 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:14.908 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:14.908 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:14.908 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:14.908 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:14.908 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:14.908 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.908 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.908 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:14.908 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:14.909 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.909 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:14.909 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.909 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:14.909 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:14.909 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:14.909 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:14.909 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:14.909 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:14.909 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:14.909 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:14.909 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:14.909 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:14.910 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:14.910 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:14.910 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:14.910 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.910 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:14.910 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:14.910 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:14.910 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:14.910 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:14.910 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:14.910 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:14.910 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:14.910 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:14.911 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:14.911 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:14.911 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.911 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.911 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:14.911 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:14.911 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:14.911 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:14.911 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:14.911 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.911 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.911 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:14.911 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:14.912 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:14.912 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:14.912 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:14.912 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.912 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:14.912 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:14.912 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:14.912 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:14.912 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:14.912 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-357" 2023-10-05T12:49:14.912 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.912 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:14.912 INFO:teuthology.orchestra.run.smithi012.stdout:____________________________ test_atomic_write_4mb _____________________________ 2023-10-05T12:49:14.913 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.913 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:14.913 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.913 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:14.913 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:14.913 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.913 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:14.913 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:14.913 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:14.913 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:14.913 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:14.913 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.913 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:14.914 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:14.914 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.914 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.914 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:14.914 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:14.914 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.914 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.914 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:14.914 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.914 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:14.914 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:14.914 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.914 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.915 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:14.915 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:14.915 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.915 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:14.915 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:14.915 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:14.915 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:14.915 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:14.915 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:14.915 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:14.915 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.915 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:14.915 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:14.916 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:14.916 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:14.916 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:14.916 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:14.916 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:14.916 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:14.916 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:14.916 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.916 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:14.916 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:14.916 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:14.916 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:14.916 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.917 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:14.917 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:14.917 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:14.917 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:14.917 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.917 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.917 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:14.917 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:14.917 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:14.917 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:14.917 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.917 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.918 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:14.918 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:14.918 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:14.918 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.918 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:14.918 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.918 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:14.918 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:14.918 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.918 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:14.918 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:14.919 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:14.919 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:14.919 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:14.919 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:14.919 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.919 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:14.919 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.919 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:14.919 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.919 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:14.919 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:14.921 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.921 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:14.921 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.921 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:14.921 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:14.921 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:14.921 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:14.921 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:14.921 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:14.921 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:14.921 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:14.921 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:14.922 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:14.922 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:14.922 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:14.922 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:14.922 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.922 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:14.922 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:14.922 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:14.922 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:14.922 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:14.923 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:14.923 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:14.923 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:14.923 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:14.923 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:14.923 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:14.923 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.923 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.923 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:14.923 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.923 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:14.923 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:14.924 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:14.924 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:14.924 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:14.924 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:14.924 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:14.924 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:14.924 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:14.924 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:14.924 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:14.924 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:14.924 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:14.924 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:14.924 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:14.925 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:14.925 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:14.925 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:14.925 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:14.925 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:14.925 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:14.925 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:14.925 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:14.925 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:14.925 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:14.925 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:14.925 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:14.925 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:14.925 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.926 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.926 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:14.926 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.926 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:14.926 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:14.926 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.926 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:14.926 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:14.926 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:14.926 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:14.926 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:14.926 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.927 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:14.927 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:14.927 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.927 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.927 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:14.927 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:14.927 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.927 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.927 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:14.927 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:14.927 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:14.927 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:14.927 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:14.928 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.928 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.928 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:14.928 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:14.928 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:14.928 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.928 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:14.928 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.928 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:14.928 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.928 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:14.928 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.929 INFO:teuthology.orchestra.run.smithi012.stdout: def test_atomic_write_4mb(): 2023-10-05T12:49:14.929 INFO:teuthology.orchestra.run.smithi012.stdout:> _test_atomic_write(1024*1024*4) 2023-10-05T12:49:14.929 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.929 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:6816: 2023-10-05T12:49:14.929 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.929 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:6788: in _test_atomic_write 2023-10-05T12:49:14.929 INFO:teuthology.orchestra.run.smithi012.stdout: bucket_name = get_new_bucket() 2023-10-05T12:49:14.929 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-10-05T12:49:14.929 INFO:teuthology.orchestra.run.smithi012.stdout: client.create_bucket(Bucket=name) 2023-10-05T12:49:14.929 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:14.929 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:14.929 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:14.930 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:14.930 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:14.930 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:14.930 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:14.930 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:14.930 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:14.930 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:14.930 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:14.930 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:14.930 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:14.930 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:14.931 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:14.931 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:14.931 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:14.931 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:14.931 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:14.931 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:14.931 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:14.931 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:14.931 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:14.931 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:14.931 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:14.931 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:14.932 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:14.932 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:14.932 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:14.932 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:14.932 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:14.932 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:14.932 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:14.932 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:14.932 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.932 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.932 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:14.932 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:14.933 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.933 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:14.933 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.933 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:14.933 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:14.933 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:14.933 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:14.933 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:14.933 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:14.933 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:14.933 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:14.934 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:14.934 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:14.934 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:14.934 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:14.934 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:14.934 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.934 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:14.934 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:14.934 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:14.934 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:14.934 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:14.935 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:14.935 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:14.935 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:14.935 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:14.935 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:14.935 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:14.935 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.935 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.935 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:14.935 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:14.935 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:14.935 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:14.936 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:14.936 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.936 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.936 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:14.936 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:14.936 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:14.936 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:14.936 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:14.936 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.937 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:14.937 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:14.937 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:14.937 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:14.937 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:14.937 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-358" 2023-10-05T12:49:14.937 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.937 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:14.937 INFO:teuthology.orchestra.run.smithi012.stdout:____________________________ test_atomic_write_8mb _____________________________ 2023-10-05T12:49:14.937 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.937 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:14.937 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.937 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:14.938 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:14.938 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.938 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:14.938 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:14.938 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:14.938 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:14.938 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:14.938 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.938 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:14.938 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:14.938 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.939 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.939 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:14.939 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:14.939 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.939 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.939 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:14.939 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.939 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:14.939 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:14.939 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.939 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.939 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:14.940 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:14.940 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.940 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:14.940 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:14.940 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:14.940 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:14.940 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:14.940 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:14.940 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:14.940 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.940 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:14.940 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:14.941 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:14.941 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:14.941 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:14.941 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:14.941 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:14.941 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:14.941 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:14.941 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.941 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:14.941 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:14.941 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:14.941 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:14.941 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.941 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:14.942 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:14.942 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:14.942 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:14.942 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.942 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.942 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:14.942 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:14.942 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:14.942 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:14.942 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.942 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.942 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:14.943 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:14.943 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:14.943 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.943 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:14.943 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.943 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:14.943 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:14.943 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.943 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:14.943 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:14.943 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:14.943 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:14.943 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:14.944 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:14.944 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.944 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:14.944 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.944 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:14.944 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.944 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:14.944 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:14.944 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.944 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:14.944 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.944 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:14.944 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:14.945 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:14.945 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:14.945 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:14.945 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:14.945 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:14.945 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:14.945 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:14.945 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:14.945 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:14.945 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:14.945 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:14.945 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.945 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:14.946 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:14.946 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:14.946 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:14.946 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:14.946 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:14.946 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:14.946 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:14.946 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:14.946 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:14.946 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:14.946 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.946 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.947 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:14.947 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.947 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:14.947 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:14.947 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:14.947 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:14.947 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:14.947 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:14.947 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:14.947 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:14.947 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:14.947 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:14.947 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:14.947 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:14.948 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:14.948 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:14.948 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:14.948 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:14.948 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:14.948 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:14.948 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:14.948 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:14.948 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:14.948 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:14.948 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:14.948 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:14.949 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:14.949 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:14.949 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:14.949 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:14.949 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.949 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.949 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:14.949 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.949 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:14.949 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:14.949 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.949 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:14.950 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:14.950 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:14.950 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:14.950 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:14.950 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.950 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:14.950 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:14.950 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.950 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.950 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:14.950 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:14.951 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.951 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.951 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:14.951 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:14.951 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:14.951 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:14.951 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:14.951 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.951 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.951 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:14.951 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:14.951 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:14.951 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.952 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:14.952 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.952 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:14.952 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.952 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:14.952 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.952 INFO:teuthology.orchestra.run.smithi012.stdout: def test_atomic_write_8mb(): 2023-10-05T12:49:14.952 INFO:teuthology.orchestra.run.smithi012.stdout:> _test_atomic_write(1024*1024*8) 2023-10-05T12:49:14.952 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.952 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:6819: 2023-10-05T12:49:14.952 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.953 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:6788: in _test_atomic_write 2023-10-05T12:49:14.953 INFO:teuthology.orchestra.run.smithi012.stdout: bucket_name = get_new_bucket() 2023-10-05T12:49:14.953 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-10-05T12:49:14.953 INFO:teuthology.orchestra.run.smithi012.stdout: client.create_bucket(Bucket=name) 2023-10-05T12:49:14.953 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:14.953 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:14.953 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:14.953 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:14.953 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:14.953 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:14.953 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:14.954 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:14.954 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:14.954 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:14.954 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:14.954 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:14.954 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:14.954 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:14.954 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:14.954 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:14.954 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:14.954 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:14.955 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:14.955 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:14.955 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:14.955 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:14.955 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:14.955 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:14.955 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:14.955 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:14.955 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:14.955 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:14.955 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:14.955 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:14.956 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:14.956 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:14.956 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:14.956 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:14.956 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.956 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.956 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:14.956 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:14.956 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.956 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:14.956 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.957 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:14.957 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:14.957 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:14.957 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:14.957 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:14.957 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:14.957 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:14.957 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:14.957 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:14.957 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:14.957 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:14.958 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:14.958 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:14.958 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.958 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:14.958 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:14.958 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:14.958 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:14.958 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:14.958 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:14.958 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:14.958 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:14.959 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:14.959 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:14.959 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:14.959 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.959 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.959 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:14.959 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:14.959 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:14.959 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:14.959 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:14.959 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.960 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.960 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:14.960 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:14.960 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:14.960 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:14.960 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:14.960 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.960 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:14.960 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:14.960 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:14.960 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:14.960 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:14.961 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-359" 2023-10-05T12:49:14.961 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.961 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:14.961 INFO:teuthology.orchestra.run.smithi012.stdout:__________________________ test_atomic_dual_write_1mb __________________________ 2023-10-05T12:49:14.961 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.961 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:14.961 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.961 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:14.961 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:14.961 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.961 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:14.961 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:14.962 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:14.962 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:14.962 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:14.962 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.962 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:14.962 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:14.962 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.962 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.962 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:14.962 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:14.962 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.963 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.963 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:14.963 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.963 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:14.963 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:14.963 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.963 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.963 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:14.963 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:14.963 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.963 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:14.963 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:14.963 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:14.964 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:14.964 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:14.964 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:14.964 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:14.964 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.964 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:14.964 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:14.964 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:14.964 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:14.964 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:14.964 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:14.964 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:14.964 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:14.965 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:14.965 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.965 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:14.965 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:14.965 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:14.965 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:14.965 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.965 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:14.965 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:14.965 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:14.966 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:14.966 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.966 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.966 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:14.966 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:14.966 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:14.966 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:14.966 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.966 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.966 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:14.966 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:14.966 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:14.967 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.967 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:14.967 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.967 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:14.967 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:14.967 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.967 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:14.967 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:14.967 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:14.967 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:14.967 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:14.968 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:14.968 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.968 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:14.968 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.968 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:14.969 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.969 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:14.969 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:14.969 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.969 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:14.969 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.969 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:14.970 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:14.970 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:14.970 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:14.970 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:14.970 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:14.970 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:14.970 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:14.970 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:14.970 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:14.970 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:14.970 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:14.971 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:14.971 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.971 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:14.971 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:14.971 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:14.971 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:14.971 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:14.971 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:14.971 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:14.971 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:14.971 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:14.971 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:14.972 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:14.972 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.972 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.972 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:14.972 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.972 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:14.972 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:14.972 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:14.972 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:14.972 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:14.972 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:14.972 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:14.973 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:14.973 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:14.973 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:14.973 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:14.973 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:14.973 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:14.973 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:14.973 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:14.973 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:14.973 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:14.973 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:14.974 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:14.974 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:14.974 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:14.974 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:14.974 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:14.974 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:14.974 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:14.974 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:14.974 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:14.974 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:14.974 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.975 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.975 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:14.975 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.975 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:14.975 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:14.975 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.975 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:14.975 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:14.975 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:14.975 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:14.975 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:14.975 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.976 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:14.976 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:14.976 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.976 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.976 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:14.976 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:14.976 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.976 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.976 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:14.976 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:14.976 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:14.977 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:14.977 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:14.977 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.977 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.977 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:14.977 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:14.977 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:14.977 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.977 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:14.977 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.977 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:14.977 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.978 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:14.978 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.978 INFO:teuthology.orchestra.run.smithi012.stdout: def test_atomic_dual_write_1mb(): 2023-10-05T12:49:14.978 INFO:teuthology.orchestra.run.smithi012.stdout:> _test_atomic_dual_write(1024*1024) 2023-10-05T12:49:14.978 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.978 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:6846: 2023-10-05T12:49:14.978 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.978 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:6826: in _test_atomic_dual_write 2023-10-05T12:49:14.978 INFO:teuthology.orchestra.run.smithi012.stdout: bucket_name = get_new_bucket() 2023-10-05T12:49:14.978 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-10-05T12:49:14.978 INFO:teuthology.orchestra.run.smithi012.stdout: client.create_bucket(Bucket=name) 2023-10-05T12:49:14.979 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:14.979 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:14.979 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:14.979 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:14.979 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:14.979 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:14.979 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:14.979 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:14.979 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:14.979 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:14.979 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:14.979 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:14.980 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:14.980 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:14.980 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:14.980 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:14.980 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:14.980 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:14.980 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:14.980 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:14.980 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:14.980 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:14.980 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:14.980 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:14.981 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:14.981 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:14.981 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:14.981 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:14.981 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:14.981 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:14.981 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:14.981 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:14.981 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:14.981 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:14.981 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.982 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.982 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:14.982 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:14.982 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.982 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:14.982 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.982 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:14.982 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:14.982 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:14.982 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:14.982 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:14.983 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:14.983 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:14.983 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:14.983 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:14.983 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:14.983 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:14.983 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:14.983 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:14.983 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.983 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:14.983 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:14.983 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:14.983 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:14.984 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:14.984 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:14.984 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:14.984 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:14.984 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:14.984 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:14.984 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:14.984 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.984 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.984 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:14.984 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:14.984 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:14.984 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:14.985 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:14.985 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.985 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.985 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:14.985 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:14.985 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:14.985 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:14.985 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:14.985 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.985 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:14.985 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:14.985 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:14.985 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:14.986 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:14.986 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-360" 2023-10-05T12:49:14.986 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.986 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:14.986 INFO:teuthology.orchestra.run.smithi012.stdout:__________________________ test_atomic_dual_write_4mb __________________________ 2023-10-05T12:49:14.986 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.986 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:14.986 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.986 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:14.986 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:14.986 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.986 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:14.987 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:14.987 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:14.987 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:14.987 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:14.987 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.987 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:14.987 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:14.987 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.987 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.987 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:14.987 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:14.987 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.987 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.988 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:14.988 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.988 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:14.988 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:14.988 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.988 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.988 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:14.988 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:14.988 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.988 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:14.988 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:14.989 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:14.989 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:14.989 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:14.989 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:14.989 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:14.989 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.989 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:14.989 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:14.989 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:14.989 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:14.989 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:14.989 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:14.990 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:14.990 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:14.990 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:14.990 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.990 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:14.990 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:14.990 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:14.990 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:14.990 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.990 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:14.990 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:14.991 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:14.991 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:14.991 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.991 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.991 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:14.991 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:14.991 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:14.991 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:14.991 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.991 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.991 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:14.991 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:14.991 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:14.992 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.992 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:14.992 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.992 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:14.992 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:14.992 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.992 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:14.992 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:14.992 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:14.992 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:14.992 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:14.992 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:14.993 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.993 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:14.993 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.993 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:14.993 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.993 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:14.993 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:14.993 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.993 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:14.993 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:14.993 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:14.993 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:14.994 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:14.994 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:14.994 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:14.994 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:14.994 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:14.994 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:14.994 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:14.994 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:14.994 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:14.994 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:14.994 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:14.994 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.994 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:14.995 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:14.995 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:14.995 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:14.995 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:14.995 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:14.995 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:14.995 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:14.995 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:14.995 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:14.995 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:14.996 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:14.996 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.996 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:14.996 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.996 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:14.996 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:14.996 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:14.996 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:14.996 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:14.996 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:14.996 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:14.996 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:14.996 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:14.997 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:14.997 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:14.997 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:14.997 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:14.997 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:14.997 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:14.997 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:14.997 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:14.997 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:14.997 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:14.997 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:14.997 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:14.997 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:14.998 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:14.998 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:14.998 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:14.998 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:14.998 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:14.998 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:14.998 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:14.998 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.998 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:14.998 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.998 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:14.999 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:14.999 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.999 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:14.999 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:14.999 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:14.999 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:14.999 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:14.999 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:14.999 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:14.999 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:14.999 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.000 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.000 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:15.000 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:15.000 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.000 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.000 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:15.000 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:15.000 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:15.000 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:15.000 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:15.000 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.000 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.000 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:15.001 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:15.001 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:15.001 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.001 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:15.001 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.001 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:15.001 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.001 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:15.001 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.001 INFO:teuthology.orchestra.run.smithi012.stdout: def test_atomic_dual_write_4mb(): 2023-10-05T12:49:15.001 INFO:teuthology.orchestra.run.smithi012.stdout:> _test_atomic_dual_write(1024*1024*4) 2023-10-05T12:49:15.001 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.001 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:6849: 2023-10-05T12:49:15.002 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.002 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:6826: in _test_atomic_dual_write 2023-10-05T12:49:15.002 INFO:teuthology.orchestra.run.smithi012.stdout: bucket_name = get_new_bucket() 2023-10-05T12:49:15.002 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-10-05T12:49:15.002 INFO:teuthology.orchestra.run.smithi012.stdout: client.create_bucket(Bucket=name) 2023-10-05T12:49:15.002 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:15.002 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:15.002 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:15.002 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:15.002 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:15.002 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:15.002 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:15.003 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:15.003 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:15.003 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:15.003 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:15.003 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:15.003 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:15.003 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:15.003 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:15.003 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:15.003 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:15.003 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:15.003 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:15.003 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:15.004 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:15.004 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:15.004 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:15.004 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:15.004 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:15.004 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:15.004 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:15.004 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:15.004 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:15.004 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:15.004 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:15.004 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:15.004 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:15.005 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:15.005 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.005 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.005 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.005 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:15.005 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.005 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:15.005 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.005 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:15.005 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:15.005 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:15.005 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:15.005 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:15.006 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:15.006 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:15.006 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:15.006 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:15.006 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:15.006 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:15.006 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:15.006 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:15.006 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.006 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:15.006 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:15.006 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:15.007 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:15.007 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:15.007 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:15.007 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:15.007 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:15.007 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:15.007 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:15.007 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:15.007 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.007 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.007 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:15.007 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:15.007 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:15.007 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:15.008 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:15.008 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.008 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.008 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:15.008 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:15.008 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:15.008 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:15.008 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:15.008 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.008 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:15.008 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:15.008 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:15.009 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:15.009 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:15.009 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-361" 2023-10-05T12:49:15.009 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.009 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:15.009 INFO:teuthology.orchestra.run.smithi012.stdout:__________________________ test_atomic_dual_write_8mb __________________________ 2023-10-05T12:49:15.009 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.009 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.009 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.009 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:15.009 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:15.009 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.010 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:15.010 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:15.010 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:15.010 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:15.010 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:15.010 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.010 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:15.010 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:15.010 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.010 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.010 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:15.010 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:15.011 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.011 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.011 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:15.011 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.011 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:15.011 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:15.011 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.011 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.011 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:15.011 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:15.011 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.011 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:15.012 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:15.012 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:15.012 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:15.012 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:15.012 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:15.012 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:15.012 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.012 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:15.012 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:15.012 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:15.012 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:15.012 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:15.012 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:15.013 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:15.013 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:15.013 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:15.013 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.013 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:15.013 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:15.013 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:15.013 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:15.013 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.013 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:15.013 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:15.013 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:15.013 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:15.013 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.014 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.014 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:15.014 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:15.014 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:15.014 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:15.014 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.014 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.014 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:15.014 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:15.014 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:15.014 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.014 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:15.015 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.015 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:15.015 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:15.015 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.015 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:15.015 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:15.015 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:15.015 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:15.015 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:15.015 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:15.015 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.015 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:15.015 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.016 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:15.016 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.016 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.016 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:15.016 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.016 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:15.016 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.016 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:15.016 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:15.016 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:15.016 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:15.016 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:15.016 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:15.017 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:15.017 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:15.017 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:15.017 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:15.017 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:15.017 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:15.017 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:15.017 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.017 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:15.017 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:15.017 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:15.017 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:15.017 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:15.018 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:15.018 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:15.018 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:15.018 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:15.018 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:15.018 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:15.018 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.018 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.018 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:15.018 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.018 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:15.019 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:15.019 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:15.019 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:15.019 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:15.019 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:15.019 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:15.019 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:15.019 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:15.019 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:15.019 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:15.019 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:15.019 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:15.019 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:15.020 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:15.020 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:15.020 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:15.020 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:15.020 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:15.020 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:15.020 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:15.020 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:15.020 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:15.020 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:15.020 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:15.020 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:15.020 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:15.021 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:15.021 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.021 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.021 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.021 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.021 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:15.021 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:15.021 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.021 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:15.021 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:15.021 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:15.021 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:15.021 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:15.022 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.022 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:15.022 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:15.022 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.022 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.022 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:15.022 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:15.022 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.022 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.022 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:15.022 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:15.022 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:15.022 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:15.023 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:15.023 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.023 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.023 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:15.023 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:15.023 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:15.023 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.023 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:15.023 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.023 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:15.023 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.024 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:15.024 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.024 INFO:teuthology.orchestra.run.smithi012.stdout: def test_atomic_dual_write_8mb(): 2023-10-05T12:49:15.024 INFO:teuthology.orchestra.run.smithi012.stdout:> _test_atomic_dual_write(1024*1024*8) 2023-10-05T12:49:15.024 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.024 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:6852: 2023-10-05T12:49:15.024 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.024 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:6826: in _test_atomic_dual_write 2023-10-05T12:49:15.024 INFO:teuthology.orchestra.run.smithi012.stdout: bucket_name = get_new_bucket() 2023-10-05T12:49:15.024 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-10-05T12:49:15.024 INFO:teuthology.orchestra.run.smithi012.stdout: client.create_bucket(Bucket=name) 2023-10-05T12:49:15.024 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:15.025 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:15.025 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:15.025 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:15.025 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:15.025 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:15.025 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:15.025 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:15.025 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:15.025 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:15.025 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:15.025 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:15.025 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:15.026 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:15.026 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:15.026 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:15.026 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:15.026 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:15.026 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:15.026 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:15.026 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:15.026 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:15.026 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:15.026 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:15.026 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:15.027 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:15.027 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:15.027 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:15.027 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:15.027 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:15.027 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:15.027 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:15.027 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:15.027 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:15.027 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.027 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.027 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.027 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:15.028 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.028 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:15.028 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.028 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:15.028 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:15.028 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:15.028 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:15.028 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:15.028 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:15.028 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:15.028 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:15.029 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:15.029 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:15.029 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:15.029 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:15.029 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:15.029 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.029 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:15.029 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:15.029 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:15.029 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:15.029 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:15.030 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:15.030 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:15.030 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:15.030 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:15.030 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:15.030 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:15.030 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.030 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.030 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:15.030 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:15.030 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:15.030 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:15.031 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:15.031 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.031 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.031 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:15.031 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:15.031 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:15.031 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:15.031 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:15.031 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.031 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:15.031 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:15.031 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:15.031 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:15.032 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:15.032 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-362" 2023-10-05T12:49:15.032 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.032 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:15.032 INFO:teuthology.orchestra.run.smithi012.stdout:______________________ test_atomic_conditional_write_1mb _______________________ 2023-10-05T12:49:15.032 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.032 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.032 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.032 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:15.032 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:15.032 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.032 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:15.033 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:15.033 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:15.033 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:15.033 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:15.033 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.033 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:15.033 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:15.033 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.033 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.033 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:15.033 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:15.033 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.033 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.034 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:15.034 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.034 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:15.034 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:15.034 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.034 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.034 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:15.034 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:15.034 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.034 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:15.034 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:15.034 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:15.035 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:15.035 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:15.035 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:15.035 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:15.035 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.035 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:15.035 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:15.035 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:15.035 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:15.035 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:15.035 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:15.035 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:15.036 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:15.036 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:15.036 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.036 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:15.036 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:15.036 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:15.036 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:15.036 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.036 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:15.036 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:15.036 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:15.036 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:15.037 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.037 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.037 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:15.037 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:15.037 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:15.037 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:15.037 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.037 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.038 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:15.038 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:15.038 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:15.038 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.038 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:15.038 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.038 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:15.038 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:15.038 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.038 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:15.038 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:15.039 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:15.039 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:15.039 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:15.039 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:15.039 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.039 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:15.039 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.039 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:15.039 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.039 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.039 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:15.040 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.040 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:15.040 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.040 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:15.040 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:15.040 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:15.040 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:15.040 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:15.040 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:15.040 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:15.040 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:15.040 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:15.041 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:15.041 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:15.041 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:15.041 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:15.041 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.041 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:15.041 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:15.041 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:15.041 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:15.041 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:15.041 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:15.041 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:15.042 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:15.042 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:15.042 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:15.042 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:15.042 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.042 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.042 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:15.042 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.042 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:15.042 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:15.043 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:15.043 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:15.043 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:15.043 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:15.043 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:15.043 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:15.043 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:15.043 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:15.043 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:15.043 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:15.043 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:15.043 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:15.043 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:15.044 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:15.044 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:15.044 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:15.044 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:15.044 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:15.044 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:15.044 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:15.044 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:15.044 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:15.044 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:15.044 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:15.044 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:15.044 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:15.045 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.045 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.045 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.045 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.045 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:15.045 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:15.045 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.045 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:15.045 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:15.045 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:15.045 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:15.046 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:15.046 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.046 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:15.046 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:15.046 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.046 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.046 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:15.046 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:15.046 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.046 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.046 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:15.046 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:15.047 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:15.047 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:15.047 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:15.047 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.047 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.047 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:15.047 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:15.047 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:15.047 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.047 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:15.047 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.048 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:15.048 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.048 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:15.048 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.048 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.fails_on_aws 2023-10-05T12:49:15.048 INFO:teuthology.orchestra.run.smithi012.stdout: def test_atomic_conditional_write_1mb(): 2023-10-05T12:49:15.048 INFO:teuthology.orchestra.run.smithi012.stdout:> _test_atomic_conditional_write(1024*1024) 2023-10-05T12:49:15.048 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.048 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:6885: 2023-10-05T12:49:15.048 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.049 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:6862: in _test_atomic_conditional_write 2023-10-05T12:49:15.049 INFO:teuthology.orchestra.run.smithi012.stdout: bucket_name = get_new_bucket() 2023-10-05T12:49:15.049 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-10-05T12:49:15.049 INFO:teuthology.orchestra.run.smithi012.stdout: client.create_bucket(Bucket=name) 2023-10-05T12:49:15.049 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:15.049 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:15.049 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:15.049 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:15.049 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:15.049 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:15.049 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:15.049 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:15.050 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:15.050 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:15.050 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:15.050 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:15.050 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:15.050 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:15.050 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:15.050 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:15.050 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:15.050 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:15.050 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:15.051 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:15.051 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:15.051 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:15.051 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:15.051 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:15.051 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:15.051 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:15.051 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:15.051 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:15.051 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:15.051 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:15.051 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:15.051 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:15.052 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:15.052 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:15.052 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.052 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.052 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.052 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:15.052 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.052 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:15.052 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.052 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:15.052 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:15.053 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:15.053 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:15.053 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:15.053 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:15.053 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:15.053 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:15.053 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:15.053 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:15.053 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:15.053 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:15.053 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:15.054 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.054 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:15.054 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:15.054 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:15.054 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:15.054 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:15.054 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:15.054 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:15.054 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:15.054 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:15.054 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:15.054 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:15.055 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.055 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.055 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:15.055 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:15.055 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:15.055 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:15.055 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:15.055 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.055 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.055 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:15.055 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:15.055 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:15.055 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:15.056 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:15.056 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.056 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:15.056 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:15.056 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:15.056 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:15.056 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:15.056 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-363" 2023-10-05T12:49:15.056 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.056 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:15.056 INFO:teuthology.orchestra.run.smithi012.stdout:______________________ test_atomic_multipart_upload_write ______________________ 2023-10-05T12:49:15.056 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.056 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.057 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.057 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:15.057 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:15.057 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.057 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:15.057 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:15.057 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:15.057 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:15.057 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:15.057 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.058 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:15.058 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:15.058 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.058 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.058 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:15.058 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:15.058 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.058 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.058 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:15.058 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.058 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:15.059 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:15.059 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.059 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.059 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:15.059 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:15.059 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.059 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:15.059 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:15.059 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:15.059 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:15.059 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:15.059 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:15.059 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:15.060 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.060 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:15.060 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:15.060 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:15.060 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:15.060 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:15.060 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:15.060 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:15.060 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:15.060 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:15.060 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.060 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:15.061 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:15.061 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:15.061 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:15.061 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.061 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:15.061 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:15.061 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:15.061 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:15.061 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.061 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.061 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:15.061 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:15.061 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:15.062 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:15.062 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.062 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.062 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:15.062 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:15.062 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:15.062 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.062 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:15.062 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.062 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:15.062 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:15.063 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.063 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:15.063 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:15.063 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:15.063 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:15.063 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:15.063 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:15.063 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.063 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:15.063 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.063 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:15.063 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.063 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.064 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:15.064 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.064 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:15.064 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.064 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:15.064 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:15.064 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:15.064 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:15.064 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:15.064 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:15.064 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:15.064 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:15.064 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:15.065 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:15.065 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:15.065 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:15.065 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:15.065 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.065 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:15.065 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:15.065 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:15.065 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:15.065 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:15.065 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:15.065 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:15.066 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:15.066 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:15.066 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:15.066 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:15.066 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.066 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.066 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:15.066 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.066 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:15.066 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:15.067 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:15.067 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:15.067 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:15.067 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:15.067 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:15.067 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:15.067 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:15.067 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:15.067 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:15.067 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:15.067 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:15.068 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:15.068 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:15.068 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:15.068 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:15.068 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:15.068 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:15.068 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:15.068 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:15.068 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:15.068 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:15.068 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:15.068 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:15.068 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:15.069 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:15.069 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:15.069 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.069 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.069 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.069 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.069 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:15.069 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:15.069 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.069 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:15.069 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:15.069 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:15.070 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:15.070 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:15.070 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.070 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:15.070 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:15.070 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.070 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.070 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:15.070 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:15.070 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.070 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.071 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:15.071 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:15.071 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:15.071 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:15.071 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:15.071 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.071 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.071 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:15.071 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:15.071 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:15.071 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.072 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:15.072 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.072 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:15.072 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.072 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:15.072 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.072 INFO:teuthology.orchestra.run.smithi012.stdout: def test_atomic_multipart_upload_write(): 2023-10-05T12:49:15.072 INFO:teuthology.orchestra.run.smithi012.stdout:> bucket_name = get_new_bucket() 2023-10-05T12:49:15.072 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.072 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:6945: 2023-10-05T12:49:15.072 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.072 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-10-05T12:49:15.072 INFO:teuthology.orchestra.run.smithi012.stdout: client.create_bucket(Bucket=name) 2023-10-05T12:49:15.073 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:15.073 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:15.073 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:15.073 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:15.073 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:15.073 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:15.073 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:15.073 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:15.073 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:15.073 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:15.073 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:15.073 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:15.073 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:15.074 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:15.074 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:15.074 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:15.074 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:15.074 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:15.074 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:15.074 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:15.074 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:15.074 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:15.074 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:15.074 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:15.074 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:15.074 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:15.075 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:15.075 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:15.075 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:15.075 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:15.075 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:15.075 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:15.075 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:15.075 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:15.075 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.075 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.075 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.075 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:15.076 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.076 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:15.076 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.076 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:15.076 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:15.076 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:15.076 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:15.076 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:15.076 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:15.076 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:15.076 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:15.076 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:15.076 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:15.076 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:15.077 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:15.077 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:15.077 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.077 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:15.077 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:15.077 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:15.077 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:15.077 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:15.077 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:15.077 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:15.077 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:15.077 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:15.077 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:15.078 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:15.078 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.078 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.078 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:15.078 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:15.078 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:15.078 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:15.078 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:15.078 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.078 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.078 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:15.078 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:15.079 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:15.079 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:15.079 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:15.079 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.079 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:15.079 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:15.079 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:15.079 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:15.079 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:15.079 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-364" 2023-10-05T12:49:15.079 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.079 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:15.079 INFO:teuthology.orchestra.run.smithi012.stdout:__________________ test_multipart_resend_first_finishes_last ___________________ 2023-10-05T12:49:15.080 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.080 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.080 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.080 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:15.080 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:15.080 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.080 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:15.080 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:15.080 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:15.080 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:15.080 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:15.081 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.081 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:15.081 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:15.081 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.081 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.081 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:15.081 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:15.081 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.081 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.081 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:15.081 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.081 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:15.082 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:15.082 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.082 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.082 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:15.082 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:15.082 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.082 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:15.082 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:15.082 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:15.082 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:15.082 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:15.083 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:15.083 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:15.083 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.083 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:15.083 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:15.083 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:15.083 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:15.083 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:15.083 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:15.083 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:15.083 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:15.083 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:15.084 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.084 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:15.084 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:15.084 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:15.084 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:15.084 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.084 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:15.084 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:15.084 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:15.084 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:15.084 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.084 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.084 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:15.085 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:15.085 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:15.085 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:15.085 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.085 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.085 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:15.085 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:15.085 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:15.085 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.085 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:15.086 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.086 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:15.086 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:15.086 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.086 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:15.086 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:15.086 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:15.086 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:15.086 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:15.086 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:15.086 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.086 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:15.087 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.087 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:15.087 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.087 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.087 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:15.087 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.087 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:15.087 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.087 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:15.087 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:15.087 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:15.088 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:15.088 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:15.088 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:15.088 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:15.088 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:15.088 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:15.088 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:15.088 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:15.088 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:15.088 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:15.088 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.089 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:15.089 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:15.089 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:15.089 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:15.089 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:15.089 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:15.089 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:15.089 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:15.089 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:15.089 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:15.089 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:15.090 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.090 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.090 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:15.090 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.090 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:15.090 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:15.090 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:15.090 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:15.090 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:15.090 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:15.090 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:15.090 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:15.091 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:15.091 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:15.091 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:15.091 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:15.091 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:15.091 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:15.091 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:15.091 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:15.091 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:15.091 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:15.091 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:15.091 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:15.092 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:15.092 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:15.092 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:15.092 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:15.092 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:15.092 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:15.092 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:15.092 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:15.092 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.092 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.092 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.092 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.093 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:15.093 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:15.093 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.093 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:15.093 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:15.093 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:15.093 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:15.093 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:15.093 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.093 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:15.093 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:15.094 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.094 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.094 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:15.094 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:15.094 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.094 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.094 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:15.094 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:15.094 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:15.094 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:15.094 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:15.094 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.095 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.095 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:15.095 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:15.095 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:15.095 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.095 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:15.095 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.095 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:15.095 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.095 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:15.095 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.096 INFO:teuthology.orchestra.run.smithi012.stdout: def test_multipart_resend_first_finishes_last(): 2023-10-05T12:49:15.096 INFO:teuthology.orchestra.run.smithi012.stdout:> bucket_name = get_new_bucket() 2023-10-05T12:49:15.096 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.096 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:6983: 2023-10-05T12:49:15.096 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.096 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-10-05T12:49:15.096 INFO:teuthology.orchestra.run.smithi012.stdout: client.create_bucket(Bucket=name) 2023-10-05T12:49:15.096 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:15.096 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:15.096 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:15.096 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:15.097 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:15.097 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:15.097 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:15.097 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:15.097 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:15.097 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:15.097 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:15.097 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:15.097 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:15.097 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:15.097 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:15.097 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:15.097 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:15.098 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:15.098 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:15.098 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:15.098 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:15.098 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:15.098 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:15.098 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:15.098 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:15.098 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:15.098 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:15.098 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:15.099 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:15.099 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:15.099 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:15.099 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:15.099 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:15.099 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:15.099 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.099 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.099 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.099 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:15.100 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.100 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:15.100 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.100 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:15.100 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:15.100 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:15.100 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:15.100 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:15.100 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:15.100 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:15.100 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:15.100 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:15.100 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:15.101 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:15.101 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:15.101 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:15.101 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.101 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:15.101 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:15.101 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:15.101 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:15.101 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:15.101 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:15.101 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:15.101 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:15.101 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:15.102 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:15.102 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:15.102 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.102 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.102 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:15.102 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:15.102 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:15.102 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:15.102 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:15.102 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.102 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.102 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:15.102 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:15.103 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:15.103 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:15.103 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:15.103 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.103 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:15.103 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:15.103 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:15.103 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:15.103 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:15.103 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-365" 2023-10-05T12:49:15.103 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.103 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:15.103 INFO:teuthology.orchestra.run.smithi012.stdout:______________________ test_ranged_request_response_code _______________________ 2023-10-05T12:49:15.104 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.104 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.104 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.104 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:15.104 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:15.104 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.104 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:15.104 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:15.104 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:15.104 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:15.104 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:15.104 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.104 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:15.105 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:15.105 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.105 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.105 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:15.105 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:15.105 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.105 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.105 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:15.105 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.105 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:15.105 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:15.105 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.105 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.105 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:15.106 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:15.106 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.106 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:15.106 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:15.106 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:15.106 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:15.106 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:15.106 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:15.106 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:15.106 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.106 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:15.106 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:15.107 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:15.107 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:15.107 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:15.107 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:15.107 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:15.107 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:15.107 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:15.107 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.107 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:15.107 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:15.107 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:15.107 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:15.117 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.117 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:15.117 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:15.117 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:15.117 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:15.117 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.117 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.117 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:15.117 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:15.118 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:15.118 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:15.118 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.118 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.118 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:15.118 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:15.118 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:15.118 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.118 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:15.118 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.118 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:15.119 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:15.119 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.119 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:15.119 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:15.119 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:15.119 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:15.119 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:15.119 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:15.119 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.119 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:15.120 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.120 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:15.120 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.120 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.120 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:15.120 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.120 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:15.120 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.120 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:15.120 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:15.120 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:15.121 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:15.121 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:15.121 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:15.121 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:15.121 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:15.121 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:15.121 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:15.121 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:15.121 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:15.121 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:15.121 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.121 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:15.122 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:15.122 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:15.122 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:15.122 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:15.122 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:15.122 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:15.122 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:15.122 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:15.122 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:15.122 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:15.122 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.125 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.125 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:15.125 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.125 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:15.125 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:15.125 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:15.125 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:15.126 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:15.126 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:15.126 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:15.126 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:15.126 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:15.126 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:15.126 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:15.126 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:15.126 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:15.126 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:15.126 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:15.126 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:15.127 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:15.127 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:15.127 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:15.127 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:15.127 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:15.127 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:15.127 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:15.127 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:15.127 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:15.127 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:15.127 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:15.128 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:15.128 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.128 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.128 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.128 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.128 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:15.128 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:15.128 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.128 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:15.128 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:15.128 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:15.128 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:15.129 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:15.129 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.129 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:15.129 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:15.129 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.129 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.129 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:15.129 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:15.129 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.129 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.129 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:15.129 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:15.130 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:15.130 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:15.130 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:15.130 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.130 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.130 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:15.130 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:15.130 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:15.130 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.130 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:15.130 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.131 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:15.131 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.131 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:15.131 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.131 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.fails_on_dbstore 2023-10-05T12:49:15.131 INFO:teuthology.orchestra.run.smithi012.stdout: def test_ranged_request_response_code(): 2023-10-05T12:49:15.131 INFO:teuthology.orchestra.run.smithi012.stdout: content = 'testcontent' 2023-10-05T12:49:15.131 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.131 INFO:teuthology.orchestra.run.smithi012.stdout:> bucket_name = get_new_bucket() 2023-10-05T12:49:15.131 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.131 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:7042: 2023-10-05T12:49:15.131 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.131 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-10-05T12:49:15.132 INFO:teuthology.orchestra.run.smithi012.stdout: client.create_bucket(Bucket=name) 2023-10-05T12:49:15.132 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:15.132 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:15.132 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:15.132 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:15.132 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:15.132 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:15.132 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:15.132 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:15.132 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:15.132 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:15.132 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:15.133 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:15.133 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:15.133 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:15.133 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:15.133 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:15.133 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:15.133 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:15.133 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:15.133 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:15.133 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:15.133 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:15.133 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:15.134 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:15.134 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:15.134 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:15.134 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:15.134 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:15.134 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:15.134 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:15.134 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:15.134 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:15.134 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:15.134 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:15.134 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.135 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.135 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.135 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:15.135 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.135 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:15.135 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.135 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:15.135 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:15.135 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:15.135 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:15.136 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:15.136 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:15.136 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:15.136 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:15.136 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:15.136 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:15.136 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:15.136 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:15.136 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:15.136 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.136 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:15.136 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:15.137 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:15.137 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:15.137 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:15.137 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:15.137 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:15.137 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:15.137 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:15.137 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:15.137 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:15.137 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.137 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.137 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:15.138 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:15.138 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:15.138 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:15.138 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:15.138 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.138 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.138 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:15.138 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:15.138 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:15.138 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:15.138 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:15.138 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.139 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:15.139 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:15.139 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:15.139 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:15.139 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:15.139 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-366" 2023-10-05T12:49:15.139 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.139 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:15.139 INFO:teuthology.orchestra.run.smithi012.stdout:____________________ test_ranged_big_request_response_code _____________________ 2023-10-05T12:49:15.139 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.139 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.140 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.140 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:15.140 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:15.140 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.140 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:15.140 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:15.140 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:15.140 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:15.140 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:15.140 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.140 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:15.140 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:15.141 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.141 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.141 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:15.141 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:15.141 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.141 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.141 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:15.141 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.141 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:15.141 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:15.141 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.141 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.142 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:15.142 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:15.142 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.142 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:15.142 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:15.142 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:15.142 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:15.142 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:15.142 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:15.142 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:15.142 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.142 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:15.143 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:15.143 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:15.143 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:15.143 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:15.143 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:15.143 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:15.143 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:15.143 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:15.143 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.143 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:15.143 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:15.143 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:15.144 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:15.144 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.144 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:15.144 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:15.144 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:15.144 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:15.144 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.144 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.144 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:15.144 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:15.144 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:15.144 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:15.145 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.145 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.145 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:15.145 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:15.145 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:15.145 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.145 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:15.145 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.145 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:15.145 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:15.145 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.146 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:15.146 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:15.146 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:15.146 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:15.146 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:15.146 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:15.146 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.146 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:15.146 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.146 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:15.146 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.146 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.147 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:15.147 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.147 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:15.147 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.147 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:15.147 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:15.147 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:15.147 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:15.147 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:15.147 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:15.147 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:15.147 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:15.148 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:15.148 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:15.148 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:15.148 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:15.148 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:15.148 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.148 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:15.148 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:15.148 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:15.148 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:15.148 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:15.149 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:15.149 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:15.149 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:15.149 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:15.149 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:15.149 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:15.149 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.149 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.149 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:15.149 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.149 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:15.149 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:15.149 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:15.150 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:15.150 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:15.150 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:15.150 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:15.150 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:15.150 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:15.150 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:15.150 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:15.150 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:15.150 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:15.150 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:15.151 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:15.151 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:15.151 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:15.151 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:15.151 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:15.151 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:15.151 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:15.151 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:15.151 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:15.151 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:15.152 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:15.152 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:15.152 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:15.152 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:15.152 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.152 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.152 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.152 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.152 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:15.152 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:15.152 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.152 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:15.152 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:15.153 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:15.153 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:15.153 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:15.153 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.153 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:15.153 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:15.153 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.153 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.153 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:15.153 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:15.153 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.153 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.154 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:15.154 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:15.154 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:15.154 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:15.154 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:15.154 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.154 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.154 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:15.154 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:15.154 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:15.154 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.155 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:15.155 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.155 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:15.155 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.155 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:15.155 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.155 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.fails_on_dbstore 2023-10-05T12:49:15.155 INFO:teuthology.orchestra.run.smithi012.stdout: def test_ranged_big_request_response_code(): 2023-10-05T12:49:15.155 INFO:teuthology.orchestra.run.smithi012.stdout: content = _generate_random_string(8*1024*1024) 2023-10-05T12:49:15.155 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.155 INFO:teuthology.orchestra.run.smithi012.stdout:> bucket_name = get_new_bucket() 2023-10-05T12:49:15.155 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.156 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:7060: 2023-10-05T12:49:15.156 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.156 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-10-05T12:49:15.156 INFO:teuthology.orchestra.run.smithi012.stdout: client.create_bucket(Bucket=name) 2023-10-05T12:49:15.156 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:15.156 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:15.156 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:15.156 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:15.156 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:15.156 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:15.156 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:15.156 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:15.157 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:15.157 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:15.157 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:15.157 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:15.157 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:15.157 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:15.157 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:15.157 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:15.157 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:15.157 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:15.157 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:15.157 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:15.158 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:15.158 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:15.158 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:15.158 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:15.158 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:15.158 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:15.158 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:15.158 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:15.158 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:15.158 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:15.159 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:15.159 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:15.159 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:15.159 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:15.159 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.159 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.159 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.159 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:15.159 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.159 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:15.159 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.159 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:15.160 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:15.160 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:15.160 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:15.160 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:15.160 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:15.160 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:15.160 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:15.160 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:15.160 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:15.160 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:15.160 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:15.160 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:15.161 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.161 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:15.161 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:15.161 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:15.161 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:15.161 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:15.161 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:15.161 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:15.161 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:15.161 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:15.161 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:15.161 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:15.162 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.162 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.162 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:15.162 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:15.162 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:15.162 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:15.162 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:15.162 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.162 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.162 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:15.162 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:15.163 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:15.163 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:15.163 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:15.163 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.163 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:15.163 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:15.163 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:15.163 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:15.163 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:15.163 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-367" 2023-10-05T12:49:15.163 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.163 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:15.164 INFO:teuthology.orchestra.run.smithi012.stdout:_____________ test_ranged_request_skip_leading_bytes_response_code _____________ 2023-10-05T12:49:15.164 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.164 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.164 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.164 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:15.164 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:15.164 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.164 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:15.164 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:15.164 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:15.164 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:15.164 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:15.165 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.165 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:15.165 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:15.165 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.165 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.165 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:15.165 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:15.165 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.165 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.165 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:15.165 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.166 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:15.166 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:15.166 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.166 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.166 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:15.166 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:15.166 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.166 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:15.166 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:15.166 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:15.166 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:15.166 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:15.167 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:15.167 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:15.167 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.167 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:15.167 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:15.167 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:15.167 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:15.167 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:15.167 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:15.167 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:15.167 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:15.167 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:15.168 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.168 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:15.168 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:15.168 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:15.168 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:15.168 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.168 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:15.168 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:15.168 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:15.168 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:15.168 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.169 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.169 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:15.169 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:15.169 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:15.169 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:15.169 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.169 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.169 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:15.169 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:15.169 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:15.169 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.170 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:15.170 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.170 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:15.170 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:15.170 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.170 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:15.170 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:15.170 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:15.170 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:15.170 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:15.170 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:15.170 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.171 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:15.171 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.171 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:15.171 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.171 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.171 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:15.171 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.171 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:15.171 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.171 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:15.171 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:15.171 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:15.172 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:15.172 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:15.172 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:15.172 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:15.172 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:15.172 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:15.172 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:15.172 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:15.172 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:15.172 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:15.172 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.172 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:15.173 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:15.173 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:15.173 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:15.173 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:15.173 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:15.173 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:15.173 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:15.173 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:15.173 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:15.173 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:15.173 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.173 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.174 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:15.174 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.174 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:15.174 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:15.174 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:15.174 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:15.174 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:15.174 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:15.174 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:15.174 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:15.174 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:15.175 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:15.175 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:15.175 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:15.175 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:15.175 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:15.175 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:15.175 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:15.175 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:15.175 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:15.175 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:15.175 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:15.175 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:15.176 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:15.176 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:15.176 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:15.176 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:15.176 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:15.176 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:15.176 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:15.176 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.176 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.176 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.176 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.176 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:15.177 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:15.177 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.177 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:15.177 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:15.177 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:15.177 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:15.177 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:15.177 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.177 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:15.177 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:15.177 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.177 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.178 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:15.178 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:15.178 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.178 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.178 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:15.178 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:15.178 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:15.178 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:15.178 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:15.178 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.178 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.179 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:15.179 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:15.179 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:15.179 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.179 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:15.179 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.179 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:15.179 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.179 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:15.179 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.179 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.fails_on_dbstore 2023-10-05T12:49:15.179 INFO:teuthology.orchestra.run.smithi012.stdout: def test_ranged_request_skip_leading_bytes_response_code(): 2023-10-05T12:49:15.180 INFO:teuthology.orchestra.run.smithi012.stdout: content = 'testcontent' 2023-10-05T12:49:15.180 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.180 INFO:teuthology.orchestra.run.smithi012.stdout:> bucket_name = get_new_bucket() 2023-10-05T12:49:15.180 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.180 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:7075: 2023-10-05T12:49:15.180 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.180 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-10-05T12:49:15.180 INFO:teuthology.orchestra.run.smithi012.stdout: client.create_bucket(Bucket=name) 2023-10-05T12:49:15.180 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:15.180 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:15.180 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:15.180 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:15.180 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:15.181 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:15.181 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:15.181 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:15.181 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:15.181 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:15.181 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:15.181 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:15.181 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:15.181 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:15.181 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:15.182 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:15.182 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:15.182 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:15.182 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:15.182 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:15.182 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:15.182 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:15.182 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:15.182 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:15.182 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:15.182 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:15.183 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:15.183 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:15.183 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:15.183 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:15.183 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:15.183 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:15.183 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:15.183 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:15.183 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.183 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.183 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.183 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:15.184 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.184 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:15.184 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.184 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:15.184 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:15.184 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:15.184 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:15.184 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:15.184 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:15.184 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:15.184 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:15.184 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:15.184 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:15.185 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:15.185 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:15.185 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:15.185 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.185 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:15.185 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:15.185 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:15.185 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:15.185 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:15.185 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:15.185 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:15.185 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:15.186 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:15.186 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:15.186 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:15.186 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.186 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.186 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:15.186 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:15.186 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:15.186 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:15.186 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:15.186 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.186 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.187 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:15.187 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:15.187 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:15.187 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:15.187 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:15.187 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.187 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:15.187 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:15.187 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:15.187 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:15.187 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:15.187 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-368" 2023-10-05T12:49:15.188 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.188 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:15.188 INFO:teuthology.orchestra.run.smithi012.stdout:___________ test_ranged_request_return_trailing_bytes_response_code ____________ 2023-10-05T12:49:15.188 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.188 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.188 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.188 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:15.188 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:15.188 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.188 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:15.188 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:15.188 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:15.189 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:15.189 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:15.189 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.189 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:15.189 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:15.189 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.189 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.189 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:15.189 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:15.189 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.189 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.190 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:15.190 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.190 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:15.190 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:15.190 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.190 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.190 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:15.190 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:15.190 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.190 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:15.190 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:15.190 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:15.191 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:15.191 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:15.191 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:15.191 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:15.191 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.191 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:15.191 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:15.191 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:15.191 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:15.191 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:15.191 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:15.191 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:15.192 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:15.192 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:15.192 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.192 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:15.192 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:15.192 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:15.192 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:15.192 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.192 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:15.192 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:15.192 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:15.192 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:15.193 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.193 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.193 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:15.193 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:15.193 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:15.193 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:15.193 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.193 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.193 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:15.193 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:15.193 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:15.193 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.194 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:15.194 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.194 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:15.194 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:15.194 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.194 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:15.194 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:15.194 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:15.194 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:15.194 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:15.194 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:15.195 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.195 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:15.195 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.195 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:15.195 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.195 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.195 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:15.195 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.195 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:15.195 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.195 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:15.195 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:15.196 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:15.196 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:15.196 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:15.196 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:15.196 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:15.196 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:15.196 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:15.196 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:15.196 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:15.196 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:15.196 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:15.197 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.197 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:15.197 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:15.197 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:15.197 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:15.197 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:15.197 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:15.197 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:15.197 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:15.197 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:15.197 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:15.198 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:15.198 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.198 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.198 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:15.198 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.198 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:15.198 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:15.198 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:15.198 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:15.198 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:15.198 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:15.198 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:15.199 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:15.199 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:15.199 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:15.199 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:15.199 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:15.199 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:15.199 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:15.199 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:15.199 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:15.199 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:15.199 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:15.200 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:15.200 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:15.200 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:15.200 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:15.200 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:15.200 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:15.200 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:15.200 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:15.200 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:15.200 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:15.200 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.200 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.201 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.201 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.201 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:15.201 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:15.201 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.201 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:15.201 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:15.201 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:15.201 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:15.201 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:15.201 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.202 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:15.202 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:15.202 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.202 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.202 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:15.202 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:15.202 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.202 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.202 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:15.202 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:15.202 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:15.202 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:15.203 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:15.203 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.203 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.203 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:15.203 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:15.203 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:15.203 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.203 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:15.203 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.203 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:15.203 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.203 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:15.204 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.204 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.fails_on_dbstore 2023-10-05T12:49:15.204 INFO:teuthology.orchestra.run.smithi012.stdout: def test_ranged_request_return_trailing_bytes_response_code(): 2023-10-05T12:49:15.204 INFO:teuthology.orchestra.run.smithi012.stdout: content = 'testcontent' 2023-10-05T12:49:15.204 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.204 INFO:teuthology.orchestra.run.smithi012.stdout:> bucket_name = get_new_bucket() 2023-10-05T12:49:15.204 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.204 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:7090: 2023-10-05T12:49:15.204 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.204 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-10-05T12:49:15.204 INFO:teuthology.orchestra.run.smithi012.stdout: client.create_bucket(Bucket=name) 2023-10-05T12:49:15.204 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:15.204 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:15.205 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:15.205 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:15.205 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:15.205 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:15.205 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:15.205 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:15.205 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:15.205 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:15.205 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:15.205 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:15.205 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:15.205 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:15.205 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:15.206 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:15.206 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:15.206 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:15.206 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:15.206 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:15.206 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:15.206 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:15.206 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:15.206 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:15.206 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:15.206 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:15.206 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:15.207 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:15.207 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:15.207 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:15.207 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:15.207 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:15.207 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:15.207 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:15.207 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.207 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.207 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.207 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:15.207 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.207 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:15.208 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.208 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:15.208 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:15.208 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:15.208 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:15.208 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:15.208 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:15.208 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:15.208 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:15.208 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:15.208 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:15.208 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:15.209 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:15.209 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:15.209 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.209 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:15.209 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:15.209 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:15.209 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:15.209 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:15.209 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:15.209 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:15.210 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:15.210 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:15.210 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:15.210 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:15.210 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.210 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.210 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:15.210 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:15.210 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:15.210 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:15.210 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:15.210 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.210 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.211 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:15.211 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:15.211 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:15.211 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:15.211 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:15.211 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.211 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:15.211 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:15.211 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:15.211 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:15.211 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:15.211 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-369" 2023-10-05T12:49:15.212 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.212 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:15.212 INFO:teuthology.orchestra.run.smithi012.stdout:______________________ test_ranged_request_invalid_range _______________________ 2023-10-05T12:49:15.212 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.212 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.212 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.212 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:15.212 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:15.212 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.212 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:15.212 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:15.212 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:15.213 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:15.213 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:15.213 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.213 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:15.213 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:15.213 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.213 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.213 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:15.213 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:15.213 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.213 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.213 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:15.213 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.214 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:15.214 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:15.214 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.214 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.214 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:15.214 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:15.214 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.214 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:15.214 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:15.214 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:15.214 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:15.214 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:15.214 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:15.215 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:15.215 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.215 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:15.215 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:15.215 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:15.215 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:15.215 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:15.215 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:15.215 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:15.215 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:15.215 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:15.215 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.215 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:15.216 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:15.216 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:15.216 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:15.216 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.216 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:15.216 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:15.216 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:15.216 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:15.216 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.216 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.216 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:15.216 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:15.216 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:15.217 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:15.217 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.217 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.217 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:15.217 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:15.217 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:15.217 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.217 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:15.217 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.217 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:15.217 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:15.217 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.217 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:15.218 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:15.218 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:15.218 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:15.218 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:15.218 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:15.218 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.218 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:15.218 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.218 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:15.218 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.218 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.218 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:15.219 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.219 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:15.219 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.219 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:15.219 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:15.219 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:15.219 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:15.219 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:15.219 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:15.219 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:15.219 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:15.219 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:15.220 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:15.220 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:15.220 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:15.220 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:15.220 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.220 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:15.220 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:15.220 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:15.220 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:15.220 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:15.220 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:15.220 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:15.220 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:15.221 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:15.221 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:15.221 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:15.221 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.221 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.221 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:15.221 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.221 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:15.221 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:15.221 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:15.221 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:15.222 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:15.222 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:15.222 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:15.222 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:15.222 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:15.222 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:15.222 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:15.222 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:15.222 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:15.222 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:15.222 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:15.222 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:15.222 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:15.223 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:15.223 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:15.223 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:15.223 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:15.223 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:15.223 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:15.223 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:15.223 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:15.223 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:15.223 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:15.223 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:15.223 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.224 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.224 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.224 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.224 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:15.224 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:15.224 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.224 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:15.224 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:15.224 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:15.224 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:15.224 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:15.224 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.224 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:15.225 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:15.225 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.225 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.225 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:15.225 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:15.225 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.225 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.225 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:15.225 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:15.225 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:15.225 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:15.225 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:15.226 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.226 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.226 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:15.226 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:15.226 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:15.226 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.226 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:15.226 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.226 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:15.226 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.226 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:15.226 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.227 INFO:teuthology.orchestra.run.smithi012.stdout: def test_ranged_request_invalid_range(): 2023-10-05T12:49:15.227 INFO:teuthology.orchestra.run.smithi012.stdout: content = 'testcontent' 2023-10-05T12:49:15.227 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.227 INFO:teuthology.orchestra.run.smithi012.stdout:> bucket_name = get_new_bucket() 2023-10-05T12:49:15.227 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.227 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:7104: 2023-10-05T12:49:15.227 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.227 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-10-05T12:49:15.227 INFO:teuthology.orchestra.run.smithi012.stdout: client.create_bucket(Bucket=name) 2023-10-05T12:49:15.227 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:15.227 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:15.227 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:15.227 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:15.228 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:15.228 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:15.228 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:15.228 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:15.228 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:15.228 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:15.228 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:15.228 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:15.228 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:15.228 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:15.228 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:15.228 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:15.229 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:15.229 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:15.229 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:15.229 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:15.229 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:15.229 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:15.229 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:15.229 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:15.229 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:15.229 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:15.229 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:15.229 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:15.230 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:15.230 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:15.230 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:15.230 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:15.230 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:15.230 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:15.230 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.230 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.230 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.230 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:15.230 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.230 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:15.231 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.231 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:15.231 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:15.231 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:15.231 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:15.231 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:15.231 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:15.231 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:15.231 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:15.231 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:15.231 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:15.231 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:15.231 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:15.232 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:15.232 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.232 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:15.232 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:15.232 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:15.232 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:15.232 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:15.232 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:15.232 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:15.232 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:15.232 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:15.232 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:15.232 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:15.233 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.233 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.233 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:15.233 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:15.233 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:15.233 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:15.233 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:15.233 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.233 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.233 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:15.233 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:15.233 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:15.234 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:15.234 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:15.234 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.234 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:15.234 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:15.234 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:15.234 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:15.234 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:15.234 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-370" 2023-10-05T12:49:15.234 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.234 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:15.234 INFO:teuthology.orchestra.run.smithi012.stdout:_______________________ test_ranged_request_empty_object _______________________ 2023-10-05T12:49:15.235 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.235 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.235 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.235 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:15.235 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:15.235 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.235 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:15.235 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:15.235 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:15.235 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:15.235 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:15.235 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.235 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:15.236 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:15.236 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.236 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.236 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:15.236 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:15.236 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.236 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.236 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:15.236 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.236 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:15.236 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:15.236 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.236 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.237 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:15.237 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:15.237 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.237 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:15.237 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:15.237 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:15.237 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:15.237 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:15.237 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:15.237 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:15.237 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.238 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:15.238 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:15.238 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:15.238 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:15.238 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:15.238 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:15.238 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:15.238 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:15.238 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:15.238 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.238 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:15.239 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:15.239 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:15.239 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:15.239 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.239 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:15.239 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:15.239 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:15.239 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:15.239 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.239 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.239 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:15.239 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:15.240 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:15.240 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:15.240 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.240 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.240 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:15.240 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:15.240 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:15.240 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.240 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:15.240 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.240 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:15.240 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:15.241 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.241 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:15.241 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:15.241 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:15.241 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:15.241 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:15.241 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:15.241 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.241 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:15.241 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.241 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:15.241 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.242 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.242 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:15.242 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.242 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:15.242 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.242 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:15.242 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:15.242 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:15.242 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:15.242 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:15.242 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:15.242 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:15.243 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:15.243 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:15.243 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:15.243 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:15.243 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:15.243 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:15.243 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.243 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:15.243 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:15.243 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:15.243 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:15.243 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:15.244 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:15.244 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:15.244 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:15.244 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:15.244 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:15.244 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:15.244 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.244 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.244 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:15.244 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.244 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:15.244 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:15.245 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:15.245 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:15.245 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:15.245 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:15.245 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:15.245 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:15.245 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:15.245 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:15.245 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:15.245 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:15.245 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:15.245 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:15.246 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:15.246 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:15.246 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:15.246 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:15.246 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:15.246 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:15.246 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:15.246 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:15.246 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:15.246 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:15.246 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:15.247 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:15.247 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:15.247 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:15.247 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.247 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.247 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.247 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.247 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:15.247 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:15.247 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.247 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:15.247 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:15.248 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:15.248 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:15.248 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:15.248 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.248 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:15.248 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:15.248 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.248 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.248 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:15.248 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:15.248 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.248 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.249 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:15.249 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:15.249 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:15.249 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:15.249 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:15.249 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.249 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.249 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:15.249 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:15.249 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:15.249 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.249 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:15.250 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.250 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:15.250 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.250 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:15.250 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.250 INFO:teuthology.orchestra.run.smithi012.stdout: def test_ranged_request_empty_object(): 2023-10-05T12:49:15.250 INFO:teuthology.orchestra.run.smithi012.stdout: content = '' 2023-10-05T12:49:15.250 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.250 INFO:teuthology.orchestra.run.smithi012.stdout:> bucket_name = get_new_bucket() 2023-10-05T12:49:15.250 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.250 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:7118: 2023-10-05T12:49:15.250 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.251 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-10-05T12:49:15.251 INFO:teuthology.orchestra.run.smithi012.stdout: client.create_bucket(Bucket=name) 2023-10-05T12:49:15.251 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:15.251 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:15.251 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:15.251 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:15.251 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:15.251 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:15.251 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:15.251 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:15.251 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:15.251 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:15.251 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:15.252 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:15.252 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:15.252 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:15.252 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:15.252 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:15.252 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:15.252 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:15.252 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:15.252 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:15.252 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:15.252 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:15.253 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:15.253 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:15.253 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:15.253 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:15.253 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:15.253 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:15.253 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:15.253 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:15.253 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:15.253 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:15.253 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:15.253 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:15.254 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.254 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.254 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.254 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:15.254 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.254 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:15.254 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.254 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:15.254 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:15.254 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:15.254 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:15.255 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:15.255 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:15.255 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:15.255 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:15.255 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:15.255 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:15.255 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:15.255 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:15.255 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:15.255 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.255 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:15.255 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:15.256 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:15.256 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:15.256 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:15.256 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:15.256 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:15.256 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:15.256 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:15.256 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:15.256 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:15.256 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.256 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.256 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:15.256 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:15.257 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:15.257 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:15.257 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:15.257 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.257 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.257 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:15.257 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:15.257 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:15.257 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:15.257 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:15.257 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.257 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:15.258 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:15.258 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:15.258 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:15.258 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:15.258 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-371" 2023-10-05T12:49:15.258 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.258 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:15.258 INFO:teuthology.orchestra.run.smithi012.stdout:____________________ test_versioning_bucket_create_suspend _____________________ 2023-10-05T12:49:15.258 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.258 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.258 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.259 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:15.259 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:15.259 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.259 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:15.259 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:15.259 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:15.259 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:15.259 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:15.259 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.259 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:15.259 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:15.259 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.260 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.260 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:15.260 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:15.260 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.260 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.260 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:15.260 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.260 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:15.260 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:15.260 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.260 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.260 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:15.261 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:15.261 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.261 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:15.261 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:15.261 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:15.261 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:15.261 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:15.261 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:15.261 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:15.261 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.261 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:15.261 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:15.261 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:15.262 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:15.262 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:15.262 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:15.262 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:15.262 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:15.262 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:15.262 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.262 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:15.262 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:15.262 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:15.262 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:15.262 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.263 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:15.263 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:15.263 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:15.263 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:15.263 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.263 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.263 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:15.263 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:15.263 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:15.263 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:15.263 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.263 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.264 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:15.264 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:15.264 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:15.264 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.264 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:15.264 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.264 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:15.264 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:15.264 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.264 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:15.264 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:15.264 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:15.265 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:15.265 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:15.265 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:15.265 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.265 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:15.265 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.265 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:15.265 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.265 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.265 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:15.265 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.265 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:15.266 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.266 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:15.266 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:15.266 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:15.266 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:15.266 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:15.266 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:15.266 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:15.266 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:15.266 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:15.266 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:15.267 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:15.267 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:15.267 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:15.267 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.267 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:15.267 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:15.267 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:15.267 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:15.267 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:15.267 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:15.267 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:15.267 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:15.267 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:15.268 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:15.268 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:15.268 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.268 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.268 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:15.268 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.268 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:15.268 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:15.268 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:15.268 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:15.269 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:15.269 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:15.269 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:15.269 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:15.269 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:15.269 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:15.269 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:15.269 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:15.269 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:15.269 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:15.269 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:15.269 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:15.270 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:15.270 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:15.270 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:15.270 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:15.270 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:15.270 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:15.270 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:15.270 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:15.270 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:15.270 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:15.270 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:15.271 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:15.271 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.271 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.271 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.271 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.271 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:15.271 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:15.271 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.271 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:15.271 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:15.271 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:15.271 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:15.272 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:15.272 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.272 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:15.272 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:15.272 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.272 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.272 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:15.272 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:15.272 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.272 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.272 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:15.272 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:15.273 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:15.273 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:15.273 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:15.273 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.273 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.273 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:15.273 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:15.273 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:15.273 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.273 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:15.273 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.273 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:15.273 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.274 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:15.274 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.274 INFO:teuthology.orchestra.run.smithi012.stdout: def test_versioning_bucket_create_suspend(): 2023-10-05T12:49:15.274 INFO:teuthology.orchestra.run.smithi012.stdout:> bucket_name = get_new_bucket() 2023-10-05T12:49:15.274 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.274 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:7130: 2023-10-05T12:49:15.274 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.274 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-10-05T12:49:15.274 INFO:teuthology.orchestra.run.smithi012.stdout: client.create_bucket(Bucket=name) 2023-10-05T12:49:15.274 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:15.274 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:15.274 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:15.275 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:15.275 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:15.275 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:15.275 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:15.275 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:15.275 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:15.275 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:15.275 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:15.275 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:15.275 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:15.275 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:15.275 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:15.275 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:15.276 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:15.276 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:15.276 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:15.276 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:15.276 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:15.276 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:15.276 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:15.276 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:15.276 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:15.276 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:15.276 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:15.276 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:15.276 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:15.277 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:15.277 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:15.277 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:15.277 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:15.277 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:15.277 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.277 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.277 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.277 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:15.277 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.277 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:15.278 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.278 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:15.278 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:15.278 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:15.278 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:15.278 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:15.278 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:15.278 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:15.278 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:15.278 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:15.278 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:15.278 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:15.279 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:15.279 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:15.279 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.279 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:15.279 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:15.279 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:15.279 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:15.279 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:15.279 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:15.279 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:15.279 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:15.279 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:15.279 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:15.280 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:15.280 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.280 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.280 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:15.280 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:15.280 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:15.280 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:15.280 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:15.280 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.280 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.280 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:15.281 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:15.281 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:15.281 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:15.281 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:15.281 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.281 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:15.281 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:15.281 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:15.281 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:15.281 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:15.281 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-372" 2023-10-05T12:49:15.282 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.282 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:15.282 INFO:teuthology.orchestra.run.smithi012.stdout:____________________ test_versioning_obj_create_read_remove ____________________ 2023-10-05T12:49:15.282 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.282 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.282 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.282 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:15.282 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:15.282 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.282 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:15.282 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:15.283 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:15.283 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:15.283 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:15.283 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.283 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:15.283 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:15.283 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.283 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.283 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:15.283 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:15.283 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.283 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.283 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:15.284 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.284 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:15.284 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:15.284 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.284 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.284 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:15.284 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:15.284 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.284 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:15.284 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:15.284 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:15.284 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:15.285 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:15.285 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:15.285 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:15.285 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.285 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:15.285 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:15.285 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:15.285 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:15.285 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:15.285 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:15.285 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:15.285 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:15.285 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:15.286 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.286 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:15.286 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:15.286 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:15.286 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:15.286 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.286 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:15.286 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:15.286 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:15.286 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:15.286 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.286 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.287 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:15.287 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:15.287 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:15.287 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:15.287 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.287 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.287 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:15.287 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:15.287 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:15.287 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.287 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:15.287 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.288 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:15.288 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:15.288 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.288 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:15.288 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:15.288 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:15.288 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:15.288 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:15.288 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:15.288 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.288 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:15.288 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.289 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:15.289 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.289 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.289 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:15.289 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.289 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:15.289 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.289 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:15.289 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:15.289 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:15.289 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:15.289 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:15.290 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:15.290 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:15.290 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:15.290 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:15.290 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:15.290 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:15.290 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:15.290 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:15.290 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.290 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:15.290 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:15.291 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:15.291 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:15.291 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:15.291 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:15.291 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:15.291 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:15.291 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:15.291 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:15.291 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:15.291 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.291 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.291 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:15.291 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.292 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:15.292 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:15.292 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:15.292 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:15.292 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:15.292 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:15.292 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:15.292 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:15.292 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:15.292 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:15.292 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:15.292 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:15.292 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:15.293 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:15.293 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:15.293 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:15.293 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:15.293 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:15.293 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:15.293 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:15.293 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:15.293 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:15.293 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:15.293 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:15.293 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:15.293 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:15.294 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:15.294 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:15.294 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.294 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.294 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.294 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.294 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:15.294 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:15.294 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.294 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:15.294 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:15.294 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:15.294 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:15.295 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:15.295 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.295 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:15.295 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:15.295 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.295 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.295 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:15.295 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:15.295 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.295 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.295 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:15.295 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:15.296 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:15.296 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:15.296 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:15.296 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.296 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.296 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:15.296 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:15.296 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:15.296 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.296 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:15.296 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.296 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:15.297 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.297 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:15.297 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.297 INFO:teuthology.orchestra.run.smithi012.stdout: def test_versioning_obj_create_read_remove(): 2023-10-05T12:49:15.297 INFO:teuthology.orchestra.run.smithi012.stdout:> bucket_name = get_new_bucket() 2023-10-05T12:49:15.297 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.297 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:7213: 2023-10-05T12:49:15.297 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.297 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-10-05T12:49:15.297 INFO:teuthology.orchestra.run.smithi012.stdout: client.create_bucket(Bucket=name) 2023-10-05T12:49:15.297 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:15.297 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:15.297 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:15.298 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:15.298 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:15.298 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:15.298 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:15.298 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:15.298 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:15.298 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:15.298 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:15.298 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:15.298 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:15.298 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:15.299 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:15.299 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:15.299 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:15.299 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:15.299 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:15.299 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:15.299 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:15.299 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:15.299 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:15.299 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:15.299 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:15.299 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:15.299 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:15.300 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:15.300 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:15.300 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:15.300 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:15.300 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:15.300 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:15.300 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:15.300 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.300 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.300 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.300 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:15.300 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.300 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:15.301 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.301 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:15.301 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:15.301 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:15.301 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:15.301 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:15.301 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:15.301 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:15.301 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:15.301 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:15.301 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:15.302 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:15.302 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:15.302 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:15.302 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.302 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:15.302 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:15.302 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:15.302 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:15.302 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:15.302 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:15.302 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:15.302 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:15.302 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:15.303 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:15.303 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:15.303 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.303 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.303 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:15.303 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:15.303 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:15.303 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:15.303 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:15.303 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.303 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.303 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:15.303 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:15.304 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:15.304 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:15.304 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:15.304 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.304 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:15.304 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:15.304 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:15.304 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:15.304 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:15.304 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-373" 2023-10-05T12:49:15.304 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.304 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:15.305 INFO:teuthology.orchestra.run.smithi012.stdout:_________________ test_versioning_obj_create_read_remove_head __________________ 2023-10-05T12:49:15.305 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.305 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.305 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.305 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:15.305 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:15.305 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.305 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:15.305 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:15.305 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:15.305 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:15.305 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:15.306 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.306 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:15.306 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:15.306 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.306 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.306 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:15.306 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:15.306 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.306 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.306 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:15.306 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.306 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:15.307 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:15.307 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.307 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.307 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:15.307 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:15.307 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.307 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:15.307 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:15.307 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:15.307 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:15.307 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:15.307 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:15.308 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:15.308 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.308 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:15.308 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:15.308 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:15.308 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:15.308 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:15.308 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:15.308 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:15.308 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:15.308 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:15.308 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.309 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:15.309 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:15.309 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:15.309 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:15.309 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.309 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:15.309 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:15.309 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:15.309 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:15.309 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.309 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.310 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:15.310 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:15.310 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:15.310 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:15.310 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.310 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.310 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:15.310 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:15.310 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:15.310 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.310 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:15.310 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.310 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:15.311 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:15.311 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.311 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:15.311 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:15.311 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:15.311 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:15.311 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:15.311 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:15.311 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.311 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:15.311 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.311 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:15.311 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.312 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.312 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:15.312 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.312 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:15.312 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.312 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:15.312 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:15.312 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:15.312 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:15.312 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:15.312 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:15.312 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:15.312 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:15.313 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:15.313 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:15.313 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:15.313 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:15.313 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:15.313 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.313 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:15.313 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:15.313 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:15.313 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:15.313 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:15.313 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:15.313 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:15.314 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:15.314 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:15.314 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:15.314 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:15.314 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.314 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.314 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:15.314 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.314 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:15.314 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:15.314 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:15.314 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:15.314 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:15.315 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:15.315 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:15.315 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:15.315 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:15.315 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:15.315 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:15.315 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:15.315 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:15.315 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:15.315 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:15.315 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:15.315 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:15.316 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:15.316 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:15.316 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:15.316 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:15.316 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:15.316 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:15.316 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:15.316 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:15.316 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:15.316 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:15.316 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:15.316 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.317 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.317 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.317 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.317 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:15.317 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:15.317 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.317 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:15.317 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:15.317 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:15.317 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:15.317 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:15.317 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.318 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:15.318 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:15.318 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.318 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.318 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:15.318 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:15.318 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.318 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.318 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:15.318 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:15.319 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:15.319 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:15.319 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:15.319 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.319 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.319 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:15.319 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:15.319 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:15.319 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.319 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:15.319 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.320 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:15.320 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.320 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:15.320 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.320 INFO:teuthology.orchestra.run.smithi012.stdout: def test_versioning_obj_create_read_remove_head(): 2023-10-05T12:49:15.320 INFO:teuthology.orchestra.run.smithi012.stdout:> bucket_name = get_new_bucket() 2023-10-05T12:49:15.320 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.320 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:7227: 2023-10-05T12:49:15.320 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.320 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-10-05T12:49:15.320 INFO:teuthology.orchestra.run.smithi012.stdout: client.create_bucket(Bucket=name) 2023-10-05T12:49:15.320 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:15.320 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:15.321 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:15.321 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:15.321 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:15.321 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:15.321 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:15.321 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:15.321 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:15.321 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:15.321 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:15.321 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:15.321 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:15.322 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:15.322 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:15.322 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:15.322 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:15.322 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:15.322 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:15.322 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:15.322 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:15.322 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:15.322 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:15.322 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:15.322 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:15.322 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:15.323 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:15.323 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:15.323 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:15.323 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:15.323 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:15.323 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:15.323 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:15.323 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:15.323 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.323 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.323 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.323 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:15.324 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.324 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:15.324 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.324 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:15.324 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:15.324 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:15.324 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:15.324 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:15.324 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:15.324 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:15.324 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:15.324 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:15.324 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:15.325 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:15.325 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:15.325 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:15.325 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.325 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:15.325 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:15.325 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:15.325 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:15.325 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:15.325 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:15.325 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:15.325 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:15.326 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:15.326 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:15.326 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:15.326 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.326 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.326 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:15.326 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:15.326 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:15.326 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:15.326 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:15.326 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.326 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.327 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:15.329 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:15.329 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:15.329 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:15.329 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:15.329 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.329 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:15.329 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:15.330 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:15.330 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:15.330 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:15.330 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-374" 2023-10-05T12:49:15.330 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.330 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:15.330 INFO:teuthology.orchestra.run.smithi012.stdout:________________ test_versioning_obj_plain_null_version_removal ________________ 2023-10-05T12:49:15.330 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.330 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.330 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.330 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:15.331 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:15.331 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.331 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:15.331 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:15.331 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:15.331 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:15.331 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:15.331 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.331 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:15.331 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:15.331 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.331 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.332 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:15.332 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:15.332 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.332 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.332 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:15.332 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.332 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:15.332 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:15.332 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.332 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.332 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:15.333 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:15.333 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.333 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:15.333 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:15.333 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:15.333 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:15.333 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:15.333 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:15.333 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:15.333 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.333 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:15.333 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:15.334 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:15.334 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:15.334 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:15.334 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:15.334 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:15.334 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:15.334 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:15.334 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.334 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:15.334 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:15.334 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:15.334 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:15.335 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.335 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:15.335 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:15.335 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:15.335 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:15.335 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.335 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.335 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:15.335 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:15.335 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:15.335 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:15.335 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.336 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.336 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:15.336 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:15.336 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:15.336 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.336 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:15.336 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.336 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:15.336 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:15.336 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.336 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:15.336 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:15.337 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:15.337 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:15.337 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:15.337 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:15.337 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.337 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:15.337 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.337 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:15.337 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.337 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.337 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:15.337 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.337 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:15.338 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.338 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:15.338 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:15.338 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:15.338 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:15.338 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:15.338 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:15.338 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:15.338 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:15.338 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:15.339 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:15.339 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:15.339 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:15.339 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:15.339 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.339 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:15.339 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:15.339 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:15.339 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:15.339 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:15.339 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:15.339 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:15.340 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:15.340 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:15.340 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:15.340 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:15.340 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.340 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.340 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:15.340 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.340 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:15.340 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:15.341 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:15.341 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:15.341 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:15.341 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:15.341 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:15.341 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:15.341 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:15.341 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:15.341 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:15.341 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:15.341 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:15.341 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:15.342 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:15.342 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:15.342 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:15.342 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:15.342 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:15.342 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:15.342 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:15.342 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:15.342 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:15.342 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:15.342 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:15.342 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:15.343 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:15.343 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:15.343 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.343 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.343 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.343 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.343 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:15.343 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:15.343 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.343 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:15.343 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:15.344 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:15.344 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:15.344 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:15.344 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.344 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:15.344 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:15.344 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.344 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.344 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:15.344 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:15.344 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.344 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.345 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:15.345 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:15.345 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:15.345 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:15.345 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:15.345 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.345 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.345 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:15.345 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:15.345 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:15.345 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.345 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:15.346 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.346 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:15.346 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.346 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:15.346 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.346 INFO:teuthology.orchestra.run.smithi012.stdout: def test_versioning_obj_plain_null_version_removal(): 2023-10-05T12:49:15.346 INFO:teuthology.orchestra.run.smithi012.stdout:> bucket_name = get_new_bucket() 2023-10-05T12:49:15.346 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.346 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:7261: 2023-10-05T12:49:15.346 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.347 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-10-05T12:49:15.347 INFO:teuthology.orchestra.run.smithi012.stdout: client.create_bucket(Bucket=name) 2023-10-05T12:49:15.347 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:15.347 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:15.347 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:15.347 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:15.347 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:15.347 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:15.347 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:15.347 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:15.347 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:15.347 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:15.348 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:15.348 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:15.348 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:15.348 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:15.348 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:15.348 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:15.348 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:15.348 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:15.348 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:15.348 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:15.348 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:15.349 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:15.349 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:15.349 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:15.349 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:15.349 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:15.349 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:15.349 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:15.349 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:15.349 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:15.349 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:15.349 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:15.349 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:15.350 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:15.350 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.350 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.350 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.350 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:15.350 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.350 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:15.350 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.350 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:15.350 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:15.350 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:15.351 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:15.351 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:15.351 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:15.351 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:15.351 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:15.351 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:15.351 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:15.351 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:15.351 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:15.351 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:15.351 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.351 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:15.352 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:15.352 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:15.352 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:15.352 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:15.352 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:15.352 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:15.352 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:15.352 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:15.352 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:15.352 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:15.352 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.352 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.353 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:15.353 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:15.353 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:15.353 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:15.353 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:15.353 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.353 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.353 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:15.353 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:15.353 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:15.353 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:15.353 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:15.354 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.354 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:15.354 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:15.354 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:15.354 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:15.354 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:15.354 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-375" 2023-10-05T12:49:15.354 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.354 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:15.354 INFO:teuthology.orchestra.run.smithi012.stdout:_______________ test_versioning_obj_plain_null_version_overwrite _______________ 2023-10-05T12:49:15.354 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.355 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.355 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.355 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:15.355 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:15.355 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.355 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:15.355 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:15.355 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:15.355 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:15.355 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:15.355 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.355 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:15.356 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:15.356 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.356 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.356 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:15.356 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:15.356 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.356 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.356 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:15.356 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.356 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:15.356 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:15.356 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.357 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.357 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:15.357 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:15.357 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.357 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:15.357 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:15.357 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:15.357 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:15.357 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:15.357 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:15.357 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:15.358 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.358 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:15.358 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:15.358 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:15.358 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:15.358 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:15.358 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:15.358 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:15.358 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:15.358 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:15.358 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.359 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:15.359 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:15.359 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:15.359 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:15.359 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.359 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:15.359 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:15.359 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:15.359 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:15.359 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.359 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.359 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:15.360 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:15.360 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:15.360 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:15.360 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.360 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.360 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:15.360 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:15.360 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:15.360 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.360 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:15.360 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.361 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:15.361 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:15.361 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.361 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:15.361 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:15.361 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:15.361 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:15.361 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:15.361 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:15.361 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.361 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:15.362 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.362 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:15.362 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.362 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.362 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:15.362 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.362 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:15.362 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.362 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:15.362 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:15.362 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:15.362 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:15.363 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:15.363 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:15.363 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:15.363 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:15.363 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:15.363 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:15.363 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:15.363 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:15.363 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:15.363 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.363 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:15.363 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:15.364 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:15.364 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:15.364 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:15.364 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:15.364 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:15.364 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:15.364 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:15.364 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:15.364 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:15.364 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.364 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.364 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:15.364 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.365 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:15.365 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:15.365 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:15.365 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:15.365 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:15.365 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:15.365 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:15.365 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:15.365 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:15.365 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:15.365 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:15.365 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:15.366 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:15.366 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:15.366 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:15.366 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:15.366 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:15.366 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:15.366 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:15.366 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:15.366 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:15.366 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:15.366 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:15.366 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:15.367 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:15.367 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:15.367 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:15.367 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:15.367 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.367 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.367 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.367 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.367 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:15.367 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:15.367 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.367 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:15.368 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:15.368 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:15.368 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:15.368 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:15.368 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.368 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:15.368 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:15.368 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.368 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.368 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:15.368 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:15.368 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.369 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.369 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:15.369 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:15.369 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:15.369 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:15.369 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:15.369 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.369 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.369 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:15.369 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:15.369 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:15.370 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.370 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:15.370 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.370 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:15.370 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.370 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:15.370 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.370 INFO:teuthology.orchestra.run.smithi012.stdout: def test_versioning_obj_plain_null_version_overwrite(): 2023-10-05T12:49:15.370 INFO:teuthology.orchestra.run.smithi012.stdout:> bucket_name = get_new_bucket() 2023-10-05T12:49:15.370 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.370 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:7281: 2023-10-05T12:49:15.371 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.371 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-10-05T12:49:15.371 INFO:teuthology.orchestra.run.smithi012.stdout: client.create_bucket(Bucket=name) 2023-10-05T12:49:15.371 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:15.371 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:15.371 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:15.371 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:15.371 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:15.371 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:15.371 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:15.371 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:15.371 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:15.372 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:15.372 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:15.372 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:15.372 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:15.372 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:15.372 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:15.372 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:15.372 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:15.372 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:15.372 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:15.372 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:15.372 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:15.372 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:15.373 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:15.373 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:15.373 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:15.373 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:15.373 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:15.373 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:15.373 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:15.373 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:15.373 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:15.373 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:15.373 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:15.373 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:15.373 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.374 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.374 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.374 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:15.374 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.374 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:15.374 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.374 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:15.374 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:15.374 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:15.374 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:15.374 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:15.374 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:15.375 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:15.375 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:15.375 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:15.375 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:15.375 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:15.375 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:15.375 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:15.375 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.375 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:15.375 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:15.375 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:15.375 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:15.375 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:15.376 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:15.376 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:15.376 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:15.376 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:15.376 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:15.376 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:15.376 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.376 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.376 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:15.376 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:15.376 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:15.376 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:15.376 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:15.377 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.377 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.377 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:15.377 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:15.377 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:15.377 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:15.377 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:15.377 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.377 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:15.377 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:15.377 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:15.377 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:15.378 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:15.378 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-376" 2023-10-05T12:49:15.378 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.378 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:15.378 INFO:teuthology.orchestra.run.smithi012.stdout:__________ test_versioning_obj_plain_null_version_overwrite_suspended __________ 2023-10-05T12:49:15.378 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.378 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.378 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.378 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:15.378 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:15.378 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.378 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:15.379 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:15.379 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:15.379 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:15.379 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:15.379 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.379 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:15.379 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:15.379 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.379 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.379 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:15.379 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:15.379 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.380 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.380 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:15.380 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.380 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:15.380 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:15.380 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.380 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.380 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:15.380 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:15.380 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.380 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:15.380 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:15.381 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:15.381 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:15.381 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:15.381 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:15.381 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:15.381 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.381 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:15.381 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:15.381 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:15.381 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:15.381 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:15.382 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:15.382 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:15.382 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:15.382 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:15.382 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.382 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:15.382 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:15.382 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:15.382 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:15.382 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.382 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:15.382 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:15.382 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:15.383 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:15.383 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.383 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.383 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:15.383 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:15.383 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:15.383 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:15.383 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.383 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.383 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:15.383 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:15.383 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:15.384 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.384 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:15.384 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.384 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:15.384 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:15.384 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.384 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:15.384 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:15.384 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:15.384 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:15.384 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:15.385 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:15.385 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.385 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:15.385 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.385 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:15.385 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.385 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.385 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:15.385 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.385 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:15.385 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.385 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:15.386 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:15.386 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:15.386 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:15.386 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:15.386 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:15.386 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:15.386 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:15.386 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:15.386 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:15.386 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:15.386 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:15.386 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:15.387 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.387 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:15.387 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:15.387 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:15.387 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:15.387 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:15.387 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:15.387 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:15.387 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:15.387 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:15.387 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:15.387 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:15.388 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.388 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.388 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:15.388 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.388 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:15.388 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:15.388 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:15.388 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:15.388 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:15.388 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:15.388 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:15.389 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:15.389 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:15.389 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:15.389 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:15.389 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:15.389 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:15.389 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:15.389 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:15.389 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:15.389 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:15.389 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:15.390 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:15.390 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:15.390 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:15.390 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:15.390 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:15.390 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:15.390 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:15.390 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:15.390 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:15.390 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:15.390 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.390 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.391 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.391 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.391 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:15.391 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:15.391 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.391 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:15.391 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:15.391 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:15.391 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:15.391 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:15.391 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.391 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:15.392 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:15.392 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.392 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.392 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:15.392 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:15.392 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.392 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.392 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:15.392 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:15.392 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:15.392 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:15.393 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:15.393 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.393 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.393 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:15.393 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:15.393 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:15.393 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.393 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:15.393 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.393 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:15.393 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.393 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:15.394 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.394 INFO:teuthology.orchestra.run.smithi012.stdout: def test_versioning_obj_plain_null_version_overwrite_suspended(): 2023-10-05T12:49:15.394 INFO:teuthology.orchestra.run.smithi012.stdout:> bucket_name = get_new_bucket() 2023-10-05T12:49:15.394 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.394 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:7314: 2023-10-05T12:49:15.394 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.394 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-10-05T12:49:15.394 INFO:teuthology.orchestra.run.smithi012.stdout: client.create_bucket(Bucket=name) 2023-10-05T12:49:15.394 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:15.394 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:15.394 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:15.394 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:15.395 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:15.395 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:15.395 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:15.395 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:15.395 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:15.395 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:15.395 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:15.395 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:15.395 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:15.395 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:15.395 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:15.395 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:15.396 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:15.396 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:15.396 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:15.396 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:15.396 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:15.396 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:15.396 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:15.396 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:15.396 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:15.396 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:15.396 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:15.396 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:15.397 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:15.397 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:15.397 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:15.397 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:15.397 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:15.397 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:15.397 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.397 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.397 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.397 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:15.397 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.398 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:15.398 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.398 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:15.398 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:15.398 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:15.398 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:15.398 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:15.398 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:15.398 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:15.398 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:15.398 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:15.399 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:15.399 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:15.399 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:15.399 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:15.399 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.399 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:15.399 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:15.399 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:15.399 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:15.399 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:15.399 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:15.399 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:15.400 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:15.400 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:15.400 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:15.400 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:15.400 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.400 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.400 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:15.400 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:15.400 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:15.400 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:15.400 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:15.400 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.401 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.401 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:15.401 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:15.401 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:15.401 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:15.401 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:15.401 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.401 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:15.401 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:15.401 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:15.401 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:15.401 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:15.402 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-377" 2023-10-05T12:49:15.402 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.402 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:15.402 INFO:teuthology.orchestra.run.smithi012.stdout:_____________________ test_versioning_obj_suspend_versions _____________________ 2023-10-05T12:49:15.402 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.402 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.402 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.402 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:15.402 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:15.402 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.402 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:15.402 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:15.403 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:15.403 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:15.403 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:15.403 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.403 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:15.403 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:15.403 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.403 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.403 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:15.403 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:15.403 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.403 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.403 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:15.404 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.404 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:15.404 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:15.404 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.404 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.404 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:15.404 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:15.404 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.404 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:15.404 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:15.404 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:15.404 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:15.404 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:15.405 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:15.405 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:15.405 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.405 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:15.405 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:15.405 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:15.405 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:15.405 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:15.405 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:15.405 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:15.405 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:15.405 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:15.405 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.406 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:15.406 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:15.406 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:15.406 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:15.406 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.406 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:15.406 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:15.406 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:15.406 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:15.406 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.407 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.407 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:15.407 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:15.407 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:15.407 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:15.407 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.407 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.407 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:15.407 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:15.407 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:15.407 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.407 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:15.408 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.408 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:15.408 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:15.408 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.408 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:15.408 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:15.408 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:15.408 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:15.408 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:15.408 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:15.408 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.409 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:15.409 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.409 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:15.409 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.409 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.409 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:15.409 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.409 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:15.409 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.409 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:15.409 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:15.409 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:15.410 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:15.410 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:15.410 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:15.410 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:15.410 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:15.410 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:15.410 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:15.410 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:15.410 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:15.410 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:15.410 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.410 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:15.411 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:15.411 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:15.411 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:15.411 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:15.411 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:15.411 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:15.411 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:15.411 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:15.411 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:15.411 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:15.411 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.411 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.412 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:15.412 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.412 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:15.412 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:15.412 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:15.412 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:15.412 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:15.412 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:15.412 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:15.412 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:15.412 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:15.412 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:15.413 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:15.413 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:15.413 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:15.413 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:15.413 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:15.413 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:15.413 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:15.413 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:15.413 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:15.413 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:15.413 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:15.414 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:15.414 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:15.414 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:15.414 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:15.414 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:15.414 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:15.414 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:15.414 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.414 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.414 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.414 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.414 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:15.415 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:15.415 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.415 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:15.415 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:15.415 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:15.415 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:15.415 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:15.415 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.415 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:15.415 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:15.415 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.415 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.416 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:15.416 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:15.416 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.416 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.416 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:15.416 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:15.416 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:15.416 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:15.416 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:15.416 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.416 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.416 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:15.416 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:15.417 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:15.417 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.417 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:15.417 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.417 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:15.417 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.417 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:15.417 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.417 INFO:teuthology.orchestra.run.smithi012.stdout: def test_versioning_obj_suspend_versions(): 2023-10-05T12:49:15.417 INFO:teuthology.orchestra.run.smithi012.stdout:> bucket_name = get_new_bucket() 2023-10-05T12:49:15.417 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.417 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:7379: 2023-10-05T12:49:15.418 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.418 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-10-05T12:49:15.418 INFO:teuthology.orchestra.run.smithi012.stdout: client.create_bucket(Bucket=name) 2023-10-05T12:49:15.418 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:15.418 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:15.418 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:15.418 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:15.418 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:15.418 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:15.418 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:15.418 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:15.419 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:15.419 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:15.419 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:15.419 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:15.419 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:15.419 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:15.419 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:15.419 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:15.419 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:15.419 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:15.419 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:15.419 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:15.419 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:15.420 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:15.420 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:15.420 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:15.420 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:15.420 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:15.420 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:15.420 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:15.420 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:15.420 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:15.420 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:15.420 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:15.420 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:15.420 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:15.421 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.421 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.421 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.421 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:15.421 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.421 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:15.421 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.421 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:15.421 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:15.421 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:15.421 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:15.421 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:15.421 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:15.422 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:15.422 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:15.422 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:15.422 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:15.422 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:15.422 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:15.422 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:15.422 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.422 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:15.422 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:15.422 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:15.422 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:15.422 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:15.423 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:15.423 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:15.423 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:15.423 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:15.423 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:15.423 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:15.423 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.423 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.423 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:15.423 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:15.423 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:15.423 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:15.423 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:15.424 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.424 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.424 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:15.424 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:15.424 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:15.424 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:15.424 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:15.424 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.424 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:15.424 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:15.424 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:15.424 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:15.425 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:15.425 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-378" 2023-10-05T12:49:15.425 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.425 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:15.425 INFO:teuthology.orchestra.run.smithi012.stdout:________________ test_versioning_obj_create_versions_remove_all ________________ 2023-10-05T12:49:15.425 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.425 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.425 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.425 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:15.425 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:15.425 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.425 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:15.425 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:15.426 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:15.426 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:15.426 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:15.426 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.426 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:15.426 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:15.426 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.426 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.426 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:15.427 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:15.427 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.427 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.427 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:15.427 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.427 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:15.427 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:15.427 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.427 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.427 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:15.427 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:15.428 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.428 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:15.428 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:15.428 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:15.428 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:15.428 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:15.428 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:15.428 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:15.428 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.428 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:15.429 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:15.429 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:15.429 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:15.429 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:15.429 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:15.429 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:15.429 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:15.429 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:15.429 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.429 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:15.429 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:15.430 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:15.430 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:15.430 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.430 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:15.430 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:15.430 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:15.430 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:15.430 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.430 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.430 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:15.430 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:15.430 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:15.431 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:15.431 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.431 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.431 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:15.431 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:15.431 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:15.431 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.431 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:15.431 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.431 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:15.431 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:15.431 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.432 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:15.432 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:15.432 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:15.432 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:15.432 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:15.432 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:15.432 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.432 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:15.432 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.432 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:15.432 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.433 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.433 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:15.433 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.433 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:15.433 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.433 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:15.433 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:15.433 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:15.433 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:15.433 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:15.433 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:15.433 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:15.434 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:15.434 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:15.434 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:15.434 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:15.434 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:15.434 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:15.434 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.434 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:15.434 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:15.434 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:15.434 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:15.434 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:15.435 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:15.435 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:15.435 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:15.435 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:15.435 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:15.435 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:15.435 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.435 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.435 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:15.435 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.435 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:15.436 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:15.436 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:15.436 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:15.436 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:15.436 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:15.436 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:15.436 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:15.436 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:15.436 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:15.436 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:15.436 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:15.436 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:15.436 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:15.437 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:15.437 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:15.437 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:15.437 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:15.437 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:15.437 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:15.437 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:15.437 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:15.437 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:15.437 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:15.437 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:15.438 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:15.438 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:15.438 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:15.438 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.438 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.438 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.438 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.438 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:15.438 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:15.438 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.438 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:15.439 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:15.439 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:15.439 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:15.439 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:15.439 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.439 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:15.439 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:15.439 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.439 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.439 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:15.439 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:15.439 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.440 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.440 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:15.440 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:15.440 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:15.440 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:15.440 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:15.440 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.440 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.440 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:15.440 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:15.440 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:15.440 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.440 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:15.441 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.441 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:15.441 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.441 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:15.441 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.441 INFO:teuthology.orchestra.run.smithi012.stdout: def test_versioning_obj_create_versions_remove_all(): 2023-10-05T12:49:15.441 INFO:teuthology.orchestra.run.smithi012.stdout:> bucket_name = get_new_bucket() 2023-10-05T12:49:15.441 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.441 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:7411: 2023-10-05T12:49:15.441 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.441 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-10-05T12:49:15.441 INFO:teuthology.orchestra.run.smithi012.stdout: client.create_bucket(Bucket=name) 2023-10-05T12:49:15.441 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:15.442 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:15.442 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:15.442 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:15.442 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:15.442 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:15.442 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:15.442 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:15.442 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:15.442 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:15.442 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:15.443 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:15.443 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:15.443 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:15.443 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:15.443 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:15.443 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:15.443 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:15.443 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:15.443 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:15.443 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:15.443 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:15.443 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:15.444 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:15.444 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:15.444 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:15.444 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:15.444 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:15.444 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:15.444 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:15.444 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:15.444 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:15.444 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:15.444 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:15.444 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.444 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.445 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.445 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:15.445 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.445 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:15.445 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.445 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:15.445 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:15.445 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:15.445 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:15.445 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:15.445 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:15.446 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:15.446 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:15.446 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:15.446 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:15.446 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:15.446 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:15.446 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:15.446 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.446 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:15.446 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:15.446 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:15.447 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:15.447 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:15.447 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:15.447 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:15.447 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:15.447 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:15.447 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:15.447 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:15.447 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.447 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.447 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:15.447 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:15.447 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:15.447 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:15.448 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:15.448 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.448 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.448 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:15.448 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:15.448 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:15.448 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:15.448 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:15.448 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.448 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:15.449 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:15.449 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:15.449 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:15.449 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:15.449 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-379" 2023-10-05T12:49:15.449 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.449 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:15.449 INFO:teuthology.orchestra.run.smithi012.stdout:___________ test_versioning_obj_create_versions_remove_special_names ___________ 2023-10-05T12:49:15.449 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.449 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.449 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.450 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:15.450 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:15.450 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.450 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:15.450 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:15.450 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:15.450 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:15.450 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:15.450 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.450 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:15.450 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:15.450 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.451 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.451 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:15.451 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:15.451 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.451 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.451 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:15.451 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.451 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:15.451 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:15.451 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.451 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.452 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:15.452 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:15.452 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.452 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:15.452 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:15.452 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:15.452 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:15.452 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:15.452 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:15.452 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:15.452 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.452 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:15.453 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:15.453 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:15.453 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:15.453 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:15.453 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:15.453 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:15.453 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:15.453 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:15.453 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.453 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:15.453 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:15.453 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:15.454 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:15.454 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.454 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:15.454 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:15.454 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:15.454 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:15.454 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.454 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.454 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:15.454 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:15.454 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:15.455 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:15.455 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.455 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.455 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:15.455 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:15.455 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:15.455 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.455 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:15.455 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.455 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:15.455 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:15.456 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.456 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:15.456 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:15.456 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:15.456 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:15.456 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:15.456 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:15.456 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.456 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:15.456 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.456 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:15.456 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.457 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.457 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:15.457 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.457 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:15.457 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.457 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:15.457 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:15.457 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:15.457 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:15.457 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:15.457 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:15.458 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:15.458 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:15.458 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:15.458 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:15.458 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:15.458 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:15.458 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:15.458 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.458 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:15.458 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:15.458 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:15.459 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:15.459 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:15.459 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:15.459 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:15.459 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:15.459 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:15.459 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:15.459 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:15.459 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.459 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.459 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:15.459 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.460 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:15.460 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:15.460 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:15.460 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:15.460 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:15.460 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:15.460 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:15.460 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:15.460 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:15.460 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:15.460 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:15.460 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:15.461 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:15.461 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:15.461 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:15.461 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:15.461 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:15.461 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:15.461 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:15.461 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:15.461 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:15.461 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:15.461 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:15.461 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:15.462 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:15.462 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:15.462 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:15.462 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:15.462 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.462 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.462 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.462 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.462 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:15.462 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:15.462 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.462 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:15.463 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:15.463 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:15.463 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:15.463 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:15.463 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.463 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:15.463 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:15.463 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.463 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.463 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:15.463 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:15.463 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.464 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.464 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:15.464 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:15.464 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:15.464 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:15.464 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:15.464 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.464 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.464 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:15.464 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:15.464 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:15.464 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.465 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:15.465 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.465 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:15.465 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.465 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:15.465 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.465 INFO:teuthology.orchestra.run.smithi012.stdout: def test_versioning_obj_create_versions_remove_special_names(): 2023-10-05T12:49:15.465 INFO:teuthology.orchestra.run.smithi012.stdout:> bucket_name = get_new_bucket() 2023-10-05T12:49:15.465 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.465 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:7427: 2023-10-05T12:49:15.465 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.465 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-10-05T12:49:15.466 INFO:teuthology.orchestra.run.smithi012.stdout: client.create_bucket(Bucket=name) 2023-10-05T12:49:15.466 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:15.466 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:15.466 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:15.466 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:15.466 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:15.466 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:15.466 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:15.466 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:15.466 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:15.466 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:15.466 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:15.467 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:15.467 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:15.467 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:15.467 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:15.467 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:15.467 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:15.467 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:15.467 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:15.467 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:15.467 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:15.467 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:15.467 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:15.468 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:15.468 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:15.468 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:15.468 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:15.468 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:15.468 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:15.468 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:15.468 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:15.468 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:15.468 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:15.468 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:15.468 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.468 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.469 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.469 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:15.469 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.469 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:15.469 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.469 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:15.469 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:15.469 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:15.469 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:15.469 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:15.469 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:15.469 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:15.469 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:15.470 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:15.470 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:15.470 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:15.470 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:15.470 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:15.470 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.470 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:15.470 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:15.470 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:15.470 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:15.470 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:15.471 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:15.471 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:15.471 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:15.471 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:15.471 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:15.471 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:15.471 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.471 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.471 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:15.471 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:15.471 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:15.471 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:15.472 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:15.472 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.472 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.472 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:15.472 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:15.472 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:15.472 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:15.472 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:15.472 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.472 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:15.472 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:15.472 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:15.472 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:15.473 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:15.473 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-380" 2023-10-05T12:49:15.473 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.473 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:15.473 INFO:teuthology.orchestra.run.smithi012.stdout:________________ test_versioning_obj_create_overwrite_multipart ________________ 2023-10-05T12:49:15.473 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.473 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.473 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.473 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:15.473 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:15.473 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.473 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:15.473 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:15.474 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:15.474 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:15.474 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:15.474 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.474 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:15.474 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:15.474 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.474 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.474 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:15.474 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:15.474 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.474 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.475 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:15.475 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.475 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:15.475 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:15.475 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.475 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.475 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:15.475 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:15.475 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.475 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:15.475 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:15.475 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:15.475 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:15.476 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:15.476 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:15.476 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:15.476 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.476 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:15.476 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:15.476 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:15.476 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:15.476 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:15.476 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:15.476 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:15.476 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:15.476 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:15.477 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.477 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:15.477 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:15.477 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:15.477 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:15.477 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.477 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:15.477 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:15.477 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:15.477 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:15.477 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.477 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.478 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:15.478 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:15.478 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:15.478 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:15.478 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.478 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.478 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:15.478 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:15.478 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:15.478 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.478 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:15.478 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.479 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:15.479 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:15.479 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.479 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:15.479 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:15.479 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:15.479 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:15.479 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:15.479 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:15.479 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.479 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:15.479 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.479 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:15.480 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.480 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.480 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:15.480 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.480 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:15.480 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.480 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:15.480 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:15.480 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:15.480 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:15.480 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:15.480 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:15.480 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:15.481 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:15.481 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:15.481 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:15.481 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:15.481 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:15.481 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:15.481 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.481 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:15.481 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:15.481 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:15.481 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:15.481 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:15.481 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:15.482 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:15.482 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:15.482 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:15.482 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:15.482 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:15.482 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.482 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.482 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:15.482 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.482 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:15.482 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:15.483 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:15.483 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:15.483 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:15.483 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:15.483 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:15.483 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:15.483 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:15.483 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:15.483 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:15.483 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:15.483 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:15.483 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:15.483 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:15.484 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:15.484 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:15.484 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:15.484 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:15.484 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:15.484 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:15.484 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:15.484 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:15.484 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:15.484 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:15.484 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:15.485 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:15.485 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:15.485 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.485 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.485 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.485 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.485 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:15.485 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:15.485 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.485 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:15.485 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:15.485 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:15.486 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:15.486 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:15.486 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.486 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:15.486 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:15.486 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.486 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.486 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:15.486 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:15.486 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.486 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.487 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:15.487 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:15.487 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:15.487 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:15.487 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:15.487 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.487 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.487 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:15.487 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:15.487 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:15.487 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.487 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:15.488 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.488 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:15.488 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.488 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:15.488 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.488 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.fails_on_dbstore 2023-10-05T12:49:15.488 INFO:teuthology.orchestra.run.smithi012.stdout: def test_versioning_obj_create_overwrite_multipart(): 2023-10-05T12:49:15.488 INFO:teuthology.orchestra.run.smithi012.stdout:> bucket_name = get_new_bucket() 2023-10-05T12:49:15.488 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.488 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:7445: 2023-10-05T12:49:15.488 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.488 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-10-05T12:49:15.489 INFO:teuthology.orchestra.run.smithi012.stdout: client.create_bucket(Bucket=name) 2023-10-05T12:49:15.489 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:15.489 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:15.489 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:15.489 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:15.489 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:15.489 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:15.489 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:15.489 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:15.489 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:15.489 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:15.489 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:15.490 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:15.490 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:15.490 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:15.490 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:15.490 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:15.490 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:15.490 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:15.490 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:15.490 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:15.490 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:15.490 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:15.490 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:15.491 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:15.491 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:15.491 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:15.491 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:15.491 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:15.491 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:15.491 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:15.491 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:15.491 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:15.491 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:15.491 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:15.491 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.491 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.492 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.492 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:15.492 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.492 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:15.492 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.492 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:15.492 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:15.492 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:15.492 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:15.492 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:15.492 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:15.492 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:15.492 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:15.493 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:15.493 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:15.493 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:15.493 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:15.493 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:15.493 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.493 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:15.493 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:15.493 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:15.493 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:15.493 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:15.493 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:15.494 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:15.494 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:15.494 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:15.494 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:15.494 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:15.494 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.494 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.494 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:15.494 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:15.494 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:15.494 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:15.494 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:15.495 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.495 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.495 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:15.495 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:15.495 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:15.495 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:15.495 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:15.495 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.495 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:15.495 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:15.495 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:15.495 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:15.496 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:15.496 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-381" 2023-10-05T12:49:15.496 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.496 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:15.496 INFO:teuthology.orchestra.run.smithi012.stdout:_______________________ test_versioning_obj_list_marker ________________________ 2023-10-05T12:49:15.496 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.496 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.496 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.496 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:15.496 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:15.496 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.496 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:15.496 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:15.497 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:15.497 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:15.497 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:15.497 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.497 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:15.497 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:15.497 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.497 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.497 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:15.497 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:15.497 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.497 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.498 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:15.498 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.498 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:15.498 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:15.498 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.498 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.498 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:15.498 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:15.498 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.498 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:15.498 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:15.499 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:15.499 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:15.499 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:15.499 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:15.499 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:15.499 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.499 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:15.499 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:15.499 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:15.499 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:15.500 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:15.500 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:15.500 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:15.500 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:15.500 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:15.500 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.500 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:15.500 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:15.500 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:15.500 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:15.500 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.500 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:15.501 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:15.501 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:15.501 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:15.501 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.501 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.501 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:15.501 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:15.501 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:15.501 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:15.501 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.501 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.502 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:15.502 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:15.502 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:15.502 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.502 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:15.502 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.502 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:15.502 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:15.502 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.502 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:15.502 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:15.502 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:15.503 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:15.503 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:15.503 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:15.503 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.503 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:15.503 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.503 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:15.503 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.503 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.503 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:15.503 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.504 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:15.504 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.504 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:15.504 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:15.504 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:15.504 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:15.504 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:15.504 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:15.504 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:15.504 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:15.504 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:15.504 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:15.504 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:15.505 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:15.505 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:15.505 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.505 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:15.505 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:15.505 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:15.505 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:15.505 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:15.505 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:15.505 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:15.505 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:15.505 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:15.506 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:15.506 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:15.506 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.506 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.506 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:15.506 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.506 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:15.506 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:15.506 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:15.506 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:15.506 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:15.506 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:15.507 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:15.507 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:15.507 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:15.507 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:15.507 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:15.507 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:15.507 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:15.507 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:15.507 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:15.507 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:15.507 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:15.508 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:15.508 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:15.508 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:15.508 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:15.508 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:15.508 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:15.508 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:15.508 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:15.508 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:15.508 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:15.508 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:15.508 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.509 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.509 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.509 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.509 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:15.509 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:15.509 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.509 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:15.509 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:15.509 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:15.509 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:15.509 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:15.509 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.509 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:15.510 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:15.510 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.510 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.510 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:15.510 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:15.510 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.510 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.510 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:15.510 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:15.510 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:15.510 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:15.511 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:15.511 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.511 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.511 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:15.511 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:15.511 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:15.511 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.511 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:15.511 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.511 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:15.511 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.511 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:15.512 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.512 INFO:teuthology.orchestra.run.smithi012.stdout: def test_versioning_obj_list_marker(): 2023-10-05T12:49:15.512 INFO:teuthology.orchestra.run.smithi012.stdout:> bucket_name = get_new_bucket() 2023-10-05T12:49:15.512 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.512 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:7473: 2023-10-05T12:49:15.512 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.512 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-10-05T12:49:15.512 INFO:teuthology.orchestra.run.smithi012.stdout: client.create_bucket(Bucket=name) 2023-10-05T12:49:15.512 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:15.512 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:15.512 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:15.512 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:15.512 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:15.513 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:15.513 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:15.513 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:15.513 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:15.513 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:15.513 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:15.513 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:15.513 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:15.513 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:15.513 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:15.513 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:15.513 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:15.514 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:15.514 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:15.514 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:15.514 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:15.514 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:15.514 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:15.514 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:15.514 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:15.514 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:15.514 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:15.514 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:15.514 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:15.515 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:15.515 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:15.515 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:15.515 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:15.515 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:15.515 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.515 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.515 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.515 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:15.515 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.515 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:15.516 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.516 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:15.516 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:15.516 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:15.516 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:15.516 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:15.516 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:15.516 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:15.516 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:15.516 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:15.516 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:15.516 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:15.517 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:15.517 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:15.517 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.517 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:15.517 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:15.517 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:15.517 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:15.517 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:15.517 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:15.517 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:15.517 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:15.517 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:15.518 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:15.518 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:15.518 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.518 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.518 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:15.518 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:15.518 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:15.518 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:15.518 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:15.518 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.518 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.519 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:15.519 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:15.519 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:15.519 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:15.519 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:15.519 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.519 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:15.519 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:15.519 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:15.519 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:15.519 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:15.519 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-382" 2023-10-05T12:49:15.520 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.520 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:15.520 INFO:teuthology.orchestra.run.smithi012.stdout:_______________________ test_versioning_copy_obj_version _______________________ 2023-10-05T12:49:15.520 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.520 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.520 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.520 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:15.520 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:15.520 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.520 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:15.520 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:15.521 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:15.521 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:15.521 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:15.521 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.521 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:15.521 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:15.521 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.521 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.521 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:15.521 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:15.521 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.521 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.522 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:15.522 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.522 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:15.522 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:15.522 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.522 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.522 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:15.522 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:15.522 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.522 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:15.522 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:15.523 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:15.523 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:15.523 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:15.523 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:15.523 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:15.523 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.523 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:15.523 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:15.523 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:15.523 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:15.523 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:15.523 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:15.524 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:15.524 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:15.524 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:15.524 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.524 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:15.524 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:15.524 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:15.524 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:15.524 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.524 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:15.524 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:15.524 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:15.525 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:15.525 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.525 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.525 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:15.525 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:15.525 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:15.525 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:15.525 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.525 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.525 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:15.525 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:15.525 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:15.526 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.526 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:15.526 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.526 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:15.526 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:15.526 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.526 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:15.526 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:15.526 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:15.526 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:15.526 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:15.527 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:15.527 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.527 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:15.527 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.527 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:15.527 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.527 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.527 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:15.527 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.527 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:15.527 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.528 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:15.528 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:15.528 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:15.528 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:15.528 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:15.528 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:15.528 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:15.528 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:15.528 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:15.528 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:15.528 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:15.529 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:15.529 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:15.529 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.529 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:15.529 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:15.529 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:15.529 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:15.529 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:15.529 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:15.529 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:15.529 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:15.529 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:15.530 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:15.530 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:15.530 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.530 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.530 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:15.530 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.530 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:15.530 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:15.530 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:15.530 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:15.530 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:15.531 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:15.531 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:15.531 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:15.531 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:15.531 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:15.531 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:15.531 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:15.531 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:15.531 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:15.531 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:15.531 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:15.531 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:15.532 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:15.532 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:15.532 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:15.532 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:15.532 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:15.532 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:15.532 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:15.532 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:15.532 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:15.532 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:15.532 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:15.532 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.533 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.533 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.533 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.533 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:15.533 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:15.533 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.533 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:15.533 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:15.533 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:15.533 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:15.533 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:15.534 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.534 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:15.534 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:15.534 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.534 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.534 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:15.534 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:15.534 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.534 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.534 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:15.534 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:15.535 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:15.535 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:15.535 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:15.535 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.535 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.535 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:15.535 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:15.535 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:15.535 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.535 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:15.535 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.535 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:15.536 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.536 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:15.536 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.536 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.fails_on_dbstore 2023-10-05T12:49:15.536 INFO:teuthology.orchestra.run.smithi012.stdout: def test_versioning_copy_obj_version(): 2023-10-05T12:49:15.536 INFO:teuthology.orchestra.run.smithi012.stdout:> bucket_name = get_new_bucket() 2023-10-05T12:49:15.536 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.536 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:7529: 2023-10-05T12:49:15.536 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.536 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-10-05T12:49:15.536 INFO:teuthology.orchestra.run.smithi012.stdout: client.create_bucket(Bucket=name) 2023-10-05T12:49:15.537 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:15.537 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:15.537 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:15.537 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:15.537 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:15.537 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:15.537 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:15.537 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:15.537 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:15.537 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:15.537 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:15.537 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:15.538 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:15.538 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:15.538 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:15.538 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:15.538 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:15.538 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:15.538 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:15.538 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:15.538 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:15.538 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:15.538 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:15.538 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:15.539 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:15.539 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:15.539 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:15.539 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:15.539 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:15.539 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:15.539 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:15.539 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:15.539 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:15.539 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:15.539 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.539 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.539 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.540 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:15.540 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.540 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:15.540 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.540 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:15.540 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:15.540 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:15.540 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:15.540 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:15.540 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:15.540 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:15.540 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:15.540 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:15.541 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:15.541 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:15.541 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:15.541 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:15.541 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.541 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:15.541 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:15.541 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:15.541 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:15.541 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:15.541 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:15.541 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:15.542 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:15.542 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:15.542 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:15.542 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:15.542 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.542 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.542 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:15.542 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:15.542 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:15.542 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:15.542 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:15.543 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.543 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.543 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:15.543 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:15.543 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:15.543 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:15.543 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:15.543 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.543 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:15.543 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:15.543 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:15.543 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:15.544 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:15.544 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-383" 2023-10-05T12:49:15.544 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.544 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:15.544 INFO:teuthology.orchestra.run.smithi012.stdout:_____________________ test_versioning_multi_object_delete ______________________ 2023-10-05T12:49:15.544 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.544 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.544 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.544 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:15.544 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:15.544 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.544 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:15.544 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:15.545 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:15.545 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:15.545 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:15.545 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.545 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:15.545 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:15.545 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.545 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.545 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:15.545 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:15.545 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.545 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.545 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:15.546 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.546 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:15.546 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:15.546 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.546 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.546 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:15.546 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:15.546 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.546 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:15.546 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:15.546 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:15.546 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:15.547 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:15.547 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:15.547 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:15.547 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.547 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:15.547 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:15.547 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:15.547 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:15.547 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:15.547 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:15.547 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:15.548 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:15.548 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:15.548 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.548 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:15.548 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:15.548 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:15.548 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:15.548 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.548 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:15.548 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:15.548 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:15.548 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:15.549 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.549 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.549 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:15.549 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:15.549 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:15.549 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:15.549 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.549 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.549 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:15.549 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:15.549 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:15.549 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.550 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:15.550 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.550 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:15.550 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:15.550 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.550 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:15.550 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:15.550 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:15.550 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:15.550 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:15.550 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:15.551 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.551 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:15.551 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.551 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:15.551 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.551 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.551 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:15.551 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.551 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:15.551 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.551 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:15.551 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:15.552 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:15.552 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:15.552 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:15.552 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:15.552 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:15.552 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:15.552 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:15.552 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:15.552 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:15.552 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:15.552 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:15.553 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.553 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:15.553 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:15.553 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:15.553 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:15.553 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:15.553 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:15.553 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:15.553 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:15.553 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:15.553 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:15.553 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:15.554 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.554 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.554 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:15.554 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.554 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:15.554 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:15.554 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:15.554 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:15.554 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:15.554 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:15.554 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:15.555 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:15.555 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:15.555 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:15.555 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:15.555 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:15.555 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:15.555 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:15.555 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:15.555 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:15.555 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:15.555 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:15.555 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:15.556 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:15.556 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:15.556 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:15.556 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:15.556 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:15.556 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:15.556 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:15.556 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:15.556 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:15.556 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.556 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.557 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.557 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.557 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:15.557 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:15.557 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.557 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:15.557 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:15.557 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:15.557 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:15.557 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:15.557 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.558 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:15.558 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:15.558 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.558 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.558 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:15.558 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:15.558 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.558 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.558 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:15.558 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:15.558 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:15.559 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:15.559 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:15.559 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.559 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.559 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:15.559 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:15.559 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:15.559 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.559 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:15.559 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.559 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:15.559 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.560 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:15.560 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.560 INFO:teuthology.orchestra.run.smithi012.stdout: def test_versioning_multi_object_delete(): 2023-10-05T12:49:15.560 INFO:teuthology.orchestra.run.smithi012.stdout:> bucket_name = get_new_bucket() 2023-10-05T12:49:15.560 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.560 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:7566: 2023-10-05T12:49:15.560 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.560 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-10-05T12:49:15.560 INFO:teuthology.orchestra.run.smithi012.stdout: client.create_bucket(Bucket=name) 2023-10-05T12:49:15.560 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:15.560 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:15.560 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:15.561 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:15.561 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:15.561 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:15.561 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:15.561 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:15.561 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:15.561 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:15.561 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:15.561 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:15.561 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:15.561 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:15.561 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:15.562 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:15.562 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:15.562 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:15.562 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:15.562 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:15.562 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:15.562 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:15.562 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:15.562 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:15.562 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:15.562 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:15.562 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:15.563 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:15.563 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:15.563 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:15.563 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:15.563 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:15.563 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:15.563 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:15.563 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.563 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.563 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.563 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:15.564 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.564 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:15.564 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.564 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:15.564 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:15.564 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:15.564 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:15.564 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:15.564 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:15.564 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:15.564 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:15.564 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:15.564 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:15.564 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:15.565 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:15.565 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:15.565 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.565 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:15.565 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:15.565 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:15.565 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:15.565 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:15.565 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:15.565 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:15.565 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:15.565 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:15.566 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:15.566 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:15.566 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.566 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.566 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:15.566 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:15.566 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:15.566 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:15.566 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:15.566 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.566 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.566 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:15.567 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:15.567 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:15.567 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:15.567 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:15.567 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.567 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:15.567 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:15.567 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:15.567 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:15.567 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:15.567 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-384" 2023-10-05T12:49:15.567 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.567 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:15.568 INFO:teuthology.orchestra.run.smithi012.stdout:_______________ test_versioning_multi_object_delete_with_marker ________________ 2023-10-05T12:49:15.568 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.568 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.568 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.568 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:15.568 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:15.568 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.568 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:15.568 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:15.568 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:15.568 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:15.568 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:15.568 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.569 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:15.569 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:15.569 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.569 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.569 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:15.569 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:15.569 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.569 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.569 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:15.569 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.569 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:15.569 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:15.570 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.570 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.570 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:15.570 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:15.570 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.570 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:15.570 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:15.570 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:15.570 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:15.570 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:15.570 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:15.570 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:15.571 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.571 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:15.571 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:15.571 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:15.571 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:15.571 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:15.571 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:15.571 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:15.571 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:15.571 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:15.571 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.571 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:15.571 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:15.571 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:15.572 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:15.572 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.572 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:15.572 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:15.572 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:15.572 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:15.572 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.572 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.572 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:15.572 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:15.572 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:15.572 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:15.573 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.573 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.573 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:15.573 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:15.573 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:15.573 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.573 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:15.573 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.573 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:15.573 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:15.573 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.573 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:15.574 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:15.574 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:15.574 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:15.574 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:15.574 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:15.574 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.574 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:15.574 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.574 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:15.574 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.574 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.574 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:15.575 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.575 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:15.575 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.575 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:15.575 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:15.575 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:15.575 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:15.575 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:15.575 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:15.575 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:15.575 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:15.575 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:15.576 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:15.576 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:15.576 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:15.576 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:15.576 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.576 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:15.576 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:15.576 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:15.576 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:15.576 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:15.576 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:15.576 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:15.577 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:15.577 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:15.577 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:15.577 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:15.577 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.577 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.577 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:15.577 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.577 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:15.577 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:15.577 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:15.577 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:15.577 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:15.578 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:15.578 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:15.578 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:15.578 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:15.578 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:15.578 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:15.578 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:15.578 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:15.578 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:15.578 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:15.578 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:15.579 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:15.579 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:15.579 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:15.579 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:15.579 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:15.579 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:15.579 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:15.579 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:15.579 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:15.579 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:15.579 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:15.579 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:15.580 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.580 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.580 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.580 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.580 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:15.580 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:15.580 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.580 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:15.580 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:15.580 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:15.580 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:15.580 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:15.581 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.581 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:15.581 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:15.581 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.581 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.581 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:15.581 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:15.581 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.581 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.581 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:15.581 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:15.581 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:15.582 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:15.582 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:15.582 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.582 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.582 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:15.582 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:15.582 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:15.582 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.582 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:15.582 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.582 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:15.582 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.583 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:15.583 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.583 INFO:teuthology.orchestra.run.smithi012.stdout: def test_versioning_multi_object_delete_with_marker(): 2023-10-05T12:49:15.583 INFO:teuthology.orchestra.run.smithi012.stdout:> bucket_name = get_new_bucket() 2023-10-05T12:49:15.583 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.583 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:7591: 2023-10-05T12:49:15.583 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.583 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-10-05T12:49:15.583 INFO:teuthology.orchestra.run.smithi012.stdout: client.create_bucket(Bucket=name) 2023-10-05T12:49:15.583 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:15.583 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:15.583 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:15.583 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:15.584 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:15.584 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:15.584 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:15.584 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:15.584 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:15.584 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:15.584 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:15.584 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:15.584 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:15.584 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:15.584 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:15.584 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:15.584 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:15.585 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:15.585 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:15.585 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:15.585 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:15.585 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:15.585 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:15.585 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:15.585 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:15.585 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:15.585 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:15.585 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:15.586 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:15.586 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:15.586 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:15.586 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:15.586 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:15.586 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:15.586 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.586 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.586 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.586 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:15.586 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.587 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:15.587 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.587 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:15.587 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:15.587 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:15.587 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:15.587 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:15.587 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:15.587 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:15.587 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:15.587 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:15.587 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:15.588 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:15.588 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:15.588 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:15.588 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.588 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:15.588 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:15.588 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:15.588 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:15.588 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:15.588 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:15.588 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:15.589 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:15.589 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:15.589 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:15.589 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:15.589 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.589 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.589 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:15.589 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:15.589 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:15.589 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:15.589 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:15.589 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.589 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.590 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:15.590 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:15.590 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:15.590 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:15.590 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:15.590 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.590 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:15.590 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:15.590 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:15.590 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:15.590 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:15.590 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-385" 2023-10-05T12:49:15.591 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.591 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:15.591 INFO:teuthology.orchestra.run.smithi012.stdout:____________ test_versioning_multi_object_delete_with_marker_create ____________ 2023-10-05T12:49:15.591 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.591 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.591 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.591 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:15.591 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:15.591 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.591 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:15.591 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:15.591 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:15.592 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:15.592 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:15.592 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.592 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:15.592 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:15.592 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.592 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.592 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:15.592 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:15.592 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.592 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.592 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:15.593 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.593 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:15.593 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:15.593 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.593 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.593 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:15.593 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:15.593 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.593 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:15.593 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:15.593 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:15.593 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:15.593 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:15.594 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:15.594 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:15.594 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.594 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:15.594 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:15.594 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:15.594 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:15.594 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:15.594 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:15.594 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:15.594 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:15.595 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:15.595 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.595 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:15.595 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:15.595 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:15.595 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:15.595 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.595 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:15.595 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:15.595 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:15.595 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:15.595 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.596 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.596 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:15.596 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:15.596 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:15.596 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:15.596 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.596 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.596 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:15.596 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:15.596 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:15.596 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.596 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:15.596 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.597 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:15.597 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:15.597 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.597 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:15.597 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:15.597 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:15.597 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:15.597 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:15.597 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:15.597 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.597 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:15.597 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.597 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:15.598 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.598 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.598 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:15.598 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.598 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:15.598 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.598 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:15.598 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:15.598 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:15.598 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:15.598 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:15.598 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:15.599 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:15.599 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:15.599 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:15.599 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:15.599 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:15.599 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:15.599 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:15.599 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.599 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:15.599 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:15.599 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:15.599 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:15.599 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:15.600 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:15.600 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:15.600 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:15.600 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:15.600 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:15.600 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:15.600 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.600 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.600 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:15.600 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.601 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:15.601 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:15.601 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:15.601 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:15.601 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:15.601 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:15.601 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:15.601 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:15.601 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:15.601 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:15.601 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:15.601 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:15.601 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:15.602 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:15.602 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:15.602 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:15.602 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:15.602 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:15.602 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:15.602 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:15.602 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:15.602 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:15.602 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:15.602 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:15.602 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:15.603 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:15.603 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:15.603 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:15.603 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.603 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.603 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.603 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.603 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:15.603 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:15.603 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.603 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:15.603 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:15.603 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:15.604 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:15.604 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:15.604 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.604 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:15.604 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:15.604 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.604 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.604 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:15.604 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:15.604 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.604 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.604 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:15.604 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:15.605 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:15.605 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:15.605 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:15.605 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.605 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.605 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:15.605 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:15.605 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:15.605 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.605 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:15.605 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.605 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:15.605 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.606 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:15.606 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.606 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.fails_on_dbstore 2023-10-05T12:49:15.606 INFO:teuthology.orchestra.run.smithi012.stdout: def test_versioning_multi_object_delete_with_marker_create(): 2023-10-05T12:49:15.606 INFO:teuthology.orchestra.run.smithi012.stdout:> bucket_name = get_new_bucket() 2023-10-05T12:49:15.606 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.606 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:7624: 2023-10-05T12:49:15.606 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.606 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-10-05T12:49:15.606 INFO:teuthology.orchestra.run.smithi012.stdout: client.create_bucket(Bucket=name) 2023-10-05T12:49:15.606 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:15.606 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:15.607 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:15.607 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:15.607 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:15.607 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:15.607 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:15.607 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:15.607 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:15.607 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:15.607 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:15.607 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:15.607 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:15.607 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:15.608 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:15.608 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:15.608 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:15.608 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:15.608 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:15.608 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:15.608 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:15.608 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:15.608 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:15.608 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:15.608 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:15.609 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:15.609 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:15.609 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:15.609 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:15.609 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:15.609 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:15.609 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:15.609 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:15.609 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:15.609 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.609 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.609 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.610 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:15.610 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.610 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:15.610 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.610 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:15.610 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:15.610 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:15.610 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:15.610 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:15.610 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:15.610 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:15.610 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:15.611 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:15.611 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:15.611 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:15.611 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:15.611 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:15.611 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.611 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:15.611 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:15.611 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:15.611 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:15.611 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:15.611 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:15.612 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:15.612 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:15.612 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:15.612 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:15.612 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:15.612 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.612 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.612 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:15.612 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:15.612 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:15.612 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:15.612 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:15.613 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.613 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.613 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:15.613 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:15.613 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:15.613 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:15.613 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:15.613 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.613 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:15.613 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:15.613 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:15.613 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:15.613 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:15.614 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-386" 2023-10-05T12:49:15.614 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.614 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:15.614 INFO:teuthology.orchestra.run.smithi012.stdout:__________________________ test_versioned_object_acl ___________________________ 2023-10-05T12:49:15.614 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.614 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.614 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.614 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:15.614 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:15.614 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.614 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:15.615 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:15.615 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:15.615 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:15.615 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:15.615 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.615 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:15.615 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:15.615 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.615 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.615 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:15.615 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:15.615 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.615 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.616 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:15.616 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.616 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:15.616 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:15.616 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.616 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.616 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:15.616 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:15.616 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.616 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:15.616 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:15.616 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:15.616 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:15.617 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:15.617 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:15.617 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:15.617 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.617 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:15.617 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:15.617 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:15.617 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:15.617 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:15.617 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:15.617 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:15.617 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:15.617 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:15.618 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.618 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:15.618 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:15.618 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:15.618 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:15.618 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.618 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:15.618 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:15.618 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:15.618 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:15.618 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.618 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.619 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:15.619 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:15.619 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:15.619 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:15.619 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.619 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.619 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:15.619 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:15.619 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:15.619 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.619 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:15.619 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.619 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:15.620 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:15.620 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.620 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:15.620 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:15.620 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:15.620 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:15.620 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:15.620 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:15.620 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.620 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:15.620 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.621 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:15.621 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.621 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.621 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:15.621 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.621 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:15.621 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.621 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:15.621 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:15.621 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:15.621 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:15.621 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:15.621 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:15.622 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:15.622 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:15.622 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:15.622 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:15.622 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:15.622 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:15.622 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:15.622 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.622 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:15.622 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:15.622 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:15.623 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:15.623 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:15.623 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:15.623 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:15.623 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:15.623 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:15.623 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:15.623 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:15.623 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.623 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.623 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:15.623 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.623 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:15.624 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:15.624 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:15.624 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:15.624 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:15.624 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:15.624 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:15.624 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:15.624 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:15.624 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:15.624 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:15.624 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:15.624 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:15.624 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:15.625 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:15.625 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:15.625 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:15.625 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:15.625 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:15.625 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:15.625 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:15.625 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:15.625 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:15.625 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:15.625 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:15.625 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:15.626 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:15.626 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:15.626 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.626 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.626 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.626 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.626 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:15.626 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:15.626 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.626 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:15.626 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:15.627 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:15.627 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:15.627 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:15.627 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.627 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:15.627 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:15.627 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.627 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.627 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:15.627 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:15.627 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.627 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.627 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:15.628 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:15.628 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:15.628 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:15.628 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:15.628 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.628 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.628 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:15.628 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:15.628 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:15.628 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.628 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:15.628 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.629 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:15.629 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.629 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:15.629 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.629 INFO:teuthology.orchestra.run.smithi012.stdout: def test_versioned_object_acl(): 2023-10-05T12:49:15.629 INFO:teuthology.orchestra.run.smithi012.stdout:> bucket_name = get_new_bucket() 2023-10-05T12:49:15.629 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.629 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:7645: 2023-10-05T12:49:15.629 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.629 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-10-05T12:49:15.629 INFO:teuthology.orchestra.run.smithi012.stdout: client.create_bucket(Bucket=name) 2023-10-05T12:49:15.629 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:15.630 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:15.630 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:15.630 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:15.630 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:15.630 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:15.630 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:15.630 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:15.630 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:15.630 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:15.630 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:15.630 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:15.631 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:15.631 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:15.631 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:15.631 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:15.631 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:15.631 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:15.631 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:15.631 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:15.631 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:15.631 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:15.631 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:15.631 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:15.631 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:15.632 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:15.632 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:15.632 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:15.632 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:15.632 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:15.632 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:15.632 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:15.632 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:15.632 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:15.632 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.632 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.632 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.633 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:15.633 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.633 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:15.633 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.633 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:15.633 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:15.633 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:15.633 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:15.633 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:15.633 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:15.633 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:15.633 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:15.633 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:15.634 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:15.634 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:15.634 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:15.634 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:15.634 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.634 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:15.634 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:15.634 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:15.634 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:15.634 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:15.634 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:15.634 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:15.635 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:15.635 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:15.635 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:15.635 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:15.635 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.635 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.635 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:15.635 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:15.635 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:15.635 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:15.635 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:15.635 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.635 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.636 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:15.636 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:15.636 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:15.636 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:15.636 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:15.636 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.636 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:15.636 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:15.636 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:15.636 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:15.636 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:15.636 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-387" 2023-10-05T12:49:15.637 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.637 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:15.637 INFO:teuthology.orchestra.run.smithi012.stdout:________________ test_versioned_object_acl_no_version_specified ________________ 2023-10-05T12:49:15.637 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.637 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.637 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.637 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:15.637 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:15.637 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.637 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:15.637 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:15.637 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:15.638 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:15.638 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:15.638 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.638 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:15.638 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:15.638 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.638 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.638 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:15.638 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:15.638 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.638 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.639 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:15.639 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.639 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:15.639 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:15.639 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.639 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.639 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:15.639 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:15.639 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.639 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:15.639 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:15.639 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:15.640 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:15.640 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:15.640 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:15.640 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:15.640 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.640 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:15.640 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:15.640 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:15.640 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:15.640 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:15.640 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:15.640 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:15.641 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:15.641 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:15.641 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.641 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:15.641 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:15.641 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:15.641 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:15.641 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.641 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:15.641 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:15.641 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:15.641 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:15.641 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.642 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.642 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:15.642 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:15.642 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:15.642 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:15.642 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.642 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.642 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:15.642 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:15.642 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:15.642 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.643 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:15.643 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.643 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:15.643 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:15.643 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.643 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:15.643 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:15.643 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:15.643 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:15.643 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:15.643 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:15.643 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.644 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:15.644 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.644 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:15.644 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.644 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.644 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:15.644 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.644 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:15.644 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.644 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:15.644 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:15.644 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:15.644 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:15.645 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:15.645 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:15.645 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:15.645 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:15.645 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:15.645 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:15.645 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:15.645 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:15.645 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:15.645 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.645 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:15.645 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:15.645 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:15.646 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:15.646 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:15.646 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:15.646 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:15.646 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:15.646 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:15.646 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:15.646 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:15.646 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.646 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.646 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:15.646 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.647 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:15.647 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:15.647 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:15.647 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:15.647 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:15.647 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:15.647 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:15.647 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:15.647 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:15.647 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:15.647 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:15.647 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:15.648 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:15.648 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:15.648 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:15.648 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:15.648 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:15.648 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:15.648 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:15.648 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:15.648 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:15.648 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:15.648 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:15.648 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:15.649 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:15.649 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:15.649 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:15.649 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:15.649 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.649 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.649 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.649 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.649 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:15.649 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:15.649 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.649 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:15.649 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:15.650 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:15.650 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:15.650 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:15.650 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.650 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:15.650 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:15.650 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.650 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.650 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:15.650 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:15.650 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.651 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.651 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:15.651 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:15.651 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:15.651 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:15.651 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:15.651 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.651 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.651 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:15.651 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:15.651 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:15.651 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.652 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:15.652 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.652 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:15.652 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.652 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:15.652 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.652 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.fails_on_dbstore 2023-10-05T12:49:15.652 INFO:teuthology.orchestra.run.smithi012.stdout: def test_versioned_object_acl_no_version_specified(): 2023-10-05T12:49:15.652 INFO:teuthology.orchestra.run.smithi012.stdout:> bucket_name = get_new_bucket() 2023-10-05T12:49:15.652 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.652 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:7713: 2023-10-05T12:49:15.652 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.653 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-10-05T12:49:15.653 INFO:teuthology.orchestra.run.smithi012.stdout: client.create_bucket(Bucket=name) 2023-10-05T12:49:15.653 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:15.653 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:15.653 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:15.653 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:15.653 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:15.653 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:15.653 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:15.653 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:15.653 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:15.653 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:15.654 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:15.654 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:15.654 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:15.654 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:15.654 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:15.654 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:15.654 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:15.654 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:15.654 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:15.654 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:15.654 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:15.655 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:15.655 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:15.655 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:15.655 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:15.655 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:15.655 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:15.655 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:15.655 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:15.655 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:15.655 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:15.655 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:15.655 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:15.655 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:15.656 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.656 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.656 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.656 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:15.656 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.656 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:15.656 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.656 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:15.656 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:15.656 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:15.656 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:15.657 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:15.657 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:15.657 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:15.657 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:15.657 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:15.657 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:15.657 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:15.657 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:15.657 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:15.657 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.657 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:15.657 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:15.658 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:15.658 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:15.658 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:15.658 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:15.658 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:15.658 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:15.658 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:15.658 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:15.658 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:15.658 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.658 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.659 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:15.659 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:15.659 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:15.659 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:15.659 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:15.659 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.659 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.659 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:15.659 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:15.659 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:15.659 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:15.659 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:15.660 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.660 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:15.660 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:15.660 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:15.660 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:15.660 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:15.660 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-388" 2023-10-05T12:49:15.660 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.660 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:15.660 INFO:teuthology.orchestra.run.smithi012.stdout:______________ test_versioned_concurrent_object_create_and_remove ______________ 2023-10-05T12:49:15.660 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.660 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.661 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.661 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:15.661 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:15.661 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.661 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:15.661 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:15.661 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:15.661 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:15.661 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:15.661 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.661 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:15.661 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:15.661 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.662 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.662 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:15.662 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:15.662 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.662 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.662 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:15.662 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.662 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:15.662 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:15.662 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.662 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.662 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:15.663 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:15.663 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.663 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:15.663 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:15.663 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:15.663 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:15.663 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:15.663 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:15.663 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:15.663 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.663 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:15.663 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:15.663 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:15.664 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:15.664 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:15.664 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:15.664 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:15.664 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:15.664 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:15.664 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.664 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:15.664 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:15.664 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:15.664 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:15.664 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.665 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:15.665 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:15.665 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:15.665 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:15.665 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.665 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.665 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:15.665 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:15.665 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:15.665 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:15.665 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.665 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.665 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:15.666 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:15.666 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:15.666 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.666 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:15.666 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.666 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:15.666 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:15.666 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.666 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:15.666 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:15.666 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:15.666 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:15.667 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:15.667 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:15.667 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.667 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:15.667 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.667 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:15.667 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.667 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.667 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:15.667 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.667 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:15.667 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.667 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:15.668 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:15.668 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:15.668 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:15.668 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:15.668 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:15.668 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:15.668 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:15.668 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:15.668 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:15.668 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:15.668 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:15.668 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:15.669 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.669 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:15.669 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:15.669 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:15.669 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:15.669 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:15.669 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:15.669 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:15.669 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:15.669 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:15.669 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:15.669 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:15.669 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.669 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.670 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:15.670 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.670 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:15.670 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:15.670 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:15.670 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:15.670 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:15.670 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:15.670 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:15.670 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:15.671 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:15.671 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:15.671 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:15.671 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:15.671 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:15.671 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:15.671 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:15.671 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:15.671 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:15.671 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:15.671 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:15.671 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:15.672 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:15.672 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:15.672 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:15.672 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:15.672 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:15.672 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:15.672 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:15.672 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:15.672 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.672 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.672 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.672 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.673 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:15.673 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:15.673 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.673 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:15.673 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:15.673 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:15.673 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:15.673 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:15.673 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.673 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:15.673 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:15.673 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.673 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.674 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:15.674 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:15.674 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.674 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.674 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:15.674 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:15.674 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:15.674 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:15.674 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:15.674 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.674 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.674 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:15.675 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:15.675 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:15.675 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.675 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:15.675 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.675 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:15.675 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.675 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:15.675 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.675 INFO:teuthology.orchestra.run.smithi012.stdout: def test_versioned_concurrent_object_create_and_remove(): 2023-10-05T12:49:15.675 INFO:teuthology.orchestra.run.smithi012.stdout:> bucket_name = get_new_bucket() 2023-10-05T12:49:15.675 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.675 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:7825: 2023-10-05T12:49:15.676 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.676 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-10-05T12:49:15.676 INFO:teuthology.orchestra.run.smithi012.stdout: client.create_bucket(Bucket=name) 2023-10-05T12:49:15.676 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:15.676 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:15.676 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:15.676 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:15.676 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:15.676 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:15.676 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:15.676 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:15.677 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:15.677 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:15.677 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:15.677 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:15.677 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:15.677 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:15.677 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:15.677 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:15.677 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:15.677 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:15.677 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:15.678 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:15.678 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:15.678 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:15.678 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:15.678 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:15.678 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:15.678 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:15.678 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:15.678 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:15.678 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:15.678 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:15.679 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:15.679 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:15.679 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:15.679 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:15.679 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.679 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.679 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.679 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:15.679 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.679 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:15.679 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.679 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:15.680 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:15.680 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:15.680 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:15.680 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:15.680 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:15.680 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:15.680 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:15.680 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:15.680 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:15.680 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:15.680 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:15.680 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:15.681 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.681 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:15.681 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:15.681 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:15.681 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:15.681 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:15.681 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:15.681 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:15.681 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:15.681 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:15.681 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:15.681 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:15.682 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.682 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.682 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:15.682 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:15.682 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:15.682 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:15.682 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:15.682 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.682 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.682 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:15.682 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:15.683 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:15.683 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:15.683 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:15.683 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.683 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:15.683 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:15.683 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:15.683 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:15.683 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:15.683 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-389" 2023-10-05T12:49:15.683 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.683 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:15.683 INFO:teuthology.orchestra.run.smithi012.stdout:______________________________ test_lifecycle_set ______________________________ 2023-10-05T12:49:15.684 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.684 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.684 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.684 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:15.684 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:15.684 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.684 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:15.684 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:15.684 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:15.684 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:15.684 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:15.684 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.684 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:15.685 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:15.685 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.685 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.685 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:15.685 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:15.685 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.685 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.685 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:15.685 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.685 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:15.685 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:15.685 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.686 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.686 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:15.686 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:15.686 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.686 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:15.686 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:15.686 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:15.686 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:15.686 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:15.686 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:15.686 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:15.687 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.687 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:15.687 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:15.687 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:15.687 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:15.687 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:15.687 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:15.687 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:15.687 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:15.687 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:15.687 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.688 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:15.688 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:15.688 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:15.688 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:15.688 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.688 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:15.688 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:15.688 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:15.688 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:15.688 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.688 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.688 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:15.689 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:15.689 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:15.689 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:15.689 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.689 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.689 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:15.689 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:15.689 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:15.689 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.689 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:15.689 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.689 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:15.690 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:15.690 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.690 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:15.690 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:15.690 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:15.690 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:15.690 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:15.690 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:15.690 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.690 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:15.690 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.691 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:15.691 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.691 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.691 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:15.691 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.691 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:15.691 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.691 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:15.691 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:15.691 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:15.691 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:15.691 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:15.691 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:15.692 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:15.692 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:15.692 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:15.692 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:15.692 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:15.692 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:15.692 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:15.692 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.692 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:15.692 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:15.692 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:15.692 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:15.693 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:15.693 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:15.693 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:15.693 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:15.693 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:15.693 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:15.693 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:15.693 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.693 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.693 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:15.693 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.693 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:15.694 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:15.694 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:15.694 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:15.694 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:15.694 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:15.694 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:15.694 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:15.694 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:15.694 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:15.694 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:15.694 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:15.694 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:15.695 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:15.695 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:15.695 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:15.695 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:15.695 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:15.695 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:15.695 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:15.695 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:15.695 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:15.695 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:15.695 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:15.695 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:15.696 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:15.696 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:15.696 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:15.696 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.696 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.696 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.696 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.696 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:15.696 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:15.696 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.696 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:15.696 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:15.696 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:15.697 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:15.697 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:15.697 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.697 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:15.697 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:15.697 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.697 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.697 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:15.697 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:15.697 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.697 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.697 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:15.698 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:15.698 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:15.698 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:15.698 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:15.698 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.698 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.698 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:15.698 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:15.698 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:15.698 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.698 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:15.698 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.699 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:15.699 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.699 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:15.699 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.699 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.lifecycle 2023-10-05T12:49:15.699 INFO:teuthology.orchestra.run.smithi012.stdout: def test_lifecycle_set(): 2023-10-05T12:49:15.699 INFO:teuthology.orchestra.run.smithi012.stdout:> bucket_name = get_new_bucket() 2023-10-05T12:49:15.699 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.699 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:7854: 2023-10-05T12:49:15.699 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.699 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-10-05T12:49:15.700 INFO:teuthology.orchestra.run.smithi012.stdout: client.create_bucket(Bucket=name) 2023-10-05T12:49:15.700 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:15.700 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:15.700 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:15.700 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:15.700 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:15.700 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:15.700 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:15.700 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:15.700 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:15.700 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:15.701 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:15.701 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:15.701 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:15.701 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:15.701 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:15.701 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:15.701 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:15.701 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:15.701 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:15.701 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:15.701 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:15.701 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:15.702 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:15.702 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:15.702 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:15.702 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:15.702 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:15.702 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:15.702 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:15.702 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:15.702 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:15.702 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:15.702 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:15.702 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:15.702 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.703 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.703 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.703 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:15.703 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.703 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:15.703 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.703 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:15.703 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:15.703 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:15.703 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:15.703 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:15.703 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:15.704 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:15.704 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:15.704 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:15.704 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:15.704 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:15.704 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:15.704 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:15.704 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.704 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:15.704 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:15.704 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:15.704 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:15.705 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:15.705 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:15.705 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:15.705 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:15.705 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:15.705 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:15.705 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:15.705 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.705 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.705 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:15.705 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:15.705 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:15.706 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:15.706 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:15.706 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.706 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.706 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:15.706 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:15.706 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:15.706 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:15.706 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:15.706 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.706 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:15.706 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:15.707 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:15.707 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:15.707 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:15.707 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-390" 2023-10-05T12:49:15.707 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.707 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:15.707 INFO:teuthology.orchestra.run.smithi012.stdout:______________________________ test_lifecycle_get ______________________________ 2023-10-05T12:49:15.707 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.707 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.707 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.707 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:15.707 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:15.708 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.708 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:15.708 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:15.708 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:15.708 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:15.708 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:15.708 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.708 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:15.708 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:15.708 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.708 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.708 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:15.709 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:15.709 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.709 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.709 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:15.709 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.710 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:15.710 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:15.710 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.710 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.710 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:15.710 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:15.710 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.710 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:15.710 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:15.710 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:15.710 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:15.710 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:15.711 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:15.711 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:15.711 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.711 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:15.711 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:15.711 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:15.711 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:15.711 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:15.711 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:15.711 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:15.711 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:15.711 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:15.711 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.712 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:15.712 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:15.712 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:15.712 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:15.712 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.712 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:15.712 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:15.712 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:15.712 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:15.712 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.712 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.712 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:15.712 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:15.713 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:15.713 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:15.713 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.713 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.713 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:15.713 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:15.713 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:15.713 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.713 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:15.713 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.713 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:15.714 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:15.714 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.714 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:15.714 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:15.714 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:15.714 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:15.714 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:15.714 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:15.714 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.714 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:15.714 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.714 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:15.715 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.715 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.715 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:15.715 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.715 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:15.715 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.715 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:15.715 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:15.715 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:15.715 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:15.715 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:15.716 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:15.716 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:15.716 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:15.716 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:15.716 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:15.716 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:15.716 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:15.716 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:15.716 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.716 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:15.716 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:15.716 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:15.716 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:15.717 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:15.717 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:15.717 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:15.717 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:15.717 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:15.717 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:15.717 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:15.717 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.717 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.717 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:15.717 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.717 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:15.718 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:15.718 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:15.718 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:15.718 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:15.718 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:15.718 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:15.718 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:15.718 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:15.718 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:15.718 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:15.718 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:15.719 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:15.719 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:15.719 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:15.719 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:15.719 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:15.719 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:15.719 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:15.719 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:15.719 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:15.719 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:15.719 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:15.719 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:15.720 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:15.720 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:15.720 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:15.720 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:15.720 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.720 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.720 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.720 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.720 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:15.720 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:15.720 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.720 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:15.721 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:15.721 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:15.721 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:15.721 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:15.721 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.721 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:15.721 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:15.721 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.721 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.721 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:15.721 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:15.721 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.722 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.722 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:15.722 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:15.722 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:15.722 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:15.722 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:15.722 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.722 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.722 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:15.722 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:15.722 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:15.723 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.723 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:15.723 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.723 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:15.723 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.723 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:15.723 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.723 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.lifecycle 2023-10-05T12:49:15.723 INFO:teuthology.orchestra.run.smithi012.stdout: def test_lifecycle_get(): 2023-10-05T12:49:15.723 INFO:teuthology.orchestra.run.smithi012.stdout:> bucket_name = get_new_bucket() 2023-10-05T12:49:15.723 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.723 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:7864: 2023-10-05T12:49:15.724 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.724 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-10-05T12:49:15.724 INFO:teuthology.orchestra.run.smithi012.stdout: client.create_bucket(Bucket=name) 2023-10-05T12:49:15.724 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:15.724 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:15.724 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:15.724 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:15.724 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:15.724 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:15.724 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:15.724 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:15.724 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:15.725 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:15.725 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:15.725 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:15.725 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:15.725 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:15.725 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:15.725 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:15.725 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:15.725 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:15.725 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:15.725 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:15.725 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:15.726 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:15.726 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:15.726 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:15.726 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:15.726 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:15.726 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:15.726 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:15.726 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:15.726 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:15.726 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:15.726 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:15.726 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:15.727 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:15.727 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.727 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.727 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.727 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:15.727 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.727 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:15.727 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.727 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:15.727 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:15.727 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:15.727 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:15.728 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:15.728 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:15.728 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:15.728 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:15.728 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:15.728 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:15.728 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:15.728 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:15.728 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:15.728 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.729 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:15.729 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:15.729 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:15.729 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:15.729 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:15.729 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:15.729 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:15.729 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:15.729 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:15.729 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:15.729 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:15.729 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.730 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.730 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:15.730 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:15.730 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:15.730 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:15.730 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:15.730 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.730 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.730 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:15.730 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:15.730 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:15.731 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:15.731 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:15.731 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.731 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:15.731 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:15.731 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:15.731 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:15.731 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:15.731 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-391" 2023-10-05T12:49:15.731 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.731 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:15.731 INFO:teuthology.orchestra.run.smithi012.stdout:___________________________ test_lifecycle_get_no_id ___________________________ 2023-10-05T12:49:15.732 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.732 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.732 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.732 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:15.732 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:15.732 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.732 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:15.732 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:15.732 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:15.732 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:15.732 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:15.732 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.733 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:15.733 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:15.733 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.733 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.733 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:15.733 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:15.733 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.733 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.733 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:15.733 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.733 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:15.734 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:15.734 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.734 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.734 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:15.734 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:15.734 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.734 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:15.734 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:15.734 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:15.734 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:15.734 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:15.735 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:15.735 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:15.735 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.735 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:15.735 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:15.735 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:15.735 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:15.735 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:15.735 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:15.735 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:15.735 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:15.735 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:15.736 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.736 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:15.736 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:15.736 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:15.736 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:15.736 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.736 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:15.736 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:15.736 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:15.736 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:15.736 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.736 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.737 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:15.737 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:15.737 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:15.737 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:15.737 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.737 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.737 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:15.737 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:15.737 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:15.737 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.738 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:15.738 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.738 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:15.738 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:15.738 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.738 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:15.738 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:15.738 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:15.738 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:15.738 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:15.738 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:15.739 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.739 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:15.739 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.739 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:15.739 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.739 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.739 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:15.739 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.739 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:15.739 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.739 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:15.740 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:15.740 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:15.740 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:15.740 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:15.740 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:15.740 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:15.740 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:15.740 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:15.740 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:15.740 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:15.740 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:15.741 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:15.741 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.741 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:15.741 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:15.741 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:15.741 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:15.741 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:15.741 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:15.741 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:15.741 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:15.741 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:15.741 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:15.742 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:15.742 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.742 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.742 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:15.742 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.742 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:15.742 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:15.742 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:15.742 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:15.742 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:15.742 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:15.742 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:15.743 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:15.743 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:15.743 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:15.743 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:15.743 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:15.743 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:15.743 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:15.743 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:15.743 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:15.743 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:15.743 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:15.743 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:15.744 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:15.744 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:15.744 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:15.744 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:15.744 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:15.744 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:15.744 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:15.744 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:15.744 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:15.744 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.744 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.745 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.745 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.745 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:15.745 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:15.745 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.745 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:15.745 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:15.745 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:15.745 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:15.745 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:15.745 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.745 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:15.746 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:15.746 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.746 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.746 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:15.746 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:15.746 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.746 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.746 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:15.746 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:15.746 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:15.746 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:15.746 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:15.747 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.747 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.747 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:15.747 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:15.747 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:15.747 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.747 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:15.747 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.747 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:15.747 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.747 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:15.747 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.748 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.lifecycle 2023-10-05T12:49:15.748 INFO:teuthology.orchestra.run.smithi012.stdout: def test_lifecycle_get_no_id(): 2023-10-05T12:49:15.748 INFO:teuthology.orchestra.run.smithi012.stdout:> bucket_name = get_new_bucket() 2023-10-05T12:49:15.748 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.748 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:7875: 2023-10-05T12:49:15.748 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.748 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-10-05T12:49:15.748 INFO:teuthology.orchestra.run.smithi012.stdout: client.create_bucket(Bucket=name) 2023-10-05T12:49:15.748 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:15.748 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:15.748 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:15.748 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:15.749 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:15.749 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:15.749 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:15.749 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:15.749 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:15.749 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:15.749 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:15.749 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:15.749 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:15.749 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:15.749 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:15.749 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:15.750 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:15.750 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:15.750 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:15.750 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:15.750 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:15.750 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:15.750 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:15.750 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:15.750 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:15.750 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:15.750 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:15.750 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:15.751 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:15.751 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:15.751 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:15.751 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:15.751 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:15.751 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:15.751 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.751 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.751 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.751 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:15.751 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.751 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:15.752 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.752 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:15.752 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:15.752 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:15.752 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:15.752 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:15.752 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:15.752 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:15.752 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:15.752 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:15.752 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:15.752 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:15.752 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:15.753 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:15.753 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.753 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:15.753 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:15.753 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:15.753 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:15.753 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:15.753 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:15.753 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:15.753 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:15.753 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:15.753 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:15.753 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:15.754 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.754 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.754 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:15.754 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:15.754 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:15.754 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:15.754 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:15.754 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.754 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.754 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:15.754 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:15.755 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:15.755 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:15.755 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:15.755 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.755 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:15.755 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:15.755 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:15.755 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:15.755 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:15.755 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-392" 2023-10-05T12:49:15.755 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.755 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:15.756 INFO:teuthology.orchestra.run.smithi012.stdout:__________________________ test_lifecycle_id_too_long __________________________ 2023-10-05T12:49:15.756 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.756 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.756 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.756 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:15.756 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:15.756 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.756 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:15.756 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:15.756 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:15.756 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:15.756 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:15.756 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.757 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:15.757 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:15.757 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.757 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.757 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:15.757 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:15.757 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.757 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.757 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:15.757 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.757 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:15.757 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:15.757 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.758 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.758 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:15.758 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:15.758 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.758 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:15.758 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:15.758 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:15.758 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:15.758 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:15.758 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:15.759 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:15.759 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.759 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:15.759 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:15.759 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:15.759 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:15.759 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:15.759 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:15.759 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:15.759 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:15.759 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:15.759 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.760 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:15.760 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:15.760 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:15.760 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:15.760 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.760 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:15.760 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:15.760 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:15.760 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:15.760 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.760 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.760 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:15.760 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:15.761 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:15.761 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:15.761 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.761 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.761 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:15.761 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:15.761 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:15.761 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.761 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:15.761 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.761 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:15.762 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:15.762 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.762 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:15.762 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:15.762 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:15.762 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:15.762 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:15.762 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:15.762 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.762 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:15.762 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.763 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:15.763 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.763 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.763 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:15.763 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.763 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:15.763 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.763 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:15.763 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:15.763 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:15.763 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:15.763 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:15.764 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:15.764 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:15.764 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:15.764 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:15.764 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:15.764 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:15.764 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:15.764 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:15.764 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.764 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:15.764 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:15.764 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:15.764 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:15.765 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:15.765 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:15.765 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:15.765 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:15.765 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:15.765 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:15.765 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:15.765 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.765 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.765 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:15.765 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.765 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:15.765 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:15.766 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:15.766 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:15.766 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:15.766 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:15.766 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:15.766 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:15.766 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:15.766 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:15.766 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:15.766 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:15.766 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:15.766 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:15.767 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:15.767 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:15.767 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:15.767 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:15.767 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:15.767 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:15.767 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:15.767 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:15.767 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:15.767 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:15.767 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:15.767 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:15.768 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:15.768 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:15.768 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.768 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.768 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.768 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.768 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:15.768 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:15.768 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.768 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:15.768 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:15.768 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:15.769 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:15.769 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:15.769 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.769 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:15.769 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:15.769 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.769 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.769 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:15.769 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:15.769 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.769 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.770 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:15.770 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:15.770 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:15.770 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:15.770 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:15.770 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.770 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.770 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:15.770 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:15.770 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:15.770 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.771 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:15.771 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.771 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:15.771 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.771 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:15.771 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.771 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.lifecycle 2023-10-05T12:49:15.771 INFO:teuthology.orchestra.run.smithi012.stdout: def test_lifecycle_id_too_long(): 2023-10-05T12:49:15.771 INFO:teuthology.orchestra.run.smithi012.stdout:> bucket_name = get_new_bucket() 2023-10-05T12:49:15.771 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.771 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:8223: 2023-10-05T12:49:15.771 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.771 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-10-05T12:49:15.772 INFO:teuthology.orchestra.run.smithi012.stdout: client.create_bucket(Bucket=name) 2023-10-05T12:49:15.772 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:15.772 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:15.772 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:15.772 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:15.772 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:15.772 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:15.772 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:15.772 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:15.772 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:15.772 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:15.772 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:15.772 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:15.773 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:15.773 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:15.773 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:15.773 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:15.773 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:15.773 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:15.773 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:15.773 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:15.773 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:15.773 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:15.773 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:15.773 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:15.774 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:15.774 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:15.774 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:15.774 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:15.774 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:15.774 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:15.774 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:15.774 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:15.774 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:15.774 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:15.774 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.775 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.775 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.775 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:15.775 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.775 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:15.775 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.775 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:15.775 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:15.775 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:15.775 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:15.775 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:15.775 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:15.775 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:15.776 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:15.776 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:15.776 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:15.776 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:15.776 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:15.776 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:15.776 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.776 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:15.776 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:15.776 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:15.776 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:15.777 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:15.777 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:15.777 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:15.777 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:15.777 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:15.777 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:15.777 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:15.777 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.777 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.777 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:15.777 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:15.777 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:15.778 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:15.778 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:15.778 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.778 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.778 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:15.778 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:15.778 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:15.778 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:15.778 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:15.778 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.778 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:15.779 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:15.779 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:15.779 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:15.779 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:15.779 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-393" 2023-10-05T12:49:15.779 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.779 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:15.779 INFO:teuthology.orchestra.run.smithi012.stdout:____________________________ test_lifecycle_same_id ____________________________ 2023-10-05T12:49:15.779 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.779 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.779 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.779 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:15.780 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:15.780 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.780 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:15.780 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:15.780 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:15.780 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:15.780 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:15.780 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.780 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:15.780 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:15.780 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.780 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.781 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:15.781 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:15.781 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.781 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.781 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:15.781 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.781 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:15.781 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:15.781 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.781 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.781 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:15.781 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:15.781 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.782 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:15.782 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:15.782 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:15.782 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:15.782 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:15.782 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:15.782 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:15.782 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.782 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:15.782 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:15.782 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:15.783 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:15.783 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:15.783 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:15.783 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:15.783 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:15.783 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:15.783 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.783 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:15.783 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:15.783 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:15.783 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:15.783 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.783 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:15.784 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:15.784 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:15.784 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:15.784 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.784 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.784 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:15.784 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:15.784 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:15.784 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:15.784 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.784 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.784 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:15.784 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:15.785 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:15.785 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.785 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:15.785 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.785 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:15.785 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:15.785 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.785 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:15.785 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:15.785 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:15.785 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:15.785 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:15.786 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:15.786 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.786 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:15.786 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.786 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:15.786 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.786 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.786 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:15.786 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.786 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:15.786 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.787 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:15.787 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:15.787 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:15.787 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:15.787 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:15.787 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:15.787 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:15.787 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:15.787 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:15.787 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:15.787 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:15.787 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:15.788 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:15.788 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.788 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:15.788 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:15.788 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:15.788 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:15.788 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:15.788 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:15.788 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:15.788 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:15.788 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:15.788 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:15.789 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:15.789 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.789 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.789 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:15.789 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.789 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:15.789 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:15.789 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:15.789 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:15.789 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:15.789 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:15.790 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:15.790 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:15.790 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:15.790 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:15.790 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:15.790 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:15.790 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:15.790 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:15.790 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:15.790 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:15.790 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:15.790 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:15.790 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:15.791 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:15.791 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:15.791 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:15.791 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:15.791 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:15.791 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:15.791 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:15.791 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:15.791 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:15.791 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.791 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.791 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.791 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.792 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:15.792 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:15.792 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.792 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:15.792 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:15.792 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:15.792 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:15.792 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:15.792 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.792 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:15.792 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:15.792 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.793 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.793 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:15.793 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:15.793 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.793 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.793 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:15.793 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:15.793 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:15.793 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:15.793 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:15.793 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.793 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.794 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:15.794 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:15.794 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:15.794 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.794 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:15.794 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.794 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:15.794 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.794 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:15.794 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.794 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.lifecycle 2023-10-05T12:49:15.794 INFO:teuthology.orchestra.run.smithi012.stdout: def test_lifecycle_same_id(): 2023-10-05T12:49:15.795 INFO:teuthology.orchestra.run.smithi012.stdout:> bucket_name = get_new_bucket() 2023-10-05T12:49:15.795 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.795 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:8235: 2023-10-05T12:49:15.795 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.795 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-10-05T12:49:15.795 INFO:teuthology.orchestra.run.smithi012.stdout: client.create_bucket(Bucket=name) 2023-10-05T12:49:15.795 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:15.795 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:15.795 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:15.795 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:15.795 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:15.795 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:15.795 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:15.796 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:15.796 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:15.796 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:15.796 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:15.796 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:15.796 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:15.796 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:15.796 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:15.796 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:15.796 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:15.796 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:15.796 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:15.797 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:15.797 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:15.797 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:15.797 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:15.797 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:15.797 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:15.797 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:15.797 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:15.797 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:15.797 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:15.797 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:15.798 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:15.798 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:15.798 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:15.798 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:15.798 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.798 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.798 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.798 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:15.798 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.798 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:15.798 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.798 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:15.799 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:15.799 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:15.799 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:15.799 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:15.799 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:15.799 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:15.799 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:15.799 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:15.799 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:15.799 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:15.799 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:15.799 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:15.800 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.800 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:15.800 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:15.800 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:15.800 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:15.800 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:15.800 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:15.800 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:15.800 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:15.800 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:15.800 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:15.800 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:15.801 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.801 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.801 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:15.801 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:15.801 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:15.801 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:15.801 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:15.801 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.802 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.802 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:15.802 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:15.802 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:15.802 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:15.802 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:15.802 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.802 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:15.802 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:15.802 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:15.802 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:15.803 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:15.803 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-394" 2023-10-05T12:49:15.803 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.803 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:15.803 INFO:teuthology.orchestra.run.smithi012.stdout:________________________ test_lifecycle_invalid_status _________________________ 2023-10-05T12:49:15.803 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.803 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.803 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.803 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:15.803 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:15.803 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.804 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:15.804 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:15.804 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:15.804 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:15.804 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:15.804 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.804 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:15.804 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:15.804 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.804 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.804 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:15.804 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:15.805 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.805 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.805 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:15.805 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.805 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:15.805 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:15.805 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.805 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.805 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:15.805 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:15.805 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.805 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:15.806 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:15.806 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:15.806 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:15.806 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:15.806 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:15.806 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:15.806 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.806 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:15.806 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:15.806 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:15.806 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:15.807 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:15.807 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:15.807 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:15.807 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:15.807 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:15.807 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.807 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:15.807 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:15.807 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:15.807 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:15.807 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.807 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:15.807 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:15.808 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:15.808 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:15.808 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.808 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.808 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:15.808 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:15.808 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:15.808 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:15.808 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.808 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.808 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:15.808 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:15.809 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:15.809 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.809 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:15.809 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.809 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:15.809 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:15.809 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.809 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:15.809 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:15.809 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:15.809 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:15.809 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:15.810 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:15.810 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.810 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:15.810 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.810 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:15.810 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.810 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.810 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:15.810 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.810 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:15.810 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.811 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:15.811 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:15.811 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:15.811 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:15.811 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:15.811 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:15.811 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:15.811 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:15.811 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:15.811 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:15.811 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:15.811 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:15.811 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:15.812 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.812 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:15.812 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:15.812 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:15.812 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:15.812 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:15.812 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:15.812 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:15.812 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:15.812 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:15.812 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:15.812 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:15.813 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.813 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.813 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:15.813 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.813 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:15.813 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:15.813 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:15.813 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:15.813 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:15.813 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:15.813 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:15.813 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:15.814 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:15.814 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:15.814 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:15.814 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:15.814 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:15.814 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:15.814 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:15.814 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:15.814 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:15.814 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:15.814 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:15.815 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:15.815 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:15.815 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:15.815 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:15.815 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:15.815 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:15.815 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:15.815 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:15.815 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:15.815 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.815 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.815 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.815 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.816 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:15.816 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:15.816 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.816 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:15.816 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:15.816 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:15.816 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:15.816 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:15.816 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.816 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:15.816 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:15.817 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.817 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.817 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:15.817 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:15.817 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.817 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.817 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:15.817 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:15.817 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:15.817 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:15.817 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:15.817 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.818 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.818 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:15.818 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:15.818 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:15.818 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.818 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:15.818 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.818 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:15.818 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.818 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:15.818 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.819 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.lifecycle 2023-10-05T12:49:15.819 INFO:teuthology.orchestra.run.smithi012.stdout: def test_lifecycle_invalid_status(): 2023-10-05T12:49:15.819 INFO:teuthology.orchestra.run.smithi012.stdout:> bucket_name = get_new_bucket() 2023-10-05T12:49:15.819 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.819 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:8248: 2023-10-05T12:49:15.819 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.819 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-10-05T12:49:15.819 INFO:teuthology.orchestra.run.smithi012.stdout: client.create_bucket(Bucket=name) 2023-10-05T12:49:15.819 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:15.819 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:15.819 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:15.820 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:15.820 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:15.820 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:15.820 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:15.820 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:15.820 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:15.820 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:15.820 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:15.820 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:15.820 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:15.820 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:15.820 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:15.820 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:15.821 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:15.821 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:15.821 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:15.821 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:15.821 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:15.821 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:15.821 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:15.821 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:15.821 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:15.821 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:15.821 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:15.821 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:15.822 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:15.822 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:15.822 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:15.822 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:15.822 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:15.822 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:15.822 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.822 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.822 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.822 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:15.822 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.822 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:15.823 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.823 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:15.823 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:15.823 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:15.823 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:15.823 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:15.823 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:15.823 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:15.823 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:15.823 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:15.823 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:15.823 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:15.823 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:15.824 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:15.824 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.824 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:15.824 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:15.824 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:15.824 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:15.824 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:15.824 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:15.824 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:15.824 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:15.824 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:15.824 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:15.825 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:15.825 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.825 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.825 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:15.825 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:15.825 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:15.825 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:15.825 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:15.825 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.825 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.825 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:15.825 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:15.825 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:15.826 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:15.826 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:15.826 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.826 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:15.826 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:15.826 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:15.826 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:15.826 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:15.826 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-395" 2023-10-05T12:49:15.826 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.826 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:15.826 INFO:teuthology.orchestra.run.smithi012.stdout:___________________________ test_lifecycle_set_date ____________________________ 2023-10-05T12:49:15.827 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.827 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.827 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.827 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:15.827 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:15.827 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.827 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:15.827 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:15.827 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:15.827 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:15.827 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:15.827 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.828 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:15.828 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:15.828 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.828 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.828 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:15.828 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:15.828 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.828 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.828 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:15.828 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.828 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:15.829 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:15.829 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.829 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.829 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:15.829 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:15.829 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.829 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:15.829 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:15.829 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:15.829 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:15.829 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:15.829 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:15.830 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:15.830 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.830 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:15.830 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:15.830 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:15.830 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:15.830 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:15.830 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:15.830 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:15.830 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:15.830 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:15.830 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.831 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:15.831 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:15.831 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:15.831 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:15.831 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.831 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:15.831 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:15.831 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:15.831 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:15.831 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.831 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.831 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:15.831 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:15.832 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:15.832 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:15.832 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.832 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.832 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:15.832 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:15.832 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:15.832 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.832 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:15.832 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.832 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:15.832 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:15.832 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.833 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:15.833 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:15.833 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:15.833 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:15.833 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:15.833 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:15.833 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.833 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:15.833 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.833 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:15.833 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.833 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.833 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:15.834 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.834 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:15.834 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.834 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:15.834 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:15.834 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:15.834 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:15.834 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:15.834 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:15.834 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:15.834 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:15.835 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:15.835 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:15.835 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:15.835 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:15.835 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:15.835 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.835 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:15.835 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:15.835 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:15.835 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:15.835 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:15.835 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:15.836 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:15.836 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:15.836 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:15.836 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:15.836 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:15.836 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.836 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.836 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:15.836 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.836 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:15.836 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:15.836 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:15.836 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:15.836 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:15.837 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:15.837 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:15.837 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:15.837 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:15.837 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:15.837 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:15.837 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:15.837 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:15.837 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:15.837 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:15.837 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:15.837 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:15.837 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:15.838 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:15.838 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:15.838 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:15.838 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:15.838 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:15.838 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:15.838 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:15.838 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:15.838 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:15.838 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:15.838 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.839 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.839 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.839 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.839 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:15.839 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:15.839 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.839 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:15.839 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:15.839 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:15.839 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:15.839 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:15.839 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.839 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:15.840 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:15.840 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.840 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.840 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:15.840 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:15.840 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.840 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.840 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:15.840 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:15.840 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:15.840 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:15.840 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:15.841 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.841 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.841 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:15.841 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:15.841 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:15.841 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.841 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:15.841 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.841 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:15.841 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.841 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:15.841 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.841 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.lifecycle 2023-10-05T12:49:15.842 INFO:teuthology.orchestra.run.smithi012.stdout: def test_lifecycle_set_date(): 2023-10-05T12:49:15.842 INFO:teuthology.orchestra.run.smithi012.stdout:> bucket_name = get_new_bucket() 2023-10-05T12:49:15.842 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.842 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:8276: 2023-10-05T12:49:15.842 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.842 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-10-05T12:49:15.842 INFO:teuthology.orchestra.run.smithi012.stdout: client.create_bucket(Bucket=name) 2023-10-05T12:49:15.842 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:15.842 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:15.842 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:15.842 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:15.843 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:15.843 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:15.843 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:15.843 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:15.843 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:15.843 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:15.843 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:15.843 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:15.843 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:15.843 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:15.843 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:15.843 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:15.843 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:15.844 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:15.844 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:15.844 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:15.844 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:15.844 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:15.844 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:15.844 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:15.844 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:15.844 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:15.844 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:15.844 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:15.845 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:15.845 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:15.845 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:15.845 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:15.845 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:15.845 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:15.845 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.845 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.845 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.845 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:15.845 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.846 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:15.846 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.846 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:15.846 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:15.846 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:15.846 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:15.846 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:15.846 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:15.846 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:15.846 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:15.846 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:15.846 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:15.847 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:15.847 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:15.847 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:15.847 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.847 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:15.847 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:15.847 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:15.847 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:15.847 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:15.847 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:15.847 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:15.847 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:15.848 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:15.848 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:15.848 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:15.848 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.848 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.848 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:15.848 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:15.848 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:15.848 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:15.848 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:15.848 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.849 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.849 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:15.849 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:15.849 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:15.849 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:15.849 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:15.849 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.849 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:15.849 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:15.849 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:15.849 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:15.849 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:15.849 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-396" 2023-10-05T12:49:15.850 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.850 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:15.850 INFO:teuthology.orchestra.run.smithi012.stdout:_______________________ test_lifecycle_set_invalid_date ________________________ 2023-10-05T12:49:15.850 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.850 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.850 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.850 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:15.850 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:15.850 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.850 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:15.850 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:15.851 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:15.851 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:15.851 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:15.851 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.851 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:15.851 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:15.851 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.851 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.851 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:15.851 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:15.851 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.852 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.852 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:15.852 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.852 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:15.852 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:15.852 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.852 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.852 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:15.852 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:15.852 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.852 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:15.853 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:15.853 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:15.853 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:15.853 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:15.853 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:15.853 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:15.853 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.853 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:15.853 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:15.853 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:15.853 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:15.853 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:15.854 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:15.854 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:15.854 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:15.854 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:15.854 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.854 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:15.854 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:15.854 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:15.854 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:15.854 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.854 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:15.854 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:15.855 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:15.855 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:15.855 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.855 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.855 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:15.855 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:15.855 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:15.855 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:15.855 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.855 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.855 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:15.856 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:15.856 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:15.856 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.856 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:15.856 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.856 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:15.856 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:15.856 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.856 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:15.856 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:15.856 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:15.857 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:15.857 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:15.857 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:15.857 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.857 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:15.857 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.857 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:15.857 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.857 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.857 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:15.857 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.857 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:15.858 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.858 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:15.858 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:15.858 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:15.858 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:15.858 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:15.858 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:15.858 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:15.858 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:15.858 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:15.858 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:15.858 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:15.859 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:15.859 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:15.859 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.859 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:15.859 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:15.859 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:15.859 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:15.859 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:15.859 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:15.859 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:15.859 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:15.860 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:15.860 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:15.860 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:15.860 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.860 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.860 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:15.860 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.860 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:15.860 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:15.860 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:15.860 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:15.860 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:15.860 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:15.861 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:15.861 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:15.861 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:15.861 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:15.861 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:15.861 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:15.861 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:15.861 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:15.861 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:15.861 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:15.861 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:15.861 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:15.862 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:15.862 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:15.862 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:15.862 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:15.862 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:15.862 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:15.862 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:15.862 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:15.862 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:15.862 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:15.862 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.863 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.863 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.863 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.863 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:15.863 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:15.863 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.863 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:15.863 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:15.863 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:15.863 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:15.863 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:15.863 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.863 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:15.864 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:15.864 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.864 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.864 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:15.864 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:15.864 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.864 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.864 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:15.864 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:15.864 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:15.864 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:15.864 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:15.865 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.865 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.865 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:15.865 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:15.865 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:15.865 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.865 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:15.865 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.865 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:15.865 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.865 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:15.865 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.865 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.lifecycle 2023-10-05T12:49:15.866 INFO:teuthology.orchestra.run.smithi012.stdout: def test_lifecycle_set_invalid_date(): 2023-10-05T12:49:15.866 INFO:teuthology.orchestra.run.smithi012.stdout:> bucket_name = get_new_bucket() 2023-10-05T12:49:15.866 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.866 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:8286: 2023-10-05T12:49:15.866 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.866 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-10-05T12:49:15.866 INFO:teuthology.orchestra.run.smithi012.stdout: client.create_bucket(Bucket=name) 2023-10-05T12:49:15.866 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:15.866 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:15.866 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:15.866 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:15.866 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:15.867 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:15.867 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:15.867 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:15.867 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:15.867 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:15.867 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:15.867 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:15.867 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:15.867 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:15.867 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:15.867 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:15.867 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:15.868 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:15.868 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:15.868 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:15.868 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:15.868 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:15.868 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:15.868 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:15.868 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:15.868 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:15.868 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:15.868 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:15.868 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:15.869 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:15.869 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:15.869 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:15.869 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:15.869 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:15.869 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.869 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.869 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.869 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:15.869 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.869 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:15.869 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.870 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:15.870 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:15.870 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:15.870 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:15.870 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:15.870 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:15.870 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:15.870 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:15.870 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:15.870 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:15.870 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:15.870 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:15.871 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:15.871 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.871 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:15.871 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:15.871 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:15.871 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:15.871 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:15.871 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:15.871 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:15.871 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:15.871 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:15.871 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:15.871 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:15.872 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.872 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.872 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:15.872 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:15.872 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:15.872 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:15.872 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:15.872 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.872 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.872 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:15.872 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:15.872 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:15.872 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:15.872 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:15.873 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.873 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:15.873 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:15.873 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:15.873 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:15.873 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:15.873 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-397" 2023-10-05T12:49:15.873 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.873 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:15.873 INFO:teuthology.orchestra.run.smithi012.stdout:________________________ test_lifecycle_set_noncurrent _________________________ 2023-10-05T12:49:15.874 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.874 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.874 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.874 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:15.874 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:15.874 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.874 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:15.874 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:15.874 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:15.874 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:15.874 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:15.875 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.875 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:15.875 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:15.875 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.875 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.875 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:15.875 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:15.875 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.875 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.875 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:15.875 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.875 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:15.875 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:15.876 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.876 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.876 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:15.876 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:15.876 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.876 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:15.876 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:15.876 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:15.876 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:15.876 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:15.876 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:15.876 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:15.876 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.877 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:15.877 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:15.877 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:15.877 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:15.877 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:15.877 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:15.877 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:15.877 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:15.877 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:15.877 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.877 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:15.877 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:15.877 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:15.878 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:15.878 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.878 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:15.878 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:15.878 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:15.878 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:15.878 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.878 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.878 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:15.878 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:15.878 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:15.879 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:15.879 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.879 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.879 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:15.879 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:15.879 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:15.879 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.879 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:15.879 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.879 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:15.879 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:15.879 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.880 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:15.880 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:15.880 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:15.880 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:15.880 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:15.880 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:15.880 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.880 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:15.880 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.880 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:15.880 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.880 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.881 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:15.881 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.881 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:15.881 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.881 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:15.881 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:15.881 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:15.881 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:15.881 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:15.881 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:15.881 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:15.881 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:15.881 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:15.882 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:15.882 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:15.882 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:15.882 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:15.882 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.882 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:15.882 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:15.882 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:15.882 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:15.882 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:15.882 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:15.882 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:15.883 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:15.883 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:15.883 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:15.883 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:15.883 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.883 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.883 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:15.883 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.883 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:15.883 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:15.883 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:15.883 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:15.884 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:15.884 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:15.884 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:15.884 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:15.884 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:15.884 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:15.884 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:15.884 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:15.884 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:15.884 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:15.884 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:15.884 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:15.885 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:15.885 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:15.885 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:15.885 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:15.885 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:15.885 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:15.885 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:15.885 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:15.885 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:15.885 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:15.885 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:15.885 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:15.885 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.886 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.886 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.886 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.886 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:15.886 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:15.886 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.886 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:15.886 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:15.886 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:15.886 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:15.886 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:15.887 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.887 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:15.887 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:15.887 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.887 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.887 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:15.887 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:15.887 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.887 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.887 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:15.887 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:15.887 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:15.888 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:15.888 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:15.888 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.888 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.888 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:15.888 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:15.888 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:15.888 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.888 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:15.888 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.888 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:15.888 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.889 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:15.889 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.889 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.lifecycle 2023-10-05T12:49:15.889 INFO:teuthology.orchestra.run.smithi012.stdout: def test_lifecycle_set_noncurrent(): 2023-10-05T12:49:15.889 INFO:teuthology.orchestra.run.smithi012.stdout:> bucket_name = _create_objects(keys=['past/foo', 'future/bar']) 2023-10-05T12:49:15.889 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.889 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:8503: 2023-10-05T12:49:15.889 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.889 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:116: in _create_objects 2023-10-05T12:49:15.889 INFO:teuthology.orchestra.run.smithi012.stdout: bucket = get_new_bucket_resource(name=bucket_name) 2023-10-05T12:49:15.889 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:581: in get_new_bucket_resource 2023-10-05T12:49:15.889 INFO:teuthology.orchestra.run.smithi012.stdout: bucket_location = bucket.create() 2023-10-05T12:49:15.890 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/boto3/resources/factory.py:580: in do_action 2023-10-05T12:49:15.890 INFO:teuthology.orchestra.run.smithi012.stdout: response = action(self, *args, **kwargs) 2023-10-05T12:49:15.890 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/boto3/resources/action.py:88: in __call__ 2023-10-05T12:49:15.890 INFO:teuthology.orchestra.run.smithi012.stdout: response = getattr(parent.meta.client, operation_name)(*args, **params) 2023-10-05T12:49:15.890 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:15.890 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:15.890 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:15.890 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:15.890 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:15.890 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:15.890 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:15.890 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:15.891 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:15.891 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:15.891 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:15.891 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:15.891 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:15.891 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:15.891 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:15.891 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:15.891 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:15.891 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:15.891 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:15.891 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:15.892 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:15.892 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:15.892 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:15.892 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:15.892 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:15.892 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:15.892 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:15.892 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:15.892 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:15.892 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:15.892 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:15.892 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:15.892 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:15.893 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:15.893 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.893 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.893 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.893 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:15.893 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.893 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:15.893 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.893 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:15.893 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:15.893 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:15.893 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:15.893 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:15.894 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:15.894 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:15.894 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:15.894 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:15.894 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:15.894 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:15.894 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:15.894 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:15.894 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.894 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:15.894 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:15.895 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:15.895 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:15.895 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:15.895 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:15.895 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:15.895 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:15.895 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:15.895 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:15.895 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:15.895 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.895 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.895 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:15.896 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:15.896 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:15.896 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:15.896 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:15.896 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.896 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.896 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:15.896 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:15.896 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:15.896 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:15.896 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:15.896 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.896 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:15.897 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:15.897 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:15.897 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:15.897 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:15.897 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-398" 2023-10-05T12:49:15.897 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.897 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:15.897 INFO:teuthology.orchestra.run.smithi012.stdout:_______________________ test_lifecycle_set_deletemarker ________________________ 2023-10-05T12:49:15.897 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.897 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.897 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.897 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:15.898 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:15.898 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.898 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:15.898 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:15.898 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:15.898 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:15.898 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:15.898 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.898 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:15.898 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:15.898 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.898 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.899 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:15.899 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:15.899 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.899 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.899 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:15.899 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.899 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:15.899 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:15.899 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.899 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.899 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:15.900 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:15.900 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.900 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:15.900 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:15.900 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:15.900 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:15.900 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:15.900 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:15.900 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:15.900 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.900 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:15.900 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:15.900 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:15.901 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:15.901 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:15.901 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:15.901 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:15.901 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:15.901 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:15.901 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.901 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:15.901 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:15.901 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:15.901 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:15.901 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.902 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:15.902 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:15.902 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:15.902 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:15.902 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.902 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.902 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:15.902 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:15.902 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:15.902 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:15.902 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.903 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.903 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:15.903 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:15.903 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:15.903 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.903 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:15.903 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.903 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:15.903 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:15.903 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.903 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:15.903 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:15.904 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:15.904 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:15.904 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:15.904 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:15.904 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.904 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:15.904 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.904 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:15.904 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.904 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.904 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:15.905 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.905 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:15.905 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.905 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:15.905 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:15.905 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:15.905 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:15.905 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:15.905 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:15.905 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:15.905 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:15.905 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:15.905 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:15.906 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:15.906 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:15.906 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:15.906 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.906 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:15.906 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:15.906 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:15.906 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:15.906 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:15.906 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:15.906 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:15.907 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:15.907 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:15.907 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:15.907 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:15.907 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.907 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.907 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:15.907 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.907 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:15.907 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:15.907 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:15.907 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:15.908 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:15.908 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:15.908 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:15.908 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:15.908 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:15.908 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:15.908 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:15.908 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:15.908 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:15.908 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:15.908 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:15.908 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:15.909 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:15.909 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:15.909 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:15.909 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:15.909 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:15.909 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:15.909 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:15.909 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:15.909 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:15.909 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:15.909 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:15.910 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:15.910 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.910 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.910 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.910 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.910 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:15.910 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:15.910 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.910 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:15.910 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:15.910 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:15.910 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:15.911 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:15.911 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.911 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:15.911 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:15.911 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.911 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.911 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:15.911 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:15.911 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.911 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.911 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:15.911 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:15.912 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:15.912 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:15.912 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:15.912 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.912 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.912 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:15.912 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:15.912 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:15.912 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.912 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:15.912 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.912 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:15.913 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.913 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:15.913 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.913 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.lifecycle 2023-10-05T12:49:15.913 INFO:teuthology.orchestra.run.smithi012.stdout: def test_lifecycle_set_deletemarker(): 2023-10-05T12:49:15.913 INFO:teuthology.orchestra.run.smithi012.stdout:> bucket_name = get_new_bucket() 2023-10-05T12:49:15.913 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.913 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:8542: 2023-10-05T12:49:15.913 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.913 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-10-05T12:49:15.913 INFO:teuthology.orchestra.run.smithi012.stdout: client.create_bucket(Bucket=name) 2023-10-05T12:49:15.914 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:15.914 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:15.914 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:15.914 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:15.914 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:15.914 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:15.914 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:15.914 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:15.914 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:15.914 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:15.914 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:15.914 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:15.915 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:15.915 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:15.915 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:15.915 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:15.915 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:15.915 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:15.915 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:15.915 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:15.915 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:15.915 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:15.915 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:15.915 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:15.916 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:15.916 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:15.916 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:15.916 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:15.916 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:15.916 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:15.916 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:15.916 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:15.916 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:15.916 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:15.916 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.916 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.917 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.917 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:15.917 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.917 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:15.917 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.917 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:15.917 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:15.917 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:15.917 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:15.917 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:15.917 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:15.918 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:15.918 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:15.918 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:15.918 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:15.918 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:15.918 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:15.918 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:15.918 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.918 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:15.918 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:15.918 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:15.919 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:15.919 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:15.919 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:15.919 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:15.919 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:15.919 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:15.919 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:15.919 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:15.919 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.919 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.919 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:15.919 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:15.919 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:15.920 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:15.920 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:15.920 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.920 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.920 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:15.920 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:15.920 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:15.920 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:15.920 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:15.920 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.920 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:15.920 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:15.921 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:15.921 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:15.921 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:15.921 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-399" 2023-10-05T12:49:15.921 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.921 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:15.921 INFO:teuthology.orchestra.run.smithi012.stdout:__________________________ test_lifecycle_set_filter ___________________________ 2023-10-05T12:49:15.921 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.921 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.921 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.921 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:15.921 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:15.921 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.922 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:15.922 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:15.922 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:15.922 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:15.922 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:15.922 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.922 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:15.922 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:15.922 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.922 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.922 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:15.923 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:15.923 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.923 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.923 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:15.923 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.923 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:15.923 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:15.923 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.923 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.923 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:15.923 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:15.923 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.923 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:15.924 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:15.924 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:15.924 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:15.924 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:15.924 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:15.924 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:15.924 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.924 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:15.924 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:15.924 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:15.924 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:15.924 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:15.925 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:15.925 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:15.925 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:15.925 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:15.925 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.925 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:15.925 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:15.925 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:15.925 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:15.925 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.925 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:15.925 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:15.925 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:15.925 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:15.926 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.926 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.926 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:15.926 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:15.926 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:15.926 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:15.926 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.926 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.926 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:15.926 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:15.926 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:15.926 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.927 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:15.927 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.927 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:15.927 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:15.927 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.927 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:15.927 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:15.927 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:15.927 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:15.927 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:15.927 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:15.927 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.927 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:15.928 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.928 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:15.928 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.928 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.928 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:15.928 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.928 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:15.928 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.928 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:15.928 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:15.928 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:15.928 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:15.929 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:15.929 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:15.929 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:15.929 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:15.929 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:15.929 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:15.929 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:15.929 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:15.929 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:15.929 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.929 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:15.929 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:15.929 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:15.930 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:15.930 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:15.930 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:15.930 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:15.930 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:15.930 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:15.930 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:15.930 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:15.930 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.930 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.930 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:15.931 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.931 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:15.931 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:15.931 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:15.931 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:15.931 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:15.931 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:15.931 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:15.931 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:15.931 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:15.931 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:15.931 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:15.931 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:15.932 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:15.932 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:15.932 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:15.932 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:15.932 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:15.932 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:15.932 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:15.932 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:15.932 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:15.932 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:15.932 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:15.932 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:15.932 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:15.933 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:15.933 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:15.933 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:15.933 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.933 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.933 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.933 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.933 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:15.933 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:15.933 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.933 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:15.933 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:15.934 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:15.934 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:15.934 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:15.934 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.934 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:15.934 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:15.934 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.934 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.934 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:15.934 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:15.934 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.934 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.935 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:15.935 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:15.935 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:15.935 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:15.935 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:15.935 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.935 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.935 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:15.935 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:15.935 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:15.935 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.935 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:15.936 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.936 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:15.936 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.936 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:15.936 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.936 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.lifecycle 2023-10-05T12:49:15.936 INFO:teuthology.orchestra.run.smithi012.stdout: def test_lifecycle_set_filter(): 2023-10-05T12:49:15.936 INFO:teuthology.orchestra.run.smithi012.stdout:> bucket_name = get_new_bucket() 2023-10-05T12:49:15.936 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.936 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:8551: 2023-10-05T12:49:15.936 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.936 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-10-05T12:49:15.936 INFO:teuthology.orchestra.run.smithi012.stdout: client.create_bucket(Bucket=name) 2023-10-05T12:49:15.937 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:15.937 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:15.937 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:15.937 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:15.937 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:15.937 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:15.937 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:15.937 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:15.937 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:15.937 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:15.937 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:15.937 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:15.937 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:15.938 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:15.938 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:15.938 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:15.938 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:15.938 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:15.938 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:15.938 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:15.938 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:15.938 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:15.938 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:15.938 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:15.939 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:15.939 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:15.939 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:15.939 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:15.939 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:15.939 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:15.939 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:15.939 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:15.939 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:15.939 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:15.939 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.939 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.940 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.940 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:15.940 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.940 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:15.940 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.940 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:15.940 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:15.940 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:15.940 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:15.940 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:15.940 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:15.940 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:15.941 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:15.941 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:15.941 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:15.941 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:15.941 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:15.941 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:15.941 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.941 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:15.941 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:15.941 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:15.941 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:15.942 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:15.942 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:15.942 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:15.942 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:15.942 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:15.942 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:15.942 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:15.942 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.942 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.942 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:15.942 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:15.943 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:15.943 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:15.943 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:15.943 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.943 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.943 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:15.943 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:15.943 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:15.943 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:15.943 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:15.943 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.943 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:15.944 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:15.944 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:15.944 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:15.944 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:15.944 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-400" 2023-10-05T12:49:15.944 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.944 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:15.944 INFO:teuthology.orchestra.run.smithi012.stdout:_______________________ test_lifecycle_set_empty_filter ________________________ 2023-10-05T12:49:15.944 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.944 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.944 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.945 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:15.945 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:15.945 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.945 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:15.945 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:15.945 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:15.945 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:15.945 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:15.945 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.945 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:15.945 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:15.945 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.946 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.946 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:15.946 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:15.946 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.946 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.946 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:15.946 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.946 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:15.946 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:15.946 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.946 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.946 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:15.947 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:15.947 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.947 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:15.947 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:15.947 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:15.947 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:15.947 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:15.947 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:15.947 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:15.947 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.947 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:15.948 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:15.948 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:15.948 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:15.948 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:15.948 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:15.948 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:15.948 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:15.948 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:15.948 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.948 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:15.948 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:15.948 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:15.949 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:15.949 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.949 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:15.949 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:15.949 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:15.949 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:15.949 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.949 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.949 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:15.949 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:15.949 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:15.949 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:15.950 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.950 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.950 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:15.950 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:15.950 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:15.950 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.950 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:15.950 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.950 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:15.950 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:15.950 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.951 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:15.951 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:15.951 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:15.951 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:15.951 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:15.951 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:15.951 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.951 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:15.951 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.951 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:15.951 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.951 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.952 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:15.952 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.952 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:15.952 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.952 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:15.952 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:15.952 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:15.952 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:15.952 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:15.952 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:15.952 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:15.953 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:15.953 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:15.953 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:15.953 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:15.953 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:15.953 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:15.953 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.953 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:15.953 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:15.953 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:15.953 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:15.953 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:15.953 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:15.954 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:15.954 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:15.954 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:15.954 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:15.954 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:15.954 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.954 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.954 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:15.954 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.954 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:15.954 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:15.955 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:15.955 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:15.955 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:15.955 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:15.955 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:15.955 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:15.955 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:15.955 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:15.955 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:15.955 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:15.955 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:15.955 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:15.955 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:15.956 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:15.956 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:15.956 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:15.956 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:15.956 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:15.956 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:15.956 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:15.956 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:15.956 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:15.956 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:15.956 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:15.956 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:15.957 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:15.957 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.957 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.957 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.957 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.957 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:15.957 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:15.957 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.957 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:15.957 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:15.957 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:15.957 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:15.957 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:15.958 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.958 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:15.958 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:15.958 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.958 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.958 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:15.958 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:15.958 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.958 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.958 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:15.958 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:15.958 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:15.959 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:15.959 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:15.959 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.959 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.959 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:15.959 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:15.959 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:15.959 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.959 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:15.959 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.959 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:15.960 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.960 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:15.960 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.960 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.lifecycle 2023-10-05T12:49:15.960 INFO:teuthology.orchestra.run.smithi012.stdout: def test_lifecycle_set_empty_filter(): 2023-10-05T12:49:15.960 INFO:teuthology.orchestra.run.smithi012.stdout:> bucket_name = get_new_bucket() 2023-10-05T12:49:15.960 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.960 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:8560: 2023-10-05T12:49:15.960 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.960 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-10-05T12:49:15.960 INFO:teuthology.orchestra.run.smithi012.stdout: client.create_bucket(Bucket=name) 2023-10-05T12:49:15.960 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:15.961 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:15.961 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:15.961 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:15.961 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:15.961 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:15.961 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:15.961 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:15.961 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:15.961 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:15.961 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:15.961 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:15.961 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:15.961 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:15.962 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:15.962 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:15.962 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:15.962 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:15.962 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:15.962 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:15.962 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:15.962 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:15.962 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:15.962 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:15.962 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:15.963 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:15.963 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:15.963 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:15.963 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:15.963 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:15.963 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:15.963 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:15.963 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:15.963 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:15.963 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.963 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.963 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.964 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:15.964 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.964 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:15.964 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.964 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:15.964 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:15.964 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:15.964 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:15.964 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:15.964 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:15.964 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:15.964 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:15.964 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:15.965 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:15.965 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:15.965 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:15.965 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:15.965 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.965 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:15.965 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:15.965 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:15.965 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:15.965 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:15.965 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:15.965 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:15.966 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:15.966 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:15.966 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:15.966 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:15.966 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.966 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.966 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:15.966 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:15.966 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:15.966 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:15.966 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:15.966 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.967 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.967 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:15.967 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:15.967 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:15.967 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:15.967 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:15.967 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.967 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:15.967 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:15.967 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:15.967 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:15.968 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:15.968 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-401" 2023-10-05T12:49:15.968 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.968 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:15.968 INFO:teuthology.orchestra.run.smithi012.stdout:_________________________ test_lifecycle_set_multipart _________________________ 2023-10-05T12:49:15.968 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.968 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.968 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.968 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:15.968 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:15.968 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.968 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:15.969 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:15.969 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:15.969 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:15.969 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:15.969 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.969 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:15.969 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:15.969 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.969 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.969 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:15.969 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:15.969 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.970 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.970 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:15.970 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.970 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:15.970 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:15.970 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.970 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.970 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:15.970 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:15.970 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.970 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:15.971 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:15.971 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:15.971 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:15.971 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:15.971 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:15.971 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:15.971 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.971 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:15.971 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:15.971 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:15.971 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:15.971 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:15.972 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:15.972 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:15.972 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:15.972 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:15.972 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.972 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:15.972 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:15.972 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:15.972 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:15.972 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.972 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:15.972 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:15.972 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:15.973 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:15.973 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.973 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.973 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:15.973 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:15.973 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:15.973 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:15.973 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.973 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.973 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:15.973 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:15.973 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:15.973 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.973 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:15.974 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.974 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:15.974 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:15.974 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.974 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:15.974 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:15.974 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:15.974 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:15.974 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:15.974 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:15.974 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.975 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:15.975 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.975 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:15.975 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.975 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.975 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:15.975 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.975 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:15.975 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.975 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:15.975 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:15.975 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:15.975 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:15.976 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:15.976 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:15.976 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:15.976 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:15.976 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:15.976 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:15.976 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:15.976 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:15.976 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:15.976 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.976 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:15.976 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:15.976 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:15.977 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:15.977 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:15.977 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:15.977 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:15.977 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:15.977 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:15.977 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:15.977 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:15.977 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.977 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.977 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:15.977 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.977 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:15.978 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:15.978 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:15.978 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:15.978 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:15.978 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:15.978 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:15.978 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:15.978 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:15.978 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:15.978 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:15.978 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:15.978 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:15.979 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:15.979 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:15.979 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:15.979 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:15.979 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:15.979 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:15.979 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:15.979 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:15.979 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:15.979 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:15.979 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:15.979 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:15.979 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:15.980 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:15.980 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:15.980 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.980 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.980 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.980 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.980 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:15.980 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:15.980 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.980 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:15.980 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:15.980 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:15.980 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:15.981 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:15.981 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.981 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:15.981 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:15.981 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.981 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.981 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:15.981 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:15.981 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.981 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.981 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:15.981 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:15.982 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:15.982 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:15.982 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:15.982 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.982 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.982 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:15.982 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:15.982 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:15.982 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.982 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:15.982 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.982 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:15.983 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.983 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:15.983 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.983 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.lifecycle 2023-10-05T12:49:15.983 INFO:teuthology.orchestra.run.smithi012.stdout: def test_lifecycle_set_multipart(): 2023-10-05T12:49:15.983 INFO:teuthology.orchestra.run.smithi012.stdout:> bucket_name = get_new_bucket() 2023-10-05T12:49:15.983 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.983 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:8604: 2023-10-05T12:49:15.983 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.983 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-10-05T12:49:15.983 INFO:teuthology.orchestra.run.smithi012.stdout: client.create_bucket(Bucket=name) 2023-10-05T12:49:15.983 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:15.983 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:15.984 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:15.984 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:15.984 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:15.984 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:15.984 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:15.984 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:15.984 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:15.984 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:15.984 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:15.984 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:15.984 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:15.984 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:15.984 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:15.985 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:15.985 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:15.985 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:15.985 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:15.985 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:15.985 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:15.985 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:15.985 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:15.985 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:15.985 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:15.985 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:15.985 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:15.985 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:15.986 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:15.986 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:15.986 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:15.986 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:15.986 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:15.986 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:15.986 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.986 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.986 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.986 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:15.986 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.986 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:15.986 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.987 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:15.987 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:15.987 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:15.987 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:15.987 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:15.987 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:15.987 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:15.987 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:15.987 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:15.987 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:15.987 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:15.988 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:15.988 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:15.988 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.988 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:15.988 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:15.988 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:15.988 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:15.988 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:15.988 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:15.988 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:15.988 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:15.989 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:15.989 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:15.989 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:15.989 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.989 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.989 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:15.989 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:15.989 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:15.989 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:15.989 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:15.989 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.989 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.990 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:15.990 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:15.990 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:15.990 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:15.990 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:15.990 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.990 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:15.990 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:15.990 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:15.990 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:15.990 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:15.991 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-402" 2023-10-05T12:49:15.991 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.991 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:15.991 INFO:teuthology.orchestra.run.smithi012.stdout:__________________ test_lifecycle_transition_set_invalid_date __________________ 2023-10-05T12:49:15.991 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.991 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.991 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.991 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:15.991 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:15.991 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.991 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:15.992 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:15.992 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:15.992 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:15.992 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:15.992 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.992 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:15.992 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:15.992 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.992 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.992 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:15.992 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:15.993 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.993 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.993 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:15.993 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.993 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:15.993 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:15.993 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:15.993 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.993 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:15.993 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:15.993 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.993 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:15.994 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:15.994 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:15.994 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:15.994 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:15.994 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:15.994 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:15.994 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.994 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:15.994 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:15.994 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:15.994 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:15.994 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:15.995 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:15.995 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:15.995 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:15.995 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:15.995 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.995 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:15.995 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:15.995 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:15.995 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:15.995 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.995 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:15.995 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:15.996 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:15.996 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:15.996 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.996 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.996 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:15.996 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:15.996 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:15.996 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:15.996 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:15.996 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.996 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:15.996 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:15.997 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:15.997 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.997 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:15.997 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.997 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:15.997 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:15.997 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.997 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:15.997 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:15.997 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:15.997 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:15.998 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:15.998 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:15.998 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.998 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:15.998 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.998 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:15.998 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.998 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:15.998 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:15.998 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:15.998 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:15.998 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:15.999 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:15.999 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:15.999 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:15.999 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:15.999 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:15.999 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:15.999 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:15.999 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:15.999 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:15.999 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:15.999 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:15.999 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:16.000 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:16.000 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.000 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:16.000 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:16.000 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:16.000 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:16.000 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:16.000 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:16.000 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:16.000 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:16.000 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:16.001 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:16.001 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:16.001 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:16.001 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.001 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:16.001 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:16.001 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:16.001 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:16.001 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:16.001 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:16.001 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:16.002 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:16.002 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:16.002 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:16.002 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:16.002 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:16.002 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:16.002 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:16.002 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:16.002 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:16.002 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:16.003 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:16.003 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:16.003 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:16.003 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:16.003 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:16.003 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:16.003 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:16.003 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:16.003 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:16.003 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:16.003 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:16.003 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:16.003 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:16.004 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:16.004 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.004 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:16.004 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.004 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:16.004 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:16.004 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.004 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:16.004 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:16.004 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:16.004 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:16.004 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:16.005 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.005 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:16.005 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:16.005 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.005 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:16.005 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:16.005 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:16.005 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:16.005 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.005 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:16.005 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:16.006 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:16.006 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:16.006 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:16.006 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:16.006 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.006 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:16.006 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:16.006 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:16.006 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:16.006 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:16.006 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.006 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:16.007 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.007 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:16.007 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.007 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.lifecycle 2023-10-05T12:49:16.007 INFO:teuthology.orchestra.run.smithi012.stdout: def test_lifecycle_transition_set_invalid_date(): 2023-10-05T12:49:16.007 INFO:teuthology.orchestra.run.smithi012.stdout:> bucket_name = get_new_bucket() 2023-10-05T12:49:16.007 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.007 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:8653: 2023-10-05T12:49:16.007 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:16.007 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-10-05T12:49:16.007 INFO:teuthology.orchestra.run.smithi012.stdout: client.create_bucket(Bucket=name) 2023-10-05T12:49:16.007 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:16.007 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:16.008 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:16.008 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:16.008 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:16.008 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:16.008 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:16.008 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:16.008 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:16.008 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:16.008 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:16.008 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:16.008 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:16.009 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:16.009 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:16.009 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:16.009 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:16.009 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:16.009 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:16.009 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:16.009 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:16.009 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:16.009 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:16.009 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:16.009 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:16.009 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:16.010 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:16.010 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:16.010 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:16.010 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:16.010 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:16.010 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:16.010 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:16.010 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:16.010 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:16.010 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.010 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:16.011 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:16.011 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.011 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:16.011 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:16.011 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:16.011 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:16.011 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:16.011 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:16.011 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:16.011 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:16.012 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:16.012 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:16.012 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:16.012 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:16.012 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:16.012 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:16.012 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:16.012 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.012 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:16.012 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:16.012 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:16.012 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:16.013 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:16.013 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:16.013 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:16.013 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:16.013 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:16.013 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:16.013 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:16.013 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:16.013 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.013 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:16.013 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:16.013 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:16.014 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:16.014 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:16.014 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:16.014 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.014 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:16.014 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:16.014 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:16.014 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:16.014 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:16.014 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.014 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:16.015 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:16.015 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:16.015 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:16.015 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:16.015 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-403" 2023-10-05T12:49:16.015 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.015 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:16.015 INFO:teuthology.orchestra.run.smithi012.stdout:__________________________ test_encrypted_transfer_1b __________________________ 2023-10-05T12:49:16.015 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.015 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:16.015 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.015 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:16.016 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:16.016 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.016 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:16.016 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:16.016 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:16.016 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:16.016 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:16.016 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.016 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:16.016 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:16.016 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.017 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:16.017 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:16.017 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:16.017 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:16.017 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.017 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:16.017 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:16.017 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:16.017 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:16.017 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:16.017 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.017 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:16.018 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:16.018 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.018 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:16.018 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:16.018 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:16.018 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:16.018 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:16.018 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:16.018 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:16.581 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.581 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:16.581 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:16.581 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:16.582 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:16.582 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:16.582 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:16.582 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:16.582 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:16.582 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:16.582 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.582 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:16.582 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:16.582 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:16.582 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:16.583 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.583 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:16.583 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:16.583 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:16.583 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:16.583 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.583 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:16.583 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:16.583 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:16.583 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:16.583 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:16.584 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:16.584 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.584 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:16.584 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:16.584 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:16.584 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:16.584 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:16.584 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.584 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:16.584 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:16.584 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.584 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:16.585 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:16.585 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:16.585 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:16.585 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:16.585 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:16.585 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.585 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:16.585 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.585 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:16.585 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.585 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:16.585 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:16.586 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.586 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:16.586 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:16.586 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:16.586 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:16.586 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:16.586 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:16.586 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:16.586 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:16.586 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:16.586 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:16.586 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:16.587 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:16.587 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:16.587 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:16.587 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:16.587 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.587 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:16.587 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:16.587 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:16.587 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:16.587 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:16.587 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:16.587 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:16.588 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:16.588 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:16.588 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:16.588 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:16.588 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:16.588 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.588 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:16.588 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:16.588 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:16.588 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:16.588 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:16.588 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:16.589 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:16.589 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:16.589 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:16.589 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:16.589 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:16.589 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:16.589 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:16.589 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:16.589 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:16.589 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:16.589 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:16.589 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:16.590 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:16.590 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:16.590 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:16.590 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:16.590 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:16.590 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:16.590 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:16.590 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:16.590 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:16.590 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:16.590 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:16.590 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:16.591 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:16.591 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.591 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:16.591 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.591 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:16.591 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:16.591 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.591 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:16.591 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:16.591 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:16.591 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:16.591 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:16.592 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.592 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:16.592 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:16.592 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.592 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:16.592 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:16.592 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:16.592 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:16.592 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.592 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:16.592 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:16.592 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:16.592 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:16.593 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:16.593 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:16.593 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.593 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:16.593 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:16.593 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:16.593 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:16.593 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:16.593 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.593 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:16.593 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.593 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:16.594 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.594 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.encryption 2023-10-05T12:49:16.594 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.fails_on_dbstore 2023-10-05T12:49:16.594 INFO:teuthology.orchestra.run.smithi012.stdout: def test_encrypted_transfer_1b(): 2023-10-05T12:49:16.594 INFO:teuthology.orchestra.run.smithi012.stdout:> _test_encryption_sse_customer_write(1) 2023-10-05T12:49:16.594 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.594 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:9227: 2023-10-05T12:49:16.594 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:16.594 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:8667: in _test_encryption_sse_customer_write 2023-10-05T12:49:16.594 INFO:teuthology.orchestra.run.smithi012.stdout: bucket_name = get_new_bucket() 2023-10-05T12:49:16.594 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-10-05T12:49:16.594 INFO:teuthology.orchestra.run.smithi012.stdout: client.create_bucket(Bucket=name) 2023-10-05T12:49:16.595 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:16.595 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:16.595 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:16.595 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:16.595 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:16.595 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:16.595 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:16.595 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:16.595 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:16.595 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:16.596 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:16.596 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:16.596 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:16.596 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:16.596 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:16.596 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:16.596 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:16.596 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:16.596 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:16.596 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:16.596 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:16.596 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:16.597 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:16.597 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:16.597 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:16.597 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:16.597 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:16.597 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:16.597 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:16.597 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:16.597 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:16.597 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:16.597 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:16.597 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:16.598 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:16.598 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.598 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:16.598 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:16.598 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.598 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:16.598 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:16.598 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:16.598 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:16.598 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:16.598 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:16.598 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:16.599 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:16.599 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:16.599 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:16.599 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:16.599 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:16.599 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:16.599 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:16.599 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:16.599 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.599 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:16.599 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:16.599 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:16.600 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:16.600 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:16.600 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:16.600 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:16.600 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:16.600 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:16.600 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:16.600 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:16.600 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:16.600 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.600 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:16.600 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:16.601 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:16.601 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:16.601 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:16.601 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:16.601 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.601 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:16.601 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:16.601 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:16.601 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:16.601 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:16.601 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.601 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:16.601 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:16.602 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:16.602 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:16.602 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:16.602 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-404" 2023-10-05T12:49:16.602 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.602 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:16.602 INFO:teuthology.orchestra.run.smithi012.stdout:_________________________ test_encrypted_transfer_1kb __________________________ 2023-10-05T12:49:16.602 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.602 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:16.602 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.602 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:16.603 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:16.603 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.603 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:16.603 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:16.603 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:16.603 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:16.603 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:16.603 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.603 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:16.603 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:16.603 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.603 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:16.604 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:16.604 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:16.604 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:16.604 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.604 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:16.604 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:16.604 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:16.604 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:16.604 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:16.604 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.604 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:16.604 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:16.605 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.605 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:16.605 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:16.605 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:16.605 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:16.605 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:16.605 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:16.605 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:16.605 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.605 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:16.605 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:16.605 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:16.606 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:16.606 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:16.606 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:16.606 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:16.606 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:16.606 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:16.606 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.606 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:16.606 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:16.606 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:16.606 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:16.606 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.607 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:16.607 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:16.607 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:16.607 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:16.607 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.607 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:16.607 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:16.607 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:16.607 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:16.607 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:16.607 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:16.607 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.608 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:16.608 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:16.608 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:16.608 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:16.608 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:16.608 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.608 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:16.608 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:16.608 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.608 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:16.608 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:16.608 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:16.609 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:16.609 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:16.609 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:16.609 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.609 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:16.609 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.609 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:16.609 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.609 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:16.609 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:16.610 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.610 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:16.610 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:16.610 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:16.610 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:16.610 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:16.610 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:16.610 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:16.610 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:16.610 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:16.610 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:16.610 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:16.611 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:16.611 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:16.611 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:16.611 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:16.611 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.611 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:16.611 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:16.611 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:16.611 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:16.611 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:16.611 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:16.611 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:16.612 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:16.612 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:16.612 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:16.612 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:16.612 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:16.612 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.612 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:16.612 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:16.612 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:16.612 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:16.612 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:16.612 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:16.613 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:16.613 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:16.613 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:16.613 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:16.613 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:16.613 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:16.613 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:16.613 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:16.613 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:16.613 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:16.613 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:16.613 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:16.613 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:16.614 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:16.614 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:16.614 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:16.614 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:16.614 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:16.614 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:16.614 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:16.614 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:16.614 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:16.614 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:16.614 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:16.615 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:16.615 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.615 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:16.615 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.615 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:16.615 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:16.615 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.615 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:16.615 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:16.615 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:16.615 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:16.615 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:16.616 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.616 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:16.616 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:16.616 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.616 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:16.616 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:16.616 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:16.616 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:16.616 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.616 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:16.616 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:16.616 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:16.617 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:16.617 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:16.617 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:16.617 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.617 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:16.617 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:16.617 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:16.617 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:16.617 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:16.617 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.617 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:16.617 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.618 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:16.618 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.618 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.encryption 2023-10-05T12:49:16.618 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.fails_on_dbstore 2023-10-05T12:49:16.618 INFO:teuthology.orchestra.run.smithi012.stdout: def test_encrypted_transfer_1kb(): 2023-10-05T12:49:16.618 INFO:teuthology.orchestra.run.smithi012.stdout:> _test_encryption_sse_customer_write(1024) 2023-10-05T12:49:16.618 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.618 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:9233: 2023-10-05T12:49:16.618 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:16.618 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:8667: in _test_encryption_sse_customer_write 2023-10-05T12:49:16.618 INFO:teuthology.orchestra.run.smithi012.stdout: bucket_name = get_new_bucket() 2023-10-05T12:49:16.618 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-10-05T12:49:16.619 INFO:teuthology.orchestra.run.smithi012.stdout: client.create_bucket(Bucket=name) 2023-10-05T12:49:16.619 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:16.619 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:16.619 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:16.619 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:16.619 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:16.619 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:16.619 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:16.619 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:16.619 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:16.619 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:16.619 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:16.620 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:16.620 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:16.620 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:16.620 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:16.620 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:16.620 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:16.620 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:16.620 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:16.620 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:16.620 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:16.620 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:16.620 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:16.621 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:16.621 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:16.621 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:16.621 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:16.621 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:16.621 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:16.621 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:16.621 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:16.621 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:16.621 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:16.621 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:16.621 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:16.622 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.622 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:16.622 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:16.622 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.622 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:16.622 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:16.622 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:16.622 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:16.622 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:16.622 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:16.622 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:16.622 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:16.623 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:16.623 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:16.623 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:16.623 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:16.623 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:16.623 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:16.623 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:16.623 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.623 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:16.623 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:16.623 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:16.624 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:16.624 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:16.624 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:16.624 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:16.624 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:16.624 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:16.659 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:16.659 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:16.660 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:16.660 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.660 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:16.660 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:16.660 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:16.660 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:16.660 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:16.660 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:16.660 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.660 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:16.660 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:16.660 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:16.661 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:16.661 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:16.661 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.661 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:16.661 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:16.661 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:16.661 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:16.661 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:16.661 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-405" 2023-10-05T12:49:16.661 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.661 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:16.662 INFO:teuthology.orchestra.run.smithi012.stdout:_________________________ test_encrypted_transfer_1MB __________________________ 2023-10-05T12:49:16.662 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.662 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:16.662 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.662 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:16.662 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:16.662 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.662 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:16.662 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:16.662 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:16.662 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:16.663 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:16.663 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.663 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:16.663 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:16.663 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.663 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:16.663 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:16.663 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:16.663 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:16.663 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.663 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:16.663 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:16.664 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:16.664 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:16.664 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:16.664 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.664 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:16.664 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:16.664 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.664 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:16.664 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:16.664 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:16.664 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:16.665 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:16.665 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:16.665 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:16.665 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.665 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:16.665 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:16.665 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:16.665 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:16.665 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:16.665 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:16.665 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:16.666 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:16.666 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:16.666 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.666 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:16.666 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:16.666 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:16.666 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:16.666 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.666 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:16.666 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:16.666 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:16.666 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:16.667 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.667 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:16.667 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:16.667 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:16.667 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:16.667 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:16.667 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:16.667 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.667 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:16.667 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:16.667 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:16.667 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:16.668 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:16.668 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.668 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:16.668 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:16.668 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.668 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:16.668 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:16.668 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:16.668 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:16.668 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:16.668 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:16.669 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.669 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:16.669 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.669 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:16.669 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.669 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:16.669 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:16.669 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.669 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:16.669 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:16.669 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:16.669 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:16.670 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:16.670 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:16.670 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:16.670 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:16.670 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:16.670 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:16.670 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:16.670 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:16.670 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:16.670 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:16.670 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:16.670 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.671 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:16.671 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:16.671 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:16.671 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:16.671 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:16.671 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:16.671 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:16.671 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:16.671 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:16.671 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:16.671 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:16.671 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:16.672 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.672 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:16.672 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:16.672 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:16.672 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:16.672 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:16.672 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:16.672 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:16.672 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:16.672 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:16.672 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:16.672 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:16.673 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:16.673 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:16.673 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:16.673 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:16.673 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:16.673 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:16.673 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:16.673 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:16.673 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:16.673 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:16.673 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:16.674 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:16.674 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:16.674 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:16.674 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:16.674 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:16.674 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:16.674 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:16.674 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:16.674 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:16.674 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.674 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:16.675 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.675 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:16.675 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:16.675 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.675 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:16.675 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:16.675 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:16.675 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:16.675 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:16.675 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.675 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:16.675 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:16.676 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.676 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:16.676 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:16.676 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:16.676 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:16.676 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.676 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:16.676 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:16.676 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:16.676 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:16.676 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:16.676 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:16.677 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.677 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:16.677 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:16.677 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:16.677 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:16.677 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:16.677 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.677 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:16.677 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.677 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:16.677 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.677 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.encryption 2023-10-05T12:49:16.678 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.fails_on_dbstore 2023-10-05T12:49:16.678 INFO:teuthology.orchestra.run.smithi012.stdout: def test_encrypted_transfer_1MB(): 2023-10-05T12:49:16.678 INFO:teuthology.orchestra.run.smithi012.stdout:> _test_encryption_sse_customer_write(1024*1024) 2023-10-05T12:49:16.678 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.678 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:9239: 2023-10-05T12:49:16.678 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:16.678 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:8667: in _test_encryption_sse_customer_write 2023-10-05T12:49:16.678 INFO:teuthology.orchestra.run.smithi012.stdout: bucket_name = get_new_bucket() 2023-10-05T12:49:16.678 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-10-05T12:49:16.678 INFO:teuthology.orchestra.run.smithi012.stdout: client.create_bucket(Bucket=name) 2023-10-05T12:49:16.678 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:16.678 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:16.679 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:16.679 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:16.679 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:16.679 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:16.679 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:16.679 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:16.679 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:16.679 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:16.679 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:16.679 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:16.679 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:16.679 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:16.680 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:16.680 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:16.680 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:16.680 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:16.680 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:16.680 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:16.680 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:16.680 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:16.680 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:16.680 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:16.680 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:16.681 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:16.681 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:16.681 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:16.681 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:16.681 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:16.681 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:16.681 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:16.681 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:16.681 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:16.681 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:16.681 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.681 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:16.682 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:16.682 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.682 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:16.682 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:16.682 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:16.682 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:16.682 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:16.682 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:16.682 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:16.682 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:16.682 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:16.683 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:16.683 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:16.683 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:16.683 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:16.683 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:16.688 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:16.688 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.688 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:16.688 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:16.688 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:16.688 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:16.688 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:16.688 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:16.689 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:16.689 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:16.689 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:16.689 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:16.689 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:16.689 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:16.689 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.689 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:16.689 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:16.689 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:16.689 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:16.689 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:16.690 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:16.690 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.690 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:16.690 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:16.690 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:16.690 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:16.690 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:16.690 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.690 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:16.690 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:16.690 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:16.691 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:16.691 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:16.691 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-406" 2023-10-05T12:49:16.691 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.691 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:16.691 INFO:teuthology.orchestra.run.smithi012.stdout:_________________________ test_encrypted_transfer_13b __________________________ 2023-10-05T12:49:16.691 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.691 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:16.691 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.691 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:16.691 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:16.691 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.692 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:16.692 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:16.692 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:16.692 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:16.692 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:16.692 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.692 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:16.692 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:16.692 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.692 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:16.692 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:16.692 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:16.693 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:16.693 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.693 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:16.693 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:16.693 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:16.693 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:16.693 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:16.693 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.693 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:16.693 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:16.693 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.694 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:16.694 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:16.694 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:16.694 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:16.694 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:16.694 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:16.694 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:16.694 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.694 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:16.694 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:16.694 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:16.695 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:16.695 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:16.695 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:16.695 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:16.695 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:16.695 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:16.695 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.695 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:16.695 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:16.695 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:16.695 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:16.695 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.696 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:16.696 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:16.696 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:16.696 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:16.696 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.696 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:16.696 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:16.696 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:16.696 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:16.696 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:16.696 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:16.696 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.697 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:16.697 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:16.697 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:16.697 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:16.697 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:16.697 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.697 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:16.697 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:16.697 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.697 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:16.697 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:16.697 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:16.698 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:16.698 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:16.698 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:16.698 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.698 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:16.698 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.698 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:16.698 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.698 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:16.698 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:16.698 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.699 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:16.699 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:16.699 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:16.699 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:16.699 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:16.699 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:16.699 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:16.699 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:16.699 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:16.699 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:16.699 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:16.699 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:16.700 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:16.700 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:16.700 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:16.700 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.700 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:16.700 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:16.700 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:16.700 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:16.700 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:16.700 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:16.700 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:16.700 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:16.701 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:16.701 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:16.701 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:16.701 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:16.701 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.701 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:16.701 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:16.701 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:16.701 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:16.701 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:16.701 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:16.701 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:16.702 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:16.702 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:16.702 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:16.702 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:16.702 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:16.702 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:16.702 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:16.702 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:16.702 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:16.702 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:16.702 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:16.703 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:16.703 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:16.703 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:16.703 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:16.703 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:16.703 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:16.703 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:16.703 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:16.703 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:16.703 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:16.703 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:16.703 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:16.704 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:16.704 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.704 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:16.704 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.704 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:16.704 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:16.704 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.704 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:16.704 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:16.704 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:16.704 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:16.705 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:16.705 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.705 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:16.705 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:16.705 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.705 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:16.705 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:16.705 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:16.705 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:16.705 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.705 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:16.705 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:16.706 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:16.706 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:16.706 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:16.706 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:16.706 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.706 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:16.706 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:16.706 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:16.706 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:16.706 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:16.706 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.707 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:16.707 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.707 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:16.707 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.707 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.encryption 2023-10-05T12:49:16.707 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.fails_on_dbstore 2023-10-05T12:49:16.707 INFO:teuthology.orchestra.run.smithi012.stdout: def test_encrypted_transfer_13b(): 2023-10-05T12:49:16.707 INFO:teuthology.orchestra.run.smithi012.stdout:> _test_encryption_sse_customer_write(13) 2023-10-05T12:49:16.707 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.707 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:9245: 2023-10-05T12:49:16.707 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:16.707 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:8667: in _test_encryption_sse_customer_write 2023-10-05T12:49:16.707 INFO:teuthology.orchestra.run.smithi012.stdout: bucket_name = get_new_bucket() 2023-10-05T12:49:16.708 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-10-05T12:49:16.708 INFO:teuthology.orchestra.run.smithi012.stdout: client.create_bucket(Bucket=name) 2023-10-05T12:49:16.708 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:16.708 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:16.708 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:16.708 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:16.708 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:16.708 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:16.708 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:16.708 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:16.709 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:16.709 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:16.709 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:16.709 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:16.709 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:16.709 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:16.709 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:16.709 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:16.709 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:16.709 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:16.709 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:16.709 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:16.709 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:16.710 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:16.710 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:16.710 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:16.710 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:16.710 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:16.710 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:16.710 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:16.710 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:16.710 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:16.710 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:16.710 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:16.711 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:16.711 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:16.711 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:16.711 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.711 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:16.711 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:16.711 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.711 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:16.711 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:16.711 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:16.711 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:16.711 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:16.712 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:16.712 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:16.712 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:16.712 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:16.712 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:16.712 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:16.712 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:16.712 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:16.712 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:16.712 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:16.712 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.712 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:16.713 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:16.713 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:16.713 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:16.713 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:16.713 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:16.713 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:16.713 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:16.713 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:16.713 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:16.713 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:16.713 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:16.713 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.714 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:16.714 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:16.714 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:16.714 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:16.714 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:16.714 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:16.714 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.714 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:16.714 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:16.714 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:16.714 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:16.715 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:16.715 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.715 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:16.715 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:16.715 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:16.715 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:16.715 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:16.715 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-407" 2023-10-05T12:49:16.715 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.715 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:16.715 INFO:teuthology.orchestra.run.smithi012.stdout:______________________ test_encryption_sse_c_method_head _______________________ 2023-10-05T12:49:16.716 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.716 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:16.716 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.716 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:16.716 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:16.716 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.716 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:16.716 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:16.716 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:16.716 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:16.716 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:16.717 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.717 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:16.717 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:16.717 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.717 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:16.717 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:16.717 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:16.717 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:16.717 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.717 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:16.717 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:16.718 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:16.718 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:16.718 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:16.718 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.718 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:16.718 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:16.718 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.718 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:16.718 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:16.718 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:16.718 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:16.719 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:16.719 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:16.719 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:16.719 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.719 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:16.719 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:16.719 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:16.719 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:16.719 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:16.719 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:16.719 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:16.719 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:16.720 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:16.720 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.720 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:16.720 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:16.720 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:16.720 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:16.721 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.721 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:16.721 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:16.721 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:16.721 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:16.721 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.721 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:16.721 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:16.721 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:16.721 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:16.721 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:16.722 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:16.722 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.722 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:16.722 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:16.722 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:16.722 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:16.722 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:16.722 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.722 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:16.722 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:16.722 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.723 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:16.723 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:16.723 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:16.723 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:16.723 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:16.723 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:16.723 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.723 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:16.723 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.723 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:16.723 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.723 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:16.724 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:16.724 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.724 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:16.724 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:16.724 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:16.724 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:16.724 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:16.724 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:16.724 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:16.724 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:16.724 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:16.725 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:16.725 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:16.725 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:16.725 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:16.725 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:16.725 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:16.725 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.725 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:16.725 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:16.725 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:16.725 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:16.725 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:16.726 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:16.726 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:16.726 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:16.726 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:16.726 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:16.726 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:16.726 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:16.726 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.726 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:16.726 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:16.726 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:16.727 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:16.727 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:16.727 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:16.727 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:16.727 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:16.727 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:16.727 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:16.727 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:16.727 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:16.727 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:16.727 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:16.727 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:16.728 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:16.728 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:16.728 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:16.728 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:16.728 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:16.728 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:16.728 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:16.728 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:16.728 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:16.728 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:16.728 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:16.728 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:16.729 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:16.729 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:16.729 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:16.729 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:16.729 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.729 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:16.729 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.729 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:16.729 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:16.729 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.729 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:16.729 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:16.730 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:16.730 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:16.730 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:16.730 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.730 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:16.730 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:16.730 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.730 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:16.730 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:16.730 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:16.730 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:16.730 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.731 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:16.731 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:16.731 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:16.731 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:16.731 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:16.731 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:16.731 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.731 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:16.731 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:16.731 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:16.731 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:16.731 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:16.732 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.732 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:16.732 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.732 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:16.732 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.732 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.encryption 2023-10-05T12:49:16.732 INFO:teuthology.orchestra.run.smithi012.stdout: def test_encryption_sse_c_method_head(): 2023-10-05T12:49:16.732 INFO:teuthology.orchestra.run.smithi012.stdout:> bucket_name = get_new_bucket() 2023-10-05T12:49:16.732 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.732 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:9250: 2023-10-05T12:49:16.732 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:16.732 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-10-05T12:49:16.733 INFO:teuthology.orchestra.run.smithi012.stdout: client.create_bucket(Bucket=name) 2023-10-05T12:49:16.733 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:16.733 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:16.733 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:16.733 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:16.733 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:16.733 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:16.733 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:16.733 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:16.733 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:16.733 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:16.734 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:16.734 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:16.734 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:16.734 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:16.734 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:16.734 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:16.734 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:16.734 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:16.734 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:16.734 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:16.734 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:16.734 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:16.735 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:16.735 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:16.735 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:16.735 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:16.735 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:16.735 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:16.735 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:16.735 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:16.735 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:16.735 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:16.735 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:16.735 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:16.736 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:16.736 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.736 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:16.736 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:16.736 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.736 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:16.736 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:16.736 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:16.736 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:16.736 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:16.736 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:16.736 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:16.737 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:16.737 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:16.737 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:16.737 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:16.737 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:16.737 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:16.737 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:16.737 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:16.737 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.737 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:16.737 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:16.737 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:16.738 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:16.738 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:16.738 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:16.738 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:16.738 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:16.738 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:16.738 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:16.738 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:16.738 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:16.738 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.738 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:16.738 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:16.739 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:16.739 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:16.739 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:16.739 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:16.739 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.739 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:16.739 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:16.739 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:16.739 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:16.739 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:16.739 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.739 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:16.740 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:16.740 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:16.740 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:16.740 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:16.740 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-408" 2023-10-05T12:49:16.740 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.740 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:16.740 INFO:teuthology.orchestra.run.smithi012.stdout:________________________ test_encryption_sse_c_present _________________________ 2023-10-05T12:49:16.740 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.740 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:16.740 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.740 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:16.741 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:16.741 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.741 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:16.741 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:16.741 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:16.741 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:16.741 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:16.741 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.741 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:16.741 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:16.741 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.742 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:16.742 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:16.742 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:16.742 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:16.742 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.742 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:16.742 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:16.742 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:16.742 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:16.742 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:16.742 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.742 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:16.743 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:16.743 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.743 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:16.743 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:16.743 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:16.743 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:16.743 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:16.743 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:16.743 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:16.743 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.743 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:16.743 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:16.744 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:16.744 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:16.744 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:16.744 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:16.744 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:16.744 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:16.744 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:16.744 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.744 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:16.744 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:16.744 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:16.744 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:16.745 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.745 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:16.745 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:16.745 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:16.745 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:16.745 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.745 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:16.745 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:16.745 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:16.745 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:16.745 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:16.745 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:16.746 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.746 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:16.746 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:16.746 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:16.746 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:16.746 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:16.746 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.746 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:16.746 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:16.746 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.746 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:16.746 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:16.747 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:16.747 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:16.747 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:16.747 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:16.747 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.747 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:16.747 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.747 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:16.747 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.747 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:16.747 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:16.748 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.748 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:16.748 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:16.748 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:16.748 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:16.748 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:16.748 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:16.748 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:16.748 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:16.748 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:16.748 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:16.748 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:16.749 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:16.749 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:16.749 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:16.749 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:16.749 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.749 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:16.749 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:16.749 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:16.749 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:16.749 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:16.749 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:16.749 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:16.750 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:16.750 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:16.750 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:16.750 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:16.750 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:16.750 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.750 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:16.750 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:16.750 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:16.750 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:16.750 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:16.750 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:16.751 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:16.751 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:16.751 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:16.751 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:16.751 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:16.751 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:16.751 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:16.751 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:16.751 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:16.751 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:16.751 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:16.751 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:16.752 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:16.752 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:16.752 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:16.752 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:16.752 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:16.752 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:16.752 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:16.752 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:16.752 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:16.752 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:16.752 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:16.752 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:16.753 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:16.753 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.753 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:16.753 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.753 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:16.753 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:16.753 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.753 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:16.753 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:16.753 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:16.753 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:16.754 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:16.754 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.754 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:16.754 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:16.754 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.754 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:16.754 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:16.754 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:16.754 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:16.754 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.754 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:16.755 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:16.755 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:16.755 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:16.755 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:16.755 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:16.755 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.755 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:16.755 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:16.755 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:16.755 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:16.755 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:16.755 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.756 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:16.756 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.756 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:16.756 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.756 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.encryption 2023-10-05T12:49:16.756 INFO:teuthology.orchestra.run.smithi012.stdout: def test_encryption_sse_c_present(): 2023-10-05T12:49:16.756 INFO:teuthology.orchestra.run.smithi012.stdout:> bucket_name = get_new_bucket() 2023-10-05T12:49:16.756 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.756 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:9275: 2023-10-05T12:49:16.756 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:16.756 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-10-05T12:49:16.756 INFO:teuthology.orchestra.run.smithi012.stdout: client.create_bucket(Bucket=name) 2023-10-05T12:49:16.757 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:16.757 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:16.757 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:16.757 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:16.757 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:16.757 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:16.757 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:16.757 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:16.757 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:16.757 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:16.757 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:16.757 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:16.758 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:16.758 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:16.758 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:16.758 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:16.758 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:16.758 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:16.758 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:16.758 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:16.758 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:16.758 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:16.758 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:16.758 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:16.759 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:16.759 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:16.759 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:16.759 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:16.759 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:16.759 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:16.759 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:16.759 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:16.759 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:16.759 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:16.759 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:16.759 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.760 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:16.760 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:16.760 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.760 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:16.760 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:16.760 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:16.760 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:16.760 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:16.760 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:16.760 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:16.760 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:16.761 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:16.761 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:16.761 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:16.761 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:16.761 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:16.761 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:16.761 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:16.761 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.761 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:16.761 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:16.761 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:16.761 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:16.762 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:16.762 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:16.762 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:16.762 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:16.762 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:16.762 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:16.762 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:16.762 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:16.762 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.762 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:16.762 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:16.763 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:16.763 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:16.763 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:16.763 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:16.763 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.763 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:16.763 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:16.763 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:16.763 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:16.763 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:16.763 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.763 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:16.763 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:16.764 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:16.764 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:16.764 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:16.764 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-409" 2023-10-05T12:49:16.764 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.764 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:16.764 INFO:teuthology.orchestra.run.smithi012.stdout:_______________________ test_encryption_sse_c_other_key ________________________ 2023-10-05T12:49:16.764 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.764 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:16.764 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.764 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:16.764 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:16.765 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.765 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:16.765 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:16.765 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:16.765 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:16.765 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:16.765 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.765 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:16.765 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:16.765 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.765 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:16.765 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:16.766 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:16.766 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:16.766 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.766 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:16.766 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:16.766 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:16.766 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:16.766 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:16.766 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.766 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:16.766 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:16.766 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.767 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:16.767 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:16.767 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:16.767 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:16.767 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:16.767 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:16.767 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:16.767 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.767 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:16.767 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:16.767 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:16.768 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:16.768 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:16.768 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:16.768 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:16.768 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:16.768 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:16.768 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.768 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:16.768 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:16.768 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:16.768 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:16.769 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.769 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:16.769 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:16.769 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:16.769 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:16.769 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.769 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:16.769 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:16.769 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:16.769 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:16.769 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:16.769 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:16.770 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.770 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:16.770 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:16.770 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:16.770 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:16.770 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:16.770 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.770 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:16.770 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:16.770 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.770 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:16.771 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:16.771 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:16.771 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:16.771 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:16.771 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:16.771 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.771 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:16.771 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.771 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:16.771 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.771 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:16.771 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:16.772 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.772 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:16.772 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:16.772 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:16.772 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:16.772 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:16.772 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:16.772 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:16.772 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:16.772 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:16.772 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:16.772 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:16.773 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:16.773 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:16.773 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:16.773 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:16.773 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.773 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:16.773 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:16.773 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:16.773 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:16.773 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:16.773 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:16.773 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:16.774 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:16.774 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:16.774 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:16.774 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:16.774 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:16.774 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.774 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:16.774 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:16.774 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:16.774 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:16.774 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:16.775 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:16.775 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:16.775 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:16.775 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:16.775 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:16.775 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:16.775 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:16.775 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:16.775 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:16.775 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:16.775 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:16.775 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:16.776 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:16.776 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:16.776 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:16.776 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:16.776 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:16.776 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:16.776 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:16.776 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:16.776 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:16.776 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:16.776 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:16.776 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:16.777 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:16.777 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:16.777 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.777 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:16.777 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.777 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:16.777 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:16.777 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.777 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:16.777 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:16.777 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:16.778 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:16.778 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:16.778 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.778 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:16.778 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:16.778 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.778 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:16.778 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:16.778 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:16.778 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:16.778 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.778 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:16.779 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:16.779 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:16.779 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:16.779 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:16.779 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:16.779 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.779 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:16.779 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:16.779 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:16.779 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:16.779 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:16.779 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.780 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:16.780 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.780 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:16.780 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.780 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.encryption 2023-10-05T12:49:16.780 INFO:teuthology.orchestra.run.smithi012.stdout: def test_encryption_sse_c_other_key(): 2023-10-05T12:49:16.780 INFO:teuthology.orchestra.run.smithi012.stdout:> bucket_name = get_new_bucket() 2023-10-05T12:49:16.780 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.780 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:9295: 2023-10-05T12:49:16.780 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:16.780 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-10-05T12:49:16.780 INFO:teuthology.orchestra.run.smithi012.stdout: client.create_bucket(Bucket=name) 2023-10-05T12:49:16.781 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:16.781 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:16.781 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:16.781 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:16.781 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:16.781 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:16.781 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:16.781 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:16.781 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:16.781 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:16.781 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:16.781 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:16.781 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:16.782 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:16.782 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:16.782 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:16.782 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:16.782 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:16.782 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:16.782 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:16.782 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:16.783 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:16.783 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:16.783 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:16.783 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:16.783 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:16.783 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:16.783 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:16.783 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:16.783 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:16.783 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:16.784 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:16.784 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:16.784 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:16.784 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:16.784 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.784 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:16.784 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:16.784 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.784 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:16.784 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:16.784 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:16.784 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:16.785 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:16.785 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:16.785 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:16.785 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:16.785 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:16.785 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:16.785 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:16.785 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:16.785 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:16.785 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:16.785 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:16.785 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.786 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:16.786 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:16.786 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:16.786 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:16.786 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:16.786 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:16.786 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:16.786 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:16.786 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:16.786 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:16.786 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:16.786 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:16.787 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.787 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:16.787 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:16.787 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:16.787 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:16.787 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:16.787 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:16.787 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.787 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:16.787 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:16.787 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:16.787 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:16.788 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:16.788 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.788 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:16.788 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:16.788 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:16.788 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:16.788 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:16.788 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-410" 2023-10-05T12:49:16.788 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.788 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:16.788 INFO:teuthology.orchestra.run.smithi012.stdout:______________________ test_encryption_sse_c_invalid_md5 _______________________ 2023-10-05T12:49:16.789 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.789 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:16.789 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.789 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:16.789 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:16.789 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.789 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:16.789 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:16.789 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:16.789 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:16.789 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:16.789 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.790 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:16.790 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:16.790 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.790 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:16.790 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:16.790 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:16.790 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:16.790 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.790 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:16.790 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:16.790 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:16.790 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:16.791 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:16.791 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.791 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:16.791 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:16.791 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.791 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:16.791 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:16.791 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:16.791 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:16.791 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:16.791 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:16.791 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:16.792 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.792 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:16.792 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:16.792 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:16.792 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:16.792 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:16.792 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:16.792 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:16.792 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:16.792 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:16.792 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.792 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:16.792 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:16.793 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:16.793 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:16.793 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.793 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:16.793 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:16.793 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:16.793 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:16.793 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.793 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:16.793 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:16.793 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:16.793 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:16.793 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:16.794 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:16.794 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.794 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:16.794 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:16.794 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:16.794 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:16.794 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:16.794 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.794 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:16.794 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:16.794 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.795 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:16.795 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:16.795 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:16.795 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:16.795 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:16.795 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:16.795 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.795 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:16.795 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.795 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:16.795 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.795 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:16.795 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:16.796 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.796 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:16.796 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:16.796 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:16.796 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:16.796 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:16.796 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:16.796 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:16.796 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:16.796 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:16.796 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:16.796 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:16.796 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:16.797 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:16.797 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:16.797 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:16.797 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.797 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:16.797 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:16.797 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:16.797 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:16.797 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:16.797 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:16.797 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:16.798 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:16.798 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:16.798 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:16.798 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:16.798 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:16.798 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.798 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:16.798 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:16.798 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:16.798 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:16.798 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:16.799 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:16.799 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:16.799 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:16.799 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:16.799 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:16.799 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:16.799 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:16.799 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:16.799 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:16.799 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:16.799 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:16.799 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:16.800 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:16.800 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:16.800 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:16.800 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:16.800 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:16.800 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:16.800 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:16.800 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:16.800 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:16.800 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:16.800 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:16.800 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:16.800 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:16.801 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:16.801 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.801 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:16.801 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.801 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:16.801 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:16.801 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.801 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:16.801 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:16.801 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:16.801 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:16.801 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:16.802 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.802 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:16.802 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:16.802 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.802 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:16.802 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:16.802 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:16.802 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:16.802 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.802 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:16.802 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:16.803 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:16.803 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:16.803 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:16.803 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:16.803 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.803 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:16.803 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:16.803 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:16.803 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:16.803 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:16.803 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.803 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:16.804 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.804 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:16.804 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.804 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.encryption 2023-10-05T12:49:16.804 INFO:teuthology.orchestra.run.smithi012.stdout: def test_encryption_sse_c_invalid_md5(): 2023-10-05T12:49:16.804 INFO:teuthology.orchestra.run.smithi012.stdout:> bucket_name = get_new_bucket() 2023-10-05T12:49:16.804 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.804 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:9322: 2023-10-05T12:49:16.804 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:16.804 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-10-05T12:49:16.804 INFO:teuthology.orchestra.run.smithi012.stdout: client.create_bucket(Bucket=name) 2023-10-05T12:49:16.804 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:16.805 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:16.805 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:16.805 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:16.805 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:16.805 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:16.805 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:16.805 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:16.805 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:16.805 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:16.805 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:16.805 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:16.805 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:16.805 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:16.806 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:16.806 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:16.806 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:16.806 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:16.806 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:16.806 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:16.806 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:16.806 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:16.806 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:16.806 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:16.806 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:16.807 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:16.807 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:16.807 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:16.807 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:16.807 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:16.807 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:16.807 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:16.807 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:16.807 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:16.807 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:16.807 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.807 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:16.807 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:16.808 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.808 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:16.808 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:16.808 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:16.808 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:16.808 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:16.808 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:16.808 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:16.808 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:16.808 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:16.808 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:16.809 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:16.809 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:16.809 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:16.809 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:16.809 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:16.809 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.809 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:16.809 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:16.809 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:16.809 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:16.809 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:16.809 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:16.810 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:16.810 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:16.810 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:16.810 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:16.810 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:16.810 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:16.810 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.810 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:16.810 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:16.810 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:16.810 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:16.810 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:16.811 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:16.811 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.811 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:16.811 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:16.811 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:16.811 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:16.811 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:16.811 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.811 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:16.811 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:16.811 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:16.812 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:16.812 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:16.812 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-411" 2023-10-05T12:49:16.812 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.812 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:16.812 INFO:teuthology.orchestra.run.smithi012.stdout:_________________________ test_encryption_sse_c_no_md5 _________________________ 2023-10-05T12:49:16.812 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.812 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:16.812 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.812 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:16.812 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:16.812 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.813 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:16.813 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:16.813 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:16.813 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:16.813 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:16.813 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.813 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:16.813 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:16.813 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.813 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:16.813 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:16.813 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:16.814 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:16.814 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.814 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:16.814 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:16.814 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:16.814 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:16.814 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:16.814 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.814 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:16.814 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:16.814 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.814 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:16.815 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:16.815 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:16.815 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:16.815 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:16.815 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:16.815 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:16.815 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.815 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:16.815 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:16.815 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:16.815 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:16.816 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:16.816 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:16.816 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:16.816 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:16.816 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:16.816 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.816 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:16.816 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:16.816 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:16.816 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:16.816 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.816 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:16.817 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:16.817 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:16.817 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:16.817 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.817 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:16.817 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:16.817 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:16.817 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:16.817 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:16.817 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:16.817 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.817 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:16.817 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:16.818 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:16.818 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:16.818 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:16.818 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.818 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:16.818 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:16.818 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.818 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:16.818 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:16.818 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:16.818 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:16.819 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:16.819 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:16.819 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.819 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:16.819 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.819 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:16.819 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.819 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:16.819 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:16.819 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.819 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:16.819 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:16.819 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:16.820 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:16.820 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:16.820 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:16.820 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:16.820 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:16.820 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:16.820 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:16.820 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:16.820 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:16.820 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:16.820 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:16.820 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:16.821 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.821 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:16.821 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:16.821 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:16.821 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:16.821 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:16.821 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:16.821 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:16.821 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:16.821 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:16.821 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:16.821 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:16.822 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:16.822 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.822 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:16.822 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:16.822 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:16.822 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:16.822 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:16.822 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:16.822 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:16.822 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:16.822 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:16.822 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:16.822 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:16.823 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:16.823 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:16.823 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:16.823 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:16.823 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:16.823 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:16.823 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:16.823 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:16.823 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:16.823 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:16.823 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:16.823 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:16.824 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:16.824 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:16.824 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:16.824 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:16.824 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:16.824 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:16.824 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:16.824 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:16.824 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.824 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:16.824 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.824 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:16.825 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:16.825 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.825 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:16.825 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:16.825 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:16.825 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:16.825 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:16.825 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.825 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:16.825 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:16.825 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.825 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:16.826 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:16.826 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:16.826 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:16.826 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.826 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:16.826 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:16.826 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:16.826 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:16.826 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:16.826 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:16.826 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.827 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:16.827 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:16.827 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:16.827 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:16.827 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:16.827 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.827 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:16.827 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.827 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:16.827 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.827 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.encryption 2023-10-05T12:49:16.827 INFO:teuthology.orchestra.run.smithi012.stdout: def test_encryption_sse_c_no_md5(): 2023-10-05T12:49:16.828 INFO:teuthology.orchestra.run.smithi012.stdout:> bucket_name = get_new_bucket() 2023-10-05T12:49:16.828 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.828 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:9340: 2023-10-05T12:49:16.828 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:16.828 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-10-05T12:49:16.828 INFO:teuthology.orchestra.run.smithi012.stdout: client.create_bucket(Bucket=name) 2023-10-05T12:49:16.828 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:16.828 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:16.828 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:16.828 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:16.828 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:16.828 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:16.829 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:16.829 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:16.829 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:16.829 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:16.829 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:16.829 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:16.829 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:16.829 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:16.829 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:16.829 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:16.829 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:16.829 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:16.830 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:16.830 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:16.830 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:16.830 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:16.830 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:16.830 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:16.830 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:16.830 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:16.830 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:16.830 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:16.830 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:16.830 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:16.831 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:16.831 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:16.831 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:16.831 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:16.831 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:16.831 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.831 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:16.831 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:16.831 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.831 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:16.831 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:16.831 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:16.832 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:16.832 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:16.832 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:16.832 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:16.832 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:16.832 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:16.832 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:16.832 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:16.832 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:16.832 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:16.832 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:16.832 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:16.833 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.833 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:16.833 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:16.833 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:16.833 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:16.833 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:16.833 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:16.833 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:16.833 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:16.833 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:16.833 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:16.833 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:16.834 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:16.834 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.834 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:16.834 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:16.834 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:16.834 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:16.834 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:16.834 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:16.834 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.834 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:16.834 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:16.835 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:16.835 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:16.835 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:16.835 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.835 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:16.835 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:16.835 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:16.835 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:16.835 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:16.835 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-412" 2023-10-05T12:49:16.835 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.835 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:16.836 INFO:teuthology.orchestra.run.smithi012.stdout:_________________________ test_encryption_sse_c_no_key _________________________ 2023-10-05T12:49:16.836 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.836 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:16.836 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.836 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:16.836 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:16.836 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.836 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:16.836 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:16.836 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:16.836 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:16.836 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:16.837 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.837 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:16.837 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:16.837 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.837 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:16.837 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:16.837 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:16.837 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:16.837 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.837 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:16.837 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:16.837 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:16.837 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:16.838 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:16.838 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.838 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:16.838 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:16.838 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.838 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:16.838 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:16.838 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:16.838 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:16.838 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:16.838 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:16.838 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:16.839 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.839 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:16.839 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:16.839 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:16.839 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:16.839 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:16.839 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:16.839 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:16.839 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:16.839 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:16.839 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.839 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:16.840 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:16.840 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:16.840 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:16.840 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.840 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:16.840 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:16.840 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:16.840 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:16.840 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.840 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:16.840 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:16.840 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:16.841 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:16.841 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:16.841 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:16.841 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.841 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:16.841 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:16.841 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:16.841 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:16.841 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:16.841 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.841 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:16.842 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:16.842 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.842 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:16.842 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:16.842 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:16.842 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:16.842 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:16.842 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:16.842 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.842 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:16.842 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.842 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:16.843 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.843 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:16.843 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:16.843 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.843 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:16.843 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:16.843 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:16.843 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:16.843 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:16.843 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:16.843 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:16.844 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:16.844 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:16.844 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:16.844 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:16.844 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:16.844 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:16.844 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:16.844 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:16.844 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.844 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:16.844 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:16.844 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:16.844 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:16.845 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:16.845 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:16.845 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:16.845 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:16.845 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:16.845 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:16.845 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:16.845 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:16.845 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.845 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:16.845 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:16.845 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:16.846 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:16.846 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:16.846 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:16.846 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:16.846 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:16.846 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:16.846 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:16.846 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:16.846 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:16.846 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:16.846 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:16.847 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:16.847 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:16.847 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:16.847 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:16.847 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:16.847 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:16.847 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:16.847 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:16.847 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:16.847 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:16.847 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:16.847 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:16.848 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:16.848 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:16.848 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:16.848 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:16.848 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:16.848 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.848 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:16.848 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.848 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:16.848 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:16.848 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.848 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:16.849 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:16.849 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:16.849 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:16.849 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:16.849 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.849 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:16.849 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:16.849 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.849 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:16.849 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:16.849 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:16.849 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:16.850 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.850 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:16.850 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:16.850 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:16.850 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:16.850 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:16.850 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:16.850 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.850 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:16.850 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:16.850 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:16.850 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:16.851 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:16.851 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.851 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:16.851 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.851 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:16.851 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.851 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.encryption 2023-10-05T12:49:16.851 INFO:teuthology.orchestra.run.smithi012.stdout: def test_encryption_sse_c_no_key(): 2023-10-05T12:49:16.851 INFO:teuthology.orchestra.run.smithi012.stdout:> bucket_name = get_new_bucket() 2023-10-05T12:49:16.851 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.851 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:9355: 2023-10-05T12:49:16.851 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:16.852 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-10-05T12:49:16.852 INFO:teuthology.orchestra.run.smithi012.stdout: client.create_bucket(Bucket=name) 2023-10-05T12:49:16.852 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:16.852 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:16.852 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:16.852 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:16.852 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:16.852 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:16.852 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:16.852 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:16.852 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:16.852 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:16.853 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:16.853 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:16.853 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:16.853 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:16.853 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:16.853 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:16.853 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:16.853 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:16.853 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:16.853 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:16.853 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:16.853 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:16.854 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:16.854 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:16.854 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:16.854 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:16.854 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:16.854 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:16.854 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:16.854 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:16.854 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:16.854 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:16.854 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:16.855 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:16.855 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:16.855 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.855 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:16.855 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:16.855 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.855 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:16.855 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:16.855 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:16.855 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:16.855 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:16.855 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:16.856 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:16.856 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:16.856 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:16.856 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:16.856 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:16.856 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:16.856 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:16.856 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:16.856 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:16.856 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.856 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:16.856 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:16.857 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:16.857 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:16.857 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:16.857 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:16.857 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:16.857 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:16.857 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:16.857 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:16.857 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:16.857 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:16.857 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.858 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:16.858 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:16.858 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:16.858 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:16.858 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:16.858 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:16.858 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.858 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:16.858 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:16.858 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:16.858 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:16.858 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:16.859 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.859 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:16.859 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:16.859 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:16.859 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:16.859 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:16.859 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-413" 2023-10-05T12:49:16.859 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.859 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:16.859 INFO:teuthology.orchestra.run.smithi012.stdout:_________________________ test_encryption_key_no_sse_c _________________________ 2023-10-05T12:49:16.859 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.859 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:16.860 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.860 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:16.860 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:16.860 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.860 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:16.860 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:16.860 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:16.860 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:16.860 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:16.860 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.860 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:16.860 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:16.861 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.861 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:16.861 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:16.861 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:16.861 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:16.861 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.861 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:16.861 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:16.861 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:16.861 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:16.861 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:16.861 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.862 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:16.862 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:16.862 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.862 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:16.862 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:16.862 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:16.862 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:16.862 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:16.862 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:16.862 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:16.862 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.863 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:16.863 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:16.863 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:16.863 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:16.863 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:16.863 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:16.863 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:16.863 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:16.863 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:16.863 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.863 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:16.863 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:16.863 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:16.864 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:16.864 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.864 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:16.864 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:16.864 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:16.864 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:16.864 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.864 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:16.864 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:16.864 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:16.864 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:16.865 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:16.865 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:16.865 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.865 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:16.865 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:16.865 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:16.865 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:16.865 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:16.865 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.865 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:16.865 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:16.865 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.866 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:16.866 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:16.866 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:16.866 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:16.866 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:16.866 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:16.866 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.866 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:16.866 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.866 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:16.866 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.866 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:16.866 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:16.867 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.867 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:16.867 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:16.867 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:16.867 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:16.867 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:16.867 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:16.867 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:16.867 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:16.867 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:16.867 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:16.867 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:16.868 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:16.868 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:16.868 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:16.868 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:16.868 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.868 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:16.868 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:16.868 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:16.868 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:16.868 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:16.868 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:16.868 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:16.869 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:16.869 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:16.869 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:16.869 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:16.869 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:16.869 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.869 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:16.869 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:16.869 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:16.869 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:16.869 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:16.869 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:16.870 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:16.870 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:16.870 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:16.870 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:16.870 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:16.870 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:16.870 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:16.870 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:16.870 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:16.870 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:16.870 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:16.870 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:16.871 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:16.871 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:16.871 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:16.871 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:16.871 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:16.871 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:16.871 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:16.871 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:16.871 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:16.871 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:16.871 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:16.871 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:16.872 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:16.872 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.872 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:16.872 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.872 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:16.872 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:16.872 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.872 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:16.872 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:16.872 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:16.872 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:16.873 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:16.873 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.873 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:16.873 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:16.873 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.873 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:16.873 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:16.873 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:16.873 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:16.873 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.873 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:16.873 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:16.874 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:16.874 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:16.874 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:16.874 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:16.874 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.874 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:16.874 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:16.874 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:16.874 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:16.874 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:16.874 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.875 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:16.875 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.875 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:16.875 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.875 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.encryption 2023-10-05T12:49:16.875 INFO:teuthology.orchestra.run.smithi012.stdout: def test_encryption_key_no_sse_c(): 2023-10-05T12:49:16.875 INFO:teuthology.orchestra.run.smithi012.stdout:> bucket_name = get_new_bucket() 2023-10-05T12:49:16.875 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.875 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:9369: 2023-10-05T12:49:16.875 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:16.875 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-10-05T12:49:16.875 INFO:teuthology.orchestra.run.smithi012.stdout: client.create_bucket(Bucket=name) 2023-10-05T12:49:16.876 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:16.876 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:16.876 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:16.876 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:16.876 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:16.876 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:16.876 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:16.876 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:16.876 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:16.876 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:16.876 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:16.877 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:16.877 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:16.877 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:16.877 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:16.877 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:16.877 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:16.877 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:16.877 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:16.877 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:16.877 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:16.877 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:16.877 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:16.878 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:16.878 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:16.878 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:16.878 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:16.878 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:16.878 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:16.878 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:16.878 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:16.878 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:16.878 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:16.878 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:16.879 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:16.879 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.879 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:16.879 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:16.879 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.879 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:16.879 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:16.879 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:16.879 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:16.879 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:16.879 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:16.879 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:16.880 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:16.880 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:16.880 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:16.880 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:16.880 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:16.880 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:16.880 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:16.880 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:16.880 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.880 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:16.880 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:16.880 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:16.881 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:16.881 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:16.881 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:16.881 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:16.881 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:16.881 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:16.881 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:16.881 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:16.881 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:16.881 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.881 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:16.882 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:16.882 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:16.882 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:16.882 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:16.882 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:16.882 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.882 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:16.882 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:16.882 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:16.882 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:16.882 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:16.883 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.883 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:16.883 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:16.883 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:16.883 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:16.883 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:16.883 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-414" 2023-10-05T12:49:16.883 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.883 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:16.883 INFO:teuthology.orchestra.run.smithi012.stdout:____________________ test_encryption_sse_c_multipart_upload ____________________ 2023-10-05T12:49:16.883 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.884 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:16.884 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.884 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:16.884 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:16.884 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.884 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:16.884 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:16.884 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:16.884 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:16.884 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:16.884 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.884 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:16.885 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:16.885 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.885 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:16.885 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:16.885 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:16.885 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:16.885 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.885 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:16.885 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:16.885 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:16.885 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:16.886 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:16.886 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.886 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:16.886 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:16.886 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.886 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:16.886 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:16.886 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:16.886 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:16.886 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:16.886 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:16.887 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:16.887 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.887 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:16.887 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:16.887 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:16.887 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:16.887 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:16.887 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:16.887 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:16.887 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:16.887 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:16.887 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.888 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:16.888 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:16.888 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:16.888 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:16.888 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.888 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:16.888 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:16.888 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:16.888 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:16.888 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.888 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:16.888 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:16.889 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:16.889 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:16.889 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:16.889 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:16.889 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.889 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:16.889 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:16.889 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:16.889 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:16.889 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:16.889 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.889 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:16.890 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:16.890 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.890 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:16.890 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:16.890 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:16.890 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:16.890 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:16.890 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:16.890 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.890 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:16.890 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.891 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:16.891 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.891 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:16.891 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:16.891 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.891 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:16.891 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:16.891 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:16.891 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:16.891 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:16.891 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:16.891 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:16.892 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:16.892 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:16.892 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:16.892 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:16.892 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:16.892 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:16.892 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:16.892 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:16.892 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.892 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:16.892 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:16.892 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:16.892 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:16.893 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:16.893 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:16.893 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:16.893 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:16.893 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:16.893 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:16.893 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:16.893 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:16.893 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.893 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:16.893 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:16.894 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:16.894 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:16.894 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:16.894 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:16.894 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:16.894 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:16.894 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:16.894 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:16.894 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:16.894 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:16.894 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:16.895 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:16.895 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:16.895 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:16.895 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:16.895 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:16.895 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:16.895 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:16.895 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:16.895 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:16.895 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:16.895 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:16.896 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:16.896 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:16.896 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:16.896 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:16.896 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:16.896 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:16.896 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:16.896 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.896 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:16.896 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.896 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:16.897 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:16.897 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.897 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:16.897 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:16.897 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:16.897 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:16.897 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:16.897 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.897 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:16.897 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:16.897 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.897 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:16.898 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:16.898 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:16.898 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:16.898 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.898 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:16.898 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:16.898 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:16.898 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:16.898 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:16.898 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:16.898 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.899 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:16.899 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:16.899 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:16.899 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:16.899 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:16.899 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.899 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:16.899 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.899 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:16.899 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.899 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.encryption 2023-10-05T12:49:16.900 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.fails_on_dbstore 2023-10-05T12:49:16.900 INFO:teuthology.orchestra.run.smithi012.stdout: def test_encryption_sse_c_multipart_upload(): 2023-10-05T12:49:16.900 INFO:teuthology.orchestra.run.smithi012.stdout:> bucket_name = get_new_bucket() 2023-10-05T12:49:16.900 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.900 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:9436: 2023-10-05T12:49:16.900 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:16.900 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-10-05T12:49:16.900 INFO:teuthology.orchestra.run.smithi012.stdout: client.create_bucket(Bucket=name) 2023-10-05T12:49:16.900 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:16.900 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:16.900 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:16.900 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:16.901 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:16.901 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:16.901 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:16.901 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:16.901 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:16.901 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:16.901 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:16.901 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:16.901 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:16.901 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:16.901 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:16.902 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:16.902 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:16.902 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:16.902 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:16.902 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:16.902 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:16.902 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:16.902 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:16.902 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:16.902 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:16.902 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:16.902 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:16.903 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:16.903 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:16.903 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:16.903 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:16.903 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:16.903 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:16.903 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:16.903 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:16.903 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.903 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:16.903 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:16.904 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.904 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:16.904 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:16.904 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:16.904 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:16.904 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:16.904 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:16.904 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:16.904 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:16.904 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:16.904 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:16.904 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:16.905 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:16.905 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:16.905 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:16.905 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:16.905 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.905 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:16.905 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:16.905 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:16.905 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:16.905 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:16.905 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:16.906 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:16.906 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:16.906 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:16.906 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:16.906 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:16.906 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:16.906 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.906 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:16.906 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:16.906 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:16.907 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:16.907 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:16.907 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:16.907 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.907 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:16.907 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:16.907 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:16.907 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:16.907 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:16.907 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.907 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:16.908 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:16.908 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:16.908 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:16.908 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:16.908 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-415" 2023-10-05T12:49:16.908 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.908 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:16.908 INFO:teuthology.orchestra.run.smithi012.stdout:_______________ test_encryption_sse_c_unaligned_multipart_upload _______________ 2023-10-05T12:49:16.908 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.908 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:16.908 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.908 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:16.909 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:16.909 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.909 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:16.909 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:16.909 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:16.909 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:16.909 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:16.909 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.909 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:16.909 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:16.909 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.909 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:16.910 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:16.910 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:16.910 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:16.910 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.910 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:16.910 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:16.910 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:16.910 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:16.910 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:16.910 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.910 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:16.910 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:16.911 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.911 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:16.911 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:16.911 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:16.911 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:16.911 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:16.911 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:16.911 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:16.911 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.911 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:16.911 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:16.911 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:16.912 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:16.912 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:16.912 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:16.912 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:16.912 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:16.912 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:16.912 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.912 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:16.912 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:16.912 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:16.912 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:16.912 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.912 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:16.913 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:16.913 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:16.913 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:16.913 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.913 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:16.913 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:16.913 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:16.913 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:16.913 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:16.913 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:16.913 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.913 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:16.914 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:16.914 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:16.914 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:16.914 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:16.914 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.914 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:16.914 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:16.914 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.914 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:16.914 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:16.915 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:16.915 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:16.915 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:16.915 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:16.915 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.915 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:16.915 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.915 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:16.915 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.915 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:16.915 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:16.915 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.915 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:16.916 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:16.916 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:16.916 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:16.916 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:16.916 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:16.916 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:16.916 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:16.916 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:16.916 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:16.916 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:16.916 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:16.917 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:16.917 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:16.917 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:16.917 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.917 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:16.917 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:16.917 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:16.917 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:16.917 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:16.917 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:16.917 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:16.917 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:16.917 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:16.918 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:16.918 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:16.918 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:16.918 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.918 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:16.918 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:16.918 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:16.918 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:16.918 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:16.918 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:16.918 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:16.919 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:16.919 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:16.919 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:16.919 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:16.919 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:16.919 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:16.919 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:16.919 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:16.919 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:16.919 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:16.919 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:16.920 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:16.920 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:16.920 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:16.920 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:16.920 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:16.920 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:16.920 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:16.920 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:16.920 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:16.920 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:16.920 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:16.920 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:16.920 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:16.921 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.921 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:16.921 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.921 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:16.921 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:16.921 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.921 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:16.921 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:16.921 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:16.921 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:16.921 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:16.921 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.922 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:16.922 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:16.922 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.922 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:16.922 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:16.922 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:16.922 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:16.922 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.922 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:16.922 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:16.922 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:16.922 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:16.923 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:16.923 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:16.923 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.923 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:16.923 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:16.923 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:16.923 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:16.923 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:16.923 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.923 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:16.923 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.923 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:16.924 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.924 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.encryption 2023-10-05T12:49:16.924 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.fails_on_dbstore 2023-10-05T12:49:16.924 INFO:teuthology.orchestra.run.smithi012.stdout: def test_encryption_sse_c_unaligned_multipart_upload(): 2023-10-05T12:49:16.924 INFO:teuthology.orchestra.run.smithi012.stdout:> bucket_name = get_new_bucket() 2023-10-05T12:49:16.924 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.924 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:9482: 2023-10-05T12:49:16.924 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:16.924 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-10-05T12:49:16.924 INFO:teuthology.orchestra.run.smithi012.stdout: client.create_bucket(Bucket=name) 2023-10-05T12:49:16.924 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:16.924 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:16.924 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:16.925 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:16.925 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:16.925 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:16.925 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:16.925 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:16.925 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:16.925 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:16.925 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:16.925 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:16.925 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:16.925 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:16.925 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:16.925 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:16.926 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:16.926 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:16.926 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:16.926 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:16.926 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:16.926 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:16.926 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:16.926 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:16.926 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:16.926 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:16.926 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:16.926 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:16.927 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:16.927 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:16.927 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:16.927 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:16.927 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:16.927 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:16.927 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:16.927 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.927 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:16.927 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:16.927 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.928 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:16.928 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:16.928 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:16.928 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:16.928 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:16.928 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:16.928 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:16.928 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:16.928 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:16.928 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:16.928 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:16.928 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:16.929 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:16.929 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:16.929 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:16.929 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.929 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:16.929 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:16.929 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:16.929 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:16.929 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:16.929 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:16.929 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:16.930 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:16.930 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:16.930 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:16.930 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:16.930 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:16.930 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.930 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:16.930 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:16.930 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:16.930 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:16.930 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:16.930 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:16.931 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.931 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:16.931 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:16.931 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:16.931 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:16.931 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:16.931 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.931 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:16.931 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:16.931 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:16.931 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:16.931 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:16.932 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-416" 2023-10-05T12:49:16.932 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.932 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:16.932 INFO:teuthology.orchestra.run.smithi012.stdout:_________________ test_encryption_sse_c_multipart_bad_download _________________ 2023-10-05T12:49:16.932 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.932 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:16.932 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.932 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:16.932 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:16.932 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.932 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:16.932 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:16.932 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:16.933 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:16.933 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:16.933 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.933 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:16.933 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:16.933 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.933 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:16.933 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:16.933 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:16.933 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:16.933 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.933 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:16.934 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:16.934 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:16.934 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:16.934 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:16.934 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.934 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:16.934 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:16.934 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.934 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:16.934 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:16.934 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:16.934 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:16.935 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:16.935 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:16.935 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:16.935 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.935 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:16.935 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:16.935 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:16.935 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:16.935 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:16.935 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:16.935 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:16.935 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:16.935 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:16.936 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.936 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:16.936 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:16.936 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:16.936 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:16.936 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.936 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:16.936 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:16.936 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:16.936 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:16.936 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.936 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:16.936 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:16.937 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:16.937 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:16.937 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:16.937 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:16.937 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.937 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:16.937 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:16.937 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:16.937 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:16.937 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:16.937 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.937 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:16.938 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:16.938 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.938 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:16.938 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:16.938 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:16.938 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:16.938 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:16.938 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:16.938 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.938 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:16.938 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.938 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:16.939 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.939 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:16.939 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:16.939 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.939 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:16.939 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:16.939 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:16.939 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:16.939 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:16.939 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:16.939 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:16.939 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:16.940 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:16.940 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:16.940 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:16.940 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:16.940 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:16.940 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:16.940 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:16.940 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.940 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:16.940 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:16.940 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:16.940 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:16.941 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:16.941 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:16.941 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:16.941 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:16.941 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:16.941 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:16.941 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:16.941 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:16.941 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.941 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:16.941 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:16.941 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:16.941 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:16.942 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:16.942 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:16.942 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:16.942 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:16.942 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:16.942 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:16.942 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:16.942 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:16.942 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:16.942 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:16.942 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:16.943 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:16.943 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:16.943 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:16.943 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:16.943 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:16.943 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:16.943 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:16.943 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:16.943 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:16.943 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:16.943 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:16.943 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:16.944 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:16.944 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:16.944 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:16.944 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:16.944 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.944 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:16.944 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.944 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:16.944 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:16.944 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.944 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:16.945 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:16.945 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:16.945 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:16.945 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:16.945 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.945 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:16.945 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:16.945 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.945 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:16.945 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:16.945 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:16.945 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:16.945 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.946 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:16.946 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:16.946 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:16.946 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:16.946 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:16.946 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:16.946 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.946 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:16.946 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:16.946 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:16.946 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:16.946 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:16.947 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.947 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:16.947 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.947 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:16.947 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.947 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.encryption 2023-10-05T12:49:16.947 INFO:teuthology.orchestra.run.smithi012.stdout: def test_encryption_sse_c_multipart_bad_download(): 2023-10-05T12:49:16.947 INFO:teuthology.orchestra.run.smithi012.stdout:> bucket_name = get_new_bucket() 2023-10-05T12:49:16.947 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.947 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:9583: 2023-10-05T12:49:16.947 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:16.947 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-10-05T12:49:16.948 INFO:teuthology.orchestra.run.smithi012.stdout: client.create_bucket(Bucket=name) 2023-10-05T12:49:16.948 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:16.948 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:16.948 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:16.948 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:16.948 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:16.948 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:16.948 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:16.948 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:16.948 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:16.948 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:16.948 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:16.949 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:16.949 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:16.949 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:16.949 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:16.949 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:16.949 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:16.949 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:16.949 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:16.949 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:16.949 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:16.949 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:16.949 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:16.950 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:16.950 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:16.950 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:16.950 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:16.950 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:16.950 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:16.950 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:16.950 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:16.950 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:16.950 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:16.950 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:16.951 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:16.951 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.951 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:16.951 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:16.951 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.951 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:16.951 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:16.951 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:16.951 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:16.951 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:16.951 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:16.951 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:16.951 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:16.952 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:16.952 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:16.952 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:16.952 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:16.952 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:16.952 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:16.952 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:16.952 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.952 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:16.952 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:16.952 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:16.952 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:16.953 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:16.953 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:16.953 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:16.953 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:16.953 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:16.953 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:16.953 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:16.953 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:16.953 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.953 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:16.953 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:16.953 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:16.954 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:16.954 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:16.954 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:16.954 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.954 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:16.954 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:16.954 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:16.954 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:16.954 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:16.954 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.954 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:16.955 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:16.955 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:16.955 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:16.955 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:16.955 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-417" 2023-10-05T12:49:16.955 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.955 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:16.955 INFO:teuthology.orchestra.run.smithi012.stdout:___________ test_encryption_sse_c_post_object_authenticated_request ____________ 2023-10-05T12:49:16.955 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.955 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:16.955 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.955 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:16.956 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:16.956 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.956 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:16.956 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:16.956 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:16.956 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:16.956 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:16.956 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.956 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:16.956 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:16.956 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.956 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:16.957 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:16.957 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:16.957 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:16.957 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.957 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:16.957 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:16.957 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:16.957 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:16.957 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:16.957 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.957 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:16.957 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:16.958 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.958 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:16.958 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:16.958 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:16.958 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:16.958 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:16.958 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:16.958 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:16.958 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.958 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:16.958 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:16.959 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:16.959 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:16.959 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:16.959 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:16.959 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:16.959 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:16.959 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:16.959 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.959 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:16.961 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:16.961 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:16.961 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:16.961 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.961 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:16.961 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:16.961 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:16.961 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:16.961 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.961 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:16.962 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:16.962 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:16.962 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:16.962 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:16.962 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:16.962 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.962 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:16.962 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:16.962 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:16.962 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:16.962 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:16.963 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.963 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:16.963 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:16.963 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.963 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:16.963 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:16.963 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:16.963 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:16.963 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:16.963 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:16.963 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.963 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:16.963 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.964 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:16.964 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.964 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:16.964 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:16.964 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.964 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:16.964 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:16.964 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:16.964 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:16.964 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:16.964 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:16.964 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:16.964 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:16.965 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:16.965 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:16.965 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:16.965 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:16.965 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:16.965 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:16.965 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:16.965 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.965 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:16.965 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:16.965 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:16.965 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:16.966 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:16.966 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:16.966 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:16.966 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:16.966 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:16.966 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:16.966 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:16.966 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:16.966 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.966 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:16.966 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:16.966 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:16.967 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:16.967 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:16.967 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:16.967 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:16.967 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:16.967 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:16.967 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:16.967 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:16.967 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:16.967 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:16.967 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:16.967 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:16.967 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:16.968 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:16.968 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:16.968 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:16.968 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:16.968 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:16.968 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:16.968 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:16.968 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:16.968 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:16.968 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:16.968 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:16.968 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:16.969 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:16.969 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:16.969 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:16.969 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.969 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:16.969 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.969 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:16.969 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:16.969 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.969 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:16.969 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:16.970 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:16.970 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:16.970 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:16.970 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.970 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:16.970 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:16.970 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.970 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:16.970 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:16.970 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:16.970 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:16.970 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.971 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:16.971 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:16.971 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:16.971 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:16.971 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:16.971 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:16.971 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.971 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:16.971 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:16.971 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:16.971 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:16.971 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:16.972 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.972 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:16.972 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.972 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:16.972 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.972 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.encryption 2023-10-05T12:49:16.972 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.fails_on_dbstore 2023-10-05T12:49:16.972 INFO:teuthology.orchestra.run.smithi012.stdout: def test_encryption_sse_c_post_object_authenticated_request(): 2023-10-05T12:49:16.972 INFO:teuthology.orchestra.run.smithi012.stdout:> bucket_name = get_new_bucket() 2023-10-05T12:49:16.972 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.972 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:9630: 2023-10-05T12:49:16.973 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:16.973 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-10-05T12:49:16.973 INFO:teuthology.orchestra.run.smithi012.stdout: client.create_bucket(Bucket=name) 2023-10-05T12:49:16.973 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:16.973 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:16.974 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:16.974 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:16.974 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:16.974 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:16.974 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:16.974 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:16.974 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:16.974 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:16.974 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:16.974 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:16.974 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:16.974 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:16.975 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:16.975 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:16.975 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:16.975 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:16.975 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:16.975 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:16.975 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:16.975 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:16.975 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:16.975 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:16.975 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:16.975 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:16.976 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:16.976 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:16.976 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:16.976 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:16.976 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:16.976 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:16.976 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:16.976 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:16.976 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:16.976 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.977 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:16.977 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:16.977 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.977 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:16.977 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:16.977 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:16.977 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:16.977 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:16.977 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:16.977 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:16.977 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:16.977 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:16.978 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:16.978 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:16.978 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:16.978 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:16.978 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:16.978 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:16.978 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.978 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:16.978 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:16.978 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:16.978 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:16.979 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:16.979 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:16.979 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:16.979 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:16.979 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:16.979 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:16.979 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:16.979 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:16.979 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.979 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:16.979 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:16.979 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:16.980 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:16.980 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:16.980 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:16.980 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.980 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:16.980 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:16.980 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:16.980 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:16.980 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:16.980 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.980 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:16.980 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:16.980 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:16.981 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:16.981 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:16.981 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-418" 2023-10-05T12:49:16.981 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.981 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:16.981 INFO:teuthology.orchestra.run.smithi012.stdout:___________________________ test_sse_kms_method_head ___________________________ 2023-10-05T12:49:16.981 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.981 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:16.981 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.981 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:16.981 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:16.981 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.982 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:16.982 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:16.982 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:16.982 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:16.982 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:16.982 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.982 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:16.982 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:16.982 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.982 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:16.982 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:16.983 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:16.983 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:16.983 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.983 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:16.983 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:16.983 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:16.983 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:16.983 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:16.983 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.983 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:16.983 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:16.983 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.984 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:16.984 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:16.984 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:16.984 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:16.984 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:16.984 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:16.984 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:16.984 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.984 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:16.984 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:16.984 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:16.984 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:16.985 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:16.985 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:16.985 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:16.985 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:16.985 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:16.985 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.985 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:16.985 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:16.985 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:16.985 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:16.985 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.985 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:16.986 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:16.986 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:16.986 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:16.986 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.986 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:16.986 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:16.986 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:16.986 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:16.986 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:16.986 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:16.986 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.987 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:16.987 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:16.987 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:16.987 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:16.987 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:16.987 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.987 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:16.987 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:16.987 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.987 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:16.987 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:16.987 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:16.988 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:16.988 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:16.988 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:16.988 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.988 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:16.988 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.988 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:16.988 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.988 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:16.988 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:16.988 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.989 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:16.989 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:16.989 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:16.989 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:16.989 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:16.989 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:16.989 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:16.989 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:16.989 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:16.989 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:16.989 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:16.989 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:16.990 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:16.990 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:16.990 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:16.990 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.990 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:16.990 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:16.990 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:16.990 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:16.990 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:16.990 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:16.990 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:16.991 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:16.991 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:16.991 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:16.991 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:16.991 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:16.991 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.991 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:16.991 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:16.991 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:16.991 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:16.991 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:16.991 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:16.992 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:16.992 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:16.992 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:16.992 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:16.992 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:16.992 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:16.992 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:16.992 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:16.992 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:16.992 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:16.992 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:16.992 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:16.993 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:16.993 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:16.993 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:16.993 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:16.993 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:16.993 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:16.993 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:16.993 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:16.993 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:16.993 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:16.993 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:16.993 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:16.994 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:16.994 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.994 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:16.994 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.994 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:16.994 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:16.994 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.994 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:16.994 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:16.994 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:16.994 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:16.995 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:16.995 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.995 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:16.995 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:16.995 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.995 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:16.995 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:16.995 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:16.995 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:16.995 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.995 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:16.995 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:16.996 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:16.996 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:16.996 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:16.996 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:16.996 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.996 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:16.996 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:16.996 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:16.996 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:16.996 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:16.996 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.996 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:16.997 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.997 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:16.997 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.997 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.encryption 2023-10-05T12:49:16.997 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.fails_on_dbstore 2023-10-05T12:49:16.997 INFO:teuthology.orchestra.run.smithi012.stdout: def test_sse_kms_method_head(): 2023-10-05T12:49:16.997 INFO:teuthology.orchestra.run.smithi012.stdout: kms_keyid = get_main_kms_keyid() 2023-10-05T12:49:16.997 INFO:teuthology.orchestra.run.smithi012.stdout:> bucket_name = get_new_bucket() 2023-10-05T12:49:16.997 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:16.997 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:9714: 2023-10-05T12:49:16.997 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:16.997 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-10-05T12:49:16.997 INFO:teuthology.orchestra.run.smithi012.stdout: client.create_bucket(Bucket=name) 2023-10-05T12:49:16.998 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:16.998 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:16.998 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:16.998 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:16.998 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:16.998 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:16.998 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:16.998 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:16.998 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:16.998 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:16.999 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:16.999 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:16.999 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:16.999 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:16.999 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:16.999 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:16.999 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:16.999 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:16.999 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:16.999 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:16.999 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:16.999 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:17.000 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:17.000 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:17.000 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:17.000 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:17.000 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:17.000 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:17.000 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:17.000 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:17.000 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:17.000 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:17.000 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:17.001 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:17.001 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.001 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.001 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:17.001 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:17.001 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.001 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:17.001 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.001 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:17.001 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:17.001 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:17.001 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:17.002 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:17.002 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:17.002 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:17.002 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:17.002 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:17.002 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:17.002 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:17.002 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:17.002 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:17.002 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.002 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:17.002 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:17.003 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:17.003 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:17.003 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:17.003 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:17.003 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:17.003 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:17.003 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:17.003 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:17.003 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:17.003 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.003 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.003 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:17.004 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:17.004 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:17.004 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:17.004 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:17.004 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.004 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.004 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:17.004 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:17.004 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:17.004 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:17.004 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:17.005 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.005 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:17.005 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:17.005 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:17.005 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:17.005 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:17.005 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-419" 2023-10-05T12:49:17.005 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.005 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:17.005 INFO:teuthology.orchestra.run.smithi012.stdout:_____________________________ test_sse_kms_present _____________________________ 2023-10-05T12:49:17.005 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.005 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:17.006 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.006 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:17.006 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:17.006 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.006 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:17.006 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:17.006 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:17.006 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:17.006 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:17.006 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.006 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:17.006 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:17.007 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.007 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.007 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:17.007 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:17.007 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.007 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.007 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:17.007 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.007 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:17.007 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:17.007 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.007 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.008 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:17.008 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:17.008 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.008 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:17.008 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:17.008 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:17.008 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:17.008 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:17.008 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:17.008 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:17.008 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.008 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:17.008 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:17.009 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:17.009 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:17.009 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:17.009 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:17.009 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:17.009 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:17.009 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:17.009 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.009 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:17.009 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:17.009 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:17.009 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:17.010 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.010 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:17.010 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:17.010 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:17.010 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:17.010 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.010 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.010 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:17.010 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:17.010 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:17.010 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:17.010 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.011 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.011 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:17.011 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:17.011 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:17.011 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.011 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:17.011 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.011 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:17.011 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:17.011 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.011 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:17.011 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:17.012 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:17.012 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:17.012 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:17.012 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:17.012 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.012 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:17.012 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.012 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:17.012 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.012 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:17.012 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:17.012 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.013 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:17.013 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.013 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:17.013 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:17.013 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:17.013 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:17.013 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:17.013 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:17.013 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:17.013 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:17.013 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:17.013 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:17.014 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:17.014 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:17.014 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:17.014 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.014 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:17.014 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:17.014 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:17.014 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:17.014 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:17.014 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:17.014 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:17.015 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:17.015 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:17.015 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:17.015 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:17.015 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.015 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.015 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:17.015 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.015 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:17.015 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:17.015 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:17.015 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:17.016 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:17.016 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:17.016 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:17.016 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:17.016 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:17.016 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:17.016 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:17.016 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:17.016 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:17.016 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:17.016 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:17.017 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:17.017 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:17.017 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:17.017 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:17.017 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:17.017 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:17.017 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:17.017 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:17.017 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:17.017 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:17.017 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:17.017 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:17.018 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:17.018 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.018 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.018 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:17.018 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.018 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:17.018 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:17.018 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.018 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:17.018 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:17.018 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:17.018 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:17.019 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:17.019 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.019 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:17.019 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:17.019 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.019 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.019 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:17.019 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:17.019 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.019 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.019 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:17.020 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:17.020 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:17.020 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:17.020 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:17.020 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.020 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.020 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:17.020 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:17.020 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:17.020 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.020 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:17.020 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.020 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:17.021 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.021 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:17.021 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.021 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.encryption 2023-10-05T12:49:17.021 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.fails_on_dbstore 2023-10-05T12:49:17.021 INFO:teuthology.orchestra.run.smithi012.stdout: def test_sse_kms_present(): 2023-10-05T12:49:17.021 INFO:teuthology.orchestra.run.smithi012.stdout: kms_keyid = get_main_kms_keyid() 2023-10-05T12:49:17.021 INFO:teuthology.orchestra.run.smithi012.stdout:> bucket_name = get_new_bucket() 2023-10-05T12:49:17.021 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.021 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:9741: 2023-10-05T12:49:17.021 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.021 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-10-05T12:49:17.022 INFO:teuthology.orchestra.run.smithi012.stdout: client.create_bucket(Bucket=name) 2023-10-05T12:49:17.022 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:17.022 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:17.022 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:17.022 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:17.022 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:17.022 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:17.022 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:17.022 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:17.022 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:17.022 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:17.022 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:17.023 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:17.023 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:17.023 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:17.023 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:17.023 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:17.023 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:17.023 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:17.023 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:17.023 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:17.023 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:17.023 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:17.023 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:17.024 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:17.024 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:17.024 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:17.024 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:17.024 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:17.024 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:17.024 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:17.024 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:17.024 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:17.024 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:17.024 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:17.024 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.024 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.025 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:17.025 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:17.025 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.025 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:17.025 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.025 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:17.025 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:17.025 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:17.025 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:17.025 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:17.025 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:17.026 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:17.026 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:17.026 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:17.026 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:17.026 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:17.026 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:17.026 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:17.026 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.026 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:17.026 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:17.026 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:17.026 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:17.027 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:17.027 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:17.027 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:17.027 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:17.027 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:17.027 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:17.027 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:17.027 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.027 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.027 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:17.027 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:17.027 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:17.028 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:17.028 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:17.028 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.028 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.028 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:17.028 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:17.028 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:17.028 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:17.028 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:17.028 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.028 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:17.028 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:17.029 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:17.029 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:17.029 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:17.029 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-420" 2023-10-05T12:49:17.029 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.029 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:17.029 INFO:teuthology.orchestra.run.smithi012.stdout:_____________________________ test_sse_kms_no_key ______________________________ 2023-10-05T12:49:17.029 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.029 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:17.029 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.029 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:17.029 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:17.030 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.030 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:17.030 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:17.030 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:17.030 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:17.030 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:17.030 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.030 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:17.030 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:17.030 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.030 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.030 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:17.031 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:17.031 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.031 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.031 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:17.031 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.031 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:17.031 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:17.031 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.031 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.031 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:17.031 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:17.031 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.032 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:17.032 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:17.032 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:17.032 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:17.032 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:17.032 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:17.032 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:17.032 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.032 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:17.032 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:17.032 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:17.032 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:17.033 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:17.033 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:17.033 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:17.033 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:17.033 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:17.033 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.033 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:17.033 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:17.033 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:17.033 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:17.033 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.033 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:17.034 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:17.034 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:17.034 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:17.034 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.034 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.034 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:17.034 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:17.034 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:17.034 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:17.034 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.034 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.035 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:17.035 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:17.035 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:17.035 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.035 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:17.035 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.035 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:17.035 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:17.035 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.035 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:17.035 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:17.035 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:17.036 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:17.036 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:17.036 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:17.036 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.036 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:17.036 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.036 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:17.036 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.036 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:17.036 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:17.036 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.037 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:17.037 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.037 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:17.037 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:17.037 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:17.037 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:17.037 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:17.037 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:17.037 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:17.037 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:17.037 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:17.037 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:17.038 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:17.038 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:17.038 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:17.038 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.038 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:17.038 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:17.038 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:17.038 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:17.038 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:17.038 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:17.038 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:17.038 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:17.039 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:17.039 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:17.039 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:17.039 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.039 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.039 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:17.039 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.039 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:17.039 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:17.039 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:17.039 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:17.039 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:17.040 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:17.040 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:17.040 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:17.040 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:17.040 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:17.040 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:17.040 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:17.040 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:17.040 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:17.040 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:17.040 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:17.040 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:17.041 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:17.041 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:17.041 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:17.041 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:17.041 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:17.041 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:17.041 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:17.041 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:17.041 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:17.041 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:17.041 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:17.041 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.042 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.042 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:17.042 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.042 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:17.042 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:17.042 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.042 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:17.042 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:17.042 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:17.042 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:17.042 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:17.043 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.043 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:17.043 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:17.043 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.043 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.043 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:17.043 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:17.043 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.043 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.043 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:17.043 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:17.043 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:17.043 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:17.044 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:17.044 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.044 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.044 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:17.044 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:17.044 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:17.044 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.044 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:17.044 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.044 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:17.044 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.045 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:17.045 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.045 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.encryption 2023-10-05T12:49:17.045 INFO:teuthology.orchestra.run.smithi012.stdout: def test_sse_kms_no_key(): 2023-10-05T12:49:17.045 INFO:teuthology.orchestra.run.smithi012.stdout:> bucket_name = get_new_bucket() 2023-10-05T12:49:17.045 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.045 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:9760: 2023-10-05T12:49:17.045 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.045 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-10-05T12:49:17.045 INFO:teuthology.orchestra.run.smithi012.stdout: client.create_bucket(Bucket=name) 2023-10-05T12:49:17.045 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:17.045 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:17.046 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:17.046 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:17.046 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:17.046 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:17.046 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:17.046 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:17.046 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:17.046 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:17.046 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:17.046 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:17.046 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:17.046 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:17.047 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:17.047 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:17.047 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:17.047 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:17.047 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:17.047 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:17.047 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:17.047 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:17.047 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:17.047 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:17.047 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:17.047 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:17.048 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:17.048 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:17.048 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:17.048 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:17.048 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:17.048 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:17.048 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:17.048 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:17.048 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.048 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.049 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:17.049 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:17.049 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.049 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:17.049 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.049 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:17.049 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:17.049 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:17.049 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:17.049 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:17.049 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:17.049 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:17.050 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:17.050 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:17.050 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:17.050 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:17.050 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:17.050 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:17.050 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.050 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:17.050 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:17.050 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:17.050 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:17.050 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:17.051 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:17.051 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:17.051 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:17.051 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:17.051 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:17.051 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:17.051 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.051 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.051 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:17.051 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:17.051 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:17.051 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:17.052 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:17.052 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.052 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.052 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:17.052 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:17.052 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:17.052 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:17.052 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:17.052 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.052 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:17.052 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:17.052 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:17.053 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:17.053 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:17.053 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-421" 2023-10-05T12:49:17.053 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.053 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:17.053 INFO:teuthology.orchestra.run.smithi012.stdout:__________________________ test_sse_kms_not_declared ___________________________ 2023-10-05T12:49:17.053 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.053 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:17.053 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.053 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:17.053 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:17.053 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.054 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:17.054 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:17.054 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:17.054 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:17.054 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:17.054 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.054 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:17.054 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:17.054 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.054 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.054 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:17.054 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:17.055 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.055 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.055 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:17.055 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.055 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:17.055 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:17.055 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.055 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.055 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:17.055 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:17.055 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.056 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:17.056 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:17.056 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:17.056 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:17.056 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:17.056 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:17.056 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:17.056 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.056 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:17.056 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:17.056 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:17.056 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:17.057 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:17.057 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:17.057 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:17.057 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:17.057 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:17.057 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.057 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:17.057 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:17.057 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:17.057 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:17.057 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.057 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:17.057 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:17.058 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:17.058 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:17.058 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.058 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.058 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:17.058 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:17.058 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:17.058 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:17.058 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.058 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.058 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:17.058 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:17.059 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:17.059 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.059 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:17.059 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.059 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:17.059 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:17.059 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.059 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:17.059 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:17.059 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:17.059 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:17.059 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:17.060 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:17.060 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.060 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:17.060 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.060 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:17.060 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.060 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:17.060 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:17.060 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.060 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:17.060 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.061 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:17.061 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:17.061 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:17.061 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:17.061 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:17.061 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:17.061 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:17.061 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:17.061 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:17.061 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:17.061 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:17.062 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:17.062 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:17.062 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.062 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:17.062 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:17.062 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:17.062 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:17.062 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:17.062 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:17.062 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:17.062 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:17.063 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:17.063 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:17.063 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:17.063 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.063 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.063 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:17.063 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.063 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:17.063 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:17.063 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:17.063 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:17.064 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:17.064 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:17.064 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:17.064 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:17.064 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:17.064 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:17.064 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:17.064 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:17.064 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:17.064 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:17.064 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:17.064 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:17.065 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:17.065 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:17.065 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:17.065 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:17.065 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:17.065 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:17.065 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:17.065 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:17.065 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:17.065 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:17.065 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:17.065 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:17.066 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.066 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.066 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:17.066 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.066 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:17.066 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:17.066 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.066 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:17.066 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:17.066 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:17.066 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:17.066 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:17.067 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.067 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:17.067 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:17.067 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.067 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.067 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:17.067 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:17.067 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.067 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.067 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:17.067 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:17.067 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:17.068 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:17.068 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:17.068 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.068 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.068 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:17.068 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:17.068 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:17.068 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.068 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:17.068 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.068 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:17.068 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.069 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:17.069 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.069 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.encryption 2023-10-05T12:49:17.069 INFO:teuthology.orchestra.run.smithi012.stdout: def test_sse_kms_not_declared(): 2023-10-05T12:49:17.069 INFO:teuthology.orchestra.run.smithi012.stdout:> bucket_name = get_new_bucket() 2023-10-05T12:49:17.069 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.069 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:9776: 2023-10-05T12:49:17.069 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.069 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-10-05T12:49:17.069 INFO:teuthology.orchestra.run.smithi012.stdout: client.create_bucket(Bucket=name) 2023-10-05T12:49:17.069 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:17.069 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:17.069 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:17.070 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:17.070 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:17.070 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:17.070 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:17.070 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:17.070 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:17.070 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:17.070 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:17.070 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:17.070 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:17.070 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:17.070 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:17.071 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:17.071 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:17.071 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:17.071 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:17.071 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:17.071 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:17.071 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:17.071 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:17.071 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:17.071 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:17.071 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:17.071 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:17.072 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:17.072 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:17.072 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:17.072 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:17.072 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:17.072 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:17.072 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:17.072 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.072 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.072 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:17.072 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:17.073 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.073 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:17.073 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.073 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:17.073 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:17.073 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:17.073 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:17.073 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:17.073 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:17.073 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:17.073 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:17.073 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:17.074 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:17.074 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:17.074 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:17.074 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:17.074 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.074 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:17.074 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:17.074 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:17.074 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:17.074 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:17.074 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:17.074 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:17.075 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:17.075 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:17.075 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:17.075 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:17.075 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.075 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.075 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:17.075 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:17.075 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:17.075 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:17.076 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:17.076 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.076 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.076 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:17.076 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:17.076 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:17.076 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:17.076 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:17.076 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.076 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:17.076 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:17.076 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:17.077 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:17.077 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:17.077 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-422" 2023-10-05T12:49:17.077 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.077 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:17.077 INFO:teuthology.orchestra.run.smithi012.stdout:________________________ test_sse_kms_multipart_upload _________________________ 2023-10-05T12:49:17.077 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.077 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:17.077 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.077 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:17.077 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:17.077 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.078 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:17.078 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:17.078 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:17.078 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:17.078 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:17.078 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.078 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:17.078 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:17.078 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.078 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.078 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:17.079 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:17.079 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.079 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.079 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:17.079 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.079 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:17.079 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:17.079 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.079 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.079 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:17.079 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:17.080 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.080 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:17.080 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:17.080 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:17.080 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:17.080 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:17.080 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:17.080 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:17.080 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.080 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:17.080 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:17.080 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:17.081 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:17.081 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:17.081 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:17.081 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:17.081 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:17.081 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:17.081 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.081 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:17.081 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:17.081 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:17.081 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:17.082 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.082 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:17.082 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:17.082 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:17.082 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:17.082 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.082 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.082 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:17.082 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:17.082 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:17.082 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:17.083 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.083 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.083 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:17.083 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:17.083 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:17.083 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.083 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:17.083 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.083 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:17.083 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:17.083 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.083 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:17.084 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:17.084 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:17.084 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:17.084 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:17.084 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:17.084 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.084 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:17.084 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.084 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:17.084 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.084 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:17.084 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:17.084 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.085 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:17.085 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.085 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:17.085 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:17.085 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:17.085 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:17.085 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:17.085 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:17.085 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:17.085 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:17.085 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:17.085 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:17.085 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:17.086 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:17.086 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:17.086 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.086 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:17.086 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:17.086 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:17.086 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:17.086 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:17.086 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:17.086 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:17.086 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:17.086 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:17.086 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:17.087 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:17.087 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.087 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.087 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:17.087 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.087 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:17.087 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:17.087 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:17.087 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:17.087 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:17.087 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:17.087 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:17.087 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:17.088 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:17.088 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:17.088 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:17.088 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:17.088 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:17.088 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:17.088 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:17.088 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:17.088 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:17.088 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:17.088 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:17.088 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:17.089 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:17.089 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:17.089 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:17.089 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:17.089 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:17.089 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:17.089 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:17.089 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:17.089 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.089 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.089 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:17.089 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.090 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:17.090 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:17.090 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.090 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:17.090 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:17.090 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:17.090 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:17.090 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:17.090 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.090 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:17.090 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:17.091 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.091 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.091 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:17.091 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:17.091 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.091 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.091 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:17.091 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:17.091 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:17.091 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:17.091 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:17.091 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.092 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.092 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:17.092 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:17.092 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:17.092 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.092 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:17.092 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.092 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:17.092 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.092 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:17.092 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.093 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.encryption 2023-10-05T12:49:17.093 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.fails_on_dbstore 2023-10-05T12:49:17.093 INFO:teuthology.orchestra.run.smithi012.stdout: def test_sse_kms_multipart_upload(): 2023-10-05T12:49:17.093 INFO:teuthology.orchestra.run.smithi012.stdout: kms_keyid = get_main_kms_keyid() 2023-10-05T12:49:17.093 INFO:teuthology.orchestra.run.smithi012.stdout:> bucket_name = get_new_bucket() 2023-10-05T12:49:17.093 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.093 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:9795: 2023-10-05T12:49:17.093 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.093 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-10-05T12:49:17.093 INFO:teuthology.orchestra.run.smithi012.stdout: client.create_bucket(Bucket=name) 2023-10-05T12:49:17.093 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:17.093 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:17.094 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:17.094 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:17.094 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:17.094 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:17.094 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:17.094 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:17.094 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:17.094 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:17.094 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:17.094 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:17.094 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:17.094 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:17.095 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:17.095 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:17.095 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:17.095 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:17.095 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:17.095 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:17.095 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:17.095 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:17.095 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:17.095 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:17.095 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:17.096 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:17.096 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:17.096 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:17.096 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:17.096 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:17.096 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:17.096 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:17.096 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:17.096 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:17.096 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.096 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.096 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:17.096 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:17.097 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.097 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:17.097 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.097 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:17.097 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:17.097 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:17.097 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:17.097 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:17.097 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:17.097 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:17.097 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:17.097 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:17.097 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:17.098 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:17.098 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:17.098 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:17.098 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.098 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:17.098 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:17.098 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:17.098 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:17.098 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:17.098 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:17.098 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:17.098 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:17.099 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:17.099 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:17.099 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:17.099 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.099 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.099 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:17.099 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:17.099 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:17.099 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:17.099 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:17.099 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.099 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.100 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:17.100 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:17.100 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:17.100 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:17.100 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:17.100 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.100 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:17.100 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:17.100 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:17.100 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:17.100 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:17.100 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-423" 2023-10-05T12:49:17.100 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.101 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:17.101 INFO:teuthology.orchestra.run.smithi012.stdout:___________________ test_sse_kms_multipart_invalid_chunks_1 ____________________ 2023-10-05T12:49:17.101 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.101 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:17.101 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.101 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:17.101 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:17.101 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.101 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:17.101 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:17.101 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:17.101 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:17.102 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:17.102 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.102 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:17.102 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:17.102 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.102 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.102 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:17.102 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:17.102 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.102 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.102 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:17.102 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.102 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:17.103 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:17.103 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.103 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.103 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:17.103 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:17.103 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.103 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:17.103 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:17.103 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:17.103 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:17.103 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:17.103 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:17.103 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:17.104 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.104 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:17.104 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:17.104 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:17.104 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:17.104 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:17.104 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:17.104 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:17.104 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:17.104 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:17.104 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.104 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:17.105 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:17.105 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:17.105 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:17.105 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.105 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:17.105 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:17.105 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:17.105 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:17.105 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.105 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.105 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:17.105 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:17.105 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:17.105 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:17.106 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.106 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.106 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:17.106 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:17.106 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:17.106 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.106 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:17.106 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.106 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:17.106 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:17.106 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.107 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:17.107 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:17.107 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:17.107 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:17.107 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:17.107 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:17.107 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.107 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:17.107 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.107 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:17.107 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.107 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:17.107 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:17.108 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.108 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:17.108 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.108 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:17.108 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:17.108 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:17.108 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:17.108 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:17.108 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:17.108 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:17.108 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:17.108 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:17.109 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:17.109 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:17.109 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:17.109 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:17.109 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.109 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:17.109 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:17.109 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:17.109 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:17.109 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:17.109 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:17.109 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:17.110 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:17.110 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:17.110 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:17.110 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:17.110 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.110 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.110 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:17.110 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.110 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:17.110 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:17.110 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:17.110 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:17.111 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:17.111 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:17.111 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:17.111 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:17.111 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:17.111 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:17.111 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:17.111 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:17.111 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:17.111 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:17.111 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:17.111 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:17.112 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:17.112 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:17.112 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:17.112 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:17.112 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:17.112 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:17.112 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:17.112 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:17.112 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:17.112 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:17.112 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:17.112 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:17.113 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.113 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.113 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:17.113 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.113 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:17.113 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:17.113 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.113 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:17.113 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:17.113 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:17.113 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:17.113 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:17.114 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.114 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:17.114 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:17.114 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.114 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.114 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:17.114 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:17.114 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.114 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.114 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:17.114 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:17.114 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:17.114 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:17.115 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:17.115 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.115 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.115 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:17.115 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:17.115 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:17.115 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.115 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:17.115 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.115 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:17.115 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.115 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:17.115 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.116 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.encryption 2023-10-05T12:49:17.116 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.fails_on_dbstore 2023-10-05T12:49:17.116 INFO:teuthology.orchestra.run.smithi012.stdout: def test_sse_kms_multipart_invalid_chunks_1(): 2023-10-05T12:49:17.116 INFO:teuthology.orchestra.run.smithi012.stdout: kms_keyid = get_main_kms_keyid() 2023-10-05T12:49:17.116 INFO:teuthology.orchestra.run.smithi012.stdout: kms_keyid2 = get_secondary_kms_keyid() 2023-10-05T12:49:17.116 INFO:teuthology.orchestra.run.smithi012.stdout:> bucket_name = get_new_bucket() 2023-10-05T12:49:17.116 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.116 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:9841: 2023-10-05T12:49:17.116 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.116 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-10-05T12:49:17.116 INFO:teuthology.orchestra.run.smithi012.stdout: client.create_bucket(Bucket=name) 2023-10-05T12:49:17.116 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:17.116 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:17.117 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:17.117 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:17.117 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:17.117 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:17.117 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:17.117 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:17.117 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:17.117 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:17.117 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:17.117 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:17.117 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:17.118 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:17.118 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:17.118 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:17.118 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:17.118 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:17.118 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:17.118 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:17.118 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:17.118 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:17.118 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:17.118 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:17.119 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:17.119 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:17.119 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:17.119 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:17.119 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:17.119 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:17.119 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:17.119 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:17.119 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:17.119 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:17.119 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.120 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.120 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:17.120 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:17.120 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.120 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:17.120 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.120 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:17.120 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:17.120 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:17.120 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:17.120 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:17.120 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:17.120 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:17.121 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:17.121 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:17.121 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:17.121 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:17.121 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:17.121 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:17.121 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.121 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:17.121 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:17.121 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:17.121 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:17.121 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:17.121 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:17.122 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:17.122 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:17.122 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:17.122 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:17.122 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:17.122 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.122 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.122 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:17.122 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:17.122 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:17.122 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:17.122 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:17.123 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.123 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.123 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:17.123 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:17.123 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:17.123 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:17.123 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:17.123 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.123 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:17.123 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:17.123 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:17.123 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:17.124 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:17.124 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-424" 2023-10-05T12:49:17.124 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.124 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:17.124 INFO:teuthology.orchestra.run.smithi012.stdout:___________________ test_sse_kms_multipart_invalid_chunks_2 ____________________ 2023-10-05T12:49:17.124 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.124 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:17.124 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.124 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:17.124 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:17.124 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.124 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:17.124 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:17.125 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:17.125 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:17.125 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:17.125 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.125 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:17.125 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:17.125 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.125 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.125 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:17.125 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:17.125 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.125 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.125 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:17.126 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.126 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:17.126 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:17.126 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.126 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.126 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:17.126 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:17.126 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.126 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:17.126 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:17.126 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:17.126 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:17.126 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:17.127 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:17.127 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:17.127 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.127 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:17.127 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:17.127 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:17.127 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:17.127 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:17.127 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:17.127 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:17.127 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:17.127 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:17.127 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.128 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:17.128 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:17.128 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:17.128 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:17.128 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.128 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:17.128 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:17.128 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:17.128 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:17.128 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.128 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.128 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:17.129 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:17.129 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:17.129 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:17.129 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.129 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.129 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:17.129 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:17.129 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:17.129 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.129 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:17.129 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.129 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:17.129 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:17.130 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.130 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:17.130 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:17.130 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:17.130 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:17.130 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:17.130 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:17.130 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.130 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:17.130 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.130 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:17.130 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.131 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:17.131 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:17.131 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.131 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:17.131 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.131 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:17.131 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:17.131 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:17.131 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:17.131 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:17.131 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:17.131 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:17.132 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:17.132 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:17.132 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:17.132 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:17.132 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:17.132 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:17.132 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.132 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:17.132 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:17.132 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:17.132 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:17.132 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:17.133 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:17.133 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:17.133 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:17.133 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:17.133 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:17.133 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:17.133 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.133 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.133 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:17.133 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.133 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:17.133 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:17.133 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:17.134 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:17.134 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:17.134 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:17.134 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:17.134 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:17.134 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:17.134 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:17.134 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:17.134 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:17.134 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:17.134 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:17.135 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:17.135 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:17.135 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:17.135 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:17.135 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:17.135 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:17.135 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:17.135 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:17.135 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:17.135 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:17.135 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:17.135 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:17.135 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:17.136 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:17.136 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.136 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.136 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:17.136 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.136 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:17.136 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:17.136 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.136 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:17.136 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:17.136 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:17.136 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:17.137 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:17.137 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.137 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:17.137 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:17.137 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.137 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.137 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:17.137 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:17.137 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.137 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.137 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:17.137 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:17.138 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:17.138 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:17.138 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:17.138 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.138 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.138 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:17.138 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:17.138 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:17.138 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.138 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:17.138 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.138 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:17.139 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.139 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:17.139 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.139 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.encryption 2023-10-05T12:49:17.139 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.fails_on_dbstore 2023-10-05T12:49:17.139 INFO:teuthology.orchestra.run.smithi012.stdout: def test_sse_kms_multipart_invalid_chunks_2(): 2023-10-05T12:49:17.139 INFO:teuthology.orchestra.run.smithi012.stdout: kms_keyid = get_main_kms_keyid() 2023-10-05T12:49:17.139 INFO:teuthology.orchestra.run.smithi012.stdout:> bucket_name = get_new_bucket() 2023-10-05T12:49:17.139 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.139 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:9867: 2023-10-05T12:49:17.139 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.139 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-10-05T12:49:17.140 INFO:teuthology.orchestra.run.smithi012.stdout: client.create_bucket(Bucket=name) 2023-10-05T12:49:17.140 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:17.140 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:17.140 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:17.140 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:17.140 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:17.140 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:17.140 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:17.140 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:17.140 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:17.140 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:17.140 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:17.141 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:17.141 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:17.141 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:17.141 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:17.141 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:17.141 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:17.141 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:17.141 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:17.141 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:17.141 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:17.141 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:17.141 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:17.142 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:17.142 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:17.142 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:17.142 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:17.142 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:17.142 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:17.142 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:17.142 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:17.142 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:17.142 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:17.142 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:17.142 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.143 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.143 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:17.143 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:17.143 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.143 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:17.143 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.143 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:17.143 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:17.143 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:17.143 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:17.143 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:17.143 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:17.143 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:17.144 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:17.144 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:17.144 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:17.144 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:17.144 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:17.144 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:17.144 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.144 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:17.144 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:17.144 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:17.144 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:17.144 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:17.144 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:17.145 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:17.145 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:17.145 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:17.145 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:17.145 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:17.145 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.145 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.145 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:17.145 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:17.145 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:17.145 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:17.145 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:17.146 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.146 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.146 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:17.146 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:17.146 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:17.146 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:17.146 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:17.146 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.146 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:17.146 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:17.146 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:17.146 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:17.147 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:17.147 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-425" 2023-10-05T12:49:17.147 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.147 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:17.147 INFO:teuthology.orchestra.run.smithi012.stdout:________________ test_sse_kms_post_object_authenticated_request ________________ 2023-10-05T12:49:17.147 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.147 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:17.147 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.147 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:17.147 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:17.147 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.147 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:17.148 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:17.148 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:17.148 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:17.148 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:17.148 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.148 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:17.148 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:17.148 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.148 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.148 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:17.148 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:17.148 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.149 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.149 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:17.149 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.149 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:17.149 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:17.149 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.149 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.149 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:17.149 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:17.149 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.149 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:17.149 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:17.150 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:17.150 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:17.150 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:17.150 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:17.150 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:17.150 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.150 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:17.150 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:17.150 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:17.150 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:17.150 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:17.150 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:17.151 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:17.151 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:17.151 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:17.151 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.151 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:17.151 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:17.151 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:17.151 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:17.151 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.151 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:17.151 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:17.151 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:17.152 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:17.152 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.152 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.152 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:17.152 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:17.152 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:17.152 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:17.152 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.152 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.152 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:17.152 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:17.152 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:17.153 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.153 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:17.153 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.153 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:17.153 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:17.153 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.153 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:17.153 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:17.153 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:17.153 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:17.153 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:17.154 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:17.154 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.154 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:17.154 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.154 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:17.154 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.154 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:17.154 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:17.154 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.154 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:17.154 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.154 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:17.155 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:17.155 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:17.155 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:17.155 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:17.155 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:17.155 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:17.155 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:17.155 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:17.155 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:17.155 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:17.155 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:17.156 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:17.156 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.156 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:17.156 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:17.156 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:17.156 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:17.156 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:17.156 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:17.156 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:17.156 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:17.156 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:17.156 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:17.156 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:17.157 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.157 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.157 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:17.157 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.157 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:17.157 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:17.157 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:17.157 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:17.157 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:17.157 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:17.157 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:17.157 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:17.158 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:17.158 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:17.158 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:17.158 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:17.158 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:17.158 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:17.158 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:17.158 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:17.158 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:17.158 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:17.158 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:17.158 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:17.159 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:17.159 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:17.159 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:17.159 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:17.159 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:17.159 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:17.159 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:17.159 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:17.159 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.159 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.159 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:17.159 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.160 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:17.160 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:17.160 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.160 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:17.160 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:17.160 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:17.160 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:17.160 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:17.160 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.160 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:17.160 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:17.160 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.161 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.161 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:17.161 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:17.161 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.161 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.161 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:17.161 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:17.161 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:17.162 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:17.162 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:17.162 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.162 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.162 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:17.162 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:17.162 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:17.162 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.162 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:17.165 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.165 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:17.165 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.165 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:17.165 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.165 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.encryption 2023-10-05T12:49:17.165 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.fails_on_dbstore 2023-10-05T12:49:17.165 INFO:teuthology.orchestra.run.smithi012.stdout: def test_sse_kms_post_object_authenticated_request(): 2023-10-05T12:49:17.165 INFO:teuthology.orchestra.run.smithi012.stdout: kms_keyid = get_main_kms_keyid() 2023-10-05T12:49:17.166 INFO:teuthology.orchestra.run.smithi012.stdout:> bucket_name = get_new_bucket() 2023-10-05T12:49:17.166 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.166 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:9893: 2023-10-05T12:49:17.166 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.166 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-10-05T12:49:17.166 INFO:teuthology.orchestra.run.smithi012.stdout: client.create_bucket(Bucket=name) 2023-10-05T12:49:17.166 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:17.166 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:17.166 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:17.166 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:17.166 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:17.167 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:17.167 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:17.167 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:17.167 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:17.167 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:17.167 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:17.167 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:17.167 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:17.167 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:17.167 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:17.167 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:17.167 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:17.167 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:17.168 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:17.168 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:17.168 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:17.168 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:17.168 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:17.168 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:17.168 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:17.168 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:17.168 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:17.168 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:17.168 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:17.168 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:17.169 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:17.169 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:17.169 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:17.169 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:17.169 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.169 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.169 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:17.169 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:17.169 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.169 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:17.169 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.169 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:17.169 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:17.170 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:17.170 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:17.170 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:17.170 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:17.170 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:17.170 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:17.170 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:17.170 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:17.170 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:17.170 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:17.170 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:17.170 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.170 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:17.171 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:17.171 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:17.171 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:17.171 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:17.171 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:17.171 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:17.171 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:17.171 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:17.171 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:17.171 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:17.171 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.171 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.172 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:17.172 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:17.172 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:17.172 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:17.172 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:17.172 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.172 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.172 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:17.172 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:17.172 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:17.172 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:17.172 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:17.172 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.173 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:17.173 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:17.173 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:17.173 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:17.173 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:17.173 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-426" 2023-10-05T12:49:17.173 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.173 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:17.173 INFO:teuthology.orchestra.run.smithi012.stdout:___________________________ test_sse_kms_transfer_1b ___________________________ 2023-10-05T12:49:17.173 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.173 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:17.173 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.173 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:17.174 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:17.174 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.174 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:17.174 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:17.174 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:17.174 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:17.174 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:17.174 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.174 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:17.174 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:17.174 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.174 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.175 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:17.175 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:17.175 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.175 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.175 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:17.175 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.175 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:17.175 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:17.175 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.175 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.175 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:17.175 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:17.176 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.176 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:17.176 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:17.176 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:17.176 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:17.176 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:17.176 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:17.176 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:17.176 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.176 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:17.176 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:17.176 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:17.177 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:17.177 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:17.177 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:17.177 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:17.177 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:17.177 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:17.177 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.177 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:17.177 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:17.177 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:17.177 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:17.177 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.178 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:17.178 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:17.178 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:17.178 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:17.178 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.178 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.178 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:17.178 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:17.178 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:17.178 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:17.179 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.179 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.179 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:17.179 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:17.179 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:17.179 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.179 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:17.179 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.179 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:17.179 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:17.179 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.179 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:17.180 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:17.180 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:17.180 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:17.180 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:17.180 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:17.180 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.180 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:17.180 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.180 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:17.180 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.180 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:17.180 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:17.181 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.181 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:17.181 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.181 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:17.181 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:17.181 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:17.181 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:17.181 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:17.181 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:17.181 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:17.181 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:17.181 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:17.181 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:17.182 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:17.182 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:17.182 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:17.182 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.182 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:17.182 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:17.182 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:17.182 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:17.182 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:17.182 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:17.182 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:17.182 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:17.183 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:17.183 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:17.183 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:17.183 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.183 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.183 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:17.183 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.183 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:17.183 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:17.183 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:17.183 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:17.183 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:17.184 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:17.184 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:17.184 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:17.184 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:17.184 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:17.184 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:17.184 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:17.184 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:17.184 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:17.184 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:17.184 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:17.185 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:17.185 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:17.185 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:17.185 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:17.185 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:17.185 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:17.185 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:17.185 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:17.185 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:17.185 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:17.185 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:17.185 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:17.186 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.186 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.186 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:17.186 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.186 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:17.186 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:17.186 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.186 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:17.186 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:17.186 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:17.186 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:17.186 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:17.187 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.187 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:17.187 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:17.187 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.187 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.187 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:17.187 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:17.187 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.187 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.187 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:17.187 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:17.187 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:17.188 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:17.188 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:17.188 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.188 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.188 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:17.188 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:17.188 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:17.188 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.188 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:17.188 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.188 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:17.188 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.189 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:17.189 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.189 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.encryption 2023-10-05T12:49:17.189 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.fails_on_dbstore 2023-10-05T12:49:17.189 INFO:teuthology.orchestra.run.smithi012.stdout: def test_sse_kms_transfer_1b(): 2023-10-05T12:49:17.189 INFO:teuthology.orchestra.run.smithi012.stdout: kms_keyid = get_main_kms_keyid() 2023-10-05T12:49:17.189 INFO:teuthology.orchestra.run.smithi012.stdout: if kms_keyid is None: 2023-10-05T12:49:17.189 INFO:teuthology.orchestra.run.smithi012.stdout: pytest.skip('[s3 main] section missing kms_keyid') 2023-10-05T12:49:17.189 INFO:teuthology.orchestra.run.smithi012.stdout:> _test_sse_kms_customer_write(1, key_id = kms_keyid) 2023-10-05T12:49:17.189 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.190 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:9941: 2023-10-05T12:49:17.190 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.190 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:9689: in _test_sse_kms_customer_write 2023-10-05T12:49:17.190 INFO:teuthology.orchestra.run.smithi012.stdout: bucket_name = get_new_bucket() 2023-10-05T12:49:17.190 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-10-05T12:49:17.190 INFO:teuthology.orchestra.run.smithi012.stdout: client.create_bucket(Bucket=name) 2023-10-05T12:49:17.190 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:17.190 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:17.190 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:17.190 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:17.190 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:17.191 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:17.191 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:17.191 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:17.191 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:17.191 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:17.191 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:17.191 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:17.191 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:17.191 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:17.191 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:17.191 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:17.191 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:17.192 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:17.192 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:17.192 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:17.192 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:17.192 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:17.192 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:17.192 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:17.192 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:17.192 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:17.192 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:17.192 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:17.193 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:17.193 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:17.193 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:17.193 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:17.193 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:17.193 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:17.193 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.193 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.193 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:17.193 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:17.193 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.193 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:17.194 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.194 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:17.194 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:17.194 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:17.194 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:17.194 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:17.194 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:17.194 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:17.194 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:17.194 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:17.194 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:17.194 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:17.195 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:17.195 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:17.195 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.195 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:17.195 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:17.195 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:17.195 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:17.195 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:17.195 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:17.195 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:17.195 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:17.195 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:17.196 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:17.196 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:17.196 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.196 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.196 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:17.196 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:17.196 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:17.196 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:17.196 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:17.196 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.196 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.196 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:17.197 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:17.197 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:17.197 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:17.197 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:17.197 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.197 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:17.197 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:17.197 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:17.197 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:17.197 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:17.197 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-427" 2023-10-05T12:49:17.197 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.198 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:17.198 INFO:teuthology.orchestra.run.smithi012.stdout:__________________________ test_sse_kms_transfer_1kb ___________________________ 2023-10-05T12:49:17.198 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.198 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:17.198 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.198 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:17.198 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:17.198 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.198 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:17.198 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:17.198 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:17.199 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:17.199 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:17.199 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.199 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:17.199 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:17.199 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.199 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.199 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:17.199 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:17.199 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.199 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.199 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:17.200 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.200 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:17.200 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:17.200 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.200 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.200 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:17.200 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:17.200 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.200 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:17.200 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:17.200 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:17.200 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:17.201 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:17.201 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:17.201 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:17.201 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.201 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:17.201 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:17.201 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:17.201 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:17.201 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:17.201 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:17.201 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:17.202 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:17.202 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:17.202 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.202 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:17.202 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:17.202 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:17.202 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:17.202 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.202 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:17.202 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:17.202 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:17.202 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:17.203 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.203 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.203 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:17.203 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:17.203 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:17.203 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:17.203 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.203 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.203 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:17.203 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:17.203 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:17.203 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.204 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:17.204 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.204 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:17.204 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:17.204 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.204 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:17.204 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:17.204 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:17.204 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:17.204 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:17.204 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:17.204 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.205 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:17.205 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.205 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:17.205 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.205 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:17.205 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:17.205 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.205 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:17.205 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.205 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:17.205 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:17.205 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:17.206 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:17.206 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:17.206 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:17.206 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:17.206 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:17.206 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:17.206 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:17.206 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:17.206 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:17.206 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:17.206 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.206 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:17.207 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:17.207 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:17.207 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:17.207 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:17.207 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:17.207 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:17.207 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:17.207 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:17.207 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:17.207 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:17.207 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.208 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.208 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:17.208 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.208 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:17.208 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:17.208 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:17.208 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:17.208 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:17.208 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:17.208 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:17.208 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:17.208 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:17.209 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:17.209 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:17.209 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:17.209 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:17.209 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:17.209 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:17.209 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:17.209 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:17.209 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:17.209 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:17.209 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:17.210 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:17.210 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:17.210 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:17.210 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:17.210 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:17.210 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:17.210 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:17.210 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:17.210 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.210 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.210 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:17.211 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.211 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:17.211 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:17.211 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.211 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:17.211 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:17.211 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:17.211 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:17.211 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:17.211 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.211 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:17.211 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:17.211 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.212 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.212 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:17.212 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:17.212 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.212 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.212 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:17.212 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:17.212 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:17.212 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:17.212 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:17.212 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.212 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.212 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:17.213 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:17.213 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:17.213 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.213 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:17.213 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.213 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:17.213 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.213 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:17.213 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.213 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.encryption 2023-10-05T12:49:17.213 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.fails_on_dbstore 2023-10-05T12:49:17.213 INFO:teuthology.orchestra.run.smithi012.stdout: def test_sse_kms_transfer_1kb(): 2023-10-05T12:49:17.214 INFO:teuthology.orchestra.run.smithi012.stdout: kms_keyid = get_main_kms_keyid() 2023-10-05T12:49:17.214 INFO:teuthology.orchestra.run.smithi012.stdout: if kms_keyid is None: 2023-10-05T12:49:17.214 INFO:teuthology.orchestra.run.smithi012.stdout: pytest.skip('[s3 main] section missing kms_keyid') 2023-10-05T12:49:17.214 INFO:teuthology.orchestra.run.smithi012.stdout:> _test_sse_kms_customer_write(1024, key_id = kms_keyid) 2023-10-05T12:49:17.214 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.214 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:9950: 2023-10-05T12:49:17.214 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.214 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:9689: in _test_sse_kms_customer_write 2023-10-05T12:49:17.214 INFO:teuthology.orchestra.run.smithi012.stdout: bucket_name = get_new_bucket() 2023-10-05T12:49:17.214 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-10-05T12:49:17.214 INFO:teuthology.orchestra.run.smithi012.stdout: client.create_bucket(Bucket=name) 2023-10-05T12:49:17.214 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:17.215 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:17.215 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:17.215 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:17.215 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:17.215 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:17.215 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:17.215 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:17.215 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:17.215 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:17.215 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:17.215 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:17.216 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:17.216 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:17.216 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:17.216 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:17.216 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:17.216 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:17.216 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:17.216 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:17.216 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:17.216 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:17.216 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:17.216 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:17.217 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:17.217 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:17.217 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:17.217 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:17.217 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:17.217 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:17.217 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:17.217 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:17.217 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:17.217 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:17.217 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.217 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.218 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:17.218 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:17.218 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.218 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:17.218 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.218 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:17.218 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:17.218 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:17.218 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:17.218 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:17.218 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:17.218 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:17.219 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:17.219 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:17.219 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:17.219 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:17.219 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:17.219 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:17.219 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.219 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:17.219 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:17.219 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:17.219 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:17.219 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:17.220 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:17.220 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:17.220 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:17.220 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:17.220 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:17.220 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:17.220 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.220 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.220 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:17.220 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:17.220 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:17.220 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:17.220 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:17.221 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.221 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.221 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:17.221 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:17.221 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:17.221 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:17.221 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:17.221 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.221 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:17.221 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:17.221 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:17.222 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:17.222 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:17.222 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-428" 2023-10-05T12:49:17.222 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.222 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:17.222 INFO:teuthology.orchestra.run.smithi012.stdout:__________________________ test_sse_kms_transfer_1MB ___________________________ 2023-10-05T12:49:17.222 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.222 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:17.222 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.222 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:17.222 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:17.222 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.223 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:17.223 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:17.223 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:17.223 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:17.223 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:17.223 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.223 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:17.223 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:17.223 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.223 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.223 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:17.223 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:17.224 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.224 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.224 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:17.224 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.224 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:17.224 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:17.224 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.224 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.224 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:17.224 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:17.224 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.224 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:17.225 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:17.225 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:17.225 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:17.225 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:17.225 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:17.225 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:17.225 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.225 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:17.225 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:17.225 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:17.225 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:17.225 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:17.226 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:17.226 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:17.226 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:17.226 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:17.226 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.226 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:17.226 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:17.226 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:17.226 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:17.226 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.226 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:17.227 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:17.227 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:17.227 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:17.227 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.227 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.227 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:17.227 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:17.227 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:17.227 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:17.227 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.227 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.227 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:17.228 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:17.228 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:17.228 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.228 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:17.228 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.228 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:17.228 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:17.228 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.228 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:17.228 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:17.228 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:17.228 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:17.229 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:17.229 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:17.229 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.229 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:17.229 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.229 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:17.229 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.229 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:17.229 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:17.229 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.229 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:17.229 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.230 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:17.230 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:17.230 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:17.230 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:17.230 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:17.230 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:17.230 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:17.230 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:17.230 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:17.230 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:17.230 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:17.231 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:17.231 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:17.231 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.231 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:17.231 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:17.231 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:17.231 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:17.231 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:17.231 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:17.231 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:17.231 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:17.231 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:17.231 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:17.232 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:17.232 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.232 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.232 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:17.232 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.232 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:17.232 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:17.232 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:17.232 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:17.232 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:17.232 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:17.232 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:17.233 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:17.233 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:17.233 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:17.233 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:17.233 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:17.233 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:17.233 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:17.233 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:17.233 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:17.233 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:17.233 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:17.233 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:17.234 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:17.234 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:17.234 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:17.234 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:17.234 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:17.234 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:17.234 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:17.234 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:17.234 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:17.234 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.234 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.234 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:17.235 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.235 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:17.235 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:17.235 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.235 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:17.235 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:17.235 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:17.235 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:17.235 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:17.235 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.235 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:17.235 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:17.236 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.236 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.236 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:17.236 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:17.236 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.236 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.236 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:17.236 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:17.236 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:17.236 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:17.236 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:17.237 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.237 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.237 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:17.237 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:17.237 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:17.237 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.237 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:17.237 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.237 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:17.237 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.237 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:17.237 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.238 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.encryption 2023-10-05T12:49:17.238 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.fails_on_dbstore 2023-10-05T12:49:17.238 INFO:teuthology.orchestra.run.smithi012.stdout: def test_sse_kms_transfer_1MB(): 2023-10-05T12:49:17.238 INFO:teuthology.orchestra.run.smithi012.stdout: kms_keyid = get_main_kms_keyid() 2023-10-05T12:49:17.238 INFO:teuthology.orchestra.run.smithi012.stdout: if kms_keyid is None: 2023-10-05T12:49:17.238 INFO:teuthology.orchestra.run.smithi012.stdout: pytest.skip('[s3 main] section missing kms_keyid') 2023-10-05T12:49:17.238 INFO:teuthology.orchestra.run.smithi012.stdout:> _test_sse_kms_customer_write(1024*1024, key_id = kms_keyid) 2023-10-05T12:49:17.238 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.238 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:9959: 2023-10-05T12:49:17.238 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.238 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:9689: in _test_sse_kms_customer_write 2023-10-05T12:49:17.238 INFO:teuthology.orchestra.run.smithi012.stdout: bucket_name = get_new_bucket() 2023-10-05T12:49:17.239 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-10-05T12:49:17.239 INFO:teuthology.orchestra.run.smithi012.stdout: client.create_bucket(Bucket=name) 2023-10-05T12:49:17.239 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:17.239 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:17.239 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:17.239 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:17.239 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:17.239 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:17.239 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:17.239 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:17.239 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:17.240 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:17.240 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:17.240 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:17.240 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:17.240 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:17.240 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:17.240 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:17.240 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:17.240 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:17.240 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:17.240 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:17.240 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:17.241 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:17.241 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:17.241 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:17.241 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:17.241 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:17.241 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:17.241 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:17.241 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:17.241 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:17.241 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:17.241 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:17.241 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:17.242 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:17.242 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.242 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.242 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:17.242 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:17.242 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.242 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:17.242 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.242 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:17.242 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:17.242 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:17.243 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:17.243 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:17.243 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:17.243 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:17.243 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:17.243 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:17.243 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:17.243 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:17.243 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:17.243 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:17.243 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.243 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:17.244 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:17.244 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:17.244 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:17.244 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:17.244 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:17.244 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:17.244 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:17.244 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:17.244 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:17.244 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:17.244 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.244 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.245 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:17.245 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:17.245 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:17.245 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:17.245 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:17.245 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.245 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.245 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:17.245 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:17.245 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:17.245 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:17.245 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:17.246 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.246 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:17.246 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:17.246 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:17.246 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:17.246 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:17.246 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-429" 2023-10-05T12:49:17.246 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.246 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:17.246 INFO:teuthology.orchestra.run.smithi012.stdout:__________________________ test_sse_kms_transfer_13b ___________________________ 2023-10-05T12:49:17.246 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.246 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:17.247 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.247 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:17.247 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:17.247 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.247 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:17.247 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:17.247 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:17.247 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:17.247 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:17.247 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.247 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:17.248 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:17.248 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.248 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.248 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:17.248 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:17.248 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.248 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.248 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:17.248 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.248 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:17.248 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:17.248 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.249 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.249 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:17.249 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:17.249 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.249 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:17.249 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:17.249 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:17.249 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:17.249 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:17.249 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:17.249 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:17.250 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.250 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:17.250 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:17.250 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:17.250 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:17.250 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:17.250 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:17.250 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:17.250 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:17.250 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:17.250 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.251 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:17.251 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:17.251 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:17.251 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:17.251 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.251 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:17.251 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:17.251 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:17.251 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:17.251 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.251 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.251 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:17.252 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:17.252 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:17.252 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:17.252 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.252 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.252 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:17.252 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:17.252 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:17.252 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.252 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:17.252 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.252 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:17.253 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:17.253 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.253 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:17.253 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:17.253 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:17.253 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:17.253 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:17.253 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:17.253 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.253 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:17.253 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.253 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:17.253 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.254 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:17.254 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:17.254 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.254 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:17.254 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.254 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:17.254 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:17.254 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:17.254 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:17.254 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:17.255 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:17.255 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:17.255 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:17.255 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:17.255 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:17.255 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:17.255 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:17.255 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:17.255 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.255 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:17.255 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:17.255 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:17.256 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:17.256 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:17.256 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:17.256 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:17.256 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:17.256 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:17.256 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:17.256 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:17.256 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.256 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.256 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:17.256 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.257 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:17.257 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:17.257 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:17.257 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:17.257 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:17.257 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:17.257 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:17.257 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:17.257 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:17.257 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:17.257 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:17.257 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:17.258 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:17.258 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:17.258 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:17.258 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:17.258 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:17.258 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:17.258 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:17.258 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:17.258 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:17.258 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:17.258 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:17.259 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:17.259 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:17.259 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:17.259 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:17.259 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:17.259 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.259 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.259 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:17.259 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.259 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:17.259 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:17.260 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.260 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:17.260 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:17.260 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:17.260 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:17.260 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:17.260 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.260 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:17.260 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:17.260 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.260 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.260 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:17.261 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:17.261 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.261 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.261 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:17.261 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:17.261 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:17.261 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:17.261 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:17.261 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.261 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.261 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:17.261 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:17.262 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:17.262 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.262 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:17.262 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.262 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:17.262 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.262 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:17.262 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.262 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.encryption 2023-10-05T12:49:17.262 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.fails_on_dbstore 2023-10-05T12:49:17.262 INFO:teuthology.orchestra.run.smithi012.stdout: def test_sse_kms_transfer_13b(): 2023-10-05T12:49:17.262 INFO:teuthology.orchestra.run.smithi012.stdout: kms_keyid = get_main_kms_keyid() 2023-10-05T12:49:17.263 INFO:teuthology.orchestra.run.smithi012.stdout: if kms_keyid is None: 2023-10-05T12:49:17.263 INFO:teuthology.orchestra.run.smithi012.stdout: pytest.skip('[s3 main] section missing kms_keyid') 2023-10-05T12:49:17.263 INFO:teuthology.orchestra.run.smithi012.stdout:> _test_sse_kms_customer_write(13, key_id = kms_keyid) 2023-10-05T12:49:17.263 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.263 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:9968: 2023-10-05T12:49:17.263 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.263 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:9689: in _test_sse_kms_customer_write 2023-10-05T12:49:17.263 INFO:teuthology.orchestra.run.smithi012.stdout: bucket_name = get_new_bucket() 2023-10-05T12:49:17.263 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-10-05T12:49:17.263 INFO:teuthology.orchestra.run.smithi012.stdout: client.create_bucket(Bucket=name) 2023-10-05T12:49:17.263 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:17.263 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:17.264 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:17.264 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:17.264 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:17.264 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:17.264 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:17.264 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:17.264 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:17.264 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:17.264 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:17.264 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:17.264 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:17.264 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:17.265 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:17.265 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:17.265 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:17.265 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:17.265 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:17.265 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:17.265 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:17.265 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:17.265 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:17.265 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:17.265 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:17.265 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:17.266 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:17.266 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:17.266 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:17.266 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:17.266 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:17.266 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:17.266 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:17.266 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:17.266 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.266 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.266 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:17.267 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:17.267 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.267 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:17.267 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.267 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:17.267 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:17.267 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:17.267 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:17.267 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:17.267 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:17.267 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:17.268 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:17.268 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:17.268 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:17.268 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:17.268 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:17.268 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:17.268 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.268 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:17.268 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:17.268 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:17.268 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:17.268 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:17.269 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:17.269 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:17.269 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:17.269 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:17.269 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:17.269 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:17.269 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.269 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.269 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:17.269 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:17.269 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:17.270 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:17.270 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:17.270 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.270 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.270 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:17.270 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:17.270 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:17.270 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:17.270 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:17.270 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.270 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:17.271 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:17.271 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:17.271 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:17.271 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:17.271 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-430" 2023-10-05T12:49:17.271 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.271 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:17.271 INFO:teuthology.orchestra.run.smithi012.stdout:__________________________ test_sse_kms_read_declare ___________________________ 2023-10-05T12:49:17.271 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.271 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:17.271 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.271 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:17.272 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:17.272 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.272 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:17.272 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:17.272 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:17.272 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:17.272 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:17.272 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.272 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:17.272 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:17.272 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.272 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.273 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:17.273 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:17.273 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.273 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.273 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:17.273 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.273 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:17.273 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:17.273 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.273 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.273 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:17.273 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:17.273 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.274 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:17.274 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:17.274 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:17.274 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:17.274 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:17.274 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:17.274 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:17.274 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.274 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:17.274 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:17.274 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:17.274 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:17.275 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:17.275 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:17.275 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:17.275 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:17.275 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:17.275 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.275 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:17.275 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:17.275 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:17.275 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:17.275 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.275 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:17.276 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:17.276 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:17.276 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:17.276 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.276 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.276 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:17.276 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:17.276 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:17.276 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:17.276 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.276 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.276 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:17.277 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:17.277 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:17.277 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.277 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:17.277 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.277 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:17.277 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:17.277 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.277 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:17.277 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:17.277 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:17.277 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:17.278 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:17.278 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:17.278 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.278 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:17.278 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.278 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:17.278 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.278 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:17.278 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:17.278 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.278 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:17.279 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.279 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:17.279 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:17.279 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:17.279 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:17.279 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:17.279 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:17.279 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:17.279 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:17.279 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:17.279 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:17.279 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:17.279 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:17.280 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:17.280 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.280 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:17.280 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:17.280 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:17.280 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:17.280 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:17.280 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:17.280 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:17.280 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:17.280 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:17.281 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:17.281 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:17.281 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.281 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.281 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:17.281 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.281 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:17.281 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:17.281 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:17.281 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:17.281 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:17.281 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:17.282 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:17.282 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:17.282 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:17.282 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:17.282 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:17.282 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:17.282 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:17.282 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:17.282 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:17.282 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:17.282 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:17.283 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:17.283 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:17.283 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:17.283 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:17.283 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:17.283 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:17.283 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:17.283 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:17.283 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:17.283 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:17.283 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:17.284 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.284 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.284 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:17.284 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.284 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:17.284 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:17.284 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.284 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:17.284 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:17.284 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:17.284 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:17.284 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:17.284 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.285 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:17.285 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:17.285 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.285 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.285 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:17.285 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:17.285 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.285 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.285 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:17.285 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:17.285 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:17.285 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:17.286 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:17.286 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.286 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.286 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:17.286 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:17.286 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:17.286 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.286 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:17.286 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.286 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:17.286 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.287 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:17.287 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.287 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.encryption 2023-10-05T12:49:17.287 INFO:teuthology.orchestra.run.smithi012.stdout: def test_sse_kms_read_declare(): 2023-10-05T12:49:17.287 INFO:teuthology.orchestra.run.smithi012.stdout:> bucket_name = get_new_bucket() 2023-10-05T12:49:17.287 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.287 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:9973: 2023-10-05T12:49:17.287 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.287 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-10-05T12:49:17.287 INFO:teuthology.orchestra.run.smithi012.stdout: client.create_bucket(Bucket=name) 2023-10-05T12:49:17.287 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:17.288 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:17.288 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:17.288 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:17.288 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:17.288 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:17.288 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:17.288 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:17.288 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:17.288 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:17.288 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:17.288 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:17.289 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:17.289 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:17.289 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:17.289 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:17.289 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:17.289 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:17.289 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:17.289 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:17.289 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:17.289 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:17.289 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:17.289 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:17.290 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:17.290 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:17.290 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:17.290 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:17.290 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:17.290 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:17.290 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:17.290 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:17.290 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:17.290 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:17.290 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.291 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.291 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:17.291 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:17.291 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.291 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:17.291 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.291 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:17.291 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:17.291 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:17.291 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:17.291 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:17.291 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:17.292 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:17.292 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:17.292 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:17.292 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:17.292 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:17.292 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:17.292 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:17.292 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.292 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:17.292 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:17.292 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:17.293 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:17.293 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:17.293 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:17.293 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:17.293 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:17.293 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:17.293 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:17.293 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:17.293 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.293 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.293 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:17.293 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:17.294 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:17.294 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:17.294 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:17.294 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.294 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.294 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:17.294 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:17.294 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:17.294 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:17.294 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:17.294 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.294 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:17.295 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:17.295 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:17.295 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:17.295 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:17.295 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-431" 2023-10-05T12:49:17.295 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.295 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:17.295 INFO:teuthology.orchestra.run.smithi012.stdout:______________________________ test_bucket_policy ______________________________ 2023-10-05T12:49:17.295 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.295 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:17.295 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.296 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:17.296 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:17.296 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.296 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:17.296 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:17.296 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:17.296 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:17.296 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:17.296 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.296 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:17.296 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:17.297 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.297 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.297 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:17.297 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:17.297 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.297 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.297 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:17.297 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.297 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:17.297 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:17.297 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.297 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.298 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:17.298 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:17.298 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.298 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:17.298 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:17.298 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:17.298 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:17.298 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:17.298 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:17.298 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:17.298 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.299 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:17.299 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:17.299 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:17.299 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:17.299 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:17.299 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:17.299 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:17.299 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:17.299 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:17.299 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.299 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:17.299 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:17.300 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:17.300 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:17.300 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.300 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:17.300 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:17.300 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:17.300 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:17.300 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.300 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.300 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:17.300 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:17.300 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:17.300 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:17.301 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.301 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.301 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:17.301 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:17.301 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:17.301 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.301 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:17.301 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.301 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:17.301 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:17.301 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.301 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:17.302 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:17.302 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:17.302 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:17.302 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:17.302 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:17.302 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.302 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:17.302 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.302 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:17.302 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.302 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:17.302 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:17.303 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.303 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:17.303 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.303 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:17.303 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:17.303 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:17.303 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:17.303 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:17.303 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:17.303 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:17.303 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:17.304 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:17.304 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:17.304 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:17.304 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:17.304 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:17.304 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.304 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:17.304 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:17.304 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:17.304 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:17.304 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:17.304 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:17.304 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:17.305 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:17.305 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:17.305 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:17.305 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:17.305 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.305 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.305 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:17.305 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.305 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:17.305 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:17.305 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:17.305 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:17.305 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:17.306 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:17.306 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:17.306 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:17.306 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:17.306 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:17.306 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:17.306 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:17.306 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:17.306 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:17.306 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:17.306 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:17.307 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:17.307 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:17.307 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:17.307 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:17.307 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:17.307 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:17.307 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:17.307 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:17.307 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:17.307 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:17.307 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:17.308 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:17.308 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.308 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.308 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:17.308 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.308 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:17.308 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:17.308 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.308 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:17.308 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:17.308 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:17.308 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:17.309 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:17.309 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.309 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:17.309 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:17.309 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.309 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.309 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:17.309 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:17.309 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.309 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.309 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:17.309 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:17.310 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:17.310 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:17.310 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:17.310 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.310 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.310 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:17.310 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:17.310 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:17.310 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.310 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:17.310 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.310 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:17.310 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.311 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:17.311 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.311 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.bucket_policy 2023-10-05T12:49:17.311 INFO:teuthology.orchestra.run.smithi012.stdout: def test_bucket_policy(): 2023-10-05T12:49:17.311 INFO:teuthology.orchestra.run.smithi012.stdout:> bucket_name = get_new_bucket() 2023-10-05T12:49:17.311 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.311 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:9992: 2023-10-05T12:49:17.311 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.311 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-10-05T12:49:17.311 INFO:teuthology.orchestra.run.smithi012.stdout: client.create_bucket(Bucket=name) 2023-10-05T12:49:17.311 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:17.311 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:17.312 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:17.312 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:17.312 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:17.312 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:17.312 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:17.312 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:17.312 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:17.312 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:17.312 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:17.312 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:17.312 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:17.312 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:17.312 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:17.313 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:17.313 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:17.313 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:17.313 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:17.313 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:17.313 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:17.313 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:17.313 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:17.313 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:17.313 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:17.313 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:17.313 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:17.313 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:17.314 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:17.314 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:17.314 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:17.314 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:17.314 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:17.314 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:17.314 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.314 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.314 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:17.314 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:17.314 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.314 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:17.315 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.315 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:17.315 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:17.315 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:17.315 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:17.315 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:17.315 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:17.315 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:17.315 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:17.315 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:17.315 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:17.316 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:17.316 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:17.316 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:17.316 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.316 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:17.316 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:17.316 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:17.316 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:17.316 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:17.316 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:17.316 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:17.316 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:17.317 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:17.317 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:17.317 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:17.317 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.317 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.317 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:17.317 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:17.317 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:17.317 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:17.317 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:17.317 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.317 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.318 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:17.318 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:17.318 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:17.318 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:17.318 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:17.318 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.318 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:17.318 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:17.318 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:17.318 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:17.318 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:17.319 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-432" 2023-10-05T12:49:17.319 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.319 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:17.319 INFO:teuthology.orchestra.run.smithi012.stdout:_____________________________ test_bucketv2_policy _____________________________ 2023-10-05T12:49:17.319 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.319 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:17.319 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.319 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:17.319 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:17.319 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.319 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:17.319 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:17.319 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:17.320 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:17.320 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:17.320 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.320 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:17.320 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:17.320 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.320 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.320 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:17.320 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:17.320 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.320 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.320 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:17.320 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.321 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:17.321 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:17.321 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.321 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.321 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:17.321 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:17.321 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.321 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:17.321 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:17.321 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:17.321 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:17.321 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:17.321 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:17.322 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:17.322 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.322 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:17.322 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:17.322 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:17.322 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:17.322 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:17.322 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:17.322 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:17.322 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:17.322 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:17.322 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.323 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:17.323 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:17.323 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:17.323 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:17.323 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.323 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:17.323 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:17.323 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:17.323 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:17.323 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.323 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.323 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:17.324 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:17.324 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:17.324 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:17.324 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.324 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.324 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:17.324 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:17.324 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:17.324 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.324 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:17.324 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.324 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:17.325 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:17.325 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.325 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:17.325 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:17.325 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:17.325 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:17.325 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:17.325 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:17.325 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.325 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:17.325 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.325 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:17.326 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.326 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:17.326 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:17.326 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.326 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:17.326 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.326 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:17.326 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:17.326 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:17.326 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:17.326 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:17.326 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:17.326 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:17.327 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:17.327 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:17.327 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:17.327 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:17.327 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:17.327 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:17.327 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.327 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:17.327 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:17.327 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:17.327 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:17.327 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:17.327 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:17.328 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:17.328 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:17.328 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:17.328 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:17.328 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:17.328 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.328 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.328 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:17.328 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.328 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:17.328 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:17.328 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:17.329 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:17.329 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:17.329 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:17.329 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:17.329 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:17.329 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:17.329 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:17.329 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:17.329 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:17.329 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:17.329 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:17.330 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:17.330 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:17.330 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:17.330 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:17.330 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:17.330 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:17.330 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:17.330 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:17.330 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:17.330 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:17.330 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:17.330 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:17.331 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:17.331 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:17.331 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.331 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.331 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:17.331 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.331 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:17.331 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:17.331 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.331 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:17.331 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:17.331 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:17.331 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:17.332 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:17.332 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.332 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:17.332 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:17.332 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.332 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.332 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:17.332 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:17.332 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.332 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.332 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:17.332 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:17.333 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:17.333 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:17.333 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:17.333 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.333 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.333 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:17.333 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:17.333 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:17.333 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.333 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:17.333 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.334 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:17.334 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.334 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:17.334 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.334 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.bucket_policy 2023-10-05T12:49:17.334 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.list_objects_v2 2023-10-05T12:49:17.334 INFO:teuthology.orchestra.run.smithi012.stdout: def test_bucketv2_policy(): 2023-10-05T12:49:17.334 INFO:teuthology.orchestra.run.smithi012.stdout:> bucket_name = get_new_bucket() 2023-10-05T12:49:17.334 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.334 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:10022: 2023-10-05T12:49:17.334 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.334 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-10-05T12:49:17.335 INFO:teuthology.orchestra.run.smithi012.stdout: client.create_bucket(Bucket=name) 2023-10-05T12:49:17.335 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:17.335 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:17.335 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:17.335 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:17.335 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:17.335 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:17.335 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:17.335 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:17.335 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:17.335 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:17.335 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:17.335 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:17.336 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:17.336 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:17.336 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:17.336 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:17.336 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:17.336 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:17.336 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:17.336 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:17.336 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:17.336 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:17.336 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:17.336 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:17.336 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:17.337 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:17.337 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:17.337 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:17.337 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:17.337 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:17.337 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:17.337 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:17.337 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:17.337 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:17.337 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.337 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.337 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:17.338 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:17.338 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.338 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:17.338 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.338 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:17.338 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:17.338 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:17.338 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:17.338 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:17.338 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:17.338 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:17.339 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:17.339 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:17.339 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:17.339 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:17.339 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:17.339 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:17.339 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.339 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:17.339 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:17.339 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:17.339 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:17.340 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:17.340 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:17.340 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:17.340 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:17.340 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:17.340 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:17.340 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:17.340 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.340 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.340 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:17.340 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:17.341 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:17.341 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:17.341 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:17.341 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.341 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.341 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:17.341 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:17.341 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:17.341 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:17.341 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:17.341 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.341 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:17.341 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:17.342 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:17.342 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:17.342 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:17.342 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-433" 2023-10-05T12:49:17.342 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.342 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:17.342 INFO:teuthology.orchestra.run.smithi012.stdout:____________________________ test_bucket_policy_acl ____________________________ 2023-10-05T12:49:17.342 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.342 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:17.342 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.342 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:17.343 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:17.343 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.343 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:17.343 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:17.343 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:17.343 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:17.343 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:17.343 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.343 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:17.343 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:17.343 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.343 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.343 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:17.344 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:17.344 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.344 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.344 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:17.344 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.344 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:17.344 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:17.344 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.344 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.344 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:17.344 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:17.344 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.344 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:17.345 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:17.345 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:17.345 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:17.345 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:17.345 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:17.345 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:17.345 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.345 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:17.345 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:17.345 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:17.345 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:17.345 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:17.346 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:17.346 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:17.346 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:17.346 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:17.346 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.346 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:17.346 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:17.346 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:17.346 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:17.346 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.346 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:17.347 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:17.347 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:17.347 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:17.347 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.347 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.347 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:17.347 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:17.347 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:17.347 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:17.347 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.347 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.347 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:17.348 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:17.348 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:17.348 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.348 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:17.348 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.348 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:17.348 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:17.348 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.348 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:17.348 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:17.348 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:17.348 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:17.349 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:17.349 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:17.349 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.349 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:17.349 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.349 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:17.349 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.349 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:17.349 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:17.349 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.349 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:17.349 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.350 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:17.350 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:17.350 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:17.350 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:17.350 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:17.350 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:17.350 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:17.350 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:17.350 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:17.350 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:17.350 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:17.350 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:17.351 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:17.351 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.351 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:17.351 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:17.351 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:17.351 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:17.351 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:17.351 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:17.351 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:17.351 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:17.351 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:17.351 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:17.351 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:17.352 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.352 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.352 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:17.352 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.352 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:17.352 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:17.352 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:17.352 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:17.352 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:17.352 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:17.352 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:17.353 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:17.353 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:17.353 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:17.353 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:17.353 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:17.353 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:17.353 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:17.353 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:17.353 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:17.353 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:17.353 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:17.353 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:17.354 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:17.354 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:17.354 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:17.354 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:17.354 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:17.354 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:17.354 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:17.354 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:17.354 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:17.354 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.354 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.355 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:17.355 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.355 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:17.355 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:17.355 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.355 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:17.355 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:17.355 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:17.355 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:17.355 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:17.355 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.355 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:17.356 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:17.356 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.356 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.356 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:17.356 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:17.356 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.356 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.356 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:17.356 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:17.356 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:17.356 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:17.356 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:17.357 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.357 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.357 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:17.357 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:17.357 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:17.357 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.357 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:17.357 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.357 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:17.357 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.357 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:17.357 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.358 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.bucket_policy 2023-10-05T12:49:17.358 INFO:teuthology.orchestra.run.smithi012.stdout: def test_bucket_policy_acl(): 2023-10-05T12:49:17.358 INFO:teuthology.orchestra.run.smithi012.stdout:> bucket_name = get_new_bucket() 2023-10-05T12:49:17.358 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.358 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:10051: 2023-10-05T12:49:17.358 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.358 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-10-05T12:49:17.358 INFO:teuthology.orchestra.run.smithi012.stdout: client.create_bucket(Bucket=name) 2023-10-05T12:49:17.358 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:17.358 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:17.358 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:17.359 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:17.359 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:17.359 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:17.359 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:17.359 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:17.359 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:17.359 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:17.359 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:17.359 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:17.359 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:17.359 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:17.360 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:17.360 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:17.360 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:17.360 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:17.360 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:17.360 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:17.360 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:17.360 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:17.360 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:17.360 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:17.360 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:17.360 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:17.360 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:17.361 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:17.361 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:17.361 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:17.361 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:17.361 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:17.361 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:17.361 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:17.361 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.361 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.361 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:17.361 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:17.361 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.362 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:17.362 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.362 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:17.362 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:17.362 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:17.362 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:17.362 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:17.362 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:17.362 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:17.362 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:17.362 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:17.362 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:17.363 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:17.363 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:17.363 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:17.363 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.363 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:17.363 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:17.363 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:17.363 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:17.363 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:17.363 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:17.363 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:17.364 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:17.364 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:17.364 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:17.364 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:17.364 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.364 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.364 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:17.364 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:17.364 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:17.364 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:17.364 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:17.364 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.364 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.365 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:17.365 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:17.365 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:17.365 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:17.365 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:17.365 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.365 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:17.365 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:17.365 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:17.365 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:17.365 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:17.365 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-434" 2023-10-05T12:49:17.366 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.366 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:17.366 INFO:teuthology.orchestra.run.smithi012.stdout:___________________________ test_bucketv2_policy_acl ___________________________ 2023-10-05T12:49:17.366 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.366 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:17.366 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.366 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:17.366 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:17.366 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.366 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:17.366 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:17.366 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:17.367 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:17.367 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:17.367 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.367 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:17.367 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:17.367 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.367 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.367 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:17.367 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:17.367 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.367 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.367 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:17.368 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.368 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:17.368 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:17.368 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.368 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.368 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:17.368 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:17.368 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.368 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:17.368 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:17.368 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:17.368 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:17.369 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:17.369 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:17.369 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:17.369 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.369 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:17.369 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:17.369 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:17.369 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:17.369 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:17.369 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:17.369 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:17.370 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:17.370 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:17.370 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.370 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:17.370 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:17.370 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:17.370 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:17.370 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.370 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:17.370 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:17.370 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:17.370 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:17.371 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.371 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.371 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:17.371 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:17.371 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:17.371 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:17.371 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.371 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.371 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:17.371 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:17.371 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:17.371 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.372 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:17.372 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.372 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:17.372 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:17.372 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.372 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:17.372 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:17.372 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:17.372 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:17.372 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:17.372 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:17.372 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.373 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:17.373 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.373 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:17.373 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.373 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:17.373 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:17.373 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.373 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:17.373 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.373 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:17.373 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:17.373 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:17.374 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:17.374 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:17.374 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:17.374 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:17.374 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:17.374 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:17.374 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:17.374 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:17.374 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:17.374 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:17.374 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.374 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:17.375 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:17.375 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:17.375 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:17.375 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:17.375 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:17.375 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:17.375 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:17.375 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:17.375 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:17.375 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:17.375 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.375 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.376 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:17.376 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.376 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:17.376 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:17.376 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:17.376 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:17.376 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:17.376 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:17.376 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:17.376 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:17.376 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:17.376 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:17.377 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:17.377 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:17.377 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:17.377 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:17.377 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:17.377 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:17.377 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:17.377 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:17.377 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:17.377 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:17.377 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:17.377 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:17.378 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:17.378 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:17.378 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:17.378 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:17.378 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:17.378 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:17.378 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.378 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.378 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:17.378 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.378 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:17.378 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:17.379 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.379 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:17.379 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:17.379 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:17.379 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:17.379 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:17.379 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.379 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:17.379 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:17.379 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.379 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.379 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:17.380 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:17.380 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.380 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.380 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:17.380 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:17.380 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:17.380 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:17.380 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:17.380 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.380 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.380 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:17.380 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:17.381 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:17.381 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.381 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:17.381 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.381 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:17.381 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.381 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:17.381 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.381 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.bucket_policy 2023-10-05T12:49:17.381 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.list_objects_v2 2023-10-05T12:49:17.381 INFO:teuthology.orchestra.run.smithi012.stdout: def test_bucketv2_policy_acl(): 2023-10-05T12:49:17.381 INFO:teuthology.orchestra.run.smithi012.stdout:> bucket_name = get_new_bucket() 2023-10-05T12:49:17.382 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.382 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:10087: 2023-10-05T12:49:17.382 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.382 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-10-05T12:49:17.382 INFO:teuthology.orchestra.run.smithi012.stdout: client.create_bucket(Bucket=name) 2023-10-05T12:49:17.382 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:17.382 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:17.382 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:17.382 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:17.382 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:17.382 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:17.383 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:17.383 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:17.383 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:17.383 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:17.383 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:17.383 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:17.383 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:17.383 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:17.383 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:17.383 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:17.383 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:17.383 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:17.384 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:17.384 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:17.384 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:17.384 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:17.384 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:17.384 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:17.384 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:17.384 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:17.384 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:17.384 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:17.384 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:17.384 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:17.385 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:17.385 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:17.385 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:17.385 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:17.385 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.385 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.385 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:17.385 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:17.385 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.385 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:17.385 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.385 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:17.386 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:17.386 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:17.386 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:17.386 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:17.386 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:17.386 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:17.386 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:17.386 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:17.386 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:17.386 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:17.386 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:17.387 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:17.387 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.387 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:17.387 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:17.387 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:17.387 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:17.387 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:17.387 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:17.387 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:17.387 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:17.387 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:17.387 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:17.387 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:17.388 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.388 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.388 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:17.388 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:17.388 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:17.388 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:17.388 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:17.388 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.388 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.388 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:17.388 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:17.389 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:17.389 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:17.389 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:17.389 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.389 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:17.389 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:17.389 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:17.389 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:17.389 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:17.389 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-435" 2023-10-05T12:49:17.389 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.389 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:17.390 INFO:teuthology.orchestra.run.smithi012.stdout:______________________ test_bucket_policy_another_bucket _______________________ 2023-10-05T12:49:17.390 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.390 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:17.390 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.390 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:17.390 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:17.390 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.390 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:17.390 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:17.390 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:17.390 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:17.390 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:17.390 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.391 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:17.391 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:17.391 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.391 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.391 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:17.391 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:17.391 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.391 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.391 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:17.391 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.391 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:17.391 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:17.391 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.392 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.392 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:17.392 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:17.392 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.392 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:17.392 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:17.392 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:17.392 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:17.392 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:17.392 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:17.392 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:17.392 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.392 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:17.393 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:17.393 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:17.393 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:17.393 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:17.393 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:17.393 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:17.393 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:17.393 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:17.393 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.393 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:17.393 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:17.393 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:17.393 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:17.394 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.394 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:17.394 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:17.394 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:17.394 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:17.394 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.394 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.394 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:17.394 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:17.394 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:17.394 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:17.394 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.394 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.395 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:17.395 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:17.395 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:17.395 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.395 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:17.395 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.395 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:17.395 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:17.395 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.395 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:17.395 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:17.395 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:17.395 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:17.396 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:17.396 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:17.396 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.396 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:17.396 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.396 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:17.396 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.396 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:17.396 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:17.396 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.396 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:17.396 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.397 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:17.397 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:17.397 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:17.397 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:17.397 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:17.397 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:17.397 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:17.397 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:17.397 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:17.397 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:17.397 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:17.398 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:17.398 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:17.398 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.398 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:17.398 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:17.398 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:17.398 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:17.398 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:17.398 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:17.398 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:17.398 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:17.399 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:17.399 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:17.399 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:17.399 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.399 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.399 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:17.399 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.399 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:17.399 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:17.399 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:17.400 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:17.400 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:17.400 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:17.400 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:17.400 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:17.400 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:17.400 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:17.400 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:17.400 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:17.400 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:17.400 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:17.400 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:17.401 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:17.401 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:17.401 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:17.401 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:17.401 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:17.401 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:17.401 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:17.401 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:17.401 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:17.401 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:17.401 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:17.401 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:17.402 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:17.402 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.402 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.402 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:17.402 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.402 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:17.402 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:17.402 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.402 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:17.402 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:17.402 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:17.403 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:17.403 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:17.403 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.403 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:17.403 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:17.403 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.403 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.403 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:17.403 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:17.403 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.403 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.403 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:17.404 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:17.404 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:17.404 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:17.404 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:17.404 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.404 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.404 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:17.404 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:17.404 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:17.404 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.404 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:17.404 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.405 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:17.405 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.405 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:17.405 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.405 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.bucket_policy 2023-10-05T12:49:17.405 INFO:teuthology.orchestra.run.smithi012.stdout: def test_bucket_policy_another_bucket(): 2023-10-05T12:49:17.405 INFO:teuthology.orchestra.run.smithi012.stdout:> bucket_name = get_new_bucket() 2023-10-05T12:49:17.405 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.405 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:10211: 2023-10-05T12:49:17.405 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.405 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-10-05T12:49:17.405 INFO:teuthology.orchestra.run.smithi012.stdout: client.create_bucket(Bucket=name) 2023-10-05T12:49:17.406 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:17.406 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:17.406 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:17.406 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:17.406 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:17.406 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:17.406 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:17.406 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:17.406 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:17.406 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:17.406 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:17.406 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:17.407 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:17.407 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:17.407 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:17.407 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:17.407 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:17.407 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:17.407 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:17.407 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:17.407 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:17.407 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:17.407 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:17.407 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:17.407 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:17.408 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:17.408 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:17.408 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:17.408 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:17.408 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:17.408 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:17.408 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:17.408 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:17.408 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:17.408 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.408 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.408 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:17.409 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:17.409 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.409 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:17.409 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.409 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:17.409 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:17.409 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:17.409 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:17.409 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:17.409 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:17.410 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:17.410 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:17.410 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:17.410 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:17.410 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:17.410 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:17.410 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:17.410 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.410 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:17.410 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:17.410 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:17.411 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:17.411 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:17.411 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:17.411 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:17.411 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:17.411 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:17.411 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:17.411 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:17.411 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.411 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.411 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:17.411 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:17.412 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:17.412 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:17.412 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:17.412 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.412 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.412 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:17.412 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:17.412 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:17.412 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:17.412 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:17.412 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.412 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:17.413 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:17.413 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:17.413 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:17.413 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:17.413 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-436" 2023-10-05T12:49:17.413 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.413 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:17.413 INFO:teuthology.orchestra.run.smithi012.stdout:_____________________ test_bucketv2_policy_another_bucket ______________________ 2023-10-05T12:49:17.413 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.413 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:17.413 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.413 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:17.414 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:17.414 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.414 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:17.414 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:17.414 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:17.414 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:17.414 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:17.414 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.414 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:17.414 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:17.415 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.415 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.415 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:17.415 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:17.415 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.415 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.415 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:17.415 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.415 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:17.415 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:17.415 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.415 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.415 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:17.416 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:17.416 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.416 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:17.416 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:17.416 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:17.416 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:17.416 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:17.416 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:17.416 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:17.416 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.416 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:17.416 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:17.416 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:17.417 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:17.417 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:17.417 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:17.417 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:17.417 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:17.417 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:17.417 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.417 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:17.417 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:17.417 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:17.417 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:17.417 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.418 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:17.418 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:17.418 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:17.418 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:17.418 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.418 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.418 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:17.418 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:17.418 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:17.418 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:17.418 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.419 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.419 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:17.419 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:17.419 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:17.419 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.419 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:17.419 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.419 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:17.419 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:17.419 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.419 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:17.419 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:17.419 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:17.420 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:17.420 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:17.420 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:17.420 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.420 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:17.420 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.420 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:17.420 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.420 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:17.420 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:17.420 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.420 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:17.420 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.421 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:17.421 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:17.421 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:17.421 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:17.421 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:17.421 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:17.421 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:17.421 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:17.421 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:17.421 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:17.421 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:17.421 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:17.421 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:17.422 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.422 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:17.422 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:17.422 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:17.422 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:17.422 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:17.422 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:17.422 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:17.422 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:17.422 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:17.422 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:17.422 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:17.423 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.423 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.423 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:17.423 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.423 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:17.423 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:17.423 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:17.423 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:17.423 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:17.423 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:17.423 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:17.423 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:17.423 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:17.423 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:17.424 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:17.424 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:17.424 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:17.424 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:17.424 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:17.424 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:17.424 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:17.424 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:17.424 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:17.424 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:17.424 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:17.424 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:17.425 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:17.425 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:17.425 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:17.425 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:17.425 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:17.425 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:17.425 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.425 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.425 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:17.425 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.425 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:17.425 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:17.425 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.426 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:17.426 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:17.426 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:17.426 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:17.426 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:17.426 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.426 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:17.426 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:17.426 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.426 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.426 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:17.426 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:17.426 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.427 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.427 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:17.427 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:17.427 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:17.427 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:17.427 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:17.427 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.427 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.427 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:17.427 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:17.427 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:17.428 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.428 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:17.428 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.428 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:17.428 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.428 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:17.428 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.428 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.bucket_policy 2023-10-05T12:49:17.428 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.list_objects_v2 2023-10-05T12:49:17.428 INFO:teuthology.orchestra.run.smithi012.stdout: def test_bucketv2_policy_another_bucket(): 2023-10-05T12:49:17.428 INFO:teuthology.orchestra.run.smithi012.stdout:> bucket_name = get_new_bucket() 2023-10-05T12:49:17.429 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.429 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:10249: 2023-10-05T12:49:17.429 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.429 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-10-05T12:49:17.429 INFO:teuthology.orchestra.run.smithi012.stdout: client.create_bucket(Bucket=name) 2023-10-05T12:49:17.429 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:17.429 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:17.429 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:17.429 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:17.429 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:17.429 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:17.429 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:17.430 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:17.430 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:17.430 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:17.430 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:17.430 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:17.430 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:17.430 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:17.430 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:17.430 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:17.430 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:17.430 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:17.430 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:17.431 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:17.431 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:17.431 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:17.431 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:17.431 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:17.431 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:17.431 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:17.431 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:17.431 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:17.431 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:17.431 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:17.431 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:17.431 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:17.432 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:17.432 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:17.432 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.432 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.432 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:17.432 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:17.432 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.432 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:17.432 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.432 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:17.432 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:17.432 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:17.432 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:17.433 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:17.433 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:17.433 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:17.433 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:17.433 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:17.433 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:17.433 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:17.433 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:17.433 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:17.433 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.433 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:17.433 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:17.433 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:17.434 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:17.434 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:17.434 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:17.434 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:17.434 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:17.434 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:17.434 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:17.434 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:17.434 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.434 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.434 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:17.434 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:17.435 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:17.435 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:17.435 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:17.435 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.435 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.435 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:17.435 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:17.435 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:17.435 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:17.435 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:17.435 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.435 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:17.436 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:17.436 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:17.436 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:17.436 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:17.436 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-437" 2023-10-05T12:49:17.436 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.436 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:17.436 INFO:teuthology.orchestra.run.smithi012.stdout:_____________________________ test_get_obj_tagging _____________________________ 2023-10-05T12:49:17.436 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.436 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:17.436 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.436 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:17.436 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:17.437 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.437 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:17.437 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:17.437 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:17.437 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:17.437 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:17.437 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.437 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:17.437 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:17.437 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.437 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.437 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:17.438 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:17.438 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.438 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.438 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:17.438 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.438 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:17.438 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:17.438 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.438 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.438 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:17.439 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:17.439 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.439 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:17.439 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:17.439 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:17.439 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:17.439 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:17.439 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:17.439 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:17.439 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.439 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:17.439 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:17.439 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:17.440 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:17.440 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:17.440 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:17.440 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:17.440 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:17.440 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:17.440 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.440 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:17.440 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:17.440 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:17.440 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:17.440 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.440 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:17.441 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:17.441 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:17.441 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:17.441 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.441 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.441 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:17.441 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:17.441 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:17.441 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:17.441 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.441 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.441 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:17.441 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:17.442 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:17.442 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.442 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:17.442 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.442 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:17.442 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:17.442 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.442 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:17.442 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:17.442 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:17.442 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:17.443 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:17.443 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:17.443 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.443 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:17.443 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.443 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:17.443 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.443 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:17.443 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:17.443 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.443 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:17.443 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.444 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:17.444 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:17.444 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:17.444 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:17.444 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:17.444 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:17.444 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:17.444 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:17.444 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:17.444 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:17.444 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:17.444 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:17.444 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:17.445 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.445 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:17.445 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:17.445 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:17.445 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:17.445 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:17.445 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:17.445 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:17.445 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:17.445 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:17.445 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:17.445 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:17.446 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.446 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.446 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:17.446 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.446 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:17.446 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:17.446 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:17.446 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:17.446 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:17.446 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:17.451 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:17.451 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:17.451 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:17.451 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:17.452 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:17.452 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:17.452 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:17.452 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:17.452 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:17.452 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:17.452 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:17.452 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:17.452 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:17.452 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:17.452 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:17.452 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:17.452 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:17.453 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:17.453 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:17.453 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:17.453 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:17.453 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:17.453 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.453 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.453 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:17.453 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.453 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:17.453 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:17.453 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.453 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:17.454 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:17.454 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:17.454 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:17.454 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:17.454 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.454 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:17.454 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:17.454 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.454 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.454 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:17.454 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:17.454 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.455 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.455 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:17.455 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:17.455 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:17.455 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:17.455 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:17.455 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.455 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.455 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:17.455 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:17.455 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:17.455 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.455 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:17.456 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.456 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:17.456 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.456 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:17.456 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.456 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.tagging 2023-10-05T12:49:17.456 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.fails_on_dbstore 2023-10-05T12:49:17.456 INFO:teuthology.orchestra.run.smithi012.stdout: def test_get_obj_tagging(): 2023-10-05T12:49:17.456 INFO:teuthology.orchestra.run.smithi012.stdout: key = 'testputtags' 2023-10-05T12:49:17.456 INFO:teuthology.orchestra.run.smithi012.stdout:> bucket_name = _create_key_with_random_content(key) 2023-10-05T12:49:17.456 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.456 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:10359: 2023-10-05T12:49:17.456 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.457 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:5796: in _create_key_with_random_content 2023-10-05T12:49:17.457 INFO:teuthology.orchestra.run.smithi012.stdout: bucket_name = get_new_bucket() 2023-10-05T12:49:17.457 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-10-05T12:49:17.457 INFO:teuthology.orchestra.run.smithi012.stdout: client.create_bucket(Bucket=name) 2023-10-05T12:49:17.457 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:17.457 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:17.457 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:17.457 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:17.457 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:17.457 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:17.457 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:17.458 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:17.458 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:17.458 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:17.458 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:17.458 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:17.458 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:17.458 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:17.458 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:17.458 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:17.458 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:17.458 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:17.459 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:17.459 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:17.459 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:17.459 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:17.459 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:17.459 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:17.459 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:17.459 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:17.459 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:17.459 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:17.459 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:17.459 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:17.460 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:17.460 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:17.460 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:17.460 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:17.460 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.460 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.460 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:17.460 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:17.460 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.460 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:17.460 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.460 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:17.461 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:17.461 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:17.461 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:17.461 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:17.461 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:17.461 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:17.461 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:17.461 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:17.461 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:17.461 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:17.461 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:17.461 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:17.462 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.462 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:17.462 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:17.462 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:17.462 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:17.462 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:17.462 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:17.462 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:17.462 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:17.462 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:17.462 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:17.463 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:17.463 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.463 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.463 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:17.463 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:17.463 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:17.463 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:17.463 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:17.463 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.463 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.463 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:17.463 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:17.463 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:17.464 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:17.464 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:17.464 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.464 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:17.464 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:17.464 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:17.464 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:17.464 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:17.464 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-438" 2023-10-05T12:49:17.464 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.464 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:17.465 INFO:teuthology.orchestra.run.smithi012.stdout:__________________________ test_get_obj_head_tagging ___________________________ 2023-10-05T12:49:17.465 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.465 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:17.465 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.465 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:17.465 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:17.465 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.465 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:17.465 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:17.465 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:17.465 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:17.465 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:17.465 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.466 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:17.466 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:17.466 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.466 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.466 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:17.466 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:17.466 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.466 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.466 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:17.466 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.466 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:17.467 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:17.467 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.467 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.467 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:17.467 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:17.467 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.467 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:17.467 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:17.467 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:17.467 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:17.467 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:17.467 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:17.468 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:17.468 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.468 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:17.468 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:17.468 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:17.468 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:17.468 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:17.468 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:17.468 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:17.468 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:17.468 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:17.469 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.469 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:17.469 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:17.469 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:17.469 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:17.469 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.469 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:17.469 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:17.469 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:17.469 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:17.469 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.469 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.470 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:17.470 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:17.470 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:17.470 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:17.470 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.470 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.470 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:17.470 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:17.470 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:17.470 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.470 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:17.471 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.471 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:17.471 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:17.471 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.471 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:17.471 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:17.471 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:17.471 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:17.471 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:17.471 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:17.471 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.471 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:17.471 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.472 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:17.472 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.472 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:17.472 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:17.472 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.472 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:17.472 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.472 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:17.472 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:17.472 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:17.472 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:17.472 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:17.473 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:17.473 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:17.473 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:17.473 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:17.473 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:17.473 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:17.473 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:17.473 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:17.473 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.473 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:17.473 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:17.473 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:17.474 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:17.474 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:17.474 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:17.474 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:17.474 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:17.474 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:17.474 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:17.474 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:17.474 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.474 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.474 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:17.474 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.475 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:17.475 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:17.475 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:17.475 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:17.475 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:17.475 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:17.475 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:17.475 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:17.475 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:17.475 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:17.475 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:17.475 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:17.476 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:17.476 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:17.476 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:17.476 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:17.476 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:17.476 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:17.476 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:17.476 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:17.476 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:17.476 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:17.476 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:17.476 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:17.477 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:17.477 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:17.477 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:17.477 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:17.477 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.477 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.477 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:17.477 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.477 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:17.477 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:17.477 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.477 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:17.477 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:17.478 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:17.478 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:17.478 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:17.478 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.478 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:17.478 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:17.478 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.478 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.478 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:17.478 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:17.478 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.479 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.479 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:17.479 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:17.479 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:17.479 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:17.479 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:17.479 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.479 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.479 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:17.479 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:17.479 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:17.479 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.480 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:17.480 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.480 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:17.480 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.480 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:17.480 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.480 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.tagging 2023-10-05T12:49:17.480 INFO:teuthology.orchestra.run.smithi012.stdout: def test_get_obj_head_tagging(): 2023-10-05T12:49:17.480 INFO:teuthology.orchestra.run.smithi012.stdout: key = 'testputtags' 2023-10-05T12:49:17.480 INFO:teuthology.orchestra.run.smithi012.stdout:> bucket_name = _create_key_with_random_content(key) 2023-10-05T12:49:17.480 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.480 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:10373: 2023-10-05T12:49:17.481 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.481 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:5796: in _create_key_with_random_content 2023-10-05T12:49:17.481 INFO:teuthology.orchestra.run.smithi012.stdout: bucket_name = get_new_bucket() 2023-10-05T12:49:17.481 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-10-05T12:49:17.481 INFO:teuthology.orchestra.run.smithi012.stdout: client.create_bucket(Bucket=name) 2023-10-05T12:49:17.481 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:17.481 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:17.481 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:17.481 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:17.481 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:17.481 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:17.481 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:17.481 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:17.482 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:17.482 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:17.482 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:17.482 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:17.482 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:17.482 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:17.482 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:17.482 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:17.482 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:17.482 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:17.482 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:17.482 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:17.483 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:17.483 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:17.483 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:17.483 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:17.483 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:17.483 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:17.483 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:17.483 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:17.483 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:17.483 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:17.483 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:17.483 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:17.483 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:17.484 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:17.484 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.484 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.484 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:17.484 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:17.484 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.484 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:17.484 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.484 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:17.484 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:17.484 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:17.484 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:17.484 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:17.485 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:17.485 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:17.485 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:17.485 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:17.485 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:17.485 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:17.485 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:17.485 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:17.485 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.485 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:17.485 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:17.485 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:17.486 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:17.486 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:17.486 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:17.486 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:17.486 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:17.486 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:17.486 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:17.486 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:17.486 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.486 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.486 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:17.486 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:17.486 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:17.487 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:17.487 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:17.487 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.487 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.487 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:17.487 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:17.487 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:17.487 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:17.487 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:17.487 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.487 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:17.488 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:17.488 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:17.488 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:17.488 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:17.488 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-439" 2023-10-05T12:49:17.488 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.488 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:17.488 INFO:teuthology.orchestra.run.smithi012.stdout:______________________________ test_put_max_tags _______________________________ 2023-10-05T12:49:17.488 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.488 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:17.488 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.488 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:17.489 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:17.489 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.489 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:17.489 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:17.489 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:17.489 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:17.489 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:17.489 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.489 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:17.489 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:17.489 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.489 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.490 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:17.490 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:17.490 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.490 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.490 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:17.490 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.490 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:17.490 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:17.490 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.490 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.490 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:17.490 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:17.491 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.491 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:17.491 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:17.491 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:17.491 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:17.491 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:17.491 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:17.491 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:17.491 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.491 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:17.491 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:17.491 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:17.491 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:17.492 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:17.492 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:17.492 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:17.492 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:17.492 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:17.492 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.492 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:17.492 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:17.492 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:17.492 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:17.492 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.492 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:17.492 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:17.493 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:17.493 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:17.493 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.493 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.493 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:17.493 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:17.493 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:17.493 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:17.493 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.493 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.493 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:17.493 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:17.494 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:17.494 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.494 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:17.494 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.494 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:17.494 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:17.494 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.494 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:17.494 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:17.494 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:17.494 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:17.494 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:17.495 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:17.495 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.495 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:17.495 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.495 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:17.495 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.495 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:17.495 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:17.495 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.495 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:17.495 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.495 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:17.495 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:17.496 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:17.496 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:17.496 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:17.496 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:17.496 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:17.496 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:17.496 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:17.496 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:17.496 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:17.496 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:17.496 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:17.496 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.497 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:17.497 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:17.497 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:17.497 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:17.497 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:17.497 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:17.497 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:17.497 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:17.497 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:17.497 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:17.497 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:17.497 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.497 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.498 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:17.498 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.498 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:17.498 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:17.498 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:17.498 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:17.498 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:17.498 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:17.498 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:17.498 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:17.498 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:17.499 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:17.499 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:17.499 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:17.499 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:17.499 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:17.499 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:17.499 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:17.499 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:17.499 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:17.499 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:17.499 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:17.500 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:17.500 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:17.500 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:17.500 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:17.500 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:17.500 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:17.500 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:17.500 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:17.500 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.500 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.500 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:17.500 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.501 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:17.501 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:17.501 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.501 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:17.501 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:17.501 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:17.501 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:17.501 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:17.501 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.501 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:17.501 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:17.501 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.502 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.502 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:17.502 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:17.502 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.502 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.502 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:17.502 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:17.502 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:17.502 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:17.502 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:17.502 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.502 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.502 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:17.503 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:17.503 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:17.503 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.503 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:17.503 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.503 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:17.503 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.503 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:17.503 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.503 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.tagging 2023-10-05T12:49:17.503 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.fails_on_dbstore 2023-10-05T12:49:17.503 INFO:teuthology.orchestra.run.smithi012.stdout: def test_put_max_tags(): 2023-10-05T12:49:17.503 INFO:teuthology.orchestra.run.smithi012.stdout: key = 'testputmaxtags' 2023-10-05T12:49:17.504 INFO:teuthology.orchestra.run.smithi012.stdout:> bucket_name = _create_key_with_random_content(key) 2023-10-05T12:49:17.504 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.504 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:10389: 2023-10-05T12:49:17.504 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.504 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:5796: in _create_key_with_random_content 2023-10-05T12:49:17.504 INFO:teuthology.orchestra.run.smithi012.stdout: bucket_name = get_new_bucket() 2023-10-05T12:49:17.504 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-10-05T12:49:17.504 INFO:teuthology.orchestra.run.smithi012.stdout: client.create_bucket(Bucket=name) 2023-10-05T12:49:17.504 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:17.504 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:17.504 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:17.504 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:17.505 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:17.505 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:17.505 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:17.505 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:17.505 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:17.505 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:17.505 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:17.505 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:17.505 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:17.505 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:17.505 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:17.505 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:17.505 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:17.506 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:17.506 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:17.506 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:17.506 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:17.506 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:17.506 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:17.506 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:17.506 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:17.506 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:17.506 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:17.506 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:17.506 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:17.507 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:17.507 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:17.507 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:17.507 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:17.507 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:17.507 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.507 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.507 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:17.507 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:17.507 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.507 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:17.508 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.508 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:17.508 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:17.508 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:17.508 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:17.508 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:17.508 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:17.508 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:17.508 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:17.508 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:17.508 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:17.509 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:17.509 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:17.509 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:17.509 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.509 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:17.509 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:17.509 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:17.509 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:17.509 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:17.509 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:17.509 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:17.509 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:17.510 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:17.510 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:17.510 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:17.510 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.510 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.510 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:17.510 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:17.510 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:17.510 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:17.510 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:17.511 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.511 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.511 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:17.511 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:17.511 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:17.511 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:17.511 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:17.511 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.511 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:17.511 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:17.511 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:17.511 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:17.512 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:17.512 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-440" 2023-10-05T12:49:17.512 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.512 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:17.512 INFO:teuthology.orchestra.run.smithi012.stdout:_____________________________ test_put_excess_tags _____________________________ 2023-10-05T12:49:17.512 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.512 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:17.512 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.512 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:17.512 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:17.512 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.512 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:17.512 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:17.513 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:17.513 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:17.513 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:17.513 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.513 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:17.513 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:17.513 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.513 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.513 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:17.513 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:17.513 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.513 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.513 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:17.514 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.514 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:17.514 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:17.514 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.514 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.514 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:17.514 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:17.514 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.514 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:17.514 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:17.514 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:17.515 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:17.515 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:17.515 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:17.515 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:17.515 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.515 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:17.515 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:17.515 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:17.515 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:17.515 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:17.515 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:17.515 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:17.516 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:17.516 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:17.516 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.516 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:17.516 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:17.516 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:17.516 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:17.516 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.516 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:17.516 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:17.516 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:17.516 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:17.517 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.517 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.517 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:17.517 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:17.517 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:17.517 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:17.517 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.517 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.517 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:17.517 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:17.517 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:17.517 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.518 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:17.518 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.518 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:17.518 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:17.518 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.518 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:17.518 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:17.518 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:17.518 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:17.518 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:17.518 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:17.519 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.519 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:17.519 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.519 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:17.519 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.519 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:17.519 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:17.519 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.519 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:17.519 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.519 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:17.519 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:17.520 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:17.520 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:17.520 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:17.520 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:17.520 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:17.520 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:17.520 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:17.520 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:17.520 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:17.520 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:17.520 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:17.520 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.520 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:17.521 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:17.521 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:17.521 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:17.521 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:17.521 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:17.521 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:17.521 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:17.521 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:17.521 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:17.521 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:17.521 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.521 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.521 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:17.522 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.522 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:17.522 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:17.522 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:17.522 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:17.522 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:17.522 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:17.522 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:17.522 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:17.522 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:17.522 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:17.523 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:17.523 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:17.523 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:17.523 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:17.523 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:17.523 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:17.523 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:17.523 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:17.523 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:17.523 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:17.523 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:17.523 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:17.523 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:17.524 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:17.524 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:17.524 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:17.524 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:17.524 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:17.524 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.524 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.524 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:17.524 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.524 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:17.524 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:17.524 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.524 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:17.525 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:17.525 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:17.525 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:17.525 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:17.525 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.525 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:17.525 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:17.525 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.525 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.525 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:17.525 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:17.525 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.526 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.526 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:17.526 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:17.526 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:17.526 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:17.526 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:17.526 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.526 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.526 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:17.526 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:17.526 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:17.527 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.527 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:17.527 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.527 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:17.527 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.527 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:17.527 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.527 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.tagging 2023-10-05T12:49:17.527 INFO:teuthology.orchestra.run.smithi012.stdout: def test_put_excess_tags(): 2023-10-05T12:49:17.527 INFO:teuthology.orchestra.run.smithi012.stdout: key = 'testputmaxtags' 2023-10-05T12:49:17.527 INFO:teuthology.orchestra.run.smithi012.stdout:> bucket_name = _create_key_with_random_content(key) 2023-10-05T12:49:17.528 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.528 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:10402: 2023-10-05T12:49:17.528 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.528 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:5796: in _create_key_with_random_content 2023-10-05T12:49:17.528 INFO:teuthology.orchestra.run.smithi012.stdout: bucket_name = get_new_bucket() 2023-10-05T12:49:17.528 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-10-05T12:49:17.528 INFO:teuthology.orchestra.run.smithi012.stdout: client.create_bucket(Bucket=name) 2023-10-05T12:49:17.528 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:17.528 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:17.528 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:17.528 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:17.529 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:17.529 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:17.529 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:17.529 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:17.529 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:17.529 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:17.529 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:17.529 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:17.529 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:17.529 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:17.529 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:17.530 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:17.530 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:17.530 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:17.530 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:17.530 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:17.530 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:17.530 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:17.530 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:17.530 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:17.530 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:17.530 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:17.531 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:17.531 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:17.531 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:17.531 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:17.531 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:17.531 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:17.531 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:17.531 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:17.531 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.531 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.531 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:17.532 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:17.532 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.532 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:17.532 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.532 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:17.532 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:17.532 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:17.532 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:17.532 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:17.532 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:17.532 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:17.532 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:17.533 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:17.533 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:17.533 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:17.533 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:17.533 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:17.533 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.533 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:17.533 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:17.533 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:17.533 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:17.533 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:17.533 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:17.534 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:17.534 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:17.534 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:17.534 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:17.534 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:17.534 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.534 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.534 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:17.534 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:17.534 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:17.534 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:17.534 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:17.535 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.535 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.535 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:17.535 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:17.535 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:17.535 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:17.535 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:17.535 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.535 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:17.535 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:17.535 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:17.535 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:17.536 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:17.536 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-441" 2023-10-05T12:49:17.536 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.536 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:17.536 INFO:teuthology.orchestra.run.smithi012.stdout:___________________________ test_put_max_kvsize_tags ___________________________ 2023-10-05T12:49:17.536 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.536 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:17.536 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.536 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:17.536 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:17.536 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.536 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:17.537 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:17.537 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:17.537 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:17.537 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:17.537 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.537 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:17.537 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:17.537 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.537 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.537 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:17.537 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:17.537 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.538 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.538 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:17.538 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.538 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:17.538 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:17.538 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.538 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.538 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:17.538 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:17.538 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.538 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:17.538 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:17.539 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:17.539 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:17.539 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:17.539 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:17.539 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:17.539 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.539 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:17.539 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:17.539 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:17.539 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:17.539 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:17.539 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:17.540 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:17.540 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:17.540 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:17.540 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.540 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:17.540 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:17.540 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:17.540 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:17.540 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.540 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:17.540 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:17.540 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:17.541 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:17.541 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.541 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.541 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:17.541 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:17.541 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:17.541 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:17.541 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.541 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.541 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:17.541 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:17.541 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:17.542 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.542 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:17.542 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.542 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:17.542 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:17.542 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.542 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:17.542 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:17.542 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:17.542 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:17.542 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:17.543 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:17.543 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.543 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:17.543 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.543 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:17.543 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.543 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:17.543 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:17.543 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.544 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:17.544 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.544 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:17.544 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:17.544 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:17.544 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:17.544 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:17.544 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:17.544 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:17.544 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:17.545 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:17.545 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:17.545 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:17.545 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:17.545 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:17.545 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.545 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:17.545 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:17.545 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:17.545 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:17.545 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:17.545 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:17.546 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:17.546 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:17.546 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:17.546 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:17.546 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:17.546 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.546 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.546 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:17.546 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.546 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:17.546 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:17.547 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:17.547 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:17.547 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:17.547 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:17.547 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:17.547 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:17.547 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:17.547 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:17.547 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:17.547 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:17.547 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:17.547 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:17.548 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:17.548 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:17.548 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:17.548 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:17.548 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:17.548 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:17.548 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:17.548 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:17.548 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:17.548 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:17.548 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:17.549 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:17.549 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:17.549 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:17.549 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.549 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.549 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:17.549 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.549 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:17.549 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:17.549 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.549 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:17.549 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:17.550 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:17.550 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:17.550 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:17.550 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.550 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:17.550 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:17.550 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.550 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.550 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:17.550 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:17.550 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.550 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.551 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:17.551 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:17.551 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:17.551 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:17.551 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:17.551 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.551 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.551 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:17.551 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:17.551 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:17.551 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.552 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:17.552 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.552 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:17.552 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.552 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:17.552 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.552 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.tagging 2023-10-05T12:49:17.552 INFO:teuthology.orchestra.run.smithi012.stdout: def test_put_max_kvsize_tags(): 2023-10-05T12:49:17.552 INFO:teuthology.orchestra.run.smithi012.stdout: key = 'testputmaxkeysize' 2023-10-05T12:49:17.552 INFO:teuthology.orchestra.run.smithi012.stdout:> bucket_name = _create_key_with_random_content(key) 2023-10-05T12:49:17.552 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.552 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:10417: 2023-10-05T12:49:17.553 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.553 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:5796: in _create_key_with_random_content 2023-10-05T12:49:17.553 INFO:teuthology.orchestra.run.smithi012.stdout: bucket_name = get_new_bucket() 2023-10-05T12:49:17.553 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-10-05T12:49:17.553 INFO:teuthology.orchestra.run.smithi012.stdout: client.create_bucket(Bucket=name) 2023-10-05T12:49:17.553 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:17.553 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:17.553 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:17.553 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:17.553 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:17.553 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:17.553 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:17.554 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:17.554 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:17.554 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:17.554 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:17.554 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:17.554 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:17.554 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:17.554 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:17.554 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:17.554 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:17.554 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:17.554 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:17.555 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:17.555 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:17.555 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:17.555 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:17.555 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:17.555 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:17.555 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:17.555 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:17.555 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:17.555 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:17.556 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:17.556 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:17.556 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:17.556 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:17.556 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:17.556 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.556 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.556 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:17.556 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:17.556 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.557 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:17.557 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.557 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:17.557 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:17.557 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:17.557 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:17.557 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:17.557 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:17.557 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:17.557 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:17.557 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:17.558 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:17.558 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:17.558 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:17.558 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:17.558 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.558 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:17.558 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:17.558 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:17.558 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:17.558 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:17.558 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:17.559 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:17.559 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:17.559 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:17.559 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:17.559 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:17.559 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.559 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.559 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:17.559 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:17.559 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:17.559 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:17.560 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:17.560 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.560 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.560 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:17.560 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:17.560 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:17.560 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:17.560 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:17.560 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.560 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:17.560 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:17.560 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:17.560 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:17.561 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:17.561 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-442" 2023-10-05T12:49:17.561 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.561 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:17.561 INFO:teuthology.orchestra.run.smithi012.stdout:___________________________ test_put_excess_key_tags ___________________________ 2023-10-05T12:49:17.561 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.561 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:17.561 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.561 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:17.561 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:17.561 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.561 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:17.562 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:17.562 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:17.562 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:17.562 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:17.562 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.562 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:17.562 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:17.562 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.562 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.562 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:17.562 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:17.562 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.563 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.563 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:17.563 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.563 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:17.563 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:17.563 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.563 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.563 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:17.563 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:17.563 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.563 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:17.563 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:17.564 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:17.564 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:17.564 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:17.564 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:17.564 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:17.564 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.564 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:17.564 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:17.564 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:17.564 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:17.564 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:17.564 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:17.564 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:17.565 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:17.565 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:17.565 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.565 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:17.565 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:17.565 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:17.565 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:17.565 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.565 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:17.565 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:17.565 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:17.565 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:17.565 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.566 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.566 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:17.566 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:17.566 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:17.566 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:17.566 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.566 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.566 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:17.566 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:17.566 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:17.566 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.566 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:17.567 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.567 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:17.567 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:17.567 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.567 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:17.567 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:17.567 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:17.567 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:17.567 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:17.567 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:17.567 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.567 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:17.567 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.568 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:17.568 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.568 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:17.568 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:17.568 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.568 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:17.568 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.568 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:17.568 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:17.568 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:17.568 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:17.569 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:17.569 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:17.569 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:17.569 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:17.569 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:17.569 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:17.569 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:17.569 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:17.569 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:17.569 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.569 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:17.569 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:17.570 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:17.570 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:17.570 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:17.570 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:17.570 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:17.570 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:17.570 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:17.570 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:17.570 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:17.570 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.570 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.570 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:17.570 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.571 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:17.571 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:17.571 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:17.571 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:17.571 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:17.571 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:17.571 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:17.571 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:17.571 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:17.571 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:17.571 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:17.571 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:17.572 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:17.572 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:17.572 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:17.573 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:17.573 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:17.573 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:17.573 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:17.573 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:17.573 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:17.573 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:17.573 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:17.573 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:17.573 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:17.574 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:17.574 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:17.574 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:17.574 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.574 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.574 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:17.574 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.574 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:17.574 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:17.574 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.574 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:17.575 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:17.575 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:17.575 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:17.575 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:17.575 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.575 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:17.575 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:17.575 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.575 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.575 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:17.575 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:17.575 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.576 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.576 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:17.576 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:17.576 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:17.576 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:17.577 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:17.577 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.577 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.577 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:17.577 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:17.577 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:17.577 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.577 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:17.577 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.577 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:17.577 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.577 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:17.577 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.578 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.tagging 2023-10-05T12:49:17.578 INFO:teuthology.orchestra.run.smithi012.stdout: def test_put_excess_key_tags(): 2023-10-05T12:49:17.578 INFO:teuthology.orchestra.run.smithi012.stdout: key = 'testputexcesskeytags' 2023-10-05T12:49:17.578 INFO:teuthology.orchestra.run.smithi012.stdout:> bucket_name = _create_key_with_random_content(key) 2023-10-05T12:49:17.578 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.578 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:10438: 2023-10-05T12:49:17.578 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.578 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:5796: in _create_key_with_random_content 2023-10-05T12:49:17.578 INFO:teuthology.orchestra.run.smithi012.stdout: bucket_name = get_new_bucket() 2023-10-05T12:49:17.578 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-10-05T12:49:17.578 INFO:teuthology.orchestra.run.smithi012.stdout: client.create_bucket(Bucket=name) 2023-10-05T12:49:17.578 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:17.579 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:17.579 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:17.579 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:17.579 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:17.579 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:17.579 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:17.579 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:17.579 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:17.579 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:17.579 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:17.579 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:17.579 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:17.580 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:17.580 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:17.580 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:17.580 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:17.580 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:17.580 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:17.580 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:17.580 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:17.580 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:17.580 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:17.580 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:17.580 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:17.580 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:17.581 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:17.581 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:17.581 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:17.581 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:17.581 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:17.581 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:17.581 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:17.581 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:17.581 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.581 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.581 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:17.581 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:17.582 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.582 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:17.582 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.582 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:17.582 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:17.582 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:17.582 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:17.582 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:17.582 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:17.582 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:17.582 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:17.582 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:17.583 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:17.583 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:17.583 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:17.583 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:17.583 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.583 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:17.583 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:17.583 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:17.583 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:17.583 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:17.583 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:17.583 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:17.583 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:17.583 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:17.584 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:17.584 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:17.584 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.584 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.584 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:17.584 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:17.584 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:17.584 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:17.584 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:17.584 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.584 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.584 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:17.584 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:17.585 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:17.585 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:17.585 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:17.585 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.585 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:17.585 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:17.585 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:17.585 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:17.585 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:17.585 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-443" 2023-10-05T12:49:17.585 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.585 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:17.585 INFO:teuthology.orchestra.run.smithi012.stdout:___________________________ test_put_excess_val_tags ___________________________ 2023-10-05T12:49:17.586 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.586 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:17.586 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.586 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:17.586 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:17.586 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.586 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:17.586 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:17.586 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:17.586 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:17.586 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:17.586 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.586 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:17.587 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:17.587 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.587 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.587 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:17.587 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:17.587 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.587 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.587 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:17.587 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.587 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:17.587 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:17.587 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.588 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.588 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:17.588 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:17.588 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.588 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:17.588 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:17.588 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:17.588 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:17.588 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:17.588 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:17.588 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:17.588 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.589 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:17.589 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:17.589 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:17.589 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:17.589 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:17.589 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:17.589 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:17.589 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:17.589 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:17.589 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.589 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:17.589 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:17.589 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:17.590 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:17.590 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.590 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:17.590 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:17.590 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:17.590 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:17.590 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.590 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.590 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:17.590 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:17.590 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:17.591 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:17.591 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.591 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.591 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:17.591 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:17.591 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:17.591 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.591 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:17.591 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.591 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:17.591 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:17.591 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.592 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:17.592 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:17.592 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:17.592 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:17.592 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:17.592 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:17.592 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.592 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:17.592 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.592 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:17.592 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.592 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:17.592 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:17.593 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.593 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:17.593 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.593 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:17.593 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:17.593 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:17.593 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:17.593 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:17.593 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:17.593 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:17.593 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:17.593 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:17.594 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:17.594 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:17.594 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:17.594 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:17.594 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.594 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:17.594 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:17.594 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:17.594 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:17.594 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:17.594 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:17.594 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:17.595 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:17.595 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:17.595 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:17.595 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:17.595 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.595 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.595 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:17.595 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.595 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:17.595 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:17.595 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:17.595 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:17.596 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:17.596 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:17.596 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:17.596 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:17.596 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:17.596 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:17.596 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:17.596 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:17.596 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:17.596 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:17.596 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:17.596 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:17.597 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:17.597 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:17.597 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:17.597 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:17.597 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:17.597 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:17.597 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:17.597 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:17.597 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:17.597 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:17.597 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:17.598 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:17.598 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.598 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.598 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:17.598 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.598 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:17.598 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:17.598 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.598 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:17.598 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:17.598 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:17.598 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:17.599 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:17.599 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.599 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:17.599 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:17.599 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.599 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.599 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:17.599 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:17.599 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.599 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.599 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:17.599 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:17.600 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:17.600 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:17.600 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:17.600 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.600 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.600 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:17.600 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:17.600 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:17.600 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.600 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:17.600 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.600 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:17.601 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.601 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:17.601 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.601 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.tagging 2023-10-05T12:49:17.601 INFO:teuthology.orchestra.run.smithi012.stdout: def test_put_excess_val_tags(): 2023-10-05T12:49:17.601 INFO:teuthology.orchestra.run.smithi012.stdout: key = 'testputexcesskeytags' 2023-10-05T12:49:17.601 INFO:teuthology.orchestra.run.smithi012.stdout:> bucket_name = _create_key_with_random_content(key) 2023-10-05T12:49:17.601 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.601 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:10460: 2023-10-05T12:49:17.601 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.601 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:5796: in _create_key_with_random_content 2023-10-05T12:49:17.601 INFO:teuthology.orchestra.run.smithi012.stdout: bucket_name = get_new_bucket() 2023-10-05T12:49:17.601 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-10-05T12:49:17.602 INFO:teuthology.orchestra.run.smithi012.stdout: client.create_bucket(Bucket=name) 2023-10-05T12:49:17.602 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:17.602 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:17.602 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:17.602 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:17.602 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:17.602 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:17.602 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:17.602 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:17.602 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:17.602 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:17.603 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:17.603 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:17.603 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:17.603 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:17.603 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:17.603 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:17.603 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:17.603 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:17.603 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:17.603 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:17.603 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:17.603 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:17.603 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:17.604 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:17.604 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:17.604 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:17.604 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:17.604 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:17.604 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:17.604 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:17.604 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:17.604 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:17.604 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:17.604 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:17.604 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.605 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.605 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:17.605 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:17.605 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.605 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:17.605 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.605 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:17.605 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:17.605 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:17.605 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:17.605 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:17.605 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:17.606 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:17.606 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:17.606 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:17.606 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:17.606 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:17.606 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:17.606 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:17.606 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.606 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:17.606 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:17.606 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:17.606 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:17.607 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:17.607 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:17.607 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:17.607 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:17.607 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:17.607 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:17.607 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:17.607 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.607 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.607 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:17.607 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:17.607 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:17.607 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:17.608 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:17.608 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.608 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.608 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:17.608 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:17.608 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:17.608 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:17.608 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:17.608 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.608 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:17.608 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:17.608 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:17.609 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:17.609 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:17.609 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-444" 2023-10-05T12:49:17.609 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.609 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:17.609 INFO:teuthology.orchestra.run.smithi012.stdout:_____________________________ test_put_modify_tags _____________________________ 2023-10-05T12:49:17.609 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.609 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:17.609 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.609 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:17.609 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:17.609 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.609 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:17.610 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:17.610 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:17.610 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:17.610 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:17.610 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.610 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:17.610 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:17.610 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.610 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.610 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:17.610 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:17.610 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.610 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.611 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:17.611 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.611 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:17.611 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:17.611 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.611 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.611 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:17.611 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:17.611 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.611 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:17.611 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:17.611 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:17.612 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:17.612 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:17.612 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:17.612 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:17.612 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.612 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:17.612 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:17.612 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:17.612 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:17.612 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:17.612 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:17.612 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:17.612 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:17.613 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:17.613 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.613 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:17.613 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:17.613 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:17.613 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:17.613 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.613 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:17.613 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:17.613 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:17.613 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:17.613 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.614 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.614 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:17.614 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:17.614 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:17.614 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:17.614 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.614 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.614 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:17.614 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:17.614 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:17.614 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.614 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:17.615 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.615 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:17.615 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:17.615 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.615 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:17.615 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:17.615 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:17.615 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:17.615 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:17.615 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:17.615 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.615 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:17.616 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.616 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:17.616 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.616 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:17.616 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:17.616 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.616 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:17.616 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.616 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:17.616 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:17.616 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:17.617 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:17.617 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:17.617 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:17.617 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:17.617 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:17.617 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:17.617 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:17.617 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:17.617 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:17.617 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:17.617 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.618 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:17.618 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:17.618 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:17.618 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:17.618 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:17.618 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:17.618 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:17.618 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:17.618 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:17.618 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:17.618 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:17.618 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.619 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.619 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:17.619 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.619 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:17.619 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:17.619 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:17.619 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:17.619 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:17.619 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:17.619 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:17.619 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:17.619 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:17.620 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:17.620 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:17.620 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:17.620 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:17.620 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:17.620 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:17.620 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:17.620 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:17.620 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:17.620 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:17.620 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:17.621 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:17.621 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:17.621 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:17.621 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:17.621 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:17.621 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:17.621 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:17.621 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:17.621 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.621 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.621 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:17.621 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.621 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:17.622 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:17.622 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.622 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:17.622 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:17.622 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:17.622 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:17.622 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:17.622 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.622 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:17.622 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:17.622 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.622 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.623 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:17.623 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:17.623 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.623 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.623 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:17.623 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:17.623 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:17.623 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:17.623 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:17.623 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.623 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.623 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:17.623 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:17.624 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:17.624 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.624 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:17.624 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.624 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:17.624 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.624 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:17.624 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.624 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.tagging 2023-10-05T12:49:17.624 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.fails_on_dbstore 2023-10-05T12:49:17.624 INFO:teuthology.orchestra.run.smithi012.stdout: def test_put_modify_tags(): 2023-10-05T12:49:17.624 INFO:teuthology.orchestra.run.smithi012.stdout: key = 'testputmodifytags' 2023-10-05T12:49:17.625 INFO:teuthology.orchestra.run.smithi012.stdout:> bucket_name = _create_key_with_random_content(key) 2023-10-05T12:49:17.625 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.625 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:10483: 2023-10-05T12:49:17.625 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.625 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:5796: in _create_key_with_random_content 2023-10-05T12:49:17.625 INFO:teuthology.orchestra.run.smithi012.stdout: bucket_name = get_new_bucket() 2023-10-05T12:49:17.625 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-10-05T12:49:17.625 INFO:teuthology.orchestra.run.smithi012.stdout: client.create_bucket(Bucket=name) 2023-10-05T12:49:17.625 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:17.625 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:17.625 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:17.625 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:17.625 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:17.626 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:17.626 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:17.626 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:17.626 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:17.626 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:17.626 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:17.626 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:17.626 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:17.626 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:17.626 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:17.626 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:17.627 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:17.627 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:17.627 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:17.627 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:17.627 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:17.627 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:17.627 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:17.627 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:17.627 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:17.627 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:17.627 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:17.627 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:17.628 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:17.628 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:17.628 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:17.628 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:17.628 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:17.628 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:17.628 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.628 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.628 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:17.628 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:17.628 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.629 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:17.629 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.629 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:17.629 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:17.629 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:17.629 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:17.629 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:17.629 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:17.629 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:17.629 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:17.629 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:17.629 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:17.630 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:17.630 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:17.630 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:17.630 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.630 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:17.630 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:17.630 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:17.630 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:17.630 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:17.630 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:17.630 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:17.631 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:17.631 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:17.631 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:17.631 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:17.631 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.631 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.631 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:17.631 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:17.631 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:17.631 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:17.631 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:17.631 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.631 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.632 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:17.632 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:17.632 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:17.632 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:17.632 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:17.632 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.632 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:17.632 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:17.632 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:17.632 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:17.632 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:17.632 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-445" 2023-10-05T12:49:17.632 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.633 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:17.633 INFO:teuthology.orchestra.run.smithi012.stdout:_____________________________ test_put_delete_tags _____________________________ 2023-10-05T12:49:17.633 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.633 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:17.633 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.633 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:17.633 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:17.633 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.633 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:17.633 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:17.633 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:17.633 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:17.633 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:17.634 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.634 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:17.634 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:17.634 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.634 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.634 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:17.634 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:17.634 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.634 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.634 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:17.634 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.634 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:17.635 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:17.635 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.635 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.635 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:17.635 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:17.635 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.635 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:17.635 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:17.635 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:17.635 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:17.635 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:17.635 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:17.635 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:17.636 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.636 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:17.636 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:17.636 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:17.636 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:17.636 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:17.636 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:17.636 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:17.636 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:17.636 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:17.636 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.636 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:17.636 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:17.637 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:17.637 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:17.637 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.637 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:17.637 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:17.637 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:17.637 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:17.637 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.637 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.637 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:17.637 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:17.637 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:17.637 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:17.638 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.638 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.638 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:17.638 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:17.638 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:17.638 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.638 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:17.638 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.638 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:17.638 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:17.638 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.638 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:17.639 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:17.639 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:17.639 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:17.639 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:17.639 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:17.639 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.639 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:17.639 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.639 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:17.639 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.639 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:17.639 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:17.640 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.640 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:17.640 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.640 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:17.640 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:17.640 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:17.640 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:17.640 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:17.640 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:17.640 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:17.640 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:17.640 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:17.640 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:17.641 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:17.641 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:17.641 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:17.641 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.641 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:17.641 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:17.641 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:17.641 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:17.641 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:17.641 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:17.641 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:17.641 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:17.641 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:17.642 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:17.642 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:17.642 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.642 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.642 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:17.642 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.642 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:17.642 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:17.642 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:17.642 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:17.642 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:17.642 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:17.643 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:17.643 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:17.643 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:17.643 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:17.643 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:17.643 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:17.643 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:17.643 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:17.643 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:17.643 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:17.643 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:17.643 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:17.643 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:17.644 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:17.644 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:17.644 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:17.644 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:17.644 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:17.644 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:17.644 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:17.644 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:17.644 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:17.644 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.644 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.644 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:17.645 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.645 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:17.645 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:17.645 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.645 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:17.645 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:17.645 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:17.645 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:17.645 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:17.645 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.645 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:17.645 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:17.645 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.646 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.646 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:17.646 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:17.646 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.646 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.646 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:17.646 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:17.646 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:17.646 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:17.646 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:17.646 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.647 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.647 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:17.647 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:17.647 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:17.647 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.647 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:17.647 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.647 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:17.647 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.647 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:17.647 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.647 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.tagging 2023-10-05T12:49:17.648 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.fails_on_dbstore 2023-10-05T12:49:17.648 INFO:teuthology.orchestra.run.smithi012.stdout: def test_put_delete_tags(): 2023-10-05T12:49:17.648 INFO:teuthology.orchestra.run.smithi012.stdout: key = 'testputmodifytags' 2023-10-05T12:49:17.648 INFO:teuthology.orchestra.run.smithi012.stdout:> bucket_name = _create_key_with_random_content(key) 2023-10-05T12:49:17.648 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.648 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:10513: 2023-10-05T12:49:17.648 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.648 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:5796: in _create_key_with_random_content 2023-10-05T12:49:17.648 INFO:teuthology.orchestra.run.smithi012.stdout: bucket_name = get_new_bucket() 2023-10-05T12:49:17.648 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-10-05T12:49:17.648 INFO:teuthology.orchestra.run.smithi012.stdout: client.create_bucket(Bucket=name) 2023-10-05T12:49:17.648 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:17.649 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:17.649 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:17.649 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:17.649 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:17.649 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:17.649 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:17.649 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:17.649 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:17.649 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:17.649 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:17.649 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:17.650 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:17.650 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:17.650 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:17.650 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:17.650 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:17.650 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:17.650 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:17.650 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:17.650 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:17.650 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:17.650 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:17.651 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:17.651 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:17.651 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:17.651 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:17.651 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:17.651 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:17.651 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:17.651 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:17.651 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:17.651 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:17.651 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:17.651 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.651 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.652 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:17.652 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:17.652 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.652 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:17.652 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.652 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:17.652 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:17.652 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:17.652 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:17.652 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:17.652 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:17.652 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:17.653 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:17.653 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:17.653 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:17.653 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:17.653 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:17.653 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:17.653 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.653 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:17.653 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:17.653 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:17.653 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:17.653 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:17.654 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:17.654 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:17.654 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:17.654 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:17.654 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:17.654 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:17.654 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.654 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.654 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:17.654 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:17.654 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:17.654 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:17.655 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:17.655 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.655 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.655 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:17.655 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:17.655 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:17.655 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:17.655 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:17.655 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.655 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:17.655 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:17.655 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:17.656 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:17.656 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:17.656 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-446" 2023-10-05T12:49:17.656 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.656 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:17.656 INFO:teuthology.orchestra.run.smithi012.stdout:___________________ test_post_object_tags_anonymous_request ____________________ 2023-10-05T12:49:17.656 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.656 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:17.656 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.656 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:17.656 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:17.656 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.657 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:17.657 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:17.657 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:17.657 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:17.657 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:17.657 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.657 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:17.657 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:17.657 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.657 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.657 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:17.657 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:17.657 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.658 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.658 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:17.658 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.658 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:17.658 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:17.658 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.658 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.658 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:17.658 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:17.658 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.658 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:17.659 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:17.659 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:17.659 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:17.659 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:17.659 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:17.659 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:17.659 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.659 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:17.659 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:17.659 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:17.659 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:17.660 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:17.660 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:17.660 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:17.660 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:17.660 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:17.660 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.660 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:17.660 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:17.660 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:17.660 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:17.660 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.660 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:17.661 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:17.661 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:17.661 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:17.661 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.661 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.661 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:17.661 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:17.661 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:17.661 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:17.661 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.661 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.661 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:17.661 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:17.662 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:17.662 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.662 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:17.662 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.662 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:17.662 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:17.662 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.662 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:17.662 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:17.662 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:17.662 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:17.663 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:17.663 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:17.663 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.663 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:17.663 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.663 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:17.663 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.663 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:17.663 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:17.663 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.663 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:17.663 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.663 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:17.664 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:17.664 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:17.664 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:17.664 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:17.664 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:17.664 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:17.664 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:17.664 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:17.664 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:17.664 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:17.664 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:17.664 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:17.664 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.665 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:17.665 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:17.665 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:17.665 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:17.665 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:17.665 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:17.665 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:17.665 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:17.665 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:17.665 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:17.665 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:17.665 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.666 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.666 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:17.666 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.666 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:17.666 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:17.666 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:17.666 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:17.666 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:17.666 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:17.666 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:17.666 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:17.666 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:17.667 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:17.667 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:17.667 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:17.667 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:17.667 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:17.667 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:17.667 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:17.667 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:17.667 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:17.667 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:17.667 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:17.667 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:17.668 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:17.668 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:17.668 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:17.668 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:17.668 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:17.668 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:17.668 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:17.668 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.668 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.668 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:17.668 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.668 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:17.669 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:17.669 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.669 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:17.669 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:17.669 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:17.669 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:17.669 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:17.669 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.669 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:17.669 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:17.669 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.669 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.670 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:17.670 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:17.670 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.670 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.670 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:17.670 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:17.670 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:17.670 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:17.670 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:17.670 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.670 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.670 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:17.671 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:17.671 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:17.671 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.671 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:17.671 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.671 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:17.671 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.671 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:17.671 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.671 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.tagging 2023-10-05T12:49:17.671 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.fails_on_dbstore 2023-10-05T12:49:17.671 INFO:teuthology.orchestra.run.smithi012.stdout: def test_post_object_tags_anonymous_request(): 2023-10-05T12:49:17.671 INFO:teuthology.orchestra.run.smithi012.stdout: bucket_name = get_new_bucket_name() 2023-10-05T12:49:17.672 INFO:teuthology.orchestra.run.smithi012.stdout: client = get_client() 2023-10-05T12:49:17.672 INFO:teuthology.orchestra.run.smithi012.stdout: url = _get_post_url(bucket_name) 2023-10-05T12:49:17.672 INFO:teuthology.orchestra.run.smithi012.stdout:> client.create_bucket(ACL='public-read-write', Bucket=bucket_name) 2023-10-05T12:49:17.672 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.672 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:10535: 2023-10-05T12:49:17.672 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.672 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:17.672 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:17.672 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:17.672 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:17.672 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:17.672 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:17.672 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:17.673 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:17.673 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:17.673 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:17.673 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:17.673 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:17.673 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:17.673 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:17.673 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:17.673 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:17.673 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:17.673 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:17.673 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:17.673 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:17.674 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:17.674 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:17.674 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:17.674 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:17.674 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:17.674 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:17.674 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:17.674 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:17.674 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:17.674 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:17.675 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:17.675 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:17.675 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:17.675 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:17.675 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.675 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.675 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:17.675 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:17.675 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.675 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:17.675 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.676 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:17.676 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:17.676 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:17.676 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:17.676 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:17.676 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:17.676 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:17.676 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:17.676 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:17.676 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:17.676 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:17.677 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:17.677 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:17.677 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.677 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:17.677 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:17.677 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:17.677 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:17.677 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:17.677 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:17.677 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:17.677 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:17.677 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:17.678 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:17.678 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:17.678 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.678 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.678 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:17.678 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:17.678 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:17.678 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:17.678 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:17.678 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.678 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.679 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:17.679 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:17.679 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:17.679 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:17.679 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:17.679 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.679 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:17.679 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:17.679 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:17.679 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:17.679 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:17.679 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-447" 2023-10-05T12:49:17.680 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.680 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:17.680 INFO:teuthology.orchestra.run.smithi012.stdout:_________________ test_post_object_tags_authenticated_request __________________ 2023-10-05T12:49:17.680 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.680 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:17.680 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.680 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:17.680 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:17.680 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.680 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:17.680 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:17.681 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:17.681 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:17.681 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:17.681 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.681 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:17.681 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:17.681 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.681 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.681 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:17.681 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:17.681 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.681 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.682 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:17.682 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.682 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:17.682 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:17.682 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.682 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.682 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:17.682 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:17.682 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.682 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:17.683 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:17.683 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:17.683 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:17.683 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:17.683 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:17.683 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:17.683 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.683 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:17.683 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:17.683 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:17.683 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:17.683 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:17.684 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:17.684 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:17.684 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:17.684 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:17.684 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.684 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:17.684 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:17.684 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:17.684 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:17.684 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.684 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:17.685 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:17.685 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:17.685 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:17.685 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.685 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.685 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:17.685 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:17.685 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:17.685 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:17.685 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.685 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.686 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:17.686 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:17.686 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:17.686 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.686 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:17.686 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.686 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:17.686 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:17.686 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.686 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:17.686 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:17.687 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:17.687 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:17.687 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:17.687 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:17.687 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.687 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:17.687 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.687 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:17.687 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.687 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:17.687 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:17.687 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.688 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:17.688 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.688 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:17.688 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:17.688 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:17.688 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:17.688 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:17.688 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:17.688 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:17.688 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:17.688 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:17.689 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:17.689 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:17.689 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:17.689 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:17.689 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.689 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:17.689 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:17.689 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:17.689 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:17.689 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:17.689 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:17.689 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:17.689 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:17.690 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:17.690 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:17.690 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:17.690 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.690 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.690 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:17.690 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.690 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:17.690 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:17.690 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:17.690 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:17.690 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:17.691 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:17.691 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:17.691 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:17.691 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:17.691 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:17.691 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:17.691 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:17.691 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:17.691 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:17.691 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:17.691 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:17.691 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:17.692 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:17.692 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:17.692 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:17.692 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:17.692 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:17.692 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:17.692 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:17.692 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:17.692 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:17.692 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:17.692 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:17.692 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.692 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.693 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:17.693 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.693 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:17.693 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:17.693 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.693 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:17.693 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:17.693 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:17.693 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:17.693 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:17.693 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.693 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:17.693 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:17.694 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.694 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.694 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:17.694 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:17.694 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.694 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.694 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:17.694 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:17.694 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:17.694 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:17.694 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:17.694 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.695 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.695 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:17.695 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:17.695 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:17.695 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.695 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:17.695 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.695 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:17.695 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.695 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:17.695 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.695 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.tagging 2023-10-05T12:49:17.695 INFO:teuthology.orchestra.run.smithi012.stdout: def test_post_object_tags_authenticated_request(): 2023-10-05T12:49:17.696 INFO:teuthology.orchestra.run.smithi012.stdout:> bucket_name = get_new_bucket() 2023-10-05T12:49:17.696 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.696 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:10563: 2023-10-05T12:49:17.696 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.696 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-10-05T12:49:17.696 INFO:teuthology.orchestra.run.smithi012.stdout: client.create_bucket(Bucket=name) 2023-10-05T12:49:17.696 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:17.696 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:17.696 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:17.696 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:17.696 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:17.696 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:17.696 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:17.697 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:17.697 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:17.697 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:17.697 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:17.697 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:17.697 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:17.697 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:17.697 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:17.697 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:17.697 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:17.697 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:17.697 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:17.698 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:17.698 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:17.698 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:17.698 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:17.698 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:17.698 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:17.698 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:17.698 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:17.698 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:17.698 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:17.698 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:17.699 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:17.699 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:17.699 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:17.699 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:17.699 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.699 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.699 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:17.699 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:17.699 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.699 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:17.699 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.699 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:17.700 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:17.700 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:17.700 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:17.700 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:17.700 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:17.700 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:17.700 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:17.700 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:17.700 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:17.700 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:17.700 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:17.700 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:17.700 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.700 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:17.701 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:17.701 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:17.701 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:17.701 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:17.701 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:17.701 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:17.701 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:17.701 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:17.701 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:17.701 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:17.701 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.702 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.702 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:17.702 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:17.702 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:17.702 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:17.702 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:17.702 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.702 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.702 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:17.702 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:17.702 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:17.702 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:17.703 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:17.703 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.703 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:17.703 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:17.703 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:17.703 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:17.703 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:17.703 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-448" 2023-10-05T12:49:17.703 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.703 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:17.703 INFO:teuthology.orchestra.run.smithi012.stdout:____________________________ test_put_obj_with_tags ____________________________ 2023-10-05T12:49:17.703 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.703 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:17.704 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.704 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:17.704 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:17.704 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.704 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:17.704 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:17.704 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:17.704 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:17.704 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:17.704 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.704 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:17.704 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:17.705 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.705 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.705 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:17.705 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:17.705 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.705 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.705 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:17.705 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.705 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:17.705 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:17.705 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.705 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.705 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:17.706 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:17.706 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.706 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:17.706 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:17.706 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:17.706 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:17.706 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:17.706 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:17.706 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:17.706 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.706 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:17.707 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:17.707 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:17.707 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:17.707 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:17.707 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:17.707 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:17.707 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:17.707 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:17.707 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.707 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:17.707 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:17.707 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:17.707 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:17.708 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.708 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:17.708 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:17.708 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:17.708 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:17.708 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.708 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.708 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:17.708 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:17.708 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:17.708 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:17.708 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.709 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.709 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:17.709 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:17.709 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:17.709 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.709 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:17.709 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.709 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:17.709 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:17.709 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.709 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:17.709 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:17.710 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:17.710 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:17.710 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:17.710 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:17.710 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.710 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:17.710 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.710 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:17.710 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.710 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:17.710 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:17.710 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.711 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:17.711 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.711 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:17.711 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:17.711 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:17.711 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:17.711 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:17.711 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:17.711 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:17.711 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:17.711 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:17.711 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:17.711 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:17.712 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:17.712 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:17.712 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.712 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:17.712 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:17.712 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:17.712 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:17.712 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:17.712 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:17.712 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:17.712 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:17.712 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:17.713 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:17.713 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:17.713 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.713 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.713 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:17.713 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.713 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:17.713 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:17.713 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:17.713 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:17.713 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:17.713 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:17.714 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:17.714 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:17.714 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:17.714 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:17.714 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:17.714 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:17.714 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:17.714 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:17.714 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:17.714 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:17.714 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:17.714 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:17.715 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:17.715 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:17.715 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:17.715 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:17.715 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:17.715 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:17.715 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:17.715 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:17.715 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:17.715 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:17.715 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.715 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.715 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:17.716 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.716 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:17.716 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:17.716 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.716 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:17.716 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:17.716 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:17.716 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:17.716 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:17.716 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.716 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:17.716 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:17.717 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.717 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.717 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:17.717 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:17.717 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.717 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.717 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:17.717 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:17.717 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:17.717 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:17.717 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:17.718 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.718 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.718 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:17.718 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:17.718 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:17.718 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.718 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:17.718 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.718 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:17.718 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.718 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:17.719 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.719 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.tagging 2023-10-05T12:49:17.719 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.fails_on_dbstore 2023-10-05T12:49:17.719 INFO:teuthology.orchestra.run.smithi012.stdout: def test_put_obj_with_tags(): 2023-10-05T12:49:17.719 INFO:teuthology.orchestra.run.smithi012.stdout:> bucket_name = get_new_bucket() 2023-10-05T12:49:17.719 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.719 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:10610: 2023-10-05T12:49:17.719 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.719 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-10-05T12:49:17.719 INFO:teuthology.orchestra.run.smithi012.stdout: client.create_bucket(Bucket=name) 2023-10-05T12:49:17.719 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:17.719 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:17.720 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:17.720 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:17.720 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:17.720 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:17.720 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:17.720 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:17.720 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:17.720 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:17.720 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:17.720 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:17.720 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:17.720 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:17.720 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:17.721 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:17.721 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:17.721 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:17.721 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:17.721 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:17.721 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:17.721 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:17.721 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:17.721 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:17.721 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:17.721 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:17.721 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:17.721 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:17.722 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:17.722 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:17.722 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:17.722 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:17.722 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:17.722 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:17.722 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.722 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.722 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:17.722 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:17.722 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.722 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:17.723 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.723 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:17.723 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:17.723 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:17.723 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:17.723 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:17.723 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:17.723 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:17.723 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:17.723 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:17.723 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:17.723 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:17.723 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:17.724 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:17.724 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.724 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:17.724 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:17.724 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:17.724 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:17.724 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:17.724 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:17.724 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:17.724 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:17.724 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:17.724 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:17.725 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:17.725 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.725 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.725 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:17.725 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:17.725 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:17.725 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:17.725 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:17.725 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.725 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.725 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:17.725 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:17.726 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:17.726 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:17.726 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:17.726 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.726 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:17.726 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:17.726 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:17.726 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:17.726 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:17.726 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-449" 2023-10-05T12:49:17.726 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.726 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:17.727 INFO:teuthology.orchestra.run.smithi012.stdout:___________________________ test_get_tags_acl_public ___________________________ 2023-10-05T12:49:17.727 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.727 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:17.727 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.727 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:17.727 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:17.727 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.727 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:17.727 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:17.727 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:17.727 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:17.727 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:17.727 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.728 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:17.728 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:17.728 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.728 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.728 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:17.728 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:17.728 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.728 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.728 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:17.728 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.728 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:17.728 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:17.729 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.729 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.729 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:17.729 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:17.729 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.729 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:17.729 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:17.729 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:17.729 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:17.729 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:17.729 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:17.729 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:17.729 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.730 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:17.730 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:17.730 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:17.730 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:17.730 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:17.730 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:17.730 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:17.730 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:17.730 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:17.730 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.730 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:17.730 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:17.731 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:17.731 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:17.731 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.731 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:17.731 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:17.731 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:17.731 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:17.731 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.731 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.731 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:17.731 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:17.731 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:17.731 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:17.732 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.732 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.732 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:17.732 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:17.732 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:17.732 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.732 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:17.732 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.732 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:17.732 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:17.732 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.732 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:17.733 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:17.733 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:17.733 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:17.733 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:17.733 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:17.733 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.733 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:17.733 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.733 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:17.733 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.733 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:17.733 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:17.734 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.734 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:17.734 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.734 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:17.734 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:17.734 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:17.734 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:17.734 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:17.734 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:17.734 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:17.734 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:17.734 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:17.735 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:17.735 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:17.735 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:17.735 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:17.735 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.735 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:17.735 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:17.735 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:17.735 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:17.735 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:17.735 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:17.736 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:17.736 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:17.736 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:17.736 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:17.736 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:17.736 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.736 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.736 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:17.736 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.736 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:17.736 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:17.736 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:17.737 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:17.737 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:17.737 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:17.737 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:17.737 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:17.737 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:17.737 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:17.737 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:17.737 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:17.737 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:17.737 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:17.738 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:17.738 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:17.738 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:17.738 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:17.738 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:17.738 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:17.738 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:17.738 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:17.738 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:17.738 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:17.738 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:17.739 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:17.739 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:17.739 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:17.739 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.739 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.739 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:17.739 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.739 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:17.739 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:17.739 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.739 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:17.739 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:17.740 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:17.740 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:17.740 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:17.740 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.740 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:17.740 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:17.740 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.740 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.740 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:17.740 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:17.740 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.741 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.741 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:17.741 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:17.741 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:17.741 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:17.741 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:17.741 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.741 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.741 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:17.741 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:17.741 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:17.741 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.741 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:17.742 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.742 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:17.742 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.742 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:17.742 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.742 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.tagging 2023-10-05T12:49:17.742 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.bucket_policy 2023-10-05T12:49:17.742 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.fails_on_dbstore 2023-10-05T12:49:17.742 INFO:teuthology.orchestra.run.smithi012.stdout: def test_get_tags_acl_public(): 2023-10-05T12:49:17.742 INFO:teuthology.orchestra.run.smithi012.stdout: key = 'testputtagsacl' 2023-10-05T12:49:17.742 INFO:teuthology.orchestra.run.smithi012.stdout:> bucket_name = _create_key_with_random_content(key) 2023-10-05T12:49:17.743 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.743 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:10644: 2023-10-05T12:49:17.743 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.743 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:5796: in _create_key_with_random_content 2023-10-05T12:49:17.743 INFO:teuthology.orchestra.run.smithi012.stdout: bucket_name = get_new_bucket() 2023-10-05T12:49:17.743 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-10-05T12:49:17.743 INFO:teuthology.orchestra.run.smithi012.stdout: client.create_bucket(Bucket=name) 2023-10-05T12:49:17.743 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:17.743 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:17.743 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:17.743 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:17.743 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:17.744 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:17.744 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:17.744 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:17.744 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:17.744 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:17.744 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:17.744 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:17.744 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:17.744 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:17.744 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:17.744 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:17.744 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:17.745 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:17.745 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:17.745 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:17.745 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:17.745 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:17.745 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:17.745 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:17.745 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:17.745 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:17.745 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:17.745 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:17.746 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:17.746 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:17.746 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:17.746 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:17.746 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:17.746 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:17.746 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.746 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.746 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:17.746 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:17.746 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.747 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:17.747 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.747 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:17.747 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:17.747 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:17.747 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:17.747 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:17.747 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:17.747 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:17.747 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:17.747 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:17.747 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:17.747 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:17.748 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:17.748 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:17.748 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.748 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:17.748 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:17.748 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:17.748 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:17.748 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:17.748 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:17.748 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:17.748 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:17.748 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:17.749 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:17.749 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:17.749 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.749 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.749 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:17.749 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:17.749 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:17.749 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:17.749 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:17.749 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.749 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.749 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:17.749 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:17.750 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:17.750 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:17.750 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:17.750 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.750 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:17.750 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:17.750 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:17.750 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:17.750 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:17.750 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-450" 2023-10-05T12:49:17.750 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.750 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:17.751 INFO:teuthology.orchestra.run.smithi012.stdout:___________________________ test_put_tags_acl_public ___________________________ 2023-10-05T12:49:17.751 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.751 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:17.751 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.751 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:17.751 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:17.751 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.751 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:17.751 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:17.751 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:17.751 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:17.752 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:17.752 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.752 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:17.752 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:17.752 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.752 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.752 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:17.752 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:17.752 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.752 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.752 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:17.752 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.752 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:17.753 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:17.753 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.753 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.753 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:17.753 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:17.753 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.753 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:17.753 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:17.753 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:17.753 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:17.753 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:17.754 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:17.754 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:17.754 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.754 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:17.754 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:17.754 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:17.754 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:17.754 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:17.754 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:17.754 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:17.754 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:17.754 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:17.755 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.755 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:17.755 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:17.755 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:17.755 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:17.755 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.755 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:17.755 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:17.755 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:17.755 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:17.755 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.755 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.756 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:17.756 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:17.756 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:17.756 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:17.756 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.756 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.756 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:17.756 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:17.756 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:17.756 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.756 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:17.756 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.757 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:17.757 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:17.757 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.757 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:17.757 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:17.757 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:17.757 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:17.757 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:17.757 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:17.757 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.757 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:17.757 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.758 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:17.758 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.758 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:17.758 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:17.758 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.758 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:17.758 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.758 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:17.758 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:17.758 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:17.758 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:17.759 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:17.759 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:17.759 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:17.759 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:17.759 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:17.759 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:17.759 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:17.759 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:17.759 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:17.759 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.759 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:17.759 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:17.759 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:17.760 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:17.760 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:17.760 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:17.760 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:17.760 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:17.760 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:17.760 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:17.760 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:17.760 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.760 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.760 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:17.760 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.761 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:17.761 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:17.761 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:17.761 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:17.761 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:17.761 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:17.761 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:17.761 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:17.761 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:17.761 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:17.761 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:17.761 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:17.762 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:17.762 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:17.762 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:17.762 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:17.762 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:17.762 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:17.762 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:17.762 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:17.762 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:17.762 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:17.762 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:17.763 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:17.763 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:17.763 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:17.763 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:17.763 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:17.763 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.763 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.763 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:17.763 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.763 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:17.763 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:17.763 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.763 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:17.764 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:17.764 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:17.764 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:17.764 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:17.764 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.764 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:17.764 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:17.764 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.764 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.764 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:17.764 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:17.764 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.765 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.765 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:17.765 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:17.765 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:17.765 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:17.765 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:17.765 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.765 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.765 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:17.765 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:17.765 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:17.765 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.765 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:17.766 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.766 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:17.766 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.766 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:17.766 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.766 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.tagging 2023-10-05T12:49:17.766 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.bucket_policy 2023-10-05T12:49:17.766 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.fails_on_dbstore 2023-10-05T12:49:17.766 INFO:teuthology.orchestra.run.smithi012.stdout: def test_put_tags_acl_public(): 2023-10-05T12:49:17.766 INFO:teuthology.orchestra.run.smithi012.stdout: key = 'testputtagsacl' 2023-10-05T12:49:17.766 INFO:teuthology.orchestra.run.smithi012.stdout:> bucket_name = _create_key_with_random_content(key) 2023-10-05T12:49:17.767 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.767 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:10667: 2023-10-05T12:49:17.767 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.767 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:5796: in _create_key_with_random_content 2023-10-05T12:49:17.767 INFO:teuthology.orchestra.run.smithi012.stdout: bucket_name = get_new_bucket() 2023-10-05T12:49:17.767 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-10-05T12:49:17.767 INFO:teuthology.orchestra.run.smithi012.stdout: client.create_bucket(Bucket=name) 2023-10-05T12:49:17.767 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:17.767 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:17.767 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:17.767 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:17.767 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:17.767 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:17.768 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:17.768 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:17.768 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:17.768 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:17.768 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:17.768 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:17.768 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:17.768 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:17.768 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:17.768 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:17.768 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:17.769 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:17.769 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:17.769 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:17.769 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:17.769 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:17.769 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:17.769 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:17.769 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:17.769 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:17.769 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:17.769 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:17.769 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:17.770 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:17.770 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:17.770 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:17.770 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:17.770 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:17.770 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.770 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.770 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:17.770 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:17.770 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.770 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:17.771 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.771 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:17.771 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:17.771 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:17.771 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:17.771 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:17.771 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:17.771 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:17.771 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:17.771 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:17.771 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:17.772 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:17.772 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:17.772 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:17.772 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.772 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:17.772 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:17.772 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:17.772 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:17.772 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:17.772 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:17.772 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:17.772 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:17.773 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:17.773 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:17.773 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:17.773 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.773 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.773 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:17.773 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:17.773 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:17.773 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:17.773 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:17.773 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.773 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.774 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:17.774 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:17.774 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:17.774 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:17.774 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:17.774 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.774 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:17.774 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:17.774 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:17.774 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:17.774 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:17.775 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-451" 2023-10-05T12:49:17.775 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.775 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:17.775 INFO:teuthology.orchestra.run.smithi012.stdout:_________________________ test_delete_tags_obj_public __________________________ 2023-10-05T12:49:17.775 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.775 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:17.775 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.775 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:17.775 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:17.775 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.775 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:17.775 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:17.776 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:17.776 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:17.776 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:17.776 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.776 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:17.776 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:17.776 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.776 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.776 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:17.776 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:17.776 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.776 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.777 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:17.777 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.777 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:17.777 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:17.777 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.777 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.777 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:17.777 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:17.777 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.777 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:17.777 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:17.778 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:17.778 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:17.778 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:17.778 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:17.778 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:17.778 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.778 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:17.778 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:17.778 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:17.778 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:17.778 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:17.779 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:17.779 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:17.779 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:17.779 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:17.779 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.779 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:17.779 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:17.779 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:17.779 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:17.779 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.779 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:17.780 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:17.780 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:17.780 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:17.780 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.780 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.780 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:17.780 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:17.780 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:17.780 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:17.780 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.780 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.780 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:17.780 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:17.781 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:17.781 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.781 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:17.781 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.781 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:17.781 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:17.781 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.781 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:17.781 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:17.781 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:17.781 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:17.781 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:17.782 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:17.782 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.782 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:17.782 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.782 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:17.782 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.782 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:17.782 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:17.782 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.782 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:17.782 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.782 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:17.783 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:17.783 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:17.783 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:17.783 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:17.783 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:17.783 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:17.783 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:17.783 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:17.783 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:17.783 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:17.783 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:17.783 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:17.783 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.783 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:17.784 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:17.784 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:17.784 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:17.784 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:17.784 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:17.784 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:17.784 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:17.784 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:17.784 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:17.784 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:17.784 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.784 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.784 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:17.785 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.785 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:17.785 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:17.785 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:17.785 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:17.785 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:17.785 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:17.785 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:17.785 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:17.785 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:17.785 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:17.785 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:17.785 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:17.786 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:17.786 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:17.786 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:17.786 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:17.786 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:17.786 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:17.786 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:17.786 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:17.786 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:17.786 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:17.786 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:17.786 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:17.787 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:17.787 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:17.787 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:17.787 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:17.787 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.787 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.787 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:17.787 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.787 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:17.787 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:17.787 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.787 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:17.788 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:17.788 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:17.788 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:17.788 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:17.788 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.788 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:17.788 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:17.788 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.788 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.788 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:17.788 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:17.788 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.789 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.789 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:17.789 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:17.789 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:17.789 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:17.789 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:17.789 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.789 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.789 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:17.789 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:17.789 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:17.789 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.790 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:17.790 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.790 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:17.790 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.790 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:17.790 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.790 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.tagging 2023-10-05T12:49:17.790 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.bucket_policy 2023-10-05T12:49:17.790 INFO:teuthology.orchestra.run.smithi012.stdout: def test_delete_tags_obj_public(): 2023-10-05T12:49:17.790 INFO:teuthology.orchestra.run.smithi012.stdout: key = 'testputtagsacl' 2023-10-05T12:49:17.790 INFO:teuthology.orchestra.run.smithi012.stdout:> bucket_name = _create_key_with_random_content(key) 2023-10-05T12:49:17.791 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.791 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:10688: 2023-10-05T12:49:17.791 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.791 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:5796: in _create_key_with_random_content 2023-10-05T12:49:17.791 INFO:teuthology.orchestra.run.smithi012.stdout: bucket_name = get_new_bucket() 2023-10-05T12:49:17.791 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-10-05T12:49:17.791 INFO:teuthology.orchestra.run.smithi012.stdout: client.create_bucket(Bucket=name) 2023-10-05T12:49:17.791 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:17.791 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:17.791 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:17.791 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:17.791 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:17.791 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:17.792 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:17.792 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:17.792 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:17.792 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:17.792 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:17.792 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:17.792 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:17.792 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:17.792 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:17.792 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:17.792 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:17.792 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:17.793 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:17.793 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:17.793 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:17.793 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:17.793 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:17.793 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:17.793 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:17.793 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:17.793 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:17.793 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:17.793 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:17.793 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:17.794 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:17.794 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:17.794 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:17.794 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:17.794 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.794 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.794 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:17.794 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:17.794 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.794 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:17.795 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.795 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:17.795 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:17.795 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:17.795 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:17.795 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:17.795 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:17.795 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:17.795 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:17.795 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:17.795 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:17.795 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:17.796 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:17.796 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:17.796 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.796 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:17.796 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:17.796 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:17.796 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:17.796 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:17.796 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:17.796 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:17.796 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:17.796 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:17.797 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:17.797 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:17.797 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.797 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.797 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:17.797 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:17.797 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:17.797 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:17.797 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:17.797 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.797 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.798 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:17.798 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:17.798 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:17.798 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:17.798 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:17.798 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.798 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:17.798 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:17.798 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:17.798 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:17.798 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:17.798 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-452" 2023-10-05T12:49:17.799 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.799 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:17.799 INFO:teuthology.orchestra.run.smithi012.stdout:____________ test_versioning_bucket_atomic_upload_return_version_id ____________ 2023-10-05T12:49:17.799 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.799 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:17.799 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.799 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:17.799 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:17.799 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.799 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:17.799 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:17.800 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:17.800 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:17.800 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:17.800 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.800 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:17.800 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:17.800 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.800 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.800 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:17.800 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:17.800 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.800 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.801 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:17.801 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.801 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:17.801 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:17.801 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.801 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.801 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:17.801 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:17.801 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.801 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:17.801 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:17.802 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:17.802 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:17.802 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:17.802 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:17.802 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:17.802 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.802 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:17.802 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:17.802 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:17.802 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:17.802 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:17.802 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:17.803 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:17.803 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:17.803 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:17.803 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.803 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:17.803 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:17.803 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:17.803 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:17.803 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.803 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:17.803 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:17.804 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:17.804 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:17.804 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.804 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.804 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:17.804 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:17.804 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:17.804 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:17.804 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.804 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.804 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:17.805 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:17.805 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:17.805 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.805 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:17.805 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.805 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:17.805 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:17.805 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.805 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:17.805 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:17.805 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:17.806 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:17.806 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:17.806 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:17.806 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.806 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:17.806 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.806 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:17.806 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.806 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:17.806 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:17.806 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.806 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:17.807 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.807 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:17.807 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:17.807 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:17.807 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:17.807 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:17.807 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:17.807 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:17.807 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:17.807 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:17.807 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:17.807 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:17.808 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:17.808 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:17.808 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.808 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:17.808 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:17.808 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:17.808 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:17.808 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:17.808 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:17.808 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:17.808 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:17.809 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:17.809 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:17.809 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:17.809 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.809 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.809 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:17.809 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.809 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:17.809 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:17.809 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:17.809 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:17.810 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:17.810 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:17.810 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:17.810 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:17.810 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:17.810 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:17.810 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:17.810 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:17.810 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:17.810 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:17.810 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:17.810 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:17.811 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:17.811 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:17.811 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:17.811 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:17.811 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:17.811 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:17.811 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:17.811 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:17.811 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:17.811 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:17.811 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:17.811 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:17.812 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.812 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.812 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:17.812 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.812 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:17.812 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:17.812 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.812 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:17.812 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:17.812 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:17.812 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:17.812 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:17.813 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.813 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:17.813 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:17.813 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.813 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.813 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:17.813 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:17.813 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.813 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.813 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:17.813 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:17.814 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:17.814 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:17.814 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:17.814 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.814 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.814 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:17.814 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:17.814 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:17.814 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.814 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:17.815 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.815 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:17.815 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.815 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:17.815 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.815 INFO:teuthology.orchestra.run.smithi012.stdout: def test_versioning_bucket_atomic_upload_return_version_id(): 2023-10-05T12:49:17.815 INFO:teuthology.orchestra.run.smithi012.stdout:> bucket_name = get_new_bucket() 2023-10-05T12:49:17.815 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.815 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:10710: 2023-10-05T12:49:17.815 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.815 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-10-05T12:49:17.816 INFO:teuthology.orchestra.run.smithi012.stdout: client.create_bucket(Bucket=name) 2023-10-05T12:49:17.816 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:17.816 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:17.816 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:17.816 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:17.816 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:17.816 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:17.816 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:17.816 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:17.816 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:17.816 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:17.817 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:17.817 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:17.817 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:17.817 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:17.817 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:17.817 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:17.817 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:17.817 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:17.817 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:17.817 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:17.817 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:17.818 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:17.818 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:17.818 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:17.818 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:17.818 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:17.818 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:17.818 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:17.818 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:17.818 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:17.818 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:17.818 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:17.819 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:17.819 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:17.819 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.819 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.819 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:17.819 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:17.819 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.819 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:17.819 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.819 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:17.819 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:17.819 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:17.820 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:17.820 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:17.820 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:17.820 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:17.820 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:17.820 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:17.820 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:17.820 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:17.820 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:17.820 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:17.820 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.821 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:17.821 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:17.821 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:17.821 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:17.821 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:17.821 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:17.821 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:17.821 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:17.821 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:17.821 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:17.821 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:17.822 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.822 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.822 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:17.822 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:17.822 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:17.822 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:17.822 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:17.822 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.822 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.822 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:17.822 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:17.823 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:17.823 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:17.823 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:17.823 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.823 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:17.823 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:17.823 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:17.823 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:17.823 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:17.823 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-453" 2023-10-05T12:49:17.823 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.823 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:17.823 INFO:teuthology.orchestra.run.smithi012.stdout:__________ test_versioning_bucket_multipart_upload_return_version_id ___________ 2023-10-05T12:49:17.824 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.824 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:17.824 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.824 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:17.824 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:17.824 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.824 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:17.824 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:17.824 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:17.824 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:17.824 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:17.824 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.825 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:17.825 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:17.825 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.825 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.825 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:17.825 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:17.825 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.825 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.825 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:17.825 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.825 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:17.825 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:17.826 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.826 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.826 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:17.826 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:17.826 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.826 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:17.826 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:17.826 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:17.826 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:17.826 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:17.826 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:17.826 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:17.827 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.827 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:17.827 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:17.827 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:17.827 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:17.827 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:17.827 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:17.827 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:17.827 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:17.827 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:17.827 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.827 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:17.828 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:17.828 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:17.828 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:17.828 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.828 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:17.828 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:17.828 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:17.828 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:17.828 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.828 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.828 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:17.828 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:17.829 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:17.829 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:17.829 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.829 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.829 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:17.829 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:17.829 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:17.829 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.829 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:17.829 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.829 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:17.829 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:17.830 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.830 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:17.830 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:17.830 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:17.830 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:17.830 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:17.830 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:17.830 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.830 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:17.830 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.830 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:17.831 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.831 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:17.831 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:17.831 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.831 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:17.831 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.831 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:17.831 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:17.831 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:17.831 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:17.831 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:17.831 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:17.832 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:17.832 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:17.832 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:17.832 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:17.832 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:17.832 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:17.832 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:17.832 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.832 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:17.832 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:17.832 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:17.832 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:17.833 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:17.833 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:17.833 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:17.833 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:17.833 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:17.833 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:17.833 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:17.833 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.833 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.833 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:17.833 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.833 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:17.833 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:17.834 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:17.834 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:17.834 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:17.834 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:17.834 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:17.834 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:17.834 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:17.834 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:17.834 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:17.834 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:17.834 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:17.834 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:17.835 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:17.835 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:17.835 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:17.835 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:17.835 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:17.835 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:17.835 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:17.835 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:17.835 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:17.835 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:17.835 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:17.835 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:17.836 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:17.836 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:17.836 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.836 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.836 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:17.836 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.836 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:17.836 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:17.837 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.837 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:17.837 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:17.837 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:17.837 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:17.837 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:17.837 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.837 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:17.837 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:17.837 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.837 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.838 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:17.838 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:17.838 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.838 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.838 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:17.838 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:17.838 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:17.838 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:17.838 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:17.838 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.838 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.839 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:17.839 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:17.839 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:17.839 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.839 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:17.839 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.839 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:17.839 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.839 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:17.839 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.839 INFO:teuthology.orchestra.run.smithi012.stdout: def test_versioning_bucket_multipart_upload_return_version_id(): 2023-10-05T12:49:17.839 INFO:teuthology.orchestra.run.smithi012.stdout: content_type='text/bla' 2023-10-05T12:49:17.840 INFO:teuthology.orchestra.run.smithi012.stdout: objlen = 30 * 1024 * 1024 2023-10-05T12:49:17.840 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.840 INFO:teuthology.orchestra.run.smithi012.stdout:> bucket_name = get_new_bucket() 2023-10-05T12:49:17.840 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.840 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:10742: 2023-10-05T12:49:17.840 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.840 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-10-05T12:49:17.840 INFO:teuthology.orchestra.run.smithi012.stdout: client.create_bucket(Bucket=name) 2023-10-05T12:49:17.840 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:17.840 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:17.840 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:17.840 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:17.841 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:17.841 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:17.841 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:17.841 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:17.841 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:17.841 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:17.841 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:17.841 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:17.841 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:17.841 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:17.841 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:17.841 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:17.842 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:17.842 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:17.842 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:17.842 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:17.842 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:17.842 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:17.842 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:17.842 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:17.842 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:17.842 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:17.842 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:17.842 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:17.843 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:17.843 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:17.843 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:17.843 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:17.843 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:17.843 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:17.843 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.843 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.843 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:17.843 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:17.843 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.844 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:17.844 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.844 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:17.844 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:17.844 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:17.844 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:17.844 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:17.844 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:17.844 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:17.844 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:17.844 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:17.844 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:17.845 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:17.845 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:17.845 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:17.845 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.845 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:17.845 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:17.845 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:17.845 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:17.845 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:17.845 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:17.845 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:17.845 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:17.846 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:17.846 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:17.846 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:17.846 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.846 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.846 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:17.846 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:17.846 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:17.846 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:17.846 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:17.846 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.846 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.847 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:17.847 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:17.847 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:17.847 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:17.847 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:17.847 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.847 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:17.847 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:17.847 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:17.847 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:17.847 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:17.848 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-454" 2023-10-05T12:49:17.848 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.848 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:17.848 INFO:teuthology.orchestra.run.smithi012.stdout:___________________ test_bucket_policy_get_obj_existing_tag ____________________ 2023-10-05T12:49:17.848 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.848 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:17.848 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.848 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:17.848 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:17.848 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.848 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:17.849 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:17.849 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:17.849 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:17.849 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:17.849 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.849 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:17.849 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:17.849 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.849 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.849 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:17.849 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:17.850 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.850 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.850 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:17.850 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.850 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:17.850 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:17.850 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.850 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.850 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:17.850 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:17.850 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.850 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:17.851 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:17.851 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:17.851 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:17.851 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:17.851 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:17.851 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:17.851 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.851 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:17.851 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:17.851 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:17.851 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:17.851 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:17.852 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:17.852 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:17.852 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:17.852 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:17.852 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.852 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:17.852 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:17.852 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:17.852 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:17.852 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.852 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:17.853 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:17.853 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:17.853 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:17.853 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.853 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.853 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:17.853 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:17.853 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:17.853 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:17.853 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.853 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.853 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:17.854 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:17.854 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:17.854 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.854 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:17.854 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.854 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:17.854 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:17.854 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.854 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:17.854 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:17.854 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:17.854 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:17.855 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:17.855 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:17.855 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.855 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:17.855 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.855 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:17.855 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.855 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:17.855 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:17.855 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.855 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:17.855 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.856 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:17.856 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:17.856 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:17.856 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:17.856 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:17.856 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:17.856 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:17.856 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:17.856 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:17.857 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:17.857 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:17.857 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:17.857 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:17.857 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.857 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:17.857 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:17.857 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:17.857 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:17.857 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:17.857 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:17.858 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:17.858 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:17.858 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:17.858 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:17.858 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:17.858 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.858 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.858 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:17.858 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.858 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:17.858 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:17.859 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:17.859 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:17.859 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:17.859 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:17.859 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:17.859 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:17.859 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:17.859 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:17.859 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:17.859 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:17.859 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:17.859 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:17.860 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:17.860 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:17.860 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:17.860 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:17.860 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:17.860 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:17.860 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:17.860 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:17.860 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:17.860 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:17.860 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:17.861 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:17.861 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:17.861 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:17.861 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.861 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.861 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:17.861 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.861 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:17.861 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:17.861 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.861 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:17.861 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:17.862 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:17.862 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:17.862 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:17.862 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.862 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:17.862 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:17.862 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.862 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.862 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:17.862 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:17.862 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.863 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.863 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:17.863 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:17.863 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:17.863 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:17.863 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:17.863 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.863 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.863 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:17.863 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:17.863 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:17.863 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.864 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:17.864 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.864 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:17.864 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.864 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:17.864 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.864 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.tagging 2023-10-05T12:49:17.864 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.bucket_policy 2023-10-05T12:49:17.864 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.fails_on_dbstore 2023-10-05T12:49:17.864 INFO:teuthology.orchestra.run.smithi012.stdout: def test_bucket_policy_get_obj_existing_tag(): 2023-10-05T12:49:17.864 INFO:teuthology.orchestra.run.smithi012.stdout:> bucket_name = _create_objects(keys=['publictag', 'privatetag', 'invalidtag']) 2023-10-05T12:49:17.865 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.865 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:10783: 2023-10-05T12:49:17.865 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.865 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:116: in _create_objects 2023-10-05T12:49:17.865 INFO:teuthology.orchestra.run.smithi012.stdout: bucket = get_new_bucket_resource(name=bucket_name) 2023-10-05T12:49:17.865 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:581: in get_new_bucket_resource 2023-10-05T12:49:17.865 INFO:teuthology.orchestra.run.smithi012.stdout: bucket_location = bucket.create() 2023-10-05T12:49:17.865 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/boto3/resources/factory.py:580: in do_action 2023-10-05T12:49:17.865 INFO:teuthology.orchestra.run.smithi012.stdout: response = action(self, *args, **kwargs) 2023-10-05T12:49:17.865 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/boto3/resources/action.py:88: in __call__ 2023-10-05T12:49:17.865 INFO:teuthology.orchestra.run.smithi012.stdout: response = getattr(parent.meta.client, operation_name)(*args, **params) 2023-10-05T12:49:17.865 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:17.866 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:17.866 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:17.866 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:17.866 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:17.866 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:17.866 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:17.866 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:17.866 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:17.866 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:17.866 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:17.866 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:17.867 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:17.867 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:17.867 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:17.867 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:17.867 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:17.867 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:17.867 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:17.867 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:17.867 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:17.867 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:17.867 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:17.867 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:17.868 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:17.868 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:17.868 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:17.868 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:17.868 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:17.868 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:17.868 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:17.868 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:17.868 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:17.868 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:17.868 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.868 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.869 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:17.869 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:17.870 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.870 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:17.870 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.870 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:17.870 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:17.870 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:17.870 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:17.870 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:17.870 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:17.871 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:17.871 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:17.871 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:17.871 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:17.871 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:17.871 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:17.871 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:17.871 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.871 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:17.871 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:17.871 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:17.871 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:17.872 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:17.872 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:17.872 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:17.872 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:17.872 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:17.872 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:17.872 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:17.872 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.872 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.872 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:17.872 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:17.872 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:17.873 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:17.874 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:17.874 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.874 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.874 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:17.874 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:17.874 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:17.874 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:17.874 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:17.874 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.874 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:17.875 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:17.875 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:17.875 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:17.875 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:17.875 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-455" 2023-10-05T12:49:17.875 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.875 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:17.875 INFO:teuthology.orchestra.run.smithi012.stdout:_______________ test_bucket_policy_get_obj_tagging_existing_tag ________________ 2023-10-05T12:49:17.875 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.875 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:17.875 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.875 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:17.876 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:17.876 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.876 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:17.876 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:17.876 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:17.876 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:17.876 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:17.876 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.876 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:17.876 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:17.876 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.877 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.877 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:17.877 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:17.877 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.877 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.877 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:17.877 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.877 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:17.877 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:17.877 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.877 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.877 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:17.878 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:17.878 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.878 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:17.878 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:17.906 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-05T12:49:17.907 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:17.907 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:17.907 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:17.907 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:17.908 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:17.908 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.908 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:17.908 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:17.908 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:17.909 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:17.909 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:17.909 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:17.909 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:17.909 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:17.909 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:17.910 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.910 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:17.910 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:17.910 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:17.910 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:17.911 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.911 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:17.911 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:17.911 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:17.911 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:17.911 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.912 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.912 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:17.912 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:17.912 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:17.912 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:17.912 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.913 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.913 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:17.913 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:17.913 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:17.913 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.913 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:17.914 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.914 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:17.914 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:17.914 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.914 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:17.915 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:17.915 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:17.915 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:17.915 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:17.915 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:17.915 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.916 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:17.916 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.916 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:17.916 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.916 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:17.916 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:17.917 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.917 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:17.917 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.917 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:17.917 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:17.918 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:17.918 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:17.918 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:17.918 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:17.918 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:17.919 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:17.919 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:17.919 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:17.919 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:17.919 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:17.919 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:17.920 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.920 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:17.920 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:17.920 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:17.920 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:17.920 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:17.921 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:17.921 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:17.921 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:17.921 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:17.921 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:17.922 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:17.922 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.922 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.922 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:17.922 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.922 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:17.923 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:17.923 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:17.923 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:17.923 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:17.923 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:17.924 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:17.924 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:17.924 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:17.924 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:17.924 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:17.924 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:17.925 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:17.925 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:17.925 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:17.925 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:17.925 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:17.926 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:17.926 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:17.926 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:17.926 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:17.926 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:17.926 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:17.927 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:17.927 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:17.927 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:17.927 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:17.927 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:17.927 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.928 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.928 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:17.928 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.928 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:17.928 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:17.928 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.929 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:17.929 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:17.929 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:17.929 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:17.929 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:17.930 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.930 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:17.930 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:17.930 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.930 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.931 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:17.931 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:17.931 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.931 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.931 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:17.932 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:17.932 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:17.932 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:17.932 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:17.932 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.932 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.933 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:17.933 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:17.933 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:17.933 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.933 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:17.934 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.934 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:17.934 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.934 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:17.934 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.934 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.tagging 2023-10-05T12:49:17.934 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.bucket_policy 2023-10-05T12:49:17.935 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.fails_on_dbstore 2023-10-05T12:49:17.935 INFO:teuthology.orchestra.run.smithi012.stdout: def test_bucket_policy_get_obj_tagging_existing_tag(): 2023-10-05T12:49:17.935 INFO:teuthology.orchestra.run.smithi012.stdout:> bucket_name = _create_objects(keys=['publictag', 'privatetag', 'invalidtag']) 2023-10-05T12:49:17.935 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.935 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:10838: 2023-10-05T12:49:17.935 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.935 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:116: in _create_objects 2023-10-05T12:49:17.936 INFO:teuthology.orchestra.run.smithi012.stdout: bucket = get_new_bucket_resource(name=bucket_name) 2023-10-05T12:49:17.936 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:581: in get_new_bucket_resource 2023-10-05T12:49:17.936 INFO:teuthology.orchestra.run.smithi012.stdout: bucket_location = bucket.create() 2023-10-05T12:49:17.936 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/boto3/resources/factory.py:580: in do_action 2023-10-05T12:49:17.936 INFO:teuthology.orchestra.run.smithi012.stdout: response = action(self, *args, **kwargs) 2023-10-05T12:49:17.936 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/boto3/resources/action.py:88: in __call__ 2023-10-05T12:49:17.936 INFO:teuthology.orchestra.run.smithi012.stdout: response = getattr(parent.meta.client, operation_name)(*args, **params) 2023-10-05T12:49:17.936 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:17.937 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:17.937 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:17.937 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:17.937 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:17.937 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:17.938 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:17.938 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:17.938 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:17.938 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:17.938 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:17.938 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:17.939 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:17.939 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:17.939 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:17.939 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:17.939 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:17.939 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:17.939 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:17.939 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:17.940 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:17.940 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:17.940 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:17.940 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:17.940 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:17.940 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:17.940 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:17.940 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:17.941 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:17.941 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:17.941 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:17.941 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:17.941 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:17.941 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:17.941 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.941 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.942 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:17.942 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:17.942 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.942 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:17.942 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.942 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:17.942 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:17.942 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:17.943 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:17.943 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:17.943 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:17.943 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:17.943 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:17.943 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:17.943 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:17.943 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:17.943 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:17.943 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:17.943 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.944 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:17.944 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:17.944 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:17.944 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:17.944 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:17.944 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:17.944 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:17.944 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:17.944 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:17.944 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:17.944 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:17.944 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.945 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.945 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:17.945 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:17.945 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:17.945 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:17.945 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:17.945 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.945 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.945 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:17.945 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:17.945 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:17.946 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:17.946 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:17.946 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.946 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:17.946 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:17.946 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:17.946 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:17.946 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:17.946 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-456" 2023-10-05T12:49:17.946 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.946 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:17.947 INFO:teuthology.orchestra.run.smithi012.stdout:_______________ test_bucket_policy_put_obj_tagging_existing_tag ________________ 2023-10-05T12:49:17.947 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.947 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:17.947 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.947 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:17.947 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:17.947 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.947 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:17.947 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:17.947 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:17.947 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:17.947 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:17.948 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.948 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:17.948 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:17.948 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.948 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.948 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:17.948 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:17.948 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.948 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.948 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:17.948 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.949 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:17.949 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:17.949 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.949 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.949 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:17.949 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:17.949 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.949 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:17.949 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:17.949 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:17.949 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:17.949 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:17.950 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:17.950 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:17.950 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.950 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:17.950 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:17.950 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:17.950 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:17.950 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:17.950 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:17.950 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:17.950 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:17.951 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:17.951 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.951 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:17.951 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:17.951 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:17.951 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:17.951 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.951 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:17.951 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:17.951 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:17.951 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:17.951 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.952 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.952 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:17.952 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:17.952 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:17.952 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:17.952 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.952 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.952 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:17.952 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:17.952 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:17.952 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.953 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:17.953 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.953 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:17.953 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:17.953 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.953 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:17.953 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:17.953 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:17.953 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:17.953 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:17.953 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:17.953 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.954 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:17.954 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.954 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:17.954 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.954 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:17.954 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:17.954 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.954 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:17.954 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.954 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:17.955 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:17.955 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:17.955 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:17.955 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:17.955 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:17.955 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:17.955 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:17.955 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:17.955 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:17.955 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:17.955 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:17.956 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:17.956 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.956 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:17.956 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:17.956 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:17.956 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:17.956 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:17.956 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:17.956 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:17.956 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:17.956 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:17.956 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:17.957 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:17.957 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.957 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.957 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:17.957 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.957 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:17.957 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:17.957 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:17.957 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:17.957 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:17.957 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:17.957 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:17.958 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:17.958 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:17.958 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:17.958 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:17.958 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:17.958 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:17.958 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:17.958 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:17.958 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:17.958 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:17.958 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:17.959 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:17.959 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:17.959 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:17.959 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:17.959 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:17.959 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:17.959 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:17.959 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:17.959 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:17.959 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:17.959 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.959 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.960 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:17.960 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.960 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:17.960 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:17.960 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.960 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:17.960 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:17.960 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:17.960 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:17.960 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:17.960 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.960 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:17.961 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:17.961 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.961 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.961 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:17.961 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:17.961 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.961 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.961 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:17.961 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:17.961 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:17.961 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:17.962 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:17.962 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.962 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.962 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:17.962 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:17.962 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:17.962 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.962 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:17.962 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.962 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:17.962 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.962 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:17.963 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.963 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.tagging 2023-10-05T12:49:17.963 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.bucket_policy 2023-10-05T12:49:17.963 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.fails_on_dbstore 2023-10-05T12:49:17.963 INFO:teuthology.orchestra.run.smithi012.stdout: def test_bucket_policy_put_obj_tagging_existing_tag(): 2023-10-05T12:49:17.963 INFO:teuthology.orchestra.run.smithi012.stdout:> bucket_name = _create_objects(keys=['publictag', 'privatetag', 'invalidtag']) 2023-10-05T12:49:17.963 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.963 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:10900: 2023-10-05T12:49:17.963 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.963 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:116: in _create_objects 2023-10-05T12:49:17.963 INFO:teuthology.orchestra.run.smithi012.stdout: bucket = get_new_bucket_resource(name=bucket_name) 2023-10-05T12:49:17.963 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:581: in get_new_bucket_resource 2023-10-05T12:49:17.964 INFO:teuthology.orchestra.run.smithi012.stdout: bucket_location = bucket.create() 2023-10-05T12:49:17.964 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/boto3/resources/factory.py:580: in do_action 2023-10-05T12:49:17.964 INFO:teuthology.orchestra.run.smithi012.stdout: response = action(self, *args, **kwargs) 2023-10-05T12:49:17.964 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/boto3/resources/action.py:88: in __call__ 2023-10-05T12:49:17.964 INFO:teuthology.orchestra.run.smithi012.stdout: response = getattr(parent.meta.client, operation_name)(*args, **params) 2023-10-05T12:49:17.964 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:17.964 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:17.964 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:17.964 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:17.964 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:17.964 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:17.964 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:17.964 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:17.965 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:17.965 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:17.965 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:17.965 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:17.965 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:17.965 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:17.965 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:17.965 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:17.965 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:17.965 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:17.965 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:17.965 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:17.965 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:17.966 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:17.966 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:17.966 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:17.966 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:17.966 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:17.966 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:17.966 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:17.966 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:17.966 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:17.966 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:17.966 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:17.967 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:17.967 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:17.967 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.967 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.967 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:17.967 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:17.967 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.967 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:17.967 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.967 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:17.967 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:17.968 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:17.968 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:17.968 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:17.968 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:17.968 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:17.968 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:17.968 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:17.968 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:17.968 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:17.968 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:17.968 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:17.969 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.969 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:17.969 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:17.969 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:17.969 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:17.969 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:17.969 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:17.969 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:17.969 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:17.969 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:17.969 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:17.970 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:17.970 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.970 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.970 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:17.970 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:17.970 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:17.970 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:17.970 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:17.970 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.970 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.970 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:17.971 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:17.971 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:17.971 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:17.971 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:17.971 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.971 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:17.971 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:17.971 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:17.971 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:17.971 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:17.971 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-457" 2023-10-05T12:49:17.971 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.972 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:17.972 INFO:teuthology.orchestra.run.smithi012.stdout:____________________ test_bucket_policy_put_obj_copy_source ____________________ 2023-10-05T12:49:17.972 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.972 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:17.972 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.972 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:17.972 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:17.972 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.972 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:17.972 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:17.972 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:17.972 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:17.973 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:17.973 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.973 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:17.973 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:17.973 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.973 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.973 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:17.973 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:17.973 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.973 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.973 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:17.974 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.974 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:17.974 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:17.974 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.974 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.974 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:17.974 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:17.974 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.974 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:17.974 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:17.974 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:17.974 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:17.975 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:17.975 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:17.975 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:17.975 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.975 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:17.975 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:17.975 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:17.975 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:17.975 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:17.975 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:17.975 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:17.975 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:17.976 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:17.976 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.976 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:17.976 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:17.976 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:17.976 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:17.976 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.976 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:17.976 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:17.976 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:17.976 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:17.976 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.977 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.977 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:17.977 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:17.977 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:17.977 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:17.977 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.977 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.977 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:17.977 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:17.977 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:17.977 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.977 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:17.978 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.978 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:17.978 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:17.978 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.978 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:17.978 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:17.978 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:17.978 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:17.978 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:17.978 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:17.978 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.978 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:17.979 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.979 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:17.979 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.979 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:17.979 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:17.979 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.979 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:17.979 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.979 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:17.979 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:17.979 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:17.979 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:17.980 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:17.980 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:17.980 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:17.980 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:17.980 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:17.980 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:17.980 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:17.980 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:17.980 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:17.980 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.980 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:17.980 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:17.981 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:17.981 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:17.981 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:17.981 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:17.981 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:17.981 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:17.981 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:17.981 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:17.981 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:17.981 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.981 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.981 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:17.982 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.982 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:17.982 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:17.982 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:17.982 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:17.982 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:17.982 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:17.982 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:17.982 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:17.982 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:17.982 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:17.982 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:17.983 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:17.983 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:17.983 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:17.983 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:17.983 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:17.983 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:17.983 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:17.983 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:17.983 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:17.983 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:17.983 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:17.984 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:17.984 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:17.984 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:17.984 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:17.984 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:17.984 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:17.984 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.984 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.984 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:17.984 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.984 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:17.984 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:17.985 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.985 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:17.985 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:17.985 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:17.985 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:17.985 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:17.985 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.985 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:17.985 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:17.985 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.985 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.985 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:17.986 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:17.986 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.986 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.986 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:17.986 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:17.986 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:17.986 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:17.986 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:17.986 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.986 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.986 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:17.986 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:17.987 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:17.987 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.987 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:17.987 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.987 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:17.987 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.987 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:17.987 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.987 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.tagging 2023-10-05T12:49:17.987 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.bucket_policy 2023-10-05T12:49:17.987 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.fails_on_dbstore 2023-10-05T12:49:17.987 INFO:teuthology.orchestra.run.smithi012.stdout: def test_bucket_policy_put_obj_copy_source(): 2023-10-05T12:49:17.988 INFO:teuthology.orchestra.run.smithi012.stdout:> bucket_name = _create_objects(keys=['public/foo', 'public/bar', 'private/foo']) 2023-10-05T12:49:17.988 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.988 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:10969: 2023-10-05T12:49:17.988 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.988 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:116: in _create_objects 2023-10-05T12:49:17.988 INFO:teuthology.orchestra.run.smithi012.stdout: bucket = get_new_bucket_resource(name=bucket_name) 2023-10-05T12:49:17.988 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:581: in get_new_bucket_resource 2023-10-05T12:49:17.988 INFO:teuthology.orchestra.run.smithi012.stdout: bucket_location = bucket.create() 2023-10-05T12:49:17.988 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/boto3/resources/factory.py:580: in do_action 2023-10-05T12:49:17.988 INFO:teuthology.orchestra.run.smithi012.stdout: response = action(self, *args, **kwargs) 2023-10-05T12:49:17.988 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/boto3/resources/action.py:88: in __call__ 2023-10-05T12:49:17.988 INFO:teuthology.orchestra.run.smithi012.stdout: response = getattr(parent.meta.client, operation_name)(*args, **params) 2023-10-05T12:49:17.989 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:17.989 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:17.989 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:17.989 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:17.989 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:17.989 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:17.989 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:17.989 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:17.989 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:17.989 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:17.989 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:17.990 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:17.990 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:17.990 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:17.990 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:17.990 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:17.990 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:17.990 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:17.990 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:17.990 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:17.990 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:17.990 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:17.990 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:17.991 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:17.991 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:17.991 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:17.991 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:17.991 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:17.991 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:17.991 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:17.991 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:17.991 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:17.991 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:17.991 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:17.991 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.991 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.992 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:17.992 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:17.992 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.992 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:17.992 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.992 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:17.992 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:17.992 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:17.992 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:17.992 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:17.992 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:17.992 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:17.993 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:17.993 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:17.993 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:17.993 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:17.993 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:17.993 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:17.993 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.993 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:17.993 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:17.993 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:17.993 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:17.993 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:17.994 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:17.994 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:17.994 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:17.994 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:17.994 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:17.994 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:17.994 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.994 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.994 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:17.994 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:17.994 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:17.995 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:17.995 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:17.995 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.995 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.995 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:17.995 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:17.995 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:17.995 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:17.995 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:17.995 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.995 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:17.995 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:17.996 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:17.996 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:17.996 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:17.996 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-458" 2023-10-05T12:49:17.996 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.996 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:17.996 INFO:teuthology.orchestra.run.smithi012.stdout:_________________ test_bucket_policy_put_obj_copy_source_meta __________________ 2023-10-05T12:49:17.996 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.996 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:17.996 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.996 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:17.997 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:17.997 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.997 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:17.997 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:17.997 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:17.997 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:17.997 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:17.997 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.997 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:17.997 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:17.997 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.998 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:17.998 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:17.998 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:17.998 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:17.998 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.998 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:17.998 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.998 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:17.998 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:17.998 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:17.998 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.999 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:17.999 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:17.999 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:17.999 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:17.999 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:17.999 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:17.999 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:17.999 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:17.999 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:17.999 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:17.999 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.000 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:18.000 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:18.000 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:18.000 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:18.000 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:18.000 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:18.000 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:18.000 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:18.000 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:18.000 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.000 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:18.000 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:18.001 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:18.001 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:18.001 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.001 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:18.001 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:18.001 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:18.001 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:18.001 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.001 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.001 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:18.001 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:18.001 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:18.002 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:18.002 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.002 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.002 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:18.002 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:18.002 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:18.002 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.002 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:18.002 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.002 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:18.002 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:18.002 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.003 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:18.003 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:18.003 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:18.003 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:18.003 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:18.003 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:18.003 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.003 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:18.003 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.003 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:18.003 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.003 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:18.004 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:18.004 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.004 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:18.004 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.004 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:18.004 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:18.004 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:18.004 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:18.004 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:18.004 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:18.004 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:18.004 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:18.005 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:18.005 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:18.005 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:18.005 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:18.005 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:18.005 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.005 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:18.005 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:18.005 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:18.005 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:18.005 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:18.005 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:18.006 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:18.006 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:18.006 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:18.006 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:18.006 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:18.006 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.006 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.006 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:18.006 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.006 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:18.006 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:18.007 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:18.007 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:18.007 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:18.007 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:18.007 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:18.007 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:18.007 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:18.007 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:18.007 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:18.007 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:18.007 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:18.007 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:18.008 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:18.008 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:18.008 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:18.008 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:18.008 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:18.008 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:18.008 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:18.008 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:18.008 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:18.008 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:18.008 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:18.008 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:18.009 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:18.009 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:18.009 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.009 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.009 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:18.009 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.009 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:18.009 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:18.009 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.009 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:18.009 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:18.009 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:18.010 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:18.010 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:18.010 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.010 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:18.010 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:18.010 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.010 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.010 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:18.010 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:18.010 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.010 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.011 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:18.011 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:18.011 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:18.011 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:18.011 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:18.011 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.011 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.011 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:18.011 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:18.011 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:18.011 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.011 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:18.012 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.012 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:18.012 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.012 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:18.012 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.012 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.tagging 2023-10-05T12:49:18.012 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.bucket_policy 2023-10-05T12:49:18.012 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.fails_on_dbstore 2023-10-05T12:49:18.012 INFO:teuthology.orchestra.run.smithi012.stdout: def test_bucket_policy_put_obj_copy_source_meta(): 2023-10-05T12:49:18.012 INFO:teuthology.orchestra.run.smithi012.stdout:> src_bucket_name = _create_objects(keys=['public/foo', 'public/bar']) 2023-10-05T12:49:18.012 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.012 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:11016: 2023-10-05T12:49:18.013 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.013 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:116: in _create_objects 2023-10-05T12:49:18.013 INFO:teuthology.orchestra.run.smithi012.stdout: bucket = get_new_bucket_resource(name=bucket_name) 2023-10-05T12:49:18.013 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:581: in get_new_bucket_resource 2023-10-05T12:49:18.013 INFO:teuthology.orchestra.run.smithi012.stdout: bucket_location = bucket.create() 2023-10-05T12:49:18.013 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/boto3/resources/factory.py:580: in do_action 2023-10-05T12:49:18.013 INFO:teuthology.orchestra.run.smithi012.stdout: response = action(self, *args, **kwargs) 2023-10-05T12:49:18.013 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/boto3/resources/action.py:88: in __call__ 2023-10-05T12:49:18.013 INFO:teuthology.orchestra.run.smithi012.stdout: response = getattr(parent.meta.client, operation_name)(*args, **params) 2023-10-05T12:49:18.013 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:18.013 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:18.014 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:18.014 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:18.014 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:18.014 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:18.014 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:18.014 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:18.014 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:18.014 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:18.014 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:18.014 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:18.014 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:18.014 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:18.015 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:18.015 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:18.015 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:18.015 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:18.015 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:18.015 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:18.015 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:18.015 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:18.015 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:18.015 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:18.015 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:18.015 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:18.016 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:18.016 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:18.016 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:18.016 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:18.016 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:18.016 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:18.016 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:18.016 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:18.016 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.016 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.016 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:18.017 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:18.017 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.017 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:18.017 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.017 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:18.017 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:18.017 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:18.017 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:18.017 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:18.017 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:18.017 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:18.018 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:18.018 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:18.018 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:18.018 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:18.018 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:18.018 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:18.018 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.018 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:18.018 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:18.018 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:18.018 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:18.018 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:18.019 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:18.019 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:18.019 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:18.019 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:18.019 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:18.019 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:18.019 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.019 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.019 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:18.019 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:18.019 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:18.019 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:18.020 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:18.020 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.020 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.020 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:18.020 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:18.020 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:18.020 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:18.020 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:18.020 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.020 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:18.020 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:18.020 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:18.021 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:18.021 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:18.021 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-459" 2023-10-05T12:49:18.021 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.021 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:18.021 INFO:teuthology.orchestra.run.smithi012.stdout:________________________ test_bucket_policy_put_obj_acl ________________________ 2023-10-05T12:49:18.021 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.021 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:18.021 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.021 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:18.021 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:18.022 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.022 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:18.022 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:18.022 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:18.022 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:18.022 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:18.022 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.022 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:18.022 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:18.022 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.022 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.023 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:18.023 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:18.023 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.023 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.023 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:18.023 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.023 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:18.023 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:18.023 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.023 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.023 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:18.023 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:18.024 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.024 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:18.024 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:18.024 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:18.024 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:18.024 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:18.024 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:18.024 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:18.024 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.024 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:18.024 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:18.024 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:18.025 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:18.025 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:18.025 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:18.025 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:18.025 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:18.025 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:18.025 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.025 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:18.025 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:18.025 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:18.025 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:18.025 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.026 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:18.026 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:18.026 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:18.026 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:18.026 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.026 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.026 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:18.026 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:18.026 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:18.026 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:18.026 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.026 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.027 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:18.027 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:18.027 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:18.027 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.027 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:18.027 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.027 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:18.027 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:18.027 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.027 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:18.027 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:18.028 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:18.028 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:18.028 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:18.028 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:18.028 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.028 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:18.028 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.028 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:18.028 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.028 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:18.028 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:18.029 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.029 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:18.029 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.029 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:18.029 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:18.029 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:18.029 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:18.029 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:18.029 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:18.029 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:18.029 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:18.029 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:18.030 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:18.030 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:18.030 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:18.030 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:18.030 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.030 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:18.030 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:18.030 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:18.030 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:18.030 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:18.030 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:18.031 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:18.031 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:18.031 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:18.031 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:18.031 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:18.031 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.031 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.031 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:18.031 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.031 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:18.031 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:18.031 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:18.032 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:18.032 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:18.032 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:18.032 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:18.032 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:18.032 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:18.032 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:18.032 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:18.032 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:18.032 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:18.032 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:18.032 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:18.033 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:18.033 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:18.033 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:18.033 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:18.033 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:18.033 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:18.033 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:18.033 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:18.033 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:18.033 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:18.033 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:18.033 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:18.034 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:18.034 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.034 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.034 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:18.034 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.034 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:18.034 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:18.034 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.034 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:18.034 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:18.034 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:18.034 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:18.035 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:18.035 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.035 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:18.035 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:18.035 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.035 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.035 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:18.035 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:18.035 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.035 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.035 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:18.036 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:18.036 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:18.036 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:18.036 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:18.036 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.036 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.036 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:18.036 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:18.036 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:18.036 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.036 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:18.036 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.037 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:18.037 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.037 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:18.037 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.037 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.tagging 2023-10-05T12:49:18.037 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.bucket_policy 2023-10-05T12:49:18.037 INFO:teuthology.orchestra.run.smithi012.stdout: def test_bucket_policy_put_obj_acl(): 2023-10-05T12:49:18.037 INFO:teuthology.orchestra.run.smithi012.stdout:> bucket_name = get_new_bucket() 2023-10-05T12:49:18.037 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.037 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:11066: 2023-10-05T12:49:18.037 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.038 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-10-05T12:49:18.038 INFO:teuthology.orchestra.run.smithi012.stdout: client.create_bucket(Bucket=name) 2023-10-05T12:49:18.038 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:18.038 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:18.038 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:18.038 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:18.038 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:18.038 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:18.038 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:18.038 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:18.038 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:18.038 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:18.039 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:18.039 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:18.039 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:18.039 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:18.039 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:18.039 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:18.039 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:18.039 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:18.039 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:18.039 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:18.039 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:18.040 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:18.040 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:18.040 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:18.040 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:18.040 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:18.040 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:18.040 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:18.040 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:18.040 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:18.040 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:18.040 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:18.040 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:18.041 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:18.041 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.041 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.041 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:18.041 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:18.041 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.041 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:18.041 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.041 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:18.041 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:18.042 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:18.042 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:18.042 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:18.042 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:18.042 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:18.042 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:18.042 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:18.042 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:18.042 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:18.042 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:18.042 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:18.042 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.043 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:18.043 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:18.043 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:18.043 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:18.043 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:18.043 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:18.043 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:18.043 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:18.043 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:18.043 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:18.043 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:18.043 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.044 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.044 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:18.044 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:18.044 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:18.044 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:18.044 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:18.044 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.044 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.044 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:18.044 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:18.044 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:18.044 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:18.045 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:18.045 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.045 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:18.045 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:18.045 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:18.045 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:18.045 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:18.045 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-460" 2023-10-05T12:49:18.045 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.045 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:18.045 INFO:teuthology.orchestra.run.smithi012.stdout:_______________________ test_bucket_policy_put_obj_grant _______________________ 2023-10-05T12:49:18.045 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.046 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:18.046 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.046 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:18.046 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:18.046 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.046 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:18.046 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:18.046 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:18.046 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:18.046 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:18.046 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.047 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:18.047 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:18.047 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.047 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.047 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:18.047 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:18.047 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.047 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.047 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:18.047 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.047 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:18.047 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:18.048 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.048 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.048 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:18.048 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:18.048 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.048 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:18.048 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:18.048 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:18.048 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:18.048 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:18.048 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:18.048 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:18.049 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.049 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:18.049 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:18.049 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:18.049 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:18.049 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:18.049 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:18.049 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:18.049 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:18.049 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:18.049 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.049 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:18.050 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:18.050 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:18.050 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:18.050 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.050 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:18.050 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:18.050 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:18.050 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:18.050 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.050 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.050 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:18.051 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:18.051 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:18.051 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:18.051 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.051 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.051 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:18.051 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:18.051 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:18.051 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.051 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:18.051 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.051 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:18.052 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:18.052 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.052 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:18.052 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:18.052 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:18.052 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:18.052 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:18.052 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:18.052 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.052 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:18.052 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.053 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:18.053 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.053 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:18.053 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:18.053 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.053 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:18.053 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.053 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:18.053 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:18.053 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:18.053 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:18.053 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:18.054 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:18.054 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:18.054 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:18.054 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:18.054 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:18.054 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:18.054 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:18.054 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:18.054 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.054 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:18.054 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:18.054 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:18.055 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:18.055 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:18.055 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:18.055 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:18.055 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:18.055 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:18.055 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:18.055 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:18.055 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.055 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.055 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:18.055 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.056 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:18.056 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:18.056 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:18.056 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:18.056 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:18.056 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:18.056 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:18.056 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:18.056 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:18.056 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:18.056 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:18.057 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:18.057 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:18.057 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:18.057 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:18.057 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:18.057 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:18.057 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:18.057 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:18.057 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:18.057 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:18.057 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:18.058 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:18.058 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:18.058 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:18.058 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:18.058 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:18.058 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:18.058 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.058 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.058 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:18.058 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.058 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:18.059 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:18.059 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.059 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:18.059 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:18.059 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:18.059 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:18.059 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:18.059 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.059 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:18.059 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:18.059 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.060 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.060 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:18.060 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:18.060 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.060 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.060 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:18.060 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:18.060 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:18.060 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:18.060 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:18.060 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.060 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.061 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:18.061 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:18.061 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:18.061 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.061 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:18.061 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.061 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:18.061 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.061 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:18.061 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.061 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.bucket_policy 2023-10-05T12:49:18.061 INFO:teuthology.orchestra.run.smithi012.stdout: def test_bucket_policy_put_obj_grant(): 2023-10-05T12:49:18.062 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.062 INFO:teuthology.orchestra.run.smithi012.stdout:> bucket_name = get_new_bucket() 2023-10-05T12:49:18.062 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.062 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:11107: 2023-10-05T12:49:18.062 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.062 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-10-05T12:49:18.062 INFO:teuthology.orchestra.run.smithi012.stdout: client.create_bucket(Bucket=name) 2023-10-05T12:49:18.062 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:18.062 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:18.062 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:18.062 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:18.063 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:18.063 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:18.063 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:18.063 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:18.063 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:18.063 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:18.063 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:18.063 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:18.063 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:18.063 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:18.063 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:18.063 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:18.064 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:18.064 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:18.064 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:18.064 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:18.064 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:18.064 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:18.064 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:18.064 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:18.064 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:18.064 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:18.064 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:18.065 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:18.065 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:18.065 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:18.065 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:18.065 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:18.065 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:18.065 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:18.065 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.065 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.065 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:18.065 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:18.065 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.066 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:18.066 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.066 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:18.066 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:18.066 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:18.066 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:18.066 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:18.066 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:18.066 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:18.066 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:18.066 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:18.066 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:18.067 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:18.067 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:18.067 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:18.067 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.067 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:18.067 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:18.067 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:18.067 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:18.067 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:18.067 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:18.067 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:18.067 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:18.068 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:18.068 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:18.068 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:18.068 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.068 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.068 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:18.068 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:18.068 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:18.068 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:18.068 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:18.068 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.069 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.069 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:18.069 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:18.069 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:18.069 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:18.069 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:18.069 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.069 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:18.069 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:18.069 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:18.069 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:18.069 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:18.070 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-461" 2023-10-05T12:49:18.070 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.070 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:18.070 INFO:teuthology.orchestra.run.smithi012.stdout:________________________ test_put_obj_enc_conflict_c_s3 ________________________ 2023-10-05T12:49:18.070 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.070 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:18.070 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.070 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:18.070 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:18.070 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.070 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:18.070 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:18.071 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:18.071 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:18.071 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:18.071 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.071 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:18.071 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:18.071 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.071 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.071 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:18.071 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:18.071 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.072 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.072 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:18.072 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.072 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:18.072 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:18.072 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.072 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.072 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:18.072 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:18.072 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.072 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:18.073 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:18.073 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:18.073 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:18.073 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:18.073 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:18.073 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:18.073 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.073 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:18.073 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:18.073 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:18.073 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:18.073 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:18.074 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:18.074 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:18.074 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:18.074 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:18.074 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.074 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:18.074 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:18.074 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:18.074 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:18.074 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.074 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:18.074 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:18.075 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:18.075 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:18.075 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.075 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.075 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:18.075 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:18.075 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:18.075 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:18.075 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.075 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.075 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:18.076 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:18.076 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:18.076 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.076 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:18.076 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.076 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:18.076 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:18.076 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.076 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:18.076 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:18.076 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:18.076 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:18.077 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:18.077 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:18.077 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.077 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:18.077 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.077 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:18.077 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.077 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:18.077 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:18.077 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.077 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:18.077 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.078 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:18.078 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:18.078 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:18.078 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:18.078 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:18.078 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:18.078 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:18.078 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:18.078 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:18.078 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:18.078 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:18.079 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:18.079 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:18.079 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.079 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:18.079 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:18.079 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:18.079 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:18.079 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:18.079 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:18.079 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:18.079 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:18.079 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:18.079 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:18.080 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:18.080 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.080 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.080 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:18.080 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.080 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:18.080 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:18.080 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:18.080 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:18.080 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:18.080 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:18.080 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:18.081 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:18.081 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:18.081 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:18.081 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:18.081 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:18.081 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:18.081 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:18.081 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:18.081 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:18.081 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:18.081 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:18.081 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:18.082 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:18.082 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:18.082 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:18.082 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:18.082 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:18.082 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:18.082 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:18.082 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:18.082 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:18.082 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.082 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.083 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:18.083 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.083 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:18.083 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:18.083 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.083 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:18.083 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:18.083 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:18.083 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:18.083 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:18.083 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.083 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:18.084 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:18.084 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.084 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.084 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:18.084 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:18.084 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.084 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.084 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:18.084 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:18.084 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:18.084 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:18.084 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:18.085 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.085 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.085 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:18.085 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:18.085 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:18.085 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.085 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:18.085 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.085 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:18.085 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.085 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:18.085 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.086 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.encryption 2023-10-05T12:49:18.086 INFO:teuthology.orchestra.run.smithi012.stdout: def test_put_obj_enc_conflict_c_s3(): 2023-10-05T12:49:18.086 INFO:teuthology.orchestra.run.smithi012.stdout:> bucket_name = get_new_bucket() 2023-10-05T12:49:18.086 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.086 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:11168: 2023-10-05T12:49:18.086 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.086 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-10-05T12:49:18.086 INFO:teuthology.orchestra.run.smithi012.stdout: client.create_bucket(Bucket=name) 2023-10-05T12:49:18.086 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:18.086 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:18.086 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:18.087 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:18.087 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:18.087 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:18.087 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:18.087 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:18.087 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:18.087 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:18.087 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:18.087 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:18.087 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:18.087 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:18.088 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:18.088 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:18.088 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:18.088 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:18.088 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:18.088 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:18.088 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:18.088 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:18.088 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:18.088 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:18.088 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:18.088 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:18.089 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:18.089 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:18.089 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:18.089 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:18.089 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:18.089 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:18.089 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:18.089 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:18.089 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.089 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.089 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:18.090 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:18.090 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.090 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:18.090 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.090 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:18.090 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:18.090 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:18.090 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:18.090 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:18.090 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:18.090 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:18.090 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:18.091 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:18.091 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:18.091 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:18.091 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:18.091 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:18.091 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.091 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:18.091 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:18.091 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:18.091 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:18.091 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:18.091 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:18.092 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:18.092 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:18.092 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:18.092 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:18.092 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:18.092 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.092 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.092 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:18.092 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:18.092 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:18.092 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:18.092 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:18.093 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.093 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.093 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:18.093 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:18.093 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:18.093 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:18.093 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:18.093 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.093 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:18.093 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:18.093 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:18.094 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:18.094 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:18.094 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-462" 2023-10-05T12:49:18.094 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.094 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:18.094 INFO:teuthology.orchestra.run.smithi012.stdout:_______________________ test_put_obj_enc_conflict_c_kms ________________________ 2023-10-05T12:49:18.094 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.094 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:18.094 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.094 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:18.094 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:18.094 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.095 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:18.095 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:18.095 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:18.095 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:18.095 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:18.095 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.095 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:18.095 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:18.095 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.095 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.095 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:18.096 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:18.096 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.096 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.096 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:18.096 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.096 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:18.096 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:18.096 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.096 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.096 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:18.096 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:18.096 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.097 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:18.097 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:18.097 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:18.097 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:18.097 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:18.097 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:18.097 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:18.097 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.097 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:18.097 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:18.097 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:18.097 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:18.098 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:18.098 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:18.098 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:18.098 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:18.098 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:18.098 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.098 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:18.098 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:18.098 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:18.098 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:18.098 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.098 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:18.099 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:18.099 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:18.099 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:18.099 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.099 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.099 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:18.099 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:18.099 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:18.099 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:18.099 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.099 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.099 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:18.100 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:18.100 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:18.100 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.100 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:18.100 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.100 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:18.100 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:18.100 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.100 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:18.100 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:18.100 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:18.100 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:18.101 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:18.101 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:18.101 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.101 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:18.101 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.101 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:18.101 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.101 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:18.101 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:18.101 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.101 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:18.102 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.102 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:18.102 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:18.102 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:18.102 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:18.102 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:18.102 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:18.102 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:18.102 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:18.102 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:18.102 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:18.103 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:18.103 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:18.103 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:18.103 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.103 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:18.103 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:18.103 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:18.103 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:18.103 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:18.103 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:18.103 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:18.103 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:18.104 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:18.104 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:18.104 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:18.104 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.104 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.104 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:18.104 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.104 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:18.104 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:18.104 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:18.104 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:18.104 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:18.105 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:18.105 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:18.105 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:18.105 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:18.105 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:18.105 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:18.105 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:18.105 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:18.105 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:18.105 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:18.105 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:18.106 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:18.106 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:18.106 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:18.106 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:18.106 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:18.106 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:18.106 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:18.106 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:18.106 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:18.106 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:18.106 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:18.106 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:18.107 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.107 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.107 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:18.107 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.107 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:18.107 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:18.107 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.107 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:18.107 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:18.107 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:18.107 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:18.107 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:18.108 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.108 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:18.108 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:18.108 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.108 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.108 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:18.108 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:18.108 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.108 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.108 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:18.108 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:18.108 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:18.109 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:18.109 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:18.109 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.109 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.109 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:18.109 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:18.109 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:18.109 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.109 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:18.109 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.109 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:18.109 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.110 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:18.110 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.110 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.encryption 2023-10-05T12:49:18.110 INFO:teuthology.orchestra.run.smithi012.stdout: def test_put_obj_enc_conflict_c_kms(): 2023-10-05T12:49:18.110 INFO:teuthology.orchestra.run.smithi012.stdout: kms_keyid = get_main_kms_keyid() 2023-10-05T12:49:18.110 INFO:teuthology.orchestra.run.smithi012.stdout: if kms_keyid is None: 2023-10-05T12:49:18.110 INFO:teuthology.orchestra.run.smithi012.stdout: kms_keyid = 'fool-me-once' 2023-10-05T12:49:18.110 INFO:teuthology.orchestra.run.smithi012.stdout:> bucket_name = get_new_bucket() 2023-10-05T12:49:18.110 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.110 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:11194: 2023-10-05T12:49:18.110 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.110 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-10-05T12:49:18.111 INFO:teuthology.orchestra.run.smithi012.stdout: client.create_bucket(Bucket=name) 2023-10-05T12:49:18.111 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:18.111 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:18.111 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:18.111 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:18.111 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:18.111 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:18.111 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:18.111 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:18.111 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:18.111 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:18.111 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:18.112 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:18.112 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:18.112 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:18.112 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:18.112 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:18.112 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:18.112 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:18.112 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:18.112 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:18.112 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:18.112 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:18.112 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:18.112 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:18.113 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:18.113 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:18.113 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:18.113 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:18.113 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:18.113 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:18.113 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:18.113 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:18.113 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:18.113 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:18.113 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.113 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.114 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:18.114 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:18.114 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.114 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:18.114 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.114 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:18.114 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:18.114 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:18.114 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:18.114 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:18.114 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:18.114 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:18.115 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:18.115 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:18.115 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:18.115 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:18.115 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:18.115 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:18.115 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.115 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:18.115 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:18.115 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:18.115 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:18.116 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:18.116 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:18.116 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:18.116 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:18.116 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:18.116 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:18.116 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:18.116 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.116 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.116 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:18.116 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:18.117 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:18.117 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:18.117 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:18.117 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.117 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.117 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:18.117 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:18.117 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:18.117 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:18.117 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:18.117 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.117 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:18.118 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:18.118 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:18.118 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:18.118 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:18.118 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-463" 2023-10-05T12:49:18.118 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.118 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:18.118 INFO:teuthology.orchestra.run.smithi012.stdout:_______________________ test_put_obj_enc_conflict_s3_kms _______________________ 2023-10-05T12:49:18.118 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.118 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:18.118 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.118 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:18.119 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:18.119 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.119 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:18.119 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:18.119 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:18.119 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:18.119 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:18.119 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.119 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:18.119 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:18.119 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.119 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.120 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:18.120 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:18.120 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.120 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.120 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:18.120 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.120 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:18.120 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:18.120 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.120 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.120 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:18.120 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:18.121 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.121 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:18.121 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:18.121 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:18.121 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:18.121 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:18.121 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:18.121 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:18.121 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.121 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:18.121 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:18.122 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:18.122 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:18.122 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:18.122 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:18.122 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:18.122 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:18.122 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:18.122 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.122 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:18.122 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:18.122 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:18.122 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:18.123 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.123 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:18.123 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:18.123 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:18.123 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:18.123 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.123 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.123 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:18.123 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:18.123 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:18.123 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:18.123 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.124 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.124 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:18.124 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:18.124 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:18.124 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.124 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:18.124 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.124 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:18.124 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:18.124 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.124 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:18.124 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:18.125 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:18.125 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:18.125 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:18.125 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:18.125 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.125 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:18.125 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.125 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:18.125 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.125 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:18.125 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:18.125 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.126 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:18.126 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.126 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:18.126 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:18.126 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:18.126 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:18.126 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:18.126 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:18.126 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:18.126 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:18.126 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:18.126 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:18.127 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:18.127 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:18.127 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:18.127 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.127 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:18.127 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:18.127 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:18.127 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:18.127 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:18.127 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:18.127 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:18.127 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:18.128 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:18.128 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:18.128 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:18.128 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.128 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.128 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:18.128 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.128 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:18.128 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:18.128 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:18.128 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:18.128 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:18.129 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:18.129 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:18.129 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:18.129 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:18.129 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:18.129 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:18.129 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:18.129 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:18.129 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:18.129 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:18.129 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:18.130 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:18.130 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:18.130 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:18.130 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:18.130 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:18.130 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:18.130 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:18.130 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:18.130 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:18.130 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:18.130 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:18.131 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:18.131 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.131 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.131 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:18.131 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.131 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:18.131 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:18.131 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.131 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:18.131 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:18.131 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:18.131 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:18.132 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:18.132 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.132 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:18.132 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:18.132 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.132 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.132 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:18.132 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:18.132 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.132 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.132 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:18.132 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:18.133 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:18.133 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:18.133 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:18.133 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.133 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.133 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:18.133 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:18.133 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:18.133 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.133 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:18.133 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.133 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:18.134 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.134 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:18.134 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.134 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.encryption 2023-10-05T12:49:18.134 INFO:teuthology.orchestra.run.smithi012.stdout: def test_put_obj_enc_conflict_s3_kms(): 2023-10-05T12:49:18.134 INFO:teuthology.orchestra.run.smithi012.stdout: kms_keyid = get_main_kms_keyid() 2023-10-05T12:49:18.134 INFO:teuthology.orchestra.run.smithi012.stdout: if kms_keyid is None: 2023-10-05T12:49:18.134 INFO:teuthology.orchestra.run.smithi012.stdout: kms_keyid = 'fool-me-once' 2023-10-05T12:49:18.134 INFO:teuthology.orchestra.run.smithi012.stdout:> bucket_name = get_new_bucket() 2023-10-05T12:49:18.134 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.134 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:11221: 2023-10-05T12:49:18.135 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.135 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-10-05T12:49:18.135 INFO:teuthology.orchestra.run.smithi012.stdout: client.create_bucket(Bucket=name) 2023-10-05T12:49:18.135 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:18.135 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:18.135 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:18.135 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:18.135 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:18.135 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:18.135 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:18.135 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:18.135 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:18.136 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:18.136 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:18.136 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:18.136 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:18.136 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:18.136 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:18.136 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:18.136 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:18.136 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:18.136 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:18.136 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:18.136 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:18.137 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:18.137 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:18.137 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:18.137 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:18.137 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:18.137 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:18.137 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:18.137 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:18.137 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:18.137 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:18.137 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:18.137 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:18.138 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:18.138 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.138 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.138 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:18.138 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:18.138 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.138 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:18.138 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.138 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:18.138 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:18.138 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:18.139 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:18.139 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:18.139 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:18.139 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:18.139 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:18.139 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:18.139 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:18.139 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:18.139 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:18.139 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:18.139 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.139 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:18.139 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:18.140 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:18.140 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:18.140 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:18.140 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:18.140 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:18.140 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:18.140 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:18.140 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:18.140 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:18.140 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.140 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.141 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:18.141 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:18.141 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:18.141 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:18.141 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:18.141 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.141 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.141 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:18.141 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:18.141 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:18.141 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:18.141 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:18.142 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.142 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:18.142 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:18.142 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:18.142 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:18.142 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:18.142 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-464" 2023-10-05T12:49:18.142 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.142 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:18.142 INFO:teuthology.orchestra.run.smithi012.stdout:____________________ test_put_obj_enc_conflict_bad_enc_kms _____________________ 2023-10-05T12:49:18.142 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.142 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:18.143 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.143 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:18.143 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:18.143 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.143 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:18.143 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:18.143 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:18.143 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:18.143 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:18.143 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.143 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:18.144 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:18.144 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.144 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.144 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:18.144 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:18.144 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.144 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.144 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:18.144 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.144 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:18.144 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:18.145 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.145 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.145 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:18.145 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:18.145 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.145 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:18.145 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:18.145 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:18.145 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:18.145 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:18.145 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:18.145 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:18.146 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.146 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:18.146 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:18.146 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:18.146 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:18.146 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:18.146 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:18.146 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:18.146 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:18.146 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:18.146 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.147 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:18.147 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:18.147 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:18.147 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:18.147 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.147 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:18.147 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:18.147 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:18.147 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:18.147 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.147 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.148 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:18.148 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:18.148 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:18.148 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:18.148 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.148 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.148 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:18.148 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:18.148 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:18.148 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.148 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:18.149 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.149 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:18.149 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:18.149 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.149 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:18.149 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:18.149 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:18.149 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:18.149 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:18.149 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:18.149 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.149 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:18.150 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.150 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:18.150 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.150 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:18.150 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:18.150 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.150 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:18.150 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.150 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:18.150 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:18.150 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:18.151 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:18.151 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:18.151 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:18.151 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:18.151 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:18.151 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:18.151 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:18.151 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:18.151 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:18.151 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:18.151 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.151 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:18.152 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:18.152 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:18.152 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:18.152 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:18.152 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:18.152 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:18.152 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:18.152 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:18.152 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:18.152 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:18.152 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.152 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.153 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:18.153 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.153 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:18.153 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:18.153 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:18.153 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:18.153 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:18.153 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:18.153 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:18.153 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:18.153 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:18.153 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:18.154 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:18.154 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:18.154 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:18.154 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:18.154 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:18.154 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:18.154 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:18.154 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:18.154 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:18.154 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:18.154 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:18.155 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:18.155 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:18.155 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:18.155 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:18.155 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:18.155 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:18.155 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:18.155 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.155 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.155 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:18.155 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.155 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:18.156 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:18.156 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.156 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:18.156 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:18.156 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:18.156 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:18.156 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:18.156 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.156 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:18.156 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:18.156 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.156 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.157 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:18.157 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:18.157 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.157 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.157 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:18.157 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:18.157 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:18.157 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:18.157 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:18.157 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.157 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.158 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:18.158 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:18.158 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:18.158 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.158 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:18.158 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.158 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:18.158 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.158 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:18.158 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.158 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.encryption 2023-10-05T12:49:18.159 INFO:teuthology.orchestra.run.smithi012.stdout: def test_put_obj_enc_conflict_bad_enc_kms(): 2023-10-05T12:49:18.159 INFO:teuthology.orchestra.run.smithi012.stdout: kms_keyid = get_main_kms_keyid() 2023-10-05T12:49:18.159 INFO:teuthology.orchestra.run.smithi012.stdout: if kms_keyid is None: 2023-10-05T12:49:18.159 INFO:teuthology.orchestra.run.smithi012.stdout: kms_keyid = 'fool-me-once' 2023-10-05T12:49:18.159 INFO:teuthology.orchestra.run.smithi012.stdout:> bucket_name = get_new_bucket() 2023-10-05T12:49:18.159 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.159 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:11245: 2023-10-05T12:49:18.159 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.159 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-10-05T12:49:18.159 INFO:teuthology.orchestra.run.smithi012.stdout: client.create_bucket(Bucket=name) 2023-10-05T12:49:18.159 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:18.160 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:18.160 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:18.160 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:18.160 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:18.160 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:18.160 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:18.160 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:18.160 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:18.160 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:18.160 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:18.160 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:18.161 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:18.161 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:18.161 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:18.161 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:18.161 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:18.161 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:18.161 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:18.161 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:18.161 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:18.161 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:18.161 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:18.161 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:18.162 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:18.162 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:18.162 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:18.162 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:18.162 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:18.162 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:18.162 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:18.162 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:18.162 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:18.162 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:18.162 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.163 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.163 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:18.163 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:18.163 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.163 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:18.163 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.163 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:18.163 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:18.163 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:18.163 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:18.163 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:18.163 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:18.164 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:18.164 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:18.164 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:18.164 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:18.164 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:18.164 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:18.164 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:18.164 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.164 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:18.164 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:18.164 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:18.164 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:18.165 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:18.165 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:18.165 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:18.165 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:18.165 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:18.165 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:18.165 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:18.165 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.165 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.165 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:18.165 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:18.166 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:18.166 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:18.166 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:18.166 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.166 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.166 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:18.166 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:18.166 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:18.166 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:18.166 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:18.166 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.166 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:18.167 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:18.167 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:18.167 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:18.167 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:18.167 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-465" 2023-10-05T12:49:18.167 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.167 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:18.167 INFO:teuthology.orchestra.run.smithi012.stdout:_____________________ test_bucket_policy_put_obj_kms_noenc _____________________ 2023-10-05T12:49:18.167 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.167 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:18.167 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.167 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:18.168 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:18.168 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.168 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:18.168 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:18.168 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:18.168 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:18.168 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:18.168 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.168 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:18.168 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:18.168 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.168 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.169 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:18.169 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:18.169 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.169 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.169 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:18.169 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.169 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:18.169 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:18.169 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.169 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.169 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:18.169 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:18.170 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.170 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:18.170 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:18.170 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:18.170 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:18.170 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:18.170 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:18.170 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:18.170 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.170 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:18.170 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:18.171 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:18.171 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:18.171 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:18.171 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:18.171 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:18.171 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:18.171 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:18.171 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.171 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:18.171 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:18.171 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:18.171 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:18.172 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.172 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:18.172 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:18.172 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:18.172 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:18.172 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.172 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.172 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:18.172 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:18.172 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:18.172 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:18.172 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.173 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.173 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:18.173 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:18.173 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:18.173 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.173 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:18.173 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.173 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:18.173 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:18.173 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.173 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:18.173 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:18.174 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:18.174 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:18.174 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:18.174 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:18.174 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.174 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:18.174 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.174 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:18.174 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.174 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:18.174 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:18.174 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.175 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:18.175 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.175 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:18.175 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:18.175 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:18.175 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:18.175 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:18.175 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:18.175 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:18.175 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:18.175 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:18.176 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:18.176 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:18.176 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:18.176 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:18.176 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.176 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:18.176 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:18.176 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:18.176 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:18.176 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:18.176 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:18.177 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:18.177 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:18.177 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:18.177 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:18.177 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:18.177 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.177 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.177 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:18.177 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.177 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:18.177 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:18.177 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:18.178 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:18.178 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:18.178 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:18.178 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:18.178 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:18.178 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:18.178 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:18.178 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:18.178 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:18.178 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:18.178 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:18.179 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:18.179 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:18.179 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:18.179 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:18.179 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:18.179 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:18.179 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:18.179 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:18.179 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:18.179 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:18.179 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:18.179 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:18.180 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:18.180 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:18.180 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.180 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.180 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:18.180 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.180 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:18.180 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:18.180 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.180 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:18.180 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:18.180 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:18.181 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:18.181 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:18.181 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.181 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:18.181 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:18.181 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.181 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.181 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:18.181 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:18.181 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.181 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.181 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:18.182 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:18.182 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:18.182 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:18.182 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:18.182 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.182 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.182 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:18.182 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:18.182 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:18.182 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.182 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:18.183 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.183 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:18.183 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.183 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:18.183 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.183 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.encryption 2023-10-05T12:49:18.183 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.fails_on_dbstore 2023-10-05T12:49:18.183 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.bucket_policy 2023-10-05T12:49:18.183 INFO:teuthology.orchestra.run.smithi012.stdout: def test_bucket_policy_put_obj_kms_noenc(): 2023-10-05T12:49:18.183 INFO:teuthology.orchestra.run.smithi012.stdout: kms_keyid = get_main_kms_keyid() 2023-10-05T12:49:18.183 INFO:teuthology.orchestra.run.smithi012.stdout: if kms_keyid is None: 2023-10-05T12:49:18.183 INFO:teuthology.orchestra.run.smithi012.stdout: pytest.skip('[s3 main] section missing kms_keyid') 2023-10-05T12:49:18.184 INFO:teuthology.orchestra.run.smithi012.stdout:> bucket_name = get_new_bucket() 2023-10-05T12:49:18.184 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.184 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:11370: 2023-10-05T12:49:18.184 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.184 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-10-05T12:49:18.184 INFO:teuthology.orchestra.run.smithi012.stdout: client.create_bucket(Bucket=name) 2023-10-05T12:49:18.184 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:18.184 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:18.184 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:18.184 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:18.184 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:18.184 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:18.185 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:18.185 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:18.185 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:18.185 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:18.185 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:18.185 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:18.185 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:18.185 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:18.185 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:18.185 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:18.186 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:18.186 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:18.186 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:18.186 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:18.186 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:18.186 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:18.186 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:18.186 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:18.186 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:18.186 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:18.186 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:18.186 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:18.187 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:18.187 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:18.187 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:18.187 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:18.187 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:18.187 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:18.187 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.187 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.187 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:18.187 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:18.187 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.187 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:18.188 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.188 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:18.188 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:18.188 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:18.188 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:18.188 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:18.188 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:18.188 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:18.188 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:18.188 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:18.188 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:18.189 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:18.189 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:18.189 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:18.189 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.189 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:18.189 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:18.189 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:18.189 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:18.189 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:18.189 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:18.189 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:18.190 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:18.190 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:18.190 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:18.190 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:18.190 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.190 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.190 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:18.190 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:18.190 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:18.190 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:18.190 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:18.191 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.191 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.191 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:18.191 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:18.191 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:18.191 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:18.191 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:18.191 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.191 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:18.191 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:18.191 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:18.191 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:18.192 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:18.192 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-466" 2023-10-05T12:49:18.192 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.192 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:18.192 INFO:teuthology.orchestra.run.smithi012.stdout:______________________ test_bucket_policy_put_obj_kms_s3 _______________________ 2023-10-05T12:49:18.192 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.192 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:18.192 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.192 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:18.192 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:18.192 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.193 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:18.193 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:18.193 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:18.193 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:18.193 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:18.193 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.193 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:18.193 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:18.193 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.193 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.193 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:18.193 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:18.194 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.194 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.194 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:18.194 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.194 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:18.194 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:18.194 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.194 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.194 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:18.194 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:18.194 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.194 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:18.195 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:18.195 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:18.195 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:18.195 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:18.195 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:18.195 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:18.195 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.195 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:18.195 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:18.195 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:18.195 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:18.196 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:18.196 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:18.196 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:18.196 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:18.196 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:18.196 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.196 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:18.196 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:18.196 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:18.196 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:18.196 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.196 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:18.197 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:18.197 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:18.197 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:18.197 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.197 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.197 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:18.197 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:18.197 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:18.197 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:18.197 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.197 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.197 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:18.198 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:18.198 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:18.198 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.198 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:18.198 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.198 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:18.198 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:18.198 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.198 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:18.198 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:18.198 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:18.199 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:18.199 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:18.199 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:18.199 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.199 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:18.199 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.199 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:18.199 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.199 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:18.199 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:18.199 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.200 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:18.200 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.200 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:18.200 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:18.200 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:18.200 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:18.200 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:18.200 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:18.200 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:18.200 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:18.200 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:18.200 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:18.201 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:18.201 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:18.201 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:18.201 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.201 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:18.201 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:18.201 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:18.201 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:18.201 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:18.201 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:18.201 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:18.201 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:18.202 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:18.202 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:18.202 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:18.202 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.202 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.202 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:18.202 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.202 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:18.202 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:18.202 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:18.202 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:18.203 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:18.203 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:18.203 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:18.203 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:18.203 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:18.203 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:18.203 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:18.203 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:18.203 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:18.203 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:18.203 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:18.203 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:18.204 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:18.204 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:18.204 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:18.204 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:18.204 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:18.204 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:18.204 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:18.204 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:18.204 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:18.204 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:18.204 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:18.205 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:18.205 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.205 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.205 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:18.205 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.205 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:18.205 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:18.205 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.205 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:18.205 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:18.205 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:18.205 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:18.206 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:18.206 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.206 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:18.206 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:18.206 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.206 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.206 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:18.206 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:18.206 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.206 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.206 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:18.206 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:18.207 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:18.207 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:18.207 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:18.207 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.207 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.207 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:18.207 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:18.207 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:18.207 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.207 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:18.207 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.208 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:18.208 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.208 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:18.208 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.208 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.encryption 2023-10-05T12:49:18.208 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.bucket_policy 2023-10-05T12:49:18.208 INFO:teuthology.orchestra.run.smithi012.stdout: def test_bucket_policy_put_obj_kms_s3(): 2023-10-05T12:49:18.208 INFO:teuthology.orchestra.run.smithi012.stdout:> bucket_name = get_new_bucket() 2023-10-05T12:49:18.208 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.208 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:11413: 2023-10-05T12:49:18.208 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.208 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-10-05T12:49:18.209 INFO:teuthology.orchestra.run.smithi012.stdout: client.create_bucket(Bucket=name) 2023-10-05T12:49:18.209 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:18.209 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:18.209 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:18.209 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:18.209 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:18.209 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:18.209 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:18.209 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:18.209 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:18.209 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:18.209 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:18.210 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:18.210 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:18.210 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:18.210 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:18.210 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:18.210 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:18.210 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:18.210 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:18.210 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:18.210 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:18.210 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:18.211 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:18.211 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:18.211 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:18.211 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:18.211 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:18.211 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:18.211 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:18.211 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:18.211 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:18.211 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:18.211 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:18.211 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:18.212 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.212 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.212 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:18.212 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:18.212 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.212 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:18.212 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.212 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:18.212 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:18.212 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:18.212 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:18.212 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:18.213 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:18.213 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:18.213 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:18.213 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:18.213 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:18.213 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:18.213 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:18.213 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:18.213 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.213 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:18.213 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:18.213 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:18.214 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:18.214 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:18.214 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:18.214 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:18.214 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:18.214 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:18.214 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:18.214 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:18.214 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.214 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.214 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:18.214 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:18.215 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:18.215 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:18.215 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:18.215 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.215 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.215 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:18.215 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:18.215 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:18.215 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:18.215 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:18.215 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.215 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:18.216 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:18.216 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:18.216 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:18.216 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:18.216 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-467" 2023-10-05T12:49:18.216 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.216 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:18.216 INFO:teuthology.orchestra.run.smithi012.stdout:_________________ test_bucket_policy_get_obj_acl_existing_tag __________________ 2023-10-05T12:49:18.216 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.216 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:18.216 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.216 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:18.217 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:18.217 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.217 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:18.217 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:18.217 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:18.217 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:18.217 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:18.217 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.217 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:18.217 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:18.217 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.217 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.218 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:18.218 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:18.218 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.218 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.218 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:18.218 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.218 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:18.218 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:18.218 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.218 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.218 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:18.219 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:18.219 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.219 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:18.219 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:18.219 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:18.219 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:18.219 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:18.219 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:18.219 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:18.219 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.219 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:18.220 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:18.220 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:18.220 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:18.220 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:18.220 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:18.220 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:18.220 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:18.220 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:18.220 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.220 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:18.220 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:18.220 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:18.221 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:18.221 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.221 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:18.221 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:18.221 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:18.221 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:18.221 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.221 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.221 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:18.221 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:18.221 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:18.221 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:18.222 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.222 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.222 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:18.222 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:18.222 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:18.222 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.222 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:18.222 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.222 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:18.222 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:18.222 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.223 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:18.223 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:18.223 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:18.223 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:18.223 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:18.223 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:18.223 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.223 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:18.223 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.223 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:18.223 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.223 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:18.224 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:18.224 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.224 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:18.224 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.224 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:18.224 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:18.224 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:18.224 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:18.224 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:18.224 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:18.224 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:18.225 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:18.225 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:18.225 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:18.225 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:18.225 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:18.225 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:18.225 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.225 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:18.225 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:18.225 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:18.225 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:18.225 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:18.226 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:18.226 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:18.226 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:18.226 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:18.226 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:18.226 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:18.226 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.226 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.226 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:18.226 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.226 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:18.226 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:18.227 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:18.227 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:18.227 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:18.227 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:18.227 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:18.227 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:18.227 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:18.227 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:18.227 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:18.227 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:18.227 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:18.227 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:18.228 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:18.228 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:18.228 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:18.228 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:18.228 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:18.228 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:18.228 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:18.228 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:18.228 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:18.228 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:18.228 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:18.228 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:18.229 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:18.229 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:18.229 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.229 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.229 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:18.229 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.229 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:18.229 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:18.229 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.229 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:18.229 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:18.229 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:18.230 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:18.230 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:18.230 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.230 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:18.230 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:18.230 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.230 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.230 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:18.230 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:18.230 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.230 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.231 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:18.231 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:18.231 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:18.231 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:18.231 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:18.231 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.231 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.231 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:18.231 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:18.231 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:18.231 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.231 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:18.231 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.232 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:18.232 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.232 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:18.232 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.232 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.tagging 2023-10-05T12:49:18.232 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.bucket_policy 2023-10-05T12:49:18.232 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.fails_on_dbstore 2023-10-05T12:49:18.232 INFO:teuthology.orchestra.run.smithi012.stdout: def test_bucket_policy_get_obj_acl_existing_tag(): 2023-10-05T12:49:18.232 INFO:teuthology.orchestra.run.smithi012.stdout:> bucket_name = _create_objects(keys=['publictag', 'privatetag', 'invalidtag']) 2023-10-05T12:49:18.232 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.232 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:11485: 2023-10-05T12:49:18.232 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.233 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:116: in _create_objects 2023-10-05T12:49:18.233 INFO:teuthology.orchestra.run.smithi012.stdout: bucket = get_new_bucket_resource(name=bucket_name) 2023-10-05T12:49:18.233 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:581: in get_new_bucket_resource 2023-10-05T12:49:18.233 INFO:teuthology.orchestra.run.smithi012.stdout: bucket_location = bucket.create() 2023-10-05T12:49:18.233 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/boto3/resources/factory.py:580: in do_action 2023-10-05T12:49:18.233 INFO:teuthology.orchestra.run.smithi012.stdout: response = action(self, *args, **kwargs) 2023-10-05T12:49:18.233 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/boto3/resources/action.py:88: in __call__ 2023-10-05T12:49:18.233 INFO:teuthology.orchestra.run.smithi012.stdout: response = getattr(parent.meta.client, operation_name)(*args, **params) 2023-10-05T12:49:18.233 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:18.233 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:18.233 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:18.234 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:18.234 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:18.234 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:18.234 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:18.234 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:18.234 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:18.234 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:18.234 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:18.234 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:18.234 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:18.234 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:18.235 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:18.235 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:18.235 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:18.235 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:18.235 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:18.235 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:18.235 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:18.235 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:18.235 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:18.235 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:18.235 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:18.235 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:18.236 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:18.236 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:18.236 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:18.236 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:18.236 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:18.236 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:18.236 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:18.236 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:18.236 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.236 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.236 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:18.237 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:18.237 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.237 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:18.237 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.237 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:18.237 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:18.237 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:18.237 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:18.237 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:18.237 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:18.237 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:18.237 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:18.238 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:18.238 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:18.238 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:18.238 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:18.238 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:18.238 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.238 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:18.238 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:18.238 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:18.238 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:18.238 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:18.239 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:18.239 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:18.239 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:18.239 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:18.239 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:18.239 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:18.239 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.239 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.239 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:18.239 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:18.239 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:18.239 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:18.240 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:18.240 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.240 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.240 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:18.240 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:18.240 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:18.240 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:18.240 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:18.240 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.240 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:18.240 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:18.240 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:18.240 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:18.241 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:18.241 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-468" 2023-10-05T12:49:18.241 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.241 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:18.241 INFO:teuthology.orchestra.run.smithi012.stdout:________________________ test_object_lock_put_obj_lock _________________________ 2023-10-05T12:49:18.241 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.241 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:18.241 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.241 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:18.241 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:18.241 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.241 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:18.242 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:18.242 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:18.242 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:18.242 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:18.242 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.242 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:18.242 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:18.242 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.242 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.242 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:18.242 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:18.242 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.243 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.243 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:18.243 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.243 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:18.243 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:18.243 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.243 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.243 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:18.243 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:18.243 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.243 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:18.243 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:18.243 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:18.244 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:18.244 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:18.244 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:18.244 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:18.244 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.244 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:18.244 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:18.244 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:18.244 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:18.244 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:18.244 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:18.244 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:18.245 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:18.245 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:18.245 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.245 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:18.245 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:18.245 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:18.245 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:18.245 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.245 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:18.245 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:18.245 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:18.245 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:18.245 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.246 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.246 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:18.246 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:18.246 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:18.246 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:18.246 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.246 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.246 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:18.246 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:18.246 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:18.246 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.247 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:18.247 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.247 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:18.247 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:18.247 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.247 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:18.247 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:18.247 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:18.247 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:18.247 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:18.247 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:18.247 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.247 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:18.248 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.248 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:18.248 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.248 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:18.248 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:18.248 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.248 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:18.248 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.248 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:18.248 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:18.249 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:18.249 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:18.249 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:18.249 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:18.249 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:18.249 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:18.249 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:18.249 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:18.249 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:18.249 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:18.249 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:18.249 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.250 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:18.250 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:18.250 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:18.250 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:18.250 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:18.250 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:18.250 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:18.250 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:18.250 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:18.250 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:18.250 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:18.251 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.251 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.251 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:18.251 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.251 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:18.251 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:18.251 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:18.251 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:18.251 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:18.251 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:18.251 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:18.251 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:18.251 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:18.252 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:18.252 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:18.252 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:18.252 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:18.252 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:18.252 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:18.252 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:18.252 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:18.252 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:18.252 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:18.252 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:18.252 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:18.253 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:18.253 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:18.253 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:18.253 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:18.253 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:18.253 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:18.253 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:18.253 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.253 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.253 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:18.253 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.253 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:18.254 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:18.254 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.254 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:18.254 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:18.254 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:18.254 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:18.254 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:18.254 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.254 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:18.254 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:18.254 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.255 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.255 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:18.255 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:18.255 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.255 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.255 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:18.255 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:18.255 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:18.255 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:18.255 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:18.255 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.256 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.256 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:18.256 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:18.256 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:18.256 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.256 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:18.256 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.256 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:18.256 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.256 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:18.256 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.256 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.fails_on_dbstore 2023-10-05T12:49:18.257 INFO:teuthology.orchestra.run.smithi012.stdout: def test_object_lock_put_obj_lock(): 2023-10-05T12:49:18.257 INFO:teuthology.orchestra.run.smithi012.stdout: bucket_name = get_new_bucket_name() 2023-10-05T12:49:18.257 INFO:teuthology.orchestra.run.smithi012.stdout: client = get_client() 2023-10-05T12:49:18.257 INFO:teuthology.orchestra.run.smithi012.stdout:> client.create_bucket(Bucket=bucket_name, ObjectLockEnabledForBucket=True) 2023-10-05T12:49:18.257 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.257 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:11546: 2023-10-05T12:49:18.257 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.257 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:18.257 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:18.257 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:18.257 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:18.258 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:18.258 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:18.258 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:18.258 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:18.258 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:18.258 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:18.258 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:18.258 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:18.258 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:18.258 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:18.258 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:18.258 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:18.259 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:18.259 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:18.259 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:18.259 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:18.259 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:18.259 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:18.259 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:18.259 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:18.259 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:18.259 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:18.260 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:18.260 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:18.260 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:18.260 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:18.260 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:18.260 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:18.260 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:18.260 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:18.260 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.260 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.260 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:18.260 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:18.261 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.261 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:18.261 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.261 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:18.261 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:18.261 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:18.261 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:18.261 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:18.261 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:18.261 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:18.261 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:18.261 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:18.262 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:18.262 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:18.262 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:18.262 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:18.262 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.262 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:18.262 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:18.262 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:18.262 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:18.262 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:18.263 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:18.263 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:18.263 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:18.263 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:18.263 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:18.263 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:18.263 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.263 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.263 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:18.263 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:18.263 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:18.263 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:18.264 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:18.264 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.264 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.264 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:18.264 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:18.264 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:18.264 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:18.264 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:18.264 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.264 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:18.264 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:18.265 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:18.265 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:18.265 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:18.265 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-469" 2023-10-05T12:49:18.265 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.265 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:18.265 INFO:teuthology.orchestra.run.smithi012.stdout:_________________ test_object_lock_put_obj_lock_invalid_bucket _________________ 2023-10-05T12:49:18.265 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.265 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:18.265 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.265 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:18.266 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:18.266 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.266 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:18.266 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:18.266 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:18.266 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:18.266 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:18.266 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.266 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:18.266 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:18.266 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.266 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.267 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:18.267 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:18.267 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.267 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.267 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:18.267 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.267 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:18.267 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:18.267 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.267 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.267 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:18.268 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:18.268 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.268 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:18.268 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:18.268 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:18.268 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:18.268 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:18.268 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:18.268 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:18.268 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.268 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:18.268 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:18.269 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:18.269 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:18.269 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:18.269 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:18.269 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:18.269 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:18.269 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:18.269 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.269 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:18.269 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:18.269 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:18.270 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:18.270 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.270 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:18.270 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:18.270 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:18.270 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:18.270 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.270 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.270 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:18.270 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:18.270 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:18.270 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:18.271 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.271 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.271 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:18.271 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:18.271 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:18.271 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.271 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:18.271 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.271 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:18.271 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:18.271 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.271 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:18.272 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:18.272 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:18.272 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:18.272 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:18.272 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:18.272 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.272 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:18.272 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.272 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:18.272 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.272 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:18.272 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:18.273 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.273 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:18.273 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.273 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:18.273 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:18.273 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:18.273 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:18.273 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:18.273 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:18.273 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:18.273 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:18.273 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:18.274 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:18.274 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:18.274 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:18.274 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:18.274 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.274 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:18.274 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:18.274 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:18.274 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:18.274 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:18.274 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:18.275 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:18.275 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:18.275 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:18.275 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:18.275 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:18.275 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.275 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.275 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:18.275 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.275 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:18.275 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:18.275 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:18.275 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:18.276 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:18.276 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:18.276 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:18.276 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:18.276 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:18.276 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:18.276 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:18.276 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:18.276 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:18.276 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:18.276 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:18.276 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:18.277 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:18.277 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:18.277 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:18.277 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:18.277 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:18.277 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:18.277 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:18.277 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:18.277 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:18.277 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:18.277 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:18.277 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:18.278 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.278 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.278 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:18.278 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.278 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:18.278 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:18.278 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.278 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:18.278 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:18.278 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:18.278 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:18.279 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:18.279 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.279 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:18.279 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:18.279 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.279 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.279 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:18.279 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:18.279 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.279 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.279 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:18.279 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:18.280 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:18.280 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:18.280 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:18.280 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.280 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.280 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:18.280 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:18.280 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:18.280 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.280 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:18.280 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.280 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:18.281 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.281 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:18.281 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.281 INFO:teuthology.orchestra.run.smithi012.stdout: def test_object_lock_put_obj_lock_invalid_bucket(): 2023-10-05T12:49:18.281 INFO:teuthology.orchestra.run.smithi012.stdout: bucket_name = get_new_bucket_name() 2023-10-05T12:49:18.281 INFO:teuthology.orchestra.run.smithi012.stdout: client = get_client() 2023-10-05T12:49:18.281 INFO:teuthology.orchestra.run.smithi012.stdout:> client.create_bucket(Bucket=bucket_name) 2023-10-05T12:49:18.281 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.281 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:11578: 2023-10-05T12:49:18.281 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.281 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:18.281 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:18.282 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:18.282 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:18.282 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:18.282 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:18.282 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:18.282 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:18.282 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:18.282 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:18.282 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:18.282 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:18.282 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:18.282 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:18.283 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:18.283 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:18.283 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:18.283 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:18.283 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:18.283 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:18.283 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:18.283 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:18.283 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:18.283 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:18.283 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:18.283 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:18.284 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:18.284 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:18.284 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:18.284 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:18.284 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:18.284 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:18.284 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:18.284 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:18.284 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.284 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.284 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:18.284 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:18.284 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.285 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:18.285 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.285 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:18.285 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:18.285 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:18.285 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:18.285 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:18.285 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:18.285 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:18.285 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:18.285 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:18.285 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:18.286 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:18.286 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:18.286 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:18.286 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.286 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:18.286 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:18.286 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:18.286 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:18.286 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:18.286 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:18.286 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:18.286 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:18.287 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:18.287 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:18.287 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:18.287 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.287 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.287 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:18.287 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:18.287 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:18.287 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:18.287 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:18.287 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.287 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.288 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:18.288 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:18.288 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:18.288 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:18.288 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:18.288 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.288 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:18.288 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:18.288 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:18.288 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:18.288 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:18.288 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-470" 2023-10-05T12:49:18.289 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.289 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:18.289 INFO:teuthology.orchestra.run.smithi012.stdout:______________ test_object_lock_put_obj_lock_with_days_and_years _______________ 2023-10-05T12:49:18.289 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.289 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:18.289 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.289 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:18.289 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:18.289 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.289 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:18.289 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:18.289 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:18.290 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:18.290 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:18.290 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.290 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:18.290 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:18.290 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.290 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.290 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:18.290 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:18.290 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.290 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.291 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:18.291 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.291 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:18.291 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:18.291 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.291 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.291 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:18.291 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:18.291 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.291 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:18.291 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:18.291 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:18.292 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:18.292 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:18.292 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:18.292 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:18.292 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.292 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:18.292 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:18.292 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:18.292 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:18.292 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:18.292 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:18.293 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:18.293 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:18.293 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:18.293 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.293 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:18.293 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:18.293 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:18.293 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:18.293 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.293 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:18.293 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:18.293 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:18.294 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:18.294 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.294 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.294 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:18.294 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:18.294 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:18.294 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:18.294 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.294 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.294 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:18.294 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:18.295 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:18.295 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.295 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:18.295 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.295 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:18.295 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:18.295 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.295 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:18.295 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:18.295 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:18.295 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:18.295 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:18.296 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:18.296 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.296 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:18.296 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.296 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:18.296 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.296 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:18.296 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:18.296 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.296 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:18.296 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.296 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:18.297 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:18.297 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:18.297 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:18.297 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:18.297 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:18.297 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:18.297 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:18.297 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:18.297 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:18.297 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:18.297 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:18.298 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:18.298 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.298 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:18.298 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:18.298 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:18.298 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:18.298 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:18.298 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:18.298 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:18.298 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:18.298 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:18.299 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:18.299 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:18.299 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.299 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.299 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:18.299 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.299 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:18.299 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:18.299 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:18.299 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:18.299 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:18.299 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:18.299 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:18.300 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:18.300 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:18.300 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:18.300 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:18.300 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:18.300 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:18.300 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:18.300 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:18.300 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:18.300 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:18.300 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:18.300 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:18.301 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:18.301 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:18.301 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:18.301 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:18.301 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:18.301 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:18.301 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:18.301 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:18.301 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:18.301 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.301 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.301 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:18.302 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.302 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:18.302 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:18.302 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.302 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:18.302 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:18.302 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:18.302 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:18.302 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:18.302 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.302 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:18.302 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:18.303 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.303 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.303 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:18.303 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:18.303 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.303 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.303 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:18.303 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:18.303 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:18.303 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:18.303 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:18.303 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.303 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.304 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:18.304 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:18.304 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:18.304 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.304 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:18.304 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.304 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:18.304 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.304 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:18.304 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.304 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.fails_on_dbstore 2023-10-05T12:49:18.304 INFO:teuthology.orchestra.run.smithi012.stdout: def test_object_lock_put_obj_lock_with_days_and_years(): 2023-10-05T12:49:18.305 INFO:teuthology.orchestra.run.smithi012.stdout: bucket_name = get_new_bucket_name() 2023-10-05T12:49:18.305 INFO:teuthology.orchestra.run.smithi012.stdout: client = get_client() 2023-10-05T12:49:18.305 INFO:teuthology.orchestra.run.smithi012.stdout:> client.create_bucket(Bucket=bucket_name, ObjectLockEnabledForBucket=True) 2023-10-05T12:49:18.305 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.305 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:11596: 2023-10-05T12:49:18.305 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.305 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:18.305 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:18.305 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:18.305 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:18.305 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:18.305 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:18.305 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:18.306 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:18.306 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:18.306 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:18.306 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:18.306 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:18.306 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:18.306 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:18.306 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:18.306 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:18.306 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:18.306 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:18.307 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:18.307 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:18.307 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:18.307 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:18.307 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:18.307 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:18.307 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:18.307 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:18.307 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:18.307 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:18.307 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:18.307 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:18.308 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:18.308 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:18.308 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:18.308 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:18.308 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.308 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.308 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:18.308 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:18.308 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.308 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:18.308 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.309 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:18.309 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:18.309 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:18.309 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:18.309 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:18.309 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:18.309 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:18.309 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:18.309 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:18.309 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:18.309 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:18.309 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:18.310 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:18.310 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.310 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:18.310 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:18.310 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:18.310 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:18.310 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:18.310 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:18.310 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:18.310 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:18.310 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:18.311 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:18.311 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:18.311 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.311 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.311 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:18.311 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:18.311 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:18.311 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:18.311 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:18.311 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.311 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.311 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:18.311 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:18.312 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:18.312 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:18.312 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:18.312 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.312 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:18.312 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:18.312 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:18.312 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:18.312 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:18.312 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-471" 2023-10-05T12:49:18.312 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.312 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:18.313 INFO:teuthology.orchestra.run.smithi012.stdout:__________________ test_object_lock_put_obj_lock_invalid_days __________________ 2023-10-05T12:49:18.313 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.313 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:18.313 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.313 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:18.313 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:18.313 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.313 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:18.313 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:18.313 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:18.313 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:18.313 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:18.313 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.314 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:18.314 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:18.314 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.314 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.314 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:18.314 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:18.314 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.314 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.314 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:18.314 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.314 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:18.315 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:18.315 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.315 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.315 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:18.315 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:18.315 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.315 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:18.315 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:18.315 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:18.315 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:18.315 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:18.315 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:18.315 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:18.316 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.316 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:18.316 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:18.316 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:18.316 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:18.316 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:18.316 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:18.316 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:18.316 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:18.316 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:18.316 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.316 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:18.316 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:18.317 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:18.317 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:18.317 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.317 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:18.317 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:18.317 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:18.317 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:18.317 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.317 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.317 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:18.317 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:18.318 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:18.318 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:18.318 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.318 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.318 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:18.318 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:18.318 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:18.318 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.318 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:18.318 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.318 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:18.319 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:18.319 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.319 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:18.319 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:18.319 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:18.319 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:18.319 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:18.319 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:18.319 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.319 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:18.319 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.319 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:18.320 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.320 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:18.320 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:18.320 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.320 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:18.320 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.320 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:18.320 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:18.320 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:18.320 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:18.320 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:18.320 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:18.321 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:18.321 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:18.321 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:18.321 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:18.321 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:18.321 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:18.321 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:18.321 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.321 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:18.321 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:18.321 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:18.322 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:18.322 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:18.322 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:18.322 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:18.322 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:18.322 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:18.322 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:18.322 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:18.322 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.322 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.322 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:18.322 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.323 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:18.323 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:18.323 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:18.323 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:18.323 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:18.323 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:18.323 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:18.323 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:18.323 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:18.323 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:18.323 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:18.323 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:18.324 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:18.324 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:18.324 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:18.324 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:18.324 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:18.324 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:18.324 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:18.324 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:18.324 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:18.324 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:18.324 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:18.325 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:18.325 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:18.325 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:18.325 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:18.325 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:18.325 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.325 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.325 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:18.325 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.325 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:18.325 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:18.325 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.326 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:18.326 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:18.326 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:18.326 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:18.326 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:18.326 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.326 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:18.326 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:18.326 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.326 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.326 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:18.326 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:18.327 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.327 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.327 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:18.327 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:18.327 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:18.327 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:18.327 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:18.327 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.327 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.327 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:18.327 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:18.327 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:18.327 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.328 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:18.328 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.328 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:18.328 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.328 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:18.328 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.328 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.fails_on_dbstore 2023-10-05T12:49:18.328 INFO:teuthology.orchestra.run.smithi012.stdout: def test_object_lock_put_obj_lock_invalid_days(): 2023-10-05T12:49:18.328 INFO:teuthology.orchestra.run.smithi012.stdout: bucket_name = get_new_bucket_name() 2023-10-05T12:49:18.328 INFO:teuthology.orchestra.run.smithi012.stdout: client = get_client() 2023-10-05T12:49:18.328 INFO:teuthology.orchestra.run.smithi012.stdout:> client.create_bucket(Bucket=bucket_name, ObjectLockEnabledForBucket=True) 2023-10-05T12:49:18.329 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.329 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:11615: 2023-10-05T12:49:18.329 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.329 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:18.329 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:18.329 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:18.329 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:18.329 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:18.329 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:18.329 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:18.329 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:18.329 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:18.330 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:18.330 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:18.330 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:18.330 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:18.330 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:18.330 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:18.330 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:18.330 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:18.330 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:18.330 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:18.330 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:18.330 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:18.331 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:18.331 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:18.331 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:18.331 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:18.331 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:18.331 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:18.331 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:18.331 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:18.331 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:18.331 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:18.331 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:18.331 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:18.331 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:18.332 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.332 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.332 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:18.332 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:18.332 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.332 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:18.332 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.332 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:18.332 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:18.332 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:18.332 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:18.332 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:18.333 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:18.333 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:18.333 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:18.333 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:18.333 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:18.333 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:18.333 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:18.333 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:18.333 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.333 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:18.333 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:18.333 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:18.333 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:18.334 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:18.334 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:18.334 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:18.334 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:18.334 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:18.334 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:18.334 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:18.334 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.334 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.334 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:18.334 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:18.334 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:18.335 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:18.335 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:18.335 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.335 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.335 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:18.335 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:18.335 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:18.335 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:18.335 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:18.335 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.335 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:18.335 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:18.336 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:18.336 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:18.336 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:18.336 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-472" 2023-10-05T12:49:18.336 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.336 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:18.336 INFO:teuthology.orchestra.run.smithi012.stdout:_________________ test_object_lock_put_obj_lock_invalid_years __________________ 2023-10-05T12:49:18.336 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.336 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:18.336 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.336 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:18.336 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:18.337 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.337 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:18.337 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:18.337 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:18.337 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:18.337 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:18.337 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.337 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:18.337 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:18.337 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.337 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.338 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:18.338 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:18.338 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.338 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.338 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:18.338 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.338 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:18.338 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:18.338 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.338 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.338 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:18.338 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:18.339 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.339 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:18.339 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:18.339 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:18.339 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:18.339 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:18.339 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:18.339 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:18.339 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.339 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:18.339 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:18.339 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:18.340 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:18.340 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:18.340 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:18.340 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:18.340 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:18.340 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:18.340 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.340 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:18.340 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:18.340 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:18.340 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:18.341 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.341 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:18.341 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:18.341 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:18.341 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:18.341 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.341 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.341 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:18.341 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:18.341 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:18.341 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:18.341 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.342 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.342 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:18.342 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:18.342 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:18.342 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.342 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:18.342 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.342 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:18.342 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:18.342 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.342 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:18.342 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:18.343 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:18.343 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:18.343 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:18.343 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:18.343 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.343 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:18.343 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.343 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:18.343 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.343 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:18.343 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:18.343 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.344 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:18.344 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.344 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:18.344 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:18.344 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:18.344 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:18.344 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:18.344 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:18.344 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:18.344 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:18.344 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:18.345 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:18.345 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:18.345 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:18.345 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:18.345 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.345 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:18.345 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:18.345 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:18.345 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:18.345 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:18.345 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:18.345 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:18.345 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:18.346 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:18.346 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:18.346 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:18.346 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.346 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.346 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:18.346 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.346 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:18.346 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:18.346 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:18.346 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:18.347 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:18.347 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:18.347 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:18.347 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:18.347 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:18.347 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:18.347 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:18.347 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:18.347 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:18.347 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:18.347 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:18.348 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:18.348 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:18.348 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:18.348 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:18.348 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:18.348 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:18.348 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:18.348 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:18.348 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:18.348 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:18.348 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:18.348 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:18.349 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:18.349 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.349 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.349 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:18.349 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.349 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:18.349 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:18.349 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.349 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:18.349 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:18.349 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:18.349 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:18.350 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:18.350 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.350 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:18.350 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:18.350 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.350 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.350 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:18.350 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:18.350 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.350 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.351 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:18.351 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:18.351 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:18.351 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:18.351 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:18.351 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.351 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.351 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:18.351 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:18.351 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:18.351 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.351 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:18.352 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.352 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:18.352 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.352 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:18.352 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.352 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.fails_on_dbstore 2023-10-05T12:49:18.352 INFO:teuthology.orchestra.run.smithi012.stdout: def test_object_lock_put_obj_lock_invalid_years(): 2023-10-05T12:49:18.352 INFO:teuthology.orchestra.run.smithi012.stdout: bucket_name = get_new_bucket_name() 2023-10-05T12:49:18.352 INFO:teuthology.orchestra.run.smithi012.stdout: client = get_client() 2023-10-05T12:49:18.352 INFO:teuthology.orchestra.run.smithi012.stdout:> client.create_bucket(Bucket=bucket_name, ObjectLockEnabledForBucket=True) 2023-10-05T12:49:18.352 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.352 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:11633: 2023-10-05T12:49:18.353 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.353 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:18.353 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:18.353 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:18.353 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:18.353 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:18.353 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:18.353 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:18.353 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:18.353 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:18.353 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:18.353 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:18.354 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:18.354 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:18.354 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:18.354 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:18.354 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:18.354 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:18.354 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:18.354 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:18.354 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:18.354 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:18.354 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:18.355 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:18.355 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:18.355 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:18.355 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:18.355 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:18.355 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:18.355 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:18.355 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:18.355 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:18.355 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:18.355 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:18.355 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:18.355 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.356 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.356 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:18.356 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:18.356 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.356 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:18.356 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.356 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:18.356 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:18.356 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:18.356 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:18.356 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:18.356 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:18.357 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:18.357 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:18.357 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:18.357 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:18.357 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:18.357 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:18.357 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:18.357 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.357 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:18.357 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:18.357 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:18.357 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:18.358 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:18.358 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:18.358 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:18.358 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:18.358 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:18.358 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:18.358 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:18.358 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.358 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.358 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:18.358 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:18.359 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:18.359 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:18.359 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:18.359 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.359 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.359 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:18.359 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:18.359 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:18.359 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:18.359 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:18.359 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.360 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:18.360 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:18.360 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:18.360 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:18.360 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:18.360 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-473" 2023-10-05T12:49:18.360 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.360 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:18.360 INFO:teuthology.orchestra.run.smithi012.stdout:__________________ test_object_lock_put_obj_lock_invalid_mode __________________ 2023-10-05T12:49:18.360 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.360 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:18.360 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.361 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:18.361 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:18.361 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.361 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:18.361 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:18.361 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:18.361 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:18.361 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:18.361 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.361 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:18.361 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:18.361 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.362 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.362 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:18.362 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:18.362 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.362 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.362 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:18.362 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.362 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:18.362 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:18.362 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.362 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.363 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:18.363 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:18.363 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.363 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:18.363 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:18.363 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:18.363 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:18.363 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:18.363 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:18.363 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:18.363 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.363 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:18.364 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:18.364 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:18.364 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:18.364 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:18.364 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:18.364 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:18.364 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:18.364 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:18.364 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.364 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:18.364 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:18.364 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:18.365 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:18.365 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.365 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:18.365 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:18.365 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:18.365 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:18.365 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.365 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.365 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:18.365 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:18.365 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:18.365 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:18.366 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.366 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.366 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:18.366 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:18.366 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:18.366 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.366 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:18.366 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.366 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:18.366 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:18.366 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.367 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:18.367 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:18.367 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:18.367 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:18.367 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:18.367 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:18.367 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.367 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:18.367 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.367 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:18.367 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.367 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:18.368 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:18.368 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.368 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:18.368 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.368 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:18.368 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:18.368 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:18.368 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:18.368 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:18.368 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:18.368 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:18.368 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:18.369 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:18.369 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:18.369 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:18.369 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:18.369 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:18.369 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.369 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:18.369 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:18.369 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:18.369 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:18.369 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:18.369 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:18.370 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:18.370 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:18.370 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:18.370 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:18.370 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:18.370 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.370 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.370 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:18.370 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.370 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:18.370 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:18.371 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:18.371 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:18.371 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:18.371 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:18.371 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:18.371 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:18.371 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:18.371 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:18.371 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:18.371 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:18.371 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:18.371 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:18.372 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:18.372 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:18.372 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:18.372 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:18.372 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:18.372 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:18.372 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:18.372 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:18.372 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:18.372 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:18.372 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:18.372 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:18.373 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:18.373 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:18.373 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.373 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.373 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:18.373 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.373 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:18.373 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:18.373 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.373 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:18.373 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:18.374 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:18.374 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:18.374 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:18.374 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.374 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:18.374 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:18.374 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.374 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.374 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:18.374 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:18.374 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.374 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.375 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:18.375 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:18.375 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:18.375 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:18.375 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:18.375 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.375 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.375 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:18.375 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:18.375 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:18.375 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.375 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:18.376 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.376 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:18.376 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.376 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:18.376 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.376 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.fails_on_dbstore 2023-10-05T12:49:18.376 INFO:teuthology.orchestra.run.smithi012.stdout: def test_object_lock_put_obj_lock_invalid_mode(): 2023-10-05T12:49:18.376 INFO:teuthology.orchestra.run.smithi012.stdout: bucket_name = get_new_bucket_name() 2023-10-05T12:49:18.376 INFO:teuthology.orchestra.run.smithi012.stdout: client = get_client() 2023-10-05T12:49:18.376 INFO:teuthology.orchestra.run.smithi012.stdout:> client.create_bucket(Bucket=bucket_name, ObjectLockEnabledForBucket=True) 2023-10-05T12:49:18.376 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.376 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:11651: 2023-10-05T12:49:18.377 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.377 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:18.377 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:18.377 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:18.377 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:18.377 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:18.377 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:18.377 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:18.377 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:18.377 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:18.377 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:18.378 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:18.378 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:18.378 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:18.378 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:18.378 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:18.378 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:18.378 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:18.378 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:18.378 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:18.378 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:18.378 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:18.378 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:18.379 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:18.379 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:18.379 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:18.379 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:18.379 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:18.379 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:18.379 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:18.379 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:18.379 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:18.379 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:18.379 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:18.380 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:18.380 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.380 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.380 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:18.380 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:18.380 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.380 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:18.380 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.380 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:18.380 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:18.380 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:18.380 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:18.381 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:18.381 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:18.381 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:18.381 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:18.381 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:18.381 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:18.381 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:18.381 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:18.381 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:18.381 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.381 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:18.381 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:18.382 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:18.382 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:18.382 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:18.382 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:18.382 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:18.382 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:18.382 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:18.382 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:18.382 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:18.382 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.382 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.382 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:18.383 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:18.383 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:18.383 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:18.383 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:18.383 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.383 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.383 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:18.383 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:18.383 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:18.383 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:18.383 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:18.383 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.384 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:18.384 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:18.384 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:18.384 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:18.384 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:18.384 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-474" 2023-10-05T12:49:18.384 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.384 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:18.384 INFO:teuthology.orchestra.run.smithi012.stdout:_________________ test_object_lock_put_obj_lock_invalid_status _________________ 2023-10-05T12:49:18.384 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.384 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:18.384 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.385 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:18.385 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:18.385 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.385 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:18.385 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:18.385 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:18.385 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:18.385 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:18.385 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.385 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:18.385 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:18.385 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.386 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.386 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:18.386 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:18.386 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.386 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.386 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:18.386 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.386 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:18.386 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:18.386 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.386 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.387 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:18.387 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:18.387 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.387 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:18.387 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:18.387 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:18.387 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:18.387 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:18.387 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:18.387 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:18.387 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.387 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:18.389 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:18.389 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:18.389 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:18.389 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:18.389 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:18.389 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:18.389 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:18.389 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:18.390 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.390 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:18.390 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:18.390 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:18.390 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:18.390 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.390 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:18.390 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:18.390 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:18.390 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:18.390 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.390 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.391 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:18.391 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:18.391 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:18.391 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:18.391 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.391 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.391 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:18.391 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:18.391 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:18.391 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.391 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:18.392 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.392 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:18.392 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:18.392 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.392 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:18.392 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:18.392 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:18.392 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:18.392 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:18.392 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:18.392 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.392 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:18.393 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.393 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:18.393 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.393 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:18.393 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:18.393 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.393 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:18.393 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.393 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:18.393 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:18.393 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:18.393 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:18.394 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:18.394 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:18.394 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:18.394 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:18.394 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:18.394 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:18.394 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:18.394 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:18.394 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:18.394 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.394 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:18.394 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:18.395 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:18.395 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:18.395 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:18.395 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:18.395 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:18.395 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:18.395 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:18.395 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:18.395 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:18.395 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.396 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.396 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:18.396 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.396 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:18.396 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:18.396 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:18.396 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:18.396 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:18.396 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:18.396 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:18.396 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:18.396 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:18.397 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:18.397 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:18.397 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:18.397 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:18.397 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:18.397 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:18.397 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:18.397 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:18.397 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:18.397 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:18.397 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:18.398 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:18.398 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:18.398 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:18.398 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:18.398 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:18.398 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:18.398 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:18.398 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:18.398 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.398 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.398 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:18.398 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.399 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:18.399 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:18.399 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.399 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:18.399 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:18.399 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:18.399 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:18.399 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:18.399 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.399 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:18.399 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:18.400 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.400 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.400 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:18.400 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:18.400 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.400 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.400 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:18.400 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:18.400 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:18.400 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:18.400 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:18.400 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.400 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.401 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:18.401 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:18.401 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:18.401 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.401 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:18.401 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.401 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:18.401 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.401 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:18.401 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.401 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.fails_on_dbstore 2023-10-05T12:49:18.401 INFO:teuthology.orchestra.run.smithi012.stdout: def test_object_lock_put_obj_lock_invalid_status(): 2023-10-05T12:49:18.402 INFO:teuthology.orchestra.run.smithi012.stdout: bucket_name = get_new_bucket_name() 2023-10-05T12:49:18.402 INFO:teuthology.orchestra.run.smithi012.stdout: client = get_client() 2023-10-05T12:49:18.402 INFO:teuthology.orchestra.run.smithi012.stdout:> client.create_bucket(Bucket=bucket_name, ObjectLockEnabledForBucket=True) 2023-10-05T12:49:18.402 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.402 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:11681: 2023-10-05T12:49:18.402 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.402 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:18.402 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:18.402 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:18.402 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:18.402 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:18.403 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:18.403 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:18.403 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:18.403 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:18.403 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:18.403 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:18.403 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:18.403 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:18.403 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:18.403 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:18.403 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:18.403 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:18.404 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:18.404 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:18.404 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:18.404 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:18.404 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:18.404 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:18.404 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:18.404 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:18.404 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:18.404 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:18.404 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:18.404 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:18.404 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:18.405 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:18.405 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:18.405 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:18.405 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:18.405 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.405 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.405 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:18.405 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:18.405 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.405 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:18.405 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.405 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:18.406 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:18.406 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:18.406 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:18.406 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:18.406 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:18.406 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:18.406 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:18.406 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:18.406 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:18.406 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:18.406 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:18.406 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:18.407 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.407 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:18.407 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:18.407 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:18.407 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:18.407 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:18.407 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:18.407 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:18.407 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:18.407 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:18.407 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:18.407 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:18.408 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.408 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.408 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:18.408 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:18.408 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:18.408 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:18.408 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:18.408 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.408 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.408 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:18.408 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:18.409 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:18.409 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:18.409 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:18.409 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.409 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:18.409 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:18.409 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:18.409 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:18.409 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:18.409 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-475" 2023-10-05T12:49:18.409 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.410 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:18.410 INFO:teuthology.orchestra.run.smithi012.stdout:_____________________ test_object_lock_suspend_versioning ______________________ 2023-10-05T12:49:18.410 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.410 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:18.410 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.410 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:18.410 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:18.410 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.410 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:18.410 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:18.410 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:18.410 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:18.411 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:18.411 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.411 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:18.411 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:18.411 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.411 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.411 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:18.411 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:18.411 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.411 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.411 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:18.412 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.412 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:18.412 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:18.412 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.412 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.412 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:18.412 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:18.412 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.412 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:18.412 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:18.412 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:18.412 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:18.413 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:18.413 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:18.413 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:18.413 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.413 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:18.413 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:18.413 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:18.413 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:18.413 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:18.413 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:18.413 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:18.413 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:18.414 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:18.414 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.414 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:18.414 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:18.414 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:18.414 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:18.414 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.414 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:18.414 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:18.414 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:18.414 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:18.415 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.415 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.415 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:18.415 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:18.415 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:18.415 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:18.415 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.415 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.415 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:18.415 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:18.415 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:18.415 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.416 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:18.416 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.416 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:18.416 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:18.416 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.416 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:18.416 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:18.416 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:18.416 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:18.416 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:18.416 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:18.416 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.417 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:18.417 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.417 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:18.417 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.417 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:18.417 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:18.417 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.417 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:18.417 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.417 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:18.417 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:18.417 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:18.418 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:18.418 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:18.418 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:18.418 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:18.418 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:18.418 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:18.418 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:18.418 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:18.418 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:18.418 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:18.418 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.419 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:18.419 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:18.419 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:18.419 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:18.419 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:18.419 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:18.419 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:18.419 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:18.419 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:18.419 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:18.419 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:18.419 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.420 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.420 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:18.420 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.420 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:18.420 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:18.420 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:18.420 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:18.420 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:18.420 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:18.420 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:18.420 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:18.420 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:18.421 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:18.421 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:18.421 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:18.421 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:18.421 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:18.421 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:18.421 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:18.421 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:18.421 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:18.421 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:18.421 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:18.422 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:18.422 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:18.422 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:18.422 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:18.422 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:18.422 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:18.422 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:18.422 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:18.422 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.422 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.422 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:18.422 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.423 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:18.423 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:18.423 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.423 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:18.423 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:18.423 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:18.423 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:18.423 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:18.423 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.423 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:18.423 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:18.423 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.424 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.424 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:18.424 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:18.424 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.424 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.424 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:18.424 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:18.424 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:18.424 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:18.424 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:18.424 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.425 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.425 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:18.425 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:18.425 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:18.425 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.425 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:18.425 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.425 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:18.425 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.425 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:18.425 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.426 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.fails_on_dbstore 2023-10-05T12:49:18.426 INFO:teuthology.orchestra.run.smithi012.stdout: def test_object_lock_suspend_versioning(): 2023-10-05T12:49:18.426 INFO:teuthology.orchestra.run.smithi012.stdout: bucket_name = get_new_bucket_name() 2023-10-05T12:49:18.426 INFO:teuthology.orchestra.run.smithi012.stdout: client = get_client() 2023-10-05T12:49:18.426 INFO:teuthology.orchestra.run.smithi012.stdout:> client.create_bucket(Bucket=bucket_name, ObjectLockEnabledForBucket=True) 2023-10-05T12:49:18.426 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.426 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:11699: 2023-10-05T12:49:18.426 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.426 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:18.426 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:18.426 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:18.426 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:18.427 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:18.427 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:18.427 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:18.427 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:18.427 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:18.427 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:18.427 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:18.427 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:18.427 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:18.427 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:18.427 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:18.427 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:18.428 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:18.428 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:18.428 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:18.428 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:18.428 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:18.428 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:18.428 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:18.428 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:18.428 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:18.428 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:18.428 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:18.429 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:18.429 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:18.429 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:18.429 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:18.429 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:18.429 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:18.429 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:18.429 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.429 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.429 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:18.429 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:18.429 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.430 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:18.430 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.430 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:18.430 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:18.430 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:18.430 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:18.430 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:18.430 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:18.430 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:18.430 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:18.430 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:18.430 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:18.431 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:18.431 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:18.431 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:18.431 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.431 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:18.431 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:18.431 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:18.431 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:18.431 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:18.431 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:18.431 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:18.431 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:18.432 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:18.432 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:18.432 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:18.432 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.432 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.432 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:18.432 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:18.432 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:18.432 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:18.432 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:18.432 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.432 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.433 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:18.433 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:18.433 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:18.433 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:18.433 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:18.433 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.433 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:18.433 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:18.433 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:18.433 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:18.433 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:18.433 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-476" 2023-10-05T12:49:18.434 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.434 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:18.434 INFO:teuthology.orchestra.run.smithi012.stdout:________________________ test_object_lock_get_obj_lock _________________________ 2023-10-05T12:49:18.434 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.434 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:18.434 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.434 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:18.434 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:18.434 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.434 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:18.434 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:18.434 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:18.435 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:18.435 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:18.435 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.435 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:18.435 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:18.435 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.435 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.435 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:18.435 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:18.435 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.435 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.435 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:18.436 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.436 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:18.436 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:18.436 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.436 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.436 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:18.436 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:18.436 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.436 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:18.436 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:18.436 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:18.436 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:18.437 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:18.437 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:18.437 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:18.437 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.437 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:18.437 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:18.437 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:18.437 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:18.437 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:18.437 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:18.437 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:18.438 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:18.438 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:18.438 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.438 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:18.438 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:18.438 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:18.438 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:18.438 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.438 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:18.438 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:18.438 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:18.439 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:18.439 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.439 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.439 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:18.439 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:18.439 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:18.439 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:18.439 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.439 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.439 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:18.439 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:18.440 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:18.440 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.440 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:18.440 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.440 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:18.440 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:18.440 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.440 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:18.440 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:18.440 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:18.440 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:18.440 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:18.441 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:18.441 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.441 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:18.441 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.441 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:18.441 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.441 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:18.441 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:18.441 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.441 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:18.441 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.441 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:18.442 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:18.442 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:18.442 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:18.442 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:18.442 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:18.442 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:18.442 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:18.442 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:18.442 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:18.442 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:18.442 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:18.443 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:18.443 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.443 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:18.443 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:18.443 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:18.443 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:18.443 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:18.443 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:18.443 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:18.443 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:18.443 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:18.443 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:18.444 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:18.444 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.444 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.444 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:18.444 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.444 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:18.444 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:18.444 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:18.444 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:18.444 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:18.444 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:18.444 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:18.445 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:18.445 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:18.445 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:18.445 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:18.445 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:18.445 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:18.445 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:18.445 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:18.445 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:18.445 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:18.445 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:18.445 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:18.446 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:18.446 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:18.446 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:18.446 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:18.446 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:18.446 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:18.446 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:18.446 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:18.446 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:18.446 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.446 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.447 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:18.447 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.447 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:18.447 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:18.447 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.447 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:18.447 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:18.447 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:18.447 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:18.447 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:18.447 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.447 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:18.448 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:18.448 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.448 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.448 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:18.448 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:18.448 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.448 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.448 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:18.448 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:18.448 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:18.448 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:18.448 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:18.449 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.449 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.449 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:18.449 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:18.449 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:18.449 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.449 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:18.449 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.449 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:18.449 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.449 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:18.449 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.450 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.fails_on_dbstore 2023-10-05T12:49:18.450 INFO:teuthology.orchestra.run.smithi012.stdout: def test_object_lock_get_obj_lock(): 2023-10-05T12:49:18.450 INFO:teuthology.orchestra.run.smithi012.stdout: bucket_name = get_new_bucket_name() 2023-10-05T12:49:18.450 INFO:teuthology.orchestra.run.smithi012.stdout: client = get_client() 2023-10-05T12:49:18.450 INFO:teuthology.orchestra.run.smithi012.stdout:> client.create_bucket(Bucket=bucket_name, ObjectLockEnabledForBucket=True) 2023-10-05T12:49:18.450 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.450 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:11710: 2023-10-05T12:49:18.450 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.450 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:18.450 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:18.450 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:18.450 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:18.451 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:18.451 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:18.451 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:18.451 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:18.451 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:18.451 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:18.451 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:18.451 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:18.451 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:18.451 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:18.451 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:18.451 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:18.452 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:18.452 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:18.452 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:18.452 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:18.452 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:18.452 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:18.452 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:18.452 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:18.452 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:18.452 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:18.452 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:18.452 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:18.453 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:18.453 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:18.453 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:18.453 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:18.453 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:18.453 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:18.453 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.453 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.453 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:18.453 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:18.453 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.454 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:18.454 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.454 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:18.454 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:18.454 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:18.454 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:18.454 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:18.454 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:18.454 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:18.454 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:18.454 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:18.455 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:18.455 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:18.455 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:18.455 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:18.455 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.455 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:18.455 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:18.455 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:18.455 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:18.455 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:18.455 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:18.455 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:18.456 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:18.456 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:18.456 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:18.456 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:18.456 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.456 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.456 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:18.456 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:18.456 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:18.456 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:18.456 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:18.456 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.457 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.457 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:18.457 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:18.457 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:18.457 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:18.457 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:18.457 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.457 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:18.457 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:18.457 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:18.457 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:18.457 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:18.458 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-477" 2023-10-05T12:49:18.458 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.458 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:18.458 INFO:teuthology.orchestra.run.smithi012.stdout:_________________ test_object_lock_get_obj_lock_invalid_bucket _________________ 2023-10-05T12:49:18.458 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.458 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:18.458 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.458 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:18.458 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:18.458 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.458 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:18.458 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:18.459 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:18.459 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:18.459 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:18.459 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.459 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:18.459 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:18.459 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.459 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.459 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:18.459 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:18.459 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.460 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.460 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:18.460 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.460 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:18.460 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:18.460 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.460 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.460 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:18.460 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:18.460 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.460 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:18.460 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:18.461 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:18.461 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:18.461 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:18.461 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:18.461 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:18.461 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.461 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:18.461 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:18.461 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:18.461 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:18.461 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:18.461 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:18.462 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:18.462 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:18.462 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:18.462 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.462 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:18.462 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:18.462 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:18.462 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:18.462 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.462 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:18.462 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:18.462 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:18.463 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:18.463 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.463 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.463 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:18.463 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:18.463 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:18.463 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:18.463 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.463 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.463 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:18.463 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:18.463 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:18.464 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.464 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:18.464 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.464 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:18.464 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:18.464 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.464 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:18.464 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:18.464 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:18.464 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:18.464 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:18.464 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:18.465 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.465 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:18.465 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.465 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:18.465 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.465 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:18.465 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:18.465 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.465 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:18.465 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.465 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:18.465 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:18.466 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:18.466 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:18.466 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:18.466 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:18.466 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:18.466 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:18.466 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:18.466 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:18.466 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:18.466 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:18.466 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:18.466 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.467 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:18.467 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:18.467 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:18.467 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:18.467 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:18.467 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:18.467 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:18.467 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:18.467 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:18.467 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:18.467 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:18.467 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.468 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.468 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:18.468 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.468 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:18.468 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:18.468 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:18.468 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:18.468 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:18.468 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:18.468 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:18.469 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:18.469 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:18.469 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:18.469 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:18.469 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:18.469 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:18.469 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:18.469 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:18.469 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:18.469 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:18.469 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:18.469 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:18.470 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:18.470 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:18.470 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:18.470 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:18.470 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:18.470 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:18.470 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:18.470 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:18.470 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:18.470 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.470 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.470 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:18.471 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.471 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:18.471 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:18.471 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.471 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:18.471 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:18.471 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:18.471 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:18.471 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:18.471 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.471 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:18.472 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:18.472 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.472 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.472 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:18.472 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:18.472 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.472 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.472 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:18.472 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:18.472 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:18.472 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:18.472 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:18.473 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.473 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.473 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:18.473 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:18.473 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:18.473 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.473 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:18.473 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.473 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:18.473 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.473 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:18.473 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.474 INFO:teuthology.orchestra.run.smithi012.stdout: def test_object_lock_get_obj_lock_invalid_bucket(): 2023-10-05T12:49:18.474 INFO:teuthology.orchestra.run.smithi012.stdout: bucket_name = get_new_bucket_name() 2023-10-05T12:49:18.474 INFO:teuthology.orchestra.run.smithi012.stdout: client = get_client() 2023-10-05T12:49:18.474 INFO:teuthology.orchestra.run.smithi012.stdout:> client.create_bucket(Bucket=bucket_name) 2023-10-05T12:49:18.474 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.474 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:11728: 2023-10-05T12:49:18.474 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.474 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:18.474 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:18.474 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:18.474 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:18.475 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:18.475 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:18.475 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:18.475 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:18.475 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:18.475 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:18.475 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:18.475 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:18.475 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:18.475 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:18.475 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:18.475 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:18.476 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:18.476 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:18.476 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:18.476 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:18.476 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:18.476 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:18.476 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:18.476 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:18.476 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:18.476 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:18.476 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:18.476 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:18.477 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:18.477 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:18.477 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:18.477 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:18.477 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:18.477 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:18.477 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.477 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.477 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:18.477 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:18.477 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.477 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:18.478 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.478 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:18.478 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:18.478 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:18.478 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:18.478 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:18.478 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:18.478 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:18.478 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:18.478 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:18.478 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:18.478 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:18.479 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:18.479 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:18.479 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.479 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:18.479 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:18.479 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:18.479 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:18.479 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:18.479 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:18.479 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:18.479 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:18.479 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:18.480 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:18.480 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:18.480 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.480 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.480 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:18.480 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:18.480 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:18.480 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:18.480 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:18.480 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.480 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.480 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:18.481 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:18.481 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:18.481 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:18.481 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:18.481 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.481 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:18.481 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:18.481 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:18.481 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:18.481 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:18.481 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-478" 2023-10-05T12:49:18.481 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.481 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:18.482 INFO:teuthology.orchestra.run.smithi012.stdout:______________________ test_object_lock_put_obj_retention ______________________ 2023-10-05T12:49:18.482 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.482 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:18.482 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.482 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:18.482 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:18.482 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.482 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:18.482 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:18.482 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:18.482 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:18.483 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:18.483 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.483 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:18.483 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:18.483 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.483 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.483 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:18.483 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:18.483 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.483 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.483 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:18.484 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.484 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:18.484 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:18.484 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.484 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.484 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:18.484 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:18.484 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.484 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:18.484 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:18.484 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:18.484 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:18.485 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:18.485 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:18.485 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:18.485 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.485 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:18.485 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:18.485 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:18.485 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:18.485 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:18.485 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:18.485 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:18.485 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:18.486 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:18.486 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.486 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:18.486 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:18.486 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:18.486 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:18.486 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.486 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:18.486 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:18.486 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:18.486 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:18.487 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.487 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.487 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:18.487 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:18.487 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:18.487 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:18.487 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.487 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.487 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:18.487 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:18.487 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:18.487 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.488 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:18.488 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.488 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:18.488 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:18.488 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.488 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:18.488 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:18.488 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:18.488 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:18.488 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:18.488 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:18.488 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.489 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:18.489 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.489 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:18.489 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.489 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:18.489 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:18.489 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.489 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:18.489 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.489 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:18.489 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:18.489 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:18.490 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:18.490 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:18.490 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:18.490 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:18.490 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:18.490 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:18.491 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:18.491 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:18.491 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:18.491 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:18.491 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.491 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:18.491 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:18.491 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:18.491 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:18.491 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:18.492 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:18.492 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:18.492 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:18.492 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:18.492 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:18.492 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:18.492 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.492 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.492 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:18.492 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.493 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:18.493 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:18.493 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:18.493 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:18.493 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:18.493 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:18.493 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:18.493 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:18.493 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:18.494 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:18.494 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:18.494 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:18.494 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:18.494 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:18.494 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:18.494 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:18.494 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:18.494 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:18.494 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:18.495 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:18.495 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:18.495 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:18.495 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:18.495 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:18.495 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:18.495 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:18.495 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:18.495 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:18.495 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.495 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.496 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:18.496 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.496 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:18.496 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:18.496 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.496 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:18.496 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:18.496 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:18.496 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:18.496 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:18.497 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.497 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:18.497 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:18.497 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.497 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.497 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:18.497 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:18.497 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.497 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.497 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:18.498 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:18.498 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:18.498 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:18.498 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:18.498 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.498 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.498 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:18.498 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:18.498 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:18.498 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.499 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:18.499 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.499 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:18.499 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.499 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:18.499 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.499 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.fails_on_dbstore 2023-10-05T12:49:18.499 INFO:teuthology.orchestra.run.smithi012.stdout: def test_object_lock_put_obj_retention(): 2023-10-05T12:49:18.499 INFO:teuthology.orchestra.run.smithi012.stdout: bucket_name = get_new_bucket_name() 2023-10-05T12:49:18.499 INFO:teuthology.orchestra.run.smithi012.stdout: client = get_client() 2023-10-05T12:49:18.500 INFO:teuthology.orchestra.run.smithi012.stdout:> client.create_bucket(Bucket=bucket_name, ObjectLockEnabledForBucket=True) 2023-10-05T12:49:18.500 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.500 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:11739: 2023-10-05T12:49:18.500 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.500 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:18.500 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:18.500 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:18.500 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:18.501 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:18.501 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:18.501 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:18.501 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:18.501 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:18.501 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:18.501 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:18.501 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:18.501 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:18.501 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:18.502 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:18.502 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:18.502 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:18.502 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:18.502 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:18.502 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:18.502 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:18.502 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:18.502 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:18.502 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:18.503 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:18.503 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:18.503 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:18.503 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:18.503 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:18.503 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:18.503 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:18.503 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:18.503 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:18.503 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:18.504 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.504 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.504 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:18.504 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:18.504 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.504 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:18.504 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.504 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:18.504 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:18.504 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:18.505 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:18.505 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:18.505 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:18.505 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:18.505 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:18.505 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:18.505 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:18.505 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:18.505 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:18.505 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:18.505 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.506 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:18.506 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:18.506 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:18.506 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:18.506 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:18.506 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:18.506 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:18.506 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:18.506 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:18.506 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:18.507 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:18.507 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.507 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.507 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:18.507 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:18.507 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:18.507 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:18.507 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:18.507 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.507 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.508 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:18.508 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:18.508 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:18.508 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:18.508 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:18.508 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.508 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:18.508 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:18.508 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:18.508 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:18.509 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:18.509 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-479" 2023-10-05T12:49:18.509 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.509 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:18.509 INFO:teuthology.orchestra.run.smithi012.stdout:______________ test_object_lock_put_obj_retention_invalid_bucket _______________ 2023-10-05T12:49:18.509 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.509 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:18.509 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.509 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:18.509 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:18.509 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.510 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:18.510 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:18.510 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:18.510 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:18.510 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:18.510 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.510 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:18.510 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:18.510 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.511 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.511 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:18.511 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:18.511 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.511 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.511 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:18.511 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.511 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:18.511 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:18.511 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.512 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.512 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:18.512 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:18.512 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.512 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:18.512 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:18.512 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:18.512 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:18.512 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:18.512 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:18.512 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:18.512 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.513 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:18.513 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:18.513 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:18.513 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:18.513 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:18.513 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:18.513 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:18.513 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:18.513 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:18.513 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.514 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:18.514 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:18.514 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:18.514 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:18.514 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.514 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:18.514 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:18.514 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:18.514 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:18.514 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.515 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.515 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:18.515 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:18.515 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:18.515 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:18.515 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.515 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.515 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:18.515 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:18.515 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:18.516 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.516 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:18.516 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.516 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:18.516 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:18.516 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.516 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:18.516 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:18.516 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:18.516 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:18.516 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:18.517 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:18.517 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.517 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:18.517 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.517 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:18.517 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.517 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:18.517 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:18.517 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.518 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:18.518 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.518 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:18.518 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:18.518 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:18.518 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:18.518 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:18.518 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:18.518 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:18.519 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:18.519 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:18.519 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:18.519 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:18.519 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:18.519 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:18.519 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.519 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:18.519 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:18.519 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:18.520 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:18.520 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:18.520 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:18.520 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:18.520 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:18.520 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:18.520 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:18.520 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:18.520 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.520 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.521 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:18.521 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.521 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:18.521 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:18.521 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:18.521 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:18.521 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:18.521 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:18.521 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:18.522 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:18.522 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:18.522 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:18.522 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:18.522 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:18.522 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:18.522 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:18.522 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:18.522 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:18.523 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:18.523 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:18.523 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:18.523 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:18.523 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:18.523 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:18.523 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:18.523 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:18.523 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:18.523 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:18.524 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:18.524 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:18.524 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.524 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.524 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:18.524 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.524 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:18.524 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:18.524 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.524 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:18.524 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:18.525 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:18.525 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:18.525 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:18.525 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.525 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:18.525 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:18.525 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.525 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.525 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:18.525 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:18.526 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.526 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.526 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:18.526 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:18.526 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:18.526 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:18.526 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:18.526 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.526 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.526 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:18.527 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:18.527 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:18.527 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.527 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:18.527 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.527 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:18.527 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.527 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:18.527 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.527 INFO:teuthology.orchestra.run.smithi012.stdout: def test_object_lock_put_obj_retention_invalid_bucket(): 2023-10-05T12:49:18.527 INFO:teuthology.orchestra.run.smithi012.stdout: bucket_name = get_new_bucket_name() 2023-10-05T12:49:18.528 INFO:teuthology.orchestra.run.smithi012.stdout: client = get_client() 2023-10-05T12:49:18.528 INFO:teuthology.orchestra.run.smithi012.stdout:> client.create_bucket(Bucket=bucket_name) 2023-10-05T12:49:18.528 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.528 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:11753: 2023-10-05T12:49:18.528 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.528 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:18.528 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:18.528 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:18.528 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:18.528 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:18.529 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:18.529 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:18.529 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:18.529 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:18.529 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:18.529 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:18.529 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:18.529 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:18.529 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:18.529 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:18.530 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:18.530 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:18.530 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:18.530 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:18.530 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:18.530 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:18.530 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:18.530 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:18.530 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:18.530 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:18.531 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:18.531 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:18.531 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:18.531 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:18.531 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:18.531 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:18.531 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:18.531 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:18.531 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:18.531 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.532 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.532 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:18.532 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:18.532 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.532 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:18.532 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.532 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:18.532 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:18.532 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:18.532 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:18.533 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:18.533 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:18.533 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:18.533 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:18.533 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:18.533 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:18.533 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:18.533 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:18.533 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:18.533 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.534 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:18.534 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:18.534 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:18.534 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:18.534 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:18.534 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:18.534 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:18.534 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:18.534 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:18.534 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:18.535 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:18.535 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.535 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.535 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:18.535 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:18.535 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:18.535 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:18.535 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:18.535 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.535 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.536 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:18.536 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:18.536 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:18.536 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:18.536 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:18.536 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.536 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:18.536 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:18.536 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:18.536 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:18.536 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:18.537 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-480" 2023-10-05T12:49:18.537 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.537 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:18.537 INFO:teuthology.orchestra.run.smithi012.stdout:_______________ test_object_lock_put_obj_retention_invalid_mode ________________ 2023-10-05T12:49:18.537 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.537 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:18.537 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.537 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:18.537 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:18.537 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.538 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:18.538 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:18.538 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:18.538 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:18.538 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:18.538 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.538 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:18.538 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:18.538 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.538 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.539 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:18.539 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:18.539 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.539 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.539 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:18.539 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.539 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:18.539 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:18.539 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.539 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.540 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:18.540 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:18.540 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.540 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:18.540 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:18.540 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:18.540 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:18.540 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:18.540 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:18.540 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:18.540 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.541 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:18.541 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:18.541 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:18.541 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:18.541 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:18.541 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:18.541 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:18.541 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:18.541 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:18.541 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.542 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:18.542 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:18.542 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:18.542 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:18.542 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.542 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:18.542 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:18.542 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:18.542 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:18.542 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.542 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.543 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:18.543 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:18.543 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:18.543 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:18.543 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.543 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.543 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:18.543 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:18.543 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:18.543 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.544 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:18.544 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.544 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:18.544 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:18.544 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.544 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:18.544 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:18.544 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:18.544 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:18.544 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:18.545 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:18.545 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.545 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:18.545 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.545 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:18.545 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.545 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:18.545 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:18.545 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.545 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:18.546 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.546 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:18.546 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:18.546 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:18.546 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:18.546 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:18.546 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:18.546 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:18.546 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:18.546 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:18.547 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:18.547 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:18.547 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:18.547 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:18.547 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.547 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:18.547 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:18.547 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:18.547 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:18.547 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:18.547 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:18.548 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:18.548 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:18.548 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:18.548 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:18.548 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:18.548 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.548 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.548 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:18.548 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.548 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:18.549 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:18.549 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:18.549 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:18.549 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:18.549 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:18.549 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:18.549 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:18.549 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:18.549 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:18.550 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:18.550 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:18.550 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:18.550 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:18.550 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:18.550 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:18.550 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:18.550 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:18.550 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:18.551 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:18.551 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:18.551 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:18.551 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:18.551 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:18.551 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:18.551 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:18.551 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:18.551 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:18.551 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.552 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.552 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:18.552 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.552 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:18.552 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:18.552 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.552 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:18.552 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:18.552 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:18.552 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:18.553 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:18.553 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.553 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:18.553 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:18.553 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.553 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.553 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:18.553 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:18.553 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.553 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.553 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:18.554 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:18.554 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:18.554 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:18.554 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:18.554 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.554 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.554 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:18.554 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:18.554 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:18.554 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.555 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:18.555 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.555 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:18.555 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.555 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:18.555 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.555 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.fails_on_dbstore 2023-10-05T12:49:18.555 INFO:teuthology.orchestra.run.smithi012.stdout: def test_object_lock_put_obj_retention_invalid_mode(): 2023-10-05T12:49:18.555 INFO:teuthology.orchestra.run.smithi012.stdout: bucket_name = get_new_bucket_name() 2023-10-05T12:49:18.555 INFO:teuthology.orchestra.run.smithi012.stdout: client = get_client() 2023-10-05T12:49:18.556 INFO:teuthology.orchestra.run.smithi012.stdout:> client.create_bucket(Bucket=bucket_name, ObjectLockEnabledForBucket=True) 2023-10-05T12:49:18.556 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.556 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:11767: 2023-10-05T12:49:18.556 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.556 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:18.556 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:18.556 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:18.556 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:18.556 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:18.556 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:18.556 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:18.557 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:18.557 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:18.557 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:18.557 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:18.557 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:18.557 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:18.557 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:18.557 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:18.557 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:18.557 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:18.557 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:18.558 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:18.558 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:18.558 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:18.558 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:18.558 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:18.558 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:18.558 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:18.558 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:18.558 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:18.559 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:18.559 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:18.559 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:18.559 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:18.559 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:18.559 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:18.559 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:18.559 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.559 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.559 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:18.560 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:18.560 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.560 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:18.560 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.560 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:18.560 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:18.560 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:18.560 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:18.560 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:18.560 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:18.560 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:18.560 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:18.561 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:18.561 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:18.561 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:18.561 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:18.561 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:18.561 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.561 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:18.561 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:18.561 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:18.561 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:18.561 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:18.562 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:18.562 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:18.562 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:18.562 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:18.562 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:18.562 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:18.562 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.562 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.562 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:18.562 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:18.562 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:18.563 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:18.563 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:18.563 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.563 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.563 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:18.563 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:18.563 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:18.563 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:18.563 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:18.563 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.564 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:18.564 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:18.564 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:18.564 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:18.564 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:18.564 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-481" 2023-10-05T12:49:18.564 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.564 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:18.564 INFO:teuthology.orchestra.run.smithi012.stdout:______________________ test_object_lock_get_obj_retention ______________________ 2023-10-05T12:49:18.564 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.564 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:18.564 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.565 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:18.565 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:18.565 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.565 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:18.565 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:18.565 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:18.565 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:18.565 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:18.565 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.565 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:18.565 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:18.566 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.566 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.566 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:18.566 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:18.566 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.566 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.566 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:18.566 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.566 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:18.566 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:18.566 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.567 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.567 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:18.567 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:18.567 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.567 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:18.567 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:18.567 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:18.567 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:18.567 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:18.567 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:18.568 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:18.568 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.568 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:18.568 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:18.568 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:18.568 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:18.568 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:18.568 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:18.568 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:18.569 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:18.569 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:18.569 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.569 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:18.569 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:18.569 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:18.569 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:18.569 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.569 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:18.569 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:18.570 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:18.570 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:18.570 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.570 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.570 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:18.570 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:18.570 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:18.570 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:18.570 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.570 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.571 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:18.571 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:18.571 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:18.571 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.571 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:18.571 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.571 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:18.571 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:18.571 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.571 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:18.571 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:18.572 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:18.572 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:18.572 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:18.572 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:18.572 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.572 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:18.572 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.572 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:18.572 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.572 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:18.573 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:18.573 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.573 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:18.573 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.573 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:18.573 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:18.573 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:18.573 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:18.573 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:18.573 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:18.574 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:18.574 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:18.574 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:18.574 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:18.574 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:18.574 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:18.574 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:18.574 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.574 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:18.574 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:18.575 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:18.575 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:18.575 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:18.575 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:18.575 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:18.575 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:18.575 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:18.575 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:18.575 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:18.575 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.576 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.576 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:18.576 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.576 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:18.576 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:18.576 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:18.576 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:18.576 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:18.576 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:18.576 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:18.576 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:18.577 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:18.577 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:18.577 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:18.577 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:18.577 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:18.577 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:18.577 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:18.577 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:18.577 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:18.577 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:18.578 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:18.578 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:18.578 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:18.578 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:18.578 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:18.578 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:18.578 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:18.578 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:18.578 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:18.579 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:18.579 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.579 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.579 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:18.579 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.579 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:18.579 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:18.579 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.579 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:18.579 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:18.580 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:18.580 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:18.580 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:18.580 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.580 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:18.580 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:18.580 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.580 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.580 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:18.580 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:18.581 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.581 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.581 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:18.581 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:18.581 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:18.581 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:18.581 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:18.581 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.581 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.581 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:18.581 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:18.582 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:18.582 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.582 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:18.582 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.582 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:18.582 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.582 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:18.582 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.582 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.fails_on_dbstore 2023-10-05T12:49:18.582 INFO:teuthology.orchestra.run.smithi012.stdout: def test_object_lock_get_obj_retention(): 2023-10-05T12:49:18.583 INFO:teuthology.orchestra.run.smithi012.stdout: bucket_name = get_new_bucket_name() 2023-10-05T12:49:18.583 INFO:teuthology.orchestra.run.smithi012.stdout: client = get_client() 2023-10-05T12:49:18.583 INFO:teuthology.orchestra.run.smithi012.stdout:> client.create_bucket(Bucket=bucket_name, ObjectLockEnabledForBucket=True) 2023-10-05T12:49:18.583 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.583 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:11787: 2023-10-05T12:49:18.583 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.583 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:18.583 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:18.583 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:18.583 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:18.584 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:18.584 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:18.584 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:18.584 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:18.584 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:18.584 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:18.584 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:18.584 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:18.584 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:18.584 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:18.585 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:18.585 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:18.585 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:18.585 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:18.585 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:18.585 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:18.585 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:18.585 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:18.585 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:18.585 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:18.586 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:18.586 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:18.586 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:18.586 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:18.586 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:18.586 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:18.586 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:18.586 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:18.586 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:18.586 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:18.587 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.587 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.587 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:18.587 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:18.587 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.587 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:18.587 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.587 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:18.587 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:18.588 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:18.588 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:18.588 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:18.588 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:18.588 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:18.588 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:18.588 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:18.588 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:18.588 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:18.588 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:18.589 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:18.589 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.589 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:18.589 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:18.589 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:18.589 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:18.589 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:18.589 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:18.589 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:18.589 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:18.590 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:18.590 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:18.590 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:18.590 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.590 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.590 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:18.590 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:18.590 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:18.590 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:18.590 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:18.591 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.591 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.591 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:18.591 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:18.591 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:18.591 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:18.591 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:18.591 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.591 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:18.591 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:18.592 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:18.592 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:18.592 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:18.592 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-482" 2023-10-05T12:49:18.592 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.592 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:18.592 INFO:teuthology.orchestra.run.smithi012.stdout:__________________ test_object_lock_get_obj_retention_iso8601 __________________ 2023-10-05T12:49:18.592 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.592 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:18.592 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.593 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:18.593 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:18.593 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.593 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:18.593 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:18.593 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:18.593 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:18.593 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:18.593 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.593 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:18.594 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:18.594 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.594 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.594 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:18.594 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:18.594 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.594 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.594 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:18.594 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.595 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:18.595 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:18.595 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.595 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.595 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:18.595 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:18.595 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.595 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:18.595 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:18.595 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:18.595 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:18.596 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:18.596 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:18.596 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:18.596 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.596 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:18.596 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:18.596 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:18.596 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:18.596 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:18.597 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:18.597 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:18.597 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:18.597 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:18.597 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.597 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:18.597 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:18.597 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:18.597 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:18.597 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.597 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:18.598 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:18.598 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:18.598 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:18.598 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.598 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.598 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:18.598 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:18.598 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:18.598 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:18.599 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.599 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.599 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:18.599 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:18.599 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:18.599 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.599 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:18.599 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.599 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:18.599 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:18.599 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.600 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:18.600 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:18.600 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:18.600 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:18.600 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:18.600 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:18.600 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.600 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:18.600 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.600 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:18.601 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.601 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:18.601 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:18.601 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.601 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:18.601 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.601 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:18.601 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:18.601 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:18.601 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:18.602 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:18.602 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:18.602 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:18.602 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:18.602 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:18.602 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:18.602 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:18.602 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:18.602 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:18.602 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.603 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:18.603 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:18.603 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:18.603 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:18.603 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:18.603 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:18.603 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:18.603 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:18.603 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:18.603 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:18.604 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:18.604 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.604 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.604 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:18.604 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.604 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:18.604 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:18.604 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:18.604 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:18.604 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:18.605 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:18.605 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:18.605 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:18.605 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:18.605 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:18.605 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:18.605 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:18.605 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:18.605 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:18.605 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:18.606 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:18.606 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:18.606 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:18.606 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:18.606 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:18.606 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:18.606 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:18.606 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:18.606 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:18.606 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:18.607 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:18.607 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:18.607 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:18.607 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.607 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.607 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:18.607 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.607 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:18.607 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:18.607 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.608 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:18.608 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:18.608 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:18.608 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:18.608 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:18.608 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.608 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:18.608 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:18.608 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.608 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.609 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:18.609 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:18.609 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.609 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.609 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:18.609 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:18.609 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:18.609 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:18.609 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:18.609 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.610 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.610 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:18.610 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:18.610 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:18.610 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.610 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:18.610 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.610 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:18.610 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.610 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:18.611 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.611 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.fails_on_dbstore 2023-10-05T12:49:18.611 INFO:teuthology.orchestra.run.smithi012.stdout: def test_object_lock_get_obj_retention_iso8601(): 2023-10-05T12:49:18.611 INFO:teuthology.orchestra.run.smithi012.stdout: bucket_name = get_new_bucket_name() 2023-10-05T12:49:18.611 INFO:teuthology.orchestra.run.smithi012.stdout: client = get_client() 2023-10-05T12:49:18.611 INFO:teuthology.orchestra.run.smithi012.stdout:> client.create_bucket(Bucket=bucket_name, ObjectLockEnabledForBucket=True) 2023-10-05T12:49:18.611 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.611 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:11802: 2023-10-05T12:49:18.611 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.612 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:18.612 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:18.612 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:18.612 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:18.612 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:18.612 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:18.612 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:18.612 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:18.612 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:18.612 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:18.613 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:18.613 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:18.613 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:18.613 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:18.613 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:18.613 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:18.613 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:18.613 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:18.613 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:18.613 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:18.614 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:18.614 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:18.614 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:18.614 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:18.614 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:18.614 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:18.614 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:18.614 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:18.614 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:18.614 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:18.615 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:18.615 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:18.615 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:18.615 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:18.615 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.615 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.615 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:18.615 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:18.615 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.615 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:18.616 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.616 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:18.616 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:18.616 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:18.616 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:18.616 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:18.616 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:18.616 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:18.616 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:18.616 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:18.617 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:18.617 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:18.617 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:18.617 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:18.617 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.617 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:18.617 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:18.617 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:18.617 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:18.617 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:18.618 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:18.618 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:18.618 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:18.618 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:18.618 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:18.618 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:18.618 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.618 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.618 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:18.618 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:18.619 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:18.619 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:18.619 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:18.619 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.619 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.619 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:18.619 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:18.619 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:18.619 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:18.620 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:18.620 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.620 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:18.620 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:18.620 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:18.620 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:18.620 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:18.620 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-483" 2023-10-05T12:49:18.620 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.620 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:18.621 INFO:teuthology.orchestra.run.smithi012.stdout:______________ test_object_lock_get_obj_retention_invalid_bucket _______________ 2023-10-05T12:49:18.621 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.621 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:18.621 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.621 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:18.621 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:18.621 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.621 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:18.621 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:18.621 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:18.622 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:18.622 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:18.622 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.622 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:18.622 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:18.622 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.622 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.622 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:18.622 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:18.622 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.623 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.623 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:18.623 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.623 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:18.623 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:18.623 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.623 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.623 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:18.623 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:18.623 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.624 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:18.624 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:18.624 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:18.624 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:18.624 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:18.624 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:18.624 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:18.624 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.624 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:18.624 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:18.624 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:18.625 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:18.625 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:18.625 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:18.625 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:18.625 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:18.625 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:18.625 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.625 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:18.625 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:18.626 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:18.626 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:18.626 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.626 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:18.626 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:18.626 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:18.626 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:18.626 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.626 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.627 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:18.627 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:18.627 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:18.627 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:18.627 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.627 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.627 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:18.627 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:18.627 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:18.627 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.628 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:18.628 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.628 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:18.628 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:18.628 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.628 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:18.628 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:18.628 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:18.628 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:18.628 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:18.629 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:18.629 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.629 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:18.629 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.629 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:18.629 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.629 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:18.629 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:18.629 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.629 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:18.630 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.630 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:18.630 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:18.630 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:18.630 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:18.630 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:18.630 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:18.630 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:18.630 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:18.631 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:18.631 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:18.631 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:18.631 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:18.631 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:18.631 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.631 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:18.631 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:18.631 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:18.632 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:18.632 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:18.632 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:18.632 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:18.632 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:18.632 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:18.632 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:18.632 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:18.632 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.632 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.633 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:18.633 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.633 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:18.633 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:18.633 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:18.633 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:18.633 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:18.633 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:18.633 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:18.633 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:18.634 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:18.634 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:18.634 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:18.634 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:18.634 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:18.634 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:18.634 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:18.634 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:18.634 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:18.634 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:18.635 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:18.635 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:18.635 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:18.635 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:18.635 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:18.635 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:18.635 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:18.635 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:18.635 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:18.635 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:18.636 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.636 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.636 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:18.636 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.636 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:18.636 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:18.636 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.636 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:18.636 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:18.636 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:18.637 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:18.637 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:18.637 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.637 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:18.637 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:18.637 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.637 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.637 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:18.637 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:18.637 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.638 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.638 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:18.638 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:18.638 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:18.638 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:18.638 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:18.638 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.638 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.638 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:18.639 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:18.639 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:18.639 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.639 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:18.639 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.639 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:18.639 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.639 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:18.639 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.639 INFO:teuthology.orchestra.run.smithi012.stdout: def test_object_lock_get_obj_retention_invalid_bucket(): 2023-10-05T12:49:18.640 INFO:teuthology.orchestra.run.smithi012.stdout: bucket_name = get_new_bucket_name() 2023-10-05T12:49:18.640 INFO:teuthology.orchestra.run.smithi012.stdout: client = get_client() 2023-10-05T12:49:18.640 INFO:teuthology.orchestra.run.smithi012.stdout:> client.create_bucket(Bucket=bucket_name) 2023-10-05T12:49:18.640 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.640 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:11819: 2023-10-05T12:49:18.640 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.640 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:18.640 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:18.640 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:18.640 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:18.640 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:18.641 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:18.641 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:18.641 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:18.641 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:18.641 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:18.641 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:18.641 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:18.641 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:18.641 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:18.641 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:18.641 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:18.642 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:18.642 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:18.642 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:18.642 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:18.642 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:18.642 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:18.642 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:18.642 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:18.642 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:18.642 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:18.643 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:18.643 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:18.643 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:18.643 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:18.643 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:18.643 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:18.643 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:18.643 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:18.643 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.643 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.644 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:18.644 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:18.644 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.644 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:18.644 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.644 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:18.644 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:18.644 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:18.644 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:18.644 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:18.644 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:18.645 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:18.645 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:18.645 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:18.645 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:18.645 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:18.645 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:18.645 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:18.645 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.645 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:18.645 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:18.645 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:18.646 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:18.646 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:18.646 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:18.646 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:18.646 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:18.646 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:18.646 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:18.646 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:18.646 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.647 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.647 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:18.647 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:18.647 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:18.647 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:18.647 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:18.647 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.647 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.647 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:18.648 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:18.648 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:18.648 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:18.648 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:18.648 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.648 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:18.648 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:18.648 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:18.648 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:18.648 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:18.649 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-484" 2023-10-05T12:49:18.649 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.649 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:18.649 INFO:teuthology.orchestra.run.smithi012.stdout:_________________ test_object_lock_put_obj_retention_versionid _________________ 2023-10-05T12:49:18.649 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.649 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:18.649 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.649 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:18.649 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:18.650 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.650 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:18.650 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:18.650 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:18.650 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:18.650 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:18.650 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.650 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:18.650 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:18.650 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.651 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.651 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:18.651 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:18.651 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.651 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.651 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:18.651 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.651 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:18.651 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:18.651 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.652 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.652 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:18.652 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:18.652 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.652 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:18.652 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:18.652 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:18.652 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:18.652 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:18.652 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:18.653 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:18.653 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.653 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:18.653 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:18.653 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:18.653 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:18.653 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:18.653 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:18.653 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:18.654 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:18.654 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:18.654 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.654 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:18.654 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:18.654 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:18.654 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:18.654 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.654 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:18.654 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:18.655 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:18.655 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:18.655 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.655 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.655 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:18.655 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:18.655 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:18.655 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:18.655 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.655 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.656 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:18.656 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:18.656 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:18.656 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.656 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:18.656 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.656 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:18.656 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:18.656 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.656 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:18.657 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:18.657 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:18.657 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:18.657 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:18.657 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:18.657 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.657 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:18.657 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.657 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:18.657 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.658 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:18.658 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:18.658 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.658 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:18.658 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.658 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:18.658 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:18.658 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:18.658 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:18.658 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:18.659 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:18.659 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:18.659 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:18.659 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:18.659 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:18.659 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:18.659 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:18.659 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:18.659 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.659 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:18.660 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:18.660 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:18.660 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:18.660 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:18.660 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:18.660 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:18.660 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:18.660 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:18.660 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:18.660 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:18.661 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.661 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.661 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:18.661 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.661 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:18.661 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:18.661 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:18.661 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:18.661 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:18.661 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:18.661 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:18.662 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:18.662 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:18.662 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:18.662 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:18.662 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:18.662 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:18.662 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:18.662 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:18.662 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:18.663 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:18.663 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:18.663 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:18.663 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:18.663 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:18.663 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:18.663 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:18.663 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:18.663 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:18.663 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:18.664 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:18.664 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:18.664 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.664 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.664 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:18.664 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.664 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:18.664 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:18.664 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.664 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:18.665 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:18.665 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:18.665 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:18.665 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:18.665 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.665 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:18.665 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:18.665 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.665 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.665 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:18.666 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:18.666 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.666 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.666 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:18.666 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:18.666 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:18.666 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:18.666 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:18.666 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.667 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.667 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:18.667 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:18.667 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:18.667 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.667 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:18.667 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.667 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:18.667 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.667 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:18.668 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.668 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.fails_on_dbstore 2023-10-05T12:49:18.668 INFO:teuthology.orchestra.run.smithi012.stdout: def test_object_lock_put_obj_retention_versionid(): 2023-10-05T12:49:18.668 INFO:teuthology.orchestra.run.smithi012.stdout: bucket_name = get_new_bucket_name() 2023-10-05T12:49:18.668 INFO:teuthology.orchestra.run.smithi012.stdout: client = get_client() 2023-10-05T12:49:18.668 INFO:teuthology.orchestra.run.smithi012.stdout:> client.create_bucket(Bucket=bucket_name, ObjectLockEnabledForBucket=True) 2023-10-05T12:49:18.668 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.668 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:11832: 2023-10-05T12:49:18.668 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.668 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:18.669 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:18.669 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:18.669 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:18.669 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:18.669 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:18.669 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:18.669 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:18.669 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:18.669 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:18.669 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:18.670 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:18.670 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:18.670 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:18.670 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:18.670 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:18.670 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:18.670 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:18.670 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:18.670 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:18.670 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:18.671 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:18.671 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:18.671 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:18.671 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:18.671 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:18.671 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:18.671 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:18.671 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:18.671 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:18.671 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:18.672 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:18.672 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:18.672 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:18.672 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.672 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.672 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:18.672 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:18.672 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.672 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:18.672 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.673 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:18.673 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:18.673 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:18.673 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:18.673 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:18.673 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:18.673 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:18.673 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:18.673 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:18.673 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:18.674 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:18.674 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:18.674 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:18.674 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.674 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:18.674 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:18.674 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:18.674 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:18.674 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:18.675 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:18.675 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:18.675 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:18.675 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:18.675 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:18.675 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:18.675 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.675 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.675 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:18.675 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:18.675 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:18.676 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:18.676 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:18.676 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.676 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.676 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:18.676 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:18.676 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:18.676 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:18.676 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:18.676 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.676 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:18.677 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:18.677 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:18.677 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:18.677 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:18.677 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-485" 2023-10-05T12:49:18.677 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.677 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:18.677 INFO:teuthology.orchestra.run.smithi012.stdout:________ test_object_lock_put_obj_retention_override_default_retention _________ 2023-10-05T12:49:18.677 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.677 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:18.678 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.678 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:18.678 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:18.678 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.678 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:18.678 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:18.678 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:18.678 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:18.678 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:18.678 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.678 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:18.679 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:18.679 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.679 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.679 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:18.679 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:18.679 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.679 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.679 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:18.679 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.680 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:18.680 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:18.680 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.680 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.680 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:18.680 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:18.680 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.680 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:18.680 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:18.680 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:18.681 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:18.681 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:18.681 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:18.681 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:18.681 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.681 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:18.681 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:18.681 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:18.681 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:18.681 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:18.682 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:18.682 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:18.682 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:18.682 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:18.682 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.682 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:18.682 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:18.682 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:18.682 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:18.682 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.683 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:18.683 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:18.683 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:18.683 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:18.683 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.683 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.683 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:18.683 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:18.683 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:18.684 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:18.684 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.684 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.684 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:18.684 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:18.684 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:18.684 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.684 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:18.684 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.684 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:18.685 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:18.685 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.685 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:18.685 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:18.685 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:18.685 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:18.685 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:18.685 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:18.685 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.685 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:18.685 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.686 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:18.686 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.686 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:18.686 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:18.686 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.686 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:18.686 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.686 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:18.686 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:18.687 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:18.687 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:18.687 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:18.687 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:18.687 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:18.687 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:18.687 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:18.687 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:18.687 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:18.687 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:18.688 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:18.688 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.688 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:18.688 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:18.688 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:18.688 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:18.688 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:18.688 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:18.688 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:18.689 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:18.689 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:18.689 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:18.689 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:18.689 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.689 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.689 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:18.689 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.689 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:18.689 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:18.690 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:18.690 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:18.690 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:18.690 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:18.690 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:18.690 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:18.690 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:18.690 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:18.690 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:18.690 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:18.691 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:18.691 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:18.691 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:18.691 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:18.691 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:18.691 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:18.691 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:18.691 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:18.691 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:18.691 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:18.692 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:18.692 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:18.692 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:18.692 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:18.692 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:18.692 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:18.692 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.692 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.692 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:18.692 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.692 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:18.693 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:18.693 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.693 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:18.693 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:18.693 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:18.693 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:18.693 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:18.693 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.693 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:18.693 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:18.694 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.694 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.694 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:18.694 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:18.694 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.694 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.694 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:18.694 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:18.694 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:18.694 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:18.695 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:18.695 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.695 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.695 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:18.695 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:18.695 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:18.695 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.695 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:18.695 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.695 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:18.696 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.696 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:18.696 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.696 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.fails_on_dbstore 2023-10-05T12:49:18.696 INFO:teuthology.orchestra.run.smithi012.stdout: def test_object_lock_put_obj_retention_override_default_retention(): 2023-10-05T12:49:18.696 INFO:teuthology.orchestra.run.smithi012.stdout: bucket_name = get_new_bucket_name() 2023-10-05T12:49:18.696 INFO:teuthology.orchestra.run.smithi012.stdout: client = get_client() 2023-10-05T12:49:18.696 INFO:teuthology.orchestra.run.smithi012.stdout:> client.create_bucket(Bucket=bucket_name, ObjectLockEnabledForBucket=True) 2023-10-05T12:49:18.696 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.696 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:11848: 2023-10-05T12:49:18.697 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.697 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:18.697 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:18.697 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:18.697 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:18.697 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:18.697 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:18.697 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:18.697 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:18.697 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:18.697 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:18.698 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:18.698 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:18.698 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:18.698 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:18.698 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:18.698 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:18.698 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:18.698 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:18.698 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:18.699 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:18.699 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:18.699 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:18.699 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:18.699 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:18.699 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:18.699 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:18.699 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:18.699 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:18.699 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:18.700 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:18.700 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:18.700 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:18.700 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:18.700 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:18.700 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.700 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.700 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:18.700 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:18.700 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.700 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:18.701 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.701 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:18.701 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:18.701 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:18.701 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:18.701 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:18.701 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:18.701 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:18.701 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:18.701 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:18.701 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:18.702 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:18.702 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:18.702 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:18.702 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.702 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:18.702 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:18.702 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:18.702 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:18.702 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:18.702 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:18.703 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:18.703 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:18.703 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:18.703 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:18.703 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:18.703 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.703 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.703 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:18.703 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:18.703 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:18.703 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:18.704 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:18.704 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.704 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.704 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:18.704 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:18.704 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:18.704 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:18.704 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:18.704 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.704 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:18.705 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:18.705 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:18.705 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:18.705 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:18.705 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-486" 2023-10-05T12:49:18.705 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.705 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:18.705 INFO:teuthology.orchestra.run.smithi012.stdout:______________ test_object_lock_put_obj_retention_increase_period ______________ 2023-10-05T12:49:18.705 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.705 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:18.706 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.706 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:18.706 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:18.706 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.706 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:18.706 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:18.706 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:18.706 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:18.706 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:18.706 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.707 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:18.707 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:18.707 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.707 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.707 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:18.707 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:18.707 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.707 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.707 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:18.707 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.708 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:18.708 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:18.708 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.708 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.708 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:18.708 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:18.708 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.708 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:18.708 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:18.708 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:18.709 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:18.709 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:18.709 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:18.709 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:18.709 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.709 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:18.709 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:18.709 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:18.709 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:18.709 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:18.710 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:18.710 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:18.710 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:18.710 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:18.710 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.710 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:18.710 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:18.710 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:18.710 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:18.710 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.710 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:18.711 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:18.711 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:18.711 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:18.711 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.711 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.711 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:18.711 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:18.711 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:18.711 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:18.711 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.712 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.712 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:18.712 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:18.712 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:18.712 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.712 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:18.712 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.712 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:18.712 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:18.712 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.712 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:18.713 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:18.713 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:18.713 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:18.713 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:18.713 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:18.713 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.713 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:18.713 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.713 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:18.713 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.713 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:18.714 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:18.714 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.714 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:18.714 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.714 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:18.714 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:18.714 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:18.714 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:18.714 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:18.715 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:18.715 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:18.715 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:18.715 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:18.715 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:18.715 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:18.715 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:18.715 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:18.715 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.715 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:18.715 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:18.716 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:18.716 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:18.716 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:18.716 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:18.716 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:18.716 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:18.716 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:18.716 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:18.716 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:18.716 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.717 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.717 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:18.717 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.717 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:18.717 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:18.717 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:18.717 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:18.717 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:18.717 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:18.717 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:18.718 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:18.718 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:18.718 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:18.718 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:18.718 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:18.718 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:18.718 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:18.718 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:18.718 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:18.719 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:18.719 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:18.719 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:18.719 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:18.719 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:18.719 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:18.719 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:18.719 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:18.719 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:18.719 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:18.720 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:18.720 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:18.720 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.720 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.720 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:18.720 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.720 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:18.720 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:18.720 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.720 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:18.720 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:18.721 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:18.721 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:18.721 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:18.721 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.721 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:18.721 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:18.721 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.721 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.721 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:18.721 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:18.722 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.722 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.722 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:18.722 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:18.722 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:18.722 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:18.722 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:18.722 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.722 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.723 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:18.723 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:18.723 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:18.723 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.723 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:18.723 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.723 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:18.723 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.723 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:18.723 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.723 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.fails_on_dbstore 2023-10-05T12:49:18.724 INFO:teuthology.orchestra.run.smithi012.stdout: def test_object_lock_put_obj_retention_increase_period(): 2023-10-05T12:49:18.724 INFO:teuthology.orchestra.run.smithi012.stdout: bucket_name = get_new_bucket_name() 2023-10-05T12:49:18.724 INFO:teuthology.orchestra.run.smithi012.stdout: client = get_client() 2023-10-05T12:49:18.724 INFO:teuthology.orchestra.run.smithi012.stdout:> client.create_bucket(Bucket=bucket_name, ObjectLockEnabledForBucket=True) 2023-10-05T12:49:18.724 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.724 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:11873: 2023-10-05T12:49:18.724 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.724 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:18.724 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:18.724 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:18.725 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:18.725 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:18.725 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:18.725 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:18.725 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:18.725 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:18.725 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:18.725 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:18.725 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:18.725 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:18.726 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:18.726 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:18.726 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:18.726 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:18.726 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:18.726 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:18.726 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:18.726 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:18.726 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:18.726 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:18.727 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:18.727 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:18.727 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:18.727 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:18.727 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:18.727 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:18.727 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:18.727 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:18.727 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:18.727 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:18.728 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:18.728 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.728 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.728 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:18.728 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:18.728 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.728 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:18.728 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.728 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:18.728 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:18.729 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:18.729 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:18.729 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:18.729 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:18.729 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:18.729 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:18.729 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:18.729 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:18.729 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:18.729 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:18.729 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:18.730 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.730 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:18.730 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:18.730 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:18.730 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:18.730 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:18.730 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:18.730 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:18.730 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:18.730 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:18.731 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:18.731 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:18.731 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.731 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.731 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:18.731 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:18.731 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:18.731 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:18.731 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:18.731 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.732 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.732 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:18.732 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:18.732 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:18.732 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:18.732 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:18.732 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.732 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:18.732 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:18.732 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:18.733 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:18.733 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:18.733 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-487" 2023-10-05T12:49:18.733 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.733 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:18.733 INFO:teuthology.orchestra.run.smithi012.stdout:______________ test_object_lock_put_obj_retention_shorten_period _______________ 2023-10-05T12:49:18.733 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.733 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:18.733 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.733 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:18.734 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:18.734 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.734 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:18.734 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:18.734 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:18.734 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:18.734 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:18.734 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.734 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:18.734 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:18.735 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.735 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.735 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:18.735 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:18.735 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.735 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.735 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:18.735 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.735 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:18.735 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:18.736 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.736 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.736 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:18.736 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:18.736 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.736 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:18.736 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:18.736 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:18.736 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:18.736 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:18.737 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:18.737 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:18.737 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.737 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:18.737 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:18.737 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:18.737 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:18.737 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:18.737 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:18.737 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:18.737 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:18.738 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:18.738 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.738 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:18.738 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:18.738 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:18.738 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:18.738 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.738 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:18.738 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:18.739 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:18.739 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:18.739 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.739 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.739 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:18.739 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:18.739 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:18.739 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:18.739 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.739 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.740 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:18.740 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:18.740 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:18.740 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.740 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:18.740 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.740 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:18.740 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:18.740 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.741 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:18.741 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:18.741 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:18.741 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:18.741 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:18.741 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:18.741 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.741 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:18.741 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.741 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:18.742 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.742 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:18.742 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:18.742 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.742 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:18.742 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.742 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:18.742 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:18.742 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:18.742 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:18.743 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:18.743 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:18.743 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:18.743 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:18.743 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:18.743 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:18.743 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:18.743 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:18.743 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:18.743 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.744 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:18.744 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:18.744 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:18.744 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:18.744 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:18.744 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:18.744 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:18.744 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:18.744 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:18.744 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:18.745 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:18.745 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.745 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.745 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:18.745 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.745 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:18.745 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:18.745 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:18.745 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:18.746 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:18.746 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:18.746 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:18.746 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:18.746 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:18.746 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:18.746 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:18.746 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:18.746 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:18.746 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:18.747 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:18.747 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:18.747 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:18.747 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:18.747 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:18.747 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:18.747 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:18.747 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:18.747 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:18.747 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:18.748 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:18.748 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:18.748 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:18.748 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:18.748 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.748 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.748 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:18.748 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.748 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:18.748 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:18.749 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.749 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:18.749 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:18.749 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:18.749 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:18.749 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:18.749 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.749 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:18.749 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:18.750 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.750 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.750 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:18.750 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:18.750 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.750 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.750 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:18.750 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:18.750 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:18.750 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:18.751 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:18.751 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.751 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.751 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:18.751 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:18.751 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:18.751 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.751 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:18.751 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.752 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:18.752 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.752 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:18.752 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.752 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.fails_on_dbstore 2023-10-05T12:49:18.752 INFO:teuthology.orchestra.run.smithi012.stdout: def test_object_lock_put_obj_retention_shorten_period(): 2023-10-05T12:49:18.752 INFO:teuthology.orchestra.run.smithi012.stdout: bucket_name = get_new_bucket_name() 2023-10-05T12:49:18.752 INFO:teuthology.orchestra.run.smithi012.stdout: client = get_client() 2023-10-05T12:49:18.752 INFO:teuthology.orchestra.run.smithi012.stdout:> client.create_bucket(Bucket=bucket_name, ObjectLockEnabledForBucket=True) 2023-10-05T12:49:18.752 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.753 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:11890: 2023-10-05T12:49:18.753 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.753 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:18.753 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:18.753 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:18.753 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:18.753 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:18.753 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:18.753 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:18.753 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:18.754 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:18.754 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:18.754 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:18.754 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:18.754 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:18.754 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:18.754 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:18.754 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:18.754 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:18.755 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:18.755 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:18.755 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:18.755 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:18.755 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:18.755 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:18.755 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:18.755 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:18.755 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:18.755 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:18.756 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:18.756 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:18.756 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:18.756 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:18.756 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:18.756 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:18.756 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:18.756 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.756 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.757 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:18.757 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:18.757 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.757 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:18.757 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.757 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:18.757 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:18.757 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:18.757 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:18.757 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:18.758 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:18.758 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:18.758 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:18.758 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:18.758 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:18.758 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:18.758 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:18.758 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:18.758 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.759 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:18.759 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:18.759 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:18.759 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:18.759 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:18.759 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:18.759 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:18.759 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:18.759 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:18.759 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:18.760 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:18.760 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.760 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.760 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:18.760 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:18.760 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:18.760 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:18.760 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:18.760 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.761 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.761 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:18.761 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:18.761 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:18.761 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:18.761 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:18.761 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.761 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:18.761 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:18.761 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:18.762 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:18.762 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:18.762 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-488" 2023-10-05T12:49:18.762 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.762 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:18.762 INFO:teuthology.orchestra.run.smithi012.stdout:___________ test_object_lock_put_obj_retention_shorten_period_bypass ___________ 2023-10-05T12:49:18.762 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.762 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:18.762 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.762 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:18.763 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:18.763 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.763 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:18.763 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:18.763 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:18.763 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:18.763 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:18.763 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.763 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:18.763 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:18.764 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.764 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.764 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:18.764 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:18.764 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.764 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.764 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:18.764 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.764 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:18.764 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:18.765 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.765 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.765 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:18.765 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:18.765 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.765 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:18.765 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:18.765 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:18.765 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:18.765 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:18.766 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:18.766 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:18.766 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.766 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:18.766 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:18.766 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:18.766 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:18.766 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:18.766 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:18.767 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:18.767 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:18.767 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:18.767 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.767 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:18.767 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:18.767 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:18.767 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:18.767 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.767 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:18.768 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:18.768 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:18.768 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:18.768 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.768 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.768 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:18.768 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:18.768 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:18.768 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:18.768 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.769 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.769 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:18.769 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:18.769 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:18.769 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.769 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:18.769 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.769 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:18.769 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:18.770 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.770 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:18.770 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:18.770 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:18.770 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:18.770 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:18.770 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:18.770 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.770 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:18.770 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.771 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:18.771 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.771 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:18.771 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:18.771 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.771 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:18.771 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.771 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:18.771 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:18.771 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:18.771 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:18.772 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:18.772 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:18.772 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:18.772 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:18.772 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:18.772 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:18.772 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:18.772 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:18.772 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:18.772 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.772 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:18.773 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:18.773 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:18.773 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:18.773 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:18.773 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:18.773 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:18.773 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:18.773 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:18.773 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:18.773 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:18.774 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.774 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.774 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:18.774 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.774 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:18.774 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:18.774 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:18.774 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:18.774 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:18.775 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:18.775 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:18.775 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:18.775 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:18.775 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:18.775 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:18.775 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:18.775 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:18.775 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:18.775 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:18.775 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:18.776 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:18.776 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:18.776 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:18.776 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:18.776 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:18.776 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:18.776 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:18.776 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:18.776 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:18.776 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:18.777 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:18.777 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:18.777 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.777 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.777 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:18.777 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.777 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:18.777 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:18.777 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.777 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:18.777 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:18.778 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:18.778 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:18.778 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:18.778 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.778 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:18.778 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:18.778 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.778 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.778 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:18.779 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:18.779 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.779 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.779 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:18.779 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:18.779 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:18.779 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:18.779 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:18.779 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.779 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.780 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:18.780 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:18.780 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:18.780 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.780 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:18.780 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.780 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:18.780 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.780 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:18.780 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.781 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.fails_on_dbstore 2023-10-05T12:49:18.781 INFO:teuthology.orchestra.run.smithi012.stdout: def test_object_lock_put_obj_retention_shorten_period_bypass(): 2023-10-05T12:49:18.781 INFO:teuthology.orchestra.run.smithi012.stdout: bucket_name = get_new_bucket_name() 2023-10-05T12:49:18.781 INFO:teuthology.orchestra.run.smithi012.stdout: client = get_client() 2023-10-05T12:49:18.781 INFO:teuthology.orchestra.run.smithi012.stdout:> client.create_bucket(Bucket=bucket_name, ObjectLockEnabledForBucket=True) 2023-10-05T12:49:18.781 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.781 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:11908: 2023-10-05T12:49:18.781 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.781 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:18.781 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:18.782 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:18.782 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:18.782 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:18.782 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:18.782 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:18.782 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:18.782 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:18.782 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:18.782 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:18.782 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:18.783 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:18.783 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:18.783 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:18.783 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:18.783 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:18.783 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:18.783 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:18.783 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:18.783 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:18.783 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:18.784 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:18.784 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:18.784 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:18.784 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:18.784 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:18.784 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:18.784 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:18.784 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:18.784 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:18.785 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:18.785 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:18.785 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:18.785 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.785 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.785 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:18.785 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:18.785 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.785 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:18.785 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.785 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:18.786 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:18.786 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:18.786 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:18.786 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:18.786 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:18.786 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:18.786 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:18.786 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:18.786 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:18.786 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:18.787 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:18.787 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:18.787 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.787 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:18.787 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:18.787 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:18.787 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:18.787 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:18.787 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:18.787 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:18.788 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:18.788 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:18.788 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:18.788 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:18.788 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.788 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.788 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:18.788 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:18.788 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:18.788 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:18.789 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:18.789 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.789 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.789 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:18.789 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:18.789 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:18.789 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:18.789 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:18.789 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.789 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:18.790 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:18.790 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:18.790 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:18.790 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:18.790 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-489" 2023-10-05T12:49:18.790 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.790 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:18.790 INFO:teuthology.orchestra.run.smithi012.stdout:________________ test_object_lock_delete_object_with_retention _________________ 2023-10-05T12:49:18.790 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.791 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:18.791 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.791 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:18.791 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:18.791 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.791 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:18.791 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:18.791 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:18.791 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:18.792 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:18.792 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.792 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:18.792 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:18.792 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.792 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.792 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:18.792 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:18.792 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.793 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.793 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:18.793 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.793 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:18.793 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:18.793 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.793 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.793 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:18.793 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:18.793 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.794 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:18.794 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:18.794 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:18.794 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:18.794 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:18.794 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:18.794 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:18.794 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.794 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:18.794 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:18.795 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:18.795 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:18.795 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:18.795 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:18.795 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:18.795 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:18.795 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:18.795 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.795 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:18.797 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:18.797 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:18.797 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:18.797 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.797 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:18.797 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:18.797 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:18.797 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:18.798 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.798 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.798 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:18.798 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:18.798 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:18.798 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:18.798 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.798 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.798 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:18.799 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:18.799 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:18.799 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.799 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:18.799 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.799 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:18.799 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:18.799 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.799 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:18.799 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:18.799 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:18.800 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:18.800 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:18.800 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:18.800 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.800 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:18.800 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.800 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:18.800 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.800 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:18.800 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:18.801 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.801 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:18.801 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.801 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:18.801 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:18.801 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:18.801 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:18.801 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:18.801 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:18.801 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:18.801 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:18.802 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:18.802 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:18.802 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:18.802 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:18.802 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:18.802 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.802 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:18.802 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:18.802 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:18.802 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:18.802 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:18.803 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:18.803 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:18.803 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:18.803 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:18.803 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:18.803 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:18.803 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.803 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.803 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:18.804 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.804 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:18.804 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:18.804 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:18.804 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:18.804 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:18.804 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:18.804 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:18.804 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:18.804 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:18.804 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:18.805 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:18.805 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:18.805 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:18.805 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:18.805 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:18.805 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:18.805 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:18.805 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:18.805 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:18.805 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:18.805 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:18.806 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:18.806 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:18.806 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:18.806 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:18.806 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:18.806 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:18.806 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:18.806 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.807 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.807 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:18.807 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.807 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:18.807 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:18.807 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.807 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:18.807 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:18.807 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:18.807 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:18.808 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:18.808 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.808 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:18.808 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:18.808 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.808 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.808 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:18.808 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:18.808 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.809 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.809 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:18.809 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:18.809 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:18.809 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:18.809 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:18.809 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.809 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.809 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:18.809 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:18.809 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:18.810 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.810 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:18.810 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.810 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:18.810 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.810 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:18.810 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.810 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.fails_on_dbstore 2023-10-05T12:49:18.810 INFO:teuthology.orchestra.run.smithi012.stdout: def test_object_lock_delete_object_with_retention(): 2023-10-05T12:49:18.810 INFO:teuthology.orchestra.run.smithi012.stdout: bucket_name = get_new_bucket_name() 2023-10-05T12:49:18.811 INFO:teuthology.orchestra.run.smithi012.stdout: client = get_client() 2023-10-05T12:49:18.811 INFO:teuthology.orchestra.run.smithi012.stdout:> client.create_bucket(Bucket=bucket_name, ObjectLockEnabledForBucket=True) 2023-10-05T12:49:18.811 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.811 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:11925: 2023-10-05T12:49:18.811 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.811 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:18.811 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:18.811 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:18.811 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:18.811 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:18.811 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:18.812 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:18.812 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:18.812 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:18.812 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:18.812 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:18.812 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:18.812 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:18.812 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:18.812 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:18.812 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:18.813 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:18.813 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:18.813 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:18.813 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:18.813 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:18.813 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:18.813 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:18.813 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:18.813 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:18.813 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:18.814 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:18.814 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:18.814 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:18.814 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:18.814 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:18.814 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:18.814 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:18.814 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:18.814 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.815 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.815 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:18.815 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:18.815 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.815 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:18.815 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.815 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:18.815 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:18.815 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:18.815 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:18.815 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:18.816 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:18.816 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:18.816 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:18.816 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:18.816 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:18.816 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:18.816 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:18.816 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:18.816 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.816 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:18.816 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:18.817 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:18.817 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:18.817 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:18.817 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:18.817 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:18.817 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:18.817 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:18.817 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:18.817 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:18.817 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.817 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.818 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:18.818 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:18.818 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:18.818 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:18.818 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:18.818 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.818 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.818 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:18.818 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:18.819 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:18.819 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:18.819 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:18.819 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.819 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:18.819 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:18.819 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:18.819 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:18.819 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:18.819 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-490" 2023-10-05T12:49:18.819 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.820 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:18.820 INFO:teuthology.orchestra.run.smithi012.stdout:___________ test_object_lock_delete_object_with_retention_and_marker ___________ 2023-10-05T12:49:18.820 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.820 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:18.820 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.820 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:18.820 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:18.820 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.820 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:18.820 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:18.820 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:18.821 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:18.821 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:18.821 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.821 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:18.821 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:18.821 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.821 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.821 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:18.821 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:18.821 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.821 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.822 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:18.822 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.822 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:18.822 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:18.822 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.822 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.822 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:18.822 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:18.822 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.822 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:18.823 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:18.823 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:18.823 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:18.823 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:18.823 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:18.823 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:18.823 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.823 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:18.823 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:18.823 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:18.823 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:18.824 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:18.824 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:18.824 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:18.824 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:18.824 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:18.824 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.824 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:18.824 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:18.824 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:18.824 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:18.824 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.825 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:18.825 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:18.825 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:18.825 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:18.825 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.825 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.825 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:18.825 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:18.825 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:18.825 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:18.825 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.826 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.826 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:18.826 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:18.826 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:18.826 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.826 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:18.826 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.826 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:18.826 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:18.826 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.827 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:18.827 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:18.827 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:18.827 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:18.827 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:18.827 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:18.827 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.827 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:18.827 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.827 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:18.828 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.828 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:18.828 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:18.828 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.828 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:18.828 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.828 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:18.828 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:18.828 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:18.829 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:18.829 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:18.829 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:18.829 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:18.829 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:18.829 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:18.829 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:18.829 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:18.829 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:18.829 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:18.830 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.830 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:18.830 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:18.830 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:18.830 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:18.830 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:18.830 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:18.830 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:18.830 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:18.830 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:18.830 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:18.831 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:18.831 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.831 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.831 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:18.831 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.831 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:18.831 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:18.831 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:18.831 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:18.831 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:18.832 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:18.832 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:18.832 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:18.832 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:18.832 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:18.832 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:18.832 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:18.832 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:18.832 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:18.832 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:18.833 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:18.833 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:18.833 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:18.833 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:18.833 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:18.833 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:18.833 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:18.833 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:18.833 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:18.833 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:18.834 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:18.834 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:18.834 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:18.834 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.834 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.834 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:18.834 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.834 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:18.834 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:18.834 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.835 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:18.835 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:18.835 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:18.835 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:18.835 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:18.835 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.835 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:18.835 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:18.835 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.835 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.836 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:18.836 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:18.836 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.836 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.836 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:18.836 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:18.836 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:18.836 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:18.836 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:18.837 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.837 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.837 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:18.837 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:18.837 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:18.837 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.837 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:18.837 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.837 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:18.837 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.838 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:18.838 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.838 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.fails_on_dbstore 2023-10-05T12:49:18.838 INFO:teuthology.orchestra.run.smithi012.stdout: def test_object_lock_delete_object_with_retention_and_marker(): 2023-10-05T12:49:18.838 INFO:teuthology.orchestra.run.smithi012.stdout: bucket_name = get_new_bucket_name() 2023-10-05T12:49:18.838 INFO:teuthology.orchestra.run.smithi012.stdout: client = get_client() 2023-10-05T12:49:18.838 INFO:teuthology.orchestra.run.smithi012.stdout:> client.create_bucket(Bucket=bucket_name, ObjectLockEnabledForBucket=True) 2023-10-05T12:49:18.838 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.838 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:11943: 2023-10-05T12:49:18.838 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.839 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:18.839 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:18.839 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:18.839 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:18.839 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:18.839 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:18.839 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:18.839 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:18.839 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:18.839 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:18.840 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:18.840 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:18.840 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:18.840 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:18.840 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:18.840 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:18.840 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:18.840 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:18.840 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:18.840 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:18.841 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:18.841 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:18.841 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:18.841 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:18.841 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:18.841 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:18.841 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:18.841 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:18.841 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:18.841 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:18.842 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:18.842 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:18.842 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:18.842 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:18.842 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.842 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.842 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:18.842 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:18.842 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.843 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:18.843 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.843 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:18.843 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:18.843 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:18.843 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:18.843 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:18.843 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:18.843 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:18.843 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:18.844 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:18.844 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:18.844 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:18.844 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:18.844 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:18.844 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.844 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:18.844 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:18.844 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:18.844 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:18.845 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:18.845 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:18.845 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:18.845 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:18.845 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:18.845 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:18.845 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:18.845 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.845 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.845 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:18.846 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:18.846 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:18.846 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:18.846 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:18.846 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.846 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.846 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:18.846 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:18.846 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:18.846 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:18.847 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:18.847 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.847 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:18.847 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:18.847 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:18.847 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:18.847 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:18.847 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-491" 2023-10-05T12:49:18.847 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.847 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:18.848 INFO:teuthology.orchestra.run.smithi012.stdout:_____________ test_object_lock_multi_delete_object_with_retention ______________ 2023-10-05T12:49:18.848 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.848 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:18.848 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.848 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:18.848 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:18.848 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.848 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:18.848 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:18.848 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:18.849 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:18.849 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:18.849 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.849 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:18.849 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:18.849 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.849 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.849 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:18.849 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:18.849 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.850 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.850 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:18.850 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.850 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:18.850 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:18.850 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.850 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.850 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:18.850 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:18.850 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.851 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:18.851 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:18.851 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:18.851 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:18.851 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:18.851 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:18.851 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:18.851 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.851 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:18.851 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:18.852 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:18.852 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:18.852 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:18.852 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:18.852 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:18.852 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:18.852 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:18.852 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.852 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:18.852 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:18.853 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:18.853 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:18.853 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.853 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:18.853 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:18.853 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:18.853 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:18.853 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.853 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.853 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:18.854 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:18.854 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:18.854 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:18.854 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.854 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.854 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:18.854 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:18.854 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:18.854 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.854 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:18.855 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.855 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:18.855 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:18.855 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.855 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:18.855 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:18.855 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:18.855 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:18.855 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:18.855 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:18.856 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.856 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:18.856 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.856 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:18.856 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.856 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:18.856 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:18.856 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.856 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:18.856 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.857 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:18.857 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:18.857 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:18.857 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:18.857 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:18.857 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:18.857 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:18.857 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:18.858 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:18.858 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:18.858 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:18.859 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:18.859 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:18.859 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.859 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:18.859 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:18.859 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:18.860 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:18.860 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:18.860 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:18.860 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:18.860 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:18.860 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:18.860 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:18.861 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:18.861 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.861 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.861 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:18.861 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.861 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:18.861 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:18.861 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:18.861 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:18.862 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:18.862 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:18.862 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:18.862 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:18.862 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:18.863 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:18.863 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:18.863 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:18.863 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:18.863 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:18.863 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:18.864 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:18.864 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:18.864 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:18.864 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:18.864 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:18.864 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:18.864 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:18.865 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:18.865 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:18.865 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:18.865 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:18.865 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:18.865 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:18.865 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.865 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.865 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:18.865 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.866 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:18.866 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:18.866 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.866 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:18.866 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:18.866 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:18.866 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:18.866 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:18.866 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.866 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:18.867 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:18.867 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.867 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.867 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:18.867 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:18.867 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.867 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.867 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:18.867 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:18.867 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:18.868 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:18.868 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:18.868 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.868 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.868 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:18.868 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:18.868 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:18.868 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.868 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:18.868 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.869 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:18.869 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.869 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:18.869 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.869 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.fails_on_dbstore 2023-10-05T12:49:18.869 INFO:teuthology.orchestra.run.smithi012.stdout: def test_object_lock_multi_delete_object_with_retention(): 2023-10-05T12:49:18.869 INFO:teuthology.orchestra.run.smithi012.stdout: bucket_name = get_new_bucket_name() 2023-10-05T12:49:18.869 INFO:teuthology.orchestra.run.smithi012.stdout: client = get_client() 2023-10-05T12:49:18.869 INFO:teuthology.orchestra.run.smithi012.stdout:> client.create_bucket(Bucket=bucket_name, ObjectLockEnabledForBucket=True) 2023-10-05T12:49:18.869 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.870 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:11968: 2023-10-05T12:49:18.870 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.870 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:18.870 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:18.870 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:18.870 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:18.870 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:18.870 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:18.870 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:18.871 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:18.871 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:18.871 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:18.871 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:18.871 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:18.871 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:18.871 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:18.871 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:18.871 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:18.871 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:18.872 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:18.872 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:18.872 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:18.872 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:18.872 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:18.872 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:18.872 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:18.872 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:18.872 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:18.872 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:18.873 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:18.873 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:18.873 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:18.873 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:18.873 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:18.873 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:18.873 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:18.873 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.873 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.873 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:18.874 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:18.874 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.874 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:18.874 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.874 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:18.874 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:18.874 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:18.874 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:18.874 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:18.875 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:18.875 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:18.875 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:18.875 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:18.875 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:18.875 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:18.875 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:18.875 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:18.875 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.875 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:18.876 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:18.876 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:18.876 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:18.876 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:18.876 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:18.876 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:18.876 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:18.876 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:18.876 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:18.876 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:18.877 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.877 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.877 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:18.877 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:18.877 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:18.877 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:18.877 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:18.877 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.877 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.877 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:18.877 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:18.878 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:18.878 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:18.878 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:18.878 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.878 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:18.878 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:18.878 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:18.878 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:18.878 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:18.879 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-492" 2023-10-05T12:49:18.879 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.879 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:18.879 INFO:teuthology.orchestra.run.smithi012.stdout:_______________________ test_object_lock_put_legal_hold ________________________ 2023-10-05T12:49:18.879 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.879 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:18.879 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.879 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:18.879 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:18.879 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.880 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:18.880 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:18.880 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:18.880 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:18.880 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:18.880 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.880 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:18.880 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:18.880 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.880 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.881 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:18.881 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:18.881 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.881 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.881 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:18.881 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.881 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:18.881 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:18.881 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.881 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.882 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:18.882 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:18.882 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.882 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:18.882 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:18.882 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:18.882 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:18.882 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:18.882 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:18.883 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:18.883 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.883 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:18.883 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:18.883 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:18.883 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:18.883 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:18.883 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:18.883 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:18.883 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:18.884 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:18.884 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.884 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:18.884 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:18.884 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:18.884 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:18.884 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.884 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:18.884 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:18.884 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:18.885 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:18.885 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.885 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.885 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:18.885 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:18.885 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:18.885 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:18.885 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.885 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.886 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:18.886 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:18.886 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:18.886 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.886 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:18.886 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.886 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:18.886 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:18.886 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.886 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:18.887 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:18.887 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:18.887 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:18.887 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:18.887 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:18.887 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.887 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:18.887 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.887 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:18.887 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.888 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:18.888 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:18.888 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.888 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:18.888 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.888 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:18.888 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:18.888 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:18.888 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:18.889 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:18.889 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:18.889 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:18.889 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:18.889 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:18.889 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:18.889 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:18.889 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:18.889 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:18.889 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.889 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:18.890 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:18.890 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:18.890 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:18.890 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:18.890 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:18.890 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:18.890 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:18.890 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:18.890 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:18.891 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:18.891 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.891 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.891 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:18.891 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.891 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:18.891 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:18.891 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:18.891 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:18.891 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:18.892 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:18.892 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:18.892 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:18.892 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:18.892 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:18.892 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:18.892 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:18.892 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:18.892 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:18.892 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:18.893 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:18.893 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:18.893 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:18.893 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:18.893 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:18.893 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:18.893 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:18.893 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:18.893 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:18.893 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:18.894 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:18.894 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:18.894 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:18.894 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.894 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.894 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:18.894 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.894 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:18.894 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:18.894 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.895 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:18.895 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:18.895 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:18.895 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:18.895 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:18.895 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.895 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:18.895 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:18.895 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.895 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.896 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:18.896 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:18.896 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.896 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.896 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:18.896 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:18.896 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:18.896 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:18.896 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:18.896 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.897 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.897 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:18.897 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:18.897 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:18.897 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.897 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:18.897 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.897 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:18.897 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.897 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:18.898 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.898 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.fails_on_dbstore 2023-10-05T12:49:18.898 INFO:teuthology.orchestra.run.smithi012.stdout: def test_object_lock_put_legal_hold(): 2023-10-05T12:49:18.898 INFO:teuthology.orchestra.run.smithi012.stdout: bucket_name = get_new_bucket_name() 2023-10-05T12:49:18.898 INFO:teuthology.orchestra.run.smithi012.stdout: client = get_client() 2023-10-05T12:49:18.898 INFO:teuthology.orchestra.run.smithi012.stdout:> client.create_bucket(Bucket=bucket_name, ObjectLockEnabledForBucket=True) 2023-10-05T12:49:18.898 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.898 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:12035: 2023-10-05T12:49:18.898 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.898 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:18.899 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:18.899 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:18.899 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:18.899 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:18.899 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:18.899 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:18.899 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:18.899 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:18.899 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:18.900 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:18.900 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:18.900 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:18.900 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:18.900 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:18.900 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:18.900 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:18.900 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:18.900 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:18.900 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:18.901 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:18.901 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:18.901 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:18.901 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:18.901 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:18.901 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:18.901 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:18.901 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:18.901 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:18.901 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:18.902 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:18.902 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:18.902 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:18.902 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:18.902 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.902 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.902 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:18.902 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:18.902 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.902 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:18.903 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.903 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:18.903 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:18.903 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:18.903 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:18.903 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:18.903 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:18.903 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:18.903 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:18.903 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:18.904 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:18.904 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:18.904 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:18.904 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:18.904 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.904 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:18.904 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:18.904 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:18.904 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:18.904 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:18.905 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:18.905 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:18.905 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:18.905 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:18.905 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:18.905 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:18.905 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.905 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.905 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:18.905 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:18.906 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:18.906 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:18.906 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:18.906 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.906 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.906 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:18.906 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:18.906 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:18.906 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:18.906 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:18.907 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.907 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:18.907 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:18.907 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:18.907 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:18.907 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:18.907 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-493" 2023-10-05T12:49:18.907 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.907 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:18.907 INFO:teuthology.orchestra.run.smithi012.stdout:________________ test_object_lock_put_legal_hold_invalid_bucket ________________ 2023-10-05T12:49:18.908 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.908 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:18.908 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.908 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:18.908 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:18.908 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.908 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:18.908 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:18.908 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:18.908 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:18.909 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:18.909 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.909 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:18.909 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:18.909 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.909 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.909 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:18.909 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:18.909 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.909 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.910 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:18.910 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.910 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:18.910 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:18.910 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.910 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.910 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:18.910 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:18.910 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.910 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:18.911 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:18.911 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:18.911 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:18.911 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:18.911 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:18.911 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:18.911 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.911 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:18.911 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:18.911 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:18.912 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:18.912 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:18.912 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:18.912 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:18.912 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:18.912 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:18.912 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.912 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:18.912 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:18.912 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:18.913 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:18.913 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.913 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:18.913 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:18.913 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:18.913 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:18.913 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.913 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.913 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:18.913 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:18.914 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:18.914 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:18.914 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.914 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.914 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:18.914 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:18.914 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:18.914 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.914 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:18.914 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.915 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:18.915 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:18.915 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.915 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:18.915 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:18.915 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:18.915 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:18.915 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:18.915 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:18.916 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.916 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:18.916 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.916 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:18.916 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.916 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:18.916 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:18.916 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.916 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:18.916 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.916 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:18.917 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:18.917 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:18.917 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:18.917 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:18.917 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:18.917 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:18.917 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:18.917 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:18.917 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:18.917 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:18.917 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:18.918 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:18.918 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.918 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:18.918 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:18.918 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:18.918 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:18.918 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:18.918 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:18.918 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:18.919 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:18.919 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:18.919 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:18.919 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:18.919 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.919 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.919 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:18.919 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.919 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:18.919 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:18.920 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:18.920 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:18.920 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:18.920 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:18.920 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:18.920 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:18.920 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:18.920 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:18.920 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:18.920 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:18.921 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:18.921 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:18.921 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:18.921 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:18.921 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:18.921 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:18.921 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:18.921 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:18.921 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:18.921 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:18.922 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:18.922 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:18.922 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:18.922 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:18.922 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:18.922 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:18.922 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.922 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.922 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:18.922 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.923 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:18.923 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:18.923 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.923 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:18.923 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:18.923 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:18.923 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:18.923 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:18.923 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.923 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:18.924 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:18.924 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.924 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.924 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:18.924 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:18.924 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.924 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.924 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:18.924 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:18.924 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:18.924 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:18.925 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:18.925 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.925 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.925 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:18.925 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:18.925 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:18.925 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.925 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:18.925 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.925 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:18.926 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.926 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:18.926 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.926 INFO:teuthology.orchestra.run.smithi012.stdout: def test_object_lock_put_legal_hold_invalid_bucket(): 2023-10-05T12:49:18.926 INFO:teuthology.orchestra.run.smithi012.stdout: bucket_name = get_new_bucket_name() 2023-10-05T12:49:18.926 INFO:teuthology.orchestra.run.smithi012.stdout: client = get_client() 2023-10-05T12:49:18.926 INFO:teuthology.orchestra.run.smithi012.stdout:> client.create_bucket(Bucket=bucket_name) 2023-10-05T12:49:18.926 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.926 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:12048: 2023-10-05T12:49:18.926 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.927 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:18.927 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:18.927 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:18.927 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:18.927 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:18.927 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:18.927 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:18.927 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:18.927 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:18.927 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:18.927 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:18.928 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:18.928 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:18.928 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:18.928 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:18.928 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:18.928 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:18.928 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:18.928 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:18.928 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:18.928 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:18.929 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:18.929 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:18.929 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:18.929 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:18.929 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:18.929 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:18.929 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:18.929 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:18.929 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:18.929 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:18.930 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:18.930 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:18.930 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:18.930 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.930 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.930 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:18.930 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:18.930 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.930 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:18.931 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.931 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:18.931 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:18.931 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:18.931 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:18.931 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:18.931 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:18.931 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:18.931 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:18.931 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:18.932 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:18.932 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:18.932 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:18.932 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:18.932 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.932 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:18.932 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:18.932 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:18.932 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:18.932 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:18.933 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:18.933 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:18.933 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:18.933 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:18.933 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:18.933 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:18.933 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.933 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.933 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:18.933 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:18.934 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:18.934 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:18.934 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:18.934 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.934 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.934 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:18.934 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:18.934 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:18.934 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:18.934 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:18.935 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.935 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:18.935 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:18.935 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:18.935 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:18.935 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:18.935 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-494" 2023-10-05T12:49:18.935 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.935 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:18.935 INFO:teuthology.orchestra.run.smithi012.stdout:________________ test_object_lock_put_legal_hold_invalid_status ________________ 2023-10-05T12:49:18.935 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.936 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:18.936 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.936 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:18.936 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:18.936 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.936 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:18.936 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:18.936 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:18.936 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:18.936 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:18.936 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.937 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:18.937 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:18.937 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.937 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.937 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:18.937 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:18.937 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.937 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.937 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:18.937 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.938 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:18.938 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:18.938 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.938 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.938 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:18.938 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:18.938 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.938 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:18.938 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:18.938 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:18.939 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:18.939 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:18.939 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:18.939 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:18.939 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.939 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:18.939 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:18.939 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:18.939 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:18.939 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:18.939 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:18.940 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:18.940 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:18.940 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:18.940 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.940 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:18.940 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:18.940 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:18.940 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:18.940 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.940 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:18.940 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:18.941 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:18.941 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:18.941 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.941 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.941 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:18.941 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:18.941 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:18.941 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:18.941 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.941 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.942 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:18.942 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:18.942 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:18.942 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.942 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:18.942 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.942 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:18.942 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:18.942 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.942 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:18.943 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:18.943 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:18.943 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:18.943 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:18.943 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:18.943 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.943 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:18.943 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.943 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:18.943 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.944 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:18.944 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:18.944 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.944 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:18.944 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.944 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:18.944 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:18.944 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:18.944 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:18.944 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:18.945 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:18.945 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:18.945 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:18.945 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:18.945 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:18.945 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:18.945 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:18.945 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:18.945 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.945 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:18.945 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:18.946 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:18.946 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:18.946 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:18.946 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:18.946 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:18.946 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:18.946 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:18.946 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:18.946 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:18.947 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.947 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.947 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:18.947 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.947 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:18.947 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:18.947 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:18.947 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:18.947 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:18.947 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:18.948 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:18.948 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:18.948 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:18.948 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:18.948 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:18.948 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:18.948 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:18.948 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:18.948 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:18.948 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:18.948 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:18.949 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:18.949 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:18.949 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:18.949 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:18.949 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:18.949 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:18.949 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:18.949 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:18.949 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:18.950 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:18.950 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:18.950 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.950 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.950 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:18.950 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.950 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:18.950 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:18.950 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.950 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:18.951 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:18.951 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:18.951 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:18.951 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:18.951 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.951 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:18.951 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:18.951 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.951 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.951 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:18.952 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:18.952 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.952 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.952 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:18.952 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:18.952 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:18.952 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:18.952 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:18.952 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.952 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.952 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:18.953 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:18.953 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:18.953 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.953 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:18.953 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.953 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:18.953 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.953 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:18.953 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.953 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.fails_on_dbstore 2023-10-05T12:49:18.954 INFO:teuthology.orchestra.run.smithi012.stdout: def test_object_lock_put_legal_hold_invalid_status(): 2023-10-05T12:49:18.954 INFO:teuthology.orchestra.run.smithi012.stdout: bucket_name = get_new_bucket_name() 2023-10-05T12:49:18.954 INFO:teuthology.orchestra.run.smithi012.stdout: client = get_client() 2023-10-05T12:49:18.954 INFO:teuthology.orchestra.run.smithi012.stdout:> client.create_bucket(Bucket=bucket_name, ObjectLockEnabledForBucket=True) 2023-10-05T12:49:18.954 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.954 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:12062: 2023-10-05T12:49:18.954 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.954 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:18.954 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:18.954 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:18.955 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:18.955 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:18.955 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:18.955 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:18.955 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:18.955 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:18.955 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:18.955 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:18.955 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:18.955 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:18.956 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:18.956 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:18.956 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:18.956 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:18.956 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:18.956 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:18.956 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:18.956 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:18.956 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:18.956 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:18.957 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:18.957 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:18.957 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:18.957 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:18.957 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:18.957 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:18.957 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:18.957 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:18.957 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:18.957 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:18.957 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:18.958 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.958 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.958 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:18.958 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:18.958 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.958 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:18.958 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.958 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:18.958 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:18.958 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:18.958 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:18.959 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:18.959 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:18.959 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:18.959 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:18.959 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:18.959 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:18.959 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:18.959 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:18.959 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:18.959 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.960 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:18.960 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:18.960 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:18.960 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:18.960 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:18.960 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:18.960 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:18.960 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:18.960 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:18.960 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:18.960 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:18.961 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.961 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.961 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:18.961 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:18.961 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:18.961 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:18.961 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:18.961 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.961 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.961 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:18.962 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:18.962 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:18.962 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:18.962 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:18.962 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.962 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:18.962 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:18.962 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:18.962 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:18.962 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:18.963 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-495" 2023-10-05T12:49:18.963 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.963 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:18.963 INFO:teuthology.orchestra.run.smithi012.stdout:_______________________ test_object_lock_get_legal_hold ________________________ 2023-10-05T12:49:18.963 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.963 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:18.963 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.963 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:18.963 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:18.963 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.963 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:18.964 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:18.964 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:18.964 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:18.964 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:18.964 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.964 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:18.964 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:18.964 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.964 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.964 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:18.964 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:18.965 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.965 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.965 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:18.965 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.965 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:18.965 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:18.965 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.965 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.965 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:18.965 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:18.966 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.966 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:18.966 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:18.966 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:18.966 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:18.966 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:18.966 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:18.966 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:18.966 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.966 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:18.966 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:18.967 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:18.967 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:18.967 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:18.967 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:18.967 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:18.967 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:18.967 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:18.967 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.967 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:18.967 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:18.968 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:18.968 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:18.968 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.968 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:18.968 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:18.968 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:18.968 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:18.968 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.968 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.968 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:18.969 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:18.969 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:18.969 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:18.969 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.969 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.969 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:18.969 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:18.969 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:18.969 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.970 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:18.970 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.970 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:18.970 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:18.970 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.970 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:18.970 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:18.970 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:18.970 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:18.970 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:18.971 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:18.971 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.971 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:18.971 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.971 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:18.971 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.971 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:18.971 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:18.971 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.971 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:18.972 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.972 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:18.972 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:18.972 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:18.972 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:18.972 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:18.972 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:18.972 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:18.972 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:18.973 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:18.973 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:18.973 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:18.973 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:18.973 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:18.973 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.973 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:18.973 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:18.973 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:18.973 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:18.974 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:18.974 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:18.974 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:18.974 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:18.974 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:18.974 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:18.974 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:18.974 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.974 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.974 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:18.975 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.975 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:18.975 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:18.975 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:18.975 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:18.975 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:18.975 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:18.975 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:18.975 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:18.975 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:18.976 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:18.976 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:18.976 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:18.976 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:18.976 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:18.976 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:18.976 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:18.976 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:18.976 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:18.976 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:18.977 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:18.977 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:18.977 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:18.977 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:18.977 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:18.977 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:18.977 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:18.977 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:18.977 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:18.977 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.978 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.978 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:18.978 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.978 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:18.978 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:18.978 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.978 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:18.978 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:18.978 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:18.978 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:18.979 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:18.979 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.979 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:18.979 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:18.979 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.979 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.979 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:18.979 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:18.979 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.979 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.980 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:18.980 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:18.980 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:18.980 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:18.980 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:18.980 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.980 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.980 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:18.980 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:18.980 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:18.980 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.981 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:18.981 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.981 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:18.981 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.981 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:18.981 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.981 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.fails_on_dbstore 2023-10-05T12:49:18.981 INFO:teuthology.orchestra.run.smithi012.stdout: def test_object_lock_get_legal_hold(): 2023-10-05T12:49:18.981 INFO:teuthology.orchestra.run.smithi012.stdout: bucket_name = get_new_bucket_name() 2023-10-05T12:49:18.982 INFO:teuthology.orchestra.run.smithi012.stdout: client = get_client() 2023-10-05T12:49:18.982 INFO:teuthology.orchestra.run.smithi012.stdout:> client.create_bucket(Bucket=bucket_name, ObjectLockEnabledForBucket=True) 2023-10-05T12:49:18.982 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.982 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:12076: 2023-10-05T12:49:18.982 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.982 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:18.982 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:18.982 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:18.982 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:18.982 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:18.982 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:18.983 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:18.983 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:18.983 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:18.983 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:18.983 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:18.983 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:18.983 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:18.983 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:18.983 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:18.983 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:18.984 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:18.984 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:18.984 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:18.984 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:18.984 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:18.984 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:18.984 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:18.984 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:18.984 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:18.985 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:18.985 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:18.985 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:18.985 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:18.985 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:18.985 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:18.985 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:18.985 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:18.985 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:18.985 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.985 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.986 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:18.986 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:18.986 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.986 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:18.986 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.986 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:18.986 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:18.986 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:18.986 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:18.986 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:18.987 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:18.987 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:18.987 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:18.987 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:18.987 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:18.987 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:18.987 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:18.987 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:18.987 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.987 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:18.988 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:18.988 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:18.988 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:18.988 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:18.988 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:18.988 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:18.988 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:18.988 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:18.988 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:18.988 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:18.989 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.989 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.989 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:18.989 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:18.989 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:18.989 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:18.989 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:18.989 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.989 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.989 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:18.990 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:18.990 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:18.990 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:18.990 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:18.990 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.990 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:18.990 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:18.990 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:18.990 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:18.990 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:18.991 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-496" 2023-10-05T12:49:18.991 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.991 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:18.991 INFO:teuthology.orchestra.run.smithi012.stdout:________________ test_object_lock_get_legal_hold_invalid_bucket ________________ 2023-10-05T12:49:18.991 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.991 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:18.991 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.991 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:18.991 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:18.991 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.991 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:18.992 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:18.992 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:18.992 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:18.992 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:18.992 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.992 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:18.992 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:18.992 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.992 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.992 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:18.993 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:18.993 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.993 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.993 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:18.993 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.993 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:18.993 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:18.993 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:18.993 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.993 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:18.993 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:18.994 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.994 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:18.994 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:18.994 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:18.994 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:18.994 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:18.994 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:18.994 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:18.994 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.994 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:18.995 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:18.995 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:18.995 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:18.995 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:18.995 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:18.995 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:18.995 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:18.995 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:18.995 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.995 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:18.995 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:18.996 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:18.996 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:18.996 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.996 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:18.996 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:18.996 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:18.996 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:18.996 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.996 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.996 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:18.997 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:18.997 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:18.997 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:18.997 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:18.997 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.997 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:18.997 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:18.997 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:18.997 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:18.997 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:18.998 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.998 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:18.998 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:18.998 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.998 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:18.998 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:18.998 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:18.998 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:18.998 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:18.999 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:18.999 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.999 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:18.999 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.999 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:18.999 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.999 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:18.999 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:18.999 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:18.999 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:19.000 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.000 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:19.000 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:19.000 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:19.000 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:19.000 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:19.000 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:19.000 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:19.000 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:19.001 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:19.001 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:19.001 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:19.001 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:19.001 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:19.001 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.001 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:19.001 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:19.001 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:19.001 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:19.002 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:19.002 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:19.002 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:19.002 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:19.002 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:19.002 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:19.002 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:19.002 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.002 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.005 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:19.005 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.005 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:19.005 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:19.006 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:19.006 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:19.006 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:19.006 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:19.006 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:19.006 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:19.006 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:19.006 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:19.006 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:19.006 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:19.007 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:19.007 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:19.007 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:19.007 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:19.007 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:19.007 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:19.007 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:19.007 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:19.007 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:19.007 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:19.008 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:19.008 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:19.008 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:19.008 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:19.008 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:19.008 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:19.008 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.008 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.008 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:19.008 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.009 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:19.009 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:19.009 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.009 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:19.009 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:19.009 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:19.009 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:19.009 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:19.009 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.009 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:19.010 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:19.010 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.010 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.010 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:19.010 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:19.010 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.010 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.010 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:19.010 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:19.010 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:19.011 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:19.011 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:19.011 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.011 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.011 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:19.011 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:19.011 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:19.011 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.011 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:19.011 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.012 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:19.012 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.012 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:19.012 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.012 INFO:teuthology.orchestra.run.smithi012.stdout: def test_object_lock_get_legal_hold_invalid_bucket(): 2023-10-05T12:49:19.012 INFO:teuthology.orchestra.run.smithi012.stdout: bucket_name = get_new_bucket_name() 2023-10-05T12:49:19.012 INFO:teuthology.orchestra.run.smithi012.stdout: client = get_client() 2023-10-05T12:49:19.012 INFO:teuthology.orchestra.run.smithi012.stdout:> client.create_bucket(Bucket=bucket_name) 2023-10-05T12:49:19.012 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.012 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:12092: 2023-10-05T12:49:19.012 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.013 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:19.013 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:19.013 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:19.013 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:19.013 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:19.013 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:19.013 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:19.013 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:19.013 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:19.013 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:19.014 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:19.014 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:19.014 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:19.014 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:19.014 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:19.014 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:19.014 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:19.014 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:19.014 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:19.014 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:19.015 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:19.015 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:19.015 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:19.015 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:19.015 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:19.015 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:19.015 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:19.015 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:19.015 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:19.015 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:19.016 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:19.016 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:19.016 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:19.016 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:19.016 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.016 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.016 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:19.016 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:19.016 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.016 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:19.017 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.017 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:19.017 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:19.017 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:19.017 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:19.017 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:19.017 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:19.017 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:19.017 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:19.017 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:19.018 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:19.018 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:19.018 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:19.018 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:19.018 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.018 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:19.018 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:19.018 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:19.018 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:19.018 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:19.019 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:19.019 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:19.019 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:19.019 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:19.019 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:19.019 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:19.019 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.019 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.019 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:19.020 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:19.020 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:19.020 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:19.020 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:19.020 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.020 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.020 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:19.020 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:19.020 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:19.020 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:19.020 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:19.021 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.021 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:19.021 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:19.021 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:19.021 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:19.021 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:19.021 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-497" 2023-10-05T12:49:19.021 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.021 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:19.021 INFO:teuthology.orchestra.run.smithi012.stdout:______________ test_object_lock_delete_object_with_legal_hold_on _______________ 2023-10-05T12:49:19.022 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.022 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:19.022 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.022 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:19.022 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:19.022 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.022 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:19.022 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:19.022 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:19.022 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:19.023 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:19.023 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.023 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:19.023 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:19.023 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.023 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.023 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:19.023 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:19.023 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.023 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.023 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:19.024 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.024 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:19.024 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:19.024 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.024 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.024 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:19.024 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:19.024 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.024 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:19.024 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:19.025 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:19.025 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:19.025 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:19.025 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:19.025 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:19.025 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.025 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:19.025 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:19.025 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:19.025 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:19.025 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:19.026 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:19.026 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:19.026 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:19.026 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:19.026 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.026 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:19.026 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:19.026 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:19.026 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:19.027 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.027 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:19.027 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:19.027 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:19.027 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:19.027 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.027 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.027 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:19.027 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:19.027 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:19.027 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:19.028 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.028 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.028 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:19.028 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:19.028 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:19.028 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.028 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:19.028 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.028 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:19.028 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:19.029 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.029 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:19.029 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:19.029 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:19.029 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:19.029 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:19.029 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:19.029 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.029 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:19.030 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.030 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:19.030 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.030 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:19.030 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:19.030 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.030 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:19.030 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.030 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:19.030 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:19.031 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:19.031 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:19.031 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:19.031 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:19.031 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:19.031 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:19.031 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:19.031 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:19.031 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:19.031 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:19.032 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:19.032 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.032 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:19.032 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:19.032 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:19.032 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:19.032 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:19.032 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:19.032 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:19.032 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:19.033 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:19.033 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:19.033 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:19.033 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.033 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.033 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:19.033 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.033 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:19.033 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:19.033 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:19.034 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:19.034 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:19.034 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:19.034 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:19.034 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:19.034 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:19.034 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:19.034 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:19.034 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:19.034 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:19.035 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:19.035 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:19.035 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:19.035 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:19.035 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:19.035 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:19.035 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:19.035 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:19.035 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:19.036 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:19.036 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:19.036 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:19.036 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:19.036 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:19.036 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:19.036 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.036 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.036 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:19.036 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.036 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:19.037 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:19.037 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.037 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:19.037 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:19.037 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:19.037 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:19.037 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:19.037 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.037 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:19.038 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:19.038 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.038 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.038 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:19.038 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:19.038 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.038 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.038 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:19.038 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:19.039 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:19.039 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:19.039 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:19.039 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.039 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.039 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:19.039 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:19.039 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:19.039 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.040 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:19.040 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.040 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:19.040 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.040 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:19.040 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.040 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.fails_on_dbstore 2023-10-05T12:49:19.040 INFO:teuthology.orchestra.run.smithi012.stdout: def test_object_lock_delete_object_with_legal_hold_on(): 2023-10-05T12:49:19.040 INFO:teuthology.orchestra.run.smithi012.stdout: bucket_name = get_new_bucket_name() 2023-10-05T12:49:19.040 INFO:teuthology.orchestra.run.smithi012.stdout: client = get_client() 2023-10-05T12:49:19.041 INFO:teuthology.orchestra.run.smithi012.stdout:> client.create_bucket(Bucket=bucket_name, ObjectLockEnabledForBucket=True) 2023-10-05T12:49:19.041 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.041 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:12105: 2023-10-05T12:49:19.041 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.041 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:19.041 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:19.041 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:19.041 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:19.041 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:19.041 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:19.042 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:19.042 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:19.042 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:19.042 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:19.042 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:19.042 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:19.042 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:19.042 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:19.042 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:19.042 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:19.043 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:19.043 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:19.043 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:19.043 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:19.043 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:19.043 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:19.043 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:19.043 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:19.043 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:19.043 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:19.044 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:19.044 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:19.044 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:19.044 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:19.044 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:19.044 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:19.044 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:19.044 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:19.044 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.044 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.045 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:19.045 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:19.045 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.045 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:19.045 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.045 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:19.045 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:19.045 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:19.045 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:19.046 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:19.046 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:19.046 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:19.046 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:19.046 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:19.046 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:19.046 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:19.046 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:19.046 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:19.046 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.047 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:19.047 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:19.047 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:19.047 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:19.047 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:19.047 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:19.047 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:19.047 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:19.047 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:19.047 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:19.047 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:19.048 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.048 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.048 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:19.048 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:19.048 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:19.048 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:19.048 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:19.048 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.048 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.048 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:19.049 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:19.049 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:19.049 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:19.049 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:19.049 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.049 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:19.049 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:19.049 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:19.049 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:19.049 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:19.050 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-498" 2023-10-05T12:49:19.050 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.050 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:19.050 INFO:teuthology.orchestra.run.smithi012.stdout:______________ test_object_lock_delete_object_with_legal_hold_off ______________ 2023-10-05T12:49:19.050 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.050 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:19.050 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.050 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:19.050 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:19.050 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.051 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:19.051 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:19.051 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:19.051 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:19.051 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:19.051 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.051 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:19.051 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:19.051 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.051 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.052 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:19.052 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:19.052 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.052 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.052 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:19.052 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.052 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:19.052 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:19.052 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.052 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.053 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:19.053 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:19.053 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.053 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:19.053 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:19.053 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:19.053 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:19.053 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:19.053 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:19.053 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:19.054 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.054 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:19.054 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:19.054 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:19.054 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:19.054 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:19.054 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:19.054 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:19.054 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:19.055 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:19.055 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.055 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:19.055 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:19.055 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:19.055 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:19.055 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.055 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:19.055 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:19.055 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:19.056 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:19.056 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.056 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.056 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:19.056 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:19.056 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:19.056 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:19.056 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.056 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.056 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:19.057 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:19.057 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:19.057 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.057 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:19.057 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.057 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:19.057 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:19.057 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.057 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:19.057 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:19.058 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:19.058 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:19.058 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:19.058 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:19.058 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.058 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:19.058 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.058 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:19.058 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.058 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:19.059 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:19.059 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.059 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:19.059 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.059 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:19.059 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:19.059 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:19.059 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:19.059 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:19.059 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:19.060 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:19.060 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:19.060 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:19.060 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:19.060 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:19.060 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:19.060 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:19.060 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.060 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:19.060 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:19.060 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:19.061 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:19.061 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:19.061 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:19.061 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:19.061 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:19.061 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:19.061 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:19.061 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:19.061 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.061 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.062 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:19.062 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.062 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:19.062 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:19.062 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:19.062 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:19.062 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:19.062 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:19.062 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:19.063 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:19.063 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:19.063 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:19.063 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:19.063 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:19.063 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:19.063 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:19.063 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:19.063 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:19.063 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:19.064 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:19.064 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:19.064 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:19.064 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:19.064 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:19.064 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:19.064 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:19.064 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:19.064 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:19.064 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:19.064 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:19.064 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.065 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.065 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:19.065 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.065 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:19.065 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:19.065 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.065 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:19.065 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:19.065 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:19.065 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:19.066 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:19.066 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.066 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:19.066 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:19.066 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.066 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.066 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:19.066 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:19.066 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.066 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.067 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:19.067 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:19.067 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:19.067 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:19.067 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:19.067 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.067 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.067 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:19.067 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:19.067 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:19.067 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.068 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:19.068 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.068 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:19.068 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.068 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:19.068 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.068 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.fails_on_dbstore 2023-10-05T12:49:19.068 INFO:teuthology.orchestra.run.smithi012.stdout: def test_object_lock_delete_object_with_legal_hold_off(): 2023-10-05T12:49:19.068 INFO:teuthology.orchestra.run.smithi012.stdout: bucket_name = get_new_bucket_name() 2023-10-05T12:49:19.068 INFO:teuthology.orchestra.run.smithi012.stdout: client = get_client() 2023-10-05T12:49:19.069 INFO:teuthology.orchestra.run.smithi012.stdout:> client.create_bucket(Bucket=bucket_name, ObjectLockEnabledForBucket=True) 2023-10-05T12:49:19.069 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.069 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:12120: 2023-10-05T12:49:19.069 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.069 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:19.069 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:19.069 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:19.069 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:19.069 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:19.070 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:19.070 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:19.070 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:19.070 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:19.070 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:19.070 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:19.070 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:19.070 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:19.070 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:19.070 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:19.071 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:19.071 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:19.071 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:19.071 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:19.071 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:19.071 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:19.071 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:19.071 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:19.071 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:19.071 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:19.072 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:19.072 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:19.072 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:19.072 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:19.072 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:19.072 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:19.072 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:19.072 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:19.072 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:19.072 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.073 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.073 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:19.073 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:19.073 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.073 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:19.073 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.073 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:19.073 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:19.073 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:19.073 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:19.074 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:19.074 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:19.074 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:19.074 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:19.074 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:19.074 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:19.074 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:19.074 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:19.074 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:19.075 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.075 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:19.075 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:19.075 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:19.075 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:19.075 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:19.075 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:19.075 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:19.075 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:19.075 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:19.076 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:19.076 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:19.076 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.076 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.076 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:19.076 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:19.076 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:19.076 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:19.076 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:19.076 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.076 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.077 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:19.077 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:19.077 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:19.077 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:19.077 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:19.077 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.077 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:19.077 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:19.077 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:19.078 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:19.078 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:19.078 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-499" 2023-10-05T12:49:19.078 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.078 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:19.078 INFO:teuthology.orchestra.run.smithi012.stdout:______________________ test_object_lock_get_obj_metadata _______________________ 2023-10-05T12:49:19.078 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.078 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:19.078 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.078 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:19.079 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:19.079 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.079 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:19.079 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:19.079 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:19.079 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:19.079 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:19.079 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.079 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:19.079 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:19.080 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.080 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.080 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:19.080 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:19.080 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.080 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.080 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:19.080 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.080 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:19.080 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:19.081 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.081 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.081 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:19.081 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:19.081 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.081 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:19.081 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:19.081 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:19.081 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:19.081 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:19.082 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:19.082 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:19.082 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.082 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:19.082 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:19.082 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:19.082 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:19.082 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:19.082 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:19.083 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:19.083 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:19.083 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:19.083 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.083 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:19.083 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:19.083 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:19.083 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:19.083 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.083 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:19.084 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:19.084 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:19.084 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:19.084 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.084 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.084 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:19.084 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:19.084 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:19.084 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:19.084 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.084 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.085 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:19.085 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:19.085 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:19.085 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.085 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:19.085 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.085 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:19.085 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:19.085 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.085 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:19.085 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:19.086 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:19.086 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:19.086 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:19.086 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:19.086 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.086 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:19.086 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.086 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:19.086 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.086 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:19.087 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:19.087 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.087 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:19.087 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.087 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:19.087 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:19.087 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:19.087 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:19.087 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:19.087 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:19.088 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:19.088 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:19.088 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:19.088 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:19.088 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:19.088 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:19.088 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:19.088 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.088 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:19.088 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:19.089 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:19.089 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:19.089 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:19.089 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:19.089 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:19.089 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:19.089 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:19.089 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:19.089 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:19.089 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.090 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.090 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:19.090 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.090 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:19.090 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:19.090 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:19.090 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:19.090 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:19.090 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:19.091 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:19.091 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:19.091 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:19.091 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:19.091 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:19.091 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:19.091 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:19.091 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:19.091 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:19.091 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:19.092 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:19.092 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:19.092 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:19.092 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:19.092 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:19.092 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:19.092 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:19.092 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:19.092 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:19.092 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:19.092 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:19.093 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:19.093 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.093 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.093 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:19.093 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.093 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:19.093 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:19.093 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.093 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:19.093 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:19.094 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:19.094 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:19.094 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:19.094 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.094 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:19.094 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:19.094 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.094 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.094 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:19.094 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:19.094 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.095 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.095 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:19.095 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:19.095 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:19.095 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:19.095 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:19.095 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.095 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.095 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:19.096 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:19.096 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:19.096 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.096 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:19.096 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.096 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:19.096 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.096 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:19.096 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.096 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.fails_on_dbstore 2023-10-05T12:49:19.096 INFO:teuthology.orchestra.run.smithi012.stdout: def test_object_lock_get_obj_metadata(): 2023-10-05T12:49:19.097 INFO:teuthology.orchestra.run.smithi012.stdout: bucket_name = get_new_bucket_name() 2023-10-05T12:49:19.097 INFO:teuthology.orchestra.run.smithi012.stdout: client = get_client() 2023-10-05T12:49:19.097 INFO:teuthology.orchestra.run.smithi012.stdout:> client.create_bucket(Bucket=bucket_name, ObjectLockEnabledForBucket=True) 2023-10-05T12:49:19.097 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.097 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:12132: 2023-10-05T12:49:19.097 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.097 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:19.097 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:19.097 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:19.097 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:19.098 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:19.098 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:19.098 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:19.098 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:19.098 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:19.098 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:19.098 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:19.098 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:19.098 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:19.099 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:19.099 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:19.099 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:19.099 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:19.099 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:19.099 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:19.099 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:19.099 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:19.099 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:19.099 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:19.100 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:19.100 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:19.100 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:19.100 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:19.100 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:19.100 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:19.100 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:19.100 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:19.100 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:19.100 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:19.100 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:19.101 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.101 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.101 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:19.101 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:19.101 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.101 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:19.101 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.101 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:19.101 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:19.101 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:19.102 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:19.102 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:19.102 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:19.102 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:19.102 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:19.102 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:19.102 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:19.102 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:19.102 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:19.102 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:19.103 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.103 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:19.103 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:19.103 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:19.103 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:19.103 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:19.103 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:19.103 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:19.103 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:19.103 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:19.103 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:19.104 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:19.104 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.104 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.104 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:19.104 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:19.104 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:19.104 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:19.104 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:19.104 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.104 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.104 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:19.105 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:19.105 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:19.105 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:19.105 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:19.105 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.105 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:19.105 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:19.105 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:19.105 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:19.105 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:19.106 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-500" 2023-10-05T12:49:19.106 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.106 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:19.106 INFO:teuthology.orchestra.run.smithi012.stdout:________________________ test_object_lock_uploading_obj ________________________ 2023-10-05T12:49:19.106 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.106 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:19.106 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.106 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:19.106 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:19.106 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.107 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:19.107 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:19.107 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:19.107 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:19.107 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:19.107 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.107 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:19.107 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:19.107 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.108 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.108 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:19.108 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:19.108 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.108 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.108 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:19.108 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.108 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:19.108 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:19.108 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.109 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.109 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:19.109 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:19.109 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.109 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:19.109 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:19.109 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:19.109 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:19.109 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:19.109 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:19.110 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:19.110 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.110 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:19.110 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:19.110 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:19.110 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:19.110 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:19.110 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:19.110 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:19.111 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:19.111 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:19.111 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.111 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:19.111 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:19.111 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:19.111 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:19.111 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.111 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:19.111 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:19.112 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:19.112 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:19.112 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.112 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.112 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:19.112 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:19.112 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:19.112 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:19.112 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.112 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.113 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:19.113 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:19.113 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:19.113 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.113 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:19.113 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.113 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:19.113 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:19.113 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.113 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:19.114 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:19.114 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:19.114 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:19.114 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:19.114 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:19.114 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.114 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:19.114 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.114 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:19.114 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.115 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:19.115 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:19.115 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.115 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:19.115 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.115 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:19.115 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:19.115 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:19.115 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:19.116 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:19.116 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:19.116 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:19.116 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:19.116 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:19.116 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:19.116 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:19.116 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:19.116 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:19.116 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.116 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:19.117 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:19.117 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:19.117 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:19.117 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:19.117 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:19.117 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:19.117 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:19.117 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:19.117 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:19.117 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:19.117 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.118 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.118 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:19.118 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.118 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:19.118 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:19.118 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:19.118 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:19.118 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:19.118 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:19.119 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:19.119 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:19.119 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:19.119 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:19.119 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:19.119 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:19.119 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:19.119 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:19.119 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:19.119 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:19.120 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:19.120 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:19.120 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:19.120 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:19.120 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:19.120 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:19.120 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:19.120 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:19.120 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:19.120 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:19.120 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:19.121 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:19.121 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.121 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.121 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:19.121 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.121 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:19.121 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:19.121 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.121 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:19.121 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:19.121 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:19.122 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:19.122 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:19.122 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.122 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:19.122 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:19.122 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.122 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.122 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:19.122 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:19.122 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.123 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.123 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:19.123 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:19.123 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:19.123 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:19.123 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:19.123 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.123 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.123 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:19.123 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:19.123 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:19.124 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.124 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:19.124 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.124 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:19.124 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.124 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:19.124 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.124 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.fails_on_dbstore 2023-10-05T12:49:19.124 INFO:teuthology.orchestra.run.smithi012.stdout: def test_object_lock_uploading_obj(): 2023-10-05T12:49:19.124 INFO:teuthology.orchestra.run.smithi012.stdout: bucket_name = get_new_bucket_name() 2023-10-05T12:49:19.125 INFO:teuthology.orchestra.run.smithi012.stdout: client = get_client() 2023-10-05T12:49:19.125 INFO:teuthology.orchestra.run.smithi012.stdout:> client.create_bucket(Bucket=bucket_name, ObjectLockEnabledForBucket=True) 2023-10-05T12:49:19.125 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.125 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:12152: 2023-10-05T12:49:19.125 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.125 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:19.125 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:19.125 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:19.125 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:19.125 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:19.126 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:19.126 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:19.126 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:19.126 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:19.126 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:19.126 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:19.126 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:19.126 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:19.126 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:19.126 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:19.127 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:19.127 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:19.127 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:19.127 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:19.127 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:19.127 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:19.127 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:19.127 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:19.127 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:19.127 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:19.127 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:19.128 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:19.128 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:19.128 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:19.128 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:19.128 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:19.128 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:19.128 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:19.128 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:19.128 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.128 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.129 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:19.129 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:19.129 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.129 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:19.129 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.129 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:19.129 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:19.129 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:19.129 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:19.129 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:19.130 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:19.130 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:19.130 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:19.130 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:19.130 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:19.130 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:19.130 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:19.130 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:19.130 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.130 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:19.131 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:19.131 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:19.131 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:19.131 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:19.131 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:19.131 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:19.131 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:19.131 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:19.131 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:19.131 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:19.132 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.132 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.132 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:19.132 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:19.132 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:19.132 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:19.132 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:19.132 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.132 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.132 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:19.133 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:19.133 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:19.133 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:19.133 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:19.133 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.133 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:19.133 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:19.133 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:19.133 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:19.133 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:19.134 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-501" 2023-10-05T12:49:19.134 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.134 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:19.134 INFO:teuthology.orchestra.run.smithi012.stdout:__________ test_object_lock_changing_mode_from_governance_with_bypass __________ 2023-10-05T12:49:19.134 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.134 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:19.134 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.134 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:19.134 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:19.134 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.135 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:19.135 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:19.135 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:19.135 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:19.135 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:19.135 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.135 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:19.135 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:19.135 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.135 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.136 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:19.136 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:19.136 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.136 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.136 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:19.136 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.136 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:19.136 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:19.136 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.136 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.137 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:19.137 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:19.137 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.137 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:19.137 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:19.137 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:19.137 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:19.137 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:19.137 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:19.138 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:19.138 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.138 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:19.138 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:19.138 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:19.138 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:19.138 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:19.138 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:19.138 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:19.138 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:19.139 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:19.139 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.139 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:19.139 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:19.139 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:19.139 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:19.139 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.139 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:19.139 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:19.139 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:19.139 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:19.140 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.140 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.140 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:19.140 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:19.140 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:19.140 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:19.140 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.140 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.140 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:19.140 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:19.140 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:19.141 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.141 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:19.141 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.141 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:19.141 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:19.141 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.141 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:19.141 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:19.141 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:19.141 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:19.141 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:19.142 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:19.142 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.142 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:19.142 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.142 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:19.142 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.142 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:19.142 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:19.142 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.142 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:19.143 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.143 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:19.143 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:19.143 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:19.143 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:19.143 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:19.143 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:19.143 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:19.143 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:19.143 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:19.143 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:19.144 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:19.144 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:19.144 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:19.144 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.144 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:19.144 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:19.144 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:19.144 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:19.144 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:19.144 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:19.144 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:19.145 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:19.145 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:19.145 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:19.145 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:19.145 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.145 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.145 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:19.145 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.145 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:19.145 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:19.145 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:19.146 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:19.146 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:19.146 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:19.146 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:19.146 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:19.146 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:19.146 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:19.146 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:19.146 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:19.146 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:19.147 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:19.147 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:19.147 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:19.147 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:19.147 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:19.147 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:19.147 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:19.147 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:19.147 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:19.147 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:19.147 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:19.148 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:19.148 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:19.148 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:19.148 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:19.148 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.148 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.148 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:19.148 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.148 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:19.148 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:19.149 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.149 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:19.149 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:19.149 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:19.149 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:19.149 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:19.149 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.149 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:19.149 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:19.149 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.150 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.150 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:19.150 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:19.150 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.150 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.150 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:19.150 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:19.150 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:19.150 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:19.150 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:19.151 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.151 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.151 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:19.151 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:19.151 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:19.151 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.151 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:19.151 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.151 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:19.151 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.151 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:19.152 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.152 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.fails_on_dbstore 2023-10-05T12:49:19.152 INFO:teuthology.orchestra.run.smithi012.stdout: def test_object_lock_changing_mode_from_governance_with_bypass(): 2023-10-05T12:49:19.152 INFO:teuthology.orchestra.run.smithi012.stdout: bucket_name = get_new_bucket_name() 2023-10-05T12:49:19.152 INFO:teuthology.orchestra.run.smithi012.stdout: key = 'file1' 2023-10-05T12:49:19.152 INFO:teuthology.orchestra.run.smithi012.stdout: client = get_client() 2023-10-05T12:49:19.152 INFO:teuthology.orchestra.run.smithi012.stdout:> client.create_bucket(Bucket=bucket_name, ObjectLockEnabledForBucket=True) 2023-10-05T12:49:19.152 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.152 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:12169: 2023-10-05T12:49:19.152 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.152 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:19.153 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:19.153 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:19.153 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:19.153 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:19.153 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:19.153 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:19.153 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:19.153 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:19.153 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:19.154 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:19.154 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:19.154 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:19.154 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:19.154 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:19.154 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:19.154 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:19.154 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:19.154 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:19.154 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:19.155 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:19.155 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:19.155 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:19.155 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:19.155 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:19.155 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:19.155 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:19.155 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:19.155 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:19.155 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:19.156 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:19.156 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:19.156 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:19.156 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:19.156 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.156 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.156 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:19.156 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:19.156 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.156 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:19.157 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.157 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:19.157 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:19.157 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:19.157 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:19.157 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:19.157 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:19.157 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:19.157 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:19.157 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:19.158 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:19.158 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:19.158 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:19.158 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:19.158 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.158 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:19.158 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:19.158 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:19.158 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:19.158 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:19.159 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:19.159 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:19.159 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:19.159 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:19.159 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:19.159 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:19.159 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.159 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.159 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:19.159 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:19.160 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:19.160 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:19.160 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:19.160 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.160 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.160 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:19.160 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:19.160 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:19.160 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:19.160 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:19.161 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.161 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:19.161 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:19.161 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:19.161 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:19.161 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:19.161 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-502" 2023-10-05T12:49:19.161 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.161 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:19.161 INFO:teuthology.orchestra.run.smithi012.stdout:________ test_object_lock_changing_mode_from_governance_without_bypass _________ 2023-10-05T12:49:19.162 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.162 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:19.162 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.162 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:19.162 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:19.162 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.162 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:19.162 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:19.162 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:19.162 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:19.163 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:19.163 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.163 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:19.163 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:19.163 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.163 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.163 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:19.163 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:19.163 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.163 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.164 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:19.164 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.164 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:19.164 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:19.164 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.164 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.164 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:19.164 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:19.164 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.164 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:19.164 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:19.165 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:19.165 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:19.165 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:19.165 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:19.165 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:19.165 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.165 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:19.165 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:19.165 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:19.165 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:19.166 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:19.166 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:19.166 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:19.166 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:19.166 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:19.166 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.166 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:19.166 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:19.166 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:19.166 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:19.167 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.167 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:19.167 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:19.167 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:19.167 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:19.167 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.167 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.167 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:19.167 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:19.167 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:19.168 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:19.168 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.168 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.168 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:19.168 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:19.168 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:19.168 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.168 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:19.168 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.168 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:19.169 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:19.169 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.169 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:19.169 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:19.169 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:19.169 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:19.169 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:19.169 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:19.169 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.169 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:19.170 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.170 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:19.170 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.170 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:19.170 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:19.170 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.170 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:19.170 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.170 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:19.170 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:19.171 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:19.171 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:19.171 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:19.171 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:19.171 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:19.171 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:19.171 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:19.171 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:19.171 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:19.171 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:19.172 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:19.172 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.172 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:19.172 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:19.172 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:19.172 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:19.172 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:19.172 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:19.172 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:19.172 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:19.173 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:19.173 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:19.173 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:19.173 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.173 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.173 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:19.173 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.173 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:19.173 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:19.173 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:19.174 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:19.174 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:19.174 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:19.174 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:19.174 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:19.174 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:19.174 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:19.174 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:19.174 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:19.174 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:19.175 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:19.175 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:19.175 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:19.175 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:19.175 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:19.175 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:19.175 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:19.175 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:19.175 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:19.175 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:19.176 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:19.176 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:19.176 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:19.176 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:19.176 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:19.176 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.176 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.176 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:19.176 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.176 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:19.177 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:19.177 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.177 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:19.177 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:19.177 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:19.177 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:19.177 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:19.177 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.177 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:19.177 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:19.178 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.178 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.178 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:19.178 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:19.178 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.178 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.178 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:19.178 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:19.178 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:19.178 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:19.179 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:19.179 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.179 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.179 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:19.179 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:19.179 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:19.179 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.179 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:19.179 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.180 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:19.180 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.180 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:19.180 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.180 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.fails_on_dbstore 2023-10-05T12:49:19.180 INFO:teuthology.orchestra.run.smithi012.stdout: def test_object_lock_changing_mode_from_governance_without_bypass(): 2023-10-05T12:49:19.180 INFO:teuthology.orchestra.run.smithi012.stdout: bucket_name = get_new_bucket_name() 2023-10-05T12:49:19.180 INFO:teuthology.orchestra.run.smithi012.stdout: key = 'file1' 2023-10-05T12:49:19.180 INFO:teuthology.orchestra.run.smithi012.stdout: client = get_client() 2023-10-05T12:49:19.180 INFO:teuthology.orchestra.run.smithi012.stdout:> client.create_bucket(Bucket=bucket_name, ObjectLockEnabledForBucket=True) 2023-10-05T12:49:19.180 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.181 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:12183: 2023-10-05T12:49:19.181 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.181 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:19.181 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:19.181 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:19.181 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:19.181 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:19.181 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:19.181 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:19.181 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:19.181 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:19.181 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:19.182 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:19.182 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:19.182 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:19.182 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:19.182 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:19.182 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:19.182 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:19.182 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:19.182 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:19.182 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:19.183 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:19.183 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:19.183 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:19.183 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:19.183 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:19.183 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:19.183 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:19.183 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:19.183 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:19.183 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:19.183 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:19.184 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:19.184 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:19.184 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:19.184 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.184 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.184 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:19.184 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:19.184 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.184 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:19.184 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.185 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:19.185 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:19.185 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:19.185 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:19.185 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:19.185 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:19.185 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:19.185 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:19.185 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:19.185 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:19.185 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:19.185 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:19.186 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:19.186 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.186 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:19.186 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:19.186 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:19.186 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:19.186 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:19.186 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:19.186 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:19.187 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:19.187 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:19.187 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:19.187 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:19.187 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.187 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.187 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:19.187 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:19.187 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:19.187 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:19.188 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:19.188 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.188 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.188 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:19.188 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:19.188 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:19.188 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:19.188 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:19.188 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.188 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:19.189 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:19.189 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:19.189 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:19.189 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:19.189 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-503" 2023-10-05T12:49:19.189 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.189 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:19.189 INFO:teuthology.orchestra.run.smithi012.stdout:________________ test_object_lock_changing_mode_from_compliance ________________ 2023-10-05T12:49:19.189 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.190 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:19.190 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.190 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:19.190 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:19.190 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.190 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:19.190 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:19.190 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:19.190 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:19.191 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:19.191 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.191 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:19.191 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:19.191 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.191 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.191 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:19.191 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:19.191 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.191 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.191 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:19.192 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.192 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:19.192 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:19.192 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.192 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.192 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:19.192 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:19.192 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.192 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:19.192 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:19.192 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:19.192 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:19.193 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:19.193 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:19.193 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:19.193 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.193 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:19.193 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:19.193 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:19.193 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:19.193 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:19.193 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:19.194 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:19.194 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:19.194 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:19.194 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.194 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:19.194 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:19.194 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:19.194 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:19.194 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.195 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:19.195 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:19.195 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:19.195 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:19.195 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.195 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.195 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:19.195 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:19.195 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:19.196 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:19.196 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.196 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.196 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:19.196 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:19.196 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:19.196 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.196 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:19.196 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.196 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:19.196 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:19.197 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.197 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:19.197 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:19.197 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:19.197 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:19.197 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:19.197 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:19.197 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.197 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:19.198 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.198 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:19.198 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.198 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:19.198 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:19.198 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.198 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:19.198 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.198 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:19.198 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:19.199 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:19.199 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:19.199 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:19.199 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:19.199 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:19.199 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:19.199 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:19.199 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:19.199 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:19.199 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:19.200 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:19.200 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.200 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:19.200 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:19.200 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:19.200 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:19.200 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:19.200 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:19.200 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:19.200 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:19.200 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:19.201 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:19.201 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:19.201 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.201 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.201 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:19.201 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.201 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:19.201 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:19.201 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:19.201 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:19.201 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:19.202 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:19.202 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:19.202 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:19.202 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:19.202 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:19.202 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:19.202 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:19.202 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:19.202 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:19.202 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:19.203 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:19.203 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:19.203 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:19.203 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:19.203 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:19.203 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:19.203 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:19.203 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:19.203 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:19.203 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:19.203 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:19.204 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:19.204 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:19.204 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.204 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.204 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:19.204 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.204 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:19.204 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:19.204 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.204 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:19.205 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:19.205 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:19.205 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:19.205 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:19.205 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.205 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:19.205 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:19.205 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.205 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.205 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:19.206 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:19.206 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.206 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.206 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:19.206 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:19.206 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:19.206 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:19.206 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:19.206 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.206 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.207 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:19.207 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:19.209 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:19.209 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.209 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:19.209 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.209 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:19.209 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.209 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:19.209 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.210 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.fails_on_dbstore 2023-10-05T12:49:19.210 INFO:teuthology.orchestra.run.smithi012.stdout: def test_object_lock_changing_mode_from_compliance(): 2023-10-05T12:49:19.210 INFO:teuthology.orchestra.run.smithi012.stdout: bucket_name = get_new_bucket_name() 2023-10-05T12:49:19.210 INFO:teuthology.orchestra.run.smithi012.stdout: key = 'file1' 2023-10-05T12:49:19.210 INFO:teuthology.orchestra.run.smithi012.stdout: client = get_client() 2023-10-05T12:49:19.210 INFO:teuthology.orchestra.run.smithi012.stdout:> client.create_bucket(Bucket=bucket_name, ObjectLockEnabledForBucket=True) 2023-10-05T12:49:19.210 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.210 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:12200: 2023-10-05T12:49:19.210 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.210 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:19.211 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:19.211 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:19.211 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:19.211 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:19.211 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:19.211 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:19.211 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:19.211 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:19.211 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:19.212 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:19.212 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:19.212 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:19.212 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:19.212 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:19.212 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:19.212 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:19.212 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:19.212 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:19.212 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:19.213 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:19.213 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:19.213 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:19.213 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:19.213 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:19.213 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:19.213 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:19.213 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:19.213 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:19.213 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:19.213 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:19.214 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:19.214 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:19.214 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:19.214 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.214 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.214 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:19.214 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:19.214 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.214 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:19.214 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.215 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:19.215 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:19.215 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:19.215 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:19.215 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:19.215 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:19.215 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:19.215 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:19.215 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:19.215 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:19.216 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:19.216 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:19.216 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:19.216 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.216 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:19.216 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:19.216 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:19.216 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:19.216 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:19.216 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:19.216 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:19.217 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:19.217 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:19.217 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:19.217 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:19.217 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.217 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.217 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:19.217 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:19.217 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:19.217 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:19.217 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:19.218 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.218 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.218 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:19.218 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:19.218 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:19.218 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:19.218 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:19.218 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.218 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:19.218 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:19.219 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:19.219 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:19.219 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:19.219 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-504" 2023-10-05T12:49:19.219 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.219 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:19.219 INFO:teuthology.orchestra.run.smithi012.stdout:________________________ test_copy_object_ifmatch_good _________________________ 2023-10-05T12:49:19.219 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.219 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:19.219 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.220 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:19.220 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:19.220 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.220 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:19.220 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:19.220 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:19.220 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:19.220 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:19.220 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.220 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:19.220 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:19.221 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.221 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.221 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:19.221 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:19.221 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.221 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.221 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:19.221 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.221 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:19.221 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:19.221 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.222 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.222 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:19.222 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:19.222 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.222 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:19.222 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:19.222 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:19.222 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:19.222 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:19.222 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:19.222 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:19.223 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.223 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:19.223 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:19.223 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:19.223 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:19.223 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:19.223 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:19.223 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:19.223 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:19.223 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:19.224 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.224 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:19.224 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:19.224 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:19.224 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:19.224 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.224 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:19.224 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:19.224 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:19.224 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:19.224 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.225 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.225 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:19.225 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:19.225 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:19.225 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:19.225 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.225 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.225 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:19.225 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:19.225 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:19.225 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.226 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:19.226 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.226 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:19.226 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:19.226 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.226 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:19.226 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:19.226 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:19.226 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:19.226 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:19.227 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:19.227 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.227 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:19.227 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.227 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:19.227 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.227 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:19.227 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:19.227 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.227 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:19.227 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.228 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:19.228 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:19.228 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:19.228 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:19.228 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:19.228 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:19.228 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:19.228 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:19.228 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:19.228 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:19.229 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:19.229 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:19.229 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:19.229 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.229 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:19.229 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:19.229 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:19.229 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:19.229 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:19.229 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:19.230 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:19.230 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:19.230 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:19.230 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:19.230 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:19.230 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.230 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.230 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:19.230 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.230 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:19.231 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:19.231 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:19.231 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:19.231 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:19.231 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:19.231 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:19.231 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:19.231 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:19.231 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:19.231 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:19.232 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:19.232 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:19.232 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:19.232 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:19.232 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:19.232 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:19.232 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:19.232 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:19.232 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:19.232 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:19.233 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:19.233 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:19.233 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:19.233 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:19.233 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:19.233 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:19.233 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:19.233 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.233 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.233 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:19.233 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.234 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:19.234 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:19.234 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.234 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:19.234 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:19.234 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:19.234 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:19.234 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:19.234 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.234 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:19.235 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:19.235 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.235 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.235 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:19.235 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:19.235 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.235 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.235 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:19.235 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:19.235 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:19.235 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:19.236 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:19.236 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.236 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.236 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:19.236 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:19.236 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:19.236 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.236 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:19.236 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.236 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:19.237 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.237 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:19.237 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.237 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.fails_on_dbstore 2023-10-05T12:49:19.237 INFO:teuthology.orchestra.run.smithi012.stdout: def test_copy_object_ifmatch_good(): 2023-10-05T12:49:19.237 INFO:teuthology.orchestra.run.smithi012.stdout:> bucket_name = get_new_bucket() 2023-10-05T12:49:19.237 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.237 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:12214: 2023-10-05T12:49:19.237 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.237 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-10-05T12:49:19.238 INFO:teuthology.orchestra.run.smithi012.stdout: client.create_bucket(Bucket=name) 2023-10-05T12:49:19.238 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:19.238 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:19.238 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:19.238 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:19.238 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:19.238 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:19.238 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:19.238 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:19.239 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:19.239 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:19.239 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:19.239 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:19.239 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:19.239 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:19.239 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:19.239 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:19.239 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:19.239 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:19.240 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:19.240 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:19.240 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:19.240 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:19.240 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:19.240 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:19.240 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:19.240 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:19.240 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:19.240 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:19.240 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:19.240 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:19.241 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:19.241 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:19.241 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:19.241 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:19.241 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.241 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.241 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:19.241 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:19.241 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.241 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:19.241 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.242 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:19.242 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:19.242 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:19.242 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:19.242 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:19.242 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:19.242 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:19.242 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:19.242 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:19.242 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:19.243 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:19.243 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:19.243 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:19.243 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.243 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:19.243 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:19.243 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:19.243 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:19.243 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:19.243 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:19.243 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:19.244 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:19.244 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:19.244 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:19.244 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:19.244 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.244 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.244 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:19.244 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:19.244 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:19.244 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:19.244 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:19.245 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.245 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.245 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:19.245 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:19.245 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:19.245 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:19.245 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:19.245 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.245 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:19.245 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:19.245 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:19.246 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:19.246 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:19.246 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-505" 2023-10-05T12:49:19.246 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.246 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:19.246 INFO:teuthology.orchestra.run.smithi012.stdout:_____________________ test_copy_object_ifnonematch_failed ______________________ 2023-10-05T12:49:19.246 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.246 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:19.246 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.246 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:19.247 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:19.247 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.247 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:19.247 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:19.247 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:19.247 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:19.247 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:19.247 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.247 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:19.247 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:19.248 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.248 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.248 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:19.248 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:19.248 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.248 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.248 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:19.248 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.248 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:19.248 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:19.249 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.249 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.249 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:19.249 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:19.249 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.249 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:19.249 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:19.249 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:19.249 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:19.249 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:19.250 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:19.250 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:19.250 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.250 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:19.250 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:19.250 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:19.250 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:19.250 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:19.250 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:19.251 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:19.251 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:19.251 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:19.251 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.251 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:19.251 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:19.251 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:19.251 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:19.251 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.251 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:19.252 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:19.252 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:19.252 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:19.252 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.252 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.252 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:19.252 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:19.252 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:19.252 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:19.252 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.253 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.253 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:19.253 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:19.253 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:19.253 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.253 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:19.253 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.253 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:19.253 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:19.253 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.254 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:19.254 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:19.254 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:19.254 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:19.254 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:19.254 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:19.254 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.254 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:19.254 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.254 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:19.255 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.255 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:19.255 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:19.255 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.255 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:19.255 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.255 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:19.255 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:19.255 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:19.255 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:19.256 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:19.256 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:19.256 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:19.256 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:19.256 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:19.256 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:19.256 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:19.256 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:19.256 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:19.256 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.257 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:19.257 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:19.257 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:19.257 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:19.257 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:19.257 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:19.257 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:19.257 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:19.257 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:19.257 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:19.258 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:19.258 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.258 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.258 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:19.258 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.258 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:19.258 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:19.258 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:19.258 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:19.259 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:19.259 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:19.259 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:19.259 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:19.259 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:19.259 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:19.259 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:19.259 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:19.259 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:19.259 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:19.260 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:19.260 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:19.260 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:19.260 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:19.260 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:19.260 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:19.260 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:19.260 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:19.260 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:19.260 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:19.261 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:19.261 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:19.261 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:19.261 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:19.261 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.261 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.261 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:19.261 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.261 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:19.261 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:19.262 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.262 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:19.262 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:19.262 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:19.262 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:19.262 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:19.262 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.262 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:19.262 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:19.262 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.263 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.263 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:19.263 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:19.263 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.263 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.263 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:19.263 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:19.263 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:19.263 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:19.264 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:19.264 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.264 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.264 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:19.264 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:19.264 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:19.264 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.264 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:19.264 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.264 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:19.265 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.265 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:19.265 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.265 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.fails_on_dbstore 2023-10-05T12:49:19.265 INFO:teuthology.orchestra.run.smithi012.stdout: def test_copy_object_ifnonematch_failed(): 2023-10-05T12:49:19.265 INFO:teuthology.orchestra.run.smithi012.stdout:> bucket_name = get_new_bucket() 2023-10-05T12:49:19.265 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.265 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:12249: 2023-10-05T12:49:19.265 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.265 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-10-05T12:49:19.266 INFO:teuthology.orchestra.run.smithi012.stdout: client.create_bucket(Bucket=name) 2023-10-05T12:49:19.266 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:19.266 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:19.266 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:19.266 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:19.266 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:19.266 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:19.266 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:19.266 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:19.267 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:19.267 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:19.267 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:19.267 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:19.267 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:19.267 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:19.267 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:19.267 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:19.267 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:19.267 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:19.268 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:19.268 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:19.268 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:19.268 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:19.268 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:19.268 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:19.268 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:19.268 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:19.268 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:19.268 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:19.269 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:19.269 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:19.269 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:19.269 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:19.269 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:19.269 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:19.269 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.269 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.269 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:19.269 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:19.270 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.270 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:19.270 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.270 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:19.270 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:19.270 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:19.270 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:19.270 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:19.270 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:19.271 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:19.271 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:19.271 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:19.271 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:19.271 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:19.271 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:19.271 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:19.271 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.271 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:19.271 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:19.271 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:19.272 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:19.272 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:19.272 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:19.272 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:19.272 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:19.272 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:19.272 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:19.272 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:19.272 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.272 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.272 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:19.273 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:19.273 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:19.273 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:19.273 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:19.273 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.273 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.273 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:19.273 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:19.273 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:19.273 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:19.273 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:19.273 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.274 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:19.274 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:19.274 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:19.274 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:19.274 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:19.274 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-506" 2023-10-05T12:49:19.274 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.274 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:19.274 INFO:teuthology.orchestra.run.smithi012.stdout:________________________ test_get_bucket_policy_status _________________________ 2023-10-05T12:49:19.274 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.275 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:19.275 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.275 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:19.275 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:19.275 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.275 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:19.275 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:19.275 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:19.275 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:19.275 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:19.275 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.276 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:19.276 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:19.276 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.276 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.276 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:19.276 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:19.276 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.276 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.276 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:19.276 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.277 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:19.277 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:19.277 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.277 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.277 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:19.277 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:19.277 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.277 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:19.278 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:19.278 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:19.278 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:19.278 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:19.278 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:19.278 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:19.278 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.278 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:19.278 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:19.279 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:19.279 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:19.279 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:19.279 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:19.279 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:19.279 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:19.279 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:19.279 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.279 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:19.279 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:19.279 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:19.280 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:19.280 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.280 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:19.280 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:19.280 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:19.280 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:19.280 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.280 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.280 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:19.280 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:19.280 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:19.281 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:19.281 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.281 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.281 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:19.281 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:19.281 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:19.281 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.281 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:19.281 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.281 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:19.281 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:19.282 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.282 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:19.282 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:19.282 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:19.282 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:19.282 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:19.282 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:19.282 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.282 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:19.282 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.283 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:19.283 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.283 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:19.283 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:19.283 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.283 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:19.283 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.283 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:19.283 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:19.283 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:19.283 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:19.284 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:19.284 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:19.284 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:19.284 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:19.284 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:19.284 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:19.284 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:19.284 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:19.284 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:19.284 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.284 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:19.285 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:19.285 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:19.285 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:19.285 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:19.285 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:19.285 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:19.285 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:19.285 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:19.285 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:19.285 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:19.285 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.286 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.286 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:19.286 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.286 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:19.286 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:19.286 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:19.286 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:19.286 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:19.286 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:19.286 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:19.286 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:19.287 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:19.287 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:19.287 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:19.287 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:19.287 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:19.287 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:19.287 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:19.287 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:19.287 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:19.287 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:19.287 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:19.288 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:19.288 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:19.288 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:19.288 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:19.288 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:19.288 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:19.288 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:19.288 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:19.288 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:19.288 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.288 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.289 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:19.289 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.289 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:19.289 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:19.289 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.289 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:19.289 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:19.289 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:19.289 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:19.289 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:19.289 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.290 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:19.290 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:19.290 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.290 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.290 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:19.290 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:19.290 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.290 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.290 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:19.290 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:19.291 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:19.291 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:19.291 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:19.291 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.291 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.291 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:19.291 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:19.291 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:19.291 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.291 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:19.291 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.292 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:19.292 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.292 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:19.292 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.292 INFO:teuthology.orchestra.run.smithi012.stdout: def test_get_bucket_policy_status(): 2023-10-05T12:49:19.292 INFO:teuthology.orchestra.run.smithi012.stdout:> bucket_name = get_new_bucket() 2023-10-05T12:49:19.292 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.292 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:12269: 2023-10-05T12:49:19.292 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.292 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-10-05T12:49:19.292 INFO:teuthology.orchestra.run.smithi012.stdout: client.create_bucket(Bucket=name) 2023-10-05T12:49:19.293 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:19.293 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:19.293 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:19.293 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:19.293 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:19.293 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:19.293 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:19.293 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:19.293 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:19.293 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:19.293 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:19.294 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:19.294 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:19.294 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:19.294 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:19.294 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:19.294 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:19.294 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:19.294 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:19.294 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:19.295 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:19.295 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:19.295 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:19.295 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:19.295 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:19.295 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:19.295 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:19.295 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:19.295 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:19.295 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:19.295 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:19.296 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:19.296 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:19.296 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:19.296 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.296 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.296 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:19.296 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:19.296 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.296 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:19.297 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.297 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:19.297 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:19.297 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:19.297 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:19.297 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:19.297 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:19.297 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:19.297 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:19.297 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:19.298 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:19.298 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:19.298 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:19.298 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:19.298 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.298 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:19.298 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:19.298 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:19.298 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:19.298 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:19.299 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:19.299 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:19.299 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:19.299 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:19.299 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:19.299 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:19.299 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.299 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.299 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:19.299 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:19.300 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:19.300 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:19.300 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:19.300 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.300 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.300 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:19.300 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:19.300 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:19.300 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:19.300 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:19.301 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.301 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:19.301 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:19.301 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:19.301 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:19.301 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:19.301 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-507" 2023-10-05T12:49:19.301 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.301 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:19.301 INFO:teuthology.orchestra.run.smithi012.stdout:___________________ test_get_public_acl_bucket_policy_status ___________________ 2023-10-05T12:49:19.302 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.302 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:19.302 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.302 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:19.302 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:19.302 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.302 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:19.302 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:19.302 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:19.303 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:19.303 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:19.303 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.303 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:19.303 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:19.303 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.303 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.303 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:19.303 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:19.303 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.303 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.304 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:19.304 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.304 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:19.304 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:19.304 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.304 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.304 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:19.304 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:19.304 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.304 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:19.305 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:19.305 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:19.305 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:19.305 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:19.305 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:19.305 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:19.305 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.305 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:19.305 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:19.305 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:19.306 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:19.306 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:19.306 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:19.306 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:19.306 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:19.306 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:19.306 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.306 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:19.306 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:19.307 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:19.307 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:19.307 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.307 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:19.307 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:19.307 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:19.307 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:19.307 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.307 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.307 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:19.308 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:19.308 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:19.308 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:19.308 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.308 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.308 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:19.308 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:19.308 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:19.308 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.308 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:19.309 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.309 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:19.309 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:19.309 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.309 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:19.309 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:19.309 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:19.309 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:19.309 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:19.309 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:19.310 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.310 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:19.310 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.310 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:19.310 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.310 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:19.310 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:19.310 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.310 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:19.311 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.311 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:19.311 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:19.311 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:19.311 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:19.311 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:19.311 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:19.311 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:19.311 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:19.311 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:19.311 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:19.312 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:19.312 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:19.312 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:19.312 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.312 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:19.312 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:19.312 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:19.312 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:19.313 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:19.313 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:19.313 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:19.313 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:19.313 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:19.313 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:19.313 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:19.313 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.313 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.314 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:19.314 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.314 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:19.314 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:19.314 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:19.314 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:19.314 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:19.314 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:19.314 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:19.314 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:19.315 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:19.315 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:19.315 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:19.315 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:19.315 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:19.315 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:19.315 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:19.315 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:19.315 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:19.315 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:19.316 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:19.316 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:19.316 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:19.316 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:19.316 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:19.316 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:19.316 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:19.316 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:19.316 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:19.316 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:19.317 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.317 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.317 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:19.317 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.317 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:19.317 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:19.317 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.317 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:19.317 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:19.317 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:19.318 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:19.318 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:19.318 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.318 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:19.318 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:19.318 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.318 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.318 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:19.318 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:19.318 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.319 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.319 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:19.319 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:19.319 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:19.319 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:19.319 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:19.319 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.319 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.319 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:19.319 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:19.320 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:19.320 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.320 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:19.320 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.320 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:19.320 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.320 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:19.320 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.320 INFO:teuthology.orchestra.run.smithi012.stdout: def test_get_public_acl_bucket_policy_status(): 2023-10-05T12:49:19.320 INFO:teuthology.orchestra.run.smithi012.stdout:> bucket_name = get_new_bucket() 2023-10-05T12:49:19.321 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.321 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:12275: 2023-10-05T12:49:19.321 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.321 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-10-05T12:49:19.321 INFO:teuthology.orchestra.run.smithi012.stdout: client.create_bucket(Bucket=name) 2023-10-05T12:49:19.321 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:19.321 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:19.321 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:19.321 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:19.321 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:19.321 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:19.322 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:19.322 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:19.322 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:19.322 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:19.322 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:19.322 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:19.322 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:19.322 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:19.322 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:19.322 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:19.323 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:19.323 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:19.323 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:19.323 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:19.323 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:19.323 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:19.323 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:19.323 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:19.323 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:19.323 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:19.324 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:19.324 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:19.324 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:19.324 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:19.324 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:19.324 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:19.324 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:19.324 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:19.324 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.324 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.324 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:19.325 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:19.325 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.325 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:19.325 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.325 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:19.325 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:19.325 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:19.325 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:19.325 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:19.325 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:19.326 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:19.326 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:19.326 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:19.326 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:19.326 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:19.326 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:19.326 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:19.326 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.326 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:19.327 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:19.327 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:19.327 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:19.327 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:19.327 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:19.327 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:19.327 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:19.327 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:19.327 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:19.327 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:19.327 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.328 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.328 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:19.328 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:19.328 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:19.328 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:19.328 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:19.328 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.328 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.328 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:19.328 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:19.329 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:19.329 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:19.329 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:19.329 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.329 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:19.329 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:19.329 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:19.329 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:19.329 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:19.329 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-508" 2023-10-05T12:49:19.330 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.330 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:19.330 INFO:teuthology.orchestra.run.smithi012.stdout:_________________ test_get_authpublic_acl_bucket_policy_status _________________ 2023-10-05T12:49:19.330 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.330 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:19.330 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.330 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:19.330 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:19.330 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.330 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:19.331 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:19.331 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:19.331 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:19.331 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:19.331 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.331 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:19.331 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:19.331 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.331 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.331 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:19.332 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:19.332 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.332 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.332 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:19.332 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.332 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:19.332 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:19.332 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.332 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.332 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:19.333 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:19.333 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.333 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:19.333 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:19.333 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:19.333 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:19.333 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:19.333 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:19.333 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:19.333 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.333 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:19.334 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:19.334 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:19.334 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:19.334 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:19.334 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:19.334 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:19.334 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:19.334 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:19.334 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.334 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:19.335 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:19.335 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:19.335 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:19.335 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.335 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:19.335 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:19.335 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:19.335 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:19.335 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.335 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.336 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:19.336 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:19.336 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:19.336 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:19.336 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.336 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.336 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:19.336 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:19.336 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:19.336 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.337 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:19.337 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.337 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:19.337 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:19.337 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.337 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:19.337 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:19.337 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:19.337 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:19.337 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:19.338 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:19.338 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.338 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:19.338 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.338 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:19.338 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.338 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:19.338 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:19.338 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.338 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:19.339 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.339 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:19.339 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:19.339 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:19.339 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:19.339 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:19.339 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:19.339 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:19.339 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:19.339 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:19.340 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:19.340 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:19.340 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:19.340 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:19.340 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.340 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:19.340 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:19.340 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:19.340 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:19.340 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:19.341 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:19.341 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:19.341 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:19.341 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:19.341 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:19.341 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:19.341 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.341 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.341 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:19.341 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.342 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:19.342 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:19.342 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:19.342 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:19.342 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:19.342 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:19.342 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:19.342 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:19.342 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:19.342 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:19.343 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:19.343 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:19.343 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:19.343 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:19.343 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:19.343 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:19.343 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:19.343 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:19.343 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:19.343 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:19.344 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:19.344 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:19.344 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:19.344 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:19.344 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:19.344 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:19.344 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:19.344 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:19.344 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.344 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.345 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:19.345 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.345 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:19.345 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:19.345 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.345 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:19.345 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:19.345 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:19.345 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:19.345 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:19.346 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.346 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:19.346 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:19.346 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.346 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.346 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:19.346 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:19.346 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.346 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.346 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:19.347 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:19.347 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:19.347 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:19.347 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:19.347 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.347 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.347 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:19.347 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:19.347 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:19.347 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.347 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:19.348 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.348 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:19.348 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.348 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:19.348 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.348 INFO:teuthology.orchestra.run.smithi012.stdout: def test_get_authpublic_acl_bucket_policy_status(): 2023-10-05T12:49:19.348 INFO:teuthology.orchestra.run.smithi012.stdout:> bucket_name = get_new_bucket() 2023-10-05T12:49:19.348 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.348 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:12282: 2023-10-05T12:49:19.349 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.349 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-10-05T12:49:19.349 INFO:teuthology.orchestra.run.smithi012.stdout: client.create_bucket(Bucket=name) 2023-10-05T12:49:19.349 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:19.349 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:19.349 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:19.349 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:19.349 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:19.349 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:19.349 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:19.350 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:19.350 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:19.350 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:19.350 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:19.350 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:19.350 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:19.350 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:19.350 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:19.350 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:19.350 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:19.351 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:19.351 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:19.351 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:19.351 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:19.351 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:19.351 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:19.351 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:19.351 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:19.351 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:19.351 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:19.352 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:19.352 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:19.352 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:19.352 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:19.352 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:19.352 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:19.352 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:19.352 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.352 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.352 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:19.353 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:19.353 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.353 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:19.353 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.353 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:19.353 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:19.353 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:19.353 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:19.353 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:19.353 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:19.354 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:19.354 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:19.354 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:19.354 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:19.354 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:19.354 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:19.354 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:19.354 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.354 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:19.354 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:19.355 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:19.355 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:19.355 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:19.355 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:19.355 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:19.355 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:19.355 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:19.355 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:19.355 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:19.355 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.356 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.356 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:19.356 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:19.356 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:19.356 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:19.356 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:19.356 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.356 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.356 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:19.356 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:19.357 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:19.357 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:19.357 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:19.357 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.357 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:19.357 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:19.357 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:19.357 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:19.357 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:19.357 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-509" 2023-10-05T12:49:19.357 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.358 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:19.358 INFO:teuthology.orchestra.run.smithi012.stdout:________________ test_get_publicpolicy_acl_bucket_policy_status ________________ 2023-10-05T12:49:19.358 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.358 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:19.358 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.358 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:19.358 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:19.358 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.358 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:19.358 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:19.359 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:19.359 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:19.359 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:19.359 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.359 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:19.359 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:19.359 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.359 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.359 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:19.359 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:19.359 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.360 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.360 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:19.360 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.360 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:19.360 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:19.360 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.360 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.360 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:19.360 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:19.360 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.360 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:19.361 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:19.361 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:19.361 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:19.361 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:19.361 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:19.361 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:19.361 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.361 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:19.361 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:19.361 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:19.361 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:19.362 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:19.362 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:19.362 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:19.362 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:19.362 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:19.362 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.362 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:19.362 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:19.362 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:19.362 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:19.363 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.363 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:19.363 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:19.363 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:19.363 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:19.363 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.363 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.363 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:19.363 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:19.363 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:19.364 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:19.364 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.364 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.364 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:19.364 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:19.364 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:19.364 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.364 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:19.364 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.364 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:19.365 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:19.365 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.365 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:19.365 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:19.365 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:19.365 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:19.365 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:19.365 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:19.365 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.365 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:19.365 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.366 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:19.366 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.366 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:19.366 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:19.366 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.366 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:19.366 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.366 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:19.366 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:19.366 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:19.367 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:19.367 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:19.367 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:19.367 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:19.367 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:19.367 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:19.367 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:19.367 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:19.367 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:19.368 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:19.368 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.368 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:19.368 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:19.368 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:19.368 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:19.368 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:19.368 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:19.368 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:19.368 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:19.369 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:19.369 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:19.369 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:19.369 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.369 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.369 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:19.369 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.369 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:19.369 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:19.369 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:19.370 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:19.370 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:19.370 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:19.370 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:19.370 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:19.370 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:19.370 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:19.370 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:19.370 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:19.370 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:19.371 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:19.371 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:19.371 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:19.371 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:19.371 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:19.371 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:19.371 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:19.371 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:19.371 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:19.371 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:19.372 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:19.372 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:19.372 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:19.372 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:19.372 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:19.372 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.372 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.372 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:19.372 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.372 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:19.372 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:19.373 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.373 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:19.373 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:19.373 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:19.373 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:19.373 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:19.373 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.373 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:19.373 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:19.373 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.374 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.374 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:19.374 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:19.374 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.374 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.374 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:19.374 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:19.374 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:19.374 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:19.374 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:19.375 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.375 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.375 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:19.375 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:19.375 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:19.375 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.375 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:19.375 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.375 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:19.375 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.376 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:19.376 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.376 INFO:teuthology.orchestra.run.smithi012.stdout: def test_get_publicpolicy_acl_bucket_policy_status(): 2023-10-05T12:49:19.376 INFO:teuthology.orchestra.run.smithi012.stdout:> bucket_name = get_new_bucket() 2023-10-05T12:49:19.376 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.376 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:12290: 2023-10-05T12:49:19.376 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.376 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-10-05T12:49:19.376 INFO:teuthology.orchestra.run.smithi012.stdout: client.create_bucket(Bucket=name) 2023-10-05T12:49:19.376 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:19.377 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:19.377 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:19.377 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:19.377 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:19.377 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:19.377 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:19.377 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:19.377 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:19.377 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:19.377 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:19.377 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:19.378 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:19.378 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:19.378 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:19.378 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:19.378 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:19.378 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:19.378 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:19.378 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:19.378 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:19.379 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:19.379 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:19.379 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:19.379 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:19.379 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:19.379 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:19.379 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:19.379 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:19.379 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:19.379 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:19.380 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:19.380 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:19.380 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:19.380 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.380 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.380 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:19.380 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:19.380 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.380 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:19.380 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.380 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:19.381 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:19.381 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:19.381 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:19.381 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:19.381 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:19.381 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:19.381 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:19.381 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:19.381 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:19.381 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:19.382 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:19.382 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:19.382 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.382 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:19.382 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:19.382 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:19.382 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:19.382 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:19.382 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:19.382 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:19.383 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:19.383 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:19.383 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:19.383 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:19.383 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.383 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.383 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:19.383 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:19.383 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:19.383 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:19.384 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:19.384 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.384 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.384 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:19.384 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:19.384 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:19.384 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:19.384 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:19.384 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.384 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:19.385 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:19.385 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:19.385 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:19.385 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:19.385 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-510" 2023-10-05T12:49:19.385 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.385 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:19.385 INFO:teuthology.orchestra.run.smithi012.stdout:______________ test_get_nonpublicpolicy_acl_bucket_policy_status _______________ 2023-10-05T12:49:19.385 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.385 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:19.385 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.386 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:19.386 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:19.386 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.386 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:19.386 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:19.386 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:19.386 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:19.386 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:19.386 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.386 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:19.387 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:19.387 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.387 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.387 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:19.387 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:19.387 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.387 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.387 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:19.387 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.387 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:19.388 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:19.388 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.388 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.388 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:19.388 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:19.388 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.388 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:19.388 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:19.388 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:19.388 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:19.388 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:19.389 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:19.389 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:19.389 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.389 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:19.389 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:19.389 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:19.389 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:19.389 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:19.389 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:19.389 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:19.390 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:19.390 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:19.390 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.390 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:19.390 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:19.390 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:19.390 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:19.390 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.390 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:19.390 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:19.391 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:19.391 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:19.391 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.391 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.391 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:19.391 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:19.391 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:19.391 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:19.391 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.391 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.391 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:19.392 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:19.392 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:19.392 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.392 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:19.392 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.392 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:19.392 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:19.392 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.392 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:19.392 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:19.393 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:19.393 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:19.393 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:19.393 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:19.393 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.393 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:19.393 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.393 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:19.393 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.393 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:19.393 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:19.394 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.394 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:19.394 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.394 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:19.394 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:19.394 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:19.394 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:19.394 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:19.394 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:19.394 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:19.395 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:19.395 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:19.395 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:19.395 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:19.395 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:19.395 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:19.395 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.395 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:19.395 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:19.395 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:19.396 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:19.396 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:19.396 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:19.396 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:19.396 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:19.396 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:19.396 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:19.396 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:19.396 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.396 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.397 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:19.397 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.397 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:19.397 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:19.397 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:19.397 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:19.397 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:19.397 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:19.397 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:19.397 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:19.398 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:19.398 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:19.398 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:19.398 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:19.398 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:19.398 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:19.398 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:19.398 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:19.398 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:19.398 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:19.399 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:19.399 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:19.399 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:19.399 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:19.399 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:19.399 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:19.399 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:19.399 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:19.399 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:19.399 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:19.400 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.400 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.400 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:19.400 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.400 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:19.400 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:19.400 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.400 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:19.400 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:19.400 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:19.400 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:19.401 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:19.401 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.401 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:19.401 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:19.401 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.401 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.401 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:19.401 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:19.401 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.402 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.402 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:19.402 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:19.402 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:19.402 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:19.402 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:19.402 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.402 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.402 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:19.402 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:19.403 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:19.403 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.403 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:19.403 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.403 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:19.403 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.403 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:19.403 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.403 INFO:teuthology.orchestra.run.smithi012.stdout: def test_get_nonpublicpolicy_acl_bucket_policy_status(): 2023-10-05T12:49:19.403 INFO:teuthology.orchestra.run.smithi012.stdout:> bucket_name = get_new_bucket() 2023-10-05T12:49:19.404 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.404 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:12318: 2023-10-05T12:49:19.404 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.404 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-10-05T12:49:19.404 INFO:teuthology.orchestra.run.smithi012.stdout: client.create_bucket(Bucket=name) 2023-10-05T12:49:19.404 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:19.404 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:19.404 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:19.404 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:19.404 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:19.404 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:19.405 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:19.405 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:19.405 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:19.405 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:19.405 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:19.405 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:19.405 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:19.405 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:19.405 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:19.405 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:19.406 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:19.406 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:19.406 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:19.406 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:19.406 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:19.406 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:19.406 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:19.406 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:19.406 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:19.406 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:19.407 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:19.407 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:19.407 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:19.407 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:19.407 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:19.407 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:19.407 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:19.407 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:19.407 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.407 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.408 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:19.408 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:19.408 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.408 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:19.408 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.408 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:19.408 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:19.408 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:19.408 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:19.408 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:19.409 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:19.409 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:19.409 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:19.409 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:19.409 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:19.409 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:19.409 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:19.409 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:19.409 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.409 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:19.410 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:19.410 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:19.410 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:19.410 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:19.410 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:19.410 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:19.410 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:19.410 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:19.410 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:19.410 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:19.411 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.411 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.413 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:19.413 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:19.413 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:19.413 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:19.413 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:19.413 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.414 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.414 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:19.414 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:19.414 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:19.414 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:19.414 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:19.414 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.414 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:19.414 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:19.415 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:19.415 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:19.415 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:19.415 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-511" 2023-10-05T12:49:19.415 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.415 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:19.415 INFO:teuthology.orchestra.run.smithi012.stdout:______________ test_get_nonpublicpolicy_deny_bucket_policy_status ______________ 2023-10-05T12:49:19.415 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.415 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:19.415 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.415 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:19.416 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:19.416 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.416 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:19.416 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:19.416 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:19.416 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:19.416 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:19.416 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.416 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:19.416 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:19.417 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.417 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.417 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:19.417 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:19.417 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.417 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.417 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:19.417 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.417 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:19.417 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:19.418 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.418 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.418 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:19.418 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:19.418 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.418 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:19.418 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:19.418 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:19.418 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:19.419 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:19.419 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:19.419 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:19.419 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.419 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:19.419 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:19.419 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:19.419 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:19.419 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:19.419 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:19.419 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:19.420 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:19.420 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:19.420 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.420 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:19.420 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:19.420 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:19.420 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:19.420 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.420 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:19.420 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:19.421 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:19.421 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:19.421 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.421 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.421 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:19.421 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:19.421 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:19.421 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:19.421 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.421 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.421 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:19.422 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:19.422 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:19.422 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.422 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:19.422 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.422 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:19.422 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:19.422 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.422 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:19.422 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:19.423 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:19.423 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:19.423 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:19.423 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:19.423 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.423 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:19.423 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.423 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:19.423 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.423 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:19.423 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:19.424 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.424 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:19.424 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.424 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:19.424 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:19.424 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:19.424 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:19.424 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:19.424 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:19.425 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:19.425 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:19.425 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:19.425 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:19.425 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:19.425 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:19.425 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:19.425 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.425 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:19.425 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:19.425 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:19.425 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:19.426 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:19.426 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:19.426 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:19.426 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:19.426 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:19.426 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:19.426 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:19.426 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.426 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.427 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:19.427 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.427 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:19.427 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:19.427 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:19.427 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:19.427 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:19.427 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:19.427 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:19.427 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:19.428 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:19.428 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:19.428 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:19.428 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:19.428 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:19.428 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:19.428 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:19.428 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:19.428 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:19.429 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:19.429 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:19.429 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:19.429 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:19.429 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:19.429 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:19.429 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:19.429 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:19.429 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:19.429 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:19.430 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:19.430 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.430 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.430 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:19.430 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.430 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:19.430 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:19.430 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.430 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:19.430 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:19.431 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:19.431 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:19.431 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:19.431 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.431 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:19.431 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:19.431 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.431 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.431 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:19.431 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:19.432 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.432 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.432 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:19.432 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:19.432 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:19.432 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:19.432 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:19.432 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.432 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.433 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:19.433 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:19.433 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:19.433 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.433 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:19.433 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.433 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:19.433 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.433 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:19.433 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.434 INFO:teuthology.orchestra.run.smithi012.stdout: def test_get_nonpublicpolicy_deny_bucket_policy_status(): 2023-10-05T12:49:19.434 INFO:teuthology.orchestra.run.smithi012.stdout:> bucket_name = get_new_bucket() 2023-10-05T12:49:19.434 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.434 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:12350: 2023-10-05T12:49:19.434 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.434 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-10-05T12:49:19.434 INFO:teuthology.orchestra.run.smithi012.stdout: client.create_bucket(Bucket=name) 2023-10-05T12:49:19.434 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:19.434 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:19.435 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:19.435 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:19.435 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:19.435 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:19.435 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:19.435 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:19.435 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:19.435 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:19.435 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:19.436 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:19.436 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:19.436 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:19.436 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:19.436 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:19.436 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:19.436 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:19.436 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:19.436 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:19.436 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:19.437 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:19.437 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:19.437 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:19.437 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:19.437 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:19.437 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:19.437 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:19.437 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:19.437 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:19.438 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:19.438 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:19.438 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:19.438 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:19.438 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.438 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.438 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:19.438 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:19.438 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.439 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:19.439 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.439 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:19.439 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:19.439 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:19.439 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:19.439 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:19.439 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:19.439 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:19.439 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:19.440 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:19.440 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:19.440 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:19.440 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:19.440 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:19.440 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.440 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:19.440 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:19.440 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:19.440 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:19.440 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:19.441 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:19.441 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:19.441 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:19.441 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:19.441 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:19.441 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:19.441 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.441 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.441 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:19.441 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:19.441 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:19.441 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:19.442 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:19.442 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.442 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.442 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:19.442 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:19.442 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:19.442 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:19.442 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:19.442 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.442 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:19.443 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:19.443 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:19.443 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:19.443 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:19.443 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-512" 2023-10-05T12:49:19.443 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.443 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:19.443 INFO:teuthology.orchestra.run.smithi012.stdout:________________________ test_get_default_public_block _________________________ 2023-10-05T12:49:19.443 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.443 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:19.443 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.444 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:19.444 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:19.444 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.444 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:19.444 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:19.444 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:19.444 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:19.444 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:19.444 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.444 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:19.444 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:19.445 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.445 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.445 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:19.445 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:19.445 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.445 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.445 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:19.445 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.445 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:19.445 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:19.445 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.446 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.446 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:19.446 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:19.446 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.446 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:19.446 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:19.446 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:19.446 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:19.446 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:19.446 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:19.447 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:19.447 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.447 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:19.447 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:19.447 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:19.447 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:19.447 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:19.447 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:19.447 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:19.447 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:19.447 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:19.448 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.448 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:19.448 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:19.448 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:19.448 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:19.448 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.448 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:19.448 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:19.448 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:19.448 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:19.449 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.449 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.449 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:19.449 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:19.449 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:19.449 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:19.449 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.449 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.449 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:19.450 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:19.450 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:19.450 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.450 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:19.450 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.450 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:19.450 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:19.450 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.450 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:19.451 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:19.451 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:19.451 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:19.451 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:19.451 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:19.451 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.451 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:19.451 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.451 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:19.451 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.452 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:19.452 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:19.452 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.452 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:19.452 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.452 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:19.452 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:19.452 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:19.452 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:19.452 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:19.452 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:19.453 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:19.453 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:19.453 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:19.453 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:19.453 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:19.453 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:19.453 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:19.453 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.453 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:19.453 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:19.454 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:19.454 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:19.454 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:19.454 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:19.454 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:19.454 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:19.454 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:19.454 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:19.454 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:19.455 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.455 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.455 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:19.455 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.455 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:19.455 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:19.455 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:19.455 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:19.455 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:19.455 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:19.456 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:19.456 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:19.456 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:19.456 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:19.456 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:19.456 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:19.456 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:19.456 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:19.456 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:19.456 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:19.456 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:19.457 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:19.457 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:19.457 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:19.457 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:19.457 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:19.457 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:19.457 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:19.457 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:19.457 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:19.457 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:19.458 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:19.458 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.458 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.458 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:19.458 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.458 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:19.458 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:19.458 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.458 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:19.459 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:19.459 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:19.459 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:19.459 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:19.459 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.459 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:19.459 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:19.459 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.459 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.459 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:19.459 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:19.460 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.460 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.460 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:19.460 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:19.460 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:19.460 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:19.460 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:19.460 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.460 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.460 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:19.461 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:19.461 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:19.461 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.461 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:19.461 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.461 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:19.461 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.461 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:19.461 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.461 INFO:teuthology.orchestra.run.smithi012.stdout: def test_get_default_public_block(): 2023-10-05T12:49:19.461 INFO:teuthology.orchestra.run.smithi012.stdout: #client = get_svc_client(svc='s3control', client_config=Config(s3={'addressing_style': 'path'})) 2023-10-05T12:49:19.461 INFO:teuthology.orchestra.run.smithi012.stdout:> bucket_name = get_new_bucket() 2023-10-05T12:49:19.462 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.462 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:12378: 2023-10-05T12:49:19.462 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.462 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-10-05T12:49:19.462 INFO:teuthology.orchestra.run.smithi012.stdout: client.create_bucket(Bucket=name) 2023-10-05T12:49:19.462 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:19.462 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:19.462 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:19.462 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:19.462 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:19.463 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:19.463 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:19.463 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:19.463 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:19.463 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:19.463 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:19.463 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:19.463 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:19.463 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:19.463 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:19.463 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:19.464 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:19.464 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:19.464 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:19.464 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:19.464 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:19.464 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:19.464 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:19.464 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:19.464 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:19.464 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:19.464 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:19.465 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:19.465 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:19.465 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:19.465 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:19.465 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:19.465 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:19.465 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:19.465 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.465 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.465 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:19.465 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:19.466 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.466 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:19.466 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.466 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:19.466 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:19.466 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:19.466 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:19.466 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:19.466 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:19.467 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:19.467 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:19.467 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:19.467 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:19.467 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:19.467 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:19.467 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:19.467 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.467 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:19.467 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:19.467 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:19.468 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:19.468 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:19.468 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:19.468 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:19.468 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:19.468 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:19.468 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:19.468 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:19.468 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.468 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.469 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:19.469 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:19.469 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:19.469 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:19.469 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:19.469 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.469 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.469 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:19.469 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:19.469 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:19.470 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:19.470 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:19.470 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.470 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:19.470 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:19.470 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:19.470 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:19.470 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:19.470 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-513" 2023-10-05T12:49:19.470 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.471 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:19.471 INFO:teuthology.orchestra.run.smithi012.stdout:____________________________ test_put_public_block _____________________________ 2023-10-05T12:49:19.471 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.471 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:19.471 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.471 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:19.471 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:19.471 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.471 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:19.471 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:19.472 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:19.472 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:19.472 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:19.472 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.472 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:19.472 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:19.472 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.472 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.472 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:19.472 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:19.472 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.473 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.473 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:19.473 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.473 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:19.473 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:19.473 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.473 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.473 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:19.473 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:19.473 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.474 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:19.474 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:19.474 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:19.474 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:19.474 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:19.474 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:19.474 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:19.474 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.474 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:19.474 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:19.475 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:19.475 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:19.475 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:19.475 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:19.475 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:19.475 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:19.475 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:19.475 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.475 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:19.475 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:19.476 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:19.476 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:19.476 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.476 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:19.476 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:19.476 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:19.476 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:19.476 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.476 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.476 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:19.477 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:19.477 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:19.477 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:19.477 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.477 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.477 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:19.477 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:19.477 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:19.477 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.477 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:19.478 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.478 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:19.478 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:19.478 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.478 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:19.478 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:19.478 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:19.478 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:19.478 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:19.479 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:19.479 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.479 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:19.479 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.479 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:19.479 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.479 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:19.479 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:19.479 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.479 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:19.480 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.480 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:19.480 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:19.480 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:19.480 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:19.480 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:19.480 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:19.480 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:19.480 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:19.480 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:19.481 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:19.481 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:19.481 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:19.481 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:19.481 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.481 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:19.481 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:19.481 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:19.481 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:19.481 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:19.481 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:19.482 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:19.482 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:19.482 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:19.482 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:19.482 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:19.482 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.482 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.483 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:19.483 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.483 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:19.483 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:19.483 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:19.483 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:19.483 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:19.483 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:19.483 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:19.483 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:19.484 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:19.484 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:19.484 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:19.484 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:19.484 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:19.484 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:19.484 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:19.484 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:19.484 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:19.484 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:19.485 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:19.485 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:19.485 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:19.485 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:19.485 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:19.485 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:19.485 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:19.485 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:19.485 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:19.485 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:19.486 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.486 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.486 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:19.486 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.486 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:19.486 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:19.486 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.486 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:19.486 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:19.486 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:19.486 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:19.487 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:19.487 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.487 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:19.487 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:19.487 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.487 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.487 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:19.487 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:19.487 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.487 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.488 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:19.488 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:19.488 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:19.488 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:19.488 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:19.488 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.488 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.488 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:19.488 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:19.488 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:19.489 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.489 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:19.489 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.489 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:19.489 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.489 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:19.489 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.489 INFO:teuthology.orchestra.run.smithi012.stdout: def test_put_public_block(): 2023-10-05T12:49:19.489 INFO:teuthology.orchestra.run.smithi012.stdout: #client = get_svc_client(svc='s3control', client_config=Config(s3={'addressing_style': 'path'})) 2023-10-05T12:49:19.489 INFO:teuthology.orchestra.run.smithi012.stdout:> bucket_name = get_new_bucket() 2023-10-05T12:49:19.490 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.490 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:12389: 2023-10-05T12:49:19.490 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.490 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-10-05T12:49:19.490 INFO:teuthology.orchestra.run.smithi012.stdout: client.create_bucket(Bucket=name) 2023-10-05T12:49:19.490 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:19.490 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:19.490 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:19.490 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:19.490 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:19.491 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:19.491 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:19.491 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:19.491 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:19.491 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:19.491 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:19.491 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:19.491 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:19.491 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:19.491 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:19.491 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:19.492 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:19.492 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:19.492 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:19.492 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:19.492 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:19.492 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:19.492 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:19.492 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:19.492 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:19.492 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:19.493 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:19.493 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:19.493 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:19.493 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:19.493 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:19.493 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:19.493 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:19.493 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:19.493 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.493 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.494 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:19.494 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:19.494 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.494 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:19.494 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.494 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:19.494 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:19.494 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:19.494 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:19.494 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:19.495 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:19.495 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:19.495 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:19.495 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:19.495 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:19.495 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:19.495 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:19.495 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:19.495 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.495 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:19.496 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:19.496 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:19.496 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:19.496 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:19.496 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:19.496 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:19.496 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:19.496 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:19.496 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:19.496 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:19.497 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.497 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.497 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:19.497 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:19.497 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:19.497 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:19.497 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:19.497 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.497 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.497 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:19.498 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:19.498 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:19.498 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:19.498 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:19.498 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.498 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:19.498 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:19.498 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:19.498 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:19.499 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:19.499 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-514" 2023-10-05T12:49:19.499 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.499 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:19.499 INFO:teuthology.orchestra.run.smithi012.stdout:______________________ test_block_public_put_bucket_acls _______________________ 2023-10-05T12:49:19.499 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.499 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:19.499 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.499 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:19.499 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:19.499 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.500 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:19.500 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:19.500 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:19.500 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:19.500 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:19.500 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.500 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:19.500 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:19.500 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.500 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.501 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:19.501 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:19.501 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.501 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.501 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:19.501 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.501 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:19.501 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:19.501 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.501 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.502 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:19.502 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:19.502 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.502 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:19.502 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:19.502 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:19.502 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:19.502 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:19.502 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:19.503 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:19.503 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.503 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:19.503 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:19.503 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:19.503 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:19.503 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:19.503 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:19.503 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:19.503 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:19.504 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:19.504 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.504 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:19.504 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:19.504 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:19.504 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:19.504 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.504 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:19.504 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:19.505 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:19.505 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:19.505 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.505 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.505 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:19.505 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:19.505 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:19.505 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:19.505 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.505 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.505 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:19.506 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:19.506 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:19.506 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.506 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:19.506 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.506 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:19.506 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:19.506 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.506 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:19.506 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:19.507 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:19.507 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:19.507 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:19.507 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:19.507 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.507 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:19.507 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.507 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:19.507 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.507 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:19.507 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:19.508 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.508 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:19.508 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.508 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:19.508 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:19.508 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:19.508 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:19.508 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:19.508 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:19.508 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:19.509 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:19.509 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:19.509 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:19.509 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:19.509 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:19.509 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:19.509 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.509 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:19.509 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:19.509 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:19.509 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:19.510 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:19.510 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:19.510 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:19.510 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:19.510 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:19.510 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:19.510 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:19.510 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.510 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.510 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:19.510 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.511 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:19.511 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:19.511 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:19.511 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:19.511 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:19.511 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:19.511 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:19.511 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:19.511 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:19.511 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:19.511 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:19.512 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:19.512 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:19.512 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:19.512 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:19.512 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:19.512 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:19.512 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:19.512 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:19.512 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:19.512 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:19.512 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:19.513 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:19.513 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:19.513 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:19.513 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:19.513 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:19.513 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:19.513 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.513 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.513 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:19.513 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.513 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:19.514 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:19.514 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.514 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:19.514 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:19.514 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:19.514 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:19.514 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:19.514 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.514 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:19.514 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:19.514 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.515 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.515 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:19.515 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:19.515 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.515 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.515 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:19.515 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:19.515 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:19.515 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:19.515 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:19.515 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.516 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.516 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:19.516 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:19.516 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:19.516 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.516 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:19.516 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.516 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:19.516 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.517 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:19.517 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.517 INFO:teuthology.orchestra.run.smithi012.stdout: def test_block_public_put_bucket_acls(): 2023-10-05T12:49:19.517 INFO:teuthology.orchestra.run.smithi012.stdout: #client = get_svc_client(svc='s3control', client_config=Config(s3={'addressing_style': 'path'})) 2023-10-05T12:49:19.517 INFO:teuthology.orchestra.run.smithi012.stdout:> bucket_name = get_new_bucket() 2023-10-05T12:49:19.517 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.517 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:12408: 2023-10-05T12:49:19.517 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.517 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-10-05T12:49:19.517 INFO:teuthology.orchestra.run.smithi012.stdout: client.create_bucket(Bucket=name) 2023-10-05T12:49:19.518 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:19.518 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:19.518 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:19.518 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:19.518 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:19.518 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:19.518 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:19.518 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:19.519 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:19.519 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:19.519 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:19.519 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:19.519 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:19.519 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:19.519 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:19.519 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:19.519 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:19.519 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:19.520 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:19.520 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:19.520 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:19.520 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:19.520 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:19.520 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:19.520 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:19.520 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:19.520 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:19.521 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:19.521 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:19.521 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:19.521 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:19.521 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:19.521 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:19.521 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:19.521 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.521 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.521 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:19.522 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:19.522 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.522 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:19.522 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.522 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:19.522 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:19.522 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:19.522 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:19.522 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:19.522 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:19.523 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:19.523 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:19.523 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:19.523 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:19.523 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:19.523 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:19.523 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:19.523 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.523 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:19.523 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:19.523 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:19.524 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:19.524 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:19.524 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:19.524 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:19.524 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:19.524 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:19.524 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:19.524 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:19.524 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.524 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.525 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:19.525 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:19.525 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:19.525 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:19.525 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:19.525 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.525 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.525 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:19.525 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:19.525 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:19.525 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:19.526 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:19.526 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.526 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:19.526 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:19.526 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:19.526 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:19.526 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:19.526 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-515" 2023-10-05T12:49:19.526 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.526 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:19.527 INFO:teuthology.orchestra.run.smithi012.stdout:_____________________ test_block_public_object_canned_acls _____________________ 2023-10-05T12:49:19.527 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.527 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:19.527 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.527 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:19.527 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:19.527 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.527 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:19.527 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:19.527 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:19.528 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:19.528 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:19.528 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.528 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:19.528 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:19.528 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.528 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.528 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:19.528 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:19.528 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.529 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.529 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:19.529 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.529 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:19.529 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:19.529 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.529 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.529 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:19.529 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:19.529 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.530 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:19.530 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:19.530 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:19.530 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:19.530 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:19.530 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:19.530 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:19.530 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.530 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:19.530 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:19.531 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:19.531 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:19.531 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:19.531 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:19.531 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:19.531 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:19.531 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:19.531 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.531 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:19.531 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:19.531 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:19.531 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:19.532 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.532 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:19.532 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:19.532 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:19.532 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:19.532 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.532 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.532 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:19.532 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:19.532 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:19.532 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:19.533 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.533 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.533 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:19.533 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:19.533 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:19.533 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.533 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:19.533 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.533 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:19.533 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:19.533 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.534 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:19.534 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:19.534 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:19.534 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:19.534 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:19.534 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:19.534 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.534 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:19.534 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.534 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:19.535 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.535 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:19.535 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:19.535 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.535 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:19.535 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.535 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:19.535 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:19.535 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:19.535 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:19.535 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:19.536 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:19.536 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:19.536 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:19.536 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:19.536 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:19.536 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:19.536 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:19.536 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:19.536 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.536 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:19.537 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:19.537 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:19.537 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:19.537 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:19.537 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:19.537 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:19.537 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:19.537 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:19.537 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:19.537 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:19.537 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.538 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.538 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:19.538 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.538 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:19.538 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:19.538 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:19.538 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:19.538 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:19.538 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:19.539 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:19.539 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:19.539 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:19.539 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:19.539 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:19.539 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:19.539 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:19.539 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:19.539 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:19.539 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:19.540 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:19.540 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:19.540 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:19.540 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:19.540 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:19.540 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:19.540 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:19.540 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:19.540 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:19.540 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:19.540 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:19.541 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:19.541 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.541 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.541 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:19.541 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.541 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:19.541 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:19.541 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.541 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:19.541 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:19.541 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:19.542 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:19.542 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:19.542 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.542 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:19.542 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:19.542 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.542 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.542 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:19.542 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:19.542 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.543 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.543 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:19.543 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:19.543 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:19.543 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:19.543 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:19.543 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.543 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.543 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:19.543 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:19.544 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:19.544 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.544 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:19.544 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.544 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:19.544 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.544 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:19.544 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.544 INFO:teuthology.orchestra.run.smithi012.stdout: def test_block_public_object_canned_acls(): 2023-10-05T12:49:19.544 INFO:teuthology.orchestra.run.smithi012.stdout:> bucket_name = get_new_bucket() 2023-10-05T12:49:19.544 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.545 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:12436: 2023-10-05T12:49:19.545 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.545 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-10-05T12:49:19.545 INFO:teuthology.orchestra.run.smithi012.stdout: client.create_bucket(Bucket=name) 2023-10-05T12:49:19.545 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:19.545 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:19.545 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:19.545 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:19.545 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:19.545 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:19.546 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:19.546 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:19.546 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:19.546 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:19.546 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:19.546 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:19.546 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:19.546 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:19.546 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:19.546 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:19.547 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:19.547 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:19.547 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:19.547 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:19.547 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:19.547 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:19.547 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:19.547 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:19.547 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:19.547 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:19.548 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:19.548 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:19.548 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:19.548 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:19.548 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:19.548 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:19.548 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:19.548 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:19.548 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.548 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.548 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:19.549 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:19.549 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.549 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:19.549 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.549 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:19.549 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:19.549 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:19.549 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:19.549 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:19.550 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:19.550 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:19.550 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:19.550 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:19.550 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:19.550 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:19.550 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:19.550 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:19.550 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.550 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:19.551 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:19.551 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:19.551 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:19.551 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:19.551 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:19.551 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:19.551 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:19.551 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:19.551 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:19.551 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:19.552 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.552 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.552 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:19.552 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:19.552 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:19.552 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:19.552 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:19.552 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.552 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.552 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:19.553 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:19.553 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:19.553 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:19.553 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:19.553 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.553 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:19.553 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:19.553 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:19.553 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:19.553 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:19.554 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-516" 2023-10-05T12:49:19.554 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.554 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:19.554 INFO:teuthology.orchestra.run.smithi012.stdout:___________________________ test_block_public_policy ___________________________ 2023-10-05T12:49:19.554 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.554 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:19.554 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.554 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:19.554 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:19.554 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.555 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:19.555 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:19.555 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:19.555 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:19.555 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:19.555 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.555 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:19.555 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:19.555 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.555 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.556 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:19.556 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:19.556 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.556 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.556 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:19.556 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.556 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:19.556 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:19.556 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.557 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.557 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:19.557 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:19.557 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.557 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:19.557 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:19.557 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:19.557 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:19.557 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:19.557 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:19.557 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:19.558 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.558 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:19.558 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:19.558 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:19.558 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:19.558 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:19.558 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:19.558 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:19.558 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:19.559 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:19.559 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.559 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:19.559 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:19.559 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:19.559 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:19.559 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.559 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:19.559 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:19.559 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:19.560 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:19.560 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.560 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.560 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:19.560 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:19.560 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:19.560 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:19.560 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.560 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.560 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:19.560 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:19.561 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:19.561 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.561 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:19.561 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.561 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:19.561 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:19.561 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.561 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:19.561 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:19.561 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:19.562 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:19.562 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:19.562 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:19.562 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.562 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:19.562 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.562 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:19.562 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.562 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:19.562 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:19.563 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.563 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:19.563 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.563 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:19.563 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:19.563 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:19.563 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:19.563 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:19.563 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:19.563 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:19.564 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:19.564 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:19.564 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:19.564 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:19.564 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:19.564 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:19.564 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.564 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:19.564 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:19.564 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:19.564 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:19.565 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:19.565 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:19.565 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:19.565 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:19.565 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:19.565 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:19.565 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:19.565 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.565 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.565 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:19.566 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.566 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:19.566 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:19.566 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:19.566 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:19.566 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:19.566 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:19.566 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:19.566 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:19.566 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:19.567 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:19.567 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:19.567 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:19.567 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:19.567 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:19.567 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:19.567 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:19.567 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:19.567 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:19.567 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:19.568 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:19.568 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:19.568 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:19.568 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:19.568 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:19.568 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:19.568 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:19.568 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:19.568 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:19.568 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.569 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.569 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:19.569 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.569 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:19.569 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:19.569 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.569 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:19.569 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:19.569 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:19.569 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:19.570 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:19.570 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.570 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:19.570 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:19.570 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.570 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.570 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:19.570 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:19.570 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.570 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.571 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:19.571 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:19.571 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:19.571 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:19.571 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:19.571 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.571 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.571 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:19.571 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:19.571 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:19.572 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.572 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:19.572 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.572 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:19.572 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.572 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:19.572 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.572 INFO:teuthology.orchestra.run.smithi012.stdout: def test_block_public_policy(): 2023-10-05T12:49:19.572 INFO:teuthology.orchestra.run.smithi012.stdout:> bucket_name = get_new_bucket() 2023-10-05T12:49:19.572 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.572 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:12465: 2023-10-05T12:49:19.573 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.573 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-10-05T12:49:19.573 INFO:teuthology.orchestra.run.smithi012.stdout: client.create_bucket(Bucket=name) 2023-10-05T12:49:19.573 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:19.573 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:19.573 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:19.573 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:19.573 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:19.573 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:19.573 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:19.574 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:19.574 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:19.574 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:19.574 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:19.574 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:19.574 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:19.574 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:19.574 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:19.574 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:19.574 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:19.575 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:19.575 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:19.575 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:19.575 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:19.575 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:19.575 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:19.575 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:19.575 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:19.575 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:19.575 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:19.575 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:19.576 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:19.576 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:19.576 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:19.576 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:19.576 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:19.576 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:19.576 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.576 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.576 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:19.576 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:19.576 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.577 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:19.577 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.577 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:19.577 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:19.577 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:19.577 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:19.577 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:19.577 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:19.577 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:19.577 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:19.578 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:19.578 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:19.578 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:19.578 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:19.578 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:19.578 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.578 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:19.578 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:19.578 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:19.578 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:19.579 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:19.579 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:19.579 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:19.579 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:19.579 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:19.579 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:19.579 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:19.579 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.579 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.579 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:19.580 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:19.580 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:19.580 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:19.580 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:19.580 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.580 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.580 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:19.580 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:19.580 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:19.580 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:19.580 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:19.581 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.581 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:19.581 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:19.581 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:19.581 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:19.581 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:19.581 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-517" 2023-10-05T12:49:19.581 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.581 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:19.581 INFO:teuthology.orchestra.run.smithi012.stdout:___________________________ test_ignore_public_acls ____________________________ 2023-10-05T12:49:19.581 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.581 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:19.582 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.582 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:19.582 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:19.582 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.582 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:19.582 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:19.582 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:19.582 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:19.582 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:19.582 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.583 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:19.583 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:19.583 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.583 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.583 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:19.583 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:19.583 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.583 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.583 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:19.583 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.583 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:19.584 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:19.584 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.584 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.584 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:19.584 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:19.584 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.584 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:19.584 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:19.584 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:19.584 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:19.584 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:19.585 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:19.585 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:19.585 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.585 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:19.585 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:19.585 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:19.585 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:19.585 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:19.585 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:19.585 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:19.586 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:19.586 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:19.586 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.586 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:19.586 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:19.586 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:19.586 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:19.586 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.586 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:19.587 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:19.587 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:19.587 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:19.587 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.587 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.587 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:19.587 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:19.587 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:19.587 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:19.587 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.587 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.588 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:19.588 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:19.588 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:19.588 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.588 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:19.588 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.588 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:19.588 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:19.588 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.588 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:19.588 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:19.589 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:19.589 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:19.589 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:19.589 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:19.589 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.589 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:19.589 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.589 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:19.589 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.589 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:19.590 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:19.590 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.590 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:19.590 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.590 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:19.590 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:19.590 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:19.590 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:19.590 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:19.590 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:19.591 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:19.591 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:19.591 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:19.591 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:19.591 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:19.591 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:19.591 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:19.591 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.591 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:19.591 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:19.591 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:19.592 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:19.592 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:19.592 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:19.592 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:19.592 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:19.592 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:19.592 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:19.592 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:19.592 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.592 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.592 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:19.593 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.593 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:19.593 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:19.593 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:19.593 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:19.593 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:19.593 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:19.593 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:19.593 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:19.593 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:19.593 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:19.593 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:19.594 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:19.594 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:19.594 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:19.594 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:19.594 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:19.594 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:19.594 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:19.594 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:19.594 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:19.595 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:19.595 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:19.595 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:19.595 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:19.595 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:19.595 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:19.595 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:19.595 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:19.595 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.596 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.596 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:19.596 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.596 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:19.596 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:19.596 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.596 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:19.596 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:19.596 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:19.596 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:19.597 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:19.597 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.597 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:19.597 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:19.597 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.597 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.597 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:19.597 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:19.597 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.597 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.597 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:19.598 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:19.598 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:19.598 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:19.598 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:19.598 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.598 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.598 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:19.598 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:19.598 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:19.598 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.599 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:19.599 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.599 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:19.599 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.599 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:19.599 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.599 INFO:teuthology.orchestra.run.smithi012.stdout: def test_ignore_public_acls(): 2023-10-05T12:49:19.599 INFO:teuthology.orchestra.run.smithi012.stdout:> bucket_name = get_new_bucket() 2023-10-05T12:49:19.599 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.599 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:12482: 2023-10-05T12:49:19.599 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.600 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-10-05T12:49:19.600 INFO:teuthology.orchestra.run.smithi012.stdout: client.create_bucket(Bucket=name) 2023-10-05T12:49:19.600 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:19.600 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:19.600 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:19.600 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:19.600 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:19.600 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:19.600 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:19.600 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:19.601 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:19.601 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:19.601 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:19.601 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:19.601 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:19.601 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:19.601 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:19.601 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:19.601 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:19.601 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:19.601 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:19.602 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:19.602 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:19.602 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:19.602 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:19.602 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:19.602 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:19.602 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:19.602 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:19.602 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:19.603 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:19.603 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:19.603 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:19.603 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:19.603 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:19.603 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:19.603 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.603 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.603 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:19.603 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:19.604 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.604 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:19.604 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.604 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:19.604 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:19.604 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:19.604 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:19.604 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:19.604 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:19.604 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:19.605 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:19.605 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:19.605 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:19.605 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:19.605 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:19.605 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:19.605 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.605 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:19.605 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:19.605 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:19.605 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:19.606 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:19.606 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:19.606 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:19.606 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:19.606 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:19.606 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:19.606 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:19.606 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.606 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.606 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:19.607 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:19.607 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:19.607 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:19.607 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:19.607 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.607 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.607 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:19.607 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:19.607 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:19.607 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:19.608 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:19.608 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.608 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:19.608 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:19.608 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:19.608 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:19.608 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:19.608 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-518" 2023-10-05T12:49:19.608 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.608 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:19.609 INFO:teuthology.orchestra.run.smithi012.stdout:________________ test_multipart_upload_on_a_bucket_with_policy _________________ 2023-10-05T12:49:19.609 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.609 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:19.609 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.609 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:19.609 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:19.609 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.609 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:19.609 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:19.609 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:19.609 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:19.610 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:19.610 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.610 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:19.610 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:19.610 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.610 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.610 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:19.610 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:19.610 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.611 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.611 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:19.611 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.611 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:19.611 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:19.611 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.611 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.611 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:19.611 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:19.611 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.611 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:19.612 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:19.612 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:19.612 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:19.612 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:19.612 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:19.612 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:19.612 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.612 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:19.612 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:19.612 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:19.612 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:19.613 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:19.613 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:19.613 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:19.613 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:19.613 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:19.613 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.613 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:19.613 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:19.613 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:19.613 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:19.613 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.614 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:19.614 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:19.614 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:19.614 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:19.614 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.614 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.614 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:19.614 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:19.614 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:19.615 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:19.615 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.615 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.615 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:19.615 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:19.615 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:19.615 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.615 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:19.615 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.615 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:19.617 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:19.617 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.617 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:19.617 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:19.617 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:19.617 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:19.617 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:19.617 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:19.617 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.618 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:19.618 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.618 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:19.618 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.618 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:19.618 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:19.618 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.618 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:19.619 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.619 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:19.619 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:19.619 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:19.619 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:19.619 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:19.619 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:19.619 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:19.619 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:19.619 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:19.620 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:19.620 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:19.620 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:19.620 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:19.620 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.620 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:19.620 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:19.620 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:19.620 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:19.620 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:19.620 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:19.621 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:19.621 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:19.621 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:19.621 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:19.621 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:19.621 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.621 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.621 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:19.621 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.621 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:19.621 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:19.622 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:19.622 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:19.622 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:19.622 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:19.622 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:19.622 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:19.622 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:19.622 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:19.622 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:19.622 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:19.622 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:19.623 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:19.623 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:19.623 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:19.623 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:19.623 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:19.623 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:19.623 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:19.623 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:19.623 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:19.623 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:19.624 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:19.624 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:19.624 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:19.624 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:19.624 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:19.624 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.624 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.624 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:19.624 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.624 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:19.624 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:19.625 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.625 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:19.625 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:19.625 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:19.625 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:19.625 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:19.625 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.625 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:19.625 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:19.625 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.626 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.626 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:19.626 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:19.626 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.626 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.626 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:19.626 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:19.626 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:19.626 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:19.627 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:19.627 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.627 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.627 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:19.627 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:19.627 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:19.627 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.627 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:19.627 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.627 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:19.627 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.628 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:19.628 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.628 INFO:teuthology.orchestra.run.smithi012.stdout: def test_multipart_upload_on_a_bucket_with_policy(): 2023-10-05T12:49:19.628 INFO:teuthology.orchestra.run.smithi012.stdout:> bucket_name = get_new_bucket() 2023-10-05T12:49:19.628 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.628 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:12509: 2023-10-05T12:49:19.628 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.628 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-10-05T12:49:19.628 INFO:teuthology.orchestra.run.smithi012.stdout: client.create_bucket(Bucket=name) 2023-10-05T12:49:19.628 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:19.629 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:19.629 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:19.629 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:19.629 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:19.629 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:19.629 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:19.629 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:19.629 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:19.629 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:19.629 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:19.630 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:19.630 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:19.630 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:19.630 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:19.630 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:19.630 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:19.630 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:19.630 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:19.630 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:19.630 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:19.631 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:19.631 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:19.631 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:19.631 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:19.631 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:19.631 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:19.631 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:19.631 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:19.631 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:19.631 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:19.632 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:19.632 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:19.632 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:19.632 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.632 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.632 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:19.632 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:19.632 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.632 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:19.632 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.633 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:19.633 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:19.633 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:19.633 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:19.633 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:19.633 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:19.633 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:19.633 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:19.633 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:19.633 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:19.634 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:19.634 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:19.634 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:19.634 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.634 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:19.634 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:19.634 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:19.634 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:19.634 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:19.634 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:19.635 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:19.635 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:19.635 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:19.635 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:19.635 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:19.635 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.635 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.635 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:19.635 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:19.635 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:19.636 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:19.636 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:19.636 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.636 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.636 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:19.636 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:19.636 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:19.636 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:19.636 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:19.636 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.637 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:19.637 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:19.637 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:19.637 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:19.637 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:19.637 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-519" 2023-10-05T12:49:19.637 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.637 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:19.637 INFO:teuthology.orchestra.run.smithi012.stdout:________________________ test_put_bucket_encryption_kms ________________________ 2023-10-05T12:49:19.637 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.638 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:19.638 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.638 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:19.638 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:19.638 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.638 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:19.638 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:19.638 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:19.638 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:19.638 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:19.639 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.639 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:19.639 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:19.639 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.639 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.639 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:19.639 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:19.639 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.639 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.639 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:19.640 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.640 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:19.640 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:19.640 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.640 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.640 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:19.640 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:19.640 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.640 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:19.640 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:19.641 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:19.641 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:19.641 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:19.641 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:19.641 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:19.641 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.641 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:19.641 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:19.641 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:19.641 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:19.642 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:19.642 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:19.642 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:19.642 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:19.642 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:19.642 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.642 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:19.642 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:19.642 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:19.642 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:19.643 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.643 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:19.643 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:19.643 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:19.643 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:19.643 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.643 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.643 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:19.643 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:19.643 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:19.644 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:19.644 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.644 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.644 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:19.644 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:19.644 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:19.644 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.644 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:19.644 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.644 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:19.644 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:19.645 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.645 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:19.645 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:19.645 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:19.645 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:19.645 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:19.645 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:19.645 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.645 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:19.645 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.645 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:19.646 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.646 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:19.646 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:19.646 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.646 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:19.646 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.646 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:19.646 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:19.646 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:19.647 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:19.647 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:19.647 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:19.647 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:19.647 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:19.647 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:19.647 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:19.647 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:19.647 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:19.647 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:19.648 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.648 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:19.648 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:19.648 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:19.648 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:19.648 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:19.648 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:19.648 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:19.648 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:19.648 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:19.649 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:19.649 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:19.649 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.649 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.649 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:19.649 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.649 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:19.649 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:19.649 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:19.650 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:19.650 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:19.650 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:19.650 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:19.650 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:19.650 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:19.650 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:19.650 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:19.650 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:19.650 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:19.651 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:19.651 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:19.651 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:19.651 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:19.651 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:19.651 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:19.651 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:19.651 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:19.651 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:19.652 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:19.652 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:19.652 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:19.652 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:19.652 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:19.652 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:19.652 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.652 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.652 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:19.652 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.653 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:19.653 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:19.653 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.653 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:19.653 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:19.653 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:19.653 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:19.653 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:19.653 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.653 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:19.654 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:19.654 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.654 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.654 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:19.654 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:19.654 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.654 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.654 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:19.654 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:19.654 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:19.655 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:19.655 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:19.655 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.655 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.655 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:19.655 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:19.655 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:19.655 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.655 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:19.656 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.656 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:19.656 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.656 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:19.656 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.656 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.encryption 2023-10-05T12:49:19.656 INFO:teuthology.orchestra.run.smithi012.stdout: def test_put_bucket_encryption_kms(): 2023-10-05T12:49:19.656 INFO:teuthology.orchestra.run.smithi012.stdout:> bucket_name = get_new_bucket() 2023-10-05T12:49:19.656 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.656 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:12578: 2023-10-05T12:49:19.657 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.657 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-10-05T12:49:19.657 INFO:teuthology.orchestra.run.smithi012.stdout: client.create_bucket(Bucket=name) 2023-10-05T12:49:19.657 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:19.657 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:19.657 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:19.657 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:19.657 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:19.657 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:19.657 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:19.658 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:19.658 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:19.658 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:19.658 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:19.658 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:19.658 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:19.658 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:19.658 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:19.658 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:19.659 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:19.659 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:19.659 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:19.659 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:19.659 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:19.659 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:19.659 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:19.659 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:19.659 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:19.659 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:19.660 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:19.660 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:19.660 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:19.660 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:19.660 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:19.660 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:19.660 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:19.660 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:19.660 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.660 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.661 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:19.661 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:19.661 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.661 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:19.661 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.661 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:19.661 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:19.661 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:19.661 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:19.661 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:19.661 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:19.662 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:19.662 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:19.662 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:19.662 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:19.662 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:19.662 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:19.662 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:19.662 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.662 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:19.662 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:19.663 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:19.663 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:19.663 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:19.663 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:19.663 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:19.663 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:19.663 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:19.663 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:19.663 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:19.663 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.663 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.664 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:19.664 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:19.664 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:19.664 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:19.664 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:19.664 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.664 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.664 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:19.664 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:19.664 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:19.664 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:19.665 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:19.665 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.665 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:19.665 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:19.665 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:19.665 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:19.665 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:19.665 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-520" 2023-10-05T12:49:19.665 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.665 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:19.665 INFO:teuthology.orchestra.run.smithi012.stdout:________________________ test_get_bucket_encryption_kms ________________________ 2023-10-05T12:49:19.666 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.666 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:19.666 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.666 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:19.666 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:19.666 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.666 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:19.666 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:19.666 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:19.666 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:19.666 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:19.667 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.667 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:19.667 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:19.667 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.667 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.667 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:19.667 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:19.667 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.667 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.667 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:19.667 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.668 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:19.668 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:19.668 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.668 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.668 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:19.668 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:19.668 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.668 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:19.668 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:19.668 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:19.668 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:19.669 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:19.669 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:19.669 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:19.669 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.669 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:19.669 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:19.669 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:19.669 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:19.669 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:19.669 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:19.670 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:19.670 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:19.670 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:19.670 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.670 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:19.670 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:19.670 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:19.670 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:19.670 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.671 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:19.671 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:19.671 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:19.671 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:19.671 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.671 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.671 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:19.671 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:19.671 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:19.671 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:19.672 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.672 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.672 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:19.672 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:19.672 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:19.672 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.672 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:19.672 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.672 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:19.672 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:19.672 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.673 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:19.673 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:19.673 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:19.673 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:19.673 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:19.673 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:19.673 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.673 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:19.673 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.673 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:19.673 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.674 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:19.674 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:19.674 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.674 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:19.674 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.674 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:19.674 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:19.674 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:19.674 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:19.674 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:19.675 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:19.675 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:19.675 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:19.675 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:19.675 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:19.675 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:19.675 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:19.675 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:19.675 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.676 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:19.676 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:19.676 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:19.676 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:19.676 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:19.676 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:19.676 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:19.676 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:19.676 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:19.676 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:19.676 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:19.677 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.677 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.677 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:19.677 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.677 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:19.677 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:19.677 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:19.677 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:19.677 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:19.677 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:19.678 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:19.678 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:19.678 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:19.678 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:19.678 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:19.678 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:19.678 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:19.678 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:19.678 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:19.679 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:19.679 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:19.679 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:19.679 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:19.679 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:19.679 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:19.679 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:19.679 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:19.679 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:19.679 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:19.680 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:19.680 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:19.680 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:19.680 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.680 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.680 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:19.680 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.680 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:19.680 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:19.680 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.681 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:19.681 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:19.681 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:19.681 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:19.681 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:19.681 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.681 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:19.681 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:19.681 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.681 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.681 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:19.682 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:19.682 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.682 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.682 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:19.682 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:19.682 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:19.682 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:19.682 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:19.682 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.682 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.683 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:19.683 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:19.683 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:19.683 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.683 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:19.683 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.683 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:19.683 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.683 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:19.683 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.683 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.encryption 2023-10-05T12:49:19.684 INFO:teuthology.orchestra.run.smithi012.stdout: def test_get_bucket_encryption_kms(): 2023-10-05T12:49:19.684 INFO:teuthology.orchestra.run.smithi012.stdout: kms_keyid = get_main_kms_keyid() 2023-10-05T12:49:19.684 INFO:teuthology.orchestra.run.smithi012.stdout: if kms_keyid is None: 2023-10-05T12:49:19.684 INFO:teuthology.orchestra.run.smithi012.stdout: kms_keyid = 'fool-me-again' 2023-10-05T12:49:19.684 INFO:teuthology.orchestra.run.smithi012.stdout:> bucket_name = get_new_bucket() 2023-10-05T12:49:19.684 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.684 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:12608: 2023-10-05T12:49:19.684 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.684 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-10-05T12:49:19.685 INFO:teuthology.orchestra.run.smithi012.stdout: client.create_bucket(Bucket=name) 2023-10-05T12:49:19.685 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:19.685 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:19.685 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:19.685 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:19.685 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:19.685 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:19.685 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:19.685 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:19.685 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:19.686 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:19.686 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:19.686 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:19.686 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:19.686 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:19.686 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:19.686 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:19.686 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:19.686 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:19.687 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:19.687 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:19.687 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:19.687 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:19.687 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:19.687 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:19.687 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:19.687 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:19.687 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:19.687 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:19.688 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:19.688 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:19.688 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:19.688 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:19.688 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:19.688 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:19.688 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.688 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.688 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:19.689 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:19.689 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.689 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:19.689 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.689 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:19.689 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:19.689 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:19.689 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:19.689 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:19.690 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:19.690 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:19.690 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:19.690 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:19.690 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:19.690 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:19.690 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:19.690 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:19.690 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.690 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:19.691 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:19.691 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:19.691 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:19.691 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:19.691 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:19.691 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:19.691 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:19.691 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:19.691 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:19.691 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:19.692 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.692 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.692 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:19.692 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:19.692 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:19.692 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:19.692 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:19.692 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.692 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.692 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:19.693 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:19.693 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:19.693 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:19.693 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:19.693 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.693 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:19.693 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:19.693 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:19.693 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:19.694 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:19.694 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-521" 2023-10-05T12:49:19.694 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.694 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:19.694 INFO:teuthology.orchestra.run.smithi012.stdout:______________________ test_delete_bucket_encryption_kms _______________________ 2023-10-05T12:49:19.694 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.694 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:19.694 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.694 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:19.694 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:19.695 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.695 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:19.695 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:19.695 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:19.695 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:19.695 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:19.695 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.695 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:19.695 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:19.696 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.696 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.696 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:19.696 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:19.696 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.696 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.696 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:19.696 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.696 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:19.696 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:19.697 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.697 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.697 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:19.697 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:19.697 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.697 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:19.697 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:19.697 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:19.697 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:19.697 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:19.698 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:19.698 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:19.698 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.698 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:19.698 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:19.698 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:19.698 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:19.698 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:19.698 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:19.698 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:19.699 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:19.699 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:19.699 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.699 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:19.699 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:19.699 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:19.699 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:19.699 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.699 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:19.699 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:19.700 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:19.700 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:19.700 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.700 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.700 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:19.700 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:19.700 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:19.700 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:19.700 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.700 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.701 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:19.701 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:19.701 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:19.701 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.701 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:19.701 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.701 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:19.701 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:19.701 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.701 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:19.702 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:19.702 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:19.702 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:19.702 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:19.702 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:19.702 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.702 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:19.702 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.702 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:19.702 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.702 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:19.703 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:19.703 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.703 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:19.703 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.703 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:19.703 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:19.703 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:19.703 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:19.703 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:19.703 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:19.704 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:19.704 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:19.704 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:19.704 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:19.704 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:19.704 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:19.704 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:19.704 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.704 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:19.704 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:19.704 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:19.704 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:19.705 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:19.705 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:19.705 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:19.705 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:19.705 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:19.705 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:19.705 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:19.705 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.705 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.705 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:19.705 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.706 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:19.706 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:19.706 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:19.706 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:19.706 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:19.706 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:19.706 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:19.706 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:19.706 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:19.706 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:19.707 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:19.707 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:19.707 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:19.707 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:19.707 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:19.707 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:19.707 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:19.707 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:19.707 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:19.707 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:19.708 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:19.708 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:19.708 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:19.708 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:19.708 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:19.708 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:19.708 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:19.708 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:19.708 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.708 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.709 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:19.709 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.709 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:19.709 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:19.709 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.709 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:19.709 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:19.709 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:19.709 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:19.709 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:19.710 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.710 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:19.710 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:19.710 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.710 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.710 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:19.710 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:19.710 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.710 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.710 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:19.711 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:19.711 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:19.711 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:19.711 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:19.711 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.711 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.711 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:19.711 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:19.711 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:19.711 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.711 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:19.712 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.712 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:19.712 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.712 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:19.712 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.712 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.encryption 2023-10-05T12:49:19.712 INFO:teuthology.orchestra.run.smithi012.stdout: def test_delete_bucket_encryption_kms(): 2023-10-05T12:49:19.712 INFO:teuthology.orchestra.run.smithi012.stdout:> bucket_name = get_new_bucket() 2023-10-05T12:49:19.712 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.712 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:12651: 2023-10-05T12:49:19.712 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.713 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-10-05T12:49:19.713 INFO:teuthology.orchestra.run.smithi012.stdout: client.create_bucket(Bucket=name) 2023-10-05T12:49:19.713 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:19.713 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:19.713 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:19.713 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:19.713 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:19.713 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:19.713 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:19.713 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:19.714 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:19.714 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:19.714 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:19.714 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:19.714 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:19.714 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:19.714 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:19.714 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:19.714 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:19.714 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:19.714 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:19.715 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:19.715 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:19.715 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:19.715 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:19.715 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:19.715 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:19.715 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:19.715 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:19.715 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:19.715 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:19.716 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:19.716 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:19.716 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:19.716 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:19.716 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:19.716 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.716 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.716 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:19.716 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:19.716 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.716 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:19.717 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.717 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:19.717 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:19.717 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:19.717 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:19.717 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:19.717 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:19.717 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:19.717 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:19.717 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:19.717 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:19.718 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:19.718 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:19.718 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:19.718 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.718 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:19.718 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:19.718 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:19.718 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:19.718 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:19.719 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:19.719 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:19.719 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:19.719 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:19.719 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:19.719 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:19.719 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.719 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.719 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:19.720 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:19.720 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:19.720 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:19.720 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:19.720 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.720 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.720 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:19.720 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:19.720 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:19.720 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:19.720 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:19.721 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.721 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:19.721 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:19.721 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:19.721 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:19.721 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:19.721 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-522" 2023-10-05T12:49:19.721 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.721 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:19.721 INFO:teuthology.orchestra.run.smithi012.stdout:____________ test_sse_kms_default_post_object_authenticated_request ____________ 2023-10-05T12:49:19.721 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.722 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:19.722 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.722 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:19.722 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:19.722 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.722 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:19.722 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:19.722 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:19.722 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:19.722 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:19.723 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.723 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:19.723 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:19.723 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.723 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.723 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:19.723 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:19.723 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.723 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.723 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:19.724 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.724 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:19.724 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:19.724 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.724 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.724 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:19.724 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:19.724 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.724 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:19.724 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:19.725 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:19.725 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:19.725 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:19.725 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:19.725 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:19.725 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.725 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:19.725 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:19.725 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:19.725 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:19.725 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:19.726 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:19.726 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:19.726 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:19.726 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:19.726 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.726 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:19.726 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:19.726 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:19.726 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:19.726 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.727 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:19.727 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:19.727 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:19.727 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:19.727 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.727 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.727 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:19.727 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:19.727 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:19.727 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:19.727 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.728 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.728 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:19.728 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:19.728 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:19.728 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.728 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:19.728 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.728 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:19.728 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:19.729 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.729 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:19.729 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:19.729 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:19.729 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:19.729 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:19.729 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:19.729 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.729 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:19.729 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.729 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:19.730 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.730 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:19.730 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:19.730 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.730 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:19.730 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.730 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:19.730 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:19.730 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:19.731 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:19.731 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:19.731 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:19.731 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:19.731 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:19.731 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:19.731 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:19.731 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:19.731 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:19.731 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:19.732 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.732 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:19.732 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:19.732 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:19.732 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:19.732 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:19.732 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:19.732 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:19.732 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:19.732 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:19.733 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:19.733 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:19.733 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.733 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.733 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:19.733 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.733 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:19.733 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:19.733 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:19.733 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:19.734 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:19.734 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:19.734 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:19.734 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:19.734 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:19.734 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:19.734 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:19.734 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:19.734 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:19.734 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:19.735 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:19.735 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:19.735 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:19.735 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:19.735 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:19.735 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:19.735 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:19.735 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:19.735 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:19.735 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:19.735 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:19.736 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:19.736 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:19.736 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:19.736 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.736 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.736 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:19.736 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.736 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:19.736 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:19.736 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.737 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:19.737 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:19.737 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:19.737 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:19.737 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:19.737 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.737 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:19.737 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:19.737 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.737 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.737 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:19.738 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:19.738 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.738 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.738 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:19.738 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:19.738 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:19.738 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:19.738 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:19.738 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.738 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.739 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:19.739 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:19.739 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:19.739 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.739 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:19.739 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.739 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:19.739 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.739 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:19.740 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.740 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.encryption 2023-10-05T12:49:19.740 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.bucket_encryption 2023-10-05T12:49:19.740 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.fails_on_dbstore 2023-10-05T12:49:19.740 INFO:teuthology.orchestra.run.smithi012.stdout: def test_sse_kms_default_post_object_authenticated_request(): 2023-10-05T12:49:19.740 INFO:teuthology.orchestra.run.smithi012.stdout: kms_keyid = get_main_kms_keyid() 2023-10-05T12:49:19.740 INFO:teuthology.orchestra.run.smithi012.stdout: if kms_keyid is None: 2023-10-05T12:49:19.740 INFO:teuthology.orchestra.run.smithi012.stdout: pytest.skip('[s3 main] section missing kms_keyid') 2023-10-05T12:49:19.740 INFO:teuthology.orchestra.run.smithi012.stdout:> bucket_name = get_new_bucket() 2023-10-05T12:49:19.740 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.741 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:12895: 2023-10-05T12:49:19.741 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.741 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-10-05T12:49:19.741 INFO:teuthology.orchestra.run.smithi012.stdout: client.create_bucket(Bucket=name) 2023-10-05T12:49:19.741 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:19.741 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:19.741 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:19.741 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:19.741 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:19.741 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:19.741 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:19.742 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:19.742 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:19.742 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:19.742 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:19.742 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:19.742 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:19.742 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:19.742 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:19.742 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:19.742 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:19.743 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:19.743 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:19.743 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:19.743 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:19.743 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:19.743 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:19.743 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:19.743 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:19.743 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:19.744 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:19.744 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:19.744 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:19.744 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:19.744 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:19.744 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:19.744 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:19.744 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:19.744 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.744 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.744 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:19.745 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:19.745 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.745 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:19.745 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.745 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:19.745 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:19.745 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:19.745 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:19.745 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:19.745 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:19.745 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:19.746 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:19.746 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:19.746 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:19.746 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:19.746 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:19.746 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:19.746 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.746 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:19.746 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:19.746 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:19.747 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:19.747 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:19.747 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:19.747 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:19.747 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:19.747 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:19.747 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:19.747 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:19.747 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.747 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.747 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:19.747 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:19.748 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:19.748 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:19.748 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:19.748 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.748 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.748 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:19.748 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:19.748 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:19.748 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:19.748 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:19.749 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.749 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:19.749 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:19.749 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:19.749 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:19.749 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:19.749 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-523" 2023-10-05T12:49:19.749 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.749 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:19.749 INFO:teuthology.orchestra.run.smithi012.stdout:___________________________ test_get_object_torrent ____________________________ 2023-10-05T12:49:19.749 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.750 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:19.750 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.750 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:19.750 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:19.750 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.750 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:19.750 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:19.750 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:19.750 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:19.751 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:19.751 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.751 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:19.751 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:19.751 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.751 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.751 INFO:teuthology.orchestra.run.smithi012.stdout:> conn = connection.create_connection( 2023-10-05T12:49:19.751 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:19.751 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.751 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.751 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-10-05T12:49:19.752 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.752 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-10-05T12:49:19.752 INFO:teuthology.orchestra.run.smithi012.stdout: raise err 2023-10-05T12:49:19.752 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.752 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.752 INFO:teuthology.orchestra.run.smithi012.stdout:address = ('smithi012.front.sepia.ceph.com', 80), timeout = 60 2023-10-05T12:49:19.752 INFO:teuthology.orchestra.run.smithi012.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-10-05T12:49:19.752 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.752 INFO:teuthology.orchestra.run.smithi012.stdout: def create_connection( 2023-10-05T12:49:19.752 INFO:teuthology.orchestra.run.smithi012.stdout: address, 2023-10-05T12:49:19.753 INFO:teuthology.orchestra.run.smithi012.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-10-05T12:49:19.753 INFO:teuthology.orchestra.run.smithi012.stdout: source_address=None, 2023-10-05T12:49:19.753 INFO:teuthology.orchestra.run.smithi012.stdout: socket_options=None, 2023-10-05T12:49:19.753 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:19.753 INFO:teuthology.orchestra.run.smithi012.stdout: """Connect to *address* and return the socket object. 2023-10-05T12:49:19.753 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.753 INFO:teuthology.orchestra.run.smithi012.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-10-05T12:49:19.753 INFO:teuthology.orchestra.run.smithi012.stdout: port)``) and return the socket object. Passing the optional 2023-10-05T12:49:19.753 INFO:teuthology.orchestra.run.smithi012.stdout: *timeout* parameter will set the timeout on the socket instance 2023-10-05T12:49:19.753 INFO:teuthology.orchestra.run.smithi012.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-10-05T12:49:19.754 INFO:teuthology.orchestra.run.smithi012.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-10-05T12:49:19.754 INFO:teuthology.orchestra.run.smithi012.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-10-05T12:49:19.754 INFO:teuthology.orchestra.run.smithi012.stdout: for the socket to bind as a source address before making the connection. 2023-10-05T12:49:19.754 INFO:teuthology.orchestra.run.smithi012.stdout: An host of '' or port 0 tells the OS to use the default. 2023-10-05T12:49:19.754 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:19.754 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.754 INFO:teuthology.orchestra.run.smithi012.stdout: host, port = address 2023-10-05T12:49:19.754 INFO:teuthology.orchestra.run.smithi012.stdout: if host.startswith("["): 2023-10-05T12:49:19.754 INFO:teuthology.orchestra.run.smithi012.stdout: host = host.strip("[]") 2023-10-05T12:49:19.755 INFO:teuthology.orchestra.run.smithi012.stdout: err = None 2023-10-05T12:49:19.755 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.755 INFO:teuthology.orchestra.run.smithi012.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-10-05T12:49:19.755 INFO:teuthology.orchestra.run.smithi012.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-10-05T12:49:19.755 INFO:teuthology.orchestra.run.smithi012.stdout: # The original create_connection function always returns all records. 2023-10-05T12:49:19.755 INFO:teuthology.orchestra.run.smithi012.stdout: family = allowed_gai_family() 2023-10-05T12:49:19.755 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.755 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.755 INFO:teuthology.orchestra.run.smithi012.stdout: host.encode("idna") 2023-10-05T12:49:19.755 INFO:teuthology.orchestra.run.smithi012.stdout: except UnicodeError: 2023-10-05T12:49:19.756 INFO:teuthology.orchestra.run.smithi012.stdout: return six.raise_from( 2023-10-05T12:49:19.756 INFO:teuthology.orchestra.run.smithi012.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-10-05T12:49:19.756 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.756 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.756 INFO:teuthology.orchestra.run.smithi012.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-10-05T12:49:19.756 INFO:teuthology.orchestra.run.smithi012.stdout: af, socktype, proto, canonname, sa = res 2023-10-05T12:49:19.756 INFO:teuthology.orchestra.run.smithi012.stdout: sock = None 2023-10-05T12:49:19.756 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.756 INFO:teuthology.orchestra.run.smithi012.stdout: sock = socket.socket(af, socktype, proto) 2023-10-05T12:49:19.756 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.757 INFO:teuthology.orchestra.run.smithi012.stdout: # If provided, set socket level options before connecting. 2023-10-05T12:49:19.757 INFO:teuthology.orchestra.run.smithi012.stdout: _set_socket_options(sock, socket_options) 2023-10-05T12:49:19.757 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.757 INFO:teuthology.orchestra.run.smithi012.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-10-05T12:49:19.757 INFO:teuthology.orchestra.run.smithi012.stdout: sock.settimeout(timeout) 2023-10-05T12:49:19.757 INFO:teuthology.orchestra.run.smithi012.stdout: if source_address: 2023-10-05T12:49:19.757 INFO:teuthology.orchestra.run.smithi012.stdout: sock.bind(source_address) 2023-10-05T12:49:19.757 INFO:teuthology.orchestra.run.smithi012.stdout:> sock.connect(sa) 2023-10-05T12:49:19.757 INFO:teuthology.orchestra.run.smithi012.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-10-05T12:49:19.757 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.758 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-10-05T12:49:19.758 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.758 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:19.758 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.758 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:19.758 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:19.758 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.758 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:19.758 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.759 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:19.759 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:19.759 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:19.759 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:19.759 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:19.759 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:19.759 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:19.759 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:19.759 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:19.760 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:19.760 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:19.760 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:19.760 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:19.760 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.760 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:19.760 INFO:teuthology.orchestra.run.smithi012.stdout:> urllib_response = conn.urlopen( 2023-10-05T12:49:19.760 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:19.760 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:19.760 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:19.761 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:19.761 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:19.761 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:19.761 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:19.761 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:19.761 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:19.761 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.761 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.761 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-10-05T12:49:19.761 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.762 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:798: in urlopen 2023-10-05T12:49:19.762 INFO:teuthology.orchestra.run.smithi012.stdout: retries = retries.increment( 2023-10-05T12:49:19.762 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-10-05T12:49:19.762 INFO:teuthology.orchestra.run.smithi012.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-10-05T12:49:19.762 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-10-05T12:49:19.762 INFO:teuthology.orchestra.run.smithi012.stdout: raise value 2023-10-05T12:49:19.762 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:714: in urlopen 2023-10-05T12:49:19.762 INFO:teuthology.orchestra.run.smithi012.stdout: httplib_response = self._make_request( 2023-10-05T12:49:19.762 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:415: in _make_request 2023-10-05T12:49:19.762 INFO:teuthology.orchestra.run.smithi012.stdout: conn.request(method, url, **httplib_request_kw) 2023-10-05T12:49:19.763 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-10-05T12:49:19.763 INFO:teuthology.orchestra.run.smithi012.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-10-05T12:49:19.763 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-10-05T12:49:19.763 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-10-05T12:49:19.763 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-10-05T12:49:19.763 INFO:teuthology.orchestra.run.smithi012.stdout: rval = super()._send_request( 2023-10-05T12:49:19.763 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-10-05T12:49:19.763 INFO:teuthology.orchestra.run.smithi012.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-10-05T12:49:19.763 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-10-05T12:49:19.763 INFO:teuthology.orchestra.run.smithi012.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-10-05T12:49:19.764 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-10-05T12:49:19.764 INFO:teuthology.orchestra.run.smithi012.stdout: self.send(msg) 2023-10-05T12:49:19.764 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-10-05T12:49:19.764 INFO:teuthology.orchestra.run.smithi012.stdout: return super().send(str) 2023-10-05T12:49:19.764 INFO:teuthology.orchestra.run.smithi012.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-10-05T12:49:19.764 INFO:teuthology.orchestra.run.smithi012.stdout: self.connect() 2023-10-05T12:49:19.764 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-10-05T12:49:19.764 INFO:teuthology.orchestra.run.smithi012.stdout: conn = self._new_conn() 2023-10-05T12:49:19.764 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.764 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.765 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:19.765 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.765 INFO:teuthology.orchestra.run.smithi012.stdout: def _new_conn(self): 2023-10-05T12:49:19.765 INFO:teuthology.orchestra.run.smithi012.stdout: """Establish a socket connection and set nodelay settings on it. 2023-10-05T12:49:19.765 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.765 INFO:teuthology.orchestra.run.smithi012.stdout: :return: New socket connection. 2023-10-05T12:49:19.765 INFO:teuthology.orchestra.run.smithi012.stdout: """ 2023-10-05T12:49:19.765 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw = {} 2023-10-05T12:49:19.765 INFO:teuthology.orchestra.run.smithi012.stdout: if self.source_address: 2023-10-05T12:49:19.765 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["source_address"] = self.source_address 2023-10-05T12:49:19.766 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.766 INFO:teuthology.orchestra.run.smithi012.stdout: if self.socket_options: 2023-10-05T12:49:19.766 INFO:teuthology.orchestra.run.smithi012.stdout: extra_kw["socket_options"] = self.socket_options 2023-10-05T12:49:19.766 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.766 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.766 INFO:teuthology.orchestra.run.smithi012.stdout: conn = connection.create_connection( 2023-10-05T12:49:19.766 INFO:teuthology.orchestra.run.smithi012.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-10-05T12:49:19.766 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.766 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.767 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketTimeout: 2023-10-05T12:49:19.767 INFO:teuthology.orchestra.run.smithi012.stdout: raise ConnectTimeoutError( 2023-10-05T12:49:19.767 INFO:teuthology.orchestra.run.smithi012.stdout: self, 2023-10-05T12:49:19.767 INFO:teuthology.orchestra.run.smithi012.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-10-05T12:49:19.767 INFO:teuthology.orchestra.run.smithi012.stdout: % (self.host, self.timeout), 2023-10-05T12:49:19.767 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.767 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.767 INFO:teuthology.orchestra.run.smithi012.stdout: except SocketError as e: 2023-10-05T12:49:19.767 INFO:teuthology.orchestra.run.smithi012.stdout:> raise NewConnectionError( 2023-10-05T12:49:19.767 INFO:teuthology.orchestra.run.smithi012.stdout: self, "Failed to establish a new connection: %s" % e 2023-10-05T12:49:19.768 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.768 INFO:teuthology.orchestra.run.smithi012.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-10-05T12:49:19.768 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.768 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-10-05T12:49:19.768 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.768 INFO:teuthology.orchestra.run.smithi012.stdout:During handling of the above exception, another exception occurred: 2023-10-05T12:49:19.768 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.768 INFO:teuthology.orchestra.run.smithi012.stdout: def test_get_object_torrent(): 2023-10-05T12:49:19.768 INFO:teuthology.orchestra.run.smithi012.stdout: client = get_client() 2023-10-05T12:49:19.769 INFO:teuthology.orchestra.run.smithi012.stdout:> bucket_name = get_new_bucket() 2023-10-05T12:49:19.769 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.769 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:12980: 2023-10-05T12:49:19.769 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.769 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-10-05T12:49:19.769 INFO:teuthology.orchestra.run.smithi012.stdout: client.create_bucket(Bucket=name) 2023-10-05T12:49:19.769 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-10-05T12:49:19.769 INFO:teuthology.orchestra.run.smithi012.stdout: return self._make_api_call(operation_name, kwargs) 2023-10-05T12:49:19.769 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-10-05T12:49:19.770 INFO:teuthology.orchestra.run.smithi012.stdout: http, parsed_response = self._make_request( 2023-10-05T12:49:19.770 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-10-05T12:49:19.770 INFO:teuthology.orchestra.run.smithi012.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-10-05T12:49:19.770 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-10-05T12:49:19.770 INFO:teuthology.orchestra.run.smithi012.stdout: return self._send_request(request_dict, operation_model) 2023-10-05T12:49:19.770 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-10-05T12:49:19.770 INFO:teuthology.orchestra.run.smithi012.stdout: while self._needs_retry( 2023-10-05T12:49:19.770 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-10-05T12:49:19.770 INFO:teuthology.orchestra.run.smithi012.stdout: responses = self._event_emitter.emit( 2023-10-05T12:49:19.771 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-10-05T12:49:19.771 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-10-05T12:49:19.771 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-10-05T12:49:19.771 INFO:teuthology.orchestra.run.smithi012.stdout: return self._emit(event_name, kwargs) 2023-10-05T12:49:19.771 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-10-05T12:49:19.771 INFO:teuthology.orchestra.run.smithi012.stdout: response = handler(**kwargs) 2023-10-05T12:49:19.771 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-10-05T12:49:19.771 INFO:teuthology.orchestra.run.smithi012.stdout: if self._checker(**checker_kwargs): 2023-10-05T12:49:19.771 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-10-05T12:49:19.772 INFO:teuthology.orchestra.run.smithi012.stdout: should_retry = self._should_retry( 2023-10-05T12:49:19.772 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-10-05T12:49:19.772 INFO:teuthology.orchestra.run.smithi012.stdout: return self._checker(attempt_number, response, caught_exception) 2023-10-05T12:49:19.772 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-10-05T12:49:19.772 INFO:teuthology.orchestra.run.smithi012.stdout: checker_response = checker( 2023-10-05T12:49:19.772 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-10-05T12:49:19.772 INFO:teuthology.orchestra.run.smithi012.stdout: return self._check_caught_exception( 2023-10-05T12:49:19.772 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-10-05T12:49:19.772 INFO:teuthology.orchestra.run.smithi012.stdout: raise caught_exception 2023-10-05T12:49:19.772 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-10-05T12:49:19.773 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = self._send(request) 2023-10-05T12:49:19.773 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-10-05T12:49:19.773 INFO:teuthology.orchestra.run.smithi012.stdout: return self.http_session.send(request) 2023-10-05T12:49:19.773 INFO:teuthology.orchestra.run.smithi012.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-10-05T12:49:19.773 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.773 INFO:teuthology.orchestra.run.smithi012.stdout:self = 2023-10-05T12:49:19.773 INFO:teuthology.orchestra.run.smithi012.stdout:request = 2023-10-05T12:49:19.773 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.773 INFO:teuthology.orchestra.run.smithi012.stdout: def send(self, request): 2023-10-05T12:49:19.773 INFO:teuthology.orchestra.run.smithi012.stdout: try: 2023-10-05T12:49:19.773 INFO:teuthology.orchestra.run.smithi012.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-10-05T12:49:19.774 INFO:teuthology.orchestra.run.smithi012.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-10-05T12:49:19.774 INFO:teuthology.orchestra.run.smithi012.stdout: conn = manager.connection_from_url(request.url) 2023-10-05T12:49:19.774 INFO:teuthology.orchestra.run.smithi012.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-10-05T12:49:19.774 INFO:teuthology.orchestra.run.smithi012.stdout: if ensure_boolean( 2023-10-05T12:49:19.774 INFO:teuthology.orchestra.run.smithi012.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-10-05T12:49:19.774 INFO:teuthology.orchestra.run.smithi012.stdout: ): 2023-10-05T12:49:19.774 INFO:teuthology.orchestra.run.smithi012.stdout: # This is currently an "experimental" feature which provides 2023-10-05T12:49:19.774 INFO:teuthology.orchestra.run.smithi012.stdout: # no guarantees of backwards compatibility. It may be subject 2023-10-05T12:49:19.774 INFO:teuthology.orchestra.run.smithi012.stdout: # to change or removal in any patch version. Anyone opting in 2023-10-05T12:49:19.775 INFO:teuthology.orchestra.run.smithi012.stdout: # to this feature should strictly pin botocore. 2023-10-05T12:49:19.775 INFO:teuthology.orchestra.run.smithi012.stdout: host = urlparse(request.url).hostname 2023-10-05T12:49:19.775 INFO:teuthology.orchestra.run.smithi012.stdout: conn.proxy_headers['host'] = host 2023-10-05T12:49:19.775 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.775 INFO:teuthology.orchestra.run.smithi012.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-10-05T12:49:19.775 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response = conn.urlopen( 2023-10-05T12:49:19.775 INFO:teuthology.orchestra.run.smithi012.stdout: method=request.method, 2023-10-05T12:49:19.775 INFO:teuthology.orchestra.run.smithi012.stdout: url=request_target, 2023-10-05T12:49:19.775 INFO:teuthology.orchestra.run.smithi012.stdout: body=request.body, 2023-10-05T12:49:19.775 INFO:teuthology.orchestra.run.smithi012.stdout: headers=request.headers, 2023-10-05T12:49:19.775 INFO:teuthology.orchestra.run.smithi012.stdout: retries=Retry(False), 2023-10-05T12:49:19.776 INFO:teuthology.orchestra.run.smithi012.stdout: assert_same_host=False, 2023-10-05T12:49:19.776 INFO:teuthology.orchestra.run.smithi012.stdout: preload_content=False, 2023-10-05T12:49:19.776 INFO:teuthology.orchestra.run.smithi012.stdout: decode_content=False, 2023-10-05T12:49:19.776 INFO:teuthology.orchestra.run.smithi012.stdout: chunked=self._chunked(request.headers), 2023-10-05T12:49:19.776 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.776 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.776 INFO:teuthology.orchestra.run.smithi012.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-10-05T12:49:19.776 INFO:teuthology.orchestra.run.smithi012.stdout: request.url, 2023-10-05T12:49:19.776 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.status, 2023-10-05T12:49:19.776 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response.headers, 2023-10-05T12:49:19.776 INFO:teuthology.orchestra.run.smithi012.stdout: urllib_response, 2023-10-05T12:49:19.777 INFO:teuthology.orchestra.run.smithi012.stdout: ) 2023-10-05T12:49:19.777 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.777 INFO:teuthology.orchestra.run.smithi012.stdout: if not request.stream_output: 2023-10-05T12:49:19.777 INFO:teuthology.orchestra.run.smithi012.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-10-05T12:49:19.777 INFO:teuthology.orchestra.run.smithi012.stdout: # this way instead of using preload_content because 2023-10-05T12:49:19.777 INFO:teuthology.orchestra.run.smithi012.stdout: # preload_content will never buffer chunked responses 2023-10-05T12:49:19.777 INFO:teuthology.orchestra.run.smithi012.stdout: http_response.content 2023-10-05T12:49:19.777 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.777 INFO:teuthology.orchestra.run.smithi012.stdout: return http_response 2023-10-05T12:49:19.777 INFO:teuthology.orchestra.run.smithi012.stdout: except URLLib3SSLError as e: 2023-10-05T12:49:19.777 INFO:teuthology.orchestra.run.smithi012.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-10-05T12:49:19.778 INFO:teuthology.orchestra.run.smithi012.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-10-05T12:49:19.778 INFO:teuthology.orchestra.run.smithi012.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-10-05T12:49:19.778 INFO:teuthology.orchestra.run.smithi012.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi012.front.sepia.ceph.com:80/test-client.0-67n8q3qaqfhf9w0-524" 2023-10-05T12:49:19.778 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.778 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-10-05T12:49:19.778 INFO:teuthology.orchestra.run.smithi012.stdout:=============================== warnings summary =============================== 2023-10-05T12:49:19.778 INFO:teuthology.orchestra.run.smithi012.stdout:.tox/py/lib/python3.9/site-packages/boto/plugin.py:40 2023-10-05T12:49:19.778 INFO:teuthology.orchestra.run.smithi012.stdout: /home/ubuntu/cephtest/s3-tests-client.0/.tox/py/lib/python3.9/site-packages/boto/plugin.py:40: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses 2023-10-05T12:49:19.778 INFO:teuthology.orchestra.run.smithi012.stdout: import imp 2023-10-05T12:49:19.779 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.779 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests/functional/test_headers.py:124 2023-10-05T12:49:19.779 INFO:teuthology.orchestra.run.smithi012.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_headers.py:124: SyntaxWarning: "is" with a literal. Did you mean "=="? 2023-10-05T12:49:19.779 INFO:teuthology.orchestra.run.smithi012.stdout: if boto_type is 'S3Connection': 2023-10-05T12:49:19.779 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.779 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests/functional/test_headers.py:129 2023-10-05T12:49:19.779 INFO:teuthology.orchestra.run.smithi012.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_headers.py:129: SyntaxWarning: "is" with a literal. Did you mean "=="? 2023-10-05T12:49:19.779 INFO:teuthology.orchestra.run.smithi012.stdout: elif boto_type is 'HTTPRequest': 2023-10-05T12:49:19.779 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.780 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests/functional/test_s3.py:359 2023-10-05T12:49:19.780 INFO:teuthology.orchestra.run.smithi012.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3.py:359: DeprecationWarning: invalid escape sequence \W 2023-10-05T12:49:19.780 INFO:teuthology.orchestra.run.smithi012.stdout: extra_sc = re.split('\W+', config['main']['storage_classes']) 2023-10-05T12:49:19.780 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.780 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests/functional/test_s3_website.py:176 2023-10-05T12:49:19.780 INFO:teuthology.orchestra.run.smithi012.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3_website.py:176: SyntaxWarning: "is" with a literal. Did you mean "=="? 2023-10-05T12:49:19.780 INFO:teuthology.orchestra.run.smithi012.stdout: if k is 'BucketName': 2023-10-05T12:49:19.780 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.780 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests/functional/test_s3_website.py:253 2023-10-05T12:49:19.780 INFO:teuthology.orchestra.run.smithi012.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3_website.py:253: PytestUnknownMarkWarning: Unknown pytest.mark.timeout - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/stable/how-to/mark.html 2023-10-05T12:49:19.780 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.timeout(10) 2023-10-05T12:49:19.781 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.781 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests/functional/test_s3_website.py:1077 2023-10-05T12:49:19.781 INFO:teuthology.orchestra.run.smithi012.stdout: s3tests/functional/test_s3_website.py:1077: PytestCollectionWarning: yield tests were removed in pytest 4.0 - test_routing_generator will be ignored 2023-10-05T12:49:19.781 INFO:teuthology.orchestra.run.smithi012.stdout: @pytest.mark.s3website_routing_rules 2023-10-05T12:49:19.781 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.781 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:2212 2023-10-05T12:49:19.781 INFO:teuthology.orchestra.run.smithi012.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2212: DeprecationWarning: invalid escape sequence \$ 2023-10-05T12:49:19.781 INFO:teuthology.orchestra.run.smithi012.stdout: ["starts-with", "$key", "\$foo"],\ 2023-10-05T12:49:19.781 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.781 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:2227 2023-10-05T12:49:19.782 INFO:teuthology.orchestra.run.smithi012.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2227: DeprecationWarning: invalid escape sequence \$ 2023-10-05T12:49:19.782 INFO:teuthology.orchestra.run.smithi012.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2023-10-05T12:49:19.782 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.782 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:2233 2023-10-05T12:49:19.782 INFO:teuthology.orchestra.run.smithi012.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2233: DeprecationWarning: invalid escape sequence \$ 2023-10-05T12:49:19.782 INFO:teuthology.orchestra.run.smithi012.stdout: response = client.get_object(Bucket=bucket_name, Key='\$foo.txt') 2023-10-05T12:49:19.782 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.782 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:2290 2023-10-05T12:49:19.782 INFO:teuthology.orchestra.run.smithi012.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2290: DeprecationWarning: invalid escape sequence \$ 2023-10-05T12:49:19.782 INFO:teuthology.orchestra.run.smithi012.stdout: ["starts-with", "$key", "\$foo"],\ 2023-10-05T12:49:19.783 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.783 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:2305 2023-10-05T12:49:19.783 INFO:teuthology.orchestra.run.smithi012.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2305: DeprecationWarning: invalid escape sequence \$ 2023-10-05T12:49:19.783 INFO:teuthology.orchestra.run.smithi012.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2023-10-05T12:49:19.783 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.783 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:2323 2023-10-05T12:49:19.783 INFO:teuthology.orchestra.run.smithi012.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2323: DeprecationWarning: invalid escape sequence \$ 2023-10-05T12:49:19.783 INFO:teuthology.orchestra.run.smithi012.stdout: ["starts-with", "$key", "\$foo"],\ 2023-10-05T12:49:19.783 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.783 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:2338 2023-10-05T12:49:19.784 INFO:teuthology.orchestra.run.smithi012.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2338: DeprecationWarning: invalid escape sequence \$ 2023-10-05T12:49:19.784 INFO:teuthology.orchestra.run.smithi012.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id[::-1]),\ 2023-10-05T12:49:19.784 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.784 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:2356 2023-10-05T12:49:19.784 INFO:teuthology.orchestra.run.smithi012.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2356: DeprecationWarning: invalid escape sequence \$ 2023-10-05T12:49:19.784 INFO:teuthology.orchestra.run.smithi012.stdout: ["starts-with", "$key", "\$foo"],\ 2023-10-05T12:49:19.784 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.784 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:2371 2023-10-05T12:49:19.784 INFO:teuthology.orchestra.run.smithi012.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2371: DeprecationWarning: invalid escape sequence \$ 2023-10-05T12:49:19.784 INFO:teuthology.orchestra.run.smithi012.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2023-10-05T12:49:19.785 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.785 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:2421 2023-10-05T12:49:19.785 INFO:teuthology.orchestra.run.smithi012.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2421: DeprecationWarning: invalid escape sequence \$ 2023-10-05T12:49:19.785 INFO:teuthology.orchestra.run.smithi012.stdout: ["starts-with", "$key", "\$foo"],\ 2023-10-05T12:49:19.785 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.785 INFO:teuthology.orchestra.run.smithi012.stdout:s3tests_boto3/functional/test_s3.py:2453 2023-10-05T12:49:19.785 INFO:teuthology.orchestra.run.smithi012.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2453: DeprecationWarning: invalid escape sequence \$ 2023-10-05T12:49:19.785 INFO:teuthology.orchestra.run.smithi012.stdout: ["starts-with", "$key", "\$foo"],\ 2023-10-05T12:49:19.785 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-05T12:49:19.785 INFO:teuthology.orchestra.run.smithi012.stdout:-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html 2023-10-05T12:49:19.786 INFO:teuthology.orchestra.run.smithi012.stdout:=========================== short test summary info ============================ 2023-10-05T12:49:19.786 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests/functional/test_s3.py::test_atomic_dual_conditional_write_1mb 2023-10-05T12:49:19.786 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_bucket_list_return_data - as... 2023-10-05T12:49:19.786 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_bucket_list_return_data_versioning 2023-10-05T12:49:19.786 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_get_object_ifmatch_failed - ... 2023-10-05T12:49:19.786 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_get_object_ifnonematch_good 2023-10-05T12:49:19.786 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_get_object_ifmodifiedsince_failed 2023-10-05T12:49:19.786 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_get_object_ifunmodifiedsince_good 2023-10-05T12:49:19.786 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_good - As... 2023-10-05T12:49:19.786 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_object_put_acl_mtime - asser... 2023-10-05T12:49:19.787 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_multipart_copy_special_names 2023-10-05T12:49:19.787 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_multipart_copy_versioned - b... 2023-10-05T12:49:19.787 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_multipart_copy_multiple_sizes 2023-10-05T12:49:19.787 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_atomic_read_4mb - s3transfer... 2023-10-05T12:49:19.787 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_atomic_read_8mb - botocore.e... 2023-10-05T12:49:19.787 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_atomic_write_1mb - botocore.... 2023-10-05T12:49:19.787 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_atomic_write_4mb - botocore.... 2023-10-05T12:49:19.787 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_atomic_write_8mb - botocore.... 2023-10-05T12:49:19.787 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_1mb - boto... 2023-10-05T12:49:19.788 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_4mb - boto... 2023-10-05T12:49:19.788 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_8mb - boto... 2023-10-05T12:49:19.788 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_atomic_conditional_write_1mb 2023-10-05T12:49:19.788 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_atomic_multipart_upload_write 2023-10-05T12:49:19.788 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_multipart_resend_first_finishes_last 2023-10-05T12:49:19.788 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_ranged_request_response_code 2023-10-05T12:49:19.788 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_ranged_big_request_response_code 2023-10-05T12:49:19.788 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_ranged_request_skip_leading_bytes_response_code 2023-10-05T12:49:19.788 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_ranged_request_return_trailing_bytes_response_code 2023-10-05T12:49:19.788 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_ranged_request_invalid_range 2023-10-05T12:49:19.789 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_ranged_request_empty_object 2023-10-05T12:49:19.789 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_versioning_bucket_create_suspend 2023-10-05T12:49:19.789 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_read_remove 2023-10-05T12:49:19.789 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_read_remove_head 2023-10-05T12:49:19.789 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_removal 2023-10-05T12:49:19.789 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_overwrite 2023-10-05T12:49:19.789 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_overwrite_suspended 2023-10-05T12:49:19.789 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_versioning_obj_suspend_versions 2023-10-05T12:49:19.789 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_versions_remove_all 2023-10-05T12:49:19.789 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_versions_remove_special_names 2023-10-05T12:49:19.790 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_overwrite_multipart 2023-10-05T12:49:19.790 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_versioning_obj_list_marker 2023-10-05T12:49:19.790 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_versioning_copy_obj_version 2023-10-05T12:49:19.790 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete 2023-10-05T12:49:19.790 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete_with_marker 2023-10-05T12:49:19.790 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete_with_marker_create 2023-10-05T12:49:19.790 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_versioned_object_acl - botoc... 2023-10-05T12:49:19.790 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_versioned_object_acl_no_version_specified 2023-10-05T12:49:19.790 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_versioned_concurrent_object_create_and_remove 2023-10-05T12:49:19.790 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_lifecycle_set - botocore.exc... 2023-10-05T12:49:19.791 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_lifecycle_get - botocore.exc... 2023-10-05T12:49:19.791 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_lifecycle_get_no_id - botoco... 2023-10-05T12:49:19.791 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_lifecycle_id_too_long - boto... 2023-10-05T12:49:19.791 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_lifecycle_same_id - botocore... 2023-10-05T12:49:19.791 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_lifecycle_invalid_status - b... 2023-10-05T12:49:19.791 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_lifecycle_set_date - botocor... 2023-10-05T12:49:19.791 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_lifecycle_set_invalid_date 2023-10-05T12:49:19.791 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_lifecycle_set_noncurrent - b... 2023-10-05T12:49:19.791 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_lifecycle_set_deletemarker 2023-10-05T12:49:19.791 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_lifecycle_set_filter - botoc... 2023-10-05T12:49:19.792 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_lifecycle_set_empty_filter 2023-10-05T12:49:19.792 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_lifecycle_set_multipart - bo... 2023-10-05T12:49:19.792 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_lifecycle_transition_set_invalid_date 2023-10-05T12:49:19.792 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1b - boto... 2023-10-05T12:49:19.792 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1kb - bot... 2023-10-05T12:49:19.792 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1MB - bot... 2023-10-05T12:49:19.792 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_13b - bot... 2023-10-05T12:49:19.792 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_method_head 2023-10-05T12:49:19.792 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_present - b... 2023-10-05T12:49:19.792 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_other_key 2023-10-05T12:49:19.792 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_invalid_md5 2023-10-05T12:49:19.793 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_no_md5 - bo... 2023-10-05T12:49:19.793 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_no_key - bo... 2023-10-05T12:49:19.793 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_encryption_key_no_sse_c - bo... 2023-10-05T12:49:19.793 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_multipart_upload 2023-10-05T12:49:19.793 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_unaligned_multipart_upload 2023-10-05T12:49:19.793 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_multipart_bad_download 2023-10-05T12:49:19.793 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_post_object_authenticated_request 2023-10-05T12:49:19.793 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_sse_kms_method_head - botoco... 2023-10-05T12:49:19.793 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_sse_kms_present - botocore.e... 2023-10-05T12:49:19.793 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_sse_kms_no_key - botocore.ex... 2023-10-05T12:49:19.793 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_sse_kms_not_declared - botoc... 2023-10-05T12:49:19.794 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_upload - b... 2023-10-05T12:49:19.794 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_invalid_chunks_1 2023-10-05T12:49:19.794 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_invalid_chunks_2 2023-10-05T12:49:19.794 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_sse_kms_post_object_authenticated_request 2023-10-05T12:49:19.794 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1b - botoco... 2023-10-05T12:49:19.794 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1kb - botoc... 2023-10-05T12:49:19.794 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1MB - botoc... 2023-10-05T12:49:19.794 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_13b - botoc... 2023-10-05T12:49:19.794 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_sse_kms_read_declare - botoc... 2023-10-05T12:49:19.795 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_bucket_policy - botocore.exc... 2023-10-05T12:49:19.795 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_bucketv2_policy - botocore.e... 2023-10-05T12:49:19.795 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_bucket_policy_acl - botocore... 2023-10-05T12:49:19.795 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_bucketv2_policy_acl - botoco... 2023-10-05T12:49:19.795 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_bucket_policy_another_bucket 2023-10-05T12:49:19.795 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_bucketv2_policy_another_bucket 2023-10-05T12:49:19.795 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_get_obj_tagging - botocore.e... 2023-10-05T12:49:19.795 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_get_obj_head_tagging - botoc... 2023-10-05T12:49:19.795 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_put_max_tags - botocore.exce... 2023-10-05T12:49:19.795 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_put_excess_tags - botocore.e... 2023-10-05T12:49:19.795 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_put_max_kvsize_tags - botoco... 2023-10-05T12:49:19.796 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_put_excess_key_tags - botoco... 2023-10-05T12:49:19.796 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_put_excess_val_tags - botoco... 2023-10-05T12:49:19.796 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_put_modify_tags - botocore.e... 2023-10-05T12:49:19.796 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_put_delete_tags - botocore.e... 2023-10-05T12:49:19.796 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_post_object_tags_anonymous_request 2023-10-05T12:49:19.796 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_post_object_tags_authenticated_request 2023-10-05T12:49:19.796 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_put_obj_with_tags - botocore... 2023-10-05T12:49:19.796 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_get_tags_acl_public - botoco... 2023-10-05T12:49:19.796 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_put_tags_acl_public - botoco... 2023-10-05T12:49:19.796 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_delete_tags_obj_public - bot... 2023-10-05T12:49:19.797 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_versioning_bucket_atomic_upload_return_version_id 2023-10-05T12:49:19.797 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_versioning_bucket_multipart_upload_return_version_id 2023-10-05T12:49:19.797 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_existing_tag 2023-10-05T12:49:19.797 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_tagging_existing_tag 2023-10-05T12:49:19.797 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_tagging_existing_tag 2023-10-05T12:49:19.797 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_copy_source 2023-10-05T12:49:19.797 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_copy_source_meta 2023-10-05T12:49:19.797 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_acl - ... 2023-10-05T12:49:19.797 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_grant 2023-10-05T12:49:19.797 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_c_s3 - ... 2023-10-05T12:49:19.798 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_c_kms 2023-10-05T12:49:19.798 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_s3_kms 2023-10-05T12:49:19.798 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_bad_enc_kms 2023-10-05T12:49:19.798 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_kms_noenc 2023-10-05T12:49:19.798 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_kms_s3 2023-10-05T12:49:19.798 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_acl_existing_tag 2023-10-05T12:49:19.798 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock - b... 2023-10-05T12:49:19.798 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_bucket 2023-10-05T12:49:19.798 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_with_days_and_years 2023-10-05T12:49:19.798 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_days 2023-10-05T12:49:19.799 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_years 2023-10-05T12:49:19.799 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_mode 2023-10-05T12:49:19.799 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_status 2023-10-05T12:49:19.799 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_object_lock_suspend_versioning 2023-10-05T12:49:19.799 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_lock - b... 2023-10-05T12:49:19.799 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_lock_invalid_bucket 2023-10-05T12:49:19.799 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention 2023-10-05T12:49:19.799 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_invalid_bucket 2023-10-05T12:49:19.799 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_invalid_mode 2023-10-05T12:49:19.799 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention 2023-10-05T12:49:19.799 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention_iso8601 2023-10-05T12:49:19.800 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention_invalid_bucket 2023-10-05T12:49:19.800 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_versionid 2023-10-05T12:49:19.800 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_override_default_retention 2023-10-05T12:49:19.800 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_increase_period 2023-10-05T12:49:19.800 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_shorten_period 2023-10-05T12:49:19.800 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_shorten_period_bypass 2023-10-05T12:49:19.800 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_retention 2023-10-05T12:49:19.800 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_retention_and_marker 2023-10-05T12:49:19.800 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_object_lock_multi_delete_object_with_retention 2023-10-05T12:49:19.800 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold 2023-10-05T12:49:19.800 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold_invalid_bucket 2023-10-05T12:49:19.801 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold_invalid_status 2023-10-05T12:49:19.801 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_object_lock_get_legal_hold 2023-10-05T12:49:19.801 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_object_lock_get_legal_hold_invalid_bucket 2023-10-05T12:49:19.801 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_legal_hold_on 2023-10-05T12:49:19.801 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_legal_hold_off 2023-10-05T12:49:19.801 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_metadata 2023-10-05T12:49:19.801 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_object_lock_uploading_obj - ... 2023-10-05T12:49:19.801 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_governance_with_bypass 2023-10-05T12:49:19.801 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_governance_without_bypass 2023-10-05T12:49:19.801 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_compliance 2023-10-05T12:49:19.802 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_copy_object_ifmatch_good - b... 2023-10-05T12:49:19.802 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_copy_object_ifnonematch_failed 2023-10-05T12:49:19.802 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_get_bucket_policy_status - b... 2023-10-05T12:49:19.802 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_get_public_acl_bucket_policy_status 2023-10-05T12:49:19.802 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_get_authpublic_acl_bucket_policy_status 2023-10-05T12:49:19.802 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_get_publicpolicy_acl_bucket_policy_status 2023-10-05T12:49:19.802 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_get_nonpublicpolicy_acl_bucket_policy_status 2023-10-05T12:49:19.802 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_get_nonpublicpolicy_deny_bucket_policy_status 2023-10-05T12:49:19.802 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_get_default_public_block - b... 2023-10-05T12:49:19.803 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_put_public_block - botocore.... 2023-10-05T12:49:19.803 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_block_public_put_bucket_acls 2023-10-05T12:49:19.803 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_block_public_object_canned_acls 2023-10-05T12:49:19.803 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_block_public_policy - botoco... 2023-10-05T12:49:19.803 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_ignore_public_acls - botocor... 2023-10-05T12:49:19.803 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_multipart_upload_on_a_bucket_with_policy 2023-10-05T12:49:19.803 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_put_bucket_encryption_kms - ... 2023-10-05T12:49:19.803 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_get_bucket_encryption_kms - ... 2023-10-05T12:49:19.803 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_delete_bucket_encryption_kms 2023-10-05T12:49:19.803 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_sse_kms_default_post_object_authenticated_request 2023-10-05T12:49:19.804 INFO:teuthology.orchestra.run.smithi012.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_get_object_torrent - botocor... 2023-10-05T12:49:19.804 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_atomic_read_8mb - botocore.ex... 2023-10-05T12:49:19.804 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_atomic_write_1mb - botocore.e... 2023-10-05T12:49:19.804 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_atomic_write_4mb - botocore.e... 2023-10-05T12:49:19.804 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_atomic_write_8mb - botocore.e... 2023-10-05T12:49:19.804 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_1mb - botoc... 2023-10-05T12:49:19.804 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_4mb - botoc... 2023-10-05T12:49:19.804 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_8mb - botoc... 2023-10-05T12:49:19.804 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_atomic_conditional_write_1mb 2023-10-05T12:49:19.804 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_atomic_multipart_upload_write 2023-10-05T12:49:19.804 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_multipart_resend_first_finishes_last 2023-10-05T12:49:19.805 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_ranged_request_response_code 2023-10-05T12:49:19.805 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_ranged_big_request_response_code 2023-10-05T12:49:19.805 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_ranged_request_skip_leading_bytes_response_code 2023-10-05T12:49:19.805 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_ranged_request_return_trailing_bytes_response_code 2023-10-05T12:49:19.805 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_ranged_request_invalid_range 2023-10-05T12:49:19.805 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_ranged_request_empty_object 2023-10-05T12:49:19.805 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_versioning_bucket_create_suspend 2023-10-05T12:49:19.805 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_read_remove 2023-10-05T12:49:19.805 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_read_remove_head 2023-10-05T12:49:19.805 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_removal 2023-10-05T12:49:19.806 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_overwrite 2023-10-05T12:49:19.806 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_overwrite_suspended 2023-10-05T12:49:19.806 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_versioning_obj_suspend_versions 2023-10-05T12:49:19.806 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_versions_remove_all 2023-10-05T12:49:19.806 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_versions_remove_special_names 2023-10-05T12:49:19.806 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_overwrite_multipart 2023-10-05T12:49:19.806 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_versioning_obj_list_marker - ... 2023-10-05T12:49:19.806 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_versioning_copy_obj_version 2023-10-05T12:49:19.806 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete 2023-10-05T12:49:19.806 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete_with_marker 2023-10-05T12:49:19.806 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete_with_marker_create 2023-10-05T12:49:19.807 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_versioned_object_acl - botoco... 2023-10-05T12:49:19.807 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_versioned_object_acl_no_version_specified 2023-10-05T12:49:19.807 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_versioned_concurrent_object_create_and_remove 2023-10-05T12:49:19.807 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_lifecycle_set - botocore.exce... 2023-10-05T12:49:19.807 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_lifecycle_get - botocore.exce... 2023-10-05T12:49:19.807 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_lifecycle_get_no_id - botocor... 2023-10-05T12:49:19.807 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_lifecycle_id_too_long - botoc... 2023-10-05T12:49:19.807 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_lifecycle_same_id - botocore.... 2023-10-05T12:49:19.807 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_lifecycle_invalid_status - bo... 2023-10-05T12:49:19.807 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_lifecycle_set_date - botocore... 2023-10-05T12:49:19.807 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_lifecycle_set_invalid_date - ... 2023-10-05T12:49:19.808 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_lifecycle_set_noncurrent - bo... 2023-10-05T12:49:19.808 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_lifecycle_set_deletemarker - ... 2023-10-05T12:49:19.808 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_lifecycle_set_filter - botoco... 2023-10-05T12:49:19.808 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_lifecycle_set_empty_filter - ... 2023-10-05T12:49:19.808 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_lifecycle_set_multipart - bot... 2023-10-05T12:49:19.808 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_lifecycle_transition_set_invalid_date 2023-10-05T12:49:19.808 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1b - botoc... 2023-10-05T12:49:19.808 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1kb - boto... 2023-10-05T12:49:19.808 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1MB - boto... 2023-10-05T12:49:19.808 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_13b - boto... 2023-10-05T12:49:19.809 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_method_head 2023-10-05T12:49:19.809 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_present - bo... 2023-10-05T12:49:19.809 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_other_key - ... 2023-10-05T12:49:19.809 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_invalid_md5 2023-10-05T12:49:19.809 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_no_md5 - bot... 2023-10-05T12:49:19.809 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_no_key - bot... 2023-10-05T12:49:19.809 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_encryption_key_no_sse_c - bot... 2023-10-05T12:49:19.809 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_multipart_upload 2023-10-05T12:49:19.809 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_unaligned_multipart_upload 2023-10-05T12:49:19.809 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_multipart_bad_download 2023-10-05T12:49:19.809 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_post_object_authenticated_request 2023-10-05T12:49:19.810 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_sse_kms_method_head - botocor... 2023-10-05T12:49:19.810 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_sse_kms_present - botocore.ex... 2023-10-05T12:49:19.810 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_sse_kms_no_key - botocore.exc... 2023-10-05T12:49:19.810 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_sse_kms_not_declared - botoco... 2023-10-05T12:49:19.810 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_upload - bo... 2023-10-05T12:49:19.810 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_invalid_chunks_1 2023-10-05T12:49:19.810 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_invalid_chunks_2 2023-10-05T12:49:19.810 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_sse_kms_post_object_authenticated_request 2023-10-05T12:49:19.810 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1b - botocor... 2023-10-05T12:49:19.810 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1kb - botoco... 2023-10-05T12:49:19.811 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1MB - botoco... 2023-10-05T12:49:19.811 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_13b - botoco... 2023-10-05T12:49:19.811 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_sse_kms_read_declare - botoco... 2023-10-05T12:49:19.811 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_policy - botocore.exce... 2023-10-05T12:49:19.811 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucketv2_policy - botocore.ex... 2023-10-05T12:49:19.811 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_policy_acl - botocore.... 2023-10-05T12:49:19.811 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucketv2_policy_acl - botocor... 2023-10-05T12:49:19.811 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_policy_another_bucket 2023-10-05T12:49:19.811 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucketv2_policy_another_bucket 2023-10-05T12:49:19.811 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_get_obj_tagging - botocore.ex... 2023-10-05T12:49:19.811 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_get_obj_head_tagging - botoco... 2023-10-05T12:49:19.812 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_put_max_tags - botocore.excep... 2023-10-05T12:49:19.812 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_put_excess_tags - botocore.ex... 2023-10-05T12:49:19.812 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_put_max_kvsize_tags - botocor... 2023-10-05T12:49:19.812 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_put_excess_key_tags - botocor... 2023-10-05T12:49:19.812 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_put_excess_val_tags - botocor... 2023-10-05T12:49:19.812 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_put_modify_tags - botocore.ex... 2023-10-05T12:49:19.812 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_put_delete_tags - botocore.ex... 2023-10-05T12:49:19.812 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_post_object_tags_anonymous_request 2023-10-05T12:49:19.812 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_post_object_tags_authenticated_request 2023-10-05T12:49:19.812 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_put_obj_with_tags - botocore.... 2023-10-05T12:49:19.812 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_get_tags_acl_public - botocor... 2023-10-05T12:49:19.813 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_put_tags_acl_public - botocor... 2023-10-05T12:49:19.813 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_delete_tags_obj_public - boto... 2023-10-05T12:49:19.813 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_versioning_bucket_atomic_upload_return_version_id 2023-10-05T12:49:19.813 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_versioning_bucket_multipart_upload_return_version_id 2023-10-05T12:49:19.813 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_existing_tag 2023-10-05T12:49:19.813 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_tagging_existing_tag 2023-10-05T12:49:19.813 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_tagging_existing_tag 2023-10-05T12:49:19.813 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_copy_source 2023-10-05T12:49:19.813 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_copy_source_meta 2023-10-05T12:49:19.813 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_acl - b... 2023-10-05T12:49:19.814 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_grant 2023-10-05T12:49:19.814 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_c_s3 - b... 2023-10-05T12:49:19.814 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_c_kms - ... 2023-10-05T12:49:19.814 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_s3_kms 2023-10-05T12:49:19.814 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_bad_enc_kms 2023-10-05T12:49:19.814 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_kms_noenc 2023-10-05T12:49:19.814 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_kms_s3 2023-10-05T12:49:19.814 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_acl_existing_tag 2023-10-05T12:49:19.814 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock - bo... 2023-10-05T12:49:19.815 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_bucket 2023-10-05T12:49:19.815 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_with_days_and_years 2023-10-05T12:49:19.815 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_days 2023-10-05T12:49:19.815 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_years 2023-10-05T12:49:19.815 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_mode 2023-10-05T12:49:19.815 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_status 2023-10-05T12:49:19.815 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_suspend_versioning 2023-10-05T12:49:19.815 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_lock - bo... 2023-10-05T12:49:19.815 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_lock_invalid_bucket 2023-10-05T12:49:19.815 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention 2023-10-05T12:49:19.815 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_invalid_bucket 2023-10-05T12:49:19.816 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_invalid_mode 2023-10-05T12:49:19.816 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention 2023-10-05T12:49:19.816 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention_iso8601 2023-10-05T12:49:19.816 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention_invalid_bucket 2023-10-05T12:49:19.816 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_versionid 2023-10-05T12:49:19.816 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_override_default_retention 2023-10-05T12:49:19.816 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_increase_period 2023-10-05T12:49:19.816 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_shorten_period 2023-10-05T12:49:19.816 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_shorten_period_bypass 2023-10-05T12:49:19.816 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_retention 2023-10-05T12:49:19.816 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_retention_and_marker 2023-10-05T12:49:19.817 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_multi_delete_object_with_retention 2023-10-05T12:49:19.817 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold - ... 2023-10-05T12:49:19.817 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold_invalid_bucket 2023-10-05T12:49:19.817 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold_invalid_status 2023-10-05T12:49:19.817 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_get_legal_hold - ... 2023-10-05T12:49:19.817 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_get_legal_hold_invalid_bucket 2023-10-05T12:49:19.817 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_legal_hold_on 2023-10-05T12:49:19.817 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_legal_hold_off 2023-10-05T12:49:19.817 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_metadata 2023-10-05T12:49:19.817 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_uploading_obj - b... 2023-10-05T12:49:19.818 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_governance_with_bypass 2023-10-05T12:49:19.818 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_governance_without_bypass 2023-10-05T12:49:19.818 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_compliance 2023-10-05T12:49:19.818 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_copy_object_ifmatch_good - bo... 2023-10-05T12:49:19.818 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_copy_object_ifnonematch_failed 2023-10-05T12:49:19.818 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_get_bucket_policy_status - bo... 2023-10-05T12:49:19.818 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_get_public_acl_bucket_policy_status 2023-10-05T12:49:19.818 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_get_authpublic_acl_bucket_policy_status 2023-10-05T12:49:19.818 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_get_publicpolicy_acl_bucket_policy_status 2023-10-05T12:49:19.819 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_get_nonpublicpolicy_acl_bucket_policy_status 2023-10-05T12:49:19.819 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_get_nonpublicpolicy_deny_bucket_policy_status 2023-10-05T12:49:19.819 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_get_default_public_block - bo... 2023-10-05T12:49:19.819 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_put_public_block - botocore.e... 2023-10-05T12:49:19.819 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_block_public_put_bucket_acls 2023-10-05T12:49:19.819 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_block_public_object_canned_acls 2023-10-05T12:49:19.819 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_block_public_policy - botocor... 2023-10-05T12:49:19.819 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_ignore_public_acls - botocore... 2023-10-05T12:49:19.819 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_multipart_upload_on_a_bucket_with_policy 2023-10-05T12:49:19.819 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_put_bucket_encryption_kms - b... 2023-10-05T12:49:19.820 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_get_bucket_encryption_kms - b... 2023-10-05T12:49:19.820 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_delete_bucket_encryption_kms 2023-10-05T12:49:19.820 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_sse_kms_default_post_object_authenticated_request 2023-10-05T12:49:19.821 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_get_object_torrent - botocore... 2023-10-05T12:49:19.821 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_generate_where_clause 2023-10-05T12:49:19.821 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_generate_projection - b... 2023-10-05T12:49:19.821 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_count_operation - botoc... 2023-10-05T12:49:19.821 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_count_json_operation - ... 2023-10-05T12:49:19.821 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_json_column_sum_min_max 2023-10-05T12:49:19.821 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_json_nullif_expressions 2023-10-05T12:49:19.821 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_column_sum_min_max - bo... 2023-10-05T12:49:19.822 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_nullif_expressions - bo... 2023-10-05T12:49:19.822 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_nulliftrue_expressions 2023-10-05T12:49:19.822 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_is_not_null_expressions 2023-10-05T12:49:19.822 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_lowerupper_expressions 2023-10-05T12:49:19.822 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_in_expressions - botoco... 2023-10-05T12:49:19.822 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_true_false_in_expressions 2023-10-05T12:49:19.822 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_like_expressions - boto... 2023-10-05T12:49:19.822 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_truefalselike_expressions 2023-10-05T12:49:19.822 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_complex_expressions - b... 2023-10-05T12:49:19.822 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_alias - botocore.except... 2023-10-05T12:49:19.823 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_alias_cyclic_refernce 2023-10-05T12:49:19.823 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_datetime - botocore.exc... 2023-10-05T12:49:19.823 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_true_false_datetime - b... 2023-10-05T12:49:19.823 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_csv_parser - botocore.e... 2023-10-05T12:49:19.823 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_csv_definition - botoco... 2023-10-05T12:49:19.823 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_schema_definition - bot... 2023-10-05T12:49:19.823 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_when_then_else_expressions 2023-10-05T12:49:19.823 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_coalesce_expressions - ... 2023-10-05T12:49:19.823 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_cast_expressions - boto... 2023-10-05T12:49:19.824 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_version - botocore.exce... 2023-10-05T12:49:19.824 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_trim_expressions - boto... 2023-10-05T12:49:19.824 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_truefalse_trim_expressions 2023-10-05T12:49:19.824 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_escape_expressions - bo... 2023-10-05T12:49:19.824 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_case_value_expressions 2023-10-05T12:49:19.824 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_bool_cast_expressions 2023-10-05T12:49:19.824 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_progress_expressions - ... 2023-10-05T12:49:19.824 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_output_serial_expressions 2023-10-05T12:49:19.824 INFO:teuthology.orchestra.run.smithi012.stdout:= 182 failed, 378 passed, 65 skipped, 124 deselected, 1 xfailed, 18 warnings, 203 errors in 3504.30s (0:58:24) = 2023-10-05T12:49:19.824 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: InvocationError for command /home/ubuntu/cephtest/s3-tests-client.0/.tox/py/bin/pytest -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3' (exited with code 1) 2023-10-05T12:49:19.825 INFO:teuthology.orchestra.run.smithi012.stdout:___________________________________ summary ____________________________________ 2023-10-05T12:49:19.825 INFO:teuthology.orchestra.run.smithi012.stdout:ERROR: py: commands failed 2023-10-05T12:49:19.825 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/contextutil.py", line 30, in nested vars.append(enter()) File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_pritha-srivastava_ceph_38321be854743c0d616618a9ea8aa0b1d4dbc0bf/qa/tasks/s3tests.py", line 398, in run_tests toxvenv_sh(ctx, remote, args, label="s3 tests against rgw") File "/home/teuthworker/src/github.com_pritha-srivastava_ceph_38321be854743c0d616618a9ea8aa0b1d4dbc0bf/qa/tasks/s3tests.py", line 353, in toxvenv_sh return remote.sh(['source', activate, run.Raw('&&')] + args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 96, in sh proc = self.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (s3 tests against rgw) on smithi012 with status 1: "source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/s3-tests-client.0 && S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto-client.0.cfg REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt tox -- -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3'" 2023-10-05T12:49:19.828 INFO:tasks.s3tests:Cleaning up boto... 2023-10-05T12:49:19.828 DEBUG:teuthology.orchestra.run.smithi012:> rm /home/ubuntu/cephtest/boto-client.0.cfg 2023-10-05T12:49:19.864 DEBUG:teuthology.orchestra.run.smithi012:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid foo.client.0 --purge-data --cluster ceph 2023-10-05T12:49:19.965 INFO:teuthology.orchestra.run.smithi012.stderr:ignoring --setuser ceph since I am not root 2023-10-05T12:49:19.965 INFO:teuthology.orchestra.run.smithi012.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T12:54:19.967 INFO:teuthology.orchestra.run.smithi012.stderr:failed to fetch mon config (--no-mon-config to skip) 2023-10-05T12:54:20.059 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-05T12:54:20.060 INFO:tasks.s3tests:Removing s3-tests... 2023-10-05T12:54:20.060 DEBUG:teuthology.orchestra.run.smithi012:> rm -rf /home/ubuntu/cephtest/s3-tests-client.0 2023-10-05T12:54:20.227 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/github.com_pritha-srivastava_ceph_38321be854743c0d616618a9ea8aa0b1d4dbc0bf/qa/tasks/s3tests.py", line 189, in create_users yield File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/contextutil.py", line 30, in nested vars.append(enter()) File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_pritha-srivastava_ceph_38321be854743c0d616618a9ea8aa0b1d4dbc0bf/qa/tasks/s3tests.py", line 398, in run_tests toxvenv_sh(ctx, remote, args, label="s3 tests against rgw") File "/home/teuthworker/src/github.com_pritha-srivastava_ceph_38321be854743c0d616618a9ea8aa0b1d4dbc0bf/qa/tasks/s3tests.py", line 353, in toxvenv_sh return remote.sh(['source', activate, run.Raw('&&')] + args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 96, in sh proc = self.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (s3 tests against rgw) on smithi012 with status 1: "source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/s3-tests-client.0 && S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto-client.0.cfg REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt tox -- -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3'" During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_pritha-srivastava_ceph_38321be854743c0d616618a9ea8aa0b1d4dbc0bf/qa/tasks/s3tests.py", line 639, in task with contextutil.nested( File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_pritha-srivastava_ceph_38321be854743c0d616618a9ea8aa0b1d4dbc0bf/qa/tasks/s3tests.py", line 59, in download yield File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_pritha-srivastava_ceph_38321be854743c0d616618a9ea8aa0b1d4dbc0bf/qa/tasks/s3tests.py", line 196, in create_users ctx.cluster.only(client).run( File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/cluster.py", line 85, in run procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/cluster.py", line 85, in procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi012 with status 1: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid foo.client.0 --purge-data --cluster ceph' 2023-10-05T12:54:20.298 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=60fd334fcc8a45dc8176e47ac9b114a4 Traceback (most recent call last): File "/home/teuthworker/src/github.com_pritha-srivastava_ceph_38321be854743c0d616618a9ea8aa0b1d4dbc0bf/qa/tasks/s3tests.py", line 189, in create_users yield File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/contextutil.py", line 30, in nested vars.append(enter()) File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_pritha-srivastava_ceph_38321be854743c0d616618a9ea8aa0b1d4dbc0bf/qa/tasks/s3tests.py", line 398, in run_tests toxvenv_sh(ctx, remote, args, label="s3 tests against rgw") File "/home/teuthworker/src/github.com_pritha-srivastava_ceph_38321be854743c0d616618a9ea8aa0b1d4dbc0bf/qa/tasks/s3tests.py", line 353, in toxvenv_sh return remote.sh(['source', activate, run.Raw('&&')] + args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 96, in sh proc = self.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (s3 tests against rgw) on smithi012 with status 1: "source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/s3-tests-client.0 && S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto-client.0.cfg REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt tox -- -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3'" During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_pritha-srivastava_ceph_38321be854743c0d616618a9ea8aa0b1d4dbc0bf/qa/tasks/s3tests.py", line 639, in task with contextutil.nested( File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_pritha-srivastava_ceph_38321be854743c0d616618a9ea8aa0b1d4dbc0bf/qa/tasks/s3tests.py", line 59, in download yield File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_pritha-srivastava_ceph_38321be854743c0d616618a9ea8aa0b1d4dbc0bf/qa/tasks/s3tests.py", line 196, in create_users ctx.cluster.only(client).run( File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/cluster.py", line 85, in run procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/cluster.py", line 85, in procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi012 with status 1: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid foo.client.0 --purge-data --cluster ceph' 2023-10-05T12:54:20.302 DEBUG:teuthology.run_tasks:Unwinding manager s3tests 2023-10-05T12:54:20.311 DEBUG:teuthology.run_tasks:Unwinding manager s3tests-java 2023-10-05T12:54:20.319 DEBUG:tasks.s3tests_java:S3 Tests Java: END 2023-10-05T12:54:20.320 INFO:tasks.s3tests_java:S3 Tests Java: Cleaning up s3-tests-java... 2023-10-05T12:54:20.320 DEBUG:teuthology.orchestra.run.smithi012:> rm -rf /home/ubuntu/cephtest/s3-tests-java 2023-10-05T12:54:20.395 INFO:tasks.s3tests_java:S3 Tests Java: Deleting S3 users... 2023-10-05T12:54:20.395 DEBUG:teuthology.orchestra.run.smithi012:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid tester.client.0 --purge-data --cluster ceph 2023-10-05T12:54:20.450 INFO:teuthology.orchestra.run.smithi012.stderr:ignoring --setuser ceph since I am not root 2023-10-05T12:54:20.450 INFO:teuthology.orchestra.run.smithi012.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T12:59:20.452 INFO:teuthology.orchestra.run.smithi012.stderr:failed to fetch mon config (--no-mon-config to skip) 2023-10-05T12:59:20.454 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-05T12:59:20.456 ERROR:teuthology.run_tasks:Manager failed: s3tests-java Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/task/__init__.py", line 132, in __exit__ self.end() File "/home/teuthworker/src/github.com_pritha-srivastava_ceph_38321be854743c0d616618a9ea8aa0b1d4dbc0bf/qa/tasks/s3tests_java.py", line 101, in end self.delete_users(client) File "/home/teuthworker/src/github.com_pritha-srivastava_ceph_38321be854743c0d616618a9ea8aa0b1d4dbc0bf/qa/tasks/s3tests_java.py", line 386, in delete_users self.ctx.cluster.only(client).run( File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/cluster.py", line 85, in run procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/cluster.py", line 85, in procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi012 with status 1: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid tester.client.0 --purge-data --cluster ceph' 2023-10-05T12:59:20.466 DEBUG:teuthology.run_tasks:Unwinding manager ragweed 2023-10-05T12:59:20.478 DEBUG:teuthology.run_tasks:Unwinding manager tox 2023-10-05T12:59:20.489 DEBUG:teuthology.orchestra.run.smithi012:> rm -rf /home/ubuntu/cephtest/tox-venv 2023-10-05T12:59:20.566 DEBUG:teuthology.run_tasks:Unwinding manager rgw 2023-10-05T12:59:20.577 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_pritha-srivastava_ceph_38321be854743c0d616618a9ea8aa0b1d4dbc0bf/qa/tasks/rgw.py", line 473, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/task/__init__.py", line 132, in __exit__ self.end() File "/home/teuthworker/src/github.com_pritha-srivastava_ceph_38321be854743c0d616618a9ea8aa0b1d4dbc0bf/qa/tasks/s3tests_java.py", line 101, in end self.delete_users(client) File "/home/teuthworker/src/github.com_pritha-srivastava_ceph_38321be854743c0d616618a9ea8aa0b1d4dbc0bf/qa/tasks/s3tests_java.py", line 386, in delete_users self.ctx.cluster.only(client).run( File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/cluster.py", line 85, in run procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/cluster.py", line 85, in procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi012 with status 1: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid tester.client.0 --purge-data --cluster ceph' 2023-10-05T12:59:20.580 DEBUG:tasks.rgw.client.0:waiting for process to exit 2023-10-05T12:59:20.580 INFO:teuthology.orchestra.run:waiting for 300 2023-10-05T12:59:20.581 INFO:tasks.rgw.client.0:Stopped 2023-10-05T12:59:20.581 DEBUG:teuthology.orchestra.run.smithi012:> rm -f /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock 2023-10-05T12:59:20.612 DEBUG:teuthology.orchestra.run.smithi012:> sudo rm -f /etc/ceph/vault-root-token 2023-10-05T12:59:20.703 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process', '--include-all'] 2023-10-05T12:59:20.703 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process', '--include-all'] 2023-10-05T12:59:20.703 DEBUG:teuthology.orchestra.run.smithi012:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process --include-all 2023-10-05T12:59:20.761 INFO:teuthology.orchestra.run.smithi012.stderr:ignoring --setuser ceph since I am not root 2023-10-05T12:59:20.762 INFO:teuthology.orchestra.run.smithi012.stderr:ignoring --setgroup ceph since I am not root 2023-10-05T13:04:20.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-05T13:04:20.762+0000 7ff844e10880 0 monclient(hunting): authenticate timed out after 300 2023-10-05T13:04:20.764 INFO:teuthology.orchestra.run.smithi012.stderr:failed to fetch mon config (--no-mon-config to skip) 2023-10-05T13:04:20.765 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-05T13:04:20.766 ERROR:teuthology.run_tasks:Manager failed: rgw Traceback (most recent call last): File "/home/teuthworker/src/github.com_pritha-srivastava_ceph_38321be854743c0d616618a9ea8aa0b1d4dbc0bf/qa/tasks/rgw.py", line 226, in start_rgw yield File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_pritha-srivastava_ceph_38321be854743c0d616618a9ea8aa0b1d4dbc0bf/qa/tasks/rgw.py", line 473, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/task/__init__.py", line 132, in __exit__ self.end() File "/home/teuthworker/src/github.com_pritha-srivastava_ceph_38321be854743c0d616618a9ea8aa0b1d4dbc0bf/qa/tasks/s3tests_java.py", line 101, in end self.delete_users(client) File "/home/teuthworker/src/github.com_pritha-srivastava_ceph_38321be854743c0d616618a9ea8aa0b1d4dbc0bf/qa/tasks/s3tests_java.py", line 386, in delete_users self.ctx.cluster.only(client).run( File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/cluster.py", line 85, in run procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/cluster.py", line 85, in procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi012 with status 1: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid tester.client.0 --purge-data --cluster ceph' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_pritha-srivastava_ceph_38321be854743c0d616618a9ea8aa0b1d4dbc0bf/qa/tasks/rgw.py", line 473, in task yield File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_pritha-srivastava_ceph_38321be854743c0d616618a9ea8aa0b1d4dbc0bf/qa/tasks/rgw.py", line 300, in create_pools yield File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_pritha-srivastava_ceph_38321be854743c0d616618a9ea8aa0b1d4dbc0bf/qa/tasks/rgw.py", line 242, in start_rgw rgwadmin(ctx, client, cmd=['gc', 'process', '--include-all'], check_status=True) File "/home/teuthworker/src/github.com_pritha-srivastava_ceph_38321be854743c0d616618a9ea8aa0b1d4dbc0bf/qa/tasks/util/rgw.py", line 34, in rgwadmin proc = remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi012 with status 1: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process --include-all' 2023-10-05T13:04:20.779 DEBUG:teuthology.run_tasks:Unwinding manager openssl_keys 2023-10-05T13:04:20.789 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-10-05T13:04:20.813 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-05T13:04:20.813 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-05T13:06:20.885 DEBUG:teuthology.orchestra.run:got remote process result: 124 2023-10-05T13:06:20.886 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/github.com_pritha-srivastava_ceph_38321be854743c0d616618a9ea8aa0b1d4dbc0bf/qa/tasks/ceph.py", line 1940, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/task/__init__.py", line 132, in __exit__ self.end() File "/home/teuthworker/src/github.com_pritha-srivastava_ceph_38321be854743c0d616618a9ea8aa0b1d4dbc0bf/qa/tasks/s3tests_java.py", line 101, in end self.delete_users(client) File "/home/teuthworker/src/github.com_pritha-srivastava_ceph_38321be854743c0d616618a9ea8aa0b1d4dbc0bf/qa/tasks/s3tests_java.py", line 386, in delete_users self.ctx.cluster.only(client).run( File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/cluster.py", line 85, in run procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/cluster.py", line 85, in procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi012 with status 1: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid tester.client.0 --purge-data --cluster ceph' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_pritha-srivastava_ceph_38321be854743c0d616618a9ea8aa0b1d4dbc0bf/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_pritha-srivastava_ceph_38321be854743c0d616618a9ea8aa0b1d4dbc0bf/qa/tasks/ceph_manager.py", line 2742, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_pritha-srivastava_ceph_38321be854743c0d616618a9ea8aa0b1d4dbc0bf/qa/tasks/ceph_manager.py", line 2574, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_pritha-srivastava_ceph_38321be854743c0d616618a9ea8aa0b1d4dbc0bf/qa/tasks/ceph_manager.py", line 2340, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_pritha-srivastava_ceph_38321be854743c0d616618a9ea8aa0b1d4dbc0bf/qa/tasks/ceph_manager.py", line 1595, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_pritha-srivastava_ceph_38321be854743c0d616618a9ea8aa0b1d4dbc0bf/qa/tasks/ceph_manager.py", line 1586, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi012 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' 2023-10-05T13:06:20.901 INFO:teuthology.misc:Shutting down mds daemons... 2023-10-05T13:06:20.901 INFO:teuthology.misc:Shutting down osd daemons... 2023-10-05T13:06:20.902 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-10-05T13:06:20.902 INFO:teuthology.orchestra.run:waiting for 300 2023-10-05T13:06:20.905 INFO:tasks.ceph.osd.0:Stopped 2023-10-05T13:06:20.905 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-10-05T13:06:20.905 INFO:teuthology.orchestra.run:waiting for 300 2023-10-05T13:06:20.906 INFO:tasks.ceph.osd.1:Stopped 2023-10-05T13:06:20.906 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-10-05T13:06:20.906 INFO:teuthology.orchestra.run:waiting for 300 2023-10-05T13:06:20.906 INFO:tasks.ceph.osd.2:Stopped 2023-10-05T13:06:20.906 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-10-05T13:06:20.906 INFO:teuthology.orchestra.run:waiting for 300 2023-10-05T13:06:20.907 INFO:tasks.ceph.osd.3:Stopped 2023-10-05T13:06:20.907 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-10-05T13:06:20.907 INFO:teuthology.orchestra.run:waiting for 300 2023-10-05T13:06:20.907 INFO:tasks.ceph.osd.4:Stopped 2023-10-05T13:06:20.907 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-10-05T13:06:20.907 INFO:teuthology.orchestra.run:waiting for 300 2023-10-05T13:06:20.908 INFO:tasks.ceph.osd.5:Stopped 2023-10-05T13:06:20.908 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-10-05T13:06:20.908 INFO:teuthology.orchestra.run:waiting for 300 2023-10-05T13:06:20.908 INFO:tasks.ceph.osd.6:Stopped 2023-10-05T13:06:20.908 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-10-05T13:06:20.908 INFO:teuthology.orchestra.run:waiting for 300 2023-10-05T13:06:20.909 INFO:tasks.ceph.osd.7:Stopped 2023-10-05T13:06:20.909 INFO:teuthology.misc:Shutting down mgr daemons... 2023-10-05T13:06:20.909 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-10-05T13:06:20.909 INFO:teuthology.orchestra.run:waiting for 300 2023-10-05T13:06:20.909 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-05T13:06:20.909 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/github.com_pritha-srivastava_ceph_38321be854743c0d616618a9ea8aa0b1d4dbc0bf/qa/tasks/ceph.py", line 1940, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/task/__init__.py", line 132, in __exit__ self.end() File "/home/teuthworker/src/github.com_pritha-srivastava_ceph_38321be854743c0d616618a9ea8aa0b1d4dbc0bf/qa/tasks/s3tests_java.py", line 101, in end self.delete_users(client) File "/home/teuthworker/src/github.com_pritha-srivastava_ceph_38321be854743c0d616618a9ea8aa0b1d4dbc0bf/qa/tasks/s3tests_java.py", line 386, in delete_users self.ctx.cluster.only(client).run( File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/cluster.py", line 85, in run procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/cluster.py", line 85, in procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi012 with status 1: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid tester.client.0 --purge-data --cluster ceph' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_pritha-srivastava_ceph_38321be854743c0d616618a9ea8aa0b1d4dbc0bf/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_pritha-srivastava_ceph_38321be854743c0d616618a9ea8aa0b1d4dbc0bf/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_pritha-srivastava_ceph_38321be854743c0d616618a9ea8aa0b1d4dbc0bf/qa/tasks/ceph_manager.py", line 2742, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_pritha-srivastava_ceph_38321be854743c0d616618a9ea8aa0b1d4dbc0bf/qa/tasks/ceph_manager.py", line 2574, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_pritha-srivastava_ceph_38321be854743c0d616618a9ea8aa0b1d4dbc0bf/qa/tasks/ceph_manager.py", line 2340, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_pritha-srivastava_ceph_38321be854743c0d616618a9ea8aa0b1d4dbc0bf/qa/tasks/ceph_manager.py", line 1595, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_pritha-srivastava_ceph_38321be854743c0d616618a9ea8aa0b1d4dbc0bf/qa/tasks/ceph_manager.py", line 1586, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi012 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi012 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y' 2023-10-05T13:06:20.923 INFO:tasks.ceph.mgr.y:Stopped 2023-10-05T13:06:20.923 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-10-05T13:06:20.923 INFO:teuthology.orchestra.run:waiting for 300 2023-10-05T13:06:20.923 INFO:tasks.ceph.mgr.x:Stopped 2023-10-05T13:06:20.923 INFO:teuthology.misc:Shutting down mon daemons... 2023-10-05T13:06:20.923 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-10-05T13:06:20.924 INFO:teuthology.orchestra.run:waiting for 300 2023-10-05T13:06:20.924 INFO:tasks.ceph.mon.a:Stopped 2023-10-05T13:06:20.924 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-10-05T13:06:20.924 INFO:teuthology.orchestra.run:waiting for 300 2023-10-05T13:06:20.924 INFO:tasks.ceph.mon.c:Stopped 2023-10-05T13:06:20.924 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-10-05T13:06:20.924 INFO:teuthology.orchestra.run:waiting for 300 2023-10-05T13:06:20.925 INFO:tasks.ceph.mon.b:Stopped 2023-10-05T13:06:20.925 INFO:tasks.ceph:Checking cluster log for badness... 2023-10-05T13:06:20.925 DEBUG:teuthology.orchestra.run.smithi012:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'not have an application enabled' | egrep -v '\(OSD_SLOW_PING_TIME' | head -n 1 2023-10-05T13:06:20.981 INFO:teuthology.orchestra.run.smithi012.stdout:2023-10-05T12:06:44.952515+0000 mon.a (mon.0) 679 : cluster [WRN] Health check failed: 1 daemons have recently crashed (RECENT_CRASH) 2023-10-05T13:06:20.982 WARNING:tasks.ceph:Found errors (ERR|WRN|SEC) in cluster log 2023-10-05T13:06:20.982 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi012.front.sepia.ceph.com 2023-10-05T13:06:20.982 DEBUG:teuthology.orchestra.run.smithi012:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-10-05T13:06:21.103 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi012.front.sepia.ceph.com 2023-10-05T13:06:21.104 DEBUG:teuthology.orchestra.run.smithi012:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-10-05T13:06:21.188 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi012.front.sepia.ceph.com 2023-10-05T13:06:21.189 DEBUG:teuthology.orchestra.run.smithi012:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-10-05T13:06:21.276 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi012.front.sepia.ceph.com 2023-10-05T13:06:21.276 DEBUG:teuthology.orchestra.run.smithi012:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-10-05T13:06:21.363 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi170.front.sepia.ceph.com 2023-10-05T13:06:21.363 DEBUG:teuthology.orchestra.run.smithi170:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-10-05T13:06:21.482 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi170.front.sepia.ceph.com 2023-10-05T13:06:21.482 DEBUG:teuthology.orchestra.run.smithi170:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-10-05T13:06:21.539 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi170.front.sepia.ceph.com 2023-10-05T13:06:21.540 DEBUG:teuthology.orchestra.run.smithi170:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-10-05T13:06:21.595 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi170.front.sepia.ceph.com 2023-10-05T13:06:21.596 DEBUG:teuthology.orchestra.run.smithi170:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-10-05T13:06:21.645 INFO:tasks.ceph:Archiving mon data... 2023-10-05T13:06:21.646 DEBUG:teuthology.misc:Transferring archived files from smithi012:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/prsrivas-2023-10-05_05:12:08-rgw-wip-rgw-d3n-filter-distro-default-smithi/7411331/data/mon.a.tgz 2023-10-05T13:06:21.646 DEBUG:teuthology.orchestra.run.smithi012:> mktemp 2023-10-05T13:06:21.676 INFO:teuthology.orchestra.run.smithi012.stdout:/tmp/tmp.fBw17m1jLs 2023-10-05T13:06:21.676 DEBUG:teuthology.orchestra.run.smithi012:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.fBw17m1jLs 2023-10-05T13:06:21.864 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod 0666 /tmp/tmp.fBw17m1jLs 2023-10-05T13:06:21.978 DEBUG:teuthology.orchestra.remote:smithi012:/tmp/tmp.fBw17m1jLs is 341KB 2023-10-05T13:06:22.056 DEBUG:teuthology.orchestra.run.smithi012:> rm -fr /tmp/tmp.fBw17m1jLs 2023-10-05T13:06:22.083 DEBUG:teuthology.misc:Transferring archived files from smithi012:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/prsrivas-2023-10-05_05:12:08-rgw-wip-rgw-d3n-filter-distro-default-smithi/7411331/data/mon.c.tgz 2023-10-05T13:06:22.083 DEBUG:teuthology.orchestra.run.smithi012:> mktemp 2023-10-05T13:06:22.150 INFO:teuthology.orchestra.run.smithi012.stdout:/tmp/tmp.KdPONUuMi8 2023-10-05T13:06:22.150 DEBUG:teuthology.orchestra.run.smithi012:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.KdPONUuMi8 2023-10-05T13:06:22.315 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod 0666 /tmp/tmp.KdPONUuMi8 2023-10-05T13:06:22.428 DEBUG:teuthology.orchestra.remote:smithi012:/tmp/tmp.KdPONUuMi8 is 347KB 2023-10-05T13:06:22.507 DEBUG:teuthology.orchestra.run.smithi012:> rm -fr /tmp/tmp.KdPONUuMi8 2023-10-05T13:06:22.535 DEBUG:teuthology.misc:Transferring archived files from smithi170:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/prsrivas-2023-10-05_05:12:08-rgw-wip-rgw-d3n-filter-distro-default-smithi/7411331/data/mon.b.tgz 2023-10-05T13:06:22.535 DEBUG:teuthology.orchestra.run.smithi170:> mktemp 2023-10-05T13:06:22.553 INFO:teuthology.orchestra.run.smithi170.stdout:/tmp/tmp.hIRkxlkYGz 2023-10-05T13:06:22.553 DEBUG:teuthology.orchestra.run.smithi170:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.hIRkxlkYGz 2023-10-05T13:06:22.738 DEBUG:teuthology.orchestra.run.smithi170:> sudo chmod 0666 /tmp/tmp.hIRkxlkYGz 2023-10-05T13:06:22.823 DEBUG:teuthology.orchestra.remote:smithi170:/tmp/tmp.hIRkxlkYGz is 347KB 2023-10-05T13:06:22.889 DEBUG:teuthology.orchestra.run.smithi170:> rm -fr /tmp/tmp.hIRkxlkYGz 2023-10-05T13:06:22.903 INFO:tasks.ceph:Cleaning ceph cluster... 2023-10-05T13:06:22.903 DEBUG:teuthology.orchestra.run.smithi012:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-05T13:06:22.906 DEBUG:teuthology.orchestra.run.smithi170:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-05T13:06:22.969 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-10-05T13:06:22.969 DEBUG:teuthology.orchestra.run.smithi012:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-05T13:06:22.972 DEBUG:teuthology.orchestra.run.smithi170:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-05T13:06:23.020 INFO:teuthology.orchestra.run.smithi012.stdout:/var/log/ceph/valgrind/ceph.client.0.log: Leak_DefinitelyLost 2023-10-05T13:06:23.020 INFO:teuthology.orchestra.run.smithi012.stdout:/var/log/ceph/valgrind/ceph.client.0.log: Leak_PossiblyLost 2023-10-05T13:06:23.021 DEBUG:tasks.ceph:file /var/log/ceph/valgrind/ceph.client.0.log kind Leak_DefinitelyLost 2023-10-05T13:06:23.021 ERROR:tasks.ceph:saw valgrind issue Leak_DefinitelyLost in /var/log/ceph/valgrind/ceph.client.0.log 2023-10-05T13:06:23.024 DEBUG:tasks.ceph:file /var/log/ceph/valgrind/ceph.client.0.log kind Leak_PossiblyLost 2023-10-05T13:06:23.025 ERROR:tasks.ceph:saw valgrind issue Leak_PossiblyLost in /var/log/ceph/valgrind/ceph.client.0.log 2023-10-05T13:06:23.038 INFO:teuthology.orchestra.run.smithi170.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-05T13:06:23.042 INFO:tasks.ceph:Archiving crash dumps... 2023-10-05T13:06:23.044 DEBUG:teuthology.misc:Transferring archived files from smithi012:/var/lib/ceph/crash to /home/teuthworker/archive/prsrivas-2023-10-05_05:12:08-rgw-wip-rgw-d3n-filter-distro-default-smithi/7411331/remote/smithi012/crash 2023-10-05T13:06:23.045 DEBUG:teuthology.orchestra.run.smithi012:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-05T13:06:23.116 DEBUG:teuthology.misc:Transferring archived files from smithi170:/var/lib/ceph/crash to /home/teuthworker/archive/prsrivas-2023-10-05_05:12:08-rgw-wip-rgw-d3n-filter-distro-default-smithi/7411331/remote/smithi170/crash 2023-10-05T13:06:23.117 DEBUG:teuthology.orchestra.run.smithi170:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-05T13:06:23.143 INFO:tasks.ceph:Compressing logs... 2023-10-05T13:06:23.143 DEBUG:teuthology.orchestra.run.smithi012:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-10-05T13:06:23.146 DEBUG:teuthology.orchestra.run.smithi170:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-10-05T13:06:23.186 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104463.log 2023-10-05T13:06:23.191 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89582.log 2023-10-05T13:06:23.191 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.104463.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94962.log 2023-10-05T13:06:23.191 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.89582.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95338.log 2023-10-05T13:06:23.191 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.89582.log.gz 2023-10-05T13:06:23.191 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.94962.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100853.log 2023-10-05T13:06:23.191 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.95338.log: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.94962.log.gz 2023-10-05T13:06:23.191 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105551.log 2023-10-05T13:06:23.192 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.100853.log: 86.6%gzip -- replaced with /var/log/ceph/ceph-client.admin.95338.log.gz 2023-10-05T13:06:23.192 INFO:teuthology.orchestra.run.smithi012.stderr: -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2023-10-05T13:06:23.192 INFO:teuthology.orchestra.run.smithi012.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.104463.log.gz 2023-10-05T13:06:23.192 INFO:teuthology.orchestra.run.smithi012.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.100853.log.gz 2023-10-05T13:06:23.192 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.105551.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95990.log 2023-10-05T13:06:23.192 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-mon.a.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.105551.log.gz 2023-10-05T13:06:23.192 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105223.log 2023-10-05T13:06:23.193 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.95990.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106139.log 2023-10-05T13:06:23.193 INFO:teuthology.orchestra.run.smithi012.stderr: 55.6% -- replaced with /var/log/ceph/ceph-client.admin.95990.log.gz 2023-10-05T13:06:23.193 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.105223.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.111317.log 2023-10-05T13:06:23.193 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.106139.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97609.log 2023-10-05T13:06:23.193 INFO:teuthology.orchestra.run.smithi012.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.105223.log.gz 2023-10-05T13:06:23.193 INFO:teuthology.orchestra.run.smithi012.stderr: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.106139.log.gz 2023-10-05T13:06:23.193 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.0.111317.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89580.log 2023-10-05T13:06:23.193 INFO:teuthology.orchestra.run.smithi012.stderr: 79.7% -- replaced with /var/log/ceph/ceph-client.0.111317.log.gz 2023-10-05T13:06:23.193 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5/var/log/ceph/ceph-client.admin.97609.log: --verbose -- /var/log/ceph/ceph-client.admin.96419.log 2023-10-05T13:06:23.194 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.89580.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102411.log 2023-10-05T13:06:23.194 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.89580.log.gz 2023-10-05T13:06:23.194 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.96419.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101263.log 2023-10-05T13:06:23.194 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.102411.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.77105.log 2023-10-05T13:06:23.194 INFO:teuthology.orchestra.run.smithi012.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.102411.log.gz 2023-10-05T13:06:23.194 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89912.log 2023-10-05T13:06:23.221 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2023-10-05T13:06:23.221 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82836.log 2023-10-05T13:06:23.221 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83076.log 2023-10-05T13:06:23.222 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-osd.6.log: /var/log/ceph/ceph-client.admin.82836.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-10-05T13:06:23.222 INFO:teuthology.orchestra.run.smithi170.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.82836.log.gz 2023-10-05T13:06:23.222 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.admin.83076.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82996.log 2023-10-05T13:06:23.222 INFO:teuthology.orchestra.run.smithi170.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.83076.log.gz 2023-10-05T13:06:23.222 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83036.log 2023-10-05T13:06:23.222 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.admin.82996.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2023-10-05T13:06:23.222 INFO:teuthology.orchestra.run.smithi170.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.82996.log.gz 2023-10-05T13:06:23.223 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.admin.83036.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82956.log 2023-10-05T13:06:23.223 INFO:teuthology.orchestra.run.smithi170.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.83036.log.gz 2023-10-05T13:06:23.223 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82876.log 2023-10-05T13:06:23.223 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.admin.82956.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.82956.log.gz 2023-10-05T13:06:23.223 INFO:teuthology.orchestra.run.smithi170.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.82916.log 2023-10-05T13:06:23.223 INFO:teuthology.orchestra.run.smithi170.stderr: 90.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-10-05T13:06:23.223 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.admin.82876.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2023-10-05T13:06:23.223 INFO:teuthology.orchestra.run.smithi170.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.82876.log.gz 2023-10-05T13:06:23.223 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.admin.82916.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2023-10-05T13:06:23.224 INFO:teuthology.orchestra.run.smithi170.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.82916.log.gz 2023-10-05T13:06:23.224 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2023-10-05T13:06:23.224 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83116.log 2023-10-05T13:06:23.224 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-10-05T13:06:23.224 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.admin.83116.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.83116.log.gz 2023-10-05T13:06:23.224 INFO:teuthology.orchestra.run.smithi170.stderr: --verbose -- /var/log/ceph/ceph-mon.b.log 2023-10-05T13:06:23.224 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph.log: /var/log/ceph/ceph-mon.b.log: 88.8% -- replaced with /var/log/ceph/ceph.log.gz 2023-10-05T13:06:23.256 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.101263.log: /var/log/ceph/ceph.tmp-client.admin.77105.log: gzip -5 --verbose -- 81.9% /var/log/ceph/ceph-client.admin.94094.log 2023-10-05T13:06:23.256 INFO:teuthology.orchestra.run.smithi012.stderr: -- replaced with /var/log/ceph/ceph-client.admin.101263.log.gz 2023-10-05T13:06:23.257 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.77105.log.gz 2023-10-05T13:06:23.257 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.89912.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103643.log 2023-10-05T13:06:23.257 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.89912.log.gz 2023-10-05T13:06:23.257 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.94094.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103151.log 2023-10-05T13:06:23.257 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.103643.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89916.log 2023-10-05T13:06:23.257 INFO:teuthology.orchestra.run.smithi012.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.94094.log.gz 2023-10-05T13:06:23.257 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.103151.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90751.log 2023-10-05T13:06:23.258 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.89916.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90155.log 2023-10-05T13:06:23.258 INFO:teuthology.orchestra.run.smithi012.stderr: 87.7% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.89916.log.gz 2023-10-05T13:06:23.258 INFO:teuthology.orchestra.run.smithi012.stderr: -- replaced with /var/log/ceph/ceph-client.admin.103151.log.gz 2023-10-05T13:06:23.258 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.90751.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101591.log 2023-10-05T13:06:23.258 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90751.log.gz 2023-10-05T13:06:23.258 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.90155.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89816.log 2023-10-05T13:06:23.258 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90155.log.gz 2023-10-05T13:06:23.259 INFO:teuthology.orchestra.run.smithi012.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.103643.log.gz 2023-10-05T13:06:23.259 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.101591.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.99648.log 2023-10-05T13:06:23.259 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.89816.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104627.log 2023-10-05T13:06:23.259 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.89816.log.gz 2023-10-05T13:06:23.259 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.0.99648.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94880.log 2023-10-05T13:06:23.259 INFO:teuthology.orchestra.run.smithi012.stderr: 93.2% -- replaced with /var/log/ceph/ceph-client.admin.97609.log.gz 2023-10-05T13:06:23.259 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95126.log 2023-10-05T13:06:23.260 INFO:teuthology.orchestra.run.smithi012.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.0.99648.log.gz 2023-10-05T13:06:23.260 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.104627.log: /var/log/ceph/ceph-client.admin.94880.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98006.log 2023-10-05T13:06:23.260 INFO:teuthology.orchestra.run.smithi012.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.104627.log.gz 2023-10-05T13:06:23.260 INFO:teuthology.orchestra.run.smithi012.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.94880.log.gz 2023-10-05T13:06:23.260 INFO:teuthology.orchestra.run.smithi012.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.101591.log.gz 2023-10-05T13:06:23.260 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96292.log 2023-10-05T13:06:23.260 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.95126.log: /var/log/ceph/ceph-client.admin.98006.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105633.log 2023-10-05T13:06:23.260 INFO:teuthology.orchestra.run.smithi012.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.95126.log.gz 2023-10-05T13:06:23.261 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.96292.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98102.log 2023-10-05T13:06:23.261 INFO:teuthology.orchestra.run.smithi012.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.96292.log.gz 2023-10-05T13:06:23.261 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.105633.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93988.log 2023-10-05T13:06:23.261 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.105633.log.gz 2023-10-05T13:06:23.261 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.98102.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102001.log 2023-10-05T13:06:23.261 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.93988.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.93988.log.gz 2023-10-05T13:06:23.261 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83378.log 2023-10-05T13:06:23.262 INFO:teuthology.orchestra.run.smithi012.stderr: 92.9% -- replaced with /var/log/ceph/ceph-client.admin.98006.log.gz 2023-10-05T13:06:23.262 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104053.log 2023-10-05T13:06:23.262 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.102001.log: /var/log/ceph/ceph-client.admin.83378.log: gzip -5 --verbose -- /var/log/ceph/valgrind/ceph.client.0.log 2023-10-05T13:06:23.262 INFO:teuthology.orchestra.run.smithi012.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.102001.log.gz 2023-10-05T13:06:23.262 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.83378.log.gz 2023-10-05T13:06:23.262 INFO:teuthology.orchestra.run.smithi012.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.98102.log.gz 2023-10-05T13:06:23.262 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.104053.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109886.log 2023-10-05T13:06:23.262 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/valgrind/ceph.client.0.log: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.104053.log.gz 2023-10-05T13:06:23.263 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101755.log 2023-10-05T13:06:23.263 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101427.log 2023-10-05T13:06:23.263 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.109886.log: /var/log/ceph/ceph-client.admin.101755.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101673.log 2023-10-05T13:06:23.263 INFO:teuthology.orchestra.run.smithi012.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.109886.log.gz 2023-10-05T13:06:23.263 INFO:teuthology.orchestra.run.smithi012.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.101755.log.gz 2023-10-05T13:06:23.263 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.101427.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103233.log 2023-10-05T13:06:23.263 INFO:teuthology.orchestra.run.smithi012.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.101427.log.gz 2023-10-05T13:06:23.263 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.101673.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98721.log 2023-10-05T13:06:23.264 INFO:teuthology.orchestra.run.smithi012.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.101673.log.gz 2023-10-05T13:06:23.264 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105469.log 2023-10-05T13:06:23.264 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.103233.log: 94.1% -- replaced with /var/log/ceph/valgrind/ceph.client.0.log.gz 2023-10-05T13:06:23.264 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.98721.log: 81.9%gzip -- replaced with /var/log/ceph/ceph-client.admin.103233.log.gz -5 2023-10-05T13:06:23.264 INFO:teuthology.orchestra.run.smithi012.stderr: --verbose -- /var/log/ceph/ceph-client.admin.100607.log 2023-10-05T13:06:23.264 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.105469.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100033.log 2023-10-05T13:06:23.264 INFO:teuthology.orchestra.run.smithi012.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.105469.log.gz 2023-10-05T13:06:23.264 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101837.log 2023-10-05T13:06:23.265 INFO:teuthology.orchestra.run.smithi012.stderr: 89.9%/var/log/ceph/ceph-client.admin.100607.log: -- replaced with /var/log/ceph/ceph-client.admin.98721.log.gz 2023-10-05T13:06:23.265 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.100033.log: 79.2% -- replaced with /var/log/ceph/ceph-client.admin.100607.log.gz 2023-10-05T13:06:23.265 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89573.log 2023-10-05T13:06:23.265 INFO:teuthology.orchestra.run.smithi012.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.100033.log.gz 2023-10-05T13:06:23.265 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97021.log 2023-10-05T13:06:23.265 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.101837.log: /var/log/ceph/ceph-client.admin.89573.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83261.log 2023-10-05T13:06:23.265 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.89573.log.gz 2023-10-05T13:06:23.266 INFO:teuthology.orchestra.run.smithi012.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.101837.log.gz 2023-10-05T13:06:23.266 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.97021.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94258.log 2023-10-05T13:06:23.266 INFO:teuthology.orchestra.run.smithi012.stderr: 21.6% -- replaced with /var/log/ceph/ceph-client.admin.97021.log.gz 2023-10-05T13:06:23.266 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.83261.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.90974.log 2023-10-05T13:06:23.266 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.83261.log.gz 2023-10-05T13:06:23.266 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.94258.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95256.log 2023-10-05T13:06:23.266 INFO:teuthology.orchestra.run.smithi012.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.94258.log.gz 2023-10-05T13:06:23.266 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.0.90974.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102329.log 2023-10-05T13:06:23.267 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.95256.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103889.log 2023-10-05T13:06:23.267 INFO:teuthology.orchestra.run.smithi012.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.95256.log.gz 2023-10-05T13:06:23.267 INFO:teuthology.orchestra.run.smithi012.stderr:gzip/var/log/ceph/ceph-client.admin.102329.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.105202.log 2023-10-05T13:06:23.267 INFO:teuthology.orchestra.run.smithi012.stderr: 95.8% -- replaced with /var/log/ceph/ceph-client.0.90974.log.gz 2023-10-05T13:06:23.267 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.103889.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.102329.log.gz 2023-10-05T13:06:23.267 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101919.log 2023-10-05T13:06:23.267 INFO:teuthology.orchestra.run.smithi012.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.103889.log.gz 2023-10-05T13:06:23.267 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103315.log 2023-10-05T13:06:23.268 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.105202.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.105202.log.gz 2023-10-05T13:06:23.268 INFO:teuthology.orchestra.run.smithi012.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.96419.log.gz 2023-10-05T13:06:23.268 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.113210.log 2023-10-05T13:06:23.268 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.101919.log: /var/log/ceph/ceph-client.admin.103315.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.101919.log.gz 2023-10-05T13:06:23.268 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.111929.log 2023-10-05T13:06:23.268 INFO:teuthology.orchestra.run.smithi012.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.103315.log.gz 2023-10-05T13:06:23.268 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.0.113210.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93506.log 2023-10-05T13:06:23.268 INFO:teuthology.orchestra.run.smithi012.stderr: 7.1% -- replaced with /var/log/ceph/ceph-client.0.113210.log.gz 2023-10-05T13:06:23.269 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.0.111929.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105119.log 2023-10-05T13:06:23.269 INFO:teuthology.orchestra.run.smithi012.stderr: 80.2% -- replaced with /var/log/ceph/ceph-client.0.111929.log.gz 2023-10-05T13:06:23.269 INFO:teuthology.orchestra.run.smithi012.stderr:gzip/var/log/ceph/ceph-client.admin.93506.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.99951.log 2023-10-05T13:06:23.269 INFO:teuthology.orchestra.run.smithi012.stderr: 84.4% -- replaced with /var/log/ceph/ceph-client.admin.93506.log.gz 2023-10-05T13:06:23.269 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.105119.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93882.log 2023-10-05T13:06:23.269 INFO:teuthology.orchestra.run.smithi012.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.105119.log.gz 2023-10-05T13:06:23.269 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.99951.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110425.log 2023-10-05T13:06:23.270 INFO:teuthology.orchestra.run.smithi012.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.99951.log.gz 2023-10-05T13:06:23.270 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.93882.log: /var/log/ceph/ceph-client.admin.90951.log 2023-10-05T13:06:23.270 INFO:teuthology.orchestra.run.smithi012.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.93882.log.gz 2023-10-05T13:06:23.270 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.110425.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90871.log 2023-10-05T13:06:23.270 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.90951.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.111827.log 2023-10-05T13:06:23.270 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90951.log.gz 2023-10-05T13:06:23.270 INFO:teuthology.orchestra.run.smithi012.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.110425.log.gz 2023-10-05T13:06:23.270 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.90871.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98888.log 2023-10-05T13:06:23.271 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90871.log.gz 2023-10-05T13:06:23.271 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.0.111827.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90214.log 2023-10-05T13:06:23.271 INFO:teuthology.orchestra.run.smithi012.stderr: 83.9% -- replaced with /var/log/ceph/ceph-client.0.111827.log.gz 2023-10-05T13:06:23.271 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.98888.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89275.log 2023-10-05T13:06:23.271 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.90214.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101017.log 2023-10-05T13:06:23.271 INFO:teuthology.orchestra.run.smithi012.stderr: 82.9% -- replaced with /var/log/ceph/ceph-client.admin.98888.log.gz 2023-10-05T13:06:23.271 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90214.log.gz 2023-10-05T13:06:23.271 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.89275.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.89275.log.gz 2023-10-05T13:06:23.272 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94856.log 2023-10-05T13:06:23.272 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.crash.smithi012.113052.log 2023-10-05T13:06:23.272 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.101017.log: 81.8%/var/log/ceph/ceph-client.admin.94856.log: -- replaced with /var/log/ceph/ceph-client.admin.101017.log.gz 2023-10-05T13:06:23.272 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105845.log 2023-10-05T13:06:23.272 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.94856.log.gz 2023-10-05T13:06:23.272 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.crash.smithi012.113052.log: /var/log/ceph/ceph-client.admin.97513.log 2023-10-05T13:06:23.272 INFO:teuthology.orchestra.run.smithi012.stderr: 52.5% -- replaced with /var/log/ceph/ceph-client.crash.smithi012.113052.log.gz 2023-10-05T13:06:23.273 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.105845.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102247.log 2023-10-05T13:06:23.273 INFO:teuthology.orchestra.run.smithi012.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.105845.log.gz 2023-10-05T13:06:23.273 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5/var/log/ceph/ceph-client.admin.97513.log: --verbose -- /var/log/ceph/ceph-client.admin.113076.log 2023-10-05T13:06:23.273 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.102247.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104381.log 2023-10-05T13:06:23.273 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.113076.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.113076.log.gz 2023-10-05T13:06:23.273 INFO:teuthology.orchestra.run.smithi012.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.102247.log.gz 2023-10-05T13:06:23.273 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97705.log 2023-10-05T13:06:23.273 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89579.log 2023-10-05T13:06:23.274 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.104381.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111083.log/var/log/ceph/ceph-client.admin.97705.log: 2023-10-05T13:06:23.274 INFO:teuthology.orchestra.run.smithi012.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.104381.log.gz 2023-10-05T13:06:23.274 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.89579.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98804.log 2023-10-05T13:06:23.274 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.89579.log.gz 2023-10-05T13:06:23.274 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.111083.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103807.log 2023-10-05T13:06:23.274 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.98804.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102083.log 2023-10-05T13:06:23.274 INFO:teuthology.orchestra.run.smithi012.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.111083.log.gz 2023-10-05T13:06:23.275 INFO:teuthology.orchestra.run.smithi012.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.98804.log.gz 2023-10-05T13:06:23.275 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.103807.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.112031.log 2023-10-05T13:06:23.275 INFO:teuthology.orchestra.run.smithi012.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.97705.log.gz 2023-10-05T13:06:23.275 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.102083.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94832.log 2023-10-05T13:06:23.275 INFO:teuthology.orchestra.run.smithi012.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.103807.log.gz 2023-10-05T13:06:23.275 INFO:teuthology.orchestra.run.smithi012.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.102083.log.gz 2023-10-05T13:06:23.275 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.0.112031.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105763.log 2023-10-05T13:06:23.275 INFO:teuthology.orchestra.run.smithi012.stderr: 80.5%gzip -- replaced with /var/log/ceph/ceph-client.0.112031.log.gz -5 2023-10-05T13:06:23.276 INFO:teuthology.orchestra.run.smithi012.stderr: --verbose -- /var/log/ceph/ceph.audit.log 2023-10-05T13:06:23.276 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.94832.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.94832.log.gz 2023-10-05T13:06:23.276 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.105763.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93612.log 2023-10-05T13:06:23.276 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102575.log 2023-10-05T13:06:23.276 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph.audit.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.105763.log.gz 2023-10-05T13:06:23.276 INFO:teuthology.orchestra.run.smithi012.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.97513.log.gz 2023-10-05T13:06:23.276 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.93612.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95044.log 2023-10-05T13:06:23.276 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.93612.log.gz 2023-10-05T13:06:23.277 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.102575.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97410.log 2023-10-05T13:06:23.277 INFO:teuthology.orchestra.run.smithi012.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.102575.log.gz 2023-10-05T13:06:23.277 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.95044.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.91262.log 2023-10-05T13:06:23.277 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102905.log 2023-10-05T13:06:23.277 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.97410.log: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.95044.log.gz 2023-10-05T13:06:23.277 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.0.91262.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97211.log 2023-10-05T13:06:23.277 INFO:teuthology.orchestra.run.smithi012.stderr: 43.0% -- replaced with /var/log/ceph/ceph-client.0.91262.log.gz 2023-10-05T13:06:23.278 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.102905.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98554.log 2023-10-05T13:06:23.278 INFO:teuthology.orchestra.run.smithi012.stderr: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.102905.log.gz 2023-10-05T13:06:23.278 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.97211.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104299.log 2023-10-05T13:06:23.278 INFO:teuthology.orchestra.run.smithi012.stderr: 94.6% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-10-05T13:06:23.278 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99408.log 2023-10-05T13:06:23.278 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.98554.log: /var/log/ceph/ceph-client.admin.104299.log: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.98554.log.gz 2023-10-05T13:06:23.278 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103069.log 2023-10-05T13:06:23.278 INFO:teuthology.orchestra.run.smithi012.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.104299.log.gz 2023-10-05T13:06:23.279 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.99408.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94750.log 2023-10-05T13:06:23.279 INFO:teuthology.orchestra.run.smithi012.stderr: 47.3% -- replaced with /var/log/ceph/ceph-client.admin.99408.log.gz 2023-10-05T13:06:23.279 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110982.log 2023-10-05T13:06:23.279 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.103069.log: /var/log/ceph/ceph-client.admin.94750.log: gzip -5 82.2% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.103069.log.gz 2023-10-05T13:06:23.279 INFO:teuthology.orchestra.run.smithi012.stderr: /var/log/ceph/ceph-client.admin.97129.log 2023-10-05T13:06:23.279 INFO:teuthology.orchestra.run.smithi012.stderr: 84.4% -- replaced with /var/log/ceph/ceph-client.admin.94750.log.gz 2023-10-05T13:06:23.279 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.110982.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92906.log 2023-10-05T13:06:23.279 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100115.log 2023-10-05T13:06:23.280 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.97129.log: /var/log/ceph/ceph-client.admin.92906.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102165.log 2023-10-05T13:06:23.280 INFO:teuthology.orchestra.run.smithi012.stderr: 84.0% -- replaced with /var/log/ceph/ceph-client.admin.97129.log.gz 2023-10-05T13:06:23.280 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.100115.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93636.log 2023-10-05T13:06:23.280 INFO:teuthology.orchestra.run.smithi012.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.92906.log.gz 2023-10-05T13:06:23.280 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.102165.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90215.log 2023-10-05T13:06:23.280 INFO:teuthology.orchestra.run.smithi012.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.100115.log.gz 2023-10-05T13:06:23.280 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.93636.log: gzip -5 81.8% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.102165.log.gz /var/log/ceph/ceph-client.admin.89401.log 2023-10-05T13:06:23.280 INFO:teuthology.orchestra.run.smithi012.stderr: 2023-10-05T13:06:23.281 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.90215.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.111623.log 2023-10-05T13:06:23.281 INFO:teuthology.orchestra.run.smithi012.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.93636.log.gz 2023-10-05T13:06:23.281 INFO:teuthology.orchestra.run.smithi012.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.110982.log.gz 2023-10-05T13:06:23.281 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90215.log.gz 2023-10-05T13:06:23.281 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.89401.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101509.log 2023-10-05T13:06:23.281 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.89401.log.gz 2023-10-05T13:06:23.281 INFO:teuthology.orchestra.run.smithi012.stderr:gzip/var/log/ceph/ceph-client.0.111623.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.100279.log 2023-10-05T13:06:23.282 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.101509.log: 83.9% -- replaced with /var/log/ceph/ceph-client.0.111623.log.gz 2023-10-05T13:06:23.282 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.99215.log 2023-10-05T13:06:23.282 INFO:teuthology.orchestra.run.smithi012.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.101509.log.gz 2023-10-05T13:06:23.282 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.100279.log: /var/log/ceph/ceph-client.admin.100771.log 2023-10-05T13:06:23.282 INFO:teuthology.orchestra.run.smithi012.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.97410.log.gz 2023-10-05T13:06:23.282 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.0.99215.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82956.log 2023-10-05T13:06:23.282 INFO:teuthology.orchestra.run.smithi012.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.100279.log.gz 2023-10-05T13:06:23.282 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90213.log 2023-10-05T13:06:23.283 INFO:teuthology.orchestra.run.smithi012.stderr: 84.0% -- replaced with /var/log/ceph/ceph-client.0.99215.log.gz 2023-10-05T13:06:23.283 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.100771.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.100771.log.gz 2023-10-05T13:06:23.283 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.82956.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89359.log 2023-10-05T13:06:23.283 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.82956.log.gz 2023-10-05T13:06:23.283 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2023-10-05T13:06:23.283 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.90213.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90213.log.gz 2023-10-05T13:06:23.283 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.89359.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90499.log 2023-10-05T13:06:23.283 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.89359.log.gz 2023-10-05T13:06:23.284 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102823.log 2023-10-05T13:06:23.284 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.90499.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96475.log 2023-10-05T13:06:23.284 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90499.log.gz 2023-10-05T13:06:23.284 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.102823.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93718.log 2023-10-05T13:06:23.284 INFO:teuthology.orchestra.run.smithi012.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.102823.log.gz 2023-10-05T13:06:23.284 INFO:teuthology.orchestra.run.smithi012.stderr:gzip/var/log/ceph/ceph-client.admin.96475.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.103479.log 2023-10-05T13:06:23.284 INFO:teuthology.orchestra.run.smithi012.stderr: 58.0% -- replaced with /var/log/ceph/ceph-client.admin.96475.log.gz 2023-10-05T13:06:23.284 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.93718.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110324.log 2023-10-05T13:06:23.284 INFO:teuthology.orchestra.run.smithi012.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.93718.log.gz 2023-10-05T13:06:23.285 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.103479.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94176.log 2023-10-05T13:06:23.285 INFO:teuthology.orchestra.run.smithi012.stderr: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.103479.log.gz 2023-10-05T13:06:23.285 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.110324.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90296.log 2023-10-05T13:06:23.285 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.94176.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102657.log 2023-10-05T13:06:23.285 INFO:teuthology.orchestra.run.smithi012.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.110324.log.gz 2023-10-05T13:06:23.285 INFO:teuthology.orchestra.run.smithi012.stderr: 84.4% -- replaced with /var/log/ceph/ceph-client.admin.94176.log.gz 2023-10-05T13:06:23.285 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.90296.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94586.log 2023-10-05T13:06:23.285 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90296.log.gz 2023-10-05T13:06:23.286 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.102657.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103725.log 2023-10-05T13:06:23.286 INFO:teuthology.orchestra.run.smithi012.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.102657.log.gz 2023-10-05T13:06:23.286 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.94586.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93424.log 2023-10-05T13:06:23.286 INFO:teuthology.orchestra.run.smithi012.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.94586.log.gz 2023-10-05T13:06:23.286 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.103725.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100443.log 2023-10-05T13:06:23.286 INFO:teuthology.orchestra.run.smithi012.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.103725.log.gz 2023-10-05T13:06:23.286 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.93424.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93964.log 2023-10-05T13:06:23.286 INFO:teuthology.orchestra.run.smithi012.stderr: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.93424.log.gz 2023-10-05T13:06:23.287 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.100443.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106057.log 2023-10-05T13:06:23.287 INFO:teuthology.orchestra.run.smithi012.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.100443.log.gz 2023-10-05T13:06:23.287 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.93964.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104545.log 2023-10-05T13:06:23.287 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.93964.log.gz 2023-10-05T13:06:23.287 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.106057.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109684.log 2023-10-05T13:06:23.287 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.104545.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.91164.log 2023-10-05T13:06:23.287 INFO:teuthology.orchestra.run.smithi012.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.106057.log.gz 2023-10-05T13:06:23.287 INFO:teuthology.orchestra.run.smithi012.stderr: 93.8% -- replaced with /var/log/ceph/ceph-client.admin.97211.log.gz 2023-10-05T13:06:23.287 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.109684.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.104545.log.gz 2023-10-05T13:06:23.288 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89581.log 2023-10-05T13:06:23.288 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90541.log 2023-10-05T13:06:23.288 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.0.91164.log: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.109684.log.gz 2023-10-05T13:06:23.288 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.89581.log: 80.6% -- replaced with /var/log/ceph/ceph-client.0.91164.log.gz 2023-10-05T13:06:23.288 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89815.log 2023-10-05T13:06:23.288 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.89581.log.gz 2023-10-05T13:06:23.288 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.90541.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105387.log 2023-10-05T13:06:23.289 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90541.log.gz 2023-10-05T13:06:23.289 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.89815.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2023-10-05T13:06:23.289 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.89815.log.gz 2023-10-05T13:06:23.289 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.105387.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94422.log 2023-10-05T13:06:23.289 INFO:teuthology.orchestra.run.smithi012.stderr: 80.1% -- replaced with /var/log/ceph/ceph-client.admin.105387.log.gz 2023-10-05T13:06:23.289 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89179.log 2023-10-05T13:06:23.289 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95208.log 2023-10-05T13:06:23.289 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.94422.log: /var/log/ceph/ceph-client.admin.89179.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89317.log 2023-10-05T13:06:23.290 INFO:teuthology.orchestra.run.smithi012.stderr: 84.5% -- replaced with /var/log/ceph/ceph-client.admin.94422.log.gz 2023-10-05T13:06:23.290 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.89179.log.gz 2023-10-05T13:06:23.290 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.95208.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98200.log 2023-10-05T13:06:23.290 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.95208.log.gz 2023-10-05T13:06:23.290 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.89317.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100197.log 2023-10-05T13:06:23.290 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.89317.log.gz 2023-10-05T13:06:23.290 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.98200.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104709.log 2023-10-05T13:06:23.290 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.100197.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90911.log 2023-10-05T13:06:23.291 INFO:teuthology.orchestra.run.smithi012.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.100197.log.gz 2023-10-05T13:06:23.291 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.104709.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101181.log 2023-10-05T13:06:23.291 INFO:teuthology.orchestra.run.smithi012.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.104709.log.gz 2023-10-05T13:06:23.291 INFO:teuthology.orchestra.run.smithi012.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.98200.log.gz 2023-10-05T13:06:23.291 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.90911.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90911.log.gz 2023-10-05T13:06:23.291 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102987.log 2023-10-05T13:06:23.291 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.111419.log 2023-10-05T13:06:23.291 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.101181.log: /var/log/ceph/ceph-client.admin.102987.log: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.101181.log.gz 2023-10-05T13:06:23.292 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103561.log 2023-10-05T13:06:23.292 INFO:teuthology.orchestra.run.smithi012.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.102987.log.gz 2023-10-05T13:06:23.292 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.0.111419.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98972.log 2023-10-05T13:06:23.292 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.103561.log: 83.9% -- replaced with /var/log/ceph/ceph-client.0.111419.log.gz 2023-10-05T13:06:23.292 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105657.log 2023-10-05T13:06:23.292 INFO:teuthology.orchestra.run.smithi012.stderr: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.103561.log.gz 2023-10-05T13:06:23.292 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.98972.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.111521.log 2023-10-05T13:06:23.292 INFO:teuthology.orchestra.run.smithi012.stderr: 25.1% -- replaced with /var/log/ceph/ceph-client.admin.98972.log.gz 2023-10-05T13:06:23.293 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89819.log 2023-10-05T13:06:23.293 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.105657.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.105657.log.gz 2023-10-05T13:06:23.293 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.0.111521.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102493.log 2023-10-05T13:06:23.293 INFO:teuthology.orchestra.run.smithi012.stderr: 80.1% -- replaced with /var/log/ceph/ceph-client.0.111521.log.gz 2023-10-05T13:06:23.293 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.89819.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.108697.log 2023-10-05T13:06:23.293 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.89819.log.gz 2023-10-05T13:06:23.293 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89235.log 2023-10-05T13:06:23.293 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.102493.log: /var/log/ceph/ceph-client.0.108697.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.crash.113064.log 2023-10-05T13:06:23.294 INFO:teuthology.orchestra.run.smithi012.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.0.108697.log.gz 2023-10-05T13:06:23.294 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.89235.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100525.log 2023-10-05T13:06:23.294 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.89235.log.gz 2023-10-05T13:06:23.294 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95232.log 2023-10-05T13:06:23.294 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.crash.113064.log: 51.1% -- replaced with /var/log/ceph/ceph-client.crash.113064.log.gz 2023-10-05T13:06:23.294 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.100525.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89919.log 2023-10-05T13:06:23.294 INFO:teuthology.orchestra.run.smithi012.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.100525.log.gz 2023-10-05T13:06:23.295 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.95232.log: gzip 86.2% -- replaced with /var/log/ceph/ceph-client.admin.102493.log.gz 2023-10-05T13:06:23.295 INFO:teuthology.orchestra.run.smithi012.stderr: -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.95232.log.gz 2023-10-05T13:06:23.295 INFO:teuthology.orchestra.run.smithi012.stderr: --verbose -- /var/log/ceph/ops-log-ceph-client.admin.log 2023-10-05T13:06:23.295 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.89919.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.89919.log.gz 2023-10-05T13:06:23.295 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.91388.log 2023-10-05T13:06:23.295 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.111725.log 2023-10-05T13:06:23.295 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ops-log-ceph-client.admin.log: /var/log/ceph/ceph-client.0.91388.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94668.log 2023-10-05T13:06:23.295 INFO:teuthology.orchestra.run.smithi012.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.0.91388.log.gz 2023-10-05T13:06:23.296 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.0.111725.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105927.log 2023-10-05T13:06:23.296 INFO:teuthology.orchestra.run.smithi012.stderr: 80.1% -- replaced with /var/log/ceph/ceph-client.0.111725.log.gz 2023-10-05T13:06:23.296 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.94668.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.99550.log 2023-10-05T13:06:23.296 INFO:teuthology.orchestra.run.smithi012.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.94668.log.gz 2023-10-05T13:06:23.296 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.105927.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.105927.log.gz 2023-10-05T13:06:23.296 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2023-10-05T13:06:23.296 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101099.log 2023-10-05T13:06:23.296 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.0.99550.log: /var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108940.log 2023-10-05T13:06:23.297 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.101099.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.99117.log 2023-10-05T13:06:23.297 INFO:teuthology.orchestra.run.smithi012.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.101099.log.gz 2023-10-05T13:06:23.297 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.108940.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96364.log 2023-10-05T13:06:23.297 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.0.99117.log: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.108940.log.gz 2023-10-05T13:06:23.297 INFO:teuthology.orchestra.run.smithi012.stderr: 84.0% -- replaced with /var/log/ceph/ceph-client.0.99117.log.gz 2023-10-05T13:06:23.297 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92818.log 2023-10-05T13:06:23.297 INFO:teuthology.orchestra.run.smithi012.stderr: 94.2% -- replaced with /var/log/ceph/ops-log-ceph-client.admin.log.gz 2023-10-05T13:06:23.297 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95420.log 2023-10-05T13:06:23.298 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.96364.log: /var/log/ceph/ceph-client.admin.92818.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89583.log 2023-10-05T13:06:23.298 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.96364.log.gz 2023-10-05T13:06:23.298 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.95420.log: 92.1% -- replaced with /var/log/ceph/ceph-client.0.99550.log.gz 2023-10-05T13:06:23.298 INFO:teuthology.orchestra.run.smithi012.stderr: 82.7% -- replaced with /var/log/ceph/ceph-client.admin.92818.log.gz 2023-10-05T13:06:23.298 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97814.log 2023-10-05T13:06:23.298 INFO:teuthology.orchestra.run.smithi012.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.95420.log.gz 2023-10-05T13:06:23.298 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.89583.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90298.log 2023-10-05T13:06:23.299 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.89583.log.gz 2023-10-05T13:06:23.299 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.97814.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97910.log 2023-10-05T13:06:23.299 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.90298.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90298.log.gz 2023-10-05T13:06:23.299 INFO:teuthology.orchestra.run.smithi012.stderr: --verbose -- /var/log/ceph/ceph-osd.0.log 2023-10-05T13:06:23.299 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.97910.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104873.log 2023-10-05T13:06:23.299 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109785.log 2023-10-05T13:06:23.299 INFO:teuthology.orchestra.run.smithi012.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.97814.log.gz 2023-10-05T13:06:23.299 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.104873.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96529.log 2023-10-05T13:06:23.300 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.109785.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.104873.log.gz 2023-10-05T13:06:23.300 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90791.log 2023-10-05T13:06:23.300 INFO:teuthology.orchestra.run.smithi012.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.109785.log.gz 2023-10-05T13:06:23.300 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.96529.log: gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.0.log 2023-10-05T13:06:23.300 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.90791.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90791.log.gz 2023-10-05T13:06:23.300 INFO:teuthology.orchestra.run.smithi012.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.96529.log.gz 2023-10-05T13:06:23.300 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100689.log 2023-10-05T13:06:23.300 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ops-log-ceph-client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90667.log 2023-10-05T13:06:23.300 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.100689.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.100689.log.gz 2023-10-05T13:06:23.301 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89917.log 2023-10-05T13:06:23.301 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.90667.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90667.log.gz 2023-10-05T13:06:23.301 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110223.log 2023-10-05T13:06:23.301 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.89917.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.89917.log.gz 2023-10-05T13:06:23.301 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104791.log 2023-10-05T13:06:23.301 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.110223.log: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.110223.log.gz 2023-10-05T13:06:23.301 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93342.log 2023-10-05T13:06:23.301 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.104791.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.104791.log.gz 2023-10-05T13:06:23.302 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102741.log 2023-10-05T13:06:23.302 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.93342.log: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.93342.log.gz 2023-10-05T13:06:23.302 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-10-05T13:06:23.302 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.102741.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.102741.log.gz 2023-10-05T13:06:23.302 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93588.log 2023-10-05T13:06:23.324 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph.log: 94.0% -- replaced with /var/log/ceph/ceph.log.gz 2023-10-05T13:06:23.324 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89914.log 2023-10-05T13:06:23.324 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.93588.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.93588.log.gz 2023-10-05T13:06:23.324 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2023-10-05T13:06:23.325 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.89914.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.89914.log.gz 2023-10-05T13:06:23.325 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.113138.log 2023-10-05T13:06:23.325 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-osd.2.log: 94.8% -- replaced with /var/log/ceph/ceph-client.admin.97910.log.gz 2023-10-05T13:06:23.325 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90294.log 2023-10-05T13:06:23.325 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.0.113138.log: 8.2% -- replaced with /var/log/ceph/ceph-client.0.113138.log.gz 2023-10-05T13:06:23.325 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.91670.log 2023-10-05T13:06:23.325 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.90294.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90294.log.gz 2023-10-05T13:06:23.325 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.91578.log 2023-10-05T13:06:23.326 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.0.91670.log: 43.7% -- replaced with /var/log/ceph/ceph-client.0.91670.log.gz 2023-10-05T13:06:23.326 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104217.log 2023-10-05T13:06:23.326 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.0.91578.log: 43.0% -- replaced with /var/log/ceph/ceph-client.0.91578.log.gz 2023-10-05T13:06:23.326 INFO:teuthology.orchestra.run.smithi012.stderr: 94.9%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104135.log 2023-10-05T13:06:23.326 INFO:teuthology.orchestra.run.smithi012.stderr: -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2023-10-05T13:06:23.326 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.104217.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.113301.log 2023-10-05T13:06:23.326 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.104135.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.104217.log.gz 2023-10-05T13:06:23.327 INFO:teuthology.orchestra.run.smithi012.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.104135.log.gz 2023-10-05T13:06:23.327 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95746.log 2023-10-05T13:06:23.327 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.0.113301.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100361.log 2023-10-05T13:06:23.327 INFO:teuthology.orchestra.run.smithi012.stderr: 7.1% -- replaced with /var/log/ceph/ceph-client.0.113301.log.gz 2023-10-05T13:06:23.327 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.95746.log: 57.9% -- replaced with /var/log/ceph/ceph-client.admin.95746.log.gz 2023-10-05T13:06:23.327 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/rgw.ceph.client.0.log 2023-10-05T13:06:23.327 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.100361.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103971.log 2023-10-05T13:06:23.328 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/rgw.ceph.client.0.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.100361.log.gz 2023-10-05T13:06:23.328 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100935.log 2023-10-05T13:06:23.328 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.103971.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.103971.log.gz 2023-10-05T13:06:23.328 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90625.log 2023-10-05T13:06:23.328 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.100935.log: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.100935.log.gz 2023-10-05T13:06:23.328 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101345.log 2023-10-05T13:06:23.328 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.90625.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90625.log.gz 2023-10-05T13:06:23.328 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105951.log 2023-10-05T13:06:23.329 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.101345.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.101345.log.gz 2023-10-05T13:06:23.329 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.91072.log 2023-10-05T13:06:23.329 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.105951.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.105951.log.gz 2023-10-05T13:06:23.329 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109583.log 2023-10-05T13:06:23.329 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.0.91072.log: 43.3% -- replaced with /var/log/ceph/ceph-client.0.91072.log.gz 2023-10-05T13:06:23.329 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.91486.log 2023-10-05T13:06:23.329 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.109583.log: 93.2% -- replaced with /var/log/ceph/ceph-client.admin.109583.log.gz 2023-10-05T13:06:23.329 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113370.log 2023-10-05T13:06:23.330 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.0.91486.log: 43.3% -- replaced with /var/log/ceph/ceph-client.0.91486.log.gz 2023-10-05T13:06:23.330 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90367.log 2023-10-05T13:06:23.330 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.113370.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.113370.log.gz 2023-10-05T13:06:23.330 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98636.log 2023-10-05T13:06:23.330 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.90367.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90367.log.gz 2023-10-05T13:06:23.330 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93260.log 2023-10-05T13:06:23.330 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.98636.log: 83.9% -- replaced with /var/log/ceph/ceph-client.admin.98636.log.gz 2023-10-05T13:06:23.330 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103397.log 2023-10-05T13:06:23.331 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.93260.log: 82.6% -- replaced with /var/log/ceph/ceph-client.admin.93260.log.gz 2023-10-05T13:06:23.331 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110122.log 2023-10-05T13:06:23.331 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.103397.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.103397.log.gz 2023-10-05T13:06:23.331 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108839.log 2023-10-05T13:06:23.331 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.110122.log: 91.6% -- replaced with /var/log/ceph/ceph-client.admin.110122.log.gz 2023-10-05T13:06:23.331 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94340.log 2023-10-05T13:06:23.331 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.108839.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.108839.log.gz 2023-10-05T13:06:23.331 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97314.log 2023-10-05T13:06:23.332 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.94340.log: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.94340.log.gz 2023-10-05T13:06:23.332 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105975.log 2023-10-05T13:06:23.332 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.97314.log: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.97314.log.gz 2023-10-05T13:06:23.332 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.111215.log 2023-10-05T13:06:23.332 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.105975.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.105975.log.gz 2023-10-05T13:06:23.332 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96092.log 2023-10-05T13:06:23.332 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.0.111215.log: 83.6% -- replaced with /var/log/ceph/ceph-client.0.111215.log.gz 2023-10-05T13:06:23.332 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94012.log 2023-10-05T13:06:23.332 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.96092.log: 66.3% -- replaced with /var/log/ceph/ceph-client.admin.96092.log.gz 2023-10-05T13:06:23.333 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90709.log 2023-10-05T13:06:23.333 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.94012.log: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.94012.log.gz 2023-10-05T13:06:23.333 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.91762.log 2023-10-05T13:06:23.333 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.90709.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90709.log.gz 2023-10-05T13:06:23.333 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104955.log 2023-10-05T13:06:23.333 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.0.91762.log: 43.3% -- replaced with /var/log/ceph/ceph-client.0.91762.log.gz 2023-10-05T13:06:23.333 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105305.log 2023-10-05T13:06:23.333 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.104955.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.104955.log.gz 2023-10-05T13:06:23.334 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105681.log 2023-10-05T13:06:23.334 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.105305.log: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.105305.log.gz 2023-10-05T13:06:23.334 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94504.log 2023-10-05T13:06:23.334 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.105681.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.105681.log.gz 2023-10-05T13:06:23.334 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90831.log 2023-10-05T13:06:23.334 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.94504.log: 84.5% -- replaced with /var/log/ceph/ceph-client.admin.94504.log.gz 2023-10-05T13:06:23.334 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89578.log 2023-10-05T13:06:23.334 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.90831.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90831.log.gz 2023-10-05T13:06:23.335 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2023-10-05T13:06:23.335 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.89578.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.89578.log.gz 2023-10-05T13:06:23.335 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105037.log 2023-10-05T13:06:23.335 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93800.log 2023-10-05T13:06:23.335 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.105037.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.105037.log.gz 2023-10-05T13:06:23.338 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89576.log 2023-10-05T13:06:23.338 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.93800.log: 94.7% -- replaced with /var/log/ceph/ops-log-ceph-client.0.log.gz 2023-10-05T13:06:23.338 INFO:teuthology.orchestra.run.smithi012.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.93800.log.gz 2023-10-05T13:06:23.338 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90583.log 2023-10-05T13:06:23.338 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.89576.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.89576.log.gz 2023-10-05T13:06:23.338 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.112133.log 2023-10-05T13:06:23.339 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.90583.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90583.log.gz 2023-10-05T13:06:23.339 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.0.112133.log: 79.9% -- replaced with /var/log/ceph/ceph-client.0.112133.log.gz 2023-10-05T13:06:23.623 INFO:teuthology.orchestra.run.smithi170.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-10-05T13:06:24.143 INFO:teuthology.orchestra.run.smithi012.stderr: 92.6% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2023-10-05T13:06:24.192 INFO:teuthology.orchestra.run.smithi170.stderr: 92.4% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2023-10-05T13:06:24.998 INFO:teuthology.orchestra.run.smithi012.stderr: 91.7% -- replaced with /var/log/ceph/rgw.ceph.client.0.log.gz 2023-10-05T13:06:25.441 INFO:teuthology.orchestra.run.smithi012.stderr: 91.4% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-10-05T13:06:29.329 INFO:teuthology.orchestra.run.smithi170.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2023-10-05T13:06:30.049 INFO:teuthology.orchestra.run.smithi012.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-10-05T13:06:30.349 INFO:teuthology.orchestra.run.smithi170.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2023-10-05T13:06:32.268 INFO:teuthology.orchestra.run.smithi170.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2023-10-05T13:06:32.805 INFO:teuthology.orchestra.run.smithi170.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2023-10-05T13:06:32.807 INFO:teuthology.orchestra.run.smithi170.stderr: 2023-10-05T13:06:32.807 INFO:teuthology.orchestra.run.smithi170.stderr:real 0m9.608s 2023-10-05T13:06:32.807 INFO:teuthology.orchestra.run.smithi170.stderr:user 0m32.117s 2023-10-05T13:06:32.808 INFO:teuthology.orchestra.run.smithi170.stderr:sys 0m1.147s 2023-10-05T13:06:34.505 INFO:teuthology.orchestra.run.smithi012.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2023-10-05T13:06:37.251 INFO:teuthology.orchestra.run.smithi012.stderr: 94.3% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2023-10-05T13:06:38.613 INFO:teuthology.orchestra.run.smithi012.stderr: 94.9% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-10-05T13:06:38.616 INFO:teuthology.orchestra.run.smithi012.stderr: 2023-10-05T13:06:38.616 INFO:teuthology.orchestra.run.smithi012.stderr:real 0m15.445s 2023-10-05T13:06:38.616 INFO:teuthology.orchestra.run.smithi012.stderr:user 0m50.845s 2023-10-05T13:06:38.616 INFO:teuthology.orchestra.run.smithi012.stderr:sys 0m1.780s 2023-10-05T13:06:38.617 INFO:tasks.ceph:Archiving logs... 2023-10-05T13:06:38.617 DEBUG:teuthology.misc:Transferring archived files from smithi012:/var/log/ceph to /home/teuthworker/archive/prsrivas-2023-10-05_05:12:08-rgw-wip-rgw-d3n-filter-distro-default-smithi/7411331/remote/smithi012/log 2023-10-05T13:06:38.618 DEBUG:teuthology.orchestra.run.smithi012:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-05T13:06:44.986 DEBUG:teuthology.misc:Transferring archived files from smithi170:/var/log/ceph to /home/teuthworker/archive/prsrivas-2023-10-05_05:12:08-rgw-wip-rgw-d3n-filter-distro-default-smithi/7411331/remote/smithi170/log 2023-10-05T13:06:44.987 DEBUG:teuthology.orchestra.run.smithi170:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-05T13:06:49.595 ERROR:teuthology.run_tasks:Manager failed: ceph Traceback (most recent call last): File "/home/teuthworker/src/github.com_pritha-srivastava_ceph_38321be854743c0d616618a9ea8aa0b1d4dbc0bf/qa/tasks/ceph.py", line 1940, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/task/__init__.py", line 132, in __exit__ self.end() File "/home/teuthworker/src/github.com_pritha-srivastava_ceph_38321be854743c0d616618a9ea8aa0b1d4dbc0bf/qa/tasks/s3tests_java.py", line 101, in end self.delete_users(client) File "/home/teuthworker/src/github.com_pritha-srivastava_ceph_38321be854743c0d616618a9ea8aa0b1d4dbc0bf/qa/tasks/s3tests_java.py", line 386, in delete_users self.ctx.cluster.only(client).run( File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/cluster.py", line 85, in run procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/cluster.py", line 85, in procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi012 with status 1: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid tester.client.0 --purge-data --cluster ceph' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_pritha-srivastava_ceph_38321be854743c0d616618a9ea8aa0b1d4dbc0bf/qa/tasks/ceph.py", line 328, in valgrind_post yield File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_pritha-srivastava_ceph_38321be854743c0d616618a9ea8aa0b1d4dbc0bf/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_pritha-srivastava_ceph_38321be854743c0d616618a9ea8aa0b1d4dbc0bf/qa/tasks/ceph_manager.py", line 2742, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_pritha-srivastava_ceph_38321be854743c0d616618a9ea8aa0b1d4dbc0bf/qa/tasks/ceph_manager.py", line 2574, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_pritha-srivastava_ceph_38321be854743c0d616618a9ea8aa0b1d4dbc0bf/qa/tasks/ceph_manager.py", line 2340, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_pritha-srivastava_ceph_38321be854743c0d616618a9ea8aa0b1d4dbc0bf/qa/tasks/ceph_manager.py", line 1595, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_pritha-srivastava_ceph_38321be854743c0d616618a9ea8aa0b1d4dbc0bf/qa/tasks/ceph_manager.py", line 1586, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi012 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_pritha-srivastava_ceph_38321be854743c0d616618a9ea8aa0b1d4dbc0bf/qa/tasks/ceph.py", line 1957, in task mon0_remote.run( File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_pritha-srivastava_ceph_38321be854743c0d616618a9ea8aa0b1d4dbc0bf/qa/tasks/ceph.py", line 251, in ceph_log yield File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_pritha-srivastava_ceph_38321be854743c0d616618a9ea8aa0b1d4dbc0bf/qa/tasks/ceph.py", line 368, in valgrind_post raise valgrind_exception Exception: saw valgrind issues 2023-10-05T13:06:49.614 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-10-05T13:06:49.627 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/task/install/__init__.py", line 626, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/task/__init__.py", line 132, in __exit__ self.end() File "/home/teuthworker/src/github.com_pritha-srivastava_ceph_38321be854743c0d616618a9ea8aa0b1d4dbc0bf/qa/tasks/s3tests_java.py", line 101, in end self.delete_users(client) File "/home/teuthworker/src/github.com_pritha-srivastava_ceph_38321be854743c0d616618a9ea8aa0b1d4dbc0bf/qa/tasks/s3tests_java.py", line 386, in delete_users self.ctx.cluster.only(client).run( File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/cluster.py", line 85, in run procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/cluster.py", line 85, in procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi012 with status 1: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid tester.client.0 --purge-data --cluster ceph' 2023-10-05T13:06:49.639 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-10-05T13:06:49.639 DEBUG:teuthology.orchestra.run.smithi012:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-05T13:06:49.642 DEBUG:teuthology.orchestra.run.smithi170:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-05T13:06:49.739 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-10-05T13:06:49.750 INFO:teuthology.task.clock:Checking final clock skew... 2023-10-05T13:06:49.751 DEBUG:teuthology.orchestra.run.smithi012:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-05T13:06:49.753 DEBUG:teuthology.orchestra.run.smithi170:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-05T13:06:49.769 INFO:teuthology.orchestra.run.smithi170.stderr:bash: line 1: ntpq: command not found 2023-10-05T13:06:49.774 INFO:teuthology.orchestra.run.smithi170.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-05T13:06:49.774 INFO:teuthology.orchestra.run.smithi170.stdout:=============================================================================== 2023-10-05T13:06:49.774 INFO:teuthology.orchestra.run.smithi170.stdout:^+ hv01.front.sepia.ceph.com 2 7 377 39 -404us[ -404us] +/- 92ms 2023-10-05T13:06:49.774 INFO:teuthology.orchestra.run.smithi170.stdout:^* hv02.front.sepia.ceph.com 3 6 377 40 -621us[ -620us] +/- 64ms 2023-10-05T13:06:49.774 INFO:teuthology.orchestra.run.smithi170.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 40 +1446us[+1446us] +/- 89ms 2023-10-05T13:06:49.775 INFO:teuthology.orchestra.run.smithi170.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2023-10-05T13:06:49.781 INFO:teuthology.orchestra.run.smithi012.stderr:bash: line 1: ntpq: command not found 2023-10-05T13:06:49.786 INFO:teuthology.orchestra.run.smithi012.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-05T13:06:49.786 INFO:teuthology.orchestra.run.smithi012.stdout:=============================================================================== 2023-10-05T13:06:49.786 INFO:teuthology.orchestra.run.smithi012.stdout:^+ hv01.front.sepia.ceph.com 2 7 377 104 -411us[ -460us] +/- 91ms 2023-10-05T13:06:49.786 INFO:teuthology.orchestra.run.smithi012.stdout:^* hv02.front.sepia.ceph.com 3 7 377 40 -547us[ -594us] +/- 64ms 2023-10-05T13:06:49.786 INFO:teuthology.orchestra.run.smithi012.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 40 +1432us[+1385us] +/- 89ms 2023-10-05T13:06:49.786 INFO:teuthology.orchestra.run.smithi012.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2023-10-05T13:06:49.787 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-10-05T13:06:49.798 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-10-05T13:06:49.799 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-10-05T13:06:49.845 DEBUG:teuthology.orchestra.run.smithi012:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-05T13:06:49.968 DEBUG:teuthology.orchestra.run.smithi170:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-05T13:06:50.064 DEBUG:teuthology.orchestra.run.smithi012:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-05T13:06:50.112 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-05T13:06:50.113 DEBUG:teuthology.orchestra.run.smithi170:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-05T13:06:50.145 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-05T13:06:50.145 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-10-05T13:06:50.155 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-10-05T13:06:50.165 INFO:teuthology.task.internal:Duration was 6381.790830 seconds 2023-10-05T13:06:50.165 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-10-05T13:06:50.175 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-10-05T13:06:50.175 DEBUG:teuthology.orchestra.run.smithi012:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-05T13:06:50.178 DEBUG:teuthology.orchestra.run.smithi170:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-05T13:06:50.229 INFO:teuthology.orchestra.run.smithi170.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-05T13:06:50.239 INFO:teuthology.orchestra.run.smithi012.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-05T13:06:50.451 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-10-05T13:06:50.452 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi012.front.sepia.ceph.com 2023-10-05T13:06:50.452 DEBUG:teuthology.orchestra.run.smithi012:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-05T13:06:50.484 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi170.front.sepia.ceph.com 2023-10-05T13:06:50.484 DEBUG:teuthology.orchestra.run.smithi170:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-05T13:06:50.506 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-10-05T13:06:50.506 DEBUG:teuthology.orchestra.run.smithi012:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-05T13:06:50.526 DEBUG:teuthology.orchestra.run.smithi170:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-05T13:06:50.574 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-10-05T13:06:50.574 DEBUG:teuthology.orchestra.run.smithi012:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-05T13:06:50.610 DEBUG:teuthology.orchestra.run.smithi170:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-05T13:06:50.723 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-10-05T13:06:50.735 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-10-05T13:06:50.735 DEBUG:teuthology.orchestra.run.smithi012:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-05T13:06:50.778 DEBUG:teuthology.orchestra.run.smithi170:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-05T13:06:50.804 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-10-05T13:06:50.815 DEBUG:teuthology.orchestra.run.smithi012:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-05T13:06:50.820 DEBUG:teuthology.orchestra.run.smithi170:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-05T13:06:50.859 INFO:teuthology.orchestra.run.smithi012.stdout:kernel.core_pattern = core 2023-10-05T13:06:50.869 INFO:teuthology.orchestra.run.smithi170.stdout:kernel.core_pattern = core 2023-10-05T13:06:50.891 DEBUG:teuthology.orchestra.run.smithi012:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-05T13:06:50.946 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-05T13:06:50.947 DEBUG:teuthology.orchestra.run.smithi170:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-05T13:06:50.960 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-05T13:06:50.961 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-10-05T13:06:50.973 INFO:teuthology.task.internal:Transferring archived files... 2023-10-05T13:06:50.974 DEBUG:teuthology.misc:Transferring archived files from smithi012:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/prsrivas-2023-10-05_05:12:08-rgw-wip-rgw-d3n-filter-distro-default-smithi/7411331/remote/smithi012 2023-10-05T13:06:50.974 DEBUG:teuthology.orchestra.run.smithi012:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-05T13:06:51.041 DEBUG:teuthology.misc:Transferring archived files from smithi170:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/prsrivas-2023-10-05_05:12:08-rgw-wip-rgw-d3n-filter-distro-default-smithi/7411331/remote/smithi170 2023-10-05T13:06:51.041 DEBUG:teuthology.orchestra.run.smithi170:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-05T13:06:51.076 INFO:teuthology.task.internal:Removing archive directory... 2023-10-05T13:06:51.076 DEBUG:teuthology.orchestra.run.smithi012:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-05T13:06:51.079 DEBUG:teuthology.orchestra.run.smithi170:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-05T13:06:51.125 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-10-05T13:06:51.136 INFO:teuthology.task.internal:Not uploading archives. 2023-10-05T13:06:51.160 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-10-05T13:06:51.171 INFO:teuthology.task.internal:Tidying up after the test... 2023-10-05T13:06:51.171 DEBUG:teuthology.orchestra.run.smithi012:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-05T13:06:51.173 DEBUG:teuthology.orchestra.run.smithi170:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-05T13:06:51.187 INFO:teuthology.orchestra.run.smithi170.stdout: 265982 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 5 13:06 /home/ubuntu/cephtest 2023-10-05T13:06:51.198 INFO:teuthology.orchestra.run.smithi012.stdout: 265242 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 5 13:06 /home/ubuntu/cephtest 2023-10-05T13:06:51.199 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-10-05T13:06:51.210 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-10-05T13:06:51.222 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: CommandFailedError: Command failed on smithi012 with status 1: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid tester.client.0 --purge-data --cluster ceph' 2023-10-05T13:06:51.223 INFO:teuthology.nuke:Checking targets against current locks 2023-10-05T13:06:51.249 DEBUG:teuthology.nuke:shortname: smithi012 2023-10-05T13:06:51.249 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-05T13:06:51.277 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi012.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/prsrivas-2023-10-05_05:12:08-rgw-wip-rgw-d3n-filter-distro-default-smithi/7411331', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-05 11:12:14.457989', 'locked_by': 'scheduled_prsrivas@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOgpaICNFfRxogNOB1i4tMaInC0z15nTSYr/P8xvHQ1AjjbvbYvsm/lWaVc06ueeus3uSz5dpKMDJLOwS1avFlU='} 2023-10-05T13:06:51.278 DEBUG:teuthology.nuke:shortname: smithi170 2023-10-05T13:06:51.278 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-05T13:06:51.300 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi170.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/prsrivas-2023-10-05_05:12:08-rgw-wip-rgw-d3n-filter-distro-default-smithi/7411331', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-05 11:12:14.459554', 'locked_by': 'scheduled_prsrivas@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBB/H8rPW3MDhFqeKPJsSAROqZ831G4Rq11eVY8UEeLVxXTN+Z2dtdc/8h4OZaWZ14amxLi+t2MIT3oivt6/xT0U='} 2023-10-05T13:06:51.331 INFO:teuthology.orchestra.console.smithi012:Power off 2023-10-05T13:06:51.332 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-05T13:06:51.358 DEBUG:teuthology.orchestra.console.smithi012:power off output: Chassis Power Control: Down/Off 2023-10-05T13:06:51.358 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-05T13:06:51.372 INFO:teuthology.orchestra.console.smithi170:Power off 2023-10-05T13:06:51.373 DEBUG:teuthology.orchestra.console.smithi170:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-05T13:06:51.382 DEBUG:teuthology.orchestra.console.smithi012:check power output: Chassis Power is on 2023-10-05T13:06:51.398 DEBUG:teuthology.orchestra.console.smithi170:power off output: Chassis Power Control: Down/Off 2023-10-05T13:06:51.398 DEBUG:teuthology.orchestra.console.smithi170:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-05T13:06:51.419 DEBUG:teuthology.orchestra.console.smithi170:check power output: Chassis Power is on 2023-10-05T13:06:55.384 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-05T13:06:55.420 DEBUG:teuthology.orchestra.console.smithi170:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-05T13:06:55.496 DEBUG:teuthology.orchestra.console.smithi012:check power output: Chassis Power is on 2023-10-05T13:06:55.530 DEBUG:teuthology.orchestra.console.smithi170:check power output: Chassis Power is on 2023-10-05T13:06:59.501 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-05T13:06:59.531 DEBUG:teuthology.orchestra.console.smithi170:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-05T13:06:59.614 DEBUG:teuthology.orchestra.console.smithi012:check power output: Chassis Power is off 2023-10-05T13:06:59.641 DEBUG:teuthology.orchestra.console.smithi170:check power output: Chassis Power is off 2023-10-05T13:06:59.715 INFO:teuthology.orchestra.console.smithi012:Power off completed 2023-10-05T13:06:59.742 INFO:teuthology.orchestra.console.smithi170:Power off completed 2023-10-05T13:06:59.847 INFO:teuthology.run:Summary data: description: rgw/verify/{0-install clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec-profile s3tests-branch sharding$/{default} striping$/{stripe-equals-chunk} supported-random-distro$/{centos_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/valgrind} duration: 6381.790830373764 failure_reason: 'Command failed on smithi012 with status 1: ''adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid foo.client.0 --purge-data --cluster ceph''' flavor: default owner: scheduled_prsrivas@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=60fd334fcc8a45dc8176e47ac9b114a4 status: fail success: false 2023-10-05T13:06:59.848 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-05T13:06:59.929 INFO:teuthology.run:FAIL